2021-04-09T18:09:14.443 INFO:root:teuthology version: 1.1.0-85d61eae 2021-04-09T18:09:14.445 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --name yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi --verbose --description fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} --archive /home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031766 -- /home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031766/orig.config.yaml 2021-04-09T18:09:14.614 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-04-09T18:09:14.709 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031766 branch: wip-yuri2-testing-2021-04-09-0846-nautilus description: fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} email: ceph-qa@ceph.io first_in_suite: false job_id: '6031766' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '18.04' overrides: admin_socket: branch: wip-yuri2-testing-2021-04-09-0846-nautilus ceph: cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(TOO_FEW_PGS\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - POOL_APP_NOT_ENABLED - has not responded to cap revoke by MDS for over - MDS_CLIENT_LATE_RELEASE - responding to mclientcaps sha1: d23cd2d5f486487b0b80655c4e33344f0f97b82b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: d23cd2d5f486487b0b80655c4e33344f0f97b82b thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri2-testing-2021-04-09-0846-nautilus sha1: d23cd2d5f486487b0b80655c4e33344f0f97b82b owner: scheduled_yuriw@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 - - client.2 sha1: d23cd2d5f486487b0b80655c4e33344f0f97b82b sleep_before_teardown: 0 suite: fs suite_branch: wip-yuri2-testing-2021-04-09-0846-nautilus suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_d23cd2d5f486487b0b80655c4e33344f0f97b82b/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: d23cd2d5f486487b0b80655c4e33344f0f97b82b targets: smithi079.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzjllv33cP1qI9185eFIa31FdKxmJSmG3cFp3zbLaB6lgsf8uAW723illrmm041nDWPMI4bO1tUCFqOxXR4LthAUtFnQ1QgMH/ArrLVdV0X0ihZ7v8R7y4BjPRYXTXzrULTyz1Nr2u2ptO65QZN94CeHNvrpMAXe3BHG1UDUnVnDHx1E4qr72xh3Bwg1GYB9P3HFME+LayvgsItcBXKLpMyasIi+GMVARQiOUVgoE1kP/6KVk5zsZ/6wbQy3SaMflxh71CnTZw5ocqZ73I6vsVDbxPToxDw6ASJJ5aM+PHtjSYRtqiZvptjrF1x+N64qu6ex9eny7yfAUo+vvtLnnz smithi089.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDGjQr3lYQYtY+jlZrbHJ266Vbt6fd+CEzDxJjZwv/FiqjfHiZLrFpQxA6J+T/LLCIbi/B/wOMmu+4dTSZ1oSHC+rht1tls8oMA6izwGtre2gqUj39uimhlQM6JIBigJMrVs0ip0UCAoaztrvdGhiS85qEqjdfXhuRwDTkUDX60c2viUmeK/VO0z+2FTKSTk0UBqeEUYLBED7Xu/SxrYY9lyUu72RdjdMXWD6VFjC5EqV3nMCdaoIEHiITFgUzZiYkpcqJt1xUG4pm1OTtdl75IoMZONZ/voXVokZgiSY+E8FkQq3Njn4NQ0e89oGOrsuyBseH23mITNfXW7TZtTv9P smithi090.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg3tkog7zFoTjSel/FB46OVqg/bbj0PWv51zaS8vJ76+jAOJfiP6nMTxr5JtYt8w1HK7ZgI8nvMdjmVEFgQ1TtgKJnKLd+Kn+opNg1Pfi2ygmkVuWq3OGAjsYs8zIujqcr8KYTTJiR86/lbeSI8qrkXB29d9c7zhLOjetx7iPCxKjbd/cCS1r9z3sJuNYnTP575jHlxSJM/gjlwo+oraocc7ffbNRx30Lfb+hBOixH1L3Xb0wbCqb3I3dcU0l4+CpLHdGd74yUrPF2zIbG73nTerKAnT+QrsU6H5cRPNud2ixWOSAnHka0E64E4v8QbOklbewb1MsbrJMqQ7FedM+J smithi136.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzAlXI4g7caLPauwGMl4AF/hVZ9DOwWbJDHkqmzrVt4tdH+3ceXFEtO5CVOsf4biS3+TnHJVp5JF1TATH9fl74Z5aE8qKz3FvBlSCJYH3zoqGqQhcXNjYElEIfqnAp1E1i+fm4RMOANFElE79hf0hcSjv9XFEsyWdohlz9+fSmabS0lyA6JT/ISPdJpEpA0vkkEFqFwquQquYMZtbJx9veqFDjBLTbDLoLjaAWNUpG1XMi4MMDgTyxqFeTmQLWePbQlk4+NnPVobkPwHY7fSunf3G8g4Ogch3e2yGvMb47A/t/eF3BFI+mGASisS0A5VIZc/rTTJtWgLUnjiyVwqqd smithi144.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/5ttRO3V3UekMDLQpySukS9V05dgWR+E/tvlhWS3sVsZD24BsU0HY8YThZZ/2XvKQv0AJxWYrHuubIV8luRyj1yflkl8Jpig2QgBeY5XRmIux4EEoCB9+u9mzaSYNUN7Qz0EOXsxlhckfQFcP7FgbjVtRhaAI6oe4sC9JBS0Q230r3w5fGYSMbr5ucpNlVXDAN0xnT0in1wnYmVtXMtZycMMEdO7TrXXmA/+KaTtL70d8s2fJdgfuj+tSeMfV8UIcASO+E8MSyBBcb8EjA8ro69ZT8t4g9aoDeNbxu8Q4mtwSosBLlTd/Ow/M3gj8t6TsHK/4Qp346wrv1DNCFK+L tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_misc teuthology_branch: master teuthology_sha1: 85d61eae4759f46ce21e9a37cd816a7a1a66c9d5 timestamp: 2021-04-09_17:56:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23935 2021-04-09T18:09:14.710 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_d23cd2d5f486487b0b80655c4e33344f0f97b82b/qa; will attempt to use it 2021-04-09T18:09:14.711 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_d23cd2d5f486487b0b80655c4e33344f0f97b82b/qa/tasks 2021-04-09T18:09:14.711 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-04-09T18:09:14.714 INFO:teuthology.task.internal:Checking packages... 2021-04-09T18:09:14.776 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash 'd23cd2d5f486487b0b80655c4e33344f0f97b82b' 2021-04-09T18:09:14.777 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-04-09T18:09:14.778 INFO:teuthology.packaging:ref: None 2021-04-09T18:09:14.778 INFO:teuthology.packaging:tag: None 2021-04-09T18:09:14.779 INFO:teuthology.packaging:branch: wip-yuri2-testing-2021-04-09-0846-nautilus 2021-04-09T18:09:14.781 INFO:teuthology.packaging:sha1: d23cd2d5f486487b0b80655c4e33344f0f97b82b 2021-04-09T18:09:14.783 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=wip-yuri2-testing-2021-04-09-0846-nautilus 2021-04-09T18:09:14.940 INFO:teuthology.task.internal:Found packages for ceph version 14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:09:14.941 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-04-09T18:09:14.954 INFO:teuthology.task.internal:no buildpackages task found 2021-04-09T18:09:14.954 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-04-09T18:09:14.981 INFO:teuthology.task.internal:Saving configuration 2021-04-09T18:09:15.014 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-04-09T18:09:15.022 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-09T18:09:15.040 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-04-09 17:58:19.991652', 'description': '/home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031766', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICqttvvFZvJvcOnXdTVollL6IJgw1dEkvFG9uWIABYCk', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi079.front.sepia.ceph.com'} 2021-04-09T18:09:15.057 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-04-09 17:58:19.991620', 'description': '/home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031766', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEAuP60vXwvIN28GxPgk7OKxyqAGm3/L6BOWkuKgSO/j', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi089.front.sepia.ceph.com'} 2021-04-09T18:09:15.079 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-04-09 17:58:19.991636', 'description': '/home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031766', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFw58Lfq9JF7H8na6yXJX06C11BpC8ZxT3mpUIJ+4EDI', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi090.front.sepia.ceph.com'} 2021-04-09T18:09:15.099 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-04-09 17:58:19.991598', 'description': '/home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031766', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDETjRe/UsUjYMkZeKOhDmNC2qsZ4++EfIVtqk8VN1+x', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi136.front.sepia.ceph.com'} 2021-04-09T18:09:15.116 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-04-09 17:58:19.991668', 'description': '/home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031766', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKJlY0kdn3D/CpDEfmY0+Rx+uxnvLpktGFwTmr3pkBrG', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi144.front.sepia.ceph.com'} 2021-04-09T18:09:15.116 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-04-09T18:09:15.128 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2021-04-09T18:09:15.129 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2021-04-09T18:09:15.129 INFO:teuthology.task.internal:roles: ubuntu@smithi090.front.sepia.ceph.com - ['client.0'] 2021-04-09T18:09:15.130 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['client.1'] 2021-04-09T18:09:15.130 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['client.2'] 2021-04-09T18:09:15.131 INFO:teuthology.run_tasks:Running task console_log... 2021-04-09T18:09:15.366 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8112a88ea0>, signals=[15]) 2021-04-09T18:09:15.368 INFO:teuthology.run_tasks:Running task internal.connect... 2021-04-09T18:09:15.382 INFO:teuthology.task.internal:Opening connections... 2021-04-09T18:09:15.386 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2021-04-09T18:09:15.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:09:15.489 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2021-04-09T18:09:15.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:09:15.565 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi090.front.sepia.ceph.com 2021-04-09T18:09:15.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:09:15.641 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2021-04-09T18:09:15.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:09:15.716 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2021-04-09T18:09:15.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:09:15.793 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-04-09T18:09:15.805 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2021-04-09T18:09:15.813 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2021-04-09T18:09:15.813 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2021-04-09T18:09:15.860 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Ubuntu" 2021-04-09T18:09:15.861 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-04-09T18:09:15.861 INFO:teuthology.orchestra.run.smithi079.stdout:ID=ubuntu 2021-04-09T18:09:15.862 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE=debian 2021-04-09T18:09:15.862 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-04-09T18:09:15.863 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="18.04" 2021-04-09T18:09:15.864 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.ubuntu.com/" 2021-04-09T18:09:15.864 INFO:teuthology.orchestra.run.smithi079.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-04-09T18:09:15.865 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-04-09T18:09:15.865 INFO:teuthology.orchestra.run.smithi079.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-04-09T18:09:15.866 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_CODENAME=bionic 2021-04-09T18:09:15.866 INFO:teuthology.orchestra.run.smithi079.stdout:UBUNTU_CODENAME=bionic 2021-04-09T18:09:15.867 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2021-04-09T18:09:15.971 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2021-04-09T18:09:15.978 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2021-04-09T18:09:15.979 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2021-04-09T18:09:16.028 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Ubuntu" 2021-04-09T18:09:16.029 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-04-09T18:09:16.029 INFO:teuthology.orchestra.run.smithi089.stdout:ID=ubuntu 2021-04-09T18:09:16.029 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE=debian 2021-04-09T18:09:16.030 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-04-09T18:09:16.030 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="18.04" 2021-04-09T18:09:16.030 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.ubuntu.com/" 2021-04-09T18:09:16.030 INFO:teuthology.orchestra.run.smithi089.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-04-09T18:09:16.030 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-04-09T18:09:16.031 INFO:teuthology.orchestra.run.smithi089.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-04-09T18:09:16.031 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_CODENAME=bionic 2021-04-09T18:09:16.031 INFO:teuthology.orchestra.run.smithi089.stdout:UBUNTU_CODENAME=bionic 2021-04-09T18:09:16.031 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2021-04-09T18:09:16.081 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2021-04-09T18:09:16.088 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2021-04-09T18:09:16.089 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2021-04-09T18:09:16.140 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="Ubuntu" 2021-04-09T18:09:16.140 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-04-09T18:09:16.141 INFO:teuthology.orchestra.run.smithi090.stdout:ID=ubuntu 2021-04-09T18:09:16.141 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE=debian 2021-04-09T18:09:16.141 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-04-09T18:09:16.141 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="18.04" 2021-04-09T18:09:16.141 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://www.ubuntu.com/" 2021-04-09T18:09:16.142 INFO:teuthology.orchestra.run.smithi090.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-04-09T18:09:16.142 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-04-09T18:09:16.142 INFO:teuthology.orchestra.run.smithi090.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-04-09T18:09:16.143 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_CODENAME=bionic 2021-04-09T18:09:16.143 INFO:teuthology.orchestra.run.smithi090.stdout:UBUNTU_CODENAME=bionic 2021-04-09T18:09:16.144 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2021-04-09T18:09:16.182 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2021-04-09T18:09:16.188 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2021-04-09T18:09:16.189 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2021-04-09T18:09:16.237 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Ubuntu" 2021-04-09T18:09:16.237 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-04-09T18:09:16.238 INFO:teuthology.orchestra.run.smithi136.stdout:ID=ubuntu 2021-04-09T18:09:16.238 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE=debian 2021-04-09T18:09:16.238 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-04-09T18:09:16.238 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="18.04" 2021-04-09T18:09:16.239 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.ubuntu.com/" 2021-04-09T18:09:16.239 INFO:teuthology.orchestra.run.smithi136.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-04-09T18:09:16.239 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-04-09T18:09:16.239 INFO:teuthology.orchestra.run.smithi136.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-04-09T18:09:16.240 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_CODENAME=bionic 2021-04-09T18:09:16.240 INFO:teuthology.orchestra.run.smithi136.stdout:UBUNTU_CODENAME=bionic 2021-04-09T18:09:16.240 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2021-04-09T18:09:16.257 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2021-04-09T18:09:16.265 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2021-04-09T18:09:16.266 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2021-04-09T18:09:16.313 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Ubuntu" 2021-04-09T18:09:16.313 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-04-09T18:09:16.314 INFO:teuthology.orchestra.run.smithi144.stdout:ID=ubuntu 2021-04-09T18:09:16.314 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE=debian 2021-04-09T18:09:16.314 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-04-09T18:09:16.314 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="18.04" 2021-04-09T18:09:16.314 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.ubuntu.com/" 2021-04-09T18:09:16.315 INFO:teuthology.orchestra.run.smithi144.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-04-09T18:09:16.315 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-04-09T18:09:16.315 INFO:teuthology.orchestra.run.smithi144.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-04-09T18:09:16.315 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_CODENAME=bionic 2021-04-09T18:09:16.316 INFO:teuthology.orchestra.run.smithi144.stdout:UBUNTU_CODENAME=bionic 2021-04-09T18:09:16.316 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2021-04-09T18:09:16.342 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-04-09T18:09:16.360 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-04-09T18:09:16.383 INFO:teuthology.task.internal:Checking for old test directory... 2021-04-09T18:09:16.383 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2021-04-09T18:09:16.386 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2021-04-09T18:09:16.388 DEBUG:teuthology.orchestra.run.smithi090:> test '!' -e /home/ubuntu/cephtest 2021-04-09T18:09:16.391 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2021-04-09T18:09:16.394 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2021-04-09T18:09:16.400 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-04-09T18:09:16.413 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-04-09T18:09:16.414 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2021-04-09T18:09:16.435 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2021-04-09T18:09:16.438 DEBUG:teuthology.orchestra.run.smithi090:> test -z $(ls -A /var/lib/ceph) 2021-04-09T18:09:16.448 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2021-04-09T18:09:16.459 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2021-04-09T18:09:16.477 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-04-09T18:09:16.595 INFO:teuthology.run_tasks:Running task kernel... 2021-04-09T18:09:16.613 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'mds.a': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'mds.b': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}} 2021-04-09T18:09:16.614 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-04-09T18:09:16.614 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2021-04-09T18:09:16.626 INFO:teuthology.orchestra.run.smithi079.stdout:4.15.0-136-generic 2021-04-09T18:09:16.626 INFO:teuthology.task.kernel:Running kernel on smithi079: 4.15.0-136-generic 2021-04-09T18:09:16.627 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get clean 2021-04-09T18:09:16.760 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2021-04-09T18:09:17.002 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-04-09T18:09:17.015 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-04-09T18:09:17.083 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-04-09T18:09:17.389 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-04-09T18:09:17.404 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,639 kB] 2021-04-09T18:09:17.534 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,979 kB] 2021-04-09T18:09:17.847 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [950 kB] 2021-04-09T18:09:17.866 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [310 kB] 2021-04-09T18:09:17.872 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted i386 Packages [17.7 kB] 2021-04-09T18:09:17.872 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [265 kB] 2021-04-09T18:09:17.879 INFO:teuthology.orchestra.run.smithi079.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [34.6 kB] 2021-04-09T18:09:17.880 INFO:teuthology.orchestra.run.smithi079.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,118 kB] 2021-04-09T18:09:17.945 INFO:teuthology.orchestra.run.smithi079.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [980 kB] 2021-04-09T18:09:17.950 INFO:teuthology.orchestra.run.smithi079.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,254 kB] 2021-04-09T18:09:17.967 INFO:teuthology.orchestra.run.smithi079.stdout:Get:15 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [251 kB] 2021-04-09T18:09:17.975 INFO:teuthology.orchestra.run.smithi079.stdout:Get:16 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [6,480 B] 2021-04-09T18:09:17.976 INFO:teuthology.orchestra.run.smithi079.stdout:Get:17 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [19.1 kB] 2021-04-09T18:09:17.976 INFO:teuthology.orchestra.run.smithi079.stdout:Get:18 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [4,412 B] 2021-04-09T18:09:17.986 INFO:teuthology.orchestra.run.smithi079.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [402 kB] 2021-04-09T18:09:18.003 INFO:teuthology.orchestra.run.smithi079.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [286 kB] 2021-04-09T18:09:18.009 INFO:teuthology.orchestra.run.smithi079.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [24.3 kB] 2021-04-09T18:09:18.010 INFO:teuthology.orchestra.run.smithi079.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [38.2 kB] 2021-04-09T18:09:18.010 INFO:teuthology.orchestra.run.smithi079.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,565 kB] 2021-04-09T18:09:18.072 INFO:teuthology.orchestra.run.smithi079.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,727 kB] 2021-04-09T18:09:18.114 INFO:teuthology.orchestra.run.smithi079.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [366 kB] 2021-04-09T18:09:18.123 INFO:teuthology.orchestra.run.smithi079.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [11.6 kB] 2021-04-09T18:09:18.123 INFO:teuthology.orchestra.run.smithi079.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [24.9 kB] 2021-04-09T18:09:18.135 INFO:teuthology.orchestra.run.smithi079.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [6,464 B] 2021-04-09T18:09:19.652 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 13.5 MB in 3s (5,130 kB/s) 2021-04-09T18:09:21.076 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2021-04-09T18:09:21.124 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-04-09T18:09:21.215 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2021-04-09T18:09:21.476 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2021-04-09T18:09:21.477 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2021-04-09T18:09:21.557 INFO:teuthology.orchestra.run.smithi079.stderr:E: Unable to locate package linux-image-current-generic 2021-04-09T18:09:21.558 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-04-09T18:09:21.559 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-04-09T18:09:21.636 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2021-04-09T18:09:21.897 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2021-04-09T18:09:21.898 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2021-04-09T18:09:22.075 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2021-04-09T18:09:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: linux-generic linux-headers-4.15.0-140 linux-headers-4.15.0-140-generic 2021-04-09T18:09:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: linux-headers-generic linux-image-4.15.0-140-generic 2021-04-09T18:09:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: linux-modules-4.15.0-140-generic linux-modules-extra-4.15.0-140-generic 2021-04-09T18:09:22.078 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2021-04-09T18:09:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2021-04-09T18:09:22.079 INFO:teuthology.orchestra.run.smithi079.stdout:Recommended packages: 2021-04-09T18:09:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: thermald 2021-04-09T18:09:22.108 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2021-04-09T18:09:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: linux-headers-4.15.0-140 linux-headers-4.15.0-140-generic 2021-04-09T18:09:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-4.15.0-140-generic linux-modules-4.15.0-140-generic 2021-04-09T18:09:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: linux-modules-extra-4.15.0-140-generic 2021-04-09T18:09:22.111 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages will be upgraded: 2021-04-09T18:09:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: linux-generic linux-headers-generic linux-image-generic 2021-04-09T18:09:22.291 INFO:teuthology.orchestra.run.smithi079.stdout:3 upgraded, 5 newly installed, 0 to remove and 41 not upgraded. 2021-04-09T18:09:22.292 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 66.0 MB of archives. 2021-04-09T18:09:22.292 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 334 MB of additional disk space will be used. 2021-04-09T18:09:22.293 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-140-generic amd64 4.15.0-140.144 [13.1 MB] 2021-04-09T18:09:23.288 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-140-generic amd64 4.15.0-140.144 [8,021 kB] 2021-04-09T18:09:23.533 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-140-generic amd64 4.15.0-140.144 [32.8 MB] 2021-04-09T18:09:24.521 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.140.127 [1,868 B] 2021-04-09T18:09:24.521 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.140.127 [2,580 B] 2021-04-09T18:09:24.522 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-140 all 4.15.0-140.144 [10.9 MB] 2021-04-09T18:09:24.823 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-140-generic amd64 4.15.0-140.144 [1,101 kB] 2021-04-09T18:09:24.863 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.140.127 [2,484 B] 2021-04-09T18:09:25.352 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 66.0 MB in 3s (24.1 MB/s) 2021-04-09T18:09:25.507 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-modules-4.15.0-140-generic. 2021-04-09T18:09:25.544 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102065 files and directories currently installed.) 2021-04-09T18:09:25.546 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../0-linux-modules-4.15.0-140-generic_4.15.0-140.144_amd64.deb ... 2021-04-09T18:09:25.596 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-modules-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:09:27.221 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-image-4.15.0-140-generic. 2021-04-09T18:09:27.233 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../1-linux-image-4.15.0-140-generic_4.15.0-140.144_amd64.deb ... 2021-04-09T18:09:27.339 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-image-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:09:27.824 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-140-generic. 2021-04-09T18:09:27.836 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-140-generic_4.15.0-140.144_amd64.deb ... 2021-04-09T18:09:27.874 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-modules-extra-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:09:31.614 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../3-linux-generic_4.15.0.140.127_amd64.deb ... 2021-04-09T18:09:31.734 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-generic (4.15.0.140.127) over (4.15.0.136.123) ... 2021-04-09T18:09:32.007 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.140.127_amd64.deb ... 2021-04-09T18:09:32.121 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-image-generic (4.15.0.140.127) over (4.15.0.136.123) ... 2021-04-09T18:09:32.448 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-headers-4.15.0-140. 2021-04-09T18:09:32.461 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../5-linux-headers-4.15.0-140_4.15.0-140.144_all.deb ... 2021-04-09T18:09:32.498 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-4.15.0-140 (4.15.0-140.144) ... 2021-04-09T18:09:37.088 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-headers-4.15.0-140-generic. 2021-04-09T18:09:37.110 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../6-linux-headers-4.15.0-140-generic_4.15.0-140.144_amd64.deb ... 2021-04-09T18:09:37.154 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:09:39.515 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.140.127_amd64.deb ... 2021-04-09T18:09:39.638 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-generic (4.15.0.140.127) over (4.15.0.136.123) ... 2021-04-09T18:09:40.666 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-4.15.0-140 (4.15.0-140.144) ... 2021-04-09T18:09:40.784 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-modules-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:09:41.311 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-image-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:09:41.754 INFO:teuthology.orchestra.run.smithi079.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-140-generic 2021-04-09T18:09:41.754 INFO:teuthology.orchestra.run.smithi079.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-140-generic 2021-04-09T18:09:41.898 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-modules-extra-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:09:42.381 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-image-generic (4.15.0.140.127) ... 2021-04-09T18:09:42.507 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:09:42.635 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-generic (4.15.0.140.127) ... 2021-04-09T18:09:42.759 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-generic (4.15.0.140.127) ... 2021-04-09T18:09:42.902 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for linux-image-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:09:43.105 INFO:teuthology.orchestra.run.smithi079.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-04-09T18:09:43.106 INFO:teuthology.orchestra.run.smithi079.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-140-generic 2021-04-09T18:09:58.065 INFO:teuthology.orchestra.run.smithi079.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-04-09T18:09:58.065 INFO:teuthology.orchestra.run.smithi079.stdout:Sourcing file `/etc/default/grub' 2021-04-09T18:09:58.101 INFO:teuthology.orchestra.run.smithi079.stdout:Generating grub configuration file ... 2021-04-09T18:09:58.452 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-4.15.0-140-generic 2021-04-09T18:09:58.483 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-4.15.0-140-generic 2021-04-09T18:09:58.808 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-4.15.0-136-generic 2021-04-09T18:09:58.838 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-4.15.0-136-generic 2021-04-09T18:10:00.318 INFO:teuthology.orchestra.run.smithi079.stdout:done 2021-04-09T18:10:00.717 DEBUG:teuthology.orchestra.run.smithi079:> dpkg -s linux-image-generic 2021-04-09T18:10:00.741 INFO:teuthology.orchestra.run.smithi079.stdout:Package: linux-image-generic 2021-04-09T18:10:00.741 INFO:teuthology.orchestra.run.smithi079.stdout:Status: install ok installed 2021-04-09T18:10:00.742 INFO:teuthology.orchestra.run.smithi079.stdout:Priority: optional 2021-04-09T18:10:00.742 INFO:teuthology.orchestra.run.smithi079.stdout:Section: kernel 2021-04-09T18:10:00.742 INFO:teuthology.orchestra.run.smithi079.stdout:Installed-Size: 17 2021-04-09T18:10:00.743 INFO:teuthology.orchestra.run.smithi079.stdout:Maintainer: Ubuntu Kernel Team 2021-04-09T18:10:00.743 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: amd64 2021-04-09T18:10:00.746 INFO:teuthology.orchestra.run.smithi079.stdout:Source: linux-meta 2021-04-09T18:10:00.748 INFO:teuthology.orchestra.run.smithi079.stdout:Version: 4.15.0.140.127 2021-04-09T18:10:00.748 INFO:teuthology.orchestra.run.smithi079.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-04-09T18:10:00.749 INFO:teuthology.orchestra.run.smithi079.stdout:Depends: linux-image-4.15.0-140-generic, linux-modules-extra-4.15.0-140-generic, linux-firmware, intel-microcode, amd64-microcode 2021-04-09T18:10:00.749 INFO:teuthology.orchestra.run.smithi079.stdout:Recommends: thermald 2021-04-09T18:10:00.749 INFO:teuthology.orchestra.run.smithi079.stdout:Description: Generic Linux kernel image 2021-04-09T18:10:00.750 INFO:teuthology.orchestra.run.smithi079.stdout: This package will always depend on the latest generic kernel image 2021-04-09T18:10:00.750 INFO:teuthology.orchestra.run.smithi079.stdout: available. 2021-04-09T18:10:00.751 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-136-generic Expected: 4.15.0-140-generic 2021-04-09T18:10:00.752 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2021-04-09T18:10:00.766 INFO:teuthology.orchestra.run.smithi089.stdout:4.15.0-136-generic 2021-04-09T18:10:00.767 INFO:teuthology.task.kernel:Running kernel on smithi089: 4.15.0-136-generic 2021-04-09T18:10:00.767 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get clean 2021-04-09T18:10:00.913 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get update 2021-04-09T18:10:01.200 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-04-09T18:10:01.200 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-04-09T18:10:01.261 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-04-09T18:10:01.544 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-04-09T18:10:01.594 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,639 kB] 2021-04-09T18:10:01.721 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,254 kB] 2021-04-09T18:10:02.039 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [950 kB] 2021-04-09T18:10:02.058 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [310 kB] 2021-04-09T18:10:02.064 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [265 kB] 2021-04-09T18:10:02.068 INFO:teuthology.orchestra.run.smithi089.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted i386 Packages [17.7 kB] 2021-04-09T18:10:02.068 INFO:teuthology.orchestra.run.smithi089.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,979 kB] 2021-04-09T18:10:02.068 INFO:teuthology.orchestra.run.smithi089.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [34.6 kB] 2021-04-09T18:10:02.069 INFO:teuthology.orchestra.run.smithi089.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [980 kB] 2021-04-09T18:10:02.135 INFO:teuthology.orchestra.run.smithi089.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,118 kB] 2021-04-09T18:10:02.157 INFO:teuthology.orchestra.run.smithi089.stdout:Get:15 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [251 kB] 2021-04-09T18:10:02.160 INFO:teuthology.orchestra.run.smithi089.stdout:Get:16 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [6,480 B] 2021-04-09T18:10:02.160 INFO:teuthology.orchestra.run.smithi089.stdout:Get:17 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [19.1 kB] 2021-04-09T18:10:02.160 INFO:teuthology.orchestra.run.smithi089.stdout:Get:18 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [4,412 B] 2021-04-09T18:10:02.173 INFO:teuthology.orchestra.run.smithi089.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [402 kB] 2021-04-09T18:10:02.191 INFO:teuthology.orchestra.run.smithi089.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [286 kB] 2021-04-09T18:10:02.204 INFO:teuthology.orchestra.run.smithi089.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [24.3 kB] 2021-04-09T18:10:02.204 INFO:teuthology.orchestra.run.smithi089.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [38.2 kB] 2021-04-09T18:10:02.205 INFO:teuthology.orchestra.run.smithi089.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,565 kB] 2021-04-09T18:10:02.240 INFO:teuthology.orchestra.run.smithi089.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,727 kB] 2021-04-09T18:10:02.295 INFO:teuthology.orchestra.run.smithi089.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [366 kB] 2021-04-09T18:10:02.309 INFO:teuthology.orchestra.run.smithi089.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [24.9 kB] 2021-04-09T18:10:02.309 INFO:teuthology.orchestra.run.smithi089.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [11.6 kB] 2021-04-09T18:10:02.309 INFO:teuthology.orchestra.run.smithi089.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [6,464 B] 2021-04-09T18:10:03.765 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 13.5 MB in 3s (5,131 kB/s) 2021-04-09T18:10:05.274 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2021-04-09T18:10:05.323 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-04-09T18:10:05.412 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2021-04-09T18:10:05.640 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2021-04-09T18:10:05.641 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2021-04-09T18:10:05.722 INFO:teuthology.orchestra.run.smithi089.stderr:E: Unable to locate package linux-image-current-generic 2021-04-09T18:10:05.723 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-04-09T18:10:05.724 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-04-09T18:10:05.851 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2021-04-09T18:10:06.105 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2021-04-09T18:10:06.105 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2021-04-09T18:10:06.284 INFO:teuthology.orchestra.run.smithi089.stdout:The following additional packages will be installed: 2021-04-09T18:10:06.285 INFO:teuthology.orchestra.run.smithi089.stdout: linux-generic linux-headers-4.15.0-140 linux-headers-4.15.0-140-generic 2021-04-09T18:10:06.285 INFO:teuthology.orchestra.run.smithi089.stdout: linux-headers-generic linux-image-4.15.0-140-generic 2021-04-09T18:10:06.285 INFO:teuthology.orchestra.run.smithi089.stdout: linux-modules-4.15.0-140-generic linux-modules-extra-4.15.0-140-generic 2021-04-09T18:10:06.286 INFO:teuthology.orchestra.run.smithi089.stdout:Suggested packages: 2021-04-09T18:10:06.287 INFO:teuthology.orchestra.run.smithi089.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2021-04-09T18:10:06.287 INFO:teuthology.orchestra.run.smithi089.stdout:Recommended packages: 2021-04-09T18:10:06.287 INFO:teuthology.orchestra.run.smithi089.stdout: thermald 2021-04-09T18:10:06.318 INFO:teuthology.orchestra.run.smithi089.stdout:The following NEW packages will be installed: 2021-04-09T18:10:06.319 INFO:teuthology.orchestra.run.smithi089.stdout: linux-headers-4.15.0-140 linux-headers-4.15.0-140-generic 2021-04-09T18:10:06.324 INFO:teuthology.orchestra.run.smithi089.stdout: linux-image-4.15.0-140-generic linux-modules-4.15.0-140-generic 2021-04-09T18:10:06.324 INFO:teuthology.orchestra.run.smithi089.stdout: linux-modules-extra-4.15.0-140-generic 2021-04-09T18:10:06.325 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages will be upgraded: 2021-04-09T18:10:06.326 INFO:teuthology.orchestra.run.smithi089.stdout: linux-generic linux-headers-generic linux-image-generic 2021-04-09T18:10:06.500 INFO:teuthology.orchestra.run.smithi089.stdout:3 upgraded, 5 newly installed, 0 to remove and 41 not upgraded. 2021-04-09T18:10:06.501 INFO:teuthology.orchestra.run.smithi089.stdout:Need to get 66.0 MB of archives. 2021-04-09T18:10:06.501 INFO:teuthology.orchestra.run.smithi089.stdout:After this operation, 334 MB of additional disk space will be used. 2021-04-09T18:10:06.501 INFO:teuthology.orchestra.run.smithi089.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-140-generic amd64 4.15.0-140.144 [13.1 MB] 2021-04-09T18:10:07.545 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-140-generic amd64 4.15.0-140.144 [8,021 kB] 2021-04-09T18:10:07.750 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-140-generic amd64 4.15.0-140.144 [32.8 MB] 2021-04-09T18:10:08.767 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.140.127 [1,868 B] 2021-04-09T18:10:08.767 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.140.127 [2,580 B] 2021-04-09T18:10:08.768 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-140 all 4.15.0-140.144 [10.9 MB] 2021-04-09T18:10:09.077 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-140-generic amd64 4.15.0-140.144 [1,101 kB] 2021-04-09T18:10:09.114 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.140.127 [2,484 B] 2021-04-09T18:10:09.580 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 66.0 MB in 3s (23.8 MB/s) 2021-04-09T18:10:09.723 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-modules-4.15.0-140-generic. 2021-04-09T18:10:09.761 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102065 files and directories currently installed.) 2021-04-09T18:10:09.764 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../0-linux-modules-4.15.0-140-generic_4.15.0-140.144_amd64.deb ... 2021-04-09T18:10:09.811 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-modules-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:10:11.478 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-image-4.15.0-140-generic. 2021-04-09T18:10:11.490 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../1-linux-image-4.15.0-140-generic_4.15.0-140.144_amd64.deb ... 2021-04-09T18:10:11.580 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-image-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:10:12.131 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-140-generic. 2021-04-09T18:10:12.143 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-140-generic_4.15.0-140.144_amd64.deb ... 2021-04-09T18:10:12.220 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-modules-extra-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:10:16.081 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../3-linux-generic_4.15.0.140.127_amd64.deb ... 2021-04-09T18:10:16.208 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-generic (4.15.0.140.127) over (4.15.0.136.123) ... 2021-04-09T18:10:16.549 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.140.127_amd64.deb ... 2021-04-09T18:10:16.711 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-image-generic (4.15.0.140.127) over (4.15.0.136.123) ... 2021-04-09T18:10:17.072 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-headers-4.15.0-140. 2021-04-09T18:10:17.084 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../5-linux-headers-4.15.0-140_4.15.0-140.144_all.deb ... 2021-04-09T18:10:17.122 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-headers-4.15.0-140 (4.15.0-140.144) ... 2021-04-09T18:10:21.959 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-headers-4.15.0-140-generic. 2021-04-09T18:10:21.980 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../6-linux-headers-4.15.0-140-generic_4.15.0-140.144_amd64.deb ... 2021-04-09T18:10:22.037 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-headers-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:10:24.613 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.140.127_amd64.deb ... 2021-04-09T18:10:24.736 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-headers-generic (4.15.0.140.127) over (4.15.0.136.123) ... 2021-04-09T18:10:25.133 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-headers-4.15.0-140 (4.15.0-140.144) ... 2021-04-09T18:10:25.267 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-modules-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:10:25.826 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-image-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:10:26.284 INFO:teuthology.orchestra.run.smithi089.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-140-generic 2021-04-09T18:10:26.285 INFO:teuthology.orchestra.run.smithi089.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-140-generic 2021-04-09T18:10:26.436 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-modules-extra-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:10:26.936 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-image-generic (4.15.0.140.127) ... 2021-04-09T18:10:27.064 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-headers-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:10:27.190 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-headers-generic (4.15.0.140.127) ... 2021-04-09T18:10:27.341 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-generic (4.15.0.140.127) ... 2021-04-09T18:10:27.467 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for linux-image-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:10:27.684 INFO:teuthology.orchestra.run.smithi089.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-04-09T18:10:27.684 INFO:teuthology.orchestra.run.smithi089.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-140-generic 2021-04-09T18:10:42.609 INFO:teuthology.orchestra.run.smithi089.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-04-09T18:10:42.610 INFO:teuthology.orchestra.run.smithi089.stdout:Sourcing file `/etc/default/grub' 2021-04-09T18:10:42.639 INFO:teuthology.orchestra.run.smithi089.stdout:Generating grub configuration file ... 2021-04-09T18:10:43.022 INFO:teuthology.orchestra.run.smithi089.stdout:Found linux image: /boot/vmlinuz-4.15.0-140-generic 2021-04-09T18:10:43.063 INFO:teuthology.orchestra.run.smithi089.stdout:Found initrd image: /boot/initrd.img-4.15.0-140-generic 2021-04-09T18:10:43.431 INFO:teuthology.orchestra.run.smithi089.stdout:Found linux image: /boot/vmlinuz-4.15.0-136-generic 2021-04-09T18:10:43.470 INFO:teuthology.orchestra.run.smithi089.stdout:Found initrd image: /boot/initrd.img-4.15.0-136-generic 2021-04-09T18:10:45.006 INFO:teuthology.orchestra.run.smithi089.stdout:done 2021-04-09T18:10:45.454 DEBUG:teuthology.orchestra.run.smithi089:> dpkg -s linux-image-generic 2021-04-09T18:10:45.477 INFO:teuthology.orchestra.run.smithi089.stdout:Package: linux-image-generic 2021-04-09T18:10:45.477 INFO:teuthology.orchestra.run.smithi089.stdout:Status: install ok installed 2021-04-09T18:10:45.478 INFO:teuthology.orchestra.run.smithi089.stdout:Priority: optional 2021-04-09T18:10:45.478 INFO:teuthology.orchestra.run.smithi089.stdout:Section: kernel 2021-04-09T18:10:45.479 INFO:teuthology.orchestra.run.smithi089.stdout:Installed-Size: 17 2021-04-09T18:10:45.479 INFO:teuthology.orchestra.run.smithi089.stdout:Maintainer: Ubuntu Kernel Team 2021-04-09T18:10:45.479 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: amd64 2021-04-09T18:10:45.480 INFO:teuthology.orchestra.run.smithi089.stdout:Source: linux-meta 2021-04-09T18:10:45.480 INFO:teuthology.orchestra.run.smithi089.stdout:Version: 4.15.0.140.127 2021-04-09T18:10:45.481 INFO:teuthology.orchestra.run.smithi089.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-04-09T18:10:45.481 INFO:teuthology.orchestra.run.smithi089.stdout:Depends: linux-image-4.15.0-140-generic, linux-modules-extra-4.15.0-140-generic, linux-firmware, intel-microcode, amd64-microcode 2021-04-09T18:10:45.481 INFO:teuthology.orchestra.run.smithi089.stdout:Recommends: thermald 2021-04-09T18:10:45.484 INFO:teuthology.orchestra.run.smithi089.stdout:Description: Generic Linux kernel image 2021-04-09T18:10:45.485 INFO:teuthology.orchestra.run.smithi089.stdout: This package will always depend on the latest generic kernel image 2021-04-09T18:10:45.485 INFO:teuthology.orchestra.run.smithi089.stdout: available. 2021-04-09T18:10:45.486 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-136-generic Expected: 4.15.0-140-generic 2021-04-09T18:10:45.487 DEBUG:teuthology.orchestra.run.smithi090:> uname -r 2021-04-09T18:10:45.496 INFO:teuthology.orchestra.run.smithi090.stdout:4.15.0-136-generic 2021-04-09T18:10:45.497 INFO:teuthology.task.kernel:Running kernel on smithi090: 4.15.0-136-generic 2021-04-09T18:10:45.498 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-get clean 2021-04-09T18:10:45.632 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-get update 2021-04-09T18:10:45.897 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-04-09T18:10:45.898 INFO:teuthology.orchestra.run.smithi090.stdout:Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-04-09T18:10:45.963 INFO:teuthology.orchestra.run.smithi090.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-04-09T18:10:46.218 INFO:teuthology.orchestra.run.smithi090.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-04-09T18:10:46.335 INFO:teuthology.orchestra.run.smithi090.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,639 kB] 2021-04-09T18:10:46.472 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,979 kB] 2021-04-09T18:10:46.771 INFO:teuthology.orchestra.run.smithi090.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [950 kB] 2021-04-09T18:10:46.788 INFO:teuthology.orchestra.run.smithi090.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [310 kB] 2021-04-09T18:10:46.791 INFO:teuthology.orchestra.run.smithi090.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [265 kB] 2021-04-09T18:10:46.794 INFO:teuthology.orchestra.run.smithi090.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted i386 Packages [17.7 kB] 2021-04-09T18:10:46.794 INFO:teuthology.orchestra.run.smithi090.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [34.6 kB] 2021-04-09T18:10:46.795 INFO:teuthology.orchestra.run.smithi090.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,118 kB] 2021-04-09T18:10:46.867 INFO:teuthology.orchestra.run.smithi090.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [980 kB] 2021-04-09T18:10:46.881 INFO:teuthology.orchestra.run.smithi090.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [251 kB] 2021-04-09T18:10:46.883 INFO:teuthology.orchestra.run.smithi090.stdout:Get:15 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [6,480 B] 2021-04-09T18:10:46.884 INFO:teuthology.orchestra.run.smithi090.stdout:Get:16 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [19.1 kB] 2021-04-09T18:10:46.884 INFO:teuthology.orchestra.run.smithi090.stdout:Get:17 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [4,412 B] 2021-04-09T18:10:46.933 INFO:teuthology.orchestra.run.smithi090.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,254 kB] 2021-04-09T18:10:46.968 INFO:teuthology.orchestra.run.smithi090.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [402 kB] 2021-04-09T18:10:46.980 INFO:teuthology.orchestra.run.smithi090.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [24.3 kB] 2021-04-09T18:10:46.981 INFO:teuthology.orchestra.run.smithi090.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [286 kB] 2021-04-09T18:10:46.988 INFO:teuthology.orchestra.run.smithi090.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [38.2 kB] 2021-04-09T18:10:46.989 INFO:teuthology.orchestra.run.smithi090.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,727 kB] 2021-04-09T18:10:47.058 INFO:teuthology.orchestra.run.smithi090.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,565 kB] 2021-04-09T18:10:47.101 INFO:teuthology.orchestra.run.smithi090.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [366 kB] 2021-04-09T18:10:47.106 INFO:teuthology.orchestra.run.smithi090.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [24.9 kB] 2021-04-09T18:10:47.117 INFO:teuthology.orchestra.run.smithi090.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [11.6 kB] 2021-04-09T18:10:47.117 INFO:teuthology.orchestra.run.smithi090.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [6,464 B] 2021-04-09T18:10:48.511 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 13.5 MB in 3s (5,072 kB/s) 2021-04-09T18:10:50.014 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2021-04-09T18:10:50.066 DEBUG:teuthology.orchestra.run.smithi090:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-04-09T18:10:50.149 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2021-04-09T18:10:50.407 INFO:teuthology.orchestra.run.smithi090.stdout:Building dependency tree... 2021-04-09T18:10:50.407 INFO:teuthology.orchestra.run.smithi090.stdout:Reading state information... 2021-04-09T18:10:50.487 INFO:teuthology.orchestra.run.smithi090.stderr:E: Unable to locate package linux-image-current-generic 2021-04-09T18:10:50.488 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-04-09T18:10:50.489 DEBUG:teuthology.orchestra.run.smithi090:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-04-09T18:10:50.565 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2021-04-09T18:10:50.801 INFO:teuthology.orchestra.run.smithi090.stdout:Building dependency tree... 2021-04-09T18:10:50.802 INFO:teuthology.orchestra.run.smithi090.stdout:Reading state information... 2021-04-09T18:10:50.978 INFO:teuthology.orchestra.run.smithi090.stdout:The following additional packages will be installed: 2021-04-09T18:10:50.978 INFO:teuthology.orchestra.run.smithi090.stdout: linux-generic linux-headers-4.15.0-140 linux-headers-4.15.0-140-generic 2021-04-09T18:10:50.979 INFO:teuthology.orchestra.run.smithi090.stdout: linux-headers-generic linux-image-4.15.0-140-generic 2021-04-09T18:10:50.979 INFO:teuthology.orchestra.run.smithi090.stdout: linux-modules-4.15.0-140-generic linux-modules-extra-4.15.0-140-generic 2021-04-09T18:10:50.980 INFO:teuthology.orchestra.run.smithi090.stdout:Suggested packages: 2021-04-09T18:10:50.980 INFO:teuthology.orchestra.run.smithi090.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2021-04-09T18:10:50.980 INFO:teuthology.orchestra.run.smithi090.stdout:Recommended packages: 2021-04-09T18:10:50.980 INFO:teuthology.orchestra.run.smithi090.stdout: thermald 2021-04-09T18:10:51.013 INFO:teuthology.orchestra.run.smithi090.stdout:The following NEW packages will be installed: 2021-04-09T18:10:51.013 INFO:teuthology.orchestra.run.smithi090.stdout: linux-headers-4.15.0-140 linux-headers-4.15.0-140-generic 2021-04-09T18:10:51.014 INFO:teuthology.orchestra.run.smithi090.stdout: linux-image-4.15.0-140-generic linux-modules-4.15.0-140-generic 2021-04-09T18:10:51.015 INFO:teuthology.orchestra.run.smithi090.stdout: linux-modules-extra-4.15.0-140-generic 2021-04-09T18:10:51.015 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages will be upgraded: 2021-04-09T18:10:51.016 INFO:teuthology.orchestra.run.smithi090.stdout: linux-generic linux-headers-generic linux-image-generic 2021-04-09T18:10:51.194 INFO:teuthology.orchestra.run.smithi090.stdout:3 upgraded, 5 newly installed, 0 to remove and 41 not upgraded. 2021-04-09T18:10:51.195 INFO:teuthology.orchestra.run.smithi090.stdout:Need to get 66.0 MB of archives. 2021-04-09T18:10:51.195 INFO:teuthology.orchestra.run.smithi090.stdout:After this operation, 334 MB of additional disk space will be used. 2021-04-09T18:10:51.196 INFO:teuthology.orchestra.run.smithi090.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-140-generic amd64 4.15.0-140.144 [13.1 MB] 2021-04-09T18:10:52.210 INFO:teuthology.orchestra.run.smithi090.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-140-generic amd64 4.15.0-140.144 [8,021 kB] 2021-04-09T18:10:52.452 INFO:teuthology.orchestra.run.smithi090.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-140-generic amd64 4.15.0-140.144 [32.8 MB] 2021-04-09T18:10:53.423 INFO:teuthology.orchestra.run.smithi090.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.140.127 [1,868 B] 2021-04-09T18:10:53.424 INFO:teuthology.orchestra.run.smithi090.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.140.127 [2,580 B] 2021-04-09T18:10:53.424 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-140 all 4.15.0-140.144 [10.9 MB] 2021-04-09T18:10:53.744 INFO:teuthology.orchestra.run.smithi090.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-140-generic amd64 4.15.0-140.144 [1,101 kB] 2021-04-09T18:10:53.753 INFO:teuthology.orchestra.run.smithi090.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.140.127 [2,484 B] 2021-04-09T18:10:54.257 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 66.0 MB in 3s (24.2 MB/s) 2021-04-09T18:10:54.410 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package linux-modules-4.15.0-140-generic. 2021-04-09T18:10:54.445 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102065 files and directories currently installed.) 2021-04-09T18:10:54.447 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../0-linux-modules-4.15.0-140-generic_4.15.0-140.144_amd64.deb ... 2021-04-09T18:10:54.499 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-modules-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:10:56.365 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package linux-image-4.15.0-140-generic. 2021-04-09T18:10:56.381 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../1-linux-image-4.15.0-140-generic_4.15.0-140.144_amd64.deb ... 2021-04-09T18:10:56.484 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-image-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:10:57.034 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-140-generic. 2021-04-09T18:10:57.046 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-140-generic_4.15.0-140.144_amd64.deb ... 2021-04-09T18:10:57.084 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-modules-extra-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:11:00.483 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../3-linux-generic_4.15.0.140.127_amd64.deb ... 2021-04-09T18:11:00.609 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-generic (4.15.0.140.127) over (4.15.0.136.123) ... 2021-04-09T18:11:00.909 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.140.127_amd64.deb ... 2021-04-09T18:11:01.063 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-image-generic (4.15.0.140.127) over (4.15.0.136.123) ... 2021-04-09T18:11:01.401 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package linux-headers-4.15.0-140. 2021-04-09T18:11:01.412 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../5-linux-headers-4.15.0-140_4.15.0-140.144_all.deb ... 2021-04-09T18:11:01.452 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-headers-4.15.0-140 (4.15.0-140.144) ... 2021-04-09T18:11:05.300 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package linux-headers-4.15.0-140-generic. 2021-04-09T18:11:05.321 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../6-linux-headers-4.15.0-140-generic_4.15.0-140.144_amd64.deb ... 2021-04-09T18:11:05.366 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-headers-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:11:07.439 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.140.127_amd64.deb ... 2021-04-09T18:11:07.563 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-headers-generic (4.15.0.140.127) over (4.15.0.136.123) ... 2021-04-09T18:11:07.909 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-headers-4.15.0-140 (4.15.0-140.144) ... 2021-04-09T18:11:08.036 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-modules-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:11:08.607 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-image-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:11:09.065 INFO:teuthology.orchestra.run.smithi090.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-140-generic 2021-04-09T18:11:09.065 INFO:teuthology.orchestra.run.smithi090.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-140-generic 2021-04-09T18:11:09.185 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-modules-extra-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:11:09.671 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-image-generic (4.15.0.140.127) ... 2021-04-09T18:11:09.797 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-headers-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:11:09.923 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-headers-generic (4.15.0.140.127) ... 2021-04-09T18:11:10.050 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-generic (4.15.0.140.127) ... 2021-04-09T18:11:10.168 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for linux-image-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:11:10.370 INFO:teuthology.orchestra.run.smithi090.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-04-09T18:11:10.372 INFO:teuthology.orchestra.run.smithi090.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-140-generic 2021-04-09T18:11:25.807 INFO:teuthology.orchestra.run.smithi090.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-04-09T18:11:25.808 INFO:teuthology.orchestra.run.smithi090.stdout:Sourcing file `/etc/default/grub' 2021-04-09T18:11:25.847 INFO:teuthology.orchestra.run.smithi090.stdout:Generating grub configuration file ... 2021-04-09T18:11:26.455 INFO:teuthology.orchestra.run.smithi090.stdout:Found linux image: /boot/vmlinuz-4.15.0-140-generic 2021-04-09T18:11:26.513 INFO:teuthology.orchestra.run.smithi090.stdout:Found initrd image: /boot/initrd.img-4.15.0-140-generic 2021-04-09T18:11:27.119 INFO:teuthology.orchestra.run.smithi090.stdout:Found linux image: /boot/vmlinuz-4.15.0-136-generic 2021-04-09T18:11:27.157 INFO:teuthology.orchestra.run.smithi090.stdout:Found initrd image: /boot/initrd.img-4.15.0-136-generic 2021-04-09T18:11:28.885 INFO:teuthology.orchestra.run.smithi090.stdout:done 2021-04-09T18:11:29.317 DEBUG:teuthology.orchestra.run.smithi090:> dpkg -s linux-image-generic 2021-04-09T18:11:29.343 INFO:teuthology.orchestra.run.smithi090.stdout:Package: linux-image-generic 2021-04-09T18:11:29.344 INFO:teuthology.orchestra.run.smithi090.stdout:Status: install ok installed 2021-04-09T18:11:29.344 INFO:teuthology.orchestra.run.smithi090.stdout:Priority: optional 2021-04-09T18:11:29.345 INFO:teuthology.orchestra.run.smithi090.stdout:Section: kernel 2021-04-09T18:11:29.345 INFO:teuthology.orchestra.run.smithi090.stdout:Installed-Size: 17 2021-04-09T18:11:29.346 INFO:teuthology.orchestra.run.smithi090.stdout:Maintainer: Ubuntu Kernel Team 2021-04-09T18:11:29.346 INFO:teuthology.orchestra.run.smithi090.stdout:Architecture: amd64 2021-04-09T18:11:29.347 INFO:teuthology.orchestra.run.smithi090.stdout:Source: linux-meta 2021-04-09T18:11:29.348 INFO:teuthology.orchestra.run.smithi090.stdout:Version: 4.15.0.140.127 2021-04-09T18:11:29.348 INFO:teuthology.orchestra.run.smithi090.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-04-09T18:11:29.349 INFO:teuthology.orchestra.run.smithi090.stdout:Depends: linux-image-4.15.0-140-generic, linux-modules-extra-4.15.0-140-generic, linux-firmware, intel-microcode, amd64-microcode 2021-04-09T18:11:29.349 INFO:teuthology.orchestra.run.smithi090.stdout:Recommends: thermald 2021-04-09T18:11:29.349 INFO:teuthology.orchestra.run.smithi090.stdout:Description: Generic Linux kernel image 2021-04-09T18:11:29.350 INFO:teuthology.orchestra.run.smithi090.stdout: This package will always depend on the latest generic kernel image 2021-04-09T18:11:29.351 INFO:teuthology.orchestra.run.smithi090.stdout: available. 2021-04-09T18:11:29.351 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-136-generic Expected: 4.15.0-140-generic 2021-04-09T18:11:29.352 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2021-04-09T18:11:29.379 INFO:teuthology.orchestra.run.smithi136.stdout:4.15.0-136-generic 2021-04-09T18:11:29.383 INFO:teuthology.task.kernel:Running kernel on smithi136: 4.15.0-136-generic 2021-04-09T18:11:29.383 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get clean 2021-04-09T18:11:29.565 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get update 2021-04-09T18:11:29.710 INFO:teuthology.orchestra.run.smithi136.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-04-09T18:11:29.835 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-04-09T18:11:29.917 INFO:teuthology.orchestra.run.smithi136.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-04-09T18:11:29.949 INFO:teuthology.orchestra.run.smithi136.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,639 kB] 2021-04-09T18:11:30.058 INFO:teuthology.orchestra.run.smithi136.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [950 kB] 2021-04-09T18:11:30.072 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [310 kB] 2021-04-09T18:11:30.075 INFO:teuthology.orchestra.run.smithi136.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [265 kB] 2021-04-09T18:11:30.079 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted i386 Packages [17.7 kB] 2021-04-09T18:11:30.080 INFO:teuthology.orchestra.run.smithi136.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [34.6 kB] 2021-04-09T18:11:30.080 INFO:teuthology.orchestra.run.smithi136.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,118 kB] 2021-04-09T18:11:30.090 INFO:teuthology.orchestra.run.smithi136.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [980 kB] 2021-04-09T18:11:30.099 INFO:teuthology.orchestra.run.smithi136.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [251 kB] 2021-04-09T18:11:30.102 INFO:teuthology.orchestra.run.smithi136.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [6,480 B] 2021-04-09T18:11:30.102 INFO:teuthology.orchestra.run.smithi136.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [19.1 kB] 2021-04-09T18:11:30.102 INFO:teuthology.orchestra.run.smithi136.stdout:Get:15 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [4,412 B] 2021-04-09T18:11:30.178 INFO:teuthology.orchestra.run.smithi136.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-04-09T18:11:30.295 INFO:teuthology.orchestra.run.smithi136.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,254 kB] 2021-04-09T18:11:30.636 INFO:teuthology.orchestra.run.smithi136.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,979 kB] 2021-04-09T18:11:30.754 INFO:teuthology.orchestra.run.smithi136.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [402 kB] 2021-04-09T18:11:30.771 INFO:teuthology.orchestra.run.smithi136.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [24.3 kB] 2021-04-09T18:11:30.773 INFO:teuthology.orchestra.run.smithi136.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [286 kB] 2021-04-09T18:11:30.782 INFO:teuthology.orchestra.run.smithi136.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [38.2 kB] 2021-04-09T18:11:30.783 INFO:teuthology.orchestra.run.smithi136.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,727 kB] 2021-04-09T18:11:30.830 INFO:teuthology.orchestra.run.smithi136.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,565 kB] 2021-04-09T18:11:30.877 INFO:teuthology.orchestra.run.smithi136.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [366 kB] 2021-04-09T18:11:30.884 INFO:teuthology.orchestra.run.smithi136.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [24.9 kB] 2021-04-09T18:11:30.884 INFO:teuthology.orchestra.run.smithi136.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [11.6 kB] 2021-04-09T18:11:30.891 INFO:teuthology.orchestra.run.smithi136.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [6,464 B] 2021-04-09T18:11:31.875 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 13.5 MB in 2s (6,442 kB/s) 2021-04-09T18:11:33.277 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2021-04-09T18:11:33.328 DEBUG:teuthology.orchestra.run.smithi136:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-04-09T18:11:33.414 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2021-04-09T18:11:33.665 INFO:teuthology.orchestra.run.smithi136.stdout:Building dependency tree... 2021-04-09T18:11:33.666 INFO:teuthology.orchestra.run.smithi136.stdout:Reading state information... 2021-04-09T18:11:33.746 INFO:teuthology.orchestra.run.smithi136.stderr:E: Unable to locate package linux-image-current-generic 2021-04-09T18:11:33.747 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-04-09T18:11:33.749 DEBUG:teuthology.orchestra.run.smithi136:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-04-09T18:11:33.829 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2021-04-09T18:11:34.084 INFO:teuthology.orchestra.run.smithi136.stdout:Building dependency tree... 2021-04-09T18:11:34.084 INFO:teuthology.orchestra.run.smithi136.stdout:Reading state information... 2021-04-09T18:11:34.265 INFO:teuthology.orchestra.run.smithi136.stdout:The following additional packages will be installed: 2021-04-09T18:11:34.265 INFO:teuthology.orchestra.run.smithi136.stdout: linux-generic linux-headers-4.15.0-140 linux-headers-4.15.0-140-generic 2021-04-09T18:11:34.265 INFO:teuthology.orchestra.run.smithi136.stdout: linux-headers-generic linux-image-4.15.0-140-generic 2021-04-09T18:11:34.266 INFO:teuthology.orchestra.run.smithi136.stdout: linux-modules-4.15.0-140-generic linux-modules-extra-4.15.0-140-generic 2021-04-09T18:11:34.266 INFO:teuthology.orchestra.run.smithi136.stdout:Suggested packages: 2021-04-09T18:11:34.266 INFO:teuthology.orchestra.run.smithi136.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2021-04-09T18:11:34.266 INFO:teuthology.orchestra.run.smithi136.stdout:Recommended packages: 2021-04-09T18:11:34.266 INFO:teuthology.orchestra.run.smithi136.stdout: thermald 2021-04-09T18:11:34.296 INFO:teuthology.orchestra.run.smithi136.stdout:The following NEW packages will be installed: 2021-04-09T18:11:34.296 INFO:teuthology.orchestra.run.smithi136.stdout: linux-headers-4.15.0-140 linux-headers-4.15.0-140-generic 2021-04-09T18:11:34.296 INFO:teuthology.orchestra.run.smithi136.stdout: linux-image-4.15.0-140-generic linux-modules-4.15.0-140-generic 2021-04-09T18:11:34.297 INFO:teuthology.orchestra.run.smithi136.stdout: linux-modules-extra-4.15.0-140-generic 2021-04-09T18:11:34.298 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages will be upgraded: 2021-04-09T18:11:34.298 INFO:teuthology.orchestra.run.smithi136.stdout: linux-generic linux-headers-generic linux-image-generic 2021-04-09T18:11:34.481 INFO:teuthology.orchestra.run.smithi136.stdout:3 upgraded, 5 newly installed, 0 to remove and 41 not upgraded. 2021-04-09T18:11:34.482 INFO:teuthology.orchestra.run.smithi136.stdout:Need to get 66.0 MB of archives. 2021-04-09T18:11:34.482 INFO:teuthology.orchestra.run.smithi136.stdout:After this operation, 334 MB of additional disk space will be used. 2021-04-09T18:11:34.483 INFO:teuthology.orchestra.run.smithi136.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-140-generic amd64 4.15.0-140.144 [13.1 MB] 2021-04-09T18:11:35.483 INFO:teuthology.orchestra.run.smithi136.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-140-generic amd64 4.15.0-140.144 [8,021 kB] 2021-04-09T18:11:35.682 INFO:teuthology.orchestra.run.smithi136.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-140-generic amd64 4.15.0-140.144 [32.8 MB] 2021-04-09T18:11:36.673 INFO:teuthology.orchestra.run.smithi136.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.140.127 [1,868 B] 2021-04-09T18:11:36.674 INFO:teuthology.orchestra.run.smithi136.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.140.127 [2,580 B] 2021-04-09T18:11:36.674 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-140 all 4.15.0-140.144 [10.9 MB] 2021-04-09T18:11:36.980 INFO:teuthology.orchestra.run.smithi136.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-140-generic amd64 4.15.0-140.144 [1,101 kB] 2021-04-09T18:11:37.011 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.140.127 [2,484 B] 2021-04-09T18:11:37.481 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 66.0 MB in 3s (24.5 MB/s) 2021-04-09T18:11:37.632 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-modules-4.15.0-140-generic. 2021-04-09T18:11:37.671 INFO:teuthology.orchestra.run.smithi136.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102065 files and directories currently installed.) 2021-04-09T18:11:37.674 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../0-linux-modules-4.15.0-140-generic_4.15.0-140.144_amd64.deb ... 2021-04-09T18:11:37.728 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-modules-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:11:39.385 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-image-4.15.0-140-generic. 2021-04-09T18:11:39.397 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../1-linux-image-4.15.0-140-generic_4.15.0-140.144_amd64.deb ... 2021-04-09T18:11:39.498 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-image-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:11:40.013 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-140-generic. 2021-04-09T18:11:40.027 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-140-generic_4.15.0-140.144_amd64.deb ... 2021-04-09T18:11:40.063 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-modules-extra-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:11:43.759 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../3-linux-generic_4.15.0.140.127_amd64.deb ... 2021-04-09T18:11:43.883 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-generic (4.15.0.140.127) over (4.15.0.136.123) ... 2021-04-09T18:11:44.186 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.140.127_amd64.deb ... 2021-04-09T18:11:44.315 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-image-generic (4.15.0.140.127) over (4.15.0.136.123) ... 2021-04-09T18:11:44.643 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-headers-4.15.0-140. 2021-04-09T18:11:44.656 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../5-linux-headers-4.15.0-140_4.15.0-140.144_all.deb ... 2021-04-09T18:11:44.693 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-headers-4.15.0-140 (4.15.0-140.144) ... 2021-04-09T18:11:49.344 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-headers-4.15.0-140-generic. 2021-04-09T18:11:49.362 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../6-linux-headers-4.15.0-140-generic_4.15.0-140.144_amd64.deb ... 2021-04-09T18:11:49.400 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-headers-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:11:51.744 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.140.127_amd64.deb ... 2021-04-09T18:11:51.864 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-headers-generic (4.15.0.140.127) over (4.15.0.136.123) ... 2021-04-09T18:11:52.204 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-headers-4.15.0-140 (4.15.0-140.144) ... 2021-04-09T18:11:52.345 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-modules-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:11:52.888 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-image-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:11:53.321 INFO:teuthology.orchestra.run.smithi136.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-140-generic 2021-04-09T18:11:53.322 INFO:teuthology.orchestra.run.smithi136.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-140-generic 2021-04-09T18:11:53.465 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-modules-extra-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:11:53.932 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-image-generic (4.15.0.140.127) ... 2021-04-09T18:11:54.059 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-headers-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:11:54.185 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-headers-generic (4.15.0.140.127) ... 2021-04-09T18:11:54.294 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-generic (4.15.0.140.127) ... 2021-04-09T18:11:54.420 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for linux-image-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:11:54.616 INFO:teuthology.orchestra.run.smithi136.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-04-09T18:11:54.616 INFO:teuthology.orchestra.run.smithi136.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-140-generic 2021-04-09T18:12:10.130 INFO:teuthology.orchestra.run.smithi136.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-04-09T18:12:10.131 INFO:teuthology.orchestra.run.smithi136.stdout:Sourcing file `/etc/default/grub' 2021-04-09T18:12:10.162 INFO:teuthology.orchestra.run.smithi136.stdout:Generating grub configuration file ... 2021-04-09T18:12:10.579 INFO:teuthology.orchestra.run.smithi136.stdout:Found linux image: /boot/vmlinuz-4.15.0-140-generic 2021-04-09T18:12:10.616 INFO:teuthology.orchestra.run.smithi136.stdout:Found initrd image: /boot/initrd.img-4.15.0-140-generic 2021-04-09T18:12:10.936 INFO:teuthology.orchestra.run.smithi136.stdout:Found linux image: /boot/vmlinuz-4.15.0-136-generic 2021-04-09T18:12:10.966 INFO:teuthology.orchestra.run.smithi136.stdout:Found initrd image: /boot/initrd.img-4.15.0-136-generic 2021-04-09T18:12:12.463 INFO:teuthology.orchestra.run.smithi136.stdout:done 2021-04-09T18:12:12.877 DEBUG:teuthology.orchestra.run.smithi136:> dpkg -s linux-image-generic 2021-04-09T18:12:12.905 INFO:teuthology.orchestra.run.smithi136.stdout:Package: linux-image-generic 2021-04-09T18:12:12.905 INFO:teuthology.orchestra.run.smithi136.stdout:Status: install ok installed 2021-04-09T18:12:12.906 INFO:teuthology.orchestra.run.smithi136.stdout:Priority: optional 2021-04-09T18:12:12.906 INFO:teuthology.orchestra.run.smithi136.stdout:Section: kernel 2021-04-09T18:12:12.917 INFO:teuthology.orchestra.run.smithi136.stdout:Installed-Size: 17 2021-04-09T18:12:12.917 INFO:teuthology.orchestra.run.smithi136.stdout:Maintainer: Ubuntu Kernel Team 2021-04-09T18:12:12.918 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: amd64 2021-04-09T18:12:12.918 INFO:teuthology.orchestra.run.smithi136.stdout:Source: linux-meta 2021-04-09T18:12:12.919 INFO:teuthology.orchestra.run.smithi136.stdout:Version: 4.15.0.140.127 2021-04-09T18:12:12.919 INFO:teuthology.orchestra.run.smithi136.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-04-09T18:12:12.920 INFO:teuthology.orchestra.run.smithi136.stdout:Depends: linux-image-4.15.0-140-generic, linux-modules-extra-4.15.0-140-generic, linux-firmware, intel-microcode, amd64-microcode 2021-04-09T18:12:12.920 INFO:teuthology.orchestra.run.smithi136.stdout:Recommends: thermald 2021-04-09T18:12:12.921 INFO:teuthology.orchestra.run.smithi136.stdout:Description: Generic Linux kernel image 2021-04-09T18:12:12.921 INFO:teuthology.orchestra.run.smithi136.stdout: This package will always depend on the latest generic kernel image 2021-04-09T18:12:12.921 INFO:teuthology.orchestra.run.smithi136.stdout: available. 2021-04-09T18:12:12.926 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-136-generic Expected: 4.15.0-140-generic 2021-04-09T18:12:12.933 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2021-04-09T18:12:12.953 INFO:teuthology.orchestra.run.smithi144.stdout:4.15.0-136-generic 2021-04-09T18:12:12.953 INFO:teuthology.task.kernel:Running kernel on smithi144: 4.15.0-136-generic 2021-04-09T18:12:12.984 DEBUG:teuthology.orchestra.run.smithi144:> sudo apt-get clean 2021-04-09T18:12:13.113 DEBUG:teuthology.orchestra.run.smithi144:> sudo apt-get update 2021-04-09T18:12:13.389 INFO:teuthology.orchestra.run.smithi144.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-04-09T18:12:13.413 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-04-09T18:12:13.471 INFO:teuthology.orchestra.run.smithi144.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-04-09T18:12:13.784 INFO:teuthology.orchestra.run.smithi144.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-04-09T18:12:13.804 INFO:teuthology.orchestra.run.smithi144.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,639 kB] 2021-04-09T18:12:13.947 INFO:teuthology.orchestra.run.smithi144.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,254 kB] 2021-04-09T18:12:14.246 INFO:teuthology.orchestra.run.smithi144.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,979 kB] 2021-04-09T18:12:14.270 INFO:teuthology.orchestra.run.smithi144.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [950 kB] 2021-04-09T18:12:14.288 INFO:teuthology.orchestra.run.smithi144.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [310 kB] 2021-04-09T18:12:14.293 INFO:teuthology.orchestra.run.smithi144.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [265 kB] 2021-04-09T18:12:14.297 INFO:teuthology.orchestra.run.smithi144.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/restricted i386 Packages [17.7 kB] 2021-04-09T18:12:14.298 INFO:teuthology.orchestra.run.smithi144.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [34.6 kB] 2021-04-09T18:12:14.299 INFO:teuthology.orchestra.run.smithi144.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [980 kB] 2021-04-09T18:12:14.358 INFO:teuthology.orchestra.run.smithi144.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [402 kB] 2021-04-09T18:12:14.366 INFO:teuthology.orchestra.run.smithi144.stdout:Get:15 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,118 kB] 2021-04-09T18:12:14.371 INFO:teuthology.orchestra.run.smithi144.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [286 kB] 2021-04-09T18:12:14.380 INFO:teuthology.orchestra.run.smithi144.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [24.3 kB] 2021-04-09T18:12:14.381 INFO:teuthology.orchestra.run.smithi144.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [38.2 kB] 2021-04-09T18:12:14.382 INFO:teuthology.orchestra.run.smithi144.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,727 kB] 2021-04-09T18:12:14.391 INFO:teuthology.orchestra.run.smithi144.stdout:Get:20 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [251 kB] 2021-04-09T18:12:14.393 INFO:teuthology.orchestra.run.smithi144.stdout:Get:21 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [19.1 kB] 2021-04-09T18:12:14.401 INFO:teuthology.orchestra.run.smithi144.stdout:Get:22 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [6,480 B] 2021-04-09T18:12:14.414 INFO:teuthology.orchestra.run.smithi144.stdout:Get:23 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [4,412 B] 2021-04-09T18:12:14.446 INFO:teuthology.orchestra.run.smithi144.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,565 kB] 2021-04-09T18:12:14.468 INFO:teuthology.orchestra.run.smithi144.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [366 kB] 2021-04-09T18:12:14.478 INFO:teuthology.orchestra.run.smithi144.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [24.9 kB] 2021-04-09T18:12:14.479 INFO:teuthology.orchestra.run.smithi144.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [11.6 kB] 2021-04-09T18:12:14.479 INFO:teuthology.orchestra.run.smithi144.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [6,464 B] 2021-04-09T18:12:16.118 INFO:teuthology.orchestra.run.smithi144.stdout:Fetched 13.5 MB in 3s (5,066 kB/s) 2021-04-09T18:12:17.519 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2021-04-09T18:12:17.564 DEBUG:teuthology.orchestra.run.smithi144:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-04-09T18:12:17.643 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2021-04-09T18:12:17.912 INFO:teuthology.orchestra.run.smithi144.stdout:Building dependency tree... 2021-04-09T18:12:17.913 INFO:teuthology.orchestra.run.smithi144.stdout:Reading state information... 2021-04-09T18:12:17.998 INFO:teuthology.orchestra.run.smithi144.stderr:E: Unable to locate package linux-image-current-generic 2021-04-09T18:12:18.000 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-04-09T18:12:18.001 DEBUG:teuthology.orchestra.run.smithi144:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-04-09T18:12:18.077 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2021-04-09T18:12:18.310 INFO:teuthology.orchestra.run.smithi144.stdout:Building dependency tree... 2021-04-09T18:12:18.311 INFO:teuthology.orchestra.run.smithi144.stdout:Reading state information... 2021-04-09T18:12:18.487 INFO:teuthology.orchestra.run.smithi144.stdout:The following additional packages will be installed: 2021-04-09T18:12:18.488 INFO:teuthology.orchestra.run.smithi144.stdout: linux-generic linux-headers-4.15.0-140 linux-headers-4.15.0-140-generic 2021-04-09T18:12:18.488 INFO:teuthology.orchestra.run.smithi144.stdout: linux-headers-generic linux-image-4.15.0-140-generic 2021-04-09T18:12:18.489 INFO:teuthology.orchestra.run.smithi144.stdout: linux-modules-4.15.0-140-generic linux-modules-extra-4.15.0-140-generic 2021-04-09T18:12:18.490 INFO:teuthology.orchestra.run.smithi144.stdout:Suggested packages: 2021-04-09T18:12:18.490 INFO:teuthology.orchestra.run.smithi144.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2021-04-09T18:12:18.490 INFO:teuthology.orchestra.run.smithi144.stdout:Recommended packages: 2021-04-09T18:12:18.491 INFO:teuthology.orchestra.run.smithi144.stdout: thermald 2021-04-09T18:12:18.524 INFO:teuthology.orchestra.run.smithi144.stdout:The following NEW packages will be installed: 2021-04-09T18:12:18.524 INFO:teuthology.orchestra.run.smithi144.stdout: linux-headers-4.15.0-140 linux-headers-4.15.0-140-generic 2021-04-09T18:12:18.525 INFO:teuthology.orchestra.run.smithi144.stdout: linux-image-4.15.0-140-generic linux-modules-4.15.0-140-generic 2021-04-09T18:12:18.525 INFO:teuthology.orchestra.run.smithi144.stdout: linux-modules-extra-4.15.0-140-generic 2021-04-09T18:12:18.526 INFO:teuthology.orchestra.run.smithi144.stdout:The following packages will be upgraded: 2021-04-09T18:12:18.526 INFO:teuthology.orchestra.run.smithi144.stdout: linux-generic linux-headers-generic linux-image-generic 2021-04-09T18:12:18.704 INFO:teuthology.orchestra.run.smithi144.stdout:3 upgraded, 5 newly installed, 0 to remove and 41 not upgraded. 2021-04-09T18:12:18.705 INFO:teuthology.orchestra.run.smithi144.stdout:Need to get 66.0 MB of archives. 2021-04-09T18:12:18.705 INFO:teuthology.orchestra.run.smithi144.stdout:After this operation, 334 MB of additional disk space will be used. 2021-04-09T18:12:18.705 INFO:teuthology.orchestra.run.smithi144.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-140-generic amd64 4.15.0-140.144 [13.1 MB] 2021-04-09T18:12:19.710 INFO:teuthology.orchestra.run.smithi144.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-140-generic amd64 4.15.0-140.144 [8,021 kB] 2021-04-09T18:12:19.914 INFO:teuthology.orchestra.run.smithi144.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-140-generic amd64 4.15.0-140.144 [32.8 MB] 2021-04-09T18:12:21.109 INFO:teuthology.orchestra.run.smithi144.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.140.127 [1,868 B] 2021-04-09T18:12:21.192 INFO:teuthology.orchestra.run.smithi144.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.140.127 [2,580 B] 2021-04-09T18:12:21.269 INFO:teuthology.orchestra.run.smithi144.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-140 all 4.15.0-140.144 [10.9 MB] 2021-04-09T18:12:22.196 INFO:teuthology.orchestra.run.smithi144.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-140-generic amd64 4.15.0-140.144 [1,101 kB] 2021-04-09T18:12:22.324 INFO:teuthology.orchestra.run.smithi144.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.140.127 [2,484 B] 2021-04-09T18:12:22.770 INFO:teuthology.orchestra.run.smithi144.stdout:Fetched 66.0 MB in 4s (17.4 MB/s) 2021-04-09T18:12:22.928 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package linux-modules-4.15.0-140-generic. 2021-04-09T18:12:22.961 INFO:teuthology.orchestra.run.smithi144.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102065 files and directories currently installed.) 2021-04-09T18:12:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../0-linux-modules-4.15.0-140-generic_4.15.0-140.144_amd64.deb ... 2021-04-09T18:12:23.015 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-modules-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:12:24.673 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package linux-image-4.15.0-140-generic. 2021-04-09T18:12:24.687 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../1-linux-image-4.15.0-140-generic_4.15.0-140.144_amd64.deb ... 2021-04-09T18:12:24.784 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-image-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:12:25.293 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-140-generic. 2021-04-09T18:12:25.304 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-140-generic_4.15.0-140.144_amd64.deb ... 2021-04-09T18:12:25.346 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-modules-extra-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:12:28.941 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../3-linux-generic_4.15.0.140.127_amd64.deb ... 2021-04-09T18:12:29.069 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-generic (4.15.0.140.127) over (4.15.0.136.123) ... 2021-04-09T18:12:29.400 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.140.127_amd64.deb ... 2021-04-09T18:12:29.522 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-image-generic (4.15.0.140.127) over (4.15.0.136.123) ... 2021-04-09T18:12:29.858 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package linux-headers-4.15.0-140. 2021-04-09T18:12:29.871 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../5-linux-headers-4.15.0-140_4.15.0-140.144_all.deb ... 2021-04-09T18:12:29.911 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-headers-4.15.0-140 (4.15.0-140.144) ... 2021-04-09T18:12:34.474 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package linux-headers-4.15.0-140-generic. 2021-04-09T18:12:34.496 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../6-linux-headers-4.15.0-140-generic_4.15.0-140.144_amd64.deb ... 2021-04-09T18:12:34.540 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-headers-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:12:36.891 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.140.127_amd64.deb ... 2021-04-09T18:12:37.011 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-headers-generic (4.15.0.140.127) over (4.15.0.136.123) ... 2021-04-09T18:12:37.348 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-headers-4.15.0-140 (4.15.0-140.144) ... 2021-04-09T18:12:37.482 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-modules-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:12:38.009 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-image-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:12:38.455 INFO:teuthology.orchestra.run.smithi144.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-140-generic 2021-04-09T18:12:38.456 INFO:teuthology.orchestra.run.smithi144.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-140-generic 2021-04-09T18:12:38.586 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-modules-extra-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:12:39.062 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-image-generic (4.15.0.140.127) ... 2021-04-09T18:12:39.189 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-headers-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:12:39.314 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-headers-generic (4.15.0.140.127) ... 2021-04-09T18:12:39.441 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-generic (4.15.0.140.127) ... 2021-04-09T18:12:39.559 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for linux-image-4.15.0-140-generic (4.15.0-140.144) ... 2021-04-09T18:12:39.748 INFO:teuthology.orchestra.run.smithi144.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-04-09T18:12:39.748 INFO:teuthology.orchestra.run.smithi144.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-140-generic 2021-04-09T18:12:55.416 INFO:teuthology.orchestra.run.smithi144.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-04-09T18:12:55.417 INFO:teuthology.orchestra.run.smithi144.stdout:Sourcing file `/etc/default/grub' 2021-04-09T18:12:55.451 INFO:teuthology.orchestra.run.smithi144.stdout:Generating grub configuration file ... 2021-04-09T18:12:55.808 INFO:teuthology.orchestra.run.smithi144.stdout:Found linux image: /boot/vmlinuz-4.15.0-140-generic 2021-04-09T18:12:55.847 INFO:teuthology.orchestra.run.smithi144.stdout:Found initrd image: /boot/initrd.img-4.15.0-140-generic 2021-04-09T18:12:56.163 INFO:teuthology.orchestra.run.smithi144.stdout:Found linux image: /boot/vmlinuz-4.15.0-136-generic 2021-04-09T18:12:56.195 INFO:teuthology.orchestra.run.smithi144.stdout:Found initrd image: /boot/initrd.img-4.15.0-136-generic 2021-04-09T18:12:57.148 INFO:teuthology.orchestra.run.smithi144.stdout:done 2021-04-09T18:12:57.542 DEBUG:teuthology.orchestra.run.smithi144:> dpkg -s linux-image-generic 2021-04-09T18:12:57.606 INFO:teuthology.orchestra.run.smithi144.stdout:Package: linux-image-generic 2021-04-09T18:12:57.608 INFO:teuthology.orchestra.run.smithi144.stdout:Status: install ok installed 2021-04-09T18:12:57.608 INFO:teuthology.orchestra.run.smithi144.stdout:Priority: optional 2021-04-09T18:12:57.609 INFO:teuthology.orchestra.run.smithi144.stdout:Section: kernel 2021-04-09T18:12:57.609 INFO:teuthology.orchestra.run.smithi144.stdout:Installed-Size: 17 2021-04-09T18:12:57.609 INFO:teuthology.orchestra.run.smithi144.stdout:Maintainer: Ubuntu Kernel Team 2021-04-09T18:12:57.610 INFO:teuthology.orchestra.run.smithi144.stdout:Architecture: amd64 2021-04-09T18:12:57.610 INFO:teuthology.orchestra.run.smithi144.stdout:Source: linux-meta 2021-04-09T18:12:57.610 INFO:teuthology.orchestra.run.smithi144.stdout:Version: 4.15.0.140.127 2021-04-09T18:12:57.611 INFO:teuthology.orchestra.run.smithi144.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-04-09T18:12:57.611 INFO:teuthology.orchestra.run.smithi144.stdout:Depends: linux-image-4.15.0-140-generic, linux-modules-extra-4.15.0-140-generic, linux-firmware, intel-microcode, amd64-microcode 2021-04-09T18:12:57.611 INFO:teuthology.orchestra.run.smithi144.stdout:Recommends: thermald 2021-04-09T18:12:57.611 INFO:teuthology.orchestra.run.smithi144.stdout:Description: Generic Linux kernel image 2021-04-09T18:12:57.612 INFO:teuthology.orchestra.run.smithi144.stdout: This package will always depend on the latest generic kernel image 2021-04-09T18:12:57.612 INFO:teuthology.orchestra.run.smithi144.stdout: available. 2021-04-09T18:12:57.613 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-136-generic Expected: 4.15.0-140-generic 2021-04-09T18:12:57.613 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-04-09T18:12:57.613 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-04-09T18:12:57.614 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-04-09T18:12:57.614 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-04-09T18:12:57.614 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-04-09T18:12:57.614 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-04-09T18:12:57.615 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-04-09T18:12:57.615 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi079.front.sepia.ceph.com, path=None, version=distro) 2021-04-09T18:12:57.615 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get clean 2021-04-09T18:12:57.751 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2021-04-09T18:12:57.870 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-04-09T18:12:57.988 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-04-09T18:12:58.068 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-04-09T18:12:58.148 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-04-09T18:13:00.060 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2021-04-09T18:13:00.108 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-04-09T18:13:00.189 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2021-04-09T18:13:00.440 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2021-04-09T18:13:00.441 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2021-04-09T18:13:00.520 INFO:teuthology.orchestra.run.smithi079.stderr:E: Unable to locate package linux-image-current-generic 2021-04-09T18:13:00.521 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-04-09T18:13:00.522 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-04-09T18:13:00.595 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2021-04-09T18:13:00.838 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2021-04-09T18:13:00.838 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2021-04-09T18:13:01.060 INFO:teuthology.orchestra.run.smithi079.stdout:linux-image-generic is already the newest version (4.15.0.140.127). 2021-04-09T18:13:01.061 INFO:teuthology.orchestra.run.smithi079.stdout:0 upgraded, 0 newly installed, 0 to remove and 41 not upgraded. 2021-04-09T18:13:01.062 DEBUG:teuthology.orchestra.run.smithi079:> dpkg -s linux-image-generic 2021-04-09T18:13:01.127 INFO:teuthology.orchestra.run.smithi079.stdout:Package: linux-image-generic 2021-04-09T18:13:01.128 INFO:teuthology.orchestra.run.smithi079.stdout:Status: install ok installed 2021-04-09T18:13:01.128 INFO:teuthology.orchestra.run.smithi079.stdout:Priority: optional 2021-04-09T18:13:01.129 INFO:teuthology.orchestra.run.smithi079.stdout:Section: kernel 2021-04-09T18:13:01.129 INFO:teuthology.orchestra.run.smithi079.stdout:Installed-Size: 17 2021-04-09T18:13:01.130 INFO:teuthology.orchestra.run.smithi079.stdout:Maintainer: Ubuntu Kernel Team 2021-04-09T18:13:01.130 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: amd64 2021-04-09T18:13:01.130 INFO:teuthology.orchestra.run.smithi079.stdout:Source: linux-meta 2021-04-09T18:13:01.131 INFO:teuthology.orchestra.run.smithi079.stdout:Version: 4.15.0.140.127 2021-04-09T18:13:01.132 INFO:teuthology.orchestra.run.smithi079.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-04-09T18:13:01.132 INFO:teuthology.orchestra.run.smithi079.stdout:Depends: linux-image-4.15.0-140-generic, linux-modules-extra-4.15.0-140-generic, linux-firmware, intel-microcode, amd64-microcode 2021-04-09T18:13:01.133 INFO:teuthology.orchestra.run.smithi079.stdout:Recommends: thermald 2021-04-09T18:13:01.133 INFO:teuthology.orchestra.run.smithi079.stdout:Description: Generic Linux kernel image 2021-04-09T18:13:01.133 INFO:teuthology.orchestra.run.smithi079.stdout: This package will always depend on the latest generic kernel image 2021-04-09T18:13:01.134 INFO:teuthology.orchestra.run.smithi079.stdout: available. 2021-04-09T18:13:01.134 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2021-04-09T18:13:01.220 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.tUgXPwvJmc 2021-04-09T18:13:01.221 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /boot/grub/grub.cfg /tmp/tmp.tUgXPwvJmc 2021-04-09T18:13:01.284 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.tUgXPwvJmc 2021-04-09T18:13:01.406 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.tUgXPwvJmc is 8KB 2021-04-09T18:13:01.465 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.tUgXPwvJmc 2021-04-09T18:13:01.498 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-04-09T18:13:01.552 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2021-04-09T18:13:01.553 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-04-09T18:13:01.553 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-04-09T18:13:01.622 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-140-generic 2021-04-09T18:13:01.622 DEBUG:teuthology.orchestra.run.smithi079:> sudo update-grub 2021-04-09T18:13:02.822 INFO:teuthology.orchestra.run.smithi079.stderr:Sourcing file `/etc/default/grub' 2021-04-09T18:13:02.854 INFO:teuthology.orchestra.run.smithi079.stderr:Generating grub configuration file ... 2021-04-09T18:13:03.114 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-4.15.0-140-generic 2021-04-09T18:13:03.118 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-4.15.0-140-generic 2021-04-09T18:13:03.475 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-4.15.0-136-generic 2021-04-09T18:13:03.488 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-4.15.0-136-generic 2021-04-09T18:13:04.645 INFO:teuthology.orchestra.run.smithi079.stderr:done 2021-04-09T18:13:04.646 DEBUG:teuthology.orchestra.run.smithi079:> sudo shutdown -r now 2021-04-09T18:13:04.650 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-04-09T18:13:04.650 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi089.front.sepia.ceph.com, path=None, version=distro) 2021-04-09T18:13:04.651 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get clean 2021-04-09T18:13:04.750 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get update 2021-04-09T18:13:04.885 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-04-09T18:13:04.991 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-04-09T18:13:05.071 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-04-09T18:13:05.157 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-04-09T18:13:06.750 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2021-04-09T18:13:06.798 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-04-09T18:13:06.874 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2021-04-09T18:13:07.123 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2021-04-09T18:13:07.124 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2021-04-09T18:13:07.209 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-04-09T18:13:07.211 INFO:teuthology.orchestra.run.smithi089.stderr:E: Unable to locate package linux-image-current-generic 2021-04-09T18:13:07.212 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-04-09T18:13:07.295 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2021-04-09T18:13:07.557 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2021-04-09T18:13:07.558 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2021-04-09T18:13:07.758 INFO:teuthology.orchestra.run.smithi089.stdout:linux-image-generic is already the newest version (4.15.0.140.127). 2021-04-09T18:13:07.759 INFO:teuthology.orchestra.run.smithi089.stdout:0 upgraded, 0 newly installed, 0 to remove and 41 not upgraded. 2021-04-09T18:13:07.760 DEBUG:teuthology.orchestra.run.smithi089:> dpkg -s linux-image-generic 2021-04-09T18:13:07.824 INFO:teuthology.orchestra.run.smithi089.stdout:Package: linux-image-generic 2021-04-09T18:13:07.825 INFO:teuthology.orchestra.run.smithi089.stdout:Status: install ok installed 2021-04-09T18:13:07.825 INFO:teuthology.orchestra.run.smithi089.stdout:Priority: optional 2021-04-09T18:13:07.826 INFO:teuthology.orchestra.run.smithi089.stdout:Section: kernel 2021-04-09T18:13:07.826 INFO:teuthology.orchestra.run.smithi089.stdout:Installed-Size: 17 2021-04-09T18:13:07.826 INFO:teuthology.orchestra.run.smithi089.stdout:Maintainer: Ubuntu Kernel Team 2021-04-09T18:13:07.827 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: amd64 2021-04-09T18:13:07.828 INFO:teuthology.orchestra.run.smithi089.stdout:Source: linux-meta 2021-04-09T18:13:07.829 INFO:teuthology.orchestra.run.smithi089.stdout:Version: 4.15.0.140.127 2021-04-09T18:13:07.829 INFO:teuthology.orchestra.run.smithi089.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-04-09T18:13:07.830 INFO:teuthology.orchestra.run.smithi089.stdout:Depends: linux-image-4.15.0-140-generic, linux-modules-extra-4.15.0-140-generic, linux-firmware, intel-microcode, amd64-microcode 2021-04-09T18:13:07.830 INFO:teuthology.orchestra.run.smithi089.stdout:Recommends: thermald 2021-04-09T18:13:07.831 INFO:teuthology.orchestra.run.smithi089.stdout:Description: Generic Linux kernel image 2021-04-09T18:13:07.832 INFO:teuthology.orchestra.run.smithi089.stdout: This package will always depend on the latest generic kernel image 2021-04-09T18:13:07.832 INFO:teuthology.orchestra.run.smithi089.stdout: available. 2021-04-09T18:13:07.833 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2021-04-09T18:13:07.873 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.IJZuJK6FH0 2021-04-09T18:13:07.874 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /boot/grub/grub.cfg /tmp/tmp.IJZuJK6FH0 2021-04-09T18:13:07.934 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.IJZuJK6FH0 2021-04-09T18:13:08.064 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.IJZuJK6FH0 is 8KB 2021-04-09T18:13:08.168 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.IJZuJK6FH0 2021-04-09T18:13:08.192 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-04-09T18:13:08.263 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2021-04-09T18:13:08.263 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-04-09T18:13:08.265 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-04-09T18:13:08.373 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-140-generic 2021-04-09T18:13:08.374 DEBUG:teuthology.orchestra.run.smithi089:> sudo update-grub 2021-04-09T18:13:09.791 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub' 2021-04-09T18:13:09.813 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2021-04-09T18:13:10.057 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-4.15.0-140-generic 2021-04-09T18:13:10.069 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-4.15.0-140-generic 2021-04-09T18:13:10.411 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-4.15.0-136-generic 2021-04-09T18:13:10.424 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-4.15.0-136-generic 2021-04-09T18:13:11.536 INFO:teuthology.orchestra.run.smithi089.stderr:done 2021-04-09T18:13:11.538 DEBUG:teuthology.orchestra.run.smithi089:> sudo shutdown -r now 2021-04-09T18:13:11.541 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2021-04-09T18:13:11.541 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi090.front.sepia.ceph.com, path=None, version=distro) 2021-04-09T18:13:11.542 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-get clean 2021-04-09T18:13:11.648 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-get update 2021-04-09T18:13:11.898 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-04-09T18:13:11.899 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:2 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-04-09T18:13:11.967 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-04-09T18:13:12.047 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-04-09T18:13:13.758 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2021-04-09T18:13:13.807 DEBUG:teuthology.orchestra.run.smithi090:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-04-09T18:13:13.892 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2021-04-09T18:13:14.137 INFO:teuthology.orchestra.run.smithi090.stdout:Building dependency tree... 2021-04-09T18:13:14.137 INFO:teuthology.orchestra.run.smithi090.stdout:Reading state information... 2021-04-09T18:13:14.219 INFO:teuthology.orchestra.run.smithi090.stderr:E: Unable to locate package linux-image-current-generic 2021-04-09T18:13:14.220 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-04-09T18:13:14.222 DEBUG:teuthology.orchestra.run.smithi090:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-04-09T18:13:14.304 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2021-04-09T18:13:14.566 INFO:teuthology.orchestra.run.smithi090.stdout:Building dependency tree... 2021-04-09T18:13:14.567 INFO:teuthology.orchestra.run.smithi090.stdout:Reading state information... 2021-04-09T18:13:14.769 INFO:teuthology.orchestra.run.smithi090.stdout:linux-image-generic is already the newest version (4.15.0.140.127). 2021-04-09T18:13:14.770 INFO:teuthology.orchestra.run.smithi090.stdout:0 upgraded, 0 newly installed, 0 to remove and 41 not upgraded. 2021-04-09T18:13:14.772 DEBUG:teuthology.orchestra.run.smithi090:> dpkg -s linux-image-generic 2021-04-09T18:13:14.805 INFO:teuthology.orchestra.run.smithi090.stdout:Package: linux-image-generic 2021-04-09T18:13:14.805 INFO:teuthology.orchestra.run.smithi090.stdout:Status: install ok installed 2021-04-09T18:13:14.806 INFO:teuthology.orchestra.run.smithi090.stdout:Priority: optional 2021-04-09T18:13:14.806 INFO:teuthology.orchestra.run.smithi090.stdout:Section: kernel 2021-04-09T18:13:14.807 INFO:teuthology.orchestra.run.smithi090.stdout:Installed-Size: 17 2021-04-09T18:13:14.807 INFO:teuthology.orchestra.run.smithi090.stdout:Maintainer: Ubuntu Kernel Team 2021-04-09T18:13:14.808 INFO:teuthology.orchestra.run.smithi090.stdout:Architecture: amd64 2021-04-09T18:13:14.808 INFO:teuthology.orchestra.run.smithi090.stdout:Source: linux-meta 2021-04-09T18:13:14.808 INFO:teuthology.orchestra.run.smithi090.stdout:Version: 4.15.0.140.127 2021-04-09T18:13:14.862 INFO:teuthology.orchestra.run.smithi090.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-04-09T18:13:14.862 INFO:teuthology.orchestra.run.smithi090.stdout:Depends: linux-image-4.15.0-140-generic, linux-modules-extra-4.15.0-140-generic, linux-firmware, intel-microcode, amd64-microcode 2021-04-09T18:13:14.862 INFO:teuthology.orchestra.run.smithi090.stdout:Recommends: thermald 2021-04-09T18:13:14.863 INFO:teuthology.orchestra.run.smithi090.stdout:Description: Generic Linux kernel image 2021-04-09T18:13:14.863 INFO:teuthology.orchestra.run.smithi090.stdout: This package will always depend on the latest generic kernel image 2021-04-09T18:13:14.863 INFO:teuthology.orchestra.run.smithi090.stdout: available. 2021-04-09T18:13:14.864 DEBUG:teuthology.orchestra.run.smithi090:> mktemp 2021-04-09T18:13:14.873 INFO:teuthology.orchestra.run.smithi090.stdout:/tmp/tmp.ZDgckz5A8Z 2021-04-09T18:13:14.873 DEBUG:teuthology.orchestra.run.smithi090:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ZDgckz5A8Z 2021-04-09T18:13:14.953 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0666 /tmp/tmp.ZDgckz5A8Z 2021-04-09T18:13:15.101 DEBUG:teuthology.orchestra.remote:smithi090:/tmp/tmp.ZDgckz5A8Z is 8KB 2021-04-09T18:13:15.196 DEBUG:teuthology.orchestra.run.smithi090:> rm -fr /tmp/tmp.ZDgckz5A8Z 2021-04-09T18:13:15.218 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-04-09T18:13:15.280 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2021-04-09T18:13:15.281 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-04-09T18:13:15.281 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-04-09T18:13:15.365 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-140-generic 2021-04-09T18:13:15.365 DEBUG:teuthology.orchestra.run.smithi090:> sudo update-grub 2021-04-09T18:13:16.940 INFO:teuthology.orchestra.run.smithi090.stderr:Sourcing file `/etc/default/grub' 2021-04-09T18:13:16.963 INFO:teuthology.orchestra.run.smithi090.stderr:Generating grub configuration file ... 2021-04-09T18:13:17.325 INFO:teuthology.orchestra.run.smithi090.stderr:Found linux image: /boot/vmlinuz-4.15.0-140-generic 2021-04-09T18:13:17.337 INFO:teuthology.orchestra.run.smithi090.stderr:Found initrd image: /boot/initrd.img-4.15.0-140-generic 2021-04-09T18:13:17.812 INFO:teuthology.orchestra.run.smithi090.stderr:Found linux image: /boot/vmlinuz-4.15.0-136-generic 2021-04-09T18:13:17.826 INFO:teuthology.orchestra.run.smithi090.stderr:Found initrd image: /boot/initrd.img-4.15.0-136-generic 2021-04-09T18:13:19.009 INFO:teuthology.orchestra.run.smithi090.stderr:done 2021-04-09T18:13:19.010 DEBUG:teuthology.orchestra.run.smithi090:> sudo shutdown -r now 2021-04-09T18:13:19.013 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2021-04-09T18:13:19.013 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi136.front.sepia.ceph.com, path=None, version=distro) 2021-04-09T18:13:19.014 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get clean 2021-04-09T18:13:19.121 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get update 2021-04-09T18:13:19.260 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-04-09T18:13:19.376 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-04-09T18:13:19.456 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-04-09T18:13:19.545 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-04-09T18:13:21.162 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2021-04-09T18:13:21.211 DEBUG:teuthology.orchestra.run.smithi136:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-04-09T18:13:21.285 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2021-04-09T18:13:21.521 INFO:teuthology.orchestra.run.smithi136.stdout:Building dependency tree... 2021-04-09T18:13:21.522 INFO:teuthology.orchestra.run.smithi136.stdout:Reading state information... 2021-04-09T18:13:21.603 INFO:teuthology.orchestra.run.smithi136.stderr:E: Unable to locate package linux-image-current-generic 2021-04-09T18:13:21.604 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-04-09T18:13:21.605 DEBUG:teuthology.orchestra.run.smithi136:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-04-09T18:13:21.677 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2021-04-09T18:13:21.908 INFO:teuthology.orchestra.run.smithi136.stdout:Building dependency tree... 2021-04-09T18:13:21.909 INFO:teuthology.orchestra.run.smithi136.stdout:Reading state information... 2021-04-09T18:13:22.113 INFO:teuthology.orchestra.run.smithi136.stdout:linux-image-generic is already the newest version (4.15.0.140.127). 2021-04-09T18:13:22.113 INFO:teuthology.orchestra.run.smithi136.stdout:0 upgraded, 0 newly installed, 0 to remove and 41 not upgraded. 2021-04-09T18:13:22.114 DEBUG:teuthology.orchestra.run.smithi136:> dpkg -s linux-image-generic 2021-04-09T18:13:22.173 INFO:teuthology.orchestra.run.smithi136.stdout:Package: linux-image-generic 2021-04-09T18:13:22.173 INFO:teuthology.orchestra.run.smithi136.stdout:Status: install ok installed 2021-04-09T18:13:22.174 INFO:teuthology.orchestra.run.smithi136.stdout:Priority: optional 2021-04-09T18:13:22.175 INFO:teuthology.orchestra.run.smithi136.stdout:Section: kernel 2021-04-09T18:13:22.175 INFO:teuthology.orchestra.run.smithi136.stdout:Installed-Size: 17 2021-04-09T18:13:22.175 INFO:teuthology.orchestra.run.smithi136.stdout:Maintainer: Ubuntu Kernel Team 2021-04-09T18:13:22.175 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: amd64 2021-04-09T18:13:22.176 INFO:teuthology.orchestra.run.smithi136.stdout:Source: linux-meta 2021-04-09T18:13:22.177 INFO:teuthology.orchestra.run.smithi136.stdout:Version: 4.15.0.140.127 2021-04-09T18:13:22.177 INFO:teuthology.orchestra.run.smithi136.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-04-09T18:13:22.177 INFO:teuthology.orchestra.run.smithi136.stdout:Depends: linux-image-4.15.0-140-generic, linux-modules-extra-4.15.0-140-generic, linux-firmware, intel-microcode, amd64-microcode 2021-04-09T18:13:22.177 INFO:teuthology.orchestra.run.smithi136.stdout:Recommends: thermald 2021-04-09T18:13:22.178 INFO:teuthology.orchestra.run.smithi136.stdout:Description: Generic Linux kernel image 2021-04-09T18:13:22.178 INFO:teuthology.orchestra.run.smithi136.stdout: This package will always depend on the latest generic kernel image 2021-04-09T18:13:22.179 INFO:teuthology.orchestra.run.smithi136.stdout: available. 2021-04-09T18:13:22.179 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2021-04-09T18:13:22.220 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.QcdVdF6CGH 2021-04-09T18:13:22.221 DEBUG:teuthology.orchestra.run.smithi136:> sudo cp /boot/grub/grub.cfg /tmp/tmp.QcdVdF6CGH 2021-04-09T18:13:22.286 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.QcdVdF6CGH 2021-04-09T18:13:22.416 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.QcdVdF6CGH is 8KB 2021-04-09T18:13:22.431 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.QcdVdF6CGH 2021-04-09T18:13:22.438 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-04-09T18:13:22.502 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2021-04-09T18:13:22.503 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-04-09T18:13:22.503 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-04-09T18:13:22.584 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-140-generic 2021-04-09T18:13:22.585 DEBUG:teuthology.orchestra.run.smithi136:> sudo update-grub 2021-04-09T18:13:23.806 INFO:teuthology.orchestra.run.smithi136.stderr:Sourcing file `/etc/default/grub' 2021-04-09T18:13:23.827 INFO:teuthology.orchestra.run.smithi136.stderr:Generating grub configuration file ... 2021-04-09T18:13:24.119 INFO:teuthology.orchestra.run.smithi136.stderr:Found linux image: /boot/vmlinuz-4.15.0-140-generic 2021-04-09T18:13:24.130 INFO:teuthology.orchestra.run.smithi136.stderr:Found initrd image: /boot/initrd.img-4.15.0-140-generic 2021-04-09T18:13:24.434 INFO:teuthology.orchestra.run.smithi136.stderr:Found linux image: /boot/vmlinuz-4.15.0-136-generic 2021-04-09T18:13:24.447 INFO:teuthology.orchestra.run.smithi136.stderr:Found initrd image: /boot/initrd.img-4.15.0-136-generic 2021-04-09T18:13:25.551 INFO:teuthology.orchestra.run.smithi136.stderr:done 2021-04-09T18:13:25.552 DEBUG:teuthology.orchestra.run.smithi136:> sudo shutdown -r now 2021-04-09T18:13:25.554 INFO:teuthology.task.kernel:Installing distro kernel on client.2... 2021-04-09T18:13:25.555 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi144.front.sepia.ceph.com, path=None, version=distro) 2021-04-09T18:13:25.555 DEBUG:teuthology.orchestra.run.smithi144:> sudo apt-get clean 2021-04-09T18:13:25.634 DEBUG:teuthology.orchestra.run.smithi144:> sudo apt-get update 2021-04-09T18:13:25.769 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-04-09T18:13:25.880 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-04-09T18:13:25.960 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-04-09T18:13:26.040 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-04-09T18:13:27.666 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2021-04-09T18:13:27.716 DEBUG:teuthology.orchestra.run.smithi144:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-04-09T18:13:27.801 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2021-04-09T18:13:28.054 INFO:teuthology.orchestra.run.smithi144.stdout:Building dependency tree... 2021-04-09T18:13:28.054 INFO:teuthology.orchestra.run.smithi144.stdout:Reading state information... 2021-04-09T18:13:28.141 INFO:teuthology.orchestra.run.smithi144.stderr:E: Unable to locate package linux-image-current-generic 2021-04-09T18:13:28.142 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-04-09T18:13:28.144 DEBUG:teuthology.orchestra.run.smithi144:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-04-09T18:13:28.275 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2021-04-09T18:13:28.548 INFO:teuthology.orchestra.run.smithi144.stdout:Building dependency tree... 2021-04-09T18:13:28.803 INFO:teuthology.orchestra.run.smithi144.stdout:Reading state information... 2021-04-09T18:13:28.805 INFO:teuthology.orchestra.run.smithi144.stdout:linux-image-generic is already the newest version (4.15.0.140.127). 2021-04-09T18:13:28.805 INFO:teuthology.orchestra.run.smithi144.stdout:0 upgraded, 0 newly installed, 0 to remove and 41 not upgraded. 2021-04-09T18:13:28.806 DEBUG:teuthology.orchestra.run.smithi144:> dpkg -s linux-image-generic 2021-04-09T18:13:28.836 INFO:teuthology.orchestra.run.smithi144.stdout:Package: linux-image-generic 2021-04-09T18:13:28.836 INFO:teuthology.orchestra.run.smithi144.stdout:Status: install ok installed 2021-04-09T18:13:28.837 INFO:teuthology.orchestra.run.smithi144.stdout:Priority: optional 2021-04-09T18:13:28.837 INFO:teuthology.orchestra.run.smithi144.stdout:Section: kernel 2021-04-09T18:13:28.837 INFO:teuthology.orchestra.run.smithi144.stdout:Installed-Size: 17 2021-04-09T18:13:28.838 INFO:teuthology.orchestra.run.smithi144.stdout:Maintainer: Ubuntu Kernel Team 2021-04-09T18:13:28.838 INFO:teuthology.orchestra.run.smithi144.stdout:Architecture: amd64 2021-04-09T18:13:28.838 INFO:teuthology.orchestra.run.smithi144.stdout:Source: linux-meta 2021-04-09T18:13:28.838 INFO:teuthology.orchestra.run.smithi144.stdout:Version: 4.15.0.140.127 2021-04-09T18:13:28.838 INFO:teuthology.orchestra.run.smithi144.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-04-09T18:13:28.839 INFO:teuthology.orchestra.run.smithi144.stdout:Depends: linux-image-4.15.0-140-generic, linux-modules-extra-4.15.0-140-generic, linux-firmware, intel-microcode, amd64-microcode 2021-04-09T18:13:28.839 INFO:teuthology.orchestra.run.smithi144.stdout:Recommends: thermald 2021-04-09T18:13:28.839 INFO:teuthology.orchestra.run.smithi144.stdout:Description: Generic Linux kernel image 2021-04-09T18:13:28.840 INFO:teuthology.orchestra.run.smithi144.stdout: This package will always depend on the latest generic kernel image 2021-04-09T18:13:28.840 INFO:teuthology.orchestra.run.smithi144.stdout: available. 2021-04-09T18:13:28.840 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2021-04-09T18:13:28.889 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.8CRwuN4TRb 2021-04-09T18:13:28.890 DEBUG:teuthology.orchestra.run.smithi144:> sudo cp /boot/grub/grub.cfg /tmp/tmp.8CRwuN4TRb 2021-04-09T18:13:28.949 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.8CRwuN4TRb 2021-04-09T18:13:29.097 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.8CRwuN4TRb is 8KB 2021-04-09T18:13:29.227 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.8CRwuN4TRb 2021-04-09T18:13:29.276 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-04-09T18:13:29.343 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2021-04-09T18:13:29.344 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-04-09T18:13:29.360 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-04-09T18:13:29.460 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-140-generic 2021-04-09T18:13:29.461 DEBUG:teuthology.orchestra.run.smithi144:> sudo update-grub 2021-04-09T18:13:30.832 INFO:teuthology.orchestra.run.smithi144.stderr:Sourcing file `/etc/default/grub' 2021-04-09T18:13:30.854 INFO:teuthology.orchestra.run.smithi144.stderr:Generating grub configuration file ... 2021-04-09T18:13:31.120 INFO:teuthology.orchestra.run.smithi144.stderr:Found linux image: /boot/vmlinuz-4.15.0-140-generic 2021-04-09T18:13:31.128 INFO:teuthology.orchestra.run.smithi144.stderr:Found initrd image: /boot/initrd.img-4.15.0-140-generic 2021-04-09T18:13:31.418 INFO:teuthology.orchestra.run.smithi144.stderr:Found linux image: /boot/vmlinuz-4.15.0-136-generic 2021-04-09T18:13:31.430 INFO:teuthology.orchestra.run.smithi144.stderr:Found initrd image: /boot/initrd.img-4.15.0-136-generic 2021-04-09T18:13:32.005 INFO:teuthology.orchestra.run.smithi144.stderr:done 2021-04-09T18:13:32.007 DEBUG:teuthology.orchestra.run.smithi144:> sudo shutdown -r now 2021-04-09T18:14:02.040 INFO:teuthology.misc:Re-opening connections... 2021-04-09T18:14:02.041 INFO:teuthology.misc:trying to connect to ubuntu@smithi079.front.sepia.ceph.com 2021-04-09T18:14:02.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T18:14:02.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:14:36.635 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2021-04-09T18:14:36.636 INFO:teuthology.misc:trying to connect to ubuntu@smithi089.front.sepia.ceph.com 2021-04-09T18:14:36.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T18:14:36.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:14:39.707 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2021-04-09T18:14:39.708 INFO:teuthology.misc:trying to connect to ubuntu@smithi090.front.sepia.ceph.com 2021-04-09T18:14:39.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T18:14:39.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:15:39.775 DEBUG:teuthology.orchestra.remote:timed out 2021-04-09T18:15:39.777 INFO:teuthology.misc:trying to connect to ubuntu@smithi136.front.sepia.ceph.com 2021-04-09T18:15:39.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T18:15:39.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:15:39.968 DEBUG:teuthology.orchestra.run.smithi136:> true 2021-04-09T18:15:40.308 DEBUG:teuthology.misc:waited 98.26710867881775 2021-04-09T18:15:41.309 INFO:teuthology.misc:trying to connect to ubuntu@smithi079.front.sepia.ceph.com 2021-04-09T18:15:41.309 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T18:15:41.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:15:41.391 DEBUG:teuthology.orchestra.run.smithi079:> true 2021-04-09T18:15:41.757 INFO:teuthology.misc:trying to connect to ubuntu@smithi090.front.sepia.ceph.com 2021-04-09T18:15:41.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T18:15:41.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:15:41.887 DEBUG:teuthology.orchestra.run.smithi090:> true 2021-04-09T18:15:42.252 DEBUG:teuthology.misc:waited 100.21170163154602 2021-04-09T18:15:43.253 INFO:teuthology.misc:trying to connect to ubuntu@smithi089.front.sepia.ceph.com 2021-04-09T18:15:43.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T18:15:43.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:15:43.357 DEBUG:teuthology.orchestra.run.smithi089:> true 2021-04-09T18:15:43.721 DEBUG:teuthology.misc:waited 101.68086338043213 2021-04-09T18:15:44.722 INFO:teuthology.misc:trying to connect to ubuntu@smithi144.front.sepia.ceph.com 2021-04-09T18:15:44.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T18:15:44.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:15:44.908 DEBUG:teuthology.orchestra.run.smithi144:> true 2021-04-09T18:15:45.126 DEBUG:teuthology.misc:waited 103.08527493476868 2021-04-09T18:15:46.127 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-04-09T18:15:46.127 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.15.0-140-generic"... 2021-04-09T18:15:46.128 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2021-04-09T18:15:46.136 INFO:teuthology.orchestra.run.smithi079.stdout:4.15.0-140-generic 2021-04-09T18:15:46.137 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-140-generic vs 4.15.0-140-generic 2021-04-09T18:15:46.138 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-04-09T18:15:46.138 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-04-09T18:15:46.139 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-04-09T18:15:46.145 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.15.0-140-generic"... 2021-04-09T18:15:46.147 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2021-04-09T18:15:46.154 INFO:teuthology.orchestra.run.smithi089.stdout:4.15.0-140-generic 2021-04-09T18:15:46.155 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-140-generic vs 4.15.0-140-generic 2021-04-09T18:15:46.155 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-04-09T18:15:46.155 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-04-09T18:15:46.156 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2021-04-09T18:15:46.156 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.15.0-140-generic"... 2021-04-09T18:15:46.156 DEBUG:teuthology.orchestra.run.smithi090:> uname -r 2021-04-09T18:15:46.211 INFO:teuthology.orchestra.run.smithi090.stdout:4.15.0-140-generic 2021-04-09T18:15:46.212 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-140-generic vs 4.15.0-140-generic 2021-04-09T18:15:46.212 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-04-09T18:15:46.213 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-04-09T18:15:46.213 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2021-04-09T18:15:46.214 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.15.0-140-generic"... 2021-04-09T18:15:46.214 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2021-04-09T18:15:46.268 INFO:teuthology.orchestra.run.smithi136.stdout:4.15.0-140-generic 2021-04-09T18:15:46.283 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-140-generic vs 4.15.0-140-generic 2021-04-09T18:15:46.283 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-04-09T18:15:46.284 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-04-09T18:15:46.284 INFO:teuthology.task.kernel:Checking client client.2 for new kernel version... 2021-04-09T18:15:46.285 INFO:teuthology.task.kernel:Checking kernel version of client.2, want "4.15.0-140-generic"... 2021-04-09T18:15:46.286 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2021-04-09T18:15:46.331 INFO:teuthology.orchestra.run.smithi144.stdout:4.15.0-140-generic 2021-04-09T18:15:46.332 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-140-generic vs 4.15.0-140-generic 2021-04-09T18:15:46.333 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-04-09T18:15:46.333 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-04-09T18:15:47.335 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-04-09T18:15:47.335 DEBUG:teuthology.orchestra.run.smithi079:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-04-09T18:15:47.374 INFO:teuthology.orchestra.run.smithi079.stdout:ttyS1 2021-04-09T18:15:47.404 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-04-09T18:15:47.405 DEBUG:teuthology.orchestra.run.smithi089:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-04-09T18:15:47.441 INFO:teuthology.orchestra.run.smithi089.stdout:ttyS1 2021-04-09T18:15:47.472 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2021-04-09T18:15:47.473 DEBUG:teuthology.orchestra.run.smithi090:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-04-09T18:15:47.505 INFO:teuthology.orchestra.run.smithi090.stdout:ttyS1 2021-04-09T18:15:47.528 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2021-04-09T18:15:47.529 DEBUG:teuthology.orchestra.run.smithi136:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-04-09T18:15:47.563 INFO:teuthology.orchestra.run.smithi136.stdout:ttyS1 2021-04-09T18:15:47.588 INFO:teuthology.task.kernel:Enabling kdb on client.2... 2021-04-09T18:15:47.589 DEBUG:teuthology.orchestra.run.smithi144:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-04-09T18:15:47.661 INFO:teuthology.orchestra.run.smithi144.stdout:ttyS1 2021-04-09T18:15:47.688 INFO:teuthology.run_tasks:Running task internal.base... 2021-04-09T18:15:47.698 INFO:teuthology.task.internal:Creating test directory... 2021-04-09T18:15:47.723 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-04-09T18:15:47.730 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-04-09T18:15:47.760 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-04-09T18:15:47.808 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-04-09T18:15:47.846 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-04-09T18:15:47.861 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-04-09T18:15:47.921 INFO:teuthology.run_tasks:Running task internal.archive... 2021-04-09T18:15:48.052 INFO:teuthology.task.internal:Creating archive directory... 2021-04-09T18:15:48.053 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-04-09T18:15:48.075 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-04-09T18:15:48.132 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-04-09T18:15:48.149 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-04-09T18:15:48.153 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-04-09T18:15:48.322 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-04-09T18:15:48.353 INFO:teuthology.task.internal:Enabling coredump saving... 2021-04-09T18:15:48.353 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-04-09T18:15:48.387 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-04-09T18:15:48.400 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-04-09T18:15:48.400 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-04-09T18:15:48.401 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-04-09T18:15:48.438 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-04-09T18:15:48.452 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-04-09T18:15:48.452 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-04-09T18:15:48.452 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-04-09T18:15:48.453 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-04-09T18:15:48.518 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-04-09T18:15:48.553 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-04-09T18:15:48.561 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-04-09T18:15:48.596 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-04-09T18:15:48.605 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-04-09T18:15:48.607 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-04-09T18:15:48.682 INFO:teuthology.task.internal:Configuring sudo... 2021-04-09T18:15:48.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-04-09T18:15:48.718 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-04-09T18:15:48.743 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-04-09T18:15:48.774 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-04-09T18:15:48.785 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-04-09T18:15:48.806 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-04-09T18:15:48.819 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-04-09T18:15:48.819 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-04-09T18:15:48.891 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-04-09T18:15:48.970 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-04-09T18:15:49.010 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-04-09T18:15:49.043 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-04-09T18:15:49.082 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-04-09T18:15:49.110 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-04-09T18:15:49.172 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2021-04-09T18:15:49.173 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-04-09T18:15:49.242 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-04-09T18:15:49.253 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-04-09T18:15:49.303 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2021-04-09T18:15:49.304 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-04-09T18:15:49.401 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-04-09T18:15:49.451 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-04-09T18:15:49.487 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2021-04-09T18:15:49.488 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-04-09T18:15:49.584 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-04-09T18:15:49.592 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-04-09T18:15:49.655 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2021-04-09T18:15:49.656 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-04-09T18:15:49.721 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-04-09T18:15:49.736 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-04-09T18:15:49.791 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2021-04-09T18:15:49.792 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-04-09T18:15:50.133 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2021-04-09T18:15:50.136 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2021-04-09T18:15:50.144 DEBUG:teuthology.orchestra.run.smithi090:> sudo service rsyslog restart 2021-04-09T18:15:50.150 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2021-04-09T18:15:50.152 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2021-04-09T18:15:50.230 INFO:teuthology.run_tasks:Running task internal.timer... 2021-04-09T18:15:50.293 INFO:teuthology.task.internal:Starting timer... 2021-04-09T18:15:50.294 INFO:teuthology.run_tasks:Running task pcp... 2021-04-09T18:15:50.472 INFO:teuthology.run_tasks:Running task selinux... 2021-04-09T18:15:50.568 DEBUG:teuthology.task.selinux:Excluding smithi079: OS 'ubuntu' does not support SELinux 2021-04-09T18:15:50.569 DEBUG:teuthology.task.selinux:Excluding smithi089: OS 'ubuntu' does not support SELinux 2021-04-09T18:15:50.570 DEBUG:teuthology.task.selinux:Excluding smithi090: OS 'ubuntu' does not support SELinux 2021-04-09T18:15:50.570 DEBUG:teuthology.task.selinux:Excluding smithi136: OS 'ubuntu' does not support SELinux 2021-04-09T18:15:50.571 DEBUG:teuthology.task.selinux:Excluding smithi144: OS 'ubuntu' does not support SELinux 2021-04-09T18:15:50.624 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-04-09T18:15:50.624 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-04-09T18:15:50.689 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-04-09T18:15:50.689 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-04-09T18:15:50.800 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2021-04-09T18:15:50.891 INFO:teuthology.repo_utils:Fetching master from origin 2021-04-09T18:15:51.217 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-04-09T18:15:51.403 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-04-09T18:15:51.405 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi079.front.sepia.ceph.com,smithi089.front.sepia.ceph.com,smithi090.front.sepia.ceph.com,smithi136.front.sepia.ceph.com,smithi144.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-04-09T18:15:55.753 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-04-09T18:16:03.886 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-04-09T18:16:22.655 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-04-09T18:16:22.898 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:22 +0000 (0:00:00.418) 0:00:00.418 ********** 2021-04-09T18:16:23.004 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:23 +0000 (0:00:00.105) 0:00:00.524 ********** 2021-04-09T18:16:23.176 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:23 +0000 (0:00:00.171) 0:00:00.695 ********** 2021-04-09T18:16:23.262 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:23 +0000 (0:00:00.085) 0:00:00.780 ********** 2021-04-09T18:16:23.406 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:23 +0000 (0:00:00.145) 0:00:00.926 ********** 2021-04-09T18:16:27.534 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-04-09T18:16:27.536 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 18.04 on host smithi136.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi136.front.sepia.ceph.com] 2021-04-09T18:16:27.749 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:27 +0000 (0:00:04.342) 0:00:05.268 ********** 2021-04-09T18:16:27.807 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 18.04 on host smithi144.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi144.front.sepia.ceph.com] 2021-04-09T18:16:27.842 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 18.04 on host smithi079.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi079.front.sepia.ceph.com] 2021-04-09T18:16:27.978 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 18.04 on host smithi090.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi090.front.sepia.ceph.com] 2021-04-09T18:16:28.071 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 18.04 on host smithi089.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi089.front.sepia.ceph.com] 2021-04-09T18:16:28.929 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:28 +0000 (0:00:01.180) 0:00:06.448 ********** 2021-04-09T18:16:29.332 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:29 +0000 (0:00:00.397) 0:00:06.846 ********** 2021-04-09T18:16:29.458 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:29 +0000 (0:00:00.127) 0:00:06.974 ********** 2021-04-09T18:16:29.616 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:29 +0000 (0:00:00.161) 0:00:07.136 ********** 2021-04-09T18:16:29.680 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-04-09T18:16:29.682 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-04-09T18:16:29.851 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:29 +0000 (0:00:00.234) 0:00:07.370 ********** 2021-04-09T18:16:29.919 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-04-09T18:16:29.936 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-04-09T18:16:30.087 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:30 +0000 (0:00:00.235) 0:00:07.606 ********** 2021-04-09T18:16:30.114 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:30 +0000 (0:00:00.026) 0:00:07.633 ********** 2021-04-09T18:16:30.125 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-04-09T18:16:30.290 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:30 +0000 (0:00:00.176) 0:00:07.810 ********** 2021-04-09T18:16:30.347 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-04-09T18:16:30.496 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:30 +0000 (0:00:00.205) 0:00:08.016 ********** 2021-04-09T18:16:33.235 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** changed: [smithi090.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-04-09T18:16:33.386 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:33 +0000 (0:00:02.889) 0:00:10.905 ********** 2021-04-09T18:16:33.435 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-04-09T18:16:33.462 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-04-09T18:16:33.464 INFO:teuthology.task.ansible.out: 2021-04-09T18:16:33.492 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-04-09T18:16:33.505 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-04-09T18:16:33.794 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:33 +0000 (0:00:00.408) 0:00:11.313 ********** 2021-04-09T18:16:33.804 INFO:teuthology.task.ansible.out: 2021-04-09T18:16:34.094 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:34 +0000 (0:00:00.299) 0:00:11.613 ********** 2021-04-09T18:16:34.415 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:34 +0000 (0:00:00.321) 0:00:11.934 ********** 2021-04-09T18:16:34.595 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:34 +0000 (0:00:00.179) 0:00:12.114 ********** 2021-04-09T18:16:34.635 INFO:teuthology.task.ansible.out: 2021-04-09T18:16:36.237 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-04-09T18:16:36.241 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.079297", "end": "2021-04-09 18:16:36.544109", "rc": 0, "start": "2021-04-09 18:16:36.464812", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} changed: [smithi144.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.089998", "end": "2021-04-09 18:16:35.908683", "rc": 0, "start": "2021-04-09 18:16:35.818685", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-04-09T18:16:36.346 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:36 +0000 (0:00:01.751) 0:00:13.865 ********** 2021-04-09T18:16:36.632 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:36 +0000 (0:00:00.285) 0:00:14.151 ********** 2021-04-09T18:16:36.690 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.067020", "end": "2021-04-09 18:16:36.210666", "rc": 0, "start": "2021-04-09 18:16:36.143646", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-04-09T18:16:36.694 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.133317", "end": "2021-04-09 18:16:35.867165", "rc": 0, "start": "2021-04-09 18:16:35.733848", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-04-09T18:16:36.740 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.145631", "end": "2021-04-09 18:16:36.313458", "rc": 0, "start": "2021-04-09 18:16:36.167827", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-04-09T18:16:36.948 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:36 +0000 (0:00:00.315) 0:00:14.467 ********** 2021-04-09T18:16:37.064 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:37 +0000 (0:00:00.116) 0:00:14.584 ********** 2021-04-09T18:16:37.168 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:37 +0000 (0:00:00.103) 0:00:14.687 ********** 2021-04-09T18:16:39.637 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-04-09T18:16:39.639 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:16:39.792 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:39 +0000 (0:00:02.623) 0:00:17.311 ********** 2021-04-09T18:16:39.799 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:16:39.812 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:16:39.813 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:16:39.814 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:16:39.875 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:39 +0000 (0:00:00.082) 0:00:17.394 ********** 2021-04-09T18:16:40.212 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:40 +0000 (0:00:00.336) 0:00:17.731 ********** 2021-04-09T18:16:40.425 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:40 +0000 (0:00:00.213) 0:00:17.945 ********** 2021-04-09T18:16:40.674 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:40 +0000 (0:00:00.248) 0:00:18.193 ********** 2021-04-09T18:16:46.539 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-04-09T18:16:46.542 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992201.060285-17459-267278312228376/source", "state": "file", "uid": 0} 2021-04-09T18:16:46.705 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:46 +0000 (0:00:06.031) 0:00:24.224 ********** 2021-04-09T18:16:46.875 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992200.5238245-17336-30750588567803/source", "state": "file", "uid": 0} 2021-04-09T18:16:46.877 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992200.0942974-17220-98047490253816/source", "state": "file", "uid": 0} 2021-04-09T18:16:46.880 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992200.7070003-17393-225287793289084/source", "state": "file", "uid": 0} 2021-04-09T18:16:46.882 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992200.3791287-17253-147403473357056/source", "state": "file", "uid": 0} 2021-04-09T18:16:47.072 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:47 +0000 (0:00:00.365) 0:00:24.590 ********** 2021-04-09T18:16:47.313 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:47 +0000 (0:00:00.242) 0:00:24.833 ********** 2021-04-09T18:16:47.467 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:47 +0000 (0:00:00.153) 0:00:24.986 ********** 2021-04-09T18:16:47.712 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:47 +0000 (0:00:00.245) 0:00:25.231 ********** 2021-04-09T18:16:50.638 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-04-09T18:16:50.644 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-04-09T18:16:50.646 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-04-09T18:16:50.732 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-04-09T18:16:50.734 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-04-09T18:16:50.954 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-04-09T18:16:50.956 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-04-09T18:16:50.964 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-04-09T18:16:50.968 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2021-04-09T18:16:50.970 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2021-04-09T18:16:50.972 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-04-09T18:16:51.864 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-04-09T18:16:51.867 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-04-09T18:16:53.960 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:53 +0000 (0:00:06.247) 0:00:31.479 ********** 2021-04-09T18:16:54.129 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:54 +0000 (0:00:00.169) 0:00:31.648 ********** 2021-04-09T18:16:54.304 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:54 +0000 (0:00:00.175) 0:00:31.824 ********** 2021-04-09T18:16:54.377 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:54 +0000 (0:00:00.072) 0:00:31.896 ********** 2021-04-09T18:16:54.567 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:54 +0000 (0:00:00.189) 0:00:32.086 ********** 2021-04-09T18:16:55.235 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-04-09T18:16:55.236 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] 2021-04-09T18:16:55.527 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] 2021-04-09T18:16:55.671 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] 2021-04-09T18:16:55.801 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] 2021-04-09T18:16:55.858 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] 2021-04-09T18:16:56.125 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Friday 09 April 2021 18:16:56 +0000 (0:00:01.558) 0:00:33.645 ********** 2021-04-09T18:16:56.968 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:56 +0000 (0:00:00.842) 0:00:34.488 ********** 2021-04-09T18:16:57.264 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:57 +0000 (0:00:00.296) 0:00:34.784 ********** 2021-04-09T18:16:57.533 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:57 +0000 (0:00:00.268) 0:00:35.052 ********** 2021-04-09T18:16:57.548 INFO:teuthology.task.ansible.out: 2021-04-09T18:16:57.743 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:57 +0000 (0:00:00.209) 0:00:35.262 ********** 2021-04-09T18:16:59.134 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-04-09T18:16:59.136 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.796534", "end": "2021-04-09 18:16:58.936857", "rc": 0, "start": "2021-04-09 18:16:58.140323", "stderr": "", "stderr_lines": [], "stdout": "5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232", "stdout_lines": ["5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232"]} 2021-04-09T18:16:59.221 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:59 +0000 (0:00:01.478) 0:00:36.740 ********** 2021-04-09T18:16:59.644 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008664", "end": "2021-04-09 18:16:59.201549", "failed_when_result": false, "rc": 0, "start": "2021-04-09 18:16:59.192885", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-04-09T18:16:59.728 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:16:59 +0000 (0:00:00.506) 0:00:37.247 ********** 2021-04-09T18:16:59.980 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-04-09T18:16:59.983 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.527705", "end": "2021-04-09 18:16:59.865126", "rc": 0, "start": "2021-04-09 18:16:59.337421", "stderr": "", "stderr_lines": [], "stdout": "5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232", "stdout_lines": ["5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232"]} 2021-04-09T18:17:00.152 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:00 +0000 (0:00:00.423) 0:00:37.671 ********** 2021-04-09T18:17:00.311 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:00.428 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:00 +0000 (0:00:00.276) 0:00:37.948 ********** 2021-04-09T18:17:00.470 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-04-09T18:17:00.472 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.529504", "end": "2021-04-09 18:17:00.240488", "rc": 0, "start": "2021-04-09 18:16:59.710984", "stderr": "", "stderr_lines": [], "stdout": "5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232", "stdout_lines": ["5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232"]} 2021-04-09T18:17:00.614 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:00 +0000 (0:00:00.185) 0:00:38.133 ********** 2021-04-09T18:17:00.645 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-04-09T18:17:00.647 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.004351", "end": "2021-04-09 18:17:00.539941", "failed_when_result": false, "rc": 0, "start": "2021-04-09 18:17:00.535590", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-04-09T18:17:00.853 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:00 +0000 (0:00:00.239) 0:00:38.372 ********** 2021-04-09T18:17:00.878 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-04-09T18:17:00.881 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.617349", "end": "2021-04-09 18:17:00.603411", "rc": 0, "start": "2021-04-09 18:16:59.986062", "stderr": "", "stderr_lines": [], "stdout": "5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232", "stdout_lines": ["5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232"]} 2021-04-09T18:17:00.914 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.644626", "end": "2021-04-09 18:17:00.717549", "rc": 0, "start": "2021-04-09 18:17:00.072923", "stderr": "", "stderr_lines": [], "stdout": "5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232", "stdout_lines": ["5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232"]} 2021-04-09T18:17:01.092 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:01 +0000 (0:00:00.238) 0:00:38.611 ********** 2021-04-09T18:17:01.245 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:01 +0000 (0:00:00.152) 0:00:38.764 ********** 2021-04-09T18:17:01.286 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-04-09T18:17:01.288 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi089.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.015687", "end": "2021-04-09 18:17:01.055388", "failed_when_result": false, "rc": 0, "start": "2021-04-09 18:17:01.039701", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-04-09T18:17:01.487 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:01 +0000 (0:00:00.242) 0:00:39.007 ********** 2021-04-09T18:17:01.768 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:01 +0000 (0:00:00.281) 0:00:39.288 ********** 2021-04-09T18:17:01.842 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.010811", "end": "2021-04-09 18:17:01.769881", "failed_when_result": false, "rc": 0, "start": "2021-04-09 18:17:01.759070", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-04-09T18:17:01.844 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:01.858 INFO:teuthology.task.ansible.out:TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-04-09T18:17:01.860 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:01.864 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:01.869 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:01.871 INFO:teuthology.task.ansible.out:TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi144.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.016260", "end": "2021-04-09 18:17:01.530913", "failed_when_result": false, "rc": 0, "start": "2021-04-09 18:17:01.514653", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-04-09T18:17:01.875 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:02.044 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:02 +0000 (0:00:00.275) 0:00:39.563 ********** 2021-04-09T18:17:02.335 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:02 +0000 (0:00:00.290) 0:00:39.854 ********** 2021-04-09T18:17:02.588 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:02 +0000 (0:00:00.252) 0:00:40.107 ********** 2021-04-09T18:17:02.626 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-04-09T18:17:02.628 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:02.724 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-04-09T18:17:02.726 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:02.901 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:02 +0000 (0:00:00.301) 0:00:40.409 ********** 2021-04-09T18:17:03.123 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:03 +0000 (0:00:00.233) 0:00:40.642 ********** 2021-04-09T18:17:03.176 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-04-09T18:17:03.178 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:03.326 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:03 +0000 (0:00:00.203) 0:00:40.846 ********** 2021-04-09T18:17:03.464 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:03 +0000 (0:00:00.137) 0:00:40.983 ********** 2021-04-09T18:17:03.500 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:03.565 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:03 +0000 (0:00:00.100) 0:00:41.084 ********** 2021-04-09T18:17:03.596 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:03.598 INFO:teuthology.task.ansible.out:TASK [Filter the managed_users list] ******************************************* skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:03.622 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:03.800 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:03 +0000 (0:00:00.234) 0:00:41.319 ********** 2021-04-09T18:17:03.863 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:03.872 INFO:teuthology.task.ansible.out:TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-04-09T18:17:03.876 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:03.877 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:03.974 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:03 +0000 (0:00:00.174) 0:00:41.493 ********** 2021-04-09T18:17:03.995 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-04-09T18:17:03.997 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:04.205 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:04 +0000 (0:00:00.231) 0:00:41.725 ********** 2021-04-09T18:17:04.259 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-04-09T18:17:04.261 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:04.366 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:04 +0000 (0:00:00.160) 0:00:41.886 ********** 2021-04-09T18:17:04.373 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:04.611 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:04 +0000 (0:00:00.244) 0:00:42.130 ********** 2021-04-09T18:17:04.650 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-04-09T18:17:04.653 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove managed_admin_users from managed_users] *************************** 2021-04-09T18:17:04.676 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:04.920 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:04 +0000 (0:00:00.308) 0:00:42.439 ********** 2021-04-09T18:17:05.085 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:05 +0000 (0:00:00.165) 0:00:42.605 ********** 2021-04-09T18:17:05.118 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:05.177 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:05.178 INFO:teuthology.task.ansible.out:TASK [Filter the managed_users list] ******************************************* 2021-04-09T18:17:05.179 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:05.180 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:05.182 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:05.182 INFO:teuthology.task.ansible.out:TASK [Remove managed_admin_users from managed_users] *************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:05.187 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:05.189 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:05.191 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:05.341 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:05 +0000 (0:00:00.255) 0:00:42.861 ********** 2021-04-09T18:17:05.729 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:05 +0000 (0:00:00.387) 0:00:43.248 ********** 2021-04-09T18:17:05.731 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:05.959 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:05 +0000 (0:00:00.230) 0:00:43.479 ********** 2021-04-09T18:17:06.000 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-04-09T18:17:06.001 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:06.024 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-04-09T18:17:06.025 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:17:06.081 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:06 +0000 (0:00:00.120) 0:00:43.600 ********** 2021-04-09T18:17:06.347 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:06 +0000 (0:00:00.266) 0:00:43.866 ********** 2021-04-09T18:17:06.440 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-04-09T18:17:06.442 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:06.444 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:06.589 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:06 +0000 (0:00:00.241) 0:00:44.108 ********** 2021-04-09T18:17:06.591 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:06.854 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:06 +0000 (0:00:00.265) 0:00:44.374 ********** 2021-04-09T18:17:06.894 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:06.944 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:06.947 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:07.163 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:07 +0000 (0:00:00.302) 0:00:44.683 ********** 2021-04-09T18:17:07.432 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:07 +0000 (0:00:00.263) 0:00:44.952 ********** 2021-04-09T18:17:07.557 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-04-09T18:17:07.561 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-04-09T18:17:07.564 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-04-09T18:17:07.588 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:17:07.592 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:07.597 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:07.598 INFO:teuthology.task.ansible.out:TASK [Filter the managed_admin_users list] ************************************* 2021-04-09T18:17:07.600 INFO:teuthology.task.ansible.out: skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:07.748 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:07 +0000 (0:00:00.315) 0:00:45.268 ********** 2021-04-09T18:17:07.750 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:07.957 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:07 +0000 (0:00:00.208) 0:00:45.476 ********** 2021-04-09T18:17:07.987 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-04-09T18:17:08.045 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-04-09T18:17:08.093 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-04-09T18:17:08.094 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:17:08.213 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:08 +0000 (0:00:00.255) 0:00:45.732 ********** 2021-04-09T18:17:08.276 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-04-09T18:17:08.295 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-04-09T18:17:08.302 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-04-09T18:17:08.304 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:17:08.381 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:08 +0000 (0:00:00.168) 0:00:45.901 ********** 2021-04-09T18:17:08.485 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-04-09T18:17:08.487 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-04-09T18:17:08.751 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-04-09T18:17:08.753 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:08.963 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-04-09T18:17:08.966 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:17:09.070 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:09 +0000 (0:00:00.688) 0:00:46.589 ********** 2021-04-09T18:17:09.097 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:09.154 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-04-09T18:17:09.196 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-04-09T18:17:09.206 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:09.224 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-04-09T18:17:09.226 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:09.257 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-04-09T18:17:09.262 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:09.397 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-04-09T18:17:09.398 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:09.423 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-04-09T18:17:09.425 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:09.438 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:09.441 INFO:teuthology.task.ansible.out:TASK [users : Set UID_MIN to 1001] ********************************************* ok: [smithi144.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:17:09.564 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:09 +0000 (0:00:00.494) 0:00:47.084 ********** 2021-04-09T18:17:09.582 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:09.635 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-04-09T18:17:09.638 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-04-09T18:17:09.666 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-04-09T18:17:09.668 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:09.799 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-04-09T18:17:09.803 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:09.902 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-04-09T18:17:10.058 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-04-09T18:17:10.070 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-04-09T18:17:10.157 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-04-09T18:17:10.204 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-04-09T18:17:10.272 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-04-09T18:17:10.350 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-04-09T18:17:10.439 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-04-09T18:17:10.559 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-04-09T18:17:10.604 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-04-09T18:17:10.606 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:10.628 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-04-09T18:17:10.630 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:10.673 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-04-09T18:17:10.847 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-04-09T18:17:10.848 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:10.894 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-04-09T18:17:10.896 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:10.982 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-04-09T18:17:10.984 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:11.009 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-04-09T18:17:11.012 INFO:teuthology.task.ansible.out: ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-04-09T18:17:11.014 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:11.262 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-04-09T18:17:11.263 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:11.266 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-04-09T18:17:11.269 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:11.322 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-04-09T18:17:11.336 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-04-09T18:17:11.363 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-04-09T18:17:11.511 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-04-09T18:17:11.602 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-04-09T18:17:11.637 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-04-09T18:17:11.646 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-04-09T18:17:11.835 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-04-09T18:17:11.880 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-04-09T18:17:11.913 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-04-09T18:17:11.936 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-04-09T18:17:11.991 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-04-09T18:17:12.210 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-04-09T18:17:12.234 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-04-09T18:17:12.299 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-04-09T18:17:12.389 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-04-09T18:17:12.445 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-04-09T18:17:12.555 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-04-09T18:17:12.643 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-04-09T18:17:12.677 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-04-09T18:17:12.718 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-04-09T18:17:12.839 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-04-09T18:17:12.940 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-04-09T18:17:12.953 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-04-09T18:17:12.965 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-04-09T18:17:12.990 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-04-09T18:17:13.170 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-04-09T18:17:13.241 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-04-09T18:17:13.275 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-04-09T18:17:13.396 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-04-09T18:17:13.418 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-04-09T18:17:13.517 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-04-09T18:17:13.540 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-04-09T18:17:13.564 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-04-09T18:17:13.746 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-04-09T18:17:13.803 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-04-09T18:17:13.840 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-04-09T18:17:13.897 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-04-09T18:17:13.908 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-04-09T18:17:14.053 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-04-09T18:17:14.109 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-04-09T18:17:14.232 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-04-09T18:17:14.244 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-04-09T18:17:14.256 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-04-09T18:17:14.328 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-04-09T18:17:14.375 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-04-09T18:17:14.495 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-04-09T18:17:14.677 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-04-09T18:17:14.689 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-04-09T18:17:14.713 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-04-09T18:17:14.824 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-04-09T18:17:14.847 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-04-09T18:17:14.990 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-04-09T18:17:15.034 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-04-09T18:17:15.178 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-04-09T18:17:15.203 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-04-09T18:17:15.239 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-04-09T18:17:15.307 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-04-09T18:17:15.571 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-04-09T18:17:15.587 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-04-09T18:17:15.598 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-04-09T18:17:15.654 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-04-09T18:17:15.852 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-04-09T18:17:15.967 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-04-09T18:17:15.969 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-04-09T18:17:15.993 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-04-09T18:17:16.024 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-04-09T18:17:16.179 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-04-09T18:17:16.325 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-04-09T18:17:16.349 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-04-09T18:17:16.374 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-04-09T18:17:16.386 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-04-09T18:17:16.649 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-04-09T18:17:16.759 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-04-09T18:17:16.793 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-04-09T18:17:16.893 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-04-09T18:17:17.024 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-04-09T18:17:17.036 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-04-09T18:17:17.159 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-04-09T18:17:17.194 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-04-09T18:17:17.262 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-04-09T18:17:17.296 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-04-09T18:17:17.427 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-04-09T18:17:17.443 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-04-09T18:17:17.466 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-04-09T18:17:17.533 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-04-09T18:17:17.632 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-04-09T18:17:17.730 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-04-09T18:17:17.765 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-04-09T18:17:17.780 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-04-09T18:17:17.793 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-04-09T18:17:18.055 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-04-09T18:17:18.079 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-04-09T18:17:18.115 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-04-09T18:17:18.234 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-04-09T18:17:18.397 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-04-09T18:17:18.410 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-04-09T18:17:18.433 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-04-09T18:17:18.459 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-04-09T18:17:18.548 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-04-09T18:17:18.550 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:18.627 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-04-09T18:17:18.684 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-04-09T18:17:18.707 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-04-09T18:17:18.774 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-04-09T18:17:18.830 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-04-09T18:17:18.896 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-04-09T18:17:19.099 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-04-09T18:17:19.133 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-04-09T18:17:19.148 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-04-09T18:17:19.150 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:19.229 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-04-09T18:17:19.453 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-04-09T18:17:19.477 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-04-09T18:17:19.512 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-04-09T18:17:19.547 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-04-09T18:17:19.658 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-04-09T18:17:19.765 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-04-09T18:17:19.770 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-04-09T18:17:19.804 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-04-09T18:17:19.869 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-04-09T18:17:20.026 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-04-09T18:17:20.060 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-04-09T18:17:20.088 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-04-09T18:17:20.119 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-04-09T18:17:20.216 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-04-09T18:17:20.217 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:20.395 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-04-09T18:17:20.398 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-04-09T18:17:20.442 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-04-09T18:17:20.455 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-04-09T18:17:20.467 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-04-09T18:17:20.666 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-04-09T18:17:20.669 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:20.690 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-04-09T18:17:20.713 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-04-09T18:17:20.726 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-04-09T18:17:20.910 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-04-09T18:17:21.010 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-04-09T18:17:21.047 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-04-09T18:17:21.060 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-04-09T18:17:21.073 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-04-09T18:17:21.271 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-04-09T18:17:21.328 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-04-09T18:17:21.331 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-04-09T18:17:21.356 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-04-09T18:17:21.423 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-04-09T18:17:21.587 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-04-09T18:17:21.624 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-04-09T18:17:21.690 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-04-09T18:17:21.741 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-04-09T18:17:21.844 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-04-09T18:17:21.855 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-04-09T18:17:21.943 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-04-09T18:17:22.020 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-04-09T18:17:22.151 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-04-09T18:17:22.164 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-04-09T18:17:22.177 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-04-09T18:17:22.213 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-04-09T18:17:22.312 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-04-09T18:17:22.475 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-04-09T18:17:22.499 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-04-09T18:17:22.543 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-04-09T18:17:22.577 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-04-09T18:17:22.613 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-04-09T18:17:22.798 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-04-09T18:17:22.886 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-04-09T18:17:22.888 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-04-09T18:17:22.901 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-04-09T18:17:22.948 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-04-09T18:17:23.155 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-04-09T18:17:23.160 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-04-09T18:17:23.245 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-04-09T18:17:23.271 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-04-09T18:17:23.313 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-04-09T18:17:23.445 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-04-09T18:17:23.512 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-04-09T18:17:23.546 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-04-09T18:17:23.578 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-04-09T18:17:23.621 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-04-09T18:17:23.752 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-04-09T18:17:23.818 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-04-09T18:17:23.842 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-04-09T18:17:23.930 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-04-09T18:17:24.121 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-04-09T18:17:24.209 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-04-09T18:17:24.231 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-04-09T18:17:24.401 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-04-09T18:17:24.480 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-04-09T18:17:24.515 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-04-09T18:17:24.571 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-04-09T18:17:24.574 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-04-09T18:17:24.696 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-04-09T18:17:24.795 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-04-09T18:17:24.851 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-04-09T18:17:24.885 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-04-09T18:17:24.973 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-04-09T18:17:25.044 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-04-09T18:17:25.113 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-04-09T18:17:25.144 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-04-09T18:17:25.197 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-04-09T18:17:25.255 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-04-09T18:17:25.438 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-04-09T18:17:25.450 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-04-09T18:17:25.461 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-04-09T18:17:25.462 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-04-09T18:17:25.630 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-04-09T18:17:25.739 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-04-09T18:17:25.763 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-04-09T18:17:25.776 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-04-09T18:17:25.778 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-04-09T18:17:26.006 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-04-09T18:17:26.018 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-04-09T18:17:26.160 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-04-09T18:17:26.204 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-04-09T18:17:26.206 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-04-09T18:17:26.279 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-04-09T18:17:26.369 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-04-09T18:17:26.425 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-04-09T18:17:26.437 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-04-09T18:17:26.671 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-04-09T18:17:26.684 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-04-09T18:17:26.686 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-04-09T18:17:26.703 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-04-09T18:17:26.737 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-04-09T18:17:27.019 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-04-09T18:17:27.066 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-04-09T18:17:27.079 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-04-09T18:17:27.092 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-04-09T18:17:27.138 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-04-09T18:17:27.343 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-04-09T18:17:27.356 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-04-09T18:17:27.369 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-04-09T18:17:27.414 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-04-09T18:17:27.452 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-04-09T18:17:27.675 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-04-09T18:17:27.679 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-04-09T18:17:27.746 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-04-09T18:17:27.836 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-04-09T18:17:27.955 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-04-09T18:17:27.957 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-04-09T18:17:28.022 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-04-09T18:17:28.089 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-04-09T18:17:28.210 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-04-09T18:17:28.331 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-04-09T18:17:28.344 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-04-09T18:17:28.400 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-04-09T18:17:28.487 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-04-09T18:17:28.511 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-04-09T18:17:28.609 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-04-09T18:17:28.688 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-04-09T18:17:28.711 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-04-09T18:17:28.724 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-04-09T18:17:28.898 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-04-09T18:17:28.900 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-04-09T18:17:28.956 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-04-09T18:17:29.040 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-04-09T18:17:29.165 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-04-09T18:17:29.234 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-04-09T18:17:29.236 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-04-09T18:17:29.250 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-04-09T18:17:29.403 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-04-09T18:17:29.427 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-04-09T18:17:29.558 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-04-09T18:17:29.571 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-04-09T18:17:29.671 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-04-09T18:17:29.684 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-04-09T18:17:29.742 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-04-09T18:17:29.841 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-04-09T18:17:29.908 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-04-09T18:17:30.055 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-04-09T18:17:30.284 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-04-09T18:17:30.286 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-04-09T18:17:30.310 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-04-09T18:17:30.387 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-04-09T18:17:30.524 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-04-09T18:17:30.527 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-04-09T18:17:30.624 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-04-09T18:17:30.636 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-04-09T18:17:30.671 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-04-09T18:17:30.843 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-04-09T18:17:30.910 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-04-09T18:17:30.922 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-04-09T18:17:30.968 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-04-09T18:17:31.056 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-04-09T18:17:31.145 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-04-09T18:17:31.161 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-04-09T18:17:31.245 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-04-09T18:17:31.249 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-04-09T18:17:31.284 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-04-09T18:17:31.492 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-04-09T18:17:31.611 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-04-09T18:17:31.613 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-04-09T18:17:31.617 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-04-09T18:17:31.641 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-04-09T18:17:31.770 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-04-09T18:17:31.866 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-04-09T18:17:31.900 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-04-09T18:17:31.916 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-04-09T18:17:31.929 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-04-09T18:17:32.039 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-04-09T18:17:32.169 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-04-09T18:17:32.180 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-04-09T18:17:32.278 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-04-09T18:17:32.315 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-04-09T18:17:32.415 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-04-09T18:17:32.527 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-04-09T18:17:32.610 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-04-09T18:17:32.704 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-04-09T18:17:32.763 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-04-09T18:17:32.998 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-04-09T18:17:33.000 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-04-09T18:17:33.033 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-04-09T18:17:33.086 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-04-09T18:17:33.346 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-04-09T18:17:33.360 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-04-09T18:17:33.373 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-04-09T18:17:33.409 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-04-09T18:17:33.478 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-04-09T18:17:33.615 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-04-09T18:17:33.697 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-04-09T18:17:33.774 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-04-09T18:17:33.830 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-04-09T18:17:33.992 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-04-09T18:17:34.015 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-04-09T18:17:34.029 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-04-09T18:17:34.263 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-04-09T18:17:34.265 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-04-09T18:17:34.268 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-04-09T18:17:34.271 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-04-09T18:17:34.273 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:34.299 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-04-09T18:17:34.523 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-04-09T18:17:34.556 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-04-09T18:17:34.579 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-04-09T18:17:34.614 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-04-09T18:17:34.648 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-04-09T18:17:34.854 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-04-09T18:17:34.891 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-04-09T18:17:34.990 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-04-09T18:17:35.092 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-04-09T18:17:35.314 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-04-09T18:17:35.336 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-04-09T18:17:35.349 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-04-09T18:17:35.370 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-04-09T18:17:35.417 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-04-09T18:17:35.543 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-04-09T18:17:35.589 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-04-09T18:17:35.591 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:35.594 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-04-09T18:17:35.687 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-04-09T18:17:35.786 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-04-09T18:17:35.791 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:35.906 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-04-09T18:17:35.918 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-04-09T18:17:35.930 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-04-09T18:17:36.068 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-04-09T18:17:36.082 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-04-09T18:17:36.281 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-04-09T18:17:36.315 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-04-09T18:17:36.341 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-04-09T18:17:36.386 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-04-09T18:17:36.388 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-04-09T18:17:36.580 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-04-09T18:17:36.640 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-04-09T18:17:36.643 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:36.668 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-04-09T18:17:36.670 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:36.716 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-04-09T18:17:36.761 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-04-09T18:17:36.874 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-04-09T18:17:37.063 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-04-09T18:17:37.085 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-04-09T18:17:37.140 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-04-09T18:17:37.333 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-04-09T18:17:37.352 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-04-09T18:17:37.429 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-04-09T18:17:37.480 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-04-09T18:17:37.590 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-04-09T18:17:37.691 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-04-09T18:17:37.737 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-04-09T18:17:37.782 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-04-09T18:17:37.805 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-04-09T18:17:38.023 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-04-09T18:17:38.046 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-04-09T18:17:38.087 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-04-09T18:17:38.107 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-04-09T18:17:38.204 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-04-09T18:17:38.331 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-04-09T18:17:38.418 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-04-09T18:17:38.462 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-04-09T18:17:38.486 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-04-09T18:17:38.541 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-04-09T18:17:38.543 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:38.598 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-04-09T18:17:38.727 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-04-09T18:17:38.736 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:38.799 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-04-09T18:17:38.821 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-04-09T18:17:38.824 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:38.836 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-04-09T18:17:38.925 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-04-09T18:17:39.136 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-04-09T18:17:39.147 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-04-09T18:17:39.202 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-04-09T18:17:39.310 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-04-09T18:17:39.328 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-04-09T18:17:39.453 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-04-09T18:17:39.455 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-04-09T18:17:39.479 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-04-09T18:17:39.611 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-04-09T18:17:39.664 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-04-09T18:17:39.688 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-04-09T18:17:39.828 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-04-09T18:17:39.836 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-04-09T18:17:39.871 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-04-09T18:17:40.026 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-04-09T18:17:40.116 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-04-09T18:17:40.128 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-04-09T18:17:40.182 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-04-09T18:17:40.183 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-04-09T18:17:40.324 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-04-09T18:17:40.433 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-04-09T18:17:40.456 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-04-09T18:17:40.458 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-04-09T18:17:40.468 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-04-09T18:17:40.703 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-04-09T18:17:40.772 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-04-09T18:17:40.783 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-04-09T18:17:40.798 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-04-09T18:17:40.800 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-04-09T18:17:41.039 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-04-09T18:17:41.084 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-04-09T18:17:41.086 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-04-09T18:17:41.110 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-04-09T18:17:41.112 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:41.274 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-04-09T18:17:41.395 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-04-09T18:17:41.419 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-04-09T18:17:41.432 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-04-09T18:17:41.434 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:41.449 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-04-09T18:17:41.576 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-04-09T18:17:41.765 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-04-09T18:17:41.766 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:41.779 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-04-09T18:17:41.781 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:41.782 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-04-09T18:17:41.823 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-04-09T18:17:41.825 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:41.876 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-04-09T18:17:42.004 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-04-09T18:17:42.080 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-04-09T18:17:42.081 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:42.094 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-04-09T18:17:42.098 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:42.100 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-04-09T18:17:42.227 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-04-09T18:17:42.331 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-04-09T18:17:42.388 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-04-09T18:17:42.391 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:42.426 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-04-09T18:17:42.429 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:42.431 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-04-09T18:17:42.433 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:42.523 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-04-09T18:17:42.755 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-04-09T18:17:42.768 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-04-09T18:17:42.772 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-04-09T18:17:42.774 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-04-09T18:17:42.831 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-04-09T18:17:43.065 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-04-09T18:17:43.138 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-04-09T18:17:43.140 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-04-09T18:17:43.142 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-04-09T18:17:43.208 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-04-09T18:17:43.403 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-04-09T18:17:43.432 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-04-09T18:17:43.444 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-04-09T18:17:43.630 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-04-09T18:17:43.632 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-04-09T18:17:43.644 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-04-09T18:17:43.699 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-04-09T18:17:43.814 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-04-09T18:17:43.892 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-04-09T18:17:43.905 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-04-09T18:17:43.987 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-04-09T18:17:44.033 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-04-09T18:17:44.215 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-04-09T18:17:44.240 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-04-09T18:17:44.252 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-04-09T18:17:44.265 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-04-09T18:17:44.363 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-04-09T18:17:44.529 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-04-09T18:17:44.542 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-04-09T18:17:44.651 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-04-09T18:17:44.652 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-04-09T18:17:44.666 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-04-09T18:17:44.760 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-04-09T18:17:44.925 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-04-09T18:17:44.970 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-04-09T18:17:44.972 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-04-09T18:17:44.973 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:44.986 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-04-09T18:17:45.025 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-04-09T18:17:45.195 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-04-09T18:17:45.258 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-04-09T18:17:45.320 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-04-09T18:17:45.397 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-04-09T18:17:45.422 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-04-09T18:17:45.489 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-04-09T18:17:45.512 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-04-09T18:17:45.514 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:45.601 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-04-09T18:17:45.603 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:45.779 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-04-09T18:17:45.792 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:45.806 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-04-09T18:17:45.807 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-04-09T18:17:45.873 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-04-09T18:17:45.977 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-04-09T18:17:46.052 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-04-09T18:17:46.232 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-04-09T18:17:46.238 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-04-09T18:17:46.241 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-04-09T18:17:46.288 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-04-09T18:17:46.291 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:46.372 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-04-09T18:17:46.562 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-04-09T18:17:46.564 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-04-09T18:17:46.577 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-04-09T18:17:46.633 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-04-09T18:17:46.716 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-04-09T18:17:46.815 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-04-09T18:17:46.850 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-04-09T18:17:46.863 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-04-09T18:17:46.949 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-04-09T18:17:47.057 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-04-09T18:17:47.070 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-04-09T18:17:47.247 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-04-09T18:17:47.249 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-04-09T18:17:47.305 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-04-09T18:17:47.332 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-04-09T18:17:47.484 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-04-09T18:17:47.499 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-04-09T18:17:47.522 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-04-09T18:17:47.580 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-04-09T18:17:47.585 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-04-09T18:17:47.797 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-04-09T18:17:47.855 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-04-09T18:17:47.892 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-04-09T18:17:47.915 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-04-09T18:17:48.046 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-04-09T18:17:48.124 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-04-09T18:17:48.192 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-04-09T18:17:48.205 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-04-09T18:17:48.283 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-04-09T18:17:48.479 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-04-09T18:17:48.492 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-04-09T18:17:48.517 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-04-09T18:17:48.521 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-04-09T18:17:48.577 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-04-09T18:17:48.731 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-04-09T18:17:48.766 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-04-09T18:17:48.800 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-04-09T18:17:48.813 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-04-09T18:17:48.988 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-04-09T18:17:49.120 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-04-09T18:17:49.122 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-04-09T18:17:49.153 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-04-09T18:17:49.221 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-04-09T18:17:49.232 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-04-09T18:17:49.351 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-04-09T18:17:49.428 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-04-09T18:17:49.555 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-04-09T18:17:49.573 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-04-09T18:17:49.675 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-04-09T18:17:49.698 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-04-09T18:17:49.890 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-04-09T18:17:49.923 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-04-09T18:17:49.935 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-04-09T18:17:49.969 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-04-09T18:17:50.137 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-04-09T18:17:50.175 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-04-09T18:17:50.280 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-04-09T18:17:50.303 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-04-09T18:17:50.358 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-04-09T18:17:50.509 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-04-09T18:17:50.522 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-04-09T18:17:50.545 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-04-09T18:17:50.580 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-04-09T18:17:50.695 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-04-09T18:17:50.836 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-04-09T18:17:50.849 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-04-09T18:17:50.884 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-04-09T18:17:50.908 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-04-09T18:17:51.102 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-04-09T18:17:51.115 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-04-09T18:17:51.127 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-04-09T18:17:51.172 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-04-09T18:17:51.261 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-04-09T18:17:51.368 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-04-09T18:17:51.536 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-04-09T18:17:51.614 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-04-09T18:17:51.627 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-04-09T18:17:51.685 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-04-09T18:17:51.730 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-04-09T18:17:51.884 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-04-09T18:17:51.907 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-04-09T18:17:51.942 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-04-09T18:17:52.020 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-04-09T18:17:52.108 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-04-09T18:17:52.195 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-04-09T18:17:52.207 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-04-09T18:17:52.285 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-04-09T18:17:52.288 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-04-09T18:17:52.409 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-04-09T18:17:52.505 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-04-09T18:17:52.548 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-04-09T18:17:52.657 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-04-09T18:17:52.724 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-04-09T18:17:52.737 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-04-09T18:17:52.869 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-04-09T18:17:52.935 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-04-09T18:17:52.948 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-04-09T18:17:52.971 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-04-09T18:17:53.048 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-04-09T18:17:53.199 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-04-09T18:17:53.275 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-04-09T18:17:53.299 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-04-09T18:17:53.301 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-04-09T18:17:53.400 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-04-09T18:17:53.507 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-04-09T18:17:53.530 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-04-09T18:17:53.562 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-04-09T18:17:53.802 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-04-09T18:17:53.804 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-04-09T18:17:53.827 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-04-09T18:17:53.846 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-04-09T18:17:53.864 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-04-09T18:17:54.108 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-04-09T18:17:54.140 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-04-09T18:17:54.153 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-04-09T18:17:54.233 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-04-09T18:17:54.409 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-04-09T18:17:54.474 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-04-09T18:17:54.539 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-04-09T18:17:54.552 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-04-09T18:17:54.629 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-04-09T18:17:54.667 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-04-09T18:17:55.371 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-04-09T18:17:55.373 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-04-09T18:17:55.393 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-04-09T18:17:55.396 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-04-09T18:17:55.398 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-04-09T18:17:55.429 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-04-09T18:17:55.435 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-04-09T18:17:55.595 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:17:55 +0000 (0:00:46.030) 0:01:33.114 ********** 2021-04-09T18:17:55.597 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:55.664 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-04-09T18:17:55.701 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-04-09T18:17:55.784 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-04-09T18:17:55.798 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-04-09T18:17:55.887 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-04-09T18:17:55.923 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-04-09T18:17:57.908 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** TASK [Create all admin users with sudo access.] ******************************** 2021-04-09T18:17:57.910 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-04-09T18:17:57.920 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-04-09T18:17:57.927 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-04-09T18:17:57.933 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-04-09T18:17:57.957 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-04-09T18:17:57.958 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-04-09T18:17:58.650 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-04-09T18:17:58.655 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:58.658 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-04-09T18:17:58.662 INFO:teuthology.task.ansible.out: 2021-04-09T18:17:58.663 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-04-09T18:17:59.480 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-04-09T18:17:59.482 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-04-09T18:18:00.377 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:00 +0000 (0:00:04.780) 0:01:37.895 ********** 2021-04-09T18:18:00.468 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:00 +0000 (0:00:00.092) 0:01:37.987 ********** 2021-04-09T18:18:00.472 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:00.591 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:00 +0000 (0:00:00.122) 0:01:38.110 ********** 2021-04-09T18:18:00.594 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:00.756 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:00 +0000 (0:00:00.164) 0:01:38.275 ********** 2021-04-09T18:18:01.002 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:00 +0000 (0:00:00.246) 0:01:38.521 ********** 2021-04-09T18:18:01.083 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-04-09T18:18:01.290 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:01 +0000 (0:00:00.288) 0:01:38.810 ********** 2021-04-09T18:18:01.450 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-04-09T18:18:01.485 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-04-09T18:18:01.487 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-04-09T18:18:01.489 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-04-09T18:18:01.490 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-04-09T18:18:01.492 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de 2021-04-09T18:18:01.494 INFO:teuthology.task.ansible.out:53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e8 2021-04-09T18:18:01.495 INFO:teuthology.task.ansible.out:16f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30 2021-04-09T18:18:01.497 INFO:teuthology.task.ansible.out:d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com 2021-04-09T18:18:01.498 INFO:teuthology.task.ansible.out:ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyC 2021-04-09T18:18:01.499 INFO:teuthology.task.ansible.out:pUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca 2021-04-09T18:18:01.501 INFO:teuthology.task.ansible.out:5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38 2021-04-09T18:18:01.502 INFO:teuthology.task.ansible.out:d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullste 2021-04-09T18:18:01.504 INFO:teuthology.task.ansible.out:am 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f 2021-04-09T18:18:01.506 INFO:teuthology.task.ansible.out:9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}]}, "changed": false} 2021-04-09T18:18:01.516 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-04-09T18:18:01.712 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:01 +0000 (0:00:00.422) 0:01:39.232 ********** 2021-04-09T18:18:01.842 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:01 +0000 (0:00:00.129) 0:01:39.361 ********** 2021-04-09T18:18:01.978 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:01 +0000 (0:00:00.135) 0:01:39.497 ********** 2021-04-09T18:18:02.346 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:02 +0000 (0:00:00.367) 0:01:39.865 ********** 2021-04-09T18:18:02.347 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:02.428 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-04-09T18:18:02.452 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-04-09T18:18:02.454 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-04-09T18:18:02.456 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-04-09T18:18:02.458 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-04-09T18:18:02.460 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de 2021-04-09T18:18:02.462 INFO:teuthology.task.ansible.out:53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e8 2021-04-09T18:18:02.464 INFO:teuthology.task.ansible.out:16f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30 2021-04-09T18:18:02.466 INFO:teuthology.task.ansible.out:d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyC 2021-04-09T18:18:02.468 INFO:teuthology.task.ansible.out:pUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 2021-04-09T18:18:02.477 INFO:teuthology.task.ansible.out:468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kc 2021-04-09T18:18:02.479 INFO:teuthology.task.ansible.out:ymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqk 2021-04-09T18:18:02.481 INFO:teuthology.task.ansible.out:w 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-n 2021-04-09T18:18:02.483 INFO:teuthology.task.ansible.out:otebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG 2021-04-09T18:18:02.485 INFO:teuthology.task.ansible.out:4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}]}, "changed": false} 2021-04-09T18:18:02.642 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:02 +0000 (0:00:00.296) 0:01:40.162 ********** 2021-04-09T18:18:02.684 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-04-09T18:18:02.686 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326ba 2021-04-09T18:18:02.689 INFO:teuthology.task.ansible.out:cae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC 2021-04-09T18:18:02.691 INFO:teuthology.task.ansible.out:1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c 2021-04-09T18:18:02.693 INFO:teuthology.task.ansible.out:9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7 2021-04-09T18:18:02.695 INFO:teuthology.task.ansible.out:d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d04 2021-04-09T18:18:02.712 INFO:teuthology.task.ansible.out:7e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"} 2021-04-09T18:18:02.714 INFO:teuthology.task.ansible.out:, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@ 2021-04-09T18:18:02.718 INFO:teuthology.task.ansible.out:hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com 2021-04-09T18:18:02.733 INFO:teuthology.task.ansible.out:ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05 2021-04-09T18:18:02.735 INFO:teuthology.task.ansible.out:b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "o 2021-04-09T18:18:02.741 INFO:teuthology.task.ansible.out:vpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubl 2021-04-09T18:18:02.743 INFO:teuthology.task.ansible.out:i", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb1 2021-04-09T18:18:02.745 INFO:teuthology.task.ansible.out:1af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhang 2021-04-09T18:18:02.749 INFO:teuthology.task.ansible.out:e", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}]}, "changed": false} 2021-04-09T18:18:02.922 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:02 +0000 (0:00:00.279) 0:01:40.441 ********** 2021-04-09T18:18:02.995 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-04-09T18:18:02.997 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-04-09T18:18:02.999 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-04-09T18:18:03.000 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-04-09T18:18:03.002 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de 2021-04-09T18:18:03.004 INFO:teuthology.task.ansible.out:53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e8 2021-04-09T18:18:03.006 INFO:teuthology.task.ansible.out:16f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5d 2021-04-09T18:18:03.006 INFO:teuthology.task.ansible.out:e374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30 2021-04-09T18:18:03.008 INFO:teuthology.task.ansible.out:d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyC 2021-04-09T18:18:03.010 INFO:teuthology.task.ansible.out:pUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca 2021-04-09T18:18:03.012 INFO:teuthology.task.ansible.out:5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38 2021-04-09T18:18:03.013 INFO:teuthology.task.ansible.out:d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullste 2021-04-09T18:18:03.015 INFO:teuthology.task.ansible.out:am 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f 2021-04-09T18:18:03.017 INFO:teuthology.task.ansible.out:9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e879 2021-04-09T18:18:03.021 INFO:teuthology.task.ansible.out:8579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}]}, "changed": false} 2021-04-09T18:18:03.265 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:03 +0000 (0:00:00.342) 0:01:40.784 ********** 2021-04-09T18:18:03.352 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-04-09T18:18:03.354 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-04-09T18:18:03.358 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-04-09T18:18:03.360 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vx 2021-04-09T18:18:03.407 INFO:teuthology.task.ansible.out:Z3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b8 2021-04-09T18:18:03.409 INFO:teuthology.task.ansible.out:0a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a9 2021-04-09T18:18:03.415 INFO:teuthology.task.ansible.out:5094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a 2021-04-09T18:18:03.426 INFO:teuthology.task.ansible.out:4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"} 2021-04-09T18:18:03.428 INFO:teuthology.task.ansible.out:, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad 2021-04-09T18:18:03.434 INFO:teuthology.task.ansible.out:7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c6 2021-04-09T18:18:03.438 INFO:teuthology.task.ansible.out:1168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c 2021-04-09T18:18:03.453 INFO:teuthology.task.ansible.out:43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400 2021-04-09T18:18:03.458 INFO:teuthology.task.ansible.out:bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c7 2021-04-09T18:18:03.462 INFO:teuthology.task.ansible.out:7912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa 2021-04-09T18:18:03.466 INFO:teuthology.task.ansible.out:9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}]}, "changed": false} 2021-04-09T18:18:03.648 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:03 +0000 (0:00:00.382) 0:01:41.167 ********** 2021-04-09T18:18:07.097 INFO:teuthology.task.ansible.out:FAILED - RETRYING: Clone the keys repo (5 retries left). 2021-04-09T18:18:07.250 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-04-09T18:18:07.254 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"after": "5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232", "attempts": 1, "before": "5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232", "changed": false, "remote_url_changed": false} 2021-04-09T18:18:07.415 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:07 +0000 (0:00:03.762) 0:01:44.930 ********** 2021-04-09T18:18:07.445 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"after": "5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232", "attempts": 1, "before": "5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232", "changed": false, "remote_url_changed": false} 2021-04-09T18:18:07.503 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"after": "5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232", "attempts": 1, "before": "5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232", "changed": false, "remote_url_changed": false} 2021-04-09T18:18:07.504 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"after": "5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232", "attempts": 1, "before": "5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232", "changed": false, "remote_url_changed": false} 2021-04-09T18:18:07.669 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:07 +0000 (0:00:00.257) 0:01:45.187 ********** 2021-04-09T18:18:07.848 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:07 +0000 (0:00:00.180) 0:01:45.367 ********** 2021-04-09T18:18:07.889 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:07.998 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:07 +0000 (0:00:00.149) 0:01:45.517 ********** 2021-04-09T18:18:08.001 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:08.457 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:18:08.459 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-04-09T18:18:08.599 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-04-09T18:18:08.704 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-04-09T18:18:08.893 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-04-09T18:18:08.915 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-04-09T18:18:08.950 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-04-09T18:18:08.952 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:09.201 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-04-09T18:18:09.202 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-04-09T18:18:09.223 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-04-09T18:18:09.245 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-04-09T18:18:09.277 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-04-09T18:18:09.485 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-04-09T18:18:09.560 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-04-09T18:18:09.563 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-04-09T18:18:09.611 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-04-09T18:18:09.623 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-04-09T18:18:09.861 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-04-09T18:18:09.896 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-04-09T18:18:09.898 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-04-09T18:18:09.973 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-04-09T18:18:09.975 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-04-09T18:18:09.977 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-04-09T18:18:10.239 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-04-09T18:18:10.241 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:10.264 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-04-09T18:18:10.267 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-04-09T18:18:10.320 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-04-09T18:18:10.404 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-04-09T18:18:10.406 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-04-09T18:18:10.528 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-04-09T18:18:10.624 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-04-09T18:18:10.642 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-04-09T18:18:10.645 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-04-09T18:18:10.707 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-04-09T18:18:10.730 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-04-09T18:18:10.790 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:10.878 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-04-09T18:18:10.881 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-04-09T18:18:10.975 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-04-09T18:18:11.084 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-04-09T18:18:11.086 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-04-09T18:18:11.097 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-04-09T18:18:11.248 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-04-09T18:18:11.297 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-04-09T18:18:11.401 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-04-09T18:18:11.402 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-04-09T18:18:11.403 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-04-09T18:18:11.436 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:11.470 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:11.481 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:11.601 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-04-09T18:18:11.603 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-04-09T18:18:11.688 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:11.772 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-04-09T18:18:11.774 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-04-09T18:18:11.829 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-04-09T18:18:11.854 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-04-09T18:18:11.903 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:12.024 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-04-09T18:18:12.025 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-04-09T18:18:12.048 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-04-09T18:18:12.050 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-04-09T18:18:12.094 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:12.148 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-04-09T18:18:12.151 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WS 2021-04-09T18:18:12.153 INFO:teuthology.task.ansible.out:ZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:12.284 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-04-09T18:18:12.286 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-04-09T18:18:12.311 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-04-09T18:18:12.314 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-04-09T18:18:12.367 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:12.376 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:12.452 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-04-09T18:18:12.456 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:12.465 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:12.488 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-04-09T18:18:12.552 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-04-09T18:18:12.555 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-04-09T18:18:12.617 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:12.662 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:12.699 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-04-09T18:18:12.730 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-04-09T18:18:12.733 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a 2021-04-09T18:18:12.735 INFO:teuthology.task.ansible.out:13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2021-04-09T18:18:12.941 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-04-09T18:18:12.977 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-04-09T18:18:12.979 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-04-09T18:18:12.991 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-04-09T18:18:12.993 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-04-09T18:18:13.217 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-04-09T18:18:13.224 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-04-09T18:18:13.242 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-04-09T18:18:13.244 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-04-09T18:18:13.285 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-04-09T18:18:13.298 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-04-09T18:18:13.546 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-04-09T18:18:13.549 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:13.564 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-04-09T18:18:13.589 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-04-09T18:18:13.613 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-04-09T18:18:13.615 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-04-09T18:18:13.812 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-04-09T18:18:13.867 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-04-09T18:18:13.905 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-04-09T18:18:13.908 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-04-09T18:18:13.917 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-04-09T18:18:13.923 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-04-09T18:18:14.178 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-04-09T18:18:14.212 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-04-09T18:18:14.225 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-04-09T18:18:14.229 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-04-09T18:18:14.247 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-04-09T18:18:14.489 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-04-09T18:18:14.491 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-04-09T18:18:14.501 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-04-09T18:18:14.525 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-04-09T18:18:14.538 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-04-09T18:18:14.789 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-04-09T18:18:14.809 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-04-09T18:18:14.817 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-04-09T18:18:14.818 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3N 2021-04-09T18:18:14.825 INFO:teuthology.task.ansible.out:zaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-04-09T18:18:14.978 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-04-09T18:18:15.073 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-04-09T18:18:15.075 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-04-09T18:18:15.117 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-04-09T18:18:15.119 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-04-09T18:18:15.121 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-04-09T18:18:15.299 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-04-09T18:18:15.302 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-04-09T18:18:15.440 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-04-09T18:18:15.498 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-04-09T18:18:15.528 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-04-09T18:18:15.606 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-04-09T18:18:15.608 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-04-09T18:18:15.738 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-04-09T18:18:15.787 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-04-09T18:18:15.947 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-04-09T18:18:15.949 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-04-09T18:18:15.971 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-04-09T18:18:16.121 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-04-09T18:18:16.123 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-04-09T18:18:16.289 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-04-09T18:18:16.293 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:16.367 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-04-09T18:18:16.389 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-04-09T18:18:16.391 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:16.475 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-04-09T18:18:16.631 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-04-09T18:18:16.635 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:16.660 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-04-09T18:18:16.662 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-04-09T18:18:16.763 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-04-09T18:18:16.785 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-04-09T18:18:16.929 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-04-09T18:18:16.941 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-04-09T18:18:16.943 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-04-09T18:18:17.048 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-04-09T18:18:17.163 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-04-09T18:18:17.176 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-04-09T18:18:17.275 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-04-09T18:18:17.352 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-04-09T18:18:17.386 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-04-09T18:18:17.462 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-04-09T18:18:17.557 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-04-09T18:18:17.645 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-04-09T18:18:17.693 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-04-09T18:18:17.695 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:17.811 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-04-09T18:18:17.813 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-04-09T18:18:17.931 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-04-09T18:18:18.028 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-04-09T18:18:18.030 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@c 2021-04-09T18:18:18.032 INFO:teuthology.task.ansible.out:lusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-04-09T18:18:18.187 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-04-09T18:18:18.198 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-04-09T18:18:18.265 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-04-09T18:18:18.412 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-04-09T18:18:18.435 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-04-09T18:18:18.437 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-04-09T18:18:18.534 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-04-09T18:18:18.735 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-04-09T18:18:18.795 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-04-09T18:18:18.829 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-04-09T18:18:18.884 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-04-09T18:18:19.077 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-04-09T18:18:19.135 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-04-09T18:18:19.147 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-04-09T18:18:19.235 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-04-09T18:18:19.387 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-04-09T18:18:19.498 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-04-09T18:18:19.551 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-04-09T18:18:19.632 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-04-09T18:18:19.634 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-04-09T18:18:19.724 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-04-09T18:18:19.844 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-04-09T18:18:19.867 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-04-09T18:18:19.870 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-04-09T18:18:20.058 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-04-09T18:18:20.123 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-04-09T18:18:20.213 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-04-09T18:18:20.258 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-04-09T18:18:20.303 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-04-09T18:18:20.347 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-04-09T18:18:20.349 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"after": "5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232", "attempts": 2, "before": "5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232", "changed": false, "remote_url_changed": false} 2021-04-09T18:18:20.427 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:20 +0000 (0:00:12.426) 0:01:57.944 ********** 2021-04-09T18:18:20.511 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-04-09T18:18:20.542 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-04-09T18:18:20.596 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-04-09T18:18:20.698 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-04-09T18:18:20.778 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-04-09T18:18:20.836 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-04-09T18:18:20.838 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-04-09T18:18:20.939 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-04-09T18:18:20.995 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-04-09T18:18:20.997 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-04-09T18:18:21.064 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2021-04-09T18:18:21.065 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-04-09T18:18:21.151 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-04-09T18:18:21.155 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-04-09T18:18:21.250 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-04-09T18:18:21.330 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-04-09T18:18:21.332 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-04-09T18:18:21.343 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-04-09T18:18:21.344 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-04-09T18:18:21.346 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-04-09T18:18:21.472 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-04-09T18:18:21.512 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-04-09T18:18:21.612 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-04-09T18:18:21.635 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-04-09T18:18:21.702 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-04-09T18:18:21.816 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-04-09T18:18:21.882 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-04-09T18:18:21.960 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-04-09T18:18:21.961 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-04-09T18:18:21.973 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-04-09T18:18:22.149 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-04-09T18:18:22.173 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-04-09T18:18:22.242 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-04-09T18:18:22.265 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-04-09T18:18:22.267 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-04-09T18:18:22.288 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-04-09T18:18:22.290 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-04-09T18:18:22.458 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2021-04-09T18:18:22.460 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-04-09T18:18:22.471 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-04-09T18:18:22.553 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2021-04-09T18:18:22.555 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-04-09T18:18:22.609 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-04-09T18:18:22.611 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-04-09T18:18:22.634 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-04-09T18:18:22.746 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-04-09T18:18:22.748 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-04-09T18:18:22.750 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-04-09T18:18:22.793 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-04-09T18:18:22.821 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-04-09T18:18:22.823 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-04-09T18:18:22.825 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-04-09T18:18:22.877 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-04-09T18:18:22.890 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-04-09T18:18:22.892 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-04-09T18:18:23.094 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-04-09T18:18:23.139 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-04-09T18:18:23.189 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-04-09T18:18:23.200 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-04-09T18:18:23.212 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-04-09T18:18:23.342 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-04-09T18:18:23.343 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-04-09T18:18:23.345 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-04-09T18:18:23.420 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-04-09T18:18:23.475 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-04-09T18:18:23.550 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-04-09T18:18:23.649 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-04-09T18:18:23.651 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-04-09T18:18:23.717 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-04-09T18:18:23.773 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2021-04-09T18:18:23.775 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-04-09T18:18:23.838 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-04-09T18:18:23.852 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-04-09T18:18:23.864 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:23.911 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-04-09T18:18:24.010 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-04-09T18:18:24.120 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-04-09T18:18:24.122 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-04-09T18:18:24.124 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLD 2021-04-09T18:18:24.126 INFO:teuthology.task.ansible.out:U2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gabrioux", "validate_certs": true} 2021-04-09T18:18:24.143 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-04-09T18:18:24.146 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-04-09T18:18:24.284 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-04-09T18:18:24.373 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-04-09T18:18:24.385 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-04-09T18:18:24.387 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-04-09T18:18:24.398 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-04-09T18:18:24.410 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-04-09T18:18:24.476 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:24.521 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:24.577 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-04-09T18:18:24.578 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-04-09T18:18:24.717 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-04-09T18:18:24.729 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-04-09T18:18:24.731 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-04-09T18:18:24.761 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-04-09T18:18:24.858 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-04-09T18:18:24.871 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-04-09T18:18:24.994 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-04-09T18:18:25.022 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-04-09T18:18:25.024 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-04-09T18:18:25.099 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-04-09T18:18:25.112 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-04-09T18:18:25.146 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-04-09T18:18:25.148 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-04-09T18:18:25.330 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-04-09T18:18:25.331 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-04-09T18:18:25.380 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-04-09T18:18:25.468 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-04-09T18:18:25.470 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-04-09T18:18:25.504 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-04-09T18:18:25.671 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-04-09T18:18:25.673 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-04-09T18:18:25.682 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-04-09T18:18:25.717 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-04-09T18:18:25.720 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-04-09T18:18:25.783 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-04-09T18:18:25.875 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-04-09T18:18:25.930 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-04-09T18:18:26.006 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-04-09T18:18:26.050 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-04-09T18:18:26.052 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-04-09T18:18:26.094 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-04-09T18:18:26.149 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-04-09T18:18:26.218 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-04-09T18:18:26.282 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-04-09T18:18:26.358 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-04-09T18:18:26.456 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-04-09T18:18:26.467 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-04-09T18:18:26.469 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-04-09T18:18:26.531 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-04-09T18:18:26.533 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-04-09T18:18:26.543 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-04-09T18:18:26.641 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-04-09T18:18:26.730 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-04-09T18:18:26.731 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-04-09T18:18:26.965 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-04-09T18:18:26.966 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-04-09T18:18:26.968 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-04-09T18:18:26.980 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-04-09T18:18:26.982 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-04-09T18:18:27.001 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-04-09T18:18:27.013 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-04-09T18:18:27.269 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-04-09T18:18:27.282 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-04-09T18:18:27.303 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-04-09T18:18:27.336 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-04-09T18:18:27.347 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-04-09T18:18:27.349 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-04-09T18:18:27.597 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-04-09T18:18:27.620 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-04-09T18:18:27.622 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-04-09T18:18:27.634 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-04-09T18:18:27.662 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-04-09T18:18:27.881 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-04-09T18:18:27.928 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-04-09T18:18:27.930 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-04-09T18:18:27.995 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-04-09T18:18:28.007 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-04-09T18:18:28.031 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-04-09T18:18:28.180 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-04-09T18:18:28.182 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:28.193 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-04-09T18:18:28.195 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:28.275 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-04-09T18:18:28.277 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-04-09T18:18:28.319 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-04-09T18:18:28.374 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-04-09T18:18:28.479 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-04-09T18:18:28.492 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-04-09T18:18:28.580 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-04-09T18:18:28.605 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-04-09T18:18:28.639 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-04-09T18:18:28.651 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-04-09T18:18:28.797 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-04-09T18:18:28.934 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-04-09T18:18:28.944 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-04-09T18:18:28.946 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-04-09T18:18:28.992 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-04-09T18:18:29.049 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-04-09T18:18:29.203 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-04-09T18:18:29.302 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-04-09T18:18:29.303 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-04-09T18:18:29.305 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-04-09T18:18:29.471 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-04-09T18:18:29.482 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-04-09T18:18:29.505 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-04-09T18:18:29.605 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-04-09T18:18:29.638 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-04-09T18:18:29.727 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-04-09T18:18:29.751 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-04-09T18:18:29.796 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-04-09T18:18:29.873 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-04-09T18:18:29.939 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-04-09T18:18:29.995 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-04-09T18:18:30.029 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-04-09T18:18:30.126 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-04-09T18:18:30.152 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-04-09T18:18:30.227 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-04-09T18:18:30.272 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-04-09T18:18:30.274 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-04-09T18:18:30.394 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-04-09T18:18:30.428 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-04-09T18:18:30.525 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-04-09T18:18:30.536 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-04-09T18:18:30.585 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-04-09T18:18:30.617 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-04-09T18:18:30.738 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-04-09T18:18:30.808 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-04-09T18:18:30.830 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-04-09T18:18:30.908 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-04-09T18:18:30.974 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-04-09T18:18:31.051 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-04-09T18:18:31.069 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-04-09T18:18:31.157 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-04-09T18:18:31.319 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-04-09T18:18:31.341 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-04-09T18:18:31.364 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-04-09T18:18:31.423 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-04-09T18:18:31.640 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-04-09T18:18:31.641 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-04-09T18:18:31.686 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-04-09T18:18:31.785 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-04-09T18:18:31.798 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-04-09T18:18:32.087 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-04-09T18:18:32.187 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-04-09T18:18:32.320 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-04-09T18:18:32.322 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-04-09T18:18:32.342 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-04-09T18:18:32.440 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-04-09T18:18:32.573 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-04-09T18:18:32.620 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-04-09T18:18:32.643 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-04-09T18:18:32.677 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-04-09T18:18:32.701 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-04-09T18:18:32.856 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-04-09T18:18:32.891 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-04-09T18:18:32.893 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-04-09T18:18:33.003 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-04-09T18:18:33.016 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-04-09T18:18:33.148 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-04-09T18:18:33.160 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-04-09T18:18:33.205 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-04-09T18:18:33.317 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-04-09T18:18:33.327 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-04-09T18:18:33.468 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-04-09T18:18:33.484 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-04-09T18:18:33.486 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-04-09T18:18:33.491 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-04-09T18:18:33.493 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-04-09T18:18:33.624 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-04-09T18:18:33.626 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-04-09T18:18:33.636 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-04-09T18:18:33.638 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-04-09T18:18:33.797 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-04-09T18:18:33.830 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-04-09T18:18:33.832 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-04-09T18:18:33.898 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-04-09T18:18:34.007 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-04-09T18:18:34.009 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-04-09T18:18:34.052 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-04-09T18:18:34.060 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-04-09T18:18:34.091 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-04-09T18:18:34.144 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-04-09T18:18:34.320 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-04-09T18:18:34.321 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-04-09T18:18:34.323 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-04-09T18:18:34.345 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-04-09T18:18:34.368 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-04-09T18:18:34.499 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-04-09T18:18:34.587 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-04-09T18:18:34.626 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-04-09T18:18:34.638 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-04-09T18:18:34.639 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-04-09T18:18:34.807 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-04-09T18:18:34.884 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-04-09T18:18:34.962 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2021-04-09T18:18:34.964 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6 2021-04-09T18:18:34.966 INFO:teuthology.task.ansible.out:wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-04-09T18:18:35.019 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-04-09T18:18:35.023 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-04-09T18:18:35.087 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-04-09T18:18:35.299 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-04-09T18:18:35.301 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-04-09T18:18:35.322 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-04-09T18:18:35.324 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-04-09T18:18:35.326 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8w 2021-04-09T18:18:35.327 INFO:teuthology.task.ansible.out:GVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8S 2021-04-09T18:18:35.329 INFO:teuthology.task.ansible.out:IkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-04-09T18:18:35.413 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-04-09T18:18:35.555 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-04-09T18:18:35.592 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-04-09T18:18:35.660 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-04-09T18:18:35.662 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-04-09T18:18:35.673 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-04-09T18:18:35.674 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-04-09T18:18:35.867 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-04-09T18:18:35.869 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-04-09T18:18:35.891 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-04-09T18:18:35.990 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-04-09T18:18:36.013 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-04-09T18:18:36.090 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-04-09T18:18:36.112 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-04-09T18:18:36.220 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-04-09T18:18:36.278 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-04-09T18:18:36.365 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-04-09T18:18:36.389 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-04-09T18:18:36.413 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-04-09T18:18:36.491 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-04-09T18:18:36.493 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-04-09T18:18:36.600 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-04-09T18:18:36.634 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-04-09T18:18:36.715 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-04-09T18:18:36.783 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-04-09T18:18:36.920 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-04-09T18:18:36.934 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-04-09T18:18:36.935 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-04-09T18:18:36.991 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-04-09T18:18:37.145 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-04-09T18:18:37.179 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-04-09T18:18:37.217 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-04-09T18:18:37.241 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-04-09T18:18:37.243 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-04-09T18:18:37.426 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-04-09T18:18:37.451 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-04-09T18:18:37.570 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-04-09T18:18:37.571 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-04-09T18:18:37.573 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-04-09T18:18:37.575 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-04-09T18:18:37.683 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-04-09T18:18:37.804 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-04-09T18:18:37.808 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-04-09T18:18:37.913 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-04-09T18:18:37.926 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-04-09T18:18:37.928 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-04-09T18:18:37.959 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-04-09T18:18:37.961 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-04-09T18:18:38.125 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-04-09T18:18:38.169 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-04-09T18:18:38.292 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-04-09T18:18:38.318 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-04-09T18:18:38.349 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-04-09T18:18:38.371 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-04-09T18:18:38.447 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-04-09T18:18:38.541 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-04-09T18:18:38.543 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-04-09T18:18:38.596 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2021-04-09T18:18:38.598 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-04-09T18:18:38.625 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-04-09T18:18:38.714 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/ 2021-04-09T18:18:38.716 INFO:teuthology.task.ansible.out:GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-04-09T18:18:38.771 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-04-09T18:18:38.805 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-04-09T18:18:38.952 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-04-09T18:18:39.007 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-04-09T18:18:39.030 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-04-09T18:18:39.042 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-04-09T18:18:39.065 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-04-09T18:18:39.227 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-04-09T18:18:39.346 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-04-09T18:18:39.348 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-04-09T18:18:39.359 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-04-09T18:18:39.381 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-04-09T18:18:39.394 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-04-09T18:18:39.517 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-04-09T18:18:39.588 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-04-09T18:18:39.620 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-04-09T18:18:39.696 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-04-09T18:18:39.802 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-04-09T18:18:39.824 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2021-04-09T18:18:39.827 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-04-09T18:18:39.836 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-04-09T18:18:39.956 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2021-04-09T18:18:39.958 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-04-09T18:18:40.067 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-04-09T18:18:40.080 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-04-09T18:18:40.229 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-04-09T18:18:40.242 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2021-04-09T18:18:40.244 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-04-09T18:18:40.298 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-04-09T18:18:40.365 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-04-09T18:18:40.367 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-04-09T18:18:40.444 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-04-09T18:18:40.562 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-04-09T18:18:40.574 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-04-09T18:18:40.652 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-04-09T18:18:40.744 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-04-09T18:18:40.819 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-04-09T18:18:40.821 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-04-09T18:18:40.908 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-04-09T18:18:40.964 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-04-09T18:18:41.074 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-04-09T18:18:41.087 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-04-09T18:18:41.241 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-04-09T18:18:41.306 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-04-09T18:18:41.330 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-04-09T18:18:41.438 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-04-09T18:18:41.472 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-04-09T18:18:41.549 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-04-09T18:18:41.604 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-04-09T18:18:41.648 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-04-09T18:18:41.745 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-04-09T18:18:41.761 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-04-09T18:18:41.804 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-04-09T18:18:41.908 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-04-09T18:18:41.910 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-04-09T18:18:41.978 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-04-09T18:18:42.047 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-04-09T18:18:42.081 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-04-09T18:18:42.126 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-04-09T18:18:42.138 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-04-09T18:18:42.214 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-04-09T18:18:42.269 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-04-09T18:18:42.345 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-04-09T18:18:42.392 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-04-09T18:18:42.490 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-04-09T18:18:42.538 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-04-09T18:18:42.651 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-04-09T18:18:42.662 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-04-09T18:18:42.705 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-04-09T18:18:42.812 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-04-09T18:18:42.855 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-04-09T18:18:42.942 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-04-09T18:18:43.021 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-04-09T18:18:43.022 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-04-09T18:18:43.125 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-04-09T18:18:43.138 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-04-09T18:18:43.259 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-04-09T18:18:43.271 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-04-09T18:18:43.445 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-04-09T18:18:43.468 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-04-09T18:18:43.471 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-04-09T18:18:43.547 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-04-09T18:18:43.560 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-04-09T18:18:43.714 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-04-09T18:18:43.725 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-04-09T18:18:43.779 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-04-09T18:18:43.801 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-04-09T18:18:43.876 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-04-09T18:18:44.007 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-04-09T18:18:44.010 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-04-09T18:18:44.053 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-04-09T18:18:44.087 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-04-09T18:18:44.099 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-04-09T18:18:44.231 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-04-09T18:18:44.264 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-04-09T18:18:44.366 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-04-09T18:18:44.385 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-04-09T18:18:44.397 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-04-09T18:18:44.535 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-04-09T18:18:44.605 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-04-09T18:18:44.617 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-04-09T18:18:44.628 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-04-09T18:18:44.771 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-04-09T18:18:44.913 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-04-09T18:18:44.937 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-04-09T18:18:44.949 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-04-09T18:18:44.951 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-04-09T18:18:45.050 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-04-09T18:18:45.272 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-04-09T18:18:45.274 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-04-09T18:18:45.286 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-04-09T18:18:45.298 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-04-09T18:18:45.352 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-04-09T18:18:45.506 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-04-09T18:18:45.529 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-04-09T18:18:45.566 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-04-09T18:18:45.569 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-04-09T18:18:45.580 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-04-09T18:18:45.830 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-04-09T18:18:45.832 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-04-09T18:18:45.842 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-04-09T18:18:45.845 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-04-09T18:18:45.847 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-04-09T18:18:45.878 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-04-09T18:18:45.880 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-04-09T18:18:45.901 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-04-09T18:18:46.130 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-04-09T18:18:46.142 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-04-09T18:18:46.155 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-04-09T18:18:46.178 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-04-09T18:18:46.255 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-04-09T18:18:46.387 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-04-09T18:18:46.404 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-04-09T18:18:46.413 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-04-09T18:18:46.447 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-04-09T18:18:46.536 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-04-09T18:18:46.646 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-04-09T18:18:46.680 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-04-09T18:18:46.681 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-04-09T18:18:46.791 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-04-09T18:18:46.880 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-04-09T18:18:46.936 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-04-09T18:18:46.959 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-04-09T18:18:47.014 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-04-09T18:18:47.070 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-04-09T18:18:47.233 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-04-09T18:18:47.235 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-04-09T18:18:47.268 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-04-09T18:18:47.269 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-04-09T18:18:47.328 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-04-09T18:18:47.372 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-04-09T18:18:47.514 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-04-09T18:18:47.546 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-04-09T18:18:47.548 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-04-09T18:18:47.579 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-04-09T18:18:47.583 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-04-09T18:18:47.661 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-04-09T18:18:47.784 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-04-09T18:18:47.796 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-04-09T18:18:47.855 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-04-09T18:18:47.863 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-04-09T18:18:47.864 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-04-09T18:18:48.027 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-04-09T18:18:48.124 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-04-09T18:18:48.137 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-04-09T18:18:48.160 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-04-09T18:18:48.185 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-04-09T18:18:48.296 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-04-09T18:18:48.307 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-04-09T18:18:48.449 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-04-09T18:18:48.494 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-04-09T18:18:48.518 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-04-09T18:18:48.577 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-04-09T18:18:48.642 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-04-09T18:18:48.773 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-04-09T18:18:48.850 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-04-09T18:18:48.877 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-04-09T18:18:48.889 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-04-09T18:18:48.957 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-04-09T18:18:48.958 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-04-09T18:18:49.088 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-04-09T18:18:49.155 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-04-09T18:18:49.157 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-04-09T18:18:49.189 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-04-09T18:18:49.266 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-04-09T18:18:49.301 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-04-09T18:18:49.302 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-04-09T18:18:49.518 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-04-09T18:18:49.519 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-04-09T18:18:49.553 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-04-09T18:18:49.617 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-04-09T18:18:49.619 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-04-09T18:18:49.759 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-04-09T18:18:49.805 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-04-09T18:18:49.855 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-04-09T18:18:50.019 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-04-09T18:18:50.021 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-04-09T18:18:50.088 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-04-09T18:18:50.122 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-04-09T18:18:50.826 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-04-09T18:18:50.854 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-04-09T18:18:50.855 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} changed: [smithi079.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8sma 2021-04-09T18:18:50.863 INFO:teuthology.task.ansible.out:VJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-04-09T18:18:50.864 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQ 2021-04-09T18:18:50.872 INFO:teuthology.task.ansible.out:C0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} changed: [smithi089.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d 2021-04-09T18:18:50.877 INFO:teuthology.task.ansible.out:8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-04-09T18:18:50.878 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-04-09T18:18:50.880 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-04-09T18:18:50.883 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-04-09T18:18:51.085 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:51 +0000 (0:00:30.659) 0:02:28.604 ********** 2021-04-09T18:18:51.087 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:51.109 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-04-09T18:18:51.113 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:51.116 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-04-09T18:18:51.118 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-04-09T18:18:51.123 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:51.540 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-04-09T18:18:51.900 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-04-09T18:18:51.920 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:51.922 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-04-09T18:18:52.524 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:18:52.526 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:52.528 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd 2021-04-09T18:18:52.529 INFO:teuthology.task.ansible.out:0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:52.534 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:52.535 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:52.537 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-04-09T18:18:52.538 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:52.539 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:52.540 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:52.543 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:52.545 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:52.546 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:52.546 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:52.549 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:18:52.551 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-04-09T18:18:52.567 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-04-09T18:18:52.570 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:52.570 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:18:52.571 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_ 2021-04-09T18:18:52.573 INFO:teuthology.task.ansible.out:var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "a 2021-04-09T18:18:52.575 INFO:teuthology.task.ansible.out:li@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-04-09T18:18:52.668 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:52 +0000 (0:00:01.578) 0:02:30.183 ********** 2021-04-09T18:18:52.834 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:52 +0000 (0:00:00.165) 0:02:30.353 ********** 2021-04-09T18:18:53.018 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:53 +0000 (0:00:00.184) 0:02:30.537 ********** 2021-04-09T18:18:53.027 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:53.032 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:18:53.037 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2021-04-09T18:18:53.038 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi090.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs 2021-04-09T18:18:53.040 INFO:teuthology.task.ansible.out:": true} skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:18:53.040 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-04-09T18:18:53.043 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:53.044 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.044 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.046 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.145 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.145 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.148 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.148 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:53.164 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.176 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.199 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.235 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.247 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.258 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.261 INFO:teuthology.task.ansible.out: skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.282 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.286 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.294 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.302 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.306 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.328 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.329 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.339 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.351 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.353 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.373 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.389 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.406 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.418 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.418 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.442 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.445 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.454 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.467 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.469 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-04-09T18:18:53.480 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:18:53.482 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.492 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.531 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.577 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.578 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.594 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.617 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.620 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.651 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.663 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.676 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.699 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.711 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.745 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.747 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-04-09T18:18:53.759 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:18:53.761 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-04-09T18:18:53.775 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.776 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:53.787 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.789 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:53.801 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.825 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.848 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.850 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:53.861 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-04-09T18:18:53.885 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.886 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.886 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:53.909 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.932 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.971 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:53.983 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-04-09T18:18:53.997 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.009 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.045 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:18:54.047 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-04-09T18:18:54.070 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:18:54.072 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.123 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.135 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.136 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-04-09T18:18:54.160 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.172 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.195 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-04-09T18:18:54.210 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.212 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:54.286 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.360 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.394 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-04-09T18:18:54.415 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.433 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-04-09T18:18:54.468 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.481 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.482 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:54.506 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.529 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.541 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.543 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:54.553 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.565 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-04-09T18:18:54.568 INFO:teuthology.task.ansible.out: skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.595 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-04-09T18:18:54.597 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.598 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.624 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.633 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.637 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:54.647 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.659 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:18:54.661 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.662 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfar 2021-04-09T18:18:54.663 INFO:teuthology.task.ansible.out:num@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.675 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.709 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.711 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:54.723 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.734 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.737 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:54.747 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.753 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:54.759 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.760 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:54.762 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.784 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.797 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.809 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.811 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.824 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.847 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.859 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.877 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.879 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-04-09T18:18:54.890 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.903 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.915 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.917 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.929 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.941 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.953 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.955 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.967 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-04-09T18:18:54.969 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:54.971 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.972 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:54.973 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.975 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:54.986 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.998 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:54.999 INFO:teuthology.task.ansible.out: skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.021 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.023 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.034 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.068 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.080 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.092 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.094 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.110 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.123 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.125 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.149 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.161 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.162 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.163 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.165 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.177 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.179 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.202 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.214 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.216 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:55.218 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.218 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.223 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:55.235 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.241 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:55.242 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.244 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:55.259 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-04-09T18:18:55.266 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.274 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.297 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.331 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.333 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:55.334 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.335 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.347 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.360 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.380 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.389 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.392 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.392 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.407 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.409 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.435 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.449 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.453 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.460 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.461 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.464 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:55.466 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.469 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.471 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:55.483 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.484 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.499 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.510 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.512 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.514 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.525 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.527 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-04-09T18:18:55.537 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:18:55.539 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.548 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.550 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.560 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.562 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.572 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.594 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.596 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.610 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.622 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.626 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.643 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.645 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.666 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.668 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.682 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.699 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.702 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.711 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.714 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.732 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:18:55.734 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.756 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.758 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.763 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:55.776 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.778 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.779 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.780 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/Ln 2021-04-09T18:18:55.782 INFO:teuthology.task.ansible.out:fuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.785 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:55.787 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.798 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.837 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.839 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.850 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.852 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.886 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.897 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.899 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.910 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.912 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.912 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.915 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.919 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.925 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.937 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.939 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.950 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:55.960 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:55.994 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.000 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.007 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.009 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:56.028 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.030 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.032 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.044 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.046 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.070 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:18:56.072 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.083 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.094 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.116 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.127 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.130 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.161 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.164 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.173 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.175 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.196 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.207 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.209 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:56.235 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.303 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_lo 2021-04-09T18:18:56.305 INFO:teuthology.task.ansible.out:op_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'} 2021-04-09T18:18:56.307 INFO:teuthology.task.ansible.out:) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.310 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.313 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.322 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.333 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.335 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.347 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.349 INFO:teuthology.task.ansible.out: skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.359 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.361 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.371 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.382 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.384 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.394 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.405 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.407 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.409 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:56.419 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.430 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-04-09T18:18:56.463 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:18:56.467 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.475 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.488 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.501 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.516 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.559 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.562 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:56.571 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.573 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:56.582 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.604 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.606 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.624 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.632 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.637 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.639 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.659 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.670 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.683 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.686 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_ 2021-04-09T18:18:56.688 INFO:teuthology.task.ansible.out:reason": "Conditional result was False"} 2021-04-09T18:18:56.697 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.708 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.709 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.731 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.734 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.757 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.769 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.771 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.804 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.805 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.817 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.819 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.845 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.847 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.881 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.883 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.904 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.905 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.916 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.928 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.941 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.953 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-04-09T18:18:56.965 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:18:56.973 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.978 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.980 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.990 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:56.993 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.012 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.024 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.028 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.061 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.063 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.074 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.076 INFO:teuthology.task.ansible.out: skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.086 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.088 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.122 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.133 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.135 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.147 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:18:57.150 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-04-09T18:18:57.160 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:57.162 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:18:57.164 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.192 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.211 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.213 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:57.223 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.235 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.248 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.249 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:57.251 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.262 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.263 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.265 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.287 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.289 INFO:teuthology.task.ansible.out: skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.290 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.301 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.302 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.313 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.315 INFO:teuthology.task.ansible.out: skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.326 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.328 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.349 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.350 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:57.352 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-04-09T18:18:57.354 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.355 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.367 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.371 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.381 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.382 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.394 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.394 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.396 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:57.408 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.409 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.410 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.425 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.432 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.434 INFO:teuthology.task.ansible.out: skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.444 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.455 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.457 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.467 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.469 INFO:teuthology.task.ansible.out: skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.491 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.502 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.504 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:57.520 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.527 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.528 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.540 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.541 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.563 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.565 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.577 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:18:57.579 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.580 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 2021-04-09T18:18:57.582 INFO:teuthology.task.ansible.out:131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.592 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.594 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.604 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.606 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.617 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.619 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.621 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.633 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.635 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:57.658 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.660 INFO:teuthology.task.ansible.out: skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.682 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.684 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.705 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.708 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.718 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.720 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.731 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.733 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.743 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.757 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.759 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.769 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.771 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:57.781 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.783 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.794 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.796 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.806 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.808 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.818 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:18:57.823 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-04-09T18:18:57.831 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.843 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.845 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.847 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.859 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.881 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.893 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.905 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.907 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.918 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.920 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.931 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.933 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.944 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.961 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.963 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.964 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.974 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.976 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:57.993 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.074 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.076 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.076 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.077 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.079 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.079 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.163 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:58 +0000 (0:00:05.144) 0:02:35.682 ********** 2021-04-09T18:18:58.218 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.220 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.220 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.265 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.266 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.267 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.268 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:58.270 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.272 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.273 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.275 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:58.277 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:58.279 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:18:58.280 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-04-09T18:18:58.282 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:58.284 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.286 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.290 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:58.295 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.297 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.319 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.320 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.324 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:58.344 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.352 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.353 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.354 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.355 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.377 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.379 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.380 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.381 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.383 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.383 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.385 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.400 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.402 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.404 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.413 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.423 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.617 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.620 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.622 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.623 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.633 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:58.635 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.637 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.638 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:58.639 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.641 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:18:58.642 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-04-09T18:18:58.646 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:58.647 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:18:58.654 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.655 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.657 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:58.658 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.662 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:58.665 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.665 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:58.667 INFO:teuthology.task.ansible.out:TASK [Filter the revoked_users list] ******************************************* 2021-04-09T18:18:58.669 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.670 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.692 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.694 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.707 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.712 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.716 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.730 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.732 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.733 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.741 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:58.744 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.748 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.750 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:58.751 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:18:58.752 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-04-09T18:18:58.752 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:58.754 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:58.758 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:18:58.760 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.761 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.811 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:58 +0000 (0:00:00.647) 0:02:36.330 ********** 2021-04-09T18:18:58.889 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:58 +0000 (0:00:00.078) 0:02:36.409 ********** 2021-04-09T18:18:58.914 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.917 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:58.933 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:59.095 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:59.097 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:59.100 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} TASK [Filter the revoked_users list] ******************************************* skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:59.101 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_key 2021-04-09T18:18:59.105 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-04-09T18:18:59.109 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:18:59.111 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:59.132 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:59.134 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:59.135 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:59.252 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:59 +0000 (0:00:00.362) 0:02:36.771 ********** 2021-04-09T18:18:59.257 INFO:teuthology.task.ansible.out: 2021-04-09T18:18:59.414 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:59 +0000 (0:00:00.162) 0:02:36.934 ********** 2021-04-09T18:18:59.494 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:59.496 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:59.498 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:59.595 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:18:59.597 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyx 2021-04-09T18:18:59.599 INFO:teuthology.task.ansible.out:LpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-04-09T18:18:59.689 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:59 +0000 (0:00:00.274) 0:02:37.208 ********** 2021-04-09T18:18:59.702 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:18:59.705 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-04-09T18:18:59.705 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:18:59.803 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:18:59 +0000 (0:00:00.114) 0:02:37.322 ********** 2021-04-09T18:18:59.854 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:18:59.856 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-04-09T18:18:59.888 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:18:59.889 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-04-09T18:19:00.037 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:00.038 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-04-09T18:19:00.061 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:00.138 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:00 +0000 (0:00:00.335) 0:02:37.658 ********** 2021-04-09T18:19:00.169 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:00.171 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-04-09T18:19:00.197 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:19:00.199 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-04-09T18:19:00.245 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:00.246 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-04-09T18:19:00.256 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-04-09T18:19:00.391 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-04-09T18:19:00.393 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:00.437 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-04-09T18:19:00.450 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:19:00.452 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-04-09T18:19:00.510 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:00.512 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-04-09T18:19:00.696 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-04-09T18:19:00.730 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:19:00.732 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-04-09T18:19:00.745 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:00.747 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-04-09T18:19:00.748 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-04-09T18:19:00.809 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-04-09T18:19:00.819 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:00.886 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-04-09T18:19:00.911 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-04-09T18:19:00.913 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:01.062 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-04-09T18:19:01.064 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:01.084 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-04-09T18:19:01.116 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:19:01.118 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-04-09T18:19:01.160 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:01.163 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-04-09T18:19:01.172 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-04-09T18:19:01.338 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-04-09T18:19:01.398 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-04-09T18:19:01.431 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-04-09T18:19:01.442 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:19:01.445 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-04-09T18:19:01.476 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:01.477 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-04-09T18:19:01.520 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-04-09T18:19:01.723 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-04-09T18:19:01.730 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-04-09T18:19:01.786 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-04-09T18:19:01.799 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:19:01.801 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-04-09T18:19:01.879 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:01.881 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-04-09T18:19:01.929 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-04-09T18:19:01.941 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-04-09T18:19:02.040 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-04-09T18:19:02.051 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-04-09T18:19:02.073 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:19:02.075 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-04-09T18:19:02.116 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:02.119 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-04-09T18:19:02.270 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-04-09T18:19:02.271 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-04-09T18:19:02.284 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-04-09T18:19:02.318 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:19:02.320 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-04-09T18:19:02.399 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:02.401 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-04-09T18:19:02.459 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-04-09T18:19:02.482 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-04-09T18:19:02.509 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-04-09T18:19:02.597 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:19:02.599 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-04-09T18:19:02.620 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:02.622 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-04-09T18:19:02.698 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-04-09T18:19:02.723 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-04-09T18:19:02.724 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:02.770 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-04-09T18:19:02.846 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:19:02.848 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-04-09T18:19:02.850 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-04-09T18:19:02.922 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:02.924 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-04-09T18:19:02.987 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-04-09T18:19:03.029 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:19:03.032 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-04-09T18:19:03.041 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:03.043 INFO:teuthology.task.ansible.out:TASK [Remove revoked users] **************************************************** ok: [smithi090.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-04-09T18:19:03.085 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-04-09T18:19:03.162 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-04-09T18:19:03.309 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-04-09T18:19:03.333 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-04-09T18:19:03.334 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:19:03.335 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-04-09T18:19:03.402 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:03.404 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-04-09T18:19:03.522 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:03.527 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:19:03.808 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:03.810 INFO:teuthology.task.ansible.out:TASK [Remove revoked users] **************************************************** ok: [smithi079.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-04-09T18:19:03.815 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-04-09T18:19:03.818 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-04-09T18:19:03.819 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-04-09T18:19:03.901 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-04-09T18:19:03.927 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:03.954 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-04-09T18:19:03.961 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:03.964 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-04-09T18:19:03.965 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:03.974 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-04-09T18:19:04.119 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:04 +0000 (0:00:03.980) 0:02:41.638 ********** 2021-04-09T18:19:04.156 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-04-09T18:19:04.232 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-04-09T18:19:04.239 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} ok: [smithi090.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-04-09T18:19:04.258 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-04-09T18:19:04.378 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-04-09T18:19:04.403 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-04-09T18:19:04.458 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-04-09T18:19:04.508 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:04.511 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:04.536 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:04.547 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:04.554 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-04-09T18:19:04.563 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:04.572 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:04.572 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:04.573 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:04.575 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:04.598 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:04.621 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:04.630 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:04.642 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:04.643 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-04-09T18:19:04.690 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:04.692 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:04.735 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:04.737 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-04-09T18:19:04.751 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:04.759 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:04.761 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-04-09T18:19:04.877 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-04-09T18:19:04.942 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-04-09T18:19:04.967 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-04-09T18:19:04.987 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-04-09T18:19:05.164 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-04-09T18:19:05.178 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-04-09T18:19:05.206 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-04-09T18:19:05.266 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-04-09T18:19:05.267 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:05.281 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-04-09T18:19:05.283 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:05.314 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:05.392 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi079.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-04-09T18:19:05.431 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-04-09T18:19:05.463 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-04-09T18:19:05.535 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:05.537 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-04-09T18:19:05.548 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:05.550 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-04-09T18:19:05.635 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-04-09T18:19:05.637 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-04-09T18:19:05.661 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-04-09T18:19:05.760 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-04-09T18:19:05.762 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:05.837 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:05.839 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-04-09T18:19:05.876 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:05.878 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi089.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-04-09T18:19:05.904 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:05.905 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:05.931 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi079.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-04-09T18:19:05.939 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:05.941 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi090.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-04-09T18:19:05.953 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:05.985 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:05.986 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:05.987 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-04-09T18:19:06.010 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:06.012 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.012 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:06.024 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.036 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.056 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.057 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.069 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.094 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.106 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.128 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.162 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:06.164 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.182 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi136.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-04-09T18:19:06.191 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-04-09T18:19:06.203 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:06.205 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:06.206 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-04-09T18:19:06.221 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:06.223 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.253 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.321 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.356 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.391 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.431 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi136.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} ok: [smithi079.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} ok: [smithi089.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-04-09T18:19:06.452 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-04-09T18:19:06.453 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:06.453 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.520 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.543 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.554 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.579 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.591 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.615 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.617 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.620 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:06.622 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} ok: [smithi079.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-04-09T18:19:06.623 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:06.623 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.642 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.644 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.655 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.656 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:06.657 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-04-09T18:19:06.677 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.689 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.712 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.713 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:06.714 INFO:teuthology.task.ansible.out:TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:06.715 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-04-09T18:19:06.727 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:06.729 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.773 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.795 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:06.797 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-04-09T18:19:06.808 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:06.809 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.810 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.823 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:06.825 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-04-09T18:19:06.850 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:06.856 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.863 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:06.865 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-04-09T18:19:06.874 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:06.876 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.886 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.888 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.897 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.909 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.941 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.958 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.969 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:06.971 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-04-09T18:19:06.985 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:06.987 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:06.988 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi079.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-04-09T18:19:06.999 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:07.001 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.014 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.047 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.049 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:07.069 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:07.071 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-04-09T18:19:07.092 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:07.095 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.110 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.120 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi089.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-04-09T18:19:07.132 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:07.134 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.174 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:07.177 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-04-09T18:19:07.197 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:07.199 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi090.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-04-09T18:19:07.252 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:07.254 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.265 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:07.267 INFO:teuthology.task.ansible.out:TASK [Remove revoked users] **************************************************** ok: [smithi136.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-04-09T18:19:07.278 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:07.279 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.308 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.310 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:07.358 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.380 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.403 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:07.405 INFO:teuthology.task.ansible.out:TASK [Remove revoked users] **************************************************** ok: [smithi089.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-04-09T18:19:07.450 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:07.452 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.453 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:07.454 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.476 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:07.478 INFO:teuthology.task.ansible.out:TASK [Remove revoked users] **************************************************** ok: [smithi136.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-04-09T18:19:07.479 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-04-09T18:19:07.481 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.513 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:07.515 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-04-09T18:19:07.536 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.577 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.589 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.636 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.638 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:07.651 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:07.653 INFO:teuthology.task.ansible.out:TASK [Remove revoked users] **************************************************** ok: [smithi136.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-04-09T18:19:07.654 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:07.667 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-04-09T18:19:07.669 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:07.691 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:07.693 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.714 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.715 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:07.739 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:07.741 INFO:teuthology.task.ansible.out:TASK [Remove revoked users] **************************************************** ok: [smithi090.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-04-09T18:19:07.764 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:07.766 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi079.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-04-09T18:19:07.825 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:07.827 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.871 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.894 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:07.896 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-04-09T18:19:07.920 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.932 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.934 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi089.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-04-09T18:19:07.944 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:07.946 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:07.966 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:07.968 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-04-09T18:19:07.978 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-04-09T18:19:07.980 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.011 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.033 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.035 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:08.055 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.057 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:08.067 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.133 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi136.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-04-09T18:19:08.134 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:08.135 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.147 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:08.149 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-04-09T18:19:08.186 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-04-09T18:19:08.189 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.205 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:08.207 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-04-09T18:19:08.228 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:08.230 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.241 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.262 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.285 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.297 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.309 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.331 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:08.334 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-04-09T18:19:08.344 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:08.346 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.357 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.367 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:08.369 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-04-09T18:19:08.379 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:08.381 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.402 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:08.404 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-04-09T18:19:08.425 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:08.427 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.437 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:08.439 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.476 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.498 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.510 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi090.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-04-09T18:19:08.520 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:08.523 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.554 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.566 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:08.568 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-04-09T18:19:08.569 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.603 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.618 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.619 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:08.619 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-04-09T18:19:08.621 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:08.624 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:08.626 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.640 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.641 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi079.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-04-09T18:19:08.652 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:08.654 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.674 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.676 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.685 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.696 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:08.699 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-04-09T18:19:08.708 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:08.711 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.740 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.772 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.784 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.795 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:08.797 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-04-09T18:19:08.818 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:08.819 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.841 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.852 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:08.854 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-04-09T18:19:08.866 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:08.867 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.878 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:08.879 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-04-09T18:19:08.912 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:19:08.914 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.924 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.979 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:08.991 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:09.095 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:09.097 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-04-09T18:19:09.098 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-04-09T18:19:09.104 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:09.158 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:09 +0000 (0:00:05.038) 0:02:46.677 ********** 2021-04-09T18:19:09.198 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-04-09T18:19:09.252 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-04-09T18:19:09.295 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-04-09T18:19:09.329 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-04-09T18:19:09.405 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-04-09T18:19:09.407 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:09.444 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:09 +0000 (0:00:00.285) 0:02:46.963 ********** 2021-04-09T18:19:09.464 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:09.467 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-04-09T18:19:09.495 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-04-09T18:19:09.568 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-04-09T18:19:09.715 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-04-09T18:19:09.766 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-04-09T18:19:09.895 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-04-09T18:19:09.916 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-04-09T18:19:09.983 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-04-09T18:19:10.018 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-04-09T18:19:10.117 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-04-09T18:19:10.198 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-04-09T18:19:10.275 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-04-09T18:19:10.346 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-04-09T18:19:10.367 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-04-09T18:19:10.400 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-04-09T18:19:10.412 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-04-09T18:19:10.518 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-04-09T18:19:10.571 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-04-09T18:19:10.604 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-04-09T18:19:10.621 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-04-09T18:19:10.644 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-04-09T18:19:10.796 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-04-09T18:19:10.848 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-04-09T18:19:10.860 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-04-09T18:19:10.863 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-04-09T18:19:10.961 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-04-09T18:19:10.973 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-04-09T18:19:11.040 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-04-09T18:19:11.074 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-04-09T18:19:11.129 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-04-09T18:19:11.142 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-04-09T18:19:11.228 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-04-09T18:19:11.309 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-04-09T18:19:11.322 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-04-09T18:19:11.403 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-04-09T18:19:11.434 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-04-09T18:19:11.447 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-04-09T18:19:11.625 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} ok: [smithi144.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-04-09T18:19:11.688 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-04-09T18:19:11.701 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-04-09T18:19:11.713 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-04-09T18:19:11.893 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:11 +0000 (0:00:02.449) 0:02:49.412 ********** 2021-04-09T18:19:11.928 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-04-09T18:19:11.933 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-04-09T18:19:11.936 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-04-09T18:19:11.937 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:11.940 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-04-09T18:19:11.941 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:12.092 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-04-09T18:19:12.094 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-04-09T18:19:12.181 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-04-09T18:19:12.213 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-04-09T18:19:12.336 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-04-09T18:19:12.359 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-04-09T18:19:12.426 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-04-09T18:19:12.492 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:12 +0000 (0:00:00.599) 0:02:50.012 ********** 2021-04-09T18:19:12.517 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-04-09T18:19:12.554 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-04-09T18:19:12.655 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-04-09T18:19:12.734 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-04-09T18:19:12.758 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-04-09T18:19:12.864 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-04-09T18:19:13.074 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:13 +0000 (0:00:00.581) 0:02:50.593 ********** 2021-04-09T18:19:13.098 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-04-09T18:19:13.100 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-04-09T18:19:13.106 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:13.106 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:13.108 INFO:teuthology.task.ansible.out:TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-04-09T18:19:13.109 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"changed": true, "checksum": "53b31205b3cc9729fea6ce5ceab6366ba2fdabc0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "6cd40c867036c949fadb741414d81285", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992352.266156-23892-228852855347607/source", "state": "file", "uid": 0} 2021-04-09T18:19:13.142 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:13.147 INFO:teuthology.task.ansible.out:TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:13.278 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:13 +0000 (0:00:00.203) 0:02:50.797 ********** 2021-04-09T18:19:13.432 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:13 +0000 (0:00:00.152) 0:02:50.950 ********** 2021-04-09T18:19:13.468 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} ok: [smithi144.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-04-09T18:19:13.529 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-04-09T18:19:13.531 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => { "msg": "Host smithi090.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2021-04-09T18:19:13.567 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:13 +0000 (0:00:00.136) 0:02:51.086 ********** 2021-04-09T18:19:13.696 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:13.698 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-04-09T18:19:13.762 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-04-09T18:19:13.767 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "checksum": "53b31205b3cc9729fea6ce5ceab6366ba2fdabc0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "6cd40c867036c949fadb741414d81285", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992353.0731404-24036-8570072165623/source", "state": "file", "uid": 0} 2021-04-09T18:19:13.832 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:13 +0000 (0:00:00.263) 0:02:51.350 ********** 2021-04-09T18:19:13.936 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:13.938 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-04-09T18:19:14.036 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-04-09T18:19:14.038 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-04-09T18:19:14.095 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:14 +0000 (0:00:00.263) 0:02:51.613 ********** 2021-04-09T18:19:14.139 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-04-09T18:19:14.147 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => { "msg": "Host smithi079.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2021-04-09T18:19:14.253 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:14 +0000 (0:00:00.157) 0:02:51.770 ********** 2021-04-09T18:19:14.300 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:14.302 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-04-09T18:19:14.303 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:14.305 INFO:teuthology.task.ansible.out:TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-04-09T18:19:14.306 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"changed": true, "checksum": "53b31205b3cc9729fea6ce5ceab6366ba2fdabc0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "6cd40c867036c949fadb741414d81285", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992353.5427277-24183-23850241999406/source", "state": "file", "uid": 0} 2021-04-09T18:19:14.381 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:14 +0000 (0:00:00.128) 0:02:51.899 ********** 2021-04-09T18:19:14.457 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi144.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-04-09T18:19:14.460 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "checksum": "53b31205b3cc9729fea6ce5ceab6366ba2fdabc0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "6cd40c867036c949fadb741414d81285", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992353.7229207-24279-159437942588151/source", "state": "file", "uid": 0} 2021-04-09T18:19:14.511 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:14 +0000 (0:00:00.130) 0:02:52.030 ********** 2021-04-09T18:19:14.589 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-04-09T18:19:14.591 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:14.652 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:14 +0000 (0:00:00.134) 0:02:52.164 ********** 2021-04-09T18:19:14.700 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-04-09T18:19:14.702 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-04-09T18:19:14.703 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:14.704 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-04-09T18:19:14.777 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:14 +0000 (0:00:00.132) 0:02:52.296 ********** 2021-04-09T18:19:14.811 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-04-09T18:19:14.821 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => { "msg": "Host smithi089.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2021-04-09T18:19:14.913 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:14 +0000 (0:00:00.133) 0:02:52.430 ********** 2021-04-09T18:19:15.012 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => { "msg": "Host smithi136.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2021-04-09T18:19:15.040 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi144.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-04-09T18:19:15.042 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:15.097 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:15 +0000 (0:00:00.185) 0:02:52.616 ********** 2021-04-09T18:19:15.099 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:15.196 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:15 +0000 (0:00:00.099) 0:02:52.716 ********** 2021-04-09T18:19:15.205 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:15.348 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:15 +0000 (0:00:00.152) 0:02:52.868 ********** 2021-04-09T18:19:15.400 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:15.402 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-04-09T18:19:15.447 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-04-09T18:19:15.449 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-04-09T18:19:15.613 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:15 +0000 (0:00:00.257) 0:02:53.125 ********** 2021-04-09T18:19:15.618 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:15.677 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:15.679 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-04-09T18:19:15.680 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:15.681 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:15.778 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:15 +0000 (0:00:00.172) 0:02:53.298 ********** 2021-04-09T18:19:15.962 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:15 +0000 (0:00:00.183) 0:02:53.481 ********** 2021-04-09T18:19:16.008 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:16.013 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-04-09T18:19:16.014 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-04-09T18:19:16.015 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-04-09T18:19:16.017 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi144.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-04-09T18:19:16.019 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:16.147 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:16 +0000 (0:00:00.185) 0:02:53.666 ********** 2021-04-09T18:19:16.261 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:16 +0000 (0:00:00.113) 0:02:53.780 ********** 2021-04-09T18:19:16.274 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-04-09T18:19:16.276 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:16.276 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:16.277 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-04-09T18:19:16.278 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:16.280 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:16.281 INFO:teuthology.task.ansible.out:TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-04-09T18:19:16.282 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:16.347 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:16 +0000 (0:00:00.085) 0:02:53.865 ********** 2021-04-09T18:19:16.364 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:16.474 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:16 +0000 (0:00:00.127) 0:02:53.993 ********** 2021-04-09T18:19:16.479 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:16.509 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:16.524 INFO:teuthology.task.ansible.out:TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:16.525 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-04-09T18:19:16.530 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:16.531 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:16.615 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:16 +0000 (0:00:00.141) 0:02:54.134 ********** 2021-04-09T18:19:16.660 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:16.666 INFO:teuthology.task.ansible.out:TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-04-09T18:19:16.668 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:16.735 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:16 +0000 (0:00:00.119) 0:02:54.253 ********** 2021-04-09T18:19:16.931 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:16 +0000 (0:00:00.196) 0:02:54.450 ********** 2021-04-09T18:19:16.984 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:16.986 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-04-09T18:19:16.994 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-04-09T18:19:17.223 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-04-09T18:19:17.428 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi144.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-04-09T18:19:17.514 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:17 +0000 (0:00:00.582) 0:02:55.033 ********** 2021-04-09T18:19:17.545 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:17.637 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:17 +0000 (0:00:00.122) 0:02:55.155 ********** 2021-04-09T18:19:17.654 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:17.660 INFO:teuthology.task.ansible.out:TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-04-09T18:19:17.662 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:17.662 INFO:teuthology.task.ansible.out:TASK [Remove revoked users] **************************************************** ok: [smithi144.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-04-09T18:19:18.224 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:18 +0000 (0:00:00.584) 0:02:55.740 ********** 2021-04-09T18:19:18.242 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-04-09T18:19:18.244 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:18.247 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:18.249 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:18.258 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi144.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-04-09T18:19:18.308 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:18 +0000 (0:00:00.086) 0:02:55.827 ********** 2021-04-09T18:19:18.358 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:18 +0000 (0:00:00.047) 0:02:55.875 ********** 2021-04-09T18:19:18.458 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-04-09T18:19:18.460 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:18.507 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:18 +0000 (0:00:00.150) 0:02:56.026 ********** 2021-04-09T18:19:18.524 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-04-09T18:19:18.526 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:18.527 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-04-09T18:19:18.648 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:18 +0000 (0:00:00.141) 0:02:56.167 ********** 2021-04-09T18:19:18.696 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:18.795 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:18 +0000 (0:00:00.146) 0:02:56.314 ********** 2021-04-09T18:19:18.848 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-04-09T18:19:18.850 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:18.850 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-04-09T18:19:18.852 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:18.952 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:18 +0000 (0:00:00.156) 0:02:56.471 ********** 2021-04-09T18:19:19.055 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:19 +0000 (0:00:00.102) 0:02:56.574 ********** 2021-04-09T18:19:19.065 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-04-09T18:19:19.068 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi144.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-04-09T18:19:19.166 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:19 +0000 (0:00:00.111) 0:02:56.686 ********** 2021-04-09T18:19:19.257 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:19.370 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:19 +0000 (0:00:00.203) 0:02:56.889 ********** 2021-04-09T18:19:19.372 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:19.387 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-04-09T18:19:19.389 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:19.465 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:19 +0000 (0:00:00.095) 0:02:56.984 ********** 2021-04-09T18:19:19.650 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:19 +0000 (0:00:00.179) 0:02:57.164 ********** 2021-04-09T18:19:19.670 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-04-09T18:19:19.672 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi090.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:19.673 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** changed: [smithi144.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-04-09T18:19:19.736 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:19 +0000 (0:00:00.092) 0:02:57.256 ********** 2021-04-09T18:19:19.761 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-04-09T18:19:19.763 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:19.841 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:19 +0000 (0:00:00.104) 0:02:57.360 ********** 2021-04-09T18:19:19.856 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-04-09T18:19:19.859 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set have_entitlements] ****************************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:19.910 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:19 +0000 (0:00:00.069) 0:02:57.429 ********** 2021-04-09T18:19:19.965 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:19 +0000 (0:00:00.054) 0:02:57.484 ********** 2021-04-09T18:19:19.974 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:20.007 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:20.008 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-04-09T18:19:20.010 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:20.086 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:20 +0000 (0:00:00.120) 0:02:57.605 ********** 2021-04-09T18:19:20.108 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-04-09T18:19:20.109 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:20.111 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:20.212 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:20 +0000 (0:00:00.126) 0:02:57.732 ********** 2021-04-09T18:19:20.238 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:20.240 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-04-09T18:19:20.245 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:20.251 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:20.282 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:20 +0000 (0:00:00.069) 0:02:57.801 ********** 2021-04-09T18:19:20.326 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:20 +0000 (0:00:00.044) 0:02:57.845 ********** 2021-04-09T18:19:20.334 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:20.361 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:20 +0000 (0:00:00.035) 0:02:57.880 ********** 2021-04-09T18:19:20.404 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:20.406 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-04-09T18:19:20.417 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:20.421 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-04-09T18:19:20.423 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:20.497 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:20 +0000 (0:00:00.135) 0:02:58.016 ********** 2021-04-09T18:19:20.536 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-04-09T18:19:20.538 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:20.595 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:20 +0000 (0:00:00.097) 0:02:58.114 ********** 2021-04-09T18:19:20.629 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi089.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:20.631 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:20.635 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:20.637 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-04-09T18:19:20.676 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:20 +0000 (0:00:00.079) 0:02:58.194 ********** 2021-04-09T18:19:20.703 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-04-09T18:19:20.705 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:20.706 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:20.752 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:20 +0000 (0:00:00.077) 0:02:58.272 ********** 2021-04-09T18:19:20.836 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:20 +0000 (0:00:00.083) 0:02:58.355 ********** 2021-04-09T18:19:20.868 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:20.869 INFO:teuthology.task.ansible.out:TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:20.870 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-04-09T18:19:20.873 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-04-09T18:19:20.877 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:20.955 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:20 +0000 (0:00:00.115) 0:02:58.471 ********** 2021-04-09T18:19:20.959 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:21.008 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:21.051 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:21 +0000 (0:00:00.099) 0:02:58.570 ********** 2021-04-09T18:19:21.082 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi090.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:21.084 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-04-09T18:19:21.211 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:21 +0000 (0:00:00.159) 0:02:58.730 ********** 2021-04-09T18:19:21.250 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-04-09T18:19:21.252 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:21.394 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:21 +0000 (0:00:00.182) 0:02:58.913 ********** 2021-04-09T18:19:21.431 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:21.471 INFO:teuthology.task.ansible.out:TASK [common : Include Red Hat encrypted variables.] *************************** 2021-04-09T18:19:21.473 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:21.475 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:21.475 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-04-09T18:19:21.571 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:21 +0000 (0:00:00.162) 0:02:59.075 ********** 2021-04-09T18:19:21.594 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-04-09T18:19:21.595 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:21.609 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:21.618 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:21.683 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:21 +0000 (0:00:00.126) 0:02:59.202 ********** 2021-04-09T18:19:21.774 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:21 +0000 (0:00:00.091) 0:02:59.293 ********** 2021-04-09T18:19:21.803 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi144.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-04-09T18:19:21.902 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-04-09T18:19:21.904 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:21.966 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:21 +0000 (0:00:00.191) 0:02:59.485 ********** 2021-04-09T18:19:21.988 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi079.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:22.051 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:22 +0000 (0:00:00.085) 0:02:59.570 ********** 2021-04-09T18:19:22.108 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:19:22.110 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-04-09T18:19:22.222 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-04-09T18:19:22.224 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set have_entitlements] ****************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:22.288 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:22 +0000 (0:00:00.237) 0:02:59.807 ********** 2021-04-09T18:19:22.453 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:22 +0000 (0:00:00.164) 0:02:59.972 ********** 2021-04-09T18:19:22.522 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:22 +0000 (0:00:00.069) 0:03:00.041 ********** 2021-04-09T18:19:22.540 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-04-09T18:19:22.542 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:22.545 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-04-09T18:19:22.546 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:22.608 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:22 +0000 (0:00:00.085) 0:03:00.127 ********** 2021-04-09T18:19:22.698 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:22 +0000 (0:00:00.090) 0:03:00.218 ********** 2021-04-09T18:19:22.782 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:22 +0000 (0:00:00.083) 0:03:00.301 ********** 2021-04-09T18:19:22.810 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-04-09T18:19:22.812 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:22.916 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:22 +0000 (0:00:00.134) 0:03:00.435 ********** 2021-04-09T18:19:22.927 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-04-09T18:19:22.929 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:23.019 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:23 +0000 (0:00:00.103) 0:03:00.539 ********** 2021-04-09T18:19:23.056 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-04-09T18:19:23.058 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:23.119 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:23 +0000 (0:00:00.097) 0:03:00.638 ********** 2021-04-09T18:19:23.146 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the releasever] ********************************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:23.251 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:23 +0000 (0:00:00.131) 0:03:00.770 ********** 2021-04-09T18:19:23.357 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:23 +0000 (0:00:00.104) 0:03:00.875 ********** 2021-04-09T18:19:23.359 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:23.376 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-04-09T18:19:23.378 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:23.380 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:23.544 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:23 +0000 (0:00:00.188) 0:03:01.063 ********** 2021-04-09T18:19:23.561 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:23.568 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:23.635 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:23 +0000 (0:00:00.091) 0:03:01.155 ********** 2021-04-09T18:19:23.717 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-04-09T18:19:23.719 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:23.756 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:23 +0000 (0:00:00.121) 0:03:01.276 ********** 2021-04-09T18:19:23.772 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi144.front.sepia.ceph.com] => {"changed": true, "checksum": "53b31205b3cc9729fea6ce5ceab6366ba2fdabc0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "6cd40c867036c949fadb741414d81285", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992362.9085777-26614-228729327269713/source", "state": "file", "uid": 0} 2021-04-09T18:19:23.806 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:23 +0000 (0:00:00.049) 0:03:01.325 ********** 2021-04-09T18:19:23.836 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-04-09T18:19:23.838 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi136.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : List CDN releases available to system] ************************** 2021-04-09T18:19:23.839 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:23.865 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:23 +0000 (0:00:00.059) 0:03:01.385 ********** 2021-04-09T18:19:23.982 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:23 +0000 (0:00:00.116) 0:03:01.501 ********** 2021-04-09T18:19:24.154 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:24 +0000 (0:00:00.171) 0:03:01.673 ********** 2021-04-09T18:19:24.218 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-04-09T18:19:24.220 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:24.237 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:24.354 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:24 +0000 (0:00:00.199) 0:03:01.873 ********** 2021-04-09T18:19:24.537 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:24 +0000 (0:00:00.183) 0:03:02.057 ********** 2021-04-09T18:19:24.545 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:24.599 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-04-09T18:19:24.601 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => { "msg": "Host smithi144.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } TASK [common : List CDN releases available to system] ************************** 2021-04-09T18:19:24.602 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:24.602 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-04-09T18:19:24.602 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:24.782 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:24 +0000 (0:00:00.244) 0:03:02.301 ********** 2021-04-09T18:19:24.941 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:24 +0000 (0:00:00.159) 0:03:02.460 ********** 2021-04-09T18:19:25.048 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:25 +0000 (0:00:00.107) 0:03:02.568 ********** 2021-04-09T18:19:25.066 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-04-09T18:19:25.067 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi090.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:25.239 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:25 +0000 (0:00:00.179) 0:03:02.747 ********** 2021-04-09T18:19:25.412 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:25 +0000 (0:00:00.184) 0:03:02.931 ********** 2021-04-09T18:19:25.447 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:25.455 INFO:teuthology.task.ansible.out:TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-04-09T18:19:25.457 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:25.459 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:25.463 INFO:teuthology.task.ansible.out:TASK [common : Register with subscription-manager.] **************************** 2021-04-09T18:19:25.464 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:25.521 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:25 +0000 (0:00:00.109) 0:03:03.041 ********** 2021-04-09T18:19:25.609 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:25 +0000 (0:00:00.087) 0:03:03.128 ********** 2021-04-09T18:19:25.613 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:25.657 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-04-09T18:19:25.659 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-04-09T18:19:25.660 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:25.669 INFO:teuthology.task.ansible.out:TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-04-09T18:19:25.671 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:25.738 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:25 +0000 (0:00:00.129) 0:03:03.257 ********** 2021-04-09T18:19:25.787 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:25 +0000 (0:00:00.048) 0:03:03.306 ********** 2021-04-09T18:19:25.795 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-04-09T18:19:25.797 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:25.844 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:25 +0000 (0:00:00.058) 0:03:03.364 ********** 2021-04-09T18:19:26.033 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-04-09T18:19:26.034 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:26.093 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:26 +0000 (0:00:00.248) 0:03:03.613 ********** 2021-04-09T18:19:26.125 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-04-09T18:19:26.127 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:26.290 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:26 +0000 (0:00:00.196) 0:03:03.810 ********** 2021-04-09T18:19:26.341 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-04-09T18:19:26.343 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:26.344 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:26.461 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:26 +0000 (0:00:00.170) 0:03:03.980 ********** 2021-04-09T18:19:26.554 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:26 +0000 (0:00:00.092) 0:03:04.073 ********** 2021-04-09T18:19:26.558 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:26.598 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:26 +0000 (0:00:00.044) 0:03:04.117 ********** 2021-04-09T18:19:26.608 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:26.609 INFO:teuthology.task.ansible.out:TASK [common : List CDN releases available to system] ************************** 2021-04-09T18:19:26.612 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:26.685 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:26 +0000 (0:00:00.086) 0:03:04.204 ********** 2021-04-09T18:19:26.695 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:26.702 INFO:teuthology.task.ansible.out:TASK [common : Get list of enabled RHSM repos] ********************************* 2021-04-09T18:19:26.704 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:26.782 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:26 +0000 (0:00:00.085) 0:03:04.290 ********** 2021-04-09T18:19:26.858 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-04-09T18:19:26.860 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:26.894 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:26 +0000 (0:00:00.124) 0:03:04.414 ********** 2021-04-09T18:19:26.896 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:26.914 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-04-09T18:19:26.916 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:27.039 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:27 +0000 (0:00:00.144) 0:03:04.558 ********** 2021-04-09T18:19:27.095 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Store list of enabled repos] ************************************ skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:27.096 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:27.102 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:27.163 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:27 +0000 (0:00:00.123) 0:03:04.682 ********** 2021-04-09T18:19:27.266 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:27 +0000 (0:00:00.098) 0:03:04.780 ********** 2021-04-09T18:19:27.276 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:27.422 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:27 +0000 (0:00:00.161) 0:03:04.942 ********** 2021-04-09T18:19:27.490 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-04-09T18:19:27.492 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:27.552 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:27 +0000 (0:00:00.128) 0:03:05.070 ********** 2021-04-09T18:19:27.554 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:27.648 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:27 +0000 (0:00:00.096) 0:03:05.167 ********** 2021-04-09T18:19:27.660 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-04-09T18:19:27.662 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:27.765 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:27 +0000 (0:00:00.117) 0:03:05.284 ********** 2021-04-09T18:19:27.974 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:27 +0000 (0:00:00.208) 0:03:05.493 ********** 2021-04-09T18:19:28.021 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:28.023 INFO:teuthology.task.ansible.out:TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-04-09T18:19:28.025 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:28.029 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:28.031 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-04-09T18:19:28.033 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:28.038 INFO:teuthology.task.ansible.out:TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:28.133 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:28 +0000 (0:00:00.159) 0:03:05.653 ********** 2021-04-09T18:19:28.137 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:28.346 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:28 +0000 (0:00:00.212) 0:03:05.865 ********** 2021-04-09T18:19:28.450 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:28 +0000 (0:00:00.103) 0:03:05.969 ********** 2021-04-09T18:19:28.503 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-04-09T18:19:28.505 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:28.516 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:28.517 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:28.610 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:28 +0000 (0:00:00.160) 0:03:06.129 ********** 2021-04-09T18:19:28.727 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:28 +0000 (0:00:00.116) 0:03:06.246 ********** 2021-04-09T18:19:28.826 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:28 +0000 (0:00:00.099) 0:03:06.346 ********** 2021-04-09T18:19:28.871 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-04-09T18:19:28.873 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:28.993 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:28 +0000 (0:00:00.166) 0:03:06.512 ********** 2021-04-09T18:19:29.040 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-04-09T18:19:29.042 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:29.048 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-04-09T18:19:29.050 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:29.140 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:29 +0000 (0:00:00.146) 0:03:06.659 ********** 2021-04-09T18:19:29.183 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:29 +0000 (0:00:00.043) 0:03:06.702 ********** 2021-04-09T18:19:29.192 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:29.198 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:29.208 INFO:teuthology.task.ansible.out:TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-04-09T18:19:29.210 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:29.314 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:29 +0000 (0:00:00.131) 0:03:06.834 ********** 2021-04-09T18:19:29.327 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:29.348 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:29.352 INFO:teuthology.task.ansible.out:TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-04-09T18:19:29.354 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:29.358 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:29.360 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-04-09T18:19:29.360 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:29.419 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:29 +0000 (0:00:00.104) 0:03:06.938 ********** 2021-04-09T18:19:29.541 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:29 +0000 (0:00:00.121) 0:03:07.060 ********** 2021-04-09T18:19:29.586 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-04-09T18:19:29.588 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:29.652 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:29 +0000 (0:00:00.111) 0:03:07.171 ********** 2021-04-09T18:19:29.699 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:29 +0000 (0:00:00.047) 0:03:07.218 ********** 2021-04-09T18:19:29.706 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-04-09T18:19:29.708 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:29.733 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:29 +0000 (0:00:00.033) 0:03:07.252 ********** 2021-04-09T18:19:29.743 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:29.753 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-04-09T18:19:29.756 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:29.801 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:29 +0000 (0:00:00.067) 0:03:07.320 ********** 2021-04-09T18:19:29.832 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:29.834 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:29.906 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:29 +0000 (0:00:00.100) 0:03:07.421 ********** 2021-04-09T18:19:29.991 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:29 +0000 (0:00:00.089) 0:03:07.510 ********** 2021-04-09T18:19:30.038 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:30.040 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:30.097 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:30 +0000 (0:00:00.106) 0:03:07.617 ********** 2021-04-09T18:19:30.169 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:30 +0000 (0:00:00.071) 0:03:07.688 ********** 2021-04-09T18:19:30.194 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-04-09T18:19:30.202 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:30.244 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:30 +0000 (0:00:00.075) 0:03:07.763 ********** 2021-04-09T18:19:30.294 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:30 +0000 (0:00:00.049) 0:03:07.813 ********** 2021-04-09T18:19:30.296 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:30.362 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-04-09T18:19:30.364 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:30.502 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:30 +0000 (0:00:00.208) 0:03:08.022 ********** 2021-04-09T18:19:30.506 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:30.534 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:30.544 INFO:teuthology.task.ansible.out:TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-04-09T18:19:30.546 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set entitlements_path] ****************************************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:30.648 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:30 +0000 (0:00:00.139) 0:03:08.162 ********** 2021-04-09T18:19:30.769 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:30 +0000 (0:00:00.126) 0:03:08.288 ********** 2021-04-09T18:19:30.789 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-04-09T18:19:30.791 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:30.820 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:30.914 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:30 +0000 (0:00:00.145) 0:03:08.433 ********** 2021-04-09T18:19:31.095 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:31 +0000 (0:00:00.180) 0:03:08.614 ********** 2021-04-09T18:19:31.284 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:31 +0000 (0:00:00.187) 0:03:08.802 ********** 2021-04-09T18:19:31.335 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:31.352 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-04-09T18:19:31.354 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi144.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:31.442 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:31 +0000 (0:00:00.158) 0:03:08.961 ********** 2021-04-09T18:19:31.518 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:31 +0000 (0:00:00.076) 0:03:09.038 ********** 2021-04-09T18:19:31.543 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:31.550 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-04-09T18:19:31.552 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:31.569 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:31.618 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:31 +0000 (0:00:00.098) 0:03:09.137 ********** 2021-04-09T18:19:31.637 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-04-09T18:19:31.642 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:31.746 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:31 +0000 (0:00:00.128) 0:03:09.265 ********** 2021-04-09T18:19:31.893 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:31 +0000 (0:00:00.146) 0:03:09.412 ********** 2021-04-09T18:19:31.936 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-04-09T18:19:31.939 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:32.102 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:32 +0000 (0:00:00.209) 0:03:09.621 ********** 2021-04-09T18:19:32.126 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-04-09T18:19:32.128 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:32.153 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:32.165 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-04-09T18:19:32.167 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:32.167 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:32.246 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:32 +0000 (0:00:00.143) 0:03:09.765 ********** 2021-04-09T18:19:32.360 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:32 +0000 (0:00:00.113) 0:03:09.879 ********** 2021-04-09T18:19:32.499 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:32 +0000 (0:00:00.139) 0:03:10.018 ********** 2021-04-09T18:19:32.533 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:32.540 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:32.547 INFO:teuthology.task.ansible.out:TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:32.594 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:32 +0000 (0:00:00.094) 0:03:10.113 ********** 2021-04-09T18:19:32.598 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:32.646 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:32 +0000 (0:00:00.052) 0:03:10.166 ********** 2021-04-09T18:19:32.704 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:32 +0000 (0:00:00.056) 0:03:10.223 ********** 2021-04-09T18:19:32.706 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:32.744 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-04-09T18:19:32.746 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:32.846 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:32 +0000 (0:00:00.142) 0:03:10.365 ********** 2021-04-09T18:19:32.899 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-04-09T18:19:32.902 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:32.939 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:33.010 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:33 +0000 (0:00:00.163) 0:03:10.529 ********** 2021-04-09T18:19:33.062 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-04-09T18:19:33.064 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:33.139 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:33 +0000 (0:00:00.125) 0:03:10.654 ********** 2021-04-09T18:19:33.151 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-04-09T18:19:33.153 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.095589", "end": "2021-04-09 18:19:33.062335", "rc": 0, "start": "2021-04-09 18:19:32.966746", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:33.154 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:33.168 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-04-09T18:19:33.169 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:33.257 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:33 +0000 (0:00:00.122) 0:03:10.776 ********** 2021-04-09T18:19:33.344 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:33 +0000 (0:00:00.086) 0:03:10.863 ********** 2021-04-09T18:19:33.509 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:33 +0000 (0:00:00.165) 0:03:11.029 ********** 2021-04-09T18:19:33.512 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:33.537 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-04-09T18:19:33.539 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:33.548 INFO:teuthology.task.ansible.out:TASK [common : Enable necessary rhsm repos] ************************************ 2021-04-09T18:19:33.550 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:33.642 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:33 +0000 (0:00:00.130) 0:03:11.160 ********** 2021-04-09T18:19:33.748 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:33 +0000 (0:00:00.107) 0:03:11.268 ********** 2021-04-09T18:19:33.762 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-04-09T18:19:33.764 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi089.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:33.764 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:33.803 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:33 +0000 (0:00:00.053) 0:03:11.321 ********** 2021-04-09T18:19:33.867 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:33 +0000 (0:00:00.065) 0:03:11.386 ********** 2021-04-09T18:19:33.885 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-04-09T18:19:33.887 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:33.991 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:33 +0000 (0:00:00.123) 0:03:11.510 ********** 2021-04-09T18:19:33.994 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:34.027 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-04-09T18:19:34.029 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:34.031 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:34.121 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:34 +0000 (0:00:00.129) 0:03:11.640 ********** 2021-04-09T18:19:34.164 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-04-09T18:19:34.166 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** 2021-04-09T18:19:34.166 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.011504", "end": "2021-04-09 18:19:34.061319", "rc": 0, "start": "2021-04-09 18:19:34.049815", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-04-09T18:19:34.168 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:34.304 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:34 +0000 (0:00:00.182) 0:03:11.823 ********** 2021-04-09T18:19:34.410 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:34 +0000 (0:00:00.102) 0:03:11.925 ********** 2021-04-09T18:19:34.574 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:34 +0000 (0:00:00.167) 0:03:12.093 ********** 2021-04-09T18:19:34.641 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Mask sleep units] *********************************************** skipping: [smithi079.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:34.664 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:34.765 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:34 +0000 (0:00:00.190) 0:03:12.284 ********** 2021-04-09T18:19:34.873 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:34 +0000 (0:00:00.107) 0:03:12.392 ********** 2021-04-09T18:19:34.878 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:34.891 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:34.893 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:35.010 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:35 +0000 (0:00:00.137) 0:03:12.529 ********** 2021-04-09T18:19:35.034 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:35.037 INFO:teuthology.task.ansible.out:TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-04-09T18:19:35.039 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:35.142 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:35 +0000 (0:00:00.131) 0:03:12.661 ********** 2021-04-09T18:19:35.184 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:35.188 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:35.192 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:35.193 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.023164", "end": "2021-04-09 18:19:35.039270", "rc": 0, "start": "2021-04-09 18:19:35.016106", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-04-09T18:19:35.194 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:35.259 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:35 +0000 (0:00:00.115) 0:03:12.777 ********** 2021-04-09T18:19:35.353 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:35 +0000 (0:00:00.095) 0:03:12.873 ********** 2021-04-09T18:19:35.371 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:35.380 INFO:teuthology.task.ansible.out:TASK [common : Register with subscription-manager.] **************************** skipping: [smithi144.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:35.381 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:35.411 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:35 +0000 (0:00:00.057) 0:03:12.930 ********** 2021-04-09T18:19:35.514 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:35 +0000 (0:00:00.103) 0:03:13.033 ********** 2021-04-09T18:19:35.525 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:35.536 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-04-09T18:19:35.538 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:35.597 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:35 +0000 (0:00:00.082) 0:03:13.116 ********** 2021-04-09T18:19:35.603 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:35.778 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:35 +0000 (0:00:00.177) 0:03:13.294 ********** 2021-04-09T18:19:35.804 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-04-09T18:19:35.806 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:35.807 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:35.811 INFO:teuthology.task.ansible.out:TASK [common : Set the timezone] *********************************************** 2021-04-09T18:19:35.813 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:35.858 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:35 +0000 (0:00:00.082) 0:03:13.377 ********** 2021-04-09T18:19:35.921 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:35 +0000 (0:00:00.063) 0:03:13.441 ********** 2021-04-09T18:19:35.927 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:35.955 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-04-09T18:19:35.972 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:36.042 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:36 +0000 (0:00:00.120) 0:03:13.562 ********** 2021-04-09T18:19:36.125 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:36 +0000 (0:00:00.082) 0:03:13.644 ********** 2021-04-09T18:19:36.152 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-04-09T18:19:36.154 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:36.174 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:36.199 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-04-09T18:19:36.213 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:36.215 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:36.230 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:36.304 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:36 +0000 (0:00:00.178) 0:03:13.823 ********** 2021-04-09T18:19:36.306 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:36.421 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:36 +0000 (0:00:00.116) 0:03:13.940 ********** 2021-04-09T18:19:36.443 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-04-09T18:19:36.445 INFO:teuthology.task.ansible.out: skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:36.524 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:36 +0000 (0:00:00.103) 0:03:14.043 ********** 2021-04-09T18:19:36.537 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:36.543 INFO:teuthology.task.ansible.out:TASK [common : Mask sleep units] *********************************************** 2021-04-09T18:19:36.544 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:36.545 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:36.547 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:36.547 INFO:teuthology.task.ansible.out:TASK [common : List CDN releases available to system] ************************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:36.554 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:36.555 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-04-09T18:19:36.556 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:36.621 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:36 +0000 (0:00:00.097) 0:03:14.141 ********** 2021-04-09T18:19:36.720 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:36 +0000 (0:00:00.098) 0:03:14.239 ********** 2021-04-09T18:19:36.740 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-04-09T18:19:36.741 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:36.846 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:36 +0000 (0:00:00.125) 0:03:14.364 ********** 2021-04-09T18:19:36.854 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:36.879 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-04-09T18:19:36.881 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:36.949 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:36 +0000 (0:00:00.103) 0:03:14.468 ********** 2021-04-09T18:19:36.959 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:36.975 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:36.980 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:36.990 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.018802", "end": "2021-04-09 18:19:36.924769", "rc": 0, "start": "2021-04-09 18:19:36.905967", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-04-09T18:19:37.040 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:37 +0000 (0:00:00.091) 0:03:14.559 ********** 2021-04-09T18:19:37.064 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:37 +0000 (0:00:00.023) 0:03:14.583 ********** 2021-04-09T18:19:37.072 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-04-09T18:19:37.074 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:37.107 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:37 +0000 (0:00:00.042) 0:03:14.626 ********** 2021-04-09T18:19:37.109 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:37.190 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:37.240 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:37 +0000 (0:00:00.132) 0:03:14.759 ********** 2021-04-09T18:19:37.258 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-04-09T18:19:37.261 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:37.308 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:37 +0000 (0:00:00.060) 0:03:14.819 ********** 2021-04-09T18:19:37.352 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-04-09T18:19:37.354 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:37.457 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:37 +0000 (0:00:00.157) 0:03:14.977 ********** 2021-04-09T18:19:37.479 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:37.508 INFO:teuthology.task.ansible.out:TASK [common : Set the timezone] *********************************************** 2021-04-09T18:19:37.515 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:37.639 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:37 +0000 (0:00:00.180) 0:03:15.158 ********** 2021-04-09T18:19:37.648 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:37.755 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:37 +0000 (0:00:00.116) 0:03:15.274 ********** 2021-04-09T18:19:37.787 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-04-09T18:19:37.789 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:37.847 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:37 +0000 (0:00:00.092) 0:03:15.366 ********** 2021-04-09T18:19:38.046 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:38 +0000 (0:00:00.199) 0:03:15.566 ********** 2021-04-09T18:19:38.115 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:38.117 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:38.219 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:38 +0000 (0:00:00.171) 0:03:15.737 ********** 2021-04-09T18:19:38.227 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:38.297 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:38 +0000 (0:00:00.078) 0:03:15.816 ********** 2021-04-09T18:19:38.315 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-04-09T18:19:38.319 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:38.325 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:38.326 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-04-09T18:19:38.327 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:38.328 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:38.336 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:38.337 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:38.339 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:38.447 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:38 +0000 (0:00:00.150) 0:03:15.966 ********** 2021-04-09T18:19:38.605 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:38 +0000 (0:00:00.158) 0:03:16.125 ********** 2021-04-09T18:19:38.612 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:38.627 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:38.630 INFO:teuthology.task.ansible.out:TASK [common : Set the hardware clock] ***************************************** 2021-04-09T18:19:38.633 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.735396", "end": "2021-04-09 18:19:38.500478", "rc": 0, "start": "2021-04-09 18:19:37.765082", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:19:38.638 INFO:teuthology.task.ansible.out:TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-04-09T18:19:38.640 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Refresh repos] ************************************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:38.733 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:38 +0000 (0:00:00.127) 0:03:16.253 ********** 2021-04-09T18:19:38.869 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:38 +0000 (0:00:00.135) 0:03:16.388 ********** 2021-04-09T18:19:39.034 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:39 +0000 (0:00:00.159) 0:03:16.548 ********** 2021-04-09T18:19:39.040 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:39.082 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-04-09T18:19:39.088 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:39.097 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-04-09T18:19:39.099 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:39.193 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:39 +0000 (0:00:00.158) 0:03:16.713 ********** 2021-04-09T18:19:39.278 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:39 +0000 (0:00:00.084) 0:03:16.798 ********** 2021-04-09T18:19:39.362 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:39 +0000 (0:00:00.083) 0:03:16.881 ********** 2021-04-09T18:19:39.381 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:39.386 INFO:teuthology.task.ansible.out:TASK [common : Refresh repos] ************************************************** 2021-04-09T18:19:39.387 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:39.465 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:39 +0000 (0:00:00.103) 0:03:16.984 ********** 2021-04-09T18:19:39.468 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:39.545 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-04-09T18:19:39.547 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.307837", "end": "2021-04-09 18:19:39.500329", "rc": 0, "start": "2021-04-09 18:19:39.192492", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:19:39.596 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:39 +0000 (0:00:00.130) 0:03:17.115 ********** 2021-04-09T18:19:39.661 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-04-09T18:19:39.663 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone] *********************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:39.737 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:39 +0000 (0:00:00.141) 0:03:17.257 ********** 2021-04-09T18:19:39.781 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:39 +0000 (0:00:00.043) 0:03:17.300 ********** 2021-04-09T18:19:39.785 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:39.905 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-04-09T18:19:39.906 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2021-04-09T18:19:39.907 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.303249", "end": "2021-04-09 18:19:39.867093", "rc": 0, "start": "2021-04-09 18:19:39.563844", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:19:40.057 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:40 +0000 (0:00:00.276) 0:03:17.576 ********** 2021-04-09T18:19:40.110 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-04-09T18:19:40.112 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:40.125 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-04-09T18:19:40.127 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:40.204 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:40 +0000 (0:00:00.147) 0:03:17.723 ********** 2021-04-09T18:19:40.211 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:40.273 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:40 +0000 (0:00:00.068) 0:03:17.792 ********** 2021-04-09T18:19:40.527 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-04-09T18:19:40.531 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:40.588 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:40 +0000 (0:00:00.315) 0:03:18.108 ********** 2021-04-09T18:19:40.616 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-04-09T18:19:40.619 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.740853", "end": "2021-04-09 18:19:40.500468", "rc": 0, "start": "2021-04-09 18:19:39.759615", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:19:40.682 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:40 +0000 (0:00:00.093) 0:03:18.201 ********** 2021-04-09T18:19:40.712 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-04-09T18:19:40.714 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:40.763 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:40 +0000 (0:00:00.080) 0:03:18.282 ********** 2021-04-09T18:19:40.840 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:40.892 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:40 +0000 (0:00:00.129) 0:03:18.411 ********** 2021-04-09T18:19:41.009 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:41.011 INFO:teuthology.task.ansible.out:TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:41.015 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:41.016 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-04-09T18:19:41.018 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.055345", "end": "2021-04-09 18:19:40.978830", "rc": 0, "start": "2021-04-09 18:19:40.923485", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:19:41.082 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:41 +0000 (0:00:00.189) 0:03:18.601 ********** 2021-04-09T18:19:41.180 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:41 +0000 (0:00:00.097) 0:03:18.699 ********** 2021-04-09T18:19:41.206 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-04-09T18:19:41.208 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:41.280 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:41 +0000 (0:00:00.100) 0:03:18.799 ********** 2021-04-09T18:19:41.304 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-04-09T18:19:41.306 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:41.373 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:41 +0000 (0:00:00.093) 0:03:18.892 ********** 2021-04-09T18:19:41.543 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:41.545 INFO:teuthology.task.ansible.out:TASK [common : Set the hardware clock] ***************************************** changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.020465", "end": "2021-04-09 18:19:41.500392", "rc": 0, "start": "2021-04-09 18:19:41.479927", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:19:41.598 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:41 +0000 (0:00:00.224) 0:03:19.117 ********** 2021-04-09T18:19:41.736 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-04-09T18:19:41.738 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.050129", "end": "2021-04-09 18:19:41.670416", "rc": 0, "start": "2021-04-09 18:19:41.620287", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:19:41.770 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:41 +0000 (0:00:00.172) 0:03:19.290 ********** 2021-04-09T18:19:41.963 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-04-09T18:19:41.966 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:42.043 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:42 +0000 (0:00:00.272) 0:03:19.562 ********** 2021-04-09T18:19:42.399 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-04-09T18:19:42.401 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:42.458 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:42 +0000 (0:00:00.415) 0:03:19.977 ********** 2021-04-09T18:19:42.594 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-04-09T18:19:42.600 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:42.643 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:42 +0000 (0:00:00.185) 0:03:20.162 ********** 2021-04-09T18:19:43.418 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.056931", "end": "2021-04-09 18:19:43.377668", "rc": 0, "start": "2021-04-09 18:19:43.320737", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:19:43.444 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:43 +0000 (0:00:00.801) 0:03:20.964 ********** 2021-04-09T18:19:43.487 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-04-09T18:19:43.492 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:43.542 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:43 +0000 (0:00:00.097) 0:03:21.062 ********** 2021-04-09T18:19:43.720 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:43.751 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:43 +0000 (0:00:00.208) 0:03:21.270 ********** 2021-04-09T18:19:44.012 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-04-09T18:19:44.014 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:44.081 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:44 +0000 (0:00:00.330) 0:03:21.600 ********** 2021-04-09T18:19:44.380 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-04-09T18:19:44.382 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:44.465 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:44 +0000 (0:00:00.384) 0:03:21.984 ********** 2021-04-09T18:19:44.468 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:44.805 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-04-09T18:19:44.807 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:44.821 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:44.901 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:44 +0000 (0:00:00.435) 0:03:22.420 ********** 2021-04-09T18:19:45.085 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-04-09T18:19:45.087 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:45.181 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:45 +0000 (0:00:00.280) 0:03:22.701 ********** 2021-04-09T18:19:45.936 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-04-09T18:19:45.938 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.253438", "end": "2021-04-09 18:19:45.905432", "rc": 0, "start": "2021-04-09 18:19:45.651994", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-04-09T18:19:45.992 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:45 +0000 (0:00:00.811) 0:03:23.512 ********** 2021-04-09T18:19:46.203 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-04-09T18:19:46.205 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:46.228 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:46 +0000 (0:00:00.236) 0:03:23.748 ********** 2021-04-09T18:19:46.401 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-04-09T18:19:46.404 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1617992384, "cache_updated": true, "changed": true} 2021-04-09T18:19:46.484 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:46 +0000 (0:00:00.255) 0:03:24.004 ********** 2021-04-09T18:19:46.509 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-04-09T18:19:46.511 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:46.561 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:46 +0000 (0:00:00.076) 0:03:24.081 ********** 2021-04-09T18:19:46.650 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-04-09T18:19:46.652 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1617992384, "cache_updated": true, "changed": true} 2021-04-09T18:19:46.802 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:46 +0000 (0:00:00.239) 0:03:24.321 ********** 2021-04-09T18:19:46.916 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-04-09T18:19:46.918 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:46.928 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:46.951 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:46.962 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:47.026 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:47 +0000 (0:00:00.225) 0:03:24.546 ********** 2021-04-09T18:19:47.355 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-04-09T18:19:47.357 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:47.440 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:47 +0000 (0:00:00.413) 0:03:24.960 ********** 2021-04-09T18:19:47.795 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:47.796 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-04-09T18:19:47.797 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1617992385, "cache_updated": true, "changed": true} 2021-04-09T18:19:47.799 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [smithi079.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:19:47.833 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:47 +0000 (0:00:00.392) 0:03:25.352 ********** 2021-04-09T18:19:47.948 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:47 +0000 (0:00:00.115) 0:03:25.467 ********** 2021-04-09T18:19:48.083 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:48 +0000 (0:00:00.135) 0:03:25.602 ********** 2021-04-09T18:19:48.097 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-04-09T18:19:48.100 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:48.215 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:48 +0000 (0:00:00.131) 0:03:25.734 ********** 2021-04-09T18:19:48.244 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-04-09T18:19:48.247 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:19:48.328 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:48 +0000 (0:00:00.113) 0:03:25.847 ********** 2021-04-09T18:19:48.411 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-04-09T18:19:48.413 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:48.497 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:48 +0000 (0:00:00.168) 0:03:26.016 ********** 2021-04-09T18:19:48.616 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:48.668 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:48 +0000 (0:00:00.171) 0:03:26.187 ********** 2021-04-09T18:19:48.688 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-04-09T18:19:48.690 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Update apt cache] *********************************************** changed: [smithi136.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1617992386, "cache_updated": true, "changed": true} 2021-04-09T18:19:48.821 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:48 +0000 (0:00:00.152) 0:03:26.340 ********** 2021-04-09T18:19:48.949 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:48 +0000 (0:00:00.127) 0:03:26.468 ********** 2021-04-09T18:19:49.022 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-04-09T18:19:49.028 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"cache_update_time": 1617992385, "cache_updated": false, "changed": false} 2021-04-09T18:19:49.051 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:49 +0000 (0:00:00.102) 0:03:26.571 ********** 2021-04-09T18:19:49.164 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-04-09T18:19:49.166 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:49.234 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:49 +0000 (0:00:00.182) 0:03:26.754 ********** 2021-04-09T18:19:49.257 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-04-09T18:19:49.259 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:49.351 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:49 +0000 (0:00:00.116) 0:03:26.870 ********** 2021-04-09T18:19:49.531 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-04-09T18:19:49.533 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.032266", "end": "2021-04-09 18:19:49.500354", "rc": 0, "start": "2021-04-09 18:19:49.468088", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:19:49.582 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:49 +0000 (0:00:00.231) 0:03:27.101 ********** 2021-04-09T18:19:49.792 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-04-09T18:19:49.794 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:49.846 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:49 +0000 (0:00:00.252) 0:03:27.353 ********** 2021-04-09T18:19:50.021 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-04-09T18:19:50.022 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-04-09T18:19:50.112 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:50 +0000 (0:00:00.278) 0:03:27.631 ********** 2021-04-09T18:19:50.170 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-04-09T18:19:50.171 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-04-09T18:19:50.173 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1617992386, "cache_updated": false, "changed": false} 2021-04-09T18:19:50.222 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:50 +0000 (0:00:00.109) 0:03:27.741 ********** 2021-04-09T18:19:50.371 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:50 +0000 (0:00:00.148) 0:03:27.890 ********** 2021-04-09T18:19:50.373 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:50.392 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:50.393 INFO:teuthology.task.ansible.out:TASK [common : Add krb5 config file] ******************************************* 2021-04-09T18:19:50.395 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:50.397 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-04-09T18:19:50.400 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:50.402 INFO:teuthology.task.ansible.out:TASK [common : Clean apt cache] ************************************************ changed: [smithi144.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.053850", "end": "2021-04-09 18:19:50.292976", "rc": 0, "start": "2021-04-09 18:19:50.239126", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:19:50.468 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:50 +0000 (0:00:00.097) 0:03:27.987 ********** 2021-04-09T18:19:50.562 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:50 +0000 (0:00:00.094) 0:03:28.082 ********** 2021-04-09T18:19:50.575 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:50.689 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:50.751 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:50 +0000 (0:00:00.188) 0:03:28.270 ********** 2021-04-09T18:19:50.753 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:51.288 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:51.290 INFO:teuthology.task.ansible.out:TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi079.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:19:51.321 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:51 +0000 (0:00:00.570) 0:03:28.841 ********** 2021-04-09T18:19:51.323 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:51.367 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:19:51.410 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:51 +0000 (0:00:00.087) 0:03:28.928 ********** 2021-04-09T18:19:51.416 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:51.497 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-04-09T18:19:51.499 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-04-09T18:19:51.567 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:51 +0000 (0:00:00.158) 0:03:29.087 ********** 2021-04-09T18:19:51.568 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:51.614 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:51.616 INFO:teuthology.task.ansible.out:TASK [common : Make sure smartmontools is installed] *************************** 2021-04-09T18:19:51.618 INFO:teuthology.task.ansible.out: ok: [smithi090.front.sepia.ceph.com] => {"cache_update_time": 1617992385, "cache_updated": false, "changed": false} 2021-04-09T18:19:51.687 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:51 +0000 (0:00:00.114) 0:03:29.202 ********** 2021-04-09T18:19:52.222 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-04-09T18:19:52.224 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-04-09T18:19:52.359 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-04-09T18:19:52.612 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-04-09T18:19:52.662 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1617992386, "cache_updated": false, "changed": false} 2021-04-09T18:19:52.703 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:52 +0000 (0:00:01.019) 0:03:30.221 ********** 2021-04-09T18:19:52.866 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi079.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-04-09T18:19:52.942 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-04-09T18:19:53.313 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-04-09T18:19:53.314 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:53.337 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-04-09T18:19:53.407 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:53 +0000 (0:00:00.702) 0:03:30.923 ********** 2021-04-09T18:19:53.462 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-04-09T18:19:53.495 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-04-09T18:19:53.535 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:53 +0000 (0:00:00.131) 0:03:31.055 ********** 2021-04-09T18:19:53.696 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-04-09T18:19:53.698 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:19:53.747 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:53 +0000 (0:00:00.211) 0:03:31.266 ********** 2021-04-09T18:19:53.820 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:19:53.888 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:53 +0000 (0:00:00.140) 0:03:31.407 ********** 2021-04-09T18:19:53.900 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:53.903 INFO:teuthology.task.ansible.out:TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-04-09T18:19:53.905 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-04-09T18:19:53.937 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:53 +0000 (0:00:00.048) 0:03:31.456 ********** 2021-04-09T18:19:53.993 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-04-09T18:19:54.156 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:54.159 INFO:teuthology.task.ansible.out:TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:19:54.216 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:54 +0000 (0:00:00.279) 0:03:31.736 ********** 2021-04-09T18:19:54.222 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:54.432 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-04-09T18:19:54.434 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-04-09T18:19:54.465 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:54 +0000 (0:00:00.248) 0:03:31.984 ********** 2021-04-09T18:19:54.497 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-04-09T18:19:54.499 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-04-09T18:19:54.510 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-04-09T18:19:54.511 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:54.717 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:54.719 INFO:teuthology.task.ansible.out:TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:19:54.769 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:54 +0000 (0:00:00.304) 0:03:32.289 ********** 2021-04-09T18:19:54.849 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-04-09T18:19:54.851 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-04-09T18:19:54.993 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-04-09T18:19:55.017 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-04-09T18:19:55.353 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-04-09T18:19:55.418 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-04-09T18:19:55.460 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:55 +0000 (0:00:00.690) 0:03:32.979 ********** 2021-04-09T18:19:55.511 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-04-09T18:19:55.519 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-04-09T18:19:55.574 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:55 +0000 (0:00:00.114) 0:03:33.094 ********** 2021-04-09T18:19:55.656 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-04-09T18:19:55.659 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-04-09T18:19:55.710 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:55 +0000 (0:00:00.135) 0:03:33.229 ********** 2021-04-09T18:19:55.843 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-04-09T18:19:55.941 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:55 +0000 (0:00:00.230) 0:03:33.460 ********** 2021-04-09T18:19:55.958 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-04-09T18:19:55.960 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-04-09T18:19:55.996 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-04-09T18:19:56.056 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:56 +0000 (0:00:00.115) 0:03:33.575 ********** 2021-04-09T18:19:56.073 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-04-09T18:19:56.075 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:56.126 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:56 +0000 (0:00:00.069) 0:03:33.645 ********** 2021-04-09T18:19:56.170 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-04-09T18:19:56.172 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1617992393, "cache_updated": true, "changed": true} 2021-04-09T18:19:56.276 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:56 +0000 (0:00:00.150) 0:03:33.795 ********** 2021-04-09T18:19:56.290 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-04-09T18:19:56.292 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Include apt_system vars] **************************************** ok: [smithi090.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-04-09T18:19:56.319 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:56 +0000 (0:00:00.043) 0:03:33.839 ********** 2021-04-09T18:19:56.324 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:56.383 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:56 +0000 (0:00:00.063) 0:03:33.902 ********** 2021-04-09T18:19:56.414 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-04-09T18:19:56.416 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:56.493 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:56 +0000 (0:00:00.109) 0:03:34.012 ********** 2021-04-09T18:19:56.527 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:56.582 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:56 +0000 (0:00:00.089) 0:03:34.101 ********** 2021-04-09T18:19:56.595 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-04-09T18:19:56.598 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-04-09T18:19:56.601 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:56.659 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:56 +0000 (0:00:00.077) 0:03:34.179 ********** 2021-04-09T18:19:56.679 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-04-09T18:19:56.681 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} TASK [common : Include yum_systems vars] *************************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:56.681 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi079.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:56.682 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:56.712 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:56 +0000 (0:00:00.052) 0:03:34.231 ********** 2021-04-09T18:19:56.796 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:56 +0000 (0:00:00.084) 0:03:34.316 ********** 2021-04-09T18:19:56.798 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:56.814 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-04-09T18:19:56.856 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:56 +0000 (0:00:00.059) 0:03:34.375 ********** 2021-04-09T18:19:56.869 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-04-09T18:19:56.871 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:56.873 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:56.947 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:56 +0000 (0:00:00.091) 0:03:34.466 ********** 2021-04-09T18:19:57.011 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:57.034 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:57 +0000 (0:00:00.087) 0:03:34.554 ********** 2021-04-09T18:19:57.063 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-04-09T18:19:57.065 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:57.099 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:57 +0000 (0:00:00.054) 0:03:34.609 ********** 2021-04-09T18:19:57.118 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-04-09T18:19:57.120 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:57.164 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:57 +0000 (0:00:00.074) 0:03:34.683 ********** 2021-04-09T18:19:57.293 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-04-09T18:19:57.296 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:57.347 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:57 +0000 (0:00:00.178) 0:03:34.862 ********** 2021-04-09T18:19:57.353 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi090.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:57.355 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:57.357 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:57.358 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:57.363 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [smithi144.front.sepia.ceph.com] => {"cache_update_time": 1617992393, "cache_updated": false, "changed": false} 2021-04-09T18:19:57.418 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:57 +0000 (0:00:00.074) 0:03:34.937 ********** 2021-04-09T18:19:57.502 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:57 +0000 (0:00:00.084) 0:03:35.021 ********** 2021-04-09T18:19:57.504 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:57.526 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:57.529 INFO:teuthology.task.ansible.out:TASK [common : Check for epel] ************************************************* 2021-04-09T18:19:57.530 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:19:57.592 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:57 +0000 (0:00:00.089) 0:03:35.111 ********** 2021-04-09T18:19:57.615 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-04-09T18:19:57.617 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:57.670 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:57 +0000 (0:00:00.078) 0:03:35.189 ********** 2021-04-09T18:19:57.701 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:57.743 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:57 +0000 (0:00:00.072) 0:03:35.262 ********** 2021-04-09T18:19:57.816 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-04-09T18:19:57.818 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:57.843 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:57.852 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:19:57.903 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:57 +0000 (0:00:00.160) 0:03:35.423 ********** 2021-04-09T18:19:58.055 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-04-09T18:19:58.057 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:19:58.102 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:58 +0000 (0:00:00.198) 0:03:35.621 ********** 2021-04-09T18:19:58.142 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-04-09T18:19:58.144 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:19:58.183 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:58 +0000 (0:00:00.080) 0:03:35.702 ********** 2021-04-09T18:19:58.489 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:19:58.491 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:58.563 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:58 +0000 (0:00:00.379) 0:03:36.082 ********** 2021-04-09T18:19:58.567 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:58.608 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-04-09T18:19:58.609 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-04-09T18:19:58.709 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:58 +0000 (0:00:00.146) 0:03:36.229 ********** 2021-04-09T18:19:58.773 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-04-09T18:19:58.775 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"cache_update_time": 1617992385, "cache_updated": false, "changed": false} 2021-04-09T18:19:58.839 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:58 +0000 (0:00:00.129) 0:03:36.358 ********** 2021-04-09T18:19:58.870 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-04-09T18:19:58.872 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-04-09T18:19:58.935 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:58 +0000 (0:00:00.095) 0:03:36.454 ********** 2021-04-09T18:19:58.950 INFO:teuthology.task.ansible.out: 2021-04-09T18:19:59.307 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-04-09T18:19:59.309 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1617992386, "cache_updated": false, "changed": false} 2021-04-09T18:19:59.352 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:59 +0000 (0:00:00.416) 0:03:36.871 ********** 2021-04-09T18:19:59.476 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-04-09T18:19:59.478 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-04-09T18:19:59.527 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:59 +0000 (0:00:00.174) 0:03:37.046 ********** 2021-04-09T18:19:59.568 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-04-09T18:19:59.607 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:59 +0000 (0:00:00.080) 0:03:37.126 ********** 2021-04-09T18:19:59.678 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-04-09T18:19:59.679 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-04-09T18:19:59.709 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:59 +0000 (0:00:00.102) 0:03:37.229 ********** 2021-04-09T18:19:59.935 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi144.front.sepia.ceph.com] => {"cache_update_time": 1617992393, "cache_updated": false, "changed": false} 2021-04-09T18:19:59.963 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:19:59 +0000 (0:00:00.253) 0:03:37.482 ********** 2021-04-09T18:20:00.065 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-04-09T18:20:00.066 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-04-09T18:20:00.102 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:00 +0000 (0:00:00.139) 0:03:37.621 ********** 2021-04-09T18:20:00.104 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:00.122 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:00.122 INFO:teuthology.task.ansible.out:TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-04-09T18:20:00.124 INFO:teuthology.task.ansible.out: ok: [smithi079.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-04-09T18:20:00.178 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-04-09T18:20:00.183 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-04-09T18:20:00.223 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:00 +0000 (0:00:00.121) 0:03:37.743 ********** 2021-04-09T18:20:00.235 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-04-09T18:20:00.286 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:00 +0000 (0:00:00.062) 0:03:37.805 ********** 2021-04-09T18:20:00.317 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-04-09T18:20:00.319 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-04-09T18:20:00.357 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:00 +0000 (0:00:00.069) 0:03:37.875 ********** 2021-04-09T18:20:00.589 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-04-09T18:20:00.591 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:00.631 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:00 +0000 (0:00:00.275) 0:03:38.151 ********** 2021-04-09T18:20:00.633 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:00.641 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-04-09T18:20:00.643 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-04-09T18:20:00.738 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-04-09T18:20:00.740 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [smithi079.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:20:00.763 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:00 +0000 (0:00:00.131) 0:03:38.282 ********** 2021-04-09T18:20:00.799 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-04-09T18:20:00.801 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-04-09T18:20:00.802 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-04-09T18:20:00.803 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-04-09T18:20:00.849 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:00 +0000 (0:00:00.082) 0:03:38.365 ********** 2021-04-09T18:20:00.895 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-04-09T18:20:00.897 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-04-09T18:20:00.927 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:00 +0000 (0:00:00.080) 0:03:38.446 ********** 2021-04-09T18:20:00.930 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:00.938 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-04-09T18:20:00.940 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-04-09T18:20:00.995 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:00 +0000 (0:00:00.060) 0:03:38.514 ********** 2021-04-09T18:20:01.048 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-04-09T18:20:01.050 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:01.085 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:01 +0000 (0:00:00.088) 0:03:38.603 ********** 2021-04-09T18:20:01.140 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-04-09T18:20:01.142 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:01.166 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:01 +0000 (0:00:00.082) 0:03:38.686 ********** 2021-04-09T18:20:01.288 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:01.344 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:01 +0000 (0:00:00.177) 0:03:38.863 ********** 2021-04-09T18:20:01.360 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-04-09T18:20:01.362 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-04-09T18:20:01.382 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-04-09T18:20:01.384 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-04-09T18:20:01.468 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-04-09T18:20:01.470 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:20:01.500 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:01 +0000 (0:00:00.155) 0:03:39.019 ********** 2021-04-09T18:20:01.538 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-04-09T18:20:01.541 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-04-09T18:20:01.574 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:01 +0000 (0:00:00.072) 0:03:39.092 ********** 2021-04-09T18:20:01.580 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-04-09T18:20:01.583 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:20:01.628 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:01 +0000 (0:00:00.055) 0:03:39.148 ********** 2021-04-09T18:20:01.696 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:01.796 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:01 +0000 (0:00:00.167) 0:03:39.316 ********** 2021-04-09T18:20:01.830 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-04-09T18:20:01.890 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:01 +0000 (0:00:00.093) 0:03:39.409 ********** 2021-04-09T18:20:01.903 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-04-09T18:20:01.907 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-04-09T18:20:01.912 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:01.913 INFO:teuthology.task.ansible.out:TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-04-09T18:20:01.914 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:01.916 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:01.994 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:01 +0000 (0:00:00.103) 0:03:39.513 ********** 2021-04-09T18:20:01.995 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:02.073 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:02 +0000 (0:00:00.079) 0:03:39.592 ********** 2021-04-09T18:20:02.197 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:02 +0000 (0:00:00.124) 0:03:39.717 ********** 2021-04-09T18:20:02.278 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-04-09T18:20:02.280 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:20:02.316 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:02 +0000 (0:00:00.118) 0:03:39.835 ********** 2021-04-09T18:20:02.318 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:02.486 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:20:02.544 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:02 +0000 (0:00:00.228) 0:03:40.063 ********** 2021-04-09T18:20:02.565 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-04-09T18:20:02.567 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:02.636 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:02 +0000 (0:00:00.091) 0:03:40.155 ********** 2021-04-09T18:20:02.659 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-04-09T18:20:02.662 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-04-09T18:20:02.694 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:02 +0000 (0:00:00.057) 0:03:40.213 ********** 2021-04-09T18:20:02.697 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:02.881 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-04-09T18:20:02.936 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:02 +0000 (0:00:00.242) 0:03:40.455 ********** 2021-04-09T18:20:03.319 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-04-09T18:20:03.321 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-04-09T18:20:03.452 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-04-09T18:20:03.453 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-04-09 18:15:18 UTC", "ActiveEnterTimestampMonotonic": "22618105", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target basic.target nss-lookup.target system.slice var-run.mount -.mount remote-fs.target systemd-tmpfiles-setup.service systemd-journald.socket network.target local-fs.target time-sync.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-04-09 18:15:18 UTC", "AssertTimestampMonotonic": "22615710", "Before": "getty@tty1.service multi-user.target plymouth-quit.service xdm.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-04-09 18:15:18 UTC", "ConditionTimestampMonotonic": "22615704", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2021-04-09T18:20:03.456 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1339", "ExecMainStartTimestamp": "Fri 2021-04-09 18:15:18 UTC", "ExecMainStartTimestampMonotonic": "22618012", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2021-04-09 18:15:18 UTC] ; stop_time=[n/a] ; pid=1339 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-04-09 18:15:18 UTC", "InactiveExitTimestampMonotonic": "22618105", "InvocationID": "fe2a82479b6443d7bbdd15789ad10159", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2021-04-09T18:20:03.458 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128028", "LimitNPROCSoft": "128028", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128028", "LimitSIGPENDINGSoft": "128028", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1339", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2021-04-09T18:20:03.460 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-04-09 18:15:18 UTC", "StateChangeTimestampMonotonic": "22618105", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-04-09 18:15:18 UTC", "WatchdogTimestampMonotonic": "22618103", "WatchdogUSec": "0"}} 2021-04-09T18:20:03.495 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:03 +0000 (0:00:00.558) 0:03:41.014 ********** 2021-04-09T18:20:03.516 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-04-09T18:20:03.518 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-04-09T18:20:03.522 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-04-09T18:20:03.525 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-04-09 18:14:46 UTC", "ActiveEnterTimestampMonotonic": "17402636", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target local-fs.target systemd-journald.socket basic.target time-sync.target -.mount nss-lookup.target var-run.mount system.slice systemd-tmpfiles-setup.service sysinit.target network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-04-09 18:14:46 UTC", "AssertTimestampMonotonic": "17401814", "Before": "getty@tty1.service xdm.service multi-user.target shutdown.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-04-09 18:14:46 UTC", "ConditionTimestampMonotonic": "17401814", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-ser 2021-04-09T18:20:03.527 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDepende 2021-04-09T18:20:03.529 INFO:teuthology.task.ansible.out:ncies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1321", "ExecMainStartTimestamp": "Fri 2021-04-09 18:14:46 UTC", "ExecMainStartTimestampMonotonic": "17402597", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2021-04-09 18:14:46 UTC] ; stop_time=[n/a] ; pid=1321 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-04-09 18:14:46 UTC", "InactiveExitTimestampMonotonic": "17402636", "InvocationID": "96904ae94e864b7a86f990711f5789a5", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE" 2021-04-09T18:20:03.531 INFO:teuthology.task.ansible.out:: "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128028", "LimitNPROCSoft": "128028", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128028", "LimitSIGPENDINGSoft": "128028", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1321", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": 2021-04-09T18:20:03.533 INFO:teuthology.task.ansible.out: "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-04-09 18:14:46 UTC", "StateChangeTimestampMonotonic": "17402636", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-04-09 18:14:46 UTC", "WatchdogTimestampMonotonic": "17402636", "WatchdogUSec": "0"}} 2021-04-09T18:20:03.537 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-04-09 18:14:46 UTC", "ActiveEnterTimestampMonotonic": "19643827", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket basic.target network.target local-fs.target nss-lookup.target remote-fs.target system.slice -.mount time-sync.target var-run.mount systemd-tmpfiles-setup.service sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-04-09 18:14:46 UTC", "AssertTimestampMonotonic": "19642763", "Before": "plymouth-quit.service multi-user.target xdm.service shutdown.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-04-09 18:14:46 UTC", "ConditionTimestampMonotonic": "19642763", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2021-04-09T18:20:03.539 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1332", "ExecMainStartTimestamp": "Fri 2021-04-09 18:14:46 UTC", "ExecMainStartTimestampMonotonic": "19643793", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2021-04-09 18:14:46 UTC] ; stop_time=[n/a] ; pid=1332 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-04-09 18:14:46 UTC", "InactiveExitTimestampMonotonic": "19643827", "InvocationID": "e525452c53a442fb8b5f062a1afe50c1", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2021-04-09T18:20:03.541 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1332", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2021-04-09T18:20:03.543 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDi 2021-04-09T18:20:03.545 INFO:teuthology.task.ansible.out:rectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-04-09 18:14:46 UTC", "StateChangeTimestampMonotonic": "19643827", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-04-09 18:14:46 UTC", "WatchdogTimestampMonotonic": "19643826", "WatchdogUSec": "0"}} 2021-04-09T18:20:03.579 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:03 +0000 (0:00:00.083) 0:03:41.097 ********** 2021-04-09T18:20:03.584 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:03.628 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:03 +0000 (0:00:00.046) 0:03:41.144 ********** 2021-04-09T18:20:03.704 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:03 +0000 (0:00:00.078) 0:03:41.223 ********** 2021-04-09T18:20:03.725 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-04-09T18:20:03.727 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:03.769 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:03 +0000 (0:00:00.064) 0:03:41.288 ********** 2021-04-09T18:20:03.771 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:03.813 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:03.815 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi144.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-04-09T18:20:03.854 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:03 +0000 (0:00:00.085) 0:03:41.373 ********** 2021-04-09T18:20:03.864 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:03.866 INFO:teuthology.task.ansible.out:TASK [common : Get SELinux status] ********************************************* skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:03.874 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:03.931 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:03 +0000 (0:00:00.077) 0:03:41.450 ********** 2021-04-09T18:20:04.063 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-04-09T18:20:04.065 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:04.065 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:04.112 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:04 +0000 (0:00:00.181) 0:03:41.632 ********** 2021-04-09T18:20:04.167 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:04 +0000 (0:00:00.054) 0:03:41.686 ********** 2021-04-09T18:20:04.186 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:04.219 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:04 +0000 (0:00:00.051) 0:03:41.738 ********** 2021-04-09T18:20:04.268 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:04.270 INFO:teuthology.task.ansible.out:TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:04.270 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-04-09T18:20:04.274 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-04-09 18:15:06 UTC", "ActiveEnterTimestampMonotonic": "20053361", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target -.mount systemd-tmpfiles-setup.service sysinit.target network.target time-sync.target remote-fs.target system.slice nss-lookup.target local-fs.target systemd-journald.socket var-run.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-04-09 18:15:06 UTC", "AssertTimestampMonotonic": "20052691", "Before": "getty@tty1.service shutdown.target multi-user.target plymouth-quit.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-04-09 18:15:06 UTC", "ConditionTimestampMonotonic": "20052691", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-ser 2021-04-09T18:20:04.276 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1388", "ExecMainStartTimestamp": "Fri 2021-04-09 18:15:06 UTC", "ExecMainStartTimestampMonotonic": "20053337", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2021-04-09 18:15:06 UTC] ; stop_time=[n/a] ; pid=1388 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-04-09 18:15:06 UTC", "InactiveExitTimestampMonotonic": "20053361", "InvocationID": "21e739e4d84e4ddeb02f3d9b74bd2e1a", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2021-04-09T18:20:04.278 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1388", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2021-04-09T18:20:04.280 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-04-09 18:15:06 UTC", "StateChangeTimestampMonotonic": "20053361", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-04-09 18:15:06 UTC", "WatchdogTimestampMonotonic": "20053361", "WatchdogUSec": "0"}} 2021-04-09T18:20:04.340 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:04 +0000 (0:00:00.121) 0:03:41.859 ********** 2021-04-09T18:20:04.419 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:04 +0000 (0:00:00.079) 0:03:41.938 ********** 2021-04-09T18:20:04.448 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi144.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-04-09T18:20:04.459 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:04.503 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:04 +0000 (0:00:00.083) 0:03:42.022 ********** 2021-04-09T18:20:04.551 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:04 +0000 (0:00:00.048) 0:03:42.071 ********** 2021-04-09T18:20:04.603 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:04 +0000 (0:00:00.051) 0:03:42.122 ********** 2021-04-09T18:20:04.621 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-04-09T18:20:04.623 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get SELinux status] ********************************************* 2021-04-09T18:20:04.623 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:04.625 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:04.690 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:04 +0000 (0:00:00.087) 0:03:42.209 ********** 2021-04-09T18:20:04.717 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:04 +0000 (0:00:00.026) 0:03:42.236 ********** 2021-04-09T18:20:04.775 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:04 +0000 (0:00:00.058) 0:03:42.294 ********** 2021-04-09T18:20:04.782 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:04.864 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:04 +0000 (0:00:00.088) 0:03:42.383 ********** 2021-04-09T18:20:04.894 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:04.902 INFO:teuthology.task.ansible.out:TASK [common : Include apt_system vars] **************************************** 2021-04-09T18:20:04.903 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-04-09T18:20:04.904 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-04-09T18:20:04.904 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:04.905 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:04.942 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:04 +0000 (0:00:00.077) 0:03:42.461 ********** 2021-04-09T18:20:04.996 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:04 +0000 (0:00:00.053) 0:03:42.515 ********** 2021-04-09T18:20:05.046 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:05 +0000 (0:00:00.049) 0:03:42.565 ********** 2021-04-09T18:20:05.057 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-04-09T18:20:05.058 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:05.099 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:05 +0000 (0:00:00.052) 0:03:42.617 ********** 2021-04-09T18:20:05.111 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:05.130 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-04-09T18:20:05.132 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:05.199 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:05 +0000 (0:00:00.100) 0:03:42.718 ********** 2021-04-09T18:20:05.211 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-04-09T18:20:05.214 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Include yum_systems vars] *************************************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:05.269 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:05 +0000 (0:00:00.070) 0:03:42.788 ********** 2021-04-09T18:20:05.325 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:05 +0000 (0:00:00.056) 0:03:42.844 ********** 2021-04-09T18:20:05.429 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:05 +0000 (0:00:00.102) 0:03:42.947 ********** 2021-04-09T18:20:05.456 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-04-09T18:20:05.458 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:05.546 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:05 +0000 (0:00:00.117) 0:03:43.065 ********** 2021-04-09T18:20:05.615 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:05 +0000 (0:00:00.069) 0:03:43.134 ********** 2021-04-09T18:20:05.623 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-04-09T18:20:05.625 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Check for epel] ************************************************* skipping: [smithi144.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:20:05.670 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:05 +0000 (0:00:00.053) 0:03:43.188 ********** 2021-04-09T18:20:05.760 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:05 +0000 (0:00:00.090) 0:03:43.279 ********** 2021-04-09T18:20:05.768 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:05.893 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:05 +0000 (0:00:00.133) 0:03:43.413 ********** 2021-04-09T18:20:05.903 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-04-09T18:20:05.928 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:05.930 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:06.011 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:06 +0000 (0:00:00.117) 0:03:43.530 ********** 2021-04-09T18:20:06.130 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:06 +0000 (0:00:00.118) 0:03:43.649 ********** 2021-04-09T18:20:06.169 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:06 +0000 (0:00:00.039) 0:03:43.688 ********** 2021-04-09T18:20:06.179 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:06.181 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi144.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi144.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:20:06.182 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:20:06.186 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:20:06.188 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:06.222 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:06 +0000 (0:00:00.052) 0:03:43.741 ********** 2021-04-09T18:20:06.271 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:06 +0000 (0:00:00.049) 0:03:43.791 ********** 2021-04-09T18:20:06.303 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:06 +0000 (0:00:00.031) 0:03:43.822 ********** 2021-04-09T18:20:06.326 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:06.340 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:06.390 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:06 +0000 (0:00:00.087) 0:03:43.909 ********** 2021-04-09T18:20:06.465 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:06 +0000 (0:00:00.075) 0:03:43.984 ********** 2021-04-09T18:20:06.516 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:06 +0000 (0:00:00.050) 0:03:44.036 ********** 2021-04-09T18:20:06.519 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:06.532 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-04-09T18:20:06.534 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:06.544 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-04-09T18:20:06.546 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include package type specific vars.] ************************** ok: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-04-09T18:20:06.573 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:06 +0000 (0:00:00.056) 0:03:44.092 ********** 2021-04-09T18:20:06.642 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:06 +0000 (0:00:00.069) 0:03:44.161 ********** 2021-04-09T18:20:06.706 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:06 +0000 (0:00:00.063) 0:03:44.225 ********** 2021-04-09T18:20:06.721 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:06.723 INFO:teuthology.task.ansible.out:TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:06.725 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:06.774 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:06 +0000 (0:00:00.067) 0:03:44.293 ********** 2021-04-09T18:20:06.825 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:06 +0000 (0:00:00.050) 0:03:44.344 ********** 2021-04-09T18:20:06.835 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-04-09T18:20:06.836 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-04-09T18:20:06.839 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-04-09T18:20:06.841 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:06.883 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:06 +0000 (0:00:00.058) 0:03:44.402 ********** 2021-04-09T18:20:06.931 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:06 +0000 (0:00:00.047) 0:03:44.450 ********** 2021-04-09T18:20:06.941 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:06.945 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:06.976 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:06 +0000 (0:00:00.045) 0:03:44.495 ********** 2021-04-09T18:20:07.004 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:07.039 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:07 +0000 (0:00:00.056) 0:03:44.552 ********** 2021-04-09T18:20:07.068 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-04-09T18:20:07.070 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-04-09T18:20:07.099 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:07 +0000 (0:00:00.060) 0:03:44.618 ********** 2021-04-09T18:20:07.136 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-04-09T18:20:07.138 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-04-09T18:20:07.178 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:07 +0000 (0:00:00.078) 0:03:44.697 ********** 2021-04-09T18:20:07.194 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-04-09T18:20:07.312 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:07 +0000 (0:00:00.132) 0:03:44.831 ********** 2021-04-09T18:20:07.335 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-04-09T18:20:07.337 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:07.438 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:07 +0000 (0:00:00.126) 0:03:44.958 ********** 2021-04-09T18:20:07.468 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-04-09T18:20:07.472 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-04-09T18:20:07.537 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:07 +0000 (0:00:00.098) 0:03:45.056 ********** 2021-04-09T18:20:07.558 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-04-09T18:20:07.560 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-04-09T18:20:07.589 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:07 +0000 (0:00:00.052) 0:03:45.109 ********** 2021-04-09T18:20:07.609 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-04-09T18:20:07.612 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-04-09T18:20:07.614 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:07.708 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:07 +0000 (0:00:00.118) 0:03:45.227 ********** 2021-04-09T18:20:07.820 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:07 +0000 (0:00:00.112) 0:03:45.339 ********** 2021-04-09T18:20:07.829 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-04-09T18:20:07.832 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"cache_update_time": 1617992393, "cache_updated": false, "changed": false} 2021-04-09T18:20:07.834 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-04-09T18:20:07.859 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:07 +0000 (0:00:00.038) 0:03:45.378 ********** 2021-04-09T18:20:07.912 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:07 +0000 (0:00:00.053) 0:03:45.432 ********** 2021-04-09T18:20:07.929 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-04-09T18:20:07.930 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-04-09T18:20:08.009 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:08 +0000 (0:00:00.096) 0:03:45.528 ********** 2021-04-09T18:20:08.052 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-04-09T18:20:08.055 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-04-09T18:20:08.057 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:08.137 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:08 +0000 (0:00:00.128) 0:03:45.657 ********** 2021-04-09T18:20:08.227 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:08 +0000 (0:00:00.089) 0:03:45.746 ********** 2021-04-09T18:20:08.278 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-04-09T18:20:08.280 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-04-09T18:20:08.336 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:08 +0000 (0:00:00.108) 0:03:45.855 ********** 2021-04-09T18:20:08.347 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-04-09T18:20:08.349 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-04-09T18:20:08.395 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:08 +0000 (0:00:00.059) 0:03:45.914 ********** 2021-04-09T18:20:08.561 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi090.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-04-09T18:20:08.616 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:08 +0000 (0:00:00.214) 0:03:46.129 ********** 2021-04-09T18:20:08.624 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-04-09T18:20:08.626 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:08.686 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:08 +0000 (0:00:00.076) 0:03:46.206 ********** 2021-04-09T18:20:08.739 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:08 +0000 (0:00:00.052) 0:03:46.258 ********** 2021-04-09T18:20:08.746 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-04-09T18:20:08.748 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-04-09T18:20:08.775 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:08 +0000 (0:00:00.036) 0:03:46.295 ********** 2021-04-09T18:20:08.807 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:08 +0000 (0:00:00.031) 0:03:46.326 ********** 2021-04-09T18:20:08.871 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-04-09T18:20:08.875 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-04-09T18:20:08.933 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:08 +0000 (0:00:00.125) 0:03:46.452 ********** 2021-04-09T18:20:08.943 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:08.997 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:09.000 INFO:teuthology.task.ansible.out:TASK [testnode : Including distro specific variables.] ************************* ok: [smithi136.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-04-09T18:20:09.026 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:09 +0000 (0:00:00.093) 0:03:46.545 ********** 2021-04-09T18:20:09.046 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:09.051 INFO:teuthology.task.ansible.out:TASK [testnode : Delete the teuthology users password.] ************************ 2021-04-09T18:20:09.053 INFO:teuthology.task.ansible.out: skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:09.092 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:09 +0000 (0:00:00.066) 0:03:46.612 ********** 2021-04-09T18:20:09.094 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:09.143 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-04-09T18:20:09.193 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:09 +0000 (0:00:00.100) 0:03:46.712 ********** 2021-04-09T18:20:09.271 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-04-09T18:20:09.324 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:09 +0000 (0:00:00.130) 0:03:46.843 ********** 2021-04-09T18:20:09.346 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-04-09T18:20:09.348 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-04-09T18:20:09.354 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-04-09T18:20:09.356 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:09.415 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:09 +0000 (0:00:00.090) 0:03:46.934 ********** 2021-04-09T18:20:09.417 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:09.483 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:09 +0000 (0:00:00.067) 0:03:47.002 ********** 2021-04-09T18:20:09.485 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:09.507 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-04-09T18:20:09.511 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-04-09T18:20:09.594 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:09 +0000 (0:00:00.111) 0:03:47.113 ********** 2021-04-09T18:20:09.661 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-04-09T18:20:09.664 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-04-09T18:20:09.713 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:09 +0000 (0:00:00.118) 0:03:47.232 ********** 2021-04-09T18:20:09.820 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:09 +0000 (0:00:00.107) 0:03:47.339 ********** 2021-04-09T18:20:09.969 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-04-09T18:20:09.970 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:10.030 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:10 +0000 (0:00:00.210) 0:03:47.549 ********** 2021-04-09T18:20:10.097 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:10.098 INFO:teuthology.task.ansible.out:TASK [testnode : Including version specific variables.] ************************ ok: [smithi136.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-04-09T18:20:10.215 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:10 +0000 (0:00:00.184) 0:03:47.734 ********** 2021-04-09T18:20:10.286 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:10.288 INFO:teuthology.task.ansible.out:TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:10.533 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:10 +0000 (0:00:00.318) 0:03:48.052 ********** 2021-04-09T18:20:10.559 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-04-09T18:20:10.560 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-04-09T18:20:10.563 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-04-09T18:20:10.564 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-04-09T18:20:10.566 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:10.606 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:10 +0000 (0:00:00.072) 0:03:48.125 ********** 2021-04-09T18:20:10.607 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:10.684 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-04-09T18:20:10.732 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:10 +0000 (0:00:00.126) 0:03:48.251 ********** 2021-04-09T18:20:10.837 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-04-09T18:20:10.840 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-04-09T18:20:10.911 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:10 +0000 (0:00:00.178) 0:03:48.430 ********** 2021-04-09T18:20:10.931 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-04-09T18:20:10.946 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-04-09T18:20:10.948 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-04-09T18:20:10.949 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-04-09T18:20:10.949 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-04-09T18:20:10.950 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-04-09T18:20:11.001 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:10 +0000 (0:00:00.089) 0:03:48.520 ********** 2021-04-09T18:20:11.059 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:11 +0000 (0:00:00.057) 0:03:48.578 ********** 2021-04-09T18:20:11.147 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:11 +0000 (0:00:00.088) 0:03:48.666 ********** 2021-04-09T18:20:11.162 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:11.184 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-04-09T18:20:11.186 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:11.267 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:11 +0000 (0:00:00.119) 0:03:48.786 ********** 2021-04-09T18:20:11.316 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-04-09T18:20:11.318 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi079"}, "changed": false} 2021-04-09T18:20:11.399 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:11 +0000 (0:00:00.132) 0:03:48.919 ********** 2021-04-09T18:20:11.432 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-04-09T18:20:11.434 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:11.509 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:11 +0000 (0:00:00.110) 0:03:49.029 ********** 2021-04-09T18:20:11.527 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:11.556 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:11.558 INFO:teuthology.task.ansible.out:TASK [common : Check firewalld status] ***************************************** skipping: [smithi144.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:20:11.602 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:11 +0000 (0:00:00.092) 0:03:49.122 ********** 2021-04-09T18:20:11.815 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-04-09T18:20:11.817 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:11.908 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:11 +0000 (0:00:00.305) 0:03:49.427 ********** 2021-04-09T18:20:11.954 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-04-09T18:20:11.955 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-04-09T18:20:12.054 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:12 +0000 (0:00:00.146) 0:03:49.574 ********** 2021-04-09T18:20:12.059 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:12.097 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-04-09T18:20:12.099 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:12.188 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:12 +0000 (0:00:00.133) 0:03:49.708 ********** 2021-04-09T18:20:12.226 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-04-09T18:20:12.228 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-04-09T18:20:12.229 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi089.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi089"}, "changed": false} 2021-04-09T18:20:12.303 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:12 +0000 (0:00:00.114) 0:03:49.822 ********** 2021-04-09T18:20:12.439 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:12 +0000 (0:00:00.135) 0:03:49.958 ********** 2021-04-09T18:20:12.475 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-04-09T18:20:12.477 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-04-09T18:20:12.491 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:12.580 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:12 +0000 (0:00:00.141) 0:03:50.099 ********** 2021-04-09T18:20:12.637 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-04-09T18:20:12.639 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi090"}, "changed": false} 2021-04-09T18:20:12.682 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:12 +0000 (0:00:00.095) 0:03:50.195 ********** 2021-04-09T18:20:13.173 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-04-09T18:20:13.181 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-04-09T18:20:13.209 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:13 +0000 (0:00:00.533) 0:03:50.729 ********** 2021-04-09T18:20:13.272 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi079.front.sepia.ceph.com", "ansible_hostname": "smithi079", "ansible_nodename": "smithi079"}, "changed": true, "name": "smithi079"} 2021-04-09T18:20:13.366 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:13 +0000 (0:00:00.155) 0:03:50.885 ********** 2021-04-09T18:20:13.378 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:13.411 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi089.front.sepia.ceph.com", "ansible_hostname": "smithi089", "ansible_nodename": "smithi089"}, "changed": true, "name": "smithi089"} 2021-04-09T18:20:13.537 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:13 +0000 (0:00:00.172) 0:03:51.057 ********** 2021-04-09T18:20:13.560 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi090.front.sepia.ceph.com", "ansible_hostname": "smithi090", "ansible_nodename": "smithi090"}, "changed": true, "name": "smithi090"} 2021-04-09T18:20:13.628 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:13 +0000 (0:00:00.090) 0:03:51.147 ********** 2021-04-09T18:20:13.661 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-04-09T18:20:13.663 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-04-09T18:20:13.701 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:13 +0000 (0:00:00.073) 0:03:51.220 ********** 2021-04-09T18:20:13.722 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-04-09T18:20:13.723 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-04-09 18:15:07 UTC", "ActiveEnterTimestampMonotonic": "19017007", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target var-run.mount system.slice local-fs.target systemd-tmpfiles-setup.service network.target time-sync.target sysinit.target -.mount systemd-journald.socket nss-lookup.target basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-04-09 18:15:07 UTC", "AssertTimestampMonotonic": "19016307", "Before": "multi-user.target xdm.service getty@tty1.service plymouth-quit.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-04-09 18:15:07 UTC", "ConditionTimestampMonotonic": "19016307", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2021-04-09T18:20:13.725 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1295", "ExecMainStartTimestamp": "Fri 2021-04-09 18:15:07 UTC", "ExecMainStartTimestampMonotonic": "19016982", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2021-04-09 18:15:07 UTC] ; stop_time=[n/a] ; pid=1295 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-04-09 18:15:07 UTC", "InactiveExitTimestampMonotonic": "19017007", "InvocationID": "49c4bae62c9942debe26e8d9ea56570f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2021-04-09T18:20:13.727 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1295", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2021-04-09T18:20:13.730 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-04-09 18:15:07 UTC", "StateChangeTimestampMonotonic": "19017007", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-04-09 18:15:07 UTC", "WatchdogTimestampMonotonic": "19017006", "WatchdogUSec": "0"}} 2021-04-09T18:20:13.755 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:13 +0000 (0:00:00.053) 0:03:51.274 ********** 2021-04-09T18:20:13.915 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-04-09T18:20:13.918 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi136"}, "changed": false} TASK [common : Get SELinux status] ********************************************* skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:13.941 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:13 +0000 (0:00:00.185) 0:03:51.460 ********** 2021-04-09T18:20:14.009 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:14 +0000 (0:00:00.067) 0:03:51.527 ********** 2021-04-09T18:20:14.177 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-04-09T18:20:14.179 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-04-09T18:20:14.257 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:14 +0000 (0:00:00.248) 0:03:51.776 ********** 2021-04-09T18:20:14.350 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-04-09T18:20:14.352 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:14.357 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-04-09T18:20:14.359 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-04-09T18:20:14.373 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-04-09T18:20:14.428 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:14 +0000 (0:00:00.171) 0:03:51.948 ********** 2021-04-09T18:20:14.470 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:14 +0000 (0:00:00.041) 0:03:51.989 ********** 2021-04-09T18:20:14.530 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:14 +0000 (0:00:00.059) 0:03:52.049 ********** 2021-04-09T18:20:14.754 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-04-09T18:20:14.756 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi136.front.sepia.ceph.com", "ansible_hostname": "smithi136", "ansible_nodename": "smithi136"}, "changed": true, "name": "smithi136"} 2021-04-09T18:20:14.833 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:14 +0000 (0:00:00.303) 0:03:52.352 ********** 2021-04-09T18:20:14.852 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-04-09T18:20:14.854 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:14.911 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:14 +0000 (0:00:00.078) 0:03:52.431 ********** 2021-04-09T18:20:15.054 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-04-09T18:20:15.055 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-04-09T18:20:15.096 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:15 +0000 (0:00:00.184) 0:03:52.615 ********** 2021-04-09T18:20:15.180 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-04-09T18:20:15.182 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:15.251 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:15 +0000 (0:00:00.150) 0:03:52.766 ********** 2021-04-09T18:20:15.259 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-04-09T18:20:15.260 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-04-09T18:20:15.312 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:15 +0000 (0:00:00.065) 0:03:52.831 ********** 2021-04-09T18:20:15.349 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-04-09T18:20:15.396 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:15 +0000 (0:00:00.084) 0:03:52.915 ********** 2021-04-09T18:20:15.494 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-04-09T18:20:15.496 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:15.543 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:15 +0000 (0:00:00.147) 0:03:53.063 ********** 2021-04-09T18:20:15.586 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-04-09T18:20:15.588 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-04-09T18:20:15.633 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:15 +0000 (0:00:00.089) 0:03:53.152 ********** 2021-04-09T18:20:15.645 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:15.711 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-04-09T18:20:15.712 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:15.752 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:15 +0000 (0:00:00.119) 0:03:53.272 ********** 2021-04-09T18:20:15.764 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-04-09T18:20:15.766 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-04-09T18:20:15.823 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:15 +0000 (0:00:00.071) 0:03:53.343 ********** 2021-04-09T18:20:15.955 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-04-09T18:20:15.957 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:16.011 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:16 +0000 (0:00:00.187) 0:03:53.530 ********** 2021-04-09T18:20:16.013 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:16.020 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-04-09T18:20:16.022 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} TASK [testnode : Create remote.conf] ******************************************* skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:16.070 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:16 +0000 (0:00:00.058) 0:03:53.589 ********** 2021-04-09T18:20:16.167 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:16 +0000 (0:00:00.096) 0:03:53.686 ********** 2021-04-09T18:20:16.178 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-04-09T18:20:16.179 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-04-09T18:20:16.180 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:16.181 INFO:teuthology.task.ansible.out:TASK [common : nrpe - Build SELinux policy package] **************************** 2021-04-09T18:20:16.181 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:16.220 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:16 +0000 (0:00:00.053) 0:03:53.739 ********** 2021-04-09T18:20:16.271 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:16 +0000 (0:00:00.050) 0:03:53.790 ********** 2021-04-09T18:20:16.272 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:16.283 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-04-09T18:20:16.285 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:16.333 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:16 +0000 (0:00:00.062) 0:03:53.853 ********** 2021-04-09T18:20:16.378 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-04-09T18:20:16.380 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-04-09T18:20:16.483 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:16 +0000 (0:00:00.148) 0:03:54.002 ********** 2021-04-09T18:20:16.497 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-04-09T18:20:16.498 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:16.499 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:16.539 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:16 +0000 (0:00:00.056) 0:03:54.058 ********** 2021-04-09T18:20:16.584 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:16 +0000 (0:00:00.044) 0:03:54.103 ********** 2021-04-09T18:20:16.606 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-04-09T18:20:16.607 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:16.682 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:16 +0000 (0:00:00.099) 0:03:54.202 ********** 2021-04-09T18:20:16.779 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:16 +0000 (0:00:00.096) 0:03:54.298 ********** 2021-04-09T18:20:16.782 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:16.792 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:16.794 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:16.857 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:16 +0000 (0:00:00.077) 0:03:54.376 ********** 2021-04-09T18:20:16.936 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:16 +0000 (0:00:00.078) 0:03:54.455 ********** 2021-04-09T18:20:16.940 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:16.965 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-04-09T18:20:16.967 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:17.020 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:17 +0000 (0:00:00.084) 0:03:54.540 ********** 2021-04-09T18:20:17.024 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:17.044 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:17.056 INFO:teuthology.task.ansible.out:TASK [common : nrpe - Remove temporary files] ********************************** 2021-04-09T18:20:17.058 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:17.096 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:17 +0000 (0:00:00.075) 0:03:54.615 ********** 2021-04-09T18:20:17.130 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:17.165 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:17 +0000 (0:00:00.066) 0:03:54.684 ********** 2021-04-09T18:20:17.221 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:17.222 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-04-09T18:20:17.223 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-04-09T18:20:17.301 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:17 +0000 (0:00:00.137) 0:03:54.821 ********** 2021-04-09T18:20:17.335 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:17 +0000 (0:00:00.033) 0:03:54.854 ********** 2021-04-09T18:20:17.350 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-04-09T18:20:17.352 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:17.386 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:17 +0000 (0:00:00.051) 0:03:54.906 ********** 2021-04-09T18:20:17.419 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:17 +0000 (0:00:00.032) 0:03:54.938 ********** 2021-04-09T18:20:17.436 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-04-09T18:20:17.438 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:17.474 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:17 +0000 (0:00:00.055) 0:03:54.994 ********** 2021-04-09T18:20:17.493 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:17.520 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:17 +0000 (0:00:00.045) 0:03:55.039 ********** 2021-04-09T18:20:17.549 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-04-09T18:20:17.551 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-04-09T18:20:17.592 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:17 +0000 (0:00:00.072) 0:03:55.111 ********** 2021-04-09T18:20:17.598 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-04-09T18:20:17.600 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:17.629 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:17 +0000 (0:00:00.037) 0:03:55.148 ********** 2021-04-09T18:20:17.636 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-04-09T18:20:17.638 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:17.705 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:17 +0000 (0:00:00.076) 0:03:55.225 ********** 2021-04-09T18:20:17.723 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-04-09T18:20:17.725 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:17.836 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:17 +0000 (0:00:00.130) 0:03:55.355 ********** 2021-04-09T18:20:17.849 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:17.851 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:17.917 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:17 +0000 (0:00:00.081) 0:03:55.436 ********** 2021-04-09T18:20:18.043 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:18 +0000 (0:00:00.125) 0:03:55.562 ********** 2021-04-09T18:20:18.096 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi144.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-04-09T18:20:18.098 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-04-09T18:20:18.121 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:18.123 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:18.176 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:18 +0000 (0:00:00.132) 0:03:55.695 ********** 2021-04-09T18:20:18.249 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:18 +0000 (0:00:00.072) 0:03:55.768 ********** 2021-04-09T18:20:18.534 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:18 +0000 (0:00:00.131) 0:03:55.899 ********** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 09 April 2021 18:20:18 +0000 (0:00:00.106) 0:03:56.006 ********** 2021-04-09T18:20:18.575 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:18 +0000 (0:00:00.087) 0:03:56.094 ********** 2021-04-09T18:20:18.709 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:18 +0000 (0:00:00.125) 0:03:56.220 ********** TASK [testnode : Rebuild rpmdb] ************************************************ 2021-04-09T18:20:18.711 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Including version specific variables.] ************************ ok: [smithi144.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-04-09T18:20:18.711 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-04-09T18:20:18.752 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:18 +0000 (0:00:00.051) 0:03:56.272 ********** 2021-04-09T18:20:18.821 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:18 +0000 (0:00:00.068) 0:03:56.341 ********** 2021-04-09T18:20:18.906 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:18 +0000 (0:00:00.083) 0:03:56.424 ********** 2021-04-09T18:20:18.928 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:18.929 INFO:teuthology.task.ansible.out:TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-04-09T18:20:18.930 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:18.931 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:18.937 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:18.983 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:18 +0000 (0:00:00.077) 0:03:56.502 ********** 2021-04-09T18:20:19.025 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:19 +0000 (0:00:00.041) 0:03:56.544 ********** 2021-04-09T18:20:19.035 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-04-09T18:20:19.036 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:19.038 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-04-09T18:20:19.085 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:19 +0000 (0:00:00.060) 0:03:56.605 ********** 2021-04-09T18:20:19.171 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:19 +0000 (0:00:00.085) 0:03:56.690 ********** 2021-04-09T18:20:19.183 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-04-09T18:20:19.185 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-04-09T18:20:19.287 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:19 +0000 (0:00:00.113) 0:03:56.804 ********** 2021-04-09T18:20:19.332 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-04-09T18:20:19.340 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable copr repos] ******************************************** 2021-04-09T18:20:19.374 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:19 +0000 (0:00:00.089) 0:03:56.893 ********** 2021-04-09T18:20:19.472 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:19 +0000 (0:00:00.098) 0:03:56.992 ********** 2021-04-09T18:20:19.548 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:19 +0000 (0:00:00.071) 0:03:57.064 ********** 2021-04-09T18:20:19.562 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-04-09T18:20:19.642 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:19 +0000 (0:00:00.097) 0:03:57.162 ********** 2021-04-09T18:20:19.691 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:19.719 INFO:teuthology.task.ansible.out:TASK [testnode : Install GPG] ************************************************** 2021-04-09T18:20:19.721 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:19.725 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:19.726 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-04-09T18:20:19.728 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-04-09T18:20:19.789 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:19 +0000 (0:00:00.147) 0:03:57.309 ********** 2021-04-09T18:20:19.803 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:19.922 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:19 +0000 (0:00:00.132) 0:03:57.441 ********** 2021-04-09T18:20:19.989 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:19 +0000 (0:00:00.067) 0:03:57.508 ********** 2021-04-09T18:20:19.999 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-04-09T18:20:20.000 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-04-09T18:20:20.005 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi079.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-04-09T18:20:20.008 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-04-09T18:20:20.062 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:20 +0000 (0:00:00.073) 0:03:57.582 ********** 2021-04-09T18:20:20.091 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:20 +0000 (0:00:00.027) 0:03:57.609 ********** 2021-04-09T18:20:20.144 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:20 +0000 (0:00:00.050) 0:03:57.659 ********** 2021-04-09T18:20:20.174 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-04-09T18:20:20.218 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:20 +0000 (0:00:00.077) 0:03:57.737 ********** 2021-04-09T18:20:20.245 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-04-09T18:20:20.247 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:20.323 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:20 +0000 (0:00:00.105) 0:03:57.842 ********** 2021-04-09T18:20:20.346 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-04-09T18:20:20.360 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:20.362 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:20.408 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:20 +0000 (0:00:00.085) 0:03:57.928 ********** 2021-04-09T18:20:20.471 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:20 +0000 (0:00:00.062) 0:03:57.990 ********** 2021-04-09T18:20:20.533 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:20 +0000 (0:00:00.061) 0:03:58.052 ********** 2021-04-09T18:20:20.572 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-04-09T18:20:20.576 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:20.625 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:20 +0000 (0:00:00.092) 0:03:58.145 ********** 2021-04-09T18:20:20.658 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:20 +0000 (0:00:00.032) 0:03:58.177 ********** 2021-04-09T18:20:20.671 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-04-09T18:20:20.673 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:20.673 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:20.760 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:20 +0000 (0:00:00.102) 0:03:58.279 ********** 2021-04-09T18:20:20.872 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:20 +0000 (0:00:00.112) 0:03:58.392 ********** 2021-04-09T18:20:20.881 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:20.889 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:20.891 INFO:teuthology.task.ansible.out:TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG] ************************************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:20.943 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:20 +0000 (0:00:00.070) 0:03:58.462 ********** 2021-04-09T18:20:20.992 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:20 +0000 (0:00:00.049) 0:03:58.511 ********** 2021-04-09T18:20:21.061 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-04-09T18:20:21.063 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:21.104 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:21 +0000 (0:00:00.111) 0:03:58.623 ********** 2021-04-09T18:20:21.120 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-04-09T18:20:21.122 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-04-09T18:20:21.178 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:21 +0000 (0:00:00.074) 0:03:58.697 ********** 2021-04-09T18:20:21.256 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-04-09T18:20:21.258 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-04-09T18:20:21.341 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:21 +0000 (0:00:00.162) 0:03:58.860 ********** 2021-04-09T18:20:21.375 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi089.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-04-09T18:20:21.385 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-04-09T18:20:21.421 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:21 +0000 (0:00:00.080) 0:03:58.941 ********** 2021-04-09T18:20:21.480 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:21 +0000 (0:00:00.058) 0:03:59.000 ********** 2021-04-09T18:20:21.575 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:21 +0000 (0:00:00.095) 0:03:59.095 ********** 2021-04-09T18:20:21.600 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-04-09T18:20:21.601 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:21.648 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:21 +0000 (0:00:00.071) 0:03:59.166 ********** 2021-04-09T18:20:21.669 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:21.699 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:21 +0000 (0:00:00.051) 0:03:59.218 ********** 2021-04-09T18:20:21.707 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:21.711 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:21.718 INFO:teuthology.task.ansible.out:TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:21.789 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:21 +0000 (0:00:00.089) 0:03:59.308 ********** 2021-04-09T18:20:21.841 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:20:21.843 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:21.941 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:21 +0000 (0:00:00.152) 0:03:59.460 ********** 2021-04-09T18:20:21.951 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-04-09T18:20:21.953 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** TASK [testnode : set_fact] ***************************************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:22.000 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:21 +0000 (0:00:00.058) 0:03:59.519 ********** 2021-04-09T18:20:22.002 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:22.029 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:22 +0000 (0:00:00.029) 0:03:59.549 ********** 2021-04-09T18:20:22.062 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:22 +0000 (0:00:00.032) 0:03:59.581 ********** 2021-04-09T18:20:22.123 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-04-09T18:20:22.127 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:22.192 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:22 +0000 (0:00:00.129) 0:03:59.711 ********** 2021-04-09T18:20:22.199 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:22.234 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-04-09T18:20:22.235 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:22.240 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-04-09T18:20:22.242 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:22.312 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:22 +0000 (0:00:00.120) 0:03:59.832 ********** 2021-04-09T18:20:22.399 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:22 +0000 (0:00:00.077) 0:03:59.909 ********** 2021-04-09T18:20:22.409 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:22.431 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-04-09T18:20:22.433 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:22.478 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:22 +0000 (0:00:00.088) 0:03:59.998 ********** 2021-04-09T18:20:22.481 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:22.518 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:22 +0000 (0:00:00.039) 0:04:00.038 ********** 2021-04-09T18:20:22.550 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-04-09T18:20:22.553 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:22.564 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-04-09T18:20:22.565 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-04-09T18:20:22.634 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:22 +0000 (0:00:00.116) 0:04:00.154 ********** 2021-04-09T18:20:22.719 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:22 +0000 (0:00:00.084) 0:04:00.239 ********** 2021-04-09T18:20:22.726 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:22.745 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-04-09T18:20:22.747 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:22.751 INFO:teuthology.task.ansible.out:TASK [testnode : Removing saved yum transactions] ****************************** 2021-04-09T18:20:22.753 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:22.815 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:22 +0000 (0:00:00.095) 0:04:00.334 ********** 2021-04-09T18:20:22.873 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:22 +0000 (0:00:00.057) 0:04:00.392 ********** 2021-04-09T18:20:22.884 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:22.906 INFO:teuthology.task.ansible.out:TASK [testnode : Install GPG] ************************************************** 2021-04-09T18:20:22.908 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:22.948 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:22 +0000 (0:00:00.075) 0:04:00.468 ********** 2021-04-09T18:20:23.049 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:23 +0000 (0:00:00.100) 0:04:00.569 ********** 2021-04-09T18:20:23.061 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:23.068 INFO:teuthology.task.ansible.out:TASK [testnode : Set hostname var] ********************************************* 2021-04-09T18:20:23.070 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi144"}, "changed": false} TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:23.103 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:23 +0000 (0:00:00.053) 0:04:00.623 ********** 2021-04-09T18:20:23.110 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:23.134 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:23 +0000 (0:00:00.029) 0:04:00.652 ********** 2021-04-09T18:20:23.202 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:23 +0000 (0:00:00.068) 0:04:00.721 ********** 2021-04-09T18:20:23.237 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:23.293 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:23 +0000 (0:00:00.091) 0:04:00.812 ********** 2021-04-09T18:20:23.302 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:23.309 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-04-09T18:20:23.312 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:23.323 INFO:teuthology.task.ansible.out:TASK [testnode : Install GPG keys] ********************************************* 2021-04-09T18:20:23.325 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-04-09T18:20:23.400 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:23 +0000 (0:00:00.106) 0:04:00.919 ********** 2021-04-09T18:20:23.475 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:23 +0000 (0:00:00.075) 0:04:00.995 ********** 2021-04-09T18:20:23.507 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-04-09T18:20:23.509 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:23.562 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:23 +0000 (0:00:00.086) 0:04:01.081 ********** 2021-04-09T18:20:23.649 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-04-09T18:20:23.651 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:23.694 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:23 +0000 (0:00:00.131) 0:04:01.213 ********** 2021-04-09T18:20:23.718 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:23.720 INFO:teuthology.task.ansible.out:TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:23.721 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:23.723 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-04-09T18:20:23.725 INFO:teuthology.task.ansible.out: skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:23.787 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:23 +0000 (0:00:00.093) 0:04:01.307 ********** 2021-04-09T18:20:23.788 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:23.873 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:23 +0000 (0:00:00.086) 0:04:01.393 ********** 2021-04-09T18:20:23.908 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:23.910 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-04-09T18:20:23.912 INFO:teuthology.task.ansible.out: skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:23.976 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:23 +0000 (0:00:00.102) 0:04:01.495 ********** 2021-04-09T18:20:23.977 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:23.997 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:23.999 INFO:teuthology.task.ansible.out:TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:24.060 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:24 +0000 (0:00:00.083) 0:04:01.579 ********** 2021-04-09T18:20:24.064 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:24.085 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:24.087 INFO:teuthology.task.ansible.out:TASK [testnode : Install packages] ********************************************* skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:24.089 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi144.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi144.front.sepia.ceph.com", "ansible_hostname": "smithi144", "ansible_nodename": "smithi144"}, "changed": true, "name": "smithi144"} 2021-04-09T18:20:24.146 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:24 +0000 (0:00:00.085) 0:04:01.665 ********** 2021-04-09T18:20:24.212 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:24 +0000 (0:00:00.064) 0:04:01.730 ********** 2021-04-09T18:20:24.223 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:20:24.225 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-04-09T18:20:24.226 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:24.273 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:24 +0000 (0:00:00.059) 0:04:01.789 ********** 2021-04-09T18:20:24.329 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:24 +0000 (0:00:00.059) 0:04:01.848 ********** 2021-04-09T18:20:24.351 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-04-09T18:20:24.364 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:24.427 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:24 +0000 (0:00:00.098) 0:04:01.947 ********** 2021-04-09T18:20:24.462 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-04-09T18:20:24.464 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:24.527 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:24 +0000 (0:00:00.099) 0:04:02.046 ********** 2021-04-09T18:20:24.549 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-04-09T18:20:24.551 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:24.615 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:24 +0000 (0:00:00.088) 0:04:02.135 ********** 2021-04-09T18:20:24.621 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:24.638 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-04-09T18:20:24.640 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:24.687 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:24 +0000 (0:00:00.070) 0:04:02.205 ********** 2021-04-09T18:20:24.710 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:24.748 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:24 +0000 (0:00:00.062) 0:04:02.267 ********** 2021-04-09T18:20:24.750 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:24.761 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-04-09T18:20:24.763 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:24.793 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:24 +0000 (0:00:00.044) 0:04:02.312 ********** 2021-04-09T18:20:24.808 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-04-09T18:20:24.811 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:24.855 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:24 +0000 (0:00:00.062) 0:04:02.375 ********** 2021-04-09T18:20:24.858 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:24.873 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:24.883 INFO:teuthology.task.ansible.out:TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:24.922 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:24 +0000 (0:00:00.066) 0:04:02.442 ********** 2021-04-09T18:20:24.938 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:24.940 INFO:teuthology.task.ansible.out:TASK [testnode : Upgrade packages] ********************************************* 2021-04-09T18:20:24.942 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:25.020 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:25 +0000 (0:00:00.097) 0:04:02.539 ********** 2021-04-09T18:20:25.050 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-04-09T18:20:25.052 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-04-09T18:20:25.127 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:25 +0000 (0:00:00.107) 0:04:02.647 ********** 2021-04-09T18:20:25.232 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:25 +0000 (0:00:00.095) 0:04:02.751 ********** 2021-04-09T18:20:25.243 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-04-09T18:20:25.245 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:25.248 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-04-09T18:20:25.250 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:25.313 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:25 +0000 (0:00:00.080) 0:04:02.832 ********** 2021-04-09T18:20:25.343 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:25 +0000 (0:00:00.029) 0:04:02.862 ********** 2021-04-09T18:20:25.356 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:25.358 INFO:teuthology.task.ansible.out:TASK [testnode : Remove packages] ********************************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:25.404 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:25 +0000 (0:00:00.061) 0:04:02.924 ********** 2021-04-09T18:20:25.418 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-04-09T18:20:25.419 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:25.467 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:25 +0000 (0:00:00.062) 0:04:02.987 ********** 2021-04-09T18:20:25.555 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:25.599 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:25 +0000 (0:00:00.131) 0:04:03.118 ********** 2021-04-09T18:20:25.664 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-04-09T18:20:25.667 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:25.732 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:25 +0000 (0:00:00.133) 0:04:03.252 ********** 2021-04-09T18:20:25.751 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:25.758 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:25.761 INFO:teuthology.task.ansible.out:TASK [testnode : Upgrade packages] ********************************************* 2021-04-09T18:20:25.763 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:25.814 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:25 +0000 (0:00:00.081) 0:04:03.333 ********** 2021-04-09T18:20:25.858 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-04-09T18:20:25.860 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:25.885 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:25 +0000 (0:00:00.071) 0:04:03.405 ********** 2021-04-09T18:20:25.908 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:25 +0000 (0:00:00.022) 0:04:03.428 ********** 2021-04-09T18:20:25.980 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-04-09T18:20:25.982 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:26.005 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:26 +0000 (0:00:00.096) 0:04:03.524 ********** 2021-04-09T18:20:26.011 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:26.088 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:26 +0000 (0:00:00.083) 0:04:03.608 ********** 2021-04-09T18:20:26.098 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-04-09T18:20:26.100 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:26.161 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:26 +0000 (0:00:00.072) 0:04:03.680 ********** 2021-04-09T18:20:26.212 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:26 +0000 (0:00:00.051) 0:04:03.731 ********** 2021-04-09T18:20:26.225 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-04-09T18:20:26.226 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-04-09T18:20:26.285 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:26 +0000 (0:00:00.072) 0:04:03.804 ********** 2021-04-09T18:20:26.294 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:26.302 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:26.305 INFO:teuthology.task.ansible.out:TASK [testnode : Stop and disable iptables] ************************************ 2021-04-09T18:20:26.307 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:26.312 INFO:teuthology.task.ansible.out:TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-04-09T18:20:26.314 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:26.370 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:26 +0000 (0:00:00.084) 0:04:03.889 ********** 2021-04-09T18:20:26.381 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:26.428 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:26 +0000 (0:00:00.058) 0:04:03.947 ********** 2021-04-09T18:20:26.429 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:26.538 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:26 +0000 (0:00:00.109) 0:04:04.057 ********** 2021-04-09T18:20:26.546 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-04-09T18:20:26.548 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:26.595 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:26 +0000 (0:00:00.057) 0:04:04.115 ********** 2021-04-09T18:20:26.609 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-04-09T18:20:26.611 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:26.715 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:26 +0000 (0:00:00.119) 0:04:04.234 ********** 2021-04-09T18:20:26.717 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:26.746 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-04-09T18:20:26.748 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:26.850 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:26 +0000 (0:00:00.134) 0:04:04.369 ********** 2021-04-09T18:20:26.934 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:26 +0000 (0:00:00.083) 0:04:04.453 ********** 2021-04-09T18:20:26.958 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-04-09T18:20:26.963 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:27.044 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:27 +0000 (0:00:00.109) 0:04:04.563 ********** 2021-04-09T18:20:27.069 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-04-09T18:20:27.070 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:27.071 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:27.078 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-04-09T18:20:27.080 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005417", "end": "2021-04-09 18:20:26.977924", "rc": 0, "start": "2021-04-09 18:20:26.972507", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:20:27.196 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:27 +0000 (0:00:00.152) 0:04:04.715 ********** 2021-04-09T18:20:27.201 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:27.306 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:27 +0000 (0:00:00.110) 0:04:04.826 ********** 2021-04-09T18:20:27.367 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-04-09T18:20:27.369 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-04-09T18:20:27.370 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-04-09T18:20:27.371 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:27.372 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-04-09T18:20:27.424 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:27 +0000 (0:00:00.118) 0:04:04.944 ********** 2021-04-09T18:20:27.502 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:27 +0000 (0:00:00.077) 0:04:05.022 ********** 2021-04-09T18:20:27.633 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:27 +0000 (0:00:00.130) 0:04:05.152 ********** 2021-04-09T18:20:27.666 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-04-09T18:20:27.669 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:27.670 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-04-09T18:20:27.671 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:27.806 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:27 +0000 (0:00:00.173) 0:04:05.325 ********** 2021-04-09T18:20:27.877 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:27 +0000 (0:00:00.066) 0:04:05.392 ********** 2021-04-09T18:20:27.911 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-04-09T18:20:27.913 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:27.921 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-04-09T18:20:27.923 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:28.022 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:28 +0000 (0:00:00.148) 0:04:05.541 ********** 2021-04-09T18:20:28.110 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:28 +0000 (0:00:00.087) 0:04:05.629 ********** 2021-04-09T18:20:28.132 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:28.134 INFO:teuthology.task.ansible.out:TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:28.231 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:28 +0000 (0:00:00.121) 0:04:05.750 ********** 2021-04-09T18:20:28.264 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:28.266 INFO:teuthology.task.ansible.out:TASK [testnode : Set apt preferences] ****************************************** 2021-04-09T18:20:28.270 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-04-09T18:20:28.357 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:28 +0000 (0:00:00.125) 0:04:05.876 ********** 2021-04-09T18:20:28.518 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-04-09T18:20:28.520 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:28.612 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:28 +0000 (0:00:00.254) 0:04:06.131 ********** 2021-04-09T18:20:28.621 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:28.640 INFO:teuthology.task.ansible.out:TASK [testnode : Restart abrtd] ************************************************ 2021-04-09T18:20:28.667 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:28.669 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:28.778 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:28 +0000 (0:00:00.165) 0:04:06.296 ********** 2021-04-09T18:20:28.867 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:28 +0000 (0:00:00.090) 0:04:06.387 ********** 2021-04-09T18:20:28.947 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-04-09T18:20:28.949 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:29.409 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:29 +0000 (0:00:00.541) 0:04:06.929 ********** 2021-04-09T18:20:29.442 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-04-09T18:20:29.444 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:29.445 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:29.445 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:29.558 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:29 +0000 (0:00:00.148) 0:04:07.078 ********** 2021-04-09T18:20:29.613 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:29 +0000 (0:00:00.054) 0:04:07.132 ********** 2021-04-09T18:20:29.631 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-04-09T18:20:29.632 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:29.634 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005175", "end": "2021-04-09 18:20:29.556154", "rc": 0, "start": "2021-04-09 18:20:29.550979", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:20:29.708 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:29 +0000 (0:00:00.094) 0:04:07.227 ********** 2021-04-09T18:20:29.710 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:29.817 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:29 +0000 (0:00:00.109) 0:04:07.337 ********** 2021-04-09T18:20:29.831 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:29.873 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-04-09T18:20:29.875 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:29.953 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:29 +0000 (0:00:00.135) 0:04:07.473 ********** 2021-04-09T18:20:29.959 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:29.977 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:29.980 INFO:teuthology.task.ansible.out:TASK [testnode : Stop and disable iptables] ************************************ 2021-04-09T18:20:29.982 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:30.047 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:30 +0000 (0:00:00.093) 0:04:07.567 ********** 2021-04-09T18:20:30.069 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-04-09T18:20:30.138 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:30 +0000 (0:00:00.090) 0:04:07.657 ********** 2021-04-09T18:20:30.145 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-04-09T18:20:30.148 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:30.214 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:30 +0000 (0:00:00.076) 0:04:07.734 ********** 2021-04-09T18:20:30.270 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-04-09T18:20:30.271 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:30.358 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:30 +0000 (0:00:00.143) 0:04:07.877 ********** 2021-04-09T18:20:30.376 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-04-09T18:20:30.377 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005192", "end": "2021-04-09 18:20:30.293436", "rc": 0, "start": "2021-04-09 18:20:30.288244", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:20:30.443 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:30 +0000 (0:00:00.085) 0:04:07.962 ********** 2021-04-09T18:20:30.570 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:30.578 INFO:teuthology.task.ansible.out:TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-04-09T18:20:30.581 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:30.626 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:30 +0000 (0:00:00.183) 0:04:08.146 ********** 2021-04-09T18:20:30.637 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-04-09T18:20:30.693 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:30 +0000 (0:00:00.067) 0:04:08.213 ********** 2021-04-09T18:20:30.734 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-04-09T18:20:30.735 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:30.802 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:30 +0000 (0:00:00.108) 0:04:08.322 ********** 2021-04-09T18:20:30.891 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-04-09T18:20:30.893 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:30.973 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:30 +0000 (0:00:00.170) 0:04:08.492 ********** 2021-04-09T18:20:31.003 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-04-09T18:20:31.005 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-04-09T18:20:31.102 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:31 +0000 (0:00:00.129) 0:04:08.621 ********** 2021-04-09T18:20:31.155 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-04-09T18:20:31.157 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:31.213 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:31 +0000 (0:00:00.111) 0:04:08.732 ********** 2021-04-09T18:20:31.224 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-04-09T18:20:31.226 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:31.248 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:31.359 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:31 +0000 (0:00:00.145) 0:04:08.878 ********** 2021-04-09T18:20:31.385 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:31.390 INFO:teuthology.task.ansible.out:TASK [testnode : Add sources list] ********************************************* 2021-04-09T18:20:31.393 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set apt preferences] ****************************************** ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-04-09T18:20:31.412 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-04-09T18:20:31.414 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:31.487 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:31 +0000 (0:00:00.128) 0:04:09.007 ********** 2021-04-09T18:20:31.574 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:31 +0000 (0:00:00.086) 0:04:09.093 ********** 2021-04-09T18:20:31.695 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:31 +0000 (0:00:00.120) 0:04:09.214 ********** 2021-04-09T18:20:31.721 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-04-09T18:20:31.723 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:31.797 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:31 +0000 (0:00:00.100) 0:04:09.314 ********** 2021-04-09T18:20:31.828 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-04-09T18:20:31.831 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:31.858 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:31 +0000 (0:00:00.062) 0:04:09.377 ********** 2021-04-09T18:20:31.941 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-04-09T18:20:31.943 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:31.979 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:31 +0000 (0:00:00.121) 0:04:09.498 ********** 2021-04-09T18:20:32.121 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-04-09T18:20:32.203 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:32 +0000 (0:00:00.223) 0:04:09.722 ********** 2021-04-09T18:20:32.211 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:32.248 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:32.356 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:32 +0000 (0:00:00.153) 0:04:09.876 ********** 2021-04-09T18:20:32.496 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:32.497 INFO:teuthology.task.ansible.out:TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-04-09T18:20:32.553 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:32 +0000 (0:00:00.196) 0:04:10.072 ********** 2021-04-09T18:20:32.555 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:32.573 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-04-09T18:20:32.574 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-04-09T18:20:32.655 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:32 +0000 (0:00:00.101) 0:04:10.174 ********** 2021-04-09T18:20:32.666 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-04-09T18:20:32.704 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:32 +0000 (0:00:00.048) 0:04:10.223 ********** 2021-04-09T18:20:32.790 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-04-09T18:20:32.792 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005270", "end": "2021-04-09 18:20:32.740003", "rc": 0, "start": "2021-04-09 18:20:32.734733", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:20:32.849 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:32 +0000 (0:00:00.145) 0:04:10.368 ********** 2021-04-09T18:20:32.974 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* ok: [smithi090.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-04-09T18:20:33.019 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:33.021 INFO:teuthology.task.ansible.out:TASK [testnode : Install GPG] ************************************************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:33.101 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:33 +0000 (0:00:00.251) 0:04:10.620 ********** 2021-04-09T18:20:33.114 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:33.180 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-04-09T18:20:33.240 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:33 +0000 (0:00:00.139) 0:04:10.759 ********** 2021-04-09T18:20:33.339 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-04-09T18:20:33.341 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-04-09T18:20:33.352 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-04-09T18:20:33.354 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi144.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-04-09T18:20:33.455 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:33 +0000 (0:00:00.215) 0:04:10.974 ********** 2021-04-09T18:20:33.461 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:33.667 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-04-09T18:20:33.669 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:33.707 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:33 +0000 (0:00:00.252) 0:04:11.227 ********** 2021-04-09T18:20:33.949 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:20:33.951 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install python-apt] ******************************************* ok: [smithi079.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:20:34.025 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:34 +0000 (0:00:00.318) 0:04:11.545 ********** 2021-04-09T18:20:34.159 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:34 +0000 (0:00:00.132) 0:04:11.678 ********** 2021-04-09T18:20:34.170 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:34.184 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-04-09T18:20:34.186 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-04-09T18:20:34.194 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-04-09T18:20:34.241 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:34 +0000 (0:00:00.082) 0:04:11.761 ********** 2021-04-09T18:20:34.342 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:34 +0000 (0:00:00.100) 0:04:11.861 ********** 2021-04-09T18:20:34.377 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-04-09T18:20:34.434 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:34 +0000 (0:00:00.091) 0:04:11.953 ********** 2021-04-09T18:20:34.454 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-04-09T18:20:34.457 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install apt keys] ********************************************* ok: [smithi089.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-04-09T18:20:34.520 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:34 +0000 (0:00:00.085) 0:04:12.039 ********** 2021-04-09T18:20:34.538 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:34.609 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:34 +0000 (0:00:00.088) 0:04:12.127 ********** 2021-04-09T18:20:34.656 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-04-09T18:20:34.658 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:34.740 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:34 +0000 (0:00:00.131) 0:04:12.259 ********** 2021-04-09T18:20:34.876 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-04-09T18:20:34.877 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:34.944 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:34 +0000 (0:00:00.199) 0:04:12.459 ********** 2021-04-09T18:20:35.004 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-04-09T18:20:35.006 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.033912", "end": "2021-04-09 18:20:34.963965", "rc": 0, "start": "2021-04-09 18:20:34.930053", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:20:35.053 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:35 +0000 (0:00:00.113) 0:04:12.572 ********** 2021-04-09T18:20:35.113 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-04-09T18:20:35.115 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:35.208 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:35 +0000 (0:00:00.119) 0:04:12.691 ********** 2021-04-09T18:20:35.413 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-04-09T18:20:35.415 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:35.480 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:35 +0000 (0:00:00.308) 0:04:12.999 ********** 2021-04-09T18:20:35.517 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* ok: [smithi090.front.sepia.ceph.com] => {"cache_update_time": 1617992385, "cache_updated": false, "changed": false} 2021-04-09T18:20:35.553 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:35 +0000 (0:00:00.072) 0:04:13.072 ********** 2021-04-09T18:20:35.665 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:20:35.733 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:35 +0000 (0:00:00.179) 0:04:13.252 ********** 2021-04-09T18:20:35.755 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-04-09T18:20:35.757 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:35.823 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:35 +0000 (0:00:00.090) 0:04:13.343 ********** 2021-04-09T18:20:35.858 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-04-09T18:20:35.928 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:35 +0000 (0:00:00.087) 0:04:13.430 ********** 2021-04-09T18:20:36.095 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:36 +0000 (0:00:00.183) 0:04:13.614 ********** 2021-04-09T18:20:36.130 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:36.135 INFO:teuthology.task.ansible.out:TASK [testnode : Install apt keys] ********************************************* 2021-04-09T18:20:36.137 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-04-09T18:20:36.138 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:36.212 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:36 +0000 (0:00:00.117) 0:04:13.732 ********** 2021-04-09T18:20:36.399 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-04-09T18:20:36.402 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.027888", "end": "2021-04-09 18:20:36.365778", "rc": 0, "start": "2021-04-09 18:20:36.337890", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:20:36.437 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:36 +0000 (0:00:00.224) 0:04:13.957 ********** 2021-04-09T18:20:36.460 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-04-09T18:20:36.463 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:36.507 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:36 +0000 (0:00:00.070) 0:04:14.027 ********** 2021-04-09T18:20:36.714 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-04-09T18:20:36.716 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.034787", "end": "2021-04-09 18:20:36.646948", "rc": 0, "start": "2021-04-09 18:20:36.612161", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:20:36.783 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:36 +0000 (0:00:00.275) 0:04:14.302 ********** 2021-04-09T18:20:36.870 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:36.944 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:36 +0000 (0:00:00.161) 0:04:14.464 ********** 2021-04-09T18:20:37.112 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-04-09T18:20:37.114 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-04-09T18:20:37.170 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:37 +0000 (0:00:00.225) 0:04:14.689 ********** 2021-04-09T18:20:37.190 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-04-09T18:20:37.194 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:37.314 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:37 +0000 (0:00:00.143) 0:04:14.833 ********** 2021-04-09T18:20:37.621 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-04-09T18:20:37.623 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:37.718 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:37 +0000 (0:00:00.403) 0:04:15.237 ********** 2021-04-09T18:20:37.913 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-04-09T18:20:37.915 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:37.968 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:37 +0000 (0:00:00.250) 0:04:15.488 ********** 2021-04-09T18:20:38.064 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-04-09T18:20:38.066 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:38.088 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:38 +0000 (0:00:00.119) 0:04:15.607 ********** 2021-04-09T18:20:38.166 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-04-09T18:20:38.168 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:20:38.228 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:38 +0000 (0:00:00.139) 0:04:15.747 ********** 2021-04-09T18:20:38.336 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:38.389 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:38 +0000 (0:00:00.160) 0:04:15.908 ********** 2021-04-09T18:20:38.420 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-04-09T18:20:38.422 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1617992386, "cache_updated": false, "changed": false} 2021-04-09T18:20:38.504 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:38 +0000 (0:00:00.115) 0:04:16.024 ********** 2021-04-09T18:20:38.694 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-04-09T18:20:38.728 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:38 +0000 (0:00:00.223) 0:04:16.248 ********** 2021-04-09T18:20:38.778 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-04-09T18:20:38.780 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:38.903 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:38 +0000 (0:00:00.174) 0:04:16.423 ********** 2021-04-09T18:20:39.098 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-04-09T18:20:39.099 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:39.100 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-04-09T18:20:39.101 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.035095", "end": "2021-04-09 18:20:39.069626", "rc": 0, "start": "2021-04-09 18:20:39.034531", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:20:39.173 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:39 +0000 (0:00:00.258) 0:04:16.693 ********** 2021-04-09T18:20:39.228 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:39 +0000 (0:00:00.054) 0:04:16.747 ********** 2021-04-09T18:20:39.485 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-04-09T18:20:39.487 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"cache_update_time": 1617992385, "cache_updated": false, "changed": false} 2021-04-09T18:20:39.536 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:39 +0000 (0:00:00.308) 0:04:17.056 ********** 2021-04-09T18:20:39.557 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:39.567 INFO:teuthology.task.ansible.out:TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:39.626 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:39 +0000 (0:00:00.089) 0:04:17.145 ********** 2021-04-09T18:20:39.923 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-04-09T18:20:39.925 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:39.985 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:39 +0000 (0:00:00.359) 0:04:17.504 ********** 2021-04-09T18:20:40.115 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-04-09T18:20:40.118 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:20:40.150 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:40 +0000 (0:00:00.158) 0:04:17.663 ********** 2021-04-09T18:20:40.218 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:40.246 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:40 +0000 (0:00:00.102) 0:04:17.766 ********** 2021-04-09T18:20:40.539 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-04-09T18:20:40.541 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005273", "end": "2021-04-09 18:20:40.507560", "rc": 0, "start": "2021-04-09 18:20:40.502287", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:20:40.565 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:40 +0000 (0:00:00.318) 0:04:18.084 ********** 2021-04-09T18:20:40.719 INFO:teuthology.task.ansible.out: 2021-04-09T18:20:40.720 INFO:teuthology.task.ansible.out:TASK [testnode : Remove custom repos] ****************************************** 2021-04-09T18:20:40.760 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:40 +0000 (0:00:00.195) 0:04:18.280 ********** 2021-04-09T18:20:41.484 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-04-09T18:20:41.486 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-04-09T18:20:41.593 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:41 +0000 (0:00:00.832) 0:04:19.113 ********** 2021-04-09T18:20:41.912 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-04-09T18:20:41.914 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:41.950 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:41 +0000 (0:00:00.356) 0:04:19.470 ********** 2021-04-09T18:20:42.366 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-04-09T18:20:42.369 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1617992386, "cache_updated": false, "changed": false} 2021-04-09T18:20:42.392 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:42 +0000 (0:00:00.441) 0:04:19.911 ********** 2021-04-09T18:20:43.189 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-04-09T18:20:43.192 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-04-09T18:20:44.218 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-04-09T18:20:44.267 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:44 +0000 (0:00:01.875) 0:04:21.787 ********** 2021-04-09T18:20:45.465 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* ok: [smithi144.front.sepia.ceph.com] => {"cache_update_time": 1617992393, "cache_updated": false, "changed": false} 2021-04-09T18:20:45.512 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:45 +0000 (0:00:01.244) 0:04:23.032 ********** 2021-04-09T18:20:45.698 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-04-09T18:20:45.749 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:45 +0000 (0:00:00.236) 0:04:23.268 ********** 2021-04-09T18:20:46.329 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-04-09T18:20:46.331 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.029946", "end": "2021-04-09 18:20:46.295090", "rc": 0, "start": "2021-04-09 18:20:46.265144", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:20:46.392 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:46 +0000 (0:00:00.642) 0:04:23.910 ********** 2021-04-09T18:20:48.770 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-04-09T18:20:48.772 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 41 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137595 files and directorie 2021-04-09T18:20:48.775 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 41 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Read 2021-04-09T18:20:48.777 INFO:teuthology.task.ansible.out:ing database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137595 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-04-09T18:20:48.797 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:48 +0000 (0:00:02.405) 0:04:26.316 ********** 2021-04-09T18:20:49.587 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-04-09T18:20:49.589 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"cache_update_time": 1617992393, "cache_updated": false, "changed": false} 2021-04-09T18:20:49.624 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:49 +0000 (0:00:00.825) 0:04:27.142 ********** 2021-04-09T18:20:50.736 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-04-09T18:20:50.738 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 41 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137595 files and directorie 2021-04-09T18:20:50.740 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 41 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Read 2021-04-09T18:20:50.742 INFO:teuthology.task.ansible.out:ing database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137595 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-04-09T18:20:50.820 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:50 +0000 (0:00:01.196) 0:04:28.339 ********** 2021-04-09T18:20:50.942 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 41 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137595 files and directorie 2021-04-09T18:20:50.944 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 41 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Read 2021-04-09T18:20:50.946 INFO:teuthology.task.ansible.out:ing database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137595 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-04-09T18:20:51.006 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:51 +0000 (0:00:00.186) 0:04:28.525 ********** 2021-04-09T18:20:53.077 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 41 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137595 files and directorie 2021-04-09T18:20:53.079 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 41 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Read 2021-04-09T18:20:53.081 INFO:teuthology.task.ansible.out:ing database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137595 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-04-09T18:20:53.123 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:53 +0000 (0:00:02.117) 0:04:30.643 ********** 2021-04-09T18:20:58.418 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-04-09T18:20:58.419 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apt-utils libapt-pkg5.0\nSuggested packages:\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apt apt-utils libapt-pkg5.0\n3 upgraded, 0 newly installed, 0 to remove and 38 not upgraded.\nNeed to get 2216 kB of archives.\nAfter this operation, 1024 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libapt-pkg5.0 amd64 1.6.13 [808 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt amd64 1.6.13 [1201 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt-utils amd64 1.6.13 [206 kB]\nFetched 2216 kB in 1s (2618 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database . 2021-04-09T18:20:58.421 INFO:teuthology.task.ansible.out:.. 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137453 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg5.0_1.6.13_amd64.deb ...\r\nUnpacking libapt-pkg5.0:amd64 (1.6.13) over (1.6.12ubuntu0.2) ...\r\nSetting up libapt-pkg5.0:amd64 (1.6.13) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137453 files and directories currently installed.)\r\nPreparing to unpack .../archives/apt_1.6.13_amd64.deb ...\r\nUnpacking apt (1.6.13) over (1.6.12ubuntu0.2) ...\r\nSetting up apt (1.6.13) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading da 2021-04-09T18:20:58.423 INFO:teuthology.task.ansible.out:tabase ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137453 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_1.6.13_amd64.deb ...\r\nUnpacking apt-utils (1.6.13) over (1.6.12ubuntu0.2) ...\r\nSetting up apt-utils (1.6.13) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apt-utils libapt-pkg5.0", "Suggested packages:", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apt apt-utils libapt-pkg5.0", "3 upgraded, 0 newly installed, 0 to remove and 38 not upgraded.", "Need to get 2216 kB of archives.", "After this operation, 1024 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libapt-pkg5.0 amd64 1.6.13 [808 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt amd64 1.6.13 [1201 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt-utils am 2021-04-09T18:20:58.424 INFO:teuthology.task.ansible.out:d64 1.6.13 [206 kB]", "Fetched 2216 kB in 1s (2618 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137453 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg5.0_1.6.13_amd64.deb ...", "Unpacking libapt-pkg5.0:amd64 (1.6.13) over (1.6.12ubuntu0.2) ...", "Setting up libapt-pkg5.0:amd64 (1.6.13) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137453 files and directories currently installed.)", "Preparing to unpack .../archives/apt_1.6.13_amd64.deb ...", "Unpacking apt (1.6.13) over (1.6.12ubuntu0.2) ...", "Setting up apt (1.6.13) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40% 2021-04-09T18:20:58.426 INFO:teuthology.task.ansible.out:", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137453 files and directories currently installed.)", "Preparing to unpack .../apt-utils_1.6.13_amd64.deb ...", "Unpacking apt-utils (1.6.13) over (1.6.12ubuntu0.2) ...", "Setting up apt-utils (1.6.13) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-04-09T18:20:58.447 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:58 +0000 (0:00:05.323) 0:04:35.967 ********** 2021-04-09T18:20:58.520 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-04-09T18:20:58.522 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:20:58.549 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:20:58 +0000 (0:00:00.101) 0:04:36.068 ********** 2021-04-09T18:21:00.076 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-04-09T18:21:00.077 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 41 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137595 files and directorie 2021-04-09T18:21:00.078 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 41 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Read 2021-04-09T18:21:00.080 INFO:teuthology.task.ansible.out:ing database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137595 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-04-09T18:21:00.105 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:00 +0000 (0:00:01.555) 0:04:37.624 ********** 2021-04-09T18:21:00.508 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:00.510 INFO:teuthology.task.ansible.out:TASK [testnode : Upgrade packages] ********************************************* changed: [smithi089.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apt-utils libapt-pkg5.0\nSuggested packages:\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apt apt-utils libapt-pkg5.0\n3 upgraded, 0 newly installed, 0 to remove and 38 not upgraded.\nNeed to get 2216 kB of archives.\nAfter this operation, 1024 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libapt-pkg5.0 amd64 1.6.13 [808 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt amd64 1.6.13 [1201 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt-utils amd64 1.6.13 [206 kB]\nFetched 2216 kB in 1s (2629 kB/s)\n(Reading datab 2021-04-09T18:21:00.512 INFO:teuthology.task.ansible.out:ase ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137453 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg5.0_1.6.13_amd64.deb ...\r\nUnpacking libapt-pkg5.0:amd64 (1.6.13) over (1.6.12ubuntu0.2) ...\r\nSetting up libapt-pkg5.0:amd64 (1.6.13) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137453 files and directories currently installed.)\r\nPreparing to unpack .../archives/apt_1.6.13_amd64.deb ...\r\nUnpacking apt (1.6.13) over (1.6.12ubuntu0.2) ...\r\nSetting up apt (1.6.13) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading d 2021-04-09T18:21:00.513 INFO:teuthology.task.ansible.out:atabase ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137453 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_1.6.13_amd64.deb ...\r\nUnpacking apt-utils (1.6.13) over (1.6.12ubuntu0.2) ...\r\nSetting up apt-utils (1.6.13) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apt-utils libapt-pkg5.0", "Suggested packages:", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apt apt-utils libapt-pkg5.0", "3 upgraded, 0 newly installed, 0 to remove and 38 not upgraded.", "Need to get 2216 kB of archives.", "After this operation, 1024 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libapt-pkg5.0 amd64 1.6.13 [808 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt amd64 1.6.13 [1201 kB 2021-04-09T18:21:00.515 INFO:teuthology.task.ansible.out:]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt-utils amd64 1.6.13 [206 kB]", "Fetched 2216 kB in 1s (2629 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137453 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg5.0_1.6.13_amd64.deb ...", "Unpacking libapt-pkg5.0:amd64 (1.6.13) over (1.6.12ubuntu0.2) ...", "Setting up libapt-pkg5.0:amd64 (1.6.13) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137453 files and directories currently installed.)", "Preparing to unpack .../archives/apt_1.6.13_amd64.deb ...", "Unpacking apt (1.6.13) over (1.6.12ubuntu0.2) ...", "Setting up apt (1.6.13) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "( 2021-04-09T18:21:00.517 INFO:teuthology.task.ansible.out:Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137453 files and directories currently installed.)", "Preparing to unpack .../apt-utils_1.6.13_amd64.deb ...", "Unpacking apt-utils (1.6.13) over (1.6.12ubuntu0.2) ...", "Setting up apt-utils (1.6.13) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-04-09T18:21:00.545 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:00 +0000 (0:00:00.439) 0:04:38.064 ********** 2021-04-09T18:21:00.610 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"cache_update_time": 1617992385, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apt-utils libapt-pkg5.0\nSuggested packages:\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apt apt-utils libapt-pkg5.0\n3 upgraded, 0 newly installed, 0 to remove and 38 not upgraded.\nNeed to get 2216 kB of archives.\nAfter this operation, 1024 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libapt-pkg5.0 amd64 1.6.13 [808 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt amd64 1.6.13 [1201 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt-utils amd64 1.6.13 [206 kB]\nFetched 2216 kB in 1s (2596 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database . 2021-04-09T18:21:00.611 INFO:teuthology.task.ansible.out:.. 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137453 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg5.0_1.6.13_amd64.deb ...\r\nUnpacking libapt-pkg5.0:amd64 (1.6.13) over (1.6.12ubuntu0.2) ...\r\nSetting up libapt-pkg5.0:amd64 (1.6.13) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137453 files and directories currently installed.)\r\nPreparing to unpack .../archives/apt_1.6.13_amd64.deb ...\r\nUnpacking apt (1.6.13) over (1.6.12ubuntu0.2) ...\r\nSetting up apt (1.6.13) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading da 2021-04-09T18:21:00.613 INFO:teuthology.task.ansible.out:tabase ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137453 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_1.6.13_amd64.deb ...\r\nUnpacking apt-utils (1.6.13) over (1.6.12ubuntu0.2) ...\r\nSetting up apt-utils (1.6.13) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apt-utils libapt-pkg5.0", "Suggested packages:", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apt apt-utils libapt-pkg5.0", "3 upgraded, 0 newly installed, 0 to remove and 38 not upgraded.", "Need to get 2216 kB of archives.", "After this operation, 1024 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libapt-pkg5.0 amd64 1.6.13 [808 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt amd64 1.6.13 [1201 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt-utils am 2021-04-09T18:21:00.615 INFO:teuthology.task.ansible.out:d64 1.6.13 [206 kB]", "Fetched 2216 kB in 1s (2596 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137453 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg5.0_1.6.13_amd64.deb ...", "Unpacking libapt-pkg5.0:amd64 (1.6.13) over (1.6.12ubuntu0.2) ...", "Setting up libapt-pkg5.0:amd64 (1.6.13) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137453 files and directories currently installed.)", "Preparing to unpack .../archives/apt_1.6.13_amd64.deb ...", "Unpacking apt (1.6.13) over (1.6.12ubuntu0.2) ...", "Setting up apt (1.6.13) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40% 2021-04-09T18:21:00.616 INFO:teuthology.task.ansible.out:", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137453 files and directories currently installed.)", "Preparing to unpack .../apt-utils_1.6.13_amd64.deb ...", "Unpacking apt-utils (1.6.13) over (1.6.12ubuntu0.2) ...", "Setting up apt-utils (1.6.13) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-04-09T18:21:00.636 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:00 +0000 (0:00:00.091) 0:04:38.156 ********** 2021-04-09T18:21:00.647 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-04-09T18:21:00.649 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:00.687 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:00 +0000 (0:00:00.050) 0:04:38.206 ********** 2021-04-09T18:21:00.688 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:00.743 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:00.780 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:00 +0000 (0:00:00.092) 0:04:38.298 ********** 2021-04-09T18:21:02.839 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-04-09T18:21:02.841 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1617992386, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apt-utils libapt-pkg5.0\nSuggested packages:\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apt apt-utils libapt-pkg5.0\n3 upgraded, 0 newly installed, 0 to remove and 38 not upgraded.\nNeed to get 2216 kB of archives.\nAfter this operation, 1024 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libapt-pkg5.0 amd64 1.6.13 [808 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt amd64 1.6.13 [1201 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt-utils amd64 1.6.13 [206 kB]\nFetched 2216 kB in 1s (2617 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database . 2021-04-09T18:21:02.843 INFO:teuthology.task.ansible.out:.. 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137453 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg5.0_1.6.13_amd64.deb ...\r\nUnpacking libapt-pkg5.0:amd64 (1.6.13) over (1.6.12ubuntu0.2) ...\r\nSetting up libapt-pkg5.0:amd64 (1.6.13) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137453 files and directories currently installed.)\r\nPreparing to unpack .../archives/apt_1.6.13_amd64.deb ...\r\nUnpacking apt (1.6.13) over (1.6.12ubuntu0.2) ...\r\nSetting up apt (1.6.13) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading da 2021-04-09T18:21:02.844 INFO:teuthology.task.ansible.out:tabase ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137453 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_1.6.13_amd64.deb ...\r\nUnpacking apt-utils (1.6.13) over (1.6.12ubuntu0.2) ...\r\nSetting up apt-utils (1.6.13) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apt-utils libapt-pkg5.0", "Suggested packages:", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apt apt-utils libapt-pkg5.0", "3 upgraded, 0 newly installed, 0 to remove and 38 not upgraded.", "Need to get 2216 kB of archives.", "After this operation, 1024 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libapt-pkg5.0 amd64 1.6.13 [808 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt amd64 1.6.13 [1201 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt-utils am 2021-04-09T18:21:02.846 INFO:teuthology.task.ansible.out:d64 1.6.13 [206 kB]", "Fetched 2216 kB in 1s (2617 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137453 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg5.0_1.6.13_amd64.deb ...", "Unpacking libapt-pkg5.0:amd64 (1.6.13) over (1.6.12ubuntu0.2) ...", "Setting up libapt-pkg5.0:amd64 (1.6.13) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137453 files and directories currently installed.)", "Preparing to unpack .../archives/apt_1.6.13_amd64.deb ...", "Unpacking apt (1.6.13) over (1.6.12ubuntu0.2) ...", "Setting up apt (1.6.13) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40% 2021-04-09T18:21:02.848 INFO:teuthology.task.ansible.out:", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137453 files and directories currently installed.)", "Preparing to unpack .../apt-utils_1.6.13_amd64.deb ...", "Unpacking apt-utils (1.6.13) over (1.6.12ubuntu0.2) ...", "Setting up apt-utils (1.6.13) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-04-09T18:21:02.868 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:02 +0000 (0:00:02.089) 0:04:40.388 ********** 2021-04-09T18:21:02.942 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-04-09T18:21:02.944 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:02.971 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:02 +0000 (0:00:00.102) 0:04:40.491 ********** 2021-04-09T18:21:02.972 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:09.078 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-04-09T18:21:09.080 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git\n1 upgraded, 6 newly installed, 0 to remove and 37 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.36 [40.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.36 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 git amd64 1:2.17.1-1ubuntu0.8 [3916 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.36 [5176 kB]\nGet:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.36 [870 kB]\nFetched 14.3 MB in 1s (12.0 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database .. 2021-04-09T18:21:09.082 INFO:teuthology.task.ansible.out:. \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137453 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nPreparing to unpack .../4-git_1%3a2.17.1-1ubuntu0.8_amd64.deb ...\r\nUnpacking git (1:2.17.1-1ubuntu0.8) over (1:2.17.1-1ubuntu0.7) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up git (1:2.17.1-1ubuntu0.8) ...\r\nSetti 2021-04-09T18:21:09.084 INFO:teuthology.task.ansible.out:ng up librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git", "1 upgraded, 6 newly installed, 0 to remove and 37 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.36 [40.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.36 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 git amd64 1:2.17.1-1ubuntu0.8 [3916 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.36 [5176 kB]", "Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.1 2021-04-09T18:21:09.086 INFO:teuthology.task.ansible.out:1+dfsg-1ubuntu7.36 [870 kB]", "Fetched 14.3 MB in 1s (12.0 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137453 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Preparing to unpack .../4-git_1%3a2.17.1-1ubuntu0.8_amd64.deb ...", "Unpacking git (1:2.17.1-1ubuntu0.8) over (1:2.17.1-1ubuntu0.7) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ub 2021-04-09T18:21:09.087 INFO:teuthology.task.ansible.out:untu7.36_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up git (1:2.17.1-1ubuntu0.8) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-04-09T18:21:09.115 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:09 +0000 (0:00:06.141) 0:04:46.633 ********** 2021-04-09T18:21:09.606 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-04-09T18:21:09.608 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"cache_update_time": 1617992393, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apt-utils libapt-pkg5.0\nSuggested packages:\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apt apt-utils libapt-pkg5.0\n3 upgraded, 0 newly installed, 0 to remove and 38 not upgraded.\nNeed to get 2216 kB of archives.\nAfter this operation, 1024 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libapt-pkg5.0 amd64 1.6.13 [808 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt amd64 1.6.13 [1201 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt-utils amd64 1.6.13 [206 kB]\nFetched 2216 kB in 1s (2597 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database . 2021-04-09T18:21:09.610 INFO:teuthology.task.ansible.out:.. 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137453 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg5.0_1.6.13_amd64.deb ...\r\nUnpacking libapt-pkg5.0:amd64 (1.6.13) over (1.6.12ubuntu0.2) ...\r\nSetting up libapt-pkg5.0:amd64 (1.6.13) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137453 files and directories currently installed.)\r\nPreparing to unpack .../archives/apt_1.6.13_amd64.deb ...\r\nUnpacking apt (1.6.13) over (1.6.12ubuntu0.2) ...\r\nSetting up apt (1.6.13) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading da 2021-04-09T18:21:09.612 INFO:teuthology.task.ansible.out:tabase ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137453 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_1.6.13_amd64.deb ...\r\nUnpacking apt-utils (1.6.13) over (1.6.12ubuntu0.2) ...\r\nSetting up apt-utils (1.6.13) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apt-utils libapt-pkg5.0", "Suggested packages:", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apt apt-utils libapt-pkg5.0", "3 upgraded, 0 newly installed, 0 to remove and 38 not upgraded.", "Need to get 2216 kB of archives.", "After this operation, 1024 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libapt-pkg5.0 amd64 1.6.13 [808 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt amd64 1.6.13 [1201 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt-utils am 2021-04-09T18:21:09.614 INFO:teuthology.task.ansible.out:d64 1.6.13 [206 kB]", "Fetched 2216 kB in 1s (2597 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137453 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg5.0_1.6.13_amd64.deb ...", "Unpacking libapt-pkg5.0:amd64 (1.6.13) over (1.6.12ubuntu0.2) ...", "Setting up libapt-pkg5.0:amd64 (1.6.13) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137453 files and directories currently installed.)", "Preparing to unpack .../archives/apt_1.6.13_amd64.deb ...", "Unpacking apt (1.6.13) over (1.6.12ubuntu0.2) ...", "Setting up apt (1.6.13) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40% 2021-04-09T18:21:09.616 INFO:teuthology.task.ansible.out:", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137453 files and directories currently installed.)", "Preparing to unpack .../apt-utils_1.6.13_amd64.deb ...", "Unpacking apt-utils (1.6.13) over (1.6.12ubuntu0.2) ...", "Setting up apt-utils (1.6.13) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-04-09T18:21:09.636 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:09 +0000 (0:00:00.522) 0:04:47.155 ********** 2021-04-09T18:21:09.727 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:09.750 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:09 +0000 (0:00:00.114) 0:04:47.269 ********** 2021-04-09T18:21:10.086 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* ok: [smithi079.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:21:10.120 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:10 +0000 (0:00:00.369) 0:04:47.639 ********** 2021-04-09T18:21:11.050 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-04-09T18:21:11.052 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git\n1 upgraded, 6 newly installed, 0 to remove and 37 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.36 [40.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.36 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 git amd64 1:2.17.1-1ubuntu0.8 [3916 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.36 [5176 kB]\nGet:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.36 [870 kB]\nFetched 14.3 MB in 1s (11.9 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database .. 2021-04-09T18:21:11.054 INFO:teuthology.task.ansible.out:. \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137453 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nPreparing to unpack .../4-git_1%3a2.17.1-1ubuntu0.8_amd64.deb ...\r\nUnpacking git (1:2.17.1-1ubuntu0.8) over (1:2.17.1-1ubuntu0.7) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up git (1:2.17.1-1ubuntu0.8) ...\r\nSetti 2021-04-09T18:21:11.055 INFO:teuthology.task.ansible.out:ng up librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git", "1 upgraded, 6 newly installed, 0 to remove and 37 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.36 [40.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.36 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 git amd64 1:2.17.1-1ubuntu0.8 [3916 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.36 [5176 kB]", "Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.1 2021-04-09T18:21:11.065 INFO:teuthology.task.ansible.out:1+dfsg-1ubuntu7.36 [870 kB]", "Fetched 14.3 MB in 1s (11.9 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137453 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Preparing to unpack .../4-git_1%3a2.17.1-1ubuntu0.8_amd64.deb ...", "Unpacking git (1:2.17.1-1ubuntu0.8) over (1:2.17.1-1ubuntu0.7) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ub 2021-04-09T18:21:11.067 INFO:teuthology.task.ansible.out:untu7.36_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up git (1:2.17.1-1ubuntu0.8) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-04-09T18:21:11.097 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:11 +0000 (0:00:00.976) 0:04:48.616 ********** 2021-04-09T18:21:11.106 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-04-09T18:21:11.108 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:21:11.134 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:11 +0000 (0:00:00.037) 0:04:48.653 ********** 2021-04-09T18:21:11.444 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-04-09T18:21:11.446 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-04-09T18:21:11.470 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:11 +0000 (0:00:00.336) 0:04:48.990 ********** 2021-04-09T18:21:11.512 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-04-09T18:21:11.514 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"cache_update_time": 1617992385, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git\n1 upgraded, 6 newly installed, 0 to remove and 37 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.36 [40.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.36 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 git amd64 1:2.17.1-1ubuntu0.8 [3916 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.36 [5176 kB]\nGet:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.36 [870 kB]\nFetched 14.3 MB in 1s (10.8 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database .. 2021-04-09T18:21:11.516 INFO:teuthology.task.ansible.out:. \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137453 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nPreparing to unpack .../4-git_1%3a2.17.1-1ubuntu0.8_amd64.deb ...\r\nUnpacking git (1:2.17.1-1ubuntu0.8) over (1:2.17.1-1ubuntu0.7) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up git (1:2.17.1-1ubuntu0.8) ...\r\nSetti 2021-04-09T18:21:11.517 INFO:teuthology.task.ansible.out:ng up librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git", "1 upgraded, 6 newly installed, 0 to remove and 37 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.36 [40.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.36 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 git amd64 1:2.17.1-1ubuntu0.8 [3916 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.36 [5176 kB]", "Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.1 2021-04-09T18:21:11.519 INFO:teuthology.task.ansible.out:1+dfsg-1ubuntu7.36 [870 kB]", "Fetched 14.3 MB in 1s (10.8 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137453 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Preparing to unpack .../4-git_1%3a2.17.1-1ubuntu0.8_amd64.deb ...", "Unpacking git (1:2.17.1-1ubuntu0.8) over (1:2.17.1-1ubuntu0.7) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ub 2021-04-09T18:21:11.520 INFO:teuthology.task.ansible.out:untu7.36_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up git (1:2.17.1-1ubuntu0.8) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-04-09T18:21:11.586 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:11 +0000 (0:00:00.114) 0:04:49.104 ********** 2021-04-09T18:21:11.663 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-04-09T18:21:11.665 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:11.693 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:11 +0000 (0:00:00.107) 0:04:49.212 ********** 2021-04-09T18:21:11.966 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-04-09T18:21:11.968 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-04-09T18:21:12.004 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:12 +0000 (0:00:00.311) 0:04:49.524 ********** 2021-04-09T18:21:12.137 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-04-09T18:21:12.139 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:21:12.226 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:12 +0000 (0:00:00.220) 0:04:49.745 ********** 2021-04-09T18:21:12.513 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-04-09T18:21:12.515 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-04-09T18:21:12.577 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:12 +0000 (0:00:00.351) 0:04:50.096 ********** 2021-04-09T18:21:12.578 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:12.643 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-04-09T18:21:12.645 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"cache_update_time": 1617992385, "cache_updated": false, "changed": false} 2021-04-09T18:21:12.703 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:12 +0000 (0:00:00.126) 0:04:50.223 ********** 2021-04-09T18:21:12.889 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi079.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-04-09T18:21:12.940 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:12 +0000 (0:00:00.236) 0:04:50.459 ********** 2021-04-09T18:21:12.941 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:13.190 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi079.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:21:13.215 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:13 +0000 (0:00:00.274) 0:04:50.734 ********** 2021-04-09T18:21:13.303 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** ok: [smithi089.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:21:13.347 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:13 +0000 (0:00:00.132) 0:04:50.867 ********** 2021-04-09T18:21:13.349 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:13.648 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-04-09T18:21:13.650 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-04-09T18:21:13.690 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:13 +0000 (0:00:00.343) 0:04:51.210 ********** 2021-04-09T18:21:13.713 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-04-09T18:21:13.716 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2021-04-09 18:14:46 UTC", "ActiveEnterTimestampMonotonic": "20037311", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount systemd-tmpfiles-setup.service basic.target system.slice network.target remote-fs.target nss-lookup.target sysinit.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-04-09 18:14:46 UTC", "AssertTimestampMonotonic": "19641849", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-04-09 18:14:46 UTC", "ConditionTimestampMonotonic": "19641849", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2021-04-09T18:21:13.718 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1397", "ExecMainStartTimestamp": "Fri 2021-04-09 18:14:46 UTC", "ExecMainStartTimestampMonotonic": "20037300", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-04-09 18:14:46 UTC", "InactiveExitTimestampMonotonic": "19642705", "InvocationID": "39c8df61e8a2490dbae2edcad9a10292", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2021-04-09T18:21:13.720 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1397", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2021-04-09T18:21:13.721 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-04-09 18:14:46 UTC", "StateChangeTimestampMonotonic": "20037311", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-04-09 18:14:46 UTC", "WatchdogTimestampMonotonic": "20037310", "WatchdogUSec": "0"}} 2021-04-09T18:21:13.752 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:13 +0000 (0:00:00.061) 0:04:51.271 ********** 2021-04-09T18:21:13.780 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-04-09T18:21:13.782 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"cache_update_time": 1617992385, "cache_updated": false, "changed": false} 2021-04-09T18:21:13.814 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:13 +0000 (0:00:00.062) 0:04:51.334 ********** 2021-04-09T18:21:13.823 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-04-09T18:21:13.825 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:13.869 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:13 +0000 (0:00:00.054) 0:04:51.388 ********** 2021-04-09T18:21:13.937 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-04-09T18:21:13.939 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:13.983 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:13 +0000 (0:00:00.114) 0:04:51.503 ********** 2021-04-09T18:21:14.017 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-04-09T18:21:14.018 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1617992386, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git\n1 upgraded, 6 newly installed, 0 to remove and 37 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.36 [40.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.36 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 git amd64 1:2.17.1-1ubuntu0.8 [3916 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.36 [5176 kB]\nGet:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.36 [870 kB]\nFetched 14.3 MB in 1s (11.9 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database .. 2021-04-09T18:21:14.020 INFO:teuthology.task.ansible.out:. \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137453 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nPreparing to unpack .../4-git_1%3a2.17.1-1ubuntu0.8_amd64.deb ...\r\nUnpacking git (1:2.17.1-1ubuntu0.8) over (1:2.17.1-1ubuntu0.7) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up git (1:2.17.1-1ubuntu0.8) ...\r\nSetti 2021-04-09T18:21:14.022 INFO:teuthology.task.ansible.out:ng up librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git", "1 upgraded, 6 newly installed, 0 to remove and 37 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.36 [40.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.36 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 git amd64 1:2.17.1-1ubuntu0.8 [3916 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.36 [5176 kB]", "Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.1 2021-04-09T18:21:14.024 INFO:teuthology.task.ansible.out:1+dfsg-1ubuntu7.36 [870 kB]", "Fetched 14.3 MB in 1s (11.9 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137453 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Preparing to unpack .../4-git_1%3a2.17.1-1ubuntu0.8_amd64.deb ...", "Unpacking git (1:2.17.1-1ubuntu0.8) over (1:2.17.1-1ubuntu0.7) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ub 2021-04-09T18:21:14.025 INFO:teuthology.task.ansible.out:untu7.36_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up git (1:2.17.1-1ubuntu0.8) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-04-09T18:21:14.058 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:14 +0000 (0:00:00.074) 0:04:51.577 ********** 2021-04-09T18:21:14.072 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-04-09T18:21:14.074 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-04-09T18:21:14.110 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:14 +0000 (0:00:00.052) 0:04:51.629 ********** 2021-04-09T18:21:14.168 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-04-09T18:21:14.170 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-04-09T18:21:14.214 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:14 +0000 (0:00:00.103) 0:04:51.733 ********** 2021-04-09T18:21:14.226 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-04-09T18:21:14.228 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:14.255 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:14 +0000 (0:00:00.041) 0:04:51.775 ********** 2021-04-09T18:21:14.263 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-04-09T18:21:14.265 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:14.303 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:14 +0000 (0:00:00.047) 0:04:51.822 ********** 2021-04-09T18:21:14.403 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-04-09T18:21:14.405 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:14.429 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:14 +0000 (0:00:00.126) 0:04:51.949 ********** 2021-04-09T18:21:14.512 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:14.536 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:14 +0000 (0:00:00.106) 0:04:52.056 ********** 2021-04-09T18:21:14.554 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-04-09T18:21:14.556 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-04-09T18:21:14.591 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:14 +0000 (0:00:00.054) 0:04:52.110 ********** 2021-04-09T18:21:14.705 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-04-09T18:21:14.707 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:14.745 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:14 +0000 (0:00:00.154) 0:04:52.264 ********** 2021-04-09T18:21:14.861 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-04-09T18:21:14.863 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-04-09T18:21:14.906 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:14 +0000 (0:00:00.160) 0:04:52.425 ********** 2021-04-09T18:21:14.927 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:14.928 INFO:teuthology.task.ansible.out:TASK [testnode : Rebuild rpmdb] ************************************************ 2021-04-09T18:21:14.928 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:14.968 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:14 +0000 (0:00:00.062) 0:04:52.488 ********** 2021-04-09T18:21:15.109 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-04-09T18:21:15.112 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1617992386, "cache_updated": false, "changed": false} 2021-04-09T18:21:15.150 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:15 +0000 (0:00:00.181) 0:04:52.669 ********** 2021-04-09T18:21:15.162 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:15.164 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-04-09T18:21:15.165 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:15.165 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:15.243 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:15 +0000 (0:00:00.093) 0:04:52.762 ********** 2021-04-09T18:21:15.247 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:15.309 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-04-09T18:21:15.311 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} TASK [testnode : Upload /etc/fuse.conf.] *************************************** ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-04-09T18:21:15.364 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:15 +0000 (0:00:00.119) 0:04:52.882 ********** 2021-04-09T18:21:15.427 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:15 +0000 (0:00:00.064) 0:04:52.946 ********** 2021-04-09T18:21:15.462 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-04-09T18:21:15.464 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:15.521 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:15 +0000 (0:00:00.094) 0:04:53.040 ********** 2021-04-09T18:21:15.720 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-04-09T18:21:15.723 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : set_fact] ***************************************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:15.772 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:15 +0000 (0:00:00.251) 0:04:53.292 ********** 2021-04-09T18:21:15.816 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:15 +0000 (0:00:00.043) 0:04:53.335 ********** 2021-04-09T18:21:15.831 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-04-09T18:21:15.832 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-04-09T18:21:15.890 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:15 +0000 (0:00:00.074) 0:04:53.410 ********** 2021-04-09T18:21:15.919 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-04-09T18:21:15.921 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:15.946 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:15 +0000 (0:00:00.055) 0:04:53.465 ********** 2021-04-09T18:21:16.060 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-04-09T18:21:16.062 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:16.085 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:16 +0000 (0:00:00.138) 0:04:53.604 ********** 2021-04-09T18:21:16.092 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:16.129 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-04-09T18:21:16.131 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1617992386, "cache_updated": false, "changed": false} 2021-04-09T18:21:16.204 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:16 +0000 (0:00:00.119) 0:04:53.723 ********** 2021-04-09T18:21:16.209 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:16.247 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi090.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:16.302 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:16 +0000 (0:00:00.097) 0:04:53.821 ********** 2021-04-09T18:21:16.387 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:16 +0000 (0:00:00.084) 0:04:53.906 ********** 2021-04-09T18:21:16.407 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-04-09T18:21:16.412 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2021-04-09 18:14:46 UTC", "ActiveEnterTimestampMonotonic": "17859057", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target systemd-journald.socket basic.target -.mount sysinit.target network.target nss-lookup.target systemd-tmpfiles-setup.service system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-04-09 18:14:46 UTC", "AssertTimestampMonotonic": "17402799", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-04-09 18:14:46 UTC", "ConditionTimestampMonotonic": "17402799", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2021-04-09T18:21:16.414 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1397", "ExecMainStartTimestamp": "Fri 2021-04-09 18:14:46 UTC", "ExecMainStartTimestampMonotonic": "17859046", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-04-09 18:14:46 UTC", "InactiveExitTimestampMonotonic": "17403654", "InvocationID": "021745b126d2474f847e7642fe4a1e1c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2021-04-09T18:21:16.415 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128028", "LimitNPROCSoft": "128028", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128028", "LimitSIGPENDINGSoft": "128028", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1397", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2021-04-09T18:21:16.417 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-04-09 18:14:46 UTC", "StateChangeTimestampMonotonic": "17859057", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-04-09 18:14:46 UTC", "WatchdogTimestampMonotonic": "17859056", "WatchdogUSec": "0"}} 2021-04-09T18:21:16.462 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:16 +0000 (0:00:00.074) 0:04:53.981 ********** 2021-04-09T18:21:16.487 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-04-09T18:21:16.488 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:16.536 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:16 +0000 (0:00:00.073) 0:04:54.055 ********** 2021-04-09T18:21:16.556 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:16.559 INFO:teuthology.task.ansible.out:TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-04-09T18:21:16.627 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:16 +0000 (0:00:00.091) 0:04:54.147 ********** 2021-04-09T18:21:16.636 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:16.638 INFO:teuthology.task.ansible.out:TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:16.670 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:16 +0000 (0:00:00.042) 0:04:54.189 ********** 2021-04-09T18:21:16.671 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:16.701 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:16.703 INFO:teuthology.task.ansible.out:TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:16.744 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:16 +0000 (0:00:00.074) 0:04:54.264 ********** 2021-04-09T18:21:16.766 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-04-09T18:21:16.769 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:16.816 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:16 +0000 (0:00:00.070) 0:04:54.334 ********** 2021-04-09T18:21:16.826 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-04-09T18:21:16.829 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:16.859 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:16 +0000 (0:00:00.043) 0:04:54.378 ********** 2021-04-09T18:21:16.870 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-04-09T18:21:16.871 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:16.874 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-04-09T18:21:16.877 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2021-04-09 18:15:18 UTC", "ActiveEnterTimestampMonotonic": "23111870", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target remote-fs.target system.slice basic.target -.mount systemd-journald.socket nss-lookup.target sysinit.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-04-09 18:15:18 UTC", "AssertTimestampMonotonic": "22620819", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-04-09 18:15:18 UTC", "ConditionTimestampMonotonic": "22620818", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2021-04-09T18:21:16.879 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1422", "ExecMainStartTimestamp": "Fri 2021-04-09 18:15:18 UTC", "ExecMainStartTimestampMonotonic": "23111843", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-04-09 18:15:18 UTC", "InactiveExitTimestampMonotonic": "22623324", "InvocationID": "043252a4afdb42628ba5777eebc87fd6", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2021-04-09T18:21:16.880 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128028", "LimitNPROCSoft": "128028", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128028", "LimitSIGPENDINGSoft": "128028", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1422", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2021-04-09T18:21:16.882 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-04-09 18:15:18 UTC", "StateChangeTimestampMonotonic": "23111870", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-04-09 18:15:18 UTC", "WatchdogTimestampMonotonic": "23111868", "WatchdogUSec": "0"}} 2021-04-09T18:21:16.959 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:16 +0000 (0:00:00.100) 0:04:54.479 ********** 2021-04-09T18:21:17.034 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:17 +0000 (0:00:00.074) 0:04:54.553 ********** 2021-04-09T18:21:17.060 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-04-09T18:21:17.062 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:17.130 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:17 +0000 (0:00:00.091) 0:04:54.644 ********** 2021-04-09T18:21:17.147 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:17.205 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:17 +0000 (0:00:00.080) 0:04:54.725 ********** 2021-04-09T18:21:17.225 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:17.278 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:17 +0000 (0:00:00.072) 0:04:54.797 ********** 2021-04-09T18:21:17.289 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-04-09T18:21:17.291 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:17.331 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:17 +0000 (0:00:00.053) 0:04:54.850 ********** 2021-04-09T18:21:17.343 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-04-09T18:21:17.344 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:17.415 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:17 +0000 (0:00:00.083) 0:04:54.934 ********** 2021-04-09T18:21:17.441 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:17.511 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:17 +0000 (0:00:00.096) 0:04:55.030 ********** 2021-04-09T18:21:17.523 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-04-09T18:21:17.525 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:17.556 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:17 +0000 (0:00:00.044) 0:04:55.075 ********** 2021-04-09T18:21:17.611 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-04-09T18:21:17.612 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:17.653 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:17 +0000 (0:00:00.097) 0:04:55.172 ********** 2021-04-09T18:21:17.696 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-04-09T18:21:17.698 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:17.741 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:17 +0000 (0:00:00.086) 0:04:55.259 ********** 2021-04-09T18:21:17.752 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-04-09T18:21:17.754 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:17.795 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:17 +0000 (0:00:00.055) 0:04:55.315 ********** 2021-04-09T18:21:17.821 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-04-09T18:21:17.822 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:17.872 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:17 +0000 (0:00:00.076) 0:04:55.391 ********** 2021-04-09T18:21:17.918 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-04-09T18:21:17.920 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:17.959 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:17 +0000 (0:00:00.080) 0:04:55.471 ********** 2021-04-09T18:21:17.966 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-04-09T18:21:17.968 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:18.029 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:18 +0000 (0:00:00.077) 0:04:55.549 ********** 2021-04-09T18:21:18.031 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:18.084 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:18 +0000 (0:00:00.054) 0:04:55.603 ********** 2021-04-09T18:21:18.095 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-04-09T18:21:18.097 INFO:teuthology.task.ansible.out: skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:18.145 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:18 +0000 (0:00:00.061) 0:04:55.664 ********** 2021-04-09T18:21:18.214 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-04-09T18:21:18.216 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:18.263 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:18 +0000 (0:00:00.109) 0:04:55.773 ********** 2021-04-09T18:21:18.288 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-04-09T18:21:18.290 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:18.336 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:18 +0000 (0:00:00.082) 0:04:55.856 ********** 2021-04-09T18:21:18.347 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-04-09T18:21:18.350 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:18.391 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:18 +0000 (0:00:00.054) 0:04:55.910 ********** 2021-04-09T18:21:18.423 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:18.425 INFO:teuthology.task.ansible.out:TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:18.510 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:18 +0000 (0:00:00.119) 0:04:56.029 ********** 2021-04-09T18:21:18.524 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:18.530 INFO:teuthology.task.ansible.out:TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-04-09T18:21:18.531 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-04-09T18:21:18.533 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:18.539 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:18.595 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:18 +0000 (0:00:00.084) 0:04:56.114 ********** 2021-04-09T18:21:18.690 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:18 +0000 (0:00:00.094) 0:04:56.209 ********** 2021-04-09T18:21:18.706 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-04-09T18:21:18.707 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:18.776 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:18 +0000 (0:00:00.086) 0:04:56.296 ********** 2021-04-09T18:21:18.785 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:18.792 INFO:teuthology.task.ansible.out:TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-04-09T18:21:18.794 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:18.825 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:18 +0000 (0:00:00.048) 0:04:56.344 ********** 2021-04-09T18:21:18.849 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:18 +0000 (0:00:00.024) 0:04:56.369 ********** 2021-04-09T18:21:18.851 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:18.891 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-04-09T18:21:18.894 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:18.917 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:18 +0000 (0:00:00.068) 0:04:56.437 ********** 2021-04-09T18:21:19.002 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:19.038 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:19 +0000 (0:00:00.120) 0:04:56.558 ********** 2021-04-09T18:21:19.061 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-04-09T18:21:19.063 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:19.101 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:19 +0000 (0:00:00.061) 0:04:56.620 ********** 2021-04-09T18:21:19.112 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-04-09T18:21:19.114 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Install packages] ********************************************* 2021-04-09T18:21:19.115 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:19.179 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:19 +0000 (0:00:00.078) 0:04:56.698 ********** 2021-04-09T18:21:19.212 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:19 +0000 (0:00:00.032) 0:04:56.731 ********** 2021-04-09T18:21:19.230 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:19.232 INFO:teuthology.task.ansible.out:TASK [testnode : set_fact] ***************************************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:19.276 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:19 +0000 (0:00:00.064) 0:04:56.796 ********** 2021-04-09T18:21:19.352 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:19 +0000 (0:00:00.075) 0:04:56.871 ********** 2021-04-09T18:21:19.416 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-04-09T18:21:19.419 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:19.484 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:19 +0000 (0:00:00.132) 0:04:57.004 ********** 2021-04-09T18:21:19.495 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:19.551 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-04-09T18:21:19.553 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:19.596 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:19 +0000 (0:00:00.111) 0:04:57.116 ********** 2021-04-09T18:21:19.621 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-04-09T18:21:19.623 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:19.681 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:19 +0000 (0:00:00.084) 0:04:57.200 ********** 2021-04-09T18:21:19.726 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-04-09T18:21:19.728 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:19.781 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:19 +0000 (0:00:00.100) 0:04:57.301 ********** 2021-04-09T18:21:19.800 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-04-09T18:21:19.804 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2021-04-09 18:15:07 UTC", "ActiveEnterTimestampMonotonic": "20533052", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target systemd-journald.socket sysinit.target -.mount systemd-tmpfiles-setup.service remote-fs.target network.target system.slice basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-04-09 18:15:06 UTC", "AssertTimestampMonotonic": "20054178", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-04-09 18:15:06 UTC", "ConditionTimestampMonotonic": "20054178", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2021-04-09T18:21:19.806 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.servi 2021-04-09T18:21:19.807 INFO:teuthology.task.ansible.out:ce.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1479", "ExecMainStartTimestamp": "Fri 2021-04-09 18:15:07 UTC", "ExecMainStartTimestampMonotonic": "20533032", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-04-09 18:15:06 UTC", "InactiveExitTimestampMonotonic": "20055151", "InvocationID": "4271f25a1e6145e6b3d59ef598fec9ce", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "Limit 2021-04-09T18:21:19.809 INFO:teuthology.task.ansible.out:LOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1479", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "syst 2021-04-09T18:21:19.811 INFO:teuthology.task.ansible.out:em.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-04-09 18:15:07 UTC", "StateChangeTimestampMonotonic": "20533052", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-04-09 18:15:07 UTC", "WatchdogTimestampMonotonic": "20533051", "WatchdogUSec": "0"}} 2021-04-09T18:21:19.818 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-04-09T18:21:19.822 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:19.849 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:19 +0000 (0:00:00.068) 0:04:57.369 ********** 2021-04-09T18:21:19.907 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:19 +0000 (0:00:00.056) 0:04:57.426 ********** 2021-04-09T18:21:19.925 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-04-09T18:21:19.938 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:19.992 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:19 +0000 (0:00:00.083) 0:04:57.511 ********** 2021-04-09T18:21:20.293 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-04-09T18:21:20.295 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:20.321 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:20 +0000 (0:00:00.327) 0:04:57.838 ********** 2021-04-09T18:21:20.347 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-04-09T18:21:20.349 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:20.433 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:20 +0000 (0:00:00.113) 0:04:57.951 ********** 2021-04-09T18:21:20.444 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-04-09T18:21:20.457 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-04-09T18:21:20.459 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:20.463 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:20.465 INFO:teuthology.task.ansible.out:TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-04-09T18:21:20.467 INFO:teuthology.task.ansible.out: skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:20.469 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:20.471 INFO:teuthology.task.ansible.out:TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:20.511 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:20 +0000 (0:00:00.079) 0:04:58.031 ********** 2021-04-09T18:21:20.551 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:20 +0000 (0:00:00.039) 0:04:58.070 ********** 2021-04-09T18:21:20.575 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:20 +0000 (0:00:00.024) 0:04:58.094 ********** 2021-04-09T18:21:20.594 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:20.648 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:20 +0000 (0:00:00.065) 0:04:58.160 ********** 2021-04-09T18:21:20.698 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:20.699 INFO:teuthology.task.ansible.out:TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-04-09T18:21:20.701 INFO:teuthology.task.ansible.out: skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:20.762 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:20 +0000 (0:00:00.121) 0:04:58.282 ********** 2021-04-09T18:21:20.777 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:20.837 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:20 +0000 (0:00:00.074) 0:04:58.357 ********** 2021-04-09T18:21:20.948 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-04-09T18:21:20.950 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:20.981 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:20 +0000 (0:00:00.143) 0:04:58.500 ********** 2021-04-09T18:21:21.043 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-04-09T18:21:21.045 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"cache_update_time": 1617992393, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git\n1 upgraded, 6 newly installed, 0 to remove and 37 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.36 [40.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.36 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 git amd64 1:2.17.1-1ubuntu0.8 [3916 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.36 [5176 kB]\nGet:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.36 [870 kB]\nFetched 14.3 MB in 1s (11.9 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database .. 2021-04-09T18:21:21.047 INFO:teuthology.task.ansible.out:. \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137453 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nPreparing to unpack .../4-git_1%3a2.17.1-1ubuntu0.8_amd64.deb ...\r\nUnpacking git (1:2.17.1-1ubuntu0.8) over (1:2.17.1-1ubuntu0.7) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up git (1:2.17.1-1ubuntu0.8) ...\r\nSetti 2021-04-09T18:21:21.049 INFO:teuthology.task.ansible.out:ng up librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git", "1 upgraded, 6 newly installed, 0 to remove and 37 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.36 [40.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.36 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 git amd64 1:2.17.1-1ubuntu0.8 [3916 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.36 [5176 kB]", "Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.1 2021-04-09T18:21:21.051 INFO:teuthology.task.ansible.out:1+dfsg-1ubuntu7.36 [870 kB]", "Fetched 14.3 MB in 1s (11.9 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137453 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Preparing to unpack .../4-git_1%3a2.17.1-1ubuntu0.8_amd64.deb ...", "Unpacking git (1:2.17.1-1ubuntu0.8) over (1:2.17.1-1ubuntu0.7) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ub 2021-04-09T18:21:21.053 INFO:teuthology.task.ansible.out:untu7.36_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up git (1:2.17.1-1ubuntu0.8) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-04-09T18:21:21.097 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:21 +0000 (0:00:00.115) 0:04:58.616 ********** 2021-04-09T18:21:21.231 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-04-09T18:21:21.233 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-04-09T18:21:21.263 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:21 +0000 (0:00:00.166) 0:04:58.782 ********** 2021-04-09T18:21:21.285 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-04-09T18:21:21.286 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:21.289 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:21.333 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:21 +0000 (0:00:00.070) 0:04:58.852 ********** 2021-04-09T18:21:21.344 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:21.346 INFO:teuthology.task.ansible.out:TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:21.409 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:21 +0000 (0:00:00.075) 0:04:58.928 ********** 2021-04-09T18:21:21.438 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-04-09T18:21:21.440 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:21.514 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:21 +0000 (0:00:00.105) 0:04:59.034 ********** 2021-04-09T18:21:21.599 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-04-09T18:21:21.601 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:21.840 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:21 +0000 (0:00:00.325) 0:04:59.359 ********** 2021-04-09T18:21:21.855 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-04-09T18:21:21.857 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:21.901 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:21 +0000 (0:00:00.060) 0:04:59.420 ********** 2021-04-09T18:21:21.948 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:21 +0000 (0:00:00.047) 0:04:59.467 ********** 2021-04-09T18:21:21.971 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-04-09T18:21:21.974 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:22.029 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:22 +0000 (0:00:00.081) 0:04:59.548 ********** 2021-04-09T18:21:22.046 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-04-09T18:21:22.048 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:22.116 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:22 +0000 (0:00:00.087) 0:04:59.636 ********** 2021-04-09T18:21:22.130 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:22.166 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:22 +0000 (0:00:00.049) 0:04:59.685 ********** 2021-04-09T18:21:22.170 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:22.241 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:22.309 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:22 +0000 (0:00:00.143) 0:04:59.829 ********** 2021-04-09T18:21:22.320 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-04-09T18:21:22.322 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:22.378 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:22 +0000 (0:00:00.068) 0:04:59.897 ********** 2021-04-09T18:21:22.425 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:22 +0000 (0:00:00.046) 0:04:59.944 ********** 2021-04-09T18:21:22.439 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-04-09T18:21:22.441 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:22.516 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:22 +0000 (0:00:00.091) 0:05:00.036 ********** 2021-04-09T18:21:22.528 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-04-09T18:21:22.530 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-04-09T18:21:22.530 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:22.532 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* ok: [smithi144.front.sepia.ceph.com] => {"cache_update_time": 1617992393, "cache_updated": false, "changed": false} 2021-04-09T18:21:22.570 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:22 +0000 (0:00:00.054) 0:05:00.090 ********** 2021-04-09T18:21:22.603 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:22 +0000 (0:00:00.032) 0:05:00.122 ********** 2021-04-09T18:21:22.665 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:22 +0000 (0:00:00.061) 0:05:00.184 ********** 2021-04-09T18:21:22.678 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:22.680 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:22.737 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:22 +0000 (0:00:00.072) 0:05:00.256 ********** 2021-04-09T18:21:22.785 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:22 +0000 (0:00:00.048) 0:05:00.305 ********** 2021-04-09T18:21:22.820 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:22.867 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:22 +0000 (0:00:00.081) 0:05:00.386 ********** 2021-04-09T18:21:22.892 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-04-09T18:21:22.894 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:22.923 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:22 +0000 (0:00:00.056) 0:05:00.442 ********** 2021-04-09T18:21:22.942 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:22.946 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:22.972 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:22 +0000 (0:00:00.049) 0:05:00.491 ********** 2021-04-09T18:21:22.992 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-04-09T18:21:22.994 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:23.029 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:23 +0000 (0:00:00.057) 0:05:00.549 ********** 2021-04-09T18:21:23.066 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-04-09T18:21:23.068 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:23.121 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:23 +0000 (0:00:00.091) 0:05:00.640 ********** 2021-04-09T18:21:23.134 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-04-09T18:21:23.136 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:23.176 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:23 +0000 (0:00:00.054) 0:05:00.695 ********** 2021-04-09T18:21:23.188 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-04-09T18:21:23.189 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:23.227 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:23 +0000 (0:00:00.051) 0:05:00.747 ********** 2021-04-09T18:21:23.241 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-04-09T18:21:23.243 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-04-09T18:21:23.295 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:23 +0000 (0:00:00.067) 0:05:00.814 ********** 2021-04-09T18:21:23.307 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-04-09T18:21:23.309 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:23.355 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:23 +0000 (0:00:00.059) 0:05:00.874 ********** 2021-04-09T18:21:23.373 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:23.412 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:23 +0000 (0:00:00.056) 0:05:00.930 ********** 2021-04-09T18:21:23.436 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:23 +0000 (0:00:00.025) 0:05:00.956 ********** 2021-04-09T18:21:23.487 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-04-09T18:21:23.489 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:23.513 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:23 +0000 (0:00:00.076) 0:05:01.032 ********** 2021-04-09T18:21:23.542 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-04-09T18:21:23.544 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:23.581 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:23 +0000 (0:00:00.068) 0:05:01.100 ********** 2021-04-09T18:21:23.620 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:23 +0000 (0:00:00.038) 0:05:01.139 ********** 2021-04-09T18:21:23.632 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:23.673 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:23 +0000 (0:00:00.053) 0:05:01.193 ********** 2021-04-09T18:21:23.675 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:23.719 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-04-09T18:21:23.721 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"cache_update_time": 1617992393, "cache_updated": false, "changed": false} 2021-04-09T18:21:23.757 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:23 +0000 (0:00:00.083) 0:05:01.276 ********** 2021-04-09T18:21:23.766 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-04-09T18:21:23.768 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:23.804 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:23 +0000 (0:00:00.047) 0:05:01.324 ********** 2021-04-09T18:21:23.817 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-04-09T18:21:23.819 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:23.879 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:23 +0000 (0:00:00.074) 0:05:01.399 ********** 2021-04-09T18:21:23.886 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-04-09T18:21:23.888 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-04-09T18:21:23.927 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:23 +0000 (0:00:00.047) 0:05:01.446 ********** 2021-04-09T18:21:23.970 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:23 +0000 (0:00:00.042) 0:05:01.489 ********** 2021-04-09T18:21:23.984 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-04-09T18:21:23.986 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:24.028 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:24 +0000 (0:00:00.058) 0:05:01.547 ********** 2021-04-09T18:21:24.048 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-04-09T18:21:24.050 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:24.051 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-04-09T18:21:24.099 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:24 +0000 (0:00:00.071) 0:05:01.619 ********** 2021-04-09T18:21:24.131 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:24 +0000 (0:00:00.030) 0:05:01.649 ********** 2021-04-09T18:21:24.139 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:24.179 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:24 +0000 (0:00:00.049) 0:05:01.698 ********** 2021-04-09T18:21:24.188 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-04-09T18:21:24.190 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:21:24.225 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:24 +0000 (0:00:00.045) 0:05:01.744 ********** 2021-04-09T18:21:24.241 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:24.276 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:24 +0000 (0:00:00.051) 0:05:01.795 ********** 2021-04-09T18:21:24.327 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:24 +0000 (0:00:00.050) 0:05:01.846 ********** 2021-04-09T18:21:24.342 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:24.345 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:24.380 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:24 +0000 (0:00:00.053) 0:05:01.900 ********** 2021-04-09T18:21:24.422 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:24 +0000 (0:00:00.041) 0:05:01.941 ********** 2021-04-09T18:21:24.429 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-04-09T18:21:24.431 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:24.467 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:24 +0000 (0:00:00.037) 0:05:01.979 ********** 2021-04-09T18:21:24.522 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-04-09T18:21:24.524 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-04-09T18:21:24.566 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:24 +0000 (0:00:00.106) 0:05:02.086 ********** 2021-04-09T18:21:24.604 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:24 +0000 (0:00:00.037) 0:05:02.124 ********** 2021-04-09T18:21:24.622 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-04-09T18:21:24.622 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-04-09T18:21:24.624 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:24.664 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:24 +0000 (0:00:00.060) 0:05:02.184 ********** 2021-04-09T18:21:24.722 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:24 +0000 (0:00:00.057) 0:05:02.241 ********** 2021-04-09T18:21:24.825 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} Friday 09 April 2021 18:21:24 +0000 (0:00:00.055) 0:05:02.297 ********** Friday 09 April 2021 18:21:24 +0000 (0:00:00.035) 0:05:02.333 ********** 2021-04-09T18:21:24.829 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-04-09T18:21:24.831 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:24.887 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:24 +0000 (0:00:00.073) 0:05:02.407 ********** 2021-04-09T18:21:24.924 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:24 +0000 (0:00:00.036) 0:05:02.443 ********** 2021-04-09T18:21:24.933 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-04-09T18:21:24.935 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:24.962 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:24 +0000 (0:00:00.038) 0:05:02.481 ********** 2021-04-09T18:21:25.004 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:25.046 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:25 +0000 (0:00:00.084) 0:05:02.566 ********** 2021-04-09T18:21:25.066 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-04-09T18:21:25.069 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:25.107 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:25 +0000 (0:00:00.060) 0:05:02.627 ********** 2021-04-09T18:21:25.167 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:25.200 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:25 +0000 (0:00:00.092) 0:05:02.720 ********** 2021-04-09T18:21:25.235 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-04-09T18:21:25.236 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-04-09T18:21:25.276 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:25 +0000 (0:00:00.075) 0:05:02.795 ********** 2021-04-09T18:21:25.301 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:25.303 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-04-09T18:21:25.331 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:25 +0000 (0:00:00.054) 0:05:02.850 ********** 2021-04-09T18:21:25.356 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-04-09T18:21:25.358 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-04-09T18:21:25.390 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:25 +0000 (0:00:00.059) 0:05:02.909 ********** 2021-04-09T18:21:25.430 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:25 +0000 (0:00:00.039) 0:05:02.948 ********** 2021-04-09T18:21:25.460 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-04-09T18:21:25.462 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-04-09T18:21:25.513 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:25 +0000 (0:00:00.084) 0:05:03.033 ********** 2021-04-09T18:21:25.554 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:25.606 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:25 +0000 (0:00:00.092) 0:05:03.125 ********** 2021-04-09T18:21:25.621 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-04-09T18:21:25.623 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi079.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:25.632 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:25.633 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:25.635 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-04-09T18:21:25.635 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-04-09T18:21:25.637 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi079.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:25.663 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:25 +0000 (0:00:00.056) 0:05:03.182 ********** 2021-04-09T18:21:25.693 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:25 +0000 (0:00:00.030) 0:05:03.213 ********** 2021-04-09T18:21:25.713 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:25.714 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-04-09T18:21:25.717 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:25.718 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:25.719 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:25.732 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:25.732 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:25.777 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:25 +0000 (0:00:00.083) 0:05:03.296 ********** 2021-04-09T18:21:25.795 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-04-09T18:21:25.797 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:25.798 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:25.799 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:25.863 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:25 +0000 (0:00:00.085) 0:05:03.382 ********** 2021-04-09T18:21:25.955 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-04-09T18:21:25.957 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:26.000 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:25 +0000 (0:00:00.136) 0:05:03.520 ********** 2021-04-09T18:21:26.001 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:26.048 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:26.050 INFO:teuthology.task.ansible.out:TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi144.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:21:26.082 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:26 +0000 (0:00:00.081) 0:05:03.601 ********** 2021-04-09T18:21:26.084 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:26.152 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-04-09T18:21:26.154 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-04-09T18:21:26.156 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:26.161 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:26.198 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:26 +0000 (0:00:00.116) 0:05:03.718 ********** 2021-04-09T18:21:26.227 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:26 +0000 (0:00:00.026) 0:05:03.744 ********** 2021-04-09T18:21:26.300 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-04-09T18:21:26.302 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-04-09T18:21:26.344 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:26 +0000 (0:00:00.118) 0:05:03.863 ********** 2021-04-09T18:21:26.367 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-04-09T18:21:26.368 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.017576", "end": "2021-04-09 18:21:26.312618", "rc": 0, "start": "2021-04-09 18:21:26.295042", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/bin/teuthology-lock"]} 2021-04-09T18:21:26.410 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:26 +0000 (0:00:00.066) 0:05:03.930 ********** 2021-04-09T18:21:26.477 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-04-09T18:21:26.479 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-04-09T18:21:26.503 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:26 +0000 (0:00:00.093) 0:05:04.023 ********** 2021-04-09T18:21:26.546 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:26.549 INFO:teuthology.task.ansible.out:TASK [testnode : Stop apache2] ************************************************* 2021-04-09T18:21:26.550 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2021-04-09 18:15:08 UTC", "ActiveEnterTimestampMonotonic": "19497269", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target system.slice -.mount systemd-tmpfiles-setup.service nss-lookup.target sysinit.target systemd-journald.socket basic.target network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-04-09 18:15:07 UTC", "AssertTimestampMonotonic": "19017830", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-04-09 18:15:07 UTC", "ConditionTimestampMonotonic": "19017829", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "D 2021-04-09T18:21:26.552 INFO:teuthology.task.ansible.out:elegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1371", "ExecMainStartTimestamp": "Fri 2021-04-09 18:15:08 UTC", "ExecMainStartTimestampMonotonic": "19497258", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-04-09 18:15:07 UTC", "InactiveExitTimestampMonotonic": "19018808", "InvocationID": "d2ba716803d54bcaac59c154026fce88", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": 2021-04-09T18:21:26.554 INFO:teuthology.task.ansible.out: "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1371", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", " 2021-04-09T18:21:26.561 INFO:teuthology.task.ansible.out:RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-04-09 18:15:08 UTC", "StateChangeTimestampMonotonic": "19497269", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-04-09 18:15:08 UTC", "WatchdogTimestampMonotonic": "19497267", "WatchdogUSec": "0"}} TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:26.599 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:26 +0000 (0:00:00.095) 0:05:04.118 ********** 2021-04-09T18:21:26.654 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:26 +0000 (0:00:00.055) 0:05:04.173 ********** 2021-04-09T18:21:26.723 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-04-09T18:21:26.757 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:26 +0000 (0:00:00.103) 0:05:04.277 ********** 2021-04-09T18:21:26.772 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-04-09T18:21:26.773 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:26.811 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:26 +0000 (0:00:00.054) 0:05:04.331 ********** 2021-04-09T18:21:26.821 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-04-09T18:21:26.822 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:26.824 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:26.864 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:26 +0000 (0:00:00.052) 0:05:04.383 ********** 2021-04-09T18:21:26.929 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-04-09T18:21:26.932 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-04-09T18:21:26.959 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:26 +0000 (0:00:00.095) 0:05:04.478 ********** 2021-04-09T18:21:26.995 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-04-09T18:21:26.997 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:27.064 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:27 +0000 (0:00:00.104) 0:05:04.582 ********** 2021-04-09T18:21:27.109 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:27 +0000 (0:00:00.045) 0:05:04.628 ********** 2021-04-09T18:21:27.123 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-04-09T18:21:27.125 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:21:27.131 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-04-09T18:21:27.160 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:27 +0000 (0:00:00.051) 0:05:04.680 ********** 2021-04-09T18:21:27.210 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:27 +0000 (0:00:00.048) 0:05:04.728 ********** 2021-04-09T18:21:27.246 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-04-09T18:21:27.248 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:27.301 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:27 +0000 (0:00:00.092) 0:05:04.820 ********** 2021-04-09T18:21:27.328 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-04-09T18:21:27.330 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:27.373 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:27 +0000 (0:00:00.071) 0:05:04.892 ********** 2021-04-09T18:21:27.409 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-04-09T18:21:27.412 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:27.448 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:27 +0000 (0:00:00.075) 0:05:04.968 ********** 2021-04-09T18:21:27.450 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:27.470 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-04-09T18:21:27.472 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:27.509 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:27 +0000 (0:00:00.059) 0:05:05.028 ********** 2021-04-09T18:21:27.519 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-04-09T18:21:27.521 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:27.562 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:27 +0000 (0:00:00.053) 0:05:05.081 ********** 2021-04-09T18:21:27.586 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-04-09T18:21:27.587 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-04-09T18:21:27.627 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:27 +0000 (0:00:00.065) 0:05:05.146 ********** 2021-04-09T18:21:27.650 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-04-09T18:21:27.652 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:27.688 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:27 +0000 (0:00:00.060) 0:05:05.207 ********** 2021-04-09T18:21:27.702 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-04-09T18:21:27.702 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:27.745 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:27 +0000 (0:00:00.057) 0:05:05.264 ********** 2021-04-09T18:21:27.875 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-04-09T18:21:27.877 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:27.920 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:27 +0000 (0:00:00.174) 0:05:05.439 ********** 2021-04-09T18:21:27.930 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-04-09T18:21:27.932 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi090.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:21:27.975 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:27 +0000 (0:00:00.053) 0:05:05.492 ********** 2021-04-09T18:21:28.011 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.037) 0:05:05.530 ********** 2021-04-09T18:21:28.029 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-04-09T18:21:28.031 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-04-09T18:21:28.065 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.054) 0:05:05.584 ********** 2021-04-09T18:21:28.074 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-04-09T18:21:28.076 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.102 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.036) 0:05:05.621 ********** 2021-04-09T18:21:28.112 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-04-09T18:21:28.113 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.114 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.140 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.037) 0:05:05.659 ********** 2021-04-09T18:21:28.171 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.030) 0:05:05.690 ********** 2021-04-09T18:21:28.187 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-04-09T18:21:28.189 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:21:28.230 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.058) 0:05:05.749 ********** 2021-04-09T18:21:28.242 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-04-09T18:21:28.243 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.245 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi089.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-04-09T18:21:28.287 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.057) 0:05:05.806 ********** 2021-04-09T18:21:28.316 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.029) 0:05:05.835 ********** 2021-04-09T18:21:28.324 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-04-09T18:21:28.326 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.326 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.370 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.053) 0:05:05.889 ********** 2021-04-09T18:21:28.410 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.040) 0:05:05.929 ********** 2021-04-09T18:21:28.418 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-04-09T18:21:28.419 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.421 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi089.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.421 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.460 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.050) 0:05:05.980 ********** 2021-04-09T18:21:28.472 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.474 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} ok: [smithi089.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-04-09T18:21:28.475 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.490 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.498 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.509 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.512 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi079.front.sepia.ceph.com] => (item={'block_used': 13760127, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226334981, 'size_available': 927068082176, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149513, 'block_size': 4096, 'inode_available': 60905463}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226334981, "block_size": 4096, "block_total": 240095108, "block_used": 13760127, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905463, "inode_total": 61054976, "inode_used": 149513, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927068082176, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}} TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-04-09T18:21:28.518 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-04-09T18:21:28.541 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.080) 0:05:06.060 ********** 2021-04-09T18:21:28.567 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.026) 0:05:06.087 ********** 2021-04-09T18:21:28.610 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.042) 0:05:06.130 ********** 2021-04-09T18:21:28.619 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-04-09T18:21:28.621 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.622 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.625 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-04-09T18:21:28.627 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.659 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.048) 0:05:06.178 ********** 2021-04-09T18:21:28.704 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.044) 0:05:06.223 ********** 2021-04-09T18:21:28.714 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-04-09T18:21:28.715 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.742 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.038) 0:05:06.261 ********** 2021-04-09T18:21:28.772 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.010356", "end": "2021-04-09 18:21:28.740689", "rc": 0, "start": "2021-04-09 18:21:28.730333", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:28.799 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.057) 0:05:06.318 ********** 2021-04-09T18:21:28.801 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:28.821 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.849 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.049) 0:05:06.368 ********** 2021-04-09T18:21:28.858 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-04-09T18:21:28.859 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.860 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:28.907 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.057) 0:05:06.426 ********** 2021-04-09T18:21:28.927 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-04-09T18:21:28.928 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'block_used': 13760127, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226334981, 'size_available': 927068082176, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149513, 'block_size': 4096, 'inode_available': 60905463}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226334981, "block_size": 4096, "block_total": 240095108, "block_used": 13760127, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905463, "inode_total": 61054976, "inode_used": 149513, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927068082176, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:28.960 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:28 +0000 (0:00:00.052) 0:05:06.479 ********** 2021-04-09T18:21:28.961 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:28.992 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:28.994 INFO:teuthology.task.ansible.out:TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:29.021 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:29 +0000 (0:00:00.061) 0:05:06.540 ********** 2021-04-09T18:21:29.041 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:29.043 INFO:teuthology.task.ansible.out:TASK [testnode : set_fact] ***************************************************** ok: [smithi090.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-04-09T18:21:29.078 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:29 +0000 (0:00:00.056) 0:05:06.597 ********** 2021-04-09T18:21:29.099 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-04-09T18:21:29.101 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi089.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.021006", "end": "2021-04-09 18:21:29.041427", "rc": 0, "start": "2021-04-09 18:21:29.020421", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/bin/teuthology-lock"]} 2021-04-09T18:21:29.134 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:29 +0000 (0:00:00.056) 0:05:06.653 ********** 2021-04-09T18:21:29.169 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:29 +0000 (0:00:00.034) 0:05:06.688 ********** 2021-04-09T18:21:29.176 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-04-09T18:21:29.177 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-04-09T18:21:29.178 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-04-09T18:21:29.212 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:29 +0000 (0:00:00.043) 0:05:06.731 ********** 2021-04-09T18:21:29.288 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:29 +0000 (0:00:00.075) 0:05:06.807 ********** 2021-04-09T18:21:29.304 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-04-09T18:21:29.307 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:29.309 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:29.310 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:29.312 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:29.314 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:29.315 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:29.316 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-04-09T18:21:29.317 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:29.318 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-04-09T18:21:29.318 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:29.319 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi090.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:29.321 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:29.322 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:29.356 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:29 +0000 (0:00:00.066) 0:05:06.875 ********** 2021-04-09T18:21:29.364 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:29.366 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi090.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:29.406 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:29 +0000 (0:00:00.050) 0:05:06.925 ********** 2021-04-09T18:21:29.414 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-04-09T18:21:29.416 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi136.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:21:29.449 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:29 +0000 (0:00:00.042) 0:05:06.969 ********** 2021-04-09T18:21:29.480 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:29 +0000 (0:00:00.030) 0:05:06.999 ********** 2021-04-09T18:21:29.489 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-04-09T18:21:29.491 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:29.522 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:29 +0000 (0:00:00.042) 0:05:07.042 ********** 2021-04-09T18:21:29.543 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:29.571 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:29 +0000 (0:00:00.048) 0:05:07.091 ********** 2021-04-09T18:21:29.580 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-04-09T18:21:29.582 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:29.583 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:29.614 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:29 +0000 (0:00:00.042) 0:05:07.133 ********** 2021-04-09T18:21:29.624 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-04-09T18:21:29.626 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:29.657 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:29 +0000 (0:00:00.043) 0:05:07.176 ********** 2021-04-09T18:21:29.665 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-04-09T18:21:29.667 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:29.697 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:29 +0000 (0:00:00.039) 0:05:07.216 ********** 2021-04-09T18:21:29.717 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-04-09T18:21:29.719 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi090.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004118", "end": "2021-04-09 18:21:29.696190", "rc": 0, "start": "2021-04-09 18:21:29.692072", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/bin/teuthology-lock"]} 2021-04-09T18:21:29.767 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:29 +0000 (0:00:00.069) 0:05:07.286 ********** 2021-04-09T18:21:29.810 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:29 +0000 (0:00:00.043) 0:05:07.330 ********** 2021-04-09T18:21:29.819 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:29.866 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:29 +0000 (0:00:00.054) 0:05:07.384 ********** 2021-04-09T18:21:29.891 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:29.950 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:29 +0000 (0:00:00.084) 0:05:07.469 ********** 2021-04-09T18:21:29.963 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-04-09T18:21:29.969 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.003 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:29 +0000 (0:00:00.052) 0:05:07.522 ********** 2021-04-09T18:21:30.022 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-04-09T18:21:30.023 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.076 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:30 +0000 (0:00:00.072) 0:05:07.595 ********** 2021-04-09T18:21:30.089 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-04-09T18:21:30.091 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.145 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:30 +0000 (0:00:00.069) 0:05:07.664 ********** 2021-04-09T18:21:30.157 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-04-09T18:21:30.160 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.208 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:30 +0000 (0:00:00.063) 0:05:07.727 ********** 2021-04-09T18:21:30.221 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-04-09T18:21:30.227 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.267 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:30 +0000 (0:00:00.058) 0:05:07.786 ********** 2021-04-09T18:21:30.275 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-04-09T18:21:30.277 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.312 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:30 +0000 (0:00:00.045) 0:05:07.831 ********** 2021-04-09T18:21:30.355 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-04-09T18:21:30.357 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.392 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:30 +0000 (0:00:00.079) 0:05:07.911 ********** 2021-04-09T18:21:30.402 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-04-09T18:21:30.448 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:30 +0000 (0:00:00.056) 0:05:07.968 ********** 2021-04-09T18:21:30.510 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-04-09T18:21:30.512 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.548 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:30 +0000 (0:00:00.099) 0:05:08.067 ********** 2021-04-09T18:21:30.568 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-04-09T18:21:30.571 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.581 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.583 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.597 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-04-09T18:21:30.600 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.613 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.627 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.630 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.640 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.642 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi089.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi136.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.644 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.681 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:30 +0000 (0:00:00.132) 0:05:08.200 ********** 2021-04-09T18:21:30.729 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:30 +0000 (0:00:00.048) 0:05:08.249 ********** 2021-04-09T18:21:30.738 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.774 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:30 +0000 (0:00:00.043) 0:05:08.293 ********** 2021-04-09T18:21:30.781 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-04-09T18:21:30.783 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.814 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:30 +0000 (0:00:00.040) 0:05:08.333 ********** 2021-04-09T18:21:30.911 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-04-09T18:21:30.913 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:30.937 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:30 +0000 (0:00:00.123) 0:05:08.457 ********** 2021-04-09T18:21:30.945 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-04-09T18:21:30.947 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item={'block_used': 13760155, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226334953, 'size_available': 927067967488, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149513, 'block_size': 4096, 'inode_available': 60905463}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226334953, "block_size": 4096, "block_total": 240095108, "block_used": 13760155, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905463, "inode_total": 61054976, "inode_used": 149513, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927067967488, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}} 2021-04-09T18:21:30.974 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:30 +0000 (0:00:00.036) 0:05:08.494 ********** 2021-04-09T18:21:31.015 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.013201", "end": "2021-04-09 18:21:30.984603", "rc": 0, "start": "2021-04-09 18:21:30.971402", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/bin/teuthology-lock"]} 2021-04-09T18:21:31.042 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:31 +0000 (0:00:00.067) 0:05:08.562 ********** 2021-04-09T18:21:31.049 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-04-09T18:21:31.051 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:31.076 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:31 +0000 (0:00:00.034) 0:05:08.596 ********** 2021-04-09T18:21:31.094 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:31.096 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-6v1KmtzjKPw9VUfZb57xNx3qXiAGNvOjb8AuZUq4kEPX2y4eMUKdykyl8UZKGZoW'], 'uuids': ['f6a853b5-8fa8-4572-9860-ba8355ee7a0f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.627324", "end": "2021-04-09 18:21:31.065743", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-6v1KmtzjKPw9VUfZb57xNx3qXiAGNvOjb8AuZUq4kEPX2y4eMUKdykyl8UZKGZoW"], "labels": [], "masters": [], "uuids": ["f6a853b5-8fa8-4572-9860-ba8355ee7a0f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:29.438419", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:31.097 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => 2021-04-09T18:21:31.098 INFO:teuthology.task.ansible.out:(item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:31.108 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:31.161 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:31.191 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:31 +0000 (0:00:00.114) 0:05:08.710 ********** 2021-04-09T18:21:31.199 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-04-09T18:21:31.201 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.007254", "end": "2021-04-09 18:21:31.155099", "rc": 0, "start": "2021-04-09 18:21:31.147845", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:31.228 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:31 +0000 (0:00:00.036) 0:05:08.747 ********** 2021-04-09T18:21:31.270 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:31 +0000 (0:00:00.042) 0:05:08.789 ********** 2021-04-09T18:21:31.308 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-04-09T18:21:31.310 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:31.342 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:31 +0000 (0:00:00.072) 0:05:08.862 ********** 2021-04-09T18:21:31.349 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-04-09T18:21:31.351 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'block_used': 13760155, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226334953, 'size_available': 927067967488, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149513, 'block_size': 4096, 'inode_available': 60905463}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226334953, "block_size": 4096, "block_total": 240095108, "block_used": 13760155, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905463, "inode_total": 61054976, "inode_used": 149513, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927067967488, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:31.352 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi090.front.sepia.ceph.com] => {"cache_update_time": 1617992385, "cache_updated": false, "changed": false} 2021-04-09T18:21:31.392 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:31 +0000 (0:00:00.050) 0:05:08.912 ********** 2021-04-09T18:21:31.427 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:31 +0000 (0:00:00.034) 0:05:08.946 ********** 2021-04-09T18:21:31.437 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-04-09T18:21:31.439 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:31.469 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:31 +0000 (0:00:00.041) 0:05:08.988 ********** 2021-04-09T18:21:31.499 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:31 +0000 (0:00:00.030) 0:05:09.019 ********** 2021-04-09T18:21:31.507 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-04-09T18:21:31.535 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:31 +0000 (0:00:00.035) 0:05:09.055 ********** 2021-04-09T18:21:31.543 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:31.545 INFO:teuthology.task.ansible.out:TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:31.576 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:31 +0000 (0:00:00.040) 0:05:09.095 ********** 2021-04-09T18:21:31.588 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-04-09T18:21:31.590 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:31.622 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:31 +0000 (0:00:00.046) 0:05:09.142 ********** 2021-04-09T18:21:31.668 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:31.669 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:31.702 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-04-09T18:21:31.704 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item={'block_used': 13760147, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226334961, 'size_available': 927068000256, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149513, 'block_size': 4096, 'inode_available': 60905463}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226334961, "block_size": 4096, "block_total": 240095108, "block_used": 13760147, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905463, "inode_total": 61054976, "inode_used": 149513, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927068000256, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}} 2021-04-09T18:21:31.736 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:31 +0000 (0:00:00.110) 0:05:09.252 ********** 2021-04-09T18:21:31.842 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-04-09T18:21:31.844 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-04-09T18:21:31.884 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:31 +0000 (0:00:00.150) 0:05:09.403 ********** 2021-04-09T18:21:31.949 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-04-09T18:21:31.951 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009960", "end": "2021-04-09 18:21:31.930253", "rc": 0, "start": "2021-04-09 18:21:31.920293", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:31.978 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:31 +0000 (0:00:00.093) 0:05:09.497 ********** 2021-04-09T18:21:32.064 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-04-09T18:21:32.066 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'block_used': 13760147, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226334961, 'size_available': 927068000256, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149513, 'block_size': 4096, 'inode_available': 60905463}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226334961, "block_size": 4096, "block_total": 240095108, "block_used": 13760147, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905463, "inode_total": 61054976, "inode_used": 149513, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927068000256, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:32.094 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:32 +0000 (0:00:00.115) 0:05:09.613 ********** 2021-04-09T18:21:32.167 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-04-09T18:21:32.195 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:32 +0000 (0:00:00.101) 0:05:09.715 ********** 2021-04-09T18:21:32.298 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-04-09T18:21:32.300 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:32.339 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:32 +0000 (0:00:00.143) 0:05:09.858 ********** 2021-04-09T18:21:32.361 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-6v1KmtzjKPw9VUfZb57xNx3qXiAGNvOjdRPQA2cnpiC1g1ijPzhX1cxS3NgscVYr'], 'uuids': ['a5f926f7-c263-4c80-bfe5-7e295cb5ae3d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.115065", "end": "2021-04-09 18:21:32.340457", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-6v1KmtzjKPw9VUfZb57xNx3qXiAGNvOjdRPQA2cnpiC1g1ijPzhX1cxS3NgscVYr"], "labels": [], "masters": [], "uuids": ["a5f926f7-c263-4c80-bfe5-7e295cb5ae3d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:31.225392", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:32.374 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QDP6', 'wwn-0x5000c50091e0487b'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QDP6-part1', 'wwn-0x5000c50091e0487b-part1'], 'uuids': ['c2492a7c-537b-4f45-893c-50f733187038']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e0487b', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QDP6', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QDP6", "wwn-0x5000c50091e0487b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QDP6-part1", "wwn-0x5000c50091e0487b-part1"], "labels": [], "masters": [], "uuids": ["c2492a7c-537b-4f45-893c-50f733187038"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QDP6", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e0487b"}}, "skip_reason": 2021-04-09T18:21:32.376 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-04-09T18:21:32.412 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-04-09T18:21:32.414 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1617992386, "cache_updated": false, "changed": false} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:32.439 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:32 +0000 (0:00:00.099) 0:05:09.958 ********** 2021-04-09T18:21:32.462 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:32 +0000 (0:00:00.023) 0:05:09.982 ********** 2021-04-09T18:21:32.533 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-04-09T18:21:32.535 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:32.567 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:32 +0000 (0:00:00.105) 0:05:10.087 ********** 2021-04-09T18:21:32.664 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-04-09T18:21:32.665 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item={'block_used': 13760128, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226334980, 'size_available': 927068078080, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149513, 'block_size': 4096, 'inode_available': 60905463}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226334980, "block_size": 4096, "block_total": 240095108, "block_used": 13760128, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905463, "inode_total": 61054976, "inode_used": 149513, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927068078080, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}} 2021-04-09T18:21:32.699 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:32 +0000 (0:00:00.131) 0:05:10.218 ********** 2021-04-09T18:21:32.903 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-04-09T18:21:32.905 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.010037", "end": "2021-04-09 18:21:32.888621", "rc": 0, "start": "2021-04-09 18:21:32.878584", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:32.941 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:32 +0000 (0:00:00.242) 0:05:10.460 ********** 2021-04-09T18:21:33.037 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-04-09T18:21:33.039 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'block_used': 13760128, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226334980, 'size_available': 927068078080, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149513, 'block_size': 4096, 'inode_available': 60905463}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226334980, "block_size": 4096, "block_total": 240095108, "block_used": 13760128, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905463, "inode_total": 61054976, "inode_used": 149513, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927068078080, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:33.067 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:33 +0000 (0:00:00.126) 0:05:10.586 ********** 2021-04-09T18:21:33.075 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-04-09T18:21:33.076 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-04-09T18:21:33.104 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:33 +0000 (0:00:00.037) 0:05:10.624 ********** 2021-04-09T18:21:33.134 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-04-09T18:21:33.172 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:33 +0000 (0:00:00.068) 0:05:10.692 ********** 2021-04-09T18:21:33.299 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:33.301 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:33.333 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-SSrpkahhOhvfCIGqBusr8Kyne90Hsys4TudApdCklMADlwUkaAeUFdSFsNOrs8Zs'], 'uuids': ['f1026f75-95fc-45ec-ab61-a7aa8c86fb21']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.555443", "end": "2021-04-09 18:21:33.310845", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-SSrpkahhOhvfCIGqBusr8Kyne90Hsys4TudApdCklMADlwUkaAeUFdSFsNOrs8Zs"], "labels": [], "masters": [], "uuids": ["f1026f75-95fc-45ec-ab61-a7aa8c86fb21"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:31.755402", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:33.345 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:33.347 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:33.367 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:33.546 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-04-09T18:21:33.548 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-04-09T18:21:33.571 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:33 +0000 (0:00:00.398) 0:05:11.090 ********** 2021-04-09T18:21:33.688 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:33.689 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-LAU6We-NaQo-nCtX-Ntf8-MPB1-W5dQ-8R2Fbn', 'nvme-INTEL_SSDPEDMD400G4_PHFT6204013G400BGN', 'nvme-nvme.8086-50484654363230343031334734303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.169706", "end": "2021-04-09 18:21:33.654714", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-LAU6We-NaQo-nCtX-Ntf8-MPB1-W5dQ-8R2Fbn", "nvme-INTEL_SSDPEDMD400G4_PHFT6204013G400BGN", "nvme-nvme.8086-50484654363230343031334734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:32.485008", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-04-09T18:21:33.691 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:33.703 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:33.705 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:33.991 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-04-09T18:21:34.012 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:34 +0000 (0:00:00.441) 0:05:11.532 ********** 2021-04-09T18:21:34.064 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:34.066 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-1lBBLHDdMrdfXhnaTSQGk3wFHENRwplqNaWLFnFUFLz0NF5XIsiDynTK60agQWmh'], 'uuids': ['46c4dd72-2de6-4e60-9bc0-56149ea6f507']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.622027", "end": "2021-04-09 18:21:34.033044", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-1lBBLHDdMrdfXhnaTSQGk3wFHENRwplqNaWLFnFUFLz0NF5XIsiDynTK60agQWmh"], "labels": [], "masters": [], "uuids": ["46c4dd72-2de6-4e60-9bc0-56149ea6f507"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:32.411017", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:34.068 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:34.080 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:34.211 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-04-09T18:21:34.213 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:21:34.244 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:34 +0000 (0:00:00.231) 0:05:11.763 ********** 2021-04-09T18:21:34.352 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-04-09T18:21:34.354 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:34.388 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:34 +0000 (0:00:00.143) 0:05:11.907 ********** 2021-04-09T18:21:34.390 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:34.494 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-04-09T18:21:34.496 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:34.534 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:34 +0000 (0:00:00.146) 0:05:12.053 ********** 2021-04-09T18:21:34.619 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-04-09T18:21:34.621 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:34.654 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:34 +0000 (0:00:00.119) 0:05:12.173 ********** 2021-04-09T18:21:34.655 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:34.664 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:34.665 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-SSrpkahhOhvfCIGqBusr8Kyne90Hsys4iv8v6fReuPeGBeFNUNcjJ7HAtIjt9YKT'], 'uuids': ['60a0884b-92cb-495d-a778-0d2e18714dc7']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.136024", "end": "2021-04-09 18:21:34.616394", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-SSrpkahhOhvfCIGqBusr8Kyne90Hsys4iv8v6fReuPeGBeFNUNcjJ7HAtIjt9YKT"], "labels": [], "masters": [], "uuids": ["60a0884b-92cb-495d-a778-0d2e18714dc7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:33.480370", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:34.669 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QAPZ', 'wwn-0x5000c50091e0ae1d'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QAPZ-part1', 'wwn-0x5000c50091e0ae1d-part1'], 'uuids': ['c2492a7c-537b-4f45-893c-50f733187038']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e0ae1d', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QAPZ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QAPZ", "wwn-0x5000c50091e0ae1d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QAPZ-part1", "wwn-0x5000c50091e0ae1d-part1"], "labels": [], "masters": [], "uuids": ["c2492a7c-537b-4f45-893c-50f733187038"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QAPZ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e0ae1d"}}, "skip_reason": 2021-04-09T18:21:34.671 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-04-09T18:21:34.747 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:34.788 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:34 +0000 (0:00:00.133) 0:05:12.307 ********** 2021-04-09T18:21:34.873 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-04-09T18:21:34.875 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:34.901 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:34 +0000 (0:00:00.112) 0:05:12.420 ********** 2021-04-09T18:21:34.961 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:34.963 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-6v1KmtzjKPw9VUfZb57xNx3qXiAGNvOjK480LUVEoC6glnCXbemSZN8AOr52XkbU'], 'uuids': ['22481c50-2e8a-449a-b599-44201843a978']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.124720", "end": "2021-04-09 18:21:34.932028", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-6v1KmtzjKPw9VUfZb57xNx3qXiAGNvOjK480LUVEoC6glnCXbemSZN8AOr52XkbU"], "labels": [], "masters": [], "uuids": ["22481c50-2e8a-449a-b599-44201843a978"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:33.807308", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:34.974 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:34.975 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:34.988 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:34.989 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-04-09T18:21:35.012 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:35 +0000 (0:00:00.110) 0:05:12.531 ********** 2021-04-09T18:21:35.061 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:35.063 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-y3yQG7Sv2Q2QMjiUmAVgEbi1oIyykuvtRLEsXBL5qRAOlsqA9b9SoS1KTzm3irp0'], 'uuids': ['17f6996d-67f3-49de-8568-75a968827a03']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.617597", "end": "2021-04-09 18:21:35.032749", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-y3yQG7Sv2Q2QMjiUmAVgEbi1oIyykuvtRLEsXBL5qRAOlsqA9b9SoS1KTzm3irp0"], "labels": [], "masters": [], "uuids": ["17f6996d-67f3-49de-8568-75a968827a03"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:33.415152", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:35.075 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:35.076 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:35.089 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:35.102 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-04-09T18:21:35.104 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi144.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:35.114 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:35.116 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:35.127 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi144.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:35.149 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-04-09T18:21:35.151 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:35.161 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:35.172 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:35.184 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:35.186 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:35.196 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:35.198 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:35.209 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:35.211 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:35.259 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:35 +0000 (0:00:00.247) 0:05:12.779 ********** 2021-04-09T18:21:35.347 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:35.349 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-1lBBLHDdMrdfXhnaTSQGk3wFHENRwplqLZC9supBNZmIhr55NVVQ4fB13W2HfstB'], 'uuids': ['5b30cf27-cad5-4fc4-944e-51a862dbd1eb']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.130587", "end": "2021-04-09 18:21:35.322000", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-1lBBLHDdMrdfXhnaTSQGk3wFHENRwplqLZC9supBNZmIhr55NVVQ4fB13W2HfstB"], "labels": [], "masters": [], "uuids": ["5b30cf27-cad5-4fc4-944e-51a862dbd1eb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:34.191413", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:35.372 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-Hitachi_HUA722010CLA330_JPW9J0N20ZVK9C', 'wwn-0x5000cca3a8ce06d4'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'links': {'masters': [], 'labels': [], 'ids': ['ata-Hitachi_HUA722010CLA330_JPW9J0N20ZVK9C-part1', 'wwn-0x5000cca3a8ce06d4-part1'], 'uuids': ['c2492a7c-537b-4f45-893c-50f733187038']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000cca3a8ce06d4', 'model': 'Hitachi HUA72201', 'serial': 'JPW9J0N20ZVK9C', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-Hitachi_HUA722010CLA330_JPW9J0N20ZVK9C", "wwn-0x5000cca3a8ce06d4"], "labels": [], "masters": [], "uuids": []}, "model": "Hitachi HUA72201", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-Hitachi_HUA722010CLA330_JPW9J0N20ZVK9C-part1", "wwn-0x5000cca3a8ce06d4-part1"], "labels": [], "masters": [], "uuids": ["c2492a7c-537b-4f45-893c-50f733187038"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "JPW9J0N20ZVK9C", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual 2021-04-09T18:21:35.374 INFO:teuthology.task.ansible.out:": 1, "wwn": "0x5000cca3a8ce06d4"}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:35.554 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi144.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003269", "end": "2021-04-09 18:21:35.521118", "rc": 0, "start": "2021-04-09 18:21:35.517849", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/bin/teuthology-lock"]} 2021-04-09T18:21:35.585 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:35 +0000 (0:00:00.325) 0:05:13.104 ********** 2021-04-09T18:21:35.677 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-04-09T18:21:35.679 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:35.715 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:35 +0000 (0:00:00.130) 0:05:13.235 ********** 2021-04-09T18:21:35.821 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:35.855 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:35 +0000 (0:00:00.139) 0:05:13.374 ********** 2021-04-09T18:21:35.938 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-04-09T18:21:35.940 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:35.971 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:35 +0000 (0:00:00.116) 0:05:13.491 ********** 2021-04-09T18:21:35.980 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:35.981 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-KFuQWR-Oc8k-IGny-7BiZ-8WKc-4ilc-2R97Ye', 'nvme-INTEL_SSDPEDMD400G4_PHFT62040126400BGN', 'nvme-nvme.8086-50484654363230343031323634303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.175407", "end": "2021-04-09 18:21:35.930391", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-KFuQWR-Oc8k-IGny-7BiZ-8WKc-4ilc-2R97Ye", "nvme-INTEL_SSDPEDMD400G4_PHFT62040126400BGN", "nvme-nvme.8086-50484654363230343031323634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:34.754984", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-04-09T18:21:35.983 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:35.985 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:35.988 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:36.248 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-6v1KmtzjKPw9VUfZb57xNx3qXiAGNvOj8eTvYbOSGbkiTJ2z8FfKpEbQrPHlglGw'], 'uuids': ['d2606dcb-8c71-4ca1-a828-b2a72d3d920b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.127644", "end": "2021-04-09 18:21:36.224627", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-6v1KmtzjKPw9VUfZb57xNx3qXiAGNvOj8eTvYbOSGbkiTJ2z8FfKpEbQrPHlglGw"], "labels": [], "masters": [], "uuids": ["d2606dcb-8c71-4ca1-a828-b2a72d3d920b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:35.096983", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:36.261 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:36.330 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-y3yQG7Sv2Q2QMjiUmAVgEbi1oIyykuvtpkjPcMnwVnv29cv8wvKwzOckQ2hukkVl'], 'uuids': ['3ebaee6a-69db-43eb-adc6-609d81e74f00']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.097261", "end": "2021-04-09 18:21:36.298189", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-y3yQG7Sv2Q2QMjiUmAVgEbi1oIyykuvtpkjPcMnwVnv29cv8wvKwzOckQ2hukkVl"], "labels": [], "masters": [], "uuids": ["3ebaee6a-69db-43eb-adc6-609d81e74f00"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:35.200928", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:36.344 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTKJ', 'wwn-0x5000c5009293d5e8'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTKJ-part1', 'wwn-0x5000c5009293d5e8-part1'], 'uuids': ['c2492a7c-537b-4f45-893c-50f733187038']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009293d5e8', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XTKJ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTKJ", "wwn-0x5000c5009293d5e8"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTKJ-part1", "wwn-0x5000c5009293d5e8-part1"], "labels": [], "masters": [], "uuids": ["c2492a7c-537b-4f45-893c-50f733187038"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTKJ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293d5e8"}}, "skip_reason": 2021-04-09T18:21:36.346 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-04-09T18:21:36.685 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-rnfWRO-DEjo-KudA-IZCP-WoH5-C6I2-a3yySX', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400UK400BGN', 'nvme-nvme.8086-50484654363230343030554b34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.161382", "end": "2021-04-09 18:21:36.653700", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-rnfWRO-DEjo-KudA-IZCP-WoH5-C6I2-a3yySX", "nvme-INTEL_SSDPEDMD400G4_PHFT620400UK400BGN", "nvme-nvme.8086-50484654363230343030554b34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:35.492318", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-04-09T18:21:36.686 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:36.708 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:36.721 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:36.915 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-04-09T18:21:36.916 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"cache_update_time": 1617992393, "cache_updated": false, "changed": false} 2021-04-09T18:21:36.953 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:36 +0000 (0:00:00.982) 0:05:14.473 ********** 2021-04-09T18:21:37.026 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-04-09T18:21:37.027 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:37.051 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:37 +0000 (0:00:00.097) 0:05:14.571 ********** 2021-04-09T18:21:37.154 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-04-09T18:21:37.156 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item={'block_used': 13760130, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226334978, 'size_available': 927068069888, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149513, 'block_size': 4096, 'inode_available': 60905463}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226334978, "block_size": 4096, "block_total": 240095108, "block_used": 13760130, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905463, "inode_total": 61054976, "inode_used": 149513, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927068069888, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}} 2021-04-09T18:21:37.186 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:37 +0000 (0:00:00.134) 0:05:14.705 ********** 2021-04-09T18:21:37.238 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:37.243 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-SSrpkahhOhvfCIGqBusr8Kyne90Hsys4Nu0ybXLEDM0VPcFOhfqUXYEfFNtOy7cR'], 'uuids': ['1c52fde8-84cc-4fda-ace2-b93cbadabb7c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.127259", "end": "2021-04-09 18:21:37.207995", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-SSrpkahhOhvfCIGqBusr8Kyne90Hsys4Nu0ybXLEDM0VPcFOhfqUXYEfFNtOy7cR"], "labels": [], "masters": [], "uuids": ["1c52fde8-84cc-4fda-ace2-b93cbadabb7c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:36.080736", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:37.245 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:37.260 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:37.391 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-04-09T18:21:37.393 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.010096", "end": "2021-04-09 18:21:37.379270", "rc": 0, "start": "2021-04-09 18:21:37.369174", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:37.417 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:37 +0000 (0:00:00.231) 0:05:14.937 ********** 2021-04-09T18:21:37.510 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:37.516 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-6v1KmtzjKPw9VUfZb57xNx3qXiAGNvOjBs3KYEoh8cQq3qM1OmpqmixDW61iEPLZ'], 'uuids': ['0f8201eb-d047-4ece-891f-60eade75bda2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.118902", "end": "2021-04-09 18:21:37.485133", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-6v1KmtzjKPw9VUfZb57xNx3qXiAGNvOjBs3KYEoh8cQq3qM1OmpqmixDW61iEPLZ"], "labels": [], "masters": [], "uuids": ["0f8201eb-d047-4ece-891f-60eade75bda2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:36.366231", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:37.517 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-04-09T18:21:37.518 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'block_used': 13760130, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226334978, 'size_available': 927068069888, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149513, 'block_size': 4096, 'inode_available': 60905463}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226334978, "block_size": 4096, "block_total": 240095108, "block_used": 13760130, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905463, "inode_total": 61054976, "inode_used": 149513, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927068069888, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:37.523 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:37.569 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:37 +0000 (0:00:00.151) 0:05:15.088 ********** 2021-04-09T18:21:37.611 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:37 +0000 (0:00:00.040) 0:05:15.129 ********** 2021-04-09T18:21:37.620 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '3907029168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-pCF8vT-fDuU-nYRf-TfPH-F2BA-PME8-1fV6Nw', 'nvme-INTEL_SSDPEDMX020T4_CVPD514100122P0SGN', 'nvme-nvme.8086-43565044353134313030313232503053474e-494e54454c205353445045444d583032305434-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMX020T4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '1.82 TB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.121746", "end": "2021-04-09 18:21:37.573400", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-pCF8vT-fDuU-nYRf-TfPH-F2BA-PME8-1fV6Nw", "nvme-INTEL_SSDPEDMX020T4_CVPD514100122P0SGN", "nvme-nvme.8086-43565044353134313030313232503053474e-494e54454c205353445045444d583032305434-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMX020T4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "3907029168", "sectorsize": "512", "size": "1.82 TB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:36.451654", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! Yo 2021-04-09T18:21:37.621 INFO:teuthology.task.ansible.out:u may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:37.625 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:37.628 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:37.674 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:37.676 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:37.686 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-04-09T18:21:37.715 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:37 +0000 (0:00:00.105) 0:05:15.234 ********** 2021-04-09T18:21:37.959 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:37.960 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:37.961 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-6v1KmtzjKPw9VUfZb57xNx3qXiAGNvOjb8AuZUq4kEPX2y4eMUKdykyl8UZKGZoW'], 'uuids': ['f6a853b5-8fa8-4572-9860-ba8355ee7a0f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.155760", "end": "2021-04-09 18:21:37.932423", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-6v1KmtzjKPw9VUfZb57xNx3qXiAGNvOjb8AuZUq4kEPX2y4eMUKdykyl8UZKGZoW"], "labels": [], "masters": [], "uuids": ["f6a853b5-8fa8-4572-9860-ba8355ee7a0f"]}, 2021-04-09T18:21:37.962 INFO:teuthology.task.ansible.out: "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:37.776663", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.151007 s, 764 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.151007 s, 764 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:37.974 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:38.051 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:38.053 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-1lBBLHDdMrdfXhnaTSQGk3wFHENRwplqraUBThS3iNDodETZFLomcJediJk4zezK'], 'uuids': ['6a745482-a1d2-43c0-9543-fe7157c70cb2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.203817", "end": "2021-04-09 18:21:38.023424", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-1lBBLHDdMrdfXhnaTSQGk3wFHENRwplqraUBThS3iNDodETZFLomcJediJk4zezK"], "labels": [], "masters": [], "uuids": ["6a745482-a1d2-43c0-9543-fe7157c70cb2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:36.819607", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:38.065 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:38.078 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:38.091 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:38.094 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:38.383 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-6v1KmtzjKPw9VUfZb57xNx3qXiAGNvOjdRPQA2cnpiC1g1ijPzhX1cxS3NgscVYr'], 'uuids': ['a5f926f7-c263-4c80-bfe5-7e295cb5ae3d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.161596", "end": "2021-04-09 18:21:38.356226", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-6v1KmtzjKPw9VUfZb57xNx3qXiAGNvOjdRPQA2cnpiC1g1ijPzhX1cxS3NgscVYr"], "labels": [], "masters": [], "uuids": ["a5f926f7-c263-4c80-bfe5-7e295cb5ae3d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:38.194630", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156839 s, 735 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156839 s, 735 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:38.386 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QDP6', 'wwn-0x5000c50091e0487b'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QDP6-part1', 'wwn-0x5000c50091e0487b-part1'], 'uuids': ['c2492a7c-537b-4f45-893c-50f733187038']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e0487b', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QDP6', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QDP6", "wwn-0x5000c50091e0487b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QDP6-part1", "wwn-0x5000c50091e0487b-part1"], "labels": [], "masters": [], "uuids": ["c2492a7c-537b-4f45-893c-50f733187038"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QDP6", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e0487b"}}, "skip_reason": 2021-04-09T18:21:38.387 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-04-09T18:21:38.493 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:38.495 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-SSrpkahhOhvfCIGqBusr8Kyne90Hsys4XNHmnUTzKPq7eEInCEBK49YNJhZ1oet8'], 'uuids': ['c863cc0e-debb-4ec1-85e1-c432fc0b9618']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.114362", "end": "2021-04-09 18:21:38.474722", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-SSrpkahhOhvfCIGqBusr8Kyne90Hsys4XNHmnUTzKPq7eEInCEBK49YNJhZ1oet8"], "labels": [], "masters": [], "uuids": ["c863cc0e-debb-4ec1-85e1-c432fc0b9618"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:37.360360", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:38.506 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:38.570 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:38.572 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-LAU6We-NaQo-nCtX-Ntf8-MPB1-W5dQ-8R2Fbn', 'nvme-INTEL_SSDPEDMD400G4_PHFT6204013G400BGN', 'nvme-nvme.8086-50484654363230343031334734303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.053625", "end": "2021-04-09 18:21:38.541746", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-LAU6We-NaQo-nCtX-Ntf8-MPB1-W5dQ-8R2Fbn", "nvme-INTEL_SSDPEDMD400G4_PHFT6204013G400BGN", "nvme-nvme.8086-50484654363230343031334734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:38.488121", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0488254 s, 2.4 GB/s", "std 2021-04-09T18:21:38.574 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0488254 s, 2.4 GB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:38.583 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:38.586 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:38.880 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-6v1KmtzjKPw9VUfZb57xNx3qXiAGNvOjK480LUVEoC6glnCXbemSZN8AOr52XkbU'], 'uuids': ['22481c50-2e8a-449a-b599-44201843a978']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.152908", "end": "2021-04-09 18:21:38.851398", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-6v1KmtzjKPw9VUfZb57xNx3qXiAGNvOjK480LUVEoC6glnCXbemSZN8AOr52XkbU"], "labels": [], "masters": [], "uuids": ["22481c50-2e8a-449a-b599-44201843a978"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:38.698490", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.148488 s, 777 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.148488 s, 777 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:38.881 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:38.883 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:38.884 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-y3yQG7Sv2Q2QMjiUmAVgEbi1oIyykuvtOWOkH91JrUCWSXWfnxBoJe62A89E1OCy'], 'uuids': ['1428293f-13d2-4715-9b7c-b2b3a8a2acf5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.117030", "end": "2021-04-09 18:21:38.849879", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-y3yQG7Sv2Q2QMjiUmAVgEbi1oIyykuvtOWOkH91JrUCWSXWfnxBoJe62A89E1OCy"], "labels": [], "masters": [], "uuids": ["1428293f-13d2-4715-9b7c-b2b3a8a2acf5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:37.732849", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:38.887 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:38.888 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:38.900 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:38.901 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:38.903 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:38.914 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:39.185 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:39.187 INFO:teuthology.task.ansible.out:TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-6v1KmtzjKPw9VUfZb57xNx3qXiAGNvOj8eTvYbOSGbkiTJ2z8FfKpEbQrPHlglGw'], 'uuids': ['d2606dcb-8c71-4ca1-a828-b2a72d3d920b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.158431", "end": "2021-04-09 18:21:39.159279", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-6v1KmtzjKPw9VUfZb57xNx3qXiAGNvOj8eTvYbOSGbkiTJ2z8FfKpEbQrPHlglGw"], "labels": [], "masters": [], "uuids": ["d2606dcb-8c71-4ca1-a828-b2a72d3d920b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:39.000848", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153684 s, 751 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153684 s, 751 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:39.200 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:39.317 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:39.319 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-1lBBLHDdMrdfXhnaTSQGk3wFHENRwplq0bXcidnXvT6xKzUhD3xCyNzk2vVZShQS'], 'uuids': ['2edcc15e-431a-4ffd-9473-5195f91e1d2d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.107143", "end": "2021-04-09 18:21:39.291567", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-1lBBLHDdMrdfXhnaTSQGk3wFHENRwplq0bXcidnXvT6xKzUhD3xCyNzk2vVZShQS"], "labels": [], "masters": [], "uuids": ["2edcc15e-431a-4ffd-9473-5195f91e1d2d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:38.184424", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:39.330 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:39.512 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:39.514 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-6v1KmtzjKPw9VUfZb57xNx3qXiAGNvOjBs3KYEoh8cQq3qM1OmpqmixDW61iEPLZ'], 'uuids': ['0f8201eb-d047-4ece-891f-60eade75bda2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.162323", "end": "2021-04-09 18:21:39.485155", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-6v1KmtzjKPw9VUfZb57xNx3qXiAGNvOjBs3KYEoh8cQq3qM1OmpqmixDW61iEPLZ"], "labels": [], "masters": [], "uuids": ["0f8201eb-d047-4ece-891f-60eade75bda2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:39.322832", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157469 s, 732 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157469 s, 732 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:39.567 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:39 +0000 (0:00:01.851) 0:05:17.086 ********** 2021-04-09T18:21:39.761 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:39.762 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-SSrpkahhOhvfCIGqBusr8Kyne90Hsys4U7WZujPqU2Ore3N1NprQr7Y4PorGQiuK'], 'uuids': ['3cc9ca2f-b04f-47f1-b791-fa7eeaf42d67']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.121273", "end": "2021-04-09 18:21:39.733558", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-SSrpkahhOhvfCIGqBusr8Kyne90Hsys4U7WZujPqU2Ore3N1NprQr7Y4PorGQiuK"], "labels": [], "masters": [], "uuids": ["3cc9ca2f-b04f-47f1-b791-fa7eeaf42d67"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:38.612285", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:39.805 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:39 +0000 (0:00:00.237) 0:05:17.324 ********** 2021-04-09T18:21:39.839 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-vf8QhQtGv1Ukrxh1i9Pq2BAuu1cVOjdQjzgdbWpWaWog5wxNvcyI228kPSQm7K1v'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.751535", "end": "2021-04-09 18:21:39.809702", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-vf8QhQtGv1Ukrxh1i9Pq2BAuu1cVOjdQjzgdbWpWaWog5wxNvcyI228kPSQm7K1v"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:38.058167", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:39.853 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:39.864 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:39.920 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:39.922 INFO:teuthology.task.ansible.out:TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:39.932 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-04-09T18:21:39.935 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.138043", "end": "2021-04-09 18:21:39.826614", "rc": 0, "start": "2021-04-09 18:21:39.688571", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:39.958 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:39 +0000 (0:00:00.153) 0:05:17.477 ********** 2021-04-09T18:21:40.154 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:40.156 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-y3yQG7Sv2Q2QMjiUmAVgEbi1oIyykuvtAGUTUhiWc7PJhuIka5cH9giK1YTfuYJT'], 'uuids': ['a1868077-46b6-415b-82cb-9c8602dc4825']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.089547", "end": "2021-04-09 18:21:40.125091", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-y3yQG7Sv2Q2QMjiUmAVgEbi1oIyykuvtAGUTUhiWc7PJhuIka5cH9giK1YTfuYJT"], "labels": [], "masters": [], "uuids": ["a1868077-46b6-415b-82cb-9c8602dc4825"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:39.035544", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:40.167 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:40.178 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-04-09T18:21:40.180 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.068880", "end": "2021-04-09 18:21:40.154840", "rc": 0, "start": "2021-04-09 18:21:40.085960", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:40.204 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:40 +0000 (0:00:00.245) 0:05:17.723 ********** 2021-04-09T18:21:40.273 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-04-09T18:21:40.345 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:40 +0000 (0:00:00.141) 0:05:17.864 ********** 2021-04-09T18:21:40.377 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-04-09T18:21:40.379 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:40.537 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:40 +0000 (0:00:00.192) 0:05:18.057 ********** 2021-04-09T18:21:40.546 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:40.547 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-SSrpkahhOhvfCIGqBusr8Kyne90Hsys4TudApdCklMADlwUkaAeUFdSFsNOrs8Zs'], 'uuids': ['f1026f75-95fc-45ec-ab61-a7aa8c86fb21']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.156854", "end": "2021-04-09 18:21:40.361052", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-SSrpkahhOhvfCIGqBusr8Kyne90Hsys4TudApdCklMADlwUkaAeUFdSFsNOrs8Zs"], "labels": [], "masters": [], "uuids": ["f1026f75-95fc-45ec-ab61-a7aa8c86fb21"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:40.204198", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.152015 s, 759 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.152015 s, 759 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:40.550 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:40.551 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:40.563 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:40.565 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-1lBBLHDdMrdfXhnaTSQGk3wFHENRwplqusgfYbt1U0ClC2bFAVdvJyB22ct3Xst8'], 'uuids': ['91291862-3127-4e5c-9e17-cef0e81daa31']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.107185", "end": "2021-04-09 18:21:40.541259", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-1lBBLHDdMrdfXhnaTSQGk3wFHENRwplqusgfYbt1U0ClC2bFAVdvJyB22ct3Xst8"], "labels": [], "masters": [], "uuids": ["91291862-3127-4e5c-9e17-cef0e81daa31"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:39.434074", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:40.601 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-04-09T18:21:40.603 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:40.631 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:40 +0000 (0:00:00.094) 0:05:18.151 ********** 2021-04-09T18:21:40.664 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:40 +0000 (0:00:00.032) 0:05:18.183 ********** 2021-04-09T18:21:40.672 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-04-09T18:21:40.674 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:40.719 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:40 +0000 (0:00:00.055) 0:05:18.239 ********** 2021-04-09T18:21:40.734 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:40.734 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-SSrpkahhOhvfCIGqBusr8Kyne90Hsys4iv8v6fReuPeGBeFNUNcjJ7HAtIjt9YKT'], 'uuids': ['60a0884b-92cb-495d-a778-0d2e18714dc7']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.169364", "end": "2021-04-09 18:21:40.685998", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-SSrpkahhOhvfCIGqBusr8Kyne90Hsys4iv8v6fReuPeGBeFNUNcjJ7HAtIjt9YKT"], "labels": [], "masters": [], "uuids": ["60a0884b-92cb-495d-a778-0d2e18714dc7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:40.516634", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.16462 s, 701 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.16462 s, 701 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:40.737 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QAPZ', 'wwn-0x5000c50091e0ae1d'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QAPZ-part1', 'wwn-0x5000c50091e0ae1d-part1'], 'uuids': ['c2492a7c-537b-4f45-893c-50f733187038']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e0ae1d', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QAPZ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QAPZ", "wwn-0x5000c50091e0ae1d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QAPZ-part1", "wwn-0x5000c50091e0ae1d-part1"], "labels": [], "masters": [], "uuids": ["c2492a7c-537b-4f45-893c-50f733187038"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QAPZ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e0ae1d"}}, "skip_reason": 2021-04-09T18:21:40.739 INFO:teuthology.task.ansible.out:"Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:40.764 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-04-09T18:21:40.767 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:40.805 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:40 +0000 (0:00:00.085) 0:05:18.324 ********** 2021-04-09T18:21:40.915 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-KFuQWR-Oc8k-IGny-7BiZ-8WKc-4ilc-2R97Ye', 'nvme-INTEL_SSDPEDMD400G4_PHFT62040126400BGN', 'nvme-nvme.8086-50484654363230343031323634303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.049677", "end": "2021-04-09 18:21:40.889683", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-KFuQWR-Oc8k-IGny-7BiZ-8WKc-4ilc-2R97Ye", "nvme-INTEL_SSDPEDMD400G4_PHFT62040126400BGN", "nvme-nvme.8086-50484654363230343031323634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:40.840006", "stderr": "110+0 records in\n110+0 2021-04-09T18:21:40.918 INFO:teuthology.task.ansible.out: records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0451737 s, 2.6 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0451737 s, 2.6 GB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:40.930 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:40.945 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:40.956 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-04-09T18:21:40.958 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:21:40.988 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:40 +0000 (0:00:00.183) 0:05:18.507 ********** 2021-04-09T18:21:41.045 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:41.047 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-1lBBLHDdMrdfXhnaTSQGk3wFHENRwplqNaWLFnFUFLz0NF5XIsiDynTK60agQWmh'], 'uuids': ['46c4dd72-2de6-4e60-9bc0-56149ea6f507']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.158280", "end": "2021-04-09 18:21:41.011952", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-1lBBLHDdMrdfXhnaTSQGk3wFHENRwplqNaWLFnFUFLz0NF5XIsiDynTK60agQWmh"], "labels": [], "masters": [], "uuids": ["46c4dd72-2de6-4e60-9bc0-56149ea6f507"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:40.853672", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153522 s, 751 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153522 s, 751 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:41.049 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi079.front.sepia.ceph.com] => (item={'block_used': 13760127, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226334981, 'size_available': 927068082176, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149513, 'block_size': 4096, 'inode_available': 60905463}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226334981, "block_size": 4096, "block_total": 240095108, "block_used": 13760127, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905463, "inode_total": 61054976, "inode_used": 149513, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927068082176, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:41.083 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:41 +0000 (0:00:00.095) 0:05:18.602 ********** 2021-04-09T18:21:41.090 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:41.092 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:41.092 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:41.120 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:41.124 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-vf8QhQtGv1Ukrxh1i9Pq2BAuu1cVOjdQ5RzXhF5UqEF9JaAW8TkyOTgDxuxJVv4s'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.107405", "end": "2021-04-09 18:21:41.083593", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-vf8QhQtGv1Ukrxh1i9Pq2BAuu1cVOjdQ5RzXhF5UqEF9JaAW8TkyOTgDxuxJVv4s"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:39.976188", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi079.front.sepia.ceph. 2021-04-09T18:21:41.126 INFO:teuthology.task.ansible.out:com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XKPY', 'wwn-0x5000c5009293d715'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XKPY-part1', 'wwn-0x5000c5009293d715-part1'], 'uuids': ['c2492a7c-537b-4f45-893c-50f733187038']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009293d715', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XKPY', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XKPY", "wwn-0x5000c5009293d715"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XKPY-part1", "wwn-0x5000c5009293d715-part1"], "labels": [], "masters": [], "uuids": ["c2492a7c-537b-4f45-893c-50f733187038"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "secto 2021-04-09T18:21:41.128 INFO:teuthology.task.ansible.out:rsize": "512", "serial": "Z1W5XKPY", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293d715"}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:41.160 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:41 +0000 (0:00:00.077) 0:05:18.680 ********** 2021-04-09T18:21:41.197 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:41.199 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:41.242 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:41 +0000 (0:00:00.081) 0:05:18.762 ********** 2021-04-09T18:21:41.251 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:41.253 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-SSrpkahhOhvfCIGqBusr8Kyne90Hsys4Nu0ybXLEDM0VPcFOhfqUXYEfFNtOy7cR'], 'uuids': ['1c52fde8-84cc-4fda-ace2-b93cbadabb7c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.157327", "end": "2021-04-09 18:21:41.197242", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-SSrpkahhOhvfCIGqBusr8Kyne90Hsys4Nu0ybXLEDM0VPcFOhfqUXYEfFNtOy7cR"], "labels": [], "masters": [], "uuids": ["1c52fde8-84cc-4fda-ace2-b93cbadabb7c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:41.039915", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153559 s, 751 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153559 s, 751 MB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': ' 2021-04-09T18:21:41.255 INFO:teuthology.task.ansible.out:0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:41.265 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:41.283 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:41.300 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:41 +0000 (0:00:00.058) 0:05:18.820 ********** 2021-04-09T18:21:41.340 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-04-09T18:21:41.343 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:41.366 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:41 +0000 (0:00:00.066) 0:05:18.886 ********** 2021-04-09T18:21:41.377 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:41.379 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-1lBBLHDdMrdfXhnaTSQGk3wFHENRwplqLZC9supBNZmIhr55NVVQ4fB13W2HfstB'], 'uuids': ['5b30cf27-cad5-4fc4-944e-51a862dbd1eb']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.157967", "end": "2021-04-09 18:21:41.333284", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-1lBBLHDdMrdfXhnaTSQGk3wFHENRwplqLZC9supBNZmIhr55NVVQ4fB13W2HfstB"], "labels": [], "masters": [], "uuids": ["5b30cf27-cad5-4fc4-944e-51a862dbd1eb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:41.175317", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154809 s, 745 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154809 s, 745 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:41.381 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-Hitachi_HUA722010CLA330_JPW9J0N20ZVK9C', 'wwn-0x5000cca3a8ce06d4'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'links': {'masters': [], 'labels': [], 'ids': ['ata-Hitachi_HUA722010CLA330_JPW9J0N20ZVK9C-part1', 'wwn-0x5000cca3a8ce06d4-part1'], 'uuids': ['c2492a7c-537b-4f45-893c-50f733187038']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000cca3a8ce06d4', 'model': 'Hitachi HUA72201', 'serial': 'JPW9J0N20ZVK9C', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-Hitachi_HUA722010CLA330_JPW9J0N20ZVK9C", "wwn-0x5000cca3a8ce06d4"], "labels": [], "masters": [], "uuids": []}, "model": "Hitachi HUA72201", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-Hitachi_HUA722010CLA330_JPW9J0N20ZVK9C-part1", "wwn-0x5000cca3a8ce06d4-part1"], "labels": [], "masters": [], "uuids": ["c2492a7c-537b-4f45-893c-50f733187038"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "JPW9J0N20ZVK9C", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual 2021-04-09T18:21:41.383 INFO:teuthology.task.ansible.out:": 1, "wwn": "0x5000cca3a8ce06d4"}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:41.404 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:41.405 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-y3yQG7Sv2Q2QMjiUmAVgEbi1oIyykuvtYCtFdMQ8ZXgAhXIypRNMh8fzOQvgfeMB'], 'uuids': ['6f2734d3-640c-4dab-8e0f-67ff1110f6cd']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.102593", "end": "2021-04-09 18:21:41.375344", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-y3yQG7Sv2Q2QMjiUmAVgEbi1oIyykuvtYCtFdMQ8ZXgAhXIypRNMh8fzOQvgfeMB"], "labels": [], "masters": [], "uuids": ["6f2734d3-640c-4dab-8e0f-67ff1110f6cd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:40.272751", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Determine desired logical v 2021-04-09T18:21:41.407 INFO:teuthology.task.ansible.out:olume percentage size] ************* skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:41.410 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:41.453 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:41 +0000 (0:00:00.086) 0:05:18.973 ********** 2021-04-09T18:21:41.483 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:41 +0000 (0:00:00.029) 0:05:19.003 ********** 2021-04-09T18:21:41.490 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-04-09T18:21:41.492 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:41.528 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:41 +0000 (0:00:00.045) 0:05:19.048 ********** 2021-04-09T18:21:41.550 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:41.552 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:41.564 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-SSrpkahhOhvfCIGqBusr8Kyne90Hsys4XNHmnUTzKPq7eEInCEBK49YNJhZ1oet8'], 'uuids': ['c863cc0e-debb-4ec1-85e1-c432fc0b9618']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.157549", "end": "2021-04-09 18:21:41.528495", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-SSrpkahhOhvfCIGqBusr8Kyne90Hsys4XNHmnUTzKPq7eEInCEBK49YNJhZ1oet8"], "labels": [], "masters": [], "uuids": ["c863cc0e-debb-4ec1-85e1-c432fc0b9618"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:41.370946", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.152804 s, 755 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.152804 s, 755 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:41.578 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-rnfWRO-DEjo-KudA-IZCP-WoH5-C6I2-a3yySX', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400UK400BGN', 'nvme-nvme.8086-50484654363230343030554b34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.053301", "end": "2021-04-09 18:21:41.545481", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-rnfWRO-DEjo-KudA-IZCP-WoH5-C6I2-a3yySX", "nvme-INTEL_SSDPEDMD400G4_PHFT620400UK400BGN", "nvme-nvme.8086-50484654363230343030554b34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:41.492180", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0484321 s, 2.4 GB/s", "std 2021-04-09T18:21:41.580 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0484321 s, 2.4 GB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:41.582 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:41.594 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:41.606 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:41.814 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-y3yQG7Sv2Q2QMjiUmAVgEbi1oIyykuvtRLEsXBL5qRAOlsqA9b9SoS1KTzm3irp0'], 'uuids': ['17f6996d-67f3-49de-8568-75a968827a03']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.119172", "end": "2021-04-09 18:21:41.787628", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-y3yQG7Sv2Q2QMjiUmAVgEbi1oIyykuvtRLEsXBL5qRAOlsqA9b9SoS1KTzm3irp0"], "labels": [], "masters": [], "uuids": ["17f6996d-67f3-49de-8568-75a968827a03"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:41.668456", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.114444 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.114444 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:41.826 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:41.839 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:41.883 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-SSrpkahhOhvfCIGqBusr8Kyne90Hsys4U7WZujPqU2Ore3N1NprQr7Y4PorGQiuK'], 'uuids': ['3cc9ca2f-b04f-47f1-b791-fa7eeaf42d67']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.153468", "end": "2021-04-09 18:21:41.851157", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-SSrpkahhOhvfCIGqBusr8Kyne90Hsys4U7WZujPqU2Ore3N1NprQr7Y4PorGQiuK"], "labels": [], "masters": [], "uuids": ["3cc9ca2f-b04f-47f1-b791-fa7eeaf42d67"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:41.697689", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.148744 s, 775 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.148744 s, 775 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:41.887 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-1lBBLHDdMrdfXhnaTSQGk3wFHENRwplqraUBThS3iNDodETZFLomcJediJk4zezK'], 'uuids': ['6a745482-a1d2-43c0-9543-fe7157c70cb2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.147925", "end": "2021-04-09 18:21:41.856013", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-1lBBLHDdMrdfXhnaTSQGk3wFHENRwplqraUBThS3iNDodETZFLomcJediJk4zezK"], "labels": [], "masters": [], "uuids": ["6a745482-a1d2-43c0-9543-fe7157c70cb2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:41.708088", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.144749 s, 797 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.144749 s, 797 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:41.905 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:41.942 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:41 +0000 (0:00:00.413) 0:05:19.461 ********** 2021-04-09T18:21:41.955 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:42.044 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-04-09T18:21:42.047 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-04-09T18:21:42.073 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:42 +0000 (0:00:00.131) 0:05:19.593 ********** 2021-04-09T18:21:42.107 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:42.109 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-y3yQG7Sv2Q2QMjiUmAVgEbi1oIyykuvtpkjPcMnwVnv29cv8wvKwzOckQ2hukkVl'], 'uuids': ['3ebaee6a-69db-43eb-adc6-609d81e74f00']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.107379", "end": "2021-04-09 18:21:42.077459", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-y3yQG7Sv2Q2QMjiUmAVgEbi1oIyykuvtpkjPcMnwVnv29cv8wvKwzOckQ2hukkVl"], "labels": [], "masters": [], "uuids": ["3ebaee6a-69db-43eb-adc6-609d81e74f00"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:41.970080", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.102667 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.102667 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:42.112 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTKJ', 'wwn-0x5000c5009293d5e8'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTKJ-part1', 'wwn-0x5000c5009293d5e8-part1'], 'uuids': ['c2492a7c-537b-4f45-893c-50f733187038']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009293d5e8', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XTKJ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTKJ", "wwn-0x5000c5009293d5e8"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTKJ-part1", "wwn-0x5000c5009293d5e8-part1"], "labels": [], "masters": [], "uuids": ["c2492a7c-537b-4f45-893c-50f733187038"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTKJ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293d5e8"}}, "skip_reason": 2021-04-09T18:21:42.114 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-04-09T18:21:42.211 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-1lBBLHDdMrdfXhnaTSQGk3wFHENRwplq0bXcidnXvT6xKzUhD3xCyNzk2vVZShQS'], 'uuids': ['2edcc15e-431a-4ffd-9473-5195f91e1d2d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.168919", "end": "2021-04-09 18:21:42.176845", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-1lBBLHDdMrdfXhnaTSQGk3wFHENRwplq0bXcidnXvT6xKzUhD3xCyNzk2vVZShQS"], "labels": [], "masters": [], "uuids": ["2edcc15e-431a-4ffd-9473-5195f91e1d2d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:42.007926", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.164164 s, 703 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.164164 s, 703 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:42.224 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:42.226 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-04-09T18:21:42.226 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.126538", "end": "2021-04-09 18:21:42.194125", "rc": 0, "start": "2021-04-09 18:21:42.067587", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:42.258 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:42 +0000 (0:00:00.185) 0:05:19.778 ********** 2021-04-09T18:21:42.298 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:42.299 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '3907029168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-pCF8vT-fDuU-nYRf-TfPH-F2BA-PME8-1fV6Nw', 'nvme-INTEL_SSDPEDMX020T4_CVPD514100122P0SGN', 'nvme-nvme.8086-43565044353134313030313232503053474e-494e54454c205353445045444d583032305434-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMX020T4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '1.82 TB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.049430", "end": "2021-04-09 18:21:42.271150", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-pCF8vT-fDuU-nYRf-TfPH-F2BA-PME8-1fV6Nw", "nvme-INTEL_SSDPEDMX020T4_CVPD514100122P0SGN", "nvme-nvme.8086-43565044353134313030313232503053474e-494e54454c205353445045444d583032305434-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMX020T4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "3907029168", "sectorsize": "512", "size": "1.82 TB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:42.221720", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0459492 s, 2.5 GB/s", "stder 2021-04-09T18:21:42.301 INFO:teuthology.task.ansible.out:r_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0459492 s, 2.5 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:42.314 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:42.445 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:42.447 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-XNjd61-U0eU-oEgL-jkYn-6vzO-9oqk-jPfuG2', 'nvme-INTEL_SSDPEDMD400G4_PHFT62050085400BGN', 'nvme-nvme.8086-50484654363230353030383534303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.164440", "end": "2021-04-09 18:21:42.414216", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-XNjd61-U0eU-oEgL-jkYn-6vzO-9oqk-jPfuG2", "nvme-INTEL_SSDPEDMD400G4_PHFT62050085400BGN", "nvme-nvme.8086-50484654363230353030383534303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:41.249776", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-04-09T18:21:42.449 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:42.459 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:42.461 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi089.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.053673", "end": "2021-04-09 18:21:42.438246", "rc": 0, "start": "2021-04-09 18:21:42.384573", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:42.462 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:42.462 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:42.495 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:42 +0000 (0:00:00.236) 0:05:20.015 ********** 2021-04-09T18:21:42.518 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:42.520 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-1lBBLHDdMrdfXhnaTSQGk3wFHENRwplqusgfYbt1U0ClC2bFAVdvJyB22ct3Xst8'], 'uuids': ['91291862-3127-4e5c-9e17-cef0e81daa31']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.156076", "end": "2021-04-09 18:21:42.490924", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-1lBBLHDdMrdfXhnaTSQGk3wFHENRwplqusgfYbt1U0ClC2bFAVdvJyB22ct3Xst8"], "labels": [], "masters": [], "uuids": ["91291862-3127-4e5c-9e17-cef0e81daa31"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:42.334848", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.151319 s, 762 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.151319 s, 762 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:42.547 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-04-09T18:21:42.548 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-y3yQG7Sv2Q2QMjiUmAVgEbi1oIyykuvtOWOkH91JrUCWSXWfnxBoJe62A89E1OCy'], 'uuids': ['1428293f-13d2-4715-9b7c-b2b3a8a2acf5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.108313", "end": "2021-04-09 18:21:42.510815", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-y3yQG7Sv2Q2QMjiUmAVgEbi1oIyykuvtOWOkH91JrUCWSXWfnxBoJe62A89E1OCy"], "labels": [], "masters": [], "uuids": ["1428293f-13d2-4715-9b7c-b2b3a8a2acf5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:42.402502", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.104182 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.104182 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:42.589 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:42 +0000 (0:00:00.093) 0:05:20.108 ********** 2021-04-09T18:21:42.632 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:42 +0000 (0:00:00.043) 0:05:20.151 ********** 2021-04-09T18:21:42.645 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:42.647 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:42.649 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-04-09T18:21:42.650 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:42.652 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:42.688 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:42 +0000 (0:00:00.053) 0:05:20.205 ********** 2021-04-09T18:21:42.724 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-04-09T18:21:42.726 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:42.754 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:42 +0000 (0:00:00.068) 0:05:20.273 ********** 2021-04-09T18:21:42.786 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-04-09T18:21:42.787 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:42.826 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:42 +0000 (0:00:00.071) 0:05:20.345 ********** 2021-04-09T18:21:42.841 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:42.842 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-y3yQG7Sv2Q2QMjiUmAVgEbi1oIyykuvtAGUTUhiWc7PJhuIka5cH9giK1YTfuYJT'], 'uuids': ['a1868077-46b6-415b-82cb-9c8602dc4825']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.113790", "end": "2021-04-09 18:21:42.792540", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-y3yQG7Sv2Q2QMjiUmAVgEbi1oIyykuvtAGUTUhiWc7PJhuIka5cH9giK1YTfuYJT"], "labels": [], "masters": [], "uuids": ["a1868077-46b6-415b-82cb-9c8602dc4825"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:42.678750", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.109269 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.109269 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:42.845 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:42.860 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-04-09T18:21:42.862 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:42.894 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:42 +0000 (0:00:00.067) 0:05:20.413 ********** 2021-04-09T18:21:42.933 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-04-09T18:21:42.935 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.138964", "end": "2021-04-09 18:21:42.897462", "rc": 0, "start": "2021-04-09 18:21:42.758498", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:42.960 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:42 +0000 (0:00:00.066) 0:05:20.480 ********** 2021-04-09T18:21:43.044 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-04-09T18:21:43.045 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:21:43.085 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.124) 0:05:20.604 ********** 2021-04-09T18:21:43.105 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:43.107 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-y3yQG7Sv2Q2QMjiUmAVgEbi1oIyykuvtYCtFdMQ8ZXgAhXIypRNMh8fzOQvgfeMB'], 'uuids': ['6f2734d3-640c-4dab-8e0f-67ff1110f6cd']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.114538", "end": "2021-04-09 18:21:43.078018", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-y3yQG7Sv2Q2QMjiUmAVgEbi1oIyykuvtYCtFdMQ8ZXgAhXIypRNMh8fzOQvgfeMB"], "labels": [], "masters": [], "uuids": ["6f2734d3-640c-4dab-8e0f-67ff1110f6cd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:42.963480", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.109807 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.109807 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:43.135 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-04-09T18:21:43.137 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:43.160 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.075) 0:05:20.679 ********** 2021-04-09T18:21:43.169 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-04-09T18:21:43.170 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.043098", "end": "2021-04-09 18:21:43.119912", "rc": 0, "start": "2021-04-09 18:21:43.076814", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:43.171 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-04-09T18:21:43.171 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'block_used': 13760155, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226334953, 'size_available': 927067967488, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149513, 'block_size': 4096, 'inode_available': 60905463}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226334953, "block_size": 4096, "block_total": 240095108, "block_used": 13760155, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905463, "inode_total": 61054976, "inode_used": 149513, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927067967488, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:43.209 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.048) 0:05:20.728 ********** 2021-04-09T18:21:43.241 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.032) 0:05:20.761 ********** 2021-04-09T18:21:43.251 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-04-09T18:21:43.252 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:43.280 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.038) 0:05:20.799 ********** 2021-04-09T18:21:43.290 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-04-09T18:21:43.322 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.041) 0:05:20.841 ********** 2021-04-09T18:21:43.328 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:43.330 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:43.362 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.040) 0:05:20.881 ********** 2021-04-09T18:21:43.371 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-04-09T18:21:43.373 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:43.410 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.048) 0:05:20.929 ********** 2021-04-09T18:21:43.418 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:43.420 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* 2021-04-09T18:21:43.421 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:43.454 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.043) 0:05:20.973 ********** 2021-04-09T18:21:43.461 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-04-09T18:21:43.462 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:43.463 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-04-09T18:21:43.464 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.145777", "end": "2021-04-09 18:21:43.429136", "rc": 0, "start": "2021-04-09 18:21:43.283359", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:43.496 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.042) 0:05:21.015 ********** 2021-04-09T18:21:43.521 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.024) 0:05:21.040 ********** 2021-04-09T18:21:43.529 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-04-09T18:21:43.531 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:43.561 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.040) 0:05:21.081 ********** 2021-04-09T18:21:43.591 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.029) 0:05:21.110 ********** 2021-04-09T18:21:43.611 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-04-09T18:21:43.613 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:43.651 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.060) 0:05:21.170 ********** 2021-04-09T18:21:43.659 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-04-09T18:21:43.661 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:43.695 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.044) 0:05:21.214 ********** 2021-04-09T18:21:43.725 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.029) 0:05:21.244 ********** 2021-04-09T18:21:43.731 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-04-09T18:21:43.733 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-vf8QhQtGv1Ukrxh1i9Pq2BAuu1cVOjdQ2Xl0ptSuj8FK6JtudElBAeeEnxc3OOhq'], 'uuids': ['bd62b173-8563-4ff7-8d69-042ee58e42f1']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.115319", "end": "2021-04-09 18:21:43.685241", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-vf8QhQtGv1Ukrxh1i9Pq2BAuu1cVOjdQ2Xl0ptSuj8FK6JtudElBAeeEnxc3OOhq"], "labels": [], "masters": [], "uuids": ["bd62b173-8563-4ff7-8d69-042ee58e42f1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:42.569922", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot o 2021-04-09T18:21:43.735 INFO:teuthology.task.ansible.out:r after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Check for physical volumes] *********************************** changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.066732", "end": "2021-04-09 18:21:43.702652", "rc": 0, "start": "2021-04-09 18:21:43.635920", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:43.736 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:43.737 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:43.772 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.047) 0:05:21.291 ********** 2021-04-09T18:21:43.812 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.039) 0:05:21.331 ********** 2021-04-09T18:21:43.823 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:43.847 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-04-09T18:21:43.886 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.074) 0:05:21.406 ********** 2021-04-09T18:21:43.894 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-04-09T18:21:43.897 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi090.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:21:43.929 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.043) 0:05:21.449 ********** 2021-04-09T18:21:43.964 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.034) 0:05:21.483 ********** 2021-04-09T18:21:43.971 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-04-09T18:21:43.973 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:44.003 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:43 +0000 (0:00:00.039) 0:05:21.522 ********** 2021-04-09T18:21:44.022 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-04-09T18:21:44.024 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'block_used': 13760147, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226334961, 'size_available': 927068000256, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149513, 'block_size': 4096, 'inode_available': 60905463}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226334961, "block_size": 4096, "block_total": 240095108, "block_used": 13760147, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905463, "inode_total": 61054976, "inode_used": 149513, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927068000256, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:44.050 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:44 +0000 (0:00:00.046) 0:05:21.569 ********** 2021-04-09T18:21:44.058 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-04-09T18:21:44.060 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:44.085 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:44 +0000 (0:00:00.035) 0:05:21.604 ********** 2021-04-09T18:21:44.098 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-04-09T18:21:44.100 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:44.128 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:44 +0000 (0:00:00.042) 0:05:21.647 ********** 2021-04-09T18:21:44.135 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-04-09T18:21:44.139 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:44.177 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:44 +0000 (0:00:00.048) 0:05:21.696 ********** 2021-04-09T18:21:44.185 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:44.187 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:44.215 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:44 +0000 (0:00:00.038) 0:05:21.735 ********** 2021-04-09T18:21:44.223 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-04-09T18:21:44.225 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-04-09T18:21:44.226 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:44.268 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:44 +0000 (0:00:00.052) 0:05:21.787 ********** 2021-04-09T18:21:44.300 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:44 +0000 (0:00:00.031) 0:05:21.819 ********** 2021-04-09T18:21:44.307 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-04-09T18:21:44.310 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:44.338 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:44 +0000 (0:00:00.038) 0:05:21.857 ********** 2021-04-09T18:21:44.381 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-04-09T18:21:44.383 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write /scratch_devs] ****************************************** 2021-04-09T18:21:44.383 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:21:44.423 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:44 +0000 (0:00:00.085) 0:05:21.943 ********** 2021-04-09T18:21:44.447 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-04-09T18:21:44.449 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:21:44.485 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:44 +0000 (0:00:00.061) 0:05:22.004 ********** 2021-04-09T18:21:44.502 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:44.557 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:44 +0000 (0:00:00.072) 0:05:22.077 ********** 2021-04-09T18:21:44.572 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:44.574 INFO:teuthology.task.ansible.out:TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi079.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:21:44.577 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:44.582 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi136.front.sepia.ceph.com] => (item={'block_used': 13760128, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226334980, 'size_available': 927068078080, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149513, 'block_size': 4096, 'inode_available': 60905463}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226334980, "block_size": 4096, "block_total": 240095108, "block_used": 13760128, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905463, "inode_total": 61054976, "inode_used": 149513, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927068078080, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:44.617 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:44 +0000 (0:00:00.059) 0:05:22.137 ********** 2021-04-09T18:21:44.656 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:44 +0000 (0:00:00.038) 0:05:22.175 ********** 2021-04-09T18:21:44.666 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:44.702 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:44 +0000 (0:00:00.046) 0:05:22.221 ********** 2021-04-09T18:21:44.709 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:44.711 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:44.738 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:44 +0000 (0:00:00.035) 0:05:22.257 ********** 2021-04-09T18:21:44.762 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:44 +0000 (0:00:00.023) 0:05:22.280 ********** 2021-04-09T18:21:44.778 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-04-09T18:21:44.780 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:44.809 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:44 +0000 (0:00:00.047) 0:05:22.328 ********** 2021-04-09T18:21:44.818 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:44.850 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:44 +0000 (0:00:00.040) 0:05:22.369 ********** 2021-04-09T18:21:44.891 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:44.893 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:44.918 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:44 +0000 (0:00:00.067) 0:05:22.437 ********** 2021-04-09T18:21:44.925 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-04-09T18:21:44.927 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:44.959 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-04-09T18:21:44.961 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:21:44.983 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:44 +0000 (0:00:00.065) 0:05:22.502 ********** 2021-04-09T18:21:44.990 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-04-09T18:21:44.992 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:45.017 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:45 +0000 (0:00:00.034) 0:05:22.537 ********** 2021-04-09T18:21:45.025 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:45.027 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-vf8QhQtGv1Ukrxh1i9Pq2BAuu1cVOjdQLbC9Q67R3jhc3HV7a4mpt0H4GK5XX8xg'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.103063", "end": "2021-04-09 18:21:44.968084", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-vf8QhQtGv1Ukrxh1i9Pq2BAuu1cVOjdQLbC9Q67R3jhc3HV7a4mpt0H4GK5XX8xg"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:43.865021", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:45.029 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:45.031 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-04-09T18:21:45.066 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:45 +0000 (0:00:00.048) 0:05:22.585 ********** 2021-04-09T18:21:45.075 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-04-09T18:21:45.077 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create volume group(s)] *************************************** changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-04-09T18:21:45.124 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:45 +0000 (0:00:00.058) 0:05:22.644 ********** 2021-04-09T18:21:45.156 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:45 +0000 (0:00:00.031) 0:05:22.675 ********** 2021-04-09T18:21:45.185 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-04-09T18:21:45.187 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:45.197 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-04-09T18:21:45.199 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:45.230 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:45 +0000 (0:00:00.074) 0:05:22.749 ********** 2021-04-09T18:21:45.446 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:45.492 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:45.637 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-04-09T18:21:45.664 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:45 +0000 (0:00:00.434) 0:05:23.184 ********** 2021-04-09T18:21:45.666 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:45.696 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-04-09T18:21:45.703 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true} 2021-04-09T18:21:45.741 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:45 +0000 (0:00:00.076) 0:05:23.260 ********** 2021-04-09T18:21:45.755 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-04-09T18:21:45.757 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:45.764 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:45.789 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:45 +0000 (0:00:00.048) 0:05:23.309 ********** 2021-04-09T18:21:45.973 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-04-09T18:21:45.975 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-04-09T18:21:46.012 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:46 +0000 (0:00:00.221) 0:05:23.531 ********** 2021-04-09T18:21:46.025 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:46.027 INFO:teuthology.task.ansible.out:TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:46.032 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:46.034 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:46.173 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-04-09T18:21:46.174 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-04-09T18:21:46.209 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:46 +0000 (0:00:00.196) 0:05:23.728 ********** 2021-04-09T18:21:46.238 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-04-09T18:21:46.240 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:21:46.259 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:46.272 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:46.300 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:46 +0000 (0:00:00.091) 0:05:23.820 ********** 2021-04-09T18:21:46.308 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-04-09T18:21:46.310 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:46.344 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-04-09T18:21:46.346 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:46.384 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:46 +0000 (0:00:00.082) 0:05:23.902 ********** 2021-04-09T18:21:46.392 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-04-09T18:21:46.393 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:21:46.425 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:46.477 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:46 +0000 (0:00:00.093) 0:05:23.996 ********** 2021-04-09T18:21:46.487 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-04-09T18:21:46.489 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-vf8QhQtGv1Ukrxh1i9Pq2BAuu1cVOjdQA1mIisledLzg2fxzoUFI7zBz0UjLEmG0'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.286653", "end": "2021-04-09 18:21:46.426440", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-vf8QhQtGv1Ukrxh1i9Pq2BAuu1cVOjdQA1mIisledLzg2fxzoUFI7zBz0UjLEmG0"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:45.139787", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:21:46.508 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:21:46.550 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:46 +0000 (0:00:00.073) 0:05:24.069 ********** 2021-04-09T18:21:46.552 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:46.558 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:46.559 INFO:teuthology.task.ansible.out:TASK [testnode : Restart cachefilesd] ****************************************** 2021-04-09T18:21:46.561 INFO:teuthology.task.ansible.out: skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:46.562 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:46.622 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:46 +0000 (0:00:00.072) 0:05:24.142 ********** 2021-04-09T18:21:46.625 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:46.641 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:46.643 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:46.714 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:46 +0000 (0:00:00.092) 0:05:24.234 ********** 2021-04-09T18:21:46.734 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-04-09T18:21:46.736 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:21:46.738 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:46.745 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** skipping: [smithi089.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:46.804 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:46 +0000 (0:00:00.089) 0:05:24.324 ********** 2021-04-09T18:21:46.823 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-04-09T18:21:46.826 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:46.858 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:46.897 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:46 +0000 (0:00:00.092) 0:05:24.416 ********** 2021-04-09T18:21:46.906 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-04-09T18:21:46.908 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-04-09T18:21:46.937 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:46 +0000 (0:00:00.039) 0:05:24.456 ********** 2021-04-09T18:21:46.950 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-04-09T18:21:46.953 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-04-09T18:21:46.989 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:46 +0000 (0:00:00.051) 0:05:24.508 ********** 2021-04-09T18:21:46.999 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-04-09T18:21:47.003 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-vf8QhQtGv1Ukrxh1i9Pq2BAuu1cVOjdQjzgdbWpWaWog5wxNvcyI228kPSQm7K1v'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.155977", "end": "2021-04-09 18:21:46.946683", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-vf8QhQtGv1Ukrxh1i9Pq2BAuu1cVOjdQjzgdbWpWaWog5wxNvcyI228kPSQm7K1v"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:46.790706", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.15102 s, 764 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.15102 s, 764 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:47.005 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:47.006 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:47.041 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:47 +0000 (0:00:00.051) 0:05:24.560 ********** 2021-04-09T18:21:47.116 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-04-09T18:21:47.118 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:47.167 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:47 +0000 (0:00:00.126) 0:05:24.686 ********** 2021-04-09T18:21:47.179 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-04-09T18:21:47.182 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : Write /scratch_devs] ****************************************** 2021-04-09T18:21:47.183 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:21:47.226 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:47 +0000 (0:00:00.059) 0:05:24.746 ********** 2021-04-09T18:21:47.241 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-04-09T18:21:47.243 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:21:47.289 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:47 +0000 (0:00:00.061) 0:05:24.808 ********** 2021-04-09T18:21:47.312 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-04-09T18:21:47.314 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:21:47.315 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-vf8QhQtGv1Ukrxh1i9Pq2BAuu1cVOjdQ5RzXhF5UqEF9JaAW8TkyOTgDxuxJVv4s'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.160621", "end": "2021-04-09 18:21:47.278530", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-vf8QhQtGv1Ukrxh1i9Pq2BAuu1cVOjdQ5RzXhF5UqEF9JaAW8TkyOTgDxuxJVv4s"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:47.117909", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156385 s, 738 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156385 s, 738 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:47.344 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XKPY', 'wwn-0x5000c5009293d715'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XKPY-part1', 'wwn-0x5000c5009293d715-part1'], 'uuids': ['c2492a7c-537b-4f45-893c-50f733187038']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009293d715', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XKPY', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XKPY", "wwn-0x5000c5009293d715"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XKPY-part1", "wwn-0x5000c5009293d715-part1"], "labels": [], "masters": [], "uuids": ["c2492a7c-537b-4f45-893c-50f733187038"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XKPY", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293d715"}}, "skip_reason": 2021-04-09T18:21:47.346 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-04-09T18:21:47.349 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:47.350 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-04-09T18:21:47.353 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-04-09T18:21:47.390 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:47 +0000 (0:00:00.101) 0:05:24.909 ********** 2021-04-09T18:21:47.402 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-04-09T18:21:47.402 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-04-09T18:21:47.438 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:47 +0000 (0:00:00.048) 0:05:24.958 ********** 2021-04-09T18:21:47.471 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-04-09T18:21:47.472 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:21:47.539 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:47.542 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-XNjd61-U0eU-oEgL-jkYn-6vzO-9oqk-jPfuG2', 'nvme-INTEL_SSDPEDMD400G4_PHFT62050085400BGN', 'nvme-nvme.8086-50484654363230353030383534303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.052971", "end": "2021-04-09 18:21:47.512935", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-XNjd61-U0eU-oEgL-jkYn-6vzO-9oqk-jPfuG2", "nvme-INTEL_SSDPEDMD400G4_PHFT62050085400BGN", "nvme-nvme.8086-50484654363230353030383534303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:47.459964", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0480457 s, 2.4 GB/s", "std 2021-04-09T18:21:47.544 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0480457 s, 2.4 GB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:47.554 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:47.566 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-04-09T18:21:47.569 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:47.569 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:47.593 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-04-09T18:21:47.594 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:21:47.606 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:47.643 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:47 +0000 (0:00:00.204) 0:05:25.162 ********** 2021-04-09T18:21:47.669 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-04-09T18:21:47.671 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-04-09T18:21:47.698 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:47 +0000 (0:00:00.055) 0:05:25.218 ********** 2021-04-09T18:21:47.705 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-04-09T18:21:47.707 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi089.front.sepia.ceph.com] => {"changed": true} 2021-04-09T18:21:47.708 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-04-09T18:21:47.708 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:21:47.737 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:47 +0000 (0:00:00.038) 0:05:25.256 ********** 2021-04-09T18:21:47.765 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:47 +0000 (0:00:00.028) 0:05:25.285 ********** 2021-04-09T18:21:47.798 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-04-09T18:21:47.800 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:47.839 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:47 +0000 (0:00:00.073) 0:05:25.359 ********** 2021-04-09T18:21:47.851 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-04-09T18:21:47.852 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:21:47.887 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-vf8QhQtGv1Ukrxh1i9Pq2BAuu1cVOjdQ2Xl0ptSuj8FK6JtudElBAeeEnxc3OOhq'], 'uuids': ['bd62b173-8563-4ff7-8d69-042ee58e42f1']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.165360", "end": "2021-04-09 18:21:47.859521", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-vf8QhQtGv1Ukrxh1i9Pq2BAuu1cVOjdQ2Xl0ptSuj8FK6JtudElBAeeEnxc3OOhq"], "labels": [], "masters": [], "uuids": ["bd62b173-8563-4ff7-8d69-042ee58e42f1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:47.694161", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.160613 s, 718 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.160613 s, 718 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:47.902 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:47.913 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:47.970 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-04-09T18:21:47.972 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:21:47.994 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:48.037 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:48 +0000 (0:00:00.197) 0:05:25.556 ********** 2021-04-09T18:21:48.045 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-04-09T18:21:48.046 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:21:48.075 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:48 +0000 (0:00:00.037) 0:05:25.594 ********** 2021-04-09T18:21:48.082 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-04-09T18:21:48.084 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:48.119 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:48 +0000 (0:00:00.044) 0:05:25.638 ********** 2021-04-09T18:21:48.132 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi089.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-04-09T18:21:48.134 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-04-09T18:21:48.134 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-04-09T18:21:48.136 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi090.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-04-09T18:21:48.162 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:48 +0000 (0:00:00.043) 0:05:25.682 ********** 2021-04-09T18:21:48.192 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:48 +0000 (0:00:00.028) 0:05:25.710 ********** 2021-04-09T18:21:48.213 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:48 +0000 (0:00:00.022) 0:05:25.732 ********** 2021-04-09T18:21:48.220 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-04-09T18:21:48.222 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:48.223 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-vf8QhQtGv1Ukrxh1i9Pq2BAuu1cVOjdQLbC9Q67R3jhc3HV7a4mpt0H4GK5XX8xg'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.156022", "end": "2021-04-09 18:21:48.189538", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-vf8QhQtGv1Ukrxh1i9Pq2BAuu1cVOjdQLbC9Q67R3jhc3HV7a4mpt0H4GK5XX8xg"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:48.033516", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.152814 s, 755 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.152814 s, 755 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:48.224 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:48.256 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:48 +0000 (0:00:00.042) 0:05:25.775 ********** 2021-04-09T18:21:48.279 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:48 +0000 (0:00:00.023) 0:05:25.798 ********** 2021-04-09T18:21:48.291 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:48.294 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:48.295 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:48.338 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:48 +0000 (0:00:00.058) 0:05:25.857 ********** 2021-04-09T18:21:48.369 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-04-09T18:21:48.372 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:48.400 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:48 +0000 (0:00:00.061) 0:05:25.919 ********** 2021-04-09T18:21:48.431 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-04-09T18:21:48.433 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:48.468 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:48 +0000 (0:00:00.068) 0:05:25.987 ********** 2021-04-09T18:21:48.475 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-04-09T18:21:48.477 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:21:48.515 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:48 +0000 (0:00:00.047) 0:05:26.035 ********** 2021-04-09T18:21:48.541 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:21:48.542 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-vf8QhQtGv1Ukrxh1i9Pq2BAuu1cVOjdQA1mIisledLzg2fxzoUFI7zBz0UjLEmG0'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.154382", "end": "2021-04-09 18:21:48.487060", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-vf8QhQtGv1Ukrxh1i9Pq2BAuu1cVOjdQA1mIisledLzg2fxzoUFI7zBz0UjLEmG0"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:21:48.332678", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.149502 s, 772 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.149502 s, 772 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:48.595 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:48 +0000 (0:00:00.077) 0:05:26.112 ********** 2021-04-09T18:21:48.602 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-04-09T18:21:48.637 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:48 +0000 (0:00:00.039) 0:05:26.152 ********** 2021-04-09T18:21:48.650 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-04-09T18:21:48.654 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-04-09T18:21:48.691 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:48 +0000 (0:00:00.059) 0:05:26.211 ********** 2021-04-09T18:21:48.846 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-04-09T18:21:48.848 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:21:48.877 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:48 +0000 (0:00:00.185) 0:05:26.396 ********** 2021-04-09T18:21:48.897 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-04-09T18:21:48.899 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true} TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi144.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.139895", "end": "2021-04-09 18:21:48.869800", "rc": 0, "start": "2021-04-09 18:21:48.729905", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:48.939 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:48 +0000 (0:00:00.061) 0:05:26.458 ********** 2021-04-09T18:21:48.971 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:48 +0000 (0:00:00.031) 0:05:26.490 ********** 2021-04-09T18:21:49.086 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-04-09T18:21:49.088 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:21:49.120 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:49 +0000 (0:00:00.149) 0:05:26.640 ********** 2021-04-09T18:21:49.149 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-04-09T18:21:49.152 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-04-09T18:21:49.176 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:49 +0000 (0:00:00.055) 0:05:26.695 ********** 2021-04-09T18:21:49.204 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-04-09T18:21:49.206 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:49.228 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:49 +0000 (0:00:00.052) 0:05:26.748 ********** 2021-04-09T18:21:49.246 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-04-09T18:21:49.248 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.135335", "end": "2021-04-09 18:21:49.223699", "rc": 0, "start": "2021-04-09 18:21:49.088364", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:49.286 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:49 +0000 (0:00:00.057) 0:05:26.805 ********** 2021-04-09T18:21:49.297 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-04-09T18:21:49.299 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload CPAN config for the teuthology user.] ****************** ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-04-09T18:21:49.331 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:49 +0000 (0:00:00.045) 0:05:26.851 ********** 2021-04-09T18:21:49.374 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:49 +0000 (0:00:00.042) 0:05:26.894 ********** 2021-04-09T18:21:49.385 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-04-09T18:21:49.387 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.047267", "end": "2021-04-09 18:21:49.292548", "rc": 0, "start": "2021-04-09 18:21:49.245281", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} TASK [testnode : Remove physical volumes] ************************************** 2021-04-09T18:21:49.421 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:49 +0000 (0:00:00.046) 0:05:26.941 ********** 2021-04-09T18:21:49.453 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:49 +0000 (0:00:00.031) 0:05:26.972 ********** 2021-04-09T18:21:49.464 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-04-09T18:21:49.466 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi090.front.sepia.ceph.com] => {"changed": true} 2021-04-09T18:21:49.498 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:49 +0000 (0:00:00.045) 0:05:27.017 ********** 2021-04-09T18:21:49.524 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:49 +0000 (0:00:00.026) 0:05:27.044 ********** 2021-04-09T18:21:49.548 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:49 +0000 (0:00:00.023) 0:05:27.067 ********** 2021-04-09T18:21:49.555 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:49.557 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:49.596 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:49 +0000 (0:00:00.048) 0:05:27.115 ********** 2021-04-09T18:21:49.640 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:49 +0000 (0:00:00.043) 0:05:27.159 ********** 2021-04-09T18:21:49.650 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-04-09T18:21:49.652 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:49.704 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:49 +0000 (0:00:00.064) 0:05:27.224 ********** 2021-04-09T18:21:49.726 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-04-09T18:21:49.728 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:49.774 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:49 +0000 (0:00:00.069) 0:05:27.293 ********** 2021-04-09T18:21:49.781 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-04-09T18:21:49.783 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi090.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-04-09T18:21:49.809 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:49 +0000 (0:00:00.035) 0:05:27.328 ********** 2021-04-09T18:21:49.834 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:49 +0000 (0:00:00.024) 0:05:27.353 ********** 2021-04-09T18:21:49.841 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-04-09T18:21:49.844 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:49.887 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:49 +0000 (0:00:00.052) 0:05:27.406 ********** 2021-04-09T18:21:49.898 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-04-09T18:21:49.900 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-04-09T18:21:49.947 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:49 +0000 (0:00:00.060) 0:05:27.466 ********** 2021-04-09T18:21:49.985 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:49 +0000 (0:00:00.037) 0:05:27.504 ********** 2021-04-09T18:21:49.992 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-04-09T18:21:49.993 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:49.994 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:50.023 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:50 +0000 (0:00:00.036) 0:05:27.541 ********** 2021-04-09T18:21:50.043 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:50 +0000 (0:00:00.021) 0:05:27.563 ********** 2021-04-09T18:21:50.061 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-04-09T18:21:50.063 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:50.090 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:50 +0000 (0:00:00.046) 0:05:27.609 ********** 2021-04-09T18:21:50.129 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-04-09T18:21:50.131 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:50.171 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:50 +0000 (0:00:00.081) 0:05:27.691 ********** 2021-04-09T18:21:50.179 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-04-09T18:21:50.180 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:21:50.210 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:50 +0000 (0:00:00.037) 0:05:27.729 ********** 2021-04-09T18:21:50.219 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-04-09T18:21:50.220 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:21:50.268 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:50 +0000 (0:00:00.059) 0:05:27.788 ********** 2021-04-09T18:21:50.344 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-04-09T18:21:50.346 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'block_used': 13760130, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226334978, 'size_available': 927068069888, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149513, 'block_size': 4096, 'inode_available': 60905463}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226334978, "block_size": 4096, "block_total": 240095108, "block_used": 13760130, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905463, "inode_total": 61054976, "inode_used": 149513, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927068069888, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:50.382 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:50 +0000 (0:00:00.113) 0:05:27.901 ********** 2021-04-09T18:21:50.392 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-04-09T18:21:50.394 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-04-09T18:21:50.428 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:50 +0000 (0:00:00.046) 0:05:27.947 ********** 2021-04-09T18:21:50.439 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-04-09T18:21:50.440 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:50.475 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:50 +0000 (0:00:00.046) 0:05:27.994 ********** 2021-04-09T18:21:50.522 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:50.525 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:50.571 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:50 +0000 (0:00:00.095) 0:05:28.090 ********** 2021-04-09T18:21:50.581 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-04-09T18:21:50.583 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:21:50.622 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:50 +0000 (0:00:00.050) 0:05:28.141 ********** 2021-04-09T18:21:50.631 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-04-09T18:21:50.633 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:50.635 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:50.636 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-04-09T18:21:50.636 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-04-09T18:21:50.669 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:50 +0000 (0:00:00.047) 0:05:28.189 ********** 2021-04-09T18:21:50.692 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:50 +0000 (0:00:00.023) 0:05:28.212 ********** 2021-04-09T18:21:50.722 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:50 +0000 (0:00:00.025) 0:05:28.238 ********** 2021-04-09T18:21:50.737 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:50.777 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:50 +0000 (0:00:00.058) 0:05:28.297 ********** 2021-04-09T18:21:50.789 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-04-09T18:21:50.791 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} TASK [testnode : Create volume_groups dict] ************************************ 2021-04-09T18:21:50.792 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:50.833 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:50 +0000 (0:00:00.055) 0:05:28.352 ********** 2021-04-09T18:21:50.877 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:50 +0000 (0:00:00.043) 0:05:28.396 ********** 2021-04-09T18:21:50.915 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:50.941 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:50 +0000 (0:00:00.064) 0:05:28.461 ********** 2021-04-09T18:21:50.979 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-04-09T18:21:50.981 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:51.004 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:50 +0000 (0:00:00.062) 0:05:28.523 ********** 2021-04-09T18:21:51.031 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-04-09T18:21:51.033 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.046861", "end": "2021-04-09 18:21:51.013529", "rc": 0, "start": "2021-04-09 18:21:50.966668", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2021-04-09T18:21:51.059 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:51 +0000 (0:00:00.054) 0:05:28.578 ********** 2021-04-09T18:21:51.092 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-04-09T18:21:51.093 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-04-09T18:21:51.094 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-04-09T18:21:51.095 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-04-09T18:21:51.123 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:51 +0000 (0:00:00.064) 0:05:28.643 ********** 2021-04-09T18:21:51.171 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:51 +0000 (0:00:00.046) 0:05:28.690 ********** 2021-04-09T18:21:51.193 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-04-09T18:21:51.195 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the ntp.conf file.] ************************************ 2021-04-09T18:21:51.196 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-04-09T18:21:51.245 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:51 +0000 (0:00:00.072) 0:05:28.763 ********** 2021-04-09T18:21:51.280 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:51 +0000 (0:00:00.035) 0:05:28.800 ********** 2021-04-09T18:21:51.301 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-04-09T18:21:51.302 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:51.330 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:51 +0000 (0:00:00.049) 0:05:28.849 ********** 2021-04-09T18:21:51.342 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-04-09T18:21:51.343 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:51.373 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:51 +0000 (0:00:00.043) 0:05:28.893 ********** 2021-04-09T18:21:51.393 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-04-09T18:21:51.395 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-04-09T18:21:51.433 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:51 +0000 (0:00:00.059) 0:05:28.952 ********** 2021-04-09T18:21:51.564 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:51.566 INFO:teuthology.task.ansible.out:TASK [testnode : Make sure ntpd is running.] *********************************** 2021-04-09T18:21:51.568 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-04-09 18:14:52 UTC", "ActiveEnterTimestampMonotonic": "25882438", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket systemd-tmpfiles-setup.service sysinit.target basic.target system.slice -.mount network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-04-09 18:14:46 UTC", "AssertTimestampMonotonic": "19424059", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-04-09 18:14:46 UTC", "ConditionTimestampMonotonic": "19424059", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2021-04-09T18:21:51.569 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1844", "ExecMainStartTimestamp": "Fri 2021-04-09 18:14:52 UTC", "ExecMainStartTimestampMonotonic": "25882393", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-04-09 18:14:46 UTC", "InactiveExitTimestampMonotonic": "19424819", "InvocationID": "f603c0dc1ccc4a85a423da7b09fa23db", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2021-04-09T18:21:51.571 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1844", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-04-09 18:14:52 UTC", "S 2021-04-09T18:21:51.573 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "25882438", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-04-09 18:14:52 UTC", "WatchdogTimestampMonotonic": "25882435", "WatchdogUSec": "0"}} 2021-04-09T18:21:51.610 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:51 +0000 (0:00:00.176) 0:05:29.129 ********** 2021-04-09T18:21:51.639 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:51.641 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-04-09T18:21:51.663 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:51 +0000 (0:00:00.053) 0:05:29.182 ********** 2021-04-09T18:21:51.691 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:51.693 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:51.726 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:51 +0000 (0:00:00.063) 0:05:29.246 ********** 2021-04-09T18:21:51.756 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-04-09T18:21:51.758 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:51.789 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:51 +0000 (0:00:00.063) 0:05:29.309 ********** 2021-04-09T18:21:52.014 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:52.135 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-04-09T18:21:52.137 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1617992386, "cache_updated": false, "changed": false} 2021-04-09T18:21:52.183 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:52 +0000 (0:00:00.393) 0:05:29.702 ********** 2021-04-09T18:21:52.193 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-04-09T18:21:52.220 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:52 +0000 (0:00:00.037) 0:05:29.739 ********** 2021-04-09T18:21:52.250 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-04-09T18:21:52.252 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:21:52.282 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:52 +0000 (0:00:00.061) 0:05:29.801 ********** 2021-04-09T18:21:52.291 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-04-09T18:21:52.293 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:52.315 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-04-09T18:21:52.316 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:52.340 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:52 +0000 (0:00:00.058) 0:05:29.859 ********** 2021-04-09T18:21:52.359 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-04-09T18:21:52.361 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.036294", "end": "2021-04-09 18:21:52.337267", "rc": 0, "start": "2021-04-09 18:21:52.300973", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2021-04-09T18:21:52.387 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:52 +0000 (0:00:00.047) 0:05:29.907 ********** 2021-04-09T18:21:52.427 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-04-09T18:21:52.429 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:52.452 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:52 +0000 (0:00:00.065) 0:05:29.972 ********** 2021-04-09T18:21:52.482 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-04-09T18:21:52.484 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:52.508 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:52 +0000 (0:00:00.054) 0:05:30.026 ********** 2021-04-09T18:21:52.536 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-04-09T18:21:52.538 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:52.655 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-04-09T18:21:52.656 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:21:52.682 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:52 +0000 (0:00:00.174) 0:05:30.201 ********** 2021-04-09T18:21:52.689 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-04-09T18:21:52.690 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-04-09T18:21:52.716 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:52 +0000 (0:00:00.033) 0:05:30.235 ********** 2021-04-09T18:21:52.723 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-04-09T18:21:52.725 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:52.749 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:52 +0000 (0:00:00.033) 0:05:30.269 ********** 2021-04-09T18:21:52.757 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-04-09T18:21:52.758 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:52.787 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:52 +0000 (0:00:00.037) 0:05:30.306 ********** 2021-04-09T18:21:52.795 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-04-09T18:21:52.797 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:21:52.825 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:52 +0000 (0:00:00.037) 0:05:30.344 ********** 2021-04-09T18:21:52.888 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-04-09T18:21:52.890 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-04-09T18:21:52.923 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:52 +0000 (0:00:00.098) 0:05:30.443 ********** 2021-04-09T18:21:52.973 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-04-09T18:21:52.975 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-04-09T18:21:53.002 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:52 +0000 (0:00:00.078) 0:05:30.522 ********** 2021-04-09T18:21:53.010 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-04-09T18:21:53.012 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-04-09 18:14:53 UTC", "ActiveEnterTimestampMonotonic": "23607418", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target systemd-tmpfiles-setup.service basic.target systemd-journald.socket system.slice sysinit.target -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-04-09 18:14:45 UTC", "AssertTimestampMonotonic": "17060079", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-04-09 18:14:45 UTC", "ConditionTimestampMonotonic": "17060079", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2021-04-09T18:21:53.014 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1824", "ExecMainStartTimestamp": "Fri 2021-04-09 18:14:53 UTC", "ExecMainStartTimestampMonotonic": "23607390", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-04-09 18:14:45 UTC", "InactiveExitTimestampMonotonic": "17060845", "InvocationID": "617b390d00774268ae2bfd9c2270f6bd", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128028", "LimitNPROCSoft": "128028", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2021-04-09T18:21:53.015 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128028", "LimitSIGPENDINGSoft": "128028", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1824", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-04-09 18:14:53 UTC", "S 2021-04-09T18:21:53.017 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "23607418", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-04-09 18:14:53 UTC", "WatchdogTimestampMonotonic": "23607415", "WatchdogUSec": "0"}} 2021-04-09T18:21:53.043 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:53 +0000 (0:00:00.040) 0:05:30.562 ********** 2021-04-09T18:21:53.073 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:53.075 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-04-09T18:21:53.098 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:53 +0000 (0:00:00.054) 0:05:30.617 ********** 2021-04-09T18:21:53.127 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:53.129 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:53.162 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:53 +0000 (0:00:00.063) 0:05:30.681 ********** 2021-04-09T18:21:53.171 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-04-09T18:21:53.173 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"cache_update_time": 1617992385, "cache_updated": false, "changed": false} TASK [testnode : Write /scratch_devs] ****************************************** 2021-04-09T18:21:53.174 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:21:53.200 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:53 +0000 (0:00:00.037) 0:05:30.719 ********** 2021-04-09T18:21:53.206 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-04-09T18:21:53.208 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:53.238 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:53 +0000 (0:00:00.038) 0:05:30.757 ********** 2021-04-09T18:21:53.256 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-04-09T18:21:53.257 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-04-09T18:21:53.286 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:53 +0000 (0:00:00.047) 0:05:30.805 ********** 2021-04-09T18:21:53.294 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-04-09T18:21:53.296 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:21:53.392 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-04-09T18:21:53.394 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.046613", "end": "2021-04-09 18:21:53.368142", "rc": 0, "start": "2021-04-09 18:21:53.321529", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2021-04-09T18:21:53.423 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:53 +0000 (0:00:00.136) 0:05:30.942 ********** 2021-04-09T18:21:53.429 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-04-09T18:21:53.431 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:21:53.431 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-04-09T18:21:53.432 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1617992386, "cache_updated": false, "changed": false} 2021-04-09T18:21:53.464 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:53 +0000 (0:00:00.040) 0:05:30.983 ********** 2021-04-09T18:21:53.474 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-04-09T18:21:53.476 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:53.500 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:53 +0000 (0:00:00.036) 0:05:31.019 ********** 2021-04-09T18:21:53.508 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-04-09T18:21:53.509 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:53.542 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:53 +0000 (0:00:00.041) 0:05:31.061 ********** 2021-04-09T18:21:53.550 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-04-09T18:21:53.552 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi144.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:21:53.554 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:53.591 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:53 +0000 (0:00:00.049) 0:05:31.111 ********** 2021-04-09T18:21:53.593 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:53.621 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:53 +0000 (0:00:00.030) 0:05:31.141 ********** 2021-04-09T18:21:53.650 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-04-09T18:21:53.651 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:53.684 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:53 +0000 (0:00:00.061) 0:05:31.203 ********** 2021-04-09T18:21:53.714 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-04-09T18:21:53.715 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:53.753 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:53 +0000 (0:00:00.069) 0:05:31.272 ********** 2021-04-09T18:21:53.892 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-04-09T18:21:53.894 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-04-09T18:21:53.928 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:53 +0000 (0:00:00.175) 0:05:31.447 ********** 2021-04-09T18:21:53.939 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-04-09T18:21:53.940 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:21:53.979 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:53 +0000 (0:00:00.051) 0:05:31.499 ********** 2021-04-09T18:21:53.986 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-04-09T18:21:53.988 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:54.013 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:54 +0000 (0:00:00.033) 0:05:31.532 ********** 2021-04-09T18:21:54.031 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-04-09T18:21:54.032 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-04-09T18:21:54.057 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:54 +0000 (0:00:00.043) 0:05:31.576 ********** 2021-04-09T18:21:54.119 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi089.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:21:54.145 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:54 +0000 (0:00:00.087) 0:05:31.664 ********** 2021-04-09T18:21:54.177 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-04-09T18:21:54.179 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:54.204 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:54 +0000 (0:00:00.059) 0:05:31.724 ********** 2021-04-09T18:21:54.235 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-04-09T18:21:54.238 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-04-09 18:15:12 UTC", "ActiveEnterTimestampMonotonic": "26269248", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target systemd-journald.socket -.mount network.target system.slice sysinit.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-04-09 18:15:06 UTC", "AssertTimestampMonotonic": "19688112", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-04-09 18:15:06 UTC", "ConditionTimestampMonotonic": "19688111", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2021-04-09T18:21:54.239 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1910", "ExecMainStartTimestamp": "Fri 2021-04-09 18:15:12 UTC", "ExecMainStartTimestampMonotonic": "26269199", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-04-09 18:15:06 UTC", "InactiveExitTimestampMonotonic": "19688853", "InvocationID": "e887b92105c8401b95ff5f0c8255266d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2021-04-09T18:21:54.241 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1910", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-04-09 18:15:12 UTC", "S 2021-04-09T18:21:54.243 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "26269248", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-04-09 18:15:12 UTC", "WatchdogTimestampMonotonic": "26269246", "WatchdogUSec": "0"}} 2021-04-09T18:21:54.267 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:54 +0000 (0:00:00.063) 0:05:31.787 ********** 2021-04-09T18:21:54.285 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-04-09T18:21:54.287 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-04-09T18:21:54.310 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:54 +0000 (0:00:00.042) 0:05:31.829 ********** 2021-04-09T18:21:54.318 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-04-09T18:21:54.319 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"changed": true} TASK [testnode : set_fact] ***************************************************** ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-04-09T18:21:54.361 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:54 +0000 (0:00:00.051) 0:05:31.881 ********** 2021-04-09T18:21:54.538 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:54 +0000 (0:00:00.176) 0:05:32.057 ********** 2021-04-09T18:21:54.546 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-04-09T18:21:54.548 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} TASK [testnode : set_fact] ***************************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install ntp package on apt based systems.] ******************** ok: [smithi090.front.sepia.ceph.com] => {"cache_update_time": 1617992385, "cache_updated": false, "changed": false} 2021-04-09T18:21:54.584 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:54 +0000 (0:00:00.045) 0:05:32.103 ********** 2021-04-09T18:21:54.611 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:54 +0000 (0:00:00.027) 0:05:32.131 ********** 2021-04-09T18:21:54.639 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:54 +0000 (0:00:00.028) 0:05:32.159 ********** 2021-04-09T18:21:54.646 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-04-09T18:21:54.648 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:54.676 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:54 +0000 (0:00:00.036) 0:05:32.195 ********** 2021-04-09T18:21:54.683 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-04-09T18:21:54.685 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:54.709 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:54 +0000 (0:00:00.033) 0:05:32.229 ********** 2021-04-09T18:21:54.758 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-04-09T18:21:54.760 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-04-09T18:21:54.791 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:54 +0000 (0:00:00.081) 0:05:32.310 ********** 2021-04-09T18:21:54.831 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-04-09T18:21:54.833 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Purge resolvconf] ********************************************* ok: [smithi079.front.sepia.ceph.com] => {"changed": false} 2021-04-09T18:21:54.859 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:54 +0000 (0:00:00.068) 0:05:32.378 ********** 2021-04-09T18:21:54.885 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:54 +0000 (0:00:00.026) 0:05:32.405 ********** 2021-04-09T18:21:54.902 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-04-09T18:21:54.904 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-04-09T18:21:54.927 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:54 +0000 (0:00:00.041) 0:05:32.446 ********** 2021-04-09T18:21:54.934 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-04-09T18:21:54.936 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:54.961 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:54 +0000 (0:00:00.034) 0:05:32.480 ********** 2021-04-09T18:21:54.969 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-04-09T18:21:54.971 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-04-09T18:21:55.000 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:54 +0000 (0:00:00.038) 0:05:32.519 ********** 2021-04-09T18:21:55.009 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-04-09T18:21:55.011 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:55.051 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:55 +0000 (0:00:00.050) 0:05:32.570 ********** 2021-04-09T18:21:55.059 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-04-09T18:21:55.060 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-04-09T18:21:55.098 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:55 +0000 (0:00:00.047) 0:05:32.618 ********** 2021-04-09T18:21:55.113 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-04-09T18:21:55.114 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1617991738.427894, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1617991738.4238942, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 262873, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1617991738.4238942, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3476867264", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-04-09T18:21:55.115 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:55.139 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:55 +0000 (0:00:00.040) 0:05:32.658 ********** 2021-04-09T18:21:55.161 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:55 +0000 (0:00:00.022) 0:05:32.680 ********** 2021-04-09T18:21:55.168 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-04-09T18:21:55.170 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:55.195 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:55 +0000 (0:00:00.033) 0:05:32.714 ********** 2021-04-09T18:21:55.341 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-04-09T18:21:55.343 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-04-09T18:21:55.367 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:55 +0000 (0:00:00.172) 0:05:32.887 ********** 2021-04-09T18:21:55.407 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-04-09T18:21:55.408 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-04-09 18:15:23 UTC", "ActiveEnterTimestampMonotonic": "28831228", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target basic.target system.slice systemd-tmpfiles-setup.service systemd-journald.socket -.mount network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-04-09 18:15:17 UTC", "AssertTimestampMonotonic": "22320072", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-04-09 18:15:17 UTC", "ConditionTimestampMonotonic": "22320072", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2021-04-09T18:21:55.410 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1830", "ExecMainStartTimestamp": "Fri 2021-04-09 18:15:23 UTC", "ExecMainStartTimestampMonotonic": "28831216", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-04-09 18:15:17 UTC", "InactiveExitTimestampMonotonic": "22320852", "InvocationID": "1f93d1202aef475da32d9d71041ba637", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128028", "LimitNPROCSoft": "128028", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2021-04-09T18:21:55.411 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128028", "LimitSIGPENDINGSoft": "128028", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1830", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-04-09 18:15:23 UTC", "S 2021-04-09T18:21:55.413 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "28831228", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-04-09 18:15:23 UTC", "WatchdogTimestampMonotonic": "28831227", "WatchdogUSec": "0"}} TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-04-09T18:21:55.436 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:55 +0000 (0:00:00.068) 0:05:32.955 ********** 2021-04-09T18:21:55.460 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:55 +0000 (0:00:00.023) 0:05:32.979 ********** 2021-04-09T18:21:55.462 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:55.481 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-04-09T18:21:55.483 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-04-09T18:21:55.517 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:55 +0000 (0:00:00.053) 0:05:33.032 ********** 2021-04-09T18:21:55.526 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:55.527 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-04-09T18:21:55.553 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:55 +0000 (0:00:00.040) 0:05:33.073 ********** 2021-04-09T18:21:55.561 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-04-09T18:21:55.562 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:21:55.564 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:55.592 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:55 +0000 (0:00:00.039) 0:05:33.112 ********** 2021-04-09T18:21:55.629 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:55 +0000 (0:00:00.036) 0:05:33.148 ********** 2021-04-09T18:21:55.638 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:55.640 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1617992386, "cache_updated": false, "changed": false} 2021-04-09T18:21:55.674 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:55 +0000 (0:00:00.044) 0:05:33.194 ********** 2021-04-09T18:21:55.712 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:55 +0000 (0:00:00.037) 0:05:33.231 ********** 2021-04-09T18:21:56.004 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 09 April 2021 18:21:55 +0000 (0:00:00.039) 0:05:33.271 ********** TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi079.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 09 April 2021 18:21:55 +0000 (0:00:00.055) 0:05:33.327 ********** Friday 09 April 2021 18:21:55 +0000 (0:00:00.042) 0:05:33.370 ********** TASK [testnode : Install packages via pip] ************************************* ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} Friday 09 April 2021 18:21:55 +0000 (0:00:00.044) 0:05:33.415 ********** TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [s 2021-04-09T18:21:56.007 INFO:teuthology.task.ansible.out:mithi079.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-04-09T18:21:56.018 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.123) 0:05:33.538 ********** 2021-04-09T18:21:56.026 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-04-09T18:21:56.028 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-04-09T18:21:56.030 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-04-09T18:21:56.059 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.040) 0:05:33.578 ********** 2021-04-09T18:21:56.082 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.023) 0:05:33.602 ********** 2021-04-09T18:21:56.091 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-04-09T18:21:56.093 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:56.121 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.039) 0:05:33.641 ********** 2021-04-09T18:21:56.160 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-04-09T18:21:56.162 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:56.172 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:56.174 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:56.198 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.076) 0:05:33.717 ********** 2021-04-09T18:21:56.236 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-04-09T18:21:56.237 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:56.259 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:56.261 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:56.271 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:56.302 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.104) 0:05:33.822 ********** 2021-04-09T18:21:56.330 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:56.331 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:56.357 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.054) 0:05:33.877 ********** 2021-04-09T18:21:56.387 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-04-09T18:21:56.389 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:56.412 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.054) 0:05:33.931 ********** 2021-04-09T18:21:56.420 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-04-09T18:21:56.422 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-04-09T18:21:56.448 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.036) 0:05:33.968 ********** 2021-04-09T18:21:56.456 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-04-09T18:21:56.458 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:56.458 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* ok: [smithi089.front.sepia.ceph.com] => {"changed": false} 2021-04-09T18:21:56.489 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.040) 0:05:34.008 ********** 2021-04-09T18:21:56.513 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.024) 0:05:34.032 ********** 2021-04-09T18:21:56.535 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.022) 0:05:34.055 ********** 2021-04-09T18:21:56.543 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-04-09T18:21:56.545 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set interface] ************************************************ ok: [smithi089.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-04-09T18:21:56.570 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.035) 0:05:34.090 ********** 2021-04-09T18:21:56.596 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.025) 0:05:34.115 ********** 2021-04-09T18:21:56.603 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-04-09T18:21:56.605 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:56.642 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.046) 0:05:34.161 ********** 2021-04-09T18:21:56.672 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-04-09T18:21:56.674 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:56.711 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.068) 0:05:34.230 ********** 2021-04-09T18:21:56.728 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-04-09T18:21:56.731 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"cache_update_time": 1617992385, "cache_updated": false, "changed": false} 2021-04-09T18:21:56.754 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.042) 0:05:34.273 ********** 2021-04-09T18:21:56.764 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-04-09T18:21:56.764 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1617991517.0556986, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1617991517.0516987, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 262873, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1617991517.0516987, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3476867264", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-04-09T18:21:56.766 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-04-09T18:21:56.768 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:56.801 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.046) 0:05:34.320 ********** 2021-04-09T18:21:56.823 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.022) 0:05:34.342 ********** 2021-04-09T18:21:56.831 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-04-09T18:21:56.833 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:56.858 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.034) 0:05:34.377 ********** 2021-04-09T18:21:56.879 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.021) 0:05:34.399 ********** 2021-04-09T18:21:56.950 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-04-09T18:21:56.952 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-04-09T18:21:56.979 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:56 +0000 (0:00:00.099) 0:05:34.498 ********** 2021-04-09T18:21:57.009 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-04-09T18:21:57.011 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-04-09T18:21:57.033 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.053) 0:05:34.552 ********** 2021-04-09T18:21:57.040 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-04-09T18:21:57.042 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011068", "end": "2021-04-09 18:21:56.988970", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-04-09 18:21:56.977902", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:57.043 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-04-09T18:21:57.045 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-04-09T18:21:57.069 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.036) 0:05:34.589 ********** 2021-04-09T18:21:57.071 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:57.078 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-04-09T18:21:57.079 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:57.081 INFO:teuthology.task.ansible.out: 2021-04-09T18:21:57.106 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.036) 0:05:34.625 ********** 2021-04-09T18:21:57.134 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-04-09T18:21:57.136 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006094", "end": "2021-04-09 18:21:57.111527", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-04-09 18:21:57.105433", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:57.221 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-04-09T18:21:57.223 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-04-09T18:21:57.252 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.146) 0:05:34.772 ********** 2021-04-09T18:21:57.262 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-04-09T18:21:57.264 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi079.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005582", "end": "2021-04-09 18:21:57.233072", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-04-09 18:21:57.227490", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:57.289 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.037) 0:05:34.809 ********** 2021-04-09T18:21:57.381 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.007810", "end": "2021-04-09 18:21:57.354710", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-04-09 18:21:57.346900", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:57.409 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.119) 0:05:34.928 ********** 2021-04-09T18:21:57.417 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-04-09T18:21:57.418 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-04-09T18:21:57.420 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi089.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-04-09T18:21:57.444 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.035) 0:05:34.964 ********** 2021-04-09T18:21:57.472 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.027) 0:05:34.992 ********** 2021-04-09T18:21:57.480 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-04-09T18:21:57.481 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-04-09T18:21:57.481 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"cache_update_time": 1617992393, "cache_updated": false, "changed": false} 2021-04-09T18:21:57.483 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:57.508 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.035) 0:05:35.027 ********** 2021-04-09T18:21:57.531 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.023) 0:05:35.050 ********** 2021-04-09T18:21:57.557 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.025) 0:05:35.076 ********** 2021-04-09T18:21:57.576 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-04-09T18:21:57.577 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:57.587 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:57.589 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:57.599 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:57.627 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.070) 0:05:35.147 ********** 2021-04-09T18:21:57.645 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-04-09T18:21:57.647 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-04-09T18:21:57.673 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi089.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:57.696 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:57.698 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi089.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:57.723 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.095) 0:05:35.242 ********** 2021-04-09T18:21:57.751 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:57.753 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.046350", "end": "2021-04-09 18:21:57.730699", "rc": 0, "start": "2021-04-09 18:21:57.684349", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2021-04-09T18:21:57.778 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.055) 0:05:35.298 ********** 2021-04-09T18:21:57.800 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.021) 0:05:35.319 ********** 2021-04-09T18:21:57.806 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-04-09T18:21:57.808 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false} TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:57.834 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.034) 0:05:35.353 ********** 2021-04-09T18:21:57.857 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.022) 0:05:35.376 ********** 2021-04-09T18:21:57.865 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-04-09T18:21:57.866 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:57.905 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.048) 0:05:35.424 ********** 2021-04-09T18:21:57.936 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.031) 0:05:35.456 ********** 2021-04-09T18:21:57.944 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-04-09T18:21:57.946 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:57.971 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.034) 0:05:35.491 ********** 2021-04-09T18:21:57.993 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:57 +0000 (0:00:00.021) 0:05:35.512 ********** 2021-04-09T18:21:58.001 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-04-09T18:21:58.003 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:58.033 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:58 +0000 (0:00:00.040) 0:05:35.553 ********** 2021-04-09T18:21:58.059 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:58 +0000 (0:00:00.025) 0:05:35.578 ********** 2021-04-09T18:21:58.066 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-04-09T18:21:58.067 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:58.095 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:58 +0000 (0:00:00.036) 0:05:35.615 ********** 2021-04-09T18:21:58.124 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-04-09T18:21:58.125 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:58.153 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:58 +0000 (0:00:00.058) 0:05:35.673 ********** 2021-04-09T18:21:58.161 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-04-09T18:21:58.162 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1617991684.2755308, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1617991684.2715309, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 262873, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1617991684.2715309, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3476867264", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-04-09T18:21:58.187 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:58 +0000 (0:00:00.034) 0:05:35.707 ********** 2021-04-09T18:21:58.194 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-04-09T18:21:58.196 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:58.223 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:58 +0000 (0:00:00.035) 0:05:35.742 ********** 2021-04-09T18:21:58.271 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-04-09T18:21:58.273 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-04-09T18:21:58.296 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:58 +0000 (0:00:00.073) 0:05:35.815 ********** 2021-04-09T18:21:58.323 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-04-09T18:21:58.325 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-04-09T18:21:58.349 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:58 +0000 (0:00:00.052) 0:05:35.868 ********** 2021-04-09T18:21:58.378 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-04-09T18:21:58.380 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010991", "end": "2021-04-09 18:21:58.352759", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-04-09 18:21:58.341768", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:58.381 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-04-09T18:21:58.381 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-04-09T18:21:58.424 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:58 +0000 (0:00:00.075) 0:05:35.943 ********** 2021-04-09T18:21:58.454 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:58.477 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:58 +0000 (0:00:00.053) 0:05:35.996 ********** 2021-04-09T18:21:58.506 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-04-09T18:21:58.507 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006170", "end": "2021-04-09 18:21:58.478895", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-04-09 18:21:58.472725", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:58.624 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-04-09T18:21:58.626 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-04-09T18:21:58.651 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:58 +0000 (0:00:00.173) 0:05:36.170 ********** 2021-04-09T18:21:58.661 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-04-09T18:21:58.663 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005580", "end": "2021-04-09 18:21:58.610300", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-04-09 18:21:58.604720", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:58.759 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.007309", "end": "2021-04-09 18:21:58.735981", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-04-09 18:21:58.728672", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:58.797 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:58 +0000 (0:00:00.146) 0:05:36.316 ********** 2021-04-09T18:21:58.805 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-04-09T18:21:58.807 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-04-09T18:21:58.835 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:58 +0000 (0:00:00.037) 0:05:36.354 ********** 2021-04-09T18:21:58.845 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-04-09T18:21:58.847 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* ok: [smithi090.front.sepia.ceph.com] => {"changed": false} 2021-04-09T18:21:58.873 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:58 +0000 (0:00:00.038) 0:05:36.393 ********** 2021-04-09T18:21:58.896 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:58 +0000 (0:00:00.022) 0:05:36.416 ********** 2021-04-09T18:21:58.904 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-04-09T18:21:58.905 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:58.931 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:58 +0000 (0:00:00.034) 0:05:36.450 ********** 2021-04-09T18:21:58.938 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-04-09T18:21:58.940 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-04-09T18:21:58.968 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:58 +0000 (0:00:00.036) 0:05:36.487 ********** 2021-04-09T18:21:58.975 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-04-09T18:21:58.977 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"cache_update_time": 1617992393, "cache_updated": false, "changed": false} TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi136.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:59.002 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:58 +0000 (0:00:00.033) 0:05:36.521 ********** 2021-04-09T18:21:59.009 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:59.011 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-04-09T18:21:59.038 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.036) 0:05:36.558 ********** 2021-04-09T18:21:59.045 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-04-09T18:21:59.046 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:59.093 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.054) 0:05:36.612 ********** 2021-04-09T18:21:59.101 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-04-09T18:21:59.104 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi136.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:59.106 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:59.106 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:59.108 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:59.148 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.055) 0:05:36.668 ********** 2021-04-09T18:21:59.155 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-04-09T18:21:59.155 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1617991491.89561, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1617991491.8916101, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 262873, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1617991491.8916101, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3476867264", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-04-09T18:21:59.185 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.036) 0:05:36.704 ********** 2021-04-09T18:21:59.192 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:59.195 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:59.220 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.035) 0:05:36.739 ********** 2021-04-09T18:21:59.248 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-04-09T18:21:59.250 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:59.272 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.051) 0:05:36.791 ********** 2021-04-09T18:21:59.298 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-04-09T18:21:59.300 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:59.329 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.057) 0:05:36.848 ********** 2021-04-09T18:21:59.335 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-04-09T18:21:59.337 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-04-09T18:21:59.361 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.031) 0:05:36.880 ********** 2021-04-09T18:21:59.368 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-04-09T18:21:59.370 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:59.403 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.042) 0:05:36.923 ********** 2021-04-09T18:21:59.410 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-04-09T18:21:59.412 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-04-09T18:21:59.440 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.036) 0:05:36.959 ********** 2021-04-09T18:21:59.449 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-04-09T18:21:59.451 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-04-09T18:21:59.452 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:59.489 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.048) 0:05:37.008 ********** 2021-04-09T18:21:59.517 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.028) 0:05:37.036 ********** 2021-04-09T18:21:59.524 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-04-09T18:21:59.526 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:59.555 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.038) 0:05:37.074 ********** 2021-04-09T18:21:59.584 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.029) 0:05:37.103 ********** 2021-04-09T18:21:59.594 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-04-09T18:21:59.596 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:59.623 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.038) 0:05:37.142 ********** 2021-04-09T18:21:59.630 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:59.658 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.035) 0:05:37.178 ********** 2021-04-09T18:21:59.688 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-04-09T18:21:59.690 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:59.714 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.055) 0:05:37.233 ********** 2021-04-09T18:21:59.724 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-04-09T18:21:59.724 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-04-09T18:21:59.759 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.044) 0:05:37.278 ********** 2021-04-09T18:21:59.833 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-04-09T18:21:59.835 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-04-09 18:15:13 UTC", "ActiveEnterTimestampMonotonic": "25297836", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target system.slice basic.target systemd-tmpfiles-setup.service systemd-journald.socket network.target -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-04-09 18:15:07 UTC", "AssertTimestampMonotonic": "18712062", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-04-09 18:15:07 UTC", "ConditionTimestampMonotonic": "18712061", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2021-04-09T18:21:59.837 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1812", "ExecMainStartTimestamp": "Fri 2021-04-09 18:15:13 UTC", "ExecMainStartTimestampMonotonic": "25297823", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-04-09 18:15:07 UTC", "InactiveExitTimestampMonotonic": "18712761", "InvocationID": "93d16f87bfd549f8be83de7202447ab4", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2021-04-09T18:21:59.838 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1812", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-04-09 18:15:13 UTC", "S 2021-04-09T18:21:59.840 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "25297836", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-04-09 18:15:13 UTC", "WatchdogTimestampMonotonic": "25297835", "WatchdogUSec": "0"}} 2021-04-09T18:21:59.868 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.109) 0:05:37.387 ********** 2021-04-09T18:21:59.886 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-04-09T18:21:59.888 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011021", "end": "2021-04-09 18:21:59.855434", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-04-09 18:21:59.844413", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:21:59.898 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:21:59.900 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi090.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-04-09T18:21:59.930 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.062) 0:05:37.449 ********** 2021-04-09T18:21:59.959 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.028) 0:05:37.478 ********** 2021-04-09T18:21:59.967 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-04-09T18:21:59.969 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:21:59.998 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:21:59 +0000 (0:00:00.039) 0:05:37.517 ********** 2021-04-09T18:22:00.005 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:22:00.007 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:00.041 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:00 +0000 (0:00:00.042) 0:05:37.560 ********** 2021-04-09T18:22:00.053 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-04-09T18:22:00.060 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006000", "end": "2021-04-09 18:21:59.993090", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-04-09 18:21:59.987090", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi090.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-04-09T18:22:00.093 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:00 +0000 (0:00:00.052) 0:05:37.612 ********** 2021-04-09T18:22:00.100 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-04-09T18:22:00.102 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:00.128 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:00 +0000 (0:00:00.035) 0:05:37.647 ********** 2021-04-09T18:22:00.136 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-04-09T18:22:00.137 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:00.148 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:00.150 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi090.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi136.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005462", "end": "2021-04-09 18:22:00.127092", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-04-09 18:22:00.121630", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-04-09T18:22:00.152 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi090.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:00.184 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:00 +0000 (0:00:00.055) 0:05:37.703 ********** 2021-04-09T18:22:00.213 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:22:00.215 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:00.243 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:00 +0000 (0:00:00.059) 0:05:37.763 ********** 2021-04-09T18:22:00.273 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-04-09T18:22:00.275 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:00.305 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:00 +0000 (0:00:00.061) 0:05:37.825 ********** 2021-04-09T18:22:00.313 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-04-09T18:22:00.315 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.024445", "end": "2021-04-09 18:22:00.269575", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-04-09 18:22:00.245130", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:22:00.353 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:00 +0000 (0:00:00.047) 0:05:37.873 ********** 2021-04-09T18:22:00.363 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-04-09T18:22:00.365 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:00.405 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:00 +0000 (0:00:00.051) 0:05:37.924 ********** 2021-04-09T18:22:00.412 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-04-09T18:22:00.441 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:00 +0000 (0:00:00.036) 0:05:37.961 ********** 2021-04-09T18:22:00.449 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-04-09T18:22:00.451 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:00.480 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:00 +0000 (0:00:00.038) 0:05:38.000 ********** 2021-04-09T18:22:00.507 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-04-09T18:22:00.509 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:00.536 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:00 +0000 (0:00:00.055) 0:05:38.055 ********** 2021-04-09T18:22:00.563 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-04-09T18:22:00.565 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:00.603 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:00 +0000 (0:00:00.067) 0:05:38.123 ********** 2021-04-09T18:22:00.614 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-04-09T18:22:00.616 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-04-09T18:22:00.652 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-04-09T18:22:00.653 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:00.684 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:00 +0000 (0:00:00.080) 0:05:38.203 ********** 2021-04-09T18:22:00.709 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-04-09T18:22:00.711 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:00.741 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:00 +0000 (0:00:00.057) 0:05:38.261 ********** 2021-04-09T18:22:00.945 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-04-09T18:22:00.948 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010508", "end": "2021-04-09 18:22:00.882245", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-04-09 18:22:00.871737", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:22:01.017 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-04-09T18:22:01.018 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"cache_update_time": 1617992393, "cache_updated": false, "changed": false} 2021-04-09T18:22:01.043 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:01 +0000 (0:00:00.301) 0:05:38.562 ********** 2021-04-09T18:22:01.087 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi090.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006050", "end": "2021-04-09 18:22:01.054040", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-04-09 18:22:01.047990", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:22:01.095 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-04-09T18:22:01.097 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:01.119 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:01 +0000 (0:00:00.076) 0:05:38.639 ********** 2021-04-09T18:22:01.237 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-04-09T18:22:01.239 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005432", "end": "2021-04-09 18:22:01.204622", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-04-09 18:22:01.199190", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-04-09T18:22:01.297 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-04-09T18:22:01.300 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-04-09T18:22:01.324 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:01 +0000 (0:00:00.205) 0:05:38.844 ********** 2021-04-09T18:22:01.406 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-04-09T18:22:01.408 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.023350", "end": "2021-04-09 18:22:01.363668", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-04-09 18:22:01.340318", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:22:01.436 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:01 +0000 (0:00:00.111) 0:05:38.955 ********** 2021-04-09T18:22:01.475 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-04-09T18:22:01.502 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:01 +0000 (0:00:00.066) 0:05:39.022 ********** 2021-04-09T18:22:01.662 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-04-09T18:22:01.664 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-04-09T18:22:01.755 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-04-09T18:22:01.757 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-04-09T18:22:01.793 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:01 +0000 (0:00:00.290) 0:05:39.312 ********** 2021-04-09T18:22:02.617 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-04-09T18:22:02.619 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-04-09T18:22:02.640 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:02 +0000 (0:00:00.847) 0:05:40.160 ********** 2021-04-09T18:22:03.155 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-04-09T18:22:03.157 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false} 2021-04-09T18:22:03.182 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:03 +0000 (0:00:00.542) 0:05:40.702 ********** 2021-04-09T18:22:03.220 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-04-09T18:22:03.222 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-04-09T18:22:03.253 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:03 +0000 (0:00:00.070) 0:05:40.772 ********** 2021-04-09T18:22:03.399 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-04-09T18:22:03.401 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1617991602.9354827, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1617991602.9314826, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 262873, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1617991602.9314826, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3476867264", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-04-09T18:22:03.426 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:03 +0000 (0:00:00.173) 0:05:40.946 ********** 2021-04-09T18:22:03.560 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-04-09T18:22:03.562 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-04-09T18:22:03.589 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:03 +0000 (0:00:00.162) 0:05:41.108 ********** 2021-04-09T18:22:03.626 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-04-09T18:22:03.627 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-04-09T18:22:03.654 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:03 +0000 (0:00:00.065) 0:05:41.173 ********** 2021-04-09T18:22:03.681 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-04-09T18:22:03.683 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:03.706 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:03 +0000 (0:00:00.052) 0:05:41.226 ********** 2021-04-09T18:22:03.852 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-04-09T18:22:03.854 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-04-09T18:22:03.879 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:03 +0000 (0:00:00.172) 0:05:41.398 ********** 2021-04-09T18:22:04.011 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-04-09T18:22:04.013 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-04-09T18:22:04.035 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:04 +0000 (0:00:00.156) 0:05:41.554 ********** 2021-04-09T18:22:04.061 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-04-09T18:22:04.063 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:04.087 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:04 +0000 (0:00:00.052) 0:05:41.606 ********** 2021-04-09T18:22:04.125 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-04-09T18:22:04.127 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-04-09T18:22:04.137 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-04-09T18:22:04.139 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-04-09T18:22:04.148 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-04-09T18:22:04.150 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-04-09T18:22:04.173 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:04 +0000 (0:00:00.086) 0:05:41.693 ********** 2021-04-09T18:22:04.222 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-04-09T18:22:04.224 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi144.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:04.234 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:04.235 INFO:teuthology.task.ansible.out: skipping: [smithi144.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:04.246 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:04.282 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:04 +0000 (0:00:00.109) 0:05:41.802 ********** 2021-04-09T18:22:04.314 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:22:04.316 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:04.342 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:04 +0000 (0:00:00.059) 0:05:41.861 ********** 2021-04-09T18:22:04.370 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:04.395 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:04 +0000 (0:00:00.053) 0:05:41.914 ********** 2021-04-09T18:22:04.422 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-04-09T18:22:04.423 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:04.450 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:04 +0000 (0:00:00.055) 0:05:41.969 ********** 2021-04-09T18:22:04.479 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-04-09T18:22:04.481 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:04.510 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:04 +0000 (0:00:00.059) 0:05:42.029 ********** 2021-04-09T18:22:04.537 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-04-09T18:22:04.539 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:04.564 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:04 +0000 (0:00:00.054) 0:05:42.083 ********** 2021-04-09T18:22:04.591 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-04-09T18:22:04.593 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:04.619 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:04 +0000 (0:00:00.055) 0:05:42.139 ********** 2021-04-09T18:22:04.646 INFO:teuthology.task.ansible.out: 2021-04-09T18:22:04.648 INFO:teuthology.task.ansible.out:TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:04.677 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:04 +0000 (0:00:00.058) 0:05:42.197 ********** 2021-04-09T18:22:04.706 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-04-09T18:22:04.708 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:04.731 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:04 +0000 (0:00:00.053) 0:05:42.251 ********** 2021-04-09T18:22:04.891 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-04-09T18:22:04.893 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011202", "end": "2021-04-09 18:22:04.865705", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-04-09 18:22:04.854503", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:22:05.020 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005613", "end": "2021-04-09 18:22:04.997682", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-04-09 18:22:04.992069", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:22:05.160 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005524", "end": "2021-04-09 18:22:05.117822", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-04-09 18:22:05.112298", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-04-09T18:22:05.270 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.007628", "end": "2021-04-09 18:22:05.247542", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-04-09 18:22:05.239914", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:22:05.272 INFO:teuthology.task.ansible.out: 2021-04-09T18:22:05.296 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:05 +0000 (0:00:00.564) 0:05:42.815 ********** 2021-04-09T18:22:05.323 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-04-09T18:22:05.348 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:05 +0000 (0:00:00.052) 0:05:42.867 ********** 2021-04-09T18:22:05.483 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-04-09T18:22:05.485 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-04-09T18:22:05.576 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-04-09T18:22:05.599 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:05 +0000 (0:00:00.250) 0:05:43.118 ********** 2021-04-09T18:22:05.622 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:05 +0000 (0:00:00.022) 0:05:43.141 ********** 2021-04-09T18:22:05.649 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:05 +0000 (0:00:00.027) 0:05:43.169 ********** 2021-04-09T18:22:05.674 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:05 +0000 (0:00:00.024) 0:05:43.193 ********** 2021-04-09T18:22:05.698 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:05 +0000 (0:00:00.024) 0:05:43.217 ********** 2021-04-09T18:22:06.367 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-04-09T18:22:06.369 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] 2021-04-09T18:22:06.434 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:06 +0000 (0:00:00.734) 0:05:43.952 ********** 2021-04-09T18:22:06.462 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] 2021-04-09T18:22:06.584 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] 2021-04-09T18:22:06.609 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] 2021-04-09T18:22:06.630 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] 2021-04-09T18:22:06.641 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-04-09T18:22:06.643 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-04-09T18:22:06.669 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:06 +0000 (0:00:00.236) 0:05:44.188 ********** 2021-04-09T18:22:06.743 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-04-09T18:22:06.745 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:06.766 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:06 +0000 (0:00:00.097) 0:05:44.286 ********** 2021-04-09T18:22:06.800 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:06 +0000 (0:00:00.025) 0:05:44.311 ********** 2021-04-09T18:22:06.826 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:06 +0000 (0:00:00.034) 0:05:44.345 ********** 2021-04-09T18:22:06.849 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:06 +0000 (0:00:00.022) 0:05:44.368 ********** 2021-04-09T18:22:06.876 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:06 +0000 (0:00:00.026) 0:05:44.395 ********** 2021-04-09T18:22:06.888 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-04-09T18:22:06.890 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-04-09T18:22:06.890 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi089.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-04-09T18:22:06.891 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-04-09T18:22:06.892 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-04-09T18:22:06.929 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:06 +0000 (0:00:00.052) 0:05:44.448 ********** 2021-04-09T18:22:06.955 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:06 +0000 (0:00:00.026) 0:05:44.475 ********** 2021-04-09T18:22:06.977 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:06 +0000 (0:00:00.021) 0:05:44.496 ********** 2021-04-09T18:22:06.998 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:06 +0000 (0:00:00.021) 0:05:44.518 ********** 2021-04-09T18:22:07.006 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-04-09T18:22:07.007 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-04-09T18:22:07.008 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:07.009 INFO:teuthology.task.ansible.out:skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:07.037 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:07 +0000 (0:00:00.038) 0:05:44.556 ********** 2021-04-09T18:22:07.065 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:07 +0000 (0:00:00.027) 0:05:44.584 ********** 2021-04-09T18:22:07.092 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:07 +0000 (0:00:00.027) 0:05:44.611 ********** 2021-04-09T18:22:07.100 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:07.102 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** ok: [smithi089.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-04-09T18:22:07.137 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:07 +0000 (0:00:00.044) 0:05:44.656 ********** 2021-04-09T18:22:07.158 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:07 +0000 (0:00:00.021) 0:05:44.677 ********** 2021-04-09T18:22:07.170 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-04-09T18:22:07.172 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-04-09T18:22:07.174 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:07.219 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:07 +0000 (0:00:00.061) 0:05:44.739 ********** 2021-04-09T18:22:07.246 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:07 +0000 (0:00:00.026) 0:05:44.766 ********** 2021-04-09T18:22:07.255 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-04-09T18:22:07.257 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-04-09T18:22:07.294 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:07 +0000 (0:00:00.047) 0:05:44.813 ********** 2021-04-09T18:22:07.306 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-04-09T18:22:07.346 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:07 +0000 (0:00:00.051) 0:05:44.865 ********** 2021-04-09T18:22:07.852 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-04-09T18:22:07.854 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:22:07.886 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:07 +0000 (0:00:00.540) 0:05:45.405 ********** 2021-04-09T18:22:07.915 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-04-09T18:22:07.917 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:07.939 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:07 +0000 (0:00:00.053) 0:05:45.458 ********** 2021-04-09T18:22:07.978 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-04-09T18:22:07.980 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-04-09T18:22:08.003 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:07 +0000 (0:00:00.063) 0:05:45.522 ********** 2021-04-09T18:22:08.031 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-04-09T18:22:08.033 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"cache_update_time": 1617992384, "cache_updated": false, "changed": false} 2021-04-09T18:22:08.057 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:08 +0000 (0:00:00.054) 0:05:45.576 ********** 2021-04-09T18:22:08.085 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-04-09T18:22:08.087 INFO:teuthology.task.ansible.out:skipping: [smithi089.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:08.109 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:08 +0000 (0:00:00.052) 0:05:45.628 ********** 2021-04-09T18:22:08.138 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-04-09T18:22:08.140 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-04-09T18:22:08.167 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:08 +0000 (0:00:00.057) 0:05:45.686 ********** 2021-04-09T18:22:08.173 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-04-09T18:22:08.175 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"cache_update_time": 1617992385, "cache_updated": false, "changed": false} 2021-04-09T18:22:08.201 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:08 +0000 (0:00:00.034) 0:05:45.720 ********** 2021-04-09T18:22:08.209 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* changed: [smithi079.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:22:08.232 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi090.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:08.263 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:08 +0000 (0:00:00.061) 0:05:45.782 ********** 2021-04-09T18:22:08.270 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-04-09T18:22:08.272 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"cache_update_time": 1617992386, "cache_updated": false, "changed": false} 2021-04-09T18:22:08.300 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:08 +0000 (0:00:00.037) 0:05:45.819 ********** 2021-04-09T18:22:08.307 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"cache_update_time": 1617992393, "cache_updated": false, "changed": false} 2021-04-09T18:22:08.309 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-04-09T18:22:08.309 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-04-09T18:22:08.310 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-04-09T18:22:08.310 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:22:08.313 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:22:08.340 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:08 +0000 (0:00:00.040) 0:05:45.860 ********** 2021-04-09T18:22:08.364 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:08 +0000 (0:00:00.022) 0:05:45.883 ********** 2021-04-09T18:22:08.386 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:08 +0000 (0:00:00.022) 0:05:45.905 ********** 2021-04-09T18:22:08.393 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-04-09T18:22:08.395 INFO:teuthology.task.ansible.out:skipping: [smithi136.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:08.421 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:08 +0000 (0:00:00.035) 0:05:45.941 ********** 2021-04-09T18:22:08.430 INFO:teuthology.task.ansible.out:skipping: [smithi144.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:22:08.458 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:08 +0000 (0:00:00.036) 0:05:45.977 ********** 2021-04-09T18:22:08.464 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-04-09T18:22:08.466 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:22:08.468 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi136.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-04-09T18:22:08.494 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:08 +0000 (0:00:00.036) 0:05:46.013 ********** 2021-04-09T18:22:08.516 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:08 +0000 (0:00:00.022) 0:05:46.035 ********** 2021-04-09T18:22:08.524 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-04-09T18:22:08.526 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-04-09T18:22:08.526 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:22:08.552 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:08 +0000 (0:00:00.036) 0:05:46.071 ********** 2021-04-09T18:22:08.653 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:22:08.681 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:08 +0000 (0:00:00.128) 0:05:46.200 ********** 2021-04-09T18:22:08.699 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** changed: [smithi079.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992528.3974528-599-90315998761203/source", "state": "file", "uid": 0} 2021-04-09T18:22:08.701 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* changed: [smithi136.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:22:08.712 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:22:08.818 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:22:08.860 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:08 +0000 (0:00:00.178) 0:05:46.379 ********** 2021-04-09T18:22:08.870 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:22:08.872 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-04-09T18:22:08.874 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992528.5494187-623-140298876889273/source", "state": "file", "uid": 0} 2021-04-09T18:22:08.898 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:08 +0000 (0:00:00.038) 0:05:46.418 ********** 2021-04-09T18:22:09.034 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992528.7262032-599-246129174307833/source", "state": "file", "uid": 0} 2021-04-09T18:22:09.060 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:09 +0000 (0:00:00.162) 0:05:46.580 ********** 2021-04-09T18:22:09.069 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992528.7408452-658-95125462628352/source", "state": "file", "uid": 0} 2021-04-09T18:22:09.207 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992528.8885894-623-122568989350863/source", "state": "file", "uid": 0} 2021-04-09T18:22:09.242 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:09 +0000 (0:00:00.181) 0:05:46.761 ********** 2021-04-09T18:22:09.254 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992528.929137-696-8435892096806/source", "state": "file", "uid": 0} 2021-04-09T18:22:09.267 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992528.963185-709-215472936757920/source", "state": "file", "uid": 0} 2021-04-09T18:22:09.386 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992529.0753953-658-271068932880608/source", "state": "file", "uid": 0} 2021-04-09T18:22:09.413 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:09 +0000 (0:00:00.171) 0:05:46.933 ********** 2021-04-09T18:22:09.557 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992529.2603674-696-46858006816631/source", "state": "file", "uid": 0} 2021-04-09T18:22:09.588 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:09 +0000 (0:00:00.174) 0:05:47.108 ********** 2021-04-09T18:22:09.595 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992529.290719-709-242308402769868/source", "state": "file", "uid": 0} 2021-04-09T18:22:09.623 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:09 +0000 (0:00:00.034) 0:05:47.143 ********** 2021-04-09T18:22:12.756 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-BDeQeu-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-BDeQeu-build", "Collecting docopt (f 2021-04-09T18:22:12.758 INFO:teuthology.task.ansible.out:rom registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-04-09T18:22:12.783 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:12 +0000 (0:00:03.159) 0:05:50.302 ********** 2021-04-09T18:22:12.909 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-zYTsAr-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-zYTsAr-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packag 2021-04-09T18:22:12.910 INFO:teuthology.task.ansible.out:es/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-04-09T18:22:12.932 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:12 +0000 (0:00:00.149) 0:05:50.451 ********** 2021-04-09T18:22:12.939 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-04-09T18:22:12.941 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-04-09T18:22:12.969 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:12 +0000 (0:00:00.036) 0:05:50.488 ********** 2021-04-09T18:22:13.017 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-04-09T18:22:13.018 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-Jvkums-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-Jvkums-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packag 2021-04-09T18:22:13.020 INFO:teuthology.task.ansible.out:es/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-04-09T18:22:13.044 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:13 +0000 (0:00:00.074) 0:05:50.563 ********** 2021-04-09T18:22:13.072 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-04-09T18:22:13.073 INFO:teuthology.task.ansible.out:ok: [smithi089.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-04-09T18:22:13.100 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:13 +0000 (0:00:00.056) 0:05:50.619 ********** 2021-04-09T18:22:13.181 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-04-09T18:22:13.183 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-1sW_IB-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-1sW_IB-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packag 2021-04-09T18:22:13.185 INFO:teuthology.task.ansible.out:es/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-04-09T18:22:13.209 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:13 +0000 (0:00:00.108) 0:05:50.728 ********** 2021-04-09T18:22:13.216 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-04-09T18:22:13.217 INFO:teuthology.task.ansible.out:ok: [smithi090.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-04-09T18:22:13.247 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:13 +0000 (0:00:00.038) 0:05:50.766 ********** 2021-04-09T18:22:13.265 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-04-09T18:22:13.266 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-W1uzRd-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-W1uzRd-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packag 2021-04-09T18:22:13.268 INFO:teuthology.task.ansible.out:es/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-04-09T18:22:13.298 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:13 +0000 (0:00:00.051) 0:05:50.818 ********** 2021-04-09T18:22:13.326 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-04-09T18:22:13.328 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992533.0263484-1130-94496544612078/source", "state": "file", "uid": 0} 2021-04-09T18:22:13.359 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:13 +0000 (0:00:00.061) 0:05:50.879 ********** 2021-04-09T18:22:13.367 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-04-09T18:22:13.369 INFO:teuthology.task.ansible.out:ok: [smithi136.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-04-09T18:22:13.394 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:13 +0000 (0:00:00.035) 0:05:50.914 ********** 2021-04-09T18:22:13.432 INFO:teuthology.task.ansible.out:ok: [smithi144.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-04-09T18:22:13.462 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:13 +0000 (0:00:00.067) 0:05:50.981 ********** 2021-04-09T18:22:13.490 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-04-09T18:22:13.492 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992533.169553-1146-193981355698400/source", "state": "file", "uid": 0} 2021-04-09T18:22:13.518 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:13 +0000 (0:00:00.056) 0:05:51.038 ********** 2021-04-09T18:22:13.601 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992533.303478-1158-121995473483679/source", "state": "file", "uid": 0} 2021-04-09T18:22:13.634 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:13 +0000 (0:00:00.115) 0:05:51.153 ********** 2021-04-09T18:22:13.642 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-04-09T18:22:13.643 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.114242", "end": "2021-04-09 18:22:13.602992", "rc": 0, "start": "2021-04-09 18:22:13.488750", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:22:13.676 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:13 +0000 (0:00:00.041) 0:05:51.195 ********** 2021-04-09T18:22:13.751 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-04-09T18:22:13.752 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992533.446495-1187-220192015181324/source", "state": "file", "uid": 0} 2021-04-09T18:22:13.778 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:13 +0000 (0:00:00.102) 0:05:51.297 ********** 2021-04-09T18:22:13.795 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-04-09T18:22:13.796 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.121860", "end": "2021-04-09 18:22:13.774848", "rc": 0, "start": "2021-04-09 18:22:13.652988", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:22:13.823 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:13 +0000 (0:00:00.045) 0:05:51.343 ********** 2021-04-09T18:22:13.831 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-04-09T18:22:13.832 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617992533.51509-1199-7948434491468/source", "state": "file", "uid": 0} 2021-04-09T18:22:13.869 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:13 +0000 (0:00:00.045) 0:05:51.389 ********** 2021-04-09T18:22:13.899 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-04-09T18:22:13.901 INFO:teuthology.task.ansible.out:changed: [smithi090.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.118330", "end": "2021-04-09 18:22:13.884264", "rc": 0, "start": "2021-04-09 18:22:13.765934", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:22:13.924 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:13 +0000 (0:00:00.055) 0:05:51.444 ********** 2021-04-09T18:22:14.036 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.112666", "end": "2021-04-09 18:22:14.017268", "rc": 0, "start": "2021-04-09 18:22:13.904602", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:22:14.061 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:14 +0000 (0:00:00.136) 0:05:51.580 ********** 2021-04-09T18:22:14.132 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.113897", "end": "2021-04-09 18:22:14.110524", "rc": 0, "start": "2021-04-09 18:22:13.996627", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:22:14.164 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:22:14 +0000 (0:00:00.103) 0:05:51.684 ********** 2021-04-09T18:22:17.198 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-04-09T18:22:17.199 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sysinit.target network-online.target firewalld.service basic.target system.slice docker.socket systemd-journald.socket containerd.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMa 2021-04-09T18:22:17.201 INFO:teuthology.task.ansible.out:inStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "12802 2021-04-09T18:22:17.202 INFO:teuthology.task.ansible.out:9", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target docker.socket system.slice", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-04-09 18:20:41 UTC", "StateChangeTimestampMonotonic": "374132502", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "S 2021-04-09T18:22:17.204 INFO:teuthology.task.ansible.out:uccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-04-09T18:22:17.332 INFO:teuthology.task.ansible.out:changed: [smithi089.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "network-online.target system.slice basic.target containerd.service systemd-journald.socket firewalld.service sysinit.target docker.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMa 2021-04-09T18:22:17.334 INFO:teuthology.task.ansible.out:inStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128028", "LimitSIGPENDINGSoft": "12802 2021-04-09T18:22:17.335 INFO:teuthology.task.ansible.out:8", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket sysinit.target system.slice", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-04-09 18:20:43 UTC", "StateChangeTimestampMonotonic": "373671572", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "S 2021-04-09T18:22:17.337 INFO:teuthology.task.ansible.out:uccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-online.target containerd.service", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-04-09T18:22:17.522 INFO:teuthology.task.ansible.out:changed: [smithi144.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice network-online.target systemd-journald.socket containerd.service docker.socket sysinit.target firewalld.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMa 2021-04-09T18:22:17.524 INFO:teuthology.task.ansible.out:inStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "12802 2021-04-09T18:22:17.525 INFO:teuthology.task.ansible.out:9", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target docker.socket", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-04-09 18:20:52 UTC", "StateChangeTimestampMonotonic": "363593853", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "S 2021-04-09T18:22:17.527 INFO:teuthology.task.ansible.out:uccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-04-09T18:22:17.550 INFO:teuthology.task.ansible.out:changed: [smithi136.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "systemd-journald.socket system.slice basic.target docker.socket firewalld.service containerd.service network-online.target sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMa 2021-04-09T18:22:17.552 INFO:teuthology.task.ansible.out:inStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "12802 2021-04-09T18:22:17.554 INFO:teuthology.task.ansible.out:9", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice docker.socket sysinit.target", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-04-09 18:20:45 UTC", "StateChangeTimestampMonotonic": "358867916", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "S 2021-04-09T18:22:17.556 INFO:teuthology.task.ansible.out:uccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-online.target containerd.service", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} changed: [smithi090.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target docker.socket network-online.target containerd.service firewalld.service systemd-journald.socket sysinit.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease c 2021-04-09T18:22:17.557 INFO:teuthology.task.ansible.out:ap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "L 2021-04-09T18:22:17.559 INFO:teuthology.task.ansible.out:imitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128028", "LimitSIGPENDINGSoft": "128028", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice docker.socket", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": 2021-04-09T18:22:17.561 INFO:teuthology.task.ansible.out: "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-04-09 18:20:42 UTC", "StateChangeTimestampMonotonic": "347446376", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-online.target containerd.service", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-04-09T18:22:17.669 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-04-09T18:22:17.670 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-04-09T18:22:17.671 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi079.front.sepia.ceph.com : ok=127 changed=40 unreachable=0 failed=0 skipped=185 rescued=0 ignored=0 smithi089.front.sepia.ceph.com : ok=127 changed=40 unreachable=0 failed=0 skipped=185 rescued=0 ignored=0 smithi090.front.sepia.ceph.com : ok=127 changed=40 unreachable=0 failed=0 skipped=185 rescued=0 ignored=0 smithi136.front.sepia.ceph.com : ok=127 changed=40 unreachable=0 failed=0 skipped=185 rescued=0 ignored=0 smithi144.front.sepia.ceph.com : ok=127 changed=40 unreachable=0 failed=0 skipped=185 rescued=0 ignored=0 Friday 09 April 2021 18:22:17 +0000 (0:00:03.506) 0:05:55.191 ********** =============================================================================== 2021-04-09T18:22:17.672 INFO:teuthology.task.ansible.out:Create all admin users with sudo access. ------------------------------- 46.01s users : Update authorized_keys using the keys repo --------------------- 30.66s ansible-managed : Add authorized keys for the ansible user. ------------- 6.25s 2021-04-09T18:22:17.672 INFO:teuthology.task.ansible.out:ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 6.03s users : Update authorized_keys for each user with literal keys ---------- 5.04s Gathering Facts --------------------------------------------------------- 4.34s users : Clone the keys repo --------------------------------------------- 3.76s container-host : Restart docker service --------------------------------- 3.51s container-host : Install registries-conf-ctl ---------------------------- 3.16s ansible-managed : Create the ansible user. ------------------------------ 2.86s ansible-managed : Ensure includedir is present in sudoers. -------------- 2.62s Remove revoked users ---------------------------------------------------- 2.45s testnode : Update apt cache. ---------------------- 2021-04-09T18:22:17.674 INFO:teuthology.task.ansible.out:---------------------- 2.41s testnode : Zap all non-root disks --------------------------------------- 1.85s ansible-managed : Delete the ansible users password. -------------------- 1.71s Gathering Facts --------------------------------------------------------- 1.56s users : Check keys_repo HEAD sha1 --------------------------------------- 1.48s testnode : Install python-apt ------------------------------------------- 1.24s testnode : Ensure packages are not present. ----------------------------- 1.20s testnode : Make sure apt dependencies are installed --------------------- 0.98s 2021-04-09T18:22:17.975 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi079.front.sepia.ceph.com'), Remote(name='ubuntu@smithi089.front.sepia.ceph.com'), Remote(name='ubuntu@smithi090.front.sepia.ceph.com'), Remote(name='ubuntu@smithi136.front.sepia.ceph.com'), Remote(name='ubuntu@smithi144.front.sepia.ceph.com')] 2021-04-09T18:22:17.976 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T18:22:17.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:22:18.050 DEBUG:teuthology.orchestra.run.smithi079:> true 2021-04-09T18:22:18.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T18:22:18.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:22:18.319 DEBUG:teuthology.orchestra.run.smithi089:> true 2021-04-09T18:22:18.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T18:22:18.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:22:18.587 DEBUG:teuthology.orchestra.run.smithi090:> true 2021-04-09T18:22:18.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T18:22:18.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:22:18.863 DEBUG:teuthology.orchestra.run.smithi136:> true 2021-04-09T18:22:19.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T18:22:19.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:22:19.137 DEBUG:teuthology.orchestra.run.smithi144:> true 2021-04-09T18:22:19.324 INFO:teuthology.run_tasks:Running task clock... 2021-04-09T18:22:19.336 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-04-09T18:22:19.336 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-04-09T18:22:19.337 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-04-09T18:22:19.389 INFO:teuthology.orchestra.run.smithi079.stdout: 9 Apr 18:22:19 ntpd[9265]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-04-09T18:22:19.389 INFO:teuthology.orchestra.run.smithi079.stdout: 9 Apr 18:22:19 ntpd[9265]: Command line: ntpd -gq 2021-04-09T18:22:19.390 INFO:teuthology.orchestra.run.smithi079.stdout: 9 Apr 18:22:19 ntpd[9265]: proto: precision = 0.123 usec (-23) 2021-04-09T18:22:19.390 INFO:teuthology.orchestra.run.smithi079.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-04-09T18:22:19.391 INFO:teuthology.orchestra.run.smithi079.stdout: 9 Apr 18:22:19 ntpd[9265]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-04-09T18:22:19.392 INFO:teuthology.orchestra.run.smithi079.stderr:restrict ::: KOD does nothing without LIMITED. 2021-04-09T18:22:19.393 INFO:teuthology.orchestra.run.smithi079.stdout: 9 Apr 18:22:19 ntpd[9265]: restrict ::: KOD does nothing without LIMITED. 2021-04-09T18:22:19.393 INFO:teuthology.orchestra.run.smithi079.stdout: 9 Apr 18:22:19 ntpd[9265]: Listen and drop on 0 v6wildcard [::]:123 2021-04-09T18:22:19.394 INFO:teuthology.orchestra.run.smithi079.stdout: 9 Apr 18:22:19 ntpd[9265]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-04-09T18:22:19.394 INFO:teuthology.orchestra.run.smithi079.stdout: 9 Apr 18:22:19 ntpd[9265]: Listen normally on 2 lo 127.0.0.1:123 2021-04-09T18:22:19.395 INFO:teuthology.orchestra.run.smithi079.stdout: 9 Apr 18:22:19 ntpd[9265]: Listen normally on 3 enp3s0f1 172.21.15.79:123 2021-04-09T18:22:19.395 INFO:teuthology.orchestra.run.smithi079.stdout: 9 Apr 18:22:19 ntpd[9265]: Listen normally on 4 lo [::1]:123 2021-04-09T18:22:19.395 INFO:teuthology.orchestra.run.smithi079.stdout: 9 Apr 18:22:19 ntpd[9265]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce87%5]:123 2021-04-09T18:22:19.396 INFO:teuthology.orchestra.run.smithi079.stdout: 9 Apr 18:22:19 ntpd[9265]: Listening on routing socket on fd #22 for interface updates 2021-04-09T18:22:20.393 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:20 ntpd[9265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:20.393 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:20 ntpd[9265]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:20.394 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:20 ntpd[9265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:20.394 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:20 ntpd[9265]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:20.395 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:20 ntpd[9265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:20.395 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:20 ntpd[9265]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:20.395 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:20 ntpd[9265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:20.396 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:20 ntpd[9265]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:20.396 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:20 ntpd[9265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:20.397 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:20 ntpd[9265]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:20.397 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:20 ntpd[9265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:20.397 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:20 ntpd[9265]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:20.397 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:20 ntpd[9265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:20.398 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:20 ntpd[9265]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:20.398 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:20 ntpd[9265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:20.398 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:20 ntpd[9265]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:22.391 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:22 ntpd[9265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:22.391 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:22 ntpd[9265]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:22.392 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:22 ntpd[9265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:22.392 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:22 ntpd[9265]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:22.392 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:22 ntpd[9265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:22.392 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:22 ntpd[9265]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:22.393 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:22 ntpd[9265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:22.393 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:22 ntpd[9265]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:22.393 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:22 ntpd[9265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:22.393 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:22 ntpd[9265]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:22.393 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:22 ntpd[9265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:22.394 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:22 ntpd[9265]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:22.394 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:22 ntpd[9265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:22.394 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:22 ntpd[9265]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:22.394 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:22 ntpd[9265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:22.394 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:22 ntpd[9265]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:24.391 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:24 ntpd[9265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:24.391 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:24 ntpd[9265]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:24.392 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:24 ntpd[9265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:24.392 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:24 ntpd[9265]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:24.392 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:24 ntpd[9265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:24.392 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:24 ntpd[9265]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:24.393 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:24 ntpd[9265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:24.393 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:24 ntpd[9265]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:24.393 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:24 ntpd[9265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:24.393 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:24 ntpd[9265]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:24.393 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:24 ntpd[9265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:24.394 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:24 ntpd[9265]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:24.394 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:24 ntpd[9265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:24.394 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:24 ntpd[9265]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:24.394 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:24 ntpd[9265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:24.394 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:24 ntpd[9265]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:26.390 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:26 ntpd[9265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:26.390 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:26 ntpd[9265]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:26.390 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:26 ntpd[9265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:26.391 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:26 ntpd[9265]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:26.391 INFO:teuthology.orchestra.run.smithi079.stdout: 9 Apr 18:22:26 ntpd[9265]: ntpd: time slew -0.006058 s 2021-04-09T18:22:26.392 INFO:teuthology.orchestra.run.smithi079.stdout:ntpd: time slew -0.006058s 2021-04-09T18:22:26.393 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:26 ntpd[9265]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-04-09T18:22:26.393 INFO:teuthology.orchestra.run.smithi079.stderr: 9 Apr 18:22:26 ntpd[9265]: can't open /var/log/ntpstats/loopstats.20210409: Permission denied 2021-04-09T18:22:26.522 INFO:teuthology.orchestra.run.smithi079.stdout: remote refid st t when poll reach delay offset jitter 2021-04-09T18:22:26.522 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================== 2021-04-09T18:22:26.522 INFO:teuthology.orchestra.run.smithi079.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:22:26.523 INFO:teuthology.orchestra.run.smithi079.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:22:26.523 INFO:teuthology.orchestra.run.smithi079.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:22:26.523 INFO:teuthology.orchestra.run.smithi079.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:22:26.523 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-04-09T18:22:26.524 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-04-09T18:22:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Apr 18:22:26 ntpd[9253]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-04-09T18:22:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Apr 18:22:26 ntpd[9253]: Command line: ntpd -gq 2021-04-09T18:22:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Apr 18:22:26 ntpd[9253]: proto: precision = 0.120 usec (-23) 2021-04-09T18:22:26.590 INFO:teuthology.orchestra.run.smithi089.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-04-09T18:22:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Apr 18:22:26 ntpd[9253]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-04-09T18:22:26.592 INFO:teuthology.orchestra.run.smithi089.stderr:restrict ::: KOD does nothing without LIMITED. 2021-04-09T18:22:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Apr 18:22:26 ntpd[9253]: restrict ::: KOD does nothing without LIMITED. 2021-04-09T18:22:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Apr 18:22:26 ntpd[9253]: Listen and drop on 0 v6wildcard [::]:123 2021-04-09T18:22:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Apr 18:22:26 ntpd[9253]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-04-09T18:22:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Apr 18:22:26 ntpd[9253]: Listen normally on 2 lo 127.0.0.1:123 2021-04-09T18:22:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Apr 18:22:26 ntpd[9253]: Listen normally on 3 enp3s0f1 172.21.15.89:123 2021-04-09T18:22:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Apr 18:22:26 ntpd[9253]: Listen normally on 4 lo [::1]:123 2021-04-09T18:22:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Apr 18:22:26 ntpd[9253]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d501%5]:123 2021-04-09T18:22:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Apr 18:22:26 ntpd[9253]: Listening on routing socket on fd #22 for interface updates 2021-04-09T18:22:27.590 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:27 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:27.590 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:27 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:27.590 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:27 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:27.591 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:27 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:27.591 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:27 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:27.591 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:27 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:27.591 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:27 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:27.592 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:27 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:29.591 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:29 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:29.591 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:29 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:29.592 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:29 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:29.592 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:29 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:29.592 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:29 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:29.592 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:29 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:29.593 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:29 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:29.593 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:29 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:29.593 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:29 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:29.593 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:29 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:29.594 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:29 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:29.594 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:29 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:30.589 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:30 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:30.590 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:30 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:30.590 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:30 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:30.590 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:30 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:31.590 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:31 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:31.590 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:31 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:31.590 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:31 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:31.591 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:31 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:31.591 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:31 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:31.591 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:31 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:31.591 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:31 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:31.592 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:31 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:31.592 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:31 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:31.592 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:31 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:31.592 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:31 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:31.593 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:31 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:32.589 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:32 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:32.590 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:32 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:32.590 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:32 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:32.591 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:32 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:33.590 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:33 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:33.591 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:33 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:33.591 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:33 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:33.591 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:33 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:33.591 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:33 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:33.591 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:33 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:33.592 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:33 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:33.592 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:33 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:33.592 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Apr 18:22:33 ntpd[9253]: ntpd: time slew -0.006300 s 2021-04-09T18:22:33.593 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd: time slew -0.006300s 2021-04-09T18:22:33.593 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:33 ntpd[9253]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-04-09T18:22:33.593 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Apr 18:22:33 ntpd[9253]: can't open /var/log/ntpstats/loopstats.20210409: Permission denied 2021-04-09T18:22:33.650 INFO:teuthology.orchestra.run.smithi089.stdout: remote refid st t when poll reach delay offset jitter 2021-04-09T18:22:33.651 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================== 2021-04-09T18:22:33.651 INFO:teuthology.orchestra.run.smithi089.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:22:33.651 INFO:teuthology.orchestra.run.smithi089.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:22:33.651 INFO:teuthology.orchestra.run.smithi089.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:22:33.652 INFO:teuthology.orchestra.run.smithi089.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:22:33.652 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-04-09T18:22:33.652 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-04-09T18:22:33.711 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Apr 18:22:33 ntpd[9253]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-04-09T18:22:33.712 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Apr 18:22:33 ntpd[9253]: Command line: ntpd -gq 2021-04-09T18:22:33.712 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Apr 18:22:33 ntpd[9253]: proto: precision = 0.124 usec (-23) 2021-04-09T18:22:33.713 INFO:teuthology.orchestra.run.smithi090.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-04-09T18:22:33.713 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Apr 18:22:33 ntpd[9253]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-04-09T18:22:33.714 INFO:teuthology.orchestra.run.smithi090.stderr:restrict ::: KOD does nothing without LIMITED. 2021-04-09T18:22:33.716 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Apr 18:22:33 ntpd[9253]: restrict ::: KOD does nothing without LIMITED. 2021-04-09T18:22:33.716 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Apr 18:22:33 ntpd[9253]: Listen and drop on 0 v6wildcard [::]:123 2021-04-09T18:22:33.716 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Apr 18:22:33 ntpd[9253]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-04-09T18:22:33.717 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Apr 18:22:33 ntpd[9253]: Listen normally on 2 lo 127.0.0.1:123 2021-04-09T18:22:33.717 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Apr 18:22:33 ntpd[9253]: Listen normally on 3 enp3s0f1 172.21.15.90:123 2021-04-09T18:22:33.717 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Apr 18:22:33 ntpd[9253]: Listen normally on 4 lo [::1]:123 2021-04-09T18:22:33.717 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Apr 18:22:33 ntpd[9253]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d767%5]:123 2021-04-09T18:22:33.717 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Apr 18:22:33 ntpd[9253]: Listening on routing socket on fd #22 for interface updates 2021-04-09T18:22:34.712 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:34 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:34.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:34 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:34.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:34 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:34.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:34 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:35.712 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:35 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:35.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:35 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:35.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:35 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:35.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:35 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:36.712 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:36 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:36.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:36 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:36.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:36 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:36.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:36 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:37.712 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:37 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:37.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:37 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:37.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:37 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:37.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:37 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:37.714 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:37 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:37.714 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:37 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:37.714 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:37 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:37.714 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:37 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:38.712 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:38 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:38.712 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:38 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:38.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:38 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:38.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:38 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:38.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:38 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:38.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:38 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:38.714 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:38 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:38.714 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:38 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:39.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:39 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:39.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:39 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:39.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:39 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:39.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:39 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:39.714 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:39 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:39.714 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:39 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:39.714 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:39 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:39.714 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:39 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:40.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:40 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:40.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:40 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:40.713 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:40 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:40.714 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:40 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:40.714 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:40 ntpd[9253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:40.714 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:40 ntpd[9253]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:40.714 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:40 ntpd[9253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:40.714 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:40 ntpd[9253]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:40.715 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Apr 18:22:40 ntpd[9253]: ntpd: time slew -0.004207 s 2021-04-09T18:22:40.715 INFO:teuthology.orchestra.run.smithi090.stdout:ntpd: time slew -0.004207s 2021-04-09T18:22:40.716 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:40 ntpd[9253]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-04-09T18:22:40.716 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Apr 18:22:40 ntpd[9253]: can't open /var/log/ntpstats/loopstats.20210409: Permission denied 2021-04-09T18:22:40.761 INFO:teuthology.orchestra.run.smithi090.stdout: remote refid st t when poll reach delay offset jitter 2021-04-09T18:22:40.762 INFO:teuthology.orchestra.run.smithi090.stdout:============================================================================== 2021-04-09T18:22:40.762 INFO:teuthology.orchestra.run.smithi090.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:22:40.762 INFO:teuthology.orchestra.run.smithi090.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:22:40.762 INFO:teuthology.orchestra.run.smithi090.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:22:40.763 INFO:teuthology.orchestra.run.smithi090.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:22:40.763 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-04-09T18:22:40.763 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-04-09T18:22:40.815 INFO:teuthology.orchestra.run.smithi136.stdout: 9 Apr 18:22:40 ntpd[9343]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-04-09T18:22:40.815 INFO:teuthology.orchestra.run.smithi136.stdout: 9 Apr 18:22:40 ntpd[9343]: Command line: ntpd -gq 2021-04-09T18:22:40.816 INFO:teuthology.orchestra.run.smithi136.stdout: 9 Apr 18:22:40 ntpd[9343]: proto: precision = 0.123 usec (-23) 2021-04-09T18:22:40.817 INFO:teuthology.orchestra.run.smithi136.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-04-09T18:22:40.818 INFO:teuthology.orchestra.run.smithi136.stdout: 9 Apr 18:22:40 ntpd[9343]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-04-09T18:22:40.819 INFO:teuthology.orchestra.run.smithi136.stderr:restrict ::: KOD does nothing without LIMITED. 2021-04-09T18:22:40.821 INFO:teuthology.orchestra.run.smithi136.stdout: 9 Apr 18:22:40 ntpd[9343]: restrict ::: KOD does nothing without LIMITED. 2021-04-09T18:22:40.822 INFO:teuthology.orchestra.run.smithi136.stdout: 9 Apr 18:22:40 ntpd[9343]: Listen and drop on 0 v6wildcard [::]:123 2021-04-09T18:22:40.822 INFO:teuthology.orchestra.run.smithi136.stdout: 9 Apr 18:22:40 ntpd[9343]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-04-09T18:22:40.822 INFO:teuthology.orchestra.run.smithi136.stdout: 9 Apr 18:22:40 ntpd[9343]: Listen normally on 2 lo 127.0.0.1:123 2021-04-09T18:22:40.823 INFO:teuthology.orchestra.run.smithi136.stdout: 9 Apr 18:22:40 ntpd[9343]: Listen normally on 3 enp3s0f1 172.21.15.136:123 2021-04-09T18:22:40.823 INFO:teuthology.orchestra.run.smithi136.stdout: 9 Apr 18:22:40 ntpd[9343]: Listen normally on 4 lo [::1]:123 2021-04-09T18:22:40.824 INFO:teuthology.orchestra.run.smithi136.stdout: 9 Apr 18:22:40 ntpd[9343]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6e43%5]:123 2021-04-09T18:22:40.824 INFO:teuthology.orchestra.run.smithi136.stdout: 9 Apr 18:22:40 ntpd[9343]: Listening on routing socket on fd #22 for interface updates 2021-04-09T18:22:41.817 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:41 ntpd[9343]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:41.817 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:41 ntpd[9343]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:41.817 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:41 ntpd[9343]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:41.817 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:41 ntpd[9343]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:41.818 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:41 ntpd[9343]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:41.818 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:41 ntpd[9343]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:41.818 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:41 ntpd[9343]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:41.818 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:41 ntpd[9343]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:41.819 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:41 ntpd[9343]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:41.819 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:41 ntpd[9343]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:41.820 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:41 ntpd[9343]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:41.820 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:41 ntpd[9343]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:43.817 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:43 ntpd[9343]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:43.818 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:43 ntpd[9343]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:43.818 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:43 ntpd[9343]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:43.819 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:43 ntpd[9343]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:43.819 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:43 ntpd[9343]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:43.820 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:43 ntpd[9343]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:43.820 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:43 ntpd[9343]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:43.820 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:43 ntpd[9343]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:43.821 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:43 ntpd[9343]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:43.821 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:43 ntpd[9343]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:43.822 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:43 ntpd[9343]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:43.822 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:43 ntpd[9343]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:44.815 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:44 ntpd[9343]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:44.816 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:44 ntpd[9343]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:44.816 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:44 ntpd[9343]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:44.816 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:44 ntpd[9343]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:45.816 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:45 ntpd[9343]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:45.817 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:45 ntpd[9343]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:45.817 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:45 ntpd[9343]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:45.817 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:45 ntpd[9343]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:45.817 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:45 ntpd[9343]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:45.818 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:45 ntpd[9343]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:45.818 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:45 ntpd[9343]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:45.818 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:45 ntpd[9343]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:45.818 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:45 ntpd[9343]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:45.819 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:45 ntpd[9343]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:45.819 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:45 ntpd[9343]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:45.819 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:45 ntpd[9343]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:46.815 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:46 ntpd[9343]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:46.815 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:46 ntpd[9343]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:46.816 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:46 ntpd[9343]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:46.816 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:46 ntpd[9343]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:47.815 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:47 ntpd[9343]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:47.816 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:47 ntpd[9343]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:47.816 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:47 ntpd[9343]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:47.816 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:47 ntpd[9343]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:47.817 INFO:teuthology.orchestra.run.smithi136.stdout: 9 Apr 18:22:47 ntpd[9343]: ntpd: time slew -0.005602 s 2021-04-09T18:22:47.817 INFO:teuthology.orchestra.run.smithi136.stdout:ntpd: time slew -0.005602s 2021-04-09T18:22:47.817 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:47 ntpd[9343]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-04-09T18:22:47.818 INFO:teuthology.orchestra.run.smithi136.stderr: 9 Apr 18:22:47 ntpd[9343]: can't open /var/log/ntpstats/loopstats.20210409: Permission denied 2021-04-09T18:22:47.868 INFO:teuthology.orchestra.run.smithi136.stdout: remote refid st t when poll reach delay offset jitter 2021-04-09T18:22:47.868 INFO:teuthology.orchestra.run.smithi136.stdout:============================================================================== 2021-04-09T18:22:47.869 INFO:teuthology.orchestra.run.smithi136.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:22:47.869 INFO:teuthology.orchestra.run.smithi136.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:22:47.869 INFO:teuthology.orchestra.run.smithi136.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:22:47.870 INFO:teuthology.orchestra.run.smithi136.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:22:47.871 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-04-09T18:22:47.871 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-04-09T18:22:47.924 INFO:teuthology.orchestra.run.smithi144.stdout: 9 Apr 18:22:47 ntpd[9215]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-04-09T18:22:47.924 INFO:teuthology.orchestra.run.smithi144.stdout: 9 Apr 18:22:47 ntpd[9215]: Command line: ntpd -gq 2021-04-09T18:22:47.925 INFO:teuthology.orchestra.run.smithi144.stdout: 9 Apr 18:22:47 ntpd[9215]: proto: precision = 0.120 usec (-23) 2021-04-09T18:22:47.925 INFO:teuthology.orchestra.run.smithi144.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-04-09T18:22:47.926 INFO:teuthology.orchestra.run.smithi144.stdout: 9 Apr 18:22:47 ntpd[9215]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-04-09T18:22:47.926 INFO:teuthology.orchestra.run.smithi144.stdout: 9 Apr 18:22:47 ntpd[9215]: restrict ::: KOD does nothing without LIMITED. 2021-04-09T18:22:47.927 INFO:teuthology.orchestra.run.smithi144.stderr:restrict ::: KOD does nothing without LIMITED. 2021-04-09T18:22:47.928 INFO:teuthology.orchestra.run.smithi144.stdout: 9 Apr 18:22:47 ntpd[9215]: Listen and drop on 0 v6wildcard [::]:123 2021-04-09T18:22:47.928 INFO:teuthology.orchestra.run.smithi144.stdout: 9 Apr 18:22:47 ntpd[9215]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-04-09T18:22:47.928 INFO:teuthology.orchestra.run.smithi144.stdout: 9 Apr 18:22:47 ntpd[9215]: Listen normally on 2 lo 127.0.0.1:123 2021-04-09T18:22:47.929 INFO:teuthology.orchestra.run.smithi144.stdout: 9 Apr 18:22:47 ntpd[9215]: Listen normally on 3 enp3s0f1 172.21.15.144:123 2021-04-09T18:22:47.929 INFO:teuthology.orchestra.run.smithi144.stdout: 9 Apr 18:22:47 ntpd[9215]: Listen normally on 4 lo [::1]:123 2021-04-09T18:22:47.929 INFO:teuthology.orchestra.run.smithi144.stdout: 9 Apr 18:22:47 ntpd[9215]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f5f%5]:123 2021-04-09T18:22:47.929 INFO:teuthology.orchestra.run.smithi144.stdout: 9 Apr 18:22:47 ntpd[9215]: Listening on routing socket on fd #22 for interface updates 2021-04-09T18:22:48.925 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:48 ntpd[9215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:48.925 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:48 ntpd[9215]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:48.925 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:48 ntpd[9215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:48.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:48 ntpd[9215]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:49.924 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:49 ntpd[9215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:49.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:49 ntpd[9215]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:49.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:49 ntpd[9215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:49.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:49 ntpd[9215]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:49.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:49 ntpd[9215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:49.927 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:49 ntpd[9215]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:49.927 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:49 ntpd[9215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:49.927 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:49 ntpd[9215]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:50.925 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:50 ntpd[9215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:50.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:50 ntpd[9215]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:50.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:50 ntpd[9215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:50.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:50 ntpd[9215]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:50.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:50 ntpd[9215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:50.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:50 ntpd[9215]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:50.927 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:50 ntpd[9215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:50.927 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:50 ntpd[9215]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:51.925 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:51 ntpd[9215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:51.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:51 ntpd[9215]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:51.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:51 ntpd[9215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:51.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:51 ntpd[9215]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:51.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:51 ntpd[9215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:51.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:51 ntpd[9215]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:51.927 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:51 ntpd[9215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:51.927 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:51 ntpd[9215]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:52.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:52 ntpd[9215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:52.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:52 ntpd[9215]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:52.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:52 ntpd[9215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:52.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:52 ntpd[9215]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:52.927 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:52 ntpd[9215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:52.927 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:52 ntpd[9215]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:52.927 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:52 ntpd[9215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:52.927 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:52 ntpd[9215]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:53.925 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:53 ntpd[9215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:53.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:53 ntpd[9215]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:53.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:53 ntpd[9215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:53.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:53 ntpd[9215]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:53.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:53 ntpd[9215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:53.927 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:53 ntpd[9215]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:53.927 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:53 ntpd[9215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:53.927 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:53 ntpd[9215]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:54.925 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:54 ntpd[9215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-04-09T18:22:54.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:54 ntpd[9215]: can't open /var/log/ntpstats/rawstats.20210409: Permission denied 2021-04-09T18:22:54.926 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:54 ntpd[9215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-04-09T18:22:54.927 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:54 ntpd[9215]: can't open /var/log/ntpstats/peerstats.20210409: Permission denied 2021-04-09T18:22:54.928 INFO:teuthology.orchestra.run.smithi144.stdout: 9 Apr 18:22:54 ntpd[9215]: ntpd: time slew -0.006339 s 2021-04-09T18:22:54.928 INFO:teuthology.orchestra.run.smithi144.stdout:ntpd: time slew -0.006339s 2021-04-09T18:22:54.929 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:54 ntpd[9215]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-04-09T18:22:54.930 INFO:teuthology.orchestra.run.smithi144.stderr: 9 Apr 18:22:54 ntpd[9215]: can't open /var/log/ntpstats/loopstats.20210409: Permission denied 2021-04-09T18:22:54.981 INFO:teuthology.orchestra.run.smithi144.stdout: remote refid st t when poll reach delay offset jitter 2021-04-09T18:22:54.982 INFO:teuthology.orchestra.run.smithi144.stdout:============================================================================== 2021-04-09T18:22:54.982 INFO:teuthology.orchestra.run.smithi144.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:22:54.982 INFO:teuthology.orchestra.run.smithi144.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:22:54.983 INFO:teuthology.orchestra.run.smithi144.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:22:54.983 INFO:teuthology.orchestra.run.smithi144.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:22:54.985 INFO:teuthology.run_tasks:Running task install... 2021-04-09T18:22:55.001 DEBUG:teuthology.task.install:project ceph 2021-04-09T18:22:55.001 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'd23cd2d5f486487b0b80655c4e33344f0f97b82b'}} 2021-04-09T18:22:55.002 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel']}, 'sha1': 'd23cd2d5f486487b0b80655c4e33344f0f97b82b'} 2021-04-09T18:22:55.002 INFO:teuthology.task.install:Using flavor: basic 2021-04-09T18:22:55.006 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python-ceph', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-ssh', 'ceph-fuse', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python-ceph', 'rbd-fuse']} 2021-04-09T18:22:55.007 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2021-04-09T18:22:55.007 DEBUG:teuthology.orchestra.run.smithi079:> sudo lsb_release -is 2021-04-09T18:22:55.067 INFO:teuthology.orchestra.run.smithi079.stdout:Ubuntu 2021-04-09T18:22:55.073 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-04-09T18:22:55.074 DEBUG:teuthology.orchestra.run.smithi089:> sudo lsb_release -is 2021-04-09T18:22:55.075 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-key list | grep Ceph 2021-04-09T18:22:55.131 INFO:teuthology.orchestra.run.smithi089.stdout:Ubuntu 2021-04-09T18:22:55.137 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-04-09T18:22:55.137 DEBUG:teuthology.orchestra.run.smithi090:> sudo lsb_release -is 2021-04-09T18:22:55.138 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-key list | grep Ceph 2021-04-09T18:22:55.204 INFO:teuthology.orchestra.run.smithi090.stdout:Ubuntu 2021-04-09T18:22:55.209 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-04-09T18:22:55.210 DEBUG:teuthology.orchestra.run.smithi136:> sudo lsb_release -is 2021-04-09T18:22:55.211 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-key list | grep Ceph 2021-04-09T18:22:55.229 INFO:teuthology.orchestra.run.smithi089.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-04-09T18:22:55.229 INFO:teuthology.orchestra.run.smithi079.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-04-09T18:22:55.266 INFO:teuthology.orchestra.run.smithi136.stdout:Ubuntu 2021-04-09T18:22:55.272 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-04-09T18:22:55.272 DEBUG:teuthology.orchestra.run.smithi144:> sudo lsb_release -is 2021-04-09T18:22:55.273 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-key list | grep Ceph 2021-04-09T18:22:55.286 INFO:teuthology.orchestra.run.smithi079.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-04-09T18:22:55.286 INFO:teuthology.orchestra.run.smithi079.stdout:uid [ unknown] Ceph.com (release key) 2021-04-09T18:22:55.288 INFO:teuthology.orchestra.run.smithi089.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-04-09T18:22:55.289 INFO:teuthology.orchestra.run.smithi089.stdout:uid [ unknown] Ceph.com (release key) 2021-04-09T18:22:55.289 DEBUG:teuthology.orchestra.run.smithi079:> sudo lsb_release -is 2021-04-09T18:22:55.291 DEBUG:teuthology.orchestra.run.smithi089:> sudo lsb_release -is 2021-04-09T18:22:55.327 INFO:teuthology.orchestra.run.smithi090.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-04-09T18:22:55.342 INFO:teuthology.orchestra.run.smithi089.stdout:Ubuntu 2021-04-09T18:22:55.345 INFO:teuthology.orchestra.run.smithi144.stdout:Ubuntu 2021-04-09T18:22:55.347 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-04-09T18:22:55.348 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python-ceph, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-04-09T18:22:55.348 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev on remote deb x86_64 2021-04-09T18:22:55.349 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=d23cd2d5f486487b0b80655c4e33344f0f97b82b 2021-04-09T18:22:55.354 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-04-09T18:22:55.355 DEBUG:teuthology.orchestra.run.smithi144:> sudo apt-key list | grep Ceph 2021-04-09T18:22:55.358 INFO:teuthology.orchestra.run.smithi079.stdout:Ubuntu 2021-04-09T18:22:55.363 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-04-09T18:22:55.364 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python-ceph, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-04-09T18:22:55.364 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev on remote deb x86_64 2021-04-09T18:22:55.365 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=d23cd2d5f486487b0b80655c4e33344f0f97b82b 2021-04-09T18:22:55.372 INFO:teuthology.orchestra.run.smithi136.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-04-09T18:22:55.387 INFO:teuthology.orchestra.run.smithi090.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-04-09T18:22:55.388 INFO:teuthology.orchestra.run.smithi090.stdout:uid [ unknown] Ceph.com (release key) 2021-04-09T18:22:55.389 DEBUG:teuthology.orchestra.run.smithi090:> sudo lsb_release -is 2021-04-09T18:22:55.439 INFO:teuthology.orchestra.run.smithi136.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-04-09T18:22:55.440 INFO:teuthology.orchestra.run.smithi136.stdout:uid [ unknown] Ceph.com (release key) 2021-04-09T18:22:55.440 DEBUG:teuthology.orchestra.run.smithi136:> sudo lsb_release -is 2021-04-09T18:22:55.452 INFO:teuthology.orchestra.run.smithi090.stdout:Ubuntu 2021-04-09T18:22:55.457 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-04-09T18:22:55.458 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python-ceph, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-04-09T18:22:55.458 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev on remote deb x86_64 2021-04-09T18:22:55.459 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=d23cd2d5f486487b0b80655c4e33344f0f97b82b 2021-04-09T18:22:55.466 INFO:teuthology.orchestra.run.smithi144.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-04-09T18:22:55.495 INFO:teuthology.orchestra.run.smithi136.stdout:Ubuntu 2021-04-09T18:22:55.500 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-04-09T18:22:55.501 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python-ceph, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-04-09T18:22:55.501 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev on remote deb x86_64 2021-04-09T18:22:55.501 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=d23cd2d5f486487b0b80655c4e33344f0f97b82b 2021-04-09T18:22:55.522 INFO:teuthology.orchestra.run.smithi144.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-04-09T18:22:55.522 INFO:teuthology.orchestra.run.smithi144.stdout:uid [ unknown] Ceph.com (release key) 2021-04-09T18:22:55.522 DEBUG:teuthology.orchestra.run.smithi144:> sudo lsb_release -is 2021-04-09T18:22:55.599 INFO:teuthology.orchestra.run.smithi144.stdout:Ubuntu 2021-04-09T18:22:55.605 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-04-09T18:22:55.605 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python-ceph, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-04-09T18:22:55.606 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev on remote deb x86_64 2021-04-09T18:22:55.608 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=d23cd2d5f486487b0b80655c4e33344f0f97b82b 2021-04-09T18:22:55.636 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default/ 2021-04-09T18:22:55.637 INFO:teuthology.task.install.deb:Package version is 14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:22:55.655 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default/ 2021-04-09T18:22:55.656 INFO:teuthology.task.install.deb:Package version is 14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:22:55.742 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default/ 2021-04-09T18:22:55.743 INFO:teuthology.task.install.deb:Package version is 14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:22:55.753 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default/ 2021-04-09T18:22:55.753 INFO:teuthology.task.install.deb:Package version is 14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:22:55.899 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default/ 2021-04-09T18:22:55.900 INFO:teuthology.task.install.deb:Package version is 14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:22:55.947 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2021-04-09T18:22:55.948 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-04-09T18:22:55.969 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2021-04-09T18:22:55.969 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-04-09T18:22:55.986 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get update 2021-04-09T18:22:56.019 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2021-04-09T18:22:56.069 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2021-04-09T18:22:56.069 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-04-09T18:22:56.072 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2021-04-09T18:22:56.073 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-04-09T18:22:56.089 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get update 2021-04-09T18:22:56.133 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-get update 2021-04-09T18:22:56.172 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-04-09T18:22:56.211 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2021-04-09T18:22:56.212 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-04-09T18:22:56.272 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-04-09T18:22:56.277 DEBUG:teuthology.orchestra.run.smithi144:> sudo apt-get update 2021-04-09T18:22:56.286 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-04-09T18:22:56.342 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-04-09T18:22:56.342 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-04-09T18:22:56.365 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-04-09T18:22:56.388 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-04-09T18:22:56.410 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-04-09T18:22:56.424 INFO:teuthology.orchestra.run.smithi089.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic InRelease 2021-04-09T18:22:56.446 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-04-09T18:22:56.446 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-04-09T18:22:56.448 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:5 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-04-09T18:22:56.468 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-04-09T18:22:56.469 INFO:teuthology.orchestra.run.smithi079.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic InRelease 2021-04-09T18:22:56.491 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:5 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-04-09T18:22:56.497 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic Release [7,663 B] 2021-04-09T18:22:56.515 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-04-09T18:22:56.532 INFO:teuthology.orchestra.run.smithi136.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic InRelease 2021-04-09T18:22:56.541 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic Release [7,663 B] 2021-04-09T18:22:56.548 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:5 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-04-09T18:22:56.573 INFO:teuthology.orchestra.run.smithi089.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic Release.gpg 2021-04-09T18:22:56.580 INFO:teuthology.orchestra.run.smithi090.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic InRelease 2021-04-09T18:22:56.596 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:5 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-04-09T18:22:56.598 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-04-09T18:22:56.598 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-04-09T18:22:56.606 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic Release [7,663 B] 2021-04-09T18:22:56.617 INFO:teuthology.orchestra.run.smithi079.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic Release.gpg 2021-04-09T18:22:56.645 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.6 kB] 2021-04-09T18:22:56.653 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic Release [7,663 B] 2021-04-09T18:22:56.666 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-04-09T18:22:56.681 INFO:teuthology.orchestra.run.smithi136.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic Release.gpg 2021-04-09T18:22:56.691 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,585 B] 2021-04-09T18:22:56.728 INFO:teuthology.orchestra.run.smithi090.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic Release.gpg 2021-04-09T18:22:56.731 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,585 B] 2021-04-09T18:22:56.739 INFO:teuthology.orchestra.run.smithi144.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic InRelease 2021-04-09T18:22:56.746 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:5 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-04-09T18:22:56.754 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.6 kB] 2021-04-09T18:22:56.775 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.6 kB] 2021-04-09T18:22:56.803 INFO:teuthology.orchestra.run.smithi090.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.6 kB] 2021-04-09T18:22:56.809 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 25.9 kB in 1s (42.3 kB/s) 2021-04-09T18:22:56.814 INFO:teuthology.orchestra.run.smithi144.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic Release [7,663 B] 2021-04-09T18:22:56.840 INFO:teuthology.orchestra.run.smithi136.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,585 B] 2021-04-09T18:22:56.889 INFO:teuthology.orchestra.run.smithi144.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic Release.gpg 2021-04-09T18:22:56.890 INFO:teuthology.orchestra.run.smithi090.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,585 B] 2021-04-09T18:22:56.924 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 25.9 kB in 1s (41.8 kB/s) 2021-04-09T18:22:56.935 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 25.9 kB in 1s (36.8 kB/s) 2021-04-09T18:22:56.963 INFO:teuthology.orchestra.run.smithi144.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.6 kB] 2021-04-09T18:22:57.032 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 25.9 kB in 1s (37.3 kB/s) 2021-04-09T18:22:57.054 INFO:teuthology.orchestra.run.smithi144.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,585 B] 2021-04-09T18:22:57.182 INFO:teuthology.orchestra.run.smithi144.stdout:Fetched 25.9 kB in 1s (37.7 kB/s) 2021-04-09T18:22:58.073 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2021-04-09T18:22:58.119 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.19-116-gd23cd2d5-1bionic ceph-mds=14.2.19-116-gd23cd2d5-1bionic ceph-mgr=14.2.19-116-gd23cd2d5-1bionic ceph-common=14.2.19-116-gd23cd2d5-1bionic ceph-fuse=14.2.19-116-gd23cd2d5-1bionic ceph-test=14.2.19-116-gd23cd2d5-1bionic radosgw=14.2.19-116-gd23cd2d5-1bionic python-ceph=14.2.19-116-gd23cd2d5-1bionic libcephfs2=14.2.19-116-gd23cd2d5-1bionic libcephfs-dev=14.2.19-116-gd23cd2d5-1bionic librados2=14.2.19-116-gd23cd2d5-1bionic librbd1=14.2.19-116-gd23cd2d5-1bionic rbd-fuse=14.2.19-116-gd23cd2d5-1bionic python3-cephfs=14.2.19-116-gd23cd2d5-1bionic cephfs-shell=14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:22:58.191 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2021-04-09T18:22:58.195 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2021-04-09T18:22:58.238 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.19-116-gd23cd2d5-1bionic ceph-mds=14.2.19-116-gd23cd2d5-1bionic ceph-mgr=14.2.19-116-gd23cd2d5-1bionic ceph-common=14.2.19-116-gd23cd2d5-1bionic ceph-fuse=14.2.19-116-gd23cd2d5-1bionic ceph-test=14.2.19-116-gd23cd2d5-1bionic radosgw=14.2.19-116-gd23cd2d5-1bionic python-ceph=14.2.19-116-gd23cd2d5-1bionic libcephfs2=14.2.19-116-gd23cd2d5-1bionic libcephfs-dev=14.2.19-116-gd23cd2d5-1bionic librados2=14.2.19-116-gd23cd2d5-1bionic librbd1=14.2.19-116-gd23cd2d5-1bionic rbd-fuse=14.2.19-116-gd23cd2d5-1bionic python3-cephfs=14.2.19-116-gd23cd2d5-1bionic cephfs-shell=14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:22:58.240 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2021-04-09T18:22:58.285 DEBUG:teuthology.orchestra.run.smithi136:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.19-116-gd23cd2d5-1bionic ceph-mds=14.2.19-116-gd23cd2d5-1bionic ceph-mgr=14.2.19-116-gd23cd2d5-1bionic ceph-common=14.2.19-116-gd23cd2d5-1bionic ceph-fuse=14.2.19-116-gd23cd2d5-1bionic ceph-test=14.2.19-116-gd23cd2d5-1bionic radosgw=14.2.19-116-gd23cd2d5-1bionic python-ceph=14.2.19-116-gd23cd2d5-1bionic libcephfs2=14.2.19-116-gd23cd2d5-1bionic libcephfs-dev=14.2.19-116-gd23cd2d5-1bionic librados2=14.2.19-116-gd23cd2d5-1bionic librbd1=14.2.19-116-gd23cd2d5-1bionic rbd-fuse=14.2.19-116-gd23cd2d5-1bionic python3-cephfs=14.2.19-116-gd23cd2d5-1bionic cephfs-shell=14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:22:58.299 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2021-04-09T18:22:58.319 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2021-04-09T18:22:58.344 DEBUG:teuthology.orchestra.run.smithi090:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.19-116-gd23cd2d5-1bionic ceph-mds=14.2.19-116-gd23cd2d5-1bionic ceph-mgr=14.2.19-116-gd23cd2d5-1bionic ceph-common=14.2.19-116-gd23cd2d5-1bionic ceph-fuse=14.2.19-116-gd23cd2d5-1bionic ceph-test=14.2.19-116-gd23cd2d5-1bionic radosgw=14.2.19-116-gd23cd2d5-1bionic python-ceph=14.2.19-116-gd23cd2d5-1bionic libcephfs2=14.2.19-116-gd23cd2d5-1bionic libcephfs-dev=14.2.19-116-gd23cd2d5-1bionic librados2=14.2.19-116-gd23cd2d5-1bionic librbd1=14.2.19-116-gd23cd2d5-1bionic rbd-fuse=14.2.19-116-gd23cd2d5-1bionic python3-cephfs=14.2.19-116-gd23cd2d5-1bionic cephfs-shell=14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:22:58.363 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2021-04-09T18:22:58.426 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2021-04-09T18:22:58.427 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2021-04-09T18:22:58.430 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2021-04-09T18:22:58.484 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2021-04-09T18:22:58.531 DEBUG:teuthology.orchestra.run.smithi144:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.19-116-gd23cd2d5-1bionic ceph-mds=14.2.19-116-gd23cd2d5-1bionic ceph-mgr=14.2.19-116-gd23cd2d5-1bionic ceph-common=14.2.19-116-gd23cd2d5-1bionic ceph-fuse=14.2.19-116-gd23cd2d5-1bionic ceph-test=14.2.19-116-gd23cd2d5-1bionic radosgw=14.2.19-116-gd23cd2d5-1bionic python-ceph=14.2.19-116-gd23cd2d5-1bionic libcephfs2=14.2.19-116-gd23cd2d5-1bionic libcephfs-dev=14.2.19-116-gd23cd2d5-1bionic librados2=14.2.19-116-gd23cd2d5-1bionic librbd1=14.2.19-116-gd23cd2d5-1bionic rbd-fuse=14.2.19-116-gd23cd2d5-1bionic python3-cephfs=14.2.19-116-gd23cd2d5-1bionic cephfs-shell=14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:22:58.553 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2021-04-09T18:22:58.554 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2021-04-09T18:22:58.596 INFO:teuthology.orchestra.run.smithi089.stdout:The following additional packages will be installed: 2021-04-09T18:22:58.596 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-04-09T18:22:58.597 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh 2021-04-09T18:22:58.599 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc libjs-underscore 2021-04-09T18:22:58.599 INFO:teuthology.orchestra.run.smithi089.stdout: libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 libradosstriper1 2021-04-09T18:22:58.600 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 libsnappy1v5 libxslt1.1 nvme-cli python-attr python-bcrypt 2021-04-09T18:22:58.600 INFO:teuthology.orchestra.run.smithi089.stdout: python-bs4 python-ceph-argparse python-cephfs python-certifi python-chardet 2021-04-09T18:22:58.600 INFO:teuthology.orchestra.run.smithi089.stdout: python-cherrypy3 python-decorator python-dnspython python-fasteners 2021-04-09T18:22:58.601 INFO:teuthology.orchestra.run.smithi089.stdout: python-formencode python-funcsigs python-html5lib python-httplib2 2021-04-09T18:22:58.601 INFO:teuthology.orchestra.run.smithi089.stdout: python-joblib python-jwt python-kubernetes python-logutils python-lxml 2021-04-09T18:22:58.602 INFO:teuthology.orchestra.run.smithi089.stdout: python-mako python-markupsafe python-monotonic python-oauth2client 2021-04-09T18:22:58.602 INFO:teuthology.orchestra.run.smithi089.stdout: python-openid python-openssl python-paste python-pastedeploy 2021-04-09T18:22:58.602 INFO:teuthology.orchestra.run.smithi089.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-pluggy 2021-04-09T18:22:58.603 INFO:teuthology.orchestra.run.smithi089.stdout: python-prettytable python-py python-pyasn1 python-pyasn1-modules 2021-04-09T18:22:58.603 INFO:teuthology.orchestra.run.smithi089.stdout: python-pyinotify python-pytest python-rados python-rbd python-repoze.lru 2021-04-09T18:22:58.604 INFO:teuthology.orchestra.run.smithi089.stdout: python-requests python-rgw python-routes python-rsa python-scgi python-scipy 2021-04-09T18:22:58.604 INFO:teuthology.orchestra.run.smithi089.stdout: python-simplegeneric python-simplejson python-singledispatch python-sklearn 2021-04-09T18:22:58.604 INFO:teuthology.orchestra.run.smithi089.stdout: python-sklearn-lib python-sqlalchemy python-sqlalchemy-ext python-tempita 2021-04-09T18:22:58.605 INFO:teuthology.orchestra.run.smithi089.stdout: python-uritemplate python-urllib3 python-waitress python-webencodings 2021-04-09T18:22:58.605 INFO:teuthology.orchestra.run.smithi089.stdout: python-webob python-websocket python-webtest python-werkzeug python-yaml 2021-04-09T18:22:58.606 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse python3-cmd2 python3-colorama python3-pyparsing 2021-04-09T18:22:58.606 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyperclip python3-rados socat xmlstarlet 2021-04-09T18:22:58.607 INFO:teuthology.orchestra.run.smithi089.stdout:Suggested packages: 2021-04-09T18:22:58.608 INFO:teuthology.orchestra.run.smithi089.stdout: python-influxdb python-attr-doc python-egenix-mxdatetime python-funcsigs-doc 2021-04-09T18:22:58.608 INFO:teuthology.orchestra.run.smithi089.stdout: python-genshi python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2021-04-09T18:22:58.609 INFO:teuthology.orchestra.run.smithi089.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2021-04-09T18:22:58.609 INFO:teuthology.orchestra.run.smithi089.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2021-04-09T18:22:58.609 INFO:teuthology.orchestra.run.smithi089.stdout: python-cherrypy python-flup python-pecan-doc subversion python-pytest-xdist 2021-04-09T18:22:58.610 INFO:teuthology.orchestra.run.smithi089.stdout: python-pyinotify-doc python-mock python-socks python-scipy-doc python-dap 2021-04-09T18:22:58.610 INFO:teuthology.orchestra.run.smithi089.stdout: python-scikits-optimization python-sklearn-doc ipython python-sqlalchemy-doc 2021-04-09T18:22:58.610 INFO:teuthology.orchestra.run.smithi089.stdout: python-psycopg2 python-pymysql python-fdb python-pymssql python-ntlm 2021-04-09T18:22:58.610 INFO:teuthology.orchestra.run.smithi089.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-pyquery 2021-04-09T18:22:58.610 INFO:teuthology.orchestra.run.smithi089.stdout: python-redis python-pylibmc | python-memcache python-termcolor 2021-04-09T18:22:58.611 INFO:teuthology.orchestra.run.smithi089.stdout: python-watchdog python-werkzeug-doc python-pyparsing-doc 2021-04-09T18:22:58.611 INFO:teuthology.orchestra.run.smithi136.stdout:Building dependency tree... 2021-04-09T18:22:58.611 INFO:teuthology.orchestra.run.smithi136.stdout:Reading state information... 2021-04-09T18:22:58.627 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2021-04-09T18:22:58.696 INFO:teuthology.orchestra.run.smithi090.stdout:Building dependency tree... 2021-04-09T18:22:58.697 INFO:teuthology.orchestra.run.smithi090.stdout:Reading state information... 2021-04-09T18:22:58.699 INFO:teuthology.orchestra.run.smithi089.stdout:The following NEW packages will be installed: 2021-04-09T18:22:58.699 INFO:teuthology.orchestra.run.smithi089.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-dashboard 2021-04-09T18:22:58.700 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local 2021-04-09T18:22:58.700 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh ceph-mon ceph-osd ceph-test 2021-04-09T18:22:58.702 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-shell formencode-i18n jq libcephfs-dev libcephfs2 libjq1 2021-04-09T18:22:58.702 INFO:teuthology.orchestra.run.smithi089.stdout: libjs-sphinxdoc libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 2021-04-09T18:22:58.702 INFO:teuthology.orchestra.run.smithi089.stdout: libonig4 librabbitmq4 libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 2021-04-09T18:22:58.703 INFO:teuthology.orchestra.run.smithi089.stdout: nvme-cli python-attr python-bcrypt python-bs4 python-ceph 2021-04-09T18:22:58.703 INFO:teuthology.orchestra.run.smithi089.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2021-04-09T18:22:58.703 INFO:teuthology.orchestra.run.smithi089.stdout: python-cherrypy3 python-decorator python-dnspython python-fasteners 2021-04-09T18:22:58.703 INFO:teuthology.orchestra.run.smithi089.stdout: python-formencode python-funcsigs python-html5lib python-httplib2 2021-04-09T18:22:58.704 INFO:teuthology.orchestra.run.smithi089.stdout: python-joblib python-jwt python-kubernetes python-logutils python-lxml 2021-04-09T18:22:58.704 INFO:teuthology.orchestra.run.smithi089.stdout: python-mako python-markupsafe python-monotonic python-oauth2client 2021-04-09T18:22:58.704 INFO:teuthology.orchestra.run.smithi089.stdout: python-openid python-openssl python-paste python-pastedeploy 2021-04-09T18:22:58.704 INFO:teuthology.orchestra.run.smithi089.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-pluggy 2021-04-09T18:22:58.705 INFO:teuthology.orchestra.run.smithi089.stdout: python-prettytable python-py python-pyasn1 python-pyasn1-modules 2021-04-09T18:22:58.705 INFO:teuthology.orchestra.run.smithi089.stdout: python-pyinotify python-pytest python-rados python-rbd python-repoze.lru 2021-04-09T18:22:58.705 INFO:teuthology.orchestra.run.smithi089.stdout: python-requests python-rgw python-routes python-rsa python-scgi python-scipy 2021-04-09T18:22:58.705 INFO:teuthology.orchestra.run.smithi089.stdout: python-simplegeneric python-simplejson python-singledispatch python-sklearn 2021-04-09T18:22:58.705 INFO:teuthology.orchestra.run.smithi089.stdout: python-sklearn-lib python-sqlalchemy python-sqlalchemy-ext python-tempita 2021-04-09T18:22:58.706 INFO:teuthology.orchestra.run.smithi089.stdout: python-uritemplate python-urllib3 python-waitress python-webencodings 2021-04-09T18:22:58.706 INFO:teuthology.orchestra.run.smithi089.stdout: python-webob python-websocket python-webtest python-werkzeug python-yaml 2021-04-09T18:22:58.706 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse python3-cephfs python3-cmd2 python3-colorama 2021-04-09T18:22:58.706 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyparsing python3-pyperclip python3-rados radosgw rbd-fuse socat 2021-04-09T18:22:58.707 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet 2021-04-09T18:22:58.707 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages will be upgraded: 2021-04-09T18:22:58.708 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 librbd1 2021-04-09T18:22:58.728 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2021-04-09T18:22:58.728 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-04-09T18:22:58.729 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh 2021-04-09T18:22:58.730 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc libjs-underscore 2021-04-09T18:22:58.730 INFO:teuthology.orchestra.run.smithi079.stdout: libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 libradosstriper1 2021-04-09T18:22:58.730 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2 libsnappy1v5 libxslt1.1 nvme-cli python-attr python-bcrypt 2021-04-09T18:22:58.731 INFO:teuthology.orchestra.run.smithi079.stdout: python-bs4 python-ceph-argparse python-cephfs python-certifi python-chardet 2021-04-09T18:22:58.731 INFO:teuthology.orchestra.run.smithi079.stdout: python-cherrypy3 python-decorator python-dnspython python-fasteners 2021-04-09T18:22:58.731 INFO:teuthology.orchestra.run.smithi079.stdout: python-formencode python-funcsigs python-html5lib python-httplib2 2021-04-09T18:22:58.731 INFO:teuthology.orchestra.run.smithi079.stdout: python-joblib python-jwt python-kubernetes python-logutils python-lxml 2021-04-09T18:22:58.732 INFO:teuthology.orchestra.run.smithi079.stdout: python-mako python-markupsafe python-monotonic python-oauth2client 2021-04-09T18:22:58.732 INFO:teuthology.orchestra.run.smithi079.stdout: python-openid python-openssl python-paste python-pastedeploy 2021-04-09T18:22:58.732 INFO:teuthology.orchestra.run.smithi079.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-pluggy 2021-04-09T18:22:58.732 INFO:teuthology.orchestra.run.smithi079.stdout: python-prettytable python-py python-pyasn1 python-pyasn1-modules 2021-04-09T18:22:58.733 INFO:teuthology.orchestra.run.smithi079.stdout: python-pyinotify python-pytest python-rados python-rbd python-repoze.lru 2021-04-09T18:22:58.733 INFO:teuthology.orchestra.run.smithi079.stdout: python-requests python-rgw python-routes python-rsa python-scgi python-scipy 2021-04-09T18:22:58.733 INFO:teuthology.orchestra.run.smithi079.stdout: python-simplegeneric python-simplejson python-singledispatch python-sklearn 2021-04-09T18:22:58.733 INFO:teuthology.orchestra.run.smithi079.stdout: python-sklearn-lib python-sqlalchemy python-sqlalchemy-ext python-tempita 2021-04-09T18:22:58.734 INFO:teuthology.orchestra.run.smithi079.stdout: python-uritemplate python-urllib3 python-waitress python-webencodings 2021-04-09T18:22:58.734 INFO:teuthology.orchestra.run.smithi079.stdout: python-webob python-websocket python-webtest python-werkzeug python-yaml 2021-04-09T18:22:58.734 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse python3-cmd2 python3-colorama python3-pyparsing 2021-04-09T18:22:58.734 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyperclip python3-rados socat xmlstarlet 2021-04-09T18:22:58.735 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2021-04-09T18:22:58.735 INFO:teuthology.orchestra.run.smithi079.stdout: python-influxdb python-attr-doc python-egenix-mxdatetime python-funcsigs-doc 2021-04-09T18:22:58.735 INFO:teuthology.orchestra.run.smithi079.stdout: python-genshi python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2021-04-09T18:22:58.736 INFO:teuthology.orchestra.run.smithi079.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2021-04-09T18:22:58.736 INFO:teuthology.orchestra.run.smithi079.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2021-04-09T18:22:58.736 INFO:teuthology.orchestra.run.smithi079.stdout: python-cherrypy python-flup python-pecan-doc subversion python-pytest-xdist 2021-04-09T18:22:58.736 INFO:teuthology.orchestra.run.smithi079.stdout: python-pyinotify-doc python-mock python-socks python-scipy-doc python-dap 2021-04-09T18:22:58.737 INFO:teuthology.orchestra.run.smithi079.stdout: python-scikits-optimization python-sklearn-doc ipython python-sqlalchemy-doc 2021-04-09T18:22:58.737 INFO:teuthology.orchestra.run.smithi079.stdout: python-psycopg2 python-pymysql python-fdb python-pymssql python-ntlm 2021-04-09T18:22:58.737 INFO:teuthology.orchestra.run.smithi079.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-pyquery 2021-04-09T18:22:58.737 INFO:teuthology.orchestra.run.smithi079.stdout: python-redis python-pylibmc | python-memcache python-termcolor 2021-04-09T18:22:58.738 INFO:teuthology.orchestra.run.smithi079.stdout: python-watchdog python-werkzeug-doc python-pyparsing-doc 2021-04-09T18:22:58.771 INFO:teuthology.orchestra.run.smithi136.stdout:The following additional packages will be installed: 2021-04-09T18:22:58.771 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-04-09T18:22:58.771 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh 2021-04-09T18:22:58.772 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc libjs-underscore 2021-04-09T18:22:58.773 INFO:teuthology.orchestra.run.smithi136.stdout: libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 libradosstriper1 2021-04-09T18:22:58.773 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2 libsnappy1v5 libxslt1.1 nvme-cli python-attr python-bcrypt 2021-04-09T18:22:58.773 INFO:teuthology.orchestra.run.smithi136.stdout: python-bs4 python-ceph-argparse python-cephfs python-certifi python-chardet 2021-04-09T18:22:58.774 INFO:teuthology.orchestra.run.smithi136.stdout: python-cherrypy3 python-decorator python-dnspython python-fasteners 2021-04-09T18:22:58.774 INFO:teuthology.orchestra.run.smithi136.stdout: python-formencode python-funcsigs python-html5lib python-httplib2 2021-04-09T18:22:58.774 INFO:teuthology.orchestra.run.smithi136.stdout: python-joblib python-jwt python-kubernetes python-logutils python-lxml 2021-04-09T18:22:58.775 INFO:teuthology.orchestra.run.smithi136.stdout: python-mako python-markupsafe python-monotonic python-oauth2client 2021-04-09T18:22:58.775 INFO:teuthology.orchestra.run.smithi136.stdout: python-openid python-openssl python-paste python-pastedeploy 2021-04-09T18:22:58.775 INFO:teuthology.orchestra.run.smithi136.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-pluggy 2021-04-09T18:22:58.775 INFO:teuthology.orchestra.run.smithi136.stdout: python-prettytable python-py python-pyasn1 python-pyasn1-modules 2021-04-09T18:22:58.776 INFO:teuthology.orchestra.run.smithi136.stdout: python-pyinotify python-pytest python-rados python-rbd python-repoze.lru 2021-04-09T18:22:58.776 INFO:teuthology.orchestra.run.smithi136.stdout: python-requests python-rgw python-routes python-rsa python-scgi python-scipy 2021-04-09T18:22:58.776 INFO:teuthology.orchestra.run.smithi136.stdout: python-simplegeneric python-simplejson python-singledispatch python-sklearn 2021-04-09T18:22:58.776 INFO:teuthology.orchestra.run.smithi136.stdout: python-sklearn-lib python-sqlalchemy python-sqlalchemy-ext python-tempita 2021-04-09T18:22:58.777 INFO:teuthology.orchestra.run.smithi136.stdout: python-uritemplate python-urllib3 python-waitress python-webencodings 2021-04-09T18:22:58.777 INFO:teuthology.orchestra.run.smithi136.stdout: python-webob python-websocket python-webtest python-werkzeug python-yaml 2021-04-09T18:22:58.777 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse python3-cmd2 python3-colorama python3-pyparsing 2021-04-09T18:22:58.777 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyperclip python3-rados socat xmlstarlet 2021-04-09T18:22:58.778 INFO:teuthology.orchestra.run.smithi136.stdout:Suggested packages: 2021-04-09T18:22:58.778 INFO:teuthology.orchestra.run.smithi136.stdout: python-influxdb python-attr-doc python-egenix-mxdatetime python-funcsigs-doc 2021-04-09T18:22:58.778 INFO:teuthology.orchestra.run.smithi136.stdout: python-genshi python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2021-04-09T18:22:58.778 INFO:teuthology.orchestra.run.smithi136.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2021-04-09T18:22:58.779 INFO:teuthology.orchestra.run.smithi136.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2021-04-09T18:22:58.779 INFO:teuthology.orchestra.run.smithi136.stdout: python-cherrypy python-flup python-pecan-doc subversion python-pytest-xdist 2021-04-09T18:22:58.779 INFO:teuthology.orchestra.run.smithi136.stdout: python-pyinotify-doc python-mock python-socks python-scipy-doc python-dap 2021-04-09T18:22:58.779 INFO:teuthology.orchestra.run.smithi136.stdout: python-scikits-optimization python-sklearn-doc ipython python-sqlalchemy-doc 2021-04-09T18:22:58.779 INFO:teuthology.orchestra.run.smithi136.stdout: python-psycopg2 python-pymysql python-fdb python-pymssql python-ntlm 2021-04-09T18:22:58.780 INFO:teuthology.orchestra.run.smithi136.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-pyquery 2021-04-09T18:22:58.780 INFO:teuthology.orchestra.run.smithi136.stdout: python-redis python-pylibmc | python-memcache python-termcolor 2021-04-09T18:22:58.780 INFO:teuthology.orchestra.run.smithi136.stdout: python-watchdog python-werkzeug-doc python-pyparsing-doc 2021-04-09T18:22:58.834 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2021-04-09T18:22:58.834 INFO:teuthology.orchestra.run.smithi079.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-dashboard 2021-04-09T18:22:58.834 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local 2021-04-09T18:22:58.834 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh ceph-mon ceph-osd ceph-test 2021-04-09T18:22:58.837 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-shell formencode-i18n jq libcephfs-dev libcephfs2 libjq1 2021-04-09T18:22:58.837 INFO:teuthology.orchestra.run.smithi079.stdout: libjs-sphinxdoc libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 2021-04-09T18:22:58.837 INFO:teuthology.orchestra.run.smithi079.stdout: libonig4 librabbitmq4 libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 2021-04-09T18:22:58.837 INFO:teuthology.orchestra.run.smithi079.stdout: nvme-cli python-attr python-bcrypt python-bs4 python-ceph 2021-04-09T18:22:58.838 INFO:teuthology.orchestra.run.smithi079.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2021-04-09T18:22:58.838 INFO:teuthology.orchestra.run.smithi079.stdout: python-cherrypy3 python-decorator python-dnspython python-fasteners 2021-04-09T18:22:58.838 INFO:teuthology.orchestra.run.smithi079.stdout: python-formencode python-funcsigs python-html5lib python-httplib2 2021-04-09T18:22:58.838 INFO:teuthology.orchestra.run.smithi079.stdout: python-joblib python-jwt python-kubernetes python-logutils python-lxml 2021-04-09T18:22:58.838 INFO:teuthology.orchestra.run.smithi079.stdout: python-mako python-markupsafe python-monotonic python-oauth2client 2021-04-09T18:22:58.839 INFO:teuthology.orchestra.run.smithi079.stdout: python-openid python-openssl python-paste python-pastedeploy 2021-04-09T18:22:58.839 INFO:teuthology.orchestra.run.smithi079.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-pluggy 2021-04-09T18:22:58.839 INFO:teuthology.orchestra.run.smithi079.stdout: python-prettytable python-py python-pyasn1 python-pyasn1-modules 2021-04-09T18:22:58.840 INFO:teuthology.orchestra.run.smithi079.stdout: python-pyinotify python-pytest python-rados python-rbd python-repoze.lru 2021-04-09T18:22:58.840 INFO:teuthology.orchestra.run.smithi079.stdout: python-requests python-rgw python-routes python-rsa python-scgi python-scipy 2021-04-09T18:22:58.840 INFO:teuthology.orchestra.run.smithi079.stdout: python-simplegeneric python-simplejson python-singledispatch python-sklearn 2021-04-09T18:22:58.840 INFO:teuthology.orchestra.run.smithi079.stdout: python-sklearn-lib python-sqlalchemy python-sqlalchemy-ext python-tempita 2021-04-09T18:22:58.840 INFO:teuthology.orchestra.run.smithi079.stdout: python-uritemplate python-urllib3 python-waitress python-webencodings 2021-04-09T18:22:58.841 INFO:teuthology.orchestra.run.smithi079.stdout: python-webob python-websocket python-webtest python-werkzeug python-yaml 2021-04-09T18:22:58.841 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse python3-cephfs python3-cmd2 python3-colorama 2021-04-09T18:22:58.841 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyparsing python3-pyperclip python3-rados radosgw rbd-fuse socat 2021-04-09T18:22:58.841 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet 2021-04-09T18:22:58.841 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages will be upgraded: 2021-04-09T18:22:58.842 INFO:teuthology.orchestra.run.smithi079.stdout: librados2 librbd1 2021-04-09T18:22:58.868 INFO:teuthology.orchestra.run.smithi090.stdout:The following additional packages will be installed: 2021-04-09T18:22:58.869 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-04-09T18:22:58.869 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh 2021-04-09T18:22:58.870 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc libjs-underscore 2021-04-09T18:22:58.870 INFO:teuthology.orchestra.run.smithi090.stdout: libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 libradosstriper1 2021-04-09T18:22:58.871 INFO:teuthology.orchestra.run.smithi090.stdout: librgw2 libsnappy1v5 libxslt1.1 nvme-cli python-attr python-bcrypt 2021-04-09T18:22:58.871 INFO:teuthology.orchestra.run.smithi090.stdout: python-bs4 python-ceph-argparse python-cephfs python-certifi python-chardet 2021-04-09T18:22:58.871 INFO:teuthology.orchestra.run.smithi090.stdout: python-cherrypy3 python-decorator python-dnspython python-fasteners 2021-04-09T18:22:58.871 INFO:teuthology.orchestra.run.smithi090.stdout: python-formencode python-funcsigs python-html5lib python-httplib2 2021-04-09T18:22:58.872 INFO:teuthology.orchestra.run.smithi090.stdout: python-joblib python-jwt python-kubernetes python-logutils python-lxml 2021-04-09T18:22:58.872 INFO:teuthology.orchestra.run.smithi090.stdout: python-mako python-markupsafe python-monotonic python-oauth2client 2021-04-09T18:22:58.872 INFO:teuthology.orchestra.run.smithi090.stdout: python-openid python-openssl python-paste python-pastedeploy 2021-04-09T18:22:58.872 INFO:teuthology.orchestra.run.smithi090.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-pluggy 2021-04-09T18:22:58.872 INFO:teuthology.orchestra.run.smithi090.stdout: python-prettytable python-py python-pyasn1 python-pyasn1-modules 2021-04-09T18:22:58.873 INFO:teuthology.orchestra.run.smithi090.stdout: python-pyinotify python-pytest python-rados python-rbd python-repoze.lru 2021-04-09T18:22:58.873 INFO:teuthology.orchestra.run.smithi090.stdout: python-requests python-rgw python-routes python-rsa python-scgi python-scipy 2021-04-09T18:22:58.873 INFO:teuthology.orchestra.run.smithi090.stdout: python-simplegeneric python-simplejson python-singledispatch python-sklearn 2021-04-09T18:22:58.873 INFO:teuthology.orchestra.run.smithi090.stdout: python-sklearn-lib python-sqlalchemy python-sqlalchemy-ext python-tempita 2021-04-09T18:22:58.874 INFO:teuthology.orchestra.run.smithi090.stdout: python-uritemplate python-urllib3 python-waitress python-webencodings 2021-04-09T18:22:58.874 INFO:teuthology.orchestra.run.smithi090.stdout: python-webob python-websocket python-webtest python-werkzeug python-yaml 2021-04-09T18:22:58.874 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse python3-cmd2 python3-colorama python3-pyparsing 2021-04-09T18:22:58.874 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyperclip python3-rados socat xmlstarlet 2021-04-09T18:22:58.875 INFO:teuthology.orchestra.run.smithi090.stdout:Suggested packages: 2021-04-09T18:22:58.875 INFO:teuthology.orchestra.run.smithi090.stdout: python-influxdb python-attr-doc python-egenix-mxdatetime python-funcsigs-doc 2021-04-09T18:22:58.876 INFO:teuthology.orchestra.run.smithi090.stdout: python-genshi python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2021-04-09T18:22:58.876 INFO:teuthology.orchestra.run.smithi090.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2021-04-09T18:22:58.876 INFO:teuthology.orchestra.run.smithi090.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2021-04-09T18:22:58.876 INFO:teuthology.orchestra.run.smithi090.stdout: python-cherrypy python-flup python-pecan-doc subversion python-pytest-xdist 2021-04-09T18:22:58.877 INFO:teuthology.orchestra.run.smithi090.stdout: python-pyinotify-doc python-mock python-socks python-scipy-doc python-dap 2021-04-09T18:22:58.877 INFO:teuthology.orchestra.run.smithi090.stdout: python-scikits-optimization python-sklearn-doc ipython python-sqlalchemy-doc 2021-04-09T18:22:58.877 INFO:teuthology.orchestra.run.smithi090.stdout: python-psycopg2 python-pymysql python-fdb python-pymssql python-ntlm 2021-04-09T18:22:58.877 INFO:teuthology.orchestra.run.smithi090.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-pyquery 2021-04-09T18:22:58.877 INFO:teuthology.orchestra.run.smithi090.stdout: python-redis python-pylibmc | python-memcache python-termcolor 2021-04-09T18:22:58.878 INFO:teuthology.orchestra.run.smithi090.stdout: python-watchdog python-werkzeug-doc python-pyparsing-doc 2021-04-09T18:22:58.879 INFO:teuthology.orchestra.run.smithi136.stdout:The following NEW packages will be installed: 2021-04-09T18:22:58.880 INFO:teuthology.orchestra.run.smithi136.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-dashboard 2021-04-09T18:22:58.880 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local 2021-04-09T18:22:58.880 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh ceph-mon ceph-osd ceph-test 2021-04-09T18:22:58.880 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-shell formencode-i18n jq libcephfs-dev libcephfs2 libjq1 2021-04-09T18:22:58.880 INFO:teuthology.orchestra.run.smithi136.stdout: libjs-sphinxdoc libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 2021-04-09T18:22:58.881 INFO:teuthology.orchestra.run.smithi136.stdout: libonig4 librabbitmq4 libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 2021-04-09T18:22:58.881 INFO:teuthology.orchestra.run.smithi136.stdout: nvme-cli python-attr python-bcrypt python-bs4 python-ceph 2021-04-09T18:22:58.881 INFO:teuthology.orchestra.run.smithi136.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2021-04-09T18:22:58.881 INFO:teuthology.orchestra.run.smithi136.stdout: python-cherrypy3 python-decorator python-dnspython python-fasteners 2021-04-09T18:22:58.882 INFO:teuthology.orchestra.run.smithi136.stdout: python-formencode python-funcsigs python-html5lib python-httplib2 2021-04-09T18:22:58.882 INFO:teuthology.orchestra.run.smithi136.stdout: python-joblib python-jwt python-kubernetes python-logutils python-lxml 2021-04-09T18:22:58.882 INFO:teuthology.orchestra.run.smithi136.stdout: python-mako python-markupsafe python-monotonic python-oauth2client 2021-04-09T18:22:58.882 INFO:teuthology.orchestra.run.smithi136.stdout: python-openid python-openssl python-paste python-pastedeploy 2021-04-09T18:22:58.882 INFO:teuthology.orchestra.run.smithi136.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-pluggy 2021-04-09T18:22:58.883 INFO:teuthology.orchestra.run.smithi136.stdout: python-prettytable python-py python-pyasn1 python-pyasn1-modules 2021-04-09T18:22:58.883 INFO:teuthology.orchestra.run.smithi136.stdout: python-pyinotify python-pytest python-rados python-rbd python-repoze.lru 2021-04-09T18:22:58.883 INFO:teuthology.orchestra.run.smithi136.stdout: python-requests python-rgw python-routes python-rsa python-scgi python-scipy 2021-04-09T18:22:58.883 INFO:teuthology.orchestra.run.smithi136.stdout: python-simplegeneric python-simplejson python-singledispatch python-sklearn 2021-04-09T18:22:58.884 INFO:teuthology.orchestra.run.smithi136.stdout: python-sklearn-lib python-sqlalchemy python-sqlalchemy-ext python-tempita 2021-04-09T18:22:58.884 INFO:teuthology.orchestra.run.smithi136.stdout: python-uritemplate python-urllib3 python-waitress python-webencodings 2021-04-09T18:22:58.884 INFO:teuthology.orchestra.run.smithi136.stdout: python-webob python-websocket python-webtest python-werkzeug python-yaml 2021-04-09T18:22:58.884 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse python3-cephfs python3-cmd2 python3-colorama 2021-04-09T18:22:58.884 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyparsing python3-pyperclip python3-rados radosgw rbd-fuse socat 2021-04-09T18:22:58.885 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet 2021-04-09T18:22:58.885 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages will be upgraded: 2021-04-09T18:22:58.885 INFO:teuthology.orchestra.run.smithi136.stdout: librados2 librbd1 2021-04-09T18:22:58.893 INFO:teuthology.orchestra.run.smithi089.stdout:2 upgraded, 109 newly installed, 0 to remove and 37 not upgraded. 2021-04-09T18:22:58.893 INFO:teuthology.orchestra.run.smithi089.stdout:Need to get 125 MB of archives. 2021-04-09T18:22:58.893 INFO:teuthology.orchestra.run.smithi089.stdout:After this operation, 564 MB of additional disk space will be used. 2021-04-09T18:22:58.893 INFO:teuthology.orchestra.run.smithi089.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-uritemplate all 0.6-1ubuntu1 [5,042 B] 2021-04-09T18:22:58.894 INFO:teuthology.orchestra.run.smithi144.stdout:Building dependency tree... 2021-04-09T18:22:58.894 INFO:teuthology.orchestra.run.smithi144.stdout:Reading state information... 2021-04-09T18:22:58.974 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2021-04-09T18:22:58.974 INFO:teuthology.orchestra.run.smithi090.stdout:The following NEW packages will be installed: 2021-04-09T18:22:58.975 INFO:teuthology.orchestra.run.smithi090.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-dashboard 2021-04-09T18:22:58.975 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local 2021-04-09T18:22:58.975 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh ceph-mon ceph-osd ceph-test 2021-04-09T18:22:58.977 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-shell formencode-i18n jq libcephfs-dev libcephfs2 libjq1 2021-04-09T18:22:58.977 INFO:teuthology.orchestra.run.smithi090.stdout: libjs-sphinxdoc libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 2021-04-09T18:22:58.977 INFO:teuthology.orchestra.run.smithi090.stdout: libonig4 librabbitmq4 libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 2021-04-09T18:22:58.977 INFO:teuthology.orchestra.run.smithi090.stdout: nvme-cli python-attr python-bcrypt python-bs4 python-ceph 2021-04-09T18:22:58.978 INFO:teuthology.orchestra.run.smithi090.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2021-04-09T18:22:58.978 INFO:teuthology.orchestra.run.smithi090.stdout: python-cherrypy3 python-decorator python-dnspython python-fasteners 2021-04-09T18:22:58.978 INFO:teuthology.orchestra.run.smithi090.stdout: python-formencode python-funcsigs python-html5lib python-httplib2 2021-04-09T18:22:58.978 INFO:teuthology.orchestra.run.smithi090.stdout: python-joblib python-jwt python-kubernetes python-logutils python-lxml 2021-04-09T18:22:58.978 INFO:teuthology.orchestra.run.smithi090.stdout: python-mako python-markupsafe python-monotonic python-oauth2client 2021-04-09T18:22:58.979 INFO:teuthology.orchestra.run.smithi090.stdout: python-openid python-openssl python-paste python-pastedeploy 2021-04-09T18:22:58.979 INFO:teuthology.orchestra.run.smithi090.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-pluggy 2021-04-09T18:22:58.979 INFO:teuthology.orchestra.run.smithi090.stdout: python-prettytable python-py python-pyasn1 python-pyasn1-modules 2021-04-09T18:22:58.979 INFO:teuthology.orchestra.run.smithi090.stdout: python-pyinotify python-pytest python-rados python-rbd python-repoze.lru 2021-04-09T18:22:58.980 INFO:teuthology.orchestra.run.smithi090.stdout: python-requests python-rgw python-routes python-rsa python-scgi python-scipy 2021-04-09T18:22:58.980 INFO:teuthology.orchestra.run.smithi090.stdout: python-simplegeneric python-simplejson python-singledispatch python-sklearn 2021-04-09T18:22:58.980 INFO:teuthology.orchestra.run.smithi090.stdout: python-sklearn-lib python-sqlalchemy python-sqlalchemy-ext python-tempita 2021-04-09T18:22:58.980 INFO:teuthology.orchestra.run.smithi090.stdout: python-uritemplate python-urllib3 python-waitress python-webencodings 2021-04-09T18:22:58.980 INFO:teuthology.orchestra.run.smithi090.stdout: python-webob python-websocket python-webtest python-werkzeug python-yaml 2021-04-09T18:22:58.981 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse python3-cephfs python3-cmd2 python3-colorama 2021-04-09T18:22:58.981 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyparsing python3-pyperclip python3-rados radosgw rbd-fuse socat 2021-04-09T18:22:58.981 INFO:teuthology.orchestra.run.smithi090.stdout: xmlstarlet 2021-04-09T18:22:58.982 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages will be upgraded: 2021-04-09T18:22:58.982 INFO:teuthology.orchestra.run.smithi090.stdout: librados2 librbd1 2021-04-09T18:22:59.027 INFO:teuthology.orchestra.run.smithi079.stdout:2 upgraded, 109 newly installed, 0 to remove and 37 not upgraded. 2021-04-09T18:22:59.028 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 125 MB of archives. 2021-04-09T18:22:59.028 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 564 MB of additional disk space will be used. 2021-04-09T18:22:59.028 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-uritemplate all 0.6-1ubuntu1 [5,042 B] 2021-04-09T18:22:59.065 INFO:teuthology.orchestra.run.smithi144.stdout:The following additional packages will be installed: 2021-04-09T18:22:59.065 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-04-09T18:22:59.065 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh 2021-04-09T18:22:59.066 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc libjs-underscore 2021-04-09T18:22:59.066 INFO:teuthology.orchestra.run.smithi144.stdout: libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 libradosstriper1 2021-04-09T18:22:59.067 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2 libsnappy1v5 libxslt1.1 nvme-cli python-attr python-bcrypt 2021-04-09T18:22:59.067 INFO:teuthology.orchestra.run.smithi144.stdout: python-bs4 python-ceph-argparse python-cephfs python-certifi python-chardet 2021-04-09T18:22:59.067 INFO:teuthology.orchestra.run.smithi144.stdout: python-cherrypy3 python-decorator python-dnspython python-fasteners 2021-04-09T18:22:59.067 INFO:teuthology.orchestra.run.smithi144.stdout: python-formencode python-funcsigs python-html5lib python-httplib2 2021-04-09T18:22:59.068 INFO:teuthology.orchestra.run.smithi144.stdout: python-joblib python-jwt python-kubernetes python-logutils python-lxml 2021-04-09T18:22:59.068 INFO:teuthology.orchestra.run.smithi144.stdout: python-mako python-markupsafe python-monotonic python-oauth2client 2021-04-09T18:22:59.068 INFO:teuthology.orchestra.run.smithi144.stdout: python-openid python-openssl python-paste python-pastedeploy 2021-04-09T18:22:59.068 INFO:teuthology.orchestra.run.smithi144.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-pluggy 2021-04-09T18:22:59.068 INFO:teuthology.orchestra.run.smithi144.stdout: python-prettytable python-py python-pyasn1 python-pyasn1-modules 2021-04-09T18:22:59.069 INFO:teuthology.orchestra.run.smithi144.stdout: python-pyinotify python-pytest python-rados python-rbd python-repoze.lru 2021-04-09T18:22:59.069 INFO:teuthology.orchestra.run.smithi144.stdout: python-requests python-rgw python-routes python-rsa python-scgi python-scipy 2021-04-09T18:22:59.069 INFO:teuthology.orchestra.run.smithi144.stdout: python-simplegeneric python-simplejson python-singledispatch python-sklearn 2021-04-09T18:22:59.069 INFO:teuthology.orchestra.run.smithi144.stdout: python-sklearn-lib python-sqlalchemy python-sqlalchemy-ext python-tempita 2021-04-09T18:22:59.069 INFO:teuthology.orchestra.run.smithi144.stdout: python-uritemplate python-urllib3 python-waitress python-webencodings 2021-04-09T18:22:59.070 INFO:teuthology.orchestra.run.smithi144.stdout: python-webob python-websocket python-webtest python-werkzeug python-yaml 2021-04-09T18:22:59.070 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse python3-cmd2 python3-colorama python3-pyparsing 2021-04-09T18:22:59.070 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyperclip python3-rados socat xmlstarlet 2021-04-09T18:22:59.071 INFO:teuthology.orchestra.run.smithi136.stdout:2 upgraded, 109 newly installed, 0 to remove and 37 not upgraded. 2021-04-09T18:22:59.071 INFO:teuthology.orchestra.run.smithi136.stdout:Need to get 125 MB of archives. 2021-04-09T18:22:59.071 INFO:teuthology.orchestra.run.smithi136.stdout:After this operation, 564 MB of additional disk space will be used. 2021-04-09T18:22:59.071 INFO:teuthology.orchestra.run.smithi136.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-uritemplate all 0.6-1ubuntu1 [5,042 B] 2021-04-09T18:22:59.072 INFO:teuthology.orchestra.run.smithi144.stdout:Suggested packages: 2021-04-09T18:22:59.072 INFO:teuthology.orchestra.run.smithi144.stdout: python-influxdb python-attr-doc python-egenix-mxdatetime python-funcsigs-doc 2021-04-09T18:22:59.072 INFO:teuthology.orchestra.run.smithi144.stdout: python-genshi python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2021-04-09T18:22:59.072 INFO:teuthology.orchestra.run.smithi144.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2021-04-09T18:22:59.073 INFO:teuthology.orchestra.run.smithi144.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2021-04-09T18:22:59.073 INFO:teuthology.orchestra.run.smithi144.stdout: python-cherrypy python-flup python-pecan-doc subversion python-pytest-xdist 2021-04-09T18:22:59.073 INFO:teuthology.orchestra.run.smithi144.stdout: python-pyinotify-doc python-mock python-socks python-scipy-doc python-dap 2021-04-09T18:22:59.073 INFO:teuthology.orchestra.run.smithi144.stdout: python-scikits-optimization python-sklearn-doc ipython python-sqlalchemy-doc 2021-04-09T18:22:59.073 INFO:teuthology.orchestra.run.smithi144.stdout: python-psycopg2 python-pymysql python-fdb python-pymssql python-ntlm 2021-04-09T18:22:59.074 INFO:teuthology.orchestra.run.smithi144.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-pyquery 2021-04-09T18:22:59.074 INFO:teuthology.orchestra.run.smithi144.stdout: python-redis python-pylibmc | python-memcache python-termcolor 2021-04-09T18:22:59.074 INFO:teuthology.orchestra.run.smithi144.stdout: python-watchdog python-werkzeug-doc python-pyparsing-doc 2021-04-09T18:22:59.075 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2021-04-09T18:22:59.108 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2021-04-09T18:22:59.134 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2021-04-09T18:22:59.136 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 14.2.19-116-gd23cd2d5-1bionic [1,567 kB] 2021-04-09T18:22:59.148 INFO:teuthology.orchestra.run.smithi136.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2021-04-09T18:22:59.155 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-04-09T18:22:59.167 INFO:teuthology.orchestra.run.smithi090.stdout:2 upgraded, 109 newly installed, 0 to remove and 37 not upgraded. 2021-04-09T18:22:59.168 INFO:teuthology.orchestra.run.smithi090.stdout:Need to get 125 MB of archives. 2021-04-09T18:22:59.168 INFO:teuthology.orchestra.run.smithi090.stdout:After this operation, 564 MB of additional disk space will be used. 2021-04-09T18:22:59.168 INFO:teuthology.orchestra.run.smithi090.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-uritemplate all 0.6-1ubuntu1 [5,042 B] 2021-04-09T18:22:59.169 INFO:teuthology.orchestra.run.smithi144.stdout:The following NEW packages will be installed: 2021-04-09T18:22:59.169 INFO:teuthology.orchestra.run.smithi144.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-dashboard 2021-04-09T18:22:59.169 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local 2021-04-09T18:22:59.170 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh ceph-mon ceph-osd ceph-test 2021-04-09T18:22:59.171 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-shell formencode-i18n jq libcephfs-dev libcephfs2 libjq1 2021-04-09T18:22:59.171 INFO:teuthology.orchestra.run.smithi144.stdout: libjs-sphinxdoc libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 2021-04-09T18:22:59.172 INFO:teuthology.orchestra.run.smithi144.stdout: libonig4 librabbitmq4 libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 2021-04-09T18:22:59.172 INFO:teuthology.orchestra.run.smithi144.stdout: nvme-cli python-attr python-bcrypt python-bs4 python-ceph 2021-04-09T18:22:59.172 INFO:teuthology.orchestra.run.smithi144.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2021-04-09T18:22:59.172 INFO:teuthology.orchestra.run.smithi144.stdout: python-cherrypy3 python-decorator python-dnspython python-fasteners 2021-04-09T18:22:59.173 INFO:teuthology.orchestra.run.smithi144.stdout: python-formencode python-funcsigs python-html5lib python-httplib2 2021-04-09T18:22:59.173 INFO:teuthology.orchestra.run.smithi144.stdout: python-joblib python-jwt python-kubernetes python-logutils python-lxml 2021-04-09T18:22:59.173 INFO:teuthology.orchestra.run.smithi144.stdout: python-mako python-markupsafe python-monotonic python-oauth2client 2021-04-09T18:22:59.173 INFO:teuthology.orchestra.run.smithi144.stdout: python-openid python-openssl python-paste python-pastedeploy 2021-04-09T18:22:59.173 INFO:teuthology.orchestra.run.smithi144.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-pluggy 2021-04-09T18:22:59.174 INFO:teuthology.orchestra.run.smithi144.stdout: python-prettytable python-py python-pyasn1 python-pyasn1-modules 2021-04-09T18:22:59.174 INFO:teuthology.orchestra.run.smithi144.stdout: python-pyinotify python-pytest python-rados python-rbd python-repoze.lru 2021-04-09T18:22:59.175 INFO:teuthology.orchestra.run.smithi144.stdout: python-requests python-rgw python-routes python-rsa python-scgi python-scipy 2021-04-09T18:22:59.175 INFO:teuthology.orchestra.run.smithi144.stdout: python-simplegeneric python-simplejson python-singledispatch python-sklearn 2021-04-09T18:22:59.175 INFO:teuthology.orchestra.run.smithi144.stdout: python-sklearn-lib python-sqlalchemy python-sqlalchemy-ext python-tempita 2021-04-09T18:22:59.175 INFO:teuthology.orchestra.run.smithi144.stdout: python-uritemplate python-urllib3 python-waitress python-webencodings 2021-04-09T18:22:59.176 INFO:teuthology.orchestra.run.smithi144.stdout: python-webob python-websocket python-webtest python-werkzeug python-yaml 2021-04-09T18:22:59.176 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse python3-cephfs python3-cmd2 python3-colorama 2021-04-09T18:22:59.176 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyparsing python3-pyperclip python3-rados radosgw rbd-fuse socat 2021-04-09T18:22:59.176 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet 2021-04-09T18:22:59.177 INFO:teuthology.orchestra.run.smithi144.stdout:The following packages will be upgraded: 2021-04-09T18:22:59.177 INFO:teuthology.orchestra.run.smithi144.stdout: librados2 librbd1 2021-04-09T18:22:59.248 INFO:teuthology.orchestra.run.smithi090.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2021-04-09T18:22:59.255 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2021-04-09T18:22:59.255 INFO:teuthology.orchestra.run.smithi136.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2021-04-09T18:22:59.262 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2021-04-09T18:22:59.265 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-04-09T18:22:59.275 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 14.2.19-116-gd23cd2d5-1bionic [1,567 kB] 2021-04-09T18:22:59.276 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2021-04-09T18:22:59.301 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-04-09T18:22:59.305 INFO:teuthology.orchestra.run.smithi089.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-04-09T18:22:59.308 INFO:teuthology.orchestra.run.smithi136.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2021-04-09T18:22:59.309 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-04-09T18:22:59.320 INFO:teuthology.orchestra.run.smithi136.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 14.2.19-116-gd23cd2d5-1bionic [1,567 kB] 2021-04-09T18:22:59.325 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-04-09T18:22:59.327 INFO:teuthology.orchestra.run.smithi089.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-04-09T18:22:59.339 INFO:teuthology.orchestra.run.smithi089.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2021-04-09T18:22:59.346 INFO:teuthology.orchestra.run.smithi089.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2021-04-09T18:22:59.363 INFO:teuthology.orchestra.run.smithi144.stdout:2 upgraded, 109 newly installed, 0 to remove and 37 not upgraded. 2021-04-09T18:22:59.363 INFO:teuthology.orchestra.run.smithi144.stdout:Need to get 125 MB of archives. 2021-04-09T18:22:59.364 INFO:teuthology.orchestra.run.smithi144.stdout:After this operation, 564 MB of additional disk space will be used. 2021-04-09T18:22:59.364 INFO:teuthology.orchestra.run.smithi144.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-uritemplate all 0.6-1ubuntu1 [5,042 B] 2021-04-09T18:22:59.365 INFO:teuthology.orchestra.run.smithi090.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2021-04-09T18:22:59.392 INFO:teuthology.orchestra.run.smithi089.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-jwt all 1.5.3+ds1-1 [15.8 kB] 2021-04-09T18:22:59.394 INFO:teuthology.orchestra.run.smithi089.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2021-04-09T18:22:59.400 INFO:teuthology.orchestra.run.smithi089.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2021-04-09T18:22:59.415 INFO:teuthology.orchestra.run.smithi090.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2021-04-09T18:22:59.418 INFO:teuthology.orchestra.run.smithi090.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-04-09T18:22:59.420 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2021-04-09T18:22:59.423 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-04-09T18:22:59.425 INFO:teuthology.orchestra.run.smithi089.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2021-04-09T18:22:59.425 INFO:teuthology.orchestra.run.smithi089.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2021-04-09T18:22:59.430 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 14.2.19-116-gd23cd2d5-1bionic [1,567 kB] 2021-04-09T18:22:59.432 INFO:teuthology.orchestra.run.smithi089.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2021-04-09T18:22:59.433 INFO:teuthology.orchestra.run.smithi136.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2021-04-09T18:22:59.434 INFO:teuthology.orchestra.run.smithi089.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2021-04-09T18:22:59.434 INFO:teuthology.orchestra.run.smithi089.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2021-04-09T18:22:59.439 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-04-09T18:22:59.440 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-04-09T18:22:59.444 INFO:teuthology.orchestra.run.smithi144.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2021-04-09T18:22:59.445 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-04-09T18:22:59.473 INFO:teuthology.orchestra.run.smithi136.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-04-09T18:22:59.477 INFO:teuthology.orchestra.run.smithi136.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-04-09T18:22:59.490 INFO:teuthology.orchestra.run.smithi079.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-04-09T18:22:59.500 INFO:teuthology.orchestra.run.smithi079.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2021-04-09T18:22:59.505 INFO:teuthology.orchestra.run.smithi089.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-04-09T18:22:59.506 INFO:teuthology.orchestra.run.smithi079.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2021-04-09T18:22:59.506 INFO:teuthology.orchestra.run.smithi136.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-04-09T18:22:59.509 INFO:teuthology.orchestra.run.smithi089.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2021-04-09T18:22:59.514 INFO:teuthology.orchestra.run.smithi089.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2021-04-09T18:22:59.516 INFO:teuthology.orchestra.run.smithi136.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2021-04-09T18:22:59.518 INFO:teuthology.orchestra.run.smithi089.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2021-04-09T18:22:59.523 INFO:teuthology.orchestra.run.smithi136.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2021-04-09T18:22:59.524 INFO:teuthology.orchestra.run.smithi089.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2021-04-09T18:22:59.527 INFO:teuthology.orchestra.run.smithi090.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2021-04-09T18:22:59.534 INFO:teuthology.orchestra.run.smithi079.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-jwt all 1.5.3+ds1-1 [15.8 kB] 2021-04-09T18:22:59.537 INFO:teuthology.orchestra.run.smithi079.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2021-04-09T18:22:59.544 INFO:teuthology.orchestra.run.smithi079.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2021-04-09T18:22:59.566 INFO:teuthology.orchestra.run.smithi090.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-04-09T18:22:59.575 INFO:teuthology.orchestra.run.smithi144.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2021-04-09T18:22:59.576 INFO:teuthology.orchestra.run.smithi136.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-jwt all 1.5.3+ds1-1 [15.8 kB] 2021-04-09T18:22:59.579 INFO:teuthology.orchestra.run.smithi090.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-04-09T18:22:59.579 INFO:teuthology.orchestra.run.smithi136.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2021-04-09T18:22:59.584 INFO:teuthology.orchestra.run.smithi079.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2021-04-09T18:22:59.584 INFO:teuthology.orchestra.run.smithi090.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-04-09T18:22:59.585 INFO:teuthology.orchestra.run.smithi136.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2021-04-09T18:22:59.586 INFO:teuthology.orchestra.run.smithi089.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2021-04-09T18:22:59.586 INFO:teuthology.orchestra.run.smithi079.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2021-04-09T18:22:59.590 INFO:teuthology.orchestra.run.smithi089.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2021-04-09T18:22:59.591 INFO:teuthology.orchestra.run.smithi089.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-04-09T18:22:59.591 INFO:teuthology.orchestra.run.smithi079.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2021-04-09T18:22:59.592 INFO:teuthology.orchestra.run.smithi079.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2021-04-09T18:22:59.593 INFO:teuthology.orchestra.run.smithi079.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2021-04-09T18:22:59.595 INFO:teuthology.orchestra.run.smithi136.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2021-04-09T18:22:59.596 INFO:teuthology.orchestra.run.smithi136.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2021-04-09T18:22:59.603 INFO:teuthology.orchestra.run.smithi136.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2021-04-09T18:22:59.603 INFO:teuthology.orchestra.run.smithi136.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2021-04-09T18:22:59.606 INFO:teuthology.orchestra.run.smithi144.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2021-04-09T18:22:59.613 INFO:teuthology.orchestra.run.smithi090.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-04-09T18:22:59.622 INFO:teuthology.orchestra.run.smithi090.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2021-04-09T18:22:59.625 INFO:teuthology.orchestra.run.smithi089.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-04-09T18:22:59.626 INFO:teuthology.orchestra.run.smithi089.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2021-04-09T18:22:59.629 INFO:teuthology.orchestra.run.smithi090.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2021-04-09T18:22:59.634 INFO:teuthology.orchestra.run.smithi144.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-04-09T18:22:59.663 INFO:teuthology.orchestra.run.smithi079.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-04-09T18:22:59.665 INFO:teuthology.orchestra.run.smithi144.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 14.2.19-116-gd23cd2d5-1bionic [1,567 kB] 2021-04-09T18:22:59.665 INFO:teuthology.orchestra.run.smithi089.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2021-04-09T18:22:59.667 INFO:teuthology.orchestra.run.smithi089.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2021-04-09T18:22:59.667 INFO:teuthology.orchestra.run.smithi079.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2021-04-09T18:22:59.671 INFO:teuthology.orchestra.run.smithi090.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-jwt all 1.5.3+ds1-1 [15.8 kB] 2021-04-09T18:22:59.672 INFO:teuthology.orchestra.run.smithi079.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2021-04-09T18:22:59.673 INFO:teuthology.orchestra.run.smithi089.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2021-04-09T18:22:59.674 INFO:teuthology.orchestra.run.smithi090.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2021-04-09T18:22:59.675 INFO:teuthology.orchestra.run.smithi136.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2021-04-09T18:22:59.676 INFO:teuthology.orchestra.run.smithi079.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2021-04-09T18:22:59.680 INFO:teuthology.orchestra.run.smithi136.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-04-09T18:22:59.681 INFO:teuthology.orchestra.run.smithi090.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2021-04-09T18:22:59.682 INFO:teuthology.orchestra.run.smithi079.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2021-04-09T18:22:59.684 INFO:teuthology.orchestra.run.smithi089.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2021-04-09T18:22:59.685 INFO:teuthology.orchestra.run.smithi136.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2021-04-09T18:22:59.690 INFO:teuthology.orchestra.run.smithi089.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.2 [86.0 kB] 2021-04-09T18:22:59.691 INFO:teuthology.orchestra.run.smithi136.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2021-04-09T18:22:59.695 INFO:teuthology.orchestra.run.smithi136.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2021-04-09T18:22:59.703 INFO:teuthology.orchestra.run.smithi136.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2021-04-09T18:22:59.725 INFO:teuthology.orchestra.run.smithi090.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2021-04-09T18:22:59.726 INFO:teuthology.orchestra.run.smithi090.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2021-04-09T18:22:59.730 INFO:teuthology.orchestra.run.smithi090.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2021-04-09T18:22:59.732 INFO:teuthology.orchestra.run.smithi090.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2021-04-09T18:22:59.732 INFO:teuthology.orchestra.run.smithi090.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2021-04-09T18:22:59.733 INFO:teuthology.orchestra.run.smithi144.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2021-04-09T18:22:59.737 INFO:teuthology.orchestra.run.smithi090.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-04-09T18:22:59.743 INFO:teuthology.orchestra.run.smithi144.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-04-09T18:22:59.744 INFO:teuthology.orchestra.run.smithi079.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2021-04-09T18:22:59.745 INFO:teuthology.orchestra.run.smithi089.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2021-04-09T18:22:59.747 INFO:teuthology.orchestra.run.smithi079.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2021-04-09T18:22:59.748 INFO:teuthology.orchestra.run.smithi089.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-04-09T18:22:59.749 INFO:teuthology.orchestra.run.smithi079.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-04-09T18:22:59.755 INFO:teuthology.orchestra.run.smithi136.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2021-04-09T18:22:59.756 INFO:teuthology.orchestra.run.smithi089.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2021-04-09T18:22:59.756 INFO:teuthology.orchestra.run.smithi089.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2021-04-09T18:22:59.757 INFO:teuthology.orchestra.run.smithi089.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2021-04-09T18:22:59.761 INFO:teuthology.orchestra.run.smithi136.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2021-04-09T18:22:59.762 INFO:teuthology.orchestra.run.smithi136.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-04-09T18:22:59.778 INFO:teuthology.orchestra.run.smithi144.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-04-09T18:22:59.781 INFO:teuthology.orchestra.run.smithi079.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-04-09T18:22:59.782 INFO:teuthology.orchestra.run.smithi079.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2021-04-09T18:22:59.784 INFO:teuthology.orchestra.run.smithi144.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-04-09T18:22:59.800 INFO:teuthology.orchestra.run.smithi136.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-04-09T18:22:59.804 INFO:teuthology.orchestra.run.smithi090.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2021-04-09T18:22:59.809 INFO:teuthology.orchestra.run.smithi090.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2021-04-09T18:22:59.813 INFO:teuthology.orchestra.run.smithi090.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2021-04-09T18:22:59.815 INFO:teuthology.orchestra.run.smithi144.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-04-09T18:22:59.820 INFO:teuthology.orchestra.run.smithi090.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2021-04-09T18:22:59.823 INFO:teuthology.orchestra.run.smithi079.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2021-04-09T18:22:59.825 INFO:teuthology.orchestra.run.smithi144.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2021-04-09T18:22:59.825 INFO:teuthology.orchestra.run.smithi079.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2021-04-09T18:22:59.826 INFO:teuthology.orchestra.run.smithi089.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2021-04-09T18:22:59.829 INFO:teuthology.orchestra.run.smithi089.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-decorator all 4.1.2-1 [9,300 B] 2021-04-09T18:22:59.830 INFO:teuthology.orchestra.run.smithi089.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-scipy amd64 0.19.1-2ubuntu1 [9,689 kB] 2021-04-09T18:22:59.831 INFO:teuthology.orchestra.run.smithi144.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2021-04-09T18:22:59.831 INFO:teuthology.orchestra.run.smithi079.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2021-04-09T18:22:59.835 INFO:teuthology.orchestra.run.smithi136.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2021-04-09T18:22:59.837 INFO:teuthology.orchestra.run.smithi136.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2021-04-09T18:22:59.839 INFO:teuthology.orchestra.run.smithi136.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2021-04-09T18:22:59.841 INFO:teuthology.orchestra.run.smithi079.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2021-04-09T18:22:59.845 INFO:teuthology.orchestra.run.smithi136.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2021-04-09T18:22:59.846 INFO:teuthology.orchestra.run.smithi079.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.2 [86.0 kB] 2021-04-09T18:22:59.856 INFO:teuthology.orchestra.run.smithi136.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2021-04-09T18:22:59.862 INFO:teuthology.orchestra.run.smithi136.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.2 [86.0 kB] 2021-04-09T18:22:59.870 INFO:teuthology.orchestra.run.smithi144.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-jwt all 1.5.3+ds1-1 [15.8 kB] 2021-04-09T18:22:59.873 INFO:teuthology.orchestra.run.smithi144.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2021-04-09T18:22:59.879 INFO:teuthology.orchestra.run.smithi144.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2021-04-09T18:22:59.891 INFO:teuthology.orchestra.run.smithi090.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2021-04-09T18:22:59.896 INFO:teuthology.orchestra.run.smithi090.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2021-04-09T18:22:59.897 INFO:teuthology.orchestra.run.smithi090.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-04-09T18:22:59.903 INFO:teuthology.orchestra.run.smithi079.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2021-04-09T18:22:59.904 INFO:teuthology.orchestra.run.smithi144.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2021-04-09T18:22:59.904 INFO:teuthology.orchestra.run.smithi144.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2021-04-09T18:22:59.906 INFO:teuthology.orchestra.run.smithi079.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-04-09T18:22:59.912 INFO:teuthology.orchestra.run.smithi144.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2021-04-09T18:22:59.913 INFO:teuthology.orchestra.run.smithi079.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2021-04-09T18:22:59.914 INFO:teuthology.orchestra.run.smithi144.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2021-04-09T18:22:59.914 INFO:teuthology.orchestra.run.smithi079.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2021-04-09T18:22:59.915 INFO:teuthology.orchestra.run.smithi136.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2021-04-09T18:22:59.915 INFO:teuthology.orchestra.run.smithi079.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2021-04-09T18:22:59.918 INFO:teuthology.orchestra.run.smithi136.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-04-09T18:22:59.925 INFO:teuthology.orchestra.run.smithi136.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2021-04-09T18:22:59.926 INFO:teuthology.orchestra.run.smithi136.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2021-04-09T18:22:59.933 INFO:teuthology.orchestra.run.smithi090.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-04-09T18:22:59.934 INFO:teuthology.orchestra.run.smithi090.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2021-04-09T18:22:59.936 INFO:teuthology.orchestra.run.smithi090.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2021-04-09T18:22:59.971 INFO:teuthology.orchestra.run.smithi090.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2021-04-09T18:22:59.977 INFO:teuthology.orchestra.run.smithi090.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2021-04-09T18:22:59.983 INFO:teuthology.orchestra.run.smithi079.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2021-04-09T18:22:59.984 INFO:teuthology.orchestra.run.smithi144.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2021-04-09T18:22:59.987 INFO:teuthology.orchestra.run.smithi079.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-decorator all 4.1.2-1 [9,300 B] 2021-04-09T18:22:59.988 INFO:teuthology.orchestra.run.smithi144.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-04-09T18:22:59.988 INFO:teuthology.orchestra.run.smithi079.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-scipy amd64 0.19.1-2ubuntu1 [9,689 kB] 2021-04-09T18:22:59.988 INFO:teuthology.orchestra.run.smithi090.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2021-04-09T18:22:59.992 INFO:teuthology.orchestra.run.smithi144.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2021-04-09T18:22:59.995 INFO:teuthology.orchestra.run.smithi136.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2021-04-09T18:22:59.995 INFO:teuthology.orchestra.run.smithi090.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.2 [86.0 kB] 2021-04-09T18:22:59.998 INFO:teuthology.orchestra.run.smithi144.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2021-04-09T18:22:59.998 INFO:teuthology.orchestra.run.smithi136.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2021-04-09T18:23:00.001 INFO:teuthology.orchestra.run.smithi144.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2021-04-09T18:23:00.003 INFO:teuthology.orchestra.run.smithi136.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-decorator all 4.1.2-1 [9,300 B] 2021-04-09T18:23:00.003 INFO:teuthology.orchestra.run.smithi136.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-scipy amd64 0.19.1-2ubuntu1 [9,689 kB] 2021-04-09T18:23:00.007 INFO:teuthology.orchestra.run.smithi144.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2021-04-09T18:23:00.051 INFO:teuthology.orchestra.run.smithi090.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2021-04-09T18:23:00.053 INFO:teuthology.orchestra.run.smithi090.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-04-09T18:23:00.061 INFO:teuthology.orchestra.run.smithi090.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2021-04-09T18:23:00.061 INFO:teuthology.orchestra.run.smithi090.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2021-04-09T18:23:00.063 INFO:teuthology.orchestra.run.smithi144.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2021-04-09T18:23:00.064 INFO:teuthology.orchestra.run.smithi090.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2021-04-09T18:23:00.065 INFO:teuthology.orchestra.run.smithi089.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 14.2.19-116-gd23cd2d5-1bionic [3,577 kB] 2021-04-09T18:23:00.068 INFO:teuthology.orchestra.run.smithi144.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2021-04-09T18:23:00.068 INFO:teuthology.orchestra.run.smithi090.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2021-04-09T18:23:00.069 INFO:teuthology.orchestra.run.smithi144.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-04-09T18:23:00.103 INFO:teuthology.orchestra.run.smithi144.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-04-09T18:23:00.130 INFO:teuthology.orchestra.run.smithi090.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-decorator all 4.1.2-1 [9,300 B] 2021-04-09T18:23:00.131 INFO:teuthology.orchestra.run.smithi090.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-scipy amd64 0.19.1-2ubuntu1 [9,689 kB] 2021-04-09T18:23:00.143 INFO:teuthology.orchestra.run.smithi144.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2021-04-09T18:23:00.144 INFO:teuthology.orchestra.run.smithi144.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2021-04-09T18:23:00.146 INFO:teuthology.orchestra.run.smithi144.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2021-04-09T18:23:00.149 INFO:teuthology.orchestra.run.smithi089.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn-lib amd64 0.19.1-3 [1,521 kB] 2021-04-09T18:23:00.152 INFO:teuthology.orchestra.run.smithi144.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2021-04-09T18:23:00.164 INFO:teuthology.orchestra.run.smithi144.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2021-04-09T18:23:00.170 INFO:teuthology.orchestra.run.smithi144.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.2 [86.0 kB] 2021-04-09T18:23:00.184 INFO:teuthology.orchestra.run.smithi089.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-joblib all 0.11-1 [112 kB] 2021-04-09T18:23:00.186 INFO:teuthology.orchestra.run.smithi089.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn all 0.19.1-3 [1,373 kB] 2021-04-09T18:23:00.218 INFO:teuthology.orchestra.run.smithi079.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 14.2.19-116-gd23cd2d5-1bionic [3,577 kB] 2021-04-09T18:23:00.223 INFO:teuthology.orchestra.run.smithi144.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2021-04-09T18:23:00.225 INFO:teuthology.orchestra.run.smithi144.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-04-09T18:23:00.230 INFO:teuthology.orchestra.run.smithi089.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-monotonic all 1.1-2 [5,262 B] 2021-04-09T18:23:00.231 INFO:teuthology.orchestra.run.smithi089.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-fasteners all 0.12.0-3 [13.4 kB] 2021-04-09T18:23:00.232 INFO:teuthology.orchestra.run.smithi089.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-httplib2 all 0.9.2+dfsg-1ubuntu0.3 [34.9 kB] 2021-04-09T18:23:00.233 INFO:teuthology.orchestra.run.smithi144.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2021-04-09T18:23:00.233 INFO:teuthology.orchestra.run.smithi144.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2021-04-09T18:23:00.234 INFO:teuthology.orchestra.run.smithi089.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1 all 0.4.2-3 [46.7 kB] 2021-04-09T18:23:00.235 INFO:teuthology.orchestra.run.smithi089.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1-modules all 0.2.1-0.2 [32.8 kB] 2021-04-09T18:23:00.235 INFO:teuthology.orchestra.run.smithi089.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-rsa all 3.4.2-1 [28.9 kB] 2021-04-09T18:23:00.235 INFO:teuthology.orchestra.run.smithi089.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy all 1.1.11+ds1-1ubuntu1 [682 kB] 2021-04-09T18:23:00.286 INFO:teuthology.orchestra.run.smithi079.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn-lib amd64 0.19.1-3 [1,521 kB] 2021-04-09T18:23:00.303 INFO:teuthology.orchestra.run.smithi144.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2021-04-09T18:23:00.306 INFO:teuthology.orchestra.run.smithi144.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2021-04-09T18:23:00.310 INFO:teuthology.orchestra.run.smithi144.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-decorator all 4.1.2-1 [9,300 B] 2021-04-09T18:23:00.310 INFO:teuthology.orchestra.run.smithi144.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-scipy amd64 0.19.1-2ubuntu1 [9,689 kB] 2021-04-09T18:23:00.312 INFO:teuthology.orchestra.run.smithi089.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-oauth2client all 4.1.2-3 [61.4 kB] 2021-04-09T18:23:00.313 INFO:teuthology.orchestra.run.smithi089.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-04-09T18:23:00.314 INFO:teuthology.orchestra.run.smithi089.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-yaml amd64 3.12-1build2 [115 kB] 2021-04-09T18:23:00.333 INFO:teuthology.orchestra.run.smithi136.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn-lib amd64 0.19.1-3 [1,521 kB] 2021-04-09T18:23:00.342 INFO:teuthology.orchestra.run.smithi079.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-joblib all 0.11-1 [112 kB] 2021-04-09T18:23:00.344 INFO:teuthology.orchestra.run.smithi079.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn all 0.19.1-3 [1,373 kB] 2021-04-09T18:23:00.361 INFO:teuthology.orchestra.run.smithi136.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-joblib all 0.11-1 [112 kB] 2021-04-09T18:23:00.363 INFO:teuthology.orchestra.run.smithi136.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn all 0.19.1-3 [1,373 kB] 2021-04-09T18:23:00.371 INFO:teuthology.orchestra.run.smithi079.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-monotonic all 1.1-2 [5,262 B] 2021-04-09T18:23:00.372 INFO:teuthology.orchestra.run.smithi079.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-fasteners all 0.12.0-3 [13.4 kB] 2021-04-09T18:23:00.373 INFO:teuthology.orchestra.run.smithi079.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-httplib2 all 0.9.2+dfsg-1ubuntu0.3 [34.9 kB] 2021-04-09T18:23:00.373 INFO:teuthology.orchestra.run.smithi079.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1 all 0.4.2-3 [46.7 kB] 2021-04-09T18:23:00.375 INFO:teuthology.orchestra.run.smithi079.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1-modules all 0.2.1-0.2 [32.8 kB] 2021-04-09T18:23:00.376 INFO:teuthology.orchestra.run.smithi079.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-rsa all 3.4.2-1 [28.9 kB] 2021-04-09T18:23:00.377 INFO:teuthology.orchestra.run.smithi079.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy all 1.1.11+ds1-1ubuntu1 [682 kB] 2021-04-09T18:23:00.392 INFO:teuthology.orchestra.run.smithi089.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-04-09T18:23:00.398 INFO:teuthology.orchestra.run.smithi089.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-04-09T18:23:00.399 INFO:teuthology.orchestra.run.smithi089.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-04-09T18:23:00.401 INFO:teuthology.orchestra.run.smithi089.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-04-09T18:23:00.402 INFO:teuthology.orchestra.run.smithi089.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-04-09T18:23:00.406 INFO:teuthology.orchestra.run.smithi089.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-04-09T18:23:00.408 INFO:teuthology.orchestra.run.smithi089.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-04-09T18:23:00.409 INFO:teuthology.orchestra.run.smithi136.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 14.2.19-116-gd23cd2d5-1bionic [3,577 kB] 2021-04-09T18:23:00.420 INFO:teuthology.orchestra.run.smithi136.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-monotonic all 1.1-2 [5,262 B] 2021-04-09T18:23:00.420 INFO:teuthology.orchestra.run.smithi136.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-fasteners all 0.12.0-3 [13.4 kB] 2021-04-09T18:23:00.421 INFO:teuthology.orchestra.run.smithi136.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-httplib2 all 0.9.2+dfsg-1ubuntu0.3 [34.9 kB] 2021-04-09T18:23:00.422 INFO:teuthology.orchestra.run.smithi136.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1 all 0.4.2-3 [46.7 kB] 2021-04-09T18:23:00.422 INFO:teuthology.orchestra.run.smithi136.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1-modules all 0.2.1-0.2 [32.8 kB] 2021-04-09T18:23:00.423 INFO:teuthology.orchestra.run.smithi136.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-rsa all 3.4.2-1 [28.9 kB] 2021-04-09T18:23:00.423 INFO:teuthology.orchestra.run.smithi136.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy all 1.1.11+ds1-1ubuntu1 [682 kB] 2021-04-09T18:23:00.447 INFO:teuthology.orchestra.run.smithi079.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-oauth2client all 4.1.2-3 [61.4 kB] 2021-04-09T18:23:00.448 INFO:teuthology.orchestra.run.smithi079.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-04-09T18:23:00.456 INFO:teuthology.orchestra.run.smithi090.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn-lib amd64 0.19.1-3 [1,521 kB] 2021-04-09T18:23:00.472 INFO:teuthology.orchestra.run.smithi089.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2021-04-09T18:23:00.473 INFO:teuthology.orchestra.run.smithi089.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-04-09T18:23:00.480 INFO:teuthology.orchestra.run.smithi089.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-04-09T18:23:00.481 INFO:teuthology.orchestra.run.smithi090.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-joblib all 0.11-1 [112 kB] 2021-04-09T18:23:00.482 INFO:teuthology.orchestra.run.smithi090.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn all 0.19.1-3 [1,373 kB] 2021-04-09T18:23:00.494 INFO:teuthology.orchestra.run.smithi136.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-oauth2client all 4.1.2-3 [61.4 kB] 2021-04-09T18:23:00.495 INFO:teuthology.orchestra.run.smithi136.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-04-09T18:23:00.527 INFO:teuthology.orchestra.run.smithi079.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-yaml amd64 3.12-1build2 [115 kB] 2021-04-09T18:23:00.531 INFO:teuthology.orchestra.run.smithi079.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-04-09T18:23:00.536 INFO:teuthology.orchestra.run.smithi079.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-04-09T18:23:00.540 INFO:teuthology.orchestra.run.smithi090.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-monotonic all 1.1-2 [5,262 B] 2021-04-09T18:23:00.540 INFO:teuthology.orchestra.run.smithi090.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-fasteners all 0.12.0-3 [13.4 kB] 2021-04-09T18:23:00.540 INFO:teuthology.orchestra.run.smithi090.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-httplib2 all 0.9.2+dfsg-1ubuntu0.3 [34.9 kB] 2021-04-09T18:23:00.542 INFO:teuthology.orchestra.run.smithi079.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-04-09T18:23:00.543 INFO:teuthology.orchestra.run.smithi079.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-04-09T18:23:00.543 INFO:teuthology.orchestra.run.smithi079.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-04-09T18:23:00.544 INFO:teuthology.orchestra.run.smithi090.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1 all 0.4.2-3 [46.7 kB] 2021-04-09T18:23:00.544 INFO:teuthology.orchestra.run.smithi090.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1-modules all 0.2.1-0.2 [32.8 kB] 2021-04-09T18:23:00.544 INFO:teuthology.orchestra.run.smithi090.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-rsa all 3.4.2-1 [28.9 kB] 2021-04-09T18:23:00.544 INFO:teuthology.orchestra.run.smithi090.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy all 1.1.11+ds1-1ubuntu1 [682 kB] 2021-04-09T18:23:00.545 INFO:teuthology.orchestra.run.smithi079.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-04-09T18:23:00.547 INFO:teuthology.orchestra.run.smithi079.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-04-09T18:23:00.552 INFO:teuthology.orchestra.run.smithi089.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-04-09T18:23:00.553 INFO:teuthology.orchestra.run.smithi089.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2021-04-09T18:23:00.554 INFO:teuthology.orchestra.run.smithi089.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2021-04-09T18:23:00.557 INFO:teuthology.orchestra.run.smithi089.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.4 [897 kB] 2021-04-09T18:23:00.572 INFO:teuthology.orchestra.run.smithi089.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2021-04-09T18:23:00.573 INFO:teuthology.orchestra.run.smithi089.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2021-04-09T18:23:00.576 INFO:teuthology.orchestra.run.smithi136.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-yaml amd64 3.12-1build2 [115 kB] 2021-04-09T18:23:00.576 INFO:teuthology.orchestra.run.smithi089.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-04-09T18:23:00.579 INFO:teuthology.orchestra.run.smithi136.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-04-09T18:23:00.585 INFO:teuthology.orchestra.run.smithi136.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-04-09T18:23:00.587 INFO:teuthology.orchestra.run.smithi136.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-04-09T18:23:00.588 INFO:teuthology.orchestra.run.smithi136.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-04-09T18:23:00.589 INFO:teuthology.orchestra.run.smithi136.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-04-09T18:23:00.592 INFO:teuthology.orchestra.run.smithi136.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-04-09T18:23:00.594 INFO:teuthology.orchestra.run.smithi136.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-04-09T18:23:00.607 INFO:teuthology.orchestra.run.smithi079.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2021-04-09T18:23:00.608 INFO:teuthology.orchestra.run.smithi079.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-04-09T18:23:00.616 INFO:teuthology.orchestra.run.smithi090.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-oauth2client all 4.1.2-3 [61.4 kB] 2021-04-09T18:23:00.618 INFO:teuthology.orchestra.run.smithi090.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-04-09T18:23:00.632 INFO:teuthology.orchestra.run.smithi089.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-04-09T18:23:00.634 INFO:teuthology.orchestra.run.smithi089.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2021-04-09T18:23:00.635 INFO:teuthology.orchestra.run.smithi089.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-04-09T18:23:00.649 INFO:teuthology.orchestra.run.smithi144.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn-lib amd64 0.19.1-3 [1,521 kB] 2021-04-09T18:23:00.656 INFO:teuthology.orchestra.run.smithi136.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2021-04-09T18:23:00.657 INFO:teuthology.orchestra.run.smithi136.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-04-09T18:23:00.668 INFO:teuthology.orchestra.run.smithi144.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-joblib all 0.11-1 [112 kB] 2021-04-09T18:23:00.669 INFO:teuthology.orchestra.run.smithi144.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn all 0.19.1-3 [1,373 kB] 2021-04-09T18:23:00.687 INFO:teuthology.orchestra.run.smithi079.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-04-09T18:23:00.688 INFO:teuthology.orchestra.run.smithi079.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-04-09T18:23:00.689 INFO:teuthology.orchestra.run.smithi079.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2021-04-09T18:23:00.690 INFO:teuthology.orchestra.run.smithi079.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2021-04-09T18:23:00.693 INFO:teuthology.orchestra.run.smithi079.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.4 [897 kB] 2021-04-09T18:23:00.696 INFO:teuthology.orchestra.run.smithi090.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-yaml amd64 3.12-1build2 [115 kB] 2021-04-09T18:23:00.705 INFO:teuthology.orchestra.run.smithi090.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-04-09T18:23:00.706 INFO:teuthology.orchestra.run.smithi090.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-04-09T18:23:00.708 INFO:teuthology.orchestra.run.smithi079.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2021-04-09T18:23:00.709 INFO:teuthology.orchestra.run.smithi090.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-04-09T18:23:00.710 INFO:teuthology.orchestra.run.smithi079.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2021-04-09T18:23:00.711 INFO:teuthology.orchestra.run.smithi079.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-04-09T18:23:00.712 INFO:teuthology.orchestra.run.smithi090.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-04-09T18:23:00.712 INFO:teuthology.orchestra.run.smithi090.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-04-09T18:23:00.713 INFO:teuthology.orchestra.run.smithi089.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2021-04-09T18:23:00.713 INFO:teuthology.orchestra.run.smithi089.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy-ext amd64 1.1.11+ds1-1ubuntu1 [13.4 kB] 2021-04-09T18:23:00.714 INFO:teuthology.orchestra.run.smithi090.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-04-09T18:23:00.716 INFO:teuthology.orchestra.run.smithi090.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-04-09T18:23:00.727 INFO:teuthology.orchestra.run.smithi144.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-monotonic all 1.1-2 [5,262 B] 2021-04-09T18:23:00.728 INFO:teuthology.orchestra.run.smithi144.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-fasteners all 0.12.0-3 [13.4 kB] 2021-04-09T18:23:00.728 INFO:teuthology.orchestra.run.smithi144.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-httplib2 all 0.9.2+dfsg-1ubuntu0.3 [34.9 kB] 2021-04-09T18:23:00.728 INFO:teuthology.orchestra.run.smithi144.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1 all 0.4.2-3 [46.7 kB] 2021-04-09T18:23:00.729 INFO:teuthology.orchestra.run.smithi144.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1-modules all 0.2.1-0.2 [32.8 kB] 2021-04-09T18:23:00.729 INFO:teuthology.orchestra.run.smithi144.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-rsa all 3.4.2-1 [28.9 kB] 2021-04-09T18:23:00.731 INFO:teuthology.orchestra.run.smithi144.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy all 1.1.11+ds1-1ubuntu1 [682 kB] 2021-04-09T18:23:00.736 INFO:teuthology.orchestra.run.smithi136.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-04-09T18:23:00.737 INFO:teuthology.orchestra.run.smithi136.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-04-09T18:23:00.737 INFO:teuthology.orchestra.run.smithi136.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2021-04-09T18:23:00.738 INFO:teuthology.orchestra.run.smithi136.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2021-04-09T18:23:00.741 INFO:teuthology.orchestra.run.smithi136.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.4 [897 kB] 2021-04-09T18:23:00.755 INFO:teuthology.orchestra.run.smithi136.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2021-04-09T18:23:00.757 INFO:teuthology.orchestra.run.smithi136.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2021-04-09T18:23:00.758 INFO:teuthology.orchestra.run.smithi136.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-04-09T18:23:00.767 INFO:teuthology.orchestra.run.smithi079.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-04-09T18:23:00.769 INFO:teuthology.orchestra.run.smithi079.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2021-04-09T18:23:00.776 INFO:teuthology.orchestra.run.smithi090.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2021-04-09T18:23:00.777 INFO:teuthology.orchestra.run.smithi090.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-04-09T18:23:00.811 INFO:teuthology.orchestra.run.smithi144.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-oauth2client all 4.1.2-3 [61.4 kB] 2021-04-09T18:23:00.811 INFO:teuthology.orchestra.run.smithi144.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-04-09T18:23:00.812 INFO:teuthology.orchestra.run.smithi144.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-yaml amd64 3.12-1build2 [115 kB] 2021-04-09T18:23:00.814 INFO:teuthology.orchestra.run.smithi144.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-04-09T18:23:00.815 INFO:teuthology.orchestra.run.smithi144.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-04-09T18:23:00.816 INFO:teuthology.orchestra.run.smithi136.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-04-09T18:23:00.816 INFO:teuthology.orchestra.run.smithi144.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-04-09T18:23:00.818 INFO:teuthology.orchestra.run.smithi136.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2021-04-09T18:23:00.819 INFO:teuthology.orchestra.run.smithi144.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-04-09T18:23:00.819 INFO:teuthology.orchestra.run.smithi144.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-04-09T18:23:00.821 INFO:teuthology.orchestra.run.smithi144.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-04-09T18:23:00.847 INFO:teuthology.orchestra.run.smithi079.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-04-09T18:23:00.851 INFO:teuthology.orchestra.run.smithi079.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2021-04-09T18:23:00.852 INFO:teuthology.orchestra.run.smithi079.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy-ext amd64 1.1.11+ds1-1ubuntu1 [13.4 kB] 2021-04-09T18:23:00.855 INFO:teuthology.orchestra.run.smithi090.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-04-09T18:23:00.856 INFO:teuthology.orchestra.run.smithi090.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-04-09T18:23:00.857 INFO:teuthology.orchestra.run.smithi090.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2021-04-09T18:23:00.857 INFO:teuthology.orchestra.run.smithi090.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2021-04-09T18:23:00.863 INFO:teuthology.orchestra.run.smithi090.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.4 [897 kB] 2021-04-09T18:23:00.876 INFO:teuthology.orchestra.run.smithi090.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2021-04-09T18:23:00.877 INFO:teuthology.orchestra.run.smithi090.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2021-04-09T18:23:00.878 INFO:teuthology.orchestra.run.smithi090.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-04-09T18:23:00.891 INFO:teuthology.orchestra.run.smithi144.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-04-09T18:23:00.895 INFO:teuthology.orchestra.run.smithi136.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-04-09T18:23:00.900 INFO:teuthology.orchestra.run.smithi136.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2021-04-09T18:23:00.901 INFO:teuthology.orchestra.run.smithi136.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy-ext amd64 1.1.11+ds1-1ubuntu1 [13.4 kB] 2021-04-09T18:23:00.935 INFO:teuthology.orchestra.run.smithi090.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-04-09T18:23:00.937 INFO:teuthology.orchestra.run.smithi090.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2021-04-09T18:23:00.941 INFO:teuthology.orchestra.run.smithi089.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 14.2.19-116-gd23cd2d5-1bionic [482 kB] 2021-04-09T18:23:00.971 INFO:teuthology.orchestra.run.smithi144.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2021-04-09T18:23:00.971 INFO:teuthology.orchestra.run.smithi144.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-04-09T18:23:00.979 INFO:teuthology.orchestra.run.smithi144.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-04-09T18:23:00.979 INFO:teuthology.orchestra.run.smithi144.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-04-09T18:23:00.980 INFO:teuthology.orchestra.run.smithi144.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2021-04-09T18:23:00.981 INFO:teuthology.orchestra.run.smithi144.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2021-04-09T18:23:00.983 INFO:teuthology.orchestra.run.smithi144.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.4 [897 kB] 2021-04-09T18:23:00.995 INFO:teuthology.orchestra.run.smithi144.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2021-04-09T18:23:00.996 INFO:teuthology.orchestra.run.smithi144.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2021-04-09T18:23:01.015 INFO:teuthology.orchestra.run.smithi090.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-04-09T18:23:01.019 INFO:teuthology.orchestra.run.smithi090.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2021-04-09T18:23:01.020 INFO:teuthology.orchestra.run.smithi090.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy-ext amd64 1.1.11+ds1-1ubuntu1 [13.4 kB] 2021-04-09T18:23:01.045 INFO:teuthology.orchestra.run.smithi089.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 14.2.19-116-gd23cd2d5-1bionic [326 kB] 2021-04-09T18:23:01.051 INFO:teuthology.orchestra.run.smithi144.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-04-09T18:23:01.130 INFO:teuthology.orchestra.run.smithi144.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-04-09T18:23:01.132 INFO:teuthology.orchestra.run.smithi144.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2021-04-09T18:23:01.133 INFO:teuthology.orchestra.run.smithi144.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-04-09T18:23:01.137 INFO:teuthology.orchestra.run.smithi144.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2021-04-09T18:23:01.138 INFO:teuthology.orchestra.run.smithi144.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy-ext amd64 1.1.11+ds1-1ubuntu1 [13.4 kB] 2021-04-09T18:23:01.138 INFO:teuthology.orchestra.run.smithi089.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse all 14.2.19-116-gd23cd2d5-1bionic [20.2 kB] 2021-04-09T18:23:01.139 INFO:teuthology.orchestra.run.smithi089.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 14.2.19-116-gd23cd2d5-1bionic [141 kB] 2021-04-09T18:23:01.144 INFO:teuthology.orchestra.run.smithi089.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 14.2.19-116-gd23cd2d5-1bionic [299 kB] 2021-04-09T18:23:01.191 INFO:teuthology.orchestra.run.smithi090.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 14.2.19-116-gd23cd2d5-1bionic [3,577 kB] 2021-04-09T18:23:01.444 INFO:teuthology.orchestra.run.smithi089.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 14.2.19-116-gd23cd2d5-1bionic [4,826 kB] 2021-04-09T18:23:01.591 INFO:teuthology.orchestra.run.smithi144.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 14.2.19-116-gd23cd2d5-1bionic [3,577 kB] 2021-04-09T18:23:01.721 INFO:teuthology.orchestra.run.smithi136.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 14.2.19-116-gd23cd2d5-1bionic [482 kB] 2021-04-09T18:23:01.857 INFO:teuthology.orchestra.run.smithi079.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 14.2.19-116-gd23cd2d5-1bionic [482 kB] 2021-04-09T18:23:01.893 INFO:teuthology.orchestra.run.smithi136.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 14.2.19-116-gd23cd2d5-1bionic [326 kB] 2021-04-09T18:23:02.056 INFO:teuthology.orchestra.run.smithi136.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse all 14.2.19-116-gd23cd2d5-1bionic [20.2 kB] 2021-04-09T18:23:02.057 INFO:teuthology.orchestra.run.smithi136.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 14.2.19-116-gd23cd2d5-1bionic [141 kB] 2021-04-09T18:23:02.062 INFO:teuthology.orchestra.run.smithi136.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 14.2.19-116-gd23cd2d5-1bionic [299 kB] 2021-04-09T18:23:02.098 INFO:teuthology.orchestra.run.smithi079.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 14.2.19-116-gd23cd2d5-1bionic [326 kB] 2021-04-09T18:23:02.196 INFO:teuthology.orchestra.run.smithi079.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse all 14.2.19-116-gd23cd2d5-1bionic [20.2 kB] 2021-04-09T18:23:02.197 INFO:teuthology.orchestra.run.smithi079.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 14.2.19-116-gd23cd2d5-1bionic [141 kB] 2021-04-09T18:23:02.231 INFO:teuthology.orchestra.run.smithi136.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 14.2.19-116-gd23cd2d5-1bionic [4,826 kB] 2021-04-09T18:23:02.278 INFO:teuthology.orchestra.run.smithi079.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 14.2.19-116-gd23cd2d5-1bionic [299 kB] 2021-04-09T18:23:02.377 INFO:teuthology.orchestra.run.smithi079.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 14.2.19-116-gd23cd2d5-1bionic [4,826 kB] 2021-04-09T18:23:02.397 INFO:teuthology.orchestra.run.smithi089.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 14.2.19-116-gd23cd2d5-1bionic [107 kB] 2021-04-09T18:23:02.480 INFO:teuthology.orchestra.run.smithi089.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 14.2.19-116-gd23cd2d5-1bionic [369 kB] 2021-04-09T18:23:02.574 INFO:teuthology.orchestra.run.smithi089.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 14.2.19-116-gd23cd2d5-1bionic [17.8 MB] 2021-04-09T18:23:03.238 INFO:teuthology.orchestra.run.smithi144.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 14.2.19-116-gd23cd2d5-1bionic [482 kB] 2021-04-09T18:23:03.345 INFO:teuthology.orchestra.run.smithi144.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 14.2.19-116-gd23cd2d5-1bionic [326 kB] 2021-04-09T18:23:03.447 INFO:teuthology.orchestra.run.smithi144.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse all 14.2.19-116-gd23cd2d5-1bionic [20.2 kB] 2021-04-09T18:23:03.448 INFO:teuthology.orchestra.run.smithi144.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 14.2.19-116-gd23cd2d5-1bionic [141 kB] 2021-04-09T18:23:03.545 INFO:teuthology.orchestra.run.smithi144.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 14.2.19-116-gd23cd2d5-1bionic [299 kB] 2021-04-09T18:23:03.648 INFO:teuthology.orchestra.run.smithi144.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 14.2.19-116-gd23cd2d5-1bionic [4,826 kB] 2021-04-09T18:23:03.921 INFO:teuthology.orchestra.run.smithi136.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 14.2.19-116-gd23cd2d5-1bionic [107 kB] 2021-04-09T18:23:03.925 INFO:teuthology.orchestra.run.smithi136.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 14.2.19-116-gd23cd2d5-1bionic [369 kB] 2021-04-09T18:23:04.022 INFO:teuthology.orchestra.run.smithi136.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 14.2.19-116-gd23cd2d5-1bionic [17.8 MB] 2021-04-09T18:23:04.438 INFO:teuthology.orchestra.run.smithi079.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 14.2.19-116-gd23cd2d5-1bionic [107 kB] 2021-04-09T18:23:04.492 INFO:teuthology.orchestra.run.smithi090.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 14.2.19-116-gd23cd2d5-1bionic [482 kB] 2021-04-09T18:23:04.516 INFO:teuthology.orchestra.run.smithi079.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 14.2.19-116-gd23cd2d5-1bionic [369 kB] 2021-04-09T18:23:04.625 INFO:teuthology.orchestra.run.smithi079.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 14.2.19-116-gd23cd2d5-1bionic [17.8 MB] 2021-04-09T18:23:04.878 INFO:teuthology.orchestra.run.smithi090.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 14.2.19-116-gd23cd2d5-1bionic [326 kB] 2021-04-09T18:23:05.171 INFO:teuthology.orchestra.run.smithi090.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse all 14.2.19-116-gd23cd2d5-1bionic [20.2 kB] 2021-04-09T18:23:05.173 INFO:teuthology.orchestra.run.smithi090.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 14.2.19-116-gd23cd2d5-1bionic [141 kB] 2021-04-09T18:23:05.202 INFO:teuthology.orchestra.run.smithi144.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 14.2.19-116-gd23cd2d5-1bionic [107 kB] 2021-04-09T18:23:05.292 INFO:teuthology.orchestra.run.smithi144.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 14.2.19-116-gd23cd2d5-1bionic [369 kB] 2021-04-09T18:23:05.316 INFO:teuthology.orchestra.run.smithi090.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 14.2.19-116-gd23cd2d5-1bionic [299 kB] 2021-04-09T18:23:05.393 INFO:teuthology.orchestra.run.smithi144.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 14.2.19-116-gd23cd2d5-1bionic [17.8 MB] 2021-04-09T18:23:05.574 INFO:teuthology.orchestra.run.smithi090.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 14.2.19-116-gd23cd2d5-1bionic [4,826 kB] 2021-04-09T18:23:06.333 INFO:teuthology.orchestra.run.smithi089.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 14.2.19-116-gd23cd2d5-1bionic [7,893 kB] 2021-04-09T18:23:07.951 INFO:teuthology.orchestra.run.smithi089.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 14.2.19-116-gd23cd2d5-1bionic [1,504 kB] 2021-04-09T18:23:08.299 INFO:teuthology.orchestra.run.smithi089.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 14.2.19-116-gd23cd2d5-1bionic [3,477 kB] 2021-04-09T18:23:08.811 INFO:teuthology.orchestra.run.smithi090.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 14.2.19-116-gd23cd2d5-1bionic [107 kB] 2021-04-09T18:23:08.878 INFO:teuthology.orchestra.run.smithi090.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 14.2.19-116-gd23cd2d5-1bionic [369 kB] 2021-04-09T18:23:09.023 INFO:teuthology.orchestra.run.smithi090.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 14.2.19-116-gd23cd2d5-1bionic [17.8 MB] 2021-04-09T18:23:09.195 INFO:teuthology.orchestra.run.smithi089.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 14.2.19-116-gd23cd2d5-1bionic [19.3 MB] 2021-04-09T18:23:09.296 INFO:teuthology.orchestra.run.smithi136.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 14.2.19-116-gd23cd2d5-1bionic [7,893 kB] 2021-04-09T18:23:10.633 INFO:teuthology.orchestra.run.smithi144.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 14.2.19-116-gd23cd2d5-1bionic [7,893 kB] 2021-04-09T18:23:11.111 INFO:teuthology.orchestra.run.smithi079.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 14.2.19-116-gd23cd2d5-1bionic [7,893 kB] 2021-04-09T18:23:11.153 INFO:teuthology.orchestra.run.smithi136.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 14.2.19-116-gd23cd2d5-1bionic [1,504 kB] 2021-04-09T18:23:11.544 INFO:teuthology.orchestra.run.smithi136.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 14.2.19-116-gd23cd2d5-1bionic [3,477 kB] 2021-04-09T18:23:12.391 INFO:teuthology.orchestra.run.smithi136.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 14.2.19-116-gd23cd2d5-1bionic [19.3 MB] 2021-04-09T18:23:13.137 INFO:teuthology.orchestra.run.smithi144.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 14.2.19-116-gd23cd2d5-1bionic [1,504 kB] 2021-04-09T18:23:13.362 INFO:teuthology.orchestra.run.smithi090.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 14.2.19-116-gd23cd2d5-1bionic [7,893 kB] 2021-04-09T18:23:13.532 INFO:teuthology.orchestra.run.smithi079.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 14.2.19-116-gd23cd2d5-1bionic [1,504 kB] 2021-04-09T18:23:13.590 INFO:teuthology.orchestra.run.smithi144.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 14.2.19-116-gd23cd2d5-1bionic [3,477 kB] 2021-04-09T18:23:13.651 INFO:teuthology.orchestra.run.smithi089.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 14.2.19-116-gd23cd2d5-1bionic [4,012 B] 2021-04-09T18:23:13.674 INFO:teuthology.orchestra.run.smithi089.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 14.2.19-116-gd23cd2d5-1bionic [564 kB] 2021-04-09T18:23:13.815 INFO:teuthology.orchestra.run.smithi089.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 14.2.19-116-gd23cd2d5-1bionic [1,940 kB] 2021-04-09T18:23:13.936 INFO:teuthology.orchestra.run.smithi079.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 14.2.19-116-gd23cd2d5-1bionic [3,477 kB] 2021-04-09T18:23:14.365 INFO:teuthology.orchestra.run.smithi089.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 14.2.19-116-gd23cd2d5-1bionic [3,457 kB] 2021-04-09T18:23:14.518 INFO:teuthology.orchestra.run.smithi144.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 14.2.19-116-gd23cd2d5-1bionic [19.3 MB] 2021-04-09T18:23:14.726 INFO:teuthology.orchestra.run.smithi090.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 14.2.19-116-gd23cd2d5-1bionic [1,504 kB] 2021-04-09T18:23:14.926 INFO:teuthology.orchestra.run.smithi079.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 14.2.19-116-gd23cd2d5-1bionic [19.3 MB] 2021-04-09T18:23:14.996 INFO:teuthology.orchestra.run.smithi090.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 14.2.19-116-gd23cd2d5-1bionic [3,477 kB] 2021-04-09T18:23:15.332 INFO:teuthology.orchestra.run.smithi089.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 14.2.19-116-gd23cd2d5-1bionic [34.6 kB] 2021-04-09T18:23:15.333 INFO:teuthology.orchestra.run.smithi089.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 14.2.19-116-gd23cd2d5-1bionic [1,093 kB] 2021-04-09T18:23:15.648 INFO:teuthology.orchestra.run.smithi090.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 14.2.19-116-gd23cd2d5-1bionic [19.3 MB] 2021-04-09T18:23:15.653 INFO:teuthology.orchestra.run.smithi089.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 14.2.19-116-gd23cd2d5-1bionic [4,132 B] 2021-04-09T18:23:15.654 INFO:teuthology.orchestra.run.smithi089.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 14.2.19-116-gd23cd2d5-1bionic [12.6 kB] 2021-04-09T18:23:15.669 INFO:teuthology.orchestra.run.smithi089.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-ssh all 14.2.19-116-gd23cd2d5-1bionic [13.0 kB] 2021-04-09T18:23:15.694 INFO:teuthology.orchestra.run.smithi089.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 14.2.19-116-gd23cd2d5-1bionic [30.6 MB] 2021-04-09T18:23:16.762 INFO:teuthology.orchestra.run.smithi136.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 14.2.19-116-gd23cd2d5-1bionic [4,012 B] 2021-04-09T18:23:16.763 INFO:teuthology.orchestra.run.smithi136.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 14.2.19-116-gd23cd2d5-1bionic [564 kB] 2021-04-09T18:23:16.881 INFO:teuthology.orchestra.run.smithi136.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 14.2.19-116-gd23cd2d5-1bionic [1,940 kB] 2021-04-09T18:23:17.274 INFO:teuthology.orchestra.run.smithi136.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 14.2.19-116-gd23cd2d5-1bionic [3,457 kB] 2021-04-09T18:23:18.046 INFO:teuthology.orchestra.run.smithi136.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 14.2.19-116-gd23cd2d5-1bionic [34.6 kB] 2021-04-09T18:23:18.064 INFO:teuthology.orchestra.run.smithi136.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 14.2.19-116-gd23cd2d5-1bionic [1,093 kB] 2021-04-09T18:23:18.305 INFO:teuthology.orchestra.run.smithi136.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 14.2.19-116-gd23cd2d5-1bionic [4,132 B] 2021-04-09T18:23:18.306 INFO:teuthology.orchestra.run.smithi136.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 14.2.19-116-gd23cd2d5-1bionic [12.6 kB] 2021-04-09T18:23:18.307 INFO:teuthology.orchestra.run.smithi136.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-ssh all 14.2.19-116-gd23cd2d5-1bionic [13.0 kB] 2021-04-09T18:23:18.309 INFO:teuthology.orchestra.run.smithi136.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 14.2.19-116-gd23cd2d5-1bionic [30.6 MB] 2021-04-09T18:23:19.445 INFO:teuthology.orchestra.run.smithi090.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 14.2.19-116-gd23cd2d5-1bionic [4,012 B] 2021-04-09T18:23:19.446 INFO:teuthology.orchestra.run.smithi090.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 14.2.19-116-gd23cd2d5-1bionic [564 kB] 2021-04-09T18:23:19.610 INFO:teuthology.orchestra.run.smithi090.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 14.2.19-116-gd23cd2d5-1bionic [1,940 kB] 2021-04-09T18:23:20.041 INFO:teuthology.orchestra.run.smithi090.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 14.2.19-116-gd23cd2d5-1bionic [3,457 kB] 2021-04-09T18:23:20.751 INFO:teuthology.orchestra.run.smithi144.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 14.2.19-116-gd23cd2d5-1bionic [4,012 B] 2021-04-09T18:23:20.752 INFO:teuthology.orchestra.run.smithi144.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 14.2.19-116-gd23cd2d5-1bionic [564 kB] 2021-04-09T18:23:20.858 INFO:teuthology.orchestra.run.smithi090.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 14.2.19-116-gd23cd2d5-1bionic [34.6 kB] 2021-04-09T18:23:20.878 INFO:teuthology.orchestra.run.smithi090.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 14.2.19-116-gd23cd2d5-1bionic [1,093 kB] 2021-04-09T18:23:20.923 INFO:teuthology.orchestra.run.smithi144.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 14.2.19-116-gd23cd2d5-1bionic [1,940 kB] 2021-04-09T18:23:21.138 INFO:teuthology.orchestra.run.smithi090.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 14.2.19-116-gd23cd2d5-1bionic [4,132 B] 2021-04-09T18:23:21.139 INFO:teuthology.orchestra.run.smithi090.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 14.2.19-116-gd23cd2d5-1bionic [12.6 kB] 2021-04-09T18:23:21.140 INFO:teuthology.orchestra.run.smithi090.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-ssh all 14.2.19-116-gd23cd2d5-1bionic [13.0 kB] 2021-04-09T18:23:21.142 INFO:teuthology.orchestra.run.smithi090.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 14.2.19-116-gd23cd2d5-1bionic [30.6 MB] 2021-04-09T18:23:21.571 INFO:teuthology.orchestra.run.smithi144.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 14.2.19-116-gd23cd2d5-1bionic [3,457 kB] 2021-04-09T18:23:22.520 INFO:teuthology.orchestra.run.smithi079.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 14.2.19-116-gd23cd2d5-1bionic [4,012 B] 2021-04-09T18:23:22.521 INFO:teuthology.orchestra.run.smithi079.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 14.2.19-116-gd23cd2d5-1bionic [564 kB] 2021-04-09T18:23:22.646 INFO:teuthology.orchestra.run.smithi144.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 14.2.19-116-gd23cd2d5-1bionic [34.6 kB] 2021-04-09T18:23:22.649 INFO:teuthology.orchestra.run.smithi144.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 14.2.19-116-gd23cd2d5-1bionic [1,093 kB] 2021-04-09T18:23:22.771 INFO:teuthology.orchestra.run.smithi079.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 14.2.19-116-gd23cd2d5-1bionic [1,940 kB] 2021-04-09T18:23:22.981 INFO:teuthology.orchestra.run.smithi144.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 14.2.19-116-gd23cd2d5-1bionic [4,132 B] 2021-04-09T18:23:23.002 INFO:teuthology.orchestra.run.smithi144.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 14.2.19-116-gd23cd2d5-1bionic [12.6 kB] 2021-04-09T18:23:23.003 INFO:teuthology.orchestra.run.smithi144.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-ssh all 14.2.19-116-gd23cd2d5-1bionic [13.0 kB] 2021-04-09T18:23:23.007 INFO:teuthology.orchestra.run.smithi144.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 14.2.19-116-gd23cd2d5-1bionic [30.6 MB] 2021-04-09T18:23:23.575 INFO:teuthology.orchestra.run.smithi079.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 14.2.19-116-gd23cd2d5-1bionic [3,457 kB] 2021-04-09T18:23:24.819 INFO:teuthology.orchestra.run.smithi079.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 14.2.19-116-gd23cd2d5-1bionic [34.6 kB] 2021-04-09T18:23:24.840 INFO:teuthology.orchestra.run.smithi079.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 14.2.19-116-gd23cd2d5-1bionic [1,093 kB] 2021-04-09T18:23:25.204 INFO:teuthology.orchestra.run.smithi079.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 14.2.19-116-gd23cd2d5-1bionic [4,132 B] 2021-04-09T18:23:25.204 INFO:teuthology.orchestra.run.smithi079.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 14.2.19-116-gd23cd2d5-1bionic [12.6 kB] 2021-04-09T18:23:25.206 INFO:teuthology.orchestra.run.smithi079.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-ssh all 14.2.19-116-gd23cd2d5-1bionic [13.0 kB] 2021-04-09T18:23:25.207 INFO:teuthology.orchestra.run.smithi079.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 14.2.19-116-gd23cd2d5-1bionic [30.6 MB] 2021-04-09T18:23:25.537 INFO:teuthology.orchestra.run.smithi089.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 14.2.19-116-gd23cd2d5-1bionic [358 kB] 2021-04-09T18:23:25.635 INFO:teuthology.orchestra.run.smithi089.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 14.2.19-116-gd23cd2d5-1bionic [20.5 kB] 2021-04-09T18:23:25.636 INFO:teuthology.orchestra.run.smithi089.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 14.2.19-116-gd23cd2d5-1bionic [146 kB] 2021-04-09T18:23:25.685 INFO:teuthology.orchestra.run.smithi089.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 14.2.19-116-gd23cd2d5-1bionic [14.1 kB] 2021-04-09T18:23:25.691 INFO:teuthology.orchestra.run.smithi089.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 14.2.19-116-gd23cd2d5-1bionic [17.9 kB] 2021-04-09T18:23:25.692 INFO:teuthology.orchestra.run.smithi089.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph amd64 14.2.19-116-gd23cd2d5-1bionic [4,072 B] 2021-04-09T18:23:25.694 INFO:teuthology.orchestra.run.smithi089.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 14.2.19-116-gd23cd2d5-1bionic [5,721 kB] 2021-04-09T18:23:27.293 INFO:teuthology.orchestra.run.smithi089.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 14.2.19-116-gd23cd2d5-1bionic [71.3 kB] 2021-04-09T18:23:27.719 INFO:teuthology.orchestra.run.smithi136.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 14.2.19-116-gd23cd2d5-1bionic [358 kB] 2021-04-09T18:23:27.816 INFO:teuthology.orchestra.run.smithi136.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 14.2.19-116-gd23cd2d5-1bionic [20.5 kB] 2021-04-09T18:23:27.823 INFO:teuthology.orchestra.run.smithi136.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 14.2.19-116-gd23cd2d5-1bionic [146 kB] 2021-04-09T18:23:27.850 INFO:teuthology.orchestra.run.smithi136.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 14.2.19-116-gd23cd2d5-1bionic [14.1 kB] 2021-04-09T18:23:27.868 INFO:teuthology.orchestra.run.smithi136.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 14.2.19-116-gd23cd2d5-1bionic [17.9 kB] 2021-04-09T18:23:27.869 INFO:teuthology.orchestra.run.smithi136.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph amd64 14.2.19-116-gd23cd2d5-1bionic [4,072 B] 2021-04-09T18:23:27.875 INFO:teuthology.orchestra.run.smithi136.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 14.2.19-116-gd23cd2d5-1bionic [5,721 kB] 2021-04-09T18:23:27.904 INFO:teuthology.orchestra.run.smithi090.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 14.2.19-116-gd23cd2d5-1bionic [358 kB] 2021-04-09T18:23:27.977 INFO:teuthology.orchestra.run.smithi090.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 14.2.19-116-gd23cd2d5-1bionic [20.5 kB] 2021-04-09T18:23:27.991 INFO:teuthology.orchestra.run.smithi090.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 14.2.19-116-gd23cd2d5-1bionic [146 kB] 2021-04-09T18:23:28.001 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 125 MB in 29s (4,380 kB/s) 2021-04-09T18:23:28.016 INFO:teuthology.orchestra.run.smithi090.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 14.2.19-116-gd23cd2d5-1bionic [14.1 kB] 2021-04-09T18:23:28.024 INFO:teuthology.orchestra.run.smithi090.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 14.2.19-116-gd23cd2d5-1bionic [17.9 kB] 2021-04-09T18:23:28.025 INFO:teuthology.orchestra.run.smithi090.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph amd64 14.2.19-116-gd23cd2d5-1bionic [4,072 B] 2021-04-09T18:23:28.027 INFO:teuthology.orchestra.run.smithi090.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 14.2.19-116-gd23cd2d5-1bionic [5,721 kB] 2021-04-09T18:23:28.128 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-uritemplate. 2021-04-09T18:23:28.174 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137596 files and directories currently installed.) 2021-04-09T18:23:28.177 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../000-python-uritemplate_0.6-1ubuntu1_all.deb ... 2021-04-09T18:23:28.226 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-uritemplate (0.6-1ubuntu1) ... 2021-04-09T18:23:29.329 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyparsing. 2021-04-09T18:23:29.342 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../001-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2021-04-09T18:23:29.388 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2021-04-09T18:23:29.470 INFO:teuthology.orchestra.run.smithi090.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 14.2.19-116-gd23cd2d5-1bionic [71.3 kB] 2021-04-09T18:23:29.740 INFO:teuthology.orchestra.run.smithi136.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 14.2.19-116-gd23cd2d5-1bionic [71.3 kB] 2021-04-09T18:23:29.741 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyperclip. 2021-04-09T18:23:29.755 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../002-python3-pyperclip_1.6.0-1_all.deb ... 2021-04-09T18:23:29.799 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2021-04-09T18:23:30.102 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cmd2. 2021-04-09T18:23:30.115 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../003-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2021-04-09T18:23:30.152 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2021-04-09T18:23:30.192 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 125 MB in 30s (4,105 kB/s) 2021-04-09T18:23:30.343 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-uritemplate. 2021-04-09T18:23:30.391 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137596 files and directories currently installed.) 2021-04-09T18:23:30.395 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../000-python-uritemplate_0.6-1ubuntu1_all.deb ... 2021-04-09T18:23:30.433 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-uritemplate (0.6-1ubuntu1) ... 2021-04-09T18:23:30.934 INFO:teuthology.orchestra.run.smithi144.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 14.2.19-116-gd23cd2d5-1bionic [358 kB] 2021-04-09T18:23:30.936 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pyparsing. 2021-04-09T18:23:30.937 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../001-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2021-04-09T18:23:30.937 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2021-04-09T18:23:30.938 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-04-09T18:23:30.938 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-04-09T18:23:30.939 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-04-09T18:23:30.939 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../005-librbd1_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:30.946 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 125 MB in 31s (4,056 kB/s) 2021-04-09T18:23:30.947 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-uritemplate. 2021-04-09T18:23:30.947 INFO:teuthology.orchestra.run.smithi136.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137596 files and directories currently installed.) 2021-04-09T18:23:30.947 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../000-python-uritemplate_0.6-1ubuntu1_all.deb ... 2021-04-09T18:23:30.948 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-uritemplate (0.6-1ubuntu1) ... 2021-04-09T18:23:30.981 INFO:teuthology.orchestra.run.smithi144.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 14.2.19-116-gd23cd2d5-1bionic [20.5 kB] 2021-04-09T18:23:30.987 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pyparsing. 2021-04-09T18:23:30.996 INFO:teuthology.orchestra.run.smithi144.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 14.2.19-116-gd23cd2d5-1bionic [146 kB] 2021-04-09T18:23:31.005 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../001-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2021-04-09T18:23:31.021 INFO:teuthology.orchestra.run.smithi144.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 14.2.19-116-gd23cd2d5-1bionic [14.1 kB] 2021-04-09T18:23:31.038 INFO:teuthology.orchestra.run.smithi144.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 14.2.19-116-gd23cd2d5-1bionic [17.9 kB] 2021-04-09T18:23:31.039 INFO:teuthology.orchestra.run.smithi144.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph amd64 14.2.19-116-gd23cd2d5-1bionic [4,072 B] 2021-04-09T18:23:31.040 INFO:teuthology.orchestra.run.smithi144.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 14.2.19-116-gd23cd2d5-1bionic [5,721 kB] 2021-04-09T18:23:31.045 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2021-04-09T18:23:31.051 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librbd1 (14.2.19-116-gd23cd2d5-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-04-09T18:23:31.382 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pyperclip. 2021-04-09T18:23:31.397 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../002-python3-pyperclip_1.6.0-1_all.deb ... 2021-04-09T18:23:31.440 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2021-04-09T18:23:31.569 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../006-librados2_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:31.673 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librados2 (14.2.19-116-gd23cd2d5-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-04-09T18:23:31.742 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-cmd2. 2021-04-09T18:23:31.756 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../003-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2021-04-09T18:23:31.792 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2021-04-09T18:23:31.860 INFO:teuthology.orchestra.run.smithi079.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 14.2.19-116-gd23cd2d5-1bionic [358 kB] 2021-04-09T18:23:31.901 INFO:teuthology.orchestra.run.smithi079.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 14.2.19-116-gd23cd2d5-1bionic [20.5 kB] 2021-04-09T18:23:31.903 INFO:teuthology.orchestra.run.smithi079.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 14.2.19-116-gd23cd2d5-1bionic [146 kB] 2021-04-09T18:23:31.917 INFO:teuthology.orchestra.run.smithi079.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 14.2.19-116-gd23cd2d5-1bionic [14.1 kB] 2021-04-09T18:23:31.917 INFO:teuthology.orchestra.run.smithi079.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 14.2.19-116-gd23cd2d5-1bionic [17.9 kB] 2021-04-09T18:23:31.918 INFO:teuthology.orchestra.run.smithi079.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph amd64 14.2.19-116-gd23cd2d5-1bionic [4,072 B] 2021-04-09T18:23:31.919 INFO:teuthology.orchestra.run.smithi079.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 14.2.19-116-gd23cd2d5-1bionic [5,721 kB] 2021-04-09T18:23:32.273 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pyperclip. 2021-04-09T18:23:32.289 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../002-python3-pyperclip_1.6.0-1_all.deb ... 2021-04-09T18:23:32.331 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2021-04-09T18:23:32.349 INFO:teuthology.orchestra.run.smithi144.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 14.2.19-116-gd23cd2d5-1bionic [71.3 kB] 2021-04-09T18:23:32.360 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libcephfs2. 2021-04-09T18:23:32.374 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../007-libcephfs2_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:32.419 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libcephfs2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:32.495 INFO:teuthology.orchestra.run.smithi079.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 14.2.19-116-gd23cd2d5-1bionic [71.3 kB] 2021-04-09T18:23:32.627 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cmd2. 2021-04-09T18:23:32.641 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../003-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2021-04-09T18:23:32.685 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2021-04-09T18:23:32.738 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-rados. 2021-04-09T18:23:32.751 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../008-python-rados_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:32.805 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-rados (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:32.846 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-04-09T18:23:32.861 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-04-09T18:23:32.946 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-04-09T18:23:33.013 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-04-09T18:23:33.028 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-04-09T18:23:33.055 INFO:teuthology.orchestra.run.smithi144.stdout:Fetched 125 MB in 33s (3,775 kB/s) 2021-04-09T18:23:33.082 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-ceph-argparse. 2021-04-09T18:23:33.096 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../009-python-ceph-argparse_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:23:33.105 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-04-09T18:23:33.141 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-ceph-argparse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:33.198 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 125 MB in 34s (3,721 kB/s) 2021-04-09T18:23:33.199 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-uritemplate. 2021-04-09T18:23:33.249 INFO:teuthology.orchestra.run.smithi144.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137596 files and directories currently installed.) 2021-04-09T18:23:33.253 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../000-python-uritemplate_0.6-1ubuntu1_all.deb ... 2021-04-09T18:23:33.298 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-uritemplate (0.6-1ubuntu1) ... 2021-04-09T18:23:33.314 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../005-librbd1_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:33.370 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-uritemplate. 2021-04-09T18:23:33.420 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137596 files and directories currently installed.) 2021-04-09T18:23:33.424 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../000-python-uritemplate_0.6-1ubuntu1_all.deb ... 2021-04-09T18:23:33.425 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../005-librbd1_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:33.441 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librbd1 (14.2.19-116-gd23cd2d5-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-04-09T18:23:33.444 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-cephfs. 2021-04-09T18:23:33.460 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../010-python-cephfs_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:33.469 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-uritemplate (0.6-1ubuntu1) ... 2021-04-09T18:23:33.502 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-cephfs (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:33.544 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librbd1 (14.2.19-116-gd23cd2d5-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-04-09T18:23:33.584 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pyparsing. 2021-04-09T18:23:33.599 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../001-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2021-04-09T18:23:33.642 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2021-04-09T18:23:33.771 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyparsing. 2021-04-09T18:23:33.785 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../001-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2021-04-09T18:23:33.822 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2021-04-09T18:23:33.953 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pyperclip. 2021-04-09T18:23:33.967 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../002-python3-pyperclip_1.6.0-1_all.deb ... 2021-04-09T18:23:33.997 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-prettytable. 2021-04-09T18:23:34.010 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../006-librados2_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:34.011 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../011-python-prettytable_0.7.2-3_all.deb ... 2021-04-09T18:23:34.012 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2021-04-09T18:23:34.055 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-prettytable (0.7.2-3) ... 2021-04-09T18:23:34.105 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../006-librados2_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:34.141 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyperclip. 2021-04-09T18:23:34.146 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librados2 (14.2.19-116-gd23cd2d5-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-04-09T18:23:34.155 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../002-python3-pyperclip_1.6.0-1_all.deb ... 2021-04-09T18:23:34.200 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2021-04-09T18:23:34.232 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librados2 (14.2.19-116-gd23cd2d5-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-04-09T18:23:34.291 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-rbd. 2021-04-09T18:23:34.306 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../012-python-rbd_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:34.314 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-cmd2. 2021-04-09T18:23:34.328 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../003-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2021-04-09T18:23:34.341 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-rbd (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:34.373 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2021-04-09T18:23:34.511 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cmd2. 2021-04-09T18:23:34.527 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../003-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2021-04-09T18:23:34.569 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2021-04-09T18:23:34.667 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-04-09T18:23:34.680 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-04-09T18:23:34.703 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-04-09T18:23:34.718 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../013-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-04-09T18:23:34.742 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-04-09T18:23:34.761 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-04-09T18:23:34.841 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libcephfs2. 2021-04-09T18:23:34.858 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../007-libcephfs2_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:34.900 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libcephfs2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:34.914 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-04-09T18:23:34.928 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-04-09T18:23:34.937 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libcephfs2. 2021-04-09T18:23:34.952 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../007-libcephfs2_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:34.996 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libcephfs2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:35.015 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-04-09T18:23:35.064 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librgw2. 2021-04-09T18:23:35.077 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../014-librgw2_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:35.092 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../005-librbd1_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:35.114 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librgw2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:35.211 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-rados. 2021-04-09T18:23:35.213 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking librbd1 (14.2.19-116-gd23cd2d5-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-04-09T18:23:35.224 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../008-python-rados_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:35.261 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-rados (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:35.298 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-rados. 2021-04-09T18:23:35.313 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../008-python-rados_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:35.357 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../005-librbd1_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:35.357 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-rados (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:35.477 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librbd1 (14.2.19-116-gd23cd2d5-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-04-09T18:23:35.605 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-ceph-argparse. 2021-04-09T18:23:35.619 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../009-python-ceph-argparse_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:23:35.651 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-ceph-argparse. 2021-04-09T18:23:35.655 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-ceph-argparse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:35.665 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../009-python-ceph-argparse_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:23:35.701 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-ceph-argparse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:35.741 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../006-librados2_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:35.792 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-rgw. 2021-04-09T18:23:35.804 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../015-python-rgw_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:35.834 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-rgw (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:35.867 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking librados2 (14.2.19-116-gd23cd2d5-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-04-09T18:23:35.949 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-cephfs. 2021-04-09T18:23:35.966 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../010-python-cephfs_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:35.997 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-cephfs. 2021-04-09T18:23:36.008 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-cephfs (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:36.012 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../010-python-cephfs_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:36.047 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../006-librados2_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:36.055 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-cephfs (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:36.153 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-04-09T18:23:36.167 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../016-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-04-09T18:23:36.174 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librados2 (14.2.19-116-gd23cd2d5-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-04-09T18:23:36.211 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-04-09T18:23:36.327 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-prettytable. 2021-04-09T18:23:36.343 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../011-python-prettytable_0.7.2-3_all.deb ... 2021-04-09T18:23:36.383 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-prettytable. 2021-04-09T18:23:36.397 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../011-python-prettytable_0.7.2-3_all.deb ... 2021-04-09T18:23:36.411 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-prettytable (0.7.2-3) ... 2021-04-09T18:23:36.442 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-prettytable (0.7.2-3) ... 2021-04-09T18:23:36.523 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-04-09T18:23:36.529 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libcephfs2. 2021-04-09T18:23:36.536 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../017-libleveldb1v5_1.20-2_amd64.deb ... 2021-04-09T18:23:36.543 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../007-libcephfs2_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:36.573 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-04-09T18:23:36.587 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libcephfs2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:36.655 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-rbd. 2021-04-09T18:23:36.668 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../012-python-rbd_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:36.694 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-rbd. 2021-04-09T18:23:36.708 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../012-python-rbd_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:36.713 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-rbd (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:36.744 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-rbd (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:36.853 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libcephfs2. 2021-04-09T18:23:36.868 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../007-libcephfs2_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:36.890 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-rados. 2021-04-09T18:23:36.893 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liboath0. 2021-04-09T18:23:36.903 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../008-python-rados_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:36.908 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../018-liboath0_2.6.1-1_amd64.deb ... 2021-04-09T18:23:36.912 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libcephfs2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:36.940 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-rados (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:36.951 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-04-09T18:23:37.074 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-04-09T18:23:37.087 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../013-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-04-09T18:23:37.124 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-04-09T18:23:37.140 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-04-09T18:23:37.154 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../013-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-04-09T18:23:37.199 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-04-09T18:23:37.214 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-rados. 2021-04-09T18:23:37.228 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../008-python-rados_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:37.242 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-ceph-argparse. 2021-04-09T18:23:37.257 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../009-python-ceph-argparse_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:23:37.262 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libradosstriper1. 2021-04-09T18:23:37.273 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-rados (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:37.276 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../019-libradosstriper1_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:37.300 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-ceph-argparse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:37.313 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libradosstriper1 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:37.469 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package librgw2. 2021-04-09T18:23:37.483 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../014-librgw2_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:37.510 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package librgw2. 2021-04-09T18:23:37.525 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../014-librgw2_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:37.527 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librgw2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:37.567 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-ceph-argparse. 2021-04-09T18:23:37.568 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librgw2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:37.578 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-cephfs. 2021-04-09T18:23:37.582 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../009-python-ceph-argparse_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:23:37.594 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../010-python-cephfs_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:37.626 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-ceph-argparse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:37.637 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-cephfs (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:37.758 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-common. 2021-04-09T18:23:37.771 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../020-ceph-common_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:37.811 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-common (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:37.956 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-prettytable. 2021-04-09T18:23:37.962 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-cephfs. 2021-04-09T18:23:37.971 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../011-python-prettytable_0.7.2-3_all.deb ... 2021-04-09T18:23:37.976 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../010-python-cephfs_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:38.014 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-prettytable (0.7.2-3) ... 2021-04-09T18:23:38.020 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-cephfs (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:38.188 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-rgw. 2021-04-09T18:23:38.201 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../015-python-rgw_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:38.238 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-rgw. 2021-04-09T18:23:38.238 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-rgw (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:38.252 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../015-python-rgw_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:38.266 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-rbd. 2021-04-09T18:23:38.280 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../012-python-rbd_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:38.288 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-rgw (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:38.325 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-rbd (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:38.332 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-prettytable. 2021-04-09T18:23:38.346 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../011-python-prettytable_0.7.2-3_all.deb ... 2021-04-09T18:23:38.390 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-prettytable (0.7.2-3) ... 2021-04-09T18:23:38.557 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-04-09T18:23:38.573 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../016-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-04-09T18:23:38.616 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-04-09T18:23:38.617 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-04-09T18:23:38.632 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../016-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-04-09T18:23:38.643 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-rbd. 2021-04-09T18:23:38.659 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../012-python-rbd_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:38.675 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-04-09T18:23:38.686 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-04-09T18:23:38.700 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../013-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-04-09T18:23:38.701 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-rbd (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:38.744 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-04-09T18:23:38.952 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-04-09T18:23:38.966 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../017-libleveldb1v5_1.20-2_amd64.deb ... 2021-04-09T18:23:38.986 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-04-09T18:23:39.001 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../017-libleveldb1v5_1.20-2_amd64.deb ... 2021-04-09T18:23:39.011 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-04-09T18:23:39.037 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-04-09T18:23:39.071 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-04-09T18:23:39.072 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package librgw2. 2021-04-09T18:23:39.085 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../013-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-04-09T18:23:39.085 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../014-librgw2_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:39.121 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-04-09T18:23:39.122 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking librgw2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:39.388 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package liboath0. 2021-04-09T18:23:39.402 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../018-liboath0_2.6.1-1_amd64.deb ... 2021-04-09T18:23:39.408 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package liboath0. 2021-04-09T18:23:39.416 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librgw2. 2021-04-09T18:23:39.421 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../018-liboath0_2.6.1-1_amd64.deb ... 2021-04-09T18:23:39.431 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../014-librgw2_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:39.455 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-04-09T18:23:39.466 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-04-09T18:23:39.474 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librgw2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:39.526 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-base. 2021-04-09T18:23:39.539 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../021-ceph-base_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:39.593 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-base (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:39.786 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libradosstriper1. 2021-04-09T18:23:39.791 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-rgw. 2021-04-09T18:23:39.799 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../019-libradosstriper1_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:39.804 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../015-python-rgw_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:39.808 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libradosstriper1. 2021-04-09T18:23:39.822 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../019-libradosstriper1_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:39.841 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-rgw (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:39.844 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libradosstriper1 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:39.866 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libradosstriper1 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:40.119 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-rgw. 2021-04-09T18:23:40.134 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../015-python-rgw_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:40.160 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-04-09T18:23:40.175 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../016-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-04-09T18:23:40.177 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-rgw (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:40.219 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-04-09T18:23:40.273 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-common. 2021-04-09T18:23:40.289 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../020-ceph-common_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:40.320 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-common. 2021-04-09T18:23:40.331 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-common (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:40.336 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../020-ceph-common_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:40.378 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-common (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:40.514 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-04-09T18:23:40.529 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../016-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-04-09T18:23:40.538 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-04-09T18:23:40.554 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../017-libleveldb1v5_1.20-2_amd64.deb ... 2021-04-09T18:23:40.572 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-04-09T18:23:40.588 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-04-09T18:23:40.614 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-bcrypt. 2021-04-09T18:23:40.630 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../022-python-bcrypt_3.1.4-2_amd64.deb ... 2021-04-09T18:23:40.664 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2021-04-09T18:23:40.866 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-04-09T18:23:40.880 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../017-libleveldb1v5_1.20-2_amd64.deb ... 2021-04-09T18:23:40.917 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-04-09T18:23:40.957 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package liboath0. 2021-04-09T18:23:40.967 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-cherrypy3. 2021-04-09T18:23:40.972 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../018-liboath0_2.6.1-1_amd64.deb ... 2021-04-09T18:23:40.980 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../023-python-cherrypy3_8.9.1-2_all.deb ... 2021-04-09T18:23:41.016 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-04-09T18:23:41.017 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2021-04-09T18:23:41.295 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liboath0. 2021-04-09T18:23:41.308 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../018-liboath0_2.6.1-1_amd64.deb ... 2021-04-09T18:23:41.327 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libradosstriper1. 2021-04-09T18:23:41.341 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../019-libradosstriper1_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:41.353 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-04-09T18:23:41.354 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-jwt. 2021-04-09T18:23:41.368 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../024-python-jwt_1.5.3+ds1-1_all.deb ... 2021-04-09T18:23:41.385 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libradosstriper1 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:41.404 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-jwt (1.5.3+ds1-1) ... 2021-04-09T18:23:41.656 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libradosstriper1. 2021-04-09T18:23:41.669 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../019-libradosstriper1_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:41.698 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libradosstriper1 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:41.743 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-openssl. 2021-04-09T18:23:41.756 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../025-python-openssl_17.5.0-1ubuntu1_all.deb ... 2021-04-09T18:23:41.793 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2021-04-09T18:23:41.814 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-common. 2021-04-09T18:23:41.828 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../020-ceph-common_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:41.864 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-common (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:42.096 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-logutils. 2021-04-09T18:23:42.104 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-base. 2021-04-09T18:23:42.110 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../026-python-logutils_0.3.3-5_all.deb ... 2021-04-09T18:23:42.117 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../021-ceph-base_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:42.138 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-common. 2021-04-09T18:23:42.145 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-logutils (0.3.3-5) ... 2021-04-09T18:23:42.152 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../020-ceph-common_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:42.173 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-base (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:42.198 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-common (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:42.231 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-base. 2021-04-09T18:23:42.239 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../021-ceph-base_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:42.448 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-markupsafe. 2021-04-09T18:23:42.461 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-base (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:42.462 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../027-python-markupsafe_1.0-1build1_amd64.deb ... 2021-04-09T18:23:42.506 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2021-04-09T18:23:42.809 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-mako. 2021-04-09T18:23:42.823 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../028-python-mako_1.0.7+ds1-1_all.deb ... 2021-04-09T18:23:42.868 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2021-04-09T18:23:43.196 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-simplegeneric. 2021-04-09T18:23:43.211 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../029-python-simplegeneric_0.8.1-1_all.deb ... 2021-04-09T18:23:43.254 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2021-04-09T18:23:43.385 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-bcrypt. 2021-04-09T18:23:43.400 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../022-python-bcrypt_3.1.4-2_amd64.deb ... 2021-04-09T18:23:43.444 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2021-04-09T18:23:43.515 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-singledispatch. 2021-04-09T18:23:43.530 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../030-python-singledispatch_3.4.0.3-2_all.deb ... 2021-04-09T18:23:43.532 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-bcrypt. 2021-04-09T18:23:43.547 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../022-python-bcrypt_3.1.4-2_amd64.deb ... 2021-04-09T18:23:43.565 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2021-04-09T18:23:43.590 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2021-04-09T18:23:43.594 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-base. 2021-04-09T18:23:43.608 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../021-ceph-base_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:43.662 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-base (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:43.746 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-cherrypy3. 2021-04-09T18:23:43.760 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../023-python-cherrypy3_8.9.1-2_all.deb ... 2021-04-09T18:23:43.806 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2021-04-09T18:23:43.868 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-simplejson. 2021-04-09T18:23:43.882 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../031-python-simplejson_3.13.2-1_amd64.deb ... 2021-04-09T18:23:43.926 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-simplejson (3.13.2-1) ... 2021-04-09T18:23:43.937 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-base. 2021-04-09T18:23:43.943 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-cherrypy3. 2021-04-09T18:23:43.951 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../021-ceph-base_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:43.959 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../023-python-cherrypy3_8.9.1-2_all.deb ... 2021-04-09T18:23:44.002 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2021-04-09T18:23:44.005 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-base (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:44.152 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-jwt. 2021-04-09T18:23:44.165 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../024-python-jwt_1.5.3+ds1-1_all.deb ... 2021-04-09T18:23:44.210 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-jwt (1.5.3+ds1-1) ... 2021-04-09T18:23:44.268 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-webob. 2021-04-09T18:23:44.283 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../032-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-04-09T18:23:44.326 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2021-04-09T18:23:44.347 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-jwt. 2021-04-09T18:23:44.361 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../024-python-jwt_1.5.3+ds1-1_all.deb ... 2021-04-09T18:23:44.405 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-jwt (1.5.3+ds1-1) ... 2021-04-09T18:23:44.513 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-openssl. 2021-04-09T18:23:44.528 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../025-python-openssl_17.5.0-1ubuntu1_all.deb ... 2021-04-09T18:23:44.571 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2021-04-09T18:23:44.637 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-bs4. 2021-04-09T18:23:44.651 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../033-python-bs4_4.6.0-1_all.deb ... 2021-04-09T18:23:44.695 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-bs4 (4.6.0-1) ... 2021-04-09T18:23:44.724 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-bcrypt. 2021-04-09T18:23:44.725 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-openssl. 2021-04-09T18:23:44.738 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../025-python-openssl_17.5.0-1ubuntu1_all.deb ... 2021-04-09T18:23:44.740 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../022-python-bcrypt_3.1.4-2_amd64.deb ... 2021-04-09T18:23:44.782 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2021-04-09T18:23:44.808 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2021-04-09T18:23:44.877 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-logutils. 2021-04-09T18:23:44.891 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../026-python-logutils_0.3.3-5_all.deb ... 2021-04-09T18:23:44.928 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-logutils (0.3.3-5) ... 2021-04-09T18:23:45.048 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-waitress. 2021-04-09T18:23:45.063 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../034-python-waitress_1.0.1-1_all.deb ... 2021-04-09T18:23:45.077 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-cherrypy3. 2021-04-09T18:23:45.091 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../023-python-cherrypy3_8.9.1-2_all.deb ... 2021-04-09T18:23:45.102 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-logutils. 2021-04-09T18:23:45.106 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-waitress (1.0.1-1) ... 2021-04-09T18:23:45.109 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-bcrypt. 2021-04-09T18:23:45.115 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../026-python-logutils_0.3.3-5_all.deb ... 2021-04-09T18:23:45.123 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../022-python-bcrypt_3.1.4-2_amd64.deb ... 2021-04-09T18:23:45.135 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2021-04-09T18:23:45.152 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-logutils (0.3.3-5) ... 2021-04-09T18:23:45.168 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2021-04-09T18:23:45.240 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-markupsafe. 2021-04-09T18:23:45.254 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../027-python-markupsafe_1.0-1build1_amd64.deb ... 2021-04-09T18:23:45.299 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2021-04-09T18:23:45.422 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-markupsafe. 2021-04-09T18:23:45.434 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-dnspython. 2021-04-09T18:23:45.435 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../027-python-markupsafe_1.0-1build1_amd64.deb ... 2021-04-09T18:23:45.448 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../035-python-dnspython_1.15.0-1_all.deb ... 2021-04-09T18:23:45.472 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2021-04-09T18:23:45.479 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-cherrypy3. 2021-04-09T18:23:45.488 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-jwt. 2021-04-09T18:23:45.492 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../023-python-cherrypy3_8.9.1-2_all.deb ... 2021-04-09T18:23:45.493 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-dnspython (1.15.0-1) ... 2021-04-09T18:23:45.503 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../024-python-jwt_1.5.3+ds1-1_all.deb ... 2021-04-09T18:23:45.521 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2021-04-09T18:23:45.547 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-jwt (1.5.3+ds1-1) ... 2021-04-09T18:23:45.644 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-mako. 2021-04-09T18:23:45.657 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../028-python-mako_1.0.7+ds1-1_all.deb ... 2021-04-09T18:23:45.702 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2021-04-09T18:23:45.787 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package formencode-i18n. 2021-04-09T18:23:45.791 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-mako. 2021-04-09T18:23:45.802 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../036-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2021-04-09T18:23:45.805 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../028-python-mako_1.0.7+ds1-1_all.deb ... 2021-04-09T18:23:45.846 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2021-04-09T18:23:45.849 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2021-04-09T18:23:45.866 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-openssl. 2021-04-09T18:23:45.867 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-jwt. 2021-04-09T18:23:45.880 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../024-python-jwt_1.5.3+ds1-1_all.deb ... 2021-04-09T18:23:45.882 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../025-python-openssl_17.5.0-1ubuntu1_all.deb ... 2021-04-09T18:23:45.924 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2021-04-09T18:23:45.925 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-jwt (1.5.3+ds1-1) ... 2021-04-09T18:23:46.032 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-simplegeneric. 2021-04-09T18:23:46.048 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../029-python-simplegeneric_0.8.1-1_all.deb ... 2021-04-09T18:23:46.090 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2021-04-09T18:23:46.140 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-formencode. 2021-04-09T18:23:46.154 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../037-python-formencode_1.3.0-0ubuntu5_all.deb ... 2021-04-09T18:23:46.185 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-simplegeneric. 2021-04-09T18:23:46.198 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2021-04-09T18:23:46.200 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../029-python-simplegeneric_0.8.1-1_all.deb ... 2021-04-09T18:23:46.236 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-logutils. 2021-04-09T18:23:46.244 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2021-04-09T18:23:46.251 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../026-python-logutils_0.3.3-5_all.deb ... 2021-04-09T18:23:46.271 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-openssl. 2021-04-09T18:23:46.284 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../025-python-openssl_17.5.0-1ubuntu1_all.deb ... 2021-04-09T18:23:46.294 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-logutils (0.3.3-5) ... 2021-04-09T18:23:46.321 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2021-04-09T18:23:46.418 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-singledispatch. 2021-04-09T18:23:46.433 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../030-python-singledispatch_3.4.0.3-2_all.deb ... 2021-04-09T18:23:46.477 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2021-04-09T18:23:46.546 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-singledispatch. 2021-04-09T18:23:46.554 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-tempita. 2021-04-09T18:23:46.562 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../030-python-singledispatch_3.4.0.3-2_all.deb ... 2021-04-09T18:23:46.568 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../038-python-tempita_0.5.2-2_all.deb ... 2021-04-09T18:23:46.604 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-tempita (0.5.2-2) ... 2021-04-09T18:23:46.605 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2021-04-09T18:23:46.614 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-markupsafe. 2021-04-09T18:23:46.628 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../027-python-markupsafe_1.0-1build1_amd64.deb ... 2021-04-09T18:23:46.640 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-logutils. 2021-04-09T18:23:46.655 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../026-python-logutils_0.3.3-5_all.deb ... 2021-04-09T18:23:46.672 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2021-04-09T18:23:46.699 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-logutils (0.3.3-5) ... 2021-04-09T18:23:46.805 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-simplejson. 2021-04-09T18:23:46.820 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../031-python-simplejson_3.13.2-1_amd64.deb ... 2021-04-09T18:23:46.863 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-simplejson (3.13.2-1) ... 2021-04-09T18:23:46.874 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-simplejson. 2021-04-09T18:23:46.889 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../031-python-simplejson_3.13.2-1_amd64.deb ... 2021-04-09T18:23:46.904 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-paste. 2021-04-09T18:23:46.919 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../039-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-04-09T18:23:46.924 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-simplejson (3.13.2-1) ... 2021-04-09T18:23:46.963 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2021-04-09T18:23:46.975 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-mako. 2021-04-09T18:23:46.988 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../028-python-mako_1.0.7+ds1-1_all.deb ... 2021-04-09T18:23:47.001 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-markupsafe. 2021-04-09T18:23:47.015 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../027-python-markupsafe_1.0-1build1_amd64.deb ... 2021-04-09T18:23:47.050 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2021-04-09T18:23:47.059 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2021-04-09T18:23:47.210 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-webob. 2021-04-09T18:23:47.224 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../032-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-04-09T18:23:47.225 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-webob. 2021-04-09T18:23:47.240 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../032-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-04-09T18:23:47.268 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2021-04-09T18:23:47.292 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2021-04-09T18:23:47.299 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-04-09T18:23:47.316 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../040-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-04-09T18:23:47.366 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-04-09T18:23:47.378 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-simplegeneric. 2021-04-09T18:23:47.392 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../029-python-simplegeneric_0.8.1-1_all.deb ... 2021-04-09T18:23:47.404 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-mako. 2021-04-09T18:23:47.419 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../028-python-mako_1.0.7+ds1-1_all.deb ... 2021-04-09T18:23:47.436 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2021-04-09T18:23:47.470 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2021-04-09T18:23:47.553 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-bs4. 2021-04-09T18:23:47.569 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../033-python-bs4_4.6.0-1_all.deb ... 2021-04-09T18:23:47.611 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-bs4. 2021-04-09T18:23:47.611 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-bs4 (4.6.0-1) ... 2021-04-09T18:23:47.625 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../033-python-bs4_4.6.0-1_all.deb ... 2021-04-09T18:23:47.669 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-pastedeploy. 2021-04-09T18:23:47.670 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-bs4 (4.6.0-1) ... 2021-04-09T18:23:47.683 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../041-python-pastedeploy_1.5.2-4_all.deb ... 2021-04-09T18:23:47.731 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-singledispatch. 2021-04-09T18:23:47.735 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2021-04-09T18:23:47.746 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../030-python-singledispatch_3.4.0.3-2_all.deb ... 2021-04-09T18:23:47.789 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2021-04-09T18:23:47.824 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-simplegeneric. 2021-04-09T18:23:47.838 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../029-python-simplegeneric_0.8.1-1_all.deb ... 2021-04-09T18:23:47.882 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2021-04-09T18:23:47.922 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-waitress. 2021-04-09T18:23:47.937 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../034-python-waitress_1.0.1-1_all.deb ... 2021-04-09T18:23:47.980 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-waitress (1.0.1-1) ... 2021-04-09T18:23:48.014 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-waitress. 2021-04-09T18:23:48.027 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../034-python-waitress_1.0.1-1_all.deb ... 2021-04-09T18:23:48.064 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-waitress (1.0.1-1) ... 2021-04-09T18:23:48.088 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-webtest. 2021-04-09T18:23:48.103 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../042-python-webtest_2.0.28-1ubuntu1_all.deb ... 2021-04-09T18:23:48.116 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-simplejson. 2021-04-09T18:23:48.131 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../031-python-simplejson_3.13.2-1_amd64.deb ... 2021-04-09T18:23:48.147 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2021-04-09T18:23:48.175 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-simplejson (3.13.2-1) ... 2021-04-09T18:23:48.218 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-singledispatch. 2021-04-09T18:23:48.231 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../030-python-singledispatch_3.4.0.3-2_all.deb ... 2021-04-09T18:23:48.276 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2021-04-09T18:23:48.333 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-dnspython. 2021-04-09T18:23:48.348 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../035-python-dnspython_1.15.0-1_all.deb ... 2021-04-09T18:23:48.377 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-dnspython. 2021-04-09T18:23:48.392 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-dnspython (1.15.0-1) ... 2021-04-09T18:23:48.392 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../035-python-dnspython_1.15.0-1_all.deb ... 2021-04-09T18:23:48.436 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-dnspython (1.15.0-1) ... 2021-04-09T18:23:48.491 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-pecan. 2021-04-09T18:23:48.508 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../043-python-pecan_1.2.1-2_all.deb ... 2021-04-09T18:23:48.511 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-webob. 2021-04-09T18:23:48.526 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../032-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-04-09T18:23:48.552 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-pecan (1.2.1-2) ... 2021-04-09T18:23:48.569 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2021-04-09T18:23:48.579 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-simplejson. 2021-04-09T18:23:48.592 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../031-python-simplejson_3.13.2-1_amd64.deb ... 2021-04-09T18:23:48.629 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-simplejson (3.13.2-1) ... 2021-04-09T18:23:48.694 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package formencode-i18n. 2021-04-09T18:23:48.708 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../036-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2021-04-09T18:23:48.731 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package formencode-i18n. 2021-04-09T18:23:48.744 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../036-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2021-04-09T18:23:48.753 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2021-04-09T18:23:48.781 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2021-04-09T18:23:48.892 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-bs4. 2021-04-09T18:23:48.893 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-certifi. 2021-04-09T18:23:48.907 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../033-python-bs4_4.6.0-1_all.deb ... 2021-04-09T18:23:48.908 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../044-python-certifi_2018.1.18-2_all.deb ... 2021-04-09T18:23:48.950 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-bs4 (4.6.0-1) ... 2021-04-09T18:23:48.951 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-certifi (2018.1.18-2) ... 2021-04-09T18:23:48.958 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-webob. 2021-04-09T18:23:48.973 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../032-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-04-09T18:23:49.016 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2021-04-09T18:23:49.047 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-formencode. 2021-04-09T18:23:49.063 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../037-python-formencode_1.3.0-0ubuntu5_all.deb ... 2021-04-09T18:23:49.076 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-formencode. 2021-04-09T18:23:49.092 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../037-python-formencode_1.3.0-0ubuntu5_all.deb ... 2021-04-09T18:23:49.105 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2021-04-09T18:23:49.135 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2021-04-09T18:23:49.287 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-waitress. 2021-04-09T18:23:49.300 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../034-python-waitress_1.0.1-1_all.deb ... 2021-04-09T18:23:49.335 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-bs4. 2021-04-09T18:23:49.337 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-chardet. 2021-04-09T18:23:49.345 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-waitress (1.0.1-1) ... 2021-04-09T18:23:49.350 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../033-python-bs4_4.6.0-1_all.deb ... 2021-04-09T18:23:49.353 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../045-python-chardet_3.0.4-1_all.deb ... 2021-04-09T18:23:49.394 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-bs4 (4.6.0-1) ... 2021-04-09T18:23:49.395 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-chardet (3.0.4-1) ... 2021-04-09T18:23:49.449 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-tempita. 2021-04-09T18:23:49.464 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../038-python-tempita_0.5.2-2_all.deb ... 2021-04-09T18:23:49.488 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-tempita. 2021-04-09T18:23:49.502 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../038-python-tempita_0.5.2-2_all.deb ... 2021-04-09T18:23:49.510 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-tempita (0.5.2-2) ... 2021-04-09T18:23:49.547 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-tempita (0.5.2-2) ... 2021-04-09T18:23:49.714 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-dnspython. 2021-04-09T18:23:49.729 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../035-python-dnspython_1.15.0-1_all.deb ... 2021-04-09T18:23:49.763 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-waitress. 2021-04-09T18:23:49.765 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-urllib3. 2021-04-09T18:23:49.778 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../034-python-waitress_1.0.1-1_all.deb ... 2021-04-09T18:23:49.779 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../046-python-urllib3_1.22-1ubuntu0.18.04.2_all.deb ... 2021-04-09T18:23:49.781 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-dnspython (1.15.0-1) ... 2021-04-09T18:23:49.822 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-waitress (1.0.1-1) ... 2021-04-09T18:23:49.823 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2021-04-09T18:23:49.833 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-paste. 2021-04-09T18:23:49.848 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../039-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-04-09T18:23:49.858 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-paste. 2021-04-09T18:23:49.873 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../039-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-04-09T18:23:49.891 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2021-04-09T18:23:49.926 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2021-04-09T18:23:50.059 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package formencode-i18n. 2021-04-09T18:23:50.076 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../036-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2021-04-09T18:23:50.117 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2021-04-09T18:23:50.125 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-dnspython. 2021-04-09T18:23:50.140 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../035-python-dnspython_1.15.0-1_all.deb ... 2021-04-09T18:23:50.160 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-requests. 2021-04-09T18:23:50.175 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../047-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2021-04-09T18:23:50.183 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-dnspython (1.15.0-1) ... 2021-04-09T18:23:50.218 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2021-04-09T18:23:50.220 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-04-09T18:23:50.234 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../040-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-04-09T18:23:50.237 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-04-09T18:23:50.253 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../040-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-04-09T18:23:50.278 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-04-09T18:23:50.296 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-04-09T18:23:50.437 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-formencode. 2021-04-09T18:23:50.452 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../037-python-formencode_1.3.0-0ubuntu5_all.deb ... 2021-04-09T18:23:50.463 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package formencode-i18n. 2021-04-09T18:23:50.477 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../036-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2021-04-09T18:23:50.495 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2021-04-09T18:23:50.519 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2021-04-09T18:23:50.530 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-werkzeug. 2021-04-09T18:23:50.543 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../048-python-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-04-09T18:23:50.588 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-04-09T18:23:50.599 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-pastedeploy. 2021-04-09T18:23:50.606 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-pastedeploy. 2021-04-09T18:23:50.612 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../041-python-pastedeploy_1.5.2-4_all.deb ... 2021-04-09T18:23:50.621 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../041-python-pastedeploy_1.5.2-4_all.deb ... 2021-04-09T18:23:50.657 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2021-04-09T18:23:50.664 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2021-04-09T18:23:50.822 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-formencode. 2021-04-09T18:23:50.831 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-tempita. 2021-04-09T18:23:50.835 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../037-python-formencode_1.3.0-0ubuntu5_all.deb ... 2021-04-09T18:23:50.845 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../038-python-tempita_0.5.2-2_all.deb ... 2021-04-09T18:23:50.880 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2021-04-09T18:23:50.889 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-tempita (0.5.2-2) ... 2021-04-09T18:23:50.958 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr. 2021-04-09T18:23:50.962 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-webtest. 2021-04-09T18:23:50.972 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../049-ceph-mgr_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:50.976 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../042-python-webtest_2.0.28-1ubuntu1_all.deb ... 2021-04-09T18:23:51.009 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-webtest. 2021-04-09T18:23:51.016 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:51.020 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2021-04-09T18:23:51.022 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../042-python-webtest_2.0.28-1ubuntu1_all.deb ... 2021-04-09T18:23:51.059 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2021-04-09T18:23:51.192 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-paste. 2021-04-09T18:23:51.203 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-tempita. 2021-04-09T18:23:51.209 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../039-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-04-09T18:23:51.216 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../038-python-tempita_0.5.2-2_all.deb ... 2021-04-09T18:23:51.251 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2021-04-09T18:23:51.253 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-tempita (0.5.2-2) ... 2021-04-09T18:23:51.373 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-pecan. 2021-04-09T18:23:51.388 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../043-python-pecan_1.2.1-2_all.deb ... 2021-04-09T18:23:51.454 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-pecan. 2021-04-09T18:23:51.470 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../043-python-pecan_1.2.1-2_all.deb ... 2021-04-09T18:23:51.485 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-pecan (1.2.1-2) ... 2021-04-09T18:23:51.515 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-pecan (1.2.1-2) ... 2021-04-09T18:23:51.550 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mon. 2021-04-09T18:23:51.563 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-04-09T18:23:51.564 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../050-ceph-mon_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:51.577 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../040-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-04-09T18:23:51.598 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-paste. 2021-04-09T18:23:51.608 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mon (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:51.612 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../039-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-04-09T18:23:51.621 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-04-09T18:23:51.664 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2021-04-09T18:23:51.838 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-certifi. 2021-04-09T18:23:51.852 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../044-python-certifi_2018.1.18-2_all.deb ... 2021-04-09T18:23:51.866 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-certifi. 2021-04-09T18:23:51.882 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../044-python-certifi_2018.1.18-2_all.deb ... 2021-04-09T18:23:51.896 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-certifi (2018.1.18-2) ... 2021-04-09T18:23:51.924 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-pastedeploy. 2021-04-09T18:23:51.925 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-certifi (2018.1.18-2) ... 2021-04-09T18:23:51.939 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../041-python-pastedeploy_1.5.2-4_all.deb ... 2021-04-09T18:23:51.982 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2021-04-09T18:23:52.026 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-04-09T18:23:52.039 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../040-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-04-09T18:23:52.084 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-04-09T18:23:52.266 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-chardet. 2021-04-09T18:23:52.281 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../045-python-chardet_3.0.4-1_all.deb ... 2021-04-09T18:23:52.283 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-chardet. 2021-04-09T18:23:52.296 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-osd. 2021-04-09T18:23:52.297 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../045-python-chardet_3.0.4-1_all.deb ... 2021-04-09T18:23:52.302 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-webtest. 2021-04-09T18:23:52.310 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../051-ceph-osd_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:52.316 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../042-python-webtest_2.0.28-1ubuntu1_all.deb ... 2021-04-09T18:23:52.316 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-chardet (3.0.4-1) ... 2021-04-09T18:23:52.341 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-chardet (3.0.4-1) ... 2021-04-09T18:23:52.354 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-osd (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:52.370 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-pastedeploy. 2021-04-09T18:23:52.381 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2021-04-09T18:23:52.385 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../041-python-pastedeploy_1.5.2-4_all.deb ... 2021-04-09T18:23:52.428 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2021-04-09T18:23:52.687 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-urllib3. 2021-04-09T18:23:52.701 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../046-python-urllib3_1.22-1ubuntu0.18.04.2_all.deb ... 2021-04-09T18:23:52.745 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2021-04-09T18:23:52.755 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-pecan. 2021-04-09T18:23:52.761 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-urllib3. 2021-04-09T18:23:52.769 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../043-python-pecan_1.2.1-2_all.deb ... 2021-04-09T18:23:52.773 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-webtest. 2021-04-09T18:23:52.777 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../046-python-urllib3_1.22-1ubuntu0.18.04.2_all.deb ... 2021-04-09T18:23:52.787 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../042-python-webtest_2.0.28-1ubuntu1_all.deb ... 2021-04-09T18:23:52.808 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-pecan (1.2.1-2) ... 2021-04-09T18:23:52.819 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2021-04-09T18:23:52.831 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2021-04-09T18:23:53.107 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-requests. 2021-04-09T18:23:53.123 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../047-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2021-04-09T18:23:53.143 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-certifi. 2021-04-09T18:23:53.158 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../044-python-certifi_2018.1.18-2_all.deb ... 2021-04-09T18:23:53.173 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2021-04-09T18:23:53.176 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-pecan. 2021-04-09T18:23:53.181 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-requests. 2021-04-09T18:23:53.192 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../043-python-pecan_1.2.1-2_all.deb ... 2021-04-09T18:23:53.197 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../047-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2021-04-09T18:23:53.201 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-certifi (2018.1.18-2) ... 2021-04-09T18:23:53.237 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-pecan (1.2.1-2) ... 2021-04-09T18:23:53.239 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2021-04-09T18:23:53.486 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-werkzeug. 2021-04-09T18:23:53.501 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../048-python-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-04-09T18:23:53.538 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-chardet. 2021-04-09T18:23:53.544 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-04-09T18:23:53.550 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-werkzeug. 2021-04-09T18:23:53.552 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../045-python-chardet_3.0.4-1_all.deb ... 2021-04-09T18:23:53.565 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../048-python-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-04-09T18:23:53.580 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-certifi. 2021-04-09T18:23:53.595 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../044-python-certifi_2018.1.18-2_all.deb ... 2021-04-09T18:23:53.596 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-chardet (3.0.4-1) ... 2021-04-09T18:23:53.609 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-04-09T18:23:53.647 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-certifi (2018.1.18-2) ... 2021-04-09T18:23:53.948 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-urllib3. 2021-04-09T18:23:53.956 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr. 2021-04-09T18:23:53.961 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../046-python-urllib3_1.22-1ubuntu0.18.04.2_all.deb ... 2021-04-09T18:23:53.966 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph. 2021-04-09T18:23:53.971 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../049-ceph-mgr_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:53.979 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../052-ceph_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:53.983 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-chardet. 2021-04-09T18:23:53.995 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr. 2021-04-09T18:23:53.997 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2021-04-09T18:23:53.998 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../045-python-chardet_3.0.4-1_all.deb ... 2021-04-09T18:23:54.010 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../049-ceph-mgr_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:54.015 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:54.016 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:54.042 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-chardet (3.0.4-1) ... 2021-04-09T18:23:54.062 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:54.334 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-requests. 2021-04-09T18:23:54.348 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../047-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2021-04-09T18:23:54.378 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-fuse. 2021-04-09T18:23:54.387 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-urllib3. 2021-04-09T18:23:54.391 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../053-ceph-fuse_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:54.392 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2021-04-09T18:23:54.402 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../046-python-urllib3_1.22-1ubuntu0.18.04.2_all.deb ... 2021-04-09T18:23:54.436 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-fuse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:54.445 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2021-04-09T18:23:54.546 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mon. 2021-04-09T18:23:54.560 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../050-ceph-mon_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:54.605 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mon (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:54.634 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mon. 2021-04-09T18:23:54.649 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../050-ceph-mon_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:54.692 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mon (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:54.703 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-werkzeug. 2021-04-09T18:23:54.717 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../048-python-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-04-09T18:23:54.756 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-requests. 2021-04-09T18:23:54.761 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-04-09T18:23:54.772 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../047-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2021-04-09T18:23:54.814 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2021-04-09T18:23:54.873 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mds. 2021-04-09T18:23:54.887 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../054-ceph-mds_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:54.931 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mds (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:55.126 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-werkzeug. 2021-04-09T18:23:55.142 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../048-python-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-04-09T18:23:55.173 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr. 2021-04-09T18:23:55.184 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-04-09T18:23:55.188 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../049-ceph-mgr_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:55.232 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:55.354 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-osd. 2021-04-09T18:23:55.368 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../051-ceph-osd_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:55.404 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-osd. 2021-04-09T18:23:55.412 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-osd (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:55.420 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../051-ceph-osd_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:55.434 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-repoze.lru. 2021-04-09T18:23:55.448 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../055-python-repoze.lru_0.7-1_all.deb ... 2021-04-09T18:23:55.462 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-osd (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:55.492 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-repoze.lru (0.7-1) ... 2021-04-09T18:23:55.546 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr. 2021-04-09T18:23:55.560 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../049-ceph-mgr_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:55.604 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:55.745 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libjs-underscore. 2021-04-09T18:23:55.758 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../056-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2021-04-09T18:23:55.762 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mon. 2021-04-09T18:23:55.778 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../050-ceph-mon_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:55.795 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2021-04-09T18:23:55.820 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mon (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:56.073 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-04-09T18:23:56.087 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../057-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2021-04-09T18:23:56.139 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2021-04-09T18:23:56.143 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mon. 2021-04-09T18:23:56.158 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../050-ceph-mon_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:56.210 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mon (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:56.492 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-routes. 2021-04-09T18:23:56.507 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../058-python-routes_2.4.1-1_all.deb ... 2021-04-09T18:23:56.550 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-routes (2.4.1-1) ... 2021-04-09T18:23:56.557 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-osd. 2021-04-09T18:23:56.571 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../051-ceph-osd_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:56.619 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-osd (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:56.887 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-04-09T18:23:56.900 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../059-ceph-mgr-dashboard_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:23:56.914 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-osd. 2021-04-09T18:23:56.928 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-dashboard (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:56.929 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../051-ceph-osd_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:56.972 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-osd (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:57.018 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph. 2021-04-09T18:23:57.032 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../052-ceph_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:57.076 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:57.083 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph. 2021-04-09T18:23:57.097 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../052-ceph_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:57.133 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:57.406 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-fuse. 2021-04-09T18:23:57.418 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../053-ceph-fuse_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:57.464 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-fuse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:57.469 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-fuse. 2021-04-09T18:23:57.484 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../053-ceph-fuse_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:57.527 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-fuse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:57.784 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-04-09T18:23:57.799 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../060-ceph-mgr-diskprediction-cloud_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:23:57.842 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-diskprediction-cloud (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:57.851 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mds. 2021-04-09T18:23:57.867 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../054-ceph-mds_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:57.909 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mds (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:57.923 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mds. 2021-04-09T18:23:57.937 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../054-ceph-mds_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:57.998 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mds (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:58.154 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-decorator. 2021-04-09T18:23:58.168 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../061-python-decorator_4.1.2-1_all.deb ... 2021-04-09T18:23:58.212 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-decorator (4.1.2-1) ... 2021-04-09T18:23:58.232 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph. 2021-04-09T18:23:58.247 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../052-ceph_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:58.290 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:58.406 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-repoze.lru. 2021-04-09T18:23:58.420 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../055-python-repoze.lru_0.7-1_all.deb ... 2021-04-09T18:23:58.464 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-repoze.lru (0.7-1) ... 2021-04-09T18:23:58.523 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-scipy. 2021-04-09T18:23:58.525 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-repoze.lru. 2021-04-09T18:23:58.538 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../062-python-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-04-09T18:23:58.541 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../055-python-repoze.lru_0.7-1_all.deb ... 2021-04-09T18:23:58.581 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-scipy (0.19.1-2ubuntu1) ... 2021-04-09T18:23:58.584 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-repoze.lru (0.7-1) ... 2021-04-09T18:23:58.584 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph. 2021-04-09T18:23:58.599 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../052-ceph_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:58.635 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-fuse. 2021-04-09T18:23:58.643 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:58.648 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../053-ceph-fuse_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:58.684 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-fuse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:58.743 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libjs-underscore. 2021-04-09T18:23:58.756 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../056-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2021-04-09T18:23:58.801 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2021-04-09T18:23:58.837 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libjs-underscore. 2021-04-09T18:23:58.852 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../056-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2021-04-09T18:23:58.928 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2021-04-09T18:23:58.962 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-fuse. 2021-04-09T18:23:58.977 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../053-ceph-fuse_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:59.020 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-fuse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:59.104 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-04-09T18:23:59.121 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../057-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2021-04-09T18:23:59.135 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mds. 2021-04-09T18:23:59.152 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../054-ceph-mds_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:59.171 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2021-04-09T18:23:59.196 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mds (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:59.206 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-04-09T18:23:59.219 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../057-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2021-04-09T18:23:59.256 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2021-04-09T18:23:59.415 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mds. 2021-04-09T18:23:59.430 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../054-ceph-mds_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:23:59.474 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mds (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:59.491 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-routes. 2021-04-09T18:23:59.505 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../058-python-routes_2.4.1-1_all.deb ... 2021-04-09T18:23:59.550 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-routes (2.4.1-1) ... 2021-04-09T18:23:59.575 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-routes. 2021-04-09T18:23:59.589 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../058-python-routes_2.4.1-1_all.deb ... 2021-04-09T18:23:59.633 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-routes (2.4.1-1) ... 2021-04-09T18:23:59.674 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-repoze.lru. 2021-04-09T18:23:59.688 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../055-python-repoze.lru_0.7-1_all.deb ... 2021-04-09T18:23:59.733 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-repoze.lru (0.7-1) ... 2021-04-09T18:23:59.890 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-sklearn-lib. 2021-04-09T18:23:59.895 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-04-09T18:23:59.906 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../063-python-sklearn-lib_0.19.1-3_amd64.deb ... 2021-04-09T18:23:59.909 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../059-ceph-mgr-dashboard_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:23:59.945 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-dashboard (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:23:59.949 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-sklearn-lib (0.19.1-3) ... 2021-04-09T18:23:59.951 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-repoze.lru. 2021-04-09T18:23:59.965 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../055-python-repoze.lru_0.7-1_all.deb ... 2021-04-09T18:23:59.994 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libjs-underscore. 2021-04-09T18:24:00.001 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-repoze.lru (0.7-1) ... 2021-04-09T18:24:00.004 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-04-09T18:24:00.009 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../056-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2021-04-09T18:24:00.018 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../059-ceph-mgr-dashboard_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:00.052 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2021-04-09T18:24:00.062 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-dashboard (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:00.254 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libjs-underscore. 2021-04-09T18:24:00.268 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../056-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2021-04-09T18:24:00.312 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2021-04-09T18:24:00.541 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-joblib. 2021-04-09T18:24:00.541 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../064-python-joblib_0.11-1_all.deb ... 2021-04-09T18:24:00.542 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-joblib (0.11-1) ... 2021-04-09T18:24:00.542 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-04-09T18:24:00.542 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../057-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2021-04-09T18:24:00.542 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2021-04-09T18:24:00.598 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-04-09T18:24:00.615 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../057-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2021-04-09T18:24:00.665 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2021-04-09T18:24:00.697 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-04-09T18:24:00.713 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../060-ceph-mgr-diskprediction-cloud_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:00.741 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-routes. 2021-04-09T18:24:00.755 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-diskprediction-cloud (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:00.756 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../058-python-routes_2.4.1-1_all.deb ... 2021-04-09T18:24:00.799 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-routes (2.4.1-1) ... 2021-04-09T18:24:00.839 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-sklearn. 2021-04-09T18:24:00.856 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../065-python-sklearn_0.19.1-3_all.deb ... 2021-04-09T18:24:00.867 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-04-09T18:24:00.882 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../060-ceph-mgr-diskprediction-cloud_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:00.897 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-sklearn (0.19.1-3) ... 2021-04-09T18:24:00.926 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-diskprediction-cloud (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:00.951 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-routes. 2021-04-09T18:24:00.965 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../058-python-routes_2.4.1-1_all.deb ... 2021-04-09T18:24:01.077 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-routes (2.4.1-1) ... 2021-04-09T18:24:01.093 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-decorator. 2021-04-09T18:24:01.109 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../061-python-decorator_4.1.2-1_all.deb ... 2021-04-09T18:24:01.127 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-04-09T18:24:01.143 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../059-ceph-mgr-dashboard_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:01.152 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-decorator (4.1.2-1) ... 2021-04-09T18:24:01.186 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-dashboard (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:01.245 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-decorator. 2021-04-09T18:24:01.261 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../061-python-decorator_4.1.2-1_all.deb ... 2021-04-09T18:24:01.304 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-decorator (4.1.2-1) ... 2021-04-09T18:24:01.362 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-04-09T18:24:01.378 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../059-ceph-mgr-dashboard_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:01.412 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-dashboard (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:01.454 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-04-09T18:24:01.455 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-scipy. 2021-04-09T18:24:01.468 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../066-ceph-mgr-diskprediction-local_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:01.469 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../062-python-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-04-09T18:24:01.512 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-diskprediction-local (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:01.513 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-scipy (0.19.1-2ubuntu1) ... 2021-04-09T18:24:01.640 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-scipy. 2021-04-09T18:24:01.654 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../062-python-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-04-09T18:24:01.698 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-scipy (0.19.1-2ubuntu1) ... 2021-04-09T18:24:02.008 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-04-09T18:24:02.025 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../060-ceph-mgr-diskprediction-cloud_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:02.066 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-diskprediction-cloud (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:02.192 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-04-09T18:24:02.207 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-monotonic. 2021-04-09T18:24:02.208 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../060-ceph-mgr-diskprediction-cloud_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:02.220 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../067-python-monotonic_1.1-2_all.deb ... 2021-04-09T18:24:02.251 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-diskprediction-cloud (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:02.256 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-monotonic (1.1-2) ... 2021-04-09T18:24:02.377 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-decorator. 2021-04-09T18:24:02.393 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../061-python-decorator_4.1.2-1_all.deb ... 2021-04-09T18:24:02.436 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-decorator (4.1.2-1) ... 2021-04-09T18:24:02.559 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-fasteners. 2021-04-09T18:24:02.562 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-decorator. 2021-04-09T18:24:02.575 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../068-python-fasteners_0.12.0-3_all.deb ... 2021-04-09T18:24:02.576 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../061-python-decorator_4.1.2-1_all.deb ... 2021-04-09T18:24:02.618 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-fasteners (0.12.0-3) ... 2021-04-09T18:24:02.620 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-decorator (4.1.2-1) ... 2021-04-09T18:24:02.747 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-scipy. 2021-04-09T18:24:02.763 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../062-python-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-04-09T18:24:02.814 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-scipy (0.19.1-2ubuntu1) ... 2021-04-09T18:24:02.904 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-httplib2. 2021-04-09T18:24:02.915 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-scipy. 2021-04-09T18:24:02.920 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../069-python-httplib2_0.9.2+dfsg-1ubuntu0.3_all.deb ... 2021-04-09T18:24:02.932 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../062-python-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-04-09T18:24:02.962 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-httplib2 (0.9.2+dfsg-1ubuntu0.3) ... 2021-04-09T18:24:02.973 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-scipy (0.19.1-2ubuntu1) ... 2021-04-09T18:24:02.992 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-sklearn-lib. 2021-04-09T18:24:03.010 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../063-python-sklearn-lib_0.19.1-3_amd64.deb ... 2021-04-09T18:24:03.016 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-sklearn-lib. 2021-04-09T18:24:03.030 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../063-python-sklearn-lib_0.19.1-3_amd64.deb ... 2021-04-09T18:24:03.050 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-sklearn-lib (0.19.1-3) ... 2021-04-09T18:24:03.099 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-sklearn-lib (0.19.1-3) ... 2021-04-09T18:24:03.282 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-pyasn1. 2021-04-09T18:24:03.296 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../070-python-pyasn1_0.4.2-3_all.deb ... 2021-04-09T18:24:03.364 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-pyasn1 (0.4.2-3) ... 2021-04-09T18:24:03.539 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-joblib. 2021-04-09T18:24:03.555 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../064-python-joblib_0.11-1_all.deb ... 2021-04-09T18:24:03.569 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-joblib. 2021-04-09T18:24:03.583 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../064-python-joblib_0.11-1_all.deb ... 2021-04-09T18:24:03.597 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-joblib (0.11-1) ... 2021-04-09T18:24:03.627 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-joblib (0.11-1) ... 2021-04-09T18:24:03.693 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-pyasn1-modules. 2021-04-09T18:24:03.707 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../071-python-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-04-09T18:24:03.751 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-pyasn1-modules (0.2.1-0.2) ... 2021-04-09T18:24:03.934 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-sklearn. 2021-04-09T18:24:03.949 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../065-python-sklearn_0.19.1-3_all.deb ... 2021-04-09T18:24:03.989 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-sklearn. 2021-04-09T18:24:03.993 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-sklearn (0.19.1-3) ... 2021-04-09T18:24:04.005 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../065-python-sklearn_0.19.1-3_all.deb ... 2021-04-09T18:24:04.047 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-sklearn (0.19.1-3) ... 2021-04-09T18:24:04.080 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-rsa. 2021-04-09T18:24:04.093 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../072-python-rsa_3.4.2-1_all.deb ... 2021-04-09T18:24:04.138 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-rsa (3.4.2-1) ... 2021-04-09T18:24:04.164 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-sklearn-lib. 2021-04-09T18:24:04.181 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../063-python-sklearn-lib_0.19.1-3_amd64.deb ... 2021-04-09T18:24:04.223 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-sklearn-lib (0.19.1-3) ... 2021-04-09T18:24:04.502 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-04-09T18:24:04.518 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../066-ceph-mgr-diskprediction-local_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:04.560 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-diskprediction-local (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:04.613 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-04-09T18:24:04.624 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-sklearn-lib. 2021-04-09T18:24:04.626 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../066-ceph-mgr-diskprediction-local_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:04.639 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../063-python-sklearn-lib_0.19.1-3_amd64.deb ... 2021-04-09T18:24:04.671 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-diskprediction-local (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:04.676 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-joblib. 2021-04-09T18:24:04.682 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-sklearn-lib (0.19.1-3) ... 2021-04-09T18:24:04.693 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../064-python-joblib_0.11-1_all.deb ... 2021-04-09T18:24:04.734 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-joblib (0.11-1) ... 2021-04-09T18:24:04.799 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-sqlalchemy. 2021-04-09T18:24:04.814 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../073-python-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-04-09T18:24:04.858 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-04-09T18:24:05.161 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-joblib. 2021-04-09T18:24:05.175 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../064-python-joblib_0.11-1_all.deb ... 2021-04-09T18:24:05.219 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-joblib (0.11-1) ... 2021-04-09T18:24:05.248 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-monotonic. 2021-04-09T18:24:05.264 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../067-python-monotonic_1.1-2_all.deb ... 2021-04-09T18:24:05.306 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-monotonic (1.1-2) ... 2021-04-09T18:24:05.312 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-oauth2client. 2021-04-09T18:24:05.327 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../074-python-oauth2client_4.1.2-3_all.deb ... 2021-04-09T18:24:05.370 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-oauth2client (4.1.2-3) ... 2021-04-09T18:24:05.407 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-monotonic. 2021-04-09T18:24:05.423 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../067-python-monotonic_1.1-2_all.deb ... 2021-04-09T18:24:05.465 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-monotonic (1.1-2) ... 2021-04-09T18:24:05.488 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-sklearn. 2021-04-09T18:24:05.506 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../065-python-sklearn_0.19.1-3_all.deb ... 2021-04-09T18:24:05.555 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-sklearn (0.19.1-3) ... 2021-04-09T18:24:05.586 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-sklearn. 2021-04-09T18:24:05.602 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../065-python-sklearn_0.19.1-3_all.deb ... 2021-04-09T18:24:05.610 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-fasteners. 2021-04-09T18:24:05.624 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../068-python-fasteners_0.12.0-3_all.deb ... 2021-04-09T18:24:05.647 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-sklearn (0.19.1-3) ... 2021-04-09T18:24:05.668 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-fasteners (0.12.0-3) ... 2021-04-09T18:24:05.732 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-websocket. 2021-04-09T18:24:05.747 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../075-python-websocket_0.44.0-0ubuntu2_all.deb ... 2021-04-09T18:24:05.790 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-websocket (0.44.0-0ubuntu2) ... 2021-04-09T18:24:05.802 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-fasteners. 2021-04-09T18:24:05.818 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../068-python-fasteners_0.12.0-3_all.deb ... 2021-04-09T18:24:05.860 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-fasteners (0.12.0-3) ... 2021-04-09T18:24:05.980 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-httplib2. 2021-04-09T18:24:05.994 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../069-python-httplib2_0.9.2+dfsg-1ubuntu0.3_all.deb ... 2021-04-09T18:24:06.039 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-httplib2 (0.9.2+dfsg-1ubuntu0.3) ... 2021-04-09T18:24:06.110 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-yaml. 2021-04-09T18:24:06.120 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-04-09T18:24:06.126 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../076-python-yaml_3.12-1build2_amd64.deb ... 2021-04-09T18:24:06.136 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../066-ceph-mgr-diskprediction-local_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:06.145 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-04-09T18:24:06.155 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-httplib2. 2021-04-09T18:24:06.162 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../066-ceph-mgr-diskprediction-local_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:06.168 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-yaml (3.12-1build2) ... 2021-04-09T18:24:06.171 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../069-python-httplib2_0.9.2+dfsg-1ubuntu0.3_all.deb ... 2021-04-09T18:24:06.178 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-diskprediction-local (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:06.203 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-diskprediction-local (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:06.213 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-httplib2 (0.9.2+dfsg-1ubuntu0.3) ... 2021-04-09T18:24:06.368 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-pyasn1. 2021-04-09T18:24:06.382 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../070-python-pyasn1_0.4.2-3_all.deb ... 2021-04-09T18:24:06.418 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-pyasn1 (0.4.2-3) ... 2021-04-09T18:24:06.538 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-kubernetes. 2021-04-09T18:24:06.552 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../077-python-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-04-09T18:24:06.582 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-pyasn1. 2021-04-09T18:24:06.596 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-kubernetes (2.0.0-2ubuntu1) ... 2021-04-09T18:24:06.597 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../070-python-pyasn1_0.4.2-3_all.deb ... 2021-04-09T18:24:06.649 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-pyasn1 (0.4.2-3) ... 2021-04-09T18:24:06.763 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-pyasn1-modules. 2021-04-09T18:24:06.777 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../071-python-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-04-09T18:24:06.821 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-pyasn1-modules (0.2.1-0.2) ... 2021-04-09T18:24:06.873 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-monotonic. 2021-04-09T18:24:06.886 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../067-python-monotonic_1.1-2_all.deb ... 2021-04-09T18:24:06.898 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-monotonic. 2021-04-09T18:24:06.912 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../067-python-monotonic_1.1-2_all.deb ... 2021-04-09T18:24:06.923 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-monotonic (1.1-2) ... 2021-04-09T18:24:06.956 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-monotonic (1.1-2) ... 2021-04-09T18:24:06.994 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-pyasn1-modules. 2021-04-09T18:24:07.009 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-04-09T18:24:07.010 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../071-python-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-04-09T18:24:07.025 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../078-ceph-mgr-k8sevents_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:07.067 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-k8sevents (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:07.068 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-pyasn1-modules (0.2.1-0.2) ... 2021-04-09T18:24:07.151 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-rsa. 2021-04-09T18:24:07.167 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../072-python-rsa_3.4.2-1_all.deb ... 2021-04-09T18:24:07.209 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-fasteners. 2021-04-09T18:24:07.210 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-rsa (3.4.2-1) ... 2021-04-09T18:24:07.223 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../068-python-fasteners_0.12.0-3_all.deb ... 2021-04-09T18:24:07.250 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-fasteners. 2021-04-09T18:24:07.259 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-fasteners (0.12.0-3) ... 2021-04-09T18:24:07.264 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../068-python-fasteners_0.12.0-3_all.deb ... 2021-04-09T18:24:07.309 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-fasteners (0.12.0-3) ... 2021-04-09T18:24:07.361 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-04-09T18:24:07.375 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../079-ceph-mgr-rook_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:07.405 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-rsa. 2021-04-09T18:24:07.421 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../072-python-rsa_3.4.2-1_all.deb ... 2021-04-09T18:24:07.428 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-rook (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:07.463 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-rsa (3.4.2-1) ... 2021-04-09T18:24:07.529 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-sqlalchemy. 2021-04-09T18:24:07.545 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../073-python-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-04-09T18:24:07.562 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-httplib2. 2021-04-09T18:24:07.576 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../069-python-httplib2_0.9.2+dfsg-1ubuntu0.3_all.deb ... 2021-04-09T18:24:07.588 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-04-09T18:24:07.620 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-httplib2 (0.9.2+dfsg-1ubuntu0.3) ... 2021-04-09T18:24:07.628 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-httplib2. 2021-04-09T18:24:07.643 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../069-python-httplib2_0.9.2+dfsg-1ubuntu0.3_all.deb ... 2021-04-09T18:24:07.686 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-httplib2 (0.9.2+dfsg-1ubuntu0.3) ... 2021-04-09T18:24:07.730 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-ssh. 2021-04-09T18:24:07.744 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../080-ceph-mgr-ssh_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:07.758 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-sqlalchemy. 2021-04-09T18:24:07.773 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../073-python-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-04-09T18:24:07.816 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-04-09T18:24:07.874 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-ssh (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:07.956 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-pyasn1. 2021-04-09T18:24:07.971 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../070-python-pyasn1_0.4.2-3_all.deb ... 2021-04-09T18:24:07.989 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-pyasn1. 2021-04-09T18:24:08.006 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../070-python-pyasn1_0.4.2-3_all.deb ... 2021-04-09T18:24:08.014 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-pyasn1 (0.4.2-3) ... 2021-04-09T18:24:08.047 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-pyasn1 (0.4.2-3) ... 2021-04-09T18:24:08.136 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-oauth2client. 2021-04-09T18:24:08.152 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../074-python-oauth2client_4.1.2-3_all.deb ... 2021-04-09T18:24:08.185 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libonig4:amd64. 2021-04-09T18:24:08.194 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-oauth2client (4.1.2-3) ... 2021-04-09T18:24:08.200 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../081-libonig4_6.7.0-1_amd64.deb ... 2021-04-09T18:24:08.243 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-04-09T18:24:08.262 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-oauth2client. 2021-04-09T18:24:08.279 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../074-python-oauth2client_4.1.2-3_all.deb ... 2021-04-09T18:24:08.312 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-oauth2client (4.1.2-3) ... 2021-04-09T18:24:08.343 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-pyasn1-modules. 2021-04-09T18:24:08.359 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../071-python-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-04-09T18:24:08.376 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-pyasn1-modules. 2021-04-09T18:24:08.391 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../071-python-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-04-09T18:24:08.392 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-pyasn1-modules (0.2.1-0.2) ... 2021-04-09T18:24:08.434 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-pyasn1-modules (0.2.1-0.2) ... 2021-04-09T18:24:08.573 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-websocket. 2021-04-09T18:24:08.588 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../075-python-websocket_0.44.0-0ubuntu2_all.deb ... 2021-04-09T18:24:08.607 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-websocket. 2021-04-09T18:24:08.613 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libjq1:amd64. 2021-04-09T18:24:08.622 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../075-python-websocket_0.44.0-0ubuntu2_all.deb ... 2021-04-09T18:24:08.629 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../082-libjq1_1.5+dfsg-2_amd64.deb ... 2021-04-09T18:24:08.631 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-websocket (0.44.0-0ubuntu2) ... 2021-04-09T18:24:08.665 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-websocket (0.44.0-0ubuntu2) ... 2021-04-09T18:24:08.670 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-rsa. 2021-04-09T18:24:08.671 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-04-09T18:24:08.686 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../072-python-rsa_3.4.2-1_all.deb ... 2021-04-09T18:24:08.720 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-rsa (3.4.2-1) ... 2021-04-09T18:24:08.779 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-rsa. 2021-04-09T18:24:08.792 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../072-python-rsa_3.4.2-1_all.deb ... 2021-04-09T18:24:08.837 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-rsa (3.4.2-1) ... 2021-04-09T18:24:08.949 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package jq. 2021-04-09T18:24:08.952 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-yaml. 2021-04-09T18:24:08.965 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../083-jq_1.5+dfsg-2_amd64.deb ... 2021-04-09T18:24:08.966 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../076-python-yaml_3.12-1build2_amd64.deb ... 2021-04-09T18:24:08.999 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-sqlalchemy. 2021-04-09T18:24:09.002 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-yaml. 2021-04-09T18:24:09.007 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-04-09T18:24:09.011 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-yaml (3.12-1build2) ... 2021-04-09T18:24:09.014 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../073-python-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-04-09T18:24:09.016 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../076-python-yaml_3.12-1build2_amd64.deb ... 2021-04-09T18:24:09.057 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-04-09T18:24:09.060 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-yaml (3.12-1build2) ... 2021-04-09T18:24:09.132 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-sqlalchemy. 2021-04-09T18:24:09.147 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../073-python-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-04-09T18:24:09.190 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-04-09T18:24:09.260 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package socat. 2021-04-09T18:24:09.274 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../084-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-04-09T18:24:09.318 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-04-09T18:24:09.339 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-kubernetes. 2021-04-09T18:24:09.353 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../077-python-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-04-09T18:24:09.397 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-kubernetes. 2021-04-09T18:24:09.397 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-kubernetes (2.0.0-2ubuntu1) ... 2021-04-09T18:24:09.413 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../077-python-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-04-09T18:24:09.455 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-kubernetes (2.0.0-2ubuntu1) ... 2021-04-09T18:24:09.528 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-oauth2client. 2021-04-09T18:24:09.543 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../074-python-oauth2client_4.1.2-3_all.deb ... 2021-04-09T18:24:09.594 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-oauth2client (4.1.2-3) ... 2021-04-09T18:24:09.669 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-oauth2client. 2021-04-09T18:24:09.684 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../074-python-oauth2client_4.1.2-3_all.deb ... 2021-04-09T18:24:09.728 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-oauth2client (4.1.2-3) ... 2021-04-09T18:24:09.730 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-04-09T18:24:09.747 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../085-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-04-09T18:24:09.796 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-04-09T18:24:09.829 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-04-09T18:24:09.846 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../078-ceph-mgr-k8sevents_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:09.887 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-k8sevents (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:09.901 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-04-09T18:24:09.918 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../078-ceph-mgr-k8sevents_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:09.959 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-k8sevents (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:09.973 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-websocket. 2021-04-09T18:24:09.987 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../075-python-websocket_0.44.0-0ubuntu2_all.deb ... 2021-04-09T18:24:10.031 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-websocket (0.44.0-0ubuntu2) ... 2021-04-09T18:24:10.082 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package xmlstarlet. 2021-04-09T18:24:10.096 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2_amd64.deb ... 2021-04-09T18:24:10.098 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-websocket. 2021-04-09T18:24:10.114 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../075-python-websocket_0.44.0-0ubuntu2_all.deb ... 2021-04-09T18:24:10.132 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-04-09T18:24:10.164 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-websocket (0.44.0-0ubuntu2) ... 2021-04-09T18:24:10.215 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-04-09T18:24:10.229 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../079-ceph-mgr-rook_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:10.273 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-rook (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:10.286 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-04-09T18:24:10.301 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../079-ceph-mgr-rook_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:10.353 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-rook (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:10.359 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-yaml. 2021-04-09T18:24:10.374 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../076-python-yaml_3.12-1build2_amd64.deb ... 2021-04-09T18:24:10.417 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-yaml (3.12-1build2) ... 2021-04-09T18:24:10.484 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-yaml. 2021-04-09T18:24:10.487 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-test. 2021-04-09T18:24:10.499 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../076-python-yaml_3.12-1build2_amd64.deb ... 2021-04-09T18:24:10.502 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../087-ceph-test_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:10.542 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-yaml (3.12-1build2) ... 2021-04-09T18:24:10.545 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-test (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:10.568 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-ssh. 2021-04-09T18:24:10.582 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../080-ceph-mgr-ssh_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:10.664 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-ssh. 2021-04-09T18:24:10.679 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../080-ceph-mgr-ssh_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:10.721 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-ssh (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:10.787 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-kubernetes. 2021-04-09T18:24:10.800 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../077-python-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-04-09T18:24:10.807 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-ssh (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:10.845 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-kubernetes (2.0.0-2ubuntu1) ... 2021-04-09T18:24:10.879 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-kubernetes. 2021-04-09T18:24:10.892 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../077-python-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-04-09T18:24:10.937 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-kubernetes (2.0.0-2ubuntu1) ... 2021-04-09T18:24:11.066 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libonig4:amd64. 2021-04-09T18:24:11.082 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../081-libonig4_6.7.0-1_amd64.deb ... 2021-04-09T18:24:11.124 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-04-09T18:24:11.135 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libonig4:amd64. 2021-04-09T18:24:11.150 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../081-libonig4_6.7.0-1_amd64.deb ... 2021-04-09T18:24:11.193 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-04-09T18:24:11.249 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-04-09T18:24:11.264 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../078-ceph-mgr-k8sevents_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:11.307 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-k8sevents (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:11.383 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-04-09T18:24:11.397 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../078-ceph-mgr-k8sevents_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:11.441 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-k8sevents (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:11.478 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libjq1:amd64. 2021-04-09T18:24:11.493 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../082-libjq1_1.5+dfsg-2_amd64.deb ... 2021-04-09T18:24:11.536 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-04-09T18:24:11.580 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libjq1:amd64. 2021-04-09T18:24:11.594 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../082-libjq1_1.5+dfsg-2_amd64.deb ... 2021-04-09T18:24:11.601 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-04-09T18:24:11.616 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../079-ceph-mgr-rook_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:11.638 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-04-09T18:24:11.660 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-rook (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:11.752 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-04-09T18:24:11.767 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../079-ceph-mgr-rook_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:11.818 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-rook (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:11.849 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package jq. 2021-04-09T18:24:11.865 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../083-jq_1.5+dfsg-2_amd64.deb ... 2021-04-09T18:24:11.907 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-04-09T18:24:11.908 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package jq. 2021-04-09T18:24:11.922 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../083-jq_1.5+dfsg-2_amd64.deb ... 2021-04-09T18:24:11.966 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-04-09T18:24:11.996 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-ssh. 2021-04-09T18:24:12.011 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../080-ceph-mgr-ssh_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:12.105 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-ssh. 2021-04-09T18:24:12.121 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../080-ceph-mgr-ssh_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:12.139 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-ssh (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:12.160 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package socat. 2021-04-09T18:24:12.176 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../084-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-04-09T18:24:12.219 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-04-09T18:24:12.244 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package socat. 2021-04-09T18:24:12.256 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-ssh (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:12.260 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../084-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-04-09T18:24:12.302 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-04-09T18:24:12.467 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libonig4:amd64. 2021-04-09T18:24:12.483 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../081-libonig4_6.7.0-1_amd64.deb ... 2021-04-09T18:24:12.533 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-04-09T18:24:12.607 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-04-09T18:24:12.609 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libonig4:amd64. 2021-04-09T18:24:12.622 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../085-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-04-09T18:24:12.624 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../081-libonig4_6.7.0-1_amd64.deb ... 2021-04-09T18:24:12.666 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-04-09T18:24:12.667 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-04-09T18:24:12.689 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-04-09T18:24:12.704 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../085-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-04-09T18:24:12.747 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-04-09T18:24:12.895 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libjq1:amd64. 2021-04-09T18:24:12.910 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../082-libjq1_1.5+dfsg-2_amd64.deb ... 2021-04-09T18:24:12.948 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rados. 2021-04-09T18:24:12.953 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-04-09T18:24:12.962 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../088-python3-rados_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:12.969 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package xmlstarlet. 2021-04-09T18:24:12.984 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2_amd64.deb ... 2021-04-09T18:24:13.007 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rados (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:13.027 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-04-09T18:24:13.045 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libjq1:amd64. 2021-04-09T18:24:13.059 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../082-libjq1_1.5+dfsg-2_amd64.deb ... 2021-04-09T18:24:13.104 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-04-09T18:24:13.239 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package jq. 2021-04-09T18:24:13.255 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../083-jq_1.5+dfsg-2_amd64.deb ... 2021-04-09T18:24:13.298 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-04-09T18:24:13.351 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-04-09T18:24:13.366 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../089-python3-ceph-argparse_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:13.367 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-test. 2021-04-09T18:24:13.375 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package xmlstarlet. 2021-04-09T18:24:13.383 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../087-ceph-test_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:13.389 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2_amd64.deb ... 2021-04-09T18:24:13.390 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package jq. 2021-04-09T18:24:13.404 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../083-jq_1.5+dfsg-2_amd64.deb ... 2021-04-09T18:24:13.409 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-ceph-argparse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:13.425 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-04-09T18:24:13.433 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-test (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:13.448 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-04-09T18:24:13.550 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package socat. 2021-04-09T18:24:13.568 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../084-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-04-09T18:24:13.608 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-04-09T18:24:13.701 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package socat. 2021-04-09T18:24:13.714 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../084-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-04-09T18:24:13.721 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cephfs. 2021-04-09T18:24:13.737 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../090-python3-cephfs_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:13.759 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-04-09T18:24:13.765 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-test. 2021-04-09T18:24:13.778 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../087-ceph-test_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:13.779 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cephfs (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:13.823 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-test (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:13.987 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-04-09T18:24:14.000 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../085-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-04-09T18:24:14.037 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-04-09T18:24:14.098 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-colorama. 2021-04-09T18:24:14.114 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../091-python3-colorama_0.3.7-1_all.deb ... 2021-04-09T18:24:14.129 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-04-09T18:24:14.145 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../085-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-04-09T18:24:14.157 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-colorama (0.3.7-1) ... 2021-04-09T18:24:14.187 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-04-09T18:24:14.323 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package xmlstarlet. 2021-04-09T18:24:14.337 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2_amd64.deb ... 2021-04-09T18:24:14.381 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-04-09T18:24:14.409 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package cephfs-shell. 2021-04-09T18:24:14.423 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../092-cephfs-shell_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:14.467 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking cephfs-shell (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:14.474 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package xmlstarlet. 2021-04-09T18:24:14.488 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2_amd64.deb ... 2021-04-09T18:24:14.532 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-04-09T18:24:14.719 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-test. 2021-04-09T18:24:14.734 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../087-ceph-test_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:14.737 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libcephfs-dev. 2021-04-09T18:24:14.751 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../093-libcephfs-dev_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:14.777 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-test (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:14.795 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libcephfs-dev (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:14.895 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-test. 2021-04-09T18:24:14.908 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../087-ceph-test_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:14.961 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-test (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:15.081 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package nvme-cli. 2021-04-09T18:24:15.097 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../094-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-04-09T18:24:15.139 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-04-09T18:24:15.493 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-attr. 2021-04-09T18:24:15.509 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../095-python-attr_17.4.0-2_all.deb ... 2021-04-09T18:24:15.552 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-attr (17.4.0-2) ... 2021-04-09T18:24:15.830 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-ceph. 2021-04-09T18:24:15.845 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../096-python-ceph_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:15.888 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-ceph (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:15.896 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-rados. 2021-04-09T18:24:15.909 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../088-python3-rados_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:15.954 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-rados (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:16.190 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-funcsigs. 2021-04-09T18:24:16.204 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../097-python-funcsigs_1.0.2-4_all.deb ... 2021-04-09T18:24:16.242 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-rados. 2021-04-09T18:24:16.248 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-04-09T18:24:16.259 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../088-python3-rados_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:16.300 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-rados (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:16.316 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-04-09T18:24:16.332 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../089-python3-ceph-argparse_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:16.375 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-ceph-argparse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:16.543 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-webencodings. 2021-04-09T18:24:16.560 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../098-python-webencodings_0.5-2_all.deb ... 2021-04-09T18:24:16.601 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-webencodings (0.5-2) ... 2021-04-09T18:24:16.670 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-04-09T18:24:16.684 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../089-python3-ceph-argparse_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:16.687 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cephfs. 2021-04-09T18:24:16.701 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../090-python3-cephfs_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:16.728 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-ceph-argparse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:16.745 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cephfs (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:16.887 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-html5lib. 2021-04-09T18:24:16.904 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../099-python-html5lib_0.999999999-1_all.deb ... 2021-04-09T18:24:16.946 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-html5lib (0.999999999-1) ... 2021-04-09T18:24:16.981 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-cephfs. 2021-04-09T18:24:16.998 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../090-python3-cephfs_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:17.031 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-cephfs (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:17.090 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-colorama. 2021-04-09T18:24:17.107 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../091-python3-colorama_0.3.7-1_all.deb ... 2021-04-09T18:24:17.148 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-colorama (0.3.7-1) ... 2021-04-09T18:24:17.205 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rados. 2021-04-09T18:24:17.219 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../088-python3-rados_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:17.263 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rados (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:17.291 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-lxml:amd64. 2021-04-09T18:24:17.306 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-rados. 2021-04-09T18:24:17.307 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../100-python-lxml_4.2.1-1ubuntu0.4_amd64.deb ... 2021-04-09T18:24:17.321 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../088-python3-rados_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:17.333 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-colorama. 2021-04-09T18:24:17.341 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../091-python3-colorama_0.3.7-1_all.deb ... 2021-04-09T18:24:17.348 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.4) ... 2021-04-09T18:24:17.364 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-rados (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:17.407 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-colorama (0.3.7-1) ... 2021-04-09T18:24:17.419 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package cephfs-shell. 2021-04-09T18:24:17.434 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../092-cephfs-shell_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:17.478 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking cephfs-shell (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:17.591 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-04-09T18:24:17.608 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../089-python3-ceph-argparse_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:17.644 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package cephfs-shell. 2021-04-09T18:24:17.649 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-ceph-argparse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:17.658 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../092-cephfs-shell_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:17.702 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking cephfs-shell (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:17.717 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-04-09T18:24:17.731 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libcephfs-dev. 2021-04-09T18:24:17.732 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../089-python3-ceph-argparse_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:17.745 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../093-libcephfs-dev_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:17.775 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-ceph-argparse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:17.785 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-openid. 2021-04-09T18:24:17.789 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libcephfs-dev (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:17.799 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../101-python-openid_2.2.5-6_all.deb ... 2021-04-09T18:24:17.844 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-openid (2.2.5-6) ... 2021-04-09T18:24:17.954 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libcephfs-dev. 2021-04-09T18:24:17.969 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cephfs. 2021-04-09T18:24:17.969 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../093-libcephfs-dev_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:17.985 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../090-python3-cephfs_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:18.012 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libcephfs-dev (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:18.035 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cephfs (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:18.092 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package nvme-cli. 2021-04-09T18:24:18.103 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-cephfs. 2021-04-09T18:24:18.108 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../094-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-04-09T18:24:18.117 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../090-python3-cephfs_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:18.150 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-04-09T18:24:18.170 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-cephfs (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:18.189 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-pastescript. 2021-04-09T18:24:18.203 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../102-python-pastescript_2.0.2-2_all.deb ... 2021-04-09T18:24:18.247 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-pastescript (2.0.2-2) ... 2021-04-09T18:24:18.299 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package nvme-cli. 2021-04-09T18:24:18.312 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../094-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-04-09T18:24:18.348 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-04-09T18:24:18.380 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-colorama. 2021-04-09T18:24:18.397 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../091-python3-colorama_0.3.7-1_all.deb ... 2021-04-09T18:24:18.438 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-colorama (0.3.7-1) ... 2021-04-09T18:24:18.506 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-colorama. 2021-04-09T18:24:18.520 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../091-python3-colorama_0.3.7-1_all.deb ... 2021-04-09T18:24:18.523 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-attr. 2021-04-09T18:24:18.537 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../095-python-attr_17.4.0-2_all.deb ... 2021-04-09T18:24:18.564 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-colorama (0.3.7-1) ... 2021-04-09T18:24:18.567 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-pluggy. 2021-04-09T18:24:18.581 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-attr (17.4.0-2) ... 2021-04-09T18:24:18.584 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../103-python-pluggy_0.6.0-1_all.deb ... 2021-04-09T18:24:18.625 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-04-09T18:24:18.677 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-attr. 2021-04-09T18:24:18.691 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package cephfs-shell. 2021-04-09T18:24:18.691 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../095-python-attr_17.4.0-2_all.deb ... 2021-04-09T18:24:18.704 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../092-cephfs-shell_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:18.735 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-attr (17.4.0-2) ... 2021-04-09T18:24:18.749 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking cephfs-shell (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:18.817 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package cephfs-shell. 2021-04-09T18:24:18.831 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../092-cephfs-shell_14.2.19-116-gd23cd2d5-1bionic_all.deb ... 2021-04-09T18:24:18.834 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-ceph. 2021-04-09T18:24:18.851 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../096-python-ceph_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:18.875 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking cephfs-shell (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:18.893 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-ceph (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:18.961 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-py. 2021-04-09T18:24:18.975 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../104-python-py_1.5.2-1_all.deb ... 2021-04-09T18:24:18.988 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-ceph. 2021-04-09T18:24:19.001 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libcephfs-dev. 2021-04-09T18:24:19.003 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../096-python-ceph_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:19.017 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../093-libcephfs-dev_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:19.020 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-py (1.5.2-1) ... 2021-04-09T18:24:19.060 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libcephfs-dev (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:19.063 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-ceph (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:19.128 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libcephfs-dev. 2021-04-09T18:24:19.145 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../093-libcephfs-dev_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:19.186 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libcephfs-dev (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:19.205 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-funcsigs. 2021-04-09T18:24:19.219 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../097-python-funcsigs_1.0.2-4_all.deb ... 2021-04-09T18:24:19.264 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-04-09T18:24:19.348 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-pyinotify. 2021-04-09T18:24:19.362 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package nvme-cli. 2021-04-09T18:24:19.363 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../105-python-pyinotify_0.9.6-1_all.deb ... 2021-04-09T18:24:19.365 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-funcsigs. 2021-04-09T18:24:19.376 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../094-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-04-09T18:24:19.381 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../097-python-funcsigs_1.0.2-4_all.deb ... 2021-04-09T18:24:19.407 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2021-04-09T18:24:19.424 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-04-09T18:24:19.454 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-04-09T18:24:19.497 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package nvme-cli. 2021-04-09T18:24:19.512 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../094-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-04-09T18:24:19.556 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-04-09T18:24:19.592 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-webencodings. 2021-04-09T18:24:19.606 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../098-python-webencodings_0.5-2_all.deb ... 2021-04-09T18:24:19.642 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-webencodings (0.5-2) ... 2021-04-09T18:24:19.684 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-webencodings. 2021-04-09T18:24:19.700 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../098-python-webencodings_0.5-2_all.deb ... 2021-04-09T18:24:19.734 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-pytest. 2021-04-09T18:24:19.735 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-webencodings (0.5-2) ... 2021-04-09T18:24:19.748 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../106-python-pytest_3.3.2-2_all.deb ... 2021-04-09T18:24:19.792 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-04-09T18:24:19.808 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-attr. 2021-04-09T18:24:19.825 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../095-python-attr_17.4.0-2_all.deb ... 2021-04-09T18:24:19.866 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-attr (17.4.0-2) ... 2021-04-09T18:24:19.910 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-attr. 2021-04-09T18:24:19.924 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../095-python-attr_17.4.0-2_all.deb ... 2021-04-09T18:24:19.945 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-html5lib. 2021-04-09T18:24:19.960 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../099-python-html5lib_0.999999999-1_all.deb ... 2021-04-09T18:24:19.968 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-attr (17.4.0-2) ... 2021-04-09T18:24:20.004 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-html5lib (0.999999999-1) ... 2021-04-09T18:24:20.054 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-html5lib. 2021-04-09T18:24:20.069 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../099-python-html5lib_0.999999999-1_all.deb ... 2021-04-09T18:24:20.112 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-html5lib (0.999999999-1) ... 2021-04-09T18:24:20.119 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-ceph. 2021-04-09T18:24:20.121 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-scgi. 2021-04-09T18:24:20.136 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../096-python-ceph_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:20.137 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../107-python-scgi_1.13-1.1build1_amd64.deb ... 2021-04-09T18:24:20.177 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-ceph (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:20.179 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2021-04-09T18:24:20.221 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-ceph. 2021-04-09T18:24:20.236 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../096-python-ceph_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:20.279 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-ceph (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:20.384 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-lxml:amd64. 2021-04-09T18:24:20.397 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../100-python-lxml_4.2.1-1ubuntu0.4_amd64.deb ... 2021-04-09T18:24:20.407 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-lxml:amd64. 2021-04-09T18:24:20.415 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-sqlalchemy-ext. 2021-04-09T18:24:20.423 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../100-python-lxml_4.2.1-1ubuntu0.4_amd64.deb ... 2021-04-09T18:24:20.428 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../108-python-sqlalchemy-ext_1.1.11+ds1-1ubuntu1_amd64.deb ... 2021-04-09T18:24:20.442 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.4) ... 2021-04-09T18:24:20.465 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.4) ... 2021-04-09T18:24:20.465 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2021-04-09T18:24:20.471 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-funcsigs. 2021-04-09T18:24:20.486 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../097-python-funcsigs_1.0.2-4_all.deb ... 2021-04-09T18:24:20.530 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-04-09T18:24:20.582 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-funcsigs. 2021-04-09T18:24:20.596 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../097-python-funcsigs_1.0.2-4_all.deb ... 2021-04-09T18:24:20.640 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-04-09T18:24:20.776 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package radosgw. 2021-04-09T18:24:20.791 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../109-radosgw_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:20.834 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking radosgw (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:20.849 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-webencodings. 2021-04-09T18:24:20.863 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../098-python-webencodings_0.5-2_all.deb ... 2021-04-09T18:24:20.893 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-openid. 2021-04-09T18:24:20.907 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-webencodings (0.5-2) ... 2021-04-09T18:24:20.910 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../101-python-openid_2.2.5-6_all.deb ... 2021-04-09T18:24:20.913 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-openid. 2021-04-09T18:24:20.928 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../101-python-openid_2.2.5-6_all.deb ... 2021-04-09T18:24:20.943 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-openid (2.2.5-6) ... 2021-04-09T18:24:20.971 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-openid (2.2.5-6) ... 2021-04-09T18:24:20.976 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-webencodings. 2021-04-09T18:24:20.991 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../098-python-webencodings_0.5-2_all.deb ... 2021-04-09T18:24:21.034 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-webencodings (0.5-2) ... 2021-04-09T18:24:21.210 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-html5lib. 2021-04-09T18:24:21.212 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-pastescript. 2021-04-09T18:24:21.224 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../099-python-html5lib_0.999999999-1_all.deb ... 2021-04-09T18:24:21.230 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../102-python-pastescript_2.0.2-2_all.deb ... 2021-04-09T18:24:21.268 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-html5lib (0.999999999-1) ... 2021-04-09T18:24:21.270 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-pastescript (2.0.2-2) ... 2021-04-09T18:24:21.320 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-html5lib. 2021-04-09T18:24:21.337 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../099-python-html5lib_0.999999999-1_all.deb ... 2021-04-09T18:24:21.343 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-pastescript. 2021-04-09T18:24:21.357 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../102-python-pastescript_2.0.2-2_all.deb ... 2021-04-09T18:24:21.378 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-html5lib (0.999999999-1) ... 2021-04-09T18:24:21.401 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-pastescript (2.0.2-2) ... 2021-04-09T18:24:21.571 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package rbd-fuse. 2021-04-09T18:24:21.586 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../110-rbd-fuse_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:21.621 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-lxml:amd64. 2021-04-09T18:24:21.629 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking rbd-fuse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:21.636 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../100-python-lxml_4.2.1-1ubuntu0.4_amd64.deb ... 2021-04-09T18:24:21.688 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.4) ... 2021-04-09T18:24:21.699 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-pluggy. 2021-04-09T18:24:21.714 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../103-python-pluggy_0.6.0-1_all.deb ... 2021-04-09T18:24:21.724 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-lxml:amd64. 2021-04-09T18:24:21.741 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../100-python-lxml_4.2.1-1ubuntu0.4_amd64.deb ... 2021-04-09T18:24:21.746 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-pluggy. 2021-04-09T18:24:21.757 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-04-09T18:24:21.761 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../103-python-pluggy_0.6.0-1_all.deb ... 2021-04-09T18:24:21.782 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.4) ... 2021-04-09T18:24:21.805 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-04-09T18:24:21.964 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-dnspython (1.15.0-1) ... 2021-04-09T18:24:22.068 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-py. 2021-04-09T18:24:22.082 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../104-python-py_1.5.2-1_all.deb ... 2021-04-09T18:24:22.101 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-py. 2021-04-09T18:24:22.118 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../104-python-py_1.5.2-1_all.deb ... 2021-04-09T18:24:22.126 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-openid. 2021-04-09T18:24:22.127 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-py (1.5.2-1) ... 2021-04-09T18:24:22.139 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../101-python-openid_2.2.5-6_all.deb ... 2021-04-09T18:24:22.168 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-py (1.5.2-1) ... 2021-04-09T18:24:22.183 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-openid (2.2.5-6) ... 2021-04-09T18:24:22.193 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-simplejson (3.13.2-1) ... 2021-04-09T18:24:22.244 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-openid. 2021-04-09T18:24:22.260 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../101-python-openid_2.2.5-6_all.deb ... 2021-04-09T18:24:22.302 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-openid (2.2.5-6) ... 2021-04-09T18:24:22.394 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-repoze.lru (0.7-1) ... 2021-04-09T18:24:22.471 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-pyinotify. 2021-04-09T18:24:22.486 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../105-python-pyinotify_0.9.6-1_all.deb ... 2021-04-09T18:24:22.496 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-pyinotify. 2021-04-09T18:24:22.511 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-pastescript. 2021-04-09T18:24:22.514 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../105-python-pyinotify_0.9.6-1_all.deb ... 2021-04-09T18:24:22.528 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../102-python-pastescript_2.0.2-2_all.deb ... 2021-04-09T18:24:22.529 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2021-04-09T18:24:22.555 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2021-04-09T18:24:22.569 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-pastescript (2.0.2-2) ... 2021-04-09T18:24:22.587 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-04-09T18:24:22.655 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-pastescript. 2021-04-09T18:24:22.669 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../102-python-pastescript_2.0.2-2_all.deb ... 2021-04-09T18:24:22.713 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-pastescript (2.0.2-2) ... 2021-04-09T18:24:22.841 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-pytest. 2021-04-09T18:24:22.854 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../106-python-pytest_3.3.2-2_all.deb ... 2021-04-09T18:24:22.884 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-pytest. 2021-04-09T18:24:22.899 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-04-09T18:24:22.900 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../106-python-pytest_3.3.2-2_all.deb ... 2021-04-09T18:24:22.915 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-pluggy. 2021-04-09T18:24:22.931 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../103-python-pluggy_0.6.0-1_all.deb ... 2021-04-09T18:24:22.951 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-04-09T18:24:22.973 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-04-09T18:24:23.055 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-openid (2.2.5-6) ... 2021-04-09T18:24:23.067 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-pluggy. 2021-04-09T18:24:23.081 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../103-python-pluggy_0.6.0-1_all.deb ... 2021-04-09T18:24:23.125 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-04-09T18:24:23.273 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-prettytable (0.7.2-3) ... 2021-04-09T18:24:23.285 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-scgi. 2021-04-09T18:24:23.288 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-scgi. 2021-04-09T18:24:23.301 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-py. 2021-04-09T18:24:23.301 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../107-python-scgi_1.13-1.1build1_amd64.deb ... 2021-04-09T18:24:23.302 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../107-python-scgi_1.13-1.1build1_amd64.deb ... 2021-04-09T18:24:23.315 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../104-python-py_1.5.2-1_all.deb ... 2021-04-09T18:24:23.343 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2021-04-09T18:24:23.346 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2021-04-09T18:24:23.359 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-py (1.5.2-1) ... 2021-04-09T18:24:23.449 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2021-04-09T18:24:23.453 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-py. 2021-04-09T18:24:23.471 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../104-python-py_1.5.2-1_all.deb ... 2021-04-09T18:24:23.511 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-py (1.5.2-1) ... 2021-04-09T18:24:23.596 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-sqlalchemy-ext. 2021-04-09T18:24:23.613 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../108-python-sqlalchemy-ext_1.1.11+ds1-1ubuntu1_amd64.deb ... 2021-04-09T18:24:23.624 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-sqlalchemy-ext. 2021-04-09T18:24:23.642 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../108-python-sqlalchemy-ext_1.1.11+ds1-1ubuntu1_amd64.deb ... 2021-04-09T18:24:23.654 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2021-04-09T18:24:23.659 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-yaml (3.12-1build2) ... 2021-04-09T18:24:23.679 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-pyinotify. 2021-04-09T18:24:23.691 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2021-04-09T18:24:23.694 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../105-python-pyinotify_0.9.6-1_all.deb ... 2021-04-09T18:24:23.737 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2021-04-09T18:24:23.850 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-pyinotify. 2021-04-09T18:24:23.864 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../105-python-pyinotify_0.9.6-1_all.deb ... 2021-04-09T18:24:23.868 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2021-04-09T18:24:23.908 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2021-04-09T18:24:24.032 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package radosgw. 2021-04-09T18:24:24.046 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package radosgw. 2021-04-09T18:24:24.046 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../109-radosgw_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:24.060 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../109-radosgw_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:24.061 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-chardet (3.0.4-1) ... 2021-04-09T18:24:24.065 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-pytest. 2021-04-09T18:24:24.081 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../106-python-pytest_3.3.2-2_all.deb ... 2021-04-09T18:24:24.098 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking radosgw (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:24.104 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking radosgw (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:24.123 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-04-09T18:24:24.219 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-pytest. 2021-04-09T18:24:24.235 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../106-python-pytest_3.3.2-2_all.deb ... 2021-04-09T18:24:24.277 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-04-09T18:24:24.329 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-attr (17.4.0-2) ... 2021-04-09T18:24:24.451 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-scgi. 2021-04-09T18:24:24.465 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../107-python-scgi_1.13-1.1build1_amd64.deb ... 2021-04-09T18:24:24.509 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2021-04-09T18:24:24.530 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2021-04-09T18:24:24.631 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-scgi. 2021-04-09T18:24:24.648 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../107-python-scgi_1.13-1.1build1_amd64.deb ... 2021-04-09T18:24:24.656 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2021-04-09T18:24:24.689 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2021-04-09T18:24:24.745 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-sqlalchemy-ext. 2021-04-09T18:24:24.761 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../108-python-sqlalchemy-ext_1.1.11+ds1-1ubuntu1_amd64.deb ... 2021-04-09T18:24:24.804 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2021-04-09T18:24:24.818 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package rbd-fuse. 2021-04-09T18:24:24.835 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../110-rbd-fuse_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:24.841 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package rbd-fuse. 2021-04-09T18:24:24.856 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../110-rbd-fuse_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:24.891 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-ceph-argparse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:24.899 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking rbd-fuse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:24.901 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking rbd-fuse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:24.984 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-sqlalchemy-ext. 2021-04-09T18:24:24.999 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../108-python-sqlalchemy-ext_1.1.11+ds1-1ubuntu1_amd64.deb ... 2021-04-09T18:24:25.042 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2021-04-09T18:24:25.150 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-04-09T18:24:25.157 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package radosgw. 2021-04-09T18:24:25.171 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../109-radosgw_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:25.196 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-dnspython (1.15.0-1) ... 2021-04-09T18:24:25.201 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-dnspython (1.15.0-1) ... 2021-04-09T18:24:25.223 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking radosgw (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:25.251 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-pyasn1 (0.4.2-3) ... 2021-04-09T18:24:25.378 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package radosgw. 2021-04-09T18:24:25.394 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../109-radosgw_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:25.436 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking radosgw (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:25.448 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-simplejson (3.13.2-1) ... 2021-04-09T18:24:25.465 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-simplejson (3.13.2-1) ... 2021-04-09T18:24:25.477 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-py (1.5.2-1) ... 2021-04-09T18:24:25.657 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-repoze.lru (0.7-1) ... 2021-04-09T18:24:25.683 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-repoze.lru (0.7-1) ... 2021-04-09T18:24:25.703 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-monotonic (1.1-2) ... 2021-04-09T18:24:25.883 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-04-09T18:24:25.893 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-04-09T18:24:25.896 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-joblib (0.11-1) ... 2021-04-09T18:24:25.935 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package rbd-fuse. 2021-04-09T18:24:25.950 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../110-rbd-fuse_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:25.993 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking rbd-fuse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:26.164 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-04-09T18:24:26.189 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package rbd-fuse. 2021-04-09T18:24:26.203 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../110-rbd-fuse_14.2.19-116-gd23cd2d5-1bionic_amd64.deb ... 2021-04-09T18:24:26.247 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking rbd-fuse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:26.287 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-dnspython (1.15.0-1) ... 2021-04-09T18:24:26.290 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-04-09T18:24:26.360 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-openid (2.2.5-6) ... 2021-04-09T18:24:26.372 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-openid (2.2.5-6) ... 2021-04-09T18:24:26.458 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-certifi (2018.1.18-2) ... 2021-04-09T18:24:26.552 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-dnspython (1.15.0-1) ... 2021-04-09T18:24:26.581 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-simplejson (3.13.2-1) ... 2021-04-09T18:24:26.595 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-prettytable (0.7.2-3) ... 2021-04-09T18:24:26.598 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-prettytable (0.7.2-3) ... 2021-04-09T18:24:26.617 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-colorama (0.3.7-1) ... 2021-04-09T18:24:26.787 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2021-04-09T18:24:26.791 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2021-04-09T18:24:26.807 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-repoze.lru (0.7-1) ... 2021-04-09T18:24:26.811 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-simplejson (3.13.2-1) ... 2021-04-09T18:24:26.885 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2021-04-09T18:24:27.000 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-04-09T18:24:27.014 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-yaml (3.12-1build2) ... 2021-04-09T18:24:27.018 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-yaml (3.12-1build2) ... 2021-04-09T18:24:27.020 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-repoze.lru (0.7-1) ... 2021-04-09T18:24:27.186 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2021-04-09T18:24:27.213 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-04-09T18:24:27.227 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2021-04-09T18:24:27.231 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2021-04-09T18:24:27.312 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2021-04-09T18:24:27.412 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-chardet (3.0.4-1) ... 2021-04-09T18:24:27.432 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-chardet (3.0.4-1) ... 2021-04-09T18:24:27.446 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2021-04-09T18:24:27.469 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-openid (2.2.5-6) ... 2021-04-09T18:24:27.681 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-attr (17.4.0-2) ... 2021-04-09T18:24:27.687 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-prettytable (0.7.2-3) ... 2021-04-09T18:24:27.690 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-openid (2.2.5-6) ... 2021-04-09T18:24:27.700 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-attr (17.4.0-2) ... 2021-04-09T18:24:27.706 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-ceph-argparse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:27.831 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-waitress (1.0.1-1) ... 2021-04-09T18:24:27.875 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2021-04-09T18:24:27.888 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2021-04-09T18:24:27.910 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2021-04-09T18:24:27.916 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-prettytable (0.7.2-3) ... 2021-04-09T18:24:28.001 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2021-04-09T18:24:28.036 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2021-04-09T18:24:28.106 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-yaml (3.12-1build2) ... 2021-04-09T18:24:28.134 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-04-09T18:24:28.134 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2021-04-09T18:24:28.227 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-ceph-argparse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:28.261 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-ceph-argparse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:28.324 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2021-04-09T18:24:28.343 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-pyasn1-modules (0.2.1-0.2) ... 2021-04-09T18:24:28.352 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-yaml (3.12-1build2) ... 2021-04-09T18:24:28.512 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-04-09T18:24:28.516 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-chardet (3.0.4-1) ... 2021-04-09T18:24:28.569 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-fasteners (0.12.0-3) ... 2021-04-09T18:24:28.570 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2021-04-09T18:24:28.571 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-04-09T18:24:28.638 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-pyasn1 (0.4.2-3) ... 2021-04-09T18:24:28.722 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-pyasn1 (0.4.2-3) ... 2021-04-09T18:24:28.761 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-jwt (1.5.3+ds1-1) ... 2021-04-09T18:24:28.779 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-chardet (3.0.4-1) ... 2021-04-09T18:24:28.784 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-attr (17.4.0-2) ... 2021-04-09T18:24:28.857 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-py (1.5.2-1) ... 2021-04-09T18:24:28.948 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-py (1.5.2-1) ... 2021-04-09T18:24:28.965 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-markupsafe (1.0-1build1) ... 2021-04-09T18:24:28.985 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2021-04-09T18:24:29.047 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-attr (17.4.0-2) ... 2021-04-09T18:24:29.084 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-monotonic (1.1-2) ... 2021-04-09T18:24:29.111 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2021-04-09T18:24:29.158 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-04-09T18:24:29.200 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-monotonic (1.1-2) ... 2021-04-09T18:24:29.248 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2021-04-09T18:24:29.285 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-joblib (0.11-1) ... 2021-04-09T18:24:29.337 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-ceph-argparse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:29.383 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2021-04-09T18:24:29.392 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-joblib (0.11-1) ... 2021-04-09T18:24:29.400 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-pyinotify (0.9.6-1) ... 2021-04-09T18:24:29.554 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-04-09T18:24:29.576 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-scgi (1.13-1.1build1) ... 2021-04-09T18:24:29.592 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-ceph-argparse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:29.643 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-04-09T18:24:29.647 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-04-09T18:24:29.680 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-04-09T18:24:29.761 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-websocket (0.44.0-0ubuntu2) ... 2021-04-09T18:24:29.769 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-04-09T18:24:29.773 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-pyasn1 (0.4.2-3) ... 2021-04-09T18:24:29.850 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/bin/python2-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-04-09T18:24:29.873 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-certifi (2018.1.18-2) ... 2021-04-09T18:24:29.893 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-04-09T18:24:29.970 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-certifi (2018.1.18-2) ... 2021-04-09T18:24:29.999 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-py (1.5.2-1) ... 2021-04-09T18:24:30.019 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-pyasn1 (0.4.2-3) ... 2021-04-09T18:24:30.021 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-04-09T18:24:30.067 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-colorama (0.3.7-1) ... 2021-04-09T18:24:30.147 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-04-09T18:24:30.171 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-colorama (0.3.7-1) ... 2021-04-09T18:24:30.234 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-monotonic (1.1-2) ... 2021-04-09T18:24:30.270 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-py (1.5.2-1) ... 2021-04-09T18:24:30.298 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-httplib2 (0.9.2+dfsg-1ubuntu0.3) ... 2021-04-09T18:24:30.360 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2021-04-09T18:24:30.418 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-joblib (0.11-1) ... 2021-04-09T18:24:30.481 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2021-04-09T18:24:30.497 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-monotonic (1.1-2) ... 2021-04-09T18:24:30.516 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-04-09T18:24:30.617 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-bs4 (4.6.0-1) ... 2021-04-09T18:24:30.669 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-04-09T18:24:30.686 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2021-04-09T18:24:30.689 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-joblib (0.11-1) ... 2021-04-09T18:24:30.795 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-04-09T18:24:30.798 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2021-04-09T18:24:30.812 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2021-04-09T18:24:30.818 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2021-04-09T18:24:30.924 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2021-04-09T18:24:30.938 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2021-04-09T18:24:30.949 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-04-09T18:24:30.999 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-certifi (2018.1.18-2) ... 2021-04-09T18:24:31.042 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2021-04-09T18:24:31.052 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-sklearn-lib (0.19.1-3) ... 2021-04-09T18:24:31.084 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-04-09T18:24:31.165 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-ceph-argparse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:31.178 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-04-09T18:24:31.208 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-colorama (0.3.7-1) ... 2021-04-09T18:24:31.243 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-ceph-argparse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:31.285 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-certifi (2018.1.18-2) ... 2021-04-09T18:24:31.292 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-waitress (1.0.1-1) ... 2021-04-09T18:24:31.304 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.4) ... 2021-04-09T18:24:31.344 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-waitress (1.0.1-1) ... 2021-04-09T18:24:31.493 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2021-04-09T18:24:31.494 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-colorama (0.3.7-1) ... 2021-04-09T18:24:31.539 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2021-04-09T18:24:31.595 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-04-09T18:24:31.649 INFO:teuthology.orchestra.run.smithi136.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-04-09T18:24:31.664 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-04-09T18:24:31.770 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2021-04-09T18:24:31.779 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-pyasn1-modules (0.2.1-0.2) ... 2021-04-09T18:24:31.802 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2021-04-09T18:24:31.863 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-pyasn1-modules (0.2.1-0.2) ... 2021-04-09T18:24:31.865 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2021-04-09T18:24:31.928 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2021-04-09T18:24:32.005 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-fasteners (0.12.0-3) ... 2021-04-09T18:24:32.054 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2021-04-09T18:24:32.058 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-uritemplate (0.6-1ubuntu1) ... 2021-04-09T18:24:32.079 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2021-04-09T18:24:32.106 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-fasteners (0.12.0-3) ... 2021-04-09T18:24:32.205 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2021-04-09T18:24:32.206 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-jwt (1.5.3+ds1-1) ... 2021-04-09T18:24:32.226 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-decorator (4.1.2-1) ... 2021-04-09T18:24:32.272 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-ceph-argparse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:32.315 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-jwt (1.5.3+ds1-1) ... 2021-04-09T18:24:32.331 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2021-04-09T18:24:32.393 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liboath0 (2.6.1-1) ... 2021-04-09T18:24:32.398 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-waitress (1.0.1-1) ... 2021-04-09T18:24:32.425 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-markupsafe (1.0-1build1) ... 2021-04-09T18:24:32.541 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-markupsafe (1.0-1build1) ... 2021-04-09T18:24:32.561 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2021-04-09T18:24:32.566 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-ceph-argparse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:32.619 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-04-09T18:24:32.692 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-waitress (1.0.1-1) ... 2021-04-09T18:24:32.724 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-04-09T18:24:32.725 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-04-09T18:24:32.746 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-04-09T18:24:32.872 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-04-09T18:24:32.887 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-pyinotify (0.9.6-1) ... 2021-04-09T18:24:32.910 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-pyasn1-modules (0.2.1-0.2) ... 2021-04-09T18:24:32.960 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-pyinotify (0.9.6-1) ... 2021-04-09T18:24:32.998 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-tempita (0.5.2-2) ... 2021-04-09T18:24:33.025 INFO:teuthology.orchestra.run.smithi144.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-04-09T18:24:33.080 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-scgi (1.13-1.1build1) ... 2021-04-09T18:24:33.135 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-scgi (1.13-1.1build1) ... 2021-04-09T18:24:33.144 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-fasteners (0.12.0-3) ... 2021-04-09T18:24:33.191 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-04-09T18:24:33.203 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-pyasn1-modules (0.2.1-0.2) ... 2021-04-09T18:24:33.273 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-websocket (0.44.0-0ubuntu2) ... 2021-04-09T18:24:33.308 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-webencodings (0.5-2) ... 2021-04-09T18:24:33.345 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-websocket (0.44.0-0ubuntu2) ... 2021-04-09T18:24:33.363 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/bin/python2-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-04-09T18:24:33.371 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-jwt (1.5.3+ds1-1) ... 2021-04-09T18:24:33.439 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-fasteners (0.12.0-3) ... 2021-04-09T18:24:33.451 INFO:teuthology.orchestra.run.smithi136.stdout:update-alternatives: using /usr/bin/python2-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-04-09T18:24:33.476 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2021-04-09T18:24:33.517 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-04-09T18:24:33.572 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-markupsafe (1.0-1build1) ... 2021-04-09T18:24:33.613 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-04-09T18:24:33.638 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-jwt (1.5.3+ds1-1) ... 2021-04-09T18:24:33.643 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-04-09T18:24:33.711 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-bcrypt (3.1.4-2) ... 2021-04-09T18:24:33.739 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-04-09T18:24:33.773 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-04-09T18:24:33.787 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-httplib2 (0.9.2+dfsg-1ubuntu0.3) ... 2021-04-09T18:24:33.840 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-markupsafe (1.0-1build1) ... 2021-04-09T18:24:33.873 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-httplib2 (0.9.2+dfsg-1ubuntu0.3) ... 2021-04-09T18:24:33.886 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-logutils (0.3.3-5) ... 2021-04-09T18:24:33.988 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-04-09T18:24:34.033 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-04-09T18:24:34.033 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-pyinotify (0.9.6-1) ... 2021-04-09T18:24:34.083 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-04-09T18:24:34.114 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-bs4 (4.6.0-1) ... 2021-04-09T18:24:34.163 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2021-04-09T18:24:34.192 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-bs4 (4.6.0-1) ... 2021-04-09T18:24:34.226 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-scgi (1.13-1.1build1) ... 2021-04-09T18:24:34.309 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-pyinotify (0.9.6-1) ... 2021-04-09T18:24:34.341 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2021-04-09T18:24:34.401 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2021-04-09T18:24:34.419 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-websocket (0.44.0-0ubuntu2) ... 2021-04-09T18:24:34.447 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-routes (2.4.1-1) ... 2021-04-09T18:24:34.509 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/python2-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-04-09T18:24:34.524 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-scgi (1.13-1.1build1) ... 2021-04-09T18:24:34.559 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-sklearn-lib (0.19.1-3) ... 2021-04-09T18:24:34.602 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-sklearn-lib (0.19.1-3) ... 2021-04-09T18:24:34.662 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-04-09T18:24:34.665 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2021-04-09T18:24:34.685 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-04-09T18:24:34.711 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-websocket (0.44.0-0ubuntu2) ... 2021-04-09T18:24:34.728 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-04-09T18:24:34.788 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-04-09T18:24:34.801 INFO:teuthology.orchestra.run.smithi144.stdout:update-alternatives: using /usr/bin/python2-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-04-09T18:24:34.812 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.4) ... 2021-04-09T18:24:34.899 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up jq (1.5+dfsg-2) ... 2021-04-09T18:24:34.912 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.4) ... 2021-04-09T18:24:34.923 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-httplib2 (0.9.2+dfsg-1ubuntu0.3) ... 2021-04-09T18:24:34.954 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-04-09T18:24:35.009 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-scipy (0.19.1-2ubuntu1) ... 2021-04-09T18:24:35.031 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2021-04-09T18:24:35.080 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-04-09T18:24:35.132 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-04-09T18:24:35.147 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2021-04-09T18:24:35.157 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-04-09T18:24:35.214 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-httplib2 (0.9.2+dfsg-1ubuntu0.3) ... 2021-04-09T18:24:35.267 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-bs4 (4.6.0-1) ... 2021-04-09T18:24:35.273 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-04-09T18:24:35.350 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2021-04-09T18:24:35.416 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-04-09T18:24:35.474 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2021-04-09T18:24:35.493 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2021-04-09T18:24:35.559 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-uritemplate (0.6-1ubuntu1) ... 2021-04-09T18:24:35.567 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-bs4 (4.6.0-1) ... 2021-04-09T18:24:35.701 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-uritemplate (0.6-1ubuntu1) ... 2021-04-09T18:24:35.736 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-sklearn-lib (0.19.1-3) ... 2021-04-09T18:24:35.752 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-decorator (4.1.2-1) ... 2021-04-09T18:24:35.862 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-04-09T18:24:35.893 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-decorator (4.1.2-1) ... 2021-04-09T18:24:35.962 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up liboath0 (2.6.1-1) ... 2021-04-09T18:24:35.988 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.4) ... 2021-04-09T18:24:36.010 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2021-04-09T18:24:36.060 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up liboath0 (2.6.1-1) ... 2021-04-09T18:24:36.121 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-rsa (3.4.2-1) ... 2021-04-09T18:24:36.140 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2021-04-09T18:24:36.211 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2021-04-09T18:24:36.215 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2021-04-09T18:24:36.227 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-sklearn-lib (0.19.1-3) ... 2021-04-09T18:24:36.322 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2021-04-09T18:24:36.333 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-04-09T18:24:36.349 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-04-09T18:24:36.353 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-04-09T18:24:36.404 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-04-09T18:24:36.459 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-04-09T18:24:36.479 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.4) ... 2021-04-09T18:24:36.551 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2021-04-09T18:24:36.564 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-04-09T18:24:36.585 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-tempita (0.5.2-2) ... 2021-04-09T18:24:36.624 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2021-04-09T18:24:36.689 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-tempita (0.5.2-2) ... 2021-04-09T18:24:36.697 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2021-04-09T18:24:36.752 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-uritemplate (0.6-1ubuntu1) ... 2021-04-09T18:24:36.795 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-04-09T18:24:36.848 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-04-09T18:24:36.890 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-04-09T18:24:36.900 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-pytest (3.3.2-2) ... 2021-04-09T18:24:36.938 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-webencodings (0.5-2) ... 2021-04-09T18:24:36.944 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-decorator (4.1.2-1) ... 2021-04-09T18:24:37.016 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-webencodings (0.5-2) ... 2021-04-09T18:24:37.041 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2021-04-09T18:24:37.132 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2021-04-09T18:24:37.134 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-oauth2client (4.1.2-3) ... 2021-04-09T18:24:37.145 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liboath0 (2.6.1-1) ... 2021-04-09T18:24:37.209 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2021-04-09T18:24:37.242 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-uritemplate (0.6-1ubuntu1) ... 2021-04-09T18:24:37.313 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2021-04-09T18:24:37.319 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-04-09T18:24:37.392 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-bcrypt (3.1.4-2) ... 2021-04-09T18:24:37.443 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-decorator (4.1.2-1) ... 2021-04-09T18:24:37.470 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-bcrypt (3.1.4-2) ... 2021-04-09T18:24:37.471 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-04-09T18:24:37.507 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-04-09T18:24:37.596 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librados2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:37.627 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-logutils (0.3.3-5) ... 2021-04-09T18:24:37.636 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up liboath0 (2.6.1-1) ... 2021-04-09T18:24:37.641 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-04-09T18:24:37.722 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libcephfs2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:37.776 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-tempita (0.5.2-2) ... 2021-04-09T18:24:37.795 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2021-04-09T18:24:37.812 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2021-04-09T18:24:37.848 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-sklearn (0.19.1-3) ... 2021-04-09T18:24:37.997 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-04-09T18:24:38.010 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-04-09T18:24:38.018 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-logutils (0.3.3-5) ... 2021-04-09T18:24:38.080 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-routes (2.4.1-1) ... 2021-04-09T18:24:38.123 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-04-09T18:24:38.136 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-webencodings (0.5-2) ... 2021-04-09T18:24:38.219 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2021-04-09T18:24:38.273 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-tempita (0.5.2-2) ... 2021-04-09T18:24:38.289 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2021-04-09T18:24:38.337 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2021-04-09T18:24:38.467 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-04-09T18:24:38.523 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up jq (1.5+dfsg-2) ... 2021-04-09T18:24:38.526 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libcephfs-dev (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:38.554 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-routes (2.4.1-1) ... 2021-04-09T18:24:38.592 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-webencodings (0.5-2) ... 2021-04-09T18:24:38.605 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-bcrypt (3.1.4-2) ... 2021-04-09T18:24:38.627 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rados (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:38.649 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-scipy (0.19.1-2ubuntu1) ... 2021-04-09T18:24:38.728 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-kubernetes (2.0.0-2ubuntu1) ... 2021-04-09T18:24:38.764 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2021-04-09T18:24:38.793 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2021-04-09T18:24:38.815 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-logutils (0.3.3-5) ... 2021-04-09T18:24:38.991 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up jq (1.5+dfsg-2) ... 2021-04-09T18:24:39.033 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2021-04-09T18:24:39.053 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-bcrypt (3.1.4-2) ... 2021-04-09T18:24:39.117 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-scipy (0.19.1-2ubuntu1) ... 2021-04-09T18:24:39.221 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-logutils (0.3.3-5) ... 2021-04-09T18:24:39.289 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-html5lib (0.999999999-1) ... 2021-04-09T18:24:39.405 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2021-04-09T18:24:39.532 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-rados (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:39.593 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-routes (2.4.1-1) ... 2021-04-09T18:24:39.658 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-cephfs (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:39.694 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-rsa (3.4.2-1) ... 2021-04-09T18:24:39.698 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-routes (2.4.1-1) ... 2021-04-09T18:24:39.794 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2021-04-09T18:24:39.859 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libradosstriper1 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:39.904 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2021-04-09T18:24:39.907 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2021-04-09T18:24:39.959 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cephfs (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:40.028 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up jq (1.5+dfsg-2) ... 2021-04-09T18:24:40.150 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up jq (1.5+dfsg-2) ... 2021-04-09T18:24:40.173 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-rsa (3.4.2-1) ... 2021-04-09T18:24:40.179 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-scipy (0.19.1-2ubuntu1) ... 2021-04-09T18:24:40.213 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2021-04-09T18:24:40.276 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-scipy (0.19.1-2ubuntu1) ... 2021-04-09T18:24:40.320 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librgw2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:40.375 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2021-04-09T18:24:40.446 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-rgw (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:40.506 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-pytest (3.3.2-2) ... 2021-04-09T18:24:40.605 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2021-04-09T18:24:40.652 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2021-04-09T18:24:40.766 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-oauth2client (4.1.2-3) ... 2021-04-09T18:24:40.816 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-fuse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:40.937 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-pytest (3.3.2-2) ... 2021-04-09T18:24:40.975 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-04-09T18:24:41.035 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-04-09T18:24:41.036 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-04-09T18:24:41.092 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-04-09T18:24:41.193 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librados2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:41.196 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-oauth2client (4.1.2-3) ... 2021-04-09T18:24:41.226 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-rsa (3.4.2-1) ... 2021-04-09T18:24:41.294 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libcephfs2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:41.305 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-rsa (3.4.2-1) ... 2021-04-09T18:24:41.317 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librbd1 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:41.395 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-sklearn (0.19.1-3) ... 2021-04-09T18:24:41.406 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-04-09T18:24:41.418 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up cephfs-shell (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:41.427 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2021-04-09T18:24:41.506 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2021-04-09T18:24:41.532 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-04-09T18:24:41.544 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-pastescript (2.0.2-2) ... 2021-04-09T18:24:41.685 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librados2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:41.720 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2021-04-09T18:24:41.762 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-rbd (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:41.791 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2021-04-09T18:24:41.811 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libcephfs2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:41.888 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-common (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:41.937 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-sklearn (0.19.1-3) ... 2021-04-09T18:24:42.013 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-pytest (3.3.2-2) ... 2021-04-09T18:24:42.084 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-pytest (3.3.2-2) ... 2021-04-09T18:24:42.099 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libcephfs-dev (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:42.224 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-rados (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:42.282 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-oauth2client (4.1.2-3) ... 2021-04-09T18:24:42.335 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-oauth2client (4.1.2-3) ... 2021-04-09T18:24:42.364 INFO:teuthology.orchestra.run.smithi089.stdout:Adding group ceph....done 2021-04-09T18:24:42.375 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-kubernetes (2.0.0-2ubuntu1) ... 2021-04-09T18:24:42.516 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-04-09T18:24:42.561 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-04-09T18:24:42.642 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-04-09T18:24:42.662 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-04-09T18:24:42.683 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libcephfs-dev (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:42.751 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librados2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:42.758 INFO:teuthology.orchestra.run.smithi089.stdout:Adding system user ceph....done 2021-04-09T18:24:42.763 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up librados2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:42.809 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-rados (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:42.852 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libcephfs2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:42.872 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libcephfs2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:42.919 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-html5lib (0.999999999-1) ... 2021-04-09T18:24:42.936 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-kubernetes (2.0.0-2ubuntu1) ... 2021-04-09T18:24:42.950 INFO:teuthology.orchestra.run.smithi089.stdout:Setting system user ceph properties....done 2021-04-09T18:24:42.953 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-sklearn (0.19.1-3) ... 2021-04-09T18:24:42.998 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-sklearn (0.19.1-3) ... 2021-04-09T18:24:43.104 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-04-09T18:24:43.145 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-rados (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:43.313 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-cephfs (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:43.314 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-04-09T18:24:43.464 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-html5lib (0.999999999-1) ... 2021-04-09T18:24:43.514 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libradosstriper1 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:43.631 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up radosgw (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:43.649 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libcephfs-dev (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:43.693 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libcephfs-dev (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:43.699 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-rados (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:43.775 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rados (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:43.819 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-rados (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:43.825 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-cephfs (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:43.874 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-04-09T18:24:43.874 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-04-09T18:24:43.901 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-kubernetes (2.0.0-2ubuntu1) ... 2021-04-09T18:24:43.928 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-kubernetes (2.0.0-2ubuntu1) ... 2021-04-09T18:24:44.035 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libradosstriper1 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:44.123 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-cephfs (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:44.162 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cephfs (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:44.267 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up rbd-fuse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:44.392 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-ceph (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:44.403 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-html5lib (0.999999999-1) ... 2021-04-09T18:24:44.447 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-html5lib (0.999999999-1) ... 2021-04-09T18:24:44.492 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librgw2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:44.518 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2021-04-09T18:24:44.541 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librgw2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:44.609 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-rgw (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:44.646 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-rados (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:44.673 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-rados (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:44.700 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-rgw (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:44.710 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2021-04-09T18:24:44.720 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-test (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:44.798 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-cephfs (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:44.808 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-cephfs (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:44.826 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2021-04-09T18:24:44.846 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-base (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:44.886 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-fuse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:44.999 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libradosstriper1 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:45.019 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-fuse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:45.050 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libradosstriper1 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:45.097 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-04-09T18:24:45.097 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-04-09T18:24:45.125 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cephfs (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:45.167 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-04-09T18:24:45.176 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-cephfs (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:45.235 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-04-09T18:24:45.236 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-04-09T18:24:45.338 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librbd1 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:45.463 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up cephfs-shell (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:45.464 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-pecan (1.2.1-2) ... 2021-04-09T18:24:45.486 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librgw2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:45.531 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librbd1 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:45.545 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-04-09T18:24:45.562 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up librgw2 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:45.578 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-04-09T18:24:45.587 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-rgw (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:45.589 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-pastescript (2.0.2-2) ... 2021-04-09T18:24:45.663 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-rgw (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:45.665 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up cephfs-shell (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:45.713 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2021-04-09T18:24:45.764 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2021-04-09T18:24:45.775 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-osd (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:45.791 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-pastescript (2.0.2-2) ... 2021-04-09T18:24:45.832 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-rbd (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:45.906 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-fuse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:45.948 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-fuse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:45.958 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-common (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:46.001 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-rbd (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:46.121 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-04-09T18:24:46.122 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-04-09T18:24:46.127 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-common (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:46.179 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-04-09T18:24:46.179 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-04-09T18:24:46.341 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-04-09T18:24:46.341 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-04-09T18:24:46.424 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librbd1 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:46.433 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up librbd1 (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:46.451 INFO:teuthology.orchestra.run.smithi136.stdout:Adding group ceph....done 2021-04-09T18:24:46.550 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up cephfs-shell (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:46.559 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up cephfs-shell (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:46.644 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mds (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:46.660 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-pastescript (2.0.2-2) ... 2021-04-09T18:24:46.673 INFO:teuthology.orchestra.run.smithi090.stdout:Adding group ceph....done 2021-04-09T18:24:46.685 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-pastescript (2.0.2-2) ... 2021-04-09T18:24:46.853 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-rbd (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:46.861 INFO:teuthology.orchestra.run.smithi136.stdout:Adding system user ceph....done 2021-04-09T18:24:46.864 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-04-09T18:24:46.865 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-04-09T18:24:46.911 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-rbd (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:46.964 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-common (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:47.012 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-common (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:47.045 INFO:teuthology.orchestra.run.smithi136.stdout:Setting system user ceph properties....done 2021-04-09T18:24:47.076 INFO:teuthology.orchestra.run.smithi090.stdout:Adding system user ceph....done 2021-04-09T18:24:47.138 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mon (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:47.204 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-04-09T18:24:47.295 INFO:teuthology.orchestra.run.smithi090.stdout:Setting system user ceph properties....done 2021-04-09T18:24:47.356 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-04-09T18:24:47.357 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-04-09T18:24:47.409 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-04-09T18:24:47.465 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-04-09T18:24:47.506 INFO:teuthology.orchestra.run.smithi144.stdout:Adding group ceph....done 2021-04-09T18:24:47.514 INFO:teuthology.orchestra.run.smithi079.stdout:Adding group ceph....done 2021-04-09T18:24:47.647 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:47.691 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-04-09T18:24:47.701 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up radosgw (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:47.833 INFO:teuthology.orchestra.run.smithi079.stdout:Adding system user ceph....done 2021-04-09T18:24:47.865 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-04-09T18:24:47.865 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-04-09T18:24:47.916 INFO:teuthology.orchestra.run.smithi144.stdout:Adding system user ceph....done 2021-04-09T18:24:47.951 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-04-09T18:24:47.952 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-04-09T18:24:47.992 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up radosgw (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:48.034 INFO:teuthology.orchestra.run.smithi079.stdout:Setting system user ceph properties....done 2021-04-09T18:24:48.075 INFO:teuthology.orchestra.run.smithi144.stdout:Setting system user ceph properties....done 2021-04-09T18:24:48.149 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-diskprediction-local (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:48.204 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-04-09T18:24:48.233 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-04-09T18:24:48.252 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-04-09T18:24:48.252 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-04-09T18:24:48.266 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-diskprediction-cloud (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:48.369 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up rbd-fuse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:48.401 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-rook (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:48.424 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-04-09T18:24:48.426 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-04-09T18:24:48.478 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-ceph (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:48.543 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:48.596 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2021-04-09T18:24:48.669 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-k8sevents (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:48.670 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up rbd-fuse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:48.707 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up radosgw (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:48.714 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up radosgw (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:48.795 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-ssh (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:48.796 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-ceph (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:48.797 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-test (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:48.922 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2021-04-09T18:24:48.923 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-base (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:48.938 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-dashboard (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:48.943 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-04-09T18:24:48.944 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-04-09T18:24:48.969 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-04-09T18:24:48.969 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-04-09T18:24:49.081 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-04-09T18:24:49.132 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-test (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:49.225 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for systemd (237-3ubuntu10.44) ... 2021-04-09T18:24:49.259 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-base (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:49.297 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-04-09T18:24:49.341 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up rbd-fuse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:49.400 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up rbd-fuse (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:49.401 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-04-09T18:24:49.467 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-ceph (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:49.526 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-ceph (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:49.575 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-pecan (1.2.1-2) ... 2021-04-09T18:24:49.593 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2021-04-09T18:24:49.596 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-04-09T18:24:49.627 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2021-04-09T18:24:49.664 INFO:teuthology.orchestra.run.smithi136.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-04-09T18:24:49.696 INFO:teuthology.orchestra.run.smithi136.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-04-09T18:24:49.802 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-test (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:49.804 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-test (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:49.902 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-osd (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:49.903 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-pecan (1.2.1-2) ... 2021-04-09T18:24:49.921 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-base (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:49.928 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-base (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:49.993 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-04-09T18:24:50.016 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-04-09T18:24:50.198 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-osd (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:50.254 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-04-09T18:24:50.261 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-04-09T18:24:50.447 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-04-09T18:24:50.448 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-04-09T18:24:50.540 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-pecan (1.2.1-2) ... 2021-04-09T18:24:50.546 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-pecan (1.2.1-2) ... 2021-04-09T18:24:50.619 INFO:teuthology.orchestra.run.smithi144.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-04-09T18:24:50.630 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-04-09T18:24:50.644 INFO:teuthology.orchestra.run.smithi144.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-04-09T18:24:50.662 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-04-09T18:24:50.730 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mds (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:50.765 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-04-09T18:24:50.765 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-04-09T18:24:50.825 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-osd (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:50.860 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-osd (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:50.952 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-04-09T18:24:50.953 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-04-09T18:24:51.061 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mds (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:51.222 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mon (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:51.284 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-04-09T18:24:51.285 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-04-09T18:24:51.372 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-04-09T18:24:51.372 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-04-09T18:24:51.381 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-04-09T18:24:51.381 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-04-09T18:24:51.402 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-04-09T18:24:51.444 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-04-09T18:24:51.445 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-04-09T18:24:51.445 INFO:teuthology.orchestra.run.smithi089.stdout:ureadahead will be reprofiled on next reboot 2021-04-09T18:24:51.546 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mon (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:51.638 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mds (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:51.660 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mds (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:51.715 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:51.750 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-04-09T18:24:51.750 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-04-09T18:24:51.819 INFO:teuthology.orchestra.run.smithi089.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-04-09T18:24:51.822 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev 2021-04-09T18:24:51.861 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-04-09T18:24:51.862 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-04-09T18:24:51.878 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-04-09T18:24:51.879 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-04-09T18:24:51.903 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2021-04-09T18:24:51.937 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-04-09T18:24:51.937 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-04-09T18:24:52.039 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:52.128 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mon (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:52.139 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mon (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:52.169 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2021-04-09T18:24:52.170 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2021-04-09T18:24:52.233 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-diskprediction-local (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:52.265 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-04-09T18:24:52.265 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-04-09T18:24:52.331 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-04-09T18:24:52.332 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-04-09T18:24:52.342 INFO:teuthology.orchestra.run.smithi089.stdout:The following additional packages will be installed: 2021-04-09T18:24:52.343 INFO:teuthology.orchestra.run.smithi089.stdout: libbison-dev libfl-dev libfl2 libssl1.1 zlib1g-dev 2021-04-09T18:24:52.345 INFO:teuthology.orchestra.run.smithi089.stdout:Suggested packages: 2021-04-09T18:24:52.345 INFO:teuthology.orchestra.run.smithi089.stdout: bison-doc flex-doc libssl-doc 2021-04-09T18:24:52.357 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-04-09T18:24:52.357 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-04-09T18:24:52.372 INFO:teuthology.orchestra.run.smithi089.stdout:The following NEW packages will be installed: 2021-04-09T18:24:52.374 INFO:teuthology.orchestra.run.smithi089.stdout: bison flex libbison-dev libelf-dev libfl-dev libfl2 libssl-dev zlib1g-dev 2021-04-09T18:24:52.375 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages will be upgraded: 2021-04-09T18:24:52.376 INFO:teuthology.orchestra.run.smithi089.stdout: libssl1.1 2021-04-09T18:24:52.384 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-diskprediction-cloud (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:52.510 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-rook (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:52.556 INFO:teuthology.orchestra.run.smithi089.stdout:1 upgraded, 8 newly installed, 0 to remove and 36 not upgraded. 2021-04-09T18:24:52.556 INFO:teuthology.orchestra.run.smithi089.stdout:Need to get 4,039 kB of archives. 2021-04-09T18:24:52.556 INFO:teuthology.orchestra.run.smithi089.stdout:After this operation, 11.6 MB of additional disk space will be used. 2021-04-09T18:24:52.557 INFO:teuthology.orchestra.run.smithi089.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2021-04-09T18:24:52.565 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-diskprediction-local (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:52.580 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:52.627 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:52.649 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:52.709 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-diskprediction-cloud (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:52.737 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-k8sevents (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:52.787 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-04-09T18:24:52.787 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-04-09T18:24:52.861 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-rook (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:52.863 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-ssh (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:52.871 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-04-09T18:24:52.871 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-04-09T18:24:53.004 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:53.005 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-dashboard (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:53.014 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl1.1 amd64 1.1.1-1ubuntu2.1~18.04.9 [1,301 kB] 2021-04-09T18:24:53.064 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-diskprediction-local (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:53.147 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-k8sevents (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:53.149 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-04-09T18:24:53.167 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-diskprediction-local (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:53.207 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-diskprediction-cloud (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:53.224 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2021-04-09T18:24:53.251 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2021-04-09T18:24:53.265 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2021-04-09T18:24:53.273 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-ssh (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:53.275 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2021-04-09T18:24:53.278 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2021-04-09T18:24:53.278 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2021-04-09T18:24:53.279 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.9 [1,566 kB] 2021-04-09T18:24:53.293 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-diskprediction-cloud (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:53.309 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for systemd (237-3ubuntu10.44) ... 2021-04-09T18:24:53.350 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-rook (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:53.416 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-dashboard (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:53.420 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-rook (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:53.493 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:53.509 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-04-09T18:24:53.546 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:53.559 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-04-09T18:24:53.618 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-k8sevents (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:53.672 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-k8sevents (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:53.679 INFO:teuthology.orchestra.run.smithi089.stdout:Preconfiguring packages ... 2021-04-09T18:24:53.695 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for systemd (237-3ubuntu10.44) ... 2021-04-09T18:24:53.744 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-ssh (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:53.815 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-ssh (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:53.817 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 4,039 kB in 1s (4,203 kB/s) 2021-04-09T18:24:53.887 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-dashboard (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:53.930 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-04-09T18:24:53.950 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package flex. 2021-04-09T18:24:53.982 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-dashboard (14.2.19-116-gd23cd2d5-1bionic) ... 2021-04-09T18:24:54.000 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 144124 files and directories currently installed.) 2021-04-09T18:24:54.004 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../0-flex_2.6.4-6_amd64.deb ... 2021-04-09T18:24:54.005 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-04-09T18:24:54.040 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking flex (2.6.4-6) ... 2021-04-09T18:24:54.117 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-04-09T18:24:54.124 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for systemd (237-3ubuntu10.44) ... 2021-04-09T18:24:54.245 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for systemd (237-3ubuntu10.44) ... 2021-04-09T18:24:54.332 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-04-09T18:24:54.478 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-04-09T18:24:54.509 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../1-libssl1.1_1.1.1-1ubuntu2.1~18.04.9_amd64.deb ... 2021-04-09T18:24:54.662 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libssl1.1:amd64 (1.1.1-1ubuntu2.1~18.04.9) over (1.1.1-1ubuntu2.1~18.04.8) ... 2021-04-09T18:24:55.124 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libbison-dev:amd64. 2021-04-09T18:24:55.137 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../2-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-04-09T18:24:55.182 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-04-09T18:24:55.510 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package bison. 2021-04-09T18:24:55.526 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../3-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-04-09T18:24:55.561 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-04-09T18:24:55.564 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2021-04-09T18:24:55.604 INFO:teuthology.orchestra.run.smithi136.stdout:ureadahead will be reprofiled on next reboot 2021-04-09T18:24:55.975 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-04-09T18:24:55.998 INFO:teuthology.orchestra.run.smithi136.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-04-09T18:24:56.000 DEBUG:teuthology.orchestra.run.smithi136:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev 2021-04-09T18:24:56.027 INFO:teuthology.orchestra.run.smithi090.stdout:ureadahead will be reprofiled on next reboot 2021-04-09T18:24:56.086 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2021-04-09T18:24:56.155 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2021-04-09T18:24:56.169 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../4-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2021-04-09T18:24:56.205 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-04-09T18:24:56.353 INFO:teuthology.orchestra.run.smithi136.stdout:Building dependency tree... 2021-04-09T18:24:56.354 INFO:teuthology.orchestra.run.smithi136.stdout:Reading state information... 2021-04-09T18:24:56.402 INFO:teuthology.orchestra.run.smithi090.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-04-09T18:24:56.404 DEBUG:teuthology.orchestra.run.smithi090:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev 2021-04-09T18:24:56.476 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-04-09T18:24:56.487 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2021-04-09T18:24:56.489 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-04-09T18:24:56.508 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-04-09T18:24:56.519 INFO:teuthology.orchestra.run.smithi144.stdout:ureadahead will be reprofiled on next reboot 2021-04-09T18:24:56.523 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../5-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2021-04-09T18:24:56.532 INFO:teuthology.orchestra.run.smithi079.stdout:ureadahead will be reprofiled on next reboot 2021-04-09T18:24:56.543 INFO:teuthology.orchestra.run.smithi136.stdout:The following additional packages will be installed: 2021-04-09T18:24:56.544 INFO:teuthology.orchestra.run.smithi136.stdout: libbison-dev libfl-dev libfl2 libssl1.1 zlib1g-dev 2021-04-09T18:24:56.546 INFO:teuthology.orchestra.run.smithi136.stdout:Suggested packages: 2021-04-09T18:24:56.547 INFO:teuthology.orchestra.run.smithi136.stdout: bison-doc flex-doc libssl-doc 2021-04-09T18:24:56.567 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-04-09T18:24:56.575 INFO:teuthology.orchestra.run.smithi136.stdout:The following NEW packages will be installed: 2021-04-09T18:24:56.577 INFO:teuthology.orchestra.run.smithi136.stdout: bison flex libbison-dev libelf-dev libfl-dev libfl2 libssl-dev zlib1g-dev 2021-04-09T18:24:56.578 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages will be upgraded: 2021-04-09T18:24:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: libssl1.1 2021-04-09T18:24:56.753 INFO:teuthology.orchestra.run.smithi090.stdout:Building dependency tree... 2021-04-09T18:24:56.754 INFO:teuthology.orchestra.run.smithi090.stdout:Reading state information... 2021-04-09T18:24:56.760 INFO:teuthology.orchestra.run.smithi136.stdout:1 upgraded, 8 newly installed, 0 to remove and 36 not upgraded. 2021-04-09T18:24:56.760 INFO:teuthology.orchestra.run.smithi136.stdout:Need to get 4,039 kB of archives. 2021-04-09T18:24:56.760 INFO:teuthology.orchestra.run.smithi136.stdout:After this operation, 11.6 MB of additional disk space will be used. 2021-04-09T18:24:56.761 INFO:teuthology.orchestra.run.smithi136.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2021-04-09T18:24:56.870 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libfl2:amd64. 2021-04-09T18:24:56.885 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../6-libfl2_2.6.4-6_amd64.deb ... 2021-04-09T18:24:56.893 INFO:teuthology.orchestra.run.smithi144.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-04-09T18:24:56.896 DEBUG:teuthology.orchestra.run.smithi144:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev 2021-04-09T18:24:56.911 INFO:teuthology.orchestra.run.smithi079.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-04-09T18:24:56.913 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev 2021-04-09T18:24:56.920 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2021-04-09T18:24:56.941 INFO:teuthology.orchestra.run.smithi090.stdout:The following additional packages will be installed: 2021-04-09T18:24:56.942 INFO:teuthology.orchestra.run.smithi090.stdout: libbison-dev libfl-dev libfl2 libssl1.1 zlib1g-dev 2021-04-09T18:24:56.944 INFO:teuthology.orchestra.run.smithi090.stdout:Suggested packages: 2021-04-09T18:24:56.944 INFO:teuthology.orchestra.run.smithi090.stdout: bison-doc flex-doc libssl-doc 2021-04-09T18:24:56.970 INFO:teuthology.orchestra.run.smithi090.stdout:The following NEW packages will be installed: 2021-04-09T18:24:56.972 INFO:teuthology.orchestra.run.smithi090.stdout: bison flex libbison-dev libelf-dev libfl-dev libfl2 libssl-dev zlib1g-dev 2021-04-09T18:24:56.974 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages will be upgraded: 2021-04-09T18:24:56.974 INFO:teuthology.orchestra.run.smithi090.stdout: libssl1.1 2021-04-09T18:24:56.980 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2021-04-09T18:24:56.991 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2021-04-09T18:24:57.155 INFO:teuthology.orchestra.run.smithi090.stdout:1 upgraded, 8 newly installed, 0 to remove and 36 not upgraded. 2021-04-09T18:24:57.156 INFO:teuthology.orchestra.run.smithi090.stdout:Need to get 4,039 kB of archives. 2021-04-09T18:24:57.156 INFO:teuthology.orchestra.run.smithi090.stdout:After this operation, 11.6 MB of additional disk space will be used. 2021-04-09T18:24:57.156 INFO:teuthology.orchestra.run.smithi090.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2021-04-09T18:24:57.164 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-04-09T18:24:57.179 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../7-libfl-dev_2.6.4-6_amd64.deb ... 2021-04-09T18:24:57.211 INFO:teuthology.orchestra.run.smithi136.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl1.1 amd64 1.1.1-1ubuntu2.1~18.04.9 [1,301 kB] 2021-04-09T18:24:57.231 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2021-04-09T18:24:57.249 INFO:teuthology.orchestra.run.smithi144.stdout:Building dependency tree... 2021-04-09T18:24:57.249 INFO:teuthology.orchestra.run.smithi144.stdout:Reading state information... 2021-04-09T18:24:57.256 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2021-04-09T18:24:57.257 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2021-04-09T18:24:57.415 INFO:teuthology.orchestra.run.smithi136.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2021-04-09T18:24:57.427 INFO:teuthology.orchestra.run.smithi144.stdout:The following additional packages will be installed: 2021-04-09T18:24:57.428 INFO:teuthology.orchestra.run.smithi144.stdout: libbison-dev libfl-dev libfl2 libssl1.1 zlib1g-dev 2021-04-09T18:24:57.430 INFO:teuthology.orchestra.run.smithi144.stdout:Suggested packages: 2021-04-09T18:24:57.430 INFO:teuthology.orchestra.run.smithi144.stdout: bison-doc flex-doc libssl-doc 2021-04-09T18:24:57.442 INFO:teuthology.orchestra.run.smithi136.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2021-04-09T18:24:57.449 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2021-04-09T18:24:57.450 INFO:teuthology.orchestra.run.smithi079.stdout: libbison-dev libfl-dev libfl2 libssl1.1 zlib1g-dev 2021-04-09T18:24:57.452 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2021-04-09T18:24:57.452 INFO:teuthology.orchestra.run.smithi079.stdout: bison-doc flex-doc libssl-doc 2021-04-09T18:24:57.458 INFO:teuthology.orchestra.run.smithi144.stdout:The following NEW packages will be installed: 2021-04-09T18:24:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: bison flex libbison-dev libelf-dev libfl-dev libfl2 libssl-dev zlib1g-dev 2021-04-09T18:24:57.460 INFO:teuthology.orchestra.run.smithi136.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2021-04-09T18:24:57.461 INFO:teuthology.orchestra.run.smithi144.stdout:The following packages will be upgraded: 2021-04-09T18:24:57.462 INFO:teuthology.orchestra.run.smithi144.stdout: libssl1.1 2021-04-09T18:24:57.468 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2021-04-09T18:24:57.470 INFO:teuthology.orchestra.run.smithi136.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2021-04-09T18:24:57.471 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2021-04-09T18:24:57.471 INFO:teuthology.orchestra.run.smithi136.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.9 [1,566 kB] 2021-04-09T18:24:57.480 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2021-04-09T18:24:57.482 INFO:teuthology.orchestra.run.smithi079.stdout: bison flex libbison-dev libelf-dev libfl-dev libfl2 libssl-dev zlib1g-dev 2021-04-09T18:24:57.483 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages will be upgraded: 2021-04-09T18:24:57.484 INFO:teuthology.orchestra.run.smithi079.stdout: libssl1.1 2021-04-09T18:24:57.492 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-04-09T18:24:57.505 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../8-libssl-dev_1.1.1-1ubuntu2.1~18.04.9_amd64.deb ... 2021-04-09T18:24:57.550 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.9) ... 2021-04-09T18:24:57.610 INFO:teuthology.orchestra.run.smithi090.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl1.1 amd64 1.1.1-1ubuntu2.1~18.04.9 [1,301 kB] 2021-04-09T18:24:57.649 INFO:teuthology.orchestra.run.smithi144.stdout:1 upgraded, 8 newly installed, 0 to remove and 36 not upgraded. 2021-04-09T18:24:57.650 INFO:teuthology.orchestra.run.smithi144.stdout:Need to get 4,039 kB of archives. 2021-04-09T18:24:57.650 INFO:teuthology.orchestra.run.smithi144.stdout:After this operation, 11.6 MB of additional disk space will be used. 2021-04-09T18:24:57.651 INFO:teuthology.orchestra.run.smithi144.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2021-04-09T18:24:57.663 INFO:teuthology.orchestra.run.smithi079.stdout:1 upgraded, 8 newly installed, 0 to remove and 36 not upgraded. 2021-04-09T18:24:57.663 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 4,039 kB of archives. 2021-04-09T18:24:57.664 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 11.6 MB of additional disk space will be used. 2021-04-09T18:24:57.664 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2021-04-09T18:24:57.816 INFO:teuthology.orchestra.run.smithi090.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2021-04-09T18:24:57.845 INFO:teuthology.orchestra.run.smithi090.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2021-04-09T18:24:57.860 INFO:teuthology.orchestra.run.smithi136.stdout:Preconfiguring packages ... 2021-04-09T18:24:57.861 INFO:teuthology.orchestra.run.smithi090.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2021-04-09T18:24:57.870 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2021-04-09T18:24:57.872 INFO:teuthology.orchestra.run.smithi090.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2021-04-09T18:24:57.873 INFO:teuthology.orchestra.run.smithi090.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2021-04-09T18:24:57.873 INFO:teuthology.orchestra.run.smithi090.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.9 [1,566 kB] 2021-04-09T18:24:57.991 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 4,039 kB in 1s (4,318 kB/s) 2021-04-09T18:24:58.021 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up flex (2.6.4-6) ... 2021-04-09T18:24:58.091 INFO:teuthology.orchestra.run.smithi144.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl1.1 amd64 1.1.1-1ubuntu2.1~18.04.9 [1,301 kB] 2021-04-09T18:24:58.112 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl1.1 amd64 1.1.1-1ubuntu2.1~18.04.9 [1,301 kB] 2021-04-09T18:24:58.133 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package flex. 2021-04-09T18:24:58.146 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libssl1.1:amd64 (1.1.1-1ubuntu2.1~18.04.9) ... 2021-04-09T18:24:58.185 INFO:teuthology.orchestra.run.smithi136.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 144124 files and directories currently installed.) 2021-04-09T18:24:58.189 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../0-flex_2.6.4-6_amd64.deb ... 2021-04-09T18:24:58.232 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking flex (2.6.4-6) ... 2021-04-09T18:24:58.274 INFO:teuthology.orchestra.run.smithi090.stdout:Preconfiguring packages ... 2021-04-09T18:24:58.313 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2021-04-09T18:24:58.316 INFO:teuthology.orchestra.run.smithi144.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2021-04-09T18:24:58.341 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2021-04-09T18:24:58.346 INFO:teuthology.orchestra.run.smithi144.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2021-04-09T18:24:58.358 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2021-04-09T18:24:58.360 INFO:teuthology.orchestra.run.smithi144.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2021-04-09T18:24:58.365 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2021-04-09T18:24:58.367 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2021-04-09T18:24:58.368 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2021-04-09T18:24:58.369 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.9 [1,566 kB] 2021-04-09T18:24:58.369 INFO:teuthology.orchestra.run.smithi144.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2021-04-09T18:24:58.372 INFO:teuthology.orchestra.run.smithi144.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2021-04-09T18:24:58.373 INFO:teuthology.orchestra.run.smithi144.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2021-04-09T18:24:58.373 INFO:teuthology.orchestra.run.smithi144.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.9 [1,566 kB] 2021-04-09T18:24:58.448 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-04-09T18:24:58.574 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2021-04-09T18:24:58.692 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2021-04-09T18:24:58.752 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 4,039 kB in 1s (4,223 kB/s) 2021-04-09T18:24:58.756 INFO:teuthology.orchestra.run.smithi079.stdout:Preconfiguring packages ... 2021-04-09T18:24:58.766 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../1-libssl1.1_1.1.1-1ubuntu2.1~18.04.9_amd64.deb ... 2021-04-09T18:24:58.773 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-04-09T18:24:58.775 INFO:teuthology.orchestra.run.smithi144.stdout:Preconfiguring packages ... 2021-04-09T18:24:58.844 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-04-09T18:24:58.898 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 4,039 kB in 1s (4,337 kB/s) 2021-04-09T18:24:58.900 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package flex. 2021-04-09T18:24:58.916 INFO:teuthology.orchestra.run.smithi144.stdout:Fetched 4,039 kB in 1s (4,176 kB/s) 2021-04-09T18:24:58.920 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libssl1.1:amd64 (1.1.1-1ubuntu2.1~18.04.9) over (1.1.1-1ubuntu2.1~18.04.8) ... 2021-04-09T18:24:58.955 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 144124 files and directories currently installed.) 2021-04-09T18:24:58.959 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../0-flex_2.6.4-6_amd64.deb ... 2021-04-09T18:24:58.969 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.9) ... 2021-04-09T18:24:59.007 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking flex (2.6.4-6) ... 2021-04-09T18:24:59.011 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package flex. 2021-04-09T18:24:59.040 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package flex. 2021-04-09T18:24:59.064 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 144124 files and directories currently installed.) 2021-04-09T18:24:59.068 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../0-flex_2.6.4-6_amd64.deb ... 2021-04-09T18:24:59.094 INFO:teuthology.orchestra.run.smithi144.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 144124 files and directories currently installed.) 2021-04-09T18:24:59.095 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-04-09T18:24:59.098 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../0-flex_2.6.4-6_amd64.deb ... 2021-04-09T18:24:59.109 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking flex (2.6.4-6) ... 2021-04-09T18:24:59.139 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking flex (2.6.4-6) ... 2021-04-09T18:24:59.255 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2021-04-09T18:24:59.390 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-04-09T18:24:59.491 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libbison-dev:amd64. 2021-04-09T18:24:59.507 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../2-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-04-09T18:24:59.549 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-04-09T18:24:59.577 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../1-libssl1.1_1.1.1-1ubuntu2.1~18.04.9_amd64.deb ... 2021-04-09T18:24:59.623 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../1-libssl1.1_1.1.1-1ubuntu2.1~18.04.9_amd64.deb ... 2021-04-09T18:24:59.675 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../1-libssl1.1_1.1.1-1ubuntu2.1~18.04.9_amd64.deb ... 2021-04-09T18:24:59.757 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libssl1.1:amd64 (1.1.1-1ubuntu2.1~18.04.9) over (1.1.1-1ubuntu2.1~18.04.8) ... 2021-04-09T18:24:59.799 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libssl1.1:amd64 (1.1.1-1ubuntu2.1~18.04.9) over (1.1.1-1ubuntu2.1~18.04.8) ... 2021-04-09T18:24:59.869 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libssl1.1:amd64 (1.1.1-1ubuntu2.1~18.04.9) over (1.1.1-1ubuntu2.1~18.04.8) ... 2021-04-09T18:24:59.918 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package bison. 2021-04-09T18:24:59.935 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../3-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-04-09T18:24:59.989 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2021-04-09T18:25:00.194 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libbison-dev:amd64. 2021-04-09T18:25:00.208 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../2-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-04-09T18:25:00.252 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-04-09T18:25:00.263 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2021-04-09T18:25:00.277 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../4-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2021-04-09T18:25:00.298 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libbison-dev:amd64. 2021-04-09T18:25:00.312 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../2-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-04-09T18:25:00.313 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-04-09T18:25:00.356 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-04-09T18:25:00.404 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libbison-dev:amd64. 2021-04-09T18:25:00.420 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../2-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-04-09T18:25:00.454 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-04-09T18:25:00.591 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-04-09T18:25:00.605 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../5-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2021-04-09T18:25:00.614 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package bison. 2021-04-09T18:25:00.628 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../3-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-04-09T18:25:00.634 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package bison. 2021-04-09T18:25:00.651 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../3-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-04-09T18:25:00.677 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2021-04-09T18:25:00.682 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-04-09T18:25:00.688 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2021-04-09T18:25:00.782 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package bison. 2021-04-09T18:25:00.795 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../3-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-04-09T18:25:00.845 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2021-04-09T18:25:00.892 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2021-04-09T18:25:01.010 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libfl2:amd64. 2021-04-09T18:25:01.012 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2021-04-09T18:25:01.026 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../6-libfl2_2.6.4-6_amd64.deb ... 2021-04-09T18:25:01.027 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2021-04-09T18:25:01.028 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../4-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2021-04-09T18:25:01.041 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../4-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2021-04-09T18:25:01.068 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2021-04-09T18:25:01.086 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-04-09T18:25:01.095 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-04-09T18:25:01.168 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2021-04-09T18:25:01.184 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../4-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2021-04-09T18:25:01.227 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-04-09T18:25:01.227 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-04-09T18:25:01.329 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-04-09T18:25:01.344 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../7-libfl-dev_2.6.4-6_amd64.deb ... 2021-04-09T18:25:01.379 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2021-04-09T18:25:01.381 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-04-09T18:25:01.396 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../5-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2021-04-09T18:25:01.397 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-04-09T18:25:01.412 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../5-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2021-04-09T18:25:01.448 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-04-09T18:25:01.456 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-04-09T18:25:01.505 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-04-09T18:25:01.521 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../5-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2021-04-09T18:25:01.555 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-04-09T18:25:01.624 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-04-09T18:25:01.639 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../8-libssl-dev_1.1.1-1ubuntu2.1~18.04.9_amd64.deb ... 2021-04-09T18:25:01.682 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.9) ... 2021-04-09T18:25:01.683 INFO:teuthology.orchestra.run.smithi089.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-04-09T18:25:01.686 DEBUG:teuthology.parallel:result is None 2021-04-09T18:25:01.794 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libfl2:amd64. 2021-04-09T18:25:01.810 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../6-libfl2_2.6.4-6_amd64.deb ... 2021-04-09T18:25:01.852 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2021-04-09T18:25:01.884 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libfl2:amd64. 2021-04-09T18:25:01.900 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../6-libfl2_2.6.4-6_amd64.deb ... 2021-04-09T18:25:01.942 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2021-04-09T18:25:02.011 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libfl2:amd64. 2021-04-09T18:25:02.027 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../6-libfl2_2.6.4-6_amd64.deb ... 2021-04-09T18:25:02.061 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2021-04-09T18:25:02.113 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-04-09T18:25:02.127 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../7-libfl-dev_2.6.4-6_amd64.deb ... 2021-04-09T18:25:02.143 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up flex (2.6.4-6) ... 2021-04-09T18:25:02.172 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2021-04-09T18:25:02.194 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-04-09T18:25:02.210 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../7-libfl-dev_2.6.4-6_amd64.deb ... 2021-04-09T18:25:02.253 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2021-04-09T18:25:02.261 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libssl1.1:amd64 (1.1.1-1ubuntu2.1~18.04.9) ... 2021-04-09T18:25:02.313 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-04-09T18:25:02.696 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-04-09T18:25:02.697 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-04-09T18:25:02.698 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../8-libssl-dev_1.1.1-1ubuntu2.1~18.04.9_amd64.deb ... 2021-04-09T18:25:02.698 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.9) ... 2021-04-09T18:25:02.698 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-04-09T18:25:02.699 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../8-libssl-dev_1.1.1-1ubuntu2.1~18.04.9_amd64.deb ... 2021-04-09T18:25:02.699 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.9) ... 2021-04-09T18:25:02.699 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../7-libfl-dev_2.6.4-6_amd64.deb ... 2021-04-09T18:25:02.700 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2021-04-09T18:25:02.700 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-04-09T18:25:02.700 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../8-libssl-dev_1.1.1-1ubuntu2.1~18.04.9_amd64.deb ... 2021-04-09T18:25:02.724 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.9) ... 2021-04-09T18:25:02.739 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2021-04-09T18:25:02.865 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2021-04-09T18:25:02.955 INFO:teuthology.orchestra.run.smithi136.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-04-09T18:25:03.020 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up flex (2.6.4-6) ... 2021-04-09T18:25:03.026 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up flex (2.6.4-6) ... 2021-04-09T18:25:03.033 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-04-09T18:25:03.137 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libssl1.1:amd64 (1.1.1-1ubuntu2.1~18.04.9) ... 2021-04-09T18:25:03.172 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up flex (2.6.4-6) ... 2021-04-09T18:25:03.182 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libssl1.1:amd64 (1.1.1-1ubuntu2.1~18.04.9) ... 2021-04-09T18:25:03.192 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.9) ... 2021-04-09T18:25:03.287 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libssl1.1:amd64 (1.1.1-1ubuntu2.1~18.04.9) ... 2021-04-09T18:25:03.318 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-04-09T18:25:03.452 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2021-04-09T18:25:03.480 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-04-09T18:25:03.525 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-04-09T18:25:03.579 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-04-09T18:25:03.588 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-04-09T18:25:03.606 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2021-04-09T18:25:03.706 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2021-04-09T18:25:03.732 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2021-04-09T18:25:03.822 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-04-09T18:25:03.828 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2021-04-09T18:25:03.857 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2021-04-09T18:25:03.901 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-04-09T18:25:03.954 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2021-04-09T18:25:03.955 INFO:teuthology.orchestra.run.smithi144.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-04-09T18:25:04.027 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.9) ... 2021-04-09T18:25:04.034 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-04-09T18:25:04.045 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-04-09T18:25:04.115 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-04-09T18:25:04.144 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-04-09T18:25:04.160 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.9) ... 2021-04-09T18:25:04.254 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2021-04-09T18:25:04.266 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.9) ... 2021-04-09T18:25:04.286 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-04-09T18:25:04.381 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-04-09T18:25:04.392 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-04-09T18:25:04.412 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2021-04-09T18:25:04.518 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2021-04-09T18:25:04.538 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-04-09T18:25:04.646 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-04-09T18:25:05.081 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2021-04-09T18:25:05.366 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-04-09T18:25:05.838 INFO:teuthology.orchestra.run.smithi136.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-04-09T18:25:05.840 DEBUG:teuthology.parallel:result is None 2021-04-09T18:25:05.950 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2021-04-09T18:25:06.040 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2021-04-09T18:25:06.207 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2021-04-09T18:25:06.268 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-04-09T18:25:06.359 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-04-09T18:25:06.592 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-04-09T18:25:06.717 INFO:teuthology.orchestra.run.smithi079.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-04-09T18:25:06.719 DEBUG:teuthology.parallel:result is None 2021-04-09T18:25:06.846 INFO:teuthology.orchestra.run.smithi144.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-04-09T18:25:06.848 DEBUG:teuthology.parallel:result is None 2021-04-09T18:25:07.047 INFO:teuthology.orchestra.run.smithi090.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-04-09T18:25:07.050 DEBUG:teuthology.parallel:result is None 2021-04-09T18:25:07.050 DEBUG:teuthology.orchestra.run.smithi079:> sudo lsb_release -is 2021-04-09T18:25:07.103 INFO:teuthology.orchestra.run.smithi079.stdout:Ubuntu 2021-04-09T18:25:07.108 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-04-09T18:25:07.109 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=d23cd2d5f486487b0b80655c4e33344f0f97b82b 2021-04-09T18:25:07.419 DEBUG:teuthology.orchestra.run.smithi079:> dpkg-query -W -f '${Version}' ceph 2021-04-09T18:25:07.443 INFO:teuthology.orchestra.run.smithi079.stdout:14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:25:07.444 INFO:teuthology.packaging:The installed version of ceph is 14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:25:07.444 INFO:teuthology.task.install:The correct ceph version 14.2.19-116-gd23cd2d5-1bionic is installed. 2021-04-09T18:25:07.445 DEBUG:teuthology.orchestra.run.smithi089:> sudo lsb_release -is 2021-04-09T18:25:07.498 INFO:teuthology.orchestra.run.smithi089.stdout:Ubuntu 2021-04-09T18:25:07.503 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-04-09T18:25:07.504 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=d23cd2d5f486487b0b80655c4e33344f0f97b82b 2021-04-09T18:25:07.811 DEBUG:teuthology.orchestra.run.smithi089:> dpkg-query -W -f '${Version}' ceph 2021-04-09T18:25:07.835 INFO:teuthology.orchestra.run.smithi089.stdout:14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:25:07.835 INFO:teuthology.packaging:The installed version of ceph is 14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:25:07.836 INFO:teuthology.task.install:The correct ceph version 14.2.19-116-gd23cd2d5-1bionic is installed. 2021-04-09T18:25:07.836 DEBUG:teuthology.orchestra.run.smithi090:> sudo lsb_release -is 2021-04-09T18:25:07.890 INFO:teuthology.orchestra.run.smithi090.stdout:Ubuntu 2021-04-09T18:25:07.895 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-04-09T18:25:07.895 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=d23cd2d5f486487b0b80655c4e33344f0f97b82b 2021-04-09T18:25:08.217 DEBUG:teuthology.orchestra.run.smithi090:> dpkg-query -W -f '${Version}' ceph 2021-04-09T18:25:08.241 INFO:teuthology.orchestra.run.smithi090.stdout:14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:25:08.241 INFO:teuthology.packaging:The installed version of ceph is 14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:25:08.242 INFO:teuthology.task.install:The correct ceph version 14.2.19-116-gd23cd2d5-1bionic is installed. 2021-04-09T18:25:08.242 DEBUG:teuthology.orchestra.run.smithi136:> sudo lsb_release -is 2021-04-09T18:25:08.292 INFO:teuthology.orchestra.run.smithi136.stdout:Ubuntu 2021-04-09T18:25:08.297 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-04-09T18:25:08.298 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=d23cd2d5f486487b0b80655c4e33344f0f97b82b 2021-04-09T18:25:08.622 DEBUG:teuthology.orchestra.run.smithi136:> dpkg-query -W -f '${Version}' ceph 2021-04-09T18:25:08.645 INFO:teuthology.orchestra.run.smithi136.stdout:14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:25:08.646 INFO:teuthology.packaging:The installed version of ceph is 14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:25:08.646 INFO:teuthology.task.install:The correct ceph version 14.2.19-116-gd23cd2d5-1bionic is installed. 2021-04-09T18:25:08.647 DEBUG:teuthology.orchestra.run.smithi144:> sudo lsb_release -is 2021-04-09T18:25:08.695 INFO:teuthology.orchestra.run.smithi144.stdout:Ubuntu 2021-04-09T18:25:08.700 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-04-09T18:25:08.701 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=d23cd2d5f486487b0b80655c4e33344f0f97b82b 2021-04-09T18:25:09.433 DEBUG:teuthology.orchestra.run.smithi144:> dpkg-query -W -f '${Version}' ceph 2021-04-09T18:25:09.460 INFO:teuthology.orchestra.run.smithi144.stdout:14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:25:09.460 INFO:teuthology.packaging:The installed version of ceph is 14.2.19-116-gd23cd2d5-1bionic 2021-04-09T18:25:09.461 INFO:teuthology.task.install:The correct ceph version 14.2.19-116-gd23cd2d5-1bionic is installed. 2021-04-09T18:25:09.462 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-04-09T18:25:09.463 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2021-04-09T18:25:09.463 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-04-09T18:25:09.480 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2021-04-09T18:25:09.480 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-04-09T18:25:09.496 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2021-04-09T18:25:09.496 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-04-09T18:25:09.644 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2021-04-09T18:25:09.644 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-04-09T18:25:09.657 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2021-04-09T18:25:09.658 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-04-09T18:25:09.673 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-04-09T18:25:09.674 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2021-04-09T18:25:09.674 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2021-04-09T18:25:09.690 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-04-09T18:25:09.746 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2021-04-09T18:25:09.746 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2021-04-09T18:25:09.762 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-04-09T18:25:09.818 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2021-04-09T18:25:09.819 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/daemon-helper 2021-04-09T18:25:09.834 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-04-09T18:25:09.888 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2021-04-09T18:25:09.889 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2021-04-09T18:25:09.904 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-04-09T18:25:09.960 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2021-04-09T18:25:09.961 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2021-04-09T18:25:09.976 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-04-09T18:25:10.031 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-04-09T18:25:10.032 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2021-04-09T18:25:10.032 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2021-04-09T18:25:10.047 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-04-09T18:25:10.102 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2021-04-09T18:25:10.102 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2021-04-09T18:25:10.118 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-04-09T18:25:10.174 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2021-04-09T18:25:10.174 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/adjust-ulimits 2021-04-09T18:25:10.190 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-04-09T18:25:10.248 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2021-04-09T18:25:10.249 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2021-04-09T18:25:10.264 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-04-09T18:25:10.321 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2021-04-09T18:25:10.321 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2021-04-09T18:25:10.336 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-04-09T18:25:10.391 INFO:teuthology.run_tasks:Running task ceph... 2021-04-09T18:25:10.441 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-04-09T18:25:10.442 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /var/log/ceph 2021-04-09T18:25:10.444 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2021-04-09T18:25:10.446 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 777 /var/log/ceph 2021-04-09T18:25:10.448 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /var/log/ceph 2021-04-09T18:25:10.451 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /var/log/ceph 2021-04-09T18:25:10.466 INFO:tasks.ceph:Disabling ceph logrotate... 2021-04-09T18:25:10.466 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/logrotate.d/ceph 2021-04-09T18:25:10.502 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2021-04-09T18:25:10.504 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/logrotate.d/ceph 2021-04-09T18:25:10.507 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/logrotate.d/ceph 2021-04-09T18:25:10.509 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/logrotate.d/ceph 2021-04-09T18:25:10.524 INFO:tasks.ceph:Creating extra log directories... 2021-04-09T18:25:10.524 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-04-09T18:25:10.558 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-04-09T18:25:10.561 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-04-09T18:25:10.564 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-04-09T18:25:10.566 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-04-09T18:25:10.582 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2021-04-09T18:25:10.582 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2021-04-09T18:25:10.582 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2021-04-09T18:25:10.583 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2021-04-09T18:25:10.583 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-04-09T18:25:10.618 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-04-09T18:25:10.694 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2021-04-09T18:25:10.695 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-04-09T18:25:10.701 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-04-09T18:25:10.779 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2021-04-09T18:25:10.779 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-04-09T18:25:10.786 DEBUG:teuthology.orchestra.run.smithi090:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-04-09T18:25:10.865 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2021-04-09T18:25:10.865 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-04-09T18:25:10.872 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-04-09T18:25:10.954 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2021-04-09T18:25:10.954 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-04-09T18:25:10.961 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-04-09T18:25:11.042 INFO:tasks.ceph:Creating ceph cluster ceph... 2021-04-09T18:25:11.042 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(TOO_FEW_PGS\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-04-09T18:25:11.043 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031766', 'branch': 'wip-yuri2-testing-2021-04-09-0846-nautilus', 'description': 'fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '6031766', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '18.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri2-testing-2021-04-09-0846-nautilus'}, 'ceph': {'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(TOO_FEW_PGS\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'sha1': 'd23cd2d5f486487b0b80655c4e33344f0f97b82b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'sha1': 'd23cd2d5f486487b0b80655c4e33344f0f97b82b'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri2-testing-2021-04-09-0846-nautilus', 'sha1': 'd23cd2d5f486487b0b80655c4e33344f0f97b82b'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1'], ['client.2']], 'sha1': 'd23cd2d5f486487b0b80655c4e33344f0f97b82b', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-yuri2-testing-2021-04-09-0846-nautilus', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_d23cd2d5f486487b0b80655c4e33344f0f97b82b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'd23cd2d5f486487b0b80655c4e33344f0f97b82b', 'targets': {'smithi079.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzjllv33cP1qI9185eFIa31FdKxmJSmG3cFp3zbLaB6lgsf8uAW723illrmm041nDWPMI4bO1tUCFqOxXR4LthAUtFnQ1QgMH/ArrLVdV0X0ihZ7v8R7y4BjPRYXTXzrULTyz1Nr2u2ptO65QZN94CeHNvrpMAXe3BHG1UDUnVnDHx1E4qr72xh3Bwg1GYB9P3HFME+LayvgsItcBXKLpMyasIi+GMVARQiOUVgoE1kP/6KVk5zsZ/6wbQy3SaMflxh71CnTZw5ocqZ73I6vsVDbxPToxDw6ASJJ5aM+PHtjSYRtqiZvptjrF1x+N64qu6ex9eny7yfAUo+vvtLnnz', 'smithi089.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDGjQr3lYQYtY+jlZrbHJ266Vbt6fd+CEzDxJjZwv/FiqjfHiZLrFpQxA6J+T/LLCIbi/B/wOMmu+4dTSZ1oSHC+rht1tls8oMA6izwGtre2gqUj39uimhlQM6JIBigJMrVs0ip0UCAoaztrvdGhiS85qEqjdfXhuRwDTkUDX60c2viUmeK/VO0z+2FTKSTk0UBqeEUYLBED7Xu/SxrYY9lyUu72RdjdMXWD6VFjC5EqV3nMCdaoIEHiITFgUzZiYkpcqJt1xUG4pm1OTtdl75IoMZONZ/voXVokZgiSY+E8FkQq3Njn4NQ0e89oGOrsuyBseH23mITNfXW7TZtTv9P', 'smithi090.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg3tkog7zFoTjSel/FB46OVqg/bbj0PWv51zaS8vJ76+jAOJfiP6nMTxr5JtYt8w1HK7ZgI8nvMdjmVEFgQ1TtgKJnKLd+Kn+opNg1Pfi2ygmkVuWq3OGAjsYs8zIujqcr8KYTTJiR86/lbeSI8qrkXB29d9c7zhLOjetx7iPCxKjbd/cCS1r9z3sJuNYnTP575jHlxSJM/gjlwo+oraocc7ffbNRx30Lfb+hBOixH1L3Xb0wbCqb3I3dcU0l4+CpLHdGd74yUrPF2zIbG73nTerKAnT+QrsU6H5cRPNud2ixWOSAnHka0E64E4v8QbOklbewb1MsbrJMqQ7FedM+J', 'smithi136.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzAlXI4g7caLPauwGMl4AF/hVZ9DOwWbJDHkqmzrVt4tdH+3ceXFEtO5CVOsf4biS3+TnHJVp5JF1TATH9fl74Z5aE8qKz3FvBlSCJYH3zoqGqQhcXNjYElEIfqnAp1E1i+fm4RMOANFElE79hf0hcSjv9XFEsyWdohlz9+fSmabS0lyA6JT/ISPdJpEpA0vkkEFqFwquQquYMZtbJx9veqFDjBLTbDLoLjaAWNUpG1XMi4MMDgTyxqFeTmQLWePbQlk4+NnPVobkPwHY7fSunf3G8g4Ogch3e2yGvMb47A/t/eF3BFI+mGASisS0A5VIZc/rTTJtWgLUnjiyVwqqd', 'smithi144.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/5ttRO3V3UekMDLQpySukS9V05dgWR+E/tvlhWS3sVsZD24BsU0HY8YThZZ/2XvKQv0AJxWYrHuubIV8luRyj1yflkl8Jpig2QgBeY5XRmIux4EEoCB9+u9mzaSYNUN7Qz0EOXsxlhckfQFcP7FgbjVtRhaAI6oe4sC9JBS0Q230r3w5fGYSMbr5ucpNlVXDAN0xnT0in1wnYmVtXMtZycMMEdO7TrXXmA/+KaTtL70d8s2fJdgfuj+tSeMfV8UIcASO+E8MSyBBcb8EjA8ro69ZT8t4g9aoDeNbxu8Q4mtwSosBLlTd/Ow/M3gj8t6TsHK/4Qp346wrv1DNCFK+L'}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel']}, 'sha1': 'd23cd2d5f486487b0b80655c4e33344f0f97b82b'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_misc']}}], 'teuthology_branch': 'master', 'teuthology_sha1': '85d61eae4759f46ce21e9a37cd816a7a1a66c9d5', 'timestamp': '2021-04-09_17:56:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23935'} 2021-04-09T18:25:11.043 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-04-09T18:25:11.046 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-04-09T18:25:11.049 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-04-09T18:25:11.051 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-04-09T18:25:11.053 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-04-09T18:25:11.092 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/run/ceph 2021-04-09T18:25:11.095 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2021-04-09T18:25:11.101 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/run/ceph 2021-04-09T18:25:11.104 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/run/ceph 2021-04-09T18:25:11.106 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/run/ceph 2021-04-09T18:25:11.148 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2021-04-09T18:25:11.148 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2021-04-09T18:25:11.158 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-04-09T18:25:11.158 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-04-09T18:25:11.206 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-04-09T18:25:11.207 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-04-09T18:25:11.207 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 340 Links: 1 2021-04-09T18:25:11.207 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-04-09T18:25:11.208 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2021-04-09 18:21:42.721515987 +0000 2021-04-09T18:25:11.208 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2021-04-09 18:21:42.593515990 +0000 2021-04-09T18:25:11.208 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2021-04-09 18:21:42.593515990 +0000 2021-04-09T18:25:11.208 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2021-04-09T18:25:11.216 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2021-04-09T18:25:11.217 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2021-04-09T18:25:11.217 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000417211 s, 1.2 MB/s 2021-04-09T18:25:11.221 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-04-09T18:25:11.270 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-04-09T18:25:11.271 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-04-09T18:25:11.271 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 347 Links: 1 2021-04-09T18:25:11.271 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-04-09T18:25:11.272 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2021-04-09 18:21:42.981515979 +0000 2021-04-09T18:25:11.272 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2021-04-09 18:21:42.865515983 +0000 2021-04-09T18:25:11.272 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2021-04-09 18:21:42.865515983 +0000 2021-04-09T18:25:11.272 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2021-04-09T18:25:11.280 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2021-04-09T18:25:11.280 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2021-04-09T18:25:11.281 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000362517 s, 1.4 MB/s 2021-04-09T18:25:11.285 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-04-09T18:25:11.334 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-04-09T18:25:11.335 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-04-09T18:25:11.335 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 353 Links: 1 2021-04-09T18:25:11.335 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-04-09T18:25:11.335 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2021-04-09 18:21:43.253515972 +0000 2021-04-09T18:25:11.336 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2021-04-09 18:21:43.125515975 +0000 2021-04-09T18:25:11.336 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2021-04-09 18:21:43.125515975 +0000 2021-04-09T18:25:11.336 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2021-04-09T18:25:11.344 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2021-04-09T18:25:11.344 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2021-04-09T18:25:11.344 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000354785 s, 1.4 MB/s 2021-04-09T18:25:11.350 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-04-09T18:25:11.403 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-04-09T18:25:11.403 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-04-09T18:25:11.404 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 359 Links: 1 2021-04-09T18:25:11.404 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-04-09T18:25:11.404 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2021-04-09 18:21:43.529515964 +0000 2021-04-09T18:25:11.404 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2021-04-09 18:21:43.393515968 +0000 2021-04-09T18:25:11.404 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2021-04-09 18:21:43.393515968 +0000 2021-04-09T18:25:11.405 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2021-04-09T18:25:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2021-04-09T18:25:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2021-04-09T18:25:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000405813 s, 1.3 MB/s 2021-04-09T18:25:11.416 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-04-09T18:25:11.416 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2021-04-09T18:25:11.416 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2021-04-09T18:25:11.424 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-04-09T18:25:11.424 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-04-09T18:25:11.474 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-04-09T18:25:11.475 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-04-09T18:25:11.475 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 341 Links: 1 2021-04-09T18:25:11.475 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-04-09T18:25:11.475 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2021-04-09 18:21:44.736216526 +0000 2021-04-09T18:25:11.476 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2021-04-09 18:21:44.624216529 +0000 2021-04-09T18:25:11.476 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2021-04-09 18:21:44.624216529 +0000 2021-04-09T18:25:11.476 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2021-04-09T18:25:11.484 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2021-04-09T18:25:11.485 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2021-04-09T18:25:11.485 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000410361 s, 1.2 MB/s 2021-04-09T18:25:11.489 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-04-09T18:25:11.538 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-04-09T18:25:11.538 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-04-09T18:25:11.539 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 348 Links: 1 2021-04-09T18:25:11.539 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-04-09T18:25:11.539 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2021-04-09 18:21:45.032216518 +0000 2021-04-09T18:25:11.539 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2021-04-09 18:21:44.900216521 +0000 2021-04-09T18:25:11.540 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2021-04-09 18:21:44.900216521 +0000 2021-04-09T18:25:11.540 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2021-04-09T18:25:11.548 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2021-04-09T18:25:11.548 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2021-04-09T18:25:11.548 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000391865 s, 1.3 MB/s 2021-04-09T18:25:11.551 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-04-09T18:25:11.598 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-04-09T18:25:11.599 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-04-09T18:25:11.599 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 354 Links: 1 2021-04-09T18:25:11.599 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-04-09T18:25:11.599 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2021-04-09 18:21:45.316216510 +0000 2021-04-09T18:25:11.600 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2021-04-09 18:21:45.184216513 +0000 2021-04-09T18:25:11.600 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2021-04-09 18:21:45.184216513 +0000 2021-04-09T18:25:11.600 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2021-04-09T18:25:11.608 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2021-04-09T18:25:11.608 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2021-04-09T18:25:11.608 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000395962 s, 1.3 MB/s 2021-04-09T18:25:11.612 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-04-09T18:25:11.662 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-04-09T18:25:11.663 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-04-09T18:25:11.663 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 360 Links: 1 2021-04-09T18:25:11.663 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-04-09T18:25:11.663 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2021-04-09 18:21:45.592216502 +0000 2021-04-09T18:25:11.664 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2021-04-09 18:21:45.452216506 +0000 2021-04-09T18:25:11.664 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2021-04-09 18:21:45.452216506 +0000 2021-04-09T18:25:11.664 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2021-04-09T18:25:11.672 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2021-04-09T18:25:11.672 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2021-04-09T18:25:11.673 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000387477 s, 1.3 MB/s 2021-04-09T18:25:11.677 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-04-09T18:25:11.677 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-04-09T18:25:11.677 INFO:tasks.ceph:Generating config... 2021-04-09T18:25:11.679 INFO:tasks.ceph:[client] client mount timeout = 600 2021-04-09T18:25:11.679 INFO:tasks.ceph:[client] debug client = 20 2021-04-09T18:25:11.679 INFO:tasks.ceph:[client] debug ms = 1 2021-04-09T18:25:11.680 INFO:tasks.ceph:[mds] debug mds = 20 2021-04-09T18:25:11.680 INFO:tasks.ceph:[mds] debug ms = 1 2021-04-09T18:25:11.680 INFO:tasks.ceph:[mds] mds bal frag = True 2021-04-09T18:25:11.681 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2021-04-09T18:25:11.681 INFO:tasks.ceph:[mds] mds bal merge size = 5 2021-04-09T18:25:11.681 INFO:tasks.ceph:[mds] mds bal split bits = 3 2021-04-09T18:25:11.681 INFO:tasks.ceph:[mds] mds bal split size = 100 2021-04-09T18:25:11.682 INFO:tasks.ceph:[mds] mds debug frag = True 2021-04-09T18:25:11.682 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2021-04-09T18:25:11.682 INFO:tasks.ceph:[mds] mds op complaint time = 180 2021-04-09T18:25:11.683 INFO:tasks.ceph:[mds] mds verify scatter = True 2021-04-09T18:25:11.683 INFO:tasks.ceph:[mds] osd op complaint time = 180 2021-04-09T18:25:11.683 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-04-09T18:25:11.683 INFO:tasks.ceph:[mgr] debug ms = 1 2021-04-09T18:25:11.684 INFO:tasks.ceph:[mon] debug mon = 20 2021-04-09T18:25:11.684 INFO:tasks.ceph:[mon] debug ms = 1 2021-04-09T18:25:11.684 INFO:tasks.ceph:[mon] debug paxos = 20 2021-04-09T18:25:11.685 INFO:tasks.ceph:[mon] mon op complaint time = 120 2021-04-09T18:25:11.685 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-04-09T18:25:11.685 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-04-09T18:25:11.685 INFO:tasks.ceph:[osd] debug bluefs = 20 2021-04-09T18:25:11.686 INFO:tasks.ceph:[osd] debug bluestore = 20 2021-04-09T18:25:11.686 INFO:tasks.ceph:[osd] debug ms = 1 2021-04-09T18:25:11.686 INFO:tasks.ceph:[osd] debug osd = 20 2021-04-09T18:25:11.687 INFO:tasks.ceph:[osd] debug rocksdb = 10 2021-04-09T18:25:11.687 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-04-09T18:25:11.687 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-04-09T18:25:11.687 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-04-09T18:25:11.688 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-04-09T18:25:11.688 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-04-09T18:25:11.688 INFO:tasks.ceph:[osd] osd op complaint time = 180 2021-04-09T18:25:11.689 INFO:tasks.ceph:Setting up mon.a... 2021-04-09T18:25:11.689 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2021-04-09T18:25:11.762 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.keyring 2021-04-09T18:25:11.765 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2021-04-09T18:25:11.802 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-04-09T18:25:11.859 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.79'), ('mon.b', '172.21.15.89'), ('mon.c', '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]')] 2021-04-09T18:25:11.859 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.79 --add b 172.21.15.89 --addv c '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:25:11.933 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:25:11.933 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: generated fsid fc927781-121d-4817-b30c-0c6f9e107f84 2021-04-09T18:25:11.933 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 0 2021-04-09T18:25:11.934 INFO:teuthology.orchestra.run.smithi079.stdout:fsid fc927781-121d-4817-b30c-0c6f9e107f84 2021-04-09T18:25:11.934 INFO:teuthology.orchestra.run.smithi079.stdout:last_changed 2021-04-09 18:25:11.933992 2021-04-09T18:25:11.934 INFO:teuthology.orchestra.run.smithi079.stdout:created 2021-04-09 18:25:11.933992 2021-04-09T18:25:11.934 INFO:teuthology.orchestra.run.smithi079.stdout:min_mon_release 0 (unknown) 2021-04-09T18:25:11.935 INFO:teuthology.orchestra.run.smithi079.stdout:0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2021-04-09T18:25:11.935 INFO:teuthology.orchestra.run.smithi079.stdout:1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2021-04-09T18:25:11.935 INFO:teuthology.orchestra.run.smithi079.stdout:2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2021-04-09T18:25:11.935 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2021-04-09T18:25:11.936 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fc927781-121d-4817-b30c-0c6f9e107f84... 2021-04-09T18:25:11.938 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-04-09T18:25:11.982 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-04-09T18:25:11.984 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-04-09T18:25:11.987 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-04-09T18:25:11.989 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-04-09T18:25:12.013 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2021-04-09T18:25:12.013 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2021-04-09T18:25:12.013 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-04-09T18:25:12.014 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2021-04-09T18:25:12.014 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.014 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2021-04-09T18:25:12.014 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.014 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2021-04-09T18:25:12.015 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.015 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2021-04-09T18:25:12.015 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2021-04-09T18:25:12.015 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.016 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2021-04-09T18:25:12.016 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2021-04-09T18:25:12.016 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.016 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2021-04-09T18:25:12.016 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2021-04-09T18:25:12.017 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.017 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2021-04-09T18:25:12.017 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.017 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2021-04-09T18:25:12.017 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2021-04-09T18:25:12.018 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2021-04-09T18:25:12.018 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2021-04-09T18:25:12.018 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2021-04-09T18:25:12.018 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2021-04-09T18:25:12.019 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2021-04-09T18:25:12.019 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-04-09T18:25:12.019 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2021-04-09T18:25:12.019 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.020 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-04-09T18:25:12.020 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.020 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2021-04-09T18:25:12.020 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.021 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2021-04-09T18:25:12.021 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.021 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2021-04-09T18:25:12.021 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2021-04-09T18:25:12.021 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2021-04-09T18:25:12.022 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.022 INFO:teuthology.orchestra.run.smithi089.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-04-09T18:25:12.022 INFO:teuthology.orchestra.run.smithi089.stdout: mon_client_directed_command_retry = 4 2021-04-09T18:25:12.022 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = "172.21.15.79,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2021-04-09T18:25:12.022 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = fc927781-121d-4817-b30c-0c6f9e107f84 2021-04-09T18:25:12.023 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.023 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2021-04-09T18:25:12.023 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2021-04-09T18:25:12.023 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.024 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2021-04-09T18:25:12.024 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2021-04-09T18:25:12.024 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.024 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2021-04-09T18:25:12.024 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2021-04-09T18:25:12.025 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.025 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2021-04-09T18:25:12.025 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2021-04-09T18:25:12.025 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2021-04-09T18:25:12.026 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.026 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2021-04-09T18:25:12.026 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2021-04-09T18:25:12.026 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.026 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2021-04-09T18:25:12.027 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.027 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2021-04-09T18:25:12.027 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.027 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2021-04-09T18:25:12.028 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.028 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2021-04-09T18:25:12.028 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2021-04-09T18:25:12.028 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.028 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2021-04-09T18:25:12.029 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2021-04-09T18:25:12.029 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2021-04-09T18:25:12.029 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2021-04-09T18:25:12.029 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 20 2021-04-09T18:25:12.029 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 20 2021-04-09T18:25:12.030 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2021-04-09T18:25:12.030 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2021-04-09T18:25:12.030 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 10 2021-04-09T18:25:12.030 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2021-04-09T18:25:12.031 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2021-04-09T18:25:12.031 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2021-04-09T18:25:12.031 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 0.95 2021-04-09T18:25:12.031 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = bluestore 2021-04-09T18:25:12.031 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2021-04-09T18:25:12.032 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.032 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2021-04-09T18:25:12.032 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2021-04-09T18:25:12.032 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2021-04-09T18:25:12.033 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2021-04-09T18:25:12.033 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2021-04-09T18:25:12.033 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:25:12.033 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:25:12.033 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.034 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2021-04-09T18:25:12.034 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2021-04-09T18:25:12.034 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2021-04-09T18:25:12.034 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2021-04-09T18:25:12.035 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2021-04-09T18:25:12.035 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2021-04-09T18:25:12.035 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2021-04-09T18:25:12.035 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:25:12.035 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2021-04-09T18:25:12.036 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2021-04-09T18:25:12.036 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:25:12.036 INFO:teuthology.orchestra.run.smithi089.stdout: mon op complaint time = 120 2021-04-09T18:25:12.036 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:25:12.036 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2021-04-09T18:25:12.037 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2021-04-09T18:25:12.037 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2021-04-09T18:25:12.037 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2021-04-09T18:25:12.037 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-04-09T18:25:12.038 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-04-09T18:25:12.038 INFO:teuthology.orchestra.run.smithi089.stdout: client mount timeout = 600 2021-04-09T18:25:12.038 INFO:teuthology.orchestra.run.smithi089.stdout: debug client = 20 2021-04-09T18:25:12.038 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2021-04-09T18:25:12.038 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2021-04-09T18:25:12.039 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.b] 2021-04-09T18:25:12.039 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.c] 2021-04-09T18:25:12.039 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2021-04-09T18:25:12.039 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2021-04-09T18:25:12.039 INFO:teuthology.orchestra.run.smithi089.stdout:[mds] 2021-04-09T18:25:12.040 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds = 20 2021-04-09T18:25:12.040 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2021-04-09T18:25:12.040 INFO:teuthology.orchestra.run.smithi089.stdout: mds bal frag = True 2021-04-09T18:25:12.040 INFO:teuthology.orchestra.run.smithi089.stdout: mds bal fragment size max = 10000 2021-04-09T18:25:12.040 INFO:teuthology.orchestra.run.smithi089.stdout: mds bal merge size = 5 2021-04-09T18:25:12.041 INFO:teuthology.orchestra.run.smithi089.stdout: mds bal split bits = 3 2021-04-09T18:25:12.041 INFO:teuthology.orchestra.run.smithi089.stdout: mds bal split size = 100 2021-04-09T18:25:12.041 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug frag = True 2021-04-09T18:25:12.041 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug scatterstat = True 2021-04-09T18:25:12.042 INFO:teuthology.orchestra.run.smithi089.stdout: mds op complaint time = 180 2021-04-09T18:25:12.042 INFO:teuthology.orchestra.run.smithi089.stdout: mds verify scatter = True 2021-04-09T18:25:12.042 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2021-04-09T18:25:12.045 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2021-04-09T18:25:12.046 INFO:teuthology.orchestra.run.smithi144.stdout: chdir = "" 2021-04-09T18:25:12.046 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-04-09T18:25:12.046 INFO:teuthology.orchestra.run.smithi144.stdout: auth supported = cephx 2021-04-09T18:25:12.046 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.047 INFO:teuthology.orchestra.run.smithi144.stdout: filestore xattr use omap = true 2021-04-09T18:25:12.047 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.047 INFO:teuthology.orchestra.run.smithi144.stdout: mon clock drift allowed = 1.000 2021-04-09T18:25:12.047 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.048 INFO:teuthology.orchestra.run.smithi144.stdout: osd crush chooseleaf type = 0 2021-04-09T18:25:12.048 INFO:teuthology.orchestra.run.smithi144.stdout: auth debug = true 2021-04-09T18:25:12.048 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.048 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on old message = true 2021-04-09T18:25:12.048 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on bug = true 2021-04-09T18:25:12.049 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.049 INFO:teuthology.orchestra.run.smithi144.stdout: mon max pg per osd = 10000 # >= luminous 2021-04-09T18:25:12.049 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn max object skew = 0 2021-04-09T18:25:12.049 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.050 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default size = 2 2021-04-09T18:25:12.050 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.050 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow primary affinity = true 2021-04-09T18:25:12.050 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow pg remap = true 2021-04-09T18:25:12.050 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on legacy crush tunables = false 2021-04-09T18:25:12.052 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on crush straw calc version zero = false 2021-04-09T18:25:12.053 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on no sortbitwise = false 2021-04-09T18:25:12.053 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on osd down out interval zero = false 2021-04-09T18:25:12.053 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on too few osds = false 2021-04-09T18:25:12.053 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-04-09T18:25:12.054 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_no_redundancy = false 2021-04-09T18:25:12.054 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.054 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-04-09T18:25:12.054 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.054 INFO:teuthology.orchestra.run.smithi144.stdout: osd default data pool replay window = 5 2021-04-09T18:25:12.055 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.055 INFO:teuthology.orchestra.run.smithi144.stdout: mon allow pool delete = true 2021-04-09T18:25:12.055 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.055 INFO:teuthology.orchestra.run.smithi144.stdout: mon cluster log file level = debug 2021-04-09T18:25:12.055 INFO:teuthology.orchestra.run.smithi144.stdout: debug asserts on shutdown = true 2021-04-09T18:25:12.056 INFO:teuthology.orchestra.run.smithi144.stdout: mon health detail to clog = false 2021-04-09T18:25:12.056 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.056 INFO:teuthology.orchestra.run.smithi144.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-04-09T18:25:12.056 INFO:teuthology.orchestra.run.smithi144.stdout: mon_client_directed_command_retry = 4 2021-04-09T18:25:12.057 INFO:teuthology.orchestra.run.smithi144.stdout: mon host = "172.21.15.79,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2021-04-09T18:25:12.057 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = fc927781-121d-4817-b30c-0c6f9e107f84 2021-04-09T18:25:12.057 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.057 INFO:teuthology.orchestra.run.smithi144.stdout:[osd] 2021-04-09T18:25:12.057 INFO:teuthology.orchestra.run.smithi144.stdout: osd journal size = 100 2021-04-09T18:25:12.058 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.058 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub load threshold = 5.0 2021-04-09T18:25:12.058 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub max interval = 600 2021-04-09T18:25:12.058 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.058 INFO:teuthology.orchestra.run.smithi144.stdout: osd recover clone overlap = true 2021-04-09T18:25:12.059 INFO:teuthology.orchestra.run.smithi144.stdout: osd recovery max chunk = 1048576 2021-04-09T18:25:12.059 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.059 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug shutdown = true 2021-04-09T18:25:12.059 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug op order = true 2021-04-09T18:25:12.060 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug verify stray on activate = true 2021-04-09T18:25:12.060 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.060 INFO:teuthology.orchestra.run.smithi144.stdout: osd open classes on start = true 2021-04-09T18:25:12.060 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug pg log writeout = true 2021-04-09T18:25:12.060 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.061 INFO:teuthology.orchestra.run.smithi144.stdout: osd deep scrub update digest min age = 30 2021-04-09T18:25:12.061 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.061 INFO:teuthology.orchestra.run.smithi144.stdout: osd map max advance = 10 2021-04-09T18:25:12.061 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.062 INFO:teuthology.orchestra.run.smithi144.stdout: journal zero on create = true 2021-04-09T18:25:12.062 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.062 INFO:teuthology.orchestra.run.smithi144.stdout: filestore ondisk finisher threads = 3 2021-04-09T18:25:12.062 INFO:teuthology.orchestra.run.smithi144.stdout: filestore apply finisher threads = 3 2021-04-09T18:25:12.062 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.063 INFO:teuthology.orchestra.run.smithi144.stdout: bdev debug aio = true 2021-04-09T18:25:12.063 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug misdirected ops = true 2021-04-09T18:25:12.063 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore block size = 96636764160 2021-04-09T18:25:12.063 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore fsck on mount = True 2021-04-09T18:25:12.064 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluefs = 20 2021-04-09T18:25:12.064 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluestore = 20 2021-04-09T18:25:12.064 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2021-04-09T18:25:12.064 INFO:teuthology.orchestra.run.smithi144.stdout: debug osd = 20 2021-04-09T18:25:12.064 INFO:teuthology.orchestra.run.smithi144.stdout: debug rocksdb = 10 2021-04-09T18:25:12.065 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull_ratio = 0.85 2021-04-09T18:25:12.065 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.9 2021-04-09T18:25:12.065 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.8 2021-04-09T18:25:12.065 INFO:teuthology.orchestra.run.smithi144.stdout: osd failsafe full ratio = 0.95 2021-04-09T18:25:12.065 INFO:teuthology.orchestra.run.smithi144.stdout: osd objectstore = bluestore 2021-04-09T18:25:12.066 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2021-04-09T18:25:12.066 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.066 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr] 2021-04-09T18:25:12.066 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2021-04-09T18:25:12.067 INFO:teuthology.orchestra.run.smithi144.stdout: debug mgr = 20 2021-04-09T18:25:12.067 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2021-04-09T18:25:12.067 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2021-04-09T18:25:12.067 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:25:12.067 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:25:12.068 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.068 INFO:teuthology.orchestra.run.smithi144.stdout:[mon] 2021-04-09T18:25:12.068 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2021-04-09T18:25:12.068 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2021-04-09T18:25:12.068 INFO:teuthology.orchestra.run.smithi144.stdout: debug paxos = 20 2021-04-09T18:25:12.069 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2021-04-09T18:25:12.069 INFO:teuthology.orchestra.run.smithi144.stdout: mon data avail warn = 5 2021-04-09T18:25:12.069 INFO:teuthology.orchestra.run.smithi144.stdout: mon mgr mkfs grace = 240 2021-04-09T18:25:12.069 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:25:12.070 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd reporter subtree level = osd 2021-04-09T18:25:12.070 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd prime pg temp = true 2021-04-09T18:25:12.070 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:25:12.070 INFO:teuthology.orchestra.run.smithi144.stdout: mon op complaint time = 120 2021-04-09T18:25:12.071 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:25:12.071 INFO:teuthology.orchestra.run.smithi144.stdout:[client] 2021-04-09T18:25:12.071 INFO:teuthology.orchestra.run.smithi144.stdout: rgw cache enabled = true 2021-04-09T18:25:12.071 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable ops log = true 2021-04-09T18:25:12.072 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable usage log = true 2021-04-09T18:25:12.072 INFO:teuthology.orchestra.run.smithi144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-04-09T18:25:12.072 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-04-09T18:25:12.072 INFO:teuthology.orchestra.run.smithi144.stdout: client mount timeout = 600 2021-04-09T18:25:12.072 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2021-04-09T18:25:12.073 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2021-04-09T18:25:12.073 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.a] 2021-04-09T18:25:12.073 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.b] 2021-04-09T18:25:12.073 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.c] 2021-04-09T18:25:12.074 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2021-04-09T18:25:12.074 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2021-04-09T18:25:12.074 INFO:teuthology.orchestra.run.smithi144.stdout:[mds] 2021-04-09T18:25:12.074 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds = 20 2021-04-09T18:25:12.074 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2021-04-09T18:25:12.075 INFO:teuthology.orchestra.run.smithi144.stdout: mds bal frag = True 2021-04-09T18:25:12.075 INFO:teuthology.orchestra.run.smithi144.stdout: mds bal fragment size max = 10000 2021-04-09T18:25:12.075 INFO:teuthology.orchestra.run.smithi144.stdout: mds bal merge size = 5 2021-04-09T18:25:12.075 INFO:teuthology.orchestra.run.smithi144.stdout: mds bal split bits = 3 2021-04-09T18:25:12.076 INFO:teuthology.orchestra.run.smithi144.stdout: mds bal split size = 100 2021-04-09T18:25:12.076 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug frag = True 2021-04-09T18:25:12.076 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug scatterstat = True 2021-04-09T18:25:12.076 INFO:teuthology.orchestra.run.smithi144.stdout: mds op complaint time = 180 2021-04-09T18:25:12.077 INFO:teuthology.orchestra.run.smithi144.stdout: mds verify scatter = True 2021-04-09T18:25:12.077 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2021-04-09T18:25:12.077 INFO:teuthology.orchestra.run.smithi136.stdout:[global] 2021-04-09T18:25:12.077 INFO:teuthology.orchestra.run.smithi136.stdout: chdir = "" 2021-04-09T18:25:12.078 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-04-09T18:25:12.078 INFO:teuthology.orchestra.run.smithi136.stdout: auth supported = cephx 2021-04-09T18:25:12.078 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.078 INFO:teuthology.orchestra.run.smithi136.stdout: filestore xattr use omap = true 2021-04-09T18:25:12.078 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.079 INFO:teuthology.orchestra.run.smithi136.stdout: mon clock drift allowed = 1.000 2021-04-09T18:25:12.079 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.079 INFO:teuthology.orchestra.run.smithi136.stdout: osd crush chooseleaf type = 0 2021-04-09T18:25:12.080 INFO:teuthology.orchestra.run.smithi136.stdout: auth debug = true 2021-04-09T18:25:12.080 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.080 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on old message = true 2021-04-09T18:25:12.080 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on bug = true 2021-04-09T18:25:12.080 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.081 INFO:teuthology.orchestra.run.smithi136.stdout: mon max pg per osd = 10000 # >= luminous 2021-04-09T18:25:12.081 INFO:teuthology.orchestra.run.smithi136.stdout: mon pg warn max object skew = 0 2021-04-09T18:25:12.081 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.081 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default size = 2 2021-04-09T18:25:12.081 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.082 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow primary affinity = true 2021-04-09T18:25:12.082 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow pg remap = true 2021-04-09T18:25:12.082 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on legacy crush tunables = false 2021-04-09T18:25:12.082 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on crush straw calc version zero = false 2021-04-09T18:25:12.083 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on no sortbitwise = false 2021-04-09T18:25:12.083 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on osd down out interval zero = false 2021-04-09T18:25:12.083 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on too few osds = false 2021-04-09T18:25:12.083 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-04-09T18:25:12.083 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_no_redundancy = false 2021-04-09T18:25:12.084 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.084 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-04-09T18:25:12.084 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.084 INFO:teuthology.orchestra.run.smithi136.stdout: osd default data pool replay window = 5 2021-04-09T18:25:12.085 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.085 INFO:teuthology.orchestra.run.smithi136.stdout: mon allow pool delete = true 2021-04-09T18:25:12.085 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.085 INFO:teuthology.orchestra.run.smithi136.stdout: mon cluster log file level = debug 2021-04-09T18:25:12.085 INFO:teuthology.orchestra.run.smithi136.stdout: debug asserts on shutdown = true 2021-04-09T18:25:12.086 INFO:teuthology.orchestra.run.smithi136.stdout: mon health detail to clog = false 2021-04-09T18:25:12.086 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.086 INFO:teuthology.orchestra.run.smithi136.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-04-09T18:25:12.086 INFO:teuthology.orchestra.run.smithi136.stdout: mon_client_directed_command_retry = 4 2021-04-09T18:25:12.086 INFO:teuthology.orchestra.run.smithi136.stdout: mon host = "172.21.15.79,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2021-04-09T18:25:12.087 INFO:teuthology.orchestra.run.smithi136.stdout: fsid = fc927781-121d-4817-b30c-0c6f9e107f84 2021-04-09T18:25:12.087 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.087 INFO:teuthology.orchestra.run.smithi136.stdout:[osd] 2021-04-09T18:25:12.087 INFO:teuthology.orchestra.run.smithi136.stdout: osd journal size = 100 2021-04-09T18:25:12.088 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.088 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub load threshold = 5.0 2021-04-09T18:25:12.088 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub max interval = 600 2021-04-09T18:25:12.088 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.088 INFO:teuthology.orchestra.run.smithi136.stdout: osd recover clone overlap = true 2021-04-09T18:25:12.089 INFO:teuthology.orchestra.run.smithi136.stdout: osd recovery max chunk = 1048576 2021-04-09T18:25:12.089 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.089 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug shutdown = true 2021-04-09T18:25:12.089 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug op order = true 2021-04-09T18:25:12.089 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug verify stray on activate = true 2021-04-09T18:25:12.090 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.090 INFO:teuthology.orchestra.run.smithi136.stdout: osd open classes on start = true 2021-04-09T18:25:12.090 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug pg log writeout = true 2021-04-09T18:25:12.090 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.090 INFO:teuthology.orchestra.run.smithi136.stdout: osd deep scrub update digest min age = 30 2021-04-09T18:25:12.091 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.091 INFO:teuthology.orchestra.run.smithi136.stdout: osd map max advance = 10 2021-04-09T18:25:12.091 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.091 INFO:teuthology.orchestra.run.smithi136.stdout: journal zero on create = true 2021-04-09T18:25:12.092 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.092 INFO:teuthology.orchestra.run.smithi136.stdout: filestore ondisk finisher threads = 3 2021-04-09T18:25:12.092 INFO:teuthology.orchestra.run.smithi136.stdout: filestore apply finisher threads = 3 2021-04-09T18:25:12.092 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.092 INFO:teuthology.orchestra.run.smithi136.stdout: bdev debug aio = true 2021-04-09T18:25:12.093 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug misdirected ops = true 2021-04-09T18:25:12.093 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore block size = 96636764160 2021-04-09T18:25:12.093 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore fsck on mount = True 2021-04-09T18:25:12.093 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluefs = 20 2021-04-09T18:25:12.094 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluestore = 20 2021-04-09T18:25:12.094 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-04-09T18:25:12.094 INFO:teuthology.orchestra.run.smithi136.stdout: debug osd = 20 2021-04-09T18:25:12.094 INFO:teuthology.orchestra.run.smithi136.stdout: debug rocksdb = 10 2021-04-09T18:25:12.095 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd backfillfull_ratio = 0.85 2021-04-09T18:25:12.095 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd full ratio = 0.9 2021-04-09T18:25:12.095 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd nearfull ratio = 0.8 2021-04-09T18:25:12.095 INFO:teuthology.orchestra.run.smithi136.stdout: osd failsafe full ratio = 0.95 2021-04-09T18:25:12.096 INFO:teuthology.orchestra.run.smithi136.stdout: osd objectstore = bluestore 2021-04-09T18:25:12.096 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2021-04-09T18:25:12.096 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.096 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr] 2021-04-09T18:25:12.097 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-04-09T18:25:12.097 INFO:teuthology.orchestra.run.smithi136.stdout: debug mgr = 20 2021-04-09T18:25:12.097 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2021-04-09T18:25:12.097 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2021-04-09T18:25:12.097 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:25:12.098 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:25:12.098 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.098 INFO:teuthology.orchestra.run.smithi136.stdout:[mon] 2021-04-09T18:25:12.098 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-04-09T18:25:12.098 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2021-04-09T18:25:12.099 INFO:teuthology.orchestra.run.smithi136.stdout: debug paxos = 20 2021-04-09T18:25:12.099 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2021-04-09T18:25:12.099 INFO:teuthology.orchestra.run.smithi136.stdout: mon data avail warn = 5 2021-04-09T18:25:12.099 INFO:teuthology.orchestra.run.smithi136.stdout: mon mgr mkfs grace = 240 2021-04-09T18:25:12.100 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:25:12.100 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd reporter subtree level = osd 2021-04-09T18:25:12.100 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd prime pg temp = true 2021-04-09T18:25:12.100 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:25:12.101 INFO:teuthology.orchestra.run.smithi136.stdout: mon op complaint time = 120 2021-04-09T18:25:12.101 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:25:12.101 INFO:teuthology.orchestra.run.smithi136.stdout:[client] 2021-04-09T18:25:12.101 INFO:teuthology.orchestra.run.smithi136.stdout: rgw cache enabled = true 2021-04-09T18:25:12.101 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable ops log = true 2021-04-09T18:25:12.102 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable usage log = true 2021-04-09T18:25:12.102 INFO:teuthology.orchestra.run.smithi136.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-04-09T18:25:12.102 INFO:teuthology.orchestra.run.smithi136.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-04-09T18:25:12.102 INFO:teuthology.orchestra.run.smithi136.stdout: client mount timeout = 600 2021-04-09T18:25:12.103 INFO:teuthology.orchestra.run.smithi136.stdout: debug client = 20 2021-04-09T18:25:12.103 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-04-09T18:25:12.103 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.a] 2021-04-09T18:25:12.103 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.b] 2021-04-09T18:25:12.103 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.c] 2021-04-09T18:25:12.104 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2021-04-09T18:25:12.104 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2021-04-09T18:25:12.104 INFO:teuthology.orchestra.run.smithi136.stdout:[mds] 2021-04-09T18:25:12.104 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds = 20 2021-04-09T18:25:12.104 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-04-09T18:25:12.105 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal frag = True 2021-04-09T18:25:12.105 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal fragment size max = 10000 2021-04-09T18:25:12.105 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal merge size = 5 2021-04-09T18:25:12.105 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal split bits = 3 2021-04-09T18:25:12.106 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal split size = 100 2021-04-09T18:25:12.106 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug frag = True 2021-04-09T18:25:12.106 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug scatterstat = True 2021-04-09T18:25:12.106 INFO:teuthology.orchestra.run.smithi136.stdout: mds op complaint time = 180 2021-04-09T18:25:12.106 INFO:teuthology.orchestra.run.smithi136.stdout: mds verify scatter = True 2021-04-09T18:25:12.107 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2021-04-09T18:25:12.107 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2021-04-09T18:25:12.107 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2021-04-09T18:25:12.107 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-04-09T18:25:12.108 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2021-04-09T18:25:12.108 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.108 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2021-04-09T18:25:12.108 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.109 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2021-04-09T18:25:12.109 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.109 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2021-04-09T18:25:12.109 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2021-04-09T18:25:12.109 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.110 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2021-04-09T18:25:12.110 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2021-04-09T18:25:12.110 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.110 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2021-04-09T18:25:12.111 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2021-04-09T18:25:12.111 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.111 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2021-04-09T18:25:12.111 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.112 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2021-04-09T18:25:12.112 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2021-04-09T18:25:12.112 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2021-04-09T18:25:12.112 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2021-04-09T18:25:12.112 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2021-04-09T18:25:12.113 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2021-04-09T18:25:12.113 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2021-04-09T18:25:12.113 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-04-09T18:25:12.113 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2021-04-09T18:25:12.113 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.114 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-04-09T18:25:12.114 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.114 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2021-04-09T18:25:12.114 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.115 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2021-04-09T18:25:12.115 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.115 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2021-04-09T18:25:12.115 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2021-04-09T18:25:12.115 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2021-04-09T18:25:12.116 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.116 INFO:teuthology.orchestra.run.smithi090.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-04-09T18:25:12.116 INFO:teuthology.orchestra.run.smithi090.stdout: mon_client_directed_command_retry = 4 2021-04-09T18:25:12.116 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.79,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2021-04-09T18:25:12.116 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = fc927781-121d-4817-b30c-0c6f9e107f84 2021-04-09T18:25:12.117 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.117 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2021-04-09T18:25:12.117 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2021-04-09T18:25:12.117 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.118 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2021-04-09T18:25:12.118 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2021-04-09T18:25:12.118 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.118 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2021-04-09T18:25:12.118 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2021-04-09T18:25:12.119 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.119 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2021-04-09T18:25:12.119 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2021-04-09T18:25:12.119 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2021-04-09T18:25:12.120 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.120 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2021-04-09T18:25:12.120 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2021-04-09T18:25:12.120 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.120 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2021-04-09T18:25:12.121 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.121 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2021-04-09T18:25:12.121 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.121 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2021-04-09T18:25:12.121 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.122 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2021-04-09T18:25:12.122 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2021-04-09T18:25:12.122 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.122 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2021-04-09T18:25:12.123 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2021-04-09T18:25:12.123 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2021-04-09T18:25:12.123 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2021-04-09T18:25:12.123 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 20 2021-04-09T18:25:12.123 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 20 2021-04-09T18:25:12.124 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2021-04-09T18:25:12.124 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2021-04-09T18:25:12.124 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 10 2021-04-09T18:25:12.124 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2021-04-09T18:25:12.125 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2021-04-09T18:25:12.125 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2021-04-09T18:25:12.125 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2021-04-09T18:25:12.125 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2021-04-09T18:25:12.125 INFO:teuthology.orchestra.run.smithi090.stdout: osd op complaint time = 180 2021-04-09T18:25:12.126 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.126 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2021-04-09T18:25:12.126 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2021-04-09T18:25:12.126 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2021-04-09T18:25:12.127 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2021-04-09T18:25:12.127 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2021-04-09T18:25:12.127 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:25:12.127 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:25:12.127 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.128 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2021-04-09T18:25:12.128 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2021-04-09T18:25:12.128 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2021-04-09T18:25:12.128 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2021-04-09T18:25:12.128 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2021-04-09T18:25:12.129 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2021-04-09T18:25:12.129 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2021-04-09T18:25:12.129 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:25:12.129 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2021-04-09T18:25:12.130 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2021-04-09T18:25:12.130 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:25:12.130 INFO:teuthology.orchestra.run.smithi090.stdout: mon op complaint time = 120 2021-04-09T18:25:12.130 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:25:12.130 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2021-04-09T18:25:12.131 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2021-04-09T18:25:12.131 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2021-04-09T18:25:12.131 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2021-04-09T18:25:12.131 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-04-09T18:25:12.132 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-04-09T18:25:12.132 INFO:teuthology.orchestra.run.smithi090.stdout: client mount timeout = 600 2021-04-09T18:25:12.132 INFO:teuthology.orchestra.run.smithi090.stdout: debug client = 20 2021-04-09T18:25:12.132 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2021-04-09T18:25:12.132 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2021-04-09T18:25:12.133 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2021-04-09T18:25:12.133 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2021-04-09T18:25:12.133 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2021-04-09T18:25:12.133 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2021-04-09T18:25:12.133 INFO:teuthology.orchestra.run.smithi090.stdout:[mds] 2021-04-09T18:25:12.134 INFO:teuthology.orchestra.run.smithi090.stdout: debug mds = 20 2021-04-09T18:25:12.134 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2021-04-09T18:25:12.134 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal frag = True 2021-04-09T18:25:12.134 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal fragment size max = 10000 2021-04-09T18:25:12.135 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal merge size = 5 2021-04-09T18:25:12.135 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal split bits = 3 2021-04-09T18:25:12.135 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal split size = 100 2021-04-09T18:25:12.135 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug frag = True 2021-04-09T18:25:12.135 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug scatterstat = True 2021-04-09T18:25:12.136 INFO:teuthology.orchestra.run.smithi090.stdout: mds op complaint time = 180 2021-04-09T18:25:12.136 INFO:teuthology.orchestra.run.smithi090.stdout: mds verify scatter = True 2021-04-09T18:25:12.136 INFO:teuthology.orchestra.run.smithi090.stdout: osd op complaint time = 180 2021-04-09T18:25:12.136 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2021-04-09T18:25:12.137 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2021-04-09T18:25:12.137 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-04-09T18:25:12.137 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2021-04-09T18:25:12.137 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.138 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2021-04-09T18:25:12.138 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.138 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2021-04-09T18:25:12.138 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.138 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2021-04-09T18:25:12.139 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2021-04-09T18:25:12.139 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.139 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2021-04-09T18:25:12.139 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2021-04-09T18:25:12.140 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.140 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2021-04-09T18:25:12.140 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2021-04-09T18:25:12.140 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.141 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2021-04-09T18:25:12.141 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.141 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2021-04-09T18:25:12.141 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2021-04-09T18:25:12.141 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2021-04-09T18:25:12.142 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2021-04-09T18:25:12.142 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2021-04-09T18:25:12.142 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2021-04-09T18:25:12.142 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2021-04-09T18:25:12.143 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-04-09T18:25:12.143 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2021-04-09T18:25:12.143 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.143 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-04-09T18:25:12.143 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.144 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2021-04-09T18:25:12.144 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.144 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2021-04-09T18:25:12.144 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.145 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2021-04-09T18:25:12.145 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2021-04-09T18:25:12.145 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2021-04-09T18:25:12.145 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.146 INFO:teuthology.orchestra.run.smithi079.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-04-09T18:25:12.146 INFO:teuthology.orchestra.run.smithi079.stdout: mon_client_directed_command_retry = 4 2021-04-09T18:25:12.146 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.79,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2021-04-09T18:25:12.146 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = fc927781-121d-4817-b30c-0c6f9e107f84 2021-04-09T18:25:12.146 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.147 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2021-04-09T18:25:12.147 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2021-04-09T18:25:12.147 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.147 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2021-04-09T18:25:12.148 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2021-04-09T18:25:12.148 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.148 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2021-04-09T18:25:12.148 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2021-04-09T18:25:12.149 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.149 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2021-04-09T18:25:12.149 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2021-04-09T18:25:12.149 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2021-04-09T18:25:12.149 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.150 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2021-04-09T18:25:12.150 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2021-04-09T18:25:12.150 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.150 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2021-04-09T18:25:12.151 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.151 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2021-04-09T18:25:12.151 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.151 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2021-04-09T18:25:12.152 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.152 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2021-04-09T18:25:12.152 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2021-04-09T18:25:12.152 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.152 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2021-04-09T18:25:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2021-04-09T18:25:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2021-04-09T18:25:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2021-04-09T18:25:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 20 2021-04-09T18:25:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 20 2021-04-09T18:25:12.154 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2021-04-09T18:25:12.154 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2021-04-09T18:25:12.154 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 10 2021-04-09T18:25:12.154 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2021-04-09T18:25:12.154 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2021-04-09T18:25:12.155 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2021-04-09T18:25:12.155 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2021-04-09T18:25:12.155 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2021-04-09T18:25:12.155 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2021-04-09T18:25:12.156 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.156 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2021-04-09T18:25:12.156 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2021-04-09T18:25:12.156 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2021-04-09T18:25:12.156 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2021-04-09T18:25:12.157 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2021-04-09T18:25:12.157 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:25:12.157 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:25:12.157 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.157 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2021-04-09T18:25:12.158 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2021-04-09T18:25:12.158 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2021-04-09T18:25:12.158 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2021-04-09T18:25:12.158 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2021-04-09T18:25:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2021-04-09T18:25:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2021-04-09T18:25:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:25:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2021-04-09T18:25:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2021-04-09T18:25:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:25:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: mon op complaint time = 120 2021-04-09T18:25:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:25:12.160 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2021-04-09T18:25:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2021-04-09T18:25:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2021-04-09T18:25:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2021-04-09T18:25:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-04-09T18:25:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-04-09T18:25:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: client mount timeout = 600 2021-04-09T18:25:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2021-04-09T18:25:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2021-04-09T18:25:12.162 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2021-04-09T18:25:12.163 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2021-04-09T18:25:12.163 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2021-04-09T18:25:12.163 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2021-04-09T18:25:12.163 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2021-04-09T18:25:12.163 INFO:teuthology.orchestra.run.smithi079.stdout:[mds] 2021-04-09T18:25:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds = 20 2021-04-09T18:25:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2021-04-09T18:25:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: mds bal frag = True 2021-04-09T18:25:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: mds bal fragment size max = 10000 2021-04-09T18:25:12.165 INFO:teuthology.orchestra.run.smithi079.stdout: mds bal merge size = 5 2021-04-09T18:25:12.165 INFO:teuthology.orchestra.run.smithi079.stdout: mds bal split bits = 3 2021-04-09T18:25:12.165 INFO:teuthology.orchestra.run.smithi079.stdout: mds bal split size = 100 2021-04-09T18:25:12.165 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug frag = True 2021-04-09T18:25:12.166 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug scatterstat = True 2021-04-09T18:25:12.166 INFO:teuthology.orchestra.run.smithi079.stdout: mds op complaint time = 180 2021-04-09T18:25:12.166 INFO:teuthology.orchestra.run.smithi079.stdout: mds verify scatter = True 2021-04-09T18:25:12.166 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2021-04-09T18:25:12.167 INFO:tasks.ceph:Creating admin key on mon.a... 2021-04-09T18:25:12.167 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2021-04-09T18:25:12.213 INFO:tasks.ceph:Copying monmap to all nodes... 2021-04-09T18:25:12.264 DEBUG:teuthology.orchestra.remote:smithi079:/etc/ceph/ceph.keyring is 206B 2021-04-09T18:25:12.283 DEBUG:teuthology.orchestra.remote:smithi079:/home/ubuntu/cephtest/ceph.monmap is 373B 2021-04-09T18:25:12.292 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi079.front.sepia.ceph.com 2021-04-09T18:25:12.293 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2021-04-09T18:25:12.293 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.keyring 2021-04-09T18:25:12.293 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-04-09T18:25:12.318 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2021-04-09T18:25:12.319 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:25:12.366 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2021-04-09T18:25:12.366 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2021-04-09T18:25:12.367 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2021-04-09T18:25:12.367 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-04-09T18:25:12.392 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2021-04-09T18:25:12.392 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:25:12.442 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi090.front.sepia.ceph.com 2021-04-09T18:25:12.442 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2021-04-09T18:25:12.443 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/ceph/ceph.keyring 2021-04-09T18:25:12.443 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-04-09T18:25:12.469 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2021-04-09T18:25:12.469 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:25:12.520 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi136.front.sepia.ceph.com 2021-04-09T18:25:12.520 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2021-04-09T18:25:12.521 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.keyring 2021-04-09T18:25:12.521 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-04-09T18:25:12.546 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2021-04-09T18:25:12.547 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:25:12.593 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi144.front.sepia.ceph.com 2021-04-09T18:25:12.594 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2021-04-09T18:25:12.594 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.keyring 2021-04-09T18:25:12.595 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-04-09T18:25:12.622 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2021-04-09T18:25:12.623 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:25:12.671 INFO:tasks.ceph:Setting up mon nodes... 2021-04-09T18:25:12.671 INFO:tasks.ceph:Setting up mgr nodes... 2021-04-09T18:25:12.672 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2021-04-09T18:25:12.713 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2021-04-09T18:25:12.716 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2021-04-09T18:25:12.794 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2021-04-09T18:25:12.797 INFO:tasks.ceph:Setting up mds nodes... 2021-04-09T18:25:12.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2021-04-09T18:25:12.840 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2021-04-09T18:25:12.843 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2021-04-09T18:25:12.900 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2021-04-09T18:25:12.940 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2021-04-09T18:25:12.944 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2021-04-09T18:25:13.003 INFO:tasks.ceph_client:Setting up client nodes... 2021-04-09T18:25:13.004 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-04-09T18:25:13.127 INFO:teuthology.orchestra.run.smithi090.stdout:creating /etc/ceph/ceph.client.0.keyring 2021-04-09T18:25:13.137 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-04-09T18:25:13.223 INFO:teuthology.orchestra.run.smithi136.stdout:creating /etc/ceph/ceph.client.1.keyring 2021-04-09T18:25:13.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2021-04-09T18:25:13.319 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.client.2.keyring 2021-04-09T18:25:13.332 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-04-09T18:25:13.333 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-04-09T18:25:13.333 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2021-04-09T18:25:13.348 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-04-09T18:25:13.348 INFO:tasks.ceph:role: osd.0 2021-04-09T18:25:13.349 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com 2021-04-09T18:25:13.349 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-04-09T18:25:13.874 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-04-09T18:25:13.874 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2021-04-09T18:25:13.874 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-04-09T18:25:13.875 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-04-09T18:25:13.875 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2021-04-09T18:25:13.875 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-04-09T18:25:13.875 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-04-09T18:25:13.876 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-04-09T18:25:13.876 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-04-09T18:25:13.877 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2021-04-09T18:25:13.877 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2021-04-09T18:25:13.956 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2021-04-09T18:25:13.968 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2021-04-09T18:25:13.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:25:13.969 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2021-04-09T18:25:14.027 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-04-09T18:25:14.028 INFO:tasks.ceph:role: osd.1 2021-04-09T18:25:14.028 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com 2021-04-09T18:25:14.028 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-04-09T18:25:14.545 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-04-09T18:25:14.545 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2021-04-09T18:25:14.546 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-04-09T18:25:14.546 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-04-09T18:25:14.546 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2021-04-09T18:25:14.546 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-04-09T18:25:14.547 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-04-09T18:25:14.547 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-04-09T18:25:14.547 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-04-09T18:25:14.548 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2021-04-09T18:25:14.549 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2021-04-09T18:25:14.615 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2021-04-09T18:25:14.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:25:14.626 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2021-04-09T18:25:14.626 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2021-04-09T18:25:14.683 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-04-09T18:25:14.684 INFO:tasks.ceph:role: osd.2 2021-04-09T18:25:14.684 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com 2021-04-09T18:25:14.684 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-04-09T18:25:15.173 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-04-09T18:25:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2021-04-09T18:25:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-04-09T18:25:15.174 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-04-09T18:25:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2021-04-09T18:25:15.174 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-04-09T18:25:15.175 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-04-09T18:25:15.175 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-04-09T18:25:15.175 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-04-09T18:25:15.176 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2021-04-09T18:25:15.176 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2021-04-09T18:25:15.223 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2021-04-09T18:25:15.234 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2021-04-09T18:25:15.235 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:25:15.236 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2021-04-09T18:25:15.290 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-04-09T18:25:15.291 INFO:tasks.ceph:role: osd.3 2021-04-09T18:25:15.291 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com 2021-04-09T18:25:15.291 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-04-09T18:25:15.819 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-04-09T18:25:15.819 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2021-04-09T18:25:15.820 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-04-09T18:25:15.820 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-04-09T18:25:15.820 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2021-04-09T18:25:15.820 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-04-09T18:25:15.820 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-04-09T18:25:15.821 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-04-09T18:25:15.821 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-04-09T18:25:15.822 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2021-04-09T18:25:15.822 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2021-04-09T18:25:15.872 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2021-04-09T18:25:15.880 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2021-04-09T18:25:15.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:25:15.882 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:25:15.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:15.987 7fef18943c00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2021-04-09T18:25:15.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:15.987 7fef18943c00 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2021-04-09T18:25:15.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:15.987 7fef18943c00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-04-09T18:25:15.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:15.987 7fef18943c00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-04-09T18:25:15.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:15.987 7fef18943c00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-04-09T18:25:15.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:15.995 7fef18943c00 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2021-04-09T18:25:18.931 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-04-09T18:25:18.948 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:25:19.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:19.027 7f90bd3f1c00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2021-04-09T18:25:19.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:19.027 7f90bd3f1c00 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2021-04-09T18:25:19.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:19.027 7f90bd3f1c00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-04-09T18:25:19.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:19.027 7f90bd3f1c00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-04-09T18:25:19.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:19.027 7f90bd3f1c00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-04-09T18:25:19.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:19.027 7f90bd3f1c00 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2021-04-09T18:25:21.981 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-04-09T18:25:22.040 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:25:22.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:22.123 7f51524e1c00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2021-04-09T18:25:22.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:22.123 7f51524e1c00 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2021-04-09T18:25:22.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:22.123 7f51524e1c00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-04-09T18:25:22.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:22.123 7f51524e1c00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-04-09T18:25:22.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:22.123 7f51524e1c00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-04-09T18:25:22.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:22.123 7f51524e1c00 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2021-04-09T18:25:25.058 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-04-09T18:25:25.115 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:25:25.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:25.191 7fca4c9ecc00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2021-04-09T18:25:25.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:25.191 7fca4c9ecc00 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2021-04-09T18:25:25.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:25.191 7fca4c9ecc00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-04-09T18:25:25.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:25.191 7fca4c9ecc00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-04-09T18:25:25.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:25.191 7fca4c9ecc00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-04-09T18:25:25.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:25.195 7fca4c9ecc00 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2021-04-09T18:25:28.158 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-04-09T18:25:28.215 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2021-04-09T18:25:28.230 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-04-09T18:25:28.231 INFO:tasks.ceph:role: osd.4 2021-04-09T18:25:28.231 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com 2021-04-09T18:25:28.232 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-04-09T18:25:28.753 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-04-09T18:25:28.754 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2021-04-09T18:25:28.754 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-04-09T18:25:28.754 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-04-09T18:25:28.754 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2021-04-09T18:25:28.755 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-04-09T18:25:28.755 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-04-09T18:25:28.755 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-04-09T18:25:28.755 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-04-09T18:25:28.756 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2021-04-09T18:25:28.757 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2021-04-09T18:25:28.829 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2021-04-09T18:25:28.839 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: /sbin/restorecon: command not found 2021-04-09T18:25:28.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:25:28.840 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2021-04-09T18:25:28.898 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-04-09T18:25:28.898 INFO:tasks.ceph:role: osd.5 2021-04-09T18:25:28.898 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com 2021-04-09T18:25:28.899 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-04-09T18:25:29.416 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-04-09T18:25:29.416 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2021-04-09T18:25:29.416 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-04-09T18:25:29.417 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-04-09T18:25:29.417 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2021-04-09T18:25:29.417 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-04-09T18:25:29.417 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-04-09T18:25:29.418 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-04-09T18:25:29.418 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-04-09T18:25:29.419 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2021-04-09T18:25:29.419 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2021-04-09T18:25:29.478 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2021-04-09T18:25:29.490 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: /sbin/restorecon: command not found 2021-04-09T18:25:29.491 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:25:29.492 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2021-04-09T18:25:29.549 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-04-09T18:25:29.550 INFO:tasks.ceph:role: osd.6 2021-04-09T18:25:29.551 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com 2021-04-09T18:25:29.551 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-04-09T18:25:30.046 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-04-09T18:25:30.046 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2021-04-09T18:25:30.046 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-04-09T18:25:30.047 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-04-09T18:25:30.047 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2021-04-09T18:25:30.047 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-04-09T18:25:30.047 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-04-09T18:25:30.047 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-04-09T18:25:30.048 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-04-09T18:25:30.049 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2021-04-09T18:25:30.049 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2021-04-09T18:25:30.094 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2021-04-09T18:25:30.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:25:30.143 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: /sbin/restorecon: command not found 2021-04-09T18:25:30.143 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2021-04-09T18:25:30.198 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-04-09T18:25:30.199 INFO:tasks.ceph:role: osd.7 2021-04-09T18:25:30.200 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com 2021-04-09T18:25:30.200 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-04-09T18:25:30.724 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-04-09T18:25:30.724 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2021-04-09T18:25:30.724 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-04-09T18:25:30.725 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-04-09T18:25:30.725 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2021-04-09T18:25:30.725 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-04-09T18:25:30.726 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-04-09T18:25:30.726 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-04-09T18:25:30.726 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-04-09T18:25:30.727 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2021-04-09T18:25:30.728 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2021-04-09T18:25:30.786 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2021-04-09T18:25:30.798 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: /sbin/restorecon: command not found 2021-04-09T18:25:30.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:25:30.799 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:25:30.908 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:30.905 7f660aca4c00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2021-04-09T18:25:30.910 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:30.905 7f660aca4c00 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2021-04-09T18:25:30.910 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:30.905 7f660aca4c00 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-04-09T18:25:30.910 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:30.905 7f660aca4c00 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-04-09T18:25:30.910 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:30.905 7f660aca4c00 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-04-09T18:25:30.917 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:30.913 7f660aca4c00 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2021-04-09T18:25:33.879 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-04-09T18:25:33.895 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:25:33.981 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:33.977 7f3f27219c00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2021-04-09T18:25:33.981 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:33.977 7f3f27219c00 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2021-04-09T18:25:33.982 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:33.977 7f3f27219c00 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-04-09T18:25:33.982 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:33.977 7f3f27219c00 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-04-09T18:25:33.982 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:33.977 7f3f27219c00 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-04-09T18:25:33.982 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:33.977 7f3f27219c00 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2021-04-09T18:25:36.922 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-04-09T18:25:36.979 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:25:37.058 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:37.053 7fc4e03b7c00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2021-04-09T18:25:37.059 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:37.053 7fc4e03b7c00 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2021-04-09T18:25:37.059 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:37.053 7fc4e03b7c00 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-04-09T18:25:37.059 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:37.053 7fc4e03b7c00 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-04-09T18:25:37.060 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:37.053 7fc4e03b7c00 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-04-09T18:25:37.060 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:37.057 7fc4e03b7c00 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2021-04-09T18:25:40.003 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-04-09T18:25:40.060 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:25:40.145 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:40.141 7fdc7b13bc00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2021-04-09T18:25:40.146 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:40.141 7fdc7b13bc00 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2021-04-09T18:25:40.146 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:40.141 7fdc7b13bc00 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-04-09T18:25:40.147 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:40.141 7fdc7b13bc00 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-04-09T18:25:40.147 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:40.141 7fdc7b13bc00 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-04-09T18:25:40.148 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:40.141 7fdc7b13bc00 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2021-04-09T18:25:41.045 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:25:41.048 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:25:41.050 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:25:41.053 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:25:41.056 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:25:43.091 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-04-09T18:25:43.107 INFO:tasks.ceph:Reading keys from all nodes... 2021-04-09T18:25:43.108 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2021-04-09T18:25:43.114 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.kk65xWRABi 2021-04-09T18:25:43.115 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.kk65xWRABi 2021-04-09T18:25:43.170 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.kk65xWRABi 2021-04-09T18:25:43.276 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.kk65xWRABi is 56B 2021-04-09T18:25:43.329 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.kk65xWRABi 2021-04-09T18:25:43.336 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2021-04-09T18:25:43.385 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.3NZFaL16jF 2021-04-09T18:25:43.385 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.3NZFaL16jF 2021-04-09T18:25:43.442 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.3NZFaL16jF 2021-04-09T18:25:43.547 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.3NZFaL16jF is 56B 2021-04-09T18:25:43.559 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.3NZFaL16jF 2021-04-09T18:25:43.566 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2021-04-09T18:25:43.613 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.IioCrotTPW 2021-04-09T18:25:43.614 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.IioCrotTPW 2021-04-09T18:25:43.670 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.IioCrotTPW 2021-04-09T18:25:43.775 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.IioCrotTPW is 56B 2021-04-09T18:25:43.787 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.IioCrotTPW 2021-04-09T18:25:43.795 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2021-04-09T18:25:43.841 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.qz5K4Q9AdF 2021-04-09T18:25:43.842 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.qz5K4Q9AdF 2021-04-09T18:25:43.899 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.qz5K4Q9AdF 2021-04-09T18:25:44.008 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.qz5K4Q9AdF is 56B 2021-04-09T18:25:44.061 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.qz5K4Q9AdF 2021-04-09T18:25:44.068 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2021-04-09T18:25:44.117 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.qeCuPIOgkO 2021-04-09T18:25:44.117 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.qeCuPIOgkO 2021-04-09T18:25:44.174 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.qeCuPIOgkO 2021-04-09T18:25:44.279 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.qeCuPIOgkO is 56B 2021-04-09T18:25:44.291 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.qeCuPIOgkO 2021-04-09T18:25:44.297 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2021-04-09T18:25:44.345 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.ytC4Agru6D 2021-04-09T18:25:44.346 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.ytC4Agru6D 2021-04-09T18:25:44.404 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.ytC4Agru6D 2021-04-09T18:25:44.511 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.ytC4Agru6D is 56B 2021-04-09T18:25:44.523 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.ytC4Agru6D 2021-04-09T18:25:44.529 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2021-04-09T18:25:44.536 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.X9mItRbZhb 2021-04-09T18:25:44.536 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.X9mItRbZhb 2021-04-09T18:25:44.595 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.X9mItRbZhb 2021-04-09T18:25:44.703 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.X9mItRbZhb is 56B 2021-04-09T18:25:44.714 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.X9mItRbZhb 2021-04-09T18:25:44.721 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2021-04-09T18:25:44.773 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.xggmiRuA2V 2021-04-09T18:25:44.773 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.xggmiRuA2V 2021-04-09T18:25:44.830 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.xggmiRuA2V 2021-04-09T18:25:44.940 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.xggmiRuA2V is 56B 2021-04-09T18:25:44.994 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.xggmiRuA2V 2021-04-09T18:25:45.001 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2021-04-09T18:25:45.050 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.gl1f0hJN2v 2021-04-09T18:25:45.050 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.gl1f0hJN2v 2021-04-09T18:25:45.109 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.gl1f0hJN2v 2021-04-09T18:25:45.218 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.gl1f0hJN2v is 56B 2021-04-09T18:25:45.269 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.gl1f0hJN2v 2021-04-09T18:25:45.277 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2021-04-09T18:25:45.325 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.PvmN0RqQDx 2021-04-09T18:25:45.325 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.PvmN0RqQDx 2021-04-09T18:25:45.382 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.PvmN0RqQDx 2021-04-09T18:25:45.487 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.PvmN0RqQDx is 56B 2021-04-09T18:25:45.498 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.PvmN0RqQDx 2021-04-09T18:25:45.505 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2021-04-09T18:25:45.553 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.t8UJH2yny8 2021-04-09T18:25:45.554 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.t8UJH2yny8 2021-04-09T18:25:45.610 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.t8UJH2yny8 2021-04-09T18:25:45.715 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.t8UJH2yny8 is 56B 2021-04-09T18:25:45.727 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.t8UJH2yny8 2021-04-09T18:25:45.734 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2021-04-09T18:25:45.781 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.VvInFHVNEJ 2021-04-09T18:25:45.781 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.VvInFHVNEJ 2021-04-09T18:25:45.838 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.VvInFHVNEJ 2021-04-09T18:25:45.947 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.VvInFHVNEJ is 56B 2021-04-09T18:25:45.959 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.VvInFHVNEJ 2021-04-09T18:25:45.973 DEBUG:teuthology.orchestra.remote:smithi090:/etc/ceph/ceph.client.0.keyring is 59B 2021-04-09T18:25:45.993 DEBUG:teuthology.orchestra.remote:smithi136:/etc/ceph/ceph.client.1.keyring is 59B 2021-04-09T18:25:46.015 DEBUG:teuthology.orchestra.remote:smithi144:/etc/ceph/ceph.client.2.keyring is 59B 2021-04-09T18:25:46.026 INFO:tasks.ceph:Adding keys to all mons... 2021-04-09T18:25:46.027 DEBUG:teuthology.orchestra.run.smithi079:> sudo tee -a /etc/ceph/ceph.keyring 2021-04-09T18:25:46.029 DEBUG:teuthology.orchestra.run.smithi089:> sudo tee -a /etc/ceph/ceph.keyring 2021-04-09T18:25:46.040 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.y] 2021-04-09T18:25:46.041 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAInHBgNCCXKhAA/bKOzzjVHldj6RpMGu0c8g== 2021-04-09T18:25:46.041 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2021-04-09T18:25:46.041 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAInHBgovEoMhAAbDfArG3lSFAdk80rS/4iEQ== 2021-04-09T18:25:46.042 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.0] 2021-04-09T18:25:46.042 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQALnHBgro0COxAAgbe5jxAZH9bD7zDLbtdkhQ== 2021-04-09T18:25:46.042 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.1] 2021-04-09T18:25:46.042 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAPnHBghZ/oARAAhkN+fnZJiskmHnvvs+G8NA== 2021-04-09T18:25:46.043 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.2] 2021-04-09T18:25:46.043 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQASnHBgWT2FBxAACrSTbwbF18k9aPeYNohelw== 2021-04-09T18:25:46.043 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.3] 2021-04-09T18:25:46.043 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAVnHBgPHy6CxAAFq+yki4AZe5ybodgTO/4/Q== 2021-04-09T18:25:46.043 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.x] 2021-04-09T18:25:46.044 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAInHBgmHJhLxAAyhBrx08J7ZFKu34MYC2Wyg== 2021-04-09T18:25:46.044 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2021-04-09T18:25:46.044 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAInHBgN4sfOBAAPjvDX11uLM+vgdFpdP49Kw== 2021-04-09T18:25:46.044 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.4] 2021-04-09T18:25:46.045 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAanHBgfbs4NhAAQzxM9dDML4RgQP8yamkuVw== 2021-04-09T18:25:46.045 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.5] 2021-04-09T18:25:46.045 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAdnHBgi0WLOhAA4OBguOCjtmzqulUjTJ+GhQ== 2021-04-09T18:25:46.045 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.6] 2021-04-09T18:25:46.046 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAhnHBgCs+PAxAAOm0wSMe/1Bu9vfTrpmrLkg== 2021-04-09T18:25:46.046 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.7] 2021-04-09T18:25:46.046 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAknHBgH1S3CBAAUcdUIW7O6wH482l1yZBKBw== 2021-04-09T18:25:46.046 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2021-04-09T18:25:46.047 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAJnHBgxEq9BxAAap2nrjhcrf2aHzygtMclVw== 2021-04-09T18:25:46.047 INFO:teuthology.orchestra.run.smithi079.stdout:[client.1] 2021-04-09T18:25:46.047 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAJnHBguJFeDRAAWL4NV4tsYRAqcwJ26kjm2Q== 2021-04-09T18:25:46.047 INFO:teuthology.orchestra.run.smithi079.stdout:[client.2] 2021-04-09T18:25:46.047 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAJnHBgN9X5EhAA3DBPdlRHVBHXJNH9nRFW0A== 2021-04-09T18:25:46.049 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.y] 2021-04-09T18:25:46.049 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAInHBgNCCXKhAA/bKOzzjVHldj6RpMGu0c8g== 2021-04-09T18:25:46.050 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2021-04-09T18:25:46.050 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAInHBgovEoMhAAbDfArG3lSFAdk80rS/4iEQ== 2021-04-09T18:25:46.050 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.0] 2021-04-09T18:25:46.050 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQALnHBgro0COxAAgbe5jxAZH9bD7zDLbtdkhQ== 2021-04-09T18:25:46.051 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.1] 2021-04-09T18:25:46.051 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAPnHBghZ/oARAAhkN+fnZJiskmHnvvs+G8NA== 2021-04-09T18:25:46.051 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.2] 2021-04-09T18:25:46.051 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQASnHBgWT2FBxAACrSTbwbF18k9aPeYNohelw== 2021-04-09T18:25:46.051 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.3] 2021-04-09T18:25:46.052 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAVnHBgPHy6CxAAFq+yki4AZe5ybodgTO/4/Q== 2021-04-09T18:25:46.052 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.x] 2021-04-09T18:25:46.052 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAInHBgmHJhLxAAyhBrx08J7ZFKu34MYC2Wyg== 2021-04-09T18:25:46.052 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2021-04-09T18:25:46.053 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAInHBgN4sfOBAAPjvDX11uLM+vgdFpdP49Kw== 2021-04-09T18:25:46.053 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.4] 2021-04-09T18:25:46.053 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAanHBgfbs4NhAAQzxM9dDML4RgQP8yamkuVw== 2021-04-09T18:25:46.053 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.5] 2021-04-09T18:25:46.053 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAdnHBgi0WLOhAA4OBguOCjtmzqulUjTJ+GhQ== 2021-04-09T18:25:46.054 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.6] 2021-04-09T18:25:46.054 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAhnHBgCs+PAxAAOm0wSMe/1Bu9vfTrpmrLkg== 2021-04-09T18:25:46.054 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.7] 2021-04-09T18:25:46.054 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAknHBgH1S3CBAAUcdUIW7O6wH482l1yZBKBw== 2021-04-09T18:25:46.055 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2021-04-09T18:25:46.055 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAJnHBgxEq9BxAAap2nrjhcrf2aHzygtMclVw== 2021-04-09T18:25:46.055 INFO:teuthology.orchestra.run.smithi089.stdout:[client.1] 2021-04-09T18:25:46.055 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAJnHBguJFeDRAAWL4NV4tsYRAqcwJ26kjm2Q== 2021-04-09T18:25:46.056 INFO:teuthology.orchestra.run.smithi089.stdout:[client.2] 2021-04-09T18:25:46.056 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAJnHBgN9X5EhAA3DBPdlRHVBHXJNH9nRFW0A== 2021-04-09T18:25:46.056 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-04-09T18:25:46.094 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-04-09T18:25:46.136 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-04-09T18:25:46.178 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-04-09T18:25:46.228 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:25:46.230 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:25:46.307 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:25:46.314 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:25:46.393 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:25:46.398 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:25:46.476 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:25:46.482 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:25:46.561 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-04-09T18:25:46.563 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-04-09T18:25:46.645 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-04-09T18:25:46.647 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-04-09T18:25:46.733 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:25:46.735 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:25:46.776 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:25:46.818 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:25:46.860 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:25:46.907 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:25:46.948 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:25:46.991 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:25:47.034 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-04-09T18:25:47.083 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-04-09T18:25:47.127 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-04-09T18:25:47.171 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-04-09T18:25:47.216 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-04-09T18:25:47.255 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-04-09T18:25:47.299 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-04-09T18:25:47.299 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2021-04-09T18:25:47.312 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-04-09T18:25:47.412 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2021-04-09T18:25:47.425 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2021-04-09T18:25:47.440 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-04-09T18:25:47.539 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2021-04-09T18:25:47.553 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2021-04-09T18:25:47.609 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-04-09T18:25:47.706 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2021-04-09T18:25:47.721 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:25:47.723 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:25:47.773 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2021-04-09T18:25:47.774 INFO:tasks.ceph.mon.a:Restarting daemon 2021-04-09T18:25:47.775 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2021-04-09T18:25:47.778 INFO:tasks.ceph.mon.a:Started 2021-04-09T18:25:47.779 INFO:tasks.ceph.mon.b:Restarting daemon 2021-04-09T18:25:47.779 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-04-09T18:25:47.821 INFO:tasks.ceph.mon.b:Started 2021-04-09T18:25:47.822 INFO:tasks.ceph.mon.c:Restarting daemon 2021-04-09T18:25:47.823 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-04-09T18:25:47.826 INFO:tasks.ceph.mon.c:Started 2021-04-09T18:25:47.826 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2021-04-09T18:25:47.827 INFO:tasks.ceph.mgr.y:Restarting daemon 2021-04-09T18:25:47.828 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2021-04-09T18:25:47.831 INFO:tasks.ceph.mgr.y:Started 2021-04-09T18:25:47.832 INFO:tasks.ceph.mgr.x:Restarting daemon 2021-04-09T18:25:47.832 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2021-04-09T18:25:47.836 INFO:tasks.ceph.mgr.x:Started 2021-04-09T18:25:47.836 INFO:tasks.ceph:Setting crush tunables to default 2021-04-09T18:25:47.837 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd crush tunables default 2021-04-09T18:25:53.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:47.969 7f2a3f2c8700 1 Processor -- start 2021-04-09T18:25:53.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:47.969 7f2a3f2c8700 1 -- start start 2021-04-09T18:25:53.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:47.973 7f2a3f2c8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 0x7f2a380f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:53.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:47.973 7f2a3f2c8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 0x7f2a381ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:53.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:47.973 7f2a3f2c8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a380fbb10 con 0x7f2a380e9ad0 2021-04-09T18:25:53.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:47.973 7f2a3f2c8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a380e9f20 con 0x7f2a381c8000 2021-04-09T18:25:53.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:47.973 7f2a3f2c8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a381c3db0 con 0x7f2a380f5510 2021-04-09T18:25:53.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:47.973 7f2a3d86d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 0x7f2a381ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:47.973 7f2a3d86d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 0x7f2a381ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54972/0 (socket says 172.21.15.79:54972) 2021-04-09T18:25:53.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:47.973 7f2a3d86d700 1 -- 172.21.15.79:0/2689236576 learned_addr learned my addr 172.21.15.79:0/2689236576 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:25:53.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:47.973 7f2a3d86d700 1 -- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 msgr2=0x7f2a381ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-04-09T18:25:53.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:47.973 7f2a3d86d700 1 -- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 msgr2=0x7f2a381ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:25:53.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:47.973 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 0x7f2a381ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:25:53.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:47.973 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 0x7f2a380f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:47.973 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 0x7f2a381ca460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-04-09T18:25:53.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:47.973 7f2a3d06c700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 msgr2=0x7f2a380f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-04-09T18:25:53.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:47.973 7f2a3d06c700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 msgr2=0x7f2a380f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:25:53.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:47.973 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 0x7f2a380f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:25:53.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:47.973 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 0x7f2a380f64a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-04-09T18:25:53.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:48.177 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 0x7f2a381ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:48.177 7f2a3d86d700 1 -- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 msgr2=0x7f2a381ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-04-09T18:25:53.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:48.177 7f2a3d86d700 1 -- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 msgr2=0x7f2a381ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:25:53.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:48.177 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 0x7f2a381ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:25:53.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:48.177 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 0x7f2a380f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:48.177 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 0x7f2a381ca460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-04-09T18:25:53.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:48.177 7f2a3d06c700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 msgr2=0x7f2a380f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-04-09T18:25:53.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:48.177 7f2a3d06c700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 msgr2=0x7f2a380f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:25:53.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:48.177 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 0x7f2a380f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:25:53.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:48.177 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 0x7f2a380f64a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-04-09T18:25:53.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:48.581 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 0x7f2a381ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:48.581 7f2a3d86d700 1 -- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 msgr2=0x7f2a381ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-04-09T18:25:53.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:48.581 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 0x7f2a380f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:48.581 7f2a3d86d700 1 -- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 msgr2=0x7f2a381ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:25:53.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:48.581 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 0x7f2a381ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:25:53.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:48.581 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 0x7f2a381ca460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-04-09T18:25:53.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:48.581 7f2a3d06c700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 msgr2=0x7f2a380f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-04-09T18:25:53.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:48.581 7f2a3d06c700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 msgr2=0x7f2a380f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:25:53.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:48.581 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 0x7f2a380f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:25:53.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:48.581 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 0x7f2a380f64a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-04-09T18:25:53.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:49.384 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 0x7f2a381ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:49.384 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 0x7f2a380f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:49.384 7f2a3d86d700 1 -- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 msgr2=0x7f2a381ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-04-09T18:25:53.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:49.384 7f2a3d86d700 1 -- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 msgr2=0x7f2a381ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:25:53.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:49.384 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 0x7f2a381ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:25:53.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:49.384 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 0x7f2a381ca460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-04-09T18:25:53.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:49.384 7f2a3d06c700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 msgr2=0x7f2a380f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-04-09T18:25:53.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:49.384 7f2a3d06c700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 msgr2=0x7f2a380f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:25:53.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:49.384 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 0x7f2a380f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:25:53.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:49.384 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 0x7f2a380f64a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-04-09T18:25:53.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:50.971 7f2a2effd700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 msgr2=0x7f2a380f64a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-04-09T18:25:53.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:50.971 7f2a2effd700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a380f5510 0x7f2a380f64a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:53.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:50.971 7f2a2effd700 1 -- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 msgr2=0x7f2a381ca460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-04-09T18:25:53.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:50.971 7f2a2effd700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.79:3300/0 conn(0x7f2a381c8000 0x7f2a381ca460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:53.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:50.971 7f2a2effd700 1 -- 172.21.15.79:0/2689236576 >> v1:172.21.15.89:6789/0 conn(0x7f2a380e9ad0 legacy=0x7f2a3809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:53.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:50.971 7f2a2effd700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 0x7f2a1c0057c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:53.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:50.971 7f2a2effd700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 0x7f2a1c00c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:53.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:50.971 7f2a2effd700 1 -- 172.21.15.79:0/2689236576 --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a1c00ca10 con 0x7f2a1c005f70 2021-04-09T18:25:53.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:50.971 7f2a2effd700 1 -- 172.21.15.79:0/2689236576 --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a380e9f20 con 0x7f2a1c0032e0 2021-04-09T18:25:53.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:50.971 7f2a2effd700 1 -- 172.21.15.79:0/2689236576 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a381c3db0 con 0x7f2a1c009ea0 2021-04-09T18:25:53.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:50.971 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 0x7f2a1c0057c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:50.971 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 0x7f2a1c00c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:50.971 7f2a3d06c700 1 -- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 msgr2=0x7f2a1c0057c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-04-09T18:25:53.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:50.971 7f2a3d06c700 1 -- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 msgr2=0x7f2a1c0057c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:25:53.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:50.971 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 0x7f2a1c0057c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:25:53.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:50.971 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 0x7f2a1c0057c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-04-09T18:25:53.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:50.971 7f2a3d86d700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 msgr2=0x7f2a1c00c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-04-09T18:25:53.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:50.971 7f2a3d86d700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 msgr2=0x7f2a1c00c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:25:53.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:50.971 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 0x7f2a1c00c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:25:53.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:50.971 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 0x7f2a1c00c340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-04-09T18:25:53.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:51.175 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 0x7f2a1c0057c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:51.175 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 0x7f2a1c00c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:51.175 7f2a3d86d700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 msgr2=0x7f2a1c00c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-04-09T18:25:53.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:51.175 7f2a3d86d700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 msgr2=0x7f2a1c00c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:25:53.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:51.175 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 0x7f2a1c00c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:25:53.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:51.175 7f2a3d06c700 1 -- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 msgr2=0x7f2a1c0057c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-04-09T18:25:53.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:51.175 7f2a3d06c700 1 -- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 msgr2=0x7f2a1c0057c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:25:53.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:51.175 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 0x7f2a1c0057c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:25:53.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:51.175 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 0x7f2a1c00c340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-04-09T18:25:53.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:51.175 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 0x7f2a1c0057c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-04-09T18:25:53.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:51.579 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 0x7f2a1c0057c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:51.579 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 0x7f2a1c00c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:51.579 7f2a3d06c700 1 -- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 msgr2=0x7f2a1c0057c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-04-09T18:25:53.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:51.579 7f2a3d06c700 1 -- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 msgr2=0x7f2a1c0057c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:25:53.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:51.579 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 0x7f2a1c0057c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:25:53.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:51.579 7f2a3d86d700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 msgr2=0x7f2a1c00c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-04-09T18:25:53.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:51.579 7f2a3d86d700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 msgr2=0x7f2a1c00c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:25:53.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:51.579 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 0x7f2a1c0057c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-04-09T18:25:53.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:51.579 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 0x7f2a1c00c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:25:53.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:51.579 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 0x7f2a1c00c340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-04-09T18:25:53.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:52.383 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 0x7f2a1c00c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:52.383 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 0x7f2a1c0057c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:52.383 7f2a3d86d700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 msgr2=0x7f2a1c00c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-04-09T18:25:53.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:52.383 7f2a3d86d700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 msgr2=0x7f2a1c00c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:25:53.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:52.383 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 0x7f2a1c00c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:25:53.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:52.383 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 0x7f2a1c00c340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-04-09T18:25:53.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:52.383 7f2a3d06c700 1 -- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 msgr2=0x7f2a1c0057c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-04-09T18:25:53.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:52.383 7f2a3d06c700 1 -- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 msgr2=0x7f2a1c0057c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:25:53.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:52.383 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 0x7f2a1c0057c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:25:53.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:52.383 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 0x7f2a1c0057c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-04-09T18:25:53.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.162 7f2a2ffff700 1 -- 172.21.15.79:0/2689236576 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419424902 0 0) 0x7f2a280010d0 con 0x7f2a1c005f70 2021-04-09T18:25:53.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.162 7f2a2ffff700 1 -- 172.21.15.79:0/2689236576 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a24003240 con 0x7f2a1c005f70 2021-04-09T18:25:53.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.162 7f2a2ffff700 1 -- 172.21.15.79:0/2689236576 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4239087896 0 0) 0x7f2a28001670 con 0x7f2a1c005f70 2021-04-09T18:25:53.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.162 7f2a2ffff700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 msgr2=0x7f2a1c00c340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-04-09T18:25:53.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.162 7f2a2ffff700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c009ea0 0x7f2a1c00c340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:53.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.162 7f2a2ffff700 1 -- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 msgr2=0x7f2a1c0057c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-04-09T18:25:53.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.162 7f2a2ffff700 1 --2- 172.21.15.79:0/2689236576 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c0032e0 0x7f2a1c0057c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:53.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.162 7f2a2ffff700 1 -- 172.21.15.79:0/2689236576 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3809f900 con 0x7f2a1c005f70 2021-04-09T18:25:53.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.162 7f2a2ffff700 1 -- 172.21.15.79:0/2689236576 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f2a28001bd0 con 0x7f2a1c005f70 2021-04-09T18:25:53.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.162 7f2a2ffff700 1 -- 172.21.15.79:0/2689236576 >> v1:172.21.15.79:6789/0 conn(0x7f2a1c005f70 legacy=0x7f2a1c0084c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:53.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.162 7f2a3d86d700 1 -- 172.21.15.79:0/2689236576 reap_dead start 2021-04-09T18:25:53.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.162 7f2a2ffff700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a240038c0 0x7f2a24003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:53.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.162 7f2a2ffff700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a240045a0 0x7f2a240049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:53.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.162 7f2a2ffff700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a240050c0 0x7f2a24093820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:53.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.162 7f2a2ffff700 1 -- 172.21.15.79:0/2689236576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380e9f20 con 0x7f2a240038c0 2021-04-09T18:25:53.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.162 7f2a2ffff700 1 -- 172.21.15.79:0/2689236576 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a381c3db0 con 0x7f2a240045a0 2021-04-09T18:25:53.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.162 7f2a2ffff700 1 -- 172.21.15.79:0/2689236576 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a24094060 con 0x7f2a240050c0 2021-04-09T18:25:53.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.162 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a240038c0 0x7f2a24003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.162 7f2a3c86b700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a240045a0 0x7f2a240049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.162 7f2a3d86d700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a240050c0 0x7f2a24093820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.166 7f2a3d06c700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a240050c0 msgr2=0x7f2a24093820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:53.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.166 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a240050c0 0x7f2a24093820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:53.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.166 7f2a3d06c700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a240045a0 msgr2=0x7f2a240049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:53.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.166 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a240045a0 0x7f2a240049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:53.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.166 7f2a3d06c700 1 -- 172.21.15.79:0/2689236576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3809f900 con 0x7f2a240038c0 2021-04-09T18:25:53.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.166 7f2a3d06c700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a240038c0 0x7f2a24003d30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f2a3400a000 tx=0x7f2a34017440).ready entity=mon.0 client_cookie=a49883959f6e3fbd server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:53.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.166 7f2a2ffff700 1 -- 172.21.15.79:0/2689236576 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2a3809f900 con 0x7f2a240038c0 2021-04-09T18:25:53.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.166 7f2a2ffff700 1 -- 172.21.15.79:0/2689236576 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a34023420 con 0x7f2a240038c0 2021-04-09T18:25:53.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.166 7f2a2ffff700 1 -- 172.21.15.79:0/2689236576 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2a3401f070 con 0x7f2a240038c0 2021-04-09T18:25:53.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.166 7f2a3f2c8700 1 -- 172.21.15.79:0/2689236576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a240038c0 msgr2=0x7f2a24003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:53.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.166 7f2a3f2c8700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a240038c0 0x7f2a24003d30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f2a3400a000 tx=0x7f2a34017440).stop 2021-04-09T18:25:53.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.166 7f2a3f2c8700 1 -- 172.21.15.79:0/2689236576 shutdown_connections 2021-04-09T18:25:53.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.166 7f2a3f2c8700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a240045a0 0x7f2a240049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:53.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.166 7f2a3f2c8700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a240050c0 0x7f2a24093820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:53.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.166 7f2a3f2c8700 1 --2- 172.21.15.79:0/2689236576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a240038c0 0x7f2a24003d30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:53.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.166 7f2a3f2c8700 1 -- 172.21.15.79:0/2689236576 >> 172.21.15.79:0/2689236576 conn(0x7f2a380e5fd0 msgr2=0x7f2a380e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:53.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.166 7f2a3f2c8700 1 -- 172.21.15.79:0/2689236576 shutdown_connections 2021-04-09T18:25:53.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.166 7f2a3f2c8700 1 -- 172.21.15.79:0/2689236576 wait complete. 2021-04-09T18:25:53.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3f2c8700 1 Processor -- start 2021-04-09T18:25:53.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3f2c8700 1 -- start start 2021-04-09T18:25:53.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3f2c8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a381b10d0 0x7f2a380d7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:53.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3f2c8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a38099640 0x7f2a38099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:53.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3f2c8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3809a0c0 0x7f2a380aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:53.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3f2c8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380c1ef0 con 0x7f2a38099640 2021-04-09T18:25:53.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3f2c8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380c21f0 con 0x7f2a3809a0c0 2021-04-09T18:25:53.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3f2c8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380c1780 con 0x7f2a381b10d0 2021-04-09T18:25:53.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3d86d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3809a0c0 0x7f2a380aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3c86b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a38099640 0x7f2a38099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3d86d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3809a0c0 0x7f2a380aba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:43402/0 (socket says 172.21.15.79:43402) 2021-04-09T18:25:53.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3d86d700 1 -- 172.21.15.79:0/382060340 learned_addr learned my addr 172.21.15.79:0/382060340 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:25:53.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3c86b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a38099640 0x7f2a38099a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55058/0 (socket says 172.21.15.79:55058) 2021-04-09T18:25:53.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3d06c700 1 --2- 172.21.15.79:0/382060340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a381b10d0 0x7f2a380d7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:53.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3c86b700 1 -- 172.21.15.79:0/382060340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a381b10d0 msgr2=0x7f2a380d7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:53.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3c86b700 1 --2- 172.21.15.79:0/382060340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a381b10d0 0x7f2a380d7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:53.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3c86b700 1 -- 172.21.15.79:0/382060340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3809a0c0 msgr2=0x7f2a380aba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:53.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3c86b700 1 --2- 172.21.15.79:0/382060340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3809a0c0 0x7f2a380aba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:53.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3c86b700 1 -- 172.21.15.79:0/382060340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a380aae10 con 0x7f2a38099640 2021-04-09T18:25:53.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3d86d700 1 --2- 172.21.15.79:0/382060340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3809a0c0 0x7f2a380aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:25:53.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3c86b700 1 --2- 172.21.15.79:0/382060340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a38099640 0x7f2a38099a90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f2a3809abf0 tx=0x7f2a2800af40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:53.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a2dffb700 1 -- 172.21.15.79:0/382060340 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2a28010040 con 0x7f2a38099640 2021-04-09T18:25:53.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a2dffb700 1 -- 172.21.15.79:0/382060340 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a28006d50 con 0x7f2a38099640 2021-04-09T18:25:53.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3f2c8700 1 -- 172.21.15.79:0/382060340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a380c1aa0 con 0x7f2a38099640 2021-04-09T18:25:53.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a2dffb700 1 -- 172.21.15.79:0/382060340 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2a28002a10 con 0x7f2a38099640 2021-04-09T18:25:53.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.174 7f2a3f2c8700 1 -- 172.21.15.79:0/382060340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a381b1520 con 0x7f2a38099640 2021-04-09T18:25:53.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.178 7f2a2dffb700 1 -- 172.21.15.79:0/382060340 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7f2a28012070 con 0x7f2a38099640 2021-04-09T18:25:53.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.178 7f2a2dffb700 1 -- 172.21.15.79:0/382060340 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f2a28011040 con 0x7f2a38099640 2021-04-09T18:25:53.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.194 7f2a3f2c8700 1 -- 172.21.15.79:0/382060340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a380e39d0 con 0x7f2a38099640 2021-04-09T18:25:53.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.198 7f2a2dffb700 1 -- 172.21.15.79:0/382060340 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66016 (secure 0 0 0) 0x7f2a380e5c90 con 0x7f2a38099640 2021-04-09T18:25:53.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.290 7f2a3f2c8700 1 -- 172.21.15.79:0/382060340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"profile": "default", "prefix": "osd crush tunables"} v 0) v1 -- 0x7f2a380f5b10 con 0x7f2a38099640 2021-04-09T18:25:53.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.294 7f2a2dffb700 1 -- 172.21.15.79:0/382060340 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"profile": "default", "prefix": "osd crush tunables"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2a28006b40 con 0x7f2a38099640 2021-04-09T18:25:53.304 INFO:teuthology.orchestra.run.smithi079.stderr:adjusted tunables profile to default 2021-04-09T18:25:53.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.298 7f2a3f2c8700 1 -- 172.21.15.79:0/382060340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a38099640 msgr2=0x7f2a38099a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:53.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.298 7f2a3f2c8700 1 --2- 172.21.15.79:0/382060340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a38099640 0x7f2a38099a90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f2a3809abf0 tx=0x7f2a2800af40).stop 2021-04-09T18:25:53.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.298 7f2a3f2c8700 1 -- 172.21.15.79:0/382060340 shutdown_connections 2021-04-09T18:25:53.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.298 7f2a3f2c8700 1 --2- 172.21.15.79:0/382060340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3809a0c0 0x7f2a380aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:53.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.298 7f2a3f2c8700 1 --2- 172.21.15.79:0/382060340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a381b10d0 0x7f2a380d7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:53.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.298 7f2a3f2c8700 1 --2- 172.21.15.79:0/382060340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a38099640 0x7f2a38099a90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:53.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.298 7f2a3f2c8700 1 -- 172.21.15.79:0/382060340 >> 172.21.15.79:0/382060340 conn(0x7f2a380981a0 msgr2=0x7f2a380af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:53.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.298 7f2a3f2c8700 1 -- 172.21.15.79:0/382060340 shutdown_connections 2021-04-09T18:25:53.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:25:53.298 7f2a3f2c8700 1 -- 172.21.15.79:0/382060340 wait complete. 2021-04-09T18:25:53.447 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2021-04-09T18:25:53.448 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2021-04-09T18:25:53.454 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.1mmTYau9Ud 2021-04-09T18:25:53.455 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.1mmTYau9Ud 2021-04-09T18:25:53.512 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.1mmTYau9Ud 2021-04-09T18:25:53.619 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.1mmTYau9Ud is 37B 2021-04-09T18:25:53.630 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.1mmTYau9Ud 2021-04-09T18:25:53.636 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2021-04-09T18:25:53.685 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.ESQI6fi7x1 2021-04-09T18:25:53.687 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.ESQI6fi7x1 2021-04-09T18:25:53.743 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.ESQI6fi7x1 2021-04-09T18:25:53.868 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.ESQI6fi7x1 is 37B 2021-04-09T18:25:53.971 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.ESQI6fi7x1 2021-04-09T18:25:53.979 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2021-04-09T18:25:54.034 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.B0Q5pFHdeN 2021-04-09T18:25:54.035 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.B0Q5pFHdeN 2021-04-09T18:25:54.096 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.B0Q5pFHdeN 2021-04-09T18:25:54.207 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.B0Q5pFHdeN is 37B 2021-04-09T18:25:54.262 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.B0Q5pFHdeN 2021-04-09T18:25:54.268 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2021-04-09T18:25:54.315 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.5g8hgCskvU 2021-04-09T18:25:54.315 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.5g8hgCskvU 2021-04-09T18:25:54.377 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.5g8hgCskvU 2021-04-09T18:25:54.483 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.5g8hgCskvU is 37B 2021-04-09T18:25:54.495 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.5g8hgCskvU 2021-04-09T18:25:54.501 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2021-04-09T18:25:54.507 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.t0bRBS7Afh 2021-04-09T18:25:54.508 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.t0bRBS7Afh 2021-04-09T18:25:54.566 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.t0bRBS7Afh 2021-04-09T18:25:54.667 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.t0bRBS7Afh is 37B 2021-04-09T18:25:54.677 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.t0bRBS7Afh 2021-04-09T18:25:54.682 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2021-04-09T18:25:54.730 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.3BZKHUxfhl 2021-04-09T18:25:54.730 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.3BZKHUxfhl 2021-04-09T18:25:54.786 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.3BZKHUxfhl 2021-04-09T18:25:54.891 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.3BZKHUxfhl is 37B 2021-04-09T18:25:54.941 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.3BZKHUxfhl 2021-04-09T18:25:54.946 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2021-04-09T18:25:54.993 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.AZ9FvOWhvL 2021-04-09T18:25:54.994 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.AZ9FvOWhvL 2021-04-09T18:25:55.050 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.AZ9FvOWhvL 2021-04-09T18:25:55.155 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.AZ9FvOWhvL is 37B 2021-04-09T18:25:55.166 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.AZ9FvOWhvL 2021-04-09T18:25:55.171 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2021-04-09T18:25:55.217 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.EgcPH4cjU1 2021-04-09T18:25:55.218 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.EgcPH4cjU1 2021-04-09T18:25:55.270 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.EgcPH4cjU1 2021-04-09T18:25:55.374 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.EgcPH4cjU1 is 37B 2021-04-09T18:25:55.424 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.EgcPH4cjU1 2021-04-09T18:25:55.430 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new c93158fb-a785-4502-86ef-88ead369a3cc 0 2021-04-09T18:25:55.591 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.576 7ff0405d2700 1 Processor -- start 2021-04-09T18:25:55.591 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.576 7ff0405d2700 1 -- start start 2021-04-09T18:25:55.591 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.576 7ff0405d2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0380f5520 0x7ff0380f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:55.591 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff0405d2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0380e9ae0 0x7ff03809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:55.592 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff0405d2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff0381c2db0 0x7ff0381c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:55.592 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff0405d2700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0380e9f30 con 0x7ff0380f5520 2021-04-09T18:25:55.592 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff0405d2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0380e59d0 con 0x7ff0381c2db0 2021-04-09T18:25:55.592 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff0405d2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0380fbb20 con 0x7ff0380e9ae0 2021-04-09T18:25:55.593 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff03db75700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0380e9ae0 0x7ff03809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:55.593 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff03eb77700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff0381c2db0 0x7ff0381c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:55.593 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff03db75700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0380e9ae0 0x7ff03809f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:47874/0 (socket says 172.21.15.89:47874) 2021-04-09T18:25:55.593 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff03db75700 1 -- 172.21.15.89:0/186866865 learned_addr learned my addr 172.21.15.89:0/186866865 (peer_addr_for_me v2:172.21.15.89:0/0) 2021-04-09T18:25:55.594 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff03e376700 1 --2- 172.21.15.89:0/186866865 >> v2:172.21.15.79:3300/0 conn(0x7ff0380f5520 0x7ff0380f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:55.594 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff03db75700 1 -- 172.21.15.89:0/186866865 >> v2:172.21.15.89:3300/0 conn(0x7ff0381c2db0 msgr2=0x7ff0381c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:55.595 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff03db75700 1 --2- 172.21.15.89:0/186866865 >> v2:172.21.15.89:3300/0 conn(0x7ff0381c2db0 0x7ff0381c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.595 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff03db75700 1 -- 172.21.15.89:0/186866865 >> v2:172.21.15.79:3300/0 conn(0x7ff0380f5520 msgr2=0x7ff0380f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:55.595 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff03db75700 1 --2- 172.21.15.89:0/186866865 >> v2:172.21.15.79:3300/0 conn(0x7ff0380f5520 0x7ff0380f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.595 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff03db75700 1 -- 172.21.15.89:0/186866865 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0380e56d0 con 0x7ff0380e9ae0 2021-04-09T18:25:55.596 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff03eb77700 1 --2- 172.21.15.89:0/186866865 >> v2:172.21.15.89:3300/0 conn(0x7ff0381c2db0 0x7ff0381c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:25:55.596 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff03db75700 1 --2- 172.21.15.89:0/186866865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0380e9ae0 0x7ff03809f110 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff034002f30 tx=0x7ff03400bcf0).ready entity=mon.2 client_cookie=ad3c62cefa073bb9 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:55.596 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff03d374700 1 -- 172.21.15.89:0/186866865 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff0380e56d0 con 0x7ff0380e9ae0 2021-04-09T18:25:55.596 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff03d374700 1 -- 172.21.15.89:0/186866865 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff034009930 con 0x7ff0380e9ae0 2021-04-09T18:25:55.597 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff03d374700 1 -- 172.21.15.89:0/186866865 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff034009d00 con 0x7ff0380e9ae0 2021-04-09T18:25:55.597 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff0405d2700 1 -- 172.21.15.89:0/186866865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0380e9ae0 msgr2=0x7ff03809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:55.597 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff0405d2700 1 --2- 172.21.15.89:0/186866865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0380e9ae0 0x7ff03809f110 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff034002f30 tx=0x7ff03400bcf0).stop 2021-04-09T18:25:55.597 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff0405d2700 1 -- 172.21.15.89:0/186866865 shutdown_connections 2021-04-09T18:25:55.598 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff0405d2700 1 --2- 172.21.15.89:0/186866865 >> v2:172.21.15.89:3300/0 conn(0x7ff0381c2db0 0x7ff0381c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.598 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff0405d2700 1 --2- 172.21.15.89:0/186866865 >> v2:172.21.15.79:3300/0 conn(0x7ff0380f5520 0x7ff0380f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.598 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff0405d2700 1 --2- 172.21.15.89:0/186866865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0380e9ae0 0x7ff03809f110 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.598 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff0405d2700 1 -- 172.21.15.89:0/186866865 >> 172.21.15.89:0/186866865 conn(0x7ff0380e5fe0 msgr2=0x7ff0380e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:55.599 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff0405d2700 1 -- 172.21.15.89:0/186866865 shutdown_connections 2021-04-09T18:25:55.599 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.580 7ff0405d2700 1 -- 172.21.15.89:0/186866865 wait complete. 2021-04-09T18:25:55.599 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff0405d2700 1 Processor -- start 2021-04-09T18:25:55.599 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff0405d2700 1 -- start start 2021-04-09T18:25:55.599 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff0405d2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff03808fee0 0x7ff0380926e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:55.600 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff0405d2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0380c6ec0 0x7ff0380c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:55.600 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff0405d2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0381a79b0 0x7ff0381a7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:55.600 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff0405d2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff038090e30 con 0x7ff03808fee0 2021-04-09T18:25:55.600 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff0405d2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff038091130 con 0x7ff0380c6ec0 2021-04-09T18:25:55.601 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff0405d2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff038090330 con 0x7ff0381a79b0 2021-04-09T18:25:55.601 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff03eb77700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0381a79b0 0x7ff0381a7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:55.601 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff03db75700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0380c6ec0 0x7ff0380c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:55.601 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff03eb77700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0381a79b0 0x7ff0381a7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:47882/0 (socket says 172.21.15.89:47882) 2021-04-09T18:25:55.602 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff03eb77700 1 -- 172.21.15.89:0/2630002045 learned_addr learned my addr 172.21.15.89:0/2630002045 (peer_addr_for_me v2:172.21.15.89:0/0) 2021-04-09T18:25:55.602 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff03e376700 1 --2- 172.21.15.89:0/2630002045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff03808fee0 0x7ff0380926e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:55.602 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff03eb77700 1 -- 172.21.15.89:0/2630002045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0380c6ec0 msgr2=0x7ff0380c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:55.602 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff03eb77700 1 --2- 172.21.15.89:0/2630002045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0380c6ec0 0x7ff0380c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.602 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff03eb77700 1 -- 172.21.15.89:0/2630002045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff03808fee0 msgr2=0x7ff0380926e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:55.603 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff03eb77700 1 --2- 172.21.15.89:0/2630002045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff03808fee0 0x7ff0380926e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.603 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff03eb77700 1 -- 172.21.15.89:0/2630002045 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0380906c0 con 0x7ff0381a79b0 2021-04-09T18:25:55.603 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff03db75700 1 --2- 172.21.15.89:0/2630002045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0380c6ec0 0x7ff0380c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:25:55.603 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff03eb77700 1 --2- 172.21.15.89:0/2630002045 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0381a79b0 0x7ff0381a7e00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff038090db0 tx=0x7ff03000c4e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:55.604 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff02affd700 1 -- 172.21.15.89:0/2630002045 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff0380906c0 con 0x7ff0381a79b0 2021-04-09T18:25:55.604 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff02affd700 1 -- 172.21.15.89:0/2630002045 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03000ce30 con 0x7ff0381a79b0 2021-04-09T18:25:55.604 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff02affd700 1 -- 172.21.15.89:0/2630002045 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff03000f040 con 0x7ff0381a79b0 2021-04-09T18:25:55.604 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff0405d2700 1 -- 172.21.15.89:0/2630002045 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0381a8b80 con 0x7ff0381a79b0 2021-04-09T18:25:55.605 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff0405d2700 1 -- 172.21.15.89:0/2630002045 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0381a8430 con 0x7ff0381a79b0 2021-04-09T18:25:55.605 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff02affd700 1 -- 172.21.15.89:0/2630002045 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff030022060 con 0x7ff0381a79b0 2021-04-09T18:25:55.605 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.584 7ff02affd700 1 -- 172.21.15.89:0/2630002045 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7ff030010040 con 0x7ff0381a79b0 2021-04-09T18:25:55.606 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.592 7ff0405d2700 1 -- 172.21.15.89:0/2630002045 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0380e39e0 con 0x7ff0381a79b0 2021-04-09T18:25:55.606 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.596 7ff02affd700 1 -- 172.21.15.89:0/2630002045 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66016 (secure 0 0 0) 0x7ff0380f76c0 con 0x7ff0381a79b0 2021-04-09T18:25:55.731 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.728 7ff0405d2700 1 -- 172.21.15.89:0/2630002045 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", "id": 0} v 0) v1 -- 0x7ff0380f5b20 con 0x7ff0381a79b0 2021-04-09T18:25:55.738 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.736 7ff02affd700 1 -- 172.21.15.89:0/2630002045 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff03000cc20 con 0x7ff0381a79b0 2021-04-09T18:25:55.746 INFO:teuthology.orchestra.run.smithi089.stdout:0 2021-04-09T18:25:55.749 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.744 7ff0405d2700 1 -- 172.21.15.89:0/2630002045 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0381a79b0 msgr2=0x7ff0381a7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:55.749 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.744 7ff0405d2700 1 --2- 172.21.15.89:0/2630002045 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0381a79b0 0x7ff0381a7e00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff038090db0 tx=0x7ff03000c4e0).stop 2021-04-09T18:25:55.750 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.744 7ff0405d2700 1 -- 172.21.15.89:0/2630002045 shutdown_connections 2021-04-09T18:25:55.750 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.744 7ff0405d2700 1 --2- 172.21.15.89:0/2630002045 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0381a79b0 0x7ff0381a7e00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.750 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.744 7ff0405d2700 1 --2- 172.21.15.89:0/2630002045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff03808fee0 0x7ff0380926e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.750 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.744 7ff0405d2700 1 --2- 172.21.15.89:0/2630002045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0380c6ec0 0x7ff0380c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.751 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.744 7ff0405d2700 1 -- 172.21.15.89:0/2630002045 >> 172.21.15.89:0/2630002045 conn(0x7ff038093e30 msgr2=0x7ff038094660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:55.751 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.744 7ff0405d2700 1 -- 172.21.15.89:0/2630002045 shutdown_connections 2021-04-09T18:25:55.751 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.748 7ff0405d2700 1 -- 172.21.15.89:0/2630002045 wait complete. 2021-04-09T18:25:55.759 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new cfc0e117-1dd7-40de-9774-b60b84f691dc 1 2021-04-09T18:25:55.856 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.848 7f9b52ed8700 1 Processor -- start 2021-04-09T18:25:55.856 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.848 7f9b52ed8700 1 -- start start 2021-04-09T18:25:55.857 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b52ed8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9b4c0e9ae0 0x7f9b4c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:55.857 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b52ed8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4c0fbb20 con 0x7f9b4c0f5520 2021-04-09T18:25:55.857 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b52ed8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4c0e56d0 con 0x7f9b4c1c8010 2021-04-09T18:25:55.857 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b52ed8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4c1c3dc0 con 0x7f9b4c0e9ae0 2021-04-09T18:25:55.858 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b4bfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9b4c0e9ae0 0x7f9b4c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:55.858 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b5147d700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9b4c1c8010 0x7f9b4c1ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56150/0 (socket says 172.21.15.89:56150) 2021-04-09T18:25:55.858 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b5147d700 1 -- 172.21.15.89:0/1930508535 learned_addr learned my addr 172.21.15.89:0/1930508535 (peer_addr_for_me v1:172.21.15.89:0/0) 2021-04-09T18:25:55.858 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b4bfff700 1 -- 172.21.15.89:0/1930508535 >> v1:172.21.15.89:6789/0 conn(0x7f9b4c1c8010 legacy=0x7f9b4c1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:55.858 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b4bfff700 1 -- 172.21.15.89:0/1930508535 >> v1:172.21.15.79:6789/0 conn(0x7f9b4c0f5520 legacy=0x7f9b4c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b4bfff700 1 -- 172.21.15.89:0/1930508535 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c0e4330 con 0x7f9b4c0e9ae0 2021-04-09T18:25:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b4b7fe700 1 -- 172.21.15.89:0/1930508535 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760440784 0 0) 0x7f9b3c0010d0 con 0x7f9b4c1c8010 2021-04-09T18:25:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b4bfff700 1 --2- 172.21.15.89:0/1930508535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b4c0e9ae0 0x7f9b4c09f110 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f9b34002f30 tx=0x7f9b3400bcc0).ready entity=mon.1 client_cookie=3865e6caf28f54d4 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:55.860 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b4b7fe700 1 -- 172.21.15.89:0/1930508535 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b4c0e4330 con 0x7f9b4c0e9ae0 2021-04-09T18:25:55.860 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b4b7fe700 1 -- 172.21.15.89:0/1930508535 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b34009800 con 0x7f9b4c0e9ae0 2021-04-09T18:25:55.860 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b4b7fe700 1 -- 172.21.15.89:0/1930508535 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b34009bd0 con 0x7f9b4c0e9ae0 2021-04-09T18:25:55.860 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b52ed8700 1 -- 172.21.15.89:0/1930508535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b4c0e9ae0 msgr2=0x7f9b4c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:55.860 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b52ed8700 1 --2- 172.21.15.89:0/1930508535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b4c0e9ae0 0x7f9b4c09f110 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f9b34002f30 tx=0x7f9b3400bcc0).stop 2021-04-09T18:25:55.861 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b52ed8700 1 -- 172.21.15.89:0/1930508535 shutdown_connections 2021-04-09T18:25:55.861 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b52ed8700 1 --2- 172.21.15.89:0/1930508535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b4c0e9ae0 0x7f9b4c09f110 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.861 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b52ed8700 1 -- 172.21.15.89:0/1930508535 >> 172.21.15.89:0/1930508535 conn(0x7f9b4c0e5fe0 msgr2=0x7f9b4c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:55.861 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b52ed8700 1 -- 172.21.15.89:0/1930508535 shutdown_connections 2021-04-09T18:25:55.862 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b52ed8700 1 -- 172.21.15.89:0/1930508535 wait complete. 2021-04-09T18:25:55.865 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b52ed8700 1 Processor -- start 2021-04-09T18:25:55.865 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.852 7f9b52ed8700 1 -- start start 2021-04-09T18:25:55.865 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b52ed8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b4c0941d0 0x7f9b4c095770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:55.869 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b52ed8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b4c0d3b60 0x7f9b4c0d3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:55.869 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b52ed8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b4c1d3af0 0x7f9b4c1d3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:55.869 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b52ed8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c0e9f30 con 0x7f9b4c0d3b60 2021-04-09T18:25:55.870 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b52ed8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c095da0 con 0x7f9b4c1d3af0 2021-04-09T18:25:55.870 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b52ed8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c093a60 con 0x7f9b4c0941d0 2021-04-09T18:25:55.870 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b50c7c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b4c0941d0 0x7f9b4c095770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:55.870 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b50c7c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b4c0941d0 0x7f9b4c095770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:47890/0 (socket says 172.21.15.89:47890) 2021-04-09T18:25:55.871 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b50c7c700 1 -- 172.21.15.89:0/643599401 learned_addr learned my addr 172.21.15.89:0/643599401 (peer_addr_for_me v2:172.21.15.89:0/0) 2021-04-09T18:25:55.871 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b5147d700 1 --2- 172.21.15.89:0/643599401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b4c1d3af0 0x7f9b4c1d3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:55.871 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b4bfff700 1 --2- 172.21.15.89:0/643599401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b4c0d3b60 0x7f9b4c0d3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:55.871 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b5147d700 1 -- 172.21.15.89:0/643599401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b4c0941d0 msgr2=0x7f9b4c095770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:55.872 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b5147d700 1 --2- 172.21.15.89:0/643599401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b4c0941d0 0x7f9b4c095770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.872 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b5147d700 1 -- 172.21.15.89:0/643599401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b4c0d3b60 msgr2=0x7f9b4c0d3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:55.872 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b5147d700 1 --2- 172.21.15.89:0/643599401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b4c0d3b60 0x7f9b4c0d3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.872 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b5147d700 1 -- 172.21.15.89:0/643599401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c0933a0 con 0x7f9b4c1d3af0 2021-04-09T18:25:55.873 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b50c7c700 1 --2- 172.21.15.89:0/643599401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b4c0941d0 0x7f9b4c095770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:25:55.873 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b5147d700 1 --2- 172.21.15.89:0/643599401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b4c1d3af0 0x7f9b4c1d3f40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f9b3c000b80 tx=0x7f9b3c00ca20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:55.873 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b497fa700 1 -- 172.21.15.89:0/643599401 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b4c0933a0 con 0x7f9b4c1d3af0 2021-04-09T18:25:55.873 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b497fa700 1 -- 172.21.15.89:0/643599401 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c0072e0 con 0x7f9b4c1d3af0 2021-04-09T18:25:55.873 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b52ed8700 1 -- 172.21.15.89:0/643599401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4c1d4570 con 0x7f9b4c1d3af0 2021-04-09T18:25:55.874 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b497fa700 1 -- 172.21.15.89:0/643599401 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b3c0057e0 con 0x7f9b4c1d3af0 2021-04-09T18:25:55.874 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b52ed8700 1 -- 172.21.15.89:0/643599401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4c0a3450 con 0x7f9b4c1d3af0 2021-04-09T18:25:55.874 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b497fa700 1 -- 172.21.15.89:0/643599401 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9b3c0059e0 con 0x7f9b4c1d3af0 2021-04-09T18:25:55.874 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.856 7f9b497fa700 1 -- 172.21.15.89:0/643599401 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 857+0+0 (secure 0 0 0) 0x7f9b3c013450 con 0x7f9b4c1d3af0 2021-04-09T18:25:55.875 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.864 7f9b52ed8700 1 -- 172.21.15.89:0/643599401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4c094620 con 0x7f9b4c1d3af0 2021-04-09T18:25:55.875 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.868 7f9b497fa700 1 -- 172.21.15.89:0/643599401 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66016 (secure 0 0 0) 0x7f9b3c0070d0 con 0x7f9b4c1d3af0 2021-04-09T18:25:55.943 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:55.940 7f9b497fa700 1 -- 172.21.15.89:0/643599401 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mgrmap(e 2) v1 ==== 16574+0+0 (secure 0 0 0) 0x7f9b3c0137c0 con 0x7f9b4c1d3af0 2021-04-09T18:25:56.014 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.012 7f9b52ed8700 1 -- 172.21.15.89:0/643599401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", "id": 1} v 0) v1 -- 0x7f9b4c0e39e0 con 0x7f9b4c1d3af0 2021-04-09T18:25:56.020 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.016 7f9b497fa700 1 -- 172.21.15.89:0/643599401 <== mon.1 v2:172.21.15.89:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9b3c000bf0 con 0x7f9b4c1d3af0 2021-04-09T18:25:56.021 INFO:teuthology.orchestra.run.smithi089.stdout:1 2021-04-09T18:25:56.023 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.020 7f9b52ed8700 1 -- 172.21.15.89:0/643599401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b4c1d3af0 msgr2=0x7f9b4c1d3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.023 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.020 7f9b52ed8700 1 --2- 172.21.15.89:0/643599401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b4c1d3af0 0x7f9b4c1d3f40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f9b3c000b80 tx=0x7f9b3c00ca20).stop 2021-04-09T18:25:56.023 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.020 7f9b52ed8700 1 -- 172.21.15.89:0/643599401 shutdown_connections 2021-04-09T18:25:56.023 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.020 7f9b52ed8700 1 --2- 172.21.15.89:0/643599401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b4c1d3af0 0x7f9b4c1d3f40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.024 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.020 7f9b52ed8700 1 --2- 172.21.15.89:0/643599401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b4c0941d0 0x7f9b4c095770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.024 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.020 7f9b52ed8700 1 --2- 172.21.15.89:0/643599401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b4c0d3b60 0x7f9b4c0d3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.024 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.020 7f9b52ed8700 1 -- 172.21.15.89:0/643599401 >> 172.21.15.89:0/643599401 conn(0x7f9b4c0978a0 msgr2=0x7f9b4c0d7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:56.024 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.020 7f9b52ed8700 1 -- 172.21.15.89:0/643599401 shutdown_connections 2021-04-09T18:25:56.025 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.020 7f9b52ed8700 1 -- 172.21.15.89:0/643599401 wait complete. 2021-04-09T18:25:56.032 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 3e132e36-804a-4e09-bf33-351ef28cc52a 2 2021-04-09T18:25:56.108 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0d53d8700 1 Processor -- start 2021-04-09T18:25:56.108 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0d53d8700 1 -- start start 2021-04-09T18:25:56.108 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0d53d8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc0d00f5520 0x7fc0d00f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.109 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0d53d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d01c8010 0x7fc0d01ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.109 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0d53d8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d00fbb20 con 0x7fc0d00e9ae0 2021-04-09T18:25:56.109 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0d53d8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d00e9f30 con 0x7fc0d00f5520 2021-04-09T18:25:56.109 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0d53d8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d01c3dc0 con 0x7fc0d01c8010 2021-04-09T18:25:56.110 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0cf806700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d01c8010 0x7fc0d01ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:56.110 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0cf005700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc0d00f5520 0x7fc0d00f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:56.110 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0cf806700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d01c8010 0x7fc0d01ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:47918/0 (socket says 172.21.15.89:47918) 2021-04-09T18:25:56.110 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0cf806700 1 -- 172.21.15.89:0/1015760810 learned_addr learned my addr 172.21.15.89:0/1015760810 (peer_addr_for_me v2:172.21.15.89:0/0) 2021-04-09T18:25:56.110 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0cf005700 1 -- 172.21.15.89:0/1015760810 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d01c8010 msgr2=0x7fc0d01ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:56.111 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0cf005700 1 --2- 172.21.15.89:0/1015760810 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d01c8010 0x7fc0d01ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.111 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0cf005700 1 -- 172.21.15.89:0/1015760810 >> v1:172.21.15.79:6789/0 conn(0x7fc0d00e9ae0 legacy=0x7fc0d009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:56.111 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0cf005700 1 -- 172.21.15.89:0/1015760810 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d009f910 con 0x7fc0d00f5520 2021-04-09T18:25:56.111 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0cf005700 1 --2- 172.21.15.89:0/1015760810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0d00f5520 0x7fc0d00f64b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fc0d00f6f00 tx=0x7fc0c000bd70).ready entity=mon.1 client_cookie=62435ccddff7a8f0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:56.112 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0ce804700 1 -- 172.21.15.89:0/1015760810 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc0d009f910 con 0x7fc0d00f5520 2021-04-09T18:25:56.112 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0ce804700 1 -- 172.21.15.89:0/1015760810 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c0009810 con 0x7fc0d00f5520 2021-04-09T18:25:56.112 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0ce804700 1 -- 172.21.15.89:0/1015760810 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc0c0009c20 con 0x7fc0d00f5520 2021-04-09T18:25:56.112 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0d53d8700 1 -- 172.21.15.89:0/1015760810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0d00f5520 msgr2=0x7fc0d00f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.113 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0d53d8700 1 --2- 172.21.15.89:0/1015760810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0d00f5520 0x7fc0d00f64b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fc0d00f6f00 tx=0x7fc0c000bd70).stop 2021-04-09T18:25:56.113 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0d53d8700 1 -- 172.21.15.89:0/1015760810 shutdown_connections 2021-04-09T18:25:56.113 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0d53d8700 1 --2- 172.21.15.89:0/1015760810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0d00f5520 0x7fc0d00f64b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.113 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0d53d8700 1 --2- 172.21.15.89:0/1015760810 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d01c8010 0x7fc0d01ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.113 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0d53d8700 1 -- 172.21.15.89:0/1015760810 >> 172.21.15.89:0/1015760810 conn(0x7fc0d00e5fe0 msgr2=0x7fc0d00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:56.114 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0d53d8700 1 -- 172.21.15.89:0/1015760810 shutdown_connections 2021-04-09T18:25:56.114 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.100 7fc0d53d8700 1 -- 172.21.15.89:0/1015760810 wait complete. 2021-04-09T18:25:56.114 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0d53d8700 1 Processor -- start 2021-04-09T18:25:56.114 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0d53d8700 1 -- start start 2021-04-09T18:25:56.115 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0d53d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d00d5110 0x7fc0d00af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.115 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0d53d8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0d00d5560 0x7fc0d00afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.115 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0d53d8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0d00a2f80 0x7fc0d00a33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.115 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0d53d8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d00adce0 con 0x7fc0d00a2f80 2021-04-09T18:25:56.116 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0d53d8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d00adfe0 con 0x7fc0d00d5560 2021-04-09T18:25:56.116 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0d53d8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d01a2190 con 0x7fc0d00d5110 2021-04-09T18:25:56.116 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0cf005700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d00d5110 0x7fc0d00af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:56.116 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0cf005700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d00d5110 0x7fc0d00af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:47920/0 (socket says 172.21.15.89:47920) 2021-04-09T18:25:56.116 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0cf005700 1 -- 172.21.15.89:0/3916796878 learned_addr learned my addr 172.21.15.89:0/3916796878 (peer_addr_for_me v2:172.21.15.89:0/0) 2021-04-09T18:25:56.117 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0c7fff700 1 --2- 172.21.15.89:0/3916796878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0d00d5560 0x7fc0d00afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:56.117 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0cf005700 1 -- 172.21.15.89:0/3916796878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0d00d5560 msgr2=0x7fc0d00afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.117 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0cf005700 1 --2- 172.21.15.89:0/3916796878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0d00d5560 0x7fc0d00afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.117 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0cf005700 1 -- 172.21.15.89:0/3916796878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0d00a2f80 msgr2=0x7fc0d00a33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.118 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0cf005700 1 --2- 172.21.15.89:0/3916796878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0d00a2f80 0x7fc0d00a33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:25:56.118 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0cf005700 1 -- 172.21.15.89:0/3916796878 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d00ad870 con 0x7fc0d00d5110 2021-04-09T18:25:56.118 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0cf005700 1 --2- 172.21.15.89:0/3916796878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d00d5110 0x7fc0d00af580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fc0d00c1fb0 tx=0x7fc0c0006890).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:56.118 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0cc800700 1 -- 172.21.15.89:0/3916796878 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc0d00ad870 con 0x7fc0d00d5110 2021-04-09T18:25:56.118 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0cc800700 1 -- 172.21.15.89:0/3916796878 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c0011a50 con 0x7fc0d00d5110 2021-04-09T18:25:56.119 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0d53d8700 1 -- 172.21.15.89:0/3916796878 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d00a3a00 con 0x7fc0d00d5110 2021-04-09T18:25:56.119 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0cc800700 1 -- 172.21.15.89:0/3916796878 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc0c001d440 con 0x7fc0d00d5110 2021-04-09T18:25:56.119 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0d53d8700 1 -- 172.21.15.89:0/3916796878 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d01aeeb0 con 0x7fc0d00d5110 2021-04-09T18:25:56.119 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0cc800700 1 -- 172.21.15.89:0/3916796878 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 2) v1 ==== 16574+0+0 (secure 0 0 0) 0x7fc0c001c3e0 con 0x7fc0d00d5110 2021-04-09T18:25:56.120 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.104 7fc0cc800700 1 -- 172.21.15.89:0/3916796878 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 960+0+0 (secure 0 0 0) 0x7fc0c0014ce0 con 0x7fc0d00d5110 2021-04-09T18:25:56.120 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.108 7fc0d53d8700 1 -- 172.21.15.89:0/3916796878 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d00e39e0 con 0x7fc0d00d5110 2021-04-09T18:25:56.121 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.108 7fc0cc800700 1 -- 172.21.15.89:0/3916796878 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66016 (secure 0 0 0) 0x7fc0c0011840 con 0x7fc0d00d5110 2021-04-09T18:25:56.210 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.208 7fc0d53d8700 1 -- 172.21.15.89:0/3916796878 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", "id": 2} v 0) v1 -- 0x7fc0d00f5b20 con 0x7fc0d00d5110 2021-04-09T18:25:56.217 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.216 7fc0cc800700 1 -- 172.21.15.89:0/3916796878 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc0c0009600 con 0x7fc0d00d5110 2021-04-09T18:25:56.217 INFO:teuthology.orchestra.run.smithi089.stdout:2 2021-04-09T18:25:56.219 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.216 7fc0d53d8700 1 -- 172.21.15.89:0/3916796878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d00d5110 msgr2=0x7fc0d00af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.219 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.216 7fc0d53d8700 1 --2- 172.21.15.89:0/3916796878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d00d5110 0x7fc0d00af580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fc0d00c1fb0 tx=0x7fc0c0006890).stop 2021-04-09T18:25:56.220 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.216 7fc0d53d8700 1 -- 172.21.15.89:0/3916796878 shutdown_connections 2021-04-09T18:25:56.220 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.216 7fc0d53d8700 1 --2- 172.21.15.89:0/3916796878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0d00a2f80 0x7fc0d00a33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:25:56.220 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.216 7fc0d53d8700 1 --2- 172.21.15.89:0/3916796878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d00d5110 0x7fc0d00af580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.220 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.216 7fc0d53d8700 1 --2- 172.21.15.89:0/3916796878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0d00d5560 0x7fc0d00afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.221 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.216 7fc0d53d8700 1 -- 172.21.15.89:0/3916796878 >> 172.21.15.89:0/3916796878 conn(0x7fc0d00a24c0 msgr2=0x7fc0d00d81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:56.221 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.216 7fc0d53d8700 1 -- 172.21.15.89:0/3916796878 shutdown_connections 2021-04-09T18:25:56.221 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.216 7fc0d53d8700 1 -- 172.21.15.89:0/3916796878 wait complete. 2021-04-09T18:25:56.228 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 5bee6c91-4f04-4f4d-9643-80d7ae17feb0 3 2021-04-09T18:25:56.326 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.316 7fbd9a9ba700 1 Processor -- start 2021-04-09T18:25:56.327 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.316 7fbd9a9ba700 1 -- start start 2021-04-09T18:25:56.327 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.316 7fbd9a9ba700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd940e9ae0 0x7fbd9409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.327 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.316 7fbd9a9ba700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbd941c8010 0x7fbd941ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.327 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.316 7fbd9a9ba700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd940fbb20 con 0x7fbd940f5520 2021-04-09T18:25:56.328 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.316 7fbd9a9ba700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd941c3dc0 con 0x7fbd941c8010 2021-04-09T18:25:56.328 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.316 7fbd9a9ba700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd940e9f30 con 0x7fbd940e9ae0 2021-04-09T18:25:56.328 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.320 7fbd937fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd940e9ae0 0x7fbd9409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:56.328 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.320 7fbd93fff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fbd940f5520 0x7fbd940f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56188/0 (socket says 172.21.15.89:56188) 2021-04-09T18:25:56.329 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.320 7fbd93fff700 1 -- 172.21.15.89:0/2437951987 learned_addr learned my addr 172.21.15.89:0/2437951987 (peer_addr_for_me v1:172.21.15.89:0/0) 2021-04-09T18:25:56.329 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.320 7fbd98f5f700 1 --2- 172.21.15.89:0/2437951987 >> v2:172.21.15.89:3300/0 conn(0x7fbd941c8010 0x7fbd941ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:56.329 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.320 7fbd937fe700 1 -- 172.21.15.89:0/2437951987 >> v2:172.21.15.89:3300/0 conn(0x7fbd941c8010 msgr2=0x7fbd941ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:56.329 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.320 7fbd937fe700 1 --2- 172.21.15.89:0/2437951987 >> v2:172.21.15.89:3300/0 conn(0x7fbd941c8010 0x7fbd941ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.330 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.320 7fbd937fe700 1 -- 172.21.15.89:0/2437951987 >> v1:172.21.15.89:6789/0 conn(0x7fbd940f5520 legacy=0x7fbd940f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.330 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.320 7fbd937fe700 1 -- 172.21.15.89:0/2437951987 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd940e56d0 con 0x7fbd940e9ae0 2021-04-09T18:25:56.330 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.320 7fbd937fe700 1 --2- 172.21.15.89:0/2437951987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd940e9ae0 0x7fbd9409f110 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fbd7c002f30 tx=0x7fbd7c00bcc0).ready entity=mon.2 client_cookie=589e6a562e366201 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:56.330 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.320 7fbd92ffd700 1 -- 172.21.15.89:0/2437951987 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbd940e56d0 con 0x7fbd940e9ae0 2021-04-09T18:25:56.331 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.320 7fbd92ffd700 1 -- 172.21.15.89:0/2437951987 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7c009800 con 0x7fbd940e9ae0 2021-04-09T18:25:56.331 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.320 7fbd92ffd700 1 -- 172.21.15.89:0/2437951987 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbd7c009c10 con 0x7fbd940e9ae0 2021-04-09T18:25:56.331 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.320 7fbd9a9ba700 1 -- 172.21.15.89:0/2437951987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd940e9ae0 msgr2=0x7fbd9409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.331 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.320 7fbd9a9ba700 1 --2- 172.21.15.89:0/2437951987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd940e9ae0 0x7fbd9409f110 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fbd7c002f30 tx=0x7fbd7c00bcc0).stop 2021-04-09T18:25:56.332 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.320 7fbd9a9ba700 1 -- 172.21.15.89:0/2437951987 shutdown_connections 2021-04-09T18:25:56.332 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.320 7fbd9a9ba700 1 --2- 172.21.15.89:0/2437951987 >> v2:172.21.15.89:3300/0 conn(0x7fbd941c8010 0x7fbd941ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.332 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.320 7fbd9a9ba700 1 --2- 172.21.15.89:0/2437951987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd940e9ae0 0x7fbd9409f110 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.332 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.320 7fbd9a9ba700 1 -- 172.21.15.89:0/2437951987 >> 172.21.15.89:0/2437951987 conn(0x7fbd940e5fe0 msgr2=0x7fbd940e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:56.333 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.320 7fbd9a9ba700 1 -- 172.21.15.89:0/2437951987 shutdown_connections 2021-04-09T18:25:56.333 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.320 7fbd9a9ba700 1 -- 172.21.15.89:0/2437951987 wait complete. 2021-04-09T18:25:56.333 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd9a9ba700 1 Processor -- start 2021-04-09T18:25:56.333 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd9a9ba700 1 -- start start 2021-04-09T18:25:56.333 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd9a9ba700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd940c1940 0x7fbd940d4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.334 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd9a9ba700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd940d55b0 0x7fbd941af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.334 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd9a9ba700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd940c4810 0x7fbd941af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.334 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd9a9ba700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd940c4f60 con 0x7fbd940c4810 2021-04-09T18:25:56.334 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd9a9ba700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd940c4c60 con 0x7fbd940c1940 2021-04-09T18:25:56.335 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd9a9ba700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd940b82f0 con 0x7fbd940d55b0 2021-04-09T18:25:56.335 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd937fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd940d55b0 0x7fbd941af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:56.335 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd93fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd940c1940 0x7fbd940d4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:56.335 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd937fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd940d55b0 0x7fbd941af010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:47934/0 (socket says 172.21.15.89:47934) 2021-04-09T18:25:56.336 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd937fe700 1 -- 172.21.15.89:0/261876645 learned_addr learned my addr 172.21.15.89:0/261876645 (peer_addr_for_me v2:172.21.15.89:0/0) 2021-04-09T18:25:56.336 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd98f5f700 1 --2- 172.21.15.89:0/261876645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd940c4810 0x7fbd941af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:56.337 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd93fff700 1 -- 172.21.15.89:0/261876645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd940d55b0 msgr2=0x7fbd941af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.338 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd93fff700 1 --2- 172.21.15.89:0/261876645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd940d55b0 0x7fbd941af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.338 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd93fff700 1 -- 172.21.15.89:0/261876645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd940c4810 msgr2=0x7fbd941af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.338 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd93fff700 1 --2- 172.21.15.89:0/261876645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd940c4810 0x7fbd941af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.338 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd93fff700 1 -- 172.21.15.89:0/261876645 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd941afc70 con 0x7fbd940c1940 2021-04-09T18:25:56.339 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd937fe700 1 --2- 172.21.15.89:0/261876645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd940d55b0 0x7fbd941af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:25:56.339 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd93fff700 1 --2- 172.21.15.89:0/261876645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd940c1940 0x7fbd940d4f80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fbd940874f0 tx=0x7fbd8400cae0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:56.339 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd90ff9700 1 -- 172.21.15.89:0/261876645 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbd941afc70 con 0x7fbd940c1940 2021-04-09T18:25:56.340 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd90ff9700 1 -- 172.21.15.89:0/261876645 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd840072e0 con 0x7fbd940c1940 2021-04-09T18:25:56.340 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd9a9ba700 1 -- 172.21.15.89:0/261876645 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd940b9870 con 0x7fbd940c1940 2021-04-09T18:25:56.340 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd90ff9700 1 -- 172.21.15.89:0/261876645 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbd840057e0 con 0x7fbd940c1940 2021-04-09T18:25:56.340 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd9a9ba700 1 -- 172.21.15.89:0/261876645 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd940b9dd0 con 0x7fbd940c1940 2021-04-09T18:25:56.341 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd90ff9700 1 -- 172.21.15.89:0/261876645 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 2) v1 ==== 16574+0+0 (secure 0 0 0) 0x7fbd8401b070 con 0x7fbd940c1940 2021-04-09T18:25:56.341 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.324 7fbd90ff9700 1 -- 172.21.15.89:0/261876645 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1063+0+0 (secure 0 0 0) 0x7fbd840219a0 con 0x7fbd940c1940 2021-04-09T18:25:56.341 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.332 7fbd9a9ba700 1 -- 172.21.15.89:0/261876645 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd940e39e0 con 0x7fbd940c1940 2021-04-09T18:25:56.342 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.336 7fbd90ff9700 1 -- 172.21.15.89:0/261876645 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66016 (secure 0 0 0) 0x7fbd84000bf0 con 0x7fbd940c1940 2021-04-09T18:25:56.491 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.488 7fbd9a9ba700 1 -- 172.21.15.89:0/261876645 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", "id": 3} v 0) v1 -- 0x7fbd940a1cc0 con 0x7fbd940c1940 2021-04-09T18:25:56.498 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.496 7fbd90ff9700 1 -- 172.21.15.89:0/261876645 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbd840070d0 con 0x7fbd940c1940 2021-04-09T18:25:56.506 INFO:teuthology.orchestra.run.smithi089.stdout:3 2021-04-09T18:25:56.508 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.504 7fbd9a9ba700 1 -- 172.21.15.89:0/261876645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd940c1940 msgr2=0x7fbd940d4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.508 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.504 7fbd9a9ba700 1 --2- 172.21.15.89:0/261876645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd940c1940 0x7fbd940d4f80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fbd940874f0 tx=0x7fbd8400cae0).stop 2021-04-09T18:25:56.508 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.504 7fbd9a9ba700 1 -- 172.21.15.89:0/261876645 shutdown_connections 2021-04-09T18:25:56.509 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.504 7fbd9a9ba700 1 --2- 172.21.15.89:0/261876645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd940c1940 0x7fbd940d4f80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.509 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.504 7fbd9a9ba700 1 --2- 172.21.15.89:0/261876645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd940c4810 0x7fbd941af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.509 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.504 7fbd9a9ba700 1 --2- 172.21.15.89:0/261876645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd940d55b0 0x7fbd941af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.509 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.504 7fbd9a9ba700 1 -- 172.21.15.89:0/261876645 >> 172.21.15.89:0/261876645 conn(0x7fbd940a24c0 msgr2=0x7fbd940d8330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:56.509 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.504 7fbd9a9ba700 1 -- 172.21.15.89:0/261876645 shutdown_connections 2021-04-09T18:25:56.510 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.504 7fbd9a9ba700 1 -- 172.21.15.89:0/261876645 wait complete. 2021-04-09T18:25:56.519 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new c0d62925-071d-468c-8425-fedf7ef98e7f 4 2021-04-09T18:25:56.616 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd03e1ba700 1 Processor -- start 2021-04-09T18:25:56.617 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd03e1ba700 1 -- start start 2021-04-09T18:25:56.617 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd03e1ba700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd0380e9ae0 0x7fd03809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.617 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd03e1ba700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd0381c8010 0x7fd0381ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.617 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd03e1ba700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0380fbb20 con 0x7fd0380f5520 2021-04-09T18:25:56.618 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd03e1ba700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0381c3dc0 con 0x7fd0380e9ae0 2021-04-09T18:25:56.618 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd03e1ba700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0380e9f30 con 0x7fd0381c8010 2021-04-09T18:25:56.618 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd0377fe700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd0380f5520 0x7fd0380f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56200/0 (socket says 172.21.15.89:56200) 2021-04-09T18:25:56.618 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd0377fe700 1 -- 172.21.15.89:0/3043696219 learned_addr learned my addr 172.21.15.89:0/3043696219 (peer_addr_for_me v1:172.21.15.89:0/0) 2021-04-09T18:25:56.618 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd037fff700 1 --2- 172.21.15.89:0/3043696219 >> v2:172.21.15.89:3300/0 conn(0x7fd0381c8010 0x7fd0381ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:56.619 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd036ffd700 1 --2- 172.21.15.89:0/3043696219 >> v2:172.21.15.79:3300/0 conn(0x7fd0380e9ae0 0x7fd03809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:56.619 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd0367fc700 1 -- 172.21.15.89:0/3043696219 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939431666 0 0) 0x7fd0200010d0 con 0x7fd0380f5520 2021-04-09T18:25:56.619 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd0367fc700 1 -- 172.21.15.89:0/3043696219 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd024003240 con 0x7fd0380f5520 2021-04-09T18:25:56.619 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd037fff700 1 -- 172.21.15.89:0/3043696219 >> v2:172.21.15.79:3300/0 conn(0x7fd0380e9ae0 msgr2=0x7fd03809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:56.620 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd0367fc700 1 -- 172.21.15.89:0/3043696219 <== mon.1 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 531480556 0 0) 0x7fd020001650 con 0x7fd0380f5520 2021-04-09T18:25:56.620 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd037fff700 1 --2- 172.21.15.89:0/3043696219 >> v2:172.21.15.79:3300/0 conn(0x7fd0380e9ae0 0x7fd03809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.620 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd037fff700 1 -- 172.21.15.89:0/3043696219 >> v1:172.21.15.89:6789/0 conn(0x7fd0380f5520 legacy=0x7fd0380f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.620 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd037fff700 1 -- 172.21.15.89:0/3043696219 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0380e56d0 con 0x7fd0381c8010 2021-04-09T18:25:56.621 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd037fff700 1 --2- 172.21.15.89:0/3043696219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0381c8010 0x7fd0381ca470 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fd020001df0 tx=0x7fd03000bc90).ready entity=mon.1 client_cookie=f8bed7b98f921968 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:56.621 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd0367fc700 1 -- 172.21.15.89:0/3043696219 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0380e56d0 con 0x7fd0381c8010 2021-04-09T18:25:56.621 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd0367fc700 1 -- 172.21.15.89:0/3043696219 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0300096c0 con 0x7fd0381c8010 2021-04-09T18:25:56.621 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd0367fc700 1 -- 172.21.15.89:0/3043696219 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd020001bb0 con 0x7fd0381c8010 2021-04-09T18:25:56.621 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd03e1ba700 1 -- 172.21.15.89:0/3043696219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0381c8010 msgr2=0x7fd0381ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.622 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.608 7fd03e1ba700 1 --2- 172.21.15.89:0/3043696219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0381c8010 0x7fd0381ca470 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fd020001df0 tx=0x7fd03000bc90).stop 2021-04-09T18:25:56.622 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.612 7fd03e1ba700 1 -- 172.21.15.89:0/3043696219 shutdown_connections 2021-04-09T18:25:56.622 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.612 7fd03e1ba700 1 --2- 172.21.15.89:0/3043696219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0381c8010 0x7fd0381ca470 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.622 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.612 7fd03e1ba700 1 --2- 172.21.15.89:0/3043696219 >> v2:172.21.15.79:3300/0 conn(0x7fd0380e9ae0 0x7fd03809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.622 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.612 7fd03e1ba700 1 -- 172.21.15.89:0/3043696219 >> 172.21.15.89:0/3043696219 conn(0x7fd0380e5fe0 msgr2=0x7fd0380e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:56.623 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.612 7fd03e1ba700 1 -- 172.21.15.89:0/3043696219 shutdown_connections 2021-04-09T18:25:56.623 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.612 7fd03e1ba700 1 -- 172.21.15.89:0/3043696219 wait complete. 2021-04-09T18:25:56.623 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.612 7fd03e1ba700 1 Processor -- start 2021-04-09T18:25:56.623 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.612 7fd03e1ba700 1 -- start start 2021-04-09T18:25:56.626 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd03e1ba700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0380bf8f0 0x7fd0380c0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.627 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd03e1ba700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0380bf0f0 0x7fd03819dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.627 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd03e1ba700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0380d50c0 0x7fd0380967c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.627 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd03e1ba700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0380c0040 con 0x7fd0380d50c0 2021-04-09T18:25:56.627 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd03e1ba700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0380bfd40 con 0x7fd0380bf8f0 2021-04-09T18:25:56.627 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd03e1ba700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0380bf540 con 0x7fd0380bf0f0 2021-04-09T18:25:56.628 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd0377fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0380bf8f0 0x7fd0380c0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:56.628 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd036ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0380bf0f0 0x7fd03819dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:56.628 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd0377fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0380bf8f0 0x7fd0380c0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54572/0 (socket says 172.21.15.89:54572) 2021-04-09T18:25:56.629 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd0377fe700 1 -- 172.21.15.89:0/272700888 learned_addr learned my addr 172.21.15.89:0/272700888 (peer_addr_for_me v2:172.21.15.89:0/0) 2021-04-09T18:25:56.629 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd037fff700 1 --2- 172.21.15.89:0/272700888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0380d50c0 0x7fd0380967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:56.629 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd0377fe700 1 -- 172.21.15.89:0/272700888 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0380bf0f0 msgr2=0x7fd03819dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.629 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd0377fe700 1 --2- 172.21.15.89:0/272700888 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0380bf0f0 0x7fd03819dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.629 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd0377fe700 1 -- 172.21.15.89:0/272700888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0380d50c0 msgr2=0x7fd0380967c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.630 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd0377fe700 1 --2- 172.21.15.89:0/272700888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0380d50c0 0x7fd0380967c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.630 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd0377fe700 1 -- 172.21.15.89:0/272700888 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03819e360 con 0x7fd0380bf8f0 2021-04-09T18:25:56.630 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd036ffd700 1 --2- 172.21.15.89:0/272700888 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0380bf0f0 0x7fd03819dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:25:56.630 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd0377fe700 1 --2- 172.21.15.89:0/272700888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0380bf8f0 0x7fd0380c0340 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fd020001e30 tx=0x7fd02000cb50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:56.631 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd02ffff700 1 -- 172.21.15.89:0/272700888 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd03819e360 con 0x7fd0380bf8f0 2021-04-09T18:25:56.631 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd02ffff700 1 -- 172.21.15.89:0/272700888 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd020007170 con 0x7fd0380bf8f0 2021-04-09T18:25:56.631 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd03e1ba700 1 -- 172.21.15.89:0/272700888 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd038096df0 con 0x7fd0380bf8f0 2021-04-09T18:25:56.632 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd02ffff700 1 -- 172.21.15.89:0/272700888 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0200048e0 con 0x7fd0380bf8f0 2021-04-09T18:25:56.632 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd03e1ba700 1 -- 172.21.15.89:0/272700888 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0380d56a0 con 0x7fd0380bf8f0 2021-04-09T18:25:56.632 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd02ffff700 1 -- 172.21.15.89:0/272700888 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 2) v1 ==== 16574+0+0 (secure 0 0 0) 0x7fd020004ae0 con 0x7fd0380bf8f0 2021-04-09T18:25:56.632 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.616 7fd02ffff700 1 -- 172.21.15.89:0/272700888 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1166+0+0 (secure 0 0 0) 0x7fd020015520 con 0x7fd0380bf8f0 2021-04-09T18:25:56.633 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.624 7fd03e1ba700 1 -- 172.21.15.89:0/272700888 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0380e39e0 con 0x7fd0380bf8f0 2021-04-09T18:25:56.633 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.624 7fd02ffff700 1 -- 172.21.15.89:0/272700888 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66016 (secure 0 0 0) 0x7fd0200046d0 con 0x7fd0380bf8f0 2021-04-09T18:25:56.734 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.732 7fd03e1ba700 1 -- 172.21.15.89:0/272700888 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", "id": 4} v 0) v1 -- 0x7fd0380a1cc0 con 0x7fd0380bf8f0 2021-04-09T18:25:56.741 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.736 7fd02ffff700 1 -- 172.21.15.89:0/272700888 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd038107f50 con 0x7fd0380bf8f0 2021-04-09T18:25:56.741 INFO:teuthology.orchestra.run.smithi089.stdout:4 2021-04-09T18:25:56.744 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.740 7fd03e1ba700 1 -- 172.21.15.89:0/272700888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0380bf8f0 msgr2=0x7fd0380c0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.744 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.740 7fd03e1ba700 1 --2- 172.21.15.89:0/272700888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0380bf8f0 0x7fd0380c0340 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fd020001e30 tx=0x7fd02000cb50).stop 2021-04-09T18:25:56.744 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.740 7fd03e1ba700 1 -- 172.21.15.89:0/272700888 shutdown_connections 2021-04-09T18:25:56.745 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.740 7fd03e1ba700 1 --2- 172.21.15.89:0/272700888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0380bf8f0 0x7fd0380c0340 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.745 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.740 7fd03e1ba700 1 --2- 172.21.15.89:0/272700888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0380d50c0 0x7fd0380967c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.745 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.740 7fd03e1ba700 1 --2- 172.21.15.89:0/272700888 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0380bf0f0 0x7fd03819dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.745 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.740 7fd03e1ba700 1 -- 172.21.15.89:0/272700888 >> 172.21.15.89:0/272700888 conn(0x7fd0380d8440 msgr2=0x7fd03809a270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:56.745 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.740 7fd03e1ba700 1 -- 172.21.15.89:0/272700888 shutdown_connections 2021-04-09T18:25:56.746 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.740 7fd03e1ba700 1 -- 172.21.15.89:0/272700888 wait complete. 2021-04-09T18:25:56.756 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 27d54918-b90c-4c75-b31b-e3ac664baee2 5 2021-04-09T18:25:56.838 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c7451700 1 Processor -- start 2021-04-09T18:25:56.839 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c7451700 1 -- start start 2021-04-09T18:25:56.839 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c7451700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff1c00e9ae0 0x7ff1c009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.839 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c7451700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff1c01c8010 0x7ff1c01ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.839 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c7451700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c00fbb20 con 0x7ff1c00f5520 2021-04-09T18:25:56.840 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c7451700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c01c3dc0 con 0x7ff1c00e9ae0 2021-04-09T18:25:56.840 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c7451700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c00e9f30 con 0x7ff1c01c8010 2021-04-09T18:25:56.840 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c59f6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff1c01c8010 0x7ff1c01ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:56.840 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c51f5700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff1c00f5520 0x7ff1c00f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56212/0 (socket says 172.21.15.89:56212) 2021-04-09T18:25:56.841 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c59f6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff1c01c8010 0x7ff1c01ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54582/0 (socket says 172.21.15.89:54582) 2021-04-09T18:25:56.841 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c51f5700 1 -- 172.21.15.89:0/1355461166 learned_addr learned my addr 172.21.15.89:0/1355461166 (peer_addr_for_me v1:172.21.15.89:0/0) 2021-04-09T18:25:56.841 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c49f4700 1 --2- 172.21.15.89:0/1355461166 >> v2:172.21.15.79:3300/0 conn(0x7ff1c00e9ae0 0x7ff1c009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:56.841 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c59f6700 1 -- 172.21.15.89:0/1355461166 >> v2:172.21.15.79:3300/0 conn(0x7ff1c00e9ae0 msgr2=0x7ff1c009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:56.842 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c59f6700 1 --2- 172.21.15.89:0/1355461166 >> v2:172.21.15.79:3300/0 conn(0x7ff1c00e9ae0 0x7ff1c009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.842 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c59f6700 1 -- 172.21.15.89:0/1355461166 >> v1:172.21.15.89:6789/0 conn(0x7ff1c00f5520 legacy=0x7ff1c00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.842 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1b7fff700 1 -- 172.21.15.89:0/1355461166 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797154177 0 0) 0x7ff1b00010d0 con 0x7ff1c00f5520 2021-04-09T18:25:56.842 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c59f6700 1 -- 172.21.15.89:0/1355461166 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c00e56d0 con 0x7ff1c01c8010 2021-04-09T18:25:56.843 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c49f4700 1 --2- 172.21.15.89:0/1355461166 >> v2:172.21.15.79:3300/0 conn(0x7ff1c00e9ae0 0x7ff1c009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:25:56.843 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c59f6700 1 --2- 172.21.15.89:0/1355461166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1c01c8010 0x7ff1c01ca470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7ff1b80032b0 tx=0x7ff1b800b0e0).ready entity=mon.1 client_cookie=fe0a60b23e7f21d1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:56.843 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1b7fff700 1 -- 172.21.15.89:0/1355461166 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff1c00e56d0 con 0x7ff1c01c8010 2021-04-09T18:25:56.843 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1b7fff700 1 -- 172.21.15.89:0/1355461166 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b800ba90 con 0x7ff1c01c8010 2021-04-09T18:25:56.843 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1b7fff700 1 -- 172.21.15.89:0/1355461166 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff1b8002020 con 0x7ff1c01c8010 2021-04-09T18:25:56.844 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c7451700 1 -- 172.21.15.89:0/1355461166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1c01c8010 msgr2=0x7ff1c01ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.844 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c7451700 1 --2- 172.21.15.89:0/1355461166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1c01c8010 0x7ff1c01ca470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7ff1b80032b0 tx=0x7ff1b800b0e0).stop 2021-04-09T18:25:56.844 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c7451700 1 -- 172.21.15.89:0/1355461166 shutdown_connections 2021-04-09T18:25:56.844 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c7451700 1 --2- 172.21.15.89:0/1355461166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1c01c8010 0x7ff1c01ca470 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.845 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c7451700 1 --2- 172.21.15.89:0/1355461166 >> v2:172.21.15.79:3300/0 conn(0x7ff1c00e9ae0 0x7ff1c009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.845 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c7451700 1 -- 172.21.15.89:0/1355461166 >> 172.21.15.89:0/1355461166 conn(0x7ff1c00e5fe0 msgr2=0x7ff1c00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:56.845 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c7451700 1 -- 172.21.15.89:0/1355461166 shutdown_connections 2021-04-09T18:25:56.845 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.831 7ff1c7451700 1 -- 172.21.15.89:0/1355461166 wait complete. 2021-04-09T18:25:56.846 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c7451700 1 Processor -- start 2021-04-09T18:25:56.846 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c7451700 1 -- start start 2021-04-09T18:25:56.848 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c7451700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c00948a0 0x7ff1c00d1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.848 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c7451700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1c0095110 0x7ff1c0095560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.849 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c7451700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1c00d02c0 0x7ff1c00d0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.849 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c7451700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c00d0e10 con 0x7ff1c00948a0 2021-04-09T18:25:56.849 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c7451700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c00bc550 con 0x7ff1c0095110 2021-04-09T18:25:56.849 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c7451700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c0094cf0 con 0x7ff1c00d02c0 2021-04-09T18:25:56.850 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c49f4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1c0095110 0x7ff1c0095560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:56.850 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c59f6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1c00d02c0 0x7ff1c00d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:56.850 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c49f4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1c0095110 0x7ff1c0095560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54586/0 (socket says 172.21.15.89:54586) 2021-04-09T18:25:56.850 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c49f4700 1 -- 172.21.15.89:0/3224715874 learned_addr learned my addr 172.21.15.89:0/3224715874 (peer_addr_for_me v2:172.21.15.89:0/0) 2021-04-09T18:25:56.851 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c51f5700 1 --2- 172.21.15.89:0/3224715874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c00948a0 0x7ff1c00d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:56.851 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c49f4700 1 -- 172.21.15.89:0/3224715874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1c00d02c0 msgr2=0x7ff1c00d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.851 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c49f4700 1 --2- 172.21.15.89:0/3224715874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1c00d02c0 0x7ff1c00d0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.851 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c49f4700 1 -- 172.21.15.89:0/3224715874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c00948a0 msgr2=0x7ff1c00d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.852 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c49f4700 1 --2- 172.21.15.89:0/3224715874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c00948a0 0x7ff1c00d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.852 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c49f4700 1 -- 172.21.15.89:0/3224715874 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c00d1740 con 0x7ff1c0095110 2021-04-09T18:25:56.852 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c51f5700 1 --2- 172.21.15.89:0/3224715874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c00948a0 0x7ff1c00d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:25:56.852 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c49f4700 1 --2- 172.21.15.89:0/3224715874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1c0095110 0x7ff1c0095560 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff1c00d54f0 tx=0x7ff1bc00df60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:56.853 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1b5ffb700 1 -- 172.21.15.89:0/3224715874 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff1c00d1740 con 0x7ff1c0095110 2021-04-09T18:25:56.853 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1b5ffb700 1 -- 172.21.15.89:0/3224715874 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc0099e0 con 0x7ff1c0095110 2021-04-09T18:25:56.853 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1b5ffb700 1 -- 172.21.15.89:0/3224715874 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff1bc00f040 con 0x7ff1c0095110 2021-04-09T18:25:56.853 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c7451700 1 -- 172.21.15.89:0/3224715874 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c00bc790 con 0x7ff1c0095110 2021-04-09T18:25:56.854 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1c7451700 1 -- 172.21.15.89:0/3224715874 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c00bc0f0 con 0x7ff1c0095110 2021-04-09T18:25:56.854 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1b5ffb700 1 -- 172.21.15.89:0/3224715874 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 2) v1 ==== 16574+0+0 (secure 0 0 0) 0x7ff1bc013480 con 0x7ff1c0095110 2021-04-09T18:25:56.854 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.835 7ff1b5ffb700 1 -- 172.21.15.89:0/3224715874 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1269+0+0 (secure 0 0 0) 0x7ff1bc010070 con 0x7ff1c0095110 2021-04-09T18:25:56.855 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.847 7ff1c7451700 1 -- 172.21.15.89:0/3224715874 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c00e39e0 con 0x7ff1c0095110 2021-04-09T18:25:56.855 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.847 7ff1b5ffb700 1 -- 172.21.15.89:0/3224715874 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66016 (secure 0 0 0) 0x7ff1bc0095e0 con 0x7ff1c0095110 2021-04-09T18:25:56.951 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.947 7ff1b5ffb700 1 -- 172.21.15.89:0/3224715874 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff1bc01c5e0 con 0x7ff1c0095110 2021-04-09T18:25:56.951 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.947 7ff1b5ffb700 1 --2- 172.21.15.89:0/3224715874 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff1a0029620 0x7ff1a002bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:56.953 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.951 7ff1c51f5700 1 --2- 172.21.15.89:0/3224715874 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff1a0029620 0x7ff1a002bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:56.954 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.951 7ff1c51f5700 1 --2- 172.21.15.89:0/3224715874 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff1a0029620 0x7ff1a002bac0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:56.964 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.959 7ff1c7451700 1 -- 172.21.15.89:0/3224715874 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", "id": 5} v 0) v1 -- 0x7ff1c00a1cc0 con 0x7ff1c0095110 2021-04-09T18:25:56.973 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.967 7ff1b5ffb700 1 -- 172.21.15.89:0/3224715874 <== mon.1 v2:172.21.15.89:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff1bc000bf0 con 0x7ff1c0095110 2021-04-09T18:25:56.979 INFO:teuthology.orchestra.run.smithi089.stdout:5 2021-04-09T18:25:56.981 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.979 7ff1c7451700 1 -- 172.21.15.89:0/3224715874 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff1a0029620 msgr2=0x7ff1a002bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.982 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.979 7ff1c7451700 1 --2- 172.21.15.89:0/3224715874 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff1a0029620 0x7ff1a002bac0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.982 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.979 7ff1c7451700 1 -- 172.21.15.89:0/3224715874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1c0095110 msgr2=0x7ff1c0095560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:56.982 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.979 7ff1c7451700 1 --2- 172.21.15.89:0/3224715874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1c0095110 0x7ff1c0095560 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff1c00d54f0 tx=0x7ff1bc00df60).stop 2021-04-09T18:25:56.982 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.979 7ff1c7451700 1 -- 172.21.15.89:0/3224715874 shutdown_connections 2021-04-09T18:25:56.983 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.979 7ff1c7451700 1 --2- 172.21.15.89:0/3224715874 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff1a0029620 0x7ff1a002bac0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.983 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.979 7ff1c7451700 1 --2- 172.21.15.89:0/3224715874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1c00d02c0 0x7ff1c00d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.983 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.979 7ff1c7451700 1 --2- 172.21.15.89:0/3224715874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1c00948a0 0x7ff1c00d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.983 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.979 7ff1c7451700 1 --2- 172.21.15.89:0/3224715874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1c0095110 0x7ff1c0095560 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:56.983 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.979 7ff1c7451700 1 -- 172.21.15.89:0/3224715874 >> 172.21.15.89:0/3224715874 conn(0x7ff1c00baf90 msgr2=0x7ff1c00bcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:56.984 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.979 7ff1c7451700 1 -- 172.21.15.89:0/3224715874 shutdown_connections 2021-04-09T18:25:56.984 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:56.979 7ff1c7451700 1 -- 172.21.15.89:0/3224715874 wait complete. 2021-04-09T18:25:56.993 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new d3e702a2-a197-49dd-b937-5b81239f2654 6 2021-04-09T18:25:57.092 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.079 7effb5d2a700 1 Processor -- start 2021-04-09T18:25:57.093 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.079 7effb5d2a700 1 -- start start 2021-04-09T18:25:57.093 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effb5d2a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effb00f5520 0x7effb00f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:57.093 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effb5d2a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7effb00e9ae0 0x7effb009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:57.093 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effb5d2a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7effb01c2db0 0x7effb01c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:57.094 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effb5d2a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb00e9f30 con 0x7effb01c2db0 2021-04-09T18:25:57.094 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effb5d2a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb00e59d0 con 0x7effb00e9ae0 2021-04-09T18:25:57.094 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effb5d2a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb00fbb20 con 0x7effb00f5520 2021-04-09T18:25:57.094 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effaf7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effb00f5520 0x7effb00f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:57.095 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effaeffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7effb00e9ae0 0x7effb009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:57.095 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effaf7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effb00f5520 0x7effb00f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:47972/0 (socket says 172.21.15.89:47972) 2021-04-09T18:25:57.095 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effaf7fe700 1 -- 172.21.15.89:0/3720200476 learned_addr learned my addr 172.21.15.89:0/3720200476 (peer_addr_for_me v2:172.21.15.89:0/0) 2021-04-09T18:25:57.095 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effaffff700 1 --2- 172.21.15.89:0/3720200476 >> v2:172.21.15.79:3300/0 conn(0x7effb01c2db0 0x7effb01c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:57.096 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effaf7fe700 1 -- 172.21.15.89:0/3720200476 >> v2:172.21.15.89:3300/0 conn(0x7effb00e9ae0 msgr2=0x7effb009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:57.096 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effaf7fe700 1 --2- 172.21.15.89:0/3720200476 >> v2:172.21.15.89:3300/0 conn(0x7effb00e9ae0 0x7effb009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.096 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effaf7fe700 1 -- 172.21.15.89:0/3720200476 >> v2:172.21.15.79:3300/0 conn(0x7effb01c2db0 msgr2=0x7effb01c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:57.097 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effaf7fe700 1 --2- 172.21.15.89:0/3720200476 >> v2:172.21.15.79:3300/0 conn(0x7effb01c2db0 0x7effb01c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.097 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effaf7fe700 1 -- 172.21.15.89:0/3720200476 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb00e56d0 con 0x7effb00f5520 2021-04-09T18:25:57.097 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effaf7fe700 1 --2- 172.21.15.89:0/3720200476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effb00f5520 0x7effb00f64b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7effa0002f30 tx=0x7effa000bcf0).ready entity=mon.2 client_cookie=b0fab78974672cf9 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:57.097 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effae7fc700 1 -- 172.21.15.89:0/3720200476 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7effb00e56d0 con 0x7effb00f5520 2021-04-09T18:25:57.098 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effae7fc700 1 -- 172.21.15.89:0/3720200476 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa0009930 con 0x7effb00f5520 2021-04-09T18:25:57.098 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effae7fc700 1 -- 172.21.15.89:0/3720200476 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7effa0009d00 con 0x7effb00f5520 2021-04-09T18:25:57.098 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effb5d2a700 1 -- 172.21.15.89:0/3720200476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effb00f5520 msgr2=0x7effb00f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:57.098 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effb5d2a700 1 --2- 172.21.15.89:0/3720200476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effb00f5520 0x7effb00f64b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7effa0002f30 tx=0x7effa000bcf0).stop 2021-04-09T18:25:57.099 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effb5d2a700 1 -- 172.21.15.89:0/3720200476 shutdown_connections 2021-04-09T18:25:57.099 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effb5d2a700 1 --2- 172.21.15.89:0/3720200476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effb00f5520 0x7effb00f64b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.099 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effb5d2a700 1 --2- 172.21.15.89:0/3720200476 >> v2:172.21.15.79:3300/0 conn(0x7effb01c2db0 0x7effb01c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.099 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effb5d2a700 1 --2- 172.21.15.89:0/3720200476 >> v2:172.21.15.89:3300/0 conn(0x7effb00e9ae0 0x7effb009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.100 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effb5d2a700 1 -- 172.21.15.89:0/3720200476 >> 172.21.15.89:0/3720200476 conn(0x7effb00e5fe0 msgr2=0x7effb00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:57.100 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effb5d2a700 1 -- 172.21.15.89:0/3720200476 shutdown_connections 2021-04-09T18:25:57.100 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.083 7effb5d2a700 1 -- 172.21.15.89:0/3720200476 wait complete. 2021-04-09T18:25:57.100 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.087 7effb5d2a700 1 Processor -- start 2021-04-09T18:25:57.100 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.087 7effb5d2a700 1 -- start start 2021-04-09T18:25:57.103 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effb5d2a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effb00ba660 0x7effb00aafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:57.104 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effb5d2a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effb019b9e0 0x7effb019d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:57.104 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effb5d2a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effb019ded0 0x7effb00c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:57.104 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effb5d2a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb019fb70 con 0x7effb00ba660 2021-04-09T18:25:57.104 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effb5d2a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb019c320 con 0x7effb019b9e0 2021-04-09T18:25:57.105 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effb5d2a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb019e940 con 0x7effb019ded0 2021-04-09T18:25:57.105 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effaffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effb019ded0 0x7effb00c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:57.105 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effaeffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effb019b9e0 0x7effb019d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:57.105 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effaffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effb019ded0 0x7effb00c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:47982/0 (socket says 172.21.15.89:47982) 2021-04-09T18:25:57.106 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effaffff700 1 -- 172.21.15.89:0/1049231054 learned_addr learned my addr 172.21.15.89:0/1049231054 (peer_addr_for_me v2:172.21.15.89:0/0) 2021-04-09T18:25:57.106 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effaf7fe700 1 --2- 172.21.15.89:0/1049231054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effb00ba660 0x7effb00aafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:57.106 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effaffff700 1 -- 172.21.15.89:0/1049231054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effb019b9e0 msgr2=0x7effb019d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:57.106 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effaffff700 1 --2- 172.21.15.89:0/1049231054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effb019b9e0 0x7effb019d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.107 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effaffff700 1 -- 172.21.15.89:0/1049231054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effb00ba660 msgr2=0x7effb00aafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:57.107 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effaffff700 1 --2- 172.21.15.89:0/1049231054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effb00ba660 0x7effb00aafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.107 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effaffff700 1 -- 172.21.15.89:0/1049231054 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb019e320 con 0x7effb019ded0 2021-04-09T18:25:57.108 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effaffff700 1 --2- 172.21.15.89:0/1049231054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effb019ded0 0x7effb00c5ea0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7effa800c000 tx=0x7effa800c430).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:57.108 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effa7fff700 1 -- 172.21.15.89:0/1049231054 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7effb019e320 con 0x7effb019ded0 2021-04-09T18:25:57.108 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effa7fff700 1 -- 172.21.15.89:0/1049231054 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa800cbf0 con 0x7effb019ded0 2021-04-09T18:25:57.108 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effb5d2a700 1 -- 172.21.15.89:0/1049231054 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb019e580 con 0x7effb019ded0 2021-04-09T18:25:57.109 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effa7fff700 1 -- 172.21.15.89:0/1049231054 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7effa800f040 con 0x7effb019ded0 2021-04-09T18:25:57.109 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effb5d2a700 1 -- 172.21.15.89:0/1049231054 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb00c6660 con 0x7effb019ded0 2021-04-09T18:25:57.109 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effa7fff700 1 -- 172.21.15.89:0/1049231054 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7effa8022060 con 0x7effb019ded0 2021-04-09T18:25:57.109 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effa7fff700 1 --2- 172.21.15.89:0/1049231054 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7eff94029100 0x7eff9402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:57.110 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effa7fff700 1 -- 172.21.15.89:0/1049231054 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1372+0+0 (secure 0 0 0) 0x7effa8010040 con 0x7effb019ded0 2021-04-09T18:25:57.110 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.091 7effaf7fe700 1 --2- 172.21.15.89:0/1049231054 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7eff94029100 0x7eff9402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:57.110 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.095 7effaf7fe700 1 --2- 172.21.15.89:0/1049231054 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7eff94029100 0x7eff9402b650 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:57.110 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.095 7effb5d2a700 1 -- 172.21.15.89:0/1049231054 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb00e39e0 con 0x7effb019ded0 2021-04-09T18:25:57.111 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.103 7effa7fff700 1 -- 172.21.15.89:0/1049231054 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7effa8000f70 con 0x7effb019ded0 2021-04-09T18:25:57.283 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.279 7effb5d2a700 1 -- 172.21.15.89:0/1049231054 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", "id": 6} v 0) v1 -- 0x7effb00c3860 con 0x7effb019ded0 2021-04-09T18:25:57.295 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.291 7effa7fff700 1 -- 172.21.15.89:0/1049231054 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7effa800c9e0 con 0x7effb019ded0 2021-04-09T18:25:57.299 INFO:teuthology.orchestra.run.smithi089.stdout:6 2021-04-09T18:25:57.302 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.299 7effb5d2a700 1 -- 172.21.15.89:0/1049231054 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7eff94029100 msgr2=0x7eff9402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:57.303 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.299 7effb5d2a700 1 --2- 172.21.15.89:0/1049231054 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7eff94029100 0x7eff9402b650 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.303 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.299 7effb5d2a700 1 -- 172.21.15.89:0/1049231054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effb019ded0 msgr2=0x7effb00c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:57.303 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.299 7effb5d2a700 1 --2- 172.21.15.89:0/1049231054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effb019ded0 0x7effb00c5ea0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7effa800c000 tx=0x7effa800c430).stop 2021-04-09T18:25:57.304 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.299 7effb5d2a700 1 -- 172.21.15.89:0/1049231054 shutdown_connections 2021-04-09T18:25:57.304 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.299 7effb5d2a700 1 --2- 172.21.15.89:0/1049231054 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7eff94029100 0x7eff9402b650 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.304 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.299 7effb5d2a700 1 --2- 172.21.15.89:0/1049231054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effb019ded0 0x7effb00c5ea0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.305 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.299 7effb5d2a700 1 --2- 172.21.15.89:0/1049231054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effb00ba660 0x7effb00aafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.305 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.299 7effb5d2a700 1 --2- 172.21.15.89:0/1049231054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effb019b9e0 0x7effb019d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.305 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.299 7effb5d2a700 1 -- 172.21.15.89:0/1049231054 >> 172.21.15.89:0/1049231054 conn(0x7effb00af410 msgr2=0x7effb00c2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:57.305 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.299 7effb5d2a700 1 -- 172.21.15.89:0/1049231054 shutdown_connections 2021-04-09T18:25:57.306 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.299 7effb5d2a700 1 -- 172.21.15.89:0/1049231054 wait complete. 2021-04-09T18:25:57.318 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 88f940d9-7a5a-4c50-9e09-de72bf87623f 7 2021-04-09T18:25:57.423 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f84350e9700 1 Processor -- start 2021-04-09T18:25:57.424 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f84350e9700 1 -- start start 2021-04-09T18:25:57.424 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f84350e9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f84300f5520 0x7f84300f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:57.424 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f84350e9700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84300fbb20 con 0x7f84300e9ae0 2021-04-09T18:25:57.424 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f84350e9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843009f910 con 0x7f84301c8010 2021-04-09T18:25:57.425 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f84350e9700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84300e9f30 con 0x7f84300f5520 2021-04-09T18:25:57.425 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f842f59e700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f84301c8010 0x7f84301ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56252/0 (socket says 172.21.15.89:56252) 2021-04-09T18:25:57.425 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f842f59e700 1 -- 172.21.15.89:0/3624814055 learned_addr learned my addr 172.21.15.89:0/3624814055 (peer_addr_for_me v1:172.21.15.89:0/0) 2021-04-09T18:25:57.425 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f842ed9d700 1 --2- 172.21.15.89:0/3624814055 >> v2:172.21.15.79:3300/0 conn(0x7f84300f5520 0x7f84300f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:57.425 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f842dd9b700 1 -- 172.21.15.89:0/3624814055 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274035854 0 0) 0x7f84280010d0 con 0x7f84301c8010 2021-04-09T18:25:57.426 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f842dd9b700 1 -- 172.21.15.89:0/3624814055 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8410003240 con 0x7f84301c8010 2021-04-09T18:25:57.426 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f842ed9d700 1 -- 172.21.15.89:0/3624814055 >> v1:172.21.15.89:6789/0 conn(0x7f84301c8010 legacy=0x7f84301ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:57.426 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f842ed9d700 1 -- 172.21.15.89:0/3624814055 >> v1:172.21.15.79:6789/0 conn(0x7f84300e9ae0 legacy=0x7f843009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:57.427 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f842dd9b700 1 -- 172.21.15.89:0/3624814055 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1830506655 0 0) 0x7f84180010d0 con 0x7f84300e9ae0 2021-04-09T18:25:57.427 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f842ed9d700 1 -- 172.21.15.89:0/3624814055 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84300e56d0 con 0x7f84300f5520 2021-04-09T18:25:57.427 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f842ed9d700 1 --2- 172.21.15.89:0/3624814055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84300f5520 0x7f84300f64b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f84200032b0 tx=0x7f842000b0e0).ready entity=mon.0 client_cookie=bf59d1f9c66c71bc server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:57.427 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f842dd9b700 1 -- 172.21.15.89:0/3624814055 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f84300e56d0 con 0x7f84300f5520 2021-04-09T18:25:57.428 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f842dd9b700 1 -- 172.21.15.89:0/3624814055 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842000bab0 con 0x7f84300f5520 2021-04-09T18:25:57.428 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f842dd9b700 1 -- 172.21.15.89:0/3624814055 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8420002020 con 0x7f84300f5520 2021-04-09T18:25:57.428 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f84350e9700 1 -- 172.21.15.89:0/3624814055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84300f5520 msgr2=0x7f84300f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:57.428 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.415 7f84350e9700 1 --2- 172.21.15.89:0/3624814055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84300f5520 0x7f84300f64b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f84200032b0 tx=0x7f842000b0e0).stop 2021-04-09T18:25:57.428 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f84350e9700 1 -- 172.21.15.89:0/3624814055 shutdown_connections 2021-04-09T18:25:57.429 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f84350e9700 1 --2- 172.21.15.89:0/3624814055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84300f5520 0x7f84300f64b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.429 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f84350e9700 1 -- 172.21.15.89:0/3624814055 >> 172.21.15.89:0/3624814055 conn(0x7f84300e5fe0 msgr2=0x7f84300e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:57.429 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f84350e9700 1 -- 172.21.15.89:0/3624814055 shutdown_connections 2021-04-09T18:25:57.429 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f84350e9700 1 -- 172.21.15.89:0/3624814055 wait complete. 2021-04-09T18:25:57.430 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f84350e9700 1 Processor -- start 2021-04-09T18:25:57.430 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f84350e9700 1 -- start start 2021-04-09T18:25:57.432 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f84350e9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8430099660 0x7f84300c5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:57.433 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f84350e9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84301c01d0 0x7f8430095fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:57.433 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f84350e9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84301c0620 0x7f84301b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:57.433 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f84350e9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84301c3dc0 con 0x7f84301c01d0 2021-04-09T18:25:57.433 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f84350e9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8430097f30 con 0x7f84301c0620 2021-04-09T18:25:57.433 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f84350e9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8430097440 con 0x7f8430099660 2021-04-09T18:25:57.434 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f842ed9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8430099660 0x7f84300c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:57.434 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f842ed9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8430099660 0x7f84300c5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:47992/0 (socket says 172.21.15.89:47992) 2021-04-09T18:25:57.434 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f842ed9d700 1 -- 172.21.15.89:0/1366062977 learned_addr learned my addr 172.21.15.89:0/1366062977 (peer_addr_for_me v2:172.21.15.89:0/0) 2021-04-09T18:25:57.434 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f842f59e700 1 --2- 172.21.15.89:0/1366062977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84301c0620 0x7f84301b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:57.434 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f842e59c700 1 --2- 172.21.15.89:0/1366062977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84301c01d0 0x7f8430095fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:57.435 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f842ed9d700 1 -- 172.21.15.89:0/1366062977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84301c0620 msgr2=0x7f84301b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:57.435 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f842ed9d700 1 --2- 172.21.15.89:0/1366062977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84301c0620 0x7f84301b1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.435 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f842ed9d700 1 -- 172.21.15.89:0/1366062977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84301c01d0 msgr2=0x7f8430095fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:57.435 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f842ed9d700 1 --2- 172.21.15.89:0/1366062977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84301c01d0 0x7f8430095fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.436 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f842ed9d700 1 -- 172.21.15.89:0/1366062977 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8430097740 con 0x7f8430099660 2021-04-09T18:25:57.436 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f842ed9d700 1 --2- 172.21.15.89:0/1366062977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8430099660 0x7f84300c5110 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f84300bb420 tx=0x7f8420006c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:57.436 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f84277fe700 1 -- 172.21.15.89:0/1366062977 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8430097740 con 0x7f8430099660 2021-04-09T18:25:57.436 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f84277fe700 1 -- 172.21.15.89:0/1366062977 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842001f020 con 0x7f8430099660 2021-04-09T18:25:57.436 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f84350e9700 1 -- 172.21.15.89:0/1366062977 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8430099ab0 con 0x7f8430099660 2021-04-09T18:25:57.437 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f84277fe700 1 -- 172.21.15.89:0/1366062977 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f842001b830 con 0x7f8430099660 2021-04-09T18:25:57.437 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.419 7f84350e9700 1 -- 172.21.15.89:0/1366062977 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84300965f0 con 0x7f8430099660 2021-04-09T18:25:57.437 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.423 7f84277fe700 1 -- 172.21.15.89:0/1366062977 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8420009ce0 con 0x7f8430099660 2021-04-09T18:25:57.437 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.423 7f84277fe700 1 --2- 172.21.15.89:0/1366062977 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8408029100 0x7f840802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:57.437 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.423 7f84277fe700 1 -- 172.21.15.89:0/1366062977 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1475+0+0 (secure 0 0 0) 0x7f842003ae50 con 0x7f8430099660 2021-04-09T18:25:57.438 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.423 7f842e59c700 1 --2- 172.21.15.89:0/1366062977 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8408029100 0x7f840802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:57.438 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.423 7f842e59c700 1 --2- 172.21.15.89:0/1366062977 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8408029100 0x7f840802b650 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:57.438 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.427 7f84350e9700 1 -- 172.21.15.89:0/1366062977 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84300e39e0 con 0x7f8430099660 2021-04-09T18:25:57.439 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.435 7f84277fe700 1 -- 172.21.15.89:0/1366062977 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f842000b8a0 con 0x7f8430099660 2021-04-09T18:25:57.613 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.607 7f84350e9700 1 -- 172.21.15.89:0/1366062977 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", "id": 7} v 0) v1 -- 0x7f8430099cb0 con 0x7f8430099660 2021-04-09T18:25:57.620 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.615 7f84277fe700 1 -- 172.21.15.89:0/1366062977 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f842001b430 con 0x7f8430099660 2021-04-09T18:25:57.628 INFO:teuthology.orchestra.run.smithi089.stdout:7 2021-04-09T18:25:57.632 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.627 7f84350e9700 1 -- 172.21.15.89:0/1366062977 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8408029100 msgr2=0x7f840802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:57.632 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.627 7f84350e9700 1 --2- 172.21.15.89:0/1366062977 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8408029100 0x7f840802b650 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.632 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.627 7f84350e9700 1 -- 172.21.15.89:0/1366062977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8430099660 msgr2=0x7f84300c5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:57.633 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.627 7f84350e9700 1 --2- 172.21.15.89:0/1366062977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8430099660 0x7f84300c5110 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f84300bb420 tx=0x7f8420006c10).stop 2021-04-09T18:25:57.633 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.627 7f84350e9700 1 -- 172.21.15.89:0/1366062977 shutdown_connections 2021-04-09T18:25:57.633 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.627 7f84350e9700 1 --2- 172.21.15.89:0/1366062977 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8408029100 0x7f840802b650 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.633 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.627 7f84350e9700 1 --2- 172.21.15.89:0/1366062977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84301c0620 0x7f84301b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.634 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.627 7f84350e9700 1 --2- 172.21.15.89:0/1366062977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8430099660 0x7f84300c5110 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.634 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.627 7f84350e9700 1 --2- 172.21.15.89:0/1366062977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84301c01d0 0x7f8430095fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.634 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.627 7f84350e9700 1 -- 172.21.15.89:0/1366062977 >> 172.21.15.89:0/1366062977 conn(0x7f84300ba9a0 msgr2=0x7f84300d85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:57.634 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.627 7f84350e9700 1 -- 172.21.15.89:0/1366062977 shutdown_connections 2021-04-09T18:25:57.634 INFO:teuthology.orchestra.run.smithi089.stderr:2021-04-09 18:25:57.627 7f84350e9700 1 -- 172.21.15.89:0/1366062977 wait complete. 2021-04-09T18:25:57.643 INFO:tasks.ceph.osd.0:Restarting daemon 2021-04-09T18:25:57.644 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2021-04-09T18:25:57.646 INFO:tasks.ceph.osd.0:Started 2021-04-09T18:25:57.646 INFO:tasks.ceph.osd.1:Restarting daemon 2021-04-09T18:25:57.647 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2021-04-09T18:25:57.649 INFO:tasks.ceph.osd.1:Started 2021-04-09T18:25:57.649 INFO:tasks.ceph.osd.2:Restarting daemon 2021-04-09T18:25:57.650 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2021-04-09T18:25:57.652 INFO:tasks.ceph.osd.2:Started 2021-04-09T18:25:57.653 INFO:tasks.ceph.osd.3:Restarting daemon 2021-04-09T18:25:57.653 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2021-04-09T18:25:57.656 INFO:tasks.ceph.osd.3:Started 2021-04-09T18:25:57.656 INFO:tasks.ceph.osd.4:Restarting daemon 2021-04-09T18:25:57.656 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2021-04-09T18:25:57.659 INFO:tasks.ceph.osd.4:Started 2021-04-09T18:25:57.659 INFO:tasks.ceph.osd.5:Restarting daemon 2021-04-09T18:25:57.660 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2021-04-09T18:25:57.663 INFO:tasks.ceph.osd.5:Started 2021-04-09T18:25:57.663 INFO:tasks.ceph.osd.6:Restarting daemon 2021-04-09T18:25:57.664 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2021-04-09T18:25:57.666 INFO:tasks.ceph.osd.6:Started 2021-04-09T18:25:57.666 INFO:tasks.ceph.osd.7:Restarting daemon 2021-04-09T18:25:57.666 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2021-04-09T18:25:57.669 INFO:tasks.ceph.osd.7:Started 2021-04-09T18:25:57.669 INFO:tasks.ceph:Waiting for OSDs to come up 2021-04-09T18:25:58.255 INFO:tasks.ceph.osd.6.smithi089.stderr:2021-04-09 18:25:58.251 7f7b0a319c00 -1 Falling back to public interface 2021-04-09T18:25:58.258 INFO:tasks.ceph.osd.0.smithi079.stderr:2021-04-09 18:25:58.250 7f8b3da67c00 -1 Falling back to public interface 2021-04-09T18:25:58.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2021-04-09 18:25:58.250 7f5ff6336c00 -1 Falling back to public interface 2021-04-09T18:25:58.259 INFO:tasks.ceph.osd.0.smithi079.stderr:2021-04-09 18:25:58.250 7f8b37b89700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2021-04-09T18:25:58.259 INFO:tasks.ceph.osd.0.smithi079.stderr:2021-04-09 18:25:58.250 7f8b37b89700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2021-04-09T18:25:58.267 INFO:tasks.ceph.osd.5.smithi089.stderr:2021-04-09 18:25:58.263 7fca7a583c00 -1 Falling back to public interface 2021-04-09T18:25:58.269 INFO:tasks.ceph.osd.2.smithi079.stderr:2021-04-09 18:25:58.262 7f46ca7c9c00 -1 Falling back to public interface 2021-04-09T18:25:58.277 INFO:tasks.ceph.osd.3.smithi079.stderr:2021-04-09 18:25:58.270 7f30455cfc00 -1 Falling back to public interface 2021-04-09T18:25:58.279 INFO:tasks.ceph.osd.7.smithi089.stderr:2021-04-09 18:25:58.275 7f5ec7077c00 -1 Falling back to public interface 2021-04-09T18:25:58.291 INFO:tasks.ceph.osd.4.smithi089.stderr:2021-04-09 18:25:58.287 7f95c2129c00 -1 Falling back to public interface 2021-04-09T18:25:58.478 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-04-09T18:25:58.583 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f551240a700 1 Processor -- start 2021-04-09T18:25:58.584 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f551240a700 1 -- start start 2021-04-09T18:25:58.584 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f551240a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f550c0f5510 0x7f550c0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:58.584 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f551240a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f550c0fbb10 con 0x7f550c0e9ad0 2021-04-09T18:25:58.584 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f551240a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f550c09f900 con 0x7f550c1c8000 2021-04-09T18:25:58.585 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f551240a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550c0e9f20 con 0x7f550c0f5510 2021-04-09T18:25:58.585 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f550c0e9ad0 0x7f550c09f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49804/0 (socket says 172.21.15.79:49804) 2021-04-09T18:25:58.585 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550b7fe700 1 -- 172.21.15.79:0/269748637 learned_addr learned my addr 172.21.15.79:0/269748637 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:25:58.586 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550bfff700 1 --2- 172.21.15.79:0/269748637 >> v2:172.21.15.89:3300/0 conn(0x7f550c0f5510 0x7f550c0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:58.586 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550affd700 1 -- 172.21.15.79:0/269748637 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3654010575 0 0) 0x7f55000010d0 con 0x7f550c0e9ad0 2021-04-09T18:25:58.586 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550affd700 1 -- 172.21.15.79:0/269748637 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54f4003240 con 0x7f550c0e9ad0 2021-04-09T18:25:58.586 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550affd700 1 -- 172.21.15.79:0/269748637 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1495857459 0 0) 0x7f5500001650 con 0x7f550c0e9ad0 2021-04-09T18:25:58.586 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550affd700 1 -- 172.21.15.79:0/269748637 >> v2:172.21.15.89:3300/0 conn(0x7f550c0f5510 msgr2=0x7f550c0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:58.587 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550affd700 1 --2- 172.21.15.79:0/269748637 >> v2:172.21.15.89:3300/0 conn(0x7f550c0f5510 0x7f550c0f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:58.587 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550affd700 1 -- 172.21.15.79:0/269748637 >> v1:172.21.15.89:6789/0 conn(0x7f550c1c8000 legacy=0x7f550c1ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:58.587 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550affd700 1 -- 172.21.15.79:0/269748637 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c0e56c0 con 0x7f550c0e9ad0 2021-04-09T18:25:58.588 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550affd700 1 -- 172.21.15.79:0/269748637 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f5500001bb0 con 0x7f550c0e9ad0 2021-04-09T18:25:58.588 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550bfff700 1 --2- 172.21.15.79:0/269748637 >> v2:172.21.15.89:3300/0 conn(0x7f550c0f5510 0x7f550c0f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:25:58.588 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550affd700 1 -- 172.21.15.79:0/269748637 >> v1:172.21.15.79:6789/0 conn(0x7f550c0e9ad0 legacy=0x7f550c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:58.588 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550affd700 1 --2- 172.21.15.79:0/269748637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54f40038c0 0x7f54f4003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:58.588 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550affd700 1 --2- 172.21.15.79:0/269748637 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54f40045a0 0x7f54f4004a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:58.589 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550affd700 1 --2- 172.21.15.79:0/269748637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54f40097e0 0x7f54f400bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:58.589 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550affd700 1 -- 172.21.15.79:0/269748637 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c0e9f20 con 0x7f54f40038c0 2021-04-09T18:25:58.589 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550affd700 1 -- 172.21.15.79:0/269748637 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f400c270 con 0x7f54f40097e0 2021-04-09T18:25:58.589 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550bfff700 1 --2- 172.21.15.79:0/269748637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54f40038c0 0x7f54f4003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:58.590 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550affd700 1 -- 172.21.15.79:0/269748637 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f4050430 con 0x7f54f40045a0 2021-04-09T18:25:58.590 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550b7fe700 1 --2- 172.21.15.79:0/269748637 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54f40045a0 0x7f54f4004a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:58.590 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f55109af700 1 --2- 172.21.15.79:0/269748637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54f40097e0 0x7f54f400bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:58.590 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550bfff700 1 -- 172.21.15.79:0/269748637 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54f40045a0 msgr2=0x7f54f4004a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:58.591 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550bfff700 1 --2- 172.21.15.79:0/269748637 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54f40045a0 0x7f54f4004a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:58.591 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550bfff700 1 -- 172.21.15.79:0/269748637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54f40097e0 msgr2=0x7f54f400bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:58.591 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.562 7f550bfff700 1 --2- 172.21.15.79:0/269748637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54f40097e0 0x7f54f400bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:58.592 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.566 7f550bfff700 1 -- 172.21.15.79:0/269748637 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f40506a0 con 0x7f54f40038c0 2021-04-09T18:25:58.592 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.566 7f55109af700 1 -- 172.21.15.79:0/269748637 reap_dead start 2021-04-09T18:25:58.592 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.566 7f550b7fe700 1 --2- 172.21.15.79:0/269748637 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54f40045a0 0x7f54f4004a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:25:58.592 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.566 7f550bfff700 1 --2- 172.21.15.79:0/269748637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54f40038c0 0x7f54f4003d70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f54fc00c000 tx=0x7f54fc00e4b0).ready entity=mon.0 client_cookie=dcc281375bd45 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:58.593 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.566 7f550affd700 1 -- 172.21.15.79:0/269748637 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f54f40506a0 con 0x7f54f40038c0 2021-04-09T18:25:58.593 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.566 7f550affd700 1 -- 172.21.15.79:0/269748637 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54fc0123f0 con 0x7f54f40038c0 2021-04-09T18:25:58.593 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.566 7f550affd700 1 -- 172.21.15.79:0/269748637 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f54fc00f040 con 0x7f54f40038c0 2021-04-09T18:25:58.593 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.566 7f551240a700 1 -- 172.21.15.79:0/269748637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54f40038c0 msgr2=0x7f54f4003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:58.594 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.566 7f551240a700 1 --2- 172.21.15.79:0/269748637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54f40038c0 0x7f54f4003d70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f54fc00c000 tx=0x7f54fc00e4b0).stop 2021-04-09T18:25:58.594 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.566 7f551240a700 1 -- 172.21.15.79:0/269748637 shutdown_connections 2021-04-09T18:25:58.594 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.566 7f551240a700 1 --2- 172.21.15.79:0/269748637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54f40038c0 0x7f54f4003d70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:58.594 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.566 7f551240a700 1 -- 172.21.15.79:0/269748637 >> 172.21.15.79:0/269748637 conn(0x7f550c0e5fd0 msgr2=0x7f550c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:58.595 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.566 7f551240a700 1 -- 172.21.15.79:0/269748637 shutdown_connections 2021-04-09T18:25:58.595 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.566 7f551240a700 1 -- 172.21.15.79:0/269748637 wait complete. 2021-04-09T18:25:58.595 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.570 7f551240a700 1 Processor -- start 2021-04-09T18:25:58.595 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.570 7f551240a700 1 -- start start 2021-04-09T18:25:58.596 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.570 7f551240a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f550c0c0240 0x7f550c0c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:58.596 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.570 7f551240a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f550c0aed90 0x7f550c0af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:58.596 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.570 7f551240a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f550c1a7380 0x7f550c1a77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:58.597 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.570 7f551240a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c1c3db0 con 0x7f550c1a7380 2021-04-09T18:25:58.597 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.570 7f551240a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c0c11d0 con 0x7f550c0aed90 2021-04-09T18:25:58.597 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.570 7f551240a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550c0c14d0 con 0x7f550c0c0240 2021-04-09T18:25:58.597 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.570 7f55109af700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f550c1a7380 0x7f550c1a77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:58.598 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.570 7f550bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f550c0c0240 0x7f550c0c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:58.598 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.570 7f550bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f550c0c0240 0x7f550c0c2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:52100/0 (socket says 172.21.15.79:52100) 2021-04-09T18:25:58.598 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.570 7f550bfff700 1 -- 172.21.15.79:0/4233996297 learned_addr learned my addr 172.21.15.79:0/4233996297 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:25:58.598 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.570 7f550b7fe700 1 --2- 172.21.15.79:0/4233996297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f550c0aed90 0x7f550c0af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:58.599 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.574 7f550bfff700 1 -- 172.21.15.79:0/4233996297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f550c0aed90 msgr2=0x7f550c0af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:58.599 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.574 7f550bfff700 1 --2- 172.21.15.79:0/4233996297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f550c0aed90 0x7f550c0af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:58.599 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.574 7f550bfff700 1 -- 172.21.15.79:0/4233996297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f550c1a7380 msgr2=0x7f550c1a77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:58.599 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.574 7f550bfff700 1 --2- 172.21.15.79:0/4233996297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f550c1a7380 0x7f550c1a77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:58.599 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.574 7f550bfff700 1 -- 172.21.15.79:0/4233996297 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c0c30a0 con 0x7f550c0c0240 2021-04-09T18:25:58.600 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.574 7f550bfff700 1 --2- 172.21.15.79:0/4233996297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f550c0c0240 0x7f550c0c2a70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f550c0874c0 tx=0x7f54fc00a040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:58.600 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.574 7f5508ff9700 1 -- 172.21.15.79:0/4233996297 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f54fc01c800 con 0x7f550c0c0240 2021-04-09T18:25:58.600 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.574 7f5508ff9700 1 -- 172.21.15.79:0/4233996297 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54fc021030 con 0x7f550c0c0240 2021-04-09T18:25:58.600 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.574 7f551240a700 1 -- 172.21.15.79:0/4233996297 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550c0c0d60 con 0x7f550c0c0240 2021-04-09T18:25:58.601 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.574 7f5508ff9700 1 -- 172.21.15.79:0/4233996297 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f54fc01cbf0 con 0x7f550c0c0240 2021-04-09T18:25:58.601 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.574 7f551240a700 1 -- 172.21.15.79:0/4233996297 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550c1a7ff0 con 0x7f550c0c0240 2021-04-09T18:25:58.601 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.574 7f5508ff9700 1 -- 172.21.15.79:0/4233996297 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f54fc023020 con 0x7f550c0c0240 2021-04-09T18:25:58.601 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.574 7f5508ff9700 1 --2- 172.21.15.79:0/4233996297 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f54ec029100 0x7f54ec02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:58.601 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.574 7f5508ff9700 1 -- 172.21.15.79:0/4233996297 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1578+0+0 (secure 0 0 0) 0x7f54fc010040 con 0x7f550c0c0240 2021-04-09T18:25:58.602 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.574 7f550b7fe700 1 --2- 172.21.15.79:0/4233996297 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f54ec029100 0x7f54ec02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:58.602 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.574 7f550b7fe700 1 --2- 172.21.15.79:0/4233996297 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f54ec029100 0x7f54ec02b650 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:58.603 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.590 7f551240a700 1 -- 172.21.15.79:0/4233996297 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550c0e39d0 con 0x7f550c0c0240 2021-04-09T18:25:58.603 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.594 7f5508ff9700 1 -- 172.21.15.79:0/4233996297 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f54fc00eb10 con 0x7f550c0c0240 2021-04-09T18:25:58.876 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.870 7f551240a700 1 -- 172.21.15.79:0/4233996297 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f550c0a1cb0 con 0x7f550c0c0240 2021-04-09T18:25:58.877 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.870 7f5508ff9700 1 -- 172.21.15.79:0/4233996297 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+5464 (secure 0 0 0) 0x7f54fc01c400 con 0x7f550c0c0240 2021-04-09T18:25:58.877 INFO:teuthology.misc.health.smithi079.stdout: 2021-04-09T18:25:58.877 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":10,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:25:57.612208","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:25:58.880 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.870 7f551240a700 1 -- 172.21.15.79:0/4233996297 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f54ec029100 msgr2=0x7f54ec02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:58.880 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.870 7f551240a700 1 --2- 172.21.15.79:0/4233996297 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f54ec029100 0x7f54ec02b650 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:58.881 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.870 7f551240a700 1 -- 172.21.15.79:0/4233996297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f550c0c0240 msgr2=0x7f550c0c2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:58.881 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.870 7f551240a700 1 --2- 172.21.15.79:0/4233996297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f550c0c0240 0x7f550c0c2a70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f550c0874c0 tx=0x7f54fc00a040).stop 2021-04-09T18:25:58.881 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.870 7f551240a700 1 -- 172.21.15.79:0/4233996297 shutdown_connections 2021-04-09T18:25:58.882 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.870 7f551240a700 1 --2- 172.21.15.79:0/4233996297 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f54ec029100 0x7f54ec02b650 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:58.882 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.870 7f551240a700 1 --2- 172.21.15.79:0/4233996297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f550c1a7380 0x7f550c1a77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:58.882 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.870 7f551240a700 1 --2- 172.21.15.79:0/4233996297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f550c0c0240 0x7f550c0c2a70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:58.882 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.870 7f551240a700 1 --2- 172.21.15.79:0/4233996297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f550c0aed90 0x7f550c0af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:58.883 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.870 7f551240a700 1 -- 172.21.15.79:0/4233996297 >> 172.21.15.79:0/4233996297 conn(0x7f550c09a8c0 msgr2=0x7f550c099cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:58.883 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.870 7f551240a700 1 -- 172.21.15.79:0/4233996297 shutdown_connections 2021-04-09T18:25:58.883 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:25:58.870 7f551240a700 1 -- 172.21.15.79:0/4233996297 wait complete. 2021-04-09T18:25:58.890 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-04-09T18:25:59.655 INFO:tasks.ceph.osd.6.smithi089.stderr:2021-04-09 18:25:59.651 7f7b0a319c00 -1 osd.6 0 log_to_monitors {default=true} 2021-04-09T18:25:59.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2021-04-09 18:25:59.650 7f5ff6336c00 -1 osd.1 0 log_to_monitors {default=true} 2021-04-09T18:25:59.702 INFO:tasks.ceph.osd.5.smithi089.stderr:2021-04-09 18:25:59.699 7fca7a583c00 -1 osd.5 0 log_to_monitors {default=true} 2021-04-09T18:25:59.703 INFO:tasks.ceph.osd.7.smithi089.stderr:2021-04-09 18:25:59.699 7f5ec7077c00 -1 osd.7 0 log_to_monitors {default=true} 2021-04-09T18:25:59.704 INFO:tasks.ceph.osd.0.smithi079.stderr:2021-04-09 18:25:59.698 7f8b3da67c00 -1 osd.0 0 log_to_monitors {default=true} 2021-04-09T18:25:59.705 INFO:tasks.ceph.osd.2.smithi079.stderr:2021-04-09 18:25:59.698 7f46ca7c9c00 -1 osd.2 0 log_to_monitors {default=true} 2021-04-09T18:25:59.717 INFO:tasks.ceph.osd.3.smithi079.stderr:2021-04-09 18:25:59.710 7f30455cfc00 -1 osd.3 0 log_to_monitors {default=true} 2021-04-09T18:25:59.752 INFO:tasks.ceph.osd.4.smithi089.stderr:2021-04-09 18:25:59.747 7f95c2129c00 -1 osd.4 0 log_to_monitors {default=true} 2021-04-09T18:26:00.971 INFO:tasks.ceph.osd.2.smithi079.stderr:2021-04-09 18:26:00.962 7f46b08ee700 -1 osd.2 0 waiting for initial osdmap 2021-04-09T18:26:00.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2021-04-09 18:26:00.966 7f5fdc45b700 -1 osd.1 0 waiting for initial osdmap 2021-04-09T18:26:00.973 INFO:tasks.ceph.osd.0.smithi079.stderr:2021-04-09 18:26:00.966 7f8b23b8c700 -1 osd.0 0 waiting for initial osdmap 2021-04-09T18:26:00.976 INFO:tasks.ceph.osd.4.smithi089.stderr:2021-04-09 18:26:00.971 7f95a824e700 -1 osd.4 0 waiting for initial osdmap 2021-04-09T18:26:00.976 INFO:tasks.ceph.osd.7.smithi089.stderr:2021-04-09 18:26:00.971 7f5ead19c700 -1 osd.7 0 waiting for initial osdmap 2021-04-09T18:26:00.977 INFO:tasks.ceph.osd.5.smithi089.stderr:2021-04-09 18:26:00.971 7fca606a8700 -1 osd.5 0 waiting for initial osdmap 2021-04-09T18:26:00.977 INFO:tasks.ceph.osd.3.smithi079.stderr:2021-04-09 18:26:00.970 7f302b6f4700 -1 osd.3 0 waiting for initial osdmap 2021-04-09T18:26:00.979 INFO:tasks.ceph.osd.6.smithi089.stderr:2021-04-09 18:26:00.975 7f7af043e700 -1 osd.6 0 waiting for initial osdmap 2021-04-09T18:26:05.698 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:05.795 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f2364cbb700 1 Processor -- start 2021-04-09T18:26:05.796 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f2364cbb700 1 -- start start 2021-04-09T18:26:05.796 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f2364cbb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23600f5510 0x7f23600f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:05.796 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f2364cbb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23601c8000 0x7f23601ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:05.796 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f2364cbb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23600fbb10 con 0x7f23600e9ad0 2021-04-09T18:26:05.797 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f2364cbb700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23600e9f20 con 0x7f23601c8000 2021-04-09T18:26:05.797 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f2364cbb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23601c3db0 con 0x7f23600f5510 2021-04-09T18:26:05.797 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f235efe7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23601c8000 0x7f23601ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:05.797 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f235efe7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23601c8000 0x7f23601ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55330/0 (socket says 172.21.15.79:55330) 2021-04-09T18:26:05.798 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f235efe7700 1 -- 172.21.15.79:0/3160136775 learned_addr learned my addr 172.21.15.79:0/3160136775 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:05.798 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f235e7e6700 1 --2- 172.21.15.79:0/3160136775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23600f5510 0x7f23600f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:05.798 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f235efe7700 1 -- 172.21.15.79:0/3160136775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23600f5510 msgr2=0x7f23600f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:05.799 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f235efe7700 1 --2- 172.21.15.79:0/3160136775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23600f5510 0x7f23600f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:05.799 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f235efe7700 1 -- 172.21.15.79:0/3160136775 >> v1:172.21.15.89:6789/0 conn(0x7f23600e9ad0 legacy=0x7f236009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:05.799 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f235efe7700 1 -- 172.21.15.79:0/3160136775 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236009f900 con 0x7f23601c8000 2021-04-09T18:26:05.799 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f235e7e6700 1 --2- 172.21.15.79:0/3160136775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23600f5510 0x7f23600f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:05.800 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f235efe7700 1 --2- 172.21.15.79:0/3160136775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23601c8000 0x7f23601ca460 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f23580032b0 tx=0x7f235800b3c0).ready entity=mon.0 client_cookie=370a4b9c2dabac7f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:05.800 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f235d7e4700 1 -- 172.21.15.79:0/3160136775 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f236009f900 con 0x7f23601c8000 2021-04-09T18:26:05.800 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f235d7e4700 1 -- 172.21.15.79:0/3160136775 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235800bc20 con 0x7f23601c8000 2021-04-09T18:26:05.801 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f235d7e4700 1 -- 172.21.15.79:0/3160136775 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2358002020 con 0x7f23601c8000 2021-04-09T18:26:05.801 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f2364cbb700 1 -- 172.21.15.79:0/3160136775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23601c8000 msgr2=0x7f23601ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:05.802 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.782 7f2364cbb700 1 --2- 172.21.15.79:0/3160136775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23601c8000 0x7f23601ca460 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f23580032b0 tx=0x7f235800b3c0).stop 2021-04-09T18:26:05.802 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.786 7f2364cbb700 1 -- 172.21.15.79:0/3160136775 shutdown_connections 2021-04-09T18:26:05.802 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.786 7f2364cbb700 1 --2- 172.21.15.79:0/3160136775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23601c8000 0x7f23601ca460 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:05.802 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.786 7f2364cbb700 1 --2- 172.21.15.79:0/3160136775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23600f5510 0x7f23600f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:05.803 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.786 7f2364cbb700 1 -- 172.21.15.79:0/3160136775 >> 172.21.15.79:0/3160136775 conn(0x7f23600e5fd0 msgr2=0x7f23600e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:05.803 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.786 7f2364cbb700 1 -- 172.21.15.79:0/3160136775 shutdown_connections 2021-04-09T18:26:05.803 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.786 7f2364cbb700 1 -- 172.21.15.79:0/3160136775 wait complete. 2021-04-09T18:26:05.806 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f2364cbb700 1 Processor -- start 2021-04-09T18:26:05.807 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f2364cbb700 1 -- start start 2021-04-09T18:26:05.807 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f2364cbb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23600d55f0 0x7f23600d6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:05.807 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f2364cbb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23600cf870 0x7f23600cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:05.808 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f2364cbb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23600acaf0 0x7f23600acf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:05.808 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f2364cbb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23600ac7f0 con 0x7f23600acaf0 2021-04-09T18:26:05.808 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f2364cbb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23600abc80 con 0x7f23600d55f0 2021-04-09T18:26:05.808 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f2364cbb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23600ac380 con 0x7f23600cf870 2021-04-09T18:26:05.808 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f235efe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23600acaf0 0x7f23600acf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:05.809 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f235efe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23600acaf0 0x7f23600acf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55336/0 (socket says 172.21.15.79:55336) 2021-04-09T18:26:05.809 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f235efe7700 1 -- 172.21.15.79:0/1546549845 learned_addr learned my addr 172.21.15.79:0/1546549845 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:05.809 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f235e7e6700 1 --2- 172.21.15.79:0/1546549845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23600d55f0 0x7f23600d6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:05.809 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f235dfe5700 1 --2- 172.21.15.79:0/1546549845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23600cf870 0x7f23600cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:05.809 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f235efe7700 1 -- 172.21.15.79:0/1546549845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23600cf870 msgr2=0x7f23600cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:05.810 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f235efe7700 1 --2- 172.21.15.79:0/1546549845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23600cf870 0x7f23600cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:05.810 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f235efe7700 1 -- 172.21.15.79:0/1546549845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23600d55f0 msgr2=0x7f23600d6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:05.810 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f235efe7700 1 --2- 172.21.15.79:0/1546549845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23600d55f0 0x7f23600d6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:05.811 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f235efe7700 1 -- 172.21.15.79:0/1546549845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23600d71f0 con 0x7f23600acaf0 2021-04-09T18:26:05.811 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f235efe7700 1 --2- 172.21.15.79:0/1546549845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23600acaf0 0x7f23600acf40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f23580032b0 tx=0x7f2358006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:05.811 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f234effd700 1 -- 172.21.15.79:0/1546549845 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f23600d71f0 con 0x7f23600acaf0 2021-04-09T18:26:05.812 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f234effd700 1 -- 172.21.15.79:0/1546549845 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235801a5d0 con 0x7f23600acaf0 2021-04-09T18:26:05.812 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f2364cbb700 1 -- 172.21.15.79:0/1546549845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23600ad570 con 0x7f23600acaf0 2021-04-09T18:26:05.813 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f234effd700 1 -- 172.21.15.79:0/1546549845 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2358020020 con 0x7f23600acaf0 2021-04-09T18:26:05.813 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.790 7f2364cbb700 1 -- 172.21.15.79:0/1546549845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236009a0a0 con 0x7f23600acaf0 2021-04-09T18:26:05.814 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.794 7f234effd700 1 -- 172.21.15.79:0/1546549845 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2358019040 con 0x7f23600acaf0 2021-04-09T18:26:05.814 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.794 7f234effd700 1 --2- 172.21.15.79:0/1546549845 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2344029100 0x7f234402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:05.814 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.794 7f234effd700 1 -- 172.21.15.79:0/1546549845 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4404+0+0 (secure 0 0 0) 0x7f2358018040 con 0x7f23600acaf0 2021-04-09T18:26:05.815 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.794 7f235e7e6700 1 --2- 172.21.15.79:0/1546549845 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2344029100 0x7f234402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:05.815 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.794 7f235e7e6700 1 --2- 172.21.15.79:0/1546549845 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2344029100 0x7f234402b650 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:05.815 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.794 7f2364cbb700 1 -- 172.21.15.79:0/1546549845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23600e39d0 con 0x7f23600acaf0 2021-04-09T18:26:05.816 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.802 7f234effd700 1 -- 172.21.15.79:0/1546549845 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f235800ba10 con 0x7f23600acaf0 2021-04-09T18:26:05.985 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.978 7f2364cbb700 1 -- 172.21.15.79:0/1546549845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23600f5b10 con 0x7f23600acaf0 2021-04-09T18:26:05.986 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.978 7f234effd700 1 -- 172.21.15.79:0/1546549845 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+9772 (secure 0 0 0) 0x7f235801a3c0 con 0x7f23600acaf0 2021-04-09T18:26:05.988 INFO:teuthology.misc.health.smithi079.stdout: 2021-04-09T18:26:05.989 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":13,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:01.966378","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:26:05.991 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.982 7f2364cbb700 1 -- 172.21.15.79:0/1546549845 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2344029100 msgr2=0x7f234402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:05.991 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.982 7f2364cbb700 1 --2- 172.21.15.79:0/1546549845 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2344029100 0x7f234402b650 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:05.991 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.982 7f2364cbb700 1 -- 172.21.15.79:0/1546549845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23600acaf0 msgr2=0x7f23600acf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:05.992 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.982 7f2364cbb700 1 --2- 172.21.15.79:0/1546549845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23600acaf0 0x7f23600acf40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f23580032b0 tx=0x7f2358006c10).stop 2021-04-09T18:26:05.992 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.982 7f2364cbb700 1 -- 172.21.15.79:0/1546549845 shutdown_connections 2021-04-09T18:26:05.992 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.982 7f2364cbb700 1 --2- 172.21.15.79:0/1546549845 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2344029100 0x7f234402b650 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:05.992 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.982 7f2364cbb700 1 --2- 172.21.15.79:0/1546549845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23600d55f0 0x7f23600d6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:05.993 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.982 7f2364cbb700 1 --2- 172.21.15.79:0/1546549845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23600acaf0 0x7f23600acf40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:05.993 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.982 7f2364cbb700 1 --2- 172.21.15.79:0/1546549845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23600cf870 0x7f23600cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:05.993 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.982 7f2364cbb700 1 -- 172.21.15.79:0/1546549845 >> 172.21.15.79:0/1546549845 conn(0x7f2360093db0 msgr2=0x7f23600d8810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:05.993 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.982 7f2364cbb700 1 -- 172.21.15.79:0/1546549845 shutdown_connections 2021-04-09T18:26:05.993 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:05.982 7f2364cbb700 1 -- 172.21.15.79:0/1546549845 wait complete. 2021-04-09T18:26:05.999 DEBUG:teuthology.misc:8 of 8 OSDs are up 2021-04-09T18:26:06.000 INFO:tasks.ceph:Creating RBD pool 2021-04-09T18:26:06.000 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd pool create rbd 8 2021-04-09T18:26:06.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.082 7ff7002c3700 1 Processor -- start 2021-04-09T18:26:06.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.082 7ff7002c3700 1 -- start start 2021-04-09T18:26:06.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.082 7ff7002c3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff6f80f5550 0x7ff6f80f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:06.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.082 7ff7002c3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f80fbb50 con 0x7ff6f81c8040 2021-04-09T18:26:06.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.082 7ff7002c3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f809f910 con 0x7ff6f80e9b10 2021-04-09T18:26:06.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.082 7ff7002c3700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f80e9f60 con 0x7ff6f80f5550 2021-04-09T18:26:06.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.082 7ff6fe067700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff6f80f5550 0x7ff6f80f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:06.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.082 7ff6fe067700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff6f80f5550 0x7ff6f80f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55340/0 (socket says 172.21.15.79:55340) 2021-04-09T18:26:06.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.082 7ff6fe067700 1 -- 172.21.15.79:0/1039986194 learned_addr learned my addr 172.21.15.79:0/1039986194 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:06.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.082 7ff6fe067700 1 -- 172.21.15.79:0/1039986194 >> v1:172.21.15.89:6789/0 conn(0x7ff6f80e9b10 legacy=0x7ff6f809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:06.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.082 7ff6fe067700 1 -- 172.21.15.79:0/1039986194 >> v1:172.21.15.79:6789/0 conn(0x7ff6f81c8040 legacy=0x7ff6f81ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:06.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.082 7ff6fe067700 1 -- 172.21.15.79:0/1039986194 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f80e5700 con 0x7ff6f80f5550 2021-04-09T18:26:06.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.082 7ff6fe067700 1 --2- 172.21.15.79:0/1039986194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f80f5550 0x7ff6f80f64e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff6f4002f30 tx=0x7ff6f400bd20).ready entity=mon.0 client_cookie=517037be76f7f2b3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:06.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.082 7ff6fd065700 1 -- 172.21.15.79:0/1039986194 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff6f80e5700 con 0x7ff6f80f5550 2021-04-09T18:26:06.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.082 7ff6fd065700 1 -- 172.21.15.79:0/1039986194 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f4009a20 con 0x7ff6f80f5550 2021-04-09T18:26:06.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.082 7ff6fd065700 1 -- 172.21.15.79:0/1039986194 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff6f4009df0 con 0x7ff6f80f5550 2021-04-09T18:26:06.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.082 7ff7002c3700 1 -- 172.21.15.79:0/1039986194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f80f5550 msgr2=0x7ff6f80f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:06.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.082 7ff7002c3700 1 --2- 172.21.15.79:0/1039986194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f80f5550 0x7ff6f80f64e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff6f4002f30 tx=0x7ff6f400bd20).stop 2021-04-09T18:26:06.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.086 7ff7002c3700 1 -- 172.21.15.79:0/1039986194 shutdown_connections 2021-04-09T18:26:06.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.086 7ff7002c3700 1 --2- 172.21.15.79:0/1039986194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f80f5550 0x7ff6f80f64e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:06.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.086 7ff7002c3700 1 -- 172.21.15.79:0/1039986194 >> 172.21.15.79:0/1039986194 conn(0x7ff6f80e6010 msgr2=0x7ff6f80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:06.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.086 7ff7002c3700 1 -- 172.21.15.79:0/1039986194 shutdown_connections 2021-04-09T18:26:06.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.086 7ff7002c3700 1 -- 172.21.15.79:0/1039986194 wait complete. 2021-04-09T18:26:06.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.086 7ff7002c3700 1 Processor -- start 2021-04-09T18:26:06.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.086 7ff7002c3700 1 -- start start 2021-04-09T18:26:06.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff7002c3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6f80add60 0x7ff6f80ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:06.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff7002c3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6f81cf9e0 0x7ff6f81cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:06.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff7002c3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f80a8780 0x7ff6f80a8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:06.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff7002c3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f81c3df0 con 0x7ff6f80a8780 2021-04-09T18:26:06.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff7002c3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f80af130 con 0x7ff6f81cf9e0 2021-04-09T18:26:06.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff7002c3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f80af430 con 0x7ff6f80add60 2021-04-09T18:26:06.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff6fe868700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f80a8780 0x7ff6f80a8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:06.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff6fe868700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f80a8780 0x7ff6f80a8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55350/0 (socket says 172.21.15.79:55350) 2021-04-09T18:26:06.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff6fe868700 1 -- 172.21.15.79:0/848918403 learned_addr learned my addr 172.21.15.79:0/848918403 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:06.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff6fe067700 1 --2- 172.21.15.79:0/848918403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6f80add60 0x7ff6f80ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:06.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff6fd866700 1 --2- 172.21.15.79:0/848918403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6f81cf9e0 0x7ff6f81cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:06.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff6fe868700 1 -- 172.21.15.79:0/848918403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6f80add60 msgr2=0x7ff6f80ae1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:06.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff6fe868700 1 --2- 172.21.15.79:0/848918403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6f80add60 0x7ff6f80ae1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:06.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff6fe868700 1 -- 172.21.15.79:0/848918403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6f81cf9e0 msgr2=0x7ff6f81cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:06.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff6fe868700 1 --2- 172.21.15.79:0/848918403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6f81cf9e0 0x7ff6f81cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:06.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff6fe868700 1 -- 172.21.15.79:0/848918403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f80aecc0 con 0x7ff6f80a8780 2021-04-09T18:26:06.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff6fe868700 1 --2- 172.21.15.79:0/848918403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f80a8780 0x7ff6f80a8bd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff6f80d8170 tx=0x7ff6f000cec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:06.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff6eeffd700 1 -- 172.21.15.79:0/848918403 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff6f80aecc0 con 0x7ff6f80a8780 2021-04-09T18:26:06.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff6eeffd700 1 -- 172.21.15.79:0/848918403 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f0006a80 con 0x7ff6f80a8780 2021-04-09T18:26:06.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff7002c3700 1 -- 172.21.15.79:0/848918403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f80b09d0 con 0x7ff6f80a8780 2021-04-09T18:26:06.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff6eeffd700 1 -- 172.21.15.79:0/848918403 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff6f0007030 con 0x7ff6f80a8780 2021-04-09T18:26:06.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff7002c3700 1 -- 172.21.15.79:0/848918403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f80a9200 con 0x7ff6f80a8780 2021-04-09T18:26:06.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff6eeffd700 1 -- 172.21.15.79:0/848918403 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff6f001a020 con 0x7ff6f80a8780 2021-04-09T18:26:06.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff6eeffd700 1 --2- 172.21.15.79:0/848918403 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff6e0029100 0x7ff6e002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:06.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff6eeffd700 1 -- 172.21.15.79:0/848918403 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4404+0+0 (secure 0 0 0) 0x7ff6f0038fc0 con 0x7ff6f80a8780 2021-04-09T18:26:06.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff6fe067700 1 --2- 172.21.15.79:0/848918403 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff6e0029100 0x7ff6e002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:06.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.090 7ff6fe067700 1 --2- 172.21.15.79:0/848918403 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff6e0029100 0x7ff6e002b650 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:06.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.094 7ff7002c3700 1 -- 172.21.15.79:0/848918403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f80e39f0 con 0x7ff6f80a8780 2021-04-09T18:26:06.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.098 7ff6eeffd700 1 -- 172.21.15.79:0/848918403 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff6f0006870 con 0x7ff6f80a8780 2021-04-09T18:26:06.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:06.254 7ff7002c3700 1 -- 172.21.15.79:0/848918403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "rbd"} v 0) v1 -- 0x7ff6f80a1c90 con 0x7ff6f80a8780 2021-04-09T18:26:07.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.042 7ff6eeffd700 1 -- 172.21.15.79:0/848918403 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "rbd"}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7ff6f0000f70 con 0x7ff6f80a8780 2021-04-09T18:26:07.077 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'rbd' created 2021-04-09T18:26:07.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.074 7ff7002c3700 1 -- 172.21.15.79:0/848918403 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff6e0029100 msgr2=0x7ff6e002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:07.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.074 7ff7002c3700 1 --2- 172.21.15.79:0/848918403 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff6e0029100 0x7ff6e002b650 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.074 7ff7002c3700 1 -- 172.21.15.79:0/848918403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f80a8780 msgr2=0x7ff6f80a8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:07.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.074 7ff7002c3700 1 --2- 172.21.15.79:0/848918403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f80a8780 0x7ff6f80a8bd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff6f80d8170 tx=0x7ff6f000cec0).stop 2021-04-09T18:26:07.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.074 7ff7002c3700 1 -- 172.21.15.79:0/848918403 shutdown_connections 2021-04-09T18:26:07.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.074 7ff7002c3700 1 --2- 172.21.15.79:0/848918403 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff6e0029100 0x7ff6e002b650 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.074 7ff7002c3700 1 --2- 172.21.15.79:0/848918403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f80a8780 0x7ff6f80a8bd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.074 7ff7002c3700 1 --2- 172.21.15.79:0/848918403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6f80add60 0x7ff6f80ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.074 7ff7002c3700 1 --2- 172.21.15.79:0/848918403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6f81cf9e0 0x7ff6f81cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.074 7ff7002c3700 1 -- 172.21.15.79:0/848918403 >> 172.21.15.79:0/848918403 conn(0x7ff6f809abe0 msgr2=0x7ff6f80ba6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:07.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.074 7ff7002c3700 1 -- 172.21.15.79:0/848918403 shutdown_connections 2021-04-09T18:26:07.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.074 7ff7002c3700 1 -- 172.21.15.79:0/848918403 wait complete. 2021-04-09T18:26:07.093 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2021-04-09T18:26:07.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.178 7f9ead81e700 1 Processor -- start 2021-04-09T18:26:07.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.178 7f9ead81e700 1 -- start start 2021-04-09T18:26:07.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.178 7f9ead81e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9ea80f5550 0x7f9ea80f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:07.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.178 7f9ead81e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea80fbb50 con 0x7f9ea80e9b10 2021-04-09T18:26:07.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.178 7f9ead81e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea809f910 con 0x7f9ea81c8040 2021-04-09T18:26:07.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.178 7f9ead81e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea80e9f60 con 0x7f9ea80f5550 2021-04-09T18:26:07.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.178 7f9ea7550700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9ea80f5550 0x7f9ea80f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:07.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.178 7f9ea7550700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9ea80f5550 0x7f9ea80f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55354/0 (socket says 172.21.15.79:55354) 2021-04-09T18:26:07.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.178 7f9ea7550700 1 -- 172.21.15.79:0/2974695156 learned_addr learned my addr 172.21.15.79:0/2974695156 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:07.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.178 7f9ea6d4f700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9ea80e9b10 0x7f9ea809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50066/0 (socket says 172.21.15.79:50066) 2021-04-09T18:26:07.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.182 7f9ea7550700 1 -- 172.21.15.79:0/2974695156 >> v1:172.21.15.89:6789/0 conn(0x7f9ea81c8040 legacy=0x7f9ea81ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:07.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.182 7f9ea7550700 1 -- 172.21.15.79:0/2974695156 >> v1:172.21.15.79:6789/0 conn(0x7f9ea80e9b10 legacy=0x7f9ea809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:07.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.182 7f9ea654e700 1 -- 172.21.15.79:0/2974695156 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447781216 0 0) 0x7f9e900010d0 con 0x7f9ea80e9b10 2021-04-09T18:26:07.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.182 7f9ea7550700 1 -- 172.21.15.79:0/2974695156 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea80e5700 con 0x7f9ea80f5550 2021-04-09T18:26:07.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.182 7f9ea7550700 1 --2- 172.21.15.79:0/2974695156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea80f5550 0x7f9ea80f64e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9e980032b0 tx=0x7f9e9800b3c0).ready entity=mon.0 client_cookie=94ea3b2067f91d30 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:07.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.182 7f9ea654e700 1 -- 172.21.15.79:0/2974695156 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9ea80e5700 con 0x7f9ea80f5550 2021-04-09T18:26:07.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.182 7f9ea654e700 1 -- 172.21.15.79:0/2974695156 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9800bca0 con 0x7f9ea80f5550 2021-04-09T18:26:07.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.182 7f9ea654e700 1 -- 172.21.15.79:0/2974695156 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9e98002020 con 0x7f9ea80f5550 2021-04-09T18:26:07.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.182 7f9ead81e700 1 -- 172.21.15.79:0/2974695156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea80f5550 msgr2=0x7f9ea80f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:07.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.182 7f9ead81e700 1 --2- 172.21.15.79:0/2974695156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea80f5550 0x7f9ea80f64e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9e980032b0 tx=0x7f9e9800b3c0).stop 2021-04-09T18:26:07.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.182 7f9ead81e700 1 -- 172.21.15.79:0/2974695156 shutdown_connections 2021-04-09T18:26:07.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.182 7f9ead81e700 1 --2- 172.21.15.79:0/2974695156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea80f5550 0x7f9ea80f64e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.182 7f9ead81e700 1 -- 172.21.15.79:0/2974695156 >> 172.21.15.79:0/2974695156 conn(0x7f9ea80e6010 msgr2=0x7f9ea80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:07.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.182 7f9ead81e700 1 -- 172.21.15.79:0/2974695156 shutdown_connections 2021-04-09T18:26:07.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.182 7f9ead81e700 1 -- 172.21.15.79:0/2974695156 wait complete. 2021-04-09T18:26:07.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ead81e700 1 Processor -- start 2021-04-09T18:26:07.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ead81e700 1 -- start start 2021-04-09T18:26:07.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ead81e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ea81d4c00 0x7f9ea81d5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:07.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ead81e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ea81d5680 0x7f9ea80bba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:07.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ead81e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea80bc0a0 0x7f9ea80bc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:07.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ead81e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea81c3df0 con 0x7f9ea80bc0a0 2021-04-09T18:26:07.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ead81e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea80b19f0 con 0x7f9ea81d5680 2021-04-09T18:26:07.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ead81e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea81d5ad0 con 0x7f9ea81d4c00 2021-04-09T18:26:07.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ea7d51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea80bc0a0 0x7f9ea80bc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:07.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ea7d51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea80bc0a0 0x7f9ea80bc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55364/0 (socket says 172.21.15.79:55364) 2021-04-09T18:26:07.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ea7d51700 1 -- 172.21.15.79:0/3117330558 learned_addr learned my addr 172.21.15.79:0/3117330558 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:07.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ea7550700 1 --2- 172.21.15.79:0/3117330558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ea81d4c00 0x7f9ea81d5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:07.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ea6d4f700 1 --2- 172.21.15.79:0/3117330558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ea81d5680 0x7f9ea80bba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:07.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ea7d51700 1 -- 172.21.15.79:0/3117330558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ea81d4c00 msgr2=0x7f9ea81d5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:07.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ea7d51700 1 --2- 172.21.15.79:0/3117330558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ea81d4c00 0x7f9ea81d5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ea7d51700 1 -- 172.21.15.79:0/3117330558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ea81d5680 msgr2=0x7f9ea80bba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:07.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ea7d51700 1 --2- 172.21.15.79:0/3117330558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ea81d5680 0x7f9ea80bba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ea7d51700 1 -- 172.21.15.79:0/3117330558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea80b1580 con 0x7f9ea80bc0a0 2021-04-09T18:26:07.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ea7d51700 1 --2- 172.21.15.79:0/3117330558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea80bc0a0 0x7f9ea80bc4f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9ea80d82a0 tx=0x7f9ea000ca60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:07.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9e9ffff700 1 -- 172.21.15.79:0/3117330558 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9ea80b1580 con 0x7f9ea80bc0a0 2021-04-09T18:26:07.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9e9ffff700 1 -- 172.21.15.79:0/3117330558 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea0007240 con 0x7f9ea80bc0a0 2021-04-09T18:26:07.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ead81e700 1 -- 172.21.15.79:0/3117330558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea81d0be0 con 0x7f9ea80bc0a0 2021-04-09T18:26:07.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9e9ffff700 1 -- 172.21.15.79:0/3117330558 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9ea00066e0 con 0x7f9ea80bc0a0 2021-04-09T18:26:07.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ead81e700 1 -- 172.21.15.79:0/3117330558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea81d10f0 con 0x7f9ea80bc0a0 2021-04-09T18:26:07.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9e9ffff700 1 -- 172.21.15.79:0/3117330558 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9ea00068e0 con 0x7f9ea80bc0a0 2021-04-09T18:26:07.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9e9ffff700 1 --2- 172.21.15.79:0/3117330558 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9e8c029100 0x7f9e8c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:07.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9e9ffff700 1 -- 172.21.15.79:0/3117330558 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4746+0+0 (secure 0 0 0) 0x7f9ea0038a50 con 0x7f9ea80bc0a0 2021-04-09T18:26:07.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.186 7f9ea7550700 1 --2- 172.21.15.79:0/3117330558 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9e8c029100 0x7f9e8c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:07.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.190 7f9ea7550700 1 --2- 172.21.15.79:0/3117330558 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9e8c029100 0x7f9e8c02b650 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:07.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.194 7f9ead81e700 1 -- 172.21.15.79:0/3117330558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea80e39f0 con 0x7f9ea80bc0a0 2021-04-09T18:26:07.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.198 7f9e9ffff700 1 -- 172.21.15.79:0/3117330558 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9ea0007030 con 0x7f9ea80bc0a0 2021-04-09T18:26:07.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:07.354 7f9ead81e700 1 -- 172.21.15.79:0/3117330558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool application enable", "app": "rbd", "pool": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9ea80a1c90 con 0x7f9ea80bc0a0 2021-04-09T18:26:08.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.042 7f9e9ffff700 1 -- 172.21.15.79:0/3117330558 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "app": "rbd", "pool": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f9ea80f76f0 con 0x7f9ea80bc0a0 2021-04-09T18:26:08.075 INFO:teuthology.orchestra.run.smithi079.stderr:enabled application 'rbd' on pool 'rbd' 2021-04-09T18:26:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.070 7f9ead81e700 1 -- 172.21.15.79:0/3117330558 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9e8c029100 msgr2=0x7f9e8c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.070 7f9ead81e700 1 --2- 172.21.15.79:0/3117330558 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9e8c029100 0x7f9e8c02b650 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.070 7f9ead81e700 1 -- 172.21.15.79:0/3117330558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea80bc0a0 msgr2=0x7f9ea80bc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.070 7f9ead81e700 1 --2- 172.21.15.79:0/3117330558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea80bc0a0 0x7f9ea80bc4f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9ea80d82a0 tx=0x7f9ea000ca60).stop 2021-04-09T18:26:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.070 7f9ead81e700 1 -- 172.21.15.79:0/3117330558 shutdown_connections 2021-04-09T18:26:08.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.070 7f9ead81e700 1 --2- 172.21.15.79:0/3117330558 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9e8c029100 0x7f9e8c02b650 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.070 7f9ead81e700 1 --2- 172.21.15.79:0/3117330558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea80bc0a0 0x7f9ea80bc4f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.070 7f9ead81e700 1 --2- 172.21.15.79:0/3117330558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ea81d4c00 0x7f9ea81d5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.070 7f9ead81e700 1 --2- 172.21.15.79:0/3117330558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ea81d5680 0x7f9ea80bba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.070 7f9ead81e700 1 -- 172.21.15.79:0/3117330558 >> 172.21.15.79:0/3117330558 conn(0x7f9ea8094000 msgr2=0x7f9ea80c2140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:08.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.070 7f9ead81e700 1 -- 172.21.15.79:0/3117330558 shutdown_connections 2021-04-09T18:26:08.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.070 7f9ead81e700 1 -- 172.21.15.79:0/3117330558 wait complete. 2021-04-09T18:26:08.091 INFO:tasks.ceph:Setting up CephFS filesystem... 2021-04-09T18:26:08.092 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:08.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.178 7fb092c2e700 1 Processor -- start 2021-04-09T18:26:08.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.178 7fb092c2e700 1 -- start start 2021-04-09T18:26:08.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.178 7fb092c2e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb08c0f5510 0x7fb08c0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:08.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.178 7fb092c2e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb08c0e9ad0 0x7fb08c09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:08.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.178 7fb092c2e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c0fbb10 con 0x7fb08c1c2da0 2021-04-09T18:26:08.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.178 7fb092c2e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08c0e9f20 con 0x7fb08c0f5510 2021-04-09T18:26:08.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.178 7fb092c2e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c0e59c0 con 0x7fb08c0e9ad0 2021-04-09T18:26:08.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.178 7fb0909d2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb08c0f5510 0x7fb08c0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:08.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.178 7fb0911d3700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb08c1c2da0 0x7fb08c1c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50082/0 (socket says 172.21.15.79:50082) 2021-04-09T18:26:08.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.178 7fb0911d3700 1 -- 172.21.15.79:0/1676675668 learned_addr learned my addr 172.21.15.79:0/1676675668 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:08.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.178 7fb08bfff700 1 --2- 172.21.15.79:0/1676675668 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb08c0e9ad0 0x7fb08c09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:08.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.178 7fb08b7fe700 1 -- 172.21.15.79:0/1676675668 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009779533 0 0) 0x7fb084001450 con 0x7fb08c1c2da0 2021-04-09T18:26:08.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.178 7fb0909d2700 1 -- 172.21.15.79:0/1676675668 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb08c0e9ad0 msgr2=0x7fb08c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:08.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.178 7fb0909d2700 1 --2- 172.21.15.79:0/1676675668 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb08c0e9ad0 0x7fb08c09f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.178 7fb0909d2700 1 -- 172.21.15.79:0/1676675668 >> v1:172.21.15.79:6789/0 conn(0x7fb08c1c2da0 legacy=0x7fb08c1c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:08.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.178 7fb0909d2700 1 -- 172.21.15.79:0/1676675668 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0e56c0 con 0x7fb08c0f5510 2021-04-09T18:26:08.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.178 7fb0909d2700 1 --2- 172.21.15.79:0/1676675668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb08c0f5510 0x7fb08c0f64a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb07c002f30 tx=0x7fb07c00bd40).ready entity=mon.0 client_cookie=729813b8f20f1c44 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:08.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.182 7fb08b7fe700 1 -- 172.21.15.79:0/1676675668 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb08c0e56c0 con 0x7fb08c0f5510 2021-04-09T18:26:08.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.182 7fb08b7fe700 1 -- 172.21.15.79:0/1676675668 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c009850 con 0x7fb08c0f5510 2021-04-09T18:26:08.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.182 7fb08b7fe700 1 -- 172.21.15.79:0/1676675668 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb07c009c20 con 0x7fb08c0f5510 2021-04-09T18:26:08.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.182 7fb092c2e700 1 -- 172.21.15.79:0/1676675668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb08c0f5510 msgr2=0x7fb08c0f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:08.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.182 7fb092c2e700 1 --2- 172.21.15.79:0/1676675668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb08c0f5510 0x7fb08c0f64a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb07c002f30 tx=0x7fb07c00bd40).stop 2021-04-09T18:26:08.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.182 7fb092c2e700 1 -- 172.21.15.79:0/1676675668 shutdown_connections 2021-04-09T18:26:08.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.182 7fb092c2e700 1 --2- 172.21.15.79:0/1676675668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb08c0f5510 0x7fb08c0f64a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.182 7fb092c2e700 1 --2- 172.21.15.79:0/1676675668 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb08c0e9ad0 0x7fb08c09f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.182 7fb092c2e700 1 -- 172.21.15.79:0/1676675668 >> 172.21.15.79:0/1676675668 conn(0x7fb08c0e5fd0 msgr2=0x7fb08c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:08.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.182 7fb092c2e700 1 -- 172.21.15.79:0/1676675668 shutdown_connections 2021-04-09T18:26:08.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.182 7fb092c2e700 1 -- 172.21.15.79:0/1676675668 wait complete. 2021-04-09T18:26:08.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.186 7fb092c2e700 1 Processor -- start 2021-04-09T18:26:08.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.186 7fb092c2e700 1 -- start start 2021-04-09T18:26:08.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.186 7fb092c2e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb08c0c3a30 0x7fb08c0c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:08.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.186 7fb092c2e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb08c0bb010 0x7fb08c098330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:08.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.186 7fb092c2e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb08c098960 0x7fb08c0c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:08.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.186 7fb092c2e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c098030 con 0x7fb08c0bb010 2021-04-09T18:26:08.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.186 7fb092c2e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c1c0980 con 0x7fb08c098960 2021-04-09T18:26:08.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.186 7fb092c2e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c098db0 con 0x7fb08c0c3a30 2021-04-09T18:26:08.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.186 7fb08bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb08c0bb010 0x7fb08c098330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:08.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.186 7fb08bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb08c0bb010 0x7fb08c098330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55376/0 (socket says 172.21.15.79:55376) 2021-04-09T18:26:08.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.186 7fb08bfff700 1 -- 172.21.15.79:0/168065737 learned_addr learned my addr 172.21.15.79:0/168065737 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:08.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.186 7fb0909d2700 1 --2- 172.21.15.79:0/168065737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb08c0c3a30 0x7fb08c0c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:08.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.186 7fb0911d3700 1 --2- 172.21.15.79:0/168065737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb08c098960 0x7fb08c0c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:08.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.186 7fb08bfff700 1 -- 172.21.15.79:0/168065737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb08c0c3a30 msgr2=0x7fb08c0c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:08.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.186 7fb08bfff700 1 --2- 172.21.15.79:0/168065737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb08c0c3a30 0x7fb08c0c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.190 7fb08bfff700 1 -- 172.21.15.79:0/168065737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb08c098960 msgr2=0x7fb08c0c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:08.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.190 7fb08bfff700 1 --2- 172.21.15.79:0/168065737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb08c098960 0x7fb08c0c4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.190 7fb08bfff700 1 -- 172.21.15.79:0/168065737 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0d68e0 con 0x7fb08c0bb010 2021-04-09T18:26:08.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.190 7fb08bfff700 1 --2- 172.21.15.79:0/168065737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb08c0bb010 0x7fb08c098330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb08c0c0bc0 tx=0x7fb08000c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:08.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.190 7fb0897fa700 1 -- 172.21.15.79:0/168065737 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb08c0d68e0 con 0x7fb08c0bb010 2021-04-09T18:26:08.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.190 7fb092c2e700 1 -- 172.21.15.79:0/168065737 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08c0bb460 con 0x7fb08c0bb010 2021-04-09T18:26:08.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.190 7fb0897fa700 1 -- 172.21.15.79:0/168065737 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08000cc10 con 0x7fb08c0bb010 2021-04-09T18:26:08.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.190 7fb0897fa700 1 -- 172.21.15.79:0/168065737 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb08000f040 con 0x7fb08c0bb010 2021-04-09T18:26:08.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.190 7fb092c2e700 1 -- 172.21.15.79:0/168065737 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08c0c4ac0 con 0x7fb08c0bb010 2021-04-09T18:26:08.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.190 7fb0897fa700 1 -- 172.21.15.79:0/168065737 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb080011070 con 0x7fb08c0bb010 2021-04-09T18:26:08.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.190 7fb0897fa700 1 --2- 172.21.15.79:0/168065737 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb06c029100 0x7fb06c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:08.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.190 7fb0897fa700 1 -- 172.21.15.79:0/168065737 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4757+0+0 (secure 0 0 0) 0x7fb080010040 con 0x7fb08c0bb010 2021-04-09T18:26:08.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.190 7fb0909d2700 1 --2- 172.21.15.79:0/168065737 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb06c029100 0x7fb06c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:08.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.190 7fb0909d2700 1 --2- 172.21.15.79:0/168065737 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb06c029100 0x7fb06c02b650 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:08.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.206 7fb092c2e700 1 -- 172.21.15.79:0/168065737 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08c0e39d0 con 0x7fb08c0bb010 2021-04-09T18:26:08.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.214 7fb0897fa700 1 -- 172.21.15.79:0/168065737 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb080000bf0 con 0x7fb08c0bb010 2021-04-09T18:26:08.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.386 7fb092c2e700 1 -- 172.21.15.79:0/168065737 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb08c0f5b10 con 0x7fb08c0bb010 2021-04-09T18:26:08.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.386 7fb0897fa700 1 -- 172.21.15.79:0/168065737 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11155 (secure 0 0 0) 0x7fb08000c810 con 0x7fb08c0bb010 2021-04-09T18:26:08.397 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:08.398 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":15,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:08.040728","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:26:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.390 7fb092c2e700 1 -- 172.21.15.79:0/168065737 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb06c029100 msgr2=0x7fb06c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.390 7fb092c2e700 1 --2- 172.21.15.79:0/168065737 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb06c029100 0x7fb06c02b650 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.390 7fb092c2e700 1 -- 172.21.15.79:0/168065737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb08c0bb010 msgr2=0x7fb08c098330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:08.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.390 7fb092c2e700 1 --2- 172.21.15.79:0/168065737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb08c0bb010 0x7fb08c098330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb08c0c0bc0 tx=0x7fb08000c150).stop 2021-04-09T18:26:08.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.390 7fb092c2e700 1 -- 172.21.15.79:0/168065737 shutdown_connections 2021-04-09T18:26:08.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.390 7fb092c2e700 1 --2- 172.21.15.79:0/168065737 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb06c029100 0x7fb06c02b650 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.390 7fb092c2e700 1 --2- 172.21.15.79:0/168065737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb08c098960 0x7fb08c0c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.390 7fb092c2e700 1 --2- 172.21.15.79:0/168065737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb08c0c3a30 0x7fb08c0c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.390 7fb092c2e700 1 --2- 172.21.15.79:0/168065737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb08c0bb010 0x7fb08c098330 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.390 7fb092c2e700 1 -- 172.21.15.79:0/168065737 >> 172.21.15.79:0/168065737 conn(0x7fb08c099470 msgr2=0x7fb08c0a7020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:08.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.390 7fb092c2e700 1 -- 172.21.15.79:0/168065737 shutdown_connections 2021-04-09T18:26:08.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.390 7fb092c2e700 1 -- 172.21.15.79:0/168065737 wait complete. 2021-04-09T18:26:08.410 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-04-09T18:26:08.413 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:26:08.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.498 7f47dd7f9700 1 Processor -- start 2021-04-09T18:26:08.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.498 7f47dd7f9700 1 -- start start 2021-04-09T18:26:08.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.498 7f47dd7f9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f47d80f5540 0x7f47d80f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:08.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.498 7f47dd7f9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d81c8030 0x7f47d81ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:08.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.498 7f47dd7f9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d80fbb40 con 0x7f47d80e9b00 2021-04-09T18:26:08.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.498 7f47dd7f9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d80e9f50 con 0x7f47d80f5540 2021-04-09T18:26:08.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.498 7f47dd7f9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d81c3de0 con 0x7f47d81c8030 2021-04-09T18:26:08.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.502 7f47d7d51700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d81c8030 0x7f47d81ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:08.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.502 7f47d7550700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f47d80f5540 0x7f47d80f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:08.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.502 7f47d7d51700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d81c8030 0x7f47d81ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:52380/0 (socket says 172.21.15.79:52380) 2021-04-09T18:26:08.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.502 7f47d7d51700 1 -- 172.21.15.79:0/3849552421 learned_addr learned my addr 172.21.15.79:0/3849552421 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:08.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.502 7f47d7d51700 1 -- 172.21.15.79:0/3849552421 >> v2:172.21.15.89:3300/0 conn(0x7f47d80f5540 msgr2=0x7f47d80f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:08.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.502 7f47d7d51700 1 --2- 172.21.15.79:0/3849552421 >> v2:172.21.15.89:3300/0 conn(0x7f47d80f5540 0x7f47d80f64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.502 7f47d7d51700 1 -- 172.21.15.79:0/3849552421 >> v1:172.21.15.89:6789/0 conn(0x7f47d80e9b00 legacy=0x7f47d809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:08.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.502 7f47d7d51700 1 -- 172.21.15.79:0/3849552421 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d809f900 con 0x7f47d81c8030 2021-04-09T18:26:08.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.502 7f47d7d51700 1 --2- 172.21.15.79:0/3849552421 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d81c8030 0x7f47d81ca490 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f47d0002f30 tx=0x7f47d000bd20).ready entity=mon.2 client_cookie=ad42681610781745 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:08.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.502 7f47d654e700 1 -- 172.21.15.79:0/3849552421 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47d809f900 con 0x7f47d81c8030 2021-04-09T18:26:08.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.502 7f47d654e700 1 -- 172.21.15.79:0/3849552421 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d0009980 con 0x7f47d81c8030 2021-04-09T18:26:08.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.502 7f47d654e700 1 -- 172.21.15.79:0/3849552421 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47d0009d50 con 0x7f47d81c8030 2021-04-09T18:26:08.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.502 7f47dd7f9700 1 -- 172.21.15.79:0/3849552421 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d81c8030 msgr2=0x7f47d81ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:08.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.502 7f47dd7f9700 1 --2- 172.21.15.79:0/3849552421 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d81c8030 0x7f47d81ca490 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f47d0002f30 tx=0x7f47d000bd20).stop 2021-04-09T18:26:08.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.502 7f47dd7f9700 1 -- 172.21.15.79:0/3849552421 shutdown_connections 2021-04-09T18:26:08.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.502 7f47dd7f9700 1 --2- 172.21.15.79:0/3849552421 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d81c8030 0x7f47d81ca490 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.502 7f47dd7f9700 1 --2- 172.21.15.79:0/3849552421 >> v2:172.21.15.89:3300/0 conn(0x7f47d80f5540 0x7f47d80f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.502 7f47dd7f9700 1 -- 172.21.15.79:0/3849552421 >> 172.21.15.79:0/3849552421 conn(0x7f47d80e6000 msgr2=0x7f47d80e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:08.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.502 7f47dd7f9700 1 -- 172.21.15.79:0/3849552421 shutdown_connections 2021-04-09T18:26:08.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.502 7f47dd7f9700 1 -- 172.21.15.79:0/3849552421 wait complete. 2021-04-09T18:26:08.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.506 7f47dd7f9700 1 Processor -- start 2021-04-09T18:26:08.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.506 7f47dd7f9700 1 -- start start 2021-04-09T18:26:08.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47dd7f9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d80acf80 0x7f47d80ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:08.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47dd7f9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d808f730 0x7f47d808fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:08.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47dd7f9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d80901b0 0x7f47d80cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:08.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47dd7f9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d809ae20 con 0x7f47d80acf80 2021-04-09T18:26:08.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47dd7f9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d809a6b0 con 0x7f47d80901b0 2021-04-09T18:26:08.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47dd7f9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d809b120 con 0x7f47d808f730 2021-04-09T18:26:08.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47d7550700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d80acf80 0x7f47d80ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:08.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47d7550700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d80acf80 0x7f47d80ad3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55388/0 (socket says 172.21.15.79:55388) 2021-04-09T18:26:08.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47d7550700 1 -- 172.21.15.79:0/663811530 learned_addr learned my addr 172.21.15.79:0/663811530 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:08.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47d7d51700 1 --2- 172.21.15.79:0/663811530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d80901b0 0x7f47d80cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:08.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47d6d4f700 1 --2- 172.21.15.79:0/663811530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d808f730 0x7f47d808fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:08.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47d7550700 1 -- 172.21.15.79:0/663811530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d808f730 msgr2=0x7f47d808fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:08.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47d7550700 1 --2- 172.21.15.79:0/663811530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d808f730 0x7f47d808fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47d7550700 1 -- 172.21.15.79:0/663811530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d80901b0 msgr2=0x7f47d80cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:08.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47d7550700 1 --2- 172.21.15.79:0/663811530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d80901b0 0x7f47d80cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47d7550700 1 -- 172.21.15.79:0/663811530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d809a150 con 0x7f47d80acf80 2021-04-09T18:26:08.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47d7550700 1 --2- 172.21.15.79:0/663811530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d80acf80 0x7f47d80ad3d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f47d80d39f0 tx=0x7f47c800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:08.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47bffff700 1 -- 172.21.15.79:0/663811530 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47d809a150 con 0x7f47d80acf80 2021-04-09T18:26:08.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47bffff700 1 -- 172.21.15.79:0/663811530 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c800cd60 con 0x7f47d80acf80 2021-04-09T18:26:08.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47dd7f9700 1 -- 172.21.15.79:0/663811530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d80cf930 con 0x7f47d80acf80 2021-04-09T18:26:08.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47bffff700 1 -- 172.21.15.79:0/663811530 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47c800f040 con 0x7f47d80acf80 2021-04-09T18:26:08.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47dd7f9700 1 -- 172.21.15.79:0/663811530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d80cfde0 con 0x7f47d80acf80 2021-04-09T18:26:08.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47bffff700 1 -- 172.21.15.79:0/663811530 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f47c8011070 con 0x7f47d80acf80 2021-04-09T18:26:08.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47bffff700 1 --2- 172.21.15.79:0/663811530 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f47b8029100 0x7f47b802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:08.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47bffff700 1 -- 172.21.15.79:0/663811530 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4757+0+0 (secure 0 0 0) 0x7f47c8010040 con 0x7f47d80acf80 2021-04-09T18:26:08.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47d6d4f700 1 --2- 172.21.15.79:0/663811530 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f47b8029100 0x7f47b802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:08.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.510 7f47d6d4f700 1 --2- 172.21.15.79:0/663811530 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f47b8029100 0x7f47b802b650 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:08.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.514 7f47dd7f9700 1 -- 172.21.15.79:0/663811530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d80e39e0 con 0x7f47d80acf80 2021-04-09T18:26:08.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.522 7f47bffff700 1 -- 172.21.15.79:0/663811530 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f47c800c960 con 0x7f47d80acf80 2021-04-09T18:26:08.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.670 7f47dd7f9700 1 -- 172.21.15.79:0/663811530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f47d80f5b40 con 0x7f47d80acf80 2021-04-09T18:26:08.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.670 7f47bffff700 1 -- 172.21.15.79:0/663811530 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f47c8000bf0 con 0x7f47d80acf80 2021-04-09T18:26:08.679 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:08.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.670 7f47dd7f9700 1 -- 172.21.15.79:0/663811530 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f47b8029100 msgr2=0x7f47b802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:08.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.670 7f47dd7f9700 1 --2- 172.21.15.79:0/663811530 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f47b8029100 0x7f47b802b650 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.670 7f47dd7f9700 1 -- 172.21.15.79:0/663811530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d80acf80 msgr2=0x7f47d80ad3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:08.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.670 7f47dd7f9700 1 --2- 172.21.15.79:0/663811530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d80acf80 0x7f47d80ad3d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f47d80d39f0 tx=0x7f47c800c430).stop 2021-04-09T18:26:08.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.670 7f47dd7f9700 1 -- 172.21.15.79:0/663811530 shutdown_connections 2021-04-09T18:26:08.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.670 7f47dd7f9700 1 --2- 172.21.15.79:0/663811530 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f47b8029100 0x7f47b802b650 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.670 7f47dd7f9700 1 --2- 172.21.15.79:0/663811530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d80901b0 0x7f47d80cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.670 7f47dd7f9700 1 --2- 172.21.15.79:0/663811530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d80acf80 0x7f47d80ad3d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.670 7f47dd7f9700 1 --2- 172.21.15.79:0/663811530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d808f730 0x7f47d808fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.674 7f47dd7f9700 1 -- 172.21.15.79:0/663811530 >> 172.21.15.79:0/663811530 conn(0x7f47d80d3af0 msgr2=0x7f47d808eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:08.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.674 7f47dd7f9700 1 -- 172.21.15.79:0/663811530 shutdown_connections 2021-04-09T18:26:08.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.674 7f47dd7f9700 1 -- 172.21.15.79:0/663811530 wait complete. 2021-04-09T18:26:08.691 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-04-09T18:26:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.774 7f7654a7f700 1 Processor -- start 2021-04-09T18:26:08.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.774 7f7654a7f700 1 -- start start 2021-04-09T18:26:08.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.774 7f7654a7f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76500f5510 0x7f76500f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:08.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.774 7f7654a7f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f76500e9ad0 0x7f765009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:08.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.774 7f7654a7f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76500fbb10 con 0x7f76501c2da0 2021-04-09T18:26:08.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.774 7f7654a7f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76500e9f20 con 0x7f76500e9ad0 2021-04-09T18:26:08.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.774 7f7654a7f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76500e59c0 con 0x7f76500f5510 2021-04-09T18:26:08.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.774 7f764dfe5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f76500e9ad0 0x7f765009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:08.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.774 7f764dfe5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f76500e9ad0 0x7f765009f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55398/0 (socket says 172.21.15.79:55398) 2021-04-09T18:26:08.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.774 7f764dfe5700 1 -- 172.21.15.79:0/1024250146 learned_addr learned my addr 172.21.15.79:0/1024250146 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:08.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.774 7f764e7e6700 1 --2- 172.21.15.79:0/1024250146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76500f5510 0x7f76500f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:08.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.774 7f764dfe5700 1 -- 172.21.15.79:0/1024250146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76500f5510 msgr2=0x7f76500f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:08.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.774 7f764dfe5700 1 --2- 172.21.15.79:0/1024250146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76500f5510 0x7f76500f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.774 7f764dfe5700 1 -- 172.21.15.79:0/1024250146 >> v1:172.21.15.89:6789/0 conn(0x7f76501c2da0 legacy=0x7f76501c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:08.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.774 7f764dfe5700 1 -- 172.21.15.79:0/1024250146 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76500e56c0 con 0x7f76500e9ad0 2021-04-09T18:26:08.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.774 7f764e7e6700 1 --2- 172.21.15.79:0/1024250146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76500f5510 0x7f76500f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:26:08.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.778 7f764dfe5700 1 --2- 172.21.15.79:0/1024250146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76500e9ad0 0x7f765009f100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f7638002f30 tx=0x7f763800bda0).ready entity=mon.0 client_cookie=8fbea00f19045053 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:08.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.778 7f764d7e4700 1 -- 172.21.15.79:0/1024250146 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f76500e56c0 con 0x7f76500e9ad0 2021-04-09T18:26:08.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.778 7f764d7e4700 1 -- 172.21.15.79:0/1024250146 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76380099d0 con 0x7f76500e9ad0 2021-04-09T18:26:08.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.778 7f764d7e4700 1 -- 172.21.15.79:0/1024250146 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7638009da0 con 0x7f76500e9ad0 2021-04-09T18:26:08.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.778 7f7654a7f700 1 -- 172.21.15.79:0/1024250146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76500e9ad0 msgr2=0x7f765009f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:08.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.778 7f7654a7f700 1 --2- 172.21.15.79:0/1024250146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76500e9ad0 0x7f765009f100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f7638002f30 tx=0x7f763800bda0).stop 2021-04-09T18:26:08.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.778 7f7654a7f700 1 -- 172.21.15.79:0/1024250146 shutdown_connections 2021-04-09T18:26:08.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.778 7f7654a7f700 1 --2- 172.21.15.79:0/1024250146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76500f5510 0x7f76500f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.778 7f7654a7f700 1 --2- 172.21.15.79:0/1024250146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76500e9ad0 0x7f765009f100 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.778 7f7654a7f700 1 -- 172.21.15.79:0/1024250146 >> 172.21.15.79:0/1024250146 conn(0x7f76500e5fd0 msgr2=0x7f76500e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:08.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.778 7f7654a7f700 1 -- 172.21.15.79:0/1024250146 shutdown_connections 2021-04-09T18:26:08.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.778 7f7654a7f700 1 -- 172.21.15.79:0/1024250146 wait complete. 2021-04-09T18:26:08.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f7654a7f700 1 Processor -- start 2021-04-09T18:26:08.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f7654a7f700 1 -- start start 2021-04-09T18:26:08.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f7654a7f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76500b9000 0x7f76500b6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:08.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f7654a7f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76500cfbd0 0x7f76500d0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:08.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f7654a7f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76500d0b40 0x7f76500d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:08.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f7654a7f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765009a8e0 con 0x7f76500cfbd0 2021-04-09T18:26:08.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f7654a7f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765009abe0 con 0x7f76500d0b40 2021-04-09T18:26:08.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f7654a7f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7650099ce0 con 0x7f76500b9000 2021-04-09T18:26:08.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f764dfe5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76500cfbd0 0x7f76500d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:08.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f764dfe5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76500cfbd0 0x7f76500d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55406/0 (socket says 172.21.15.79:55406) 2021-04-09T18:26:08.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f764dfe5700 1 -- 172.21.15.79:0/140508097 learned_addr learned my addr 172.21.15.79:0/140508097 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:08.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f764e7e6700 1 --2- 172.21.15.79:0/140508097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76500b9000 0x7f76500b6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:08.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f764efe7700 1 --2- 172.21.15.79:0/140508097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76500d0b40 0x7f76500d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:08.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f764dfe5700 1 -- 172.21.15.79:0/140508097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76500b9000 msgr2=0x7f76500b6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:08.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f764dfe5700 1 --2- 172.21.15.79:0/140508097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76500b9000 0x7f76500b6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f764dfe5700 1 -- 172.21.15.79:0/140508097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76500d0b40 msgr2=0x7f76500d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:08.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f764dfe5700 1 --2- 172.21.15.79:0/140508097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76500d0b40 0x7f76500d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f764dfe5700 1 -- 172.21.15.79:0/140508097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765009a470 con 0x7f76500cfbd0 2021-04-09T18:26:08.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f764dfe5700 1 --2- 172.21.15.79:0/140508097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76500cfbd0 0x7f76500d0020 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f765009ad90 tx=0x7f7638006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:08.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f7646ffd700 1 -- 172.21.15.79:0/140508097 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f765009a470 con 0x7f76500cfbd0 2021-04-09T18:26:08.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f7646ffd700 1 -- 172.21.15.79:0/140508097 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763801d440 con 0x7f76500cfbd0 2021-04-09T18:26:08.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f7654a7f700 1 -- 172.21.15.79:0/140508097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76500d15c0 con 0x7f76500cfbd0 2021-04-09T18:26:08.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f7646ffd700 1 -- 172.21.15.79:0/140508097 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f763801d810 con 0x7f76500cfbd0 2021-04-09T18:26:08.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f7654a7f700 1 -- 172.21.15.79:0/140508097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76500b7610 con 0x7f76500cfbd0 2021-04-09T18:26:08.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f7646ffd700 1 -- 172.21.15.79:0/140508097 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f763801da10 con 0x7f76500cfbd0 2021-04-09T18:26:08.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f7646ffd700 1 --2- 172.21.15.79:0/140508097 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7634029100 0x7f763402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:08.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.782 7f7646ffd700 1 -- 172.21.15.79:0/140508097 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4757+0+0 (secure 0 0 0) 0x7f763803b300 con 0x7f76500cfbd0 2021-04-09T18:26:08.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.786 7f764e7e6700 1 --2- 172.21.15.79:0/140508097 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7634029100 0x7f763402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:08.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.786 7f764e7e6700 1 --2- 172.21.15.79:0/140508097 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7634029100 0x7f763402b650 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:08.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.790 7f7654a7f700 1 -- 172.21.15.79:0/140508097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76500e39d0 con 0x7f76500cfbd0 2021-04-09T18:26:08.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.798 7f7646ffd700 1 -- 172.21.15.79:0/140508097 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f76380097c0 con 0x7f76500cfbd0 2021-04-09T18:26:08.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.946 7f7654a7f700 1 -- 172.21.15.79:0/140508097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f76500f5b10 con 0x7f76500cfbd0 2021-04-09T18:26:08.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.946 7f7646ffd700 1 -- 172.21.15.79:0/140508097 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v15) v1 ==== 84+0+64 (secure 0 0 0) 0x7f7638011c90 con 0x7f76500cfbd0 2021-04-09T18:26:08.956 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:08.956 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2021-04-09T18:26:08.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:08.957 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2021-04-09T18:26:08.957 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": "rbd" 2021-04-09T18:26:08.957 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:08.958 INFO:teuthology.orchestra.run.smithi079.stdout:] 2021-04-09T18:26:08.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.950 7f7654a7f700 1 -- 172.21.15.79:0/140508097 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7634029100 msgr2=0x7f763402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:08.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.950 7f7654a7f700 1 --2- 172.21.15.79:0/140508097 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7634029100 0x7f763402b650 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.950 7f7654a7f700 1 -- 172.21.15.79:0/140508097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76500cfbd0 msgr2=0x7f76500d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:08.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.950 7f7654a7f700 1 --2- 172.21.15.79:0/140508097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76500cfbd0 0x7f76500d0020 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f765009ad90 tx=0x7f7638006890).stop 2021-04-09T18:26:08.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.950 7f7654a7f700 1 -- 172.21.15.79:0/140508097 shutdown_connections 2021-04-09T18:26:08.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.950 7f7654a7f700 1 --2- 172.21.15.79:0/140508097 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7634029100 0x7f763402b650 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.950 7f7654a7f700 1 --2- 172.21.15.79:0/140508097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76500d0b40 0x7f76500d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.950 7f7654a7f700 1 --2- 172.21.15.79:0/140508097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76500b9000 0x7f76500b6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.950 7f7654a7f700 1 --2- 172.21.15.79:0/140508097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76500cfbd0 0x7f76500d0020 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:08.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.950 7f7654a7f700 1 -- 172.21.15.79:0/140508097 >> 172.21.15.79:0/140508097 conn(0x7f76500938a0 msgr2=0x7f76500d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:08.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.950 7f7654a7f700 1 -- 172.21.15.79:0/140508097 shutdown_connections 2021-04-09T18:26:08.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:08.950 7f7654a7f700 1 -- 172.21.15.79:0/140508097 wait complete. 2021-04-09T18:26:08.966 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-04-09T18:26:08.967 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-04-09T18:26:09.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.058 7f10d7d79700 1 Processor -- start 2021-04-09T18:26:09.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.058 7f10d7d79700 1 -- start start 2021-04-09T18:26:09.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.062 7f10d7d79700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f10d00f5550 0x7f10d00f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:09.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.062 7f10d7d79700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10d00e9b10 0x7f10d009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:09.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.062 7f10d7d79700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d00fbb50 con 0x7f10d01c2de0 2021-04-09T18:26:09.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.062 7f10d7d79700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d00e9f60 con 0x7f10d00f5550 2021-04-09T18:26:09.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.062 7f10d7d79700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d00e5a00 con 0x7f10d00e9b10 2021-04-09T18:26:09.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.062 7f10d5b1d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f10d00f5550 0x7f10d00f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:09.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.062 7f10d5b1d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f10d00f5550 0x7f10d00f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55412/0 (socket says 172.21.15.79:55412) 2021-04-09T18:26:09.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.062 7f10d5b1d700 1 -- 172.21.15.79:0/567799218 learned_addr learned my addr 172.21.15.79:0/567799218 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:09.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.062 7f10d531c700 1 --2- 172.21.15.79:0/567799218 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10d00e9b10 0x7f10d009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:09.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.062 7f10d531c700 1 -- 172.21.15.79:0/567799218 >> v2:172.21.15.79:3300/0 conn(0x7f10d00f5550 msgr2=0x7f10d00f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:09.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.062 7f10d531c700 1 --2- 172.21.15.79:0/567799218 >> v2:172.21.15.79:3300/0 conn(0x7f10d00f5550 0x7f10d00f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:09.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.062 7f10d531c700 1 -- 172.21.15.79:0/567799218 >> v1:172.21.15.89:6789/0 conn(0x7f10d01c2de0 legacy=0x7f10d01c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:09.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.062 7f10d531c700 1 -- 172.21.15.79:0/567799218 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d00e5700 con 0x7f10d00e9b10 2021-04-09T18:26:09.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.062 7f10d531c700 1 --2- 172.21.15.79:0/567799218 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10d00e9b10 0x7f10d009f110 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f10c0002f30 tx=0x7f10c000bcc0).ready entity=mon.2 client_cookie=832c942b3ab72786 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:09.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.062 7f10d4b1b700 1 -- 172.21.15.79:0/567799218 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f10d00e5700 con 0x7f10d00e9b10 2021-04-09T18:26:09.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.062 7f10d4b1b700 1 -- 172.21.15.79:0/567799218 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c0009800 con 0x7f10d00e9b10 2021-04-09T18:26:09.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.062 7f10d4b1b700 1 -- 172.21.15.79:0/567799218 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f10c0009c10 con 0x7f10d00e9b10 2021-04-09T18:26:09.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.062 7f10d7d79700 1 -- 172.21.15.79:0/567799218 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10d00e9b10 msgr2=0x7f10d009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:09.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.062 7f10d7d79700 1 --2- 172.21.15.79:0/567799218 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10d00e9b10 0x7f10d009f110 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f10c0002f30 tx=0x7f10c000bcc0).stop 2021-04-09T18:26:09.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.066 7f10d7d79700 1 -- 172.21.15.79:0/567799218 shutdown_connections 2021-04-09T18:26:09.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.066 7f10d7d79700 1 --2- 172.21.15.79:0/567799218 >> v2:172.21.15.79:3300/0 conn(0x7f10d00f5550 0x7f10d00f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:09.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.066 7f10d7d79700 1 --2- 172.21.15.79:0/567799218 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10d00e9b10 0x7f10d009f110 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:09.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.066 7f10d7d79700 1 -- 172.21.15.79:0/567799218 >> 172.21.15.79:0/567799218 conn(0x7f10d00e6010 msgr2=0x7f10d00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:09.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.066 7f10d7d79700 1 -- 172.21.15.79:0/567799218 shutdown_connections 2021-04-09T18:26:09.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.066 7f10d7d79700 1 -- 172.21.15.79:0/567799218 wait complete. 2021-04-09T18:26:09.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d7d79700 1 Processor -- start 2021-04-09T18:26:09.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d7d79700 1 -- start start 2021-04-09T18:26:09.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d7d79700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10d019c490 0x7f10d00bb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:09.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d7d79700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d019ba10 0x7f10d019cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:09.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d7d79700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10d019d510 0x7f10d00967f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:09.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d7d79700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d019cbe0 con 0x7f10d019ba10 2021-04-09T18:26:09.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d7d79700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d019c8e0 con 0x7f10d019d510 2021-04-09T18:26:09.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d7d79700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d0095f50 con 0x7f10d019c490 2021-04-09T18:26:09.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d531c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d019ba10 0x7f10d019cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:09.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d531c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d019ba10 0x7f10d019cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55418/0 (socket says 172.21.15.79:55418) 2021-04-09T18:26:09.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d531c700 1 -- 172.21.15.79:0/603338330 learned_addr learned my addr 172.21.15.79:0/603338330 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:09.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d5b1d700 1 --2- 172.21.15.79:0/603338330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10d019c490 0x7f10d00bb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:09.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d631e700 1 --2- 172.21.15.79:0/603338330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10d019d510 0x7f10d00967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:09.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d531c700 1 -- 172.21.15.79:0/603338330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10d019c490 msgr2=0x7f10d00bb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:09.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d531c700 1 --2- 172.21.15.79:0/603338330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10d019c490 0x7f10d00bb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:09.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d531c700 1 -- 172.21.15.79:0/603338330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10d019d510 msgr2=0x7f10d00967f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:09.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d531c700 1 --2- 172.21.15.79:0/603338330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10d019d510 0x7f10d00967f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:09.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d531c700 1 -- 172.21.15.79:0/603338330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d019be60 con 0x7f10d019ba10 2021-04-09T18:26:09.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d531c700 1 --2- 172.21.15.79:0/603338330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d019ba10 0x7f10d019cee0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f10c0002f30 tx=0x7f10c0006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:09.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10c67fc700 1 -- 172.21.15.79:0/603338330 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f10d019be60 con 0x7f10d019ba10 2021-04-09T18:26:09.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10c67fc700 1 -- 172.21.15.79:0/603338330 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c0011cd0 con 0x7f10d019ba10 2021-04-09T18:26:09.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d7d79700 1 -- 172.21.15.79:0/603338330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d00c3b40 con 0x7f10d019ba10 2021-04-09T18:26:09.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10c67fc700 1 -- 172.21.15.79:0/603338330 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f10c001d630 con 0x7f10d019ba10 2021-04-09T18:26:09.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d7d79700 1 -- 172.21.15.79:0/603338330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d0096fb0 con 0x7f10d019ba10 2021-04-09T18:26:09.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10c67fc700 1 -- 172.21.15.79:0/603338330 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f10c0026450 con 0x7f10d019ba10 2021-04-09T18:26:09.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10c67fc700 1 --2- 172.21.15.79:0/603338330 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f10b8029100 0x7f10b802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:09.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10c67fc700 1 -- 172.21.15.79:0/603338330 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4757+0+0 (secure 0 0 0) 0x7f10c003a8b0 con 0x7f10d019ba10 2021-04-09T18:26:09.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.070 7f10d5b1d700 1 --2- 172.21.15.79:0/603338330 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f10b8029100 0x7f10b802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:09.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.074 7f10d5b1d700 1 --2- 172.21.15.79:0/603338330 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f10b8029100 0x7f10b802b650 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:09.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.090 7f10d7d79700 1 -- 172.21.15.79:0/603338330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d00e39f0 con 0x7f10d019ba10 2021-04-09T18:26:09.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.094 7f10c67fc700 1 -- 172.21.15.79:0/603338330 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f10c0011ac0 con 0x7f10d019ba10 2021-04-09T18:26:09.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:09.250 7f10d7d79700 1 -- 172.21.15.79:0/603338330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f10d00f5b50 con 0x7f10d019ba10 2021-04-09T18:26:10.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.074 7f10c67fc700 1 -- 172.21.15.79:0/603338330 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v17) v1 ==== 133+0+0 (secure 0 0 0) 0x7f10c00095f0 con 0x7f10d019ba10 2021-04-09T18:26:10.125 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2021-04-09T18:26:10.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.122 7f10d7d79700 1 -- 172.21.15.79:0/603338330 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f10b8029100 msgr2=0x7f10b802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:10.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.122 7f10d7d79700 1 --2- 172.21.15.79:0/603338330 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f10b8029100 0x7f10b802b650 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:10.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.122 7f10d7d79700 1 -- 172.21.15.79:0/603338330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d019ba10 msgr2=0x7f10d019cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:10.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.122 7f10d7d79700 1 --2- 172.21.15.79:0/603338330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d019ba10 0x7f10d019cee0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f10c0002f30 tx=0x7f10c0006890).stop 2021-04-09T18:26:10.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.122 7f10d7d79700 1 -- 172.21.15.79:0/603338330 shutdown_connections 2021-04-09T18:26:10.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.122 7f10d7d79700 1 --2- 172.21.15.79:0/603338330 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f10b8029100 0x7f10b802b650 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:10.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.122 7f10d7d79700 1 --2- 172.21.15.79:0/603338330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10d019d510 0x7f10d00967f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:10.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.122 7f10d7d79700 1 --2- 172.21.15.79:0/603338330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10d019c490 0x7f10d00bb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:10.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.122 7f10d7d79700 1 --2- 172.21.15.79:0/603338330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d019ba10 0x7f10d019cee0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:10.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.122 7f10d7d79700 1 -- 172.21.15.79:0/603338330 >> 172.21.15.79:0/603338330 conn(0x7f10d009aaf0 msgr2=0x7f10d00af420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:10.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.122 7f10d7d79700 1 -- 172.21.15.79:0/603338330 shutdown_connections 2021-04-09T18:26:10.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.122 7f10d7d79700 1 -- 172.21.15.79:0/603338330 wait complete. 2021-04-09T18:26:10.150 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2021-04-09T18:26:10.150 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2021-04-09T18:26:10.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.250 7f5f8cc51700 1 Processor -- start 2021-04-09T18:26:10.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.250 7f5f8cc51700 1 -- start start 2021-04-09T18:26:10.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.250 7f5f8cc51700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5f881c9050 0x7f5f881cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:10.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.250 7f5f8cc51700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f880fbb50 con 0x7f5f880e9b10 2021-04-09T18:26:10.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.250 7f5f8cc51700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8809f910 con 0x7f5f880f5550 2021-04-09T18:26:10.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.250 7f5f8cc51700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f881c3df0 con 0x7f5f881c9050 2021-04-09T18:26:10.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.250 7f5f85fe5700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5f880e9b10 0x7f5f8809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50136/0 (socket says 172.21.15.79:50136) 2021-04-09T18:26:10.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.250 7f5f85fe5700 1 -- 172.21.15.79:0/4266109102 learned_addr learned my addr 172.21.15.79:0/4266109102 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:10.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.250 7f5f86fe7700 1 --2- 172.21.15.79:0/4266109102 >> v2:172.21.15.79:3300/0 conn(0x7f5f881c9050 0x7f5f881cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:10.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.254 7f5f857e4700 1 -- 172.21.15.79:0/4266109102 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2143075476 0 0) 0x7f5f7c0010d0 con 0x7f5f880e9b10 2021-04-09T18:26:10.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.254 7f5f857e4700 1 -- 172.21.15.79:0/4266109102 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f70003240 con 0x7f5f880e9b10 2021-04-09T18:26:10.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.254 7f5f857e4700 1 -- 172.21.15.79:0/4266109102 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3839831410 0 0) 0x7f5f780010d0 con 0x7f5f880f5550 2021-04-09T18:26:10.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.254 7f5f86fe7700 1 -- 172.21.15.79:0/4266109102 >> v1:172.21.15.89:6789/0 conn(0x7f5f880f5550 legacy=0x7f5f880f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:10.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.254 7f5f86fe7700 1 -- 172.21.15.79:0/4266109102 >> v1:172.21.15.79:6789/0 conn(0x7f5f880e9b10 legacy=0x7f5f8809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:10.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.254 7f5f86fe7700 1 -- 172.21.15.79:0/4266109102 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f880e5700 con 0x7f5f881c9050 2021-04-09T18:26:10.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.254 7f5f86fe7700 1 --2- 172.21.15.79:0/4266109102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f881c9050 0x7f5f881cb4b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5f800032b0 tx=0x7f5f8000b0e0).ready entity=mon.0 client_cookie=3fafddca675580a9 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:10.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.254 7f5f857e4700 1 -- 172.21.15.79:0/4266109102 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5f880e5700 con 0x7f5f881c9050 2021-04-09T18:26:10.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.254 7f5f857e4700 1 -- 172.21.15.79:0/4266109102 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8000bab0 con 0x7f5f881c9050 2021-04-09T18:26:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.254 7f5f857e4700 1 -- 172.21.15.79:0/4266109102 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5f80002020 con 0x7f5f881c9050 2021-04-09T18:26:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.254 7f5f8cc51700 1 -- 172.21.15.79:0/4266109102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f881c9050 msgr2=0x7f5f881cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.254 7f5f8cc51700 1 --2- 172.21.15.79:0/4266109102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f881c9050 0x7f5f881cb4b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5f800032b0 tx=0x7f5f8000b0e0).stop 2021-04-09T18:26:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.254 7f5f8cc51700 1 -- 172.21.15.79:0/4266109102 shutdown_connections 2021-04-09T18:26:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.254 7f5f8cc51700 1 --2- 172.21.15.79:0/4266109102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f881c9050 0x7f5f881cb4b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:10.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.254 7f5f8cc51700 1 -- 172.21.15.79:0/4266109102 >> 172.21.15.79:0/4266109102 conn(0x7f5f880e6010 msgr2=0x7f5f880e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:10.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.254 7f5f8cc51700 1 -- 172.21.15.79:0/4266109102 shutdown_connections 2021-04-09T18:26:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.254 7f5f8cc51700 1 -- 172.21.15.79:0/4266109102 wait complete. 2021-04-09T18:26:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f8cc51700 1 Processor -- start 2021-04-09T18:26:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f8cc51700 1 -- start start 2021-04-09T18:26:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f8cc51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f881aade0 0x7f5f880afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f8cc51700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f880d5130 0x7f5f880d5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f8cc51700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f880bdda0 0x7f5f880be1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f8cc51700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880e9f60 con 0x7f5f881aade0 2021-04-09T18:26:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f8cc51700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880bf890 con 0x7f5f880bdda0 2021-04-09T18:26:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f8cc51700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880beda0 con 0x7f5f880d5130 2021-04-09T18:26:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f867e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f881aade0 0x7f5f880afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f867e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f881aade0 0x7f5f880afbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55432/0 (socket says 172.21.15.79:55432) 2021-04-09T18:26:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f867e6700 1 -- 172.21.15.79:0/3250114672 learned_addr learned my addr 172.21.15.79:0/3250114672 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f85fe5700 1 --2- 172.21.15.79:0/3250114672 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f880d5130 0x7f5f880d5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:10.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f86fe7700 1 --2- 172.21.15.79:0/3250114672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f880bdda0 0x7f5f880be1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:10.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f867e6700 1 -- 172.21.15.79:0/3250114672 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f880d5130 msgr2=0x7f5f880d5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:10.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f867e6700 1 --2- 172.21.15.79:0/3250114672 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f880d5130 0x7f5f880d5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:10.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f867e6700 1 -- 172.21.15.79:0/3250114672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f880bdda0 msgr2=0x7f5f880be1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:10.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f867e6700 1 --2- 172.21.15.79:0/3250114672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f880bdda0 0x7f5f880be1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:10.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f867e6700 1 -- 172.21.15.79:0/3250114672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f880be820 con 0x7f5f881aade0 2021-04-09T18:26:10.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f867e6700 1 --2- 172.21.15.79:0/3250114672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f881aade0 0x7f5f880afbd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5f880d8330 tx=0x7f5f7800cb30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:10.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f76ffd700 1 -- 172.21.15.79:0/3250114672 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5f880be820 con 0x7f5f881aade0 2021-04-09T18:26:10.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f76ffd700 1 -- 172.21.15.79:0/3250114672 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7800e4a0 con 0x7f5f881aade0 2021-04-09T18:26:10.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f8cc51700 1 -- 172.21.15.79:0/3250114672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f880bf110 con 0x7f5f881aade0 2021-04-09T18:26:10.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f76ffd700 1 -- 172.21.15.79:0/3250114672 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5f7800e870 con 0x7f5f881aade0 2021-04-09T18:26:10.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.258 7f5f8cc51700 1 -- 172.21.15.79:0/3250114672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f880b0200 con 0x7f5f881aade0 2021-04-09T18:26:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.262 7f5f76ffd700 1 -- 172.21.15.79:0/3250114672 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5f7801a060 con 0x7f5f881aade0 2021-04-09T18:26:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.262 7f5f76ffd700 1 --2- 172.21.15.79:0/3250114672 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5f6c029100 0x7f5f6c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:10.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.262 7f5f76ffd700 1 -- 172.21.15.79:0/3250114672 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5111+0+0 (secure 0 0 0) 0x7f5f78038a50 con 0x7f5f881aade0 2021-04-09T18:26:10.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.262 7f5f85fe5700 1 --2- 172.21.15.79:0/3250114672 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5f6c029100 0x7f5f6c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:10.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.262 7f5f85fe5700 1 --2- 172.21.15.79:0/3250114672 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5f6c029100 0x7f5f6c02b650 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:10.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.266 7f5f8cc51700 1 -- 172.21.15.79:0/3250114672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f880e39f0 con 0x7f5f881aade0 2021-04-09T18:26:10.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.274 7f5f76ffd700 1 -- 172.21.15.79:0/3250114672 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5f78000bf0 con 0x7f5f881aade0 2021-04-09T18:26:10.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:10.446 7f5f8cc51700 1 -- 172.21.15.79:0/3250114672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"profile": ["m=2", "k=2", "crush-failure-domain=osd"], "prefix": "osd erasure-code-profile set", "name": "cephfs_data"} v 0) v1 -- 0x7f5f880a1c90 con 0x7f5f881aade0 2021-04-09T18:26:11.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.074 7f5f76ffd700 1 -- 172.21.15.79:0/3250114672 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"profile": ["m=2", "k=2", "crush-failure-domain=osd"], "prefix": "osd erasure-code-profile set", "name": "cephfs_data"}]=0 v18) v1 ==== 154+0+0 (secure 0 0 0) 0x7f5f7800e290 con 0x7f5f881aade0 2021-04-09T18:26:11.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.114 7f5f8cc51700 1 -- 172.21.15.79:0/3250114672 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5f6c029100 msgr2=0x7f5f6c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:11.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.114 7f5f8cc51700 1 --2- 172.21.15.79:0/3250114672 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5f6c029100 0x7f5f6c02b650 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:11.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.114 7f5f8cc51700 1 -- 172.21.15.79:0/3250114672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f881aade0 msgr2=0x7f5f880afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:11.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.114 7f5f8cc51700 1 --2- 172.21.15.79:0/3250114672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f881aade0 0x7f5f880afbd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5f880d8330 tx=0x7f5f7800cb30).stop 2021-04-09T18:26:11.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.114 7f5f8cc51700 1 -- 172.21.15.79:0/3250114672 shutdown_connections 2021-04-09T18:26:11.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.114 7f5f8cc51700 1 --2- 172.21.15.79:0/3250114672 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5f6c029100 0x7f5f6c02b650 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:11.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.114 7f5f8cc51700 1 --2- 172.21.15.79:0/3250114672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f880bdda0 0x7f5f880be1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:11.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.114 7f5f8cc51700 1 --2- 172.21.15.79:0/3250114672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f881aade0 0x7f5f880afbd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:11.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.114 7f5f8cc51700 1 --2- 172.21.15.79:0/3250114672 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f880d5130 0x7f5f880d5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:11.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.114 7f5f8cc51700 1 -- 172.21.15.79:0/3250114672 >> 172.21.15.79:0/3250114672 conn(0x7f5f8809aff0 msgr2=0x7f5f88095d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:11.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.114 7f5f8cc51700 1 -- 172.21.15.79:0/3250114672 shutdown_connections 2021-04-09T18:26:11.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.114 7f5f8cc51700 1 -- 172.21.15.79:0/3250114672 wait complete. 2021-04-09T18:26:11.134 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 erasure cephfs_data 2021-04-09T18:26:11.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2c7563700 1 Processor -- start 2021-04-09T18:26:11.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2c7563700 1 -- start start 2021-04-09T18:26:11.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2c7563700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb2c00f5550 0x7fb2c00f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:11.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2c7563700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb2c00e9b10 0x7fb2c009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:11.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2c7563700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c00fbb50 con 0x7fb2c01c2de0 2021-04-09T18:26:11.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2c7563700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c00e9f60 con 0x7fb2c00e9b10 2021-04-09T18:26:11.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2c7563700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c00e5a00 con 0x7fb2c00f5550 2021-04-09T18:26:11.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2c4b06700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb2c00e9b10 0x7fb2c009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:11.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2c4b06700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb2c00e9b10 0x7fb2c009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55442/0 (socket says 172.21.15.79:55442) 2021-04-09T18:26:11.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2c4b06700 1 -- 172.21.15.79:0/2357808260 learned_addr learned my addr 172.21.15.79:0/2357808260 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:11.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2c5307700 1 --2- 172.21.15.79:0/2357808260 >> v2:172.21.15.89:3300/0 conn(0x7fb2c00f5550 0x7fb2c00f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:11.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2c4b06700 1 -- 172.21.15.79:0/2357808260 >> v2:172.21.15.89:3300/0 conn(0x7fb2c00f5550 msgr2=0x7fb2c00f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:11.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2c4b06700 1 --2- 172.21.15.79:0/2357808260 >> v2:172.21.15.89:3300/0 conn(0x7fb2c00f5550 0x7fb2c00f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:11.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2c4b06700 1 -- 172.21.15.79:0/2357808260 >> v1:172.21.15.89:6789/0 conn(0x7fb2c01c2de0 legacy=0x7fb2c01c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:11.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2c4b06700 1 -- 172.21.15.79:0/2357808260 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c00e5700 con 0x7fb2c00e9b10 2021-04-09T18:26:11.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2c4b06700 1 --2- 172.21.15.79:0/2357808260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2c00e9b10 0x7fb2c009f110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fb2b4002f30 tx=0x7fb2b400bd70).ready entity=mon.0 client_cookie=1a2befba0c5fd643 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:11.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2bffff700 1 -- 172.21.15.79:0/2357808260 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb2c00e5700 con 0x7fb2c00e9b10 2021-04-09T18:26:11.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2bffff700 1 -- 172.21.15.79:0/2357808260 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b4009950 con 0x7fb2c00e9b10 2021-04-09T18:26:11.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2bffff700 1 -- 172.21.15.79:0/2357808260 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb2b4009d20 con 0x7fb2c00e9b10 2021-04-09T18:26:11.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2c7563700 1 -- 172.21.15.79:0/2357808260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2c00e9b10 msgr2=0x7fb2c009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:11.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.222 7fb2c7563700 1 --2- 172.21.15.79:0/2357808260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2c00e9b10 0x7fb2c009f110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fb2b4002f30 tx=0x7fb2b400bd70).stop 2021-04-09T18:26:11.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.226 7fb2c7563700 1 -- 172.21.15.79:0/2357808260 shutdown_connections 2021-04-09T18:26:11.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.226 7fb2c7563700 1 --2- 172.21.15.79:0/2357808260 >> v2:172.21.15.89:3300/0 conn(0x7fb2c00f5550 0x7fb2c00f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:11.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.226 7fb2c7563700 1 --2- 172.21.15.79:0/2357808260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2c00e9b10 0x7fb2c009f110 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:11.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.226 7fb2c7563700 1 -- 172.21.15.79:0/2357808260 >> 172.21.15.79:0/2357808260 conn(0x7fb2c00e6010 msgr2=0x7fb2c00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:11.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.226 7fb2c7563700 1 -- 172.21.15.79:0/2357808260 shutdown_connections 2021-04-09T18:26:11.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.226 7fb2c7563700 1 -- 172.21.15.79:0/2357808260 wait complete. 2021-04-09T18:26:11.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c7563700 1 Processor -- start 2021-04-09T18:26:11.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c7563700 1 -- start start 2021-04-09T18:26:11.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c7563700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2c01c0190 0x7fb2c00b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:11.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c7563700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2c00b07d0 0x7fb2c00c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:11.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c7563700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2c01c05e0 0x7fb2c00c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:11.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c7563700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00c3990 con 0x7fb2c01c05e0 2021-04-09T18:26:11.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c7563700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00c3c90 con 0x7fb2c00b07d0 2021-04-09T18:26:11.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c7563700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00c3520 con 0x7fb2c01c0190 2021-04-09T18:26:11.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c5b08700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2c01c05e0 0x7fb2c00c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:11.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c5b08700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2c01c05e0 0x7fb2c00c2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55444/0 (socket says 172.21.15.79:55444) 2021-04-09T18:26:11.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c5b08700 1 -- 172.21.15.79:0/2991307648 learned_addr learned my addr 172.21.15.79:0/2991307648 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:11.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c5307700 1 --2- 172.21.15.79:0/2991307648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2c01c0190 0x7fb2c00b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:11.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c4b06700 1 --2- 172.21.15.79:0/2991307648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2c00b07d0 0x7fb2c00c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:11.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c5b08700 1 -- 172.21.15.79:0/2991307648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2c01c0190 msgr2=0x7fb2c00b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:11.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c5b08700 1 --2- 172.21.15.79:0/2991307648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2c01c0190 0x7fb2c00b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:11.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c5b08700 1 -- 172.21.15.79:0/2991307648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2c00b07d0 msgr2=0x7fb2c00c1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:11.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c5b08700 1 --2- 172.21.15.79:0/2991307648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2c00b07d0 0x7fb2c00c1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:11.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c5b08700 1 -- 172.21.15.79:0/2991307648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c00c2b40 con 0x7fb2c01c05e0 2021-04-09T18:26:11.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c5b08700 1 --2- 172.21.15.79:0/2991307648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2c01c05e0 0x7fb2c00c2510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb2c00a4020 tx=0x7fb2b800ce60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:11.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2bdffb700 1 -- 172.21.15.79:0/2991307648 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb2c00c2b40 con 0x7fb2c01c05e0 2021-04-09T18:26:11.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2bdffb700 1 -- 172.21.15.79:0/2991307648 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b8006870 con 0x7fb2c01c05e0 2021-04-09T18:26:11.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c7563700 1 -- 172.21.15.79:0/2991307648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c00c2da0 con 0x7fb2c01c05e0 2021-04-09T18:26:11.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2bdffb700 1 -- 172.21.15.79:0/2991307648 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb2b8006c40 con 0x7fb2c01c05e0 2021-04-09T18:26:11.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c7563700 1 -- 172.21.15.79:0/2991307648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c01b1260 con 0x7fb2c01c05e0 2021-04-09T18:26:11.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2bdffb700 1 -- 172.21.15.79:0/2991307648 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb2b800a770 con 0x7fb2c01c05e0 2021-04-09T18:26:11.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2bdffb700 1 --2- 172.21.15.79:0/2991307648 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb2a0029100 0x7fb2a002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:11.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2bdffb700 1 -- 172.21.15.79:0/2991307648 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5367+0+0 (secure 0 0 0) 0x7fb2b8038f00 con 0x7fb2c01c05e0 2021-04-09T18:26:11.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.230 7fb2c5307700 1 --2- 172.21.15.79:0/2991307648 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb2a0029100 0x7fb2a002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:11.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.234 7fb2c5307700 1 --2- 172.21.15.79:0/2991307648 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb2a0029100 0x7fb2a002b650 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:11.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.234 7fb2c7563700 1 -- 172.21.15.79:0/2991307648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c00e39f0 con 0x7fb2c01c05e0 2021-04-09T18:26:11.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.238 7fb2bdffb700 1 -- 172.21.15.79:0/2991307648 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb2b800a560 con 0x7fb2c01c05e0 2021-04-09T18:26:11.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:11.398 7fb2c7563700 1 -- 172.21.15.79:0/2991307648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool_type": "erasure", "prefix": "osd pool create", "pg_num": 8, "erasure_code_profile": "cephfs_data", "pool": "cephfs_data"} v 0) v1 -- 0x7fb2c00f5b50 con 0x7fb2c01c05e0 2021-04-09T18:26:11.833 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:26:11.836 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:26:11.839 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:26:11.843 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:26:11.846 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:26:13.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.098 7fb2bdffb700 1 -- 172.21.15.79:0/2991307648 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool_type": "erasure", "prefix": "osd pool create", "pg_num": 8, "erasure_code_profile": "cephfs_data", "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v20) v1 ==== 188+0+0 (secure 0 0 0) 0x7fb2c00f76f0 con 0x7fb2c01c05e0 2021-04-09T18:26:13.122 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2021-04-09T18:26:13.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.118 7fb2c7563700 1 -- 172.21.15.79:0/2991307648 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb2a0029100 msgr2=0x7fb2a002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:13.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.118 7fb2c7563700 1 --2- 172.21.15.79:0/2991307648 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb2a0029100 0x7fb2a002b650 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:13.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.118 7fb2c7563700 1 -- 172.21.15.79:0/2991307648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2c01c05e0 msgr2=0x7fb2c00c2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:13.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.118 7fb2c7563700 1 --2- 172.21.15.79:0/2991307648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2c01c05e0 0x7fb2c00c2510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb2c00a4020 tx=0x7fb2b800ce60).stop 2021-04-09T18:26:13.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.118 7fb2c7563700 1 -- 172.21.15.79:0/2991307648 shutdown_connections 2021-04-09T18:26:13.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.118 7fb2c7563700 1 --2- 172.21.15.79:0/2991307648 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb2a0029100 0x7fb2a002b650 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.118 7fb2c7563700 1 --2- 172.21.15.79:0/2991307648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2c01c05e0 0x7fb2c00c2510 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.118 7fb2c7563700 1 --2- 172.21.15.79:0/2991307648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2c01c0190 0x7fb2c00b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.118 7fb2c7563700 1 --2- 172.21.15.79:0/2991307648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2c00b07d0 0x7fb2c00c1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.118 7fb2c7563700 1 -- 172.21.15.79:0/2991307648 >> 172.21.15.79:0/2991307648 conn(0x7fb2c0096130 msgr2=0x7fb2c00955c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:13.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.118 7fb2c7563700 1 -- 172.21.15.79:0/2991307648 shutdown_connections 2021-04-09T18:26:13.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.118 7fb2c7563700 1 -- 172.21.15.79:0/2991307648 wait complete. 2021-04-09T18:26:13.138 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data allow_ec_overwrites true 2021-04-09T18:26:13.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.222 7faf826ab700 1 Processor -- start 2021-04-09T18:26:13.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.222 7faf826ab700 1 -- start start 2021-04-09T18:26:13.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.222 7faf826ab700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf7c0f5550 0x7faf7c0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:13.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.222 7faf826ab700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf7c0e9b10 0x7faf7c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:13.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.222 7faf826ab700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7c0fbb50 con 0x7faf7c1c2de0 2021-04-09T18:26:13.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.222 7faf826ab700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7c0e9f60 con 0x7faf7c0f5550 2021-04-09T18:26:13.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.222 7faf826ab700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c0e5a00 con 0x7faf7c0e9b10 2021-04-09T18:26:13.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.222 7faf80c50700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7faf7c1c2de0 0x7faf7c1c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50166/0 (socket says 172.21.15.79:50166) 2021-04-09T18:26:13.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf80c50700 1 -- 172.21.15.79:0/4157341273 learned_addr learned my addr 172.21.15.79:0/4157341273 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:13.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf7bfff700 1 --2- 172.21.15.79:0/4157341273 >> v2:172.21.15.89:3300/0 conn(0x7faf7c0f5550 0x7faf7c0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:13.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf7b7fe700 1 --2- 172.21.15.79:0/4157341273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf7c0e9b10 0x7faf7c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:13.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf7affd700 1 -- 172.21.15.79:0/4157341273 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048680610 0 0) 0x7faf6c001450 con 0x7faf7c1c2de0 2021-04-09T18:26:13.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf7affd700 1 -- 172.21.15.79:0/4157341273 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf68003240 con 0x7faf7c1c2de0 2021-04-09T18:26:13.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf7bfff700 1 -- 172.21.15.79:0/4157341273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf7c0e9b10 msgr2=0x7faf7c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:13.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf7bfff700 1 --2- 172.21.15.79:0/4157341273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf7c0e9b10 0x7faf7c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:13.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf7bfff700 1 -- 172.21.15.79:0/4157341273 >> v1:172.21.15.79:6789/0 conn(0x7faf7c1c2de0 legacy=0x7faf7c1c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:13.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf7bfff700 1 -- 172.21.15.79:0/4157341273 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c0e5700 con 0x7faf7c0f5550 2021-04-09T18:26:13.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf7bfff700 1 --2- 172.21.15.79:0/4157341273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf7c0f5550 0x7faf7c0f64e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7faf64002f30 tx=0x7faf6400bd40).ready entity=mon.1 client_cookie=afcc2f0acd1afbb2 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:13.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf7affd700 1 -- 172.21.15.79:0/4157341273 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf7c0e5700 con 0x7faf7c0f5550 2021-04-09T18:26:13.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf7affd700 1 -- 172.21.15.79:0/4157341273 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf64009850 con 0x7faf7c0f5550 2021-04-09T18:26:13.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf7affd700 1 -- 172.21.15.79:0/4157341273 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf64009c20 con 0x7faf7c0f5550 2021-04-09T18:26:13.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf826ab700 1 -- 172.21.15.79:0/4157341273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf7c0f5550 msgr2=0x7faf7c0f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:13.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf826ab700 1 --2- 172.21.15.79:0/4157341273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf7c0f5550 0x7faf7c0f64e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7faf64002f30 tx=0x7faf6400bd40).stop 2021-04-09T18:26:13.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf826ab700 1 -- 172.21.15.79:0/4157341273 shutdown_connections 2021-04-09T18:26:13.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf826ab700 1 --2- 172.21.15.79:0/4157341273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf7c0f5550 0x7faf7c0f64e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:13.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf826ab700 1 --2- 172.21.15.79:0/4157341273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf7c0e9b10 0x7faf7c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:13.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf826ab700 1 -- 172.21.15.79:0/4157341273 >> 172.21.15.79:0/4157341273 conn(0x7faf7c0e6010 msgr2=0x7faf7c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:13.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf826ab700 1 -- 172.21.15.79:0/4157341273 shutdown_connections 2021-04-09T18:26:13.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.226 7faf826ab700 1 -- 172.21.15.79:0/4157341273 wait complete. 2021-04-09T18:26:13.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf826ab700 1 Processor -- start 2021-04-09T18:26:13.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf826ab700 1 -- start start 2021-04-09T18:26:13.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf826ab700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf7c0993c0 0x7faf7c0d6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:13.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf826ab700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf7c090210 0x7faf7c0cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:13.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf826ab700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf7c0d0460 0x7faf7c0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:13.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf826ab700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c091160 con 0x7faf7c090210 2021-04-09T18:26:13.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf826ab700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c090660 con 0x7faf7c0993c0 2021-04-09T18:26:13.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf826ab700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c0d08b0 con 0x7faf7c0d0460 2021-04-09T18:26:13.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf7b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf7c090210 0x7faf7c0cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:13.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf7b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf7c090210 0x7faf7c0cfe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55460/0 (socket says 172.21.15.79:55460) 2021-04-09T18:26:13.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf7b7fe700 1 -- 172.21.15.79:0/80430363 learned_addr learned my addr 172.21.15.79:0/80430363 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:13.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf7bfff700 1 --2- 172.21.15.79:0/80430363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf7c0993c0 0x7faf7c0d6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:13.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf80c50700 1 --2- 172.21.15.79:0/80430363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf7c0d0460 0x7faf7c0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:13.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf7b7fe700 1 -- 172.21.15.79:0/80430363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf7c0d0460 msgr2=0x7faf7c0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:13.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf7b7fe700 1 --2- 172.21.15.79:0/80430363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf7c0d0460 0x7faf7c0cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:13.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf7b7fe700 1 -- 172.21.15.79:0/80430363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf7c0993c0 msgr2=0x7faf7c0d6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:13.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf7b7fe700 1 --2- 172.21.15.79:0/80430363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf7c0993c0 0x7faf7c0d6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:13.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf7b7fe700 1 -- 172.21.15.79:0/80430363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c090930 con 0x7faf7c090210 2021-04-09T18:26:13.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf7b7fe700 1 --2- 172.21.15.79:0/80430363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf7c090210 0x7faf7c0cfe30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7faf7c0d2e70 tx=0x7faf7400c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:13.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf78ff9700 1 -- 172.21.15.79:0/80430363 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf7c090930 con 0x7faf7c090210 2021-04-09T18:26:13.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf826ab700 1 -- 172.21.15.79:0/80430363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7c090cf0 con 0x7faf7c090210 2021-04-09T18:26:13.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf826ab700 1 -- 172.21.15.79:0/80430363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7c0cf250 con 0x7faf7c090210 2021-04-09T18:26:13.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf78ff9700 1 -- 172.21.15.79:0/80430363 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7400cc10 con 0x7faf7c090210 2021-04-09T18:26:13.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.230 7faf78ff9700 1 -- 172.21.15.79:0/80430363 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf7400f040 con 0x7faf7c090210 2021-04-09T18:26:13.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.234 7faf78ff9700 1 -- 172.21.15.79:0/80430363 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7faf74011070 con 0x7faf7c090210 2021-04-09T18:26:13.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.234 7faf78ff9700 1 --2- 172.21.15.79:0/80430363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf60029100 0x7faf6002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:13.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.234 7faf78ff9700 1 -- 172.21.15.79:0/80430363 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5819+0+0 (secure 0 0 0) 0x7faf74010040 con 0x7faf7c090210 2021-04-09T18:26:13.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.234 7faf7bfff700 1 --2- 172.21.15.79:0/80430363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf60029100 0x7faf6002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:13.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.234 7faf7bfff700 1 --2- 172.21.15.79:0/80430363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf60029100 0x7faf6002b650 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:13.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.238 7faf826ab700 1 -- 172.21.15.79:0/80430363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7c0e39f0 con 0x7faf7c090210 2021-04-09T18:26:13.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.242 7faf78ff9700 1 -- 172.21.15.79:0/80430363 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7faf74000bf0 con 0x7faf7c090210 2021-04-09T18:26:13.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:13.398 7faf826ab700 1 -- 172.21.15.79:0/80430363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "allow_ec_overwrites", "prefix": "osd pool set", "pool": "cephfs_data", "val": "true"} v 0) v1 -- 0x7faf7c0f5b50 con 0x7faf7c090210 2021-04-09T18:26:14.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.102 7faf78ff9700 1 -- 172.21.15.79:0/80430363 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "allow_ec_overwrites", "prefix": "osd pool set", "pool": "cephfs_data", "val": "true"}]=0 set pool 3 allow_ec_overwrites to true v21) v1 ==== 166+0+0 (secure 0 0 0) 0x7faf7400c810 con 0x7faf7c090210 2021-04-09T18:26:14.123 INFO:teuthology.orchestra.run.smithi079.stderr:set pool 3 allow_ec_overwrites to true 2021-04-09T18:26:14.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.118 7faf826ab700 1 -- 172.21.15.79:0/80430363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf60029100 msgr2=0x7faf6002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:14.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.118 7faf826ab700 1 --2- 172.21.15.79:0/80430363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf60029100 0x7faf6002b650 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.118 7faf826ab700 1 -- 172.21.15.79:0/80430363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf7c090210 msgr2=0x7faf7c0cfe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:14.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.118 7faf826ab700 1 --2- 172.21.15.79:0/80430363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf7c090210 0x7faf7c0cfe30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7faf7c0d2e70 tx=0x7faf7400c150).stop 2021-04-09T18:26:14.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.118 7faf826ab700 1 -- 172.21.15.79:0/80430363 shutdown_connections 2021-04-09T18:26:14.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.118 7faf826ab700 1 --2- 172.21.15.79:0/80430363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf60029100 0x7faf6002b650 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.118 7faf826ab700 1 --2- 172.21.15.79:0/80430363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf7c0993c0 0x7faf7c0d6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.118 7faf826ab700 1 --2- 172.21.15.79:0/80430363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf7c0d0460 0x7faf7c0cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.118 7faf826ab700 1 --2- 172.21.15.79:0/80430363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf7c090210 0x7faf7c0cfe30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.118 7faf826ab700 1 -- 172.21.15.79:0/80430363 >> 172.21.15.79:0/80430363 conn(0x7faf7c092d60 msgr2=0x7faf7c093590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:14.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.118 7faf826ab700 1 -- 172.21.15.79:0/80430363 shutdown_connections 2021-04-09T18:26:14.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.118 7faf826ab700 1 -- 172.21.15.79:0/80430363 wait complete. 2021-04-09T18:26:14.137 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-04-09T18:26:14.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f41c8700 1 Processor -- start 2021-04-09T18:26:14.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f41c8700 1 -- start start 2021-04-09T18:26:14.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f41c8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f80ec0e9b00 0x7f80ec09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:14.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f41c8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ec0fbb40 con 0x7f80ec0f5540 2021-04-09T18:26:14.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f41c8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ec0e56f0 con 0x7f80ec1c8030 2021-04-09T18:26:14.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f41c8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80ec1c3de0 con 0x7f80ec0e9b00 2021-04-09T18:26:14.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f176b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f80ec0e9b00 0x7f80ec09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:14.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f1f6c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f80ec0f5540 0x7f80ec0f64d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50176/0 (socket says 172.21.15.79:50176) 2021-04-09T18:26:14.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f1f6c700 1 -- 172.21.15.79:0/2464760288 learned_addr learned my addr 172.21.15.79:0/2464760288 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:14.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f176b700 1 --2- 172.21.15.79:0/2464760288 >> v2:172.21.15.79:3300/0 conn(0x7f80ec0e9b00 0x7f80ec09f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55468/0 (socket says 172.21.15.79:55468) 2021-04-09T18:26:14.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f176b700 1 -- 172.21.15.79:0/2464760288 >> v1:172.21.15.89:6789/0 conn(0x7f80ec1c8030 legacy=0x7f80ec1ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:14.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f176b700 1 -- 172.21.15.79:0/2464760288 >> v1:172.21.15.79:6789/0 conn(0x7f80ec0f5540 legacy=0x7f80ec0f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:14.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f176b700 1 -- 172.21.15.79:0/2464760288 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec0e4350 con 0x7f80ec0e9b00 2021-04-09T18:26:14.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f176b700 1 --2- 172.21.15.79:0/2464760288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80ec0e9b00 0x7f80ec09f100 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f80e80032b0 tx=0x7f80e800b0e0).ready entity=mon.0 client_cookie=15d6d8fb4125d08 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:14.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f0f6a700 1 -- 172.21.15.79:0/2464760288 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f80ec0e4350 con 0x7f80ec0e9b00 2021-04-09T18:26:14.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f0f6a700 1 -- 172.21.15.79:0/2464760288 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e800bab0 con 0x7f80ec0e9b00 2021-04-09T18:26:14.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f0f6a700 1 -- 172.21.15.79:0/2464760288 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f80e8002020 con 0x7f80ec0e9b00 2021-04-09T18:26:14.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f41c8700 1 -- 172.21.15.79:0/2464760288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80ec0e9b00 msgr2=0x7f80ec09f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:14.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f41c8700 1 --2- 172.21.15.79:0/2464760288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80ec0e9b00 0x7f80ec09f100 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f80e80032b0 tx=0x7f80e800b0e0).stop 2021-04-09T18:26:14.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f41c8700 1 -- 172.21.15.79:0/2464760288 shutdown_connections 2021-04-09T18:26:14.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f41c8700 1 --2- 172.21.15.79:0/2464760288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80ec0e9b00 0x7f80ec09f100 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f41c8700 1 -- 172.21.15.79:0/2464760288 >> 172.21.15.79:0/2464760288 conn(0x7f80ec0e6000 msgr2=0x7f80ec0e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:14.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f41c8700 1 -- 172.21.15.79:0/2464760288 shutdown_connections 2021-04-09T18:26:14.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.226 7f80f41c8700 1 -- 172.21.15.79:0/2464760288 wait complete. 2021-04-09T18:26:14.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f41c8700 1 Processor -- start 2021-04-09T18:26:14.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f41c8700 1 -- start start 2021-04-09T18:26:14.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f41c8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80ec1d0b00 0x7f80ec1d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:14.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f41c8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80ec1d4c20 0x7f80ec1d5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:14.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f41c8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80ec0b2160 0x7f80ec0b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:14.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f41c8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec0e9f50 con 0x7f80ec0b2160 2021-04-09T18:26:14.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f41c8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec0b1e60 con 0x7f80ec1d4c20 2021-04-09T18:26:14.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f41c8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec1d1580 con 0x7f80ec1d0b00 2021-04-09T18:26:14.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f276d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80ec0b2160 0x7f80ec0b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:14.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f1f6c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80ec1d0b00 0x7f80ec1d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:14.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f176b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80ec1d4c20 0x7f80ec1d5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:14.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f276d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80ec0b2160 0x7f80ec0b25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55476/0 (socket says 172.21.15.79:55476) 2021-04-09T18:26:14.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f276d700 1 -- 172.21.15.79:0/3125551026 learned_addr learned my addr 172.21.15.79:0/3125551026 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:14.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f276d700 1 -- 172.21.15.79:0/3125551026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80ec1d0b00 msgr2=0x7f80ec1d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:14.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f276d700 1 --2- 172.21.15.79:0/3125551026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80ec1d0b00 0x7f80ec1d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f276d700 1 -- 172.21.15.79:0/3125551026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80ec1d4c20 msgr2=0x7f80ec1d5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:14.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f276d700 1 --2- 172.21.15.79:0/3125551026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80ec1d4c20 0x7f80ec1d5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f276d700 1 -- 172.21.15.79:0/3125551026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec0b16f0 con 0x7f80ec0b2160 2021-04-09T18:26:14.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f176b700 1 --2- 172.21.15.79:0/3125551026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80ec1d4c20 0x7f80ec1d5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:14.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f276d700 1 --2- 172.21.15.79:0/3125551026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80ec0b2160 0x7f80ec0b25b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f80ec09b470 tx=0x7f80dc009b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:14.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80e27fc700 1 -- 172.21.15.79:0/3125551026 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f80ec0b16f0 con 0x7f80ec0b2160 2021-04-09T18:26:14.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80e27fc700 1 -- 172.21.15.79:0/3125551026 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc0105e0 con 0x7f80ec0b2160 2021-04-09T18:26:14.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80e27fc700 1 -- 172.21.15.79:0/3125551026 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f80dc0109b0 con 0x7f80ec0b2160 2021-04-09T18:26:14.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f41c8700 1 -- 172.21.15.79:0/3125551026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ec0b1a10 con 0x7f80ec0b2160 2021-04-09T18:26:14.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.230 7f80f41c8700 1 -- 172.21.15.79:0/3125551026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ec0b2be0 con 0x7f80ec0b2160 2021-04-09T18:26:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.234 7f80e27fc700 1 -- 172.21.15.79:0/3125551026 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f80dc010bb0 con 0x7f80ec0b2160 2021-04-09T18:26:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.234 7f80e27fc700 1 --2- 172.21.15.79:0/3125551026 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f80cc029100 0x7f80cc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.234 7f80e27fc700 1 -- 172.21.15.79:0/3125551026 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5819+0+0 (secure 0 0 0) 0x7f80dc038dc0 con 0x7f80ec0b2160 2021-04-09T18:26:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.234 7f80f1f6c700 1 --2- 172.21.15.79:0/3125551026 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f80cc029100 0x7f80cc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.234 7f80f1f6c700 1 --2- 172.21.15.79:0/3125551026 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f80cc029100 0x7f80cc02b650 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:14.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.238 7f80f41c8700 1 -- 172.21.15.79:0/3125551026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ec0e39e0 con 0x7f80ec0b2160 2021-04-09T18:26:14.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.242 7f80e27fc700 1 -- 172.21.15.79:0/3125551026 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f80dc00d040 con 0x7f80ec0b2160 2021-04-09T18:26:14.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.406 7f80f41c8700 1 -- 172.21.15.79:0/3125551026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f80ec0a1c80 con 0x7f80ec0b2160 2021-04-09T18:26:14.414 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:26:14.406 7fbccdd11700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:26:14.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.414 7f80e27fc700 1 -- 172.21.15.79:0/3125551026 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 2 and data pool 3 v2) v1 ==== 187+0+0 (secure 0 0 0) 0x7f80ec0f76e0 con 0x7f80ec0b2160 2021-04-09T18:26:14.428 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 2 and data pool 3 2021-04-09T18:26:14.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.422 7f80f41c8700 1 -- 172.21.15.79:0/3125551026 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f80cc029100 msgr2=0x7f80cc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:14.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.422 7f80f41c8700 1 --2- 172.21.15.79:0/3125551026 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f80cc029100 0x7f80cc02b650 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.422 7f80f41c8700 1 -- 172.21.15.79:0/3125551026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80ec0b2160 msgr2=0x7f80ec0b25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.422 7f80f41c8700 1 --2- 172.21.15.79:0/3125551026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80ec0b2160 0x7f80ec0b25b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f80ec09b470 tx=0x7f80dc009b60).stop 2021-04-09T18:26:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.426 7f80f41c8700 1 -- 172.21.15.79:0/3125551026 shutdown_connections 2021-04-09T18:26:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.426 7f80f41c8700 1 --2- 172.21.15.79:0/3125551026 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f80cc029100 0x7f80cc02b650 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.426 7f80f41c8700 1 --2- 172.21.15.79:0/3125551026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80ec0b2160 0x7f80ec0b25b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.426 7f80f41c8700 1 --2- 172.21.15.79:0/3125551026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80ec1d0b00 0x7f80ec1d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.426 7f80f41c8700 1 --2- 172.21.15.79:0/3125551026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80ec1d4c20 0x7f80ec1d5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.426 7f80f41c8700 1 -- 172.21.15.79:0/3125551026 >> 172.21.15.79:0/3125551026 conn(0x7f80ec0946b0 msgr2=0x7f80ec098750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:14.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.426 7f80f41c8700 1 -- 172.21.15.79:0/3125551026 shutdown_connections 2021-04-09T18:26:14.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.426 7f80f41c8700 1 -- 172.21.15.79:0/3125551026 wait complete. 2021-04-09T18:26:14.443 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:14.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46ff87700 1 Processor -- start 2021-04-09T18:26:14.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46ff87700 1 -- start start 2021-04-09T18:26:14.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46ff87700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb4680f5510 0x7fb4680f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:14.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46ff87700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4681c8000 0x7fb4681ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:14.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46ff87700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4680fbb10 con 0x7fb4680e9ad0 2021-04-09T18:26:14.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46ff87700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4680e9f20 con 0x7fb4680f5510 2021-04-09T18:26:14.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46ff87700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4681c3db0 con 0x7fb4681c8000 2021-04-09T18:26:14.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46dd2b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb4680f5510 0x7fb4680f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:14.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46dd2b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb4680f5510 0x7fb4680f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55484/0 (socket says 172.21.15.79:55484) 2021-04-09T18:26:14.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46dd2b700 1 -- 172.21.15.79:0/2869719164 learned_addr learned my addr 172.21.15.79:0/2869719164 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:14.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46e52c700 1 --2- 172.21.15.79:0/2869719164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4681c8000 0x7fb4681ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:14.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46dd2b700 1 -- 172.21.15.79:0/2869719164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4681c8000 msgr2=0x7fb4681ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:14.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46dd2b700 1 --2- 172.21.15.79:0/2869719164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4681c8000 0x7fb4681ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46dd2b700 1 -- 172.21.15.79:0/2869719164 >> v1:172.21.15.89:6789/0 conn(0x7fb4680e9ad0 legacy=0x7fb46809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:14.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46dd2b700 1 -- 172.21.15.79:0/2869719164 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46809f900 con 0x7fb4680f5510 2021-04-09T18:26:14.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46dd2b700 1 --2- 172.21.15.79:0/2869719164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4680f5510 0x7fb4680f64a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb4680f6ef0 tx=0x7fb45800bdd0).ready entity=mon.0 client_cookie=b369504f408caab4 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:14.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46cd29700 1 -- 172.21.15.79:0/2869719164 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb46809f900 con 0x7fb4680f5510 2021-04-09T18:26:14.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46cd29700 1 -- 172.21.15.79:0/2869719164 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb458009990 con 0x7fb4680f5510 2021-04-09T18:26:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46cd29700 1 -- 172.21.15.79:0/2869719164 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb458009d60 con 0x7fb4680f5510 2021-04-09T18:26:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46ff87700 1 -- 172.21.15.79:0/2869719164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4680f5510 msgr2=0x7fb4680f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46ff87700 1 --2- 172.21.15.79:0/2869719164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4680f5510 0x7fb4680f64a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb4680f6ef0 tx=0x7fb45800bdd0).stop 2021-04-09T18:26:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46ff87700 1 -- 172.21.15.79:0/2869719164 shutdown_connections 2021-04-09T18:26:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46ff87700 1 --2- 172.21.15.79:0/2869719164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4681c8000 0x7fb4681ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46ff87700 1 --2- 172.21.15.79:0/2869719164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4680f5510 0x7fb4680f64a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46ff87700 1 -- 172.21.15.79:0/2869719164 >> 172.21.15.79:0/2869719164 conn(0x7fb4680e5fd0 msgr2=0x7fb4680e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:14.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46ff87700 1 -- 172.21.15.79:0/2869719164 shutdown_connections 2021-04-09T18:26:14.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.534 7fb46ff87700 1 -- 172.21.15.79:0/2869719164 wait complete. 2021-04-09T18:26:14.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.538 7fb46ff87700 1 Processor -- start 2021-04-09T18:26:14.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.538 7fb46ff87700 1 -- start start 2021-04-09T18:26:14.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.538 7fb46ff87700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4680a2fe0 0x7fb4680c1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:14.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.538 7fb46ff87700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4680d4f90 0x7fb4680af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:14.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.538 7fb46ff87700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4680d53e0 0x7fb4680af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:14.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.538 7fb46ff87700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4680ada00 con 0x7fb4680a2fe0 2021-04-09T18:26:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.538 7fb46ff87700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4680add00 con 0x7fb4680d4f90 2021-04-09T18:26:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.538 7fb46ff87700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4681a2ac0 con 0x7fb4680d53e0 2021-04-09T18:26:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.538 7fb46dd2b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4680a2fe0 0x7fb4680c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.538 7fb46dd2b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4680a2fe0 0x7fb4680c1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55488/0 (socket says 172.21.15.79:55488) 2021-04-09T18:26:14.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.538 7fb46dd2b700 1 -- 172.21.15.79:0/503035472 learned_addr learned my addr 172.21.15.79:0/503035472 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.538 7fb46e52c700 1 --2- 172.21.15.79:0/503035472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4680d53e0 0x7fb4680af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.538 7fb46d52a700 1 --2- 172.21.15.79:0/503035472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4680d4f90 0x7fb4680af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:14.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.542 7fb46dd2b700 1 -- 172.21.15.79:0/503035472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4680d53e0 msgr2=0x7fb4680af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:14.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.542 7fb46dd2b700 1 --2- 172.21.15.79:0/503035472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4680d53e0 0x7fb4680af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.542 7fb46dd2b700 1 -- 172.21.15.79:0/503035472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4680d4f90 msgr2=0x7fb4680af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:14.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.542 7fb46dd2b700 1 --2- 172.21.15.79:0/503035472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4680d4f90 0x7fb4680af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.542 7fb46dd2b700 1 -- 172.21.15.79:0/503035472 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4680ad140 con 0x7fb4680a2fe0 2021-04-09T18:26:14.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.542 7fb46dd2b700 1 --2- 172.21.15.79:0/503035472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4680a2fe0 0x7fb4680c1460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb46809b460 tx=0x7fb458006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:14.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.542 7fb4667fc700 1 -- 172.21.15.79:0/503035472 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4680ad140 con 0x7fb4680a2fe0 2021-04-09T18:26:14.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.542 7fb4667fc700 1 -- 172.21.15.79:0/503035472 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb458011de0 con 0x7fb4680a2fe0 2021-04-09T18:26:14.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.542 7fb46ff87700 1 -- 172.21.15.79:0/503035472 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4680ad5b0 con 0x7fb4680a2fe0 2021-04-09T18:26:14.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.542 7fb4667fc700 1 -- 172.21.15.79:0/503035472 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb45801d640 con 0x7fb4680a2fe0 2021-04-09T18:26:14.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.542 7fb46ff87700 1 -- 172.21.15.79:0/503035472 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4680b02d0 con 0x7fb4680a2fe0 2021-04-09T18:26:14.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.542 7fb4667fc700 1 -- 172.21.15.79:0/503035472 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb45801d840 con 0x7fb4680a2fe0 2021-04-09T18:26:14.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.542 7fb4667fc700 1 --2- 172.21.15.79:0/503035472 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb448029100 0x7fb44802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:14.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.542 7fb4667fc700 1 -- 172.21.15.79:0/503035472 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fb45803c7f0 con 0x7fb4680a2fe0 2021-04-09T18:26:14.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.542 7fb46d52a700 1 --2- 172.21.15.79:0/503035472 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb448029100 0x7fb44802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:14.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.546 7fb46d52a700 1 --2- 172.21.15.79:0/503035472 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb448029100 0x7fb44802b650 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:14.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.546 7fb46ff87700 1 -- 172.21.15.79:0/503035472 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4680e39d0 con 0x7fb4680a2fe0 2021-04-09T18:26:14.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.554 7fb4667fc700 1 -- 172.21.15.79:0/503035472 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb458009780 con 0x7fb4680a2fe0 2021-04-09T18:26:14.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.714 7fb46ff87700 1 -- 172.21.15.79:0/503035472 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4680f5b10 con 0x7fb4680a2fe0 2021-04-09T18:26:14.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.718 7fb4667fc700 1 -- 172.21.15.79:0/503035472 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14254 (secure 0 0 0) 0x7fb458011bd0 con 0x7fb4680a2fe0 2021-04-09T18:26:14.727 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:14.727 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:14.412296","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:26:09.311735","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:26:12.130710","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:26:14.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.722 7fb46ff87700 1 -- 172.21.15.79:0/503035472 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb448029100 msgr2=0x7fb44802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:14.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.722 7fb46ff87700 1 --2- 172.21.15.79:0/503035472 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb448029100 0x7fb44802b650 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.722 7fb46ff87700 1 -- 172.21.15.79:0/503035472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4680a2fe0 msgr2=0x7fb4680c1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:14.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.722 7fb46ff87700 1 --2- 172.21.15.79:0/503035472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4680a2fe0 0x7fb4680c1460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb46809b460 tx=0x7fb458006890).stop 2021-04-09T18:26:14.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.722 7fb46ff87700 1 -- 172.21.15.79:0/503035472 shutdown_connections 2021-04-09T18:26:14.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.722 7fb46ff87700 1 --2- 172.21.15.79:0/503035472 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb448029100 0x7fb44802b650 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.722 7fb46ff87700 1 --2- 172.21.15.79:0/503035472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4680d53e0 0x7fb4680af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.722 7fb46ff87700 1 --2- 172.21.15.79:0/503035472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4680a2fe0 0x7fb4680c1460 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.722 7fb46ff87700 1 --2- 172.21.15.79:0/503035472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4680d4f90 0x7fb4680af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.722 7fb46ff87700 1 -- 172.21.15.79:0/503035472 >> 172.21.15.79:0/503035472 conn(0x7fb4680a24b0 msgr2=0x7fb4680d8110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:14.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.722 7fb46ff87700 1 -- 172.21.15.79:0/503035472 shutdown_connections 2021-04-09T18:26:14.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.722 7fb46ff87700 1 -- 172.21.15.79:0/503035472 wait complete. 2021-04-09T18:26:14.739 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:14.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.818 7f13078b4700 1 Processor -- start 2021-04-09T18:26:14.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.818 7f13078b4700 1 -- start start 2021-04-09T18:26:14.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.818 7f13078b4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13001c9020 0x7f13001cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:14.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.818 7f13078b4700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13000fbb20 con 0x7f13000e9ae0 2021-04-09T18:26:14.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.818 7f13078b4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f130009f910 con 0x7f13000f5520 2021-04-09T18:26:14.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.818 7f13078b4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13001c3dc0 con 0x7f13001c9020 2021-04-09T18:26:14.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.818 7f1304e57700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f13000e9ae0 0x7f130009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50206/0 (socket says 172.21.15.79:50206) 2021-04-09T18:26:14.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.818 7f1304e57700 1 -- 172.21.15.79:0/2982379471 learned_addr learned my addr 172.21.15.79:0/2982379471 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:14.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.818 7f1305e59700 1 --2- 172.21.15.79:0/2982379471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13001c9020 0x7f13001cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:14.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.818 7f12f7fff700 1 -- 172.21.15.79:0/2982379471 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872119585 0 0) 0x7f12f00010d0 con 0x7f13000e9ae0 2021-04-09T18:26:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.822 7f12f7fff700 1 -- 172.21.15.79:0/2982379471 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12ec003240 con 0x7f13000e9ae0 2021-04-09T18:26:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.822 7f12f7fff700 1 -- 172.21.15.79:0/2982379471 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773430287 0 0) 0x7f12fc0010d0 con 0x7f13000f5520 2021-04-09T18:26:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.822 7f12f7fff700 1 -- 172.21.15.79:0/2982379471 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12ec003620 con 0x7f13000f5520 2021-04-09T18:26:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.822 7f12f7fff700 1 -- 172.21.15.79:0/2982379471 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1378232911 0 0) 0x7f12f0001650 con 0x7f13000e9ae0 2021-04-09T18:26:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.822 7f1305e59700 1 -- 172.21.15.79:0/2982379471 >> v1:172.21.15.89:6789/0 conn(0x7f13000f5520 legacy=0x7f13000f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.822 7f1305e59700 1 -- 172.21.15.79:0/2982379471 >> v1:172.21.15.79:6789/0 conn(0x7f13000e9ae0 legacy=0x7f130009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.822 7f1305e59700 1 -- 172.21.15.79:0/2982379471 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13000e56d0 con 0x7f13001c9020 2021-04-09T18:26:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.822 7f1305e59700 1 --2- 172.21.15.79:0/2982379471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13001c9020 0x7f13001cb480 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f12f0001df0 tx=0x7f12f800b0e0).ready entity=mon.2 client_cookie=3a60eed87a3e9343 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.822 7f12f7fff700 1 -- 172.21.15.79:0/2982379471 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f13000e56d0 con 0x7f13001c9020 2021-04-09T18:26:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.822 7f12f7fff700 1 -- 172.21.15.79:0/2982379471 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f800b9b0 con 0x7f13001c9020 2021-04-09T18:26:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.822 7f13078b4700 1 -- 172.21.15.79:0/2982379471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13001c9020 msgr2=0x7f13001cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.822 7f12f7fff700 1 -- 172.21.15.79:0/2982379471 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f12f8002020 con 0x7f13001c9020 2021-04-09T18:26:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.822 7f13078b4700 1 --2- 172.21.15.79:0/2982379471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13001c9020 0x7f13001cb480 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f12f0001df0 tx=0x7f12f800b0e0).stop 2021-04-09T18:26:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.822 7f13078b4700 1 -- 172.21.15.79:0/2982379471 shutdown_connections 2021-04-09T18:26:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.822 7f13078b4700 1 --2- 172.21.15.79:0/2982379471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13001c9020 0x7f13001cb480 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.822 7f13078b4700 1 -- 172.21.15.79:0/2982379471 >> 172.21.15.79:0/2982379471 conn(0x7f13000e5fe0 msgr2=0x7f13000e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.822 7f13078b4700 1 -- 172.21.15.79:0/2982379471 shutdown_connections 2021-04-09T18:26:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.822 7f13078b4700 1 -- 172.21.15.79:0/2982379471 wait complete. 2021-04-09T18:26:14.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f13078b4700 1 Processor -- start 2021-04-09T18:26:14.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f13078b4700 1 -- start start 2021-04-09T18:26:14.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f13078b4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13000bf480 0x7f13000d5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:14.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f13078b4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13000d57b0 0x7f13000bbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:14.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f13078b4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13000bc530 0x7f13000bc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:14.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f13078b4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000885c0 con 0x7f13000bf480 2021-04-09T18:26:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f13078b4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000e9f30 con 0x7f13000bc530 2021-04-09T18:26:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f13078b4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13000bfbd0 con 0x7f13000d57b0 2021-04-09T18:26:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f1305658700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13000bf480 0x7f13000d5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f1305658700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13000bf480 0x7f13000d5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55500/0 (socket says 172.21.15.79:55500) 2021-04-09T18:26:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f1305658700 1 -- 172.21.15.79:0/1629355816 learned_addr learned my addr 172.21.15.79:0/1629355816 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f1304e57700 1 --2- 172.21.15.79:0/1629355816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13000d57b0 0x7f13000bbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f1305e59700 1 --2- 172.21.15.79:0/1629355816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13000bc530 0x7f13000bc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f1305658700 1 -- 172.21.15.79:0/1629355816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13000d57b0 msgr2=0x7f13000bbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:14.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f1305658700 1 --2- 172.21.15.79:0/1629355816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13000d57b0 0x7f13000bbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f1305658700 1 -- 172.21.15.79:0/1629355816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13000bc530 msgr2=0x7f13000bc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f1305658700 1 --2- 172.21.15.79:0/1629355816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13000bc530 0x7f13000bc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f1305658700 1 -- 172.21.15.79:0/1629355816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13000bf020 con 0x7f13000bf480 2021-04-09T18:26:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f1305658700 1 --2- 172.21.15.79:0/1629355816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13000bf480 0x7f13000d5180 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f12fc000b80 tx=0x7f12fc00ca80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:14.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f12f5ffb700 1 -- 172.21.15.79:0/1629355816 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f13000bf020 con 0x7f13000bf480 2021-04-09T18:26:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f12f5ffb700 1 -- 172.21.15.79:0/1629355816 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc010510 con 0x7f13000bf480 2021-04-09T18:26:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f13078b4700 1 -- 172.21.15.79:0/1629355816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13000a30e0 con 0x7f13000bf480 2021-04-09T18:26:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.826 7f12f5ffb700 1 -- 172.21.15.79:0/1629355816 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f12fc0106f0 con 0x7f13000bf480 2021-04-09T18:26:14.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.830 7f13078b4700 1 -- 172.21.15.79:0/1629355816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13001ae420 con 0x7f13000bf480 2021-04-09T18:26:14.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.830 7f12f5ffb700 1 -- 172.21.15.79:0/1629355816 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f12fc019020 con 0x7f13000bf480 2021-04-09T18:26:14.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.830 7f12f5ffb700 1 --2- 172.21.15.79:0/1629355816 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f12e0029100 0x7f12e002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:14.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.830 7f12f5ffb700 1 -- 172.21.15.79:0/1629355816 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f12fc038e10 con 0x7f13000bf480 2021-04-09T18:26:14.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.830 7f1304e57700 1 --2- 172.21.15.79:0/1629355816 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f12e0029100 0x7f12e002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:14.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.830 7f1304e57700 1 --2- 172.21.15.79:0/1629355816 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f12e0029100 0x7f12e002b650 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:14.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.830 7f13078b4700 1 -- 172.21.15.79:0/1629355816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13000e39e0 con 0x7f13000bf480 2021-04-09T18:26:14.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.838 7f12f5ffb700 1 -- 172.21.15.79:0/1629355816 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f12fc010300 con 0x7f13000bf480 2021-04-09T18:26:15.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.998 7f13078b4700 1 -- 172.21.15.79:0/1629355816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13000f5b20 con 0x7f13000bf480 2021-04-09T18:26:15.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:14.998 7f12f5ffb700 1 -- 172.21.15.79:0/1629355816 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14254 (secure 0 0 0) 0x7f1300107f50 con 0x7f13000bf480 2021-04-09T18:26:15.009 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:15.009 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:14.412296","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:26:09.311735","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:26:12.130710","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:26:15.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.002 7f13078b4700 1 -- 172.21.15.79:0/1629355816 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f12e0029100 msgr2=0x7f12e002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:15.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.002 7f13078b4700 1 --2- 172.21.15.79:0/1629355816 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f12e0029100 0x7f12e002b650 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:15.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.002 7f13078b4700 1 -- 172.21.15.79:0/1629355816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13000bf480 msgr2=0x7f13000d5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:15.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.002 7f13078b4700 1 --2- 172.21.15.79:0/1629355816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13000bf480 0x7f13000d5180 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f12fc000b80 tx=0x7f12fc00ca80).stop 2021-04-09T18:26:15.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.002 7f13078b4700 1 -- 172.21.15.79:0/1629355816 shutdown_connections 2021-04-09T18:26:15.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.002 7f13078b4700 1 --2- 172.21.15.79:0/1629355816 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f12e0029100 0x7f12e002b650 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:15.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.002 7f13078b4700 1 --2- 172.21.15.79:0/1629355816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13000bc530 0x7f13000bc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:15.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.002 7f13078b4700 1 --2- 172.21.15.79:0/1629355816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13000bf480 0x7f13000d5180 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:15.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.002 7f13078b4700 1 --2- 172.21.15.79:0/1629355816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13000d57b0 0x7f13000bbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:15.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.002 7f13078b4700 1 -- 172.21.15.79:0/1629355816 >> 172.21.15.79:0/1629355816 conn(0x7f130009acf0 msgr2=0x7f13000d84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:15.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.002 7f13078b4700 1 -- 172.21.15.79:0/1629355816 shutdown_connections 2021-04-09T18:26:15.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.002 7f13078b4700 1 -- 172.21.15.79:0/1629355816 wait complete. 2021-04-09T18:26:15.021 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-04-09T18:26:15.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08df8f3700 1 Processor -- start 2021-04-09T18:26:15.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08df8f3700 1 -- start start 2021-04-09T18:26:15.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08df8f3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08d80e9b10 0x7f08d809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:15.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08df8f3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f08d81c8040 0x7f08d81ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:15.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08df8f3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d80fbb50 con 0x7f08d80f5550 2021-04-09T18:26:15.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08df8f3700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d81c3df0 con 0x7f08d80e9b10 2021-04-09T18:26:15.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08df8f3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d80e9f60 con 0x7f08d81c8040 2021-04-09T18:26:15.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08dce96700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08d80e9b10 0x7f08d809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:15.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08dce96700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08d80e9b10 0x7f08d809f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55510/0 (socket says 172.21.15.79:55510) 2021-04-09T18:26:15.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08dce96700 1 -- 172.21.15.79:0/301664057 learned_addr learned my addr 172.21.15.79:0/301664057 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:15.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08dde98700 1 --2- 172.21.15.79:0/301664057 >> v2:172.21.15.89:3300/0 conn(0x7f08d81c8040 0x7f08d81ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:15.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08dce96700 1 -- 172.21.15.79:0/301664057 >> v2:172.21.15.89:3300/0 conn(0x7f08d81c8040 msgr2=0x7f08d81ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:15.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08dce96700 1 --2- 172.21.15.79:0/301664057 >> v2:172.21.15.89:3300/0 conn(0x7f08d81c8040 0x7f08d81ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:15.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08dce96700 1 -- 172.21.15.79:0/301664057 >> v1:172.21.15.89:6789/0 conn(0x7f08d80f5550 legacy=0x7f08d80f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:15.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08dce96700 1 -- 172.21.15.79:0/301664057 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d80e5700 con 0x7f08d80e9b10 2021-04-09T18:26:15.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08dce96700 1 --2- 172.21.15.79:0/301664057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d80e9b10 0x7f08d809f110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f08d40032b0 tx=0x7f08d400b3c0).ready entity=mon.0 client_cookie=4439da19d3556473 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:15.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08cffff700 1 -- 172.21.15.79:0/301664057 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08d80e5700 con 0x7f08d80e9b10 2021-04-09T18:26:15.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08cffff700 1 -- 172.21.15.79:0/301664057 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d400bc20 con 0x7f08d80e9b10 2021-04-09T18:26:15.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08cffff700 1 -- 172.21.15.79:0/301664057 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08d4002020 con 0x7f08d80e9b10 2021-04-09T18:26:15.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08df8f3700 1 -- 172.21.15.79:0/301664057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d80e9b10 msgr2=0x7f08d809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:15.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08df8f3700 1 --2- 172.21.15.79:0/301664057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d80e9b10 0x7f08d809f110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f08d40032b0 tx=0x7f08d400b3c0).stop 2021-04-09T18:26:15.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08df8f3700 1 -- 172.21.15.79:0/301664057 shutdown_connections 2021-04-09T18:26:15.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08df8f3700 1 --2- 172.21.15.79:0/301664057 >> v2:172.21.15.89:3300/0 conn(0x7f08d81c8040 0x7f08d81ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:15.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08df8f3700 1 --2- 172.21.15.79:0/301664057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d80e9b10 0x7f08d809f110 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:15.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08df8f3700 1 -- 172.21.15.79:0/301664057 >> 172.21.15.79:0/301664057 conn(0x7f08d80e6010 msgr2=0x7f08d80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:15.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08df8f3700 1 -- 172.21.15.79:0/301664057 shutdown_connections 2021-04-09T18:26:15.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.106 7f08df8f3700 1 -- 172.21.15.79:0/301664057 wait complete. 2021-04-09T18:26:15.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08df8f3700 1 Processor -- start 2021-04-09T18:26:15.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08df8f3700 1 -- start start 2021-04-09T18:26:15.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08df8f3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d80abc40 0x7f08d80d4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:15.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08df8f3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08d808f6e0 0x7f08d80d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:15.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08df8f3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08d8090da0 0x7f08d80911f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:15.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08df8f3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d8047500 con 0x7f08d80abc40 2021-04-09T18:26:15.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08df8f3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d80acb00 con 0x7f08d8090da0 2021-04-09T18:26:15.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08df8f3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d808fb30 con 0x7f08d808f6e0 2021-04-09T18:26:15.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08dd697700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d80abc40 0x7f08d80d4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:15.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08dd697700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d80abc40 0x7f08d80d4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55514/0 (socket says 172.21.15.79:55514) 2021-04-09T18:26:15.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08dd697700 1 -- 172.21.15.79:0/1015620670 learned_addr learned my addr 172.21.15.79:0/1015620670 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:15.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08dce96700 1 --2- 172.21.15.79:0/1015620670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08d808f6e0 0x7f08d80d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:15.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08dde98700 1 --2- 172.21.15.79:0/1015620670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08d8090da0 0x7f08d80911f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:15.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08dd697700 1 -- 172.21.15.79:0/1015620670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08d808f6e0 msgr2=0x7f08d80d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:15.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08dd697700 1 --2- 172.21.15.79:0/1015620670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08d808f6e0 0x7f08d80d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:15.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08dd697700 1 -- 172.21.15.79:0/1015620670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08d8090da0 msgr2=0x7f08d80911f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:15.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08dd697700 1 --2- 172.21.15.79:0/1015620670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08d8090da0 0x7f08d80911f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:15.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08dd697700 1 -- 172.21.15.79:0/1015620670 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d80d4b80 con 0x7f08d80abc40 2021-04-09T18:26:15.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08dd697700 1 --2- 172.21.15.79:0/1015620670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d80abc40 0x7f08d80d4550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f08d8093bc0 tx=0x7f08c800cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:15.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08cdffb700 1 -- 172.21.15.79:0/1015620670 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08d80d4b80 con 0x7f08d80abc40 2021-04-09T18:26:15.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08cdffb700 1 -- 172.21.15.79:0/1015620670 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c8010510 con 0x7f08d80abc40 2021-04-09T18:26:15.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.110 7f08cdffb700 1 -- 172.21.15.79:0/1015620670 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08c80106f0 con 0x7f08d80abc40 2021-04-09T18:26:15.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.114 7f08df8f3700 1 -- 172.21.15.79:0/1015620670 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d80ac690 con 0x7f08d80abc40 2021-04-09T18:26:15.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.114 7f08df8f3700 1 -- 172.21.15.79:0/1015620670 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d80d11d0 con 0x7f08d80abc40 2021-04-09T18:26:15.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.114 7f08cdffb700 1 -- 172.21.15.79:0/1015620670 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f08c8019020 con 0x7f08d80abc40 2021-04-09T18:26:15.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.114 7f08cdffb700 1 --2- 172.21.15.79:0/1015620670 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f08b8029100 0x7f08b802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:15.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.114 7f08cdffb700 1 -- 172.21.15.79:0/1015620670 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f08c8038de0 con 0x7f08d80abc40 2021-04-09T18:26:15.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.114 7f08dce96700 1 --2- 172.21.15.79:0/1015620670 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f08b8029100 0x7f08b802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:15.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.114 7f08dce96700 1 --2- 172.21.15.79:0/1015620670 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f08b8029100 0x7f08b802b650 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:15.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.118 7f08df8f3700 1 -- 172.21.15.79:0/1015620670 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d80e39f0 con 0x7f08d80abc40 2021-04-09T18:26:15.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.126 7f08cdffb700 1 -- 172.21.15.79:0/1015620670 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f08c8010300 con 0x7f08d80abc40 2021-04-09T18:26:15.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:15.298 7f08df8f3700 1 -- 172.21.15.79:0/1015620670 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f08d80f5b50 con 0x7f08d80abc40 2021-04-09T18:26:16.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.114 7f08cdffb700 1 -- 172.21.15.79:0/1015620670 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v3) v1 ==== 118+0+0 (secure 0 0 0) 0x7f08c8000bf0 con 0x7f08d80abc40 2021-04-09T18:26:16.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.166 7f08df8f3700 1 -- 172.21.15.79:0/1015620670 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f08b8029100 msgr2=0x7f08b802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:16.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.166 7f08df8f3700 1 --2- 172.21.15.79:0/1015620670 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f08b8029100 0x7f08b802b650 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.166 7f08df8f3700 1 -- 172.21.15.79:0/1015620670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d80abc40 msgr2=0x7f08d80d4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:16.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.166 7f08df8f3700 1 --2- 172.21.15.79:0/1015620670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d80abc40 0x7f08d80d4550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f08d8093bc0 tx=0x7f08c800cae0).stop 2021-04-09T18:26:16.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.166 7f08df8f3700 1 -- 172.21.15.79:0/1015620670 shutdown_connections 2021-04-09T18:26:16.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.166 7f08df8f3700 1 --2- 172.21.15.79:0/1015620670 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f08b8029100 0x7f08b802b650 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.166 7f08df8f3700 1 --2- 172.21.15.79:0/1015620670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08d8090da0 0x7f08d80911f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.166 7f08df8f3700 1 --2- 172.21.15.79:0/1015620670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d80abc40 0x7f08d80d4550 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.166 7f08df8f3700 1 --2- 172.21.15.79:0/1015620670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08d808f6e0 0x7f08d80d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.166 7f08df8f3700 1 -- 172.21.15.79:0/1015620670 >> 172.21.15.79:0/1015620670 conn(0x7f08d80d8080 msgr2=0x7f08d8093c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:16.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.166 7f08df8f3700 1 -- 172.21.15.79:0/1015620670 shutdown_connections 2021-04-09T18:26:16.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.166 7f08df8f3700 1 -- 172.21.15.79:0/1015620670 wait complete. 2021-04-09T18:26:16.192 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:26:16.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.278 7f8142634700 1 Processor -- start 2021-04-09T18:26:16.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.278 7f8142634700 1 -- start start 2021-04-09T18:26:16.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.278 7f8142634700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f813c0e9ae0 0x7f813c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:16.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.278 7f8142634700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f813c1c8010 0x7f813c1ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:16.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.278 7f8142634700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813c0fbb20 con 0x7f813c0f5520 2021-04-09T18:26:16.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.278 7f8142634700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813c1c3dc0 con 0x7f813c1c8010 2021-04-09T18:26:16.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.278 7f8142634700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813c0e9f30 con 0x7f813c0e9ae0 2021-04-09T18:26:16.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.278 7f8140bd9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f813c1c8010 0x7f813c1ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:16.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.278 7f8140bd9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f813c1c8010 0x7f813c1ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55526/0 (socket says 172.21.15.79:55526) 2021-04-09T18:26:16.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.278 7f8140bd9700 1 -- 172.21.15.79:0/4115080643 learned_addr learned my addr 172.21.15.79:0/4115080643 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:16.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.278 7f813b7fe700 1 --2- 172.21.15.79:0/4115080643 >> v2:172.21.15.89:3300/0 conn(0x7f813c0e9ae0 0x7f813c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:16.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.282 7f8140bd9700 1 -- 172.21.15.79:0/4115080643 >> v2:172.21.15.89:3300/0 conn(0x7f813c0e9ae0 msgr2=0x7f813c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:16.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.282 7f8140bd9700 1 --2- 172.21.15.79:0/4115080643 >> v2:172.21.15.89:3300/0 conn(0x7f813c0e9ae0 0x7f813c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.282 7f8140bd9700 1 -- 172.21.15.79:0/4115080643 >> v1:172.21.15.89:6789/0 conn(0x7f813c0f5520 legacy=0x7f813c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:16.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.282 7f8140bd9700 1 -- 172.21.15.79:0/4115080643 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c0e56d0 con 0x7f813c1c8010 2021-04-09T18:26:16.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.282 7f8140bd9700 1 --2- 172.21.15.79:0/4115080643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f813c1c8010 0x7f813c1ca470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f81340032b0 tx=0x7f813400b3c0).ready entity=mon.0 client_cookie=92137bf7b213dd6c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:16.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.282 7f813affd700 1 -- 172.21.15.79:0/4115080643 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f813c0e56d0 con 0x7f813c1c8010 2021-04-09T18:26:16.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.282 7f813affd700 1 -- 172.21.15.79:0/4115080643 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813400bc20 con 0x7f813c1c8010 2021-04-09T18:26:16.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.282 7f813affd700 1 -- 172.21.15.79:0/4115080643 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8134002020 con 0x7f813c1c8010 2021-04-09T18:26:16.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.282 7f8142634700 1 -- 172.21.15.79:0/4115080643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f813c1c8010 msgr2=0x7f813c1ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:16.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.282 7f8142634700 1 --2- 172.21.15.79:0/4115080643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f813c1c8010 0x7f813c1ca470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f81340032b0 tx=0x7f813400b3c0).stop 2021-04-09T18:26:16.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.282 7f8142634700 1 -- 172.21.15.79:0/4115080643 shutdown_connections 2021-04-09T18:26:16.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.282 7f8142634700 1 --2- 172.21.15.79:0/4115080643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f813c1c8010 0x7f813c1ca470 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.282 7f8142634700 1 --2- 172.21.15.79:0/4115080643 >> v2:172.21.15.89:3300/0 conn(0x7f813c0e9ae0 0x7f813c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.282 7f8142634700 1 -- 172.21.15.79:0/4115080643 >> 172.21.15.79:0/4115080643 conn(0x7f813c0e5fe0 msgr2=0x7f813c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:16.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.282 7f8142634700 1 -- 172.21.15.79:0/4115080643 shutdown_connections 2021-04-09T18:26:16.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.282 7f8142634700 1 -- 172.21.15.79:0/4115080643 wait complete. 2021-04-09T18:26:16.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.286 7f8142634700 1 Processor -- start 2021-04-09T18:26:16.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.286 7f8142634700 1 -- start start 2021-04-09T18:26:16.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.286 7f8142634700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f813c094ab0 0x7f813c0b8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:16.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.286 7f8142634700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f813c0d6a50 0x7f813c1a75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:16.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.286 7f8142634700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f813c1a7c20 0x7f813c0cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:16.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.286 7f8142634700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0b7690 con 0x7f813c0d6a50 2021-04-09T18:26:16.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.286 7f8142634700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0d6ea0 con 0x7f813c1a7c20 2021-04-09T18:26:16.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.286 7f8142634700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0b7990 con 0x7f813c094ab0 2021-04-09T18:26:16.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.286 7f813b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f813c0d6a50 0x7f813c1a75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:16.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.286 7f813b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f813c0d6a50 0x7f813c1a75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55528/0 (socket says 172.21.15.79:55528) 2021-04-09T18:26:16.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.286 7f813b7fe700 1 -- 172.21.15.79:0/646610041 learned_addr learned my addr 172.21.15.79:0/646610041 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:16.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.286 7f8140bd9700 1 --2- 172.21.15.79:0/646610041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f813c1a7c20 0x7f813c0cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:16.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.286 7f813bfff700 1 --2- 172.21.15.79:0/646610041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f813c094ab0 0x7f813c0b8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:16.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.286 7f813b7fe700 1 -- 172.21.15.79:0/646610041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f813c094ab0 msgr2=0x7f813c0b8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:16.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.286 7f813b7fe700 1 --2- 172.21.15.79:0/646610041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f813c094ab0 0x7f813c0b8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.286 7f813b7fe700 1 -- 172.21.15.79:0/646610041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f813c1a7c20 msgr2=0x7f813c0cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:16.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.286 7f813b7fe700 1 --2- 172.21.15.79:0/646610041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f813c1a7c20 0x7f813c0cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.286 7f813b7fe700 1 -- 172.21.15.79:0/646610041 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c0b9560 con 0x7f813c0d6a50 2021-04-09T18:26:16.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.286 7f8140bd9700 1 --2- 172.21.15.79:0/646610041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f813c1a7c20 0x7f813c0cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:16.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.286 7f813b7fe700 1 --2- 172.21.15.79:0/646610041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f813c0d6a50 0x7f813c1a75f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f813c0d3000 tx=0x7f813000c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:16.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.290 7f8138ff9700 1 -- 172.21.15.79:0/646610041 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f813000f040 con 0x7f813c0d6a50 2021-04-09T18:26:16.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.290 7f8138ff9700 1 -- 172.21.15.79:0/646610041 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813000cc10 con 0x7f813c0d6a50 2021-04-09T18:26:16.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.290 7f8142634700 1 -- 172.21.15.79:0/646610041 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813c0b7220 con 0x7f813c0d6a50 2021-04-09T18:26:16.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.290 7f8138ff9700 1 -- 172.21.15.79:0/646610041 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f81300123f0 con 0x7f813c0d6a50 2021-04-09T18:26:16.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.290 7f8142634700 1 -- 172.21.15.79:0/646610041 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813c0cf7a0 con 0x7f813c0d6a50 2021-04-09T18:26:16.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.290 7f8138ff9700 1 -- 172.21.15.79:0/646610041 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8130011070 con 0x7f813c0d6a50 2021-04-09T18:26:16.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.290 7f8138ff9700 1 --2- 172.21.15.79:0/646610041 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f811c029100 0x7f811c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:16.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.290 7f8138ff9700 1 -- 172.21.15.79:0/646610041 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f8130010040 con 0x7f813c0d6a50 2021-04-09T18:26:16.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.290 7f813bfff700 1 --2- 172.21.15.79:0/646610041 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f811c029100 0x7f811c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:16.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.290 7f813bfff700 1 --2- 172.21.15.79:0/646610041 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f811c029100 0x7f811c02b650 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:16.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.290 7f8142634700 1 -- 172.21.15.79:0/646610041 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813c1a52d0 con 0x7f813c0d6a50 2021-04-09T18:26:16.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.298 7f8138ff9700 1 -- 172.21.15.79:0/646610041 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8130000bf0 con 0x7f813c0d6a50 2021-04-09T18:26:16.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.462 7f8142634700 1 -- 172.21.15.79:0/646610041 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f813c0e39e0 con 0x7f813c0d6a50 2021-04-09T18:26:16.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.466 7f8138ff9700 1 -- 172.21.15.79:0/646610041 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1415 (secure 0 0 0) 0x7f813000c810 con 0x7f813c0d6a50 2021-04-09T18:26:16.474 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 3 2021-04-09T18:26:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:16.475 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":3,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":3,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:26:14.412596","modified":"2021-04-09 18:26:16.107928","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:26:16.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.470 7f8142634700 1 -- 172.21.15.79:0/646610041 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f811c029100 msgr2=0x7f811c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:16.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.470 7f8142634700 1 --2- 172.21.15.79:0/646610041 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f811c029100 0x7f811c02b650 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.470 7f8142634700 1 -- 172.21.15.79:0/646610041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f813c0d6a50 msgr2=0x7f813c1a75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:16.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.470 7f8142634700 1 --2- 172.21.15.79:0/646610041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f813c0d6a50 0x7f813c1a75f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f813c0d3000 tx=0x7f813000c150).stop 2021-04-09T18:26:16.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.470 7f8142634700 1 -- 172.21.15.79:0/646610041 shutdown_connections 2021-04-09T18:26:16.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.470 7f8142634700 1 --2- 172.21.15.79:0/646610041 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f811c029100 0x7f811c02b650 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.470 7f8142634700 1 --2- 172.21.15.79:0/646610041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f813c1a7c20 0x7f813c0cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.470 7f8142634700 1 --2- 172.21.15.79:0/646610041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f813c094ab0 0x7f813c0b8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.470 7f8142634700 1 --2- 172.21.15.79:0/646610041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f813c0d6a50 0x7f813c1a75f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.470 7f8142634700 1 -- 172.21.15.79:0/646610041 >> 172.21.15.79:0/646610041 conn(0x7f813c0d8bb0 msgr2=0x7f813c0d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:16.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.470 7f8142634700 1 -- 172.21.15.79:0/646610041 shutdown_connections 2021-04-09T18:26:16.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.470 7f8142634700 1 -- 172.21.15.79:0/646610041 wait complete. 2021-04-09T18:26:16.487 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:16.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88fd91a700 1 Processor -- start 2021-04-09T18:26:16.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88fd91a700 1 -- start start 2021-04-09T18:26:16.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88fd91a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88f80f5520 0x7f88f80f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:16.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88fd91a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f88f81c8010 0x7f88f81ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:16.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88fd91a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f80fbb20 con 0x7f88f80e9ae0 2021-04-09T18:26:16.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88fd91a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f80e9f30 con 0x7f88f81c8010 2021-04-09T18:26:16.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88fd91a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f81c3dc0 con 0x7f88f80f5520 2021-04-09T18:26:16.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88f7d51700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f88f81c8010 0x7f88f81ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:16.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88f7d51700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f88f81c8010 0x7f88f81ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55540/0 (socket says 172.21.15.79:55540) 2021-04-09T18:26:16.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88f7d51700 1 -- 172.21.15.79:0/1678676179 learned_addr learned my addr 172.21.15.79:0/1678676179 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:16.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88f7550700 1 --2- 172.21.15.79:0/1678676179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88f80f5520 0x7f88f80f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:16.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88f7d51700 1 -- 172.21.15.79:0/1678676179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88f80f5520 msgr2=0x7f88f80f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:16.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88f7d51700 1 --2- 172.21.15.79:0/1678676179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88f80f5520 0x7f88f80f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88f7d51700 1 -- 172.21.15.79:0/1678676179 >> v1:172.21.15.89:6789/0 conn(0x7f88f80e9ae0 legacy=0x7f88f809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:16.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88f7d51700 1 -- 172.21.15.79:0/1678676179 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f809f910 con 0x7f88f81c8010 2021-04-09T18:26:16.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88f7d51700 1 --2- 172.21.15.79:0/1678676179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88f81c8010 0x7f88f81ca470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f88f00032b0 tx=0x7f88f000b3c0).ready entity=mon.0 client_cookie=d53b90529e155a8f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:16.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88f654e700 1 -- 172.21.15.79:0/1678676179 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88f809f910 con 0x7f88f81c8010 2021-04-09T18:26:16.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88f654e700 1 -- 172.21.15.79:0/1678676179 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f000bc20 con 0x7f88f81c8010 2021-04-09T18:26:16.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88f654e700 1 -- 172.21.15.79:0/1678676179 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88f0002020 con 0x7f88f81c8010 2021-04-09T18:26:16.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88fd91a700 1 -- 172.21.15.79:0/1678676179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88f81c8010 msgr2=0x7f88f81ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:16.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.574 7f88fd91a700 1 --2- 172.21.15.79:0/1678676179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88f81c8010 0x7f88f81ca470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f88f00032b0 tx=0x7f88f000b3c0).stop 2021-04-09T18:26:16.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.578 7f88fd91a700 1 -- 172.21.15.79:0/1678676179 shutdown_connections 2021-04-09T18:26:16.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.578 7f88fd91a700 1 --2- 172.21.15.79:0/1678676179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88f81c8010 0x7f88f81ca470 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.578 7f88fd91a700 1 --2- 172.21.15.79:0/1678676179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88f80f5520 0x7f88f80f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.578 7f88fd91a700 1 -- 172.21.15.79:0/1678676179 >> 172.21.15.79:0/1678676179 conn(0x7f88f80e5fe0 msgr2=0x7f88f80e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:16.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.578 7f88fd91a700 1 -- 172.21.15.79:0/1678676179 shutdown_connections 2021-04-09T18:26:16.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.578 7f88fd91a700 1 -- 172.21.15.79:0/1678676179 wait complete. 2021-04-09T18:26:16.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88fd91a700 1 Processor -- start 2021-04-09T18:26:16.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88fd91a700 1 -- start start 2021-04-09T18:26:16.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88fd91a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88f80ad150 0x7f88f80c1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:16.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88fd91a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88f81aefd0 0x7f88f80d4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:16.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88fd91a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88f80d53f0 0x7f88f80a3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:16.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88fd91a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f80ad820 con 0x7f88f81aefd0 2021-04-09T18:26:16.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88fd91a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f80adb20 con 0x7f88f80d53f0 2021-04-09T18:26:16.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88fd91a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f81af420 con 0x7f88f80ad150 2021-04-09T18:26:16.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88f6d4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88f81aefd0 0x7f88f80d4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:16.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88f6d4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88f81aefd0 0x7f88f80d4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55542/0 (socket says 172.21.15.79:55542) 2021-04-09T18:26:16.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88f6d4f700 1 -- 172.21.15.79:0/2778788816 learned_addr learned my addr 172.21.15.79:0/2778788816 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:16.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88f7550700 1 --2- 172.21.15.79:0/2778788816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88f80ad150 0x7f88f80c1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:16.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88f7d51700 1 --2- 172.21.15.79:0/2778788816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88f80d53f0 0x7f88f80a3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:16.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88f6d4f700 1 -- 172.21.15.79:0/2778788816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88f80ad150 msgr2=0x7f88f80c1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88f6d4f700 1 --2- 172.21.15.79:0/2778788816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88f80ad150 0x7f88f80c1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88f6d4f700 1 -- 172.21.15.79:0/2778788816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88f80d53f0 msgr2=0x7f88f80a3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88f6d4f700 1 --2- 172.21.15.79:0/2778788816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88f80d53f0 0x7f88f80a3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88f6d4f700 1 -- 172.21.15.79:0/2778788816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f80c1aa0 con 0x7f88f81aefd0 2021-04-09T18:26:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88f6d4f700 1 --2- 172.21.15.79:0/2778788816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88f81aefd0 0x7f88f80d4dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f88f80874d0 tx=0x7f88ec00cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88dffff700 1 -- 172.21.15.79:0/2778788816 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88f80c1aa0 con 0x7f88f81aefd0 2021-04-09T18:26:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88dffff700 1 -- 172.21.15.79:0/2778788816 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec010510 con 0x7f88f81aefd0 2021-04-09T18:26:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88fd91a700 1 -- 172.21.15.79:0/2778788816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f80a3b40 con 0x7f88f81aefd0 2021-04-09T18:26:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88dffff700 1 -- 172.21.15.79:0/2778788816 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88ec0106f0 con 0x7f88f81aefd0 2021-04-09T18:26:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88fd91a700 1 -- 172.21.15.79:0/2778788816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f80a40a0 con 0x7f88f81aefd0 2021-04-09T18:26:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88dffff700 1 -- 172.21.15.79:0/2778788816 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f88ec019020 con 0x7f88f81aefd0 2021-04-09T18:26:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.582 7f88dffff700 1 --2- 172.21.15.79:0/2778788816 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f88d8029100 0x7f88d802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:16.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.586 7f88dffff700 1 -- 172.21.15.79:0/2778788816 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f88ec038de0 con 0x7f88f81aefd0 2021-04-09T18:26:16.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.586 7f88f7550700 1 --2- 172.21.15.79:0/2778788816 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f88d8029100 0x7f88d802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:16.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.586 7f88f7550700 1 --2- 172.21.15.79:0/2778788816 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f88d8029100 0x7f88d802b650 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:16.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.586 7f88fd91a700 1 -- 172.21.15.79:0/2778788816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f80e39e0 con 0x7f88f81aefd0 2021-04-09T18:26:16.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.590 7f88dffff700 1 -- 172.21.15.79:0/2778788816 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f88ec010300 con 0x7f88f81aefd0 2021-04-09T18:26:16.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.754 7f88fd91a700 1 -- 172.21.15.79:0/2778788816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88f80f5b20 con 0x7f88f81aefd0 2021-04-09T18:26:16.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.758 7f88dffff700 1 -- 172.21.15.79:0/2778788816 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14254 (secure 0 0 0) 0x7f88ec000bf0 con 0x7f88f81aefd0 2021-04-09T18:26:16.765 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:16.765 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:14.412296","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:26:09.311735","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:26:12.130710","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:26:16.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.758 7f88fd91a700 1 -- 172.21.15.79:0/2778788816 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f88d8029100 msgr2=0x7f88d802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:16.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.758 7f88fd91a700 1 --2- 172.21.15.79:0/2778788816 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f88d8029100 0x7f88d802b650 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.758 7f88fd91a700 1 -- 172.21.15.79:0/2778788816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88f81aefd0 msgr2=0x7f88f80d4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:16.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.758 7f88fd91a700 1 --2- 172.21.15.79:0/2778788816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88f81aefd0 0x7f88f80d4dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f88f80874d0 tx=0x7f88ec00cae0).stop 2021-04-09T18:26:16.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.758 7f88fd91a700 1 -- 172.21.15.79:0/2778788816 shutdown_connections 2021-04-09T18:26:16.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.758 7f88fd91a700 1 --2- 172.21.15.79:0/2778788816 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f88d8029100 0x7f88d802b650 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.762 7f88fd91a700 1 --2- 172.21.15.79:0/2778788816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88f80d53f0 0x7f88f80a3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.762 7f88fd91a700 1 --2- 172.21.15.79:0/2778788816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88f80ad150 0x7f88f80c1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.762 7f88fd91a700 1 --2- 172.21.15.79:0/2778788816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88f81aefd0 0x7f88f80d4dc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.762 7f88fd91a700 1 -- 172.21.15.79:0/2778788816 >> 172.21.15.79:0/2778788816 conn(0x7f88f81a27a0 msgr2=0x7f88f81a1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:16.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.762 7f88fd91a700 1 -- 172.21.15.79:0/2778788816 shutdown_connections 2021-04-09T18:26:16.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.762 7f88fd91a700 1 -- 172.21.15.79:0/2778788816 wait complete. 2021-04-09T18:26:16.778 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2021-04-09T18:26:16.778 INFO:tasks.ceph.mds.a:Restarting daemon 2021-04-09T18:26:16.779 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-04-09T18:26:16.781 INFO:tasks.ceph.mds.a:Started 2021-04-09T18:26:16.781 INFO:tasks.ceph.mds.b:Restarting daemon 2021-04-09T18:26:16.782 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-04-09T18:26:16.784 INFO:tasks.ceph.mds.b:Started 2021-04-09T18:26:16.785 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:16.854 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2021-04-09T18:26:16.861 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2021-04-09T18:26:16.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.858 7f909b396700 1 Processor -- start 2021-04-09T18:26:16.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.858 7f909b396700 1 -- start start 2021-04-09T18:26:16.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.858 7f909b396700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f90940f5510 0x7f90940f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:16.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909b396700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90940e9ad0 0x7f909409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:16.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909b396700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90940fbb10 con 0x7f90941c2da0 2021-04-09T18:26:16.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909b396700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90940e9f20 con 0x7f90940f5510 2021-04-09T18:26:16.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909b396700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90940e59c0 con 0x7f90940e9ad0 2021-04-09T18:26:16.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909913a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f90940f5510 0x7f90940f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:16.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909913a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f90940f5510 0x7f90940f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55562/0 (socket says 172.21.15.79:55562) 2021-04-09T18:26:16.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909913a700 1 -- 172.21.15.79:0/1731238397 learned_addr learned my addr 172.21.15.79:0/1731238397 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:16.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909993b700 1 --1- 172.21.15.79:0/1731238397 >> v1:172.21.15.79:6789/0 conn(0x7f90941c2da0 0x7f90941c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50274/0 (socket says 172.21.15.79:50274) 2021-04-09T18:26:16.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f9098939700 1 --2- 172.21.15.79:0/1731238397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90940e9ad0 0x7f909409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:16.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909913a700 1 -- 172.21.15.79:0/1731238397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90940e9ad0 msgr2=0x7f909409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:16.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909913a700 1 --2- 172.21.15.79:0/1731238397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90940e9ad0 0x7f909409f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909913a700 1 -- 172.21.15.79:0/1731238397 >> v1:172.21.15.79:6789/0 conn(0x7f90941c2da0 legacy=0x7f90941c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:16.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f908bfff700 1 -- 172.21.15.79:0/1731238397 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83402926 0 0) 0x7f908c001450 con 0x7f90941c2da0 2021-04-09T18:26:16.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909913a700 1 -- 172.21.15.79:0/1731238397 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90940e56c0 con 0x7f90940f5510 2021-04-09T18:26:16.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909913a700 1 --2- 172.21.15.79:0/1731238397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90940f5510 0x7f90940f64a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f9090002f30 tx=0x7f909000bda0).ready entity=mon.0 client_cookie=5c85937399126109 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:16.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f908bfff700 1 -- 172.21.15.79:0/1731238397 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90940e56c0 con 0x7f90940f5510 2021-04-09T18:26:16.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f908bfff700 1 -- 172.21.15.79:0/1731238397 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90900099d0 con 0x7f90940f5510 2021-04-09T18:26:16.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f908bfff700 1 -- 172.21.15.79:0/1731238397 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9090009da0 con 0x7f90940f5510 2021-04-09T18:26:16.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909b396700 1 -- 172.21.15.79:0/1731238397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90940f5510 msgr2=0x7f90940f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:16.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909b396700 1 --2- 172.21.15.79:0/1731238397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90940f5510 0x7f90940f64a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f9090002f30 tx=0x7f909000bda0).stop 2021-04-09T18:26:16.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909b396700 1 -- 172.21.15.79:0/1731238397 shutdown_connections 2021-04-09T18:26:16.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909b396700 1 --2- 172.21.15.79:0/1731238397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90940f5510 0x7f90940f64a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909b396700 1 --2- 172.21.15.79:0/1731238397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90940e9ad0 0x7f909409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909b396700 1 -- 172.21.15.79:0/1731238397 >> 172.21.15.79:0/1731238397 conn(0x7f90940e5fd0 msgr2=0x7f90940e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:16.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909b396700 1 -- 172.21.15.79:0/1731238397 shutdown_connections 2021-04-09T18:26:16.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.862 7f909b396700 1 -- 172.21.15.79:0/1731238397 wait complete. 2021-04-09T18:26:16.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f909b396700 1 Processor -- start 2021-04-09T18:26:16.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f909b396700 1 -- start start 2021-04-09T18:26:16.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f909b396700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90940983a0 0x7f90940d4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:16.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f909b396700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90940d5260 0x7f90940ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:16.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f909b396700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90940987f0 0x7f90940ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:16.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f909b396700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9094096b20 con 0x7f90940983a0 2021-04-09T18:26:16.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f909b396700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90940aef30 con 0x7f90940d5260 2021-04-09T18:26:16.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f909b396700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9094096e20 con 0x7f90940987f0 2021-04-09T18:26:16.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f909913a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90940983a0 0x7f90940d4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:16.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f909913a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90940983a0 0x7f90940d4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55568/0 (socket says 172.21.15.79:55568) 2021-04-09T18:26:16.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f909913a700 1 -- 172.21.15.79:0/2064053793 learned_addr learned my addr 172.21.15.79:0/2064053793 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:16.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f909993b700 1 --2- 172.21.15.79:0/2064053793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90940987f0 0x7f90940ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:16.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f9098939700 1 --2- 172.21.15.79:0/2064053793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90940d5260 0x7f90940ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:16.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f909913a700 1 -- 172.21.15.79:0/2064053793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90940987f0 msgr2=0x7f90940ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:16.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f909913a700 1 --2- 172.21.15.79:0/2064053793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90940987f0 0x7f90940ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f909913a700 1 -- 172.21.15.79:0/2064053793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90940d5260 msgr2=0x7f90940ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:16.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f909913a700 1 --2- 172.21.15.79:0/2064053793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90940d5260 0x7f90940ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:16.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f909913a700 1 -- 172.21.15.79:0/2064053793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9094098e40 con 0x7f90940983a0 2021-04-09T18:26:16.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f9098939700 1 --2- 172.21.15.79:0/2064053793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90940d5260 0x7f90940ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:16.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f909913a700 1 --2- 172.21.15.79:0/2064053793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90940983a0 0x7f90940d4c30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f90940d7ea0 tx=0x7f9090006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:16.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f9089ffb700 1 -- 172.21.15.79:0/2064053793 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9094098e40 con 0x7f90940983a0 2021-04-09T18:26:16.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f9089ffb700 1 -- 172.21.15.79:0/2064053793 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9090011d90 con 0x7f90940983a0 2021-04-09T18:26:16.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f9089ffb700 1 -- 172.21.15.79:0/2064053793 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f909001d630 con 0x7f90940983a0 2021-04-09T18:26:16.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f909b396700 1 -- 172.21.15.79:0/2064053793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90940966b0 con 0x7f90940983a0 2021-04-09T18:26:16.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f909b396700 1 -- 172.21.15.79:0/2064053793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90940c39c0 con 0x7f90940983a0 2021-04-09T18:26:16.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f9089ffb700 1 -- 172.21.15.79:0/2064053793 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f909001d830 con 0x7f90940983a0 2021-04-09T18:26:16.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f9089ffb700 1 --2- 172.21.15.79:0/2064053793 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9074029100 0x7f907402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:16.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f9089ffb700 1 -- 172.21.15.79:0/2064053793 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f909003aa00 con 0x7f90940983a0 2021-04-09T18:26:16.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.866 7f9098939700 1 --2- 172.21.15.79:0/2064053793 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9074029100 0x7f907402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:16.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.870 7f9098939700 1 --2- 172.21.15.79:0/2064053793 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9074029100 0x7f907402b650 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:16.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.874 7f909b396700 1 -- 172.21.15.79:0/2064053793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9094098c40 con 0x7f90940983a0 2021-04-09T18:26:16.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:16.882 7f9089ffb700 1 -- 172.21.15.79:0/2064053793 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9090011b80 con 0x7f90940983a0 2021-04-09T18:26:17.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.046 7f909b396700 1 -- 172.21.15.79:0/2064053793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90940e39d0 con 0x7f90940983a0 2021-04-09T18:26:17.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.050 7f9089ffb700 1 -- 172.21.15.79:0/2064053793 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14254 (secure 0 0 0) 0x7f90900097c0 con 0x7f90940983a0 2021-04-09T18:26:17.058 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:17.058 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:14.412296","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:26:09.311735","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:26:12.130710","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:26:17.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.054 7f909b396700 1 -- 172.21.15.79:0/2064053793 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9074029100 msgr2=0x7f907402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.054 7f909b396700 1 --2- 172.21.15.79:0/2064053793 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9074029100 0x7f907402b650 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.054 7f909b396700 1 -- 172.21.15.79:0/2064053793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90940983a0 msgr2=0x7f90940d4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.054 7f909b396700 1 --2- 172.21.15.79:0/2064053793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90940983a0 0x7f90940d4c30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f90940d7ea0 tx=0x7f9090006890).stop 2021-04-09T18:26:17.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.054 7f909b396700 1 -- 172.21.15.79:0/2064053793 shutdown_connections 2021-04-09T18:26:17.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.054 7f909b396700 1 --2- 172.21.15.79:0/2064053793 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9074029100 0x7f907402b650 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.054 7f909b396700 1 --2- 172.21.15.79:0/2064053793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90940987f0 0x7f90940ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.054 7f909b396700 1 --2- 172.21.15.79:0/2064053793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90940983a0 0x7f90940d4c30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.054 7f909b396700 1 --2- 172.21.15.79:0/2064053793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90940d5260 0x7f90940ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.054 7f909b396700 1 -- 172.21.15.79:0/2064053793 >> 172.21.15.79:0/2064053793 conn(0x7f909409aa40 msgr2=0x7f90940d7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:17.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.054 7f909b396700 1 -- 172.21.15.79:0/2064053793 shutdown_connections 2021-04-09T18:26:17.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.054 7f909b396700 1 -- 172.21.15.79:0/2064053793 wait complete. 2021-04-09T18:26:17.071 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:26:09.311735', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:26:12.130710', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:26:17.072 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:26:17.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf12154700 1 Processor -- start 2021-04-09T18:26:17.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf12154700 1 -- start start 2021-04-09T18:26:17.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf12154700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf0c0e9b10 0x7fcf0c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:17.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf12154700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf0c0fbb50 con 0x7fcf0c0f5550 2021-04-09T18:26:17.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf12154700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf0c0e5700 con 0x7fcf0c1c8040 2021-04-09T18:26:17.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf12154700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c1c3df0 con 0x7fcf0c0e9b10 2021-04-09T18:26:17.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcf0c0f5550 0x7fcf0c0f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50290/0 (socket says 172.21.15.79:50290) 2021-04-09T18:26:17.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0b7fe700 1 -- 172.21.15.79:0/881592956 learned_addr learned my addr 172.21.15.79:0/881592956 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:17.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0affd700 1 --2- 172.21.15.79:0/881592956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf0c0e9b10 0x7fcf0c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:17.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0a7fc700 1 -- 172.21.15.79:0/881592956 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271016349 0 0) 0x7fcefc0010d0 con 0x7fcf0c0f5550 2021-04-09T18:26:17.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0a7fc700 1 -- 172.21.15.79:0/881592956 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcef8003240 con 0x7fcf0c0f5550 2021-04-09T18:26:17.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0a7fc700 1 -- 172.21.15.79:0/881592956 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 76858229 0 0) 0x7fcf04001450 con 0x7fcf0c1c8040 2021-04-09T18:26:17.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0a7fc700 1 -- 172.21.15.79:0/881592956 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcef8003620 con 0x7fcf0c1c8040 2021-04-09T18:26:17.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0a7fc700 1 -- 172.21.15.79:0/881592956 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2140016338 0 0) 0x7fcefc001650 con 0x7fcf0c0f5550 2021-04-09T18:26:17.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0a7fc700 1 -- 172.21.15.79:0/881592956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf0c0e9b10 msgr2=0x7fcf0c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:17.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0a7fc700 1 --2- 172.21.15.79:0/881592956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf0c0e9b10 0x7fcf0c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0a7fc700 1 -- 172.21.15.79:0/881592956 >> v1:172.21.15.89:6789/0 conn(0x7fcf0c1c8040 legacy=0x7fcf0c1ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0a7fc700 1 -- 172.21.15.79:0/881592956 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c0e4360 con 0x7fcf0c0f5550 2021-04-09T18:26:17.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0a7fc700 1 -- 172.21.15.79:0/881592956 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7fcefc001bb0 con 0x7fcf0c0f5550 2021-04-09T18:26:17.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0affd700 1 --2- 172.21.15.79:0/881592956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf0c0e9b10 0x7fcf0c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:17.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0a7fc700 1 -- 172.21.15.79:0/881592956 >> v1:172.21.15.79:6789/0 conn(0x7fcf0c0f5550 legacy=0x7fcf0c0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0a7fc700 1 --2- 172.21.15.79:0/881592956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcef8003d40 0x7fcef80045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:17.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0a7fc700 1 --2- 172.21.15.79:0/881592956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcef8004bd0 0x7fcef80097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:17.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0a7fc700 1 --2- 172.21.15.79:0/881592956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcef8005020 0x7fcef800be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:17.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0a7fc700 1 -- 172.21.15.79:0/881592956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c1c3df0 con 0x7fcef8005020 2021-04-09T18:26:17.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0a7fc700 1 -- 172.21.15.79:0/881592956 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef8050460 con 0x7fcef8004bd0 2021-04-09T18:26:17.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0a7fc700 1 -- 172.21.15.79:0/881592956 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef8050610 con 0x7fcef8003d40 2021-04-09T18:26:17.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0bfff700 1 --2- 172.21.15.79:0/881592956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcef8005020 0x7fcef800be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:17.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0affd700 1 --2- 172.21.15.79:0/881592956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcef8004bd0 0x7fcef80097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:17.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0b7fe700 1 --2- 172.21.15.79:0/881592956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcef8003d40 0x7fcef80045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:17.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0bfff700 1 -- 172.21.15.79:0/881592956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcef8003d40 msgr2=0x7fcef80045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:17.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0bfff700 1 --2- 172.21.15.79:0/881592956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcef8003d40 0x7fcef80045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0bfff700 1 -- 172.21.15.79:0/881592956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcef8004bd0 msgr2=0x7fcef80097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:17.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.170 7fcf0bfff700 1 --2- 172.21.15.79:0/881592956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcef8004bd0 0x7fcef80097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.174 7fcf0bfff700 1 -- 172.21.15.79:0/881592956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef8050880 con 0x7fcef8005020 2021-04-09T18:26:17.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.174 7fcf0bfff700 1 --2- 172.21.15.79:0/881592956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcef8005020 0x7fcef800be20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fcef8004510 tx=0x7fcf0400c4a0).ready entity=mon.0 client_cookie=3a9567966332b465 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:17.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.174 7fcf0a7fc700 1 -- 172.21.15.79:0/881592956 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcef8050880 con 0x7fcef8005020 2021-04-09T18:26:17.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.174 7fcf0a7fc700 1 -- 172.21.15.79:0/881592956 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0400cdf0 con 0x7fcef8005020 2021-04-09T18:26:17.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.174 7fcf0a7fc700 1 -- 172.21.15.79:0/881592956 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcf040125f0 con 0x7fcef8005020 2021-04-09T18:26:17.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.174 7fcf12154700 1 -- 172.21.15.79:0/881592956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcef8005020 msgr2=0x7fcef800be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.174 7fcf12154700 1 --2- 172.21.15.79:0/881592956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcef8005020 0x7fcef800be20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fcef8004510 tx=0x7fcf0400c4a0).stop 2021-04-09T18:26:17.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.174 7fcf0bfff700 1 -- 172.21.15.79:0/881592956 reap_dead start 2021-04-09T18:26:17.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.174 7fcf12154700 1 -- 172.21.15.79:0/881592956 shutdown_connections 2021-04-09T18:26:17.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.174 7fcf12154700 1 -- 172.21.15.79:0/881592956 >> 172.21.15.79:0/881592956 conn(0x7fcf0c0e6010 msgr2=0x7fcf0c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:17.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.174 7fcf12154700 1 -- 172.21.15.79:0/881592956 shutdown_connections 2021-04-09T18:26:17.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.174 7fcf12154700 1 -- 172.21.15.79:0/881592956 wait complete. 2021-04-09T18:26:17.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf12154700 1 Processor -- start 2021-04-09T18:26:17.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf12154700 1 -- start start 2021-04-09T18:26:17.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf12154700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf0c19c470 0x7fcf0c19ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:17.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf12154700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf0c0ae150 0x7fcf0c19e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:17.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf12154700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf0c0ae5a0 0x7fcf0c0aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:17.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf12154700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c0e9f60 con 0x7fcf0c19c470 2021-04-09T18:26:17.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf12154700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c19cbe0 con 0x7fcf0c0ae5a0 2021-04-09T18:26:17.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf12154700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c19cee0 con 0x7fcf0c0ae150 2021-04-09T18:26:17.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf0b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf0c19c470 0x7fcf0c19ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:17.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf0b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf0c19c470 0x7fcf0c19ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55588/0 (socket says 172.21.15.79:55588) 2021-04-09T18:26:17.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf0b7fe700 1 -- 172.21.15.79:0/2211091736 learned_addr learned my addr 172.21.15.79:0/2211091736 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:17.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf0bfff700 1 --2- 172.21.15.79:0/2211091736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf0c0ae5a0 0x7fcf0c0aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:17.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf0affd700 1 --2- 172.21.15.79:0/2211091736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf0c0ae150 0x7fcf0c19e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:17.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf0b7fe700 1 -- 172.21.15.79:0/2211091736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf0c0ae150 msgr2=0x7fcf0c19e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf0b7fe700 1 --2- 172.21.15.79:0/2211091736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf0c0ae150 0x7fcf0c19e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf0b7fe700 1 -- 172.21.15.79:0/2211091736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf0c0ae5a0 msgr2=0x7fcf0c0aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf0b7fe700 1 --2- 172.21.15.79:0/2211091736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf0c0ae5a0 0x7fcf0c0aee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf0b7fe700 1 -- 172.21.15.79:0/2211091736 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c1af190 con 0x7fcf0c19c470 2021-04-09T18:26:17.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf0b7fe700 1 --2- 172.21.15.79:0/2211091736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf0c19c470 0x7fcf0c19ba10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fcf0c19cb60 tx=0x7fcefc00f560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:17.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf03fff700 1 -- 172.21.15.79:0/2211091736 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcf0c1af190 con 0x7fcf0c19c470 2021-04-09T18:26:17.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf03fff700 1 -- 172.21.15.79:0/2211091736 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc0145f0 con 0x7fcf0c19c470 2021-04-09T18:26:17.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf12154700 1 -- 172.21.15.79:0/2211091736 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0c19c040 con 0x7fcf0c19c470 2021-04-09T18:26:17.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf03fff700 1 -- 172.21.15.79:0/2211091736 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcefc010040 con 0x7fcf0c19c470 2021-04-09T18:26:17.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.178 7fcf12154700 1 -- 172.21.15.79:0/2211091736 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0c19eab0 con 0x7fcf0c19c470 2021-04-09T18:26:17.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.182 7fcf03fff700 1 -- 172.21.15.79:0/2211091736 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fcefc01b060 con 0x7fcf0c19c470 2021-04-09T18:26:17.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.182 7fcf03fff700 1 --2- 172.21.15.79:0/2211091736 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcef0029100 0x7fcef002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:17.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.182 7fcf03fff700 1 -- 172.21.15.79:0/2211091736 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fcefc011040 con 0x7fcf0c19c470 2021-04-09T18:26:17.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.182 7fcf0affd700 1 --2- 172.21.15.79:0/2211091736 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcef0029100 0x7fcef002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:17.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.182 7fcf0affd700 1 --2- 172.21.15.79:0/2211091736 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcef0029100 0x7fcef002b650 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:17.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.182 7fcf12154700 1 -- 172.21.15.79:0/2211091736 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf0c0e39f0 con 0x7fcf0c19c470 2021-04-09T18:26:17.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.190 7fcf03fff700 1 -- 172.21.15.79:0/2211091736 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fcefc00fcf0 con 0x7fcf0c19c470 2021-04-09T18:26:17.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.358 7fcf12154700 1 -- 172.21.15.79:0/2211091736 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fcf0c0f5b50 con 0x7fcf0c19c470 2021-04-09T18:26:17.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.358 7fcf03fff700 1 -- 172.21.15.79:0/2211091736 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcf0c107f80 con 0x7fcf0c19c470 2021-04-09T18:26:17.367 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:17.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.362 7fcf12154700 1 -- 172.21.15.79:0/2211091736 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcef0029100 msgr2=0x7fcef002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.362 7fcf12154700 1 --2- 172.21.15.79:0/2211091736 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcef0029100 0x7fcef002b650 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.362 7fcf12154700 1 -- 172.21.15.79:0/2211091736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf0c19c470 msgr2=0x7fcf0c19ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.362 7fcf12154700 1 --2- 172.21.15.79:0/2211091736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf0c19c470 0x7fcf0c19ba10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fcf0c19cb60 tx=0x7fcefc00f560).stop 2021-04-09T18:26:17.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.362 7fcf12154700 1 -- 172.21.15.79:0/2211091736 shutdown_connections 2021-04-09T18:26:17.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.362 7fcf12154700 1 --2- 172.21.15.79:0/2211091736 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcef0029100 0x7fcef002b650 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.362 7fcf12154700 1 --2- 172.21.15.79:0/2211091736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf0c0ae5a0 0x7fcf0c0aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.362 7fcf12154700 1 --2- 172.21.15.79:0/2211091736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf0c19c470 0x7fcf0c19ba10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.362 7fcf12154700 1 --2- 172.21.15.79:0/2211091736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf0c0ae150 0x7fcf0c19e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.362 7fcf12154700 1 -- 172.21.15.79:0/2211091736 >> 172.21.15.79:0/2211091736 conn(0x7fcf0c09a490 msgr2=0x7fcf0c097e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:17.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.362 7fcf12154700 1 -- 172.21.15.79:0/2211091736 shutdown_connections 2021-04-09T18:26:17.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.362 7fcf12154700 1 -- 172.21.15.79:0/2211091736 wait complete. 2021-04-09T18:26:17.379 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:26:17.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.462 7fceecd8d700 1 Processor -- start 2021-04-09T18:26:17.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.462 7fceecd8d700 1 -- start start 2021-04-09T18:26:17.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fceecd8d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcee80f5550 0x7fcee80f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:17.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fceecd8d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcee80e9b10 0x7fcee809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:17.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fceecd8d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee80fbb50 con 0x7fcee81c2de0 2021-04-09T18:26:17.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fceecd8d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee80e9f60 con 0x7fcee80e9b10 2021-04-09T18:26:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fceecd8d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee80e5a00 con 0x7fcee80f5550 2021-04-09T18:26:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fcee62ee700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcee80e9b10 0x7fcee809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fcee72f0700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcee81c2de0 0x7fcee81c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50310/0 (socket says 172.21.15.79:50310) 2021-04-09T18:26:17.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fcee72f0700 1 -- 172.21.15.79:0/922690798 learned_addr learned my addr 172.21.15.79:0/922690798 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:17.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fcee6aef700 1 --2- 172.21.15.79:0/922690798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcee80f5550 0x7fcee80f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:17.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fcee62ee700 1 -- 172.21.15.79:0/922690798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcee80f5550 msgr2=0x7fcee80f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:17.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fcee62ee700 1 --2- 172.21.15.79:0/922690798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcee80f5550 0x7fcee80f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fcee62ee700 1 -- 172.21.15.79:0/922690798 >> v1:172.21.15.79:6789/0 conn(0x7fcee81c2de0 legacy=0x7fcee81c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fcee62ee700 1 -- 172.21.15.79:0/922690798 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee80e5700 con 0x7fcee80e9b10 2021-04-09T18:26:17.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fcee5aed700 1 -- 172.21.15.79:0/922690798 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255534439 0 0) 0x7fcee0001450 con 0x7fcee81c2de0 2021-04-09T18:26:17.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fcee62ee700 1 --2- 172.21.15.79:0/922690798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee80e9b10 0x7fcee809f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fcedc002f30 tx=0x7fcedc00bd40).ready entity=mon.0 client_cookie=6459b00066fe8f2d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:17.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fcee5aed700 1 -- 172.21.15.79:0/922690798 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcee80e5700 con 0x7fcee80e9b10 2021-04-09T18:26:17.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fcee5aed700 1 -- 172.21.15.79:0/922690798 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc009850 con 0x7fcee80e9b10 2021-04-09T18:26:17.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fcee5aed700 1 -- 172.21.15.79:0/922690798 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcedc009c20 con 0x7fcee80e9b10 2021-04-09T18:26:17.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fceecd8d700 1 -- 172.21.15.79:0/922690798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee80e9b10 msgr2=0x7fcee809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fceecd8d700 1 --2- 172.21.15.79:0/922690798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee80e9b10 0x7fcee809f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fcedc002f30 tx=0x7fcedc00bd40).stop 2021-04-09T18:26:17.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fceecd8d700 1 -- 172.21.15.79:0/922690798 shutdown_connections 2021-04-09T18:26:17.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fceecd8d700 1 --2- 172.21.15.79:0/922690798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcee80f5550 0x7fcee80f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fceecd8d700 1 --2- 172.21.15.79:0/922690798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee80e9b10 0x7fcee809f110 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fceecd8d700 1 -- 172.21.15.79:0/922690798 >> 172.21.15.79:0/922690798 conn(0x7fcee80e6010 msgr2=0x7fcee80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:17.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fceecd8d700 1 -- 172.21.15.79:0/922690798 shutdown_connections 2021-04-09T18:26:17.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.466 7fceecd8d700 1 -- 172.21.15.79:0/922690798 wait complete. 2021-04-09T18:26:17.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.470 7fceecd8d700 1 Processor -- start 2021-04-09T18:26:17.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.470 7fceecd8d700 1 -- start start 2021-04-09T18:26:17.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fceecd8d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee80bb0b0 0x7fcee819ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:17.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fceecd8d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcee80bfe80 0x7fcee80c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:17.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fceecd8d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcee80c02d0 0x7fcee80c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:17.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fceecd8d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee80e1ac0 con 0x7fcee80bb0b0 2021-04-09T18:26:17.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fceecd8d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee8098190 con 0x7fcee80bfe80 2021-04-09T18:26:17.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fceecd8d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee80bb500 con 0x7fcee80c02d0 2021-04-09T18:26:17.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fcee6aef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee80bb0b0 0x7fcee819ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:17.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fcee6aef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee80bb0b0 0x7fcee819ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55602/0 (socket says 172.21.15.79:55602) 2021-04-09T18:26:17.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fcee6aef700 1 -- 172.21.15.79:0/4195274671 learned_addr learned my addr 172.21.15.79:0/4195274671 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:17.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fcee72f0700 1 --2- 172.21.15.79:0/4195274671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcee80c02d0 0x7fcee80c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:17.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fcee62ee700 1 --2- 172.21.15.79:0/4195274671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcee80bfe80 0x7fcee80c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:17.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fcee6aef700 1 -- 172.21.15.79:0/4195274671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcee80c02d0 msgr2=0x7fcee80c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fcee6aef700 1 --2- 172.21.15.79:0/4195274671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcee80c02d0 0x7fcee80c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fcee6aef700 1 -- 172.21.15.79:0/4195274671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcee80bfe80 msgr2=0x7fcee80c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fcee6aef700 1 --2- 172.21.15.79:0/4195274671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcee80bfe80 0x7fcee80c6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fcee6aef700 1 -- 172.21.15.79:0/4195274671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee819c040 con 0x7fcee80bb0b0 2021-04-09T18:26:17.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fcee6aef700 1 --2- 172.21.15.79:0/4195274671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee80bb0b0 0x7fcee819ba10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fcee80d7e00 tx=0x7fced800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:17.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fced77fe700 1 -- 172.21.15.79:0/4195274671 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcee819c040 con 0x7fcee80bb0b0 2021-04-09T18:26:17.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fced77fe700 1 -- 172.21.15.79:0/4195274671 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced800cd60 con 0x7fcee80bb0b0 2021-04-09T18:26:17.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fceecd8d700 1 -- 172.21.15.79:0/4195274671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee8097d40 con 0x7fcee80bb0b0 2021-04-09T18:26:17.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fced77fe700 1 -- 172.21.15.79:0/4195274671 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fced800f040 con 0x7fcee80bb0b0 2021-04-09T18:26:17.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fceecd8d700 1 -- 172.21.15.79:0/4195274671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee80aff10 con 0x7fcee80bb0b0 2021-04-09T18:26:17.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fced77fe700 1 -- 172.21.15.79:0/4195274671 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fced8011070 con 0x7fcee80bb0b0 2021-04-09T18:26:17.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fced77fe700 1 --2- 172.21.15.79:0/4195274671 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcecc029100 0x7fcecc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:17.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fced77fe700 1 -- 172.21.15.79:0/4195274671 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fced8010040 con 0x7fcee80bb0b0 2021-04-09T18:26:17.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.474 7fcee62ee700 1 --2- 172.21.15.79:0/4195274671 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcecc029100 0x7fcecc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:17.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.478 7fcee62ee700 1 --2- 172.21.15.79:0/4195274671 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcecc029100 0x7fcecc02b650 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:17.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.478 7fceecd8d700 1 -- 172.21.15.79:0/4195274671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee80e39f0 con 0x7fcee80bb0b0 2021-04-09T18:26:17.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.482 7fced77fe700 1 -- 172.21.15.79:0/4195274671 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fced800c960 con 0x7fcee80bb0b0 2021-04-09T18:26:17.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.638 7fceecd8d700 1 -- 172.21.15.79:0/4195274671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fcee80f5b50 con 0x7fcee80bb0b0 2021-04-09T18:26:17.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.638 7fced77fe700 1 -- 172.21.15.79:0/4195274671 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7fced8000bf0 con 0x7fcee80bb0b0 2021-04-09T18:26:17.645 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:17.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.638 7fceecd8d700 1 -- 172.21.15.79:0/4195274671 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcecc029100 msgr2=0x7fcecc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.638 7fceecd8d700 1 --2- 172.21.15.79:0/4195274671 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcecc029100 0x7fcecc02b650 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.638 7fceecd8d700 1 -- 172.21.15.79:0/4195274671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee80bb0b0 msgr2=0x7fcee819ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.638 7fceecd8d700 1 --2- 172.21.15.79:0/4195274671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee80bb0b0 0x7fcee819ba10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fcee80d7e00 tx=0x7fced800c430).stop 2021-04-09T18:26:17.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.638 7fceecd8d700 1 -- 172.21.15.79:0/4195274671 shutdown_connections 2021-04-09T18:26:17.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.638 7fceecd8d700 1 --2- 172.21.15.79:0/4195274671 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcecc029100 0x7fcecc02b650 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.638 7fceecd8d700 1 --2- 172.21.15.79:0/4195274671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcee80c02d0 0x7fcee80c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.638 7fceecd8d700 1 --2- 172.21.15.79:0/4195274671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee80bb0b0 0x7fcee819ba10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.638 7fceecd8d700 1 --2- 172.21.15.79:0/4195274671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcee80bfe80 0x7fcee80c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.638 7fceecd8d700 1 -- 172.21.15.79:0/4195274671 >> 172.21.15.79:0/4195274671 conn(0x7fcee80a7080 msgr2=0x7fcee80d8040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:17.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.638 7fceecd8d700 1 -- 172.21.15.79:0/4195274671 shutdown_connections 2021-04-09T18:26:17.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.638 7fceecd8d700 1 -- 172.21.15.79:0/4195274671 wait complete. 2021-04-09T18:26:17.657 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:26:17.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f8de9a700 1 Processor -- start 2021-04-09T18:26:17.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f8de9a700 1 -- start start 2021-04-09T18:26:17.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f8de9a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0f881c9050 0x7f0f881cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:17.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f8de9a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f880fbb50 con 0x7f0f880e9b10 2021-04-09T18:26:17.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f8de9a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f8809f910 con 0x7f0f880f5550 2021-04-09T18:26:17.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f8de9a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f881c3df0 con 0x7f0f881c9050 2021-04-09T18:26:17.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f87fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0f881c9050 0x7f0f881cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:17.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f86ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0f880e9b10 0x7f0f8809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50320/0 (socket says 172.21.15.79:50320) 2021-04-09T18:26:17.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f86ffd700 1 -- 172.21.15.79:0/935944577 learned_addr learned my addr 172.21.15.79:0/935944577 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:17.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f867fc700 1 -- 172.21.15.79:0/935944577 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581506068 0 0) 0x7f0f700010d0 con 0x7f0f880e9b10 2021-04-09T18:26:17.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f867fc700 1 -- 172.21.15.79:0/935944577 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f74003240 con 0x7f0f880e9b10 2021-04-09T18:26:17.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f87fff700 1 -- 172.21.15.79:0/935944577 >> v1:172.21.15.89:6789/0 conn(0x7f0f880f5550 legacy=0x7f0f880f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f867fc700 1 -- 172.21.15.79:0/935944577 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782988128 0 0) 0x7f0f780010d0 con 0x7f0f880f5550 2021-04-09T18:26:17.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f87fff700 1 -- 172.21.15.79:0/935944577 >> v1:172.21.15.79:6789/0 conn(0x7f0f880e9b10 legacy=0x7f0f8809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f87fff700 1 -- 172.21.15.79:0/935944577 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f880e5700 con 0x7f0f881c9050 2021-04-09T18:26:17.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f87fff700 1 --2- 172.21.15.79:0/935944577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f881c9050 0x7f0f881cb4b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f0f800032b0 tx=0x7f0f8000b0e0).ready entity=mon.0 client_cookie=8ab5549962b75ab2 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:17.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f867fc700 1 -- 172.21.15.79:0/935944577 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0f880e5700 con 0x7f0f881c9050 2021-04-09T18:26:17.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f867fc700 1 -- 172.21.15.79:0/935944577 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8000bab0 con 0x7f0f881c9050 2021-04-09T18:26:17.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f867fc700 1 -- 172.21.15.79:0/935944577 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0f80002020 con 0x7f0f881c9050 2021-04-09T18:26:17.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f8de9a700 1 -- 172.21.15.79:0/935944577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f881c9050 msgr2=0x7f0f881cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f8de9a700 1 --2- 172.21.15.79:0/935944577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f881c9050 0x7f0f881cb4b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f0f800032b0 tx=0x7f0f8000b0e0).stop 2021-04-09T18:26:17.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f8de9a700 1 -- 172.21.15.79:0/935944577 shutdown_connections 2021-04-09T18:26:17.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f8de9a700 1 --2- 172.21.15.79:0/935944577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f881c9050 0x7f0f881cb4b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f8de9a700 1 -- 172.21.15.79:0/935944577 >> 172.21.15.79:0/935944577 conn(0x7f0f880e6010 msgr2=0x7f0f880e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:17.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f8de9a700 1 -- 172.21.15.79:0/935944577 shutdown_connections 2021-04-09T18:26:17.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.742 7f0f8de9a700 1 -- 172.21.15.79:0/935944577 wait complete. 2021-04-09T18:26:17.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f8de9a700 1 Processor -- start 2021-04-09T18:26:17.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f8de9a700 1 -- start start 2021-04-09T18:26:17.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f8de9a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f8819d290 0x7f0f8819dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:17.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f8de9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f8819d6e0 0x7f0f8819e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:17.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f8de9a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f881b17e0 0x7f0f881b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:17.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f8de9a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f880e9f60 con 0x7f0f8819d6e0 2021-04-09T18:26:17.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f8de9a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8819ba10 con 0x7f0f881b17e0 2021-04-09T18:26:17.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f8de9a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8819bd10 con 0x7f0f8819d290 2021-04-09T18:26:17.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f86ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f8819d6e0 0x7f0f8819e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:17.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f86ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f8819d6e0 0x7f0f8819e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55616/0 (socket says 172.21.15.79:55616) 2021-04-09T18:26:17.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f86ffd700 1 -- 172.21.15.79:0/430463051 learned_addr learned my addr 172.21.15.79:0/430463051 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:17.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f87fff700 1 --2- 172.21.15.79:0/430463051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f881b17e0 0x7f0f881b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:17.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f877fe700 1 --2- 172.21.15.79:0/430463051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f8819d290 0x7f0f8819dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:17.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f86ffd700 1 -- 172.21.15.79:0/430463051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f8819d290 msgr2=0x7f0f8819dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f86ffd700 1 --2- 172.21.15.79:0/430463051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f8819d290 0x7f0f8819dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f86ffd700 1 -- 172.21.15.79:0/430463051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f881b17e0 msgr2=0x7f0f881b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f86ffd700 1 --2- 172.21.15.79:0/430463051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f881b17e0 0x7f0f881b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f86ffd700 1 -- 172.21.15.79:0/430463051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f880d7b80 con 0x7f0f8819d6e0 2021-04-09T18:26:17.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f86ffd700 1 --2- 172.21.15.79:0/430463051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f8819d6e0 0x7f0f8819e320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f0f8809b1b0 tx=0x7f0f7000cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:17.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f7ffff700 1 -- 172.21.15.79:0/430463051 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0f880d7b80 con 0x7f0f8819d6e0 2021-04-09T18:26:17.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f7ffff700 1 -- 172.21.15.79:0/430463051 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f70007320 con 0x7f0f8819d6e0 2021-04-09T18:26:17.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f8de9a700 1 -- 172.21.15.79:0/430463051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f881b2260 con 0x7f0f8819d6e0 2021-04-09T18:26:17.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f7ffff700 1 -- 172.21.15.79:0/430463051 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0f700057e0 con 0x7f0f8819d6e0 2021-04-09T18:26:17.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.746 7f0f8de9a700 1 -- 172.21.15.79:0/430463051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f881b2710 con 0x7f0f8819d6e0 2021-04-09T18:26:17.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.750 7f0f7ffff700 1 -- 172.21.15.79:0/430463051 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0f7001a060 con 0x7f0f8819d6e0 2021-04-09T18:26:17.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.750 7f0f7ffff700 1 --2- 172.21.15.79:0/430463051 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0f6c029100 0x7f0f6c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:17.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.750 7f0f7ffff700 1 -- 172.21.15.79:0/430463051 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f0f70038c30 con 0x7f0f8819d6e0 2021-04-09T18:26:17.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.750 7f0f877fe700 1 --2- 172.21.15.79:0/430463051 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0f6c029100 0x7f0f6c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:17.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.750 7f0f877fe700 1 --2- 172.21.15.79:0/430463051 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0f6c029100 0x7f0f6c02b650 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:17.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.754 7f0f8de9a700 1 -- 172.21.15.79:0/430463051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f880e39f0 con 0x7f0f8819d6e0 2021-04-09T18:26:17.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.762 7f0f7ffff700 1 -- 172.21.15.79:0/430463051 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0f880e5cd0 con 0x7f0f8819d6e0 2021-04-09T18:26:17.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.922 7f0f8de9a700 1 -- 172.21.15.79:0/430463051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f0f880a1c90 con 0x7f0f8819d6e0 2021-04-09T18:26:17.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.922 7f0f7ffff700 1 -- 172.21.15.79:0/430463051 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f0f70007110 con 0x7f0f8819d6e0 2021-04-09T18:26:17.931 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:17.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.926 7f0f8de9a700 1 -- 172.21.15.79:0/430463051 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0f6c029100 msgr2=0x7f0f6c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.926 7f0f8de9a700 1 --2- 172.21.15.79:0/430463051 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0f6c029100 0x7f0f6c02b650 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.926 7f0f8de9a700 1 -- 172.21.15.79:0/430463051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f8819d6e0 msgr2=0x7f0f8819e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:17.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.926 7f0f8de9a700 1 --2- 172.21.15.79:0/430463051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f8819d6e0 0x7f0f8819e320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f0f8809b1b0 tx=0x7f0f7000cae0).stop 2021-04-09T18:26:17.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.926 7f0f8de9a700 1 -- 172.21.15.79:0/430463051 shutdown_connections 2021-04-09T18:26:17.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.926 7f0f8de9a700 1 --2- 172.21.15.79:0/430463051 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0f6c029100 0x7f0f6c02b650 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.926 7f0f8de9a700 1 --2- 172.21.15.79:0/430463051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f881b17e0 0x7f0f881b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.926 7f0f8de9a700 1 --2- 172.21.15.79:0/430463051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f8819d290 0x7f0f8819dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.926 7f0f8de9a700 1 --2- 172.21.15.79:0/430463051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f8819d6e0 0x7f0f8819e320 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:17.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.926 7f0f8de9a700 1 -- 172.21.15.79:0/430463051 >> 172.21.15.79:0/430463051 conn(0x7f0f880ba660 msgr2=0x7f0f8809a570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:17.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.926 7f0f8de9a700 1 -- 172.21.15.79:0/430463051 shutdown_connections 2021-04-09T18:26:17.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:17.926 7f0f8de9a700 1 -- 172.21.15.79:0/430463051 wait complete. 2021-04-09T18:26:17.950 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-04-09T18:26:17.950 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2021-04-09T18:26:17.951 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2021-04-09T18:26:18.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.038 7fbcbeb18700 1 Processor -- start 2021-04-09T18:26:18.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.038 7fbcbeb18700 1 -- start start 2021-04-09T18:26:18.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcbeb18700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbcb80e9ad0 0x7fbcb809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:18.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcbeb18700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbcb81c8000 0x7fbcb81ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:18.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcbeb18700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb80fbb10 con 0x7fbcb80f5510 2021-04-09T18:26:18.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcbeb18700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb81c3db0 con 0x7fbcb80e9ad0 2021-04-09T18:26:18.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcbeb18700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb80e9f20 con 0x7fbcb81c8000 2021-04-09T18:26:18.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcb7fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbcb80e9ad0 0x7fbcb809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:18.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcbc8bc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbcb80f5510 0x7fbcb80f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50334/0 (socket says 172.21.15.79:50334) 2021-04-09T18:26:18.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcbc8bc700 1 -- 172.21.15.79:0/4137942054 learned_addr learned my addr 172.21.15.79:0/4137942054 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:18.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcbd0bd700 1 --2- 172.21.15.79:0/4137942054 >> v2:172.21.15.89:3300/0 conn(0x7fbcb81c8000 0x7fbcb81ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:18.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcb7fff700 1 -- 172.21.15.79:0/4137942054 >> v2:172.21.15.89:3300/0 conn(0x7fbcb81c8000 msgr2=0x7fbcb81ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:18.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcb7fff700 1 --2- 172.21.15.79:0/4137942054 >> v2:172.21.15.89:3300/0 conn(0x7fbcb81c8000 0x7fbcb81ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:18.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcb7fff700 1 -- 172.21.15.79:0/4137942054 >> v1:172.21.15.79:6789/0 conn(0x7fbcb80f5510 legacy=0x7fbcb80f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:18.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcb7fff700 1 -- 172.21.15.79:0/4137942054 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb80e56c0 con 0x7fbcb80e9ad0 2021-04-09T18:26:18.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcb77fe700 1 -- 172.21.15.79:0/4137942054 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117203139 0 0) 0x7fbca80010d0 con 0x7fbcb80f5510 2021-04-09T18:26:18.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcb7fff700 1 --2- 172.21.15.79:0/4137942054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb80e9ad0 0x7fbcb809f100 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fbca4002f30 tx=0x7fbca400bd10).ready entity=mon.0 client_cookie=8fec71aa988579f5 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:18.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcb77fe700 1 -- 172.21.15.79:0/4137942054 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbcb80e56c0 con 0x7fbcb80e9ad0 2021-04-09T18:26:18.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcb77fe700 1 -- 172.21.15.79:0/4137942054 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca40098a0 con 0x7fbcb80e9ad0 2021-04-09T18:26:18.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcb77fe700 1 -- 172.21.15.79:0/4137942054 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbca4009c70 con 0x7fbcb80e9ad0 2021-04-09T18:26:18.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcbeb18700 1 -- 172.21.15.79:0/4137942054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb80e9ad0 msgr2=0x7fbcb809f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:18.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcbeb18700 1 --2- 172.21.15.79:0/4137942054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb80e9ad0 0x7fbcb809f100 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fbca4002f30 tx=0x7fbca400bd10).stop 2021-04-09T18:26:18.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcbeb18700 1 -- 172.21.15.79:0/4137942054 shutdown_connections 2021-04-09T18:26:18.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcbeb18700 1 --2- 172.21.15.79:0/4137942054 >> v2:172.21.15.89:3300/0 conn(0x7fbcb81c8000 0x7fbcb81ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:18.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcbeb18700 1 --2- 172.21.15.79:0/4137942054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb80e9ad0 0x7fbcb809f100 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:18.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcbeb18700 1 -- 172.21.15.79:0/4137942054 >> 172.21.15.79:0/4137942054 conn(0x7fbcb80e5fd0 msgr2=0x7fbcb80e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:18.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcbeb18700 1 -- 172.21.15.79:0/4137942054 shutdown_connections 2021-04-09T18:26:18.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.042 7fbcbeb18700 1 -- 172.21.15.79:0/4137942054 wait complete. 2021-04-09T18:26:18.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.046 7fbcbeb18700 1 Processor -- start 2021-04-09T18:26:18.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcbeb18700 1 -- start start 2021-04-09T18:26:18.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcbeb18700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb80d6950 0x7fbcb809a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:18.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcbeb18700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8099f90 0x7fbcb80acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:18.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcbeb18700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb809a3e0 0x7fbcb80cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:18.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcbeb18700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb80d70c0 con 0x7fbcb80d6950 2021-04-09T18:26:18.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcbeb18700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb80d6da0 con 0x7fbcb8099f90 2021-04-09T18:26:18.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcbeb18700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb809afa0 con 0x7fbcb809a3e0 2021-04-09T18:26:18.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcbc8bc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb80d6950 0x7fbcb809a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:18.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcbc8bc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb80d6950 0x7fbcb809a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55630/0 (socket says 172.21.15.79:55630) 2021-04-09T18:26:18.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcbc8bc700 1 -- 172.21.15.79:0/618497420 learned_addr learned my addr 172.21.15.79:0/618497420 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:18.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcb7fff700 1 --2- 172.21.15.79:0/618497420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8099f90 0x7fbcb80acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:18.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcbd0bd700 1 --2- 172.21.15.79:0/618497420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb809a3e0 0x7fbcb80cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:18.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcbc8bc700 1 -- 172.21.15.79:0/618497420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb809a3e0 msgr2=0x7fbcb80cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:18.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcbc8bc700 1 --2- 172.21.15.79:0/618497420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb809a3e0 0x7fbcb80cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:18.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcbc8bc700 1 -- 172.21.15.79:0/618497420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8099f90 msgr2=0x7fbcb80acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:18.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcbc8bc700 1 --2- 172.21.15.79:0/618497420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8099f90 0x7fbcb80acfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:18.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcbc8bc700 1 -- 172.21.15.79:0/618497420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb80ad600 con 0x7fbcb80d6950 2021-04-09T18:26:18.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcbd0bd700 1 --2- 172.21.15.79:0/618497420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb809a3e0 0x7fbcb80cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:18.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcbc8bc700 1 --2- 172.21.15.79:0/618497420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb80d6950 0x7fbcb809a970 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fbcb80d3620 tx=0x7fbca800cb10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:18.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcb57fa700 1 -- 172.21.15.79:0/618497420 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbcb80ad600 con 0x7fbcb80d6950 2021-04-09T18:26:18.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcbeb18700 1 -- 172.21.15.79:0/618497420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb80cf600 con 0x7fbcb80d6950 2021-04-09T18:26:18.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcb57fa700 1 -- 172.21.15.79:0/618497420 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca80072e0 con 0x7fbcb80d6950 2021-04-09T18:26:18.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcb57fa700 1 -- 172.21.15.79:0/618497420 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbca80057e0 con 0x7fbcb80d6950 2021-04-09T18:26:18.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcbeb18700 1 -- 172.21.15.79:0/618497420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb80cfb30 con 0x7fbcb80d6950 2021-04-09T18:26:18.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.050 7fbcb57fa700 1 -- 172.21.15.79:0/618497420 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fbca80059e0 con 0x7fbcb80d6950 2021-04-09T18:26:18.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.054 7fbcb57fa700 1 --2- 172.21.15.79:0/618497420 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbc94029100 0x7fbc9402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:18.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.054 7fbcb57fa700 1 -- 172.21.15.79:0/618497420 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fbca8038e70 con 0x7fbcb80d6950 2021-04-09T18:26:18.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.054 7fbcb7fff700 1 --2- 172.21.15.79:0/618497420 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbc94029100 0x7fbc9402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:18.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.054 7fbcbeb18700 1 -- 172.21.15.79:0/618497420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb80e39d0 con 0x7fbcb80d6950 2021-04-09T18:26:18.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.054 7fbcb7fff700 1 --2- 172.21.15.79:0/618497420 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbc94029100 0x7fbc9402b650 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:18.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.058 7fbcb57fa700 1 -- 172.21.15.79:0/618497420 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fbca8000bf0 con 0x7fbcb80d6950 2021-04-09T18:26:18.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.262 7fbcbeb18700 1 -- 172.21.15.79:0/618497420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fbcb80f5b10 con 0x7fbcb80d6950 2021-04-09T18:26:18.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.262 7fbcb57fa700 1 -- 172.21.15.79:0/618497420 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v3) v1 ==== 74+0+70604 (secure 0 0 0) 0x7fbca80070d0 con 0x7fbcb80d6950 2021-04-09T18:26:18.274 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:18.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.266 7fbcbeb18700 1 -- 172.21.15.79:0/618497420 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbc94029100 msgr2=0x7fbc9402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:18.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.266 7fbcbeb18700 1 --2- 172.21.15.79:0/618497420 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbc94029100 0x7fbc9402b650 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:18.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.266 7fbcbeb18700 1 -- 172.21.15.79:0/618497420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb80d6950 msgr2=0x7fbcb809a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:18.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.266 7fbcbeb18700 1 --2- 172.21.15.79:0/618497420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb80d6950 0x7fbcb809a970 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fbcb80d3620 tx=0x7fbca800cb10).stop 2021-04-09T18:26:18.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.266 7fbcbeb18700 1 -- 172.21.15.79:0/618497420 shutdown_connections 2021-04-09T18:26:18.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.266 7fbcbeb18700 1 --2- 172.21.15.79:0/618497420 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbc94029100 0x7fbc9402b650 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:18.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.266 7fbcbeb18700 1 --2- 172.21.15.79:0/618497420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb809a3e0 0x7fbcb80cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:18.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.266 7fbcbeb18700 1 --2- 172.21.15.79:0/618497420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb80d6950 0x7fbcb809a970 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:18.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.266 7fbcbeb18700 1 --2- 172.21.15.79:0/618497420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8099f90 0x7fbcb80acfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:18.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.266 7fbcbeb18700 1 -- 172.21.15.79:0/618497420 >> 172.21.15.79:0/618497420 conn(0x7fbcb80babc0 msgr2=0x7fbcb808eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:18.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.266 7fbcbeb18700 1 -- 172.21.15.79:0/618497420 shutdown_connections 2021-04-09T18:26:18.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:18.266 7fbcbeb18700 1 -- 172.21.15.79:0/618497420 wait complete. 2021-04-09T18:26:18.284 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":3,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":13779},{"type":"v1","addr":"172.21.15.89:6801","nonce":13779}]},"active_addr":"172.21.15.89:6801/13779","active_change":"2021-04-09 18:25:55.935878","available":true,"standbys":[{"gid":4104,"name":"y","available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout_min":{"name":"inventory_cache_timeout_min","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout_min":{"name":"inventory_cache_timeout_min","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"]}} 2021-04-09T18:26:18.286 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2021-04-09T18:26:19.095 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:19.191 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f5710f25700 1 Processor -- start 2021-04-09T18:26:19.191 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f5710f25700 1 -- start start 2021-04-09T18:26:19.191 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f5710f25700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f570c1c9020 0x7f570c1cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.192 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f5710f25700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f570c0fbb20 con 0x7f570c0e9ae0 2021-04-09T18:26:19.192 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f5710f25700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f570c09f910 con 0x7f570c0f5520 2021-04-09T18:26:19.192 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f5710f25700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f570c1c3dc0 con 0x7f570c1c9020 2021-04-09T18:26:19.192 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f570a2ee700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f570c0e9ae0 0x7f570c09f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50352/0 (socket says 172.21.15.79:50352) 2021-04-09T18:26:19.193 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f570a2ee700 1 -- 172.21.15.79:0/3595225754 learned_addr learned my addr 172.21.15.79:0/3595225754 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:19.193 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f570b2f0700 1 --2- 172.21.15.79:0/3595225754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f570c1c9020 0x7f570c1cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.193 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f5709aed700 1 -- 172.21.15.79:0/3595225754 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023535445 0 0) 0x7f5700001450 con 0x7f570c0e9ae0 2021-04-09T18:26:19.193 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f5709aed700 1 -- 172.21.15.79:0/3595225754 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56f4003240 con 0x7f570c0e9ae0 2021-04-09T18:26:19.193 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f5709aed700 1 -- 172.21.15.79:0/3595225754 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 540723641 0 0) 0x7f56fc0010d0 con 0x7f570c0f5520 2021-04-09T18:26:19.194 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f570b2f0700 1 -- 172.21.15.79:0/3595225754 >> v1:172.21.15.89:6789/0 conn(0x7f570c0f5520 legacy=0x7f570c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.194 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f570b2f0700 1 -- 172.21.15.79:0/3595225754 >> v1:172.21.15.79:6789/0 conn(0x7f570c0e9ae0 legacy=0x7f570c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.194 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f570b2f0700 1 -- 172.21.15.79:0/3595225754 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570c0e56d0 con 0x7f570c1c9020 2021-04-09T18:26:19.194 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f570b2f0700 1 --2- 172.21.15.79:0/3595225754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f570c1c9020 0x7f570c1cb480 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5704002f30 tx=0x7f570400bcf0).ready entity=mon.2 client_cookie=1601554c8b0925d6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:19.194 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f5709aed700 1 -- 172.21.15.79:0/3595225754 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f570c0e56d0 con 0x7f570c1c9020 2021-04-09T18:26:19.195 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f5709aed700 1 -- 172.21.15.79:0/3595225754 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5704009920 con 0x7f570c1c9020 2021-04-09T18:26:19.195 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f5709aed700 1 -- 172.21.15.79:0/3595225754 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5704009cf0 con 0x7f570c1c9020 2021-04-09T18:26:19.195 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f5710f25700 1 -- 172.21.15.79:0/3595225754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f570c1c9020 msgr2=0x7f570c1cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.195 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.178 7f5710f25700 1 --2- 172.21.15.79:0/3595225754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f570c1c9020 0x7f570c1cb480 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5704002f30 tx=0x7f570400bcf0).stop 2021-04-09T18:26:19.196 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.182 7f5710f25700 1 -- 172.21.15.79:0/3595225754 shutdown_connections 2021-04-09T18:26:19.196 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.182 7f5710f25700 1 --2- 172.21.15.79:0/3595225754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f570c1c9020 0x7f570c1cb480 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.196 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.182 7f5710f25700 1 -- 172.21.15.79:0/3595225754 >> 172.21.15.79:0/3595225754 conn(0x7f570c0e5fe0 msgr2=0x7f570c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:19.196 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.182 7f5710f25700 1 -- 172.21.15.79:0/3595225754 shutdown_connections 2021-04-09T18:26:19.197 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.182 7f5710f25700 1 -- 172.21.15.79:0/3595225754 wait complete. 2021-04-09T18:26:19.200 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.182 7f5710f25700 1 Processor -- start 2021-04-09T18:26:19.200 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f5710f25700 1 -- start start 2021-04-09T18:26:19.200 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f5710f25700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f570c097c90 0x7f570c1a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.201 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f5710f25700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f570c19fb00 0x7f570c0c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.201 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f5710f25700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f570c19ff50 0x7f570c0c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.201 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f5710f25700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570c0e9f30 con 0x7f570c19ff50 2021-04-09T18:26:19.201 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f5710f25700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570c0983e0 con 0x7f570c19fb00 2021-04-09T18:26:19.201 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f5710f25700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f570c0980e0 con 0x7f570c097c90 2021-04-09T18:26:19.202 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f570b2f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f570c19ff50 0x7f570c0c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.202 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f570b2f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f570c19ff50 0x7f570c0c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55648/0 (socket says 172.21.15.79:55648) 2021-04-09T18:26:19.202 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f570b2f0700 1 -- 172.21.15.79:0/4135654114 learned_addr learned my addr 172.21.15.79:0/4135654114 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:19.202 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f570a2ee700 1 --2- 172.21.15.79:0/4135654114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f570c19fb00 0x7f570c0c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.202 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f570aaef700 1 --2- 172.21.15.79:0/4135654114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f570c097c90 0x7f570c1a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.203 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f570b2f0700 1 -- 172.21.15.79:0/4135654114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f570c097c90 msgr2=0x7f570c1a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.203 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f570b2f0700 1 --2- 172.21.15.79:0/4135654114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f570c097c90 0x7f570c1a0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.203 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f570b2f0700 1 -- 172.21.15.79:0/4135654114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f570c19fb00 msgr2=0x7f570c0c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.203 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f570b2f0700 1 --2- 172.21.15.79:0/4135654114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f570c19fb00 0x7f570c0c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.204 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f570b2f0700 1 -- 172.21.15.79:0/4135654114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570c0abe30 con 0x7f570c19ff50 2021-04-09T18:26:19.204 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f570b2f0700 1 --2- 172.21.15.79:0/4135654114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f570c19ff50 0x7f570c0c5ed0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f570c0874d0 tx=0x7f5704006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:19.204 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f56fb7fe700 1 -- 172.21.15.79:0/4135654114 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5704022020 con 0x7f570c19ff50 2021-04-09T18:26:19.204 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f56fb7fe700 1 -- 172.21.15.79:0/4135654114 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5704018580 con 0x7f570c19ff50 2021-04-09T18:26:19.204 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f5710f25700 1 -- 172.21.15.79:0/4135654114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f570c0bb350 con 0x7f570c19ff50 2021-04-09T18:26:19.205 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f56fb7fe700 1 -- 172.21.15.79:0/4135654114 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5704018950 con 0x7f570c19ff50 2021-04-09T18:26:19.205 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f5710f25700 1 -- 172.21.15.79:0/4135654114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f570c0c6690 con 0x7f570c19ff50 2021-04-09T18:26:19.205 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.186 7f56fb7fe700 1 -- 172.21.15.79:0/4135654114 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5704018b50 con 0x7f570c19ff50 2021-04-09T18:26:19.205 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.190 7f56fb7fe700 1 --2- 172.21.15.79:0/4135654114 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f56f0029100 0x7f56f002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.205 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.190 7f56fb7fe700 1 -- 172.21.15.79:0/4135654114 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f570403c690 con 0x7f570c19ff50 2021-04-09T18:26:19.206 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.190 7f570aaef700 1 --2- 172.21.15.79:0/4135654114 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f56f0029100 0x7f56f002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.206 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.190 7f570aaef700 1 --2- 172.21.15.79:0/4135654114 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f56f0029100 0x7f56f002b650 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:19.206 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.194 7f5710f25700 1 -- 172.21.15.79:0/4135654114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f570c0e39e0 con 0x7f570c19ff50 2021-04-09T18:26:19.208 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.202 7f56fb7fe700 1 -- 172.21.15.79:0/4135654114 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5704018370 con 0x7f570c19ff50 2021-04-09T18:26:19.379 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.370 7f5710f25700 1 -- 172.21.15.79:0/4135654114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f570c0f5b20 con 0x7f570c19ff50 2021-04-09T18:26:19.381 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.374 7f56fb7fe700 1 -- 172.21.15.79:0/4135654114 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14254 (secure 0 0 0) 0x7f57040387c0 con 0x7f570c19ff50 2021-04-09T18:26:19.382 INFO:teuthology.misc.health.smithi079.stdout: 2021-04-09T18:26:19.383 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":22,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:14.412296","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:26:09.311735","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:26:12.130710","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:26:19.385 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.378 7f5710f25700 1 -- 172.21.15.79:0/4135654114 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f56f0029100 msgr2=0x7f56f002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.385 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.378 7f5710f25700 1 --2- 172.21.15.79:0/4135654114 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f56f0029100 0x7f56f002b650 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.386 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.378 7f5710f25700 1 -- 172.21.15.79:0/4135654114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f570c19ff50 msgr2=0x7f570c0c5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.386 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.378 7f5710f25700 1 --2- 172.21.15.79:0/4135654114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f570c19ff50 0x7f570c0c5ed0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f570c0874d0 tx=0x7f5704006890).stop 2021-04-09T18:26:19.386 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.378 7f5710f25700 1 -- 172.21.15.79:0/4135654114 shutdown_connections 2021-04-09T18:26:19.386 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.378 7f5710f25700 1 --2- 172.21.15.79:0/4135654114 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f56f0029100 0x7f56f002b650 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.387 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.378 7f5710f25700 1 --2- 172.21.15.79:0/4135654114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f570c19ff50 0x7f570c0c5ed0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.387 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.378 7f5710f25700 1 --2- 172.21.15.79:0/4135654114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f570c097c90 0x7f570c1a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.387 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.378 7f5710f25700 1 --2- 172.21.15.79:0/4135654114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f570c19fb00 0x7f570c0c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.387 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.378 7f5710f25700 1 -- 172.21.15.79:0/4135654114 >> 172.21.15.79:0/4135654114 conn(0x7f570c09a1b0 msgr2=0x7f570c09a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:19.387 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.378 7f5710f25700 1 -- 172.21.15.79:0/4135654114 shutdown_connections 2021-04-09T18:26:19.388 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:19.378 7f5710f25700 1 -- 172.21.15.79:0/4135654114 wait complete. 2021-04-09T18:26:19.393 DEBUG:teuthology.misc:8 of 8 OSDs are up 2021-04-09T18:26:19.394 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:19.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.478 7ff9c3f6a700 1 Processor -- start 2021-04-09T18:26:19.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.478 7ff9c3f6a700 1 -- start start 2021-04-09T18:26:19.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.478 7ff9c3f6a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff9bc0e9ad0 0x7ff9bc09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.478 7ff9c3f6a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9bc0fbb10 con 0x7ff9bc0f5510 2021-04-09T18:26:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.478 7ff9c3f6a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9bc0e56c0 con 0x7ff9bc1c8000 2021-04-09T18:26:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.478 7ff9c3f6a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9bc1c3db0 con 0x7ff9bc0e9ad0 2021-04-09T18:26:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.478 7ff9c1d0e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff9bc0f5510 0x7ff9bc0f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50362/0 (socket says 172.21.15.79:50362) 2021-04-09T18:26:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.478 7ff9c1d0e700 1 -- 172.21.15.79:0/1190768023 learned_addr learned my addr 172.21.15.79:0/1190768023 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:19.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.478 7ff9c150d700 1 --2- 172.21.15.79:0/1190768023 >> v2:172.21.15.89:3300/0 conn(0x7ff9bc0e9ad0 0x7ff9bc09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.478 7ff9c0d0c700 1 -- 172.21.15.79:0/1190768023 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010782963 0 0) 0x7ff9b80010d0 con 0x7ff9bc0f5510 2021-04-09T18:26:19.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.478 7ff9c0d0c700 1 -- 172.21.15.79:0/1190768023 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9a8003240 con 0x7ff9bc0f5510 2021-04-09T18:26:19.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.478 7ff9c150d700 1 -- 172.21.15.79:0/1190768023 >> v1:172.21.15.89:6789/0 conn(0x7ff9bc1c8000 legacy=0x7ff9bc1ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.478 7ff9c0d0c700 1 -- 172.21.15.79:0/1190768023 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988803652 0 0) 0x7ff9b4001450 con 0x7ff9bc1c8000 2021-04-09T18:26:19.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.478 7ff9c150d700 1 -- 172.21.15.79:0/1190768023 >> v1:172.21.15.79:6789/0 conn(0x7ff9bc0f5510 legacy=0x7ff9bc0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.478 7ff9c150d700 1 -- 172.21.15.79:0/1190768023 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc0e4320 con 0x7ff9bc0e9ad0 2021-04-09T18:26:19.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.478 7ff9c150d700 1 --2- 172.21.15.79:0/1190768023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9bc0e9ad0 0x7ff9bc09f100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff9ac002f30 tx=0x7ff9ac00bcc0).ready entity=mon.1 client_cookie=46372c300790a47f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:19.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c0d0c700 1 -- 172.21.15.79:0/1190768023 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff9bc0e4320 con 0x7ff9bc0e9ad0 2021-04-09T18:26:19.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c0d0c700 1 -- 172.21.15.79:0/1190768023 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac009800 con 0x7ff9bc0e9ad0 2021-04-09T18:26:19.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c0d0c700 1 -- 172.21.15.79:0/1190768023 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff9ac009bd0 con 0x7ff9bc0e9ad0 2021-04-09T18:26:19.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c3f6a700 1 -- 172.21.15.79:0/1190768023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9bc0e9ad0 msgr2=0x7ff9bc09f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c3f6a700 1 --2- 172.21.15.79:0/1190768023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9bc0e9ad0 0x7ff9bc09f100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff9ac002f30 tx=0x7ff9ac00bcc0).stop 2021-04-09T18:26:19.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c3f6a700 1 -- 172.21.15.79:0/1190768023 shutdown_connections 2021-04-09T18:26:19.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c3f6a700 1 --2- 172.21.15.79:0/1190768023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9bc0e9ad0 0x7ff9bc09f100 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c3f6a700 1 -- 172.21.15.79:0/1190768023 >> 172.21.15.79:0/1190768023 conn(0x7ff9bc0e5fd0 msgr2=0x7ff9bc0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:19.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c3f6a700 1 -- 172.21.15.79:0/1190768023 shutdown_connections 2021-04-09T18:26:19.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c3f6a700 1 -- 172.21.15.79:0/1190768023 wait complete. 2021-04-09T18:26:19.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c3f6a700 1 Processor -- start 2021-04-09T18:26:19.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c3f6a700 1 -- start start 2021-04-09T18:26:19.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c3f6a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9bc1af4c0 0x7ff9bc0a40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c3f6a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9bc1af910 0x7ff9bc0a3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c3f6a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9bc0d5250 0x7ff9bc0d56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c3f6a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0e9f20 con 0x7ff9bc1af4c0 2021-04-09T18:26:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c3f6a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc19baa0 con 0x7ff9bc0d5250 2021-04-09T18:26:19.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c3f6a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc19bda0 con 0x7ff9bc1af910 2021-04-09T18:26:19.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c1d0e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9bc1af4c0 0x7ff9bc0a40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c1d0e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9bc1af4c0 0x7ff9bc0a40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55658/0 (socket says 172.21.15.79:55658) 2021-04-09T18:26:19.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c1d0e700 1 -- 172.21.15.79:0/835844619 learned_addr learned my addr 172.21.15.79:0/835844619 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:19.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c150d700 1 --2- 172.21.15.79:0/835844619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9bc1af910 0x7ff9bc0a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.482 7ff9c250f700 1 --2- 172.21.15.79:0/835844619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9bc0d5250 0x7ff9bc0d56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.486 7ff9c150d700 1 -- 172.21.15.79:0/835844619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9bc0d5250 msgr2=0x7ff9bc0d56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.486 7ff9c150d700 1 --2- 172.21.15.79:0/835844619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9bc0d5250 0x7ff9bc0d56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.486 7ff9c150d700 1 -- 172.21.15.79:0/835844619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9bc1af4c0 msgr2=0x7ff9bc0a40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.486 7ff9c150d700 1 --2- 172.21.15.79:0/835844619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9bc1af4c0 0x7ff9bc0a40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.486 7ff9c150d700 1 -- 172.21.15.79:0/835844619 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc0a46e0 con 0x7ff9bc1af910 2021-04-09T18:26:19.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.486 7ff9c150d700 1 --2- 172.21.15.79:0/835844619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9bc1af910 0x7ff9bc0a3700 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7ff9bc0d82f0 tx=0x7ff9ac006890).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:19.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.486 7ff9b27fc700 1 -- 172.21.15.79:0/835844619 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff9bc0a46e0 con 0x7ff9bc1af910 2021-04-09T18:26:19.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.486 7ff9b27fc700 1 -- 172.21.15.79:0/835844619 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac011c10 con 0x7ff9bc1af910 2021-04-09T18:26:19.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.486 7ff9c3f6a700 1 -- 172.21.15.79:0/835844619 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9bc0a3d30 con 0x7ff9bc1af910 2021-04-09T18:26:19.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.486 7ff9b27fc700 1 -- 172.21.15.79:0/835844619 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff9ac01d480 con 0x7ff9bc1af910 2021-04-09T18:26:19.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.486 7ff9c3f6a700 1 -- 172.21.15.79:0/835844619 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9bc19e720 con 0x7ff9bc1af910 2021-04-09T18:26:19.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.486 7ff9b27fc700 1 -- 172.21.15.79:0/835844619 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff9ac01c3e0 con 0x7ff9bc1af910 2021-04-09T18:26:19.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.486 7ff9b27fc700 1 --2- 172.21.15.79:0/835844619 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff9a4029100 0x7ff9a402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.486 7ff9b27fc700 1 -- 172.21.15.79:0/835844619 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7ff9ac03a730 con 0x7ff9bc1af910 2021-04-09T18:26:19.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.486 7ff9c1d0e700 1 --2- 172.21.15.79:0/835844619 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff9a4029100 0x7ff9a402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.490 7ff9c1d0e700 1 --2- 172.21.15.79:0/835844619 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff9a4029100 0x7ff9a402b650 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:19.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.490 7ff9c3f6a700 1 -- 172.21.15.79:0/835844619 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9bc0e39d0 con 0x7ff9bc1af910 2021-04-09T18:26:19.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.498 7ff9b27fc700 1 -- 172.21.15.79:0/835844619 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff9ac0095f0 con 0x7ff9bc1af910 2021-04-09T18:26:19.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.666 7ff9c3f6a700 1 -- 172.21.15.79:0/835844619 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9bc0a1cb0 con 0x7ff9bc1af910 2021-04-09T18:26:19.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.670 7ff9b27fc700 1 -- 172.21.15.79:0/835844619 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14254 (secure 0 0 0) 0x7ff9ac011a00 con 0x7ff9bc1af910 2021-04-09T18:26:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:19.678 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:14.412296","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:26:09.311735","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:26:12.130710","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:26:19.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.670 7ff9c3f6a700 1 -- 172.21.15.79:0/835844619 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff9a4029100 msgr2=0x7ff9a402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.670 7ff9c3f6a700 1 --2- 172.21.15.79:0/835844619 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff9a4029100 0x7ff9a402b650 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.674 7ff9c3f6a700 1 -- 172.21.15.79:0/835844619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9bc1af910 msgr2=0x7ff9bc0a3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.674 7ff9c3f6a700 1 --2- 172.21.15.79:0/835844619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9bc1af910 0x7ff9bc0a3700 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7ff9bc0d82f0 tx=0x7ff9ac006890).stop 2021-04-09T18:26:19.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.674 7ff9c3f6a700 1 -- 172.21.15.79:0/835844619 shutdown_connections 2021-04-09T18:26:19.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.674 7ff9c3f6a700 1 --2- 172.21.15.79:0/835844619 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff9a4029100 0x7ff9a402b650 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.674 7ff9c3f6a700 1 --2- 172.21.15.79:0/835844619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9bc0d5250 0x7ff9bc0d56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.674 7ff9c3f6a700 1 --2- 172.21.15.79:0/835844619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9bc1af4c0 0x7ff9bc0a40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.674 7ff9c3f6a700 1 --2- 172.21.15.79:0/835844619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9bc1af910 0x7ff9bc0a3700 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.674 7ff9c3f6a700 1 -- 172.21.15.79:0/835844619 >> 172.21.15.79:0/835844619 conn(0x7ff9bc0a30b0 msgr2=0x7ff9bc0a2540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:19.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.674 7ff9c3f6a700 1 -- 172.21.15.79:0/835844619 shutdown_connections 2021-04-09T18:26:19.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.674 7ff9c3f6a700 1 -- 172.21.15.79:0/835844619 wait complete. 2021-04-09T18:26:19.690 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2021-04-09T18:26:19.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.774 7f7a49287700 1 Processor -- start 2021-04-09T18:26:19.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.774 7f7a49287700 1 -- start start 2021-04-09T18:26:19.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.774 7f7a49287700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a440f5520 0x7f7a440f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.774 7f7a49287700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7a440e9ae0 0x7f7a4409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.774 7f7a49287700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a440fbb20 con 0x7f7a441c2db0 2021-04-09T18:26:19.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.774 7f7a49287700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a440e9f30 con 0x7f7a440e9ae0 2021-04-09T18:26:19.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.774 7f7a49287700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a440e59d0 con 0x7f7a440f5520 2021-04-09T18:26:19.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.774 7f7a42804700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7a440e9ae0 0x7f7a4409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.774 7f7a43005700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a440f5520 0x7f7a440f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.774 7f7a42804700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7a440e9ae0 0x7f7a4409f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:44010/0 (socket says 172.21.15.79:44010) 2021-04-09T18:26:19.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.774 7f7a43005700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a440f5520 0x7f7a440f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:52662/0 (socket says 172.21.15.79:52662) 2021-04-09T18:26:19.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.774 7f7a42804700 1 -- 172.21.15.79:0/4231486669 learned_addr learned my addr 172.21.15.79:0/4231486669 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:19.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.774 7f7a43806700 1 --1- 172.21.15.79:0/4231486669 >> v1:172.21.15.89:6789/0 conn(0x7f7a441c2db0 0x7f7a441c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:50850/0 (socket says 172.21.15.79:50850) 2021-04-09T18:26:19.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.778 7f7a43005700 1 -- 172.21.15.79:0/4231486669 >> v2:172.21.15.89:3300/0 conn(0x7f7a440e9ae0 msgr2=0x7f7a4409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:19.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.778 7f7a43005700 1 --2- 172.21.15.79:0/4231486669 >> v2:172.21.15.89:3300/0 conn(0x7f7a440e9ae0 0x7f7a4409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.778 7f7a43005700 1 -- 172.21.15.79:0/4231486669 >> v1:172.21.15.89:6789/0 conn(0x7f7a441c2db0 legacy=0x7f7a441c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.778 7f7a43005700 1 -- 172.21.15.79:0/4231486669 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a440e56d0 con 0x7f7a440f5520 2021-04-09T18:26:19.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.778 7f7a42804700 1 --2- 172.21.15.79:0/4231486669 >> v2:172.21.15.89:3300/0 conn(0x7f7a440e9ae0 0x7f7a4409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:19.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.778 7f7a43005700 1 --2- 172.21.15.79:0/4231486669 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a440f5520 0x7f7a440f64b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f7a3c001340 tx=0x7f7a3c001040).ready entity=mon.2 client_cookie=9380541a4e244201 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:19.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.778 7f7a42003700 1 -- 172.21.15.79:0/4231486669 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7a440e56d0 con 0x7f7a440f5520 2021-04-09T18:26:19.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.778 7f7a42003700 1 -- 172.21.15.79:0/4231486669 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a340096c0 con 0x7f7a440f5520 2021-04-09T18:26:19.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.778 7f7a42003700 1 -- 172.21.15.79:0/4231486669 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7a34009ad0 con 0x7f7a440f5520 2021-04-09T18:26:19.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.778 7f7a49287700 1 -- 172.21.15.79:0/4231486669 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a440f5520 msgr2=0x7f7a440f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.778 7f7a49287700 1 --2- 172.21.15.79:0/4231486669 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a440f5520 0x7f7a440f64b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f7a3c001340 tx=0x7f7a3c001040).stop 2021-04-09T18:26:19.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.778 7f7a49287700 1 -- 172.21.15.79:0/4231486669 shutdown_connections 2021-04-09T18:26:19.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.778 7f7a49287700 1 --2- 172.21.15.79:0/4231486669 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a440f5520 0x7f7a440f64b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.778 7f7a49287700 1 --2- 172.21.15.79:0/4231486669 >> v2:172.21.15.89:3300/0 conn(0x7f7a440e9ae0 0x7f7a4409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.778 7f7a49287700 1 -- 172.21.15.79:0/4231486669 >> 172.21.15.79:0/4231486669 conn(0x7f7a440e5fe0 msgr2=0x7f7a440e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:19.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.778 7f7a49287700 1 -- 172.21.15.79:0/4231486669 shutdown_connections 2021-04-09T18:26:19.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.778 7f7a49287700 1 -- 172.21.15.79:0/4231486669 wait complete. 2021-04-09T18:26:19.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a49287700 1 Processor -- start 2021-04-09T18:26:19.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a49287700 1 -- start start 2021-04-09T18:26:19.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a49287700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a440ad2a0 0x7f7a440a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a49287700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a440a83e0 0x7f7a440c1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a49287700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a440d4cf0 0x7f7a440d5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a49287700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a440ad860 con 0x7f7a440a83e0 2021-04-09T18:26:19.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a49287700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a440adb60 con 0x7f7a440ad2a0 2021-04-09T18:26:19.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a49287700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a440a4010 con 0x7f7a440d4cf0 2021-04-09T18:26:19.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a42804700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a440a83e0 0x7f7a440c1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a42804700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a440a83e0 0x7f7a440c1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55672/0 (socket says 172.21.15.79:55672) 2021-04-09T18:26:19.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a42804700 1 -- 172.21.15.79:0/3493777557 learned_addr learned my addr 172.21.15.79:0/3493777557 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:19.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a43005700 1 --2- 172.21.15.79:0/3493777557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a440ad2a0 0x7f7a440a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a43806700 1 --2- 172.21.15.79:0/3493777557 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a440d4cf0 0x7f7a440d5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a42804700 1 -- 172.21.15.79:0/3493777557 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a440d4cf0 msgr2=0x7f7a440d5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a42804700 1 --2- 172.21.15.79:0/3493777557 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a440d4cf0 0x7f7a440d5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a42804700 1 -- 172.21.15.79:0/3493777557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a440ad2a0 msgr2=0x7f7a440a33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a42804700 1 --2- 172.21.15.79:0/3493777557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a440ad2a0 0x7f7a440a33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a42804700 1 -- 172.21.15.79:0/3493777557 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a440a39d0 con 0x7f7a440a83e0 2021-04-09T18:26:19.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a42804700 1 --2- 172.21.15.79:0/3493777557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a440a83e0 0x7f7a440c1450 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f7a44096ed0 tx=0x7f7a2c00c650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:19.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a3bfff700 1 -- 172.21.15.79:0/3493777557 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7a440a39d0 con 0x7f7a440a83e0 2021-04-09T18:26:19.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a3bfff700 1 -- 172.21.15.79:0/3493777557 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2c0123f0 con 0x7f7a440a83e0 2021-04-09T18:26:19.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a3bfff700 1 -- 172.21.15.79:0/3493777557 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7a2c00f040 con 0x7f7a440a83e0 2021-04-09T18:26:19.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a49287700 1 -- 172.21.15.79:0/3493777557 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a441aefd0 con 0x7f7a440a83e0 2021-04-09T18:26:19.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.782 7f7a49287700 1 -- 172.21.15.79:0/3493777557 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a440af100 con 0x7f7a440a83e0 2021-04-09T18:26:19.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.786 7f7a3bfff700 1 -- 172.21.15.79:0/3493777557 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7a2c011070 con 0x7f7a440a83e0 2021-04-09T18:26:19.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.786 7f7a3bfff700 1 --2- 172.21.15.79:0/3493777557 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7a28029100 0x7f7a2802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.786 7f7a3bfff700 1 -- 172.21.15.79:0/3493777557 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f7a2c003020 con 0x7f7a440a83e0 2021-04-09T18:26:19.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.786 7f7a43005700 1 --2- 172.21.15.79:0/3493777557 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7a28029100 0x7f7a2802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.786 7f7a43005700 1 --2- 172.21.15.79:0/3493777557 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7a28029100 0x7f7a2802b650 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:19.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.790 7f7a49287700 1 --2- 172.21.15.79:0/3493777557 >> [v2:172.21.15.79:6802/13961,v1:172.21.15.79:6804/13961] conn(0x7f7a440af670 0x7f7a440afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.790 7f7a49287700 1 -- 172.21.15.79:0/3493777557 --> [v2:172.21.15.79:6802/13961,v1:172.21.15.79:6804/13961] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7a440e39e0 con 0x7f7a440af670 2021-04-09T18:26:19.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.790 7f7a43806700 1 --2- 172.21.15.79:0/3493777557 >> [v2:172.21.15.79:6802/13961,v1:172.21.15.79:6804/13961] conn(0x7f7a440af670 0x7f7a440afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.790 7f7a43806700 1 --2- 172.21.15.79:0/3493777557 >> [v2:172.21.15.79:6802/13961,v1:172.21.15.79:6804/13961] conn(0x7f7a440af670 0x7f7a440afac0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:19.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.790 7f7a3bfff700 1 -- 172.21.15.79:0/3493777557 <== osd.0 v2:172.21.15.79:6802/13961 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f7a440e39e0 con 0x7f7a440af670 2021-04-09T18:26:19.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.802 7f7a49287700 1 -- 172.21.15.79:0/3493777557 --> [v2:172.21.15.79:6802/13961,v1:172.21.15.79:6804/13961] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7a440f5b20 con 0x7f7a440af670 2021-04-09T18:26:19.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.802 7f7a3bfff700 1 -- 172.21.15.79:0/3493777557 <== osd.0 v2:172.21.15.79:6802/13961 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7a440f5b20 con 0x7f7a440af670 2021-04-09T18:26:19.811 INFO:teuthology.orchestra.run.smithi079.stdout:55834574855 2021-04-09T18:26:19.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.806 7f7a49287700 1 -- 172.21.15.79:0/3493777557 >> [v2:172.21.15.79:6802/13961,v1:172.21.15.79:6804/13961] conn(0x7f7a440af670 msgr2=0x7f7a440afac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.806 7f7a49287700 1 --2- 172.21.15.79:0/3493777557 >> [v2:172.21.15.79:6802/13961,v1:172.21.15.79:6804/13961] conn(0x7f7a440af670 0x7f7a440afac0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.806 7f7a49287700 1 -- 172.21.15.79:0/3493777557 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7a28029100 msgr2=0x7f7a2802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.806 7f7a49287700 1 --2- 172.21.15.79:0/3493777557 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7a28029100 0x7f7a2802b650 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.806 7f7a49287700 1 -- 172.21.15.79:0/3493777557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a440a83e0 msgr2=0x7f7a440c1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.806 7f7a49287700 1 --2- 172.21.15.79:0/3493777557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a440a83e0 0x7f7a440c1450 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f7a44096ed0 tx=0x7f7a2c00c650).stop 2021-04-09T18:26:19.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.806 7f7a43806700 1 -- 172.21.15.79:0/3493777557 reap_dead start 2021-04-09T18:26:19.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.806 7f7a49287700 1 -- 172.21.15.79:0/3493777557 shutdown_connections 2021-04-09T18:26:19.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.806 7f7a49287700 1 -- 172.21.15.79:0/3493777557 >> 172.21.15.79:0/3493777557 conn(0x7f7a441a2690 msgr2=0x7f7a440a24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:19.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.806 7f7a49287700 1 -- 172.21.15.79:0/3493777557 shutdown_connections 2021-04-09T18:26:19.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.806 7f7a49287700 1 -- 172.21.15.79:0/3493777557 wait complete. 2021-04-09T18:26:19.823 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2021-04-09T18:26:19.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c8cdd0700 1 Processor -- start 2021-04-09T18:26:19.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c8cdd0700 1 -- start start 2021-04-09T18:26:19.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c8cdd0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7c880e9ae0 0x7f7c8809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c8cdd0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c881c8010 0x7f7c881ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c8cdd0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c880fbb20 con 0x7f7c880f5520 2021-04-09T18:26:19.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c8cdd0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c881c3dc0 con 0x7f7c880e9ae0 2021-04-09T18:26:19.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c8cdd0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c880e9f30 con 0x7f7c881c8010 2021-04-09T18:26:19.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c862ee700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7c880e9ae0 0x7f7c8809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c872f0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c881c8010 0x7f7c881ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c86aef700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7c880f5520 0x7f7c880f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:50862/0 (socket says 172.21.15.79:50862) 2021-04-09T18:26:19.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c86aef700 1 -- 172.21.15.79:0/203119876 learned_addr learned my addr 172.21.15.79:0/203119876 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:19.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c872f0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c881c8010 0x7f7c881ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:52682/0 (socket says 172.21.15.79:52682) 2021-04-09T18:26:19.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c872f0700 1 -- 172.21.15.79:0/203119876 >> v2:172.21.15.89:3300/0 conn(0x7f7c880e9ae0 msgr2=0x7f7c8809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:19.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c872f0700 1 --2- 172.21.15.79:0/203119876 >> v2:172.21.15.89:3300/0 conn(0x7f7c880e9ae0 0x7f7c8809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c872f0700 1 -- 172.21.15.79:0/203119876 >> v1:172.21.15.89:6789/0 conn(0x7f7c880f5520 legacy=0x7f7c880f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c85aed700 1 -- 172.21.15.79:0/203119876 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483767688 0 0) 0x7f7c80001450 con 0x7f7c880f5520 2021-04-09T18:26:19.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c872f0700 1 -- 172.21.15.79:0/203119876 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c880e56d0 con 0x7f7c881c8010 2021-04-09T18:26:19.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c862ee700 1 --2- 172.21.15.79:0/203119876 >> v2:172.21.15.89:3300/0 conn(0x7f7c880e9ae0 0x7f7c8809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:19.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c872f0700 1 --2- 172.21.15.79:0/203119876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c881c8010 0x7f7c881ca470 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7c78002f30 tx=0x7f7c7800bcc0).ready entity=mon.2 client_cookie=164ae76cc6140507 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:19.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c85aed700 1 -- 172.21.15.79:0/203119876 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c880e56d0 con 0x7f7c881c8010 2021-04-09T18:26:19.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c85aed700 1 -- 172.21.15.79:0/203119876 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c78009800 con 0x7f7c881c8010 2021-04-09T18:26:19.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c85aed700 1 -- 172.21.15.79:0/203119876 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c78009bd0 con 0x7f7c881c8010 2021-04-09T18:26:19.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c8cdd0700 1 -- 172.21.15.79:0/203119876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c881c8010 msgr2=0x7f7c881ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.914 7f7c8cdd0700 1 --2- 172.21.15.79:0/203119876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c881c8010 0x7f7c881ca470 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7c78002f30 tx=0x7f7c7800bcc0).stop 2021-04-09T18:26:19.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.918 7f7c8cdd0700 1 -- 172.21.15.79:0/203119876 shutdown_connections 2021-04-09T18:26:19.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.918 7f7c8cdd0700 1 --2- 172.21.15.79:0/203119876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c881c8010 0x7f7c881ca470 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.918 7f7c8cdd0700 1 --2- 172.21.15.79:0/203119876 >> v2:172.21.15.89:3300/0 conn(0x7f7c880e9ae0 0x7f7c8809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.918 7f7c8cdd0700 1 -- 172.21.15.79:0/203119876 >> 172.21.15.79:0/203119876 conn(0x7f7c880e5fe0 msgr2=0x7f7c880e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:19.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.918 7f7c8cdd0700 1 -- 172.21.15.79:0/203119876 shutdown_connections 2021-04-09T18:26:19.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.918 7f7c8cdd0700 1 -- 172.21.15.79:0/203119876 wait complete. 2021-04-09T18:26:19.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c8cdd0700 1 Processor -- start 2021-04-09T18:26:19.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c8cdd0700 1 -- start start 2021-04-09T18:26:19.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c8cdd0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c880a6660 0x7f7c880c0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c8cdd0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c88097690 0x7f7c880980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c8cdd0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c880bfeb0 0x7f7c881ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c8cdd0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c88097de0 con 0x7f7c880bfeb0 2021-04-09T18:26:19.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c8cdd0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c88097ae0 con 0x7f7c88097690 2021-04-09T18:26:19.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c8cdd0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c88098710 con 0x7f7c880a6660 2021-04-09T18:26:19.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c872f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c880bfeb0 0x7f7c881ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c862ee700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c88097690 0x7f7c880980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c862ee700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c88097690 0x7f7c880980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:44030/0 (socket says 172.21.15.79:44030) 2021-04-09T18:26:19.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c862ee700 1 -- 172.21.15.79:0/1274724551 learned_addr learned my addr 172.21.15.79:0/1274724551 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:19.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c86aef700 1 --2- 172.21.15.79:0/1274724551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c880a6660 0x7f7c880c0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c862ee700 1 -- 172.21.15.79:0/1274724551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c880a6660 msgr2=0x7f7c880c0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c862ee700 1 --2- 172.21.15.79:0/1274724551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c880a6660 0x7f7c880c0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c862ee700 1 -- 172.21.15.79:0/1274724551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c880bfeb0 msgr2=0x7f7c881ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c862ee700 1 --2- 172.21.15.79:0/1274724551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c880bfeb0 0x7f7c881ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c862ee700 1 -- 172.21.15.79:0/1274724551 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c880c0300 con 0x7f7c88097690 2021-04-09T18:26:19.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c872f0700 1 --2- 172.21.15.79:0/1274724551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c880bfeb0 0x7f7c881ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:19.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c862ee700 1 --2- 172.21.15.79:0/1274724551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c88097690 0x7f7c880980e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f7c7000efc0 tx=0x7f7c7000c430).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:19.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c7f7fe700 1 -- 172.21.15.79:0/1274724551 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c880c0300 con 0x7f7c88097690 2021-04-09T18:26:19.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c7f7fe700 1 -- 172.21.15.79:0/1274724551 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7000cdc0 con 0x7f7c88097690 2021-04-09T18:26:19.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c8cdd0700 1 -- 172.21.15.79:0/1274724551 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c881ad4c0 con 0x7f7c88097690 2021-04-09T18:26:19.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c7f7fe700 1 -- 172.21.15.79:0/1274724551 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c7000f040 con 0x7f7c88097690 2021-04-09T18:26:19.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.922 7f7c8cdd0700 1 -- 172.21.15.79:0/1274724551 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c880c1600 con 0x7f7c88097690 2021-04-09T18:26:19.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.926 7f7c7f7fe700 1 -- 172.21.15.79:0/1274724551 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7c70011070 con 0x7f7c88097690 2021-04-09T18:26:19.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.926 7f7c7f7fe700 1 --2- 172.21.15.79:0/1274724551 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c6c029100 0x7f7c6c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.926 7f7c7f7fe700 1 -- 172.21.15.79:0/1274724551 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f7c70010040 con 0x7f7c88097690 2021-04-09T18:26:19.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.926 7f7c86aef700 1 --2- 172.21.15.79:0/1274724551 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c6c029100 0x7f7c6c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.926 7f7c86aef700 1 --2- 172.21.15.79:0/1274724551 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c6c029100 0x7f7c6c02b650 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:19.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.926 7f7c8cdd0700 1 --2- 172.21.15.79:0/1274724551 >> [v2:172.21.15.79:6800/13963,v1:172.21.15.79:6801/13963] conn(0x7f7c880c1ca0 0x7f7c880c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:19.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.926 7f7c8cdd0700 1 -- 172.21.15.79:0/1274724551 --> [v2:172.21.15.79:6800/13963,v1:172.21.15.79:6801/13963] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c880e39e0 con 0x7f7c880c1ca0 2021-04-09T18:26:19.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.926 7f7c872f0700 1 --2- 172.21.15.79:0/1274724551 >> [v2:172.21.15.79:6800/13963,v1:172.21.15.79:6801/13963] conn(0x7f7c880c1ca0 0x7f7c880c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:19.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.926 7f7c872f0700 1 --2- 172.21.15.79:0/1274724551 >> [v2:172.21.15.79:6800/13963,v1:172.21.15.79:6801/13963] conn(0x7f7c880c1ca0 0x7f7c880c20f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:19.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.926 7f7c7f7fe700 1 -- 172.21.15.79:0/1274724551 <== osd.1 v2:172.21.15.79:6800/13963 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f7c880e39e0 con 0x7f7c880c1ca0 2021-04-09T18:26:19.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.942 7f7c8cdd0700 1 -- 172.21.15.79:0/1274724551 --> [v2:172.21.15.79:6800/13963,v1:172.21.15.79:6801/13963] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7c880f5b20 con 0x7f7c880c1ca0 2021-04-09T18:26:19.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.942 7f7c7f7fe700 1 -- 172.21.15.79:0/1274724551 <== osd.1 v2:172.21.15.79:6800/13963 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7c880f5b20 con 0x7f7c880c1ca0 2021-04-09T18:26:19.950 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2021-04-09T18:26:19.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.942 7f7c8cdd0700 1 -- 172.21.15.79:0/1274724551 >> [v2:172.21.15.79:6800/13963,v1:172.21.15.79:6801/13963] conn(0x7f7c880c1ca0 msgr2=0x7f7c880c20f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.942 7f7c8cdd0700 1 --2- 172.21.15.79:0/1274724551 >> [v2:172.21.15.79:6800/13963,v1:172.21.15.79:6801/13963] conn(0x7f7c880c1ca0 0x7f7c880c20f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.942 7f7c8cdd0700 1 -- 172.21.15.79:0/1274724551 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c6c029100 msgr2=0x7f7c6c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.942 7f7c8cdd0700 1 --2- 172.21.15.79:0/1274724551 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c6c029100 0x7f7c6c02b650 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:19.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.942 7f7c8cdd0700 1 -- 172.21.15.79:0/1274724551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c88097690 msgr2=0x7f7c880980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:19.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.942 7f7c8cdd0700 1 --2- 172.21.15.79:0/1274724551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c88097690 0x7f7c880980e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f7c7000efc0 tx=0x7f7c7000c430).stop 2021-04-09T18:26:19.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.942 7f7c872f0700 1 -- 172.21.15.79:0/1274724551 reap_dead start 2021-04-09T18:26:19.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.942 7f7c8cdd0700 1 -- 172.21.15.79:0/1274724551 shutdown_connections 2021-04-09T18:26:19.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.942 7f7c8cdd0700 1 -- 172.21.15.79:0/1274724551 >> 172.21.15.79:0/1274724551 conn(0x7f7c8809a9f0 msgr2=0x7f7c880a6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:19.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.942 7f7c8cdd0700 1 -- 172.21.15.79:0/1274724551 shutdown_connections 2021-04-09T18:26:19.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:19.942 7f7c8cdd0700 1 -- 172.21.15.79:0/1274724551 wait complete. 2021-04-09T18:26:19.960 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2021-04-09T18:26:20.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.054 7f598776e700 1 Processor -- start 2021-04-09T18:26:20.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.054 7f598776e700 1 -- start start 2021-04-09T18:26:20.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.054 7f598776e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f59800e9ae0 0x7f598009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.054 7f598776e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59800fbb20 con 0x7f59801c8010 2021-04-09T18:26:20.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.054 7f598776e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59800e56d0 con 0x7f59800f5520 2021-04-09T18:26:20.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.054 7f598776e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59801c3dc0 con 0x7f59800e9ae0 2021-04-09T18:26:20.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.054 7f5984d11700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f59800e9ae0 0x7f598009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.054 7f5985d13700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f59801c8010 0x7f59801ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50412/0 (socket says 172.21.15.79:50412) 2021-04-09T18:26:20.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.054 7f5985d13700 1 -- 172.21.15.79:0/28586255 learned_addr learned my addr 172.21.15.79:0/28586255 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:20.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.054 7f5984d11700 1 -- 172.21.15.79:0/28586255 >> v1:172.21.15.89:6789/0 conn(0x7f59800f5520 legacy=0x7f59800f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.054 7f5984d11700 1 -- 172.21.15.79:0/28586255 >> v1:172.21.15.79:6789/0 conn(0x7f59801c8010 legacy=0x7f59801ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.054 7f5977fff700 1 -- 172.21.15.79:0/28586255 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791209977 0 0) 0x7f5978001450 con 0x7f59801c8010 2021-04-09T18:26:20.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.054 7f5984d11700 1 -- 172.21.15.79:0/28586255 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59800e4330 con 0x7f59800e9ae0 2021-04-09T18:26:20.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.054 7f5984d11700 1 --2- 172.21.15.79:0/28586255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59800e9ae0 0x7f598009f110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f5970002f30 tx=0x7f597000bcc0).ready entity=mon.0 client_cookie=9255b1c3a6becea8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.054 7f5977fff700 1 -- 172.21.15.79:0/28586255 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59800e4330 con 0x7f59800e9ae0 2021-04-09T18:26:20.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.054 7f5977fff700 1 -- 172.21.15.79:0/28586255 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5970009800 con 0x7f59800e9ae0 2021-04-09T18:26:20.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.054 7f5977fff700 1 -- 172.21.15.79:0/28586255 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5970009bd0 con 0x7f59800e9ae0 2021-04-09T18:26:20.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.054 7f598776e700 1 -- 172.21.15.79:0/28586255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59800e9ae0 msgr2=0x7f598009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.054 7f598776e700 1 --2- 172.21.15.79:0/28586255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59800e9ae0 0x7f598009f110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f5970002f30 tx=0x7f597000bcc0).stop 2021-04-09T18:26:20.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.058 7f598776e700 1 -- 172.21.15.79:0/28586255 shutdown_connections 2021-04-09T18:26:20.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.058 7f598776e700 1 --2- 172.21.15.79:0/28586255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59800e9ae0 0x7f598009f110 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.058 7f598776e700 1 -- 172.21.15.79:0/28586255 >> 172.21.15.79:0/28586255 conn(0x7f59800e5fe0 msgr2=0x7f59800e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:20.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.058 7f598776e700 1 -- 172.21.15.79:0/28586255 shutdown_connections 2021-04-09T18:26:20.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.058 7f598776e700 1 -- 172.21.15.79:0/28586255 wait complete. 2021-04-09T18:26:20.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f598776e700 1 Processor -- start 2021-04-09T18:26:20.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f598776e700 1 -- start start 2021-04-09T18:26:20.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f598776e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5980094330 0x7f5980093b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f598776e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59800a8640 0x7f59801d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f598776e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59801d1090 0x7f59801d4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f598776e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59800e9f30 con 0x7f5980094330 2021-04-09T18:26:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f598776e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5980094aa0 con 0x7f59801d1090 2021-04-09T18:26:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f598776e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5980094780 con 0x7f59800a8640 2021-04-09T18:26:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f5985512700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5980094330 0x7f5980093b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f5985512700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5980094330 0x7f5980093b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55704/0 (socket says 172.21.15.79:55704) 2021-04-09T18:26:20.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f5985512700 1 -- 172.21.15.79:0/1949284632 learned_addr learned my addr 172.21.15.79:0/1949284632 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:20.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f5984d11700 1 --2- 172.21.15.79:0/1949284632 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59800a8640 0x7f59801d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f5985d13700 1 --2- 172.21.15.79:0/1949284632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59801d1090 0x7f59801d4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f5985512700 1 -- 172.21.15.79:0/1949284632 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59800a8640 msgr2=0x7f59801d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f5985512700 1 --2- 172.21.15.79:0/1949284632 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59800a8640 0x7f59801d0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f5985512700 1 -- 172.21.15.79:0/1949284632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59801d1090 msgr2=0x7f59801d4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f5985512700 1 --2- 172.21.15.79:0/1949284632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59801d1090 0x7f59801d4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f5985512700 1 -- 172.21.15.79:0/1949284632 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59800962b0 con 0x7f5980094330 2021-04-09T18:26:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f5985512700 1 --2- 172.21.15.79:0/1949284632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5980094330 0x7f5980093b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f59800d7930 tx=0x7f597c00cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f5975ffb700 1 -- 172.21.15.79:0/1949284632 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59800962b0 con 0x7f5980094330 2021-04-09T18:26:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f5975ffb700 1 -- 172.21.15.79:0/1949284632 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597c010510 con 0x7f5980094330 2021-04-09T18:26:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f598776e700 1 -- 172.21.15.79:0/1949284632 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59800a8a90 con 0x7f5980094330 2021-04-09T18:26:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f5975ffb700 1 -- 172.21.15.79:0/1949284632 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f597c0106f0 con 0x7f5980094330 2021-04-09T18:26:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.062 7f598776e700 1 -- 172.21.15.79:0/1949284632 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59801d5140 con 0x7f5980094330 2021-04-09T18:26:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.066 7f5975ffb700 1 -- 172.21.15.79:0/1949284632 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f597c019020 con 0x7f5980094330 2021-04-09T18:26:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.066 7f5975ffb700 1 --2- 172.21.15.79:0/1949284632 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5960029100 0x7f596002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.066 7f5975ffb700 1 -- 172.21.15.79:0/1949284632 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f597c038e20 con 0x7f5980094330 2021-04-09T18:26:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.066 7f5984d11700 1 --2- 172.21.15.79:0/1949284632 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5960029100 0x7f596002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.066 7f5984d11700 1 --2- 172.21.15.79:0/1949284632 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5960029100 0x7f596002b650 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.066 7f598776e700 1 --2- 172.21.15.79:0/1949284632 >> [v2:172.21.15.79:6816/13962,v1:172.21.15.79:6817/13962] conn(0x7f59801d5720 0x7f59800ab750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.066 7f598776e700 1 -- 172.21.15.79:0/1949284632 --> [v2:172.21.15.79:6816/13962,v1:172.21.15.79:6817/13962] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59800e39e0 con 0x7f59801d5720 2021-04-09T18:26:20.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.066 7f5985d13700 1 --2- 172.21.15.79:0/1949284632 >> [v2:172.21.15.79:6816/13962,v1:172.21.15.79:6817/13962] conn(0x7f59801d5720 0x7f59800ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.066 7f5985d13700 1 --2- 172.21.15.79:0/1949284632 >> [v2:172.21.15.79:6816/13962,v1:172.21.15.79:6817/13962] conn(0x7f59801d5720 0x7f59800ab750 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.066 7f5975ffb700 1 -- 172.21.15.79:0/1949284632 <== osd.2 v2:172.21.15.79:6816/13962 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f59800e39e0 con 0x7f59801d5720 2021-04-09T18:26:20.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.078 7f598776e700 1 -- 172.21.15.79:0/1949284632 --> [v2:172.21.15.79:6816/13962,v1:172.21.15.79:6817/13962] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f59800a1cc0 con 0x7f59801d5720 2021-04-09T18:26:20.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.078 7f5975ffb700 1 -- 172.21.15.79:0/1949284632 <== osd.2 v2:172.21.15.79:6816/13962 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f59800a1cc0 con 0x7f59801d5720 2021-04-09T18:26:20.087 INFO:teuthology.orchestra.run.smithi079.stdout:55834574855 2021-04-09T18:26:20.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.082 7f598776e700 1 -- 172.21.15.79:0/1949284632 >> [v2:172.21.15.79:6816/13962,v1:172.21.15.79:6817/13962] conn(0x7f59801d5720 msgr2=0x7f59800ab750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.082 7f598776e700 1 --2- 172.21.15.79:0/1949284632 >> [v2:172.21.15.79:6816/13962,v1:172.21.15.79:6817/13962] conn(0x7f59801d5720 0x7f59800ab750 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.082 7f598776e700 1 -- 172.21.15.79:0/1949284632 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5960029100 msgr2=0x7f596002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.082 7f598776e700 1 --2- 172.21.15.79:0/1949284632 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5960029100 0x7f596002b650 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.082 7f598776e700 1 -- 172.21.15.79:0/1949284632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5980094330 msgr2=0x7f5980093b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.082 7f598776e700 1 --2- 172.21.15.79:0/1949284632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5980094330 0x7f5980093b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f59800d7930 tx=0x7f597c00cae0).stop 2021-04-09T18:26:20.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.082 7f5985d13700 1 -- 172.21.15.79:0/1949284632 reap_dead start 2021-04-09T18:26:20.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.082 7f598776e700 1 -- 172.21.15.79:0/1949284632 shutdown_connections 2021-04-09T18:26:20.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.082 7f598776e700 1 -- 172.21.15.79:0/1949284632 >> 172.21.15.79:0/1949284632 conn(0x7f5980097600 msgr2=0x7f59800ba530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:20.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.082 7f598776e700 1 -- 172.21.15.79:0/1949284632 shutdown_connections 2021-04-09T18:26:20.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.082 7f598776e700 1 -- 172.21.15.79:0/1949284632 wait complete. 2021-04-09T18:26:20.099 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2021-04-09T18:26:20.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.186 7f7891f69700 1 Processor -- start 2021-04-09T18:26:20.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.186 7f7891f69700 1 -- start start 2021-04-09T18:26:20.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.186 7f7891f69700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f788c0e9ae0 0x7f788c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.186 7f7891f69700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f788c1c8010 0x7f788c1ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.186 7f7891f69700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788c0fbb20 con 0x7f788c0f5520 2021-04-09T18:26:20.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.186 7f7891f69700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f788c1c3dc0 con 0x7f788c1c8010 2021-04-09T18:26:20.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.186 7f7891f69700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f788c0e9f30 con 0x7f788c0e9ae0 2021-04-09T18:26:20.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.186 7f788bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f788c1c8010 0x7f788c1ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.186 7f788bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f788c1c8010 0x7f788c1ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55718/0 (socket says 172.21.15.79:55718) 2021-04-09T18:26:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.186 7f788bfff700 1 -- 172.21.15.79:0/3118920033 learned_addr learned my addr 172.21.15.79:0/3118920033 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.186 7f788affd700 1 --2- 172.21.15.79:0/3118920033 >> v2:172.21.15.89:3300/0 conn(0x7f788c0e9ae0 0x7f788c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.186 7f788bfff700 1 -- 172.21.15.79:0/3118920033 >> v2:172.21.15.89:3300/0 conn(0x7f788c0e9ae0 msgr2=0x7f788c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.186 7f788bfff700 1 --2- 172.21.15.79:0/3118920033 >> v2:172.21.15.89:3300/0 conn(0x7f788c0e9ae0 0x7f788c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.186 7f788bfff700 1 -- 172.21.15.79:0/3118920033 >> v1:172.21.15.89:6789/0 conn(0x7f788c0f5520 legacy=0x7f788c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.186 7f788bfff700 1 -- 172.21.15.79:0/3118920033 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c0e56d0 con 0x7f788c1c8010 2021-04-09T18:26:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.186 7f788affd700 1 --2- 172.21.15.79:0/3118920033 >> v2:172.21.15.89:3300/0 conn(0x7f788c0e9ae0 0x7f788c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.190 7f788bfff700 1 --2- 172.21.15.79:0/3118920033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f788c1c8010 0x7f788c1ca470 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f78840032b0 tx=0x7f788400b3c0).ready entity=mon.0 client_cookie=ae29acd7ab80fca1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.190 7f788a7fc700 1 -- 172.21.15.79:0/3118920033 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f788c0e56d0 con 0x7f788c1c8010 2021-04-09T18:26:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.190 7f788a7fc700 1 -- 172.21.15.79:0/3118920033 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788400bc20 con 0x7f788c1c8010 2021-04-09T18:26:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.190 7f788a7fc700 1 -- 172.21.15.79:0/3118920033 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7884002020 con 0x7f788c1c8010 2021-04-09T18:26:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.190 7f7891f69700 1 -- 172.21.15.79:0/3118920033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f788c1c8010 msgr2=0x7f788c1ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.190 7f7891f69700 1 --2- 172.21.15.79:0/3118920033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f788c1c8010 0x7f788c1ca470 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f78840032b0 tx=0x7f788400b3c0).stop 2021-04-09T18:26:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.190 7f7891f69700 1 -- 172.21.15.79:0/3118920033 shutdown_connections 2021-04-09T18:26:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.190 7f7891f69700 1 --2- 172.21.15.79:0/3118920033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f788c1c8010 0x7f788c1ca470 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.190 7f7891f69700 1 --2- 172.21.15.79:0/3118920033 >> v2:172.21.15.89:3300/0 conn(0x7f788c0e9ae0 0x7f788c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.190 7f7891f69700 1 -- 172.21.15.79:0/3118920033 >> 172.21.15.79:0/3118920033 conn(0x7f788c0e5fe0 msgr2=0x7f788c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.190 7f7891f69700 1 -- 172.21.15.79:0/3118920033 shutdown_connections 2021-04-09T18:26:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.190 7f7891f69700 1 -- 172.21.15.79:0/3118920033 wait complete. 2021-04-09T18:26:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.194 7f7891f69700 1 Processor -- start 2021-04-09T18:26:20.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.194 7f7891f69700 1 -- start start 2021-04-09T18:26:20.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.194 7f7891f69700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f788c0949e0 0x7f788c1a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.194 7f7891f69700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f788c0d4ab0 0x7f788c0d4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.194 7f7891f69700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f788c0d0dd0 0x7f788c0d1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.194 7f7891f69700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c090fd0 con 0x7f788c0949e0 2021-04-09T18:26:20.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.194 7f7891f69700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c1a54a0 con 0x7f788c0d4ab0 2021-04-09T18:26:20.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.194 7f7891f69700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788c092570 con 0x7f788c0d0dd0 2021-04-09T18:26:20.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.194 7f788b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f788c0949e0 0x7f788c1a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.194 7f788b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f788c0949e0 0x7f788c1a4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55720/0 (socket says 172.21.15.79:55720) 2021-04-09T18:26:20.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.194 7f788b7fe700 1 -- 172.21.15.79:0/314115474 learned_addr learned my addr 172.21.15.79:0/314115474 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:20.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.194 7f788affd700 1 --2- 172.21.15.79:0/314115474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f788c0d4ab0 0x7f788c0d4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.194 7f788bfff700 1 --2- 172.21.15.79:0/314115474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f788c0d0dd0 0x7f788c0d1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f788b7fe700 1 -- 172.21.15.79:0/314115474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f788c0d0dd0 msgr2=0x7f788c0d1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f788b7fe700 1 --2- 172.21.15.79:0/314115474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f788c0d0dd0 0x7f788c0d1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f788b7fe700 1 -- 172.21.15.79:0/314115474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f788c0d4ab0 msgr2=0x7f788c0d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f788b7fe700 1 --2- 172.21.15.79:0/314115474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f788c0d4ab0 0x7f788c0d4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f788b7fe700 1 -- 172.21.15.79:0/314115474 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c0d5530 con 0x7f788c0949e0 2021-04-09T18:26:20.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f788b7fe700 1 --2- 172.21.15.79:0/314115474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f788c0949e0 0x7f788c1a4220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f787c000b80 tx=0x7f787c00ca80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f7873fff700 1 -- 172.21.15.79:0/314115474 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f788c0d5530 con 0x7f788c0949e0 2021-04-09T18:26:20.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f7873fff700 1 -- 172.21.15.79:0/314115474 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c00e4a0 con 0x7f788c0949e0 2021-04-09T18:26:20.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f7873fff700 1 -- 172.21.15.79:0/314115474 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f787c00e870 con 0x7f788c0949e0 2021-04-09T18:26:20.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f7891f69700 1 -- 172.21.15.79:0/314115474 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788c0955e0 con 0x7f788c0949e0 2021-04-09T18:26:20.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f7891f69700 1 -- 172.21.15.79:0/314115474 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788c0d1850 con 0x7f788c0949e0 2021-04-09T18:26:20.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f7891f69700 1 -- 172.21.15.79:0/314115474 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f788c0e39e0 con 0x7f788c0949e0 2021-04-09T18:26:20.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f7873fff700 1 -- 172.21.15.79:0/314115474 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f787c00ea70 con 0x7f788c0949e0 2021-04-09T18:26:20.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f7873fff700 1 --2- 172.21.15.79:0/314115474 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f786c029100 0x7f786c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f7873fff700 1 -- 172.21.15.79:0/314115474 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f787c038ce0 con 0x7f788c0949e0 2021-04-09T18:26:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f7873fff700 1 --2- 172.21.15.79:0/314115474 >> [v2:172.21.15.79:6824/13987,v1:172.21.15.79:6825/13987] conn(0x7f786c030130 0x7f786c0325c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f7873fff700 1 -- 172.21.15.79:0/314115474 --> [v2:172.21.15.79:6824/13987,v1:172.21.15.79:6825/13987] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f786c032d60 con 0x7f786c030130 2021-04-09T18:26:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f7873fff700 1 -- 172.21.15.79:0/314115474 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f787c03d030 con 0x7f788c0949e0 2021-04-09T18:26:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f788bfff700 1 --2- 172.21.15.79:0/314115474 >> [v2:172.21.15.79:6824/13987,v1:172.21.15.79:6825/13987] conn(0x7f786c030130 0x7f786c0325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f788affd700 1 --2- 172.21.15.79:0/314115474 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f786c029100 0x7f786c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.198 7f788bfff700 1 --2- 172.21.15.79:0/314115474 >> [v2:172.21.15.79:6824/13987,v1:172.21.15.79:6825/13987] conn(0x7f786c030130 0x7f786c0325c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.202 7f788affd700 1 --2- 172.21.15.79:0/314115474 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f786c029100 0x7f786c02b650 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.202 7f7873fff700 1 -- 172.21.15.79:0/314115474 <== osd.3 v2:172.21.15.79:6824/13987 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f786c032d60 con 0x7f786c030130 2021-04-09T18:26:20.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.210 7f7891f69700 1 -- 172.21.15.79:0/314115474 --> [v2:172.21.15.79:6824/13987,v1:172.21.15.79:6825/13987] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f788c0a1cc0 con 0x7f786c030130 2021-04-09T18:26:20.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.210 7f7873fff700 1 -- 172.21.15.79:0/314115474 <== osd.3 v2:172.21.15.79:6824/13987 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f788c0a1cc0 con 0x7f786c030130 2021-04-09T18:26:20.221 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2021-04-09T18:26:20.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.210 7f7891f69700 1 -- 172.21.15.79:0/314115474 >> [v2:172.21.15.79:6824/13987,v1:172.21.15.79:6825/13987] conn(0x7f786c030130 msgr2=0x7f786c0325c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.210 7f7891f69700 1 --2- 172.21.15.79:0/314115474 >> [v2:172.21.15.79:6824/13987,v1:172.21.15.79:6825/13987] conn(0x7f786c030130 0x7f786c0325c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.210 7f7891f69700 1 -- 172.21.15.79:0/314115474 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f786c029100 msgr2=0x7f786c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.210 7f7891f69700 1 --2- 172.21.15.79:0/314115474 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f786c029100 0x7f786c02b650 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.210 7f7891f69700 1 -- 172.21.15.79:0/314115474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f788c0949e0 msgr2=0x7f788c1a4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.210 7f7891f69700 1 --2- 172.21.15.79:0/314115474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f788c0949e0 0x7f788c1a4220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f787c000b80 tx=0x7f787c00ca80).stop 2021-04-09T18:26:20.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.210 7f788bfff700 1 -- 172.21.15.79:0/314115474 reap_dead start 2021-04-09T18:26:20.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.210 7f7891f69700 1 -- 172.21.15.79:0/314115474 shutdown_connections 2021-04-09T18:26:20.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.210 7f7891f69700 1 -- 172.21.15.79:0/314115474 >> 172.21.15.79:0/314115474 conn(0x7f788c09b1c0 msgr2=0x7f788c0bcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:20.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.210 7f7891f69700 1 -- 172.21.15.79:0/314115474 shutdown_connections 2021-04-09T18:26:20.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.210 7f7891f69700 1 -- 172.21.15.79:0/314115474 wait complete. 2021-04-09T18:26:20.229 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2021-04-09T18:26:20.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08d0435700 1 Processor -- start 2021-04-09T18:26:20.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08d0435700 1 -- start start 2021-04-09T18:26:20.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08d0435700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08c80f5520 0x7f08c80f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08d0435700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f08c81c8010 0x7f08c81ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08d0435700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c80fbb20 con 0x7f08c80e9ae0 2021-04-09T18:26:20.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08d0435700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c80e9f30 con 0x7f08c80f5520 2021-04-09T18:26:20.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08d0435700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c81c3dc0 con 0x7f08c81c8010 2021-04-09T18:26:20.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08ce1d9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08c80f5520 0x7f08c80f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08ce1d9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08c80f5520 0x7f08c80f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55732/0 (socket says 172.21.15.79:55732) 2021-04-09T18:26:20.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08ce1d9700 1 -- 172.21.15.79:0/760489916 learned_addr learned my addr 172.21.15.79:0/760489916 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:20.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08ce9da700 1 --2- 172.21.15.79:0/760489916 >> v2:172.21.15.89:3300/0 conn(0x7f08c81c8010 0x7f08c81ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08ce1d9700 1 -- 172.21.15.79:0/760489916 >> v2:172.21.15.89:3300/0 conn(0x7f08c81c8010 msgr2=0x7f08c81ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:20.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08ce1d9700 1 --2- 172.21.15.79:0/760489916 >> v2:172.21.15.89:3300/0 conn(0x7f08c81c8010 0x7f08c81ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08ce1d9700 1 -- 172.21.15.79:0/760489916 >> v1:172.21.15.89:6789/0 conn(0x7f08c80e9ae0 legacy=0x7f08c809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08ce1d9700 1 -- 172.21.15.79:0/760489916 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c809f910 con 0x7f08c80f5520 2021-04-09T18:26:20.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08ce1d9700 1 --2- 172.21.15.79:0/760489916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c80f5520 0x7f08c80f64b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f08c4002f30 tx=0x7f08c400bd70).ready entity=mon.0 client_cookie=ddfd495347c060d5 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08cd1d7700 1 -- 172.21.15.79:0/760489916 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08c809f910 con 0x7f08c80f5520 2021-04-09T18:26:20.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08cd1d7700 1 -- 172.21.15.79:0/760489916 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c4009950 con 0x7f08c80f5520 2021-04-09T18:26:20.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08cd1d7700 1 -- 172.21.15.79:0/760489916 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08c4009d20 con 0x7f08c80f5520 2021-04-09T18:26:20.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08d0435700 1 -- 172.21.15.79:0/760489916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c80f5520 msgr2=0x7f08c80f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.322 7f08d0435700 1 --2- 172.21.15.79:0/760489916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c80f5520 0x7f08c80f64b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f08c4002f30 tx=0x7f08c400bd70).stop 2021-04-09T18:26:20.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.326 7f08d0435700 1 -- 172.21.15.79:0/760489916 shutdown_connections 2021-04-09T18:26:20.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.326 7f08d0435700 1 --2- 172.21.15.79:0/760489916 >> v2:172.21.15.89:3300/0 conn(0x7f08c81c8010 0x7f08c81ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.326 7f08d0435700 1 --2- 172.21.15.79:0/760489916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c80f5520 0x7f08c80f64b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.326 7f08d0435700 1 -- 172.21.15.79:0/760489916 >> 172.21.15.79:0/760489916 conn(0x7f08c80e5fe0 msgr2=0x7f08c80e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:20.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.326 7f08d0435700 1 -- 172.21.15.79:0/760489916 shutdown_connections 2021-04-09T18:26:20.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.326 7f08d0435700 1 -- 172.21.15.79:0/760489916 wait complete. 2021-04-09T18:26:20.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08d0435700 1 Processor -- start 2021-04-09T18:26:20.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08d0435700 1 -- start start 2021-04-09T18:26:20.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08d0435700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08c809ac60 0x7f08c809a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08d0435700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08c80d4f50 0x7f08c80d53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08d0435700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c819ce70 0x7f08c819d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08d0435700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c81a1bc0 con 0x7f08c819ce70 2021-04-09T18:26:20.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08d0435700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c809a6e0 con 0x7f08c80d4f50 2021-04-09T18:26:20.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08d0435700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c81a1770 con 0x7f08c809ac60 2021-04-09T18:26:20.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08ce9da700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c819ce70 0x7f08c819d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08ce9da700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c819ce70 0x7f08c819d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55740/0 (socket says 172.21.15.79:55740) 2021-04-09T18:26:20.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08ce9da700 1 -- 172.21.15.79:0/964650807 learned_addr learned my addr 172.21.15.79:0/964650807 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:20.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08ce1d9700 1 --2- 172.21.15.79:0/964650807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08c809ac60 0x7f08c809a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08cd9d8700 1 --2- 172.21.15.79:0/964650807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08c80d4f50 0x7f08c80d53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08ce9da700 1 -- 172.21.15.79:0/964650807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08c809ac60 msgr2=0x7f08c809a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08ce9da700 1 --2- 172.21.15.79:0/964650807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08c809ac60 0x7f08c809a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08ce9da700 1 -- 172.21.15.79:0/964650807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08c80d4f50 msgr2=0x7f08c80d53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08ce9da700 1 --2- 172.21.15.79:0/964650807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08c80d4f50 0x7f08c80d53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08ce9da700 1 -- 172.21.15.79:0/964650807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c81a12c0 con 0x7f08c819ce70 2021-04-09T18:26:20.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08ce9da700 1 --2- 172.21.15.79:0/964650807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c819ce70 0x7f08c819d2c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f08c0006de0 tx=0x7f08c000c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08beffd700 1 -- 172.21.15.79:0/964650807 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08c81a12c0 con 0x7f08c819ce70 2021-04-09T18:26:20.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08beffd700 1 -- 172.21.15.79:0/964650807 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c000cca0 con 0x7f08c819ce70 2021-04-09T18:26:20.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08d0435700 1 -- 172.21.15.79:0/964650807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c809b0b0 con 0x7f08c819ce70 2021-04-09T18:26:20.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08beffd700 1 -- 172.21.15.79:0/964650807 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08c000f040 con 0x7f08c819ce70 2021-04-09T18:26:20.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.330 7f08d0435700 1 -- 172.21.15.79:0/964650807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c819da80 con 0x7f08c819ce70 2021-04-09T18:26:20.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.334 7f08beffd700 1 -- 172.21.15.79:0/964650807 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f08c0022060 con 0x7f08c819ce70 2021-04-09T18:26:20.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.334 7f08beffd700 1 --2- 172.21.15.79:0/964650807 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f08b0029100 0x7f08b002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.334 7f08beffd700 1 -- 172.21.15.79:0/964650807 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f08c0010040 con 0x7f08c819ce70 2021-04-09T18:26:20.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.334 7f08ce1d9700 1 --2- 172.21.15.79:0/964650807 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f08b0029100 0x7f08b002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.334 7f08d0435700 1 --2- 172.21.15.79:0/964650807 >> [v2:172.21.15.89:6826/14212,v1:172.21.15.89:6827/14212] conn(0x7f08c81a31d0 0x7f08c819e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.334 7f08d0435700 1 -- 172.21.15.79:0/964650807 --> [v2:172.21.15.89:6826/14212,v1:172.21.15.89:6827/14212] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f08c80e39e0 con 0x7f08c81a31d0 2021-04-09T18:26:20.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.334 7f08cd9d8700 1 --2- 172.21.15.79:0/964650807 >> [v2:172.21.15.89:6826/14212,v1:172.21.15.89:6827/14212] conn(0x7f08c81a31d0 0x7f08c819e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.334 7f08ce1d9700 1 --2- 172.21.15.79:0/964650807 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f08b0029100 0x7f08b002b650 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.334 7f08cd9d8700 1 --2- 172.21.15.79:0/964650807 >> [v2:172.21.15.89:6826/14212,v1:172.21.15.89:6827/14212] conn(0x7f08c81a31d0 0x7f08c819e180 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.334 7f08beffd700 1 -- 172.21.15.79:0/964650807 <== osd.4 v2:172.21.15.89:6826/14212 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f08c80e39e0 con 0x7f08c81a31d0 2021-04-09T18:26:20.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.346 7f08d0435700 1 -- 172.21.15.79:0/964650807 --> [v2:172.21.15.89:6826/14212,v1:172.21.15.89:6827/14212] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f08c819e7b0 con 0x7f08c81a31d0 2021-04-09T18:26:20.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.346 7f08beffd700 1 -- 172.21.15.79:0/964650807 <== osd.4 v2:172.21.15.89:6826/14212 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f08c819e7b0 con 0x7f08c81a31d0 2021-04-09T18:26:20.357 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2021-04-09T18:26:20.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.350 7f08d0435700 1 -- 172.21.15.79:0/964650807 >> [v2:172.21.15.89:6826/14212,v1:172.21.15.89:6827/14212] conn(0x7f08c81a31d0 msgr2=0x7f08c819e180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.350 7f08d0435700 1 --2- 172.21.15.79:0/964650807 >> [v2:172.21.15.89:6826/14212,v1:172.21.15.89:6827/14212] conn(0x7f08c81a31d0 0x7f08c819e180 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.350 7f08d0435700 1 -- 172.21.15.79:0/964650807 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f08b0029100 msgr2=0x7f08b002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.350 7f08d0435700 1 --2- 172.21.15.79:0/964650807 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f08b0029100 0x7f08b002b650 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.350 7f08d0435700 1 -- 172.21.15.79:0/964650807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c819ce70 msgr2=0x7f08c819d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.350 7f08d0435700 1 --2- 172.21.15.79:0/964650807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08c819ce70 0x7f08c819d2c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f08c0006de0 tx=0x7f08c000c430).stop 2021-04-09T18:26:20.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.350 7f08ce9da700 1 -- 172.21.15.79:0/964650807 reap_dead start 2021-04-09T18:26:20.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.350 7f08d0435700 1 -- 172.21.15.79:0/964650807 shutdown_connections 2021-04-09T18:26:20.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.350 7f08d0435700 1 -- 172.21.15.79:0/964650807 >> 172.21.15.79:0/964650807 conn(0x7f08c80a24c0 msgr2=0x7f08c80a7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:20.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.350 7f08d0435700 1 -- 172.21.15.79:0/964650807 shutdown_connections 2021-04-09T18:26:20.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.350 7f08d0435700 1 -- 172.21.15.79:0/964650807 wait complete. 2021-04-09T18:26:20.370 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2021-04-09T18:26:20.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.462 7f7b50c79700 1 Processor -- start 2021-04-09T18:26:20.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.462 7f7b50c79700 1 -- start start 2021-04-09T18:26:20.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b50c79700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7b4c0e9ae0 0x7f7b4c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b50c79700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4c0fbb20 con 0x7f7b4c1c8010 2021-04-09T18:26:20.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b50c79700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4c0e56d0 con 0x7f7b4c0f5520 2021-04-09T18:26:20.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b50c79700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4c1c3dc0 con 0x7f7b4c0e9ae0 2021-04-09T18:26:20.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b49fe5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7b4c0e9ae0 0x7f7b4c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b49fe5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7b4c0e9ae0 0x7f7b4c09f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55748/0 (socket says 172.21.15.79:55748) 2021-04-09T18:26:20.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b49fe5700 1 -- 172.21.15.79:0/2186196256 learned_addr learned my addr 172.21.15.79:0/2186196256 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:20.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b4afe7700 1 --1- 172.21.15.79:0/2186196256 >> v1:172.21.15.79:6789/0 conn(0x7f7b4c1c8010 0x7f7b4c1ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50460/0 (socket says 172.21.15.79:50460) 2021-04-09T18:26:20.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b49fe5700 1 -- 172.21.15.79:0/2186196256 >> v1:172.21.15.89:6789/0 conn(0x7f7b4c0f5520 legacy=0x7f7b4c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b49fe5700 1 -- 172.21.15.79:0/2186196256 >> v1:172.21.15.79:6789/0 conn(0x7f7b4c1c8010 legacy=0x7f7b4c1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b497e4700 1 -- 172.21.15.79:0/2186196256 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221189198 0 0) 0x7f7b44001450 con 0x7f7b4c1c8010 2021-04-09T18:26:20.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b49fe5700 1 -- 172.21.15.79:0/2186196256 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c0e4330 con 0x7f7b4c0e9ae0 2021-04-09T18:26:20.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b49fe5700 1 --2- 172.21.15.79:0/2186196256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b4c0e9ae0 0x7f7b4c09f110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f7b3c002f30 tx=0x7f7b3c00bd20).ready entity=mon.0 client_cookie=b2367487e1620b4e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b497e4700 1 -- 172.21.15.79:0/2186196256 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7b4c0e4330 con 0x7f7b4c0e9ae0 2021-04-09T18:26:20.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b497e4700 1 -- 172.21.15.79:0/2186196256 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c009a20 con 0x7f7b4c0e9ae0 2021-04-09T18:26:20.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b497e4700 1 -- 172.21.15.79:0/2186196256 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7b3c009df0 con 0x7f7b4c0e9ae0 2021-04-09T18:26:20.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b50c79700 1 -- 172.21.15.79:0/2186196256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b4c0e9ae0 msgr2=0x7f7b4c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b50c79700 1 --2- 172.21.15.79:0/2186196256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b4c0e9ae0 0x7f7b4c09f110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f7b3c002f30 tx=0x7f7b3c00bd20).stop 2021-04-09T18:26:20.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b50c79700 1 -- 172.21.15.79:0/2186196256 shutdown_connections 2021-04-09T18:26:20.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b50c79700 1 --2- 172.21.15.79:0/2186196256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b4c0e9ae0 0x7f7b4c09f110 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b50c79700 1 -- 172.21.15.79:0/2186196256 >> 172.21.15.79:0/2186196256 conn(0x7f7b4c0e5fe0 msgr2=0x7f7b4c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:20.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b50c79700 1 -- 172.21.15.79:0/2186196256 shutdown_connections 2021-04-09T18:26:20.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.466 7f7b50c79700 1 -- 172.21.15.79:0/2186196256 wait complete. 2021-04-09T18:26:20.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.470 7f7b50c79700 1 Processor -- start 2021-04-09T18:26:20.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.470 7f7b50c79700 1 -- start start 2021-04-09T18:26:20.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b50c79700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b4c0b1b40 0x7f7b4c093c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b50c79700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b4c0ac780 0x7f7b4c1d0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b50c79700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b4c1d12d0 0x7f7b4c1d4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b50c79700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c0e9f30 con 0x7f7b4c0b1b40 2021-04-09T18:26:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b50c79700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c0b02a0 con 0x7f7b4c0ac780 2021-04-09T18:26:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b50c79700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c0b05a0 con 0x7f7b4c1d12d0 2021-04-09T18:26:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b4a7e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b4c0b1b40 0x7f7b4c093c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b4a7e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b4c0b1b40 0x7f7b4c093c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55752/0 (socket says 172.21.15.79:55752) 2021-04-09T18:26:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b4a7e6700 1 -- 172.21.15.79:0/3904084116 learned_addr learned my addr 172.21.15.79:0/3904084116 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b4afe7700 1 --2- 172.21.15.79:0/3904084116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b4c1d12d0 0x7f7b4c1d4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b49fe5700 1 --2- 172.21.15.79:0/3904084116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b4c0ac780 0x7f7b4c1d0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b4a7e6700 1 -- 172.21.15.79:0/3904084116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b4c1d12d0 msgr2=0x7f7b4c1d4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b4a7e6700 1 --2- 172.21.15.79:0/3904084116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b4c1d12d0 0x7f7b4c1d4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b4a7e6700 1 -- 172.21.15.79:0/3904084116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b4c0ac780 msgr2=0x7f7b4c1d0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b4a7e6700 1 --2- 172.21.15.79:0/3904084116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b4c0ac780 0x7f7b4c1d0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b4a7e6700 1 -- 172.21.15.79:0/3904084116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c098280 con 0x7f7b4c0b1b40 2021-04-09T18:26:20.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b4a7e6700 1 --2- 172.21.15.79:0/3904084116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b4c0b1b40 0x7f7b4c093c10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f7b4c094740 tx=0x7f7b4000cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b3affd700 1 -- 172.21.15.79:0/3904084116 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7b4c098280 con 0x7f7b4c0b1b40 2021-04-09T18:26:20.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b3affd700 1 -- 172.21.15.79:0/3904084116 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b40010510 con 0x7f7b4c0b1b40 2021-04-09T18:26:20.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b50c79700 1 -- 172.21.15.79:0/3904084116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4c0d8bc0 con 0x7f7b4c0b1b40 2021-04-09T18:26:20.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b3affd700 1 -- 172.21.15.79:0/3904084116 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7b400106f0 con 0x7f7b4c0b1b40 2021-04-09T18:26:20.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b50c79700 1 -- 172.21.15.79:0/3904084116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4c0943d0 con 0x7f7b4c0b1b40 2021-04-09T18:26:20.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b3affd700 1 -- 172.21.15.79:0/3904084116 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7b40019020 con 0x7f7b4c0b1b40 2021-04-09T18:26:20.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b3affd700 1 --2- 172.21.15.79:0/3904084116 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7b30029100 0x7f7b3002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b3affd700 1 -- 172.21.15.79:0/3904084116 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f7b40038e60 con 0x7f7b4c0b1b40 2021-04-09T18:26:20.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.474 7f7b49fe5700 1 --2- 172.21.15.79:0/3904084116 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7b30029100 0x7f7b3002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.478 7f7b49fe5700 1 --2- 172.21.15.79:0/3904084116 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7b30029100 0x7f7b3002b650 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.478 7f7b50c79700 1 --2- 172.21.15.79:0/3904084116 >> [v2:172.21.15.89:6810/14210,v1:172.21.15.89:6811/14210] conn(0x7f7b4c097ab0 0x7f7b4c1d5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.478 7f7b50c79700 1 -- 172.21.15.79:0/3904084116 --> [v2:172.21.15.89:6810/14210,v1:172.21.15.89:6811/14210] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b4c0e39e0 con 0x7f7b4c097ab0 2021-04-09T18:26:20.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.478 7f7b4afe7700 1 --2- 172.21.15.79:0/3904084116 >> [v2:172.21.15.89:6810/14210,v1:172.21.15.89:6811/14210] conn(0x7f7b4c097ab0 0x7f7b4c1d5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.478 7f7b4afe7700 1 --2- 172.21.15.79:0/3904084116 >> [v2:172.21.15.89:6810/14210,v1:172.21.15.89:6811/14210] conn(0x7f7b4c097ab0 0x7f7b4c1d5210 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.478 7f7b3affd700 1 -- 172.21.15.79:0/3904084116 <== osd.5 v2:172.21.15.89:6810/14210 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f7b4c0e39e0 con 0x7f7b4c097ab0 2021-04-09T18:26:20.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.490 7f7b50c79700 1 -- 172.21.15.79:0/3904084116 --> [v2:172.21.15.89:6810/14210,v1:172.21.15.89:6811/14210] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7b4c0a1cc0 con 0x7f7b4c097ab0 2021-04-09T18:26:20.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.490 7f7b3affd700 1 -- 172.21.15.79:0/3904084116 <== osd.5 v2:172.21.15.89:6810/14210 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7b4c0a1cc0 con 0x7f7b4c097ab0 2021-04-09T18:26:20.499 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2021-04-09T18:26:20.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.490 7f7b50c79700 1 -- 172.21.15.79:0/3904084116 >> [v2:172.21.15.89:6810/14210,v1:172.21.15.89:6811/14210] conn(0x7f7b4c097ab0 msgr2=0x7f7b4c1d5210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.490 7f7b50c79700 1 --2- 172.21.15.79:0/3904084116 >> [v2:172.21.15.89:6810/14210,v1:172.21.15.89:6811/14210] conn(0x7f7b4c097ab0 0x7f7b4c1d5210 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.494 7f7b50c79700 1 -- 172.21.15.79:0/3904084116 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7b30029100 msgr2=0x7f7b3002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.494 7f7b50c79700 1 --2- 172.21.15.79:0/3904084116 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7b30029100 0x7f7b3002b650 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.494 7f7b50c79700 1 -- 172.21.15.79:0/3904084116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b4c0b1b40 msgr2=0x7f7b4c093c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.494 7f7b50c79700 1 --2- 172.21.15.79:0/3904084116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b4c0b1b40 0x7f7b4c093c10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f7b4c094740 tx=0x7f7b4000cae0).stop 2021-04-09T18:26:20.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.494 7f7b4afe7700 1 -- 172.21.15.79:0/3904084116 reap_dead start 2021-04-09T18:26:20.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.494 7f7b50c79700 1 -- 172.21.15.79:0/3904084116 shutdown_connections 2021-04-09T18:26:20.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.494 7f7b50c79700 1 -- 172.21.15.79:0/3904084116 >> 172.21.15.79:0/3904084116 conn(0x7f7b4c09ac40 msgr2=0x7f7b4c0ba670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:20.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.494 7f7b50c79700 1 -- 172.21.15.79:0/3904084116 shutdown_connections 2021-04-09T18:26:20.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.494 7f7b50c79700 1 -- 172.21.15.79:0/3904084116 wait complete. 2021-04-09T18:26:20.511 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2021-04-09T18:26:20.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb389b4d700 1 Processor -- start 2021-04-09T18:26:20.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb389b4d700 1 -- start start 2021-04-09T18:26:20.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb389b4d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3841c9020 0x7fb3841cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb389b4d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3840fbb20 con 0x7fb3840f5520 2021-04-09T18:26:20.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb389b4d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb38409f910 con 0x7fb3840e9ae0 2021-04-09T18:26:20.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb389b4d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3841c3dc0 con 0x7fb3841c9020 2021-04-09T18:26:20.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb3837fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb3840f5520 0x7fb3840f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50472/0 (socket says 172.21.15.79:50472) 2021-04-09T18:26:20.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb3837fe700 1 -- 172.21.15.79:0/2343744155 learned_addr learned my addr 172.21.15.79:0/2343744155 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:20.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb383fff700 1 --2- 172.21.15.79:0/2343744155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3841c9020 0x7fb3841cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb3827fc700 1 -- 172.21.15.79:0/2343744155 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127077597 0 0) 0x7fb3740010d0 con 0x7fb3840f5520 2021-04-09T18:26:20.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb3827fc700 1 -- 172.21.15.79:0/2343744155 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb36c003240 con 0x7fb3840f5520 2021-04-09T18:26:20.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb3827fc700 1 -- 172.21.15.79:0/2343744155 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420036332 0 0) 0x7fb3780010d0 con 0x7fb3840e9ae0 2021-04-09T18:26:20.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb3827fc700 1 -- 172.21.15.79:0/2343744155 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb36c003620 con 0x7fb3840e9ae0 2021-04-09T18:26:20.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb383fff700 1 -- 172.21.15.79:0/2343744155 >> v1:172.21.15.89:6789/0 conn(0x7fb3840e9ae0 legacy=0x7fb38409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb383fff700 1 -- 172.21.15.79:0/2343744155 >> v1:172.21.15.79:6789/0 conn(0x7fb3840f5520 legacy=0x7fb3840f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb383fff700 1 -- 172.21.15.79:0/2343744155 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3840e56d0 con 0x7fb3841c9020 2021-04-09T18:26:20.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb383fff700 1 --2- 172.21.15.79:0/2343744155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3841c9020 0x7fb3841cb480 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fb37c0032b0 tx=0x7fb37c00b0e0).ready entity=mon.2 client_cookie=5684ce6af805cb46 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb3827fc700 1 -- 172.21.15.79:0/2343744155 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb3840e56d0 con 0x7fb3841c9020 2021-04-09T18:26:20.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb3827fc700 1 -- 172.21.15.79:0/2343744155 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37c00baf0 con 0x7fb3841c9020 2021-04-09T18:26:20.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb3827fc700 1 -- 172.21.15.79:0/2343744155 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb37c002020 con 0x7fb3841c9020 2021-04-09T18:26:20.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb389b4d700 1 -- 172.21.15.79:0/2343744155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3841c9020 msgr2=0x7fb3841cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.602 7fb389b4d700 1 --2- 172.21.15.79:0/2343744155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3841c9020 0x7fb3841cb480 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fb37c0032b0 tx=0x7fb37c00b0e0).stop 2021-04-09T18:26:20.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.606 7fb389b4d700 1 -- 172.21.15.79:0/2343744155 shutdown_connections 2021-04-09T18:26:20.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.606 7fb389b4d700 1 --2- 172.21.15.79:0/2343744155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3841c9020 0x7fb3841cb480 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.606 7fb389b4d700 1 -- 172.21.15.79:0/2343744155 >> 172.21.15.79:0/2343744155 conn(0x7fb3840e5fe0 msgr2=0x7fb3840e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:20.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.606 7fb389b4d700 1 -- 172.21.15.79:0/2343744155 shutdown_connections 2021-04-09T18:26:20.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.606 7fb389b4d700 1 -- 172.21.15.79:0/2343744155 wait complete. 2021-04-09T18:26:20.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb389b4d700 1 Processor -- start 2021-04-09T18:26:20.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb389b4d700 1 -- start start 2021-04-09T18:26:20.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb389b4d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3840d8360 0x7fb384094ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb389b4d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3840d01f0 0x7fb3840d0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb389b4d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3840d0c70 0x7fb3840bbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb389b4d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3840885c0 con 0x7fb3840d0c70 2021-04-09T18:26:20.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb389b4d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3840e9f30 con 0x7fb3840d8360 2021-04-09T18:26:20.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb389b4d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38408e2c0 con 0x7fb3840d01f0 2021-04-09T18:26:20.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb383fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3840d0c70 0x7fb3840bbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb383fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3840d0c70 0x7fb3840bbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55772/0 (socket says 172.21.15.79:55772) 2021-04-09T18:26:20.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb383fff700 1 -- 172.21.15.79:0/4016417738 learned_addr learned my addr 172.21.15.79:0/4016417738 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:20.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb3837fe700 1 --2- 172.21.15.79:0/4016417738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3840d8360 0x7fb384094ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb382ffd700 1 --2- 172.21.15.79:0/4016417738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3840d01f0 0x7fb3840d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb383fff700 1 -- 172.21.15.79:0/4016417738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3840d01f0 msgr2=0x7fb3840d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb383fff700 1 --2- 172.21.15.79:0/4016417738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3840d01f0 0x7fb3840d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb383fff700 1 -- 172.21.15.79:0/4016417738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3840d8360 msgr2=0x7fb384094ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb383fff700 1 --2- 172.21.15.79:0/4016417738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3840d8360 0x7fb384094ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb383fff700 1 -- 172.21.15.79:0/4016417738 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb384095ae0 con 0x7fb3840d0c70 2021-04-09T18:26:20.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb383fff700 1 --2- 172.21.15.79:0/4016417738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3840d0c70 0x7fb3840bbbe0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb3840d8f20 tx=0x7fb37c006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb36bfff700 1 -- 172.21.15.79:0/4016417738 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb384095ae0 con 0x7fb3840d0c70 2021-04-09T18:26:20.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb36bfff700 1 -- 172.21.15.79:0/4016417738 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37c01f030 con 0x7fb3840d0c70 2021-04-09T18:26:20.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb389b4d700 1 -- 172.21.15.79:0/4016417738 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3840bd730 con 0x7fb3840d0c70 2021-04-09T18:26:20.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb36bfff700 1 -- 172.21.15.79:0/4016417738 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb37c002020 con 0x7fb3840d0c70 2021-04-09T18:26:20.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb389b4d700 1 -- 172.21.15.79:0/4016417738 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb384095280 con 0x7fb3840d0c70 2021-04-09T18:26:20.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb36bfff700 1 -- 172.21.15.79:0/4016417738 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb37c02a060 con 0x7fb3840d0c70 2021-04-09T18:26:20.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb36bfff700 1 --2- 172.21.15.79:0/4016417738 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb364029100 0x7fb36402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.610 7fb36bfff700 1 -- 172.21.15.79:0/4016417738 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fb37c03b430 con 0x7fb3840d0c70 2021-04-09T18:26:20.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.614 7fb3837fe700 1 --2- 172.21.15.79:0/4016417738 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb364029100 0x7fb36402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.614 7fb3837fe700 1 --2- 172.21.15.79:0/4016417738 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb364029100 0x7fb36402b650 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.614 7fb389b4d700 1 --2- 172.21.15.79:0/4016417738 >> [v2:172.21.15.89:6802/14211,v1:172.21.15.89:6803/14211] conn(0x7fb384049150 0x7fb3840495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.614 7fb389b4d700 1 -- 172.21.15.79:0/4016417738 --> [v2:172.21.15.89:6802/14211,v1:172.21.15.89:6803/14211] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb3840e39e0 con 0x7fb384049150 2021-04-09T18:26:20.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.614 7fb382ffd700 1 --2- 172.21.15.79:0/4016417738 >> [v2:172.21.15.89:6802/14211,v1:172.21.15.89:6803/14211] conn(0x7fb384049150 0x7fb3840495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.618 7fb382ffd700 1 --2- 172.21.15.79:0/4016417738 >> [v2:172.21.15.89:6802/14211,v1:172.21.15.89:6803/14211] conn(0x7fb384049150 0x7fb3840495a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.618 7fb36bfff700 1 -- 172.21.15.79:0/4016417738 <== osd.6 v2:172.21.15.89:6802/14211 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7fb3840e39e0 con 0x7fb384049150 2021-04-09T18:26:20.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.630 7fb389b4d700 1 -- 172.21.15.79:0/4016417738 --> [v2:172.21.15.89:6802/14211,v1:172.21.15.89:6803/14211] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb3840f5b20 con 0x7fb384049150 2021-04-09T18:26:20.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.630 7fb36bfff700 1 -- 172.21.15.79:0/4016417738 <== osd.6 v2:172.21.15.89:6802/14211 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb3840f5b20 con 0x7fb384049150 2021-04-09T18:26:20.640 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2021-04-09T18:26:20.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.634 7fb389b4d700 1 -- 172.21.15.79:0/4016417738 >> [v2:172.21.15.89:6802/14211,v1:172.21.15.89:6803/14211] conn(0x7fb384049150 msgr2=0x7fb3840495a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.634 7fb389b4d700 1 --2- 172.21.15.79:0/4016417738 >> [v2:172.21.15.89:6802/14211,v1:172.21.15.89:6803/14211] conn(0x7fb384049150 0x7fb3840495a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.634 7fb389b4d700 1 -- 172.21.15.79:0/4016417738 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb364029100 msgr2=0x7fb36402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.634 7fb389b4d700 1 --2- 172.21.15.79:0/4016417738 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb364029100 0x7fb36402b650 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.634 7fb389b4d700 1 -- 172.21.15.79:0/4016417738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3840d0c70 msgr2=0x7fb3840bbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.634 7fb389b4d700 1 --2- 172.21.15.79:0/4016417738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3840d0c70 0x7fb3840bbbe0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb3840d8f20 tx=0x7fb37c006c10).stop 2021-04-09T18:26:20.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.634 7fb383fff700 1 -- 172.21.15.79:0/4016417738 reap_dead start 2021-04-09T18:26:20.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.634 7fb389b4d700 1 -- 172.21.15.79:0/4016417738 shutdown_connections 2021-04-09T18:26:20.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.634 7fb389b4d700 1 -- 172.21.15.79:0/4016417738 >> 172.21.15.79:0/4016417738 conn(0x7fb3840b9db0 msgr2=0x7fb384093980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:20.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.634 7fb389b4d700 1 -- 172.21.15.79:0/4016417738 shutdown_connections 2021-04-09T18:26:20.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.634 7fb389b4d700 1 -- 172.21.15.79:0/4016417738 wait complete. 2021-04-09T18:26:20.651 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2021-04-09T18:26:20.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f31a0fd0700 1 Processor -- start 2021-04-09T18:26:20.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f31a0fd0700 1 -- start start 2021-04-09T18:26:20.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f31a0fd0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f319c0f5520 0x7f319c0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f31a0fd0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f319c0e9ae0 0x7f319c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f31a0fd0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319c0fbb20 con 0x7f319c1c2db0 2021-04-09T18:26:20.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f31a0fd0700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319c0e9f30 con 0x7f319c0f5520 2021-04-09T18:26:20.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f31a0fd0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319c0e59d0 con 0x7f319c0e9ae0 2021-04-09T18:26:20.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f319aaef700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f319c0f5520 0x7f319c0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f319aaef700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f319c0f5520 0x7f319c0f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55778/0 (socket says 172.21.15.79:55778) 2021-04-09T18:26:20.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f319aaef700 1 -- 172.21.15.79:0/706110369 learned_addr learned my addr 172.21.15.79:0/706110369 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:20.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f319b2f0700 1 --1- 172.21.15.79:0/706110369 >> v1:172.21.15.79:6789/0 conn(0x7f319c1c2db0 0x7f319c1c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50492/0 (socket says 172.21.15.79:50492) 2021-04-09T18:26:20.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f319a2ee700 1 --2- 172.21.15.79:0/706110369 >> v2:172.21.15.89:3300/0 conn(0x7f319c0e9ae0 0x7f319c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f319aaef700 1 -- 172.21.15.79:0/706110369 >> v2:172.21.15.89:3300/0 conn(0x7f319c0e9ae0 msgr2=0x7f319c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:20.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f319aaef700 1 --2- 172.21.15.79:0/706110369 >> v2:172.21.15.89:3300/0 conn(0x7f319c0e9ae0 0x7f319c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f319aaef700 1 -- 172.21.15.79:0/706110369 >> v1:172.21.15.79:6789/0 conn(0x7f319c1c2db0 legacy=0x7f319c1c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f3199aed700 1 -- 172.21.15.79:0/706110369 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436606134 0 0) 0x7f3194001450 con 0x7f319c1c2db0 2021-04-09T18:26:20.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f319aaef700 1 -- 172.21.15.79:0/706110369 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c0e56d0 con 0x7f319c0f5520 2021-04-09T18:26:20.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f319aaef700 1 --2- 172.21.15.79:0/706110369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c0f5520 0x7f319c0f64b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f318c002f30 tx=0x7f318c00bd70).ready entity=mon.0 client_cookie=b7b078c7e6d40b6c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f3199aed700 1 -- 172.21.15.79:0/706110369 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f319c0e56d0 con 0x7f319c0f5520 2021-04-09T18:26:20.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f3199aed700 1 -- 172.21.15.79:0/706110369 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318c009950 con 0x7f319c0f5520 2021-04-09T18:26:20.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f3199aed700 1 -- 172.21.15.79:0/706110369 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f318c009d20 con 0x7f319c0f5520 2021-04-09T18:26:20.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f31a0fd0700 1 -- 172.21.15.79:0/706110369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c0f5520 msgr2=0x7f319c0f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.742 7f31a0fd0700 1 --2- 172.21.15.79:0/706110369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c0f5520 0x7f319c0f64b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f318c002f30 tx=0x7f318c00bd70).stop 2021-04-09T18:26:20.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.746 7f31a0fd0700 1 -- 172.21.15.79:0/706110369 shutdown_connections 2021-04-09T18:26:20.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.746 7f31a0fd0700 1 --2- 172.21.15.79:0/706110369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c0f5520 0x7f319c0f64b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.746 7f31a0fd0700 1 --2- 172.21.15.79:0/706110369 >> v2:172.21.15.89:3300/0 conn(0x7f319c0e9ae0 0x7f319c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.746 7f31a0fd0700 1 -- 172.21.15.79:0/706110369 >> 172.21.15.79:0/706110369 conn(0x7f319c0e5fe0 msgr2=0x7f319c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:20.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.746 7f31a0fd0700 1 -- 172.21.15.79:0/706110369 shutdown_connections 2021-04-09T18:26:20.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.746 7f31a0fd0700 1 -- 172.21.15.79:0/706110369 wait complete. 2021-04-09T18:26:20.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f31a0fd0700 1 Processor -- start 2021-04-09T18:26:20.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f31a0fd0700 1 -- start start 2021-04-09T18:26:20.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f31a0fd0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f319c0d6200 0x7f319c0aa510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f31a0fd0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c0d5790 0x7f319c094e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f31a0fd0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f319c0a9b90 0x7f319c0cf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f31a0fd0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c0d5f00 con 0x7f319c0d5790 2021-04-09T18:26:20.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f31a0fd0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c0d5be0 con 0x7f319c0a9b90 2021-04-09T18:26:20.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f31a0fd0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c095470 con 0x7f319c0d6200 2021-04-09T18:26:20.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f319a2ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c0d5790 0x7f319c094e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f319a2ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c0d5790 0x7f319c094e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55786/0 (socket says 172.21.15.79:55786) 2021-04-09T18:26:20.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f319a2ee700 1 -- 172.21.15.79:0/156875629 learned_addr learned my addr 172.21.15.79:0/156875629 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:20.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f319b2f0700 1 --2- 172.21.15.79:0/156875629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f319c0a9b90 0x7f319c0cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f319aaef700 1 --2- 172.21.15.79:0/156875629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f319c0d6200 0x7f319c0aa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f319a2ee700 1 -- 172.21.15.79:0/156875629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f319c0d6200 msgr2=0x7f319c0aa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f319a2ee700 1 --2- 172.21.15.79:0/156875629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f319c0d6200 0x7f319c0aa510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f319a2ee700 1 -- 172.21.15.79:0/156875629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f319c0a9b90 msgr2=0x7f319c0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f319a2ee700 1 --2- 172.21.15.79:0/156875629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f319c0a9b90 0x7f319c0cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f319a2ee700 1 -- 172.21.15.79:0/156875629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c0a9fe0 con 0x7f319c0d5790 2021-04-09T18:26:20.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f319a2ee700 1 --2- 172.21.15.79:0/156875629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c0d5790 0x7f319c094e40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f319c093300 tx=0x7f319000c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f318b7fe700 1 -- 172.21.15.79:0/156875629 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f319c0a9fe0 con 0x7f319c0d5790 2021-04-09T18:26:20.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f318b7fe700 1 -- 172.21.15.79:0/156875629 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319000cb90 con 0x7f319c0d5790 2021-04-09T18:26:20.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f31a0fd0700 1 -- 172.21.15.79:0/156875629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319c0cfe70 con 0x7f319c0d5790 2021-04-09T18:26:20.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f318b7fe700 1 -- 172.21.15.79:0/156875629 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f319000f040 con 0x7f319c0d5790 2021-04-09T18:26:20.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.750 7f31a0fd0700 1 -- 172.21.15.79:0/156875629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319c1a7320 con 0x7f319c0d5790 2021-04-09T18:26:20.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.754 7f318b7fe700 1 -- 172.21.15.79:0/156875629 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3190011070 con 0x7f319c0d5790 2021-04-09T18:26:20.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.754 7f318b7fe700 1 --2- 172.21.15.79:0/156875629 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3180029100 0x7f318002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.754 7f318b7fe700 1 -- 172.21.15.79:0/156875629 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f3190010040 con 0x7f319c0d5790 2021-04-09T18:26:20.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.754 7f319aaef700 1 --2- 172.21.15.79:0/156875629 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3180029100 0x7f318002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.754 7f31a0fd0700 1 --2- 172.21.15.79:0/156875629 >> [v2:172.21.15.89:6818/14233,v1:172.21.15.89:6819/14233] conn(0x7f319c0d75e0 0x7f319c1a78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.754 7f31a0fd0700 1 -- 172.21.15.79:0/156875629 --> [v2:172.21.15.89:6818/14233,v1:172.21.15.89:6819/14233] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f319c0e39e0 con 0x7f319c0d75e0 2021-04-09T18:26:20.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.754 7f319b2f0700 1 --2- 172.21.15.79:0/156875629 >> [v2:172.21.15.89:6818/14233,v1:172.21.15.89:6819/14233] conn(0x7f319c0d75e0 0x7f319c1a78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.754 7f319aaef700 1 --2- 172.21.15.79:0/156875629 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3180029100 0x7f318002b650 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.754 7f319b2f0700 1 --2- 172.21.15.79:0/156875629 >> [v2:172.21.15.89:6818/14233,v1:172.21.15.89:6819/14233] conn(0x7f319c0d75e0 0x7f319c1a78d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.754 7f318b7fe700 1 -- 172.21.15.79:0/156875629 <== osd.7 v2:172.21.15.89:6818/14233 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f319c0e39e0 con 0x7f319c0d75e0 2021-04-09T18:26:20.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.766 7f31a0fd0700 1 -- 172.21.15.79:0/156875629 --> [v2:172.21.15.89:6818/14233,v1:172.21.15.89:6819/14233] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f319c0a1cc0 con 0x7f319c0d75e0 2021-04-09T18:26:20.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.766 7f318b7fe700 1 -- 172.21.15.79:0/156875629 <== osd.7 v2:172.21.15.89:6818/14233 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f319c0a1cc0 con 0x7f319c0d75e0 2021-04-09T18:26:20.774 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2021-04-09T18:26:20.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.766 7f31a0fd0700 1 -- 172.21.15.79:0/156875629 >> [v2:172.21.15.89:6818/14233,v1:172.21.15.89:6819/14233] conn(0x7f319c0d75e0 msgr2=0x7f319c1a78d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.766 7f31a0fd0700 1 --2- 172.21.15.79:0/156875629 >> [v2:172.21.15.89:6818/14233,v1:172.21.15.89:6819/14233] conn(0x7f319c0d75e0 0x7f319c1a78d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.766 7f31a0fd0700 1 -- 172.21.15.79:0/156875629 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3180029100 msgr2=0x7f318002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.766 7f31a0fd0700 1 --2- 172.21.15.79:0/156875629 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3180029100 0x7f318002b650 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.766 7f31a0fd0700 1 -- 172.21.15.79:0/156875629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c0d5790 msgr2=0x7f319c094e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.766 7f31a0fd0700 1 --2- 172.21.15.79:0/156875629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c0d5790 0x7f319c094e40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f319c093300 tx=0x7f319000c150).stop 2021-04-09T18:26:20.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.766 7f319b2f0700 1 -- 172.21.15.79:0/156875629 reap_dead start 2021-04-09T18:26:20.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.766 7f31a0fd0700 1 -- 172.21.15.79:0/156875629 shutdown_connections 2021-04-09T18:26:20.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.766 7f31a0fd0700 1 -- 172.21.15.79:0/156875629 >> 172.21.15.79:0/156875629 conn(0x7f319c093340 msgr2=0x7f319c08ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:20.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.766 7f31a0fd0700 1 -- 172.21.15.79:0/156875629 shutdown_connections 2021-04-09T18:26:20.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.766 7f31a0fd0700 1 -- 172.21.15.79:0/156875629 wait complete. 2021-04-09T18:26:20.785 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-04-09T18:26:20.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.870 7fa20ea4e700 1 Processor -- start 2021-04-09T18:26:20.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.870 7fa20ea4e700 1 -- start start 2021-04-09T18:26:20.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.870 7fa20ea4e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2080e9ae0 0x7fa20809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.870 7fa20ea4e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2080fbb20 con 0x7fa2080f5520 2021-04-09T18:26:20.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.870 7fa20ea4e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2080e56d0 con 0x7fa2081c8010 2021-04-09T18:26:20.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.870 7fa20ea4e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2081c3dc0 con 0x7fa2080e9ae0 2021-04-09T18:26:20.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.870 7fa1ff7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2080e9ae0 0x7fa20809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.870 7fa207fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa2080f5520 0x7fa2080f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50504/0 (socket says 172.21.15.79:50504) 2021-04-09T18:26:20.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.870 7fa207fff700 1 -- 172.21.15.79:0/1380902827 learned_addr learned my addr 172.21.15.79:0/1380902827 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:20.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.870 7fa1ff7fe700 1 -- 172.21.15.79:0/1380902827 >> v1:172.21.15.89:6789/0 conn(0x7fa2081c8010 legacy=0x7fa2081ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.870 7fa1ff7fe700 1 -- 172.21.15.79:0/1380902827 >> v1:172.21.15.79:6789/0 conn(0x7fa2080f5520 legacy=0x7fa2080f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.870 7fa2077fe700 1 -- 172.21.15.79:0/1380902827 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694318521 0 0) 0x7fa1f80010d0 con 0x7fa2080f5520 2021-04-09T18:26:20.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.870 7fa1ff7fe700 1 -- 172.21.15.79:0/1380902827 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2080e4330 con 0x7fa2080e9ae0 2021-04-09T18:26:20.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.870 7fa1ff7fe700 1 --2- 172.21.15.79:0/1380902827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2080e9ae0 0x7fa20809f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fa1f0002f30 tx=0x7fa1f000bcc0).ready entity=mon.0 client_cookie=26fde83633396ce7 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.870 7fa2077fe700 1 -- 172.21.15.79:0/1380902827 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa2080e4330 con 0x7fa2080e9ae0 2021-04-09T18:26:20.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.870 7fa2077fe700 1 -- 172.21.15.79:0/1380902827 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f0009800 con 0x7fa2080e9ae0 2021-04-09T18:26:20.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.870 7fa2077fe700 1 -- 172.21.15.79:0/1380902827 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa1f0009bd0 con 0x7fa2080e9ae0 2021-04-09T18:26:20.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.870 7fa20ea4e700 1 -- 172.21.15.79:0/1380902827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2080e9ae0 msgr2=0x7fa20809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.870 7fa20ea4e700 1 --2- 172.21.15.79:0/1380902827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2080e9ae0 0x7fa20809f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fa1f0002f30 tx=0x7fa1f000bcc0).stop 2021-04-09T18:26:20.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.874 7fa20ea4e700 1 -- 172.21.15.79:0/1380902827 shutdown_connections 2021-04-09T18:26:20.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.874 7fa20ea4e700 1 --2- 172.21.15.79:0/1380902827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2080e9ae0 0x7fa20809f110 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.874 7fa20ea4e700 1 -- 172.21.15.79:0/1380902827 >> 172.21.15.79:0/1380902827 conn(0x7fa2080e5fe0 msgr2=0x7fa2080e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:20.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.874 7fa20ea4e700 1 -- 172.21.15.79:0/1380902827 shutdown_connections 2021-04-09T18:26:20.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.874 7fa20ea4e700 1 -- 172.21.15.79:0/1380902827 wait complete. 2021-04-09T18:26:20.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa20ea4e700 1 Processor -- start 2021-04-09T18:26:20.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa20ea4e700 1 -- start start 2021-04-09T18:26:20.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa20ea4e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa208094350 0x7fa2080c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa20ea4e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2080c21b0 0x7fa2081d6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa20ea4e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2081d72d0 0x7fa2081d7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa20ea4e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080e9f30 con 0x7fa208094350 2021-04-09T18:26:20.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa20ea4e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080c0300 con 0x7fa2080c21b0 2021-04-09T18:26:20.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa20ea4e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080c0600 con 0x7fa2081d72d0 2021-04-09T18:26:20.898 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa207fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa208094350 0x7fa2080c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.898 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa207fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa208094350 0x7fa2080c1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55802/0 (socket says 172.21.15.79:55802) 2021-04-09T18:26:20.898 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa207fff700 1 -- 172.21.15.79:0/485610425 learned_addr learned my addr 172.21.15.79:0/485610425 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:20.898 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa1ff7fe700 1 --2- 172.21.15.79:0/485610425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2080c21b0 0x7fa2081d6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa20cff3700 1 --2- 172.21.15.79:0/485610425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2081d72d0 0x7fa2081d7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa207fff700 1 -- 172.21.15.79:0/485610425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2081d72d0 msgr2=0x7fa2081d7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa207fff700 1 --2- 172.21.15.79:0/485610425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2081d72d0 0x7fa2081d7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa207fff700 1 -- 172.21.15.79:0/485610425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2080c21b0 msgr2=0x7fa2081d6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:20.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa207fff700 1 --2- 172.21.15.79:0/485610425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2080c21b0 0x7fa2081d6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:20.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa207fff700 1 -- 172.21.15.79:0/485610425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2080c28f0 con 0x7fa208094350 2021-04-09T18:26:20.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa20cff3700 1 --2- 172.21.15.79:0/485610425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2081d72d0 0x7fa2081d7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:20.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa207fff700 1 --2- 172.21.15.79:0/485610425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa208094350 0x7fa2080c1b80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fa2080c0280 tx=0x7fa1f800cb40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa2057fa700 1 -- 172.21.15.79:0/485610425 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa2080c28f0 con 0x7fa208094350 2021-04-09T18:26:20.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa2057fa700 1 -- 172.21.15.79:0/485610425 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f8007320 con 0x7fa208094350 2021-04-09T18:26:20.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa20ea4e700 1 -- 172.21.15.79:0/485610425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2080bfeb0 con 0x7fa208094350 2021-04-09T18:26:20.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa2057fa700 1 -- 172.21.15.79:0/485610425 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa1f80057e0 con 0x7fa208094350 2021-04-09T18:26:20.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa20ea4e700 1 -- 172.21.15.79:0/485610425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa208094930 con 0x7fa208094350 2021-04-09T18:26:20.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.878 7fa2057fa700 1 -- 172.21.15.79:0/485610425 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa1f801a060 con 0x7fa208094350 2021-04-09T18:26:20.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.882 7fa2057fa700 1 --2- 172.21.15.79:0/485610425 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa1ec029100 0x7fa1ec02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:20.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.882 7fa2057fa700 1 -- 172.21.15.79:0/485610425 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fa1f8038cd0 con 0x7fa208094350 2021-04-09T18:26:20.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.882 7fa1ff7fe700 1 --2- 172.21.15.79:0/485610425 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa1ec029100 0x7fa1ec02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:20.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.882 7fa1ff7fe700 1 --2- 172.21.15.79:0/485610425 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa1ec029100 0x7fa1ec02b650 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:20.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.882 7fa20ea4e700 1 -- 172.21.15.79:0/485610425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2080e39e0 con 0x7fa208094350 2021-04-09T18:26:20.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:20.886 7fa2057fa700 1 -- 172.21.15.79:0/485610425 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa1f8007110 con 0x7fa208094350 2021-04-09T18:26:21.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.054 7fa20ea4e700 1 -- 172.21.15.79:0/485610425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa2080a1cc0 con 0x7fa208094350 2021-04-09T18:26:21.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.054 7fa2057fa700 1 -- 172.21.15.79:0/485610425 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa1f8000bf0 con 0x7fa208094350 2021-04-09T18:26:21.064 INFO:teuthology.orchestra.run.smithi079.stdout:55834574855 2021-04-09T18:26:21.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.058 7fa20ea4e700 1 -- 172.21.15.79:0/485610425 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa1ec029100 msgr2=0x7fa1ec02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:21.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.058 7fa20ea4e700 1 --2- 172.21.15.79:0/485610425 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa1ec029100 0x7fa1ec02b650 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.058 7fa20ea4e700 1 -- 172.21.15.79:0/485610425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa208094350 msgr2=0x7fa2080c1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:21.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.058 7fa20ea4e700 1 --2- 172.21.15.79:0/485610425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa208094350 0x7fa2080c1b80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fa2080c0280 tx=0x7fa1f800cb40).stop 2021-04-09T18:26:21.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.058 7fa20ea4e700 1 -- 172.21.15.79:0/485610425 shutdown_connections 2021-04-09T18:26:21.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.058 7fa20ea4e700 1 --2- 172.21.15.79:0/485610425 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa1ec029100 0x7fa1ec02b650 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.058 7fa20ea4e700 1 --2- 172.21.15.79:0/485610425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2081d72d0 0x7fa2081d7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.058 7fa20ea4e700 1 --2- 172.21.15.79:0/485610425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa208094350 0x7fa2080c1b80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.058 7fa20ea4e700 1 --2- 172.21.15.79:0/485610425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2080c21b0 0x7fa2081d6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.058 7fa20ea4e700 1 -- 172.21.15.79:0/485610425 >> 172.21.15.79:0/485610425 conn(0x7fa208098670 msgr2=0x7fa2080a99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:21.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.058 7fa20ea4e700 1 -- 172.21.15.79:0/485610425 shutdown_connections 2021-04-09T18:26:21.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.058 7fa20ea4e700 1 -- 172.21.15.79:0/485610425 wait complete. 2021-04-09T18:26:21.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2021-04-09T18:26:21.080 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-04-09T18:26:21.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa8565b3700 1 Processor -- start 2021-04-09T18:26:21.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa8565b3700 1 -- start start 2021-04-09T18:26:21.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa8565b3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8500e9ae0 0x7fa85009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:21.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa8565b3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa8501c8010 0x7fa8501ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:21.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa8565b3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8500fbb20 con 0x7fa8500f5520 2021-04-09T18:26:21.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa8565b3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8501c3dc0 con 0x7fa8501c8010 2021-04-09T18:26:21.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa8565b3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8500e9f30 con 0x7fa8500e9ae0 2021-04-09T18:26:21.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa854b58700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa8501c8010 0x7fa8501ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:21.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa84f7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8500e9ae0 0x7fa85009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:21.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa84ffff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa8500f5520 0x7fa8500f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:50998/0 (socket says 172.21.15.79:50998) 2021-04-09T18:26:21.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa854b58700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa8501c8010 0x7fa8501ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:44164/0 (socket says 172.21.15.79:44164) 2021-04-09T18:26:21.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa84f7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8500e9ae0 0x7fa85009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:52816/0 (socket says 172.21.15.79:52816) 2021-04-09T18:26:21.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa84ffff700 1 -- 172.21.15.79:0/1972324154 learned_addr learned my addr 172.21.15.79:0/1972324154 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:21.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa84effd700 1 -- 172.21.15.79:0/1972324154 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285816772 0 0) 0x7fa8400010d0 con 0x7fa8500f5520 2021-04-09T18:26:21.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa84effd700 1 -- 172.21.15.79:0/1972324154 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa838003240 con 0x7fa8500f5520 2021-04-09T18:26:21.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa84f7fe700 1 -- 172.21.15.79:0/1972324154 >> v2:172.21.15.89:3300/0 conn(0x7fa8501c8010 msgr2=0x7fa8501ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:21.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa84f7fe700 1 --2- 172.21.15.79:0/1972324154 >> v2:172.21.15.89:3300/0 conn(0x7fa8501c8010 0x7fa8501ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa84f7fe700 1 -- 172.21.15.79:0/1972324154 >> v1:172.21.15.89:6789/0 conn(0x7fa8500f5520 legacy=0x7fa8500f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:21.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa84f7fe700 1 -- 172.21.15.79:0/1972324154 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8500e56d0 con 0x7fa8500e9ae0 2021-04-09T18:26:21.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa854b58700 1 --2- 172.21.15.79:0/1972324154 >> v2:172.21.15.89:3300/0 conn(0x7fa8501c8010 0x7fa8501ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:21.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa84f7fe700 1 --2- 172.21.15.79:0/1972324154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8500e9ae0 0x7fa85009f110 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa844002f30 tx=0x7fa84400bcc0).ready entity=mon.2 client_cookie=a47d17660f24ab66 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:21.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa84effd700 1 -- 172.21.15.79:0/1972324154 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa8500e56d0 con 0x7fa8500e9ae0 2021-04-09T18:26:21.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa84effd700 1 -- 172.21.15.79:0/1972324154 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa844009800 con 0x7fa8500e9ae0 2021-04-09T18:26:21.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa84effd700 1 -- 172.21.15.79:0/1972324154 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa844009bd0 con 0x7fa8500e9ae0 2021-04-09T18:26:21.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa8565b3700 1 -- 172.21.15.79:0/1972324154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8500e9ae0 msgr2=0x7fa85009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:21.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa8565b3700 1 --2- 172.21.15.79:0/1972324154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8500e9ae0 0x7fa85009f110 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa844002f30 tx=0x7fa84400bcc0).stop 2021-04-09T18:26:21.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa8565b3700 1 -- 172.21.15.79:0/1972324154 shutdown_connections 2021-04-09T18:26:21.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa8565b3700 1 --2- 172.21.15.79:0/1972324154 >> v2:172.21.15.89:3300/0 conn(0x7fa8501c8010 0x7fa8501ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa8565b3700 1 --2- 172.21.15.79:0/1972324154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8500e9ae0 0x7fa85009f110 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa8565b3700 1 -- 172.21.15.79:0/1972324154 >> 172.21.15.79:0/1972324154 conn(0x7fa8500e5fe0 msgr2=0x7fa8500e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:21.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa8565b3700 1 -- 172.21.15.79:0/1972324154 shutdown_connections 2021-04-09T18:26:21.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.158 7fa8565b3700 1 -- 172.21.15.79:0/1972324154 wait complete. 2021-04-09T18:26:21.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa8565b3700 1 Processor -- start 2021-04-09T18:26:21.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa8565b3700 1 -- start start 2021-04-09T18:26:21.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa8565b3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8500ba740 0x7fa8500ad820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:21.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa8565b3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8500d7a10 0x7fa8500d7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:21.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa8565b3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8500aeb10 0x7fa8500aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:21.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa8565b3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8500ba170 con 0x7fa8500ba740 2021-04-09T18:26:21.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa8565b3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8500ba470 con 0x7fa8500aeb10 2021-04-09T18:26:21.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa8565b3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8500b88f0 con 0x7fa8500d7a10 2021-04-09T18:26:21.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa84ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8500ba740 0x7fa8500ad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:21.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa84ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8500ba740 0x7fa8500ad820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55824/0 (socket says 172.21.15.79:55824) 2021-04-09T18:26:21.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa84f7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8500d7a10 0x7fa8500d7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:21.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa84ffff700 1 -- 172.21.15.79:0/596446022 learned_addr learned my addr 172.21.15.79:0/596446022 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:21.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa854b58700 1 --2- 172.21.15.79:0/596446022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8500aeb10 0x7fa8500aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:21.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa84f7fe700 1 -- 172.21.15.79:0/596446022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8500aeb10 msgr2=0x7fa8500aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:21.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa84f7fe700 1 --2- 172.21.15.79:0/596446022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8500aeb10 0x7fa8500aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa84f7fe700 1 -- 172.21.15.79:0/596446022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8500ba740 msgr2=0x7fa8500ad820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:21.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa84f7fe700 1 --2- 172.21.15.79:0/596446022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8500ba740 0x7fa8500ad820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa84f7fe700 1 -- 172.21.15.79:0/596446022 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8500b9d00 con 0x7fa8500d7a10 2021-04-09T18:26:21.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa84ffff700 1 --2- 172.21.15.79:0/596446022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8500ba740 0x7fa8500ad820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:21.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa84f7fe700 1 --2- 172.21.15.79:0/596446022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8500d7a10 0x7fa8500d7e60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fa8501a3220 tx=0x7fa844006890).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:21.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa84cff9700 1 -- 172.21.15.79:0/596446022 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa8500b9d00 con 0x7fa8500d7a10 2021-04-09T18:26:21.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa84cff9700 1 -- 172.21.15.79:0/596446022 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa844009e20 con 0x7fa8500d7a10 2021-04-09T18:26:21.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa8565b3700 1 -- 172.21.15.79:0/596446022 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8500af590 con 0x7fa8500d7a10 2021-04-09T18:26:21.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa84cff9700 1 -- 172.21.15.79:0/596446022 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa84401d440 con 0x7fa8500d7a10 2021-04-09T18:26:21.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.162 7fa8565b3700 1 -- 172.21.15.79:0/596446022 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8501b13f0 con 0x7fa8500d7a10 2021-04-09T18:26:21.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.166 7fa84cff9700 1 -- 172.21.15.79:0/596446022 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa844026450 con 0x7fa8500d7a10 2021-04-09T18:26:21.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.166 7fa84cff9700 1 --2- 172.21.15.79:0/596446022 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa830029100 0x7fa83002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:21.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.166 7fa84cff9700 1 -- 172.21.15.79:0/596446022 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fa84403a6c0 con 0x7fa8500d7a10 2021-04-09T18:26:21.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.166 7fa84ffff700 1 --2- 172.21.15.79:0/596446022 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa830029100 0x7fa83002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:21.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.166 7fa84ffff700 1 --2- 172.21.15.79:0/596446022 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa830029100 0x7fa83002b650 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:21.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.174 7fa8565b3700 1 -- 172.21.15.79:0/596446022 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8500e39e0 con 0x7fa8500d7a10 2021-04-09T18:26:21.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.178 7fa84cff9700 1 -- 172.21.15.79:0/596446022 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa8440095f0 con 0x7fa8500d7a10 2021-04-09T18:26:21.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.350 7fa8565b3700 1 -- 172.21.15.79:0/596446022 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa8500a1cc0 con 0x7fa8500d7a10 2021-04-09T18:26:21.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.350 7fa84cff9700 1 -- 172.21.15.79:0/596446022 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa844011a40 con 0x7fa8500d7a10 2021-04-09T18:26:21.358 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2021-04-09T18:26:21.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.354 7fa8565b3700 1 -- 172.21.15.79:0/596446022 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa830029100 msgr2=0x7fa83002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:21.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.354 7fa8565b3700 1 --2- 172.21.15.79:0/596446022 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa830029100 0x7fa83002b650 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.354 7fa8565b3700 1 -- 172.21.15.79:0/596446022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8500d7a10 msgr2=0x7fa8500d7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:21.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.354 7fa8565b3700 1 --2- 172.21.15.79:0/596446022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8500d7a10 0x7fa8500d7e60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fa8501a3220 tx=0x7fa844006890).stop 2021-04-09T18:26:21.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.354 7fa8565b3700 1 -- 172.21.15.79:0/596446022 shutdown_connections 2021-04-09T18:26:21.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.354 7fa8565b3700 1 --2- 172.21.15.79:0/596446022 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa830029100 0x7fa83002b650 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.354 7fa8565b3700 1 --2- 172.21.15.79:0/596446022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8500aeb10 0x7fa8500aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.354 7fa8565b3700 1 --2- 172.21.15.79:0/596446022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8500ba740 0x7fa8500ad820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.354 7fa8565b3700 1 --2- 172.21.15.79:0/596446022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8500d7a10 0x7fa8500d7e60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.354 7fa8565b3700 1 -- 172.21.15.79:0/596446022 >> 172.21.15.79:0/596446022 conn(0x7fa85009a250 msgr2=0x7fa8500adfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:21.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.354 7fa8565b3700 1 -- 172.21.15.79:0/596446022 shutdown_connections 2021-04-09T18:26:21.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.354 7fa8565b3700 1 -- 172.21.15.79:0/596446022 wait complete. 2021-04-09T18:26:21.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2021-04-09T18:26:21.371 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2021-04-09T18:26:21.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.458 7fc8f17e5700 1 Processor -- start 2021-04-09T18:26:21.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.458 7fc8f17e5700 1 -- start start 2021-04-09T18:26:21.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.458 7fc8f17e5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8ec0e9ae0 0x7fc8ec09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:21.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.458 7fc8f17e5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc8ec1c8010 0x7fc8ec1ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:21.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.458 7fc8f17e5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8ec0fbb20 con 0x7fc8ec0f5520 2021-04-09T18:26:21.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.458 7fc8f17e5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8ec1c3dc0 con 0x7fc8ec1c8010 2021-04-09T18:26:21.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.458 7fc8f17e5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0e9f30 con 0x7fc8ec0e9ae0 2021-04-09T18:26:21.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.458 7fc8ebd51700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc8ec1c8010 0x7fc8ec1ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:21.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.458 7fc8ebd51700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc8ec1c8010 0x7fc8ec1ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55834/0 (socket says 172.21.15.79:55834) 2021-04-09T18:26:21.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.458 7fc8ebd51700 1 -- 172.21.15.79:0/2607154196 learned_addr learned my addr 172.21.15.79:0/2607154196 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:21.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.458 7fc8ead4f700 1 --2- 172.21.15.79:0/2607154196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8ec0e9ae0 0x7fc8ec09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:21.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.462 7fc8ebd51700 1 -- 172.21.15.79:0/2607154196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8ec0e9ae0 msgr2=0x7fc8ec09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:21.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.462 7fc8ebd51700 1 --2- 172.21.15.79:0/2607154196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8ec0e9ae0 0x7fc8ec09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.462 7fc8ebd51700 1 -- 172.21.15.79:0/2607154196 >> v1:172.21.15.89:6789/0 conn(0x7fc8ec0f5520 legacy=0x7fc8ec0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:21.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.462 7fc8ebd51700 1 -- 172.21.15.79:0/2607154196 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec0e56d0 con 0x7fc8ec1c8010 2021-04-09T18:26:21.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.462 7fc8ebd51700 1 --2- 172.21.15.79:0/2607154196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8ec1c8010 0x7fc8ec1ca470 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fc8e4002f30 tx=0x7fc8e400bda0).ready entity=mon.0 client_cookie=1f705fdb178969da server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:21.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.462 7fc8ea54e700 1 -- 172.21.15.79:0/2607154196 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc8ec0e56d0 con 0x7fc8ec1c8010 2021-04-09T18:26:21.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.462 7fc8ea54e700 1 -- 172.21.15.79:0/2607154196 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e40099d0 con 0x7fc8ec1c8010 2021-04-09T18:26:21.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.462 7fc8ea54e700 1 -- 172.21.15.79:0/2607154196 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc8e4009da0 con 0x7fc8ec1c8010 2021-04-09T18:26:21.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.462 7fc8f17e5700 1 -- 172.21.15.79:0/2607154196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8ec1c8010 msgr2=0x7fc8ec1ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:21.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.462 7fc8f17e5700 1 --2- 172.21.15.79:0/2607154196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8ec1c8010 0x7fc8ec1ca470 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fc8e4002f30 tx=0x7fc8e400bda0).stop 2021-04-09T18:26:21.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.462 7fc8f17e5700 1 -- 172.21.15.79:0/2607154196 shutdown_connections 2021-04-09T18:26:21.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.462 7fc8f17e5700 1 --2- 172.21.15.79:0/2607154196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8ec1c8010 0x7fc8ec1ca470 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.462 7fc8f17e5700 1 --2- 172.21.15.79:0/2607154196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8ec0e9ae0 0x7fc8ec09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.462 7fc8f17e5700 1 -- 172.21.15.79:0/2607154196 >> 172.21.15.79:0/2607154196 conn(0x7fc8ec0e5fe0 msgr2=0x7fc8ec0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:21.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.462 7fc8f17e5700 1 -- 172.21.15.79:0/2607154196 shutdown_connections 2021-04-09T18:26:21.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.462 7fc8f17e5700 1 -- 172.21.15.79:0/2607154196 wait complete. 2021-04-09T18:26:21.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.466 7fc8f17e5700 1 Processor -- start 2021-04-09T18:26:21.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.466 7fc8f17e5700 1 -- start start 2021-04-09T18:26:21.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.466 7fc8f17e5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8ec0ae8d0 0x7fc8ec0baea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:21.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.466 7fc8f17e5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8ec0ac8c0 0x7fc8ec0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.466 7fc8f17e5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8ec0ac0d0 0x7fc8ec0d4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.466 7fc8f17e5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0e8af0 con 0x7fc8ec0ac0d0 2021-04-09T18:26:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.466 7fc8f17e5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0ad030 con 0x7fc8ec0ac8c0 2021-04-09T18:26:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.466 7fc8f17e5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0ad330 con 0x7fc8ec0ae8d0 2021-04-09T18:26:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.466 7fc8ebd51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8ec0ac0d0 0x7fc8ec0d4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.466 7fc8ebd51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8ec0ac0d0 0x7fc8ec0d4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55842/0 (socket says 172.21.15.79:55842) 2021-04-09T18:26:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.466 7fc8ebd51700 1 -- 172.21.15.79:0/3799976976 learned_addr learned my addr 172.21.15.79:0/3799976976 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.466 7fc8ead4f700 1 --2- 172.21.15.79:0/3799976976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8ec0ac8c0 0x7fc8ec0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.466 7fc8eb550700 1 --2- 172.21.15.79:0/3799976976 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8ec0ae8d0 0x7fc8ec0baea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.466 7fc8ebd51700 1 -- 172.21.15.79:0/3799976976 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8ec0ae8d0 msgr2=0x7fc8ec0baea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:21.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.466 7fc8ebd51700 1 --2- 172.21.15.79:0/3799976976 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8ec0ae8d0 0x7fc8ec0baea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.466 7fc8ebd51700 1 -- 172.21.15.79:0/3799976976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8ec0ac8c0 msgr2=0x7fc8ec0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:21.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.466 7fc8ebd51700 1 --2- 172.21.15.79:0/3799976976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8ec0ac8c0 0x7fc8ec0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.470 7fc8ebd51700 1 -- 172.21.15.79:0/3799976976 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec0affe0 con 0x7fc8ec0ac0d0 2021-04-09T18:26:21.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.470 7fc8ebd51700 1 --2- 172.21.15.79:0/3799976976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8ec0ac0d0 0x7fc8ec0d4e50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fc8ec0961b0 tx=0x7fc8e4006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:21.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.470 7fc8d3fff700 1 -- 172.21.15.79:0/3799976976 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc8ec0affe0 con 0x7fc8ec0ac0d0 2021-04-09T18:26:21.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.470 7fc8d3fff700 1 -- 172.21.15.79:0/3799976976 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e4011cc0 con 0x7fc8ec0ac0d0 2021-04-09T18:26:21.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.470 7fc8d3fff700 1 -- 172.21.15.79:0/3799976976 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc8e401d630 con 0x7fc8ec0ac0d0 2021-04-09T18:26:21.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.470 7fc8f17e5700 1 -- 172.21.15.79:0/3799976976 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ec0afc00 con 0x7fc8ec0ac0d0 2021-04-09T18:26:21.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.470 7fc8f17e5700 1 -- 172.21.15.79:0/3799976976 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ec0d5480 con 0x7fc8ec0ac0d0 2021-04-09T18:26:21.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.470 7fc8d3fff700 1 -- 172.21.15.79:0/3799976976 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc8e401d830 con 0x7fc8ec0ac0d0 2021-04-09T18:26:21.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.470 7fc8d3fff700 1 --2- 172.21.15.79:0/3799976976 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc8cc029100 0x7fc8cc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:21.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.470 7fc8d3fff700 1 -- 172.21.15.79:0/3799976976 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fc8e403b790 con 0x7fc8ec0ac0d0 2021-04-09T18:26:21.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.470 7fc8eb550700 1 --2- 172.21.15.79:0/3799976976 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc8cc029100 0x7fc8cc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:21.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.470 7fc8eb550700 1 --2- 172.21.15.79:0/3799976976 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc8cc029100 0x7fc8cc02b650 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:21.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.474 7fc8f17e5700 1 -- 172.21.15.79:0/3799976976 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8ec0e39e0 con 0x7fc8ec0ac0d0 2021-04-09T18:26:21.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.478 7fc8d3fff700 1 -- 172.21.15.79:0/3799976976 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc8e4011ab0 con 0x7fc8ec0ac0d0 2021-04-09T18:26:21.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.654 7fc8f17e5700 1 -- 172.21.15.79:0/3799976976 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc8ec0f5b20 con 0x7fc8ec0ac0d0 2021-04-09T18:26:21.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.654 7fc8d3fff700 1 -- 172.21.15.79:0/3799976976 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc8e40097c0 con 0x7fc8ec0ac0d0 2021-04-09T18:26:21.662 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2021-04-09T18:26:21.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.658 7fc8f17e5700 1 -- 172.21.15.79:0/3799976976 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc8cc029100 msgr2=0x7fc8cc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:21.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.658 7fc8f17e5700 1 --2- 172.21.15.79:0/3799976976 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc8cc029100 0x7fc8cc02b650 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.658 7fc8f17e5700 1 -- 172.21.15.79:0/3799976976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8ec0ac0d0 msgr2=0x7fc8ec0d4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:21.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.658 7fc8f17e5700 1 --2- 172.21.15.79:0/3799976976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8ec0ac0d0 0x7fc8ec0d4e50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fc8ec0961b0 tx=0x7fc8e4006890).stop 2021-04-09T18:26:21.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.658 7fc8f17e5700 1 -- 172.21.15.79:0/3799976976 shutdown_connections 2021-04-09T18:26:21.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.658 7fc8f17e5700 1 --2- 172.21.15.79:0/3799976976 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc8cc029100 0x7fc8cc02b650 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.658 7fc8f17e5700 1 --2- 172.21.15.79:0/3799976976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8ec0ac0d0 0x7fc8ec0d4e50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.658 7fc8f17e5700 1 --2- 172.21.15.79:0/3799976976 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8ec0ae8d0 0x7fc8ec0baea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.658 7fc8f17e5700 1 --2- 172.21.15.79:0/3799976976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8ec0ac8c0 0x7fc8ec0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:21.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.658 7fc8f17e5700 1 -- 172.21.15.79:0/3799976976 >> 172.21.15.79:0/3799976976 conn(0x7fc8ec1a14a0 msgr2=0x7fc8ec0957e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:21.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.658 7fc8f17e5700 1 -- 172.21.15.79:0/3799976976 shutdown_connections 2021-04-09T18:26:21.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:21.658 7fc8f17e5700 1 -- 172.21.15.79:0/3799976976 wait complete. 2021-04-09T18:26:21.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2021-04-09T18:26:22.674 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2021-04-09T18:26:22.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.770 7fd1e4950700 1 Processor -- start 2021-04-09T18:26:22.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.770 7fd1e4950700 1 -- start start 2021-04-09T18:26:22.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.770 7fd1e4950700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd1e00e9ae0 0x7fd1e009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:22.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.770 7fd1e4950700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1e01c8010 0x7fd1e01ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:22.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.770 7fd1e4950700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e00fbb20 con 0x7fd1e00f5520 2021-04-09T18:26:22.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.770 7fd1e4950700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e01c3dc0 con 0x7fd1e00e9ae0 2021-04-09T18:26:22.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.770 7fd1e4950700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00e9f30 con 0x7fd1e01c8010 2021-04-09T18:26:22.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.770 7fd1ddda3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd1e00e9ae0 0x7fd1e009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:22.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.770 7fd1ddda3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd1e00e9ae0 0x7fd1e009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55850/0 (socket says 172.21.15.79:55850) 2021-04-09T18:26:22.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.770 7fd1de5a4700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd1e00f5520 0x7fd1e00f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50556/0 (socket says 172.21.15.79:50556) 2021-04-09T18:26:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.770 7fd1ddda3700 1 -- 172.21.15.79:0/4047208449 learned_addr learned my addr 172.21.15.79:0/4047208449 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.774 7fd1deda5700 1 --2- 172.21.15.79:0/4047208449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1e01c8010 0x7fd1e01ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.774 7fd1ddda3700 1 -- 172.21.15.79:0/4047208449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1e01c8010 msgr2=0x7fd1e01ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.774 7fd1ddda3700 1 --2- 172.21.15.79:0/4047208449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1e01c8010 0x7fd1e01ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.774 7fd1ddda3700 1 -- 172.21.15.79:0/4047208449 >> v1:172.21.15.79:6789/0 conn(0x7fd1e00f5520 legacy=0x7fd1e00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.774 7fd1ddda3700 1 -- 172.21.15.79:0/4047208449 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e00e56d0 con 0x7fd1e00e9ae0 2021-04-09T18:26:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.774 7fd1dd5a2700 1 -- 172.21.15.79:0/4047208449 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485751150 0 0) 0x7fd1d00010d0 con 0x7fd1e00f5520 2021-04-09T18:26:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.774 7fd1ddda3700 1 --2- 172.21.15.79:0/4047208449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e00e9ae0 0x7fd1e009f110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd1e00f6f00 tx=0x7fd1c800bdd0).ready entity=mon.0 client_cookie=a05a67df1d4bd522 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.774 7fd1dd5a2700 1 -- 172.21.15.79:0/4047208449 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1e00e56d0 con 0x7fd1e00e9ae0 2021-04-09T18:26:22.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.774 7fd1dd5a2700 1 -- 172.21.15.79:0/4047208449 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c8009990 con 0x7fd1e00e9ae0 2021-04-09T18:26:22.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.774 7fd1dd5a2700 1 -- 172.21.15.79:0/4047208449 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1c8009d60 con 0x7fd1e00e9ae0 2021-04-09T18:26:22.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.774 7fd1e4950700 1 -- 172.21.15.79:0/4047208449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e00e9ae0 msgr2=0x7fd1e009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:22.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.774 7fd1e4950700 1 --2- 172.21.15.79:0/4047208449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e00e9ae0 0x7fd1e009f110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd1e00f6f00 tx=0x7fd1c800bdd0).stop 2021-04-09T18:26:22.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.774 7fd1e4950700 1 -- 172.21.15.79:0/4047208449 shutdown_connections 2021-04-09T18:26:22.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.774 7fd1e4950700 1 --2- 172.21.15.79:0/4047208449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1e01c8010 0x7fd1e01ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:22.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.774 7fd1e4950700 1 --2- 172.21.15.79:0/4047208449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e00e9ae0 0x7fd1e009f110 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:22.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.774 7fd1e4950700 1 -- 172.21.15.79:0/4047208449 >> 172.21.15.79:0/4047208449 conn(0x7fd1e00e5fe0 msgr2=0x7fd1e00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:22.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.774 7fd1e4950700 1 -- 172.21.15.79:0/4047208449 shutdown_connections 2021-04-09T18:26:22.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.774 7fd1e4950700 1 -- 172.21.15.79:0/4047208449 wait complete. 2021-04-09T18:26:22.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.778 7fd1e4950700 1 Processor -- start 2021-04-09T18:26:22.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.778 7fd1e4950700 1 -- start start 2021-04-09T18:26:22.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.778 7fd1e4950700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1e00b71c0 0x7fd1e00c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:22.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.778 7fd1e4950700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1e0098b90 0x7fd1e009a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:22.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.778 7fd1e4950700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0098fe0 0x7fd1e00c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:22.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.778 7fd1e4950700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00b79f0 con 0x7fd1e0098fe0 2021-04-09T18:26:22.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.778 7fd1e4950700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e009ab30 con 0x7fd1e00b71c0 2021-04-09T18:26:22.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.778 7fd1e4950700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00b7610 con 0x7fd1e0098b90 2021-04-09T18:26:22.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.778 7fd1deda5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0098fe0 0x7fd1e00c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:22.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.778 7fd1deda5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0098fe0 0x7fd1e00c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55856/0 (socket says 172.21.15.79:55856) 2021-04-09T18:26:22.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.778 7fd1deda5700 1 -- 172.21.15.79:0/3834218584 learned_addr learned my addr 172.21.15.79:0/3834218584 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:22.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.778 7fd1ddda3700 1 --2- 172.21.15.79:0/3834218584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1e0098b90 0x7fd1e009a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:22.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.778 7fd1de5a4700 1 --2- 172.21.15.79:0/3834218584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1e00b71c0 0x7fd1e00c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:22.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.778 7fd1deda5700 1 -- 172.21.15.79:0/3834218584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1e0098b90 msgr2=0x7fd1e009a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:22.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.778 7fd1deda5700 1 --2- 172.21.15.79:0/3834218584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1e0098b90 0x7fd1e009a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:22.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.778 7fd1deda5700 1 -- 172.21.15.79:0/3834218584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1e00b71c0 msgr2=0x7fd1e00c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:22.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.778 7fd1deda5700 1 --2- 172.21.15.79:0/3834218584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1e00b71c0 0x7fd1e00c18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:22.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.778 7fd1deda5700 1 -- 172.21.15.79:0/3834218584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e00b7cf0 con 0x7fd1e0098fe0 2021-04-09T18:26:22.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.778 7fd1deda5700 1 --2- 172.21.15.79:0/3834218584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0098fe0 0x7fd1e00c68d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fd1e00d8410 tx=0x7fd1d800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:22.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.782 7fd1d6ffd700 1 -- 172.21.15.79:0/3834218584 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1e00b7cf0 con 0x7fd1e0098fe0 2021-04-09T18:26:22.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.782 7fd1d6ffd700 1 -- 172.21.15.79:0/3834218584 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d800cca0 con 0x7fd1e0098fe0 2021-04-09T18:26:22.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.782 7fd1e4950700 1 -- 172.21.15.79:0/3834218584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e009a6d0 con 0x7fd1e0098fe0 2021-04-09T18:26:22.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.782 7fd1d6ffd700 1 -- 172.21.15.79:0/3834218584 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1d800f040 con 0x7fd1e0098fe0 2021-04-09T18:26:22.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.782 7fd1e4950700 1 -- 172.21.15.79:0/3834218584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e0099910 con 0x7fd1e0098fe0 2021-04-09T18:26:22.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.782 7fd1d6ffd700 1 -- 172.21.15.79:0/3834218584 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd1d8022060 con 0x7fd1e0098fe0 2021-04-09T18:26:22.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.782 7fd1d6ffd700 1 --2- 172.21.15.79:0/3834218584 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd1b8029100 0x7fd1b802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:22.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.782 7fd1d6ffd700 1 -- 172.21.15.79:0/3834218584 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fd1d8010040 con 0x7fd1e0098fe0 2021-04-09T18:26:22.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.782 7fd1de5a4700 1 --2- 172.21.15.79:0/3834218584 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd1b8029100 0x7fd1b802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:22.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.782 7fd1de5a4700 1 --2- 172.21.15.79:0/3834218584 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd1b8029100 0x7fd1b802b650 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:22.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.786 7fd1e4950700 1 -- 172.21.15.79:0/3834218584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e00e39e0 con 0x7fd1e0098fe0 2021-04-09T18:26:22.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.794 7fd1d6ffd700 1 -- 172.21.15.79:0/3834218584 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd1e00f76c0 con 0x7fd1e0098fe0 2021-04-09T18:26:22.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.970 7fd1e4950700 1 -- 172.21.15.79:0/3834218584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd1e00a1cc0 con 0x7fd1e0098fe0 2021-04-09T18:26:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.970 7fd1d6ffd700 1 -- 172.21.15.79:0/3834218584 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd1d800ca90 con 0x7fd1e0098fe0 2021-04-09T18:26:22.980 INFO:teuthology.orchestra.run.smithi079.stdout:55834574855 2021-04-09T18:26:22.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.974 7fd1e4950700 1 -- 172.21.15.79:0/3834218584 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd1b8029100 msgr2=0x7fd1b802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:22.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.974 7fd1e4950700 1 --2- 172.21.15.79:0/3834218584 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd1b8029100 0x7fd1b802b650 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:22.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.974 7fd1e4950700 1 -- 172.21.15.79:0/3834218584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0098fe0 msgr2=0x7fd1e00c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:22.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.974 7fd1e4950700 1 --2- 172.21.15.79:0/3834218584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0098fe0 0x7fd1e00c68d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fd1e00d8410 tx=0x7fd1d800c430).stop 2021-04-09T18:26:22.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.974 7fd1e4950700 1 -- 172.21.15.79:0/3834218584 shutdown_connections 2021-04-09T18:26:22.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.974 7fd1e4950700 1 --2- 172.21.15.79:0/3834218584 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd1b8029100 0x7fd1b802b650 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:22.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.974 7fd1e4950700 1 --2- 172.21.15.79:0/3834218584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1e00b71c0 0x7fd1e00c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:22.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.974 7fd1e4950700 1 --2- 172.21.15.79:0/3834218584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0098fe0 0x7fd1e00c68d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:22.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.974 7fd1e4950700 1 --2- 172.21.15.79:0/3834218584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1e0098b90 0x7fd1e009a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:22.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.974 7fd1e4950700 1 -- 172.21.15.79:0/3834218584 >> 172.21.15.79:0/3834218584 conn(0x7fd1e00a24c0 msgr2=0x7fd1e00d8510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:22.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.974 7fd1e4950700 1 -- 172.21.15.79:0/3834218584 shutdown_connections 2021-04-09T18:26:22.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:22.974 7fd1e4950700 1 -- 172.21.15.79:0/3834218584 wait complete. 2021-04-09T18:26:22.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2021-04-09T18:26:22.993 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2021-04-09T18:26:23.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.078 7f3a28066700 1 Processor -- start 2021-04-09T18:26:23.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.078 7f3a28066700 1 -- start start 2021-04-09T18:26:23.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.078 7f3a28066700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3a201c9020 0x7f3a201cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.078 7f3a28066700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a200fbb20 con 0x7f3a200e9ae0 2021-04-09T18:26:23.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.078 7f3a28066700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2009f910 con 0x7f3a200f5520 2021-04-09T18:26:23.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.078 7f3a28066700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a201c3dc0 con 0x7f3a201c9020 2021-04-09T18:26:23.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.078 7f3a25609700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3a200e9ae0 0x7f3a2009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50572/0 (socket says 172.21.15.79:50572) 2021-04-09T18:26:23.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.078 7f3a25609700 1 -- 172.21.15.79:0/801515175 learned_addr learned my addr 172.21.15.79:0/801515175 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:23.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.078 7f3a2660b700 1 --2- 172.21.15.79:0/801515175 >> v2:172.21.15.89:3300/0 conn(0x7f3a201c9020 0x7f3a201cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.078 7f3a24e08700 1 -- 172.21.15.79:0/801515175 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575692893 0 0) 0x7f3a1c0010d0 con 0x7f3a200e9ae0 2021-04-09T18:26:23.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.078 7f3a24e08700 1 -- 172.21.15.79:0/801515175 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a08003240 con 0x7f3a200e9ae0 2021-04-09T18:26:23.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.082 7f3a24e08700 1 -- 172.21.15.79:0/801515175 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2031669531 0 0) 0x7f3a1c001650 con 0x7f3a200e9ae0 2021-04-09T18:26:23.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.082 7f3a2660b700 1 -- 172.21.15.79:0/801515175 >> v1:172.21.15.89:6789/0 conn(0x7f3a200f5520 legacy=0x7f3a200f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.082 7f3a2660b700 1 -- 172.21.15.79:0/801515175 >> v1:172.21.15.79:6789/0 conn(0x7f3a200e9ae0 legacy=0x7f3a2009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.082 7f3a2660b700 1 -- 172.21.15.79:0/801515175 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a200e56d0 con 0x7f3a201c9020 2021-04-09T18:26:23.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.082 7f3a2660b700 1 --2- 172.21.15.79:0/801515175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a201c9020 0x7f3a201cb480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f3a1c001db0 tx=0x7f3a1800b0e0).ready entity=mon.1 client_cookie=e8a5b1dd89ed834d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:23.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.082 7f3a24e08700 1 -- 172.21.15.79:0/801515175 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a200e56d0 con 0x7f3a201c9020 2021-04-09T18:26:23.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.082 7f3a24e08700 1 -- 172.21.15.79:0/801515175 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1800b9b0 con 0x7f3a201c9020 2021-04-09T18:26:23.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.082 7f3a24e08700 1 -- 172.21.15.79:0/801515175 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a18002020 con 0x7f3a201c9020 2021-04-09T18:26:23.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.082 7f3a28066700 1 -- 172.21.15.79:0/801515175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a201c9020 msgr2=0x7f3a201cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.082 7f3a28066700 1 --2- 172.21.15.79:0/801515175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a201c9020 0x7f3a201cb480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f3a1c001db0 tx=0x7f3a1800b0e0).stop 2021-04-09T18:26:23.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.082 7f3a28066700 1 -- 172.21.15.79:0/801515175 shutdown_connections 2021-04-09T18:26:23.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.082 7f3a28066700 1 --2- 172.21.15.79:0/801515175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a201c9020 0x7f3a201cb480 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.082 7f3a28066700 1 -- 172.21.15.79:0/801515175 >> 172.21.15.79:0/801515175 conn(0x7f3a200e5fe0 msgr2=0x7f3a200e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:23.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.082 7f3a28066700 1 -- 172.21.15.79:0/801515175 shutdown_connections 2021-04-09T18:26:23.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.082 7f3a28066700 1 -- 172.21.15.79:0/801515175 wait complete. 2021-04-09T18:26:23.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a28066700 1 Processor -- start 2021-04-09T18:26:23.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a28066700 1 -- start start 2021-04-09T18:26:23.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a28066700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a200c4de0 0x7f3a200a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a28066700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a200c3d40 0x7f3a200c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a28066700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a200d5130 0x7f3a200d5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a28066700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a200e9f30 con 0x7f3a200c3d40 2021-04-09T18:26:23.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a28066700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a200c27a0 con 0x7f3a200d5130 2021-04-09T18:26:23.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a28066700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a200c5230 con 0x7f3a200c4de0 2021-04-09T18:26:23.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a25609700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a200c3d40 0x7f3a200c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a25609700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a200c3d40 0x7f3a200c4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55866/0 (socket says 172.21.15.79:55866) 2021-04-09T18:26:23.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a25609700 1 -- 172.21.15.79:0/2779870595 learned_addr learned my addr 172.21.15.79:0/2779870595 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:23.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a2660b700 1 --2- 172.21.15.79:0/2779870595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a200d5130 0x7f3a200d5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a25e0a700 1 --2- 172.21.15.79:0/2779870595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a200c4de0 0x7f3a200a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a25609700 1 -- 172.21.15.79:0/2779870595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a200c4de0 msgr2=0x7f3a200a3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a25609700 1 --2- 172.21.15.79:0/2779870595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a200c4de0 0x7f3a200a3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a25609700 1 -- 172.21.15.79:0/2779870595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a200d5130 msgr2=0x7f3a200d5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a25609700 1 --2- 172.21.15.79:0/2779870595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a200d5130 0x7f3a200d5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a25609700 1 -- 172.21.15.79:0/2779870595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a200a44a0 con 0x7f3a200c3d40 2021-04-09T18:26:23.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a25609700 1 --2- 172.21.15.79:0/2779870595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a200c3d40 0x7f3a200c4190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f3a200d8330 tx=0x7f3a1c00ded0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:23.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a167fc700 1 -- 172.21.15.79:0/2779870595 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a200a44a0 con 0x7f3a200c3d40 2021-04-09T18:26:23.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a167fc700 1 -- 172.21.15.79:0/2779870595 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1c008170 con 0x7f3a200c3d40 2021-04-09T18:26:23.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a167fc700 1 -- 172.21.15.79:0/2779870595 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a1c004e70 con 0x7f3a200c3d40 2021-04-09T18:26:23.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a28066700 1 -- 172.21.15.79:0/2779870595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a200b7c40 con 0x7f3a200c3d40 2021-04-09T18:26:23.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.086 7f3a28066700 1 -- 172.21.15.79:0/2779870595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a200c5a00 con 0x7f3a200c3d40 2021-04-09T18:26:23.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.090 7f3a167fc700 1 -- 172.21.15.79:0/2779870595 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3a1c0143c0 con 0x7f3a200c3d40 2021-04-09T18:26:23.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.090 7f3a167fc700 1 --2- 172.21.15.79:0/2779870595 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a00029100 0x7f3a0002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.090 7f3a167fc700 1 -- 172.21.15.79:0/2779870595 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f3a1c039350 con 0x7f3a200c3d40 2021-04-09T18:26:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.090 7f3a25e0a700 1 --2- 172.21.15.79:0/2779870595 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a00029100 0x7f3a0002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.090 7f3a25e0a700 1 --2- 172.21.15.79:0/2779870595 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a00029100 0x7f3a0002b650 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.094 7f3a28066700 1 -- 172.21.15.79:0/2779870595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a200e39e0 con 0x7f3a200c3d40 2021-04-09T18:26:23.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.098 7f3a167fc700 1 -- 172.21.15.79:0/2779870595 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3a1c000bf0 con 0x7f3a200c3d40 2021-04-09T18:26:23.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.270 7f3a28066700 1 -- 172.21.15.79:0/2779870595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3a200a3ee0 con 0x7f3a200c3d40 2021-04-09T18:26:23.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.270 7f3a167fc700 1 -- 172.21.15.79:0/2779870595 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3a1c004c60 con 0x7f3a200c3d40 2021-04-09T18:26:23.279 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2021-04-09T18:26:23.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.274 7f3a28066700 1 -- 172.21.15.79:0/2779870595 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a00029100 msgr2=0x7f3a0002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.274 7f3a28066700 1 --2- 172.21.15.79:0/2779870595 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a00029100 0x7f3a0002b650 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.274 7f3a28066700 1 -- 172.21.15.79:0/2779870595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a200c3d40 msgr2=0x7f3a200c4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.274 7f3a28066700 1 --2- 172.21.15.79:0/2779870595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a200c3d40 0x7f3a200c4190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f3a200d8330 tx=0x7f3a1c00ded0).stop 2021-04-09T18:26:23.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.274 7f3a28066700 1 -- 172.21.15.79:0/2779870595 shutdown_connections 2021-04-09T18:26:23.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.274 7f3a28066700 1 --2- 172.21.15.79:0/2779870595 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a00029100 0x7f3a0002b650 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.274 7f3a28066700 1 --2- 172.21.15.79:0/2779870595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a200d5130 0x7f3a200d5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.274 7f3a28066700 1 --2- 172.21.15.79:0/2779870595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a200c4de0 0x7f3a200a3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.274 7f3a28066700 1 --2- 172.21.15.79:0/2779870595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a200c3d40 0x7f3a200c4190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.274 7f3a28066700 1 -- 172.21.15.79:0/2779870595 >> 172.21.15.79:0/2779870595 conn(0x7f3a200a24c0 msgr2=0x7f3a200d8430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:23.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.274 7f3a28066700 1 -- 172.21.15.79:0/2779870595 shutdown_connections 2021-04-09T18:26:23.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.274 7f3a28066700 1 -- 172.21.15.79:0/2779870595 wait complete. 2021-04-09T18:26:23.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2021-04-09T18:26:23.291 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2021-04-09T18:26:23.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce23975700 1 Processor -- start 2021-04-09T18:26:23.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce23975700 1 -- start start 2021-04-09T18:26:23.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce23975700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fce1c0f5520 0x7fce1c0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce23975700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fce1c0e9ae0 0x7fce1c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce23975700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce1c0fbb20 con 0x7fce1c1c2db0 2021-04-09T18:26:23.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce23975700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce1c0e9f30 con 0x7fce1c0f5520 2021-04-09T18:26:23.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce23975700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce1c0e59d0 con 0x7fce1c0e9ae0 2021-04-09T18:26:23.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce21719700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fce1c0f5520 0x7fce1c0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce21719700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fce1c0f5520 0x7fce1c0f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55874/0 (socket says 172.21.15.79:55874) 2021-04-09T18:26:23.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce21719700 1 -- 172.21.15.79:0/1184327222 learned_addr learned my addr 172.21.15.79:0/1184327222 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:23.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce20f18700 1 --2- 172.21.15.79:0/1184327222 >> v2:172.21.15.89:3300/0 conn(0x7fce1c0e9ae0 0x7fce1c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce21719700 1 -- 172.21.15.79:0/1184327222 >> v2:172.21.15.89:3300/0 conn(0x7fce1c0e9ae0 msgr2=0x7fce1c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:23.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce21719700 1 --2- 172.21.15.79:0/1184327222 >> v2:172.21.15.89:3300/0 conn(0x7fce1c0e9ae0 0x7fce1c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce1bfff700 1 -- 172.21.15.79:0/1184327222 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989255646 0 0) 0x7fce140010d0 con 0x7fce1c1c2db0 2021-04-09T18:26:23.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce21719700 1 -- 172.21.15.79:0/1184327222 >> v1:172.21.15.79:6789/0 conn(0x7fce1c1c2db0 legacy=0x7fce1c1c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce21719700 1 -- 172.21.15.79:0/1184327222 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1c0e56d0 con 0x7fce1c0f5520 2021-04-09T18:26:23.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce21719700 1 --2- 172.21.15.79:0/1184327222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c0f5520 0x7fce1c0f64b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fce0c002f30 tx=0x7fce0c00bd70).ready entity=mon.0 client_cookie=d524781f46080e5 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:23.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce1bfff700 1 -- 172.21.15.79:0/1184327222 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fce1c0e56d0 con 0x7fce1c0f5520 2021-04-09T18:26:23.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce1bfff700 1 -- 172.21.15.79:0/1184327222 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c009950 con 0x7fce1c0f5520 2021-04-09T18:26:23.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce1bfff700 1 -- 172.21.15.79:0/1184327222 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fce0c009d20 con 0x7fce1c0f5520 2021-04-09T18:26:23.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce23975700 1 -- 172.21.15.79:0/1184327222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c0f5520 msgr2=0x7fce1c0f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.374 7fce23975700 1 --2- 172.21.15.79:0/1184327222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c0f5520 0x7fce1c0f64b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fce0c002f30 tx=0x7fce0c00bd70).stop 2021-04-09T18:26:23.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.378 7fce23975700 1 -- 172.21.15.79:0/1184327222 shutdown_connections 2021-04-09T18:26:23.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.378 7fce23975700 1 --2- 172.21.15.79:0/1184327222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c0f5520 0x7fce1c0f64b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.378 7fce23975700 1 --2- 172.21.15.79:0/1184327222 >> v2:172.21.15.89:3300/0 conn(0x7fce1c0e9ae0 0x7fce1c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.378 7fce23975700 1 -- 172.21.15.79:0/1184327222 >> 172.21.15.79:0/1184327222 conn(0x7fce1c0e5fe0 msgr2=0x7fce1c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:23.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.378 7fce23975700 1 -- 172.21.15.79:0/1184327222 shutdown_connections 2021-04-09T18:26:23.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.378 7fce23975700 1 -- 172.21.15.79:0/1184327222 wait complete. 2021-04-09T18:26:23.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.378 7fce23975700 1 Processor -- start 2021-04-09T18:26:23.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.378 7fce23975700 1 -- start start 2021-04-09T18:26:23.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.378 7fce23975700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c0d0c50 0x7fce1c099e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.378 7fce23975700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce1c09a4a0 0x7fce1c0d6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.378 7fce23975700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce1c0d6ca0 0x7fce1c0cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.378 7fce23975700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c091de0 con 0x7fce1c0d0c50 2021-04-09T18:26:23.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.378 7fce23975700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c0920e0 con 0x7fce1c09a4a0 2021-04-09T18:26:23.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.378 7fce23975700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c091aa0 con 0x7fce1c0d6ca0 2021-04-09T18:26:23.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.382 7fce21719700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c0d0c50 0x7fce1c099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.382 7fce21719700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c0d0c50 0x7fce1c099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55882/0 (socket says 172.21.15.79:55882) 2021-04-09T18:26:23.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.382 7fce21719700 1 -- 172.21.15.79:0/570071625 learned_addr learned my addr 172.21.15.79:0/570071625 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:23.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.382 7fce20f18700 1 --2- 172.21.15.79:0/570071625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce1c09a4a0 0x7fce1c0d6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.382 7fce21f1a700 1 --2- 172.21.15.79:0/570071625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce1c0d6ca0 0x7fce1c0cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.382 7fce21719700 1 -- 172.21.15.79:0/570071625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce1c0d6ca0 msgr2=0x7fce1c0cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.382 7fce21719700 1 --2- 172.21.15.79:0/570071625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce1c0d6ca0 0x7fce1c0cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.382 7fce21719700 1 -- 172.21.15.79:0/570071625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce1c09a4a0 msgr2=0x7fce1c0d6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.382 7fce21719700 1 --2- 172.21.15.79:0/570071625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce1c09a4a0 0x7fce1c0d6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.382 7fce21719700 1 -- 172.21.15.79:0/570071625 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1c0d70f0 con 0x7fce1c0d0c50 2021-04-09T18:26:23.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.382 7fce21719700 1 --2- 172.21.15.79:0/570071625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c0d0c50 0x7fce1c099e70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fce1c0d34c0 tx=0x7fce0c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:23.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.382 7fce19ffb700 1 -- 172.21.15.79:0/570071625 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fce1c0d70f0 con 0x7fce1c0d0c50 2021-04-09T18:26:23.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.382 7fce19ffb700 1 -- 172.21.15.79:0/570071625 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c011c40 con 0x7fce1c0d0c50 2021-04-09T18:26:23.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.382 7fce19ffb700 1 -- 172.21.15.79:0/570071625 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fce0c01d670 con 0x7fce1c0d0c50 2021-04-09T18:26:23.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.382 7fce23975700 1 -- 172.21.15.79:0/570071625 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce1c0a9360 con 0x7fce1c0d0c50 2021-04-09T18:26:23.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.382 7fce23975700 1 -- 172.21.15.79:0/570071625 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce1c0cf570 con 0x7fce1c0d0c50 2021-04-09T18:26:23.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.382 7fce19ffb700 1 -- 172.21.15.79:0/570071625 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fce0c01c3e0 con 0x7fce1c0d0c50 2021-04-09T18:26:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.382 7fce19ffb700 1 --2- 172.21.15.79:0/570071625 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcdfc029100 0x7fcdfc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.382 7fce19ffb700 1 -- 172.21.15.79:0/570071625 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fce0c03adc0 con 0x7fce1c0d0c50 2021-04-09T18:26:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.382 7fce20f18700 1 --2- 172.21.15.79:0/570071625 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcdfc029100 0x7fcdfc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.386 7fce20f18700 1 --2- 172.21.15.79:0/570071625 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcdfc029100 0x7fcdfc02b650 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:23.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.386 7fce23975700 1 -- 172.21.15.79:0/570071625 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce1c0e39e0 con 0x7fce1c0d0c50 2021-04-09T18:26:23.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.390 7fce19ffb700 1 -- 172.21.15.79:0/570071625 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fce0c009740 con 0x7fce1c0d0c50 2021-04-09T18:26:23.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.558 7fce23975700 1 -- 172.21.15.79:0/570071625 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fce1c0f5b20 con 0x7fce1c0d0c50 2021-04-09T18:26:23.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.562 7fce19ffb700 1 -- 172.21.15.79:0/570071625 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fce0c011a30 con 0x7fce1c0d0c50 2021-04-09T18:26:23.569 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2021-04-09T18:26:23.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.562 7fce23975700 1 -- 172.21.15.79:0/570071625 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcdfc029100 msgr2=0x7fcdfc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.562 7fce23975700 1 --2- 172.21.15.79:0/570071625 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcdfc029100 0x7fcdfc02b650 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.562 7fce23975700 1 -- 172.21.15.79:0/570071625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c0d0c50 msgr2=0x7fce1c099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.562 7fce23975700 1 --2- 172.21.15.79:0/570071625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c0d0c50 0x7fce1c099e70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fce1c0d34c0 tx=0x7fce0c006890).stop 2021-04-09T18:26:23.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.562 7fce23975700 1 -- 172.21.15.79:0/570071625 shutdown_connections 2021-04-09T18:26:23.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.562 7fce23975700 1 --2- 172.21.15.79:0/570071625 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcdfc029100 0x7fcdfc02b650 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.562 7fce23975700 1 --2- 172.21.15.79:0/570071625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce1c0d6ca0 0x7fce1c0cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.562 7fce23975700 1 --2- 172.21.15.79:0/570071625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c0d0c50 0x7fce1c099e70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.562 7fce23975700 1 --2- 172.21.15.79:0/570071625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce1c09a4a0 0x7fce1c0d6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.562 7fce23975700 1 -- 172.21.15.79:0/570071625 >> 172.21.15.79:0/570071625 conn(0x7fce1c0d3700 msgr2=0x7fce1c0d8540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:23.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.562 7fce23975700 1 -- 172.21.15.79:0/570071625 shutdown_connections 2021-04-09T18:26:23.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.562 7fce23975700 1 -- 172.21.15.79:0/570071625 wait complete. 2021-04-09T18:26:23.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2021-04-09T18:26:23.581 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2021-04-09T18:26:23.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf2a1a0700 1 Processor -- start 2021-04-09T18:26:23.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf2a1a0700 1 -- start start 2021-04-09T18:26:23.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf2a1a0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf240f5520 0x7faf240f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf2a1a0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf241c8010 0x7faf241ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf2a1a0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf240fbb20 con 0x7faf240e9ae0 2021-04-09T18:26:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf2a1a0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf240e9f30 con 0x7faf241c8010 2021-04-09T18:26:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf2a1a0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf241c3dc0 con 0x7faf240f5520 2021-04-09T18:26:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf23fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf241c8010 0x7faf241ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf237fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf240f5520 0x7faf240f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf23fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf241c8010 0x7faf241ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:44234/0 (socket says 172.21.15.79:44234) 2021-04-09T18:26:23.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf23fff700 1 -- 172.21.15.79:0/3891310686 learned_addr learned my addr 172.21.15.79:0/3891310686 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:23.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf23fff700 1 -- 172.21.15.79:0/3891310686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf240f5520 msgr2=0x7faf240f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:23.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf23fff700 1 --2- 172.21.15.79:0/3891310686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf240f5520 0x7faf240f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf23fff700 1 -- 172.21.15.79:0/3891310686 >> v1:172.21.15.89:6789/0 conn(0x7faf240e9ae0 legacy=0x7faf2409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf23fff700 1 -- 172.21.15.79:0/3891310686 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2409f910 con 0x7faf241c8010 2021-04-09T18:26:23.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf227fc700 1 -- 172.21.15.79:0/3891310686 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1259476428 0 0) 0x7faf180010d0 con 0x7faf240e9ae0 2021-04-09T18:26:23.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf237fe700 1 --2- 172.21.15.79:0/3891310686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf240f5520 0x7faf240f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:23.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf23fff700 1 --2- 172.21.15.79:0/3891310686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf241c8010 0x7faf241ca470 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7faf1c0032b0 tx=0x7faf1c00b3c0).ready entity=mon.1 client_cookie=3aea5faa76b4a684 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:23.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf227fc700 1 -- 172.21.15.79:0/3891310686 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf2409f910 con 0x7faf241c8010 2021-04-09T18:26:23.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf227fc700 1 -- 172.21.15.79:0/3891310686 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c00bc20 con 0x7faf241c8010 2021-04-09T18:26:23.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.666 7faf227fc700 1 -- 172.21.15.79:0/3891310686 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf1c002020 con 0x7faf241c8010 2021-04-09T18:26:23.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.670 7faf2a1a0700 1 -- 172.21.15.79:0/3891310686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf241c8010 msgr2=0x7faf241ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.670 7faf2a1a0700 1 --2- 172.21.15.79:0/3891310686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf241c8010 0x7faf241ca470 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7faf1c0032b0 tx=0x7faf1c00b3c0).stop 2021-04-09T18:26:23.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.670 7faf2a1a0700 1 -- 172.21.15.79:0/3891310686 shutdown_connections 2021-04-09T18:26:23.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.670 7faf2a1a0700 1 --2- 172.21.15.79:0/3891310686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf241c8010 0x7faf241ca470 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.670 7faf2a1a0700 1 --2- 172.21.15.79:0/3891310686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf240f5520 0x7faf240f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.670 7faf2a1a0700 1 -- 172.21.15.79:0/3891310686 >> 172.21.15.79:0/3891310686 conn(0x7faf240e5fe0 msgr2=0x7faf240e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:23.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.670 7faf2a1a0700 1 -- 172.21.15.79:0/3891310686 shutdown_connections 2021-04-09T18:26:23.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.670 7faf2a1a0700 1 -- 172.21.15.79:0/3891310686 wait complete. 2021-04-09T18:26:23.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.670 7faf2a1a0700 1 Processor -- start 2021-04-09T18:26:23.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.670 7faf2a1a0700 1 -- start start 2021-04-09T18:26:23.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf2a1a0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf2408f800 0x7faf240abc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf2a1a0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf24094c90 0x7faf240d0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf2a1a0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf240950e0 0x7faf240d0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf2a1a0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf240acce0 con 0x7faf240950e0 2021-04-09T18:26:23.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf2a1a0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf240acfe0 con 0x7faf2408f800 2021-04-09T18:26:23.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf2a1a0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2408fc50 con 0x7faf24094c90 2021-04-09T18:26:23.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf23fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf240950e0 0x7faf240d0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf237fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf2408f800 0x7faf240abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf23fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf240950e0 0x7faf240d0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55898/0 (socket says 172.21.15.79:55898) 2021-04-09T18:26:23.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf23fff700 1 -- 172.21.15.79:0/780185996 learned_addr learned my addr 172.21.15.79:0/780185996 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:23.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf22ffd700 1 --2- 172.21.15.79:0/780185996 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf24094c90 0x7faf240d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf23fff700 1 -- 172.21.15.79:0/780185996 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf24094c90 msgr2=0x7faf240d0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf23fff700 1 --2- 172.21.15.79:0/780185996 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf24094c90 0x7faf240d0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf23fff700 1 -- 172.21.15.79:0/780185996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf2408f800 msgr2=0x7faf240abc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf23fff700 1 --2- 172.21.15.79:0/780185996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf2408f800 0x7faf240abc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf23fff700 1 -- 172.21.15.79:0/780185996 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf240ac870 con 0x7faf240950e0 2021-04-09T18:26:23.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf23fff700 1 --2- 172.21.15.79:0/780185996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf240950e0 0x7faf240d0f80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7faf240acc60 tx=0x7faf1c006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:23.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf0bfff700 1 -- 172.21.15.79:0/780185996 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf240ac870 con 0x7faf240950e0 2021-04-09T18:26:23.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf0bfff700 1 -- 172.21.15.79:0/780185996 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c01a5d0 con 0x7faf240950e0 2021-04-09T18:26:23.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf0bfff700 1 -- 172.21.15.79:0/780185996 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf1c020020 con 0x7faf240950e0 2021-04-09T18:26:23.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf2a1a0700 1 -- 172.21.15.79:0/780185996 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2408ffb0 con 0x7faf240950e0 2021-04-09T18:26:23.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.674 7faf2a1a0700 1 -- 172.21.15.79:0/780185996 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf24090400 con 0x7faf240950e0 2021-04-09T18:26:23.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.678 7faf0bfff700 1 -- 172.21.15.79:0/780185996 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7faf1c019040 con 0x7faf240950e0 2021-04-09T18:26:23.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.678 7faf0bfff700 1 --2- 172.21.15.79:0/780185996 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf04029100 0x7faf0402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.678 7faf0bfff700 1 -- 172.21.15.79:0/780185996 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7faf1c018040 con 0x7faf240950e0 2021-04-09T18:26:23.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.678 7faf237fe700 1 --2- 172.21.15.79:0/780185996 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf04029100 0x7faf0402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.678 7faf237fe700 1 --2- 172.21.15.79:0/780185996 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf04029100 0x7faf0402b650 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:23.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.678 7faf2a1a0700 1 -- 172.21.15.79:0/780185996 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf240e39e0 con 0x7faf240950e0 2021-04-09T18:26:23.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.686 7faf0bfff700 1 -- 172.21.15.79:0/780185996 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7faf1c01a3c0 con 0x7faf240950e0 2021-04-09T18:26:23.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.866 7faf2a1a0700 1 -- 172.21.15.79:0/780185996 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7faf240f5b20 con 0x7faf240950e0 2021-04-09T18:26:23.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.866 7faf0bfff700 1 -- 172.21.15.79:0/780185996 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf1c00ba10 con 0x7faf240950e0 2021-04-09T18:26:23.874 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2021-04-09T18:26:23.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.866 7faf2a1a0700 1 -- 172.21.15.79:0/780185996 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf04029100 msgr2=0x7faf0402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.866 7faf2a1a0700 1 --2- 172.21.15.79:0/780185996 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf04029100 0x7faf0402b650 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.866 7faf2a1a0700 1 -- 172.21.15.79:0/780185996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf240950e0 msgr2=0x7faf240d0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.866 7faf2a1a0700 1 --2- 172.21.15.79:0/780185996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf240950e0 0x7faf240d0f80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7faf240acc60 tx=0x7faf1c006c10).stop 2021-04-09T18:26:23.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.866 7faf2a1a0700 1 -- 172.21.15.79:0/780185996 shutdown_connections 2021-04-09T18:26:23.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.866 7faf2a1a0700 1 --2- 172.21.15.79:0/780185996 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf04029100 0x7faf0402b650 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.866 7faf2a1a0700 1 --2- 172.21.15.79:0/780185996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf2408f800 0x7faf240abc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.866 7faf2a1a0700 1 --2- 172.21.15.79:0/780185996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf240950e0 0x7faf240d0f80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.866 7faf2a1a0700 1 --2- 172.21.15.79:0/780185996 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf24094c90 0x7faf240d0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.866 7faf2a1a0700 1 -- 172.21.15.79:0/780185996 >> 172.21.15.79:0/780185996 conn(0x7faf240bace0 msgr2=0x7faf2408ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:23.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.866 7faf2a1a0700 1 -- 172.21.15.79:0/780185996 shutdown_connections 2021-04-09T18:26:23.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.866 7faf2a1a0700 1 -- 172.21.15.79:0/780185996 wait complete. 2021-04-09T18:26:23.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2021-04-09T18:26:23.885 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2021-04-09T18:26:23.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bf4cd0700 1 Processor -- start 2021-04-09T18:26:23.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bf4cd0700 1 -- start start 2021-04-09T18:26:23.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bf4cd0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5bf01c9020 0x7f5bf01cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bf4cd0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf00fbb20 con 0x7f5bf00f5520 2021-04-09T18:26:23.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bf4cd0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf009f910 con 0x7f5bf00e9ae0 2021-04-09T18:26:23.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bf4cd0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf01c3dc0 con 0x7f5bf01c9020 2021-04-09T18:26:23.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bee7e6700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5bf00f5520 0x7f5bf00f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50614/0 (socket says 172.21.15.79:50614) 2021-04-09T18:26:23.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bee7e6700 1 -- 172.21.15.79:0/1434113511 learned_addr learned my addr 172.21.15.79:0/1434113511 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:23.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5beefe7700 1 --2- 172.21.15.79:0/1434113511 >> v2:172.21.15.89:3300/0 conn(0x7f5bf01c9020 0x7f5bf01cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bed7e4700 1 -- 172.21.15.79:0/1434113511 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526452083 0 0) 0x7f5be00010d0 con 0x7f5bf00f5520 2021-04-09T18:26:23.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bed7e4700 1 -- 172.21.15.79:0/1434113511 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bd8003240 con 0x7f5bf00f5520 2021-04-09T18:26:23.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bed7e4700 1 -- 172.21.15.79:0/1434113511 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1144430040 0 0) 0x7f5be40010d0 con 0x7f5bf00e9ae0 2021-04-09T18:26:23.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bed7e4700 1 -- 172.21.15.79:0/1434113511 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bd8003620 con 0x7f5bf00e9ae0 2021-04-09T18:26:23.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bed7e4700 1 -- 172.21.15.79:0/1434113511 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3609241068 0 0) 0x7f5be0001650 con 0x7f5bf00f5520 2021-04-09T18:26:23.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bed7e4700 1 -- 172.21.15.79:0/1434113511 >> v2:172.21.15.89:3300/0 conn(0x7f5bf01c9020 msgr2=0x7f5bf01cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:23.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bed7e4700 1 --2- 172.21.15.79:0/1434113511 >> v2:172.21.15.89:3300/0 conn(0x7f5bf01c9020 0x7f5bf01cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bed7e4700 1 -- 172.21.15.79:0/1434113511 >> v1:172.21.15.89:6789/0 conn(0x7f5bf00e9ae0 legacy=0x7f5bf009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bed7e4700 1 -- 172.21.15.79:0/1434113511 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf00e56d0 con 0x7f5bf00f5520 2021-04-09T18:26:23.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bed7e4700 1 -- 172.21.15.79:0/1434113511 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f5be0001bb0 con 0x7f5bf00f5520 2021-04-09T18:26:23.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bed7e4700 1 -- 172.21.15.79:0/1434113511 >> v1:172.21.15.79:6789/0 conn(0x7f5bf00f5520 legacy=0x7f5bf00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:23.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bed7e4700 1 --2- 172.21.15.79:0/1434113511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bd8003d10 0x7f5bd80045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bed7e4700 1 --2- 172.21.15.79:0/1434113511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bd8004bd0 0x7f5bd80097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bed7e4700 1 --2- 172.21.15.79:0/1434113511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bd8005020 0x7f5bd800be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:23.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bed7e4700 1 -- 172.21.15.79:0/1434113511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf01c3dc0 con 0x7f5bd8003d10 2021-04-09T18:26:23.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bed7e4700 1 -- 172.21.15.79:0/1434113511 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80505b0 con 0x7f5bd8005020 2021-04-09T18:26:23.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bed7e4700 1 -- 172.21.15.79:0/1434113511 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80507b0 con 0x7f5bd8004bd0 2021-04-09T18:26:23.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bee7e6700 1 --2- 172.21.15.79:0/1434113511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bd8003d10 0x7f5bd80045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bedfe5700 1 --2- 172.21.15.79:0/1434113511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bd8004bd0 0x7f5bd80097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5beefe7700 1 --2- 172.21.15.79:0/1434113511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bd8005020 0x7f5bd800be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:23.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bee7e6700 1 -- 172.21.15.79:0/1434113511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bd8004bd0 msgr2=0x7f5bd80097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:23.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bee7e6700 1 --2- 172.21.15.79:0/1434113511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bd8004bd0 0x7f5bd80097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bee7e6700 1 -- 172.21.15.79:0/1434113511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bd8005020 msgr2=0x7f5bd800be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:23.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bee7e6700 1 --2- 172.21.15.79:0/1434113511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bd8005020 0x7f5bd800be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:23.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bee7e6700 1 -- 172.21.15.79:0/1434113511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd8050aa0 con 0x7f5bd8003d10 2021-04-09T18:26:23.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5beefe7700 1 --2- 172.21.15.79:0/1434113511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bd8005020 0x7f5bd800be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:23.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5beefe7700 1 -- 172.21.15.79:0/1434113511 reap_dead start 2021-04-09T18:26:23.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.974 7f5bee7e6700 1 --2- 172.21.15.79:0/1434113511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bd8003d10 0x7f5bd80045a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f5be0001980 tx=0x7f5be000cc80).ready entity=mon.0 client_cookie=510e7d64585c064b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:23.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.978 7f5bed7e4700 1 -- 172.21.15.79:0/1434113511 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5bd8050aa0 con 0x7f5bd8003d10 2021-04-09T18:26:24.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.978 7f5bed7e4700 1 -- 172.21.15.79:0/1434113511 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be0007320 con 0x7f5bd8003d10 2021-04-09T18:26:24.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.978 7f5bed7e4700 1 -- 172.21.15.79:0/1434113511 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5bf00e56d0 con 0x7f5bd8003d10 2021-04-09T18:26:24.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.978 7f5bf4cd0700 1 -- 172.21.15.79:0/1434113511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bd8003d10 msgr2=0x7f5bd80045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.978 7f5bf4cd0700 1 --2- 172.21.15.79:0/1434113511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bd8003d10 0x7f5bd80045a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f5be0001980 tx=0x7f5be000cc80).stop 2021-04-09T18:26:24.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.978 7f5bf4cd0700 1 -- 172.21.15.79:0/1434113511 shutdown_connections 2021-04-09T18:26:24.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.978 7f5bf4cd0700 1 --2- 172.21.15.79:0/1434113511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bd8003d10 0x7f5bd80045a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.978 7f5bf4cd0700 1 -- 172.21.15.79:0/1434113511 >> 172.21.15.79:0/1434113511 conn(0x7f5bf00e5fe0 msgr2=0x7f5bf00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:24.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.978 7f5bf4cd0700 1 -- 172.21.15.79:0/1434113511 shutdown_connections 2021-04-09T18:26:24.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.978 7f5bf4cd0700 1 -- 172.21.15.79:0/1434113511 wait complete. 2021-04-09T18:26:24.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.982 7f5bf4cd0700 1 Processor -- start 2021-04-09T18:26:24.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.982 7f5bf4cd0700 1 -- start start 2021-04-09T18:26:24.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.982 7f5bf4cd0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bf00bdcb0 0x7f5bf0096980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.982 7f5bf4cd0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bf00be100 0x7f5bf00c0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.982 7f5bf4cd0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bf00c0980 0x7f5bf00d4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.982 7f5bf4cd0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf00e9f30 con 0x7f5bf00c0980 2021-04-09T18:26:24.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.982 7f5bf4cd0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf00c0050 con 0x7f5bf00bdcb0 2021-04-09T18:26:24.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.982 7f5bf4cd0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf00d6a50 con 0x7f5bf00be100 2021-04-09T18:26:24.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.982 7f5beefe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bf00c0980 0x7f5bf00d4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.982 7f5bee7e6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bf00bdcb0 0x7f5bf0096980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.982 7f5beefe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bf00c0980 0x7f5bf00d4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55918/0 (socket says 172.21.15.79:55918) 2021-04-09T18:26:24.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.982 7f5bedfe5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bf00be100 0x7f5bf00c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.982 7f5beefe7700 1 -- 172.21.15.79:0/2645156079 learned_addr learned my addr 172.21.15.79:0/2645156079 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:24.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.982 7f5beefe7700 1 -- 172.21.15.79:0/2645156079 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bf00be100 msgr2=0x7f5bf00c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.982 7f5beefe7700 1 --2- 172.21.15.79:0/2645156079 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bf00be100 0x7f5bf00c0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.982 7f5beefe7700 1 -- 172.21.15.79:0/2645156079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bf00bdcb0 msgr2=0x7f5bf0096980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.982 7f5beefe7700 1 --2- 172.21.15.79:0/2645156079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bf00bdcb0 0x7f5bf0096980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.982 7f5beefe7700 1 -- 172.21.15.79:0/2645156079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf0096fb0 con 0x7f5bf00c0980 2021-04-09T18:26:24.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.986 7f5bee7e6700 1 --2- 172.21.15.79:0/2645156079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bf00bdcb0 0x7f5bf0096980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:24.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.986 7f5beefe7700 1 --2- 172.21.15.79:0/2645156079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bf00c0980 0x7f5bf00d4f40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f5bf00d8040 tx=0x7f5be8006b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:24.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.986 7f5bdeffd700 1 -- 172.21.15.79:0/2645156079 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5bf0096fb0 con 0x7f5bf00c0980 2021-04-09T18:26:24.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.986 7f5bdeffd700 1 -- 172.21.15.79:0/2645156079 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be800e8e0 con 0x7f5bf00c0980 2021-04-09T18:26:24.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.986 7f5bf4cd0700 1 -- 172.21.15.79:0/2645156079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf00d5e50 con 0x7f5bf00c0980 2021-04-09T18:26:24.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.986 7f5bdeffd700 1 -- 172.21.15.79:0/2645156079 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5be800f040 con 0x7f5bf00c0980 2021-04-09T18:26:24.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.986 7f5bf4cd0700 1 -- 172.21.15.79:0/2645156079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf00d5760 con 0x7f5bf00c0980 2021-04-09T18:26:24.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.986 7f5bdeffd700 1 -- 172.21.15.79:0/2645156079 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5be800ecb0 con 0x7f5bf00c0980 2021-04-09T18:26:24.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.986 7f5bdeffd700 1 --2- 172.21.15.79:0/2645156079 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5bd4029100 0x7f5bd402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.986 7f5bdeffd700 1 -- 172.21.15.79:0/2645156079 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f5be80397e0 con 0x7f5bf00c0980 2021-04-09T18:26:24.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.986 7f5bee7e6700 1 --2- 172.21.15.79:0/2645156079 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5bd4029100 0x7f5bd402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.986 7f5bee7e6700 1 --2- 172.21.15.79:0/2645156079 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5bd4029100 0x7f5bd402b650 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:24.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.990 7f5bf4cd0700 1 -- 172.21.15.79:0/2645156079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf00e39e0 con 0x7f5bf00c0980 2021-04-09T18:26:24.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:23.994 7f5bdeffd700 1 -- 172.21.15.79:0/2645156079 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5bf00f76c0 con 0x7f5bf00c0980 2021-04-09T18:26:24.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.170 7f5bf4cd0700 1 -- 172.21.15.79:0/2645156079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5bf00a1cc0 con 0x7f5bf00c0980 2021-04-09T18:26:24.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.174 7f5bdeffd700 1 -- 172.21.15.79:0/2645156079 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5be800e6d0 con 0x7f5bf00c0980 2021-04-09T18:26:24.181 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2021-04-09T18:26:24.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.174 7f5bf4cd0700 1 -- 172.21.15.79:0/2645156079 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5bd4029100 msgr2=0x7f5bd402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.174 7f5bf4cd0700 1 --2- 172.21.15.79:0/2645156079 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5bd4029100 0x7f5bd402b650 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.174 7f5bf4cd0700 1 -- 172.21.15.79:0/2645156079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bf00c0980 msgr2=0x7f5bf00d4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.174 7f5bf4cd0700 1 --2- 172.21.15.79:0/2645156079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bf00c0980 0x7f5bf00d4f40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f5bf00d8040 tx=0x7f5be8006b80).stop 2021-04-09T18:26:24.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.174 7f5bf4cd0700 1 -- 172.21.15.79:0/2645156079 shutdown_connections 2021-04-09T18:26:24.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.174 7f5bf4cd0700 1 --2- 172.21.15.79:0/2645156079 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5bd4029100 0x7f5bd402b650 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.174 7f5bf4cd0700 1 --2- 172.21.15.79:0/2645156079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bf00bdcb0 0x7f5bf0096980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.174 7f5bf4cd0700 1 --2- 172.21.15.79:0/2645156079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bf00c0980 0x7f5bf00d4f40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.174 7f5bf4cd0700 1 --2- 172.21.15.79:0/2645156079 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bf00be100 0x7f5bf00c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.174 7f5bf4cd0700 1 -- 172.21.15.79:0/2645156079 >> 172.21.15.79:0/2645156079 conn(0x7f5bf009ae40 msgr2=0x7f5bf009a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:24.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.174 7f5bf4cd0700 1 -- 172.21.15.79:0/2645156079 shutdown_connections 2021-04-09T18:26:24.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.174 7f5bf4cd0700 1 -- 172.21.15.79:0/2645156079 wait complete. 2021-04-09T18:26:24.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.6 2021-04-09T18:26:24.192 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2021-04-09T18:26:24.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58aaa40700 1 Processor -- start 2021-04-09T18:26:24.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58aaa40700 1 -- start start 2021-04-09T18:26:24.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58aaa40700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f58a40f5520 0x7f58a40f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58aaa40700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58a40e9ae0 0x7f58a409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58aaa40700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a40fbb20 con 0x7f58a41c2db0 2021-04-09T18:26:24.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58aaa40700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a40e9f30 con 0x7f58a40f5520 2021-04-09T18:26:24.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58aaa40700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40e59d0 con 0x7f58a40e9ae0 2021-04-09T18:26:24.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58a8fe5700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f58a41c2db0 0x7f58a41c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50632/0 (socket says 172.21.15.79:50632) 2021-04-09T18:26:24.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58a8fe5700 1 -- 172.21.15.79:0/1927077909 learned_addr learned my addr 172.21.15.79:0/1927077909 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:24.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58a3fff700 1 --2- 172.21.15.79:0/1927077909 >> v2:172.21.15.89:3300/0 conn(0x7f58a40f5520 0x7f58a40f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58a37fe700 1 --2- 172.21.15.79:0/1927077909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58a40e9ae0 0x7f58a409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58a2ffd700 1 -- 172.21.15.79:0/1927077909 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478053002 0 0) 0x7f589c0010d0 con 0x7f58a41c2db0 2021-04-09T18:26:24.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58a2ffd700 1 -- 172.21.15.79:0/1927077909 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5890003240 con 0x7f58a41c2db0 2021-04-09T18:26:24.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58a37fe700 1 -- 172.21.15.79:0/1927077909 >> v2:172.21.15.89:3300/0 conn(0x7f58a40f5520 msgr2=0x7f58a40f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:24.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58a37fe700 1 --2- 172.21.15.79:0/1927077909 >> v2:172.21.15.89:3300/0 conn(0x7f58a40f5520 0x7f58a40f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58a37fe700 1 -- 172.21.15.79:0/1927077909 >> v1:172.21.15.79:6789/0 conn(0x7f58a41c2db0 legacy=0x7f58a41c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58a37fe700 1 -- 172.21.15.79:0/1927077909 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a40e56d0 con 0x7f58a40e9ae0 2021-04-09T18:26:24.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58a37fe700 1 --2- 172.21.15.79:0/1927077909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58a40e9ae0 0x7f58a409f110 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f588c0032b0 tx=0x7f588c00b0e0).ready entity=mon.2 client_cookie=e57d91a717d84ccf server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:24.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58a2ffd700 1 -- 172.21.15.79:0/1927077909 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f58a40e56d0 con 0x7f58a40e9ae0 2021-04-09T18:26:24.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58a2ffd700 1 -- 172.21.15.79:0/1927077909 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c00bab0 con 0x7f58a40e9ae0 2021-04-09T18:26:24.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58a2ffd700 1 -- 172.21.15.79:0/1927077909 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f588c002020 con 0x7f58a40e9ae0 2021-04-09T18:26:24.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58aaa40700 1 -- 172.21.15.79:0/1927077909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58a40e9ae0 msgr2=0x7f58a409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.274 7f58aaa40700 1 --2- 172.21.15.79:0/1927077909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58a40e9ae0 0x7f58a409f110 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f588c0032b0 tx=0x7f588c00b0e0).stop 2021-04-09T18:26:24.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.278 7f58aaa40700 1 -- 172.21.15.79:0/1927077909 shutdown_connections 2021-04-09T18:26:24.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.278 7f58aaa40700 1 --2- 172.21.15.79:0/1927077909 >> v2:172.21.15.89:3300/0 conn(0x7f58a40f5520 0x7f58a40f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.278 7f58aaa40700 1 --2- 172.21.15.79:0/1927077909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58a40e9ae0 0x7f58a409f110 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.278 7f58aaa40700 1 -- 172.21.15.79:0/1927077909 >> 172.21.15.79:0/1927077909 conn(0x7f58a40e5fe0 msgr2=0x7f58a40e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:24.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.278 7f58aaa40700 1 -- 172.21.15.79:0/1927077909 shutdown_connections 2021-04-09T18:26:24.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.278 7f58aaa40700 1 -- 172.21.15.79:0/1927077909 wait complete. 2021-04-09T18:26:24.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.278 7f58aaa40700 1 Processor -- start 2021-04-09T18:26:24.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.278 7f58aaa40700 1 -- start start 2021-04-09T18:26:24.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.278 7f58aaa40700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a40a95c0 0x7f58a40ad140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.278 7f58aaa40700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58a4093050 0x7f58a40d0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.278 7f58aaa40700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58a4095030 0x7f58a408e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.278 7f58aaa40700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40aa820 con 0x7f58a4093050 2021-04-09T18:26:24.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.278 7f58aaa40700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40aab20 con 0x7f58a40a95c0 2021-04-09T18:26:24.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.278 7f58aaa40700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40ad770 con 0x7f58a4095030 2021-04-09T18:26:24.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.278 7f58a37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58a4093050 0x7f58a40d0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.282 7f58a37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58a4093050 0x7f58a40d0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55930/0 (socket says 172.21.15.79:55930) 2021-04-09T18:26:24.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.282 7f58a37fe700 1 -- 172.21.15.79:0/2224017111 learned_addr learned my addr 172.21.15.79:0/2224017111 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:24.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.282 7f58a8fe5700 1 --2- 172.21.15.79:0/2224017111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58a4095030 0x7f58a408e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.282 7f58a3fff700 1 --2- 172.21.15.79:0/2224017111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a40a95c0 0x7f58a40ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.282 7f58a37fe700 1 -- 172.21.15.79:0/2224017111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58a4095030 msgr2=0x7f58a408e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.282 7f58a37fe700 1 --2- 172.21.15.79:0/2224017111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58a4095030 0x7f58a408e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.282 7f58a37fe700 1 -- 172.21.15.79:0/2224017111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a40a95c0 msgr2=0x7f58a40ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.282 7f58a37fe700 1 --2- 172.21.15.79:0/2224017111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a40a95c0 0x7f58a40ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.282 7f58a37fe700 1 -- 172.21.15.79:0/2224017111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a4095c00 con 0x7f58a4093050 2021-04-09T18:26:24.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.282 7f58a37fe700 1 --2- 172.21.15.79:0/2224017111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58a4093050 0x7f58a40d0d40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f58a40d3be0 tx=0x7f588c006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:24.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.282 7f58a0ff9700 1 -- 172.21.15.79:0/2224017111 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f58a4095c00 con 0x7f58a4093050 2021-04-09T18:26:24.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.282 7f58a0ff9700 1 -- 172.21.15.79:0/2224017111 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c01c440 con 0x7f58a4093050 2021-04-09T18:26:24.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.282 7f58aaa40700 1 -- 172.21.15.79:0/2224017111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a40d1370 con 0x7f58a4093050 2021-04-09T18:26:24.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.282 7f58a0ff9700 1 -- 172.21.15.79:0/2224017111 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f588c01c810 con 0x7f58a4093050 2021-04-09T18:26:24.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.282 7f58aaa40700 1 -- 172.21.15.79:0/2224017111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a408f7b0 con 0x7f58a4093050 2021-04-09T18:26:24.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.282 7f58a0ff9700 1 -- 172.21.15.79:0/2224017111 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f588c019030 con 0x7f58a4093050 2021-04-09T18:26:24.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.282 7f58a0ff9700 1 --2- 172.21.15.79:0/2224017111 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5888029100 0x7f588802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.282 7f58a0ff9700 1 -- 172.21.15.79:0/2224017111 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f588c018040 con 0x7f58a4093050 2021-04-09T18:26:24.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.282 7f58a3fff700 1 --2- 172.21.15.79:0/2224017111 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5888029100 0x7f588802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.282 7f58a3fff700 1 --2- 172.21.15.79:0/2224017111 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5888029100 0x7f588802b650 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:24.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.286 7f58aaa40700 1 -- 172.21.15.79:0/2224017111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a40e39e0 con 0x7f58a4093050 2021-04-09T18:26:24.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.294 7f58a0ff9700 1 -- 172.21.15.79:0/2224017111 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f588c011c90 con 0x7f58a4093050 2021-04-09T18:26:24.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.466 7f58aaa40700 1 -- 172.21.15.79:0/2224017111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f58a40f5b20 con 0x7f58a4093050 2021-04-09T18:26:24.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.470 7f58a0ff9700 1 -- 172.21.15.79:0/2224017111 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f588c00b8a0 con 0x7f58a4093050 2021-04-09T18:26:24.477 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2021-04-09T18:26:24.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.470 7f58aaa40700 1 -- 172.21.15.79:0/2224017111 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5888029100 msgr2=0x7f588802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.470 7f58aaa40700 1 --2- 172.21.15.79:0/2224017111 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5888029100 0x7f588802b650 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.470 7f58aaa40700 1 -- 172.21.15.79:0/2224017111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58a4093050 msgr2=0x7f58a40d0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.470 7f58aaa40700 1 --2- 172.21.15.79:0/2224017111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58a4093050 0x7f58a40d0d40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f58a40d3be0 tx=0x7f588c006c10).stop 2021-04-09T18:26:24.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.470 7f58aaa40700 1 -- 172.21.15.79:0/2224017111 shutdown_connections 2021-04-09T18:26:24.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.470 7f58aaa40700 1 --2- 172.21.15.79:0/2224017111 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5888029100 0x7f588802b650 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.470 7f58aaa40700 1 --2- 172.21.15.79:0/2224017111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a40a95c0 0x7f58a40ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.470 7f58aaa40700 1 --2- 172.21.15.79:0/2224017111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58a4095030 0x7f58a408e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.470 7f58aaa40700 1 --2- 172.21.15.79:0/2224017111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58a4093050 0x7f58a40d0d40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.470 7f58aaa40700 1 -- 172.21.15.79:0/2224017111 >> 172.21.15.79:0/2224017111 conn(0x7f58a4094a30 msgr2=0x7f58a40adc40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:24.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.470 7f58aaa40700 1 -- 172.21.15.79:0/2224017111 shutdown_connections 2021-04-09T18:26:24.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.470 7f58aaa40700 1 -- 172.21.15.79:0/2224017111 wait complete. 2021-04-09T18:26:24.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.7 2021-04-09T18:26:24.490 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2021-04-09T18:26:24.490 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-04-09T18:26:24.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.574 7f53e56c4700 1 Processor -- start 2021-04-09T18:26:24.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53e56c4700 1 -- start start 2021-04-09T18:26:24.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53e56c4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f53e00f5510 0x7f53e00f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53e56c4700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e00fbb10 con 0x7f53e00e9ad0 2021-04-09T18:26:24.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53e56c4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e009f900 con 0x7f53e01c8000 2021-04-09T18:26:24.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53e56c4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e00e9f20 con 0x7f53e00f5510 2021-04-09T18:26:24.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53dea46700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f53e00e9ad0 0x7f53e009f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50648/0 (socket says 172.21.15.79:50648) 2021-04-09T18:26:24.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53dea46700 1 -- 172.21.15.79:0/2690452187 learned_addr learned my addr 172.21.15.79:0/2690452187 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:24.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53df247700 1 --2- 172.21.15.79:0/2690452187 >> v2:172.21.15.89:3300/0 conn(0x7f53e00f5510 0x7f53e00f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53de245700 1 -- 172.21.15.79:0/2690452187 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636074804 0 0) 0x7f53c80010d0 con 0x7f53e00e9ad0 2021-04-09T18:26:24.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53de245700 1 -- 172.21.15.79:0/2690452187 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53cc003240 con 0x7f53e00e9ad0 2021-04-09T18:26:24.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53df247700 1 -- 172.21.15.79:0/2690452187 >> v1:172.21.15.89:6789/0 conn(0x7f53e01c8000 legacy=0x7f53e01ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53df247700 1 -- 172.21.15.79:0/2690452187 >> v1:172.21.15.79:6789/0 conn(0x7f53e00e9ad0 legacy=0x7f53e009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53df247700 1 -- 172.21.15.79:0/2690452187 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e00e56c0 con 0x7f53e00f5510 2021-04-09T18:26:24.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53df247700 1 --2- 172.21.15.79:0/2690452187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e00f5510 0x7f53e00f64a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f53d0002f30 tx=0x7f53d000bcc0).ready entity=mon.1 client_cookie=aa2e1c81c9ed3daf server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:24.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53de245700 1 -- 172.21.15.79:0/2690452187 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f53e00e56c0 con 0x7f53e00f5510 2021-04-09T18:26:24.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53de245700 1 -- 172.21.15.79:0/2690452187 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d0009800 con 0x7f53e00f5510 2021-04-09T18:26:24.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53de245700 1 -- 172.21.15.79:0/2690452187 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f53d0009bd0 con 0x7f53e00f5510 2021-04-09T18:26:24.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53e56c4700 1 -- 172.21.15.79:0/2690452187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e00f5510 msgr2=0x7f53e00f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53e56c4700 1 --2- 172.21.15.79:0/2690452187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e00f5510 0x7f53e00f64a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f53d0002f30 tx=0x7f53d000bcc0).stop 2021-04-09T18:26:24.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53e56c4700 1 -- 172.21.15.79:0/2690452187 shutdown_connections 2021-04-09T18:26:24.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53e56c4700 1 --2- 172.21.15.79:0/2690452187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e00f5510 0x7f53e00f64a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53e56c4700 1 -- 172.21.15.79:0/2690452187 >> 172.21.15.79:0/2690452187 conn(0x7f53e00e5fd0 msgr2=0x7f53e00e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:24.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53e56c4700 1 -- 172.21.15.79:0/2690452187 shutdown_connections 2021-04-09T18:26:24.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.578 7f53e56c4700 1 -- 172.21.15.79:0/2690452187 wait complete. 2021-04-09T18:26:24.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.582 7f53e56c4700 1 Processor -- start 2021-04-09T18:26:24.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.582 7f53e56c4700 1 -- start start 2021-04-09T18:26:24.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53e56c4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e00bad30 0x7f53e00c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53e56c4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e00bb180 0x7f53e00ae190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53e56c4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e00c3990 0x7f53e00d4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53e56c4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e01c3db0 con 0x7f53e00bad30 2021-04-09T18:26:24.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53e56c4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00ac8f0 con 0x7f53e00bb180 2021-04-09T18:26:24.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53e56c4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00acbf0 con 0x7f53e00c3990 2021-04-09T18:26:24.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53df247700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e00bad30 0x7f53e00c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53df247700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e00bad30 0x7f53e00c3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55942/0 (socket says 172.21.15.79:55942) 2021-04-09T18:26:24.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53df247700 1 -- 172.21.15.79:0/208855977 learned_addr learned my addr 172.21.15.79:0/208855977 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:24.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53dea46700 1 --2- 172.21.15.79:0/208855977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e00bb180 0x7f53e00ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53dfa48700 1 --2- 172.21.15.79:0/208855977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e00c3990 0x7f53e00d4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53df247700 1 -- 172.21.15.79:0/208855977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e00c3990 msgr2=0x7f53e00d4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53df247700 1 --2- 172.21.15.79:0/208855977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e00c3990 0x7f53e00d4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53df247700 1 -- 172.21.15.79:0/208855977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e00bb180 msgr2=0x7f53e00ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53df247700 1 --2- 172.21.15.79:0/208855977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e00bb180 0x7f53e00ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53df247700 1 -- 172.21.15.79:0/208855977 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e00ae7c0 con 0x7f53e00bad30 2021-04-09T18:26:24.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53dfa48700 1 --2- 172.21.15.79:0/208855977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e00c3990 0x7f53e00d4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:24.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53df247700 1 --2- 172.21.15.79:0/208855977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e00bad30 0x7f53e00c3360 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f53e009b2f0 tx=0x7f53d0006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:24.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53d7fff700 1 -- 172.21.15.79:0/208855977 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f53e00ae7c0 con 0x7f53e00bad30 2021-04-09T18:26:24.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53d7fff700 1 -- 172.21.15.79:0/208855977 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d001d450 con 0x7f53e00bad30 2021-04-09T18:26:24.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53e56c4700 1 -- 172.21.15.79:0/208855977 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e00d4b30 con 0x7f53e00bad30 2021-04-09T18:26:24.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53d7fff700 1 -- 172.21.15.79:0/208855977 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f53d0022020 con 0x7f53e00bad30 2021-04-09T18:26:24.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53e56c4700 1 -- 172.21.15.79:0/208855977 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e00d5090 con 0x7f53e00bad30 2021-04-09T18:26:24.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53d7fff700 1 -- 172.21.15.79:0/208855977 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f53d001d820 con 0x7f53e00bad30 2021-04-09T18:26:24.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53d7fff700 1 --2- 172.21.15.79:0/208855977 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f53c4029100 0x7f53c402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.586 7f53d7fff700 1 -- 172.21.15.79:0/208855977 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f53d003c690 con 0x7f53e00bad30 2021-04-09T18:26:24.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.590 7f53dea46700 1 --2- 172.21.15.79:0/208855977 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f53c4029100 0x7f53c402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.590 7f53dea46700 1 --2- 172.21.15.79:0/208855977 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f53c4029100 0x7f53c402b650 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:24.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.590 7f53e56c4700 1 -- 172.21.15.79:0/208855977 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e00e39d0 con 0x7f53e00bad30 2021-04-09T18:26:24.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.598 7f53d7fff700 1 -- 172.21.15.79:0/208855977 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f53d00095f0 con 0x7f53e00bad30 2021-04-09T18:26:24.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.758 7f53e56c4700 1 -- 172.21.15.79:0/208855977 --> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f53e00a1cb0 con 0x7f53c4029100 2021-04-09T18:26:24.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.762 7f53d7fff700 1 -- 172.21.15.79:0/208855977 <== mgr.4100 v2:172.21.15.89:6800/13779 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+77369 (crc 0 0 0) 0x7f53e00a1cb0 con 0x7f53c4029100 2021-04-09T18:26:24.930 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2021-04-09T18:26:24.932 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:24.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.766 7f53e56c4700 1 -- 172.21.15.79:0/208855977 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f53c4029100 msgr2=0x7f53c402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.766 7f53e56c4700 1 --2- 172.21.15.79:0/208855977 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f53c4029100 0x7f53c402b650 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.766 7f53e56c4700 1 -- 172.21.15.79:0/208855977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e00bad30 msgr2=0x7f53e00c3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.766 7f53e56c4700 1 --2- 172.21.15.79:0/208855977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e00bad30 0x7f53e00c3360 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f53e009b2f0 tx=0x7f53d0006890).stop 2021-04-09T18:26:24.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.766 7f53e56c4700 1 -- 172.21.15.79:0/208855977 shutdown_connections 2021-04-09T18:26:24.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.766 7f53e56c4700 1 --2- 172.21.15.79:0/208855977 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f53c4029100 0x7f53c402b650 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.766 7f53e56c4700 1 --2- 172.21.15.79:0/208855977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e00c3990 0x7f53e00d4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.766 7f53e56c4700 1 --2- 172.21.15.79:0/208855977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53e00bad30 0x7f53e00c3360 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.766 7f53e56c4700 1 --2- 172.21.15.79:0/208855977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e00bb180 0x7f53e00ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.766 7f53e56c4700 1 -- 172.21.15.79:0/208855977 >> 172.21.15.79:0/208855977 conn(0x7f53e01a1260 msgr2=0x7f53e009a570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:24.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.766 7f53e56c4700 1 -- 172.21.15.79:0/208855977 shutdown_connections 2021-04-09T18:26:24.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:24.766 7f53e56c4700 1 -- 172.21.15.79:0/208855977 wait complete. 2021-04-09T18:26:24.940 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2021-04-09 18:26:23.952016","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":8390528,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584192,"statfs":{"total":773094113280,"available":764502212608,"internally_reserved":8589934592,"allocated":1900544,"data_stored":664916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.113787","last_change":"2021-04-09 18:26:08.058514","last_active":"2021-04-09 18:26:14.113787","last_peered":"2021-04-09 18:26:14.113787","last_clean":"2021-04-09 18:26:14.113787","last_became_active":"2021-04-09 18:26:08.058166","last_became_peered":"2021-04-09 18:26:08.058166","last_unstale":"2021-04-09 18:26:14.113787","last_undegraded":"2021-04-09 18:26:14.113787","last_fullsized":"2021-04-09 18:26:14.113787","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"22'8","reported_seq":"20","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:26:21.154367","last_change":"2021-04-09 18:26:11.082149","last_active":"2021-04-09 18:26:21.154367","last_peered":"2021-04-09 18:26:21.154367","last_clean":"2021-04-09 18:26:21.154367","last_became_active":"2021-04-09 18:26:11.081851","last_became_peered":"2021-04-09 18:26:11.081851","last_unstale":"2021-04-09 18:26:21.154367","last_undegraded":"2021-04-09 18:26:21.154367","last_fullsized":"2021-04-09 18:26:21.154367","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:10.064426","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:10.064426","last_clean_scrub_stamp":"2021-04-09 18:26:10.064426","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.134411","last_change":"2021-04-09 18:26:14.129558","last_active":"2021-04-09 18:26:14.134411","last_peered":"2021-04-09 18:26:14.134411","last_clean":"2021-04-09 18:26:14.134411","last_became_active":"2021-04-09 18:26:14.129055","last_became_peered":"2021-04-09 18:26:14.129055","last_unstale":"2021-04-09 18:26:14.134411","last_undegraded":"2021-04-09 18:26:14.134411","last_fullsized":"2021-04-09 18:26:14.134411","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:13.090116","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:13.090116","last_clean_scrub_stamp":"2021-04-09 18:26:13.090116","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.113619","last_change":"2021-04-09 18:26:08.061036","last_active":"2021-04-09 18:26:14.113619","last_peered":"2021-04-09 18:26:14.113619","last_clean":"2021-04-09 18:26:14.113619","last_became_active":"2021-04-09 18:26:08.060740","last_became_peered":"2021-04-09 18:26:08.060740","last_unstale":"2021-04-09 18:26:14.113619","last_undegraded":"2021-04-09 18:26:14.113619","last_fullsized":"2021-04-09 18:26:14.113619","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"22'6","reported_seq":"18","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:26:21.156720","last_change":"2021-04-09 18:26:11.089522","last_active":"2021-04-09 18:26:21.156720","last_peered":"2021-04-09 18:26:21.156720","last_clean":"2021-04-09 18:26:21.156720","last_became_active":"2021-04-09 18:26:11.088658","last_became_peered":"2021-04-09 18:26:11.088658","last_unstale":"2021-04-09 18:26:21.156720","last_undegraded":"2021-04-09 18:26:21.156720","last_fullsized":"2021-04-09 18:26:21.156720","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:10.064426","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:10.064426","last_clean_scrub_stamp":"2021-04-09 18:26:10.064426","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.123737","last_change":"2021-04-09 18:26:14.116606","last_active":"2021-04-09 18:26:14.123737","last_peered":"2021-04-09 18:26:14.123737","last_clean":"2021-04-09 18:26:14.123737","last_became_active":"2021-04-09 18:26:14.116130","last_became_peered":"2021-04-09 18:26:14.116130","last_unstale":"2021-04-09 18:26:14.123737","last_undegraded":"2021-04-09 18:26:14.123737","last_fullsized":"2021-04-09 18:26:14.123737","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:13.090116","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:13.090116","last_clean_scrub_stamp":"2021-04-09 18:26:13.090116","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.132825","last_change":"2021-04-09 18:26:14.127728","last_active":"2021-04-09 18:26:14.132825","last_peered":"2021-04-09 18:26:14.132825","last_clean":"2021-04-09 18:26:14.132825","last_became_active":"2021-04-09 18:26:14.127252","last_became_peered":"2021-04-09 18:26:14.127252","last_unstale":"2021-04-09 18:26:14.132825","last_undegraded":"2021-04-09 18:26:14.132825","last_fullsized":"2021-04-09 18:26:14.132825","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:13.090116","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:13.090116","last_clean_scrub_stamp":"2021-04-09 18:26:13.090116","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.119397","last_change":"2021-04-09 18:26:08.061551","last_active":"2021-04-09 18:26:14.119397","last_peered":"2021-04-09 18:26:14.119397","last_clean":"2021-04-09 18:26:14.119397","last_became_active":"2021-04-09 18:26:08.061226","last_became_peered":"2021-04-09 18:26:08.061226","last_unstale":"2021-04-09 18:26:14.119397","last_undegraded":"2021-04-09 18:26:14.119397","last_fullsized":"2021-04-09 18:26:14.119397","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'3","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:26:21.150479","last_change":"2021-04-09 18:26:11.084700","last_active":"2021-04-09 18:26:21.150479","last_peered":"2021-04-09 18:26:21.150479","last_clean":"2021-04-09 18:26:21.150479","last_became_active":"2021-04-09 18:26:11.084384","last_became_peered":"2021-04-09 18:26:11.084384","last_unstale":"2021-04-09 18:26:21.150479","last_undegraded":"2021-04-09 18:26:21.150479","last_fullsized":"2021-04-09 18:26:21.150479","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:10.064426","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:10.064426","last_clean_scrub_stamp":"2021-04-09 18:26:10.064426","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'1","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:26:14.726859","last_change":"2021-04-09 18:26:11.090114","last_active":"2021-04-09 18:26:14.726859","last_peered":"2021-04-09 18:26:14.726859","last_clean":"2021-04-09 18:26:14.726859","last_became_active":"2021-04-09 18:26:11.089745","last_became_peered":"2021-04-09 18:26:11.089745","last_unstale":"2021-04-09 18:26:14.726859","last_undegraded":"2021-04-09 18:26:14.726859","last_fullsized":"2021-04-09 18:26:14.726859","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:10.064426","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:10.064426","last_clean_scrub_stamp":"2021-04-09 18:26:10.064426","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.113869","last_change":"2021-04-09 18:26:08.058408","last_active":"2021-04-09 18:26:14.113869","last_peered":"2021-04-09 18:26:14.113869","last_clean":"2021-04-09 18:26:14.113869","last_became_active":"2021-04-09 18:26:08.058080","last_became_peered":"2021-04-09 18:26:08.058080","last_unstale":"2021-04-09 18:26:14.113869","last_undegraded":"2021-04-09 18:26:14.113869","last_fullsized":"2021-04-09 18:26:14.113869","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.134544","last_change":"2021-04-09 18:26:14.129564","last_active":"2021-04-09 18:26:14.134544","last_peered":"2021-04-09 18:26:14.134544","last_clean":"2021-04-09 18:26:14.134544","last_became_active":"2021-04-09 18:26:14.128878","last_became_peered":"2021-04-09 18:26:14.128878","last_unstale":"2021-04-09 18:26:14.134544","last_undegraded":"2021-04-09 18:26:14.134544","last_fullsized":"2021-04-09 18:26:14.134544","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:13.090116","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:13.090116","last_clean_scrub_stamp":"2021-04-09 18:26:13.090116","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.119864","last_change":"2021-04-09 18:26:08.054702","last_active":"2021-04-09 18:26:14.119864","last_peered":"2021-04-09 18:26:14.119864","last_clean":"2021-04-09 18:26:14.119864","last_became_active":"2021-04-09 18:26:08.054144","last_became_peered":"2021-04-09 18:26:08.054144","last_unstale":"2021-04-09 18:26:14.119864","last_undegraded":"2021-04-09 18:26:14.119864","last_fullsized":"2021-04-09 18:26:14.119864","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'7","reported_seq":"19","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:26:21.157359","last_change":"2021-04-09 18:26:11.089160","last_active":"2021-04-09 18:26:21.157359","last_peered":"2021-04-09 18:26:21.157359","last_clean":"2021-04-09 18:26:21.157359","last_became_active":"2021-04-09 18:26:11.088847","last_became_peered":"2021-04-09 18:26:11.088847","last_unstale":"2021-04-09 18:26:21.157359","last_undegraded":"2021-04-09 18:26:21.157359","last_fullsized":"2021-04-09 18:26:21.157359","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:10.064426","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:10.064426","last_clean_scrub_stamp":"2021-04-09 18:26:10.064426","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.127275","last_change":"2021-04-09 18:26:14.125615","last_active":"2021-04-09 18:26:14.127275","last_peered":"2021-04-09 18:26:14.127275","last_clean":"2021-04-09 18:26:14.127275","last_became_active":"2021-04-09 18:26:14.125185","last_became_peered":"2021-04-09 18:26:14.125185","last_unstale":"2021-04-09 18:26:14.127275","last_undegraded":"2021-04-09 18:26:14.127275","last_fullsized":"2021-04-09 18:26:14.127275","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:13.090116","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:13.090116","last_clean_scrub_stamp":"2021-04-09 18:26:13.090116","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.119218","last_change":"2021-04-09 18:26:08.061669","last_active":"2021-04-09 18:26:14.119218","last_peered":"2021-04-09 18:26:14.119218","last_clean":"2021-04-09 18:26:14.119218","last_became_active":"2021-04-09 18:26:08.060952","last_became_peered":"2021-04-09 18:26:08.060952","last_unstale":"2021-04-09 18:26:14.119218","last_undegraded":"2021-04-09 18:26:14.119218","last_fullsized":"2021-04-09 18:26:14.119218","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'5","reported_seq":"17","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:26:21.156059","last_change":"2021-04-09 18:26:11.091152","last_active":"2021-04-09 18:26:21.156059","last_peered":"2021-04-09 18:26:21.156059","last_clean":"2021-04-09 18:26:21.156059","last_became_active":"2021-04-09 18:26:11.090895","last_became_peered":"2021-04-09 18:26:11.090895","last_unstale":"2021-04-09 18:26:21.156059","last_undegraded":"2021-04-09 18:26:21.156059","last_fullsized":"2021-04-09 18:26:21.156059","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:10.064426","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:10.064426","last_clean_scrub_stamp":"2021-04-09 18:26:10.064426","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.132810","last_change":"2021-04-09 18:26:14.127675","last_active":"2021-04-09 18:26:14.132810","last_peered":"2021-04-09 18:26:14.132810","last_clean":"2021-04-09 18:26:14.132810","last_became_active":"2021-04-09 18:26:14.126970","last_became_peered":"2021-04-09 18:26:14.126970","last_unstale":"2021-04-09 18:26:14.132810","last_undegraded":"2021-04-09 18:26:14.132810","last_fullsized":"2021-04-09 18:26:14.132810","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:13.090116","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:13.090116","last_clean_scrub_stamp":"2021-04-09 18:26:13.090116","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.112299","last_change":"2021-04-09 18:26:11.086318","last_active":"2021-04-09 18:26:14.112299","last_peered":"2021-04-09 18:26:14.112299","last_clean":"2021-04-09 18:26:14.112299","last_became_active":"2021-04-09 18:26:11.085930","last_became_peered":"2021-04-09 18:26:11.085930","last_unstale":"2021-04-09 18:26:14.112299","last_undegraded":"2021-04-09 18:26:14.112299","last_fullsized":"2021-04-09 18:26:14.112299","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:10.064426","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:10.064426","last_clean_scrub_stamp":"2021-04-09 18:26:10.064426","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.119329","last_change":"2021-04-09 18:26:08.060814","last_active":"2021-04-09 18:26:14.119329","last_peered":"2021-04-09 18:26:14.119329","last_clean":"2021-04-09 18:26:14.119329","last_became_active":"2021-04-09 18:26:08.060463","last_became_peered":"2021-04-09 18:26:08.060463","last_unstale":"2021-04-09 18:26:14.119329","last_undegraded":"2021-04-09 18:26:14.119329","last_fullsized":"2021-04-09 18:26:14.119329","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.123772","last_change":"2021-04-09 18:26:14.117344","last_active":"2021-04-09 18:26:14.123772","last_peered":"2021-04-09 18:26:14.123772","last_clean":"2021-04-09 18:26:14.123772","last_became_active":"2021-04-09 18:26:14.116292","last_became_peered":"2021-04-09 18:26:14.116292","last_unstale":"2021-04-09 18:26:14.123772","last_undegraded":"2021-04-09 18:26:14.123772","last_fullsized":"2021-04-09 18:26:14.123772","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:13.090116","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:13.090116","last_clean_scrub_stamp":"2021-04-09 18:26:13.090116","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"22'8","reported_seq":"20","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:26:21.158644","last_change":"2021-04-09 18:26:11.087590","last_active":"2021-04-09 18:26:21.158644","last_peered":"2021-04-09 18:26:21.158644","last_clean":"2021-04-09 18:26:21.158644","last_became_active":"2021-04-09 18:26:11.087217","last_became_peered":"2021-04-09 18:26:11.087217","last_unstale":"2021-04-09 18:26:21.158644","last_undegraded":"2021-04-09 18:26:21.158644","last_fullsized":"2021-04-09 18:26:21.158644","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:10.064426","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:10.064426","last_clean_scrub_stamp":"2021-04-09 18:26:10.064426","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.108072","last_change":"2021-04-09 18:26:08.054741","last_active":"2021-04-09 18:26:14.108072","last_peered":"2021-04-09 18:26:14.108072","last_clean":"2021-04-09 18:26:14.108072","last_became_active":"2021-04-09 18:26:08.054184","last_became_peered":"2021-04-09 18:26:08.054184","last_unstale":"2021-04-09 18:26:14.108072","last_undegraded":"2021-04-09 18:26:14.108072","last_fullsized":"2021-04-09 18:26:14.108072","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.130298","last_change":"2021-04-09 18:26:14.127936","last_active":"2021-04-09 18:26:14.130298","last_peered":"2021-04-09 18:26:14.130298","last_clean":"2021-04-09 18:26:14.130298","last_became_active":"2021-04-09 18:26:14.127265","last_became_peered":"2021-04-09 18:26:14.127265","last_unstale":"2021-04-09 18:26:14.130298","last_undegraded":"2021-04-09 18:26:14.130298","last_fullsized":"2021-04-09 18:26:14.130298","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:13.090116","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:13.090116","last_clean_scrub_stamp":"2021-04-09 18:26:13.090116","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":83269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048816,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323024,"statfs":{"total":96636764160,"available":95562776576,"internally_reserved":1073741824,"allocated":237568,"data_stored":83109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":82577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":84069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":84229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":82577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]}]}]}} 2021-04-09T18:26:24.944 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-04-09T18:26:25.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.050 7f2b4be0c700 1 Processor -- start 2021-04-09T18:26:25.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.050 7f2b4be0c700 1 -- start start 2021-04-09T18:26:25.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b4be0c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2b440f5510 0x7f2b440f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:25.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b4be0c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2b440e9ad0 0x7f2b4409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:25.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b4be0c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b440fbb10 con 0x7f2b441c2da0 2021-04-09T18:26:25.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b4be0c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b440e9f20 con 0x7f2b440e9ad0 2021-04-09T18:26:25.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b4be0c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b440e59c0 con 0x7f2b440f5510 2021-04-09T18:26:25.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b4a3b1700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2b441c2da0 0x7f2b441c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50662/0 (socket says 172.21.15.79:50662) 2021-04-09T18:26:25.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b4a3b1700 1 -- 172.21.15.79:0/4028686690 learned_addr learned my addr 172.21.15.79:0/4028686690 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:25.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b493af700 1 --2- 172.21.15.79:0/4028686690 >> v2:172.21.15.79:3300/0 conn(0x7f2b440e9ad0 0x7f2b4409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:25.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b49bb0700 1 --2- 172.21.15.79:0/4028686690 >> v2:172.21.15.89:3300/0 conn(0x7f2b440f5510 0x7f2b440f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:25.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b48bae700 1 -- 172.21.15.79:0/4028686690 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710780738 0 0) 0x7f2b3c001450 con 0x7f2b441c2da0 2021-04-09T18:26:25.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b48bae700 1 -- 172.21.15.79:0/4028686690 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b30003240 con 0x7f2b441c2da0 2021-04-09T18:26:25.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b493af700 1 -- 172.21.15.79:0/4028686690 >> v2:172.21.15.89:3300/0 conn(0x7f2b440f5510 msgr2=0x7f2b440f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:25.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b48bae700 1 -- 172.21.15.79:0/4028686690 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2630720975 0 0) 0x7f2b3c0019d0 con 0x7f2b441c2da0 2021-04-09T18:26:25.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b493af700 1 --2- 172.21.15.79:0/4028686690 >> v2:172.21.15.89:3300/0 conn(0x7f2b440f5510 0x7f2b440f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:25.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b493af700 1 -- 172.21.15.79:0/4028686690 >> v1:172.21.15.79:6789/0 conn(0x7f2b441c2da0 legacy=0x7f2b441c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:25.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b493af700 1 -- 172.21.15.79:0/4028686690 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b440e56c0 con 0x7f2b440e9ad0 2021-04-09T18:26:25.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b493af700 1 --2- 172.21.15.79:0/4028686690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b440e9ad0 0x7f2b4409f100 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f2b3c002170 tx=0x7f2b3400bd10).ready entity=mon.0 client_cookie=4ae6cf56c2d285ee server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:25.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b48bae700 1 -- 172.21.15.79:0/4028686690 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2b440e56c0 con 0x7f2b440e9ad0 2021-04-09T18:26:25.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b48bae700 1 -- 172.21.15.79:0/4028686690 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b34009710 con 0x7f2b440e9ad0 2021-04-09T18:26:25.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b48bae700 1 -- 172.21.15.79:0/4028686690 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2b3c001f30 con 0x7f2b440e9ad0 2021-04-09T18:26:25.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b4be0c700 1 -- 172.21.15.79:0/4028686690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b440e9ad0 msgr2=0x7f2b4409f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:25.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b4be0c700 1 --2- 172.21.15.79:0/4028686690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b440e9ad0 0x7f2b4409f100 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f2b3c002170 tx=0x7f2b3400bd10).stop 2021-04-09T18:26:25.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b4be0c700 1 -- 172.21.15.79:0/4028686690 shutdown_connections 2021-04-09T18:26:25.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b4be0c700 1 --2- 172.21.15.79:0/4028686690 >> v2:172.21.15.89:3300/0 conn(0x7f2b440f5510 0x7f2b440f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:25.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b4be0c700 1 --2- 172.21.15.79:0/4028686690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b440e9ad0 0x7f2b4409f100 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:25.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b4be0c700 1 -- 172.21.15.79:0/4028686690 >> 172.21.15.79:0/4028686690 conn(0x7f2b440e5fd0 msgr2=0x7f2b440e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:25.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b4be0c700 1 -- 172.21.15.79:0/4028686690 shutdown_connections 2021-04-09T18:26:25.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.054 7f2b4be0c700 1 -- 172.21.15.79:0/4028686690 wait complete. 2021-04-09T18:26:25.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.058 7f2b4be0c700 1 Processor -- start 2021-04-09T18:26:25.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b4be0c700 1 -- start start 2021-04-09T18:26:25.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b4be0c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b441a0800 0x7f2b44096110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:25.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b4be0c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b440abe10 0x7f2b440ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:25.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b4be0c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b440cca30 0x7f2b440cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:25.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b4be0c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440ad300 con 0x7f2b440abe10 2021-04-09T18:26:25.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b4be0c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440ad600 con 0x7f2b441a0800 2021-04-09T18:26:25.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b4be0c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440ac890 con 0x7f2b440cca30 2021-04-09T18:26:25.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b493af700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b440abe10 0x7f2b440ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:25.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b493af700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b440abe10 0x7f2b440ac260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55960/0 (socket says 172.21.15.79:55960) 2021-04-09T18:26:25.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b493af700 1 -- 172.21.15.79:0/2905605680 learned_addr learned my addr 172.21.15.79:0/2905605680 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:25.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b4a3b1700 1 --2- 172.21.15.79:0/2905605680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b440cca30 0x7f2b440cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:25.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b49bb0700 1 --2- 172.21.15.79:0/2905605680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b441a0800 0x7f2b44096110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:25.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b493af700 1 -- 172.21.15.79:0/2905605680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b440cca30 msgr2=0x7f2b440cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:25.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b493af700 1 --2- 172.21.15.79:0/2905605680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b440cca30 0x7f2b440cce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:25.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b493af700 1 -- 172.21.15.79:0/2905605680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b441a0800 msgr2=0x7f2b44096110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:25.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b493af700 1 --2- 172.21.15.79:0/2905605680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b441a0800 0x7f2b44096110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:25.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b493af700 1 -- 172.21.15.79:0/2905605680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b441a0c50 con 0x7f2b440abe10 2021-04-09T18:26:25.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b493af700 1 --2- 172.21.15.79:0/2905605680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b440abe10 0x7f2b440ac260 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f2b440874c0 tx=0x7f2b34006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:25.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b3a7fc700 1 -- 172.21.15.79:0/2905605680 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2b34011d00 con 0x7f2b440abe10 2021-04-09T18:26:25.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b3a7fc700 1 -- 172.21.15.79:0/2905605680 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3401d440 con 0x7f2b440abe10 2021-04-09T18:26:25.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b4be0c700 1 -- 172.21.15.79:0/2905605680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b440aeb80 con 0x7f2b440abe10 2021-04-09T18:26:25.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b3a7fc700 1 -- 172.21.15.79:0/2905605680 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2b3401d810 con 0x7f2b440abe10 2021-04-09T18:26:25.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.062 7f2b4be0c700 1 -- 172.21.15.79:0/2905605680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b44096d90 con 0x7f2b440abe10 2021-04-09T18:26:25.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.066 7f2b3a7fc700 1 -- 172.21.15.79:0/2905605680 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2b34026450 con 0x7f2b440abe10 2021-04-09T18:26:25.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.066 7f2b3a7fc700 1 --2- 172.21.15.79:0/2905605680 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2b2c029100 0x7f2b2c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:25.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.066 7f2b3a7fc700 1 -- 172.21.15.79:0/2905605680 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f2b3403aee0 con 0x7f2b440abe10 2021-04-09T18:26:25.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.066 7f2b49bb0700 1 --2- 172.21.15.79:0/2905605680 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2b2c029100 0x7f2b2c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:25.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.066 7f2b49bb0700 1 --2- 172.21.15.79:0/2905605680 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2b2c029100 0x7f2b2c02b650 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:25.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.066 7f2b4be0c700 1 -- 172.21.15.79:0/2905605680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b440e39d0 con 0x7f2b440abe10 2021-04-09T18:26:25.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.070 7f2b3a7fc700 1 -- 172.21.15.79:0/2905605680 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2b34011af0 con 0x7f2b440abe10 2021-04-09T18:26:25.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.234 7f2b4be0c700 1 -- 172.21.15.79:0/2905605680 --> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f2b440f5b10 con 0x7f2b2c029100 2021-04-09T18:26:25.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.242 7f2b3a7fc700 1 -- 172.21.15.79:0/2905605680 <== mgr.4100 v2:172.21.15.89:6800/13779 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+77369 (crc 0 0 0) 0x7f2b440f5b10 con 0x7f2b2c029100 2021-04-09T18:26:25.250 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2021-04-09T18:26:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:25.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.246 7f2b4be0c700 1 -- 172.21.15.79:0/2905605680 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2b2c029100 msgr2=0x7f2b2c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:25.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.246 7f2b4be0c700 1 --2- 172.21.15.79:0/2905605680 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2b2c029100 0x7f2b2c02b650 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:25.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.246 7f2b4be0c700 1 -- 172.21.15.79:0/2905605680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b440abe10 msgr2=0x7f2b440ac260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:25.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.246 7f2b4be0c700 1 --2- 172.21.15.79:0/2905605680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b440abe10 0x7f2b440ac260 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f2b440874c0 tx=0x7f2b34006890).stop 2021-04-09T18:26:25.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.246 7f2b4be0c700 1 -- 172.21.15.79:0/2905605680 shutdown_connections 2021-04-09T18:26:25.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.246 7f2b4be0c700 1 --2- 172.21.15.79:0/2905605680 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2b2c029100 0x7f2b2c02b650 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:25.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.246 7f2b4be0c700 1 --2- 172.21.15.79:0/2905605680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b441a0800 0x7f2b44096110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:25.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.246 7f2b4be0c700 1 --2- 172.21.15.79:0/2905605680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b440cca30 0x7f2b440cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:25.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.246 7f2b4be0c700 1 --2- 172.21.15.79:0/2905605680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b440abe10 0x7f2b440ac260 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:25.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.246 7f2b4be0c700 1 -- 172.21.15.79:0/2905605680 >> 172.21.15.79:0/2905605680 conn(0x7f2b441a1130 msgr2=0x7f2b44095520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:25.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.246 7f2b4be0c700 1 -- 172.21.15.79:0/2905605680 shutdown_connections 2021-04-09T18:26:25.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.246 7f2b4be0c700 1 -- 172.21.15.79:0/2905605680 wait complete. 2021-04-09T18:26:25.263 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2021-04-09 18:26:23.952016","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":8390528,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584192,"statfs":{"total":773094113280,"available":764502212608,"internally_reserved":8589934592,"allocated":1900544,"data_stored":664916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.113787","last_change":"2021-04-09 18:26:08.058514","last_active":"2021-04-09 18:26:14.113787","last_peered":"2021-04-09 18:26:14.113787","last_clean":"2021-04-09 18:26:14.113787","last_became_active":"2021-04-09 18:26:08.058166","last_became_peered":"2021-04-09 18:26:08.058166","last_unstale":"2021-04-09 18:26:14.113787","last_undegraded":"2021-04-09 18:26:14.113787","last_fullsized":"2021-04-09 18:26:14.113787","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"22'8","reported_seq":"20","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:26:21.154367","last_change":"2021-04-09 18:26:11.082149","last_active":"2021-04-09 18:26:21.154367","last_peered":"2021-04-09 18:26:21.154367","last_clean":"2021-04-09 18:26:21.154367","last_became_active":"2021-04-09 18:26:11.081851","last_became_peered":"2021-04-09 18:26:11.081851","last_unstale":"2021-04-09 18:26:21.154367","last_undegraded":"2021-04-09 18:26:21.154367","last_fullsized":"2021-04-09 18:26:21.154367","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:10.064426","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:10.064426","last_clean_scrub_stamp":"2021-04-09 18:26:10.064426","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.134411","last_change":"2021-04-09 18:26:14.129558","last_active":"2021-04-09 18:26:14.134411","last_peered":"2021-04-09 18:26:14.134411","last_clean":"2021-04-09 18:26:14.134411","last_became_active":"2021-04-09 18:26:14.129055","last_became_peered":"2021-04-09 18:26:14.129055","last_unstale":"2021-04-09 18:26:14.134411","last_undegraded":"2021-04-09 18:26:14.134411","last_fullsized":"2021-04-09 18:26:14.134411","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:13.090116","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:13.090116","last_clean_scrub_stamp":"2021-04-09 18:26:13.090116","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.113619","last_change":"2021-04-09 18:26:08.061036","last_active":"2021-04-09 18:26:14.113619","last_peered":"2021-04-09 18:26:14.113619","last_clean":"2021-04-09 18:26:14.113619","last_became_active":"2021-04-09 18:26:08.060740","last_became_peered":"2021-04-09 18:26:08.060740","last_unstale":"2021-04-09 18:26:14.113619","last_undegraded":"2021-04-09 18:26:14.113619","last_fullsized":"2021-04-09 18:26:14.113619","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"22'6","reported_seq":"18","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:26:21.156720","last_change":"2021-04-09 18:26:11.089522","last_active":"2021-04-09 18:26:21.156720","last_peered":"2021-04-09 18:26:21.156720","last_clean":"2021-04-09 18:26:21.156720","last_became_active":"2021-04-09 18:26:11.088658","last_became_peered":"2021-04-09 18:26:11.088658","last_unstale":"2021-04-09 18:26:21.156720","last_undegraded":"2021-04-09 18:26:21.156720","last_fullsized":"2021-04-09 18:26:21.156720","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:10.064426","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:10.064426","last_clean_scrub_stamp":"2021-04-09 18:26:10.064426","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.123737","last_change":"2021-04-09 18:26:14.116606","last_active":"2021-04-09 18:26:14.123737","last_peered":"2021-04-09 18:26:14.123737","last_clean":"2021-04-09 18:26:14.123737","last_became_active":"2021-04-09 18:26:14.116130","last_became_peered":"2021-04-09 18:26:14.116130","last_unstale":"2021-04-09 18:26:14.123737","last_undegraded":"2021-04-09 18:26:14.123737","last_fullsized":"2021-04-09 18:26:14.123737","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:13.090116","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:13.090116","last_clean_scrub_stamp":"2021-04-09 18:26:13.090116","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.132825","last_change":"2021-04-09 18:26:14.127728","last_active":"2021-04-09 18:26:14.132825","last_peered":"2021-04-09 18:26:14.132825","last_clean":"2021-04-09 18:26:14.132825","last_became_active":"2021-04-09 18:26:14.127252","last_became_peered":"2021-04-09 18:26:14.127252","last_unstale":"2021-04-09 18:26:14.132825","last_undegraded":"2021-04-09 18:26:14.132825","last_fullsized":"2021-04-09 18:26:14.132825","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:13.090116","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:13.090116","last_clean_scrub_stamp":"2021-04-09 18:26:13.090116","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.119397","last_change":"2021-04-09 18:26:08.061551","last_active":"2021-04-09 18:26:14.119397","last_peered":"2021-04-09 18:26:14.119397","last_clean":"2021-04-09 18:26:14.119397","last_became_active":"2021-04-09 18:26:08.061226","last_became_peered":"2021-04-09 18:26:08.061226","last_unstale":"2021-04-09 18:26:14.119397","last_undegraded":"2021-04-09 18:26:14.119397","last_fullsized":"2021-04-09 18:26:14.119397","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'3","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:26:21.150479","last_change":"2021-04-09 18:26:11.084700","last_active":"2021-04-09 18:26:21.150479","last_peered":"2021-04-09 18:26:21.150479","last_clean":"2021-04-09 18:26:21.150479","last_became_active":"2021-04-09 18:26:11.084384","last_became_peered":"2021-04-09 18:26:11.084384","last_unstale":"2021-04-09 18:26:21.150479","last_undegraded":"2021-04-09 18:26:21.150479","last_fullsized":"2021-04-09 18:26:21.150479","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:10.064426","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:10.064426","last_clean_scrub_stamp":"2021-04-09 18:26:10.064426","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'1","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:26:14.726859","last_change":"2021-04-09 18:26:11.090114","last_active":"2021-04-09 18:26:14.726859","last_peered":"2021-04-09 18:26:14.726859","last_clean":"2021-04-09 18:26:14.726859","last_became_active":"2021-04-09 18:26:11.089745","last_became_peered":"2021-04-09 18:26:11.089745","last_unstale":"2021-04-09 18:26:14.726859","last_undegraded":"2021-04-09 18:26:14.726859","last_fullsized":"2021-04-09 18:26:14.726859","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:10.064426","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:10.064426","last_clean_scrub_stamp":"2021-04-09 18:26:10.064426","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.113869","last_change":"2021-04-09 18:26:08.058408","last_active":"2021-04-09 18:26:14.113869","last_peered":"2021-04-09 18:26:14.113869","last_clean":"2021-04-09 18:26:14.113869","last_became_active":"2021-04-09 18:26:08.058080","last_became_peered":"2021-04-09 18:26:08.058080","last_unstale":"2021-04-09 18:26:14.113869","last_undegraded":"2021-04-09 18:26:14.113869","last_fullsized":"2021-04-09 18:26:14.113869","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.134544","last_change":"2021-04-09 18:26:14.129564","last_active":"2021-04-09 18:26:14.134544","last_peered":"2021-04-09 18:26:14.134544","last_clean":"2021-04-09 18:26:14.134544","last_became_active":"2021-04-09 18:26:14.128878","last_became_peered":"2021-04-09 18:26:14.128878","last_unstale":"2021-04-09 18:26:14.134544","last_undegraded":"2021-04-09 18:26:14.134544","last_fullsized":"2021-04-09 18:26:14.134544","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:13.090116","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:13.090116","last_clean_scrub_stamp":"2021-04-09 18:26:13.090116","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.119864","last_change":"2021-04-09 18:26:08.054702","last_active":"2021-04-09 18:26:14.119864","last_peered":"2021-04-09 18:26:14.119864","last_clean":"2021-04-09 18:26:14.119864","last_became_active":"2021-04-09 18:26:08.054144","last_became_peered":"2021-04-09 18:26:08.054144","last_unstale":"2021-04-09 18:26:14.119864","last_undegraded":"2021-04-09 18:26:14.119864","last_fullsized":"2021-04-09 18:26:14.119864","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'7","reported_seq":"19","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:26:21.157359","last_change":"2021-04-09 18:26:11.089160","last_active":"2021-04-09 18:26:21.157359","last_peered":"2021-04-09 18:26:21.157359","last_clean":"2021-04-09 18:26:21.157359","last_became_active":"2021-04-09 18:26:11.088847","last_became_peered":"2021-04-09 18:26:11.088847","last_unstale":"2021-04-09 18:26:21.157359","last_undegraded":"2021-04-09 18:26:21.157359","last_fullsized":"2021-04-09 18:26:21.157359","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:10.064426","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:10.064426","last_clean_scrub_stamp":"2021-04-09 18:26:10.064426","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.127275","last_change":"2021-04-09 18:26:14.125615","last_active":"2021-04-09 18:26:14.127275","last_peered":"2021-04-09 18:26:14.127275","last_clean":"2021-04-09 18:26:14.127275","last_became_active":"2021-04-09 18:26:14.125185","last_became_peered":"2021-04-09 18:26:14.125185","last_unstale":"2021-04-09 18:26:14.127275","last_undegraded":"2021-04-09 18:26:14.127275","last_fullsized":"2021-04-09 18:26:14.127275","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:13.090116","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:13.090116","last_clean_scrub_stamp":"2021-04-09 18:26:13.090116","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.119218","last_change":"2021-04-09 18:26:08.061669","last_active":"2021-04-09 18:26:14.119218","last_peered":"2021-04-09 18:26:14.119218","last_clean":"2021-04-09 18:26:14.119218","last_became_active":"2021-04-09 18:26:08.060952","last_became_peered":"2021-04-09 18:26:08.060952","last_unstale":"2021-04-09 18:26:14.119218","last_undegraded":"2021-04-09 18:26:14.119218","last_fullsized":"2021-04-09 18:26:14.119218","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'5","reported_seq":"17","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:26:21.156059","last_change":"2021-04-09 18:26:11.091152","last_active":"2021-04-09 18:26:21.156059","last_peered":"2021-04-09 18:26:21.156059","last_clean":"2021-04-09 18:26:21.156059","last_became_active":"2021-04-09 18:26:11.090895","last_became_peered":"2021-04-09 18:26:11.090895","last_unstale":"2021-04-09 18:26:21.156059","last_undegraded":"2021-04-09 18:26:21.156059","last_fullsized":"2021-04-09 18:26:21.156059","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:10.064426","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:10.064426","last_clean_scrub_stamp":"2021-04-09 18:26:10.064426","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.132810","last_change":"2021-04-09 18:26:14.127675","last_active":"2021-04-09 18:26:14.132810","last_peered":"2021-04-09 18:26:14.132810","last_clean":"2021-04-09 18:26:14.132810","last_became_active":"2021-04-09 18:26:14.126970","last_became_peered":"2021-04-09 18:26:14.126970","last_unstale":"2021-04-09 18:26:14.132810","last_undegraded":"2021-04-09 18:26:14.132810","last_fullsized":"2021-04-09 18:26:14.132810","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:13.090116","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:13.090116","last_clean_scrub_stamp":"2021-04-09 18:26:13.090116","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.112299","last_change":"2021-04-09 18:26:11.086318","last_active":"2021-04-09 18:26:14.112299","last_peered":"2021-04-09 18:26:14.112299","last_clean":"2021-04-09 18:26:14.112299","last_became_active":"2021-04-09 18:26:11.085930","last_became_peered":"2021-04-09 18:26:11.085930","last_unstale":"2021-04-09 18:26:14.112299","last_undegraded":"2021-04-09 18:26:14.112299","last_fullsized":"2021-04-09 18:26:14.112299","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:10.064426","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:10.064426","last_clean_scrub_stamp":"2021-04-09 18:26:10.064426","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.119329","last_change":"2021-04-09 18:26:08.060814","last_active":"2021-04-09 18:26:14.119329","last_peered":"2021-04-09 18:26:14.119329","last_clean":"2021-04-09 18:26:14.119329","last_became_active":"2021-04-09 18:26:08.060463","last_became_peered":"2021-04-09 18:26:08.060463","last_unstale":"2021-04-09 18:26:14.119329","last_undegraded":"2021-04-09 18:26:14.119329","last_fullsized":"2021-04-09 18:26:14.119329","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.123772","last_change":"2021-04-09 18:26:14.117344","last_active":"2021-04-09 18:26:14.123772","last_peered":"2021-04-09 18:26:14.123772","last_clean":"2021-04-09 18:26:14.123772","last_became_active":"2021-04-09 18:26:14.116292","last_became_peered":"2021-04-09 18:26:14.116292","last_unstale":"2021-04-09 18:26:14.123772","last_undegraded":"2021-04-09 18:26:14.123772","last_fullsized":"2021-04-09 18:26:14.123772","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:13.090116","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:13.090116","last_clean_scrub_stamp":"2021-04-09 18:26:13.090116","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"22'8","reported_seq":"20","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:26:21.158644","last_change":"2021-04-09 18:26:11.087590","last_active":"2021-04-09 18:26:21.158644","last_peered":"2021-04-09 18:26:21.158644","last_clean":"2021-04-09 18:26:21.158644","last_became_active":"2021-04-09 18:26:11.087217","last_became_peered":"2021-04-09 18:26:11.087217","last_unstale":"2021-04-09 18:26:21.158644","last_undegraded":"2021-04-09 18:26:21.158644","last_fullsized":"2021-04-09 18:26:21.158644","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:10.064426","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:10.064426","last_clean_scrub_stamp":"2021-04-09 18:26:10.064426","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.108072","last_change":"2021-04-09 18:26:08.054741","last_active":"2021-04-09 18:26:14.108072","last_peered":"2021-04-09 18:26:14.108072","last_clean":"2021-04-09 18:26:14.108072","last_became_active":"2021-04-09 18:26:08.054184","last_became_peered":"2021-04-09 18:26:08.054184","last_unstale":"2021-04-09 18:26:14.108072","last_undegraded":"2021-04-09 18:26:14.108072","last_fullsized":"2021-04-09 18:26:14.108072","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:26:14.130298","last_change":"2021-04-09 18:26:14.127936","last_active":"2021-04-09 18:26:14.130298","last_peered":"2021-04-09 18:26:14.130298","last_clean":"2021-04-09 18:26:14.130298","last_became_active":"2021-04-09 18:26:14.127265","last_became_peered":"2021-04-09 18:26:14.127265","last_unstale":"2021-04-09 18:26:14.130298","last_undegraded":"2021-04-09 18:26:14.130298","last_fullsized":"2021-04-09 18:26:14.130298","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:13.090116","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:13.090116","last_clean_scrub_stamp":"2021-04-09 18:26:13.090116","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":83269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048816,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323024,"statfs":{"total":96636764160,"available":95562776576,"internally_reserved":1073741824,"allocated":237568,"data_stored":83109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":82577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":84069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":84229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":82577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]}]}]}} 2021-04-09T18:26:25.267 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json-pretty 2021-04-09T18:26:25.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f56253d1700 1 Processor -- start 2021-04-09T18:26:25.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f56253d1700 1 -- start start 2021-04-09T18:26:25.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f56253d1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56200f5520 0x7f56200f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:25.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f56253d1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f56201c8010 0x7f56201ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:25.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f56253d1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56200fbb20 con 0x7f56200e9ae0 2021-04-09T18:26:25.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f56253d1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56200e9f30 con 0x7f56201c8010 2021-04-09T18:26:25.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f56253d1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56201c3dc0 con 0x7f56200f5520 2021-04-09T18:26:25.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f561f806700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f56201c8010 0x7f56201ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:25.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f561f005700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56200f5520 0x7f56200f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:25.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f561f806700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f56201c8010 0x7f56201ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:44310/0 (socket says 172.21.15.79:44310) 2021-04-09T18:26:25.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f561f005700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56200f5520 0x7f56200f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:52960/0 (socket says 172.21.15.79:52960) 2021-04-09T18:26:25.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f561f806700 1 -- 172.21.15.79:0/3455441857 learned_addr learned my addr 172.21.15.79:0/3455441857 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:25.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f5616804700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f56200e9ae0 0x7f562009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:51146/0 (socket says 172.21.15.79:51146) 2021-04-09T18:26:25.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f561f806700 1 -- 172.21.15.79:0/3455441857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56200f5520 msgr2=0x7f56200f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:25.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f561f806700 1 --2- 172.21.15.79:0/3455441857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56200f5520 0x7f56200f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:25.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f561f806700 1 -- 172.21.15.79:0/3455441857 >> v1:172.21.15.89:6789/0 conn(0x7f56200e9ae0 legacy=0x7f562009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:25.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f561e804700 1 -- 172.21.15.79:0/3455441857 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103732643 0 0) 0x7f56080010d0 con 0x7f56200e9ae0 2021-04-09T18:26:25.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f561f806700 1 -- 172.21.15.79:0/3455441857 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562009f910 con 0x7f56201c8010 2021-04-09T18:26:25.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f561f005700 1 --2- 172.21.15.79:0/3455441857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56200f5520 0x7f56200f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:25.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f561f806700 1 --2- 172.21.15.79:0/3455441857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56201c8010 0x7f56201ca470 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f56180032b0 tx=0x7f561800b3c0).ready entity=mon.1 client_cookie=374e0826eabb0c4d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:25.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f561e804700 1 -- 172.21.15.79:0/3455441857 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f562009f910 con 0x7f56201c8010 2021-04-09T18:26:25.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f561e804700 1 -- 172.21.15.79:0/3455441857 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561800bc20 con 0x7f56201c8010 2021-04-09T18:26:25.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f561e804700 1 -- 172.21.15.79:0/3455441857 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5618002020 con 0x7f56201c8010 2021-04-09T18:26:25.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f56253d1700 1 -- 172.21.15.79:0/3455441857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56201c8010 msgr2=0x7f56201ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:25.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.354 7f56253d1700 1 --2- 172.21.15.79:0/3455441857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56201c8010 0x7f56201ca470 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f56180032b0 tx=0x7f561800b3c0).stop 2021-04-09T18:26:25.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.358 7f56253d1700 1 -- 172.21.15.79:0/3455441857 shutdown_connections 2021-04-09T18:26:25.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.358 7f56253d1700 1 --2- 172.21.15.79:0/3455441857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56201c8010 0x7f56201ca470 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:25.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.358 7f56253d1700 1 --2- 172.21.15.79:0/3455441857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56200f5520 0x7f56200f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:25.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.358 7f56253d1700 1 -- 172.21.15.79:0/3455441857 >> 172.21.15.79:0/3455441857 conn(0x7f56200e5fe0 msgr2=0x7f56200e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:25.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.358 7f56253d1700 1 -- 172.21.15.79:0/3455441857 shutdown_connections 2021-04-09T18:26:25.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.358 7f56253d1700 1 -- 172.21.15.79:0/3455441857 wait complete. 2021-04-09T18:26:25.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f56253d1700 1 Processor -- start 2021-04-09T18:26:25.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f56253d1700 1 -- start start 2021-04-09T18:26:25.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f56253d1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56200cfea0 0x7f562008efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:25.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f56253d1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56200d6560 0x7f56200ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:25.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f56253d1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56200ceda0 0x7f562008fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:25.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f56253d1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56200d6260 con 0x7f56200ceda0 2021-04-09T18:26:25.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f56253d1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56200d02f0 con 0x7f56200cfea0 2021-04-09T18:26:25.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f56253d1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56200d5e10 con 0x7f56200d6560 2021-04-09T18:26:25.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f561f806700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56200ceda0 0x7f562008fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:25.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f561f806700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56200ceda0 0x7f562008fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55974/0 (socket says 172.21.15.79:55974) 2021-04-09T18:26:25.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f561f806700 1 -- 172.21.15.79:0/752927305 learned_addr learned my addr 172.21.15.79:0/752927305 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:25.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f5616804700 1 --2- 172.21.15.79:0/752927305 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56200d6560 0x7f56200ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:25.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f561f005700 1 --2- 172.21.15.79:0/752927305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56200cfea0 0x7f562008efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:25.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f561f806700 1 -- 172.21.15.79:0/752927305 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56200d6560 msgr2=0x7f56200ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:25.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f561f806700 1 --2- 172.21.15.79:0/752927305 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56200d6560 0x7f56200ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:25.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f561f806700 1 -- 172.21.15.79:0/752927305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56200cfea0 msgr2=0x7f562008efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:25.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f561f806700 1 --2- 172.21.15.79:0/752927305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56200cfea0 0x7f562008efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:25.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f561f806700 1 -- 172.21.15.79:0/752927305 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562009a930 con 0x7f56200ceda0 2021-04-09T18:26:25.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f561f806700 1 --2- 172.21.15.79:0/752927305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56200ceda0 0x7f562008fd10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f56200d61e0 tx=0x7f5618006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:25.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f561c800700 1 -- 172.21.15.79:0/752927305 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f562009a930 con 0x7f56200ceda0 2021-04-09T18:26:25.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f561c800700 1 -- 172.21.15.79:0/752927305 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561801a5d0 con 0x7f56200ceda0 2021-04-09T18:26:25.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f56253d1700 1 -- 172.21.15.79:0/752927305 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56200d69b0 con 0x7f56200ceda0 2021-04-09T18:26:25.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f561c800700 1 -- 172.21.15.79:0/752927305 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5618020020 con 0x7f56200ceda0 2021-04-09T18:26:25.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.362 7f56253d1700 1 -- 172.21.15.79:0/752927305 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5620090340 con 0x7f56200ceda0 2021-04-09T18:26:25.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.366 7f561c800700 1 -- 172.21.15.79:0/752927305 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5618019040 con 0x7f56200ceda0 2021-04-09T18:26:25.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.366 7f561c800700 1 --2- 172.21.15.79:0/752927305 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5604029100 0x7f560402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:25.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.366 7f561c800700 1 -- 172.21.15.79:0/752927305 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f5618018040 con 0x7f56200ceda0 2021-04-09T18:26:25.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.366 7f561f005700 1 --2- 172.21.15.79:0/752927305 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5604029100 0x7f560402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:25.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.366 7f561f005700 1 --2- 172.21.15.79:0/752927305 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5604029100 0x7f560402b650 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:25.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.366 7f56253d1700 1 -- 172.21.15.79:0/752927305 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56200e39e0 con 0x7f56200ceda0 2021-04-09T18:26:25.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.374 7f561c800700 1 -- 172.21.15.79:0/752927305 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f561800ba10 con 0x7f56200ceda0 2021-04-09T18:26:25.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.546 7f56253d1700 1 -- 172.21.15.79:0/752927305 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f56200f5b20 con 0x7f56200ceda0 2021-04-09T18:26:25.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.550 7f561c800700 1 -- 172.21.15.79:0/752927305 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+211657 (secure 0 0 0) 0x7f561801a3c0 con 0x7f56200ceda0 2021-04-09T18:26:25.571 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:25.571 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:26:25.571 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:26:25.571 INFO:teuthology.orchestra.run.smithi079.stdout: "health": { 2021-04-09T18:26:25.572 INFO:teuthology.orchestra.run.smithi079.stdout: "checks": {}, 2021-04-09T18:26:25.572 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "HEALTH_OK" 2021-04-09T18:26:25.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.572 INFO:teuthology.orchestra.run.smithi079.stdout: "election_epoch": 8, 2021-04-09T18:26:25.573 INFO:teuthology.orchestra.run.smithi079.stdout: "quorum": [ 2021-04-09T18:26:25.573 INFO:teuthology.orchestra.run.smithi079.stdout: 0, 2021-04-09T18:26:25.573 INFO:teuthology.orchestra.run.smithi079.stdout: 1, 2021-04-09T18:26:25.573 INFO:teuthology.orchestra.run.smithi079.stdout: 2 2021-04-09T18:26:25.574 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:26:25.574 INFO:teuthology.orchestra.run.smithi079.stdout: "quorum_names": [ 2021-04-09T18:26:25.574 INFO:teuthology.orchestra.run.smithi079.stdout: "a", 2021-04-09T18:26:25.574 INFO:teuthology.orchestra.run.smithi079.stdout: "b", 2021-04-09T18:26:25.574 INFO:teuthology.orchestra.run.smithi079.stdout: "c" 2021-04-09T18:26:25.575 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:26:25.575 INFO:teuthology.orchestra.run.smithi079.stdout: "quorum_age": 32, 2021-04-09T18:26:25.575 INFO:teuthology.orchestra.run.smithi079.stdout: "monmap": { 2021-04-09T18:26:25.575 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 1, 2021-04-09T18:26:25.576 INFO:teuthology.orchestra.run.smithi079.stdout: "min_mon_release_name": "14", 2021-04-09T18:26:25.576 INFO:teuthology.orchestra.run.smithi079.stdout: "num_mons": 3 2021-04-09T18:26:25.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.576 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap": { 2021-04-09T18:26:25.577 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap": { 2021-04-09T18:26:25.577 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 22, 2021-04-09T18:26:25.577 INFO:teuthology.orchestra.run.smithi079.stdout: "num_osds": 8, 2021-04-09T18:26:25.577 INFO:teuthology.orchestra.run.smithi079.stdout: "num_up_osds": 8, 2021-04-09T18:26:25.577 INFO:teuthology.orchestra.run.smithi079.stdout: "num_in_osds": 8, 2021-04-09T18:26:25.578 INFO:teuthology.orchestra.run.smithi079.stdout: "num_remapped_pgs": 0 2021-04-09T18:26:25.578 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.578 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap": { 2021-04-09T18:26:25.579 INFO:teuthology.orchestra.run.smithi079.stdout: "pgs_by_state": [ 2021-04-09T18:26:25.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.579 INFO:teuthology.orchestra.run.smithi079.stdout: "state_name": "active+clean", 2021-04-09T18:26:25.579 INFO:teuthology.orchestra.run.smithi079.stdout: "count": 24 2021-04-09T18:26:25.580 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.580 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:26:25.580 INFO:teuthology.orchestra.run.smithi079.stdout: "num_pgs": 24, 2021-04-09T18:26:25.581 INFO:teuthology.orchestra.run.smithi079.stdout: "num_pools": 3, 2021-04-09T18:26:25.581 INFO:teuthology.orchestra.run.smithi079.stdout: "num_objects": 21, 2021-04-09T18:26:25.581 INFO:teuthology.orchestra.run.smithi079.stdout: "data_bytes": 2286, 2021-04-09T18:26:25.582 INFO:teuthology.orchestra.run.smithi079.stdout: "bytes_used": 8591900672, 2021-04-09T18:26:25.582 INFO:teuthology.orchestra.run.smithi079.stdout: "bytes_avail": 764502212608, 2021-04-09T18:26:25.582 INFO:teuthology.orchestra.run.smithi079.stdout: "bytes_total": 773094113280 2021-04-09T18:26:25.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.583 INFO:teuthology.orchestra.run.smithi079.stdout: "fsmap": { 2021-04-09T18:26:25.583 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 6, 2021-04-09T18:26:25.583 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 1, 2021-04-09T18:26:25.583 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:26:25.584 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:26:25.584 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 1, 2021-04-09T18:26:25.584 INFO:teuthology.orchestra.run.smithi079.stdout: "by_rank": [ 2021-04-09T18:26:25.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.585 INFO:teuthology.orchestra.run.smithi079.stdout: "filesystem_id": 1, 2021-04-09T18:26:25.585 INFO:teuthology.orchestra.run.smithi079.stdout: "rank": 0, 2021-04-09T18:26:25.585 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "a", 2021-04-09T18:26:25.586 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "up:active", 2021-04-09T18:26:25.586 INFO:teuthology.orchestra.run.smithi079.stdout: "gid": 4338 2021-04-09T18:26:25.586 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.586 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:26:25.587 INFO:teuthology.orchestra.run.smithi079.stdout: "up:standby": 1 2021-04-09T18:26:25.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.587 INFO:teuthology.orchestra.run.smithi079.stdout: "mgrmap": { 2021-04-09T18:26:25.587 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 3, 2021-04-09T18:26:25.588 INFO:teuthology.orchestra.run.smithi079.stdout: "active_gid": 4100, 2021-04-09T18:26:25.588 INFO:teuthology.orchestra.run.smithi079.stdout: "active_name": "x", 2021-04-09T18:26:25.588 INFO:teuthology.orchestra.run.smithi079.stdout: "active_addrs": { 2021-04-09T18:26:25.588 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:25.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.589 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:25.589 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6800", 2021-04-09T18:26:25.589 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13779 2021-04-09T18:26:25.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.590 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:25.590 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6801", 2021-04-09T18:26:25.590 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13779 2021-04-09T18:26:25.591 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.591 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:25.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.591 INFO:teuthology.orchestra.run.smithi079.stdout: "active_addr": "172.21.15.89:6801/13779", 2021-04-09T18:26:25.592 INFO:teuthology.orchestra.run.smithi079.stdout: "active_change": "2021-04-09 18:25:55.935878", 2021-04-09T18:26:25.592 INFO:teuthology.orchestra.run.smithi079.stdout: "available": true, 2021-04-09T18:26:25.592 INFO:teuthology.orchestra.run.smithi079.stdout: "standbys": [ 2021-04-09T18:26:25.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.592 INFO:teuthology.orchestra.run.smithi079.stdout: "gid": 4104, 2021-04-09T18:26:25.593 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "y", 2021-04-09T18:26:25.593 INFO:teuthology.orchestra.run.smithi079.stdout: "available_modules": [ 2021-04-09T18:26:25.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.594 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "alerts", 2021-04-09T18:26:25.594 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:25.594 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:25.594 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:25.595 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2021-04-09T18:26:25.595 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2021-04-09T18:26:25.595 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:25.595 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.595 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.596 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2021-04-09T18:26:25.596 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.596 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.597 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.597 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How frequently to reexamine health status", 2021-04-09T18:26:25.597 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.598 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.598 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.598 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_destination": { 2021-04-09T18:26:25.598 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_destination", 2021-04-09T18:26:25.599 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.599 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.599 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.599 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.600 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.600 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.600 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.601 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Email address to send alerts to", 2021-04-09T18:26:25.601 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.601 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.601 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.602 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_from_name": { 2021-04-09T18:26:25.602 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_from_name", 2021-04-09T18:26:25.602 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.603 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.603 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.603 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "Ceph", 2021-04-09T18:26:25.603 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.604 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.604 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.604 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Email From: name", 2021-04-09T18:26:25.604 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.604 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.605 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.605 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_host": { 2021-04-09T18:26:25.605 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_host", 2021-04-09T18:26:25.606 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.606 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.606 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.606 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.606 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.607 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.607 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.607 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP server", 2021-04-09T18:26:25.607 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.608 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.608 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.609 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_password": { 2021-04-09T18:26:25.609 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_password", 2021-04-09T18:26:25.609 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.610 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.610 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.610 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.610 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.611 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.611 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.611 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Password to authenticate with", 2021-04-09T18:26:25.612 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.612 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.612 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.613 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_port": { 2021-04-09T18:26:25.613 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_port", 2021-04-09T18:26:25.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:25.613 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.613 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.614 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "465", 2021-04-09T18:26:25.614 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.614 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.615 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.615 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP port", 2021-04-09T18:26:25.615 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.616 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.616 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.616 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_sender": { 2021-04-09T18:26:25.617 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_sender", 2021-04-09T18:26:25.617 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.617 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.617 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.618 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.618 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.618 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.618 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.619 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP envelope sender", 2021-04-09T18:26:25.619 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.619 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.620 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.620 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_ssl": { 2021-04-09T18:26:25.620 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_ssl", 2021-04-09T18:26:25.621 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:25.621 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.621 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.621 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:25.622 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.622 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.622 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.622 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use SSL to connect to SMTP server", 2021-04-09T18:26:25.623 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.623 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.623 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.623 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_user": { 2021-04-09T18:26:25.624 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_user", 2021-04-09T18:26:25.624 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.624 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.624 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.625 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.625 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.625 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.625 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.626 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "User to authenticate as", 2021-04-09T18:26:25.626 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.626 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.626 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.628 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ansible", 2021-04-09T18:26:25.628 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:25.628 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:25.628 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:25.628 INFO:teuthology.orchestra.run.smithi079.stdout: "password": { 2021-04-09T18:26:25.629 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "password", 2021-04-09T18:26:25.629 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.629 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.629 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.630 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.630 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.630 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.630 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.631 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.631 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.631 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.632 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.632 INFO:teuthology.orchestra.run.smithi079.stdout: "server_url": { 2021-04-09T18:26:25.633 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_url", 2021-04-09T18:26:25.633 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.633 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.633 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.634 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.634 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.634 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.634 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.635 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.635 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.636 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.636 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.636 INFO:teuthology.orchestra.run.smithi079.stdout: "username": { 2021-04-09T18:26:25.637 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "username", 2021-04-09T18:26:25.637 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.637 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.637 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.637 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.638 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.638 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.638 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.638 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.639 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.639 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.639 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.640 INFO:teuthology.orchestra.run.smithi079.stdout: "verify_server": { 2021-04-09T18:26:25.640 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "verify_server", 2021-04-09T18:26:25.640 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.640 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.641 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.641 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.641 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.641 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.641 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.642 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.642 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.642 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.642 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.642 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.643 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.643 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "balancer", 2021-04-09T18:26:25.644 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:25.644 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:25.644 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:25.644 INFO:teuthology.orchestra.run.smithi079.stdout: "active": { 2021-04-09T18:26:25.645 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "active", 2021-04-09T18:26:25.645 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:25.645 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.645 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.645 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2021-04-09T18:26:25.646 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.646 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.646 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.646 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically balance PGs across cluster", 2021-04-09T18:26:25.646 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.647 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.647 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.647 INFO:teuthology.orchestra.run.smithi079.stdout: "begin_time": { 2021-04-09T18:26:25.648 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "begin_time", 2021-04-09T18:26:25.648 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.648 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.648 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.648 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0000", 2021-04-09T18:26:25.649 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.649 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.649 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.649 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "beginning time of day to automatically balance", 2021-04-09T18:26:25.649 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-04-09T18:26:25.650 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.650 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.650 INFO:teuthology.orchestra.run.smithi079.stdout: "begin_weekday": { 2021-04-09T18:26:25.650 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "begin_weekday", 2021-04-09T18:26:25.651 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2021-04-09T18:26:25.651 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.651 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.651 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2021-04-09T18:26:25.651 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0", 2021-04-09T18:26:25.652 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "7", 2021-04-09T18:26:25.652 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.652 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2021-04-09T18:26:25.652 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-04-09T18:26:25.653 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.653 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.654 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_max_iterations": { 2021-04-09T18:26:25.654 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_max_iterations", 2021-04-09T18:26:25.654 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2021-04-09T18:26:25.654 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.655 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.655 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "25", 2021-04-09T18:26:25.655 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2021-04-09T18:26:25.655 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "250", 2021-04-09T18:26:25.656 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.656 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "maximum number of iterations to attempt optimization", 2021-04-09T18:26:25.656 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.656 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.657 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.657 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_metrics": { 2021-04-09T18:26:25.658 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_metrics", 2021-04-09T18:26:25.658 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.658 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.658 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.658 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "pgs,objects,bytes", 2021-04-09T18:26:25.659 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.659 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.659 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.659 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "metrics with which to calculate OSD utilization", 2021-04-09T18:26:25.660 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-04-09T18:26:25.660 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.660 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.661 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_step": { 2021-04-09T18:26:25.661 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_step", 2021-04-09T18:26:25.661 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2021-04-09T18:26:25.662 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.662 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.662 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0.5", 2021-04-09T18:26:25.662 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0.001", 2021-04-09T18:26:25.663 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "0.999", 2021-04-09T18:26:25.663 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.663 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "aggressiveness of optimization", 2021-04-09T18:26:25.664 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-04-09T18:26:25.664 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.664 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.665 INFO:teuthology.orchestra.run.smithi079.stdout: "end_time": { 2021-04-09T18:26:25.665 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "end_time", 2021-04-09T18:26:25.665 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.665 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.665 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.666 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "2400", 2021-04-09T18:26:25.666 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.666 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.666 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.667 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "ending time of day to automatically balance", 2021-04-09T18:26:25.667 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-04-09T18:26:25.667 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.667 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.668 INFO:teuthology.orchestra.run.smithi079.stdout: "end_weekday": { 2021-04-09T18:26:25.668 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "end_weekday", 2021-04-09T18:26:25.668 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2021-04-09T18:26:25.669 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.669 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.669 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "7", 2021-04-09T18:26:25.669 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0", 2021-04-09T18:26:25.670 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "7", 2021-04-09T18:26:25.670 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.670 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-04-09T18:26:25.671 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-04-09T18:26:25.671 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.671 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.672 INFO:teuthology.orchestra.run.smithi079.stdout: "min_score": { 2021-04-09T18:26:25.672 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "min_score", 2021-04-09T18:26:25.672 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2021-04-09T18:26:25.672 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.672 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.673 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2021-04-09T18:26:25.673 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.673 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.673 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.674 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "minimum score, below which no optimization is attempted", 2021-04-09T18:26:25.674 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.674 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.674 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.675 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": { 2021-04-09T18:26:25.675 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mode", 2021-04-09T18:26:25.675 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.676 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.676 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.676 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "none", 2021-04-09T18:26:25.676 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.676 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.677 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2021-04-09T18:26:25.677 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-compat", 2021-04-09T18:26:25.678 INFO:teuthology.orchestra.run.smithi079.stdout: "none", 2021-04-09T18:26:25.678 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap" 2021-04-09T18:26:25.678 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:26:25.678 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Balancer mode", 2021-04-09T18:26:25.679 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.679 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.679 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.680 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_ids": { 2021-04-09T18:26:25.680 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pool_ids", 2021-04-09T18:26:25.681 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.681 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.681 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.681 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.682 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.682 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.682 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.682 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "pools which the automatic balancing will be limited to", 2021-04-09T18:26:25.683 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.683 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.683 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.684 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2021-04-09T18:26:25.684 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2021-04-09T18:26:25.684 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:25.685 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.685 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.685 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2021-04-09T18:26:25.686 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.686 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.686 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.687 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to wake up and attempt optimization", 2021-04-09T18:26:25.687 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.688 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.688 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.689 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap_max_deviation": { 2021-04-09T18:26:25.689 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "upmap_max_deviation", 2021-04-09T18:26:25.690 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:25.690 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.690 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.691 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2021-04-09T18:26:25.691 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2021-04-09T18:26:25.691 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.692 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.692 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "deviation below which no optimization is attempted", 2021-04-09T18:26:25.692 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-04-09T18:26:25.693 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.693 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.694 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap_max_iterations": { 2021-04-09T18:26:25.694 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "upmap_max_iterations", 2021-04-09T18:26:25.694 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2021-04-09T18:26:25.694 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.695 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.695 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2021-04-09T18:26:25.695 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.696 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.696 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.696 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "maximum upmap optimization iterations", 2021-04-09T18:26:25.696 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.697 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.697 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.698 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crash", 2021-04-09T18:26:25.698 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:25.698 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:25.699 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:25.699 INFO:teuthology.orchestra.run.smithi079.stdout: "retain_interval": { 2021-04-09T18:26:25.699 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "retain_interval", 2021-04-09T18:26:25.699 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:25.700 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.700 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.700 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "31536000", 2021-04-09T18:26:25.700 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.701 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.701 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.701 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long to retain crashes before pruning them", 2021-04-09T18:26:25.701 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.702 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.702 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.702 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_recent_interval": { 2021-04-09T18:26:25.703 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_recent_interval", 2021-04-09T18:26:25.703 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:25.703 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.704 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.704 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1209600", 2021-04-09T18:26:25.704 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.705 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.705 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.706 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "time interval in which to warn about recent crashes", 2021-04-09T18:26:25.706 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.706 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.707 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.707 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.707 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.708 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "dashboard", 2021-04-09T18:26:25.708 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:25.709 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:25.709 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:25.709 INFO:teuthology.orchestra.run.smithi079.stdout: "ALERTMANAGER_API_HOST": { 2021-04-09T18:26:25.709 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ALERTMANAGER_API_HOST", 2021-04-09T18:26:25.710 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.710 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.710 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.710 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.711 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.711 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.711 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.711 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.712 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.712 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.712 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.713 INFO:teuthology.orchestra.run.smithi079.stdout: "AUDIT_API_ENABLED": { 2021-04-09T18:26:25.713 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "AUDIT_API_ENABLED", 2021-04-09T18:26:25.713 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:25.713 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.714 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.714 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2021-04-09T18:26:25.714 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.714 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.715 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.715 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.716 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.716 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.716 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.717 INFO:teuthology.orchestra.run.smithi079.stdout: "AUDIT_API_LOG_PAYLOAD": { 2021-04-09T18:26:25.718 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2021-04-09T18:26:25.718 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:25.718 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.719 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.719 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:25.720 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.720 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.720 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.721 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.721 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.721 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.722 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.722 INFO:teuthology.orchestra.run.smithi079.stdout: "ENABLE_BROWSABLE_API": { 2021-04-09T18:26:25.723 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ENABLE_BROWSABLE_API", 2021-04-09T18:26:25.723 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:25.723 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.723 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.724 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:25.724 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.724 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.724 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.725 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.725 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.725 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.726 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.726 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_cephfs": { 2021-04-09T18:26:25.726 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_cephfs", 2021-04-09T18:26:25.727 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:25.727 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.727 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.727 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:25.727 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.728 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.728 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.728 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.728 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.728 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.729 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.729 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_iscsi": { 2021-04-09T18:26:25.729 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_iscsi", 2021-04-09T18:26:25.730 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:25.730 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.730 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.730 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:25.730 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.731 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.731 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.731 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.731 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.731 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.732 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.732 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_mirroring": { 2021-04-09T18:26:25.732 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_mirroring", 2021-04-09T18:26:25.732 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:25.733 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.733 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.733 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:25.733 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.733 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.734 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.734 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.734 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.734 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.735 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.735 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_rbd": { 2021-04-09T18:26:25.735 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_rbd", 2021-04-09T18:26:25.735 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:25.736 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.736 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.736 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:25.736 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.736 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.737 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.737 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.737 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.737 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.738 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.738 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_rgw": { 2021-04-09T18:26:25.738 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_rgw", 2021-04-09T18:26:25.739 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:25.739 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.739 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.739 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:25.740 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.740 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.740 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.740 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.740 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.741 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.741 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.741 INFO:teuthology.orchestra.run.smithi079.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-04-09T18:26:25.741 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-04-09T18:26:25.742 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.742 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.742 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.742 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.742 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.743 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.743 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.743 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.743 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.743 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.744 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.744 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_PASSWORD": { 2021-04-09T18:26:25.744 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_PASSWORD", 2021-04-09T18:26:25.745 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.745 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.745 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.745 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2021-04-09T18:26:25.745 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.746 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.746 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.746 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.746 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.746 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.747 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.747 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_SSL_VERIFY": { 2021-04-09T18:26:25.747 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2021-04-09T18:26:25.748 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:25.748 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.748 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.748 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:25.748 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.749 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.749 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.749 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.749 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.749 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.750 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.750 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_URL": { 2021-04-09T18:26:25.750 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_URL", 2021-04-09T18:26:25.751 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.751 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.751 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.751 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.752 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.752 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.752 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.752 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.752 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.753 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.753 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.753 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_USERNAME": { 2021-04-09T18:26:25.753 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_USERNAME", 2021-04-09T18:26:25.754 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.754 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.754 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.754 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2021-04-09T18:26:25.755 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.755 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.755 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.755 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.756 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.756 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.756 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.756 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_FRONTEND_API_URL": { 2021-04-09T18:26:25.757 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2021-04-09T18:26:25.757 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.757 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.757 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.757 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.758 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.758 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.758 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.758 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.759 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.759 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.759 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.760 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2021-04-09T18:26:25.760 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-04-09T18:26:25.760 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:25.760 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.760 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.761 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2021-04-09T18:26:25.761 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.761 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.761 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.761 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.762 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.762 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.762 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.763 INFO:teuthology.orchestra.run.smithi079.stdout: "ISCSI_API_SSL_VERIFICATION": { 2021-04-09T18:26:25.763 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2021-04-09T18:26:25.763 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:25.763 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.764 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.764 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:25.764 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.764 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.764 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.765 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.765 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.765 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.765 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.766 INFO:teuthology.orchestra.run.smithi079.stdout: "PROMETHEUS_API_HOST": { 2021-04-09T18:26:25.766 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PROMETHEUS_API_HOST", 2021-04-09T18:26:25.766 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.766 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.766 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.767 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.767 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.768 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.768 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.768 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.769 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.769 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.770 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.770 INFO:teuthology.orchestra.run.smithi079.stdout: "REST_REQUESTS_TIMEOUT": { 2021-04-09T18:26:25.770 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "REST_REQUESTS_TIMEOUT", 2021-04-09T18:26:25.771 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:25.771 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.771 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.771 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "45", 2021-04-09T18:26:25.772 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.772 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.772 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.772 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.772 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.773 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.773 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.774 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_ACCESS_KEY": { 2021-04-09T18:26:25.774 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_ACCESS_KEY", 2021-04-09T18:26:25.774 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.775 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.775 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.776 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.776 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.776 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.776 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.776 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.777 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.777 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.777 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.777 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_ADMIN_RESOURCE": { 2021-04-09T18:26:25.778 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2021-04-09T18:26:25.778 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.778 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.778 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.779 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2021-04-09T18:26:25.779 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.779 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.779 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.779 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.780 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.780 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.780 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.780 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_HOST": { 2021-04-09T18:26:25.781 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_HOST", 2021-04-09T18:26:25.781 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.781 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.781 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.781 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.782 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.782 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.782 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.782 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.782 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.783 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.783 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.783 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_PORT": { 2021-04-09T18:26:25.783 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_PORT", 2021-04-09T18:26:25.784 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:25.784 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.784 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.784 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "80", 2021-04-09T18:26:25.784 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.785 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.785 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.785 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.785 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.785 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.786 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.786 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_SCHEME": { 2021-04-09T18:26:25.786 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_SCHEME", 2021-04-09T18:26:25.786 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.787 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.787 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.787 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "http", 2021-04-09T18:26:25.787 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.787 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.788 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.788 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.788 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.788 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.788 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.789 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_SECRET_KEY": { 2021-04-09T18:26:25.789 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_SECRET_KEY", 2021-04-09T18:26:25.789 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.789 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.790 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.790 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.790 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.790 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.791 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.791 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.791 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.791 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.791 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.792 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_SSL_VERIFY": { 2021-04-09T18:26:25.792 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_SSL_VERIFY", 2021-04-09T18:26:25.792 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:25.792 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.793 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.793 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:25.793 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.793 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.793 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.794 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.794 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.794 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.794 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.795 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_USER_ID": { 2021-04-09T18:26:25.795 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_USER_ID", 2021-04-09T18:26:25.795 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.795 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.795 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.796 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.796 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.796 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.796 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.796 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.797 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.797 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.797 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.798 INFO:teuthology.orchestra.run.smithi079.stdout: "crt_file": { 2021-04-09T18:26:25.798 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crt_file", 2021-04-09T18:26:25.798 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.798 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.798 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.799 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.799 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.799 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.799 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.799 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.800 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.800 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.800 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.800 INFO:teuthology.orchestra.run.smithi079.stdout: "debug": { 2021-04-09T18:26:25.801 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "debug", 2021-04-09T18:26:25.801 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:25.801 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.801 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.801 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2021-04-09T18:26:25.802 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.802 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.802 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.802 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Enable/disable debug options", 2021-04-09T18:26:25.802 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.803 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.803 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.803 INFO:teuthology.orchestra.run.smithi079.stdout: "jwt_token_ttl": { 2021-04-09T18:26:25.803 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "jwt_token_ttl", 2021-04-09T18:26:25.804 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:25.804 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.804 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.804 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "28800", 2021-04-09T18:26:25.804 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.805 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.805 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.805 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.805 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.805 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.806 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.806 INFO:teuthology.orchestra.run.smithi079.stdout: "key_file": { 2021-04-09T18:26:25.806 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "key_file", 2021-04-09T18:26:25.806 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.807 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.807 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.807 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.807 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.808 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.808 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.808 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.808 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.808 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.809 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.809 INFO:teuthology.orchestra.run.smithi079.stdout: "password": { 2021-04-09T18:26:25.809 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "password", 2021-04-09T18:26:25.809 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.810 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.810 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.810 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.810 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.810 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.811 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.811 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.811 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.811 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.811 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.812 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2021-04-09T18:26:25.812 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2021-04-09T18:26:25.812 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.812 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.813 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.813 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "::", 2021-04-09T18:26:25.813 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.813 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.813 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.814 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.814 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.814 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.814 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.815 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2021-04-09T18:26:25.815 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2021-04-09T18:26:25.815 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:25.815 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.815 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.816 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8080", 2021-04-09T18:26:25.816 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.816 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.816 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.816 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.817 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.817 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.817 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.817 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl": { 2021-04-09T18:26:25.818 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl", 2021-04-09T18:26:25.818 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:25.818 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.818 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.818 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:25.819 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.819 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.819 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.819 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.819 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.820 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.820 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.820 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl_server_port": { 2021-04-09T18:26:25.820 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl_server_port", 2021-04-09T18:26:25.821 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:25.821 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.821 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.821 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8443", 2021-04-09T18:26:25.821 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.822 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.822 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.822 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.822 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.822 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.823 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.823 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_behaviour": { 2021-04-09T18:26:25.823 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_behaviour", 2021-04-09T18:26:25.823 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.824 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.824 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.824 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "redirect", 2021-04-09T18:26:25.824 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.824 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.825 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2021-04-09T18:26:25.825 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2021-04-09T18:26:25.825 INFO:teuthology.orchestra.run.smithi079.stdout: "redirect" 2021-04-09T18:26:25.825 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:26:25.825 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.826 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.826 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.826 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.826 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_error_status_code": { 2021-04-09T18:26:25.827 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_error_status_code", 2021-04-09T18:26:25.827 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:25.827 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.827 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.827 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "500", 2021-04-09T18:26:25.828 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "400", 2021-04-09T18:26:25.828 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "599", 2021-04-09T18:26:25.828 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.828 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.828 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.829 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.829 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.829 INFO:teuthology.orchestra.run.smithi079.stdout: "url_prefix": { 2021-04-09T18:26:25.830 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "url_prefix", 2021-04-09T18:26:25.830 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.830 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.830 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.830 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.831 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.831 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.831 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.831 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.831 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.832 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.832 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.832 INFO:teuthology.orchestra.run.smithi079.stdout: "username": { 2021-04-09T18:26:25.832 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "username", 2021-04-09T18:26:25.833 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.833 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.833 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.833 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.833 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.834 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.834 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.834 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.834 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.834 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.835 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.835 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.835 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.836 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "deepsea", 2021-04-09T18:26:25.836 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:25.836 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:25.836 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:25.836 INFO:teuthology.orchestra.run.smithi079.stdout: "salt_api_eauth": { 2021-04-09T18:26:25.837 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "salt_api_eauth", 2021-04-09T18:26:25.837 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.837 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.837 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.837 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "sharedsecret", 2021-04-09T18:26:25.838 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.838 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.838 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.838 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.838 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.839 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.839 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.839 INFO:teuthology.orchestra.run.smithi079.stdout: "salt_api_password": { 2021-04-09T18:26:25.839 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "salt_api_password", 2021-04-09T18:26:25.840 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.840 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.840 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.840 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.841 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.841 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.841 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.841 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.841 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.842 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.842 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.842 INFO:teuthology.orchestra.run.smithi079.stdout: "salt_api_url": { 2021-04-09T18:26:25.842 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "salt_api_url", 2021-04-09T18:26:25.843 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.843 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.843 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.843 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.843 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.844 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.844 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.844 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.844 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.844 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.845 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.845 INFO:teuthology.orchestra.run.smithi079.stdout: "salt_api_username": { 2021-04-09T18:26:25.845 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "salt_api_username", 2021-04-09T18:26:25.845 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.846 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.846 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.846 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.846 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.846 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.847 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.847 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.847 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.847 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.847 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.848 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.848 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.848 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "devicehealth", 2021-04-09T18:26:25.849 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:25.849 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:25.849 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:25.849 INFO:teuthology.orchestra.run.smithi079.stdout: "enable_monitoring": { 2021-04-09T18:26:25.849 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enable_monitoring", 2021-04-09T18:26:25.850 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:25.850 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.850 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.850 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2021-04-09T18:26:25.850 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.851 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.851 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.851 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "monitor device health metrics", 2021-04-09T18:26:25.851 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.852 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.852 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.852 INFO:teuthology.orchestra.run.smithi079.stdout: "mark_out_threshold": { 2021-04-09T18:26:25.852 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mark_out_threshold", 2021-04-09T18:26:25.853 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:25.853 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.853 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.853 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "2419200", 2021-04-09T18:26:25.853 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.854 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.854 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.854 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically mark OSD if it may fail before this long", 2021-04-09T18:26:25.854 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.854 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.855 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.855 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": { 2021-04-09T18:26:25.855 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pool_name", 2021-04-09T18:26:25.855 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.856 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.856 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.856 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "device_health_metrics", 2021-04-09T18:26:25.856 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.856 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.857 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.857 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "name of pool in which to store device health metrics", 2021-04-09T18:26:25.857 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.857 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.857 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.858 INFO:teuthology.orchestra.run.smithi079.stdout: "retention_period": { 2021-04-09T18:26:25.858 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "retention_period", 2021-04-09T18:26:25.858 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:25.858 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.859 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.859 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15552000", 2021-04-09T18:26:25.859 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.859 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.859 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.860 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long to retain device health metrics", 2021-04-09T18:26:25.860 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.860 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.860 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.861 INFO:teuthology.orchestra.run.smithi079.stdout: "scrape_frequency": { 2021-04-09T18:26:25.861 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "scrape_frequency", 2021-04-09T18:26:25.861 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:25.861 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.861 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.862 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "86400", 2021-04-09T18:26:25.862 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.862 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.862 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.862 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to scrape device health metrics", 2021-04-09T18:26:25.863 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.863 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.863 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.863 INFO:teuthology.orchestra.run.smithi079.stdout: "self_heal": { 2021-04-09T18:26:25.864 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "self_heal", 2021-04-09T18:26:25.864 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:25.864 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.864 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "preemptively heal cluster around devices that may fail", 2021-04-09T18:26:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2021-04-09T18:26:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2021-04-09T18:26:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2021-04-09T18:26:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to wake up and check device health", 2021-04-09T18:26:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_threshold": { 2021-04-09T18:26:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_threshold", 2021-04-09T18:26:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "7257600", 2021-04-09T18:26:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise health warning if OSD may fail before this long", 2021-04-09T18:26:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_cloud", 2021-04-09T18:26:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "diskprediction_cert_context": { 2021-04-09T18:26:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_cert_context", 2021-04-09T18:26:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "diskprediction_default_authority": { 2021-04-09T18:26:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_default_authority", 2021-04-09T18:26:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "localhost", 2021-04-09T18:26:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "diskprediction_password": { 2021-04-09T18:26:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_password", 2021-04-09T18:26:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "diskprediction_port": { 2021-04-09T18:26:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_port", 2021-04-09T18:26:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "31400", 2021-04-09T18:26:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "diskprediction_retrieve_prediction_interval": { 2021-04-09T18:26:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_retrieve_prediction_interval", 2021-04-09T18:26:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "43200", 2021-04-09T18:26:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "diskprediction_server": { 2021-04-09T18:26:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_server", 2021-04-09T18:26:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "diskprediction_ssl_target_name_override": { 2021-04-09T18:26:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_ssl_target_name_override", 2021-04-09T18:26:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "localhost", 2021-04-09T18:26:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: "diskprediction_upload_metrics_interval": { 2021-04-09T18:26:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_upload_metrics_interval", 2021-04-09T18:26:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2021-04-09T18:26:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: "diskprediction_upload_smart_interval": { 2021-04-09T18:26:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_upload_smart_interval", 2021-04-09T18:26:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "43200", 2021-04-09T18:26:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: "diskprediction_user": { 2021-04-09T18:26:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_user", 2021-04-09T18:26:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2021-04-09T18:26:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2021-04-09T18:26:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2021-04-09T18:26:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_local", 2021-04-09T18:26:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "predict_interval": { 2021-04-09T18:26:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "predict_interval", 2021-04-09T18:26:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "86400", 2021-04-09T18:26:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2021-04-09T18:26:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2021-04-09T18:26:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2021-04-09T18:26:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "influx", 2021-04-09T18:26:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": false, 2021-04-09T18:26:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "influxdb python module not found", 2021-04-09T18:26:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: "batch_size": { 2021-04-09T18:26:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "batch_size", 2021-04-09T18:26:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5000", 2021-04-09T18:26:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: "database": { 2021-04-09T18:26:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "database", 2021-04-09T18:26:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "ceph", 2021-04-09T18:26:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": { 2021-04-09T18:26:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "hostname", 2021-04-09T18:26:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "None", 2021-04-09T18:26:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2021-04-09T18:26:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2021-04-09T18:26:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "30", 2021-04-09T18:26:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: "password": { 2021-04-09T18:26:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "password", 2021-04-09T18:26:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "None", 2021-04-09T18:26:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: "port": { 2021-04-09T18:26:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "port", 2021-04-09T18:26:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8086", 2021-04-09T18:26:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl": { 2021-04-09T18:26:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl", 2021-04-09T18:26:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "false", 2021-04-09T18:26:25.936 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.936 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.936 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.936 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.936 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.937 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.937 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.937 INFO:teuthology.orchestra.run.smithi079.stdout: "threads": { 2021-04-09T18:26:25.937 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "threads", 2021-04-09T18:26:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2021-04-09T18:26:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "username": { 2021-04-09T18:26:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "username", 2021-04-09T18:26:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "None", 2021-04-09T18:26:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: "verify_ssl": { 2021-04-09T18:26:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "verify_ssl", 2021-04-09T18:26:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "true", 2021-04-09T18:26:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "insights", 2021-04-09T18:26:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": {} 2021-04-09T18:26:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.948 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "iostat", 2021-04-09T18:26:25.948 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:25.948 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:25.948 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": {} 2021-04-09T18:26:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "localpool", 2021-04-09T18:26:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: "failure_domain": { 2021-04-09T18:26:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "failure_domain", 2021-04-09T18:26:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "host", 2021-04-09T18:26:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "failure domain for any created local pool", 2021-04-09T18:26:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": { 2021-04-09T18:26:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "min_size", 2021-04-09T18:26:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default min_size for any created local pool", 2021-04-09T18:26:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: "num_rep": { 2021-04-09T18:26:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "num_rep", 2021-04-09T18:26:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3", 2021-04-09T18:26:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default replica count for any created local pool", 2021-04-09T18:26:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": { 2021-04-09T18:26:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pg_num", 2021-04-09T18:26:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "128", 2021-04-09T18:26:25.960 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.960 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.960 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.960 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default pg_num for any created local pool", 2021-04-09T18:26:25.960 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.961 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.961 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.961 INFO:teuthology.orchestra.run.smithi079.stdout: "prefix": { 2021-04-09T18:26:25.961 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prefix", 2021-04-09T18:26:25.962 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.962 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.962 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.962 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.962 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.963 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.963 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.963 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "name prefix for any created local pool", 2021-04-09T18:26:25.963 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.963 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.964 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.964 INFO:teuthology.orchestra.run.smithi079.stdout: "subtree": { 2021-04-09T18:26:25.964 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "subtree", 2021-04-09T18:26:25.964 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.965 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.965 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.965 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "rack", 2021-04-09T18:26:25.965 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.965 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.966 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.966 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "CRUSH level for which to create a local pool", 2021-04-09T18:26:25.966 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.966 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.966 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.967 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "orchestrator_cli", 2021-04-09T18:26:25.968 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:25.968 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:25.968 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:25.968 INFO:teuthology.orchestra.run.smithi079.stdout: "orchestrator": { 2021-04-09T18:26:25.969 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "orchestrator", 2021-04-09T18:26:25.969 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.969 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.969 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.969 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.970 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.970 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.970 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.970 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.970 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.971 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.971 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.971 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.971 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.972 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pg_autoscaler", 2021-04-09T18:26:25.972 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:25.972 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:25.972 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:25.973 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2021-04-09T18:26:25.973 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2021-04-09T18:26:25.973 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.973 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.973 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.974 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2021-04-09T18:26:25.974 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.974 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.974 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.974 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.975 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.975 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.975 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.975 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.975 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.976 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "progress", 2021-04-09T18:26:25.976 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:25.977 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:25.977 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:25.977 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": { 2021-04-09T18:26:25.977 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enabled", 2021-04-09T18:26:25.977 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:25.978 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.978 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.978 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:25.978 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.978 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.979 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.979 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.979 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.979 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.979 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.980 INFO:teuthology.orchestra.run.smithi079.stdout: "max_completed_events": { 2021-04-09T18:26:25.980 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_completed_events", 2021-04-09T18:26:25.980 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:25.980 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.981 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.981 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "50", 2021-04-09T18:26:25.981 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.981 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.981 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.982 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "number of past completed events to remember", 2021-04-09T18:26:25.982 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.982 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.982 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.983 INFO:teuthology.orchestra.run.smithi079.stdout: "persist_interval": { 2021-04-09T18:26:25.983 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "persist_interval", 2021-04-09T18:26:25.983 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:25.983 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.983 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:25.984 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2021-04-09T18:26:25.984 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.984 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.984 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.984 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to persist completed events", 2021-04-09T18:26:25.985 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.985 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.985 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.985 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.985 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:25.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:25.986 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prometheus", 2021-04-09T18:26:25.986 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:25.986 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:25.987 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:25.987 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_stats_pools": { 2021-04-09T18:26:25.987 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_stats_pools", 2021-04-09T18:26:25.987 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.988 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.988 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.988 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.988 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.988 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.989 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.989 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.989 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.989 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.989 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.990 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_stats_pools_refresh_interval": { 2021-04-09T18:26:25.990 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_stats_pools_refresh_interval", 2021-04-09T18:26:25.990 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:25.990 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.991 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.991 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "300", 2021-04-09T18:26:25.991 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.991 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.991 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.992 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.992 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.992 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.992 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.993 INFO:teuthology.orchestra.run.smithi079.stdout: "scrape_interval": { 2021-04-09T18:26:25.993 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "scrape_interval", 2021-04-09T18:26:25.993 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.993 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.993 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.994 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.994 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.994 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.994 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.994 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.995 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.995 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.995 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.995 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2021-04-09T18:26:25.996 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2021-04-09T18:26:25.996 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.996 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.996 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.996 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:25.997 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:25.997 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:25.997 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:25.997 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:25.997 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:25.998 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:25.998 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:25.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:25.998 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2021-04-09T18:26:25.998 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2021-04-09T18:26:25.999 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:25.999 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:25.999 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:25.999 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.000 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.000 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.000 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.000 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.000 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.001 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.001 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.001 INFO:teuthology.orchestra.run.smithi079.stdout: "stale_cache_strategy": { 2021-04-09T18:26:26.001 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "stale_cache_strategy", 2021-04-09T18:26:26.002 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.002 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.002 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.002 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.002 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.003 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.003 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.003 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.003 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.003 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.004 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.004 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.004 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.005 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_support", 2021-04-09T18:26:26.005 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.005 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.005 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": {} 2021-04-09T18:26:26.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.006 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "restful", 2021-04-09T18:26:26.006 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.006 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.007 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.007 INFO:teuthology.orchestra.run.smithi079.stdout: "key_file": { 2021-04-09T18:26:26.007 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "key_file", 2021-04-09T18:26:26.007 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.007 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.008 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.008 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.008 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.008 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.008 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.009 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.009 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.009 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.009 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.010 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2021-04-09T18:26:26.010 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2021-04-09T18:26:26.010 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.010 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.010 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.011 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.011 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.011 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.011 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.011 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.012 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.012 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.012 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.013 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2021-04-09T18:26:26.013 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2021-04-09T18:26:26.013 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.013 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.013 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.014 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.014 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.014 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.014 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.014 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.015 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.015 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.015 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.015 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.015 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.016 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rook", 2021-04-09T18:26:26.016 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.016 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.017 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": {} 2021-04-09T18:26:26.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.017 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "selftest", 2021-04-09T18:26:26.017 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.018 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.018 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.018 INFO:teuthology.orchestra.run.smithi079.stdout: "roption1": { 2021-04-09T18:26:26.018 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "roption1", 2021-04-09T18:26:26.018 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.019 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.019 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.019 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.019 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.019 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.020 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.020 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.020 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.020 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.020 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.021 INFO:teuthology.orchestra.run.smithi079.stdout: "roption2": { 2021-04-09T18:26:26.021 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "roption2", 2021-04-09T18:26:26.021 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.021 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.022 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.022 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "xyz", 2021-04-09T18:26:26.022 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.022 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.022 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.023 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.023 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.023 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.023 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.024 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption1": { 2021-04-09T18:26:26.024 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption1", 2021-04-09T18:26:26.024 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.024 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.024 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.025 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.025 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.025 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.025 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.025 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.026 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.026 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.026 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.026 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption2": { 2021-04-09T18:26:26.027 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption2", 2021-04-09T18:26:26.027 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.027 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.027 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.027 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.028 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.028 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.028 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.028 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.029 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.029 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.029 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.029 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption3": { 2021-04-09T18:26:26.030 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption3", 2021-04-09T18:26:26.030 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2021-04-09T18:26:26.030 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.030 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.030 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.031 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.031 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.031 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.031 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.031 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.032 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.032 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.032 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption4": { 2021-04-09T18:26:26.032 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption4", 2021-04-09T18:26:26.033 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.033 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.033 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.033 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.033 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.034 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.034 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.034 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.034 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.034 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.035 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.035 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption5": { 2021-04-09T18:26:26.035 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption5", 2021-04-09T18:26:26.035 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.036 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.036 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.036 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.036 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.036 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.037 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.037 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.037 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.037 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.037 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.038 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption6": { 2021-04-09T18:26:26.038 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption6", 2021-04-09T18:26:26.038 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.038 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.039 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.039 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.039 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.039 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.039 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.040 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.040 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.040 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.040 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.041 INFO:teuthology.orchestra.run.smithi079.stdout: "testkey": { 2021-04-09T18:26:26.041 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testkey", 2021-04-09T18:26:26.041 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.041 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.041 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.042 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.042 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.042 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.042 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.042 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.043 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.043 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.043 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.043 INFO:teuthology.orchestra.run.smithi079.stdout: "testlkey": { 2021-04-09T18:26:26.044 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testlkey", 2021-04-09T18:26:26.044 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.044 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.044 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.044 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.045 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.045 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.045 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.045 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.045 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.046 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.046 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.046 INFO:teuthology.orchestra.run.smithi079.stdout: "testnewline": { 2021-04-09T18:26:26.046 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testnewline", 2021-04-09T18:26:26.047 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.047 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.047 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.047 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.048 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.048 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.048 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.048 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.048 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.049 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.049 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.049 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.049 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.050 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssh", 2021-04-09T18:26:26.050 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.050 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.050 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.051 INFO:teuthology.orchestra.run.smithi079.stdout: "inventory_cache_timeout_min": { 2021-04-09T18:26:26.051 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "inventory_cache_timeout_min", 2021-04-09T18:26:26.051 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.051 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.051 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.052 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.052 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.052 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.052 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.052 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.053 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.053 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.053 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.053 INFO:teuthology.orchestra.run.smithi079.stdout: "ssh_config_file": { 2021-04-09T18:26:26.054 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssh_config_file", 2021-04-09T18:26:26.054 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.054 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.054 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.054 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.055 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.055 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.055 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.055 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.056 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.056 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.056 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.056 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.056 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.057 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "status", 2021-04-09T18:26:26.057 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.057 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.058 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": {} 2021-04-09T18:26:26.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.058 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "telegraf", 2021-04-09T18:26:26.058 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.059 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.059 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.059 INFO:teuthology.orchestra.run.smithi079.stdout: "address": { 2021-04-09T18:26:26.059 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "address", 2021-04-09T18:26:26.059 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.060 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.060 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.060 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2021-04-09T18:26:26.060 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.060 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.061 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.061 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.061 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.061 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.061 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.062 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2021-04-09T18:26:26.062 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2021-04-09T18:26:26.062 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:26.063 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.063 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.063 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15", 2021-04-09T18:26:26.063 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.063 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.064 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.064 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.064 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.064 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.064 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.065 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.065 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.065 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "telemetry", 2021-04-09T18:26:26.066 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.066 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.066 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.066 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_basic": { 2021-04-09T18:26:26.066 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_basic", 2021-04-09T18:26:26.067 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.067 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.067 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.067 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.067 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.068 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.068 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.068 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share basic cluster information (size, version)", 2021-04-09T18:26:26.068 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.068 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.069 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.069 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_crash": { 2021-04-09T18:26:26.069 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_crash", 2021-04-09T18:26:26.069 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.070 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.070 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.070 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.070 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.070 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.071 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.071 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.071 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.071 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.072 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.072 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_device": { 2021-04-09T18:26:26.072 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_device", 2021-04-09T18:26:26.072 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.073 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.073 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.073 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.073 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.073 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.074 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.074 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.074 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.074 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.074 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.075 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_ident": { 2021-04-09T18:26:26.075 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_ident", 2021-04-09T18:26:26.075 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.075 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.076 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.076 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2021-04-09T18:26:26.076 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.076 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.076 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.077 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.077 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.077 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.077 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.078 INFO:teuthology.orchestra.run.smithi079.stdout: "contact": { 2021-04-09T18:26:26.078 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "contact", 2021-04-09T18:26:26.078 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.078 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.078 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.079 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "None", 2021-04-09T18:26:26.079 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.079 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.079 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.079 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.080 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.080 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.080 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.080 INFO:teuthology.orchestra.run.smithi079.stdout: "description": { 2021-04-09T18:26:26.081 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "description", 2021-04-09T18:26:26.081 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.081 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.081 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.081 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "None", 2021-04-09T18:26:26.082 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.082 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.082 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.082 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.082 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.083 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.083 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.083 INFO:teuthology.orchestra.run.smithi079.stdout: "device_url": { 2021-04-09T18:26:26.084 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "device_url", 2021-04-09T18:26:26.084 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.084 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.084 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.084 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "https://telemetry.ceph.com/device", 2021-04-09T18:26:26.085 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.085 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.085 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.085 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.085 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.086 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.086 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.086 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": { 2021-04-09T18:26:26.086 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enabled", 2021-04-09T18:26:26.087 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.087 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.087 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.087 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2021-04-09T18:26:26.087 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.088 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.088 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.088 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.088 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.088 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.089 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.089 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2021-04-09T18:26:26.089 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2021-04-09T18:26:26.089 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.090 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.090 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.090 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "24", 2021-04-09T18:26:26.090 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "8", 2021-04-09T18:26:26.090 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.091 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.091 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.091 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.091 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.091 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.092 INFO:teuthology.orchestra.run.smithi079.stdout: "last_opt_revision": { 2021-04-09T18:26:26.092 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "last_opt_revision", 2021-04-09T18:26:26.092 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.092 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.093 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.093 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1", 2021-04-09T18:26:26.093 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.093 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.093 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.094 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.094 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.094 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.094 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "leaderboard": { 2021-04-09T18:26:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "leaderboard", 2021-04-09T18:26:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2021-04-09T18:26:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: "organization": { 2021-04-09T18:26:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "organization", 2021-04-09T18:26:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "None", 2021-04-09T18:26:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.100 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.100 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.100 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.100 INFO:teuthology.orchestra.run.smithi079.stdout: "proxy": { 2021-04-09T18:26:26.101 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "proxy", 2021-04-09T18:26:26.101 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.101 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.101 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.101 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "None", 2021-04-09T18:26:26.102 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.102 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.102 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.102 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.102 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.103 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.103 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.103 INFO:teuthology.orchestra.run.smithi079.stdout: "url": { 2021-04-09T18:26:26.103 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "url", 2021-04-09T18:26:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "https://telemetry.ceph.com/report", 2021-04-09T18:26:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.105 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.105 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.105 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.105 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.105 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.106 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.106 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.106 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.107 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "test_orchestrator", 2021-04-09T18:26:26.107 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.107 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.107 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": {} 2021-04-09T18:26:26.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.108 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "volumes", 2021-04-09T18:26:26.108 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.108 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.109 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.109 INFO:teuthology.orchestra.run.smithi079.stdout: "max_concurrent_clones": { 2021-04-09T18:26:26.109 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_concurrent_clones", 2021-04-09T18:26:26.109 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.109 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.110 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.110 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "4", 2021-04-09T18:26:26.110 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.110 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.110 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.111 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Number of asynchronous cloner threads", 2021-04-09T18:26:26.111 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.111 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.111 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.111 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.112 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.112 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix", 2021-04-09T18:26:26.112 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.113 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.113 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.113 INFO:teuthology.orchestra.run.smithi079.stdout: "identifier": { 2021-04-09T18:26:26.113 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "identifier", 2021-04-09T18:26:26.113 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.114 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.114 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.114 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.114 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.114 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.115 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.115 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.115 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.115 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.115 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.116 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2021-04-09T18:26:26.116 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2021-04-09T18:26:26.116 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:26.116 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.117 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.117 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2021-04-09T18:26:26.117 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.117 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.117 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.119 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_host": { 2021-04-09T18:26:26.119 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_host", 2021-04-09T18:26:26.119 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.119 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.119 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.120 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "None", 2021-04-09T18:26:26.120 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.120 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.120 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.120 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_port": { 2021-04-09T18:26:26.122 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_port", 2021-04-09T18:26:26.122 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.122 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.122 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.122 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10051", 2021-04-09T18:26:26.123 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.123 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.123 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.123 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.124 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.124 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.124 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.124 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_sender": { 2021-04-09T18:26:26.125 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_sender", 2021-04-09T18:26:26.125 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.125 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.125 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.125 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "/usr/bin/zabbix_sender", 2021-04-09T18:26:26.126 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.126 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.126 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.126 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.126 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.127 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.127 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.127 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.127 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.127 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.128 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:26.128 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.128 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:26:26.128 INFO:teuthology.orchestra.run.smithi079.stdout: "modules": [ 2021-04-09T18:26:26.128 INFO:teuthology.orchestra.run.smithi079.stdout: "iostat", 2021-04-09T18:26:26.129 INFO:teuthology.orchestra.run.smithi079.stdout: "restful" 2021-04-09T18:26:26.129 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:26:26.129 INFO:teuthology.orchestra.run.smithi079.stdout: "available_modules": [ 2021-04-09T18:26:26.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.129 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "alerts", 2021-04-09T18:26:26.130 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.130 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.130 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.130 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2021-04-09T18:26:26.130 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2021-04-09T18:26:26.131 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:26.131 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.131 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.131 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2021-04-09T18:26:26.131 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How frequently to reexamine health status", 2021-04-09T18:26:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.133 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.133 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_destination": { 2021-04-09T18:26:26.133 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_destination", 2021-04-09T18:26:26.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Email address to send alerts to", 2021-04-09T18:26:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.136 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_from_name": { 2021-04-09T18:26:26.136 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_from_name", 2021-04-09T18:26:26.136 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.136 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.137 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.137 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "Ceph", 2021-04-09T18:26:26.137 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.137 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.137 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.138 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Email From: name", 2021-04-09T18:26:26.138 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.138 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.138 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.139 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_host": { 2021-04-09T18:26:26.139 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_host", 2021-04-09T18:26:26.139 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.139 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.140 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.140 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.140 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.140 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.140 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.140 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP server", 2021-04-09T18:26:26.141 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.141 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.141 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.141 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_password": { 2021-04-09T18:26:26.142 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_password", 2021-04-09T18:26:26.142 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.142 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.142 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.142 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.143 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.143 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.143 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.143 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Password to authenticate with", 2021-04-09T18:26:26.144 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.144 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.144 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.144 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_port": { 2021-04-09T18:26:26.145 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_port", 2021-04-09T18:26:26.145 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.145 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.145 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.145 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "465", 2021-04-09T18:26:26.146 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.146 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.146 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.146 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP port", 2021-04-09T18:26:26.146 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.147 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.147 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.147 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_sender": { 2021-04-09T18:26:26.147 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_sender", 2021-04-09T18:26:26.148 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.148 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.148 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.148 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.148 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.149 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.149 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.149 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP envelope sender", 2021-04-09T18:26:26.149 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.149 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.150 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.150 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_ssl": { 2021-04-09T18:26:26.150 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_ssl", 2021-04-09T18:26:26.151 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.151 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.151 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.151 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.151 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.152 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.152 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.152 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use SSL to connect to SMTP server", 2021-04-09T18:26:26.152 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.152 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.153 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.153 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_user": { 2021-04-09T18:26:26.153 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_user", 2021-04-09T18:26:26.153 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.154 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.154 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.154 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.154 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.154 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "User to authenticate as", 2021-04-09T18:26:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.156 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.156 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.156 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ansible", 2021-04-09T18:26:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: "password": { 2021-04-09T18:26:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "password", 2021-04-09T18:26:26.158 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.158 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.158 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.158 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.158 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.159 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.159 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.159 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.159 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.159 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.160 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.160 INFO:teuthology.orchestra.run.smithi079.stdout: "server_url": { 2021-04-09T18:26:26.160 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_url", 2021-04-09T18:26:26.160 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.161 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.161 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.161 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.161 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.161 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.162 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.162 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.162 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.162 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.162 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.163 INFO:teuthology.orchestra.run.smithi079.stdout: "username": { 2021-04-09T18:26:26.163 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "username", 2021-04-09T18:26:26.163 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.164 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.164 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.164 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.164 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.164 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: "verify_server": { 2021-04-09T18:26:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "verify_server", 2021-04-09T18:26:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.167 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.167 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.167 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.167 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.167 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.168 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.168 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.168 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.168 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.168 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.169 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.169 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "balancer", 2021-04-09T18:26:26.169 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.170 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.170 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.170 INFO:teuthology.orchestra.run.smithi079.stdout: "active": { 2021-04-09T18:26:26.170 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "active", 2021-04-09T18:26:26.170 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.171 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.171 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.171 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2021-04-09T18:26:26.171 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.171 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.172 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.172 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically balance PGs across cluster", 2021-04-09T18:26:26.172 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.172 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.172 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.173 INFO:teuthology.orchestra.run.smithi079.stdout: "begin_time": { 2021-04-09T18:26:26.173 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "begin_time", 2021-04-09T18:26:26.173 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.173 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.174 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.174 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0000", 2021-04-09T18:26:26.174 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.174 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.174 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.175 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "beginning time of day to automatically balance", 2021-04-09T18:26:26.175 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-04-09T18:26:26.175 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.175 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.176 INFO:teuthology.orchestra.run.smithi079.stdout: "begin_weekday": { 2021-04-09T18:26:26.176 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "begin_weekday", 2021-04-09T18:26:26.176 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2021-04-09T18:26:26.176 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.177 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.177 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2021-04-09T18:26:26.177 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0", 2021-04-09T18:26:26.177 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "7", 2021-04-09T18:26:26.177 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.178 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2021-04-09T18:26:26.178 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-04-09T18:26:26.178 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.178 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.179 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_max_iterations": { 2021-04-09T18:26:26.179 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_max_iterations", 2021-04-09T18:26:26.179 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2021-04-09T18:26:26.179 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.179 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.180 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "25", 2021-04-09T18:26:26.180 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2021-04-09T18:26:26.180 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "250", 2021-04-09T18:26:26.180 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.180 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "maximum number of iterations to attempt optimization", 2021-04-09T18:26:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_metrics": { 2021-04-09T18:26:26.182 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_metrics", 2021-04-09T18:26:26.182 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.182 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.182 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.182 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "pgs,objects,bytes", 2021-04-09T18:26:26.183 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.183 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.183 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.183 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "metrics with which to calculate OSD utilization", 2021-04-09T18:26:26.183 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-04-09T18:26:26.184 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.184 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.184 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_step": { 2021-04-09T18:26:26.184 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_step", 2021-04-09T18:26:26.185 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2021-04-09T18:26:26.185 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.185 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.185 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0.5", 2021-04-09T18:26:26.185 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0.001", 2021-04-09T18:26:26.186 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "0.999", 2021-04-09T18:26:26.186 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.186 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "aggressiveness of optimization", 2021-04-09T18:26:26.186 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-04-09T18:26:26.186 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.187 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.187 INFO:teuthology.orchestra.run.smithi079.stdout: "end_time": { 2021-04-09T18:26:26.187 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "end_time", 2021-04-09T18:26:26.187 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "2400", 2021-04-09T18:26:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "ending time of day to automatically balance", 2021-04-09T18:26:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-04-09T18:26:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.190 INFO:teuthology.orchestra.run.smithi079.stdout: "end_weekday": { 2021-04-09T18:26:26.190 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "end_weekday", 2021-04-09T18:26:26.190 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2021-04-09T18:26:26.190 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.191 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.191 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "7", 2021-04-09T18:26:26.191 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0", 2021-04-09T18:26:26.191 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "7", 2021-04-09T18:26:26.192 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.192 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-04-09T18:26:26.192 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-04-09T18:26:26.192 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.192 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.193 INFO:teuthology.orchestra.run.smithi079.stdout: "min_score": { 2021-04-09T18:26:26.193 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "min_score", 2021-04-09T18:26:26.193 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2021-04-09T18:26:26.193 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.194 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.194 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2021-04-09T18:26:26.194 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.194 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.194 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "minimum score, below which no optimization is attempted", 2021-04-09T18:26:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.196 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": { 2021-04-09T18:26:26.196 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mode", 2021-04-09T18:26:26.196 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.196 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.196 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.197 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "none", 2021-04-09T18:26:26.197 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.197 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.197 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2021-04-09T18:26:26.197 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-compat", 2021-04-09T18:26:26.198 INFO:teuthology.orchestra.run.smithi079.stdout: "none", 2021-04-09T18:26:26.198 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap" 2021-04-09T18:26:26.198 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:26:26.198 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Balancer mode", 2021-04-09T18:26:26.198 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.199 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.199 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.199 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_ids": { 2021-04-09T18:26:26.200 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pool_ids", 2021-04-09T18:26:26.200 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.200 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.200 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.200 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.201 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.201 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.201 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.201 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "pools which the automatic balancing will be limited to", 2021-04-09T18:26:26.201 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.202 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.202 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.202 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2021-04-09T18:26:26.202 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2021-04-09T18:26:26.203 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:26.203 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.203 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.203 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2021-04-09T18:26:26.203 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.204 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.204 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.204 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to wake up and attempt optimization", 2021-04-09T18:26:26.204 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.204 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.205 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.205 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap_max_deviation": { 2021-04-09T18:26:26.205 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "upmap_max_deviation", 2021-04-09T18:26:26.205 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.206 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.206 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.206 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2021-04-09T18:26:26.206 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2021-04-09T18:26:26.206 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.207 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.207 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "deviation below which no optimization is attempted", 2021-04-09T18:26:26.207 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-04-09T18:26:26.207 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.207 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.208 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap_max_iterations": { 2021-04-09T18:26:26.208 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "upmap_max_iterations", 2021-04-09T18:26:26.208 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2021-04-09T18:26:26.208 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.209 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.209 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2021-04-09T18:26:26.209 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.209 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.209 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.210 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "maximum upmap optimization iterations", 2021-04-09T18:26:26.210 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.210 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.210 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.210 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.211 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.211 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crash", 2021-04-09T18:26:26.211 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.212 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.212 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.212 INFO:teuthology.orchestra.run.smithi079.stdout: "retain_interval": { 2021-04-09T18:26:26.212 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "retain_interval", 2021-04-09T18:26:26.212 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:26.213 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.213 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.213 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "31536000", 2021-04-09T18:26:26.213 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.213 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.214 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.214 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long to retain crashes before pruning them", 2021-04-09T18:26:26.214 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.214 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.214 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.215 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_recent_interval": { 2021-04-09T18:26:26.215 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_recent_interval", 2021-04-09T18:26:26.215 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:26.216 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.216 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.216 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1209600", 2021-04-09T18:26:26.216 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.216 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.217 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.217 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "time interval in which to warn about recent crashes", 2021-04-09T18:26:26.217 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.217 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.217 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.218 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.218 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.218 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "dashboard", 2021-04-09T18:26:26.219 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.219 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.219 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.219 INFO:teuthology.orchestra.run.smithi079.stdout: "ALERTMANAGER_API_HOST": { 2021-04-09T18:26:26.219 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ALERTMANAGER_API_HOST", 2021-04-09T18:26:26.220 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.220 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.220 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.220 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.220 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.221 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.221 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.221 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.221 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.221 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.222 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.222 INFO:teuthology.orchestra.run.smithi079.stdout: "AUDIT_API_ENABLED": { 2021-04-09T18:26:26.222 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "AUDIT_API_ENABLED", 2021-04-09T18:26:26.222 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.223 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.223 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.223 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2021-04-09T18:26:26.223 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.223 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.224 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.224 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.224 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.224 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.224 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.225 INFO:teuthology.orchestra.run.smithi079.stdout: "AUDIT_API_LOG_PAYLOAD": { 2021-04-09T18:26:26.225 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2021-04-09T18:26:26.225 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.225 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.226 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.226 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.226 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.226 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.226 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.227 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.227 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.227 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.227 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.228 INFO:teuthology.orchestra.run.smithi079.stdout: "ENABLE_BROWSABLE_API": { 2021-04-09T18:26:26.228 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ENABLE_BROWSABLE_API", 2021-04-09T18:26:26.228 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.228 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.228 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.229 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.229 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.229 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.229 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.229 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.230 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.230 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.230 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.230 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_cephfs": { 2021-04-09T18:26:26.231 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_cephfs", 2021-04-09T18:26:26.231 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.231 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.231 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.231 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.232 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.232 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.232 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.232 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.232 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.233 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.233 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.233 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_iscsi": { 2021-04-09T18:26:26.233 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_iscsi", 2021-04-09T18:26:26.234 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.234 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.234 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.234 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.234 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.235 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.235 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.235 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.235 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.235 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.236 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.236 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_mirroring": { 2021-04-09T18:26:26.236 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_mirroring", 2021-04-09T18:26:26.236 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.237 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.237 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.237 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.237 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.237 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.238 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.238 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.238 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.238 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.238 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.239 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_rbd": { 2021-04-09T18:26:26.239 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_rbd", 2021-04-09T18:26:26.239 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.239 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.240 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.240 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.240 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.240 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.240 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.241 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.241 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.241 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.241 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.242 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_rgw": { 2021-04-09T18:26:26.242 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_rgw", 2021-04-09T18:26:26.242 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.242 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.242 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.243 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.243 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.243 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.243 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.244 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.244 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.244 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.244 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.245 INFO:teuthology.orchestra.run.smithi079.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-04-09T18:26:26.245 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-04-09T18:26:26.245 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.245 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.245 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.246 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.246 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.246 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.246 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.246 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.247 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.247 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.247 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.247 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_PASSWORD": { 2021-04-09T18:26:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_PASSWORD", 2021-04-09T18:26:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2021-04-09T18:26:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_SSL_VERIFY": { 2021-04-09T18:26:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2021-04-09T18:26:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.253 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.253 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.253 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_URL": { 2021-04-09T18:26:26.253 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_URL", 2021-04-09T18:26:26.254 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.254 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.254 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.254 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.254 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.255 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.255 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.255 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.255 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.255 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.256 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.256 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_USERNAME": { 2021-04-09T18:26:26.256 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_USERNAME", 2021-04-09T18:26:26.256 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.257 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.257 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.257 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2021-04-09T18:26:26.257 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.257 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.258 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.258 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.258 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.258 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.258 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.259 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_FRONTEND_API_URL": { 2021-04-09T18:26:26.259 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2021-04-09T18:26:26.259 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.259 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.260 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.260 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.260 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.260 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.260 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.261 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.261 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.261 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.261 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.262 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2021-04-09T18:26:26.262 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-04-09T18:26:26.262 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.262 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.262 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.263 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2021-04-09T18:26:26.263 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.263 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.263 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.263 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.264 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.264 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.264 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.264 INFO:teuthology.orchestra.run.smithi079.stdout: "ISCSI_API_SSL_VERIFICATION": { 2021-04-09T18:26:26.265 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2021-04-09T18:26:26.265 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.265 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.265 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.265 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.266 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.266 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.266 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.266 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.266 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.267 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.267 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.267 INFO:teuthology.orchestra.run.smithi079.stdout: "PROMETHEUS_API_HOST": { 2021-04-09T18:26:26.267 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PROMETHEUS_API_HOST", 2021-04-09T18:26:26.268 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.268 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.268 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.268 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.268 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.269 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.269 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.269 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.269 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.269 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.270 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.270 INFO:teuthology.orchestra.run.smithi079.stdout: "REST_REQUESTS_TIMEOUT": { 2021-04-09T18:26:26.270 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "REST_REQUESTS_TIMEOUT", 2021-04-09T18:26:26.270 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.271 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.271 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.271 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "45", 2021-04-09T18:26:26.271 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.272 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.272 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.272 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.272 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.272 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.273 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.273 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_ACCESS_KEY": { 2021-04-09T18:26:26.273 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_ACCESS_KEY", 2021-04-09T18:26:26.273 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.274 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.274 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.274 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.274 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.274 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.275 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.275 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.275 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.275 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.275 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.276 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_ADMIN_RESOURCE": { 2021-04-09T18:26:26.276 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2021-04-09T18:26:26.276 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.276 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.277 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.277 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2021-04-09T18:26:26.277 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.277 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.277 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.278 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.278 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.278 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.278 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.279 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_HOST": { 2021-04-09T18:26:26.279 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_HOST", 2021-04-09T18:26:26.279 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.279 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.279 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.280 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.280 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.280 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.280 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.280 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.281 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.281 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.281 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.281 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_PORT": { 2021-04-09T18:26:26.282 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_PORT", 2021-04-09T18:26:26.282 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.282 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.282 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.282 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "80", 2021-04-09T18:26:26.283 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.283 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.283 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.283 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.283 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.284 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.284 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.284 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_SCHEME": { 2021-04-09T18:26:26.284 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_SCHEME", 2021-04-09T18:26:26.285 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.285 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.285 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.285 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "http", 2021-04-09T18:26:26.285 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.286 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.286 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.286 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.286 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.286 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.287 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.287 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_SECRET_KEY": { 2021-04-09T18:26:26.287 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_SECRET_KEY", 2021-04-09T18:26:26.288 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.288 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.288 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.288 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.288 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.289 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.289 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.289 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.289 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.289 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.290 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.290 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_SSL_VERIFY": { 2021-04-09T18:26:26.290 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_SSL_VERIFY", 2021-04-09T18:26:26.290 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.291 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.291 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.291 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.291 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.291 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.292 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.292 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.292 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.292 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.292 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.293 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_USER_ID": { 2021-04-09T18:26:26.293 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_USER_ID", 2021-04-09T18:26:26.293 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.293 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.294 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.294 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.294 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.294 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.294 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.295 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.295 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.295 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.295 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.296 INFO:teuthology.orchestra.run.smithi079.stdout: "crt_file": { 2021-04-09T18:26:26.296 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crt_file", 2021-04-09T18:26:26.296 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.296 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.296 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.297 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.297 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.297 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.297 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.298 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.298 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.298 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.298 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.299 INFO:teuthology.orchestra.run.smithi079.stdout: "debug": { 2021-04-09T18:26:26.299 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "debug", 2021-04-09T18:26:26.299 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.299 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.300 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.300 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2021-04-09T18:26:26.300 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.300 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.300 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.301 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Enable/disable debug options", 2021-04-09T18:26:26.301 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.301 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.301 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.302 INFO:teuthology.orchestra.run.smithi079.stdout: "jwt_token_ttl": { 2021-04-09T18:26:26.302 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "jwt_token_ttl", 2021-04-09T18:26:26.302 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.302 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.302 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.303 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "28800", 2021-04-09T18:26:26.303 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.303 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.303 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.304 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.304 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.304 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.304 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.305 INFO:teuthology.orchestra.run.smithi079.stdout: "key_file": { 2021-04-09T18:26:26.305 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "key_file", 2021-04-09T18:26:26.305 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.305 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.305 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.306 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.306 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.306 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.306 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.306 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.307 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.307 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.307 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.307 INFO:teuthology.orchestra.run.smithi079.stdout: "password": { 2021-04-09T18:26:26.308 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "password", 2021-04-09T18:26:26.308 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.308 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.308 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.308 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.309 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.309 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.309 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.309 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.310 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.310 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.310 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.310 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2021-04-09T18:26:26.311 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2021-04-09T18:26:26.311 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.311 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.311 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.311 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "::", 2021-04-09T18:26:26.312 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.312 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.312 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.312 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.312 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.313 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.313 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.313 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2021-04-09T18:26:26.313 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2021-04-09T18:26:26.314 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.314 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.314 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.314 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8080", 2021-04-09T18:26:26.314 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.315 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.315 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.315 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.315 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.315 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.316 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.316 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl": { 2021-04-09T18:26:26.316 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl", 2021-04-09T18:26:26.316 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.317 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.317 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.317 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.317 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.317 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.318 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.318 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.318 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.318 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.318 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.319 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl_server_port": { 2021-04-09T18:26:26.319 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl_server_port", 2021-04-09T18:26:26.319 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.319 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.320 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.320 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8443", 2021-04-09T18:26:26.320 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.320 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.321 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.321 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.321 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.321 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.321 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.322 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_behaviour": { 2021-04-09T18:26:26.322 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_behaviour", 2021-04-09T18:26:26.322 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.322 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.323 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.323 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "redirect", 2021-04-09T18:26:26.323 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.323 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.323 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2021-04-09T18:26:26.324 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2021-04-09T18:26:26.324 INFO:teuthology.orchestra.run.smithi079.stdout: "redirect" 2021-04-09T18:26:26.324 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:26:26.324 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.324 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.325 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.325 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.325 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_error_status_code": { 2021-04-09T18:26:26.325 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_error_status_code", 2021-04-09T18:26:26.326 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.326 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.326 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.326 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "500", 2021-04-09T18:26:26.326 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "400", 2021-04-09T18:26:26.327 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "599", 2021-04-09T18:26:26.327 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.327 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.327 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.327 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.328 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.328 INFO:teuthology.orchestra.run.smithi079.stdout: "url_prefix": { 2021-04-09T18:26:26.328 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "url_prefix", 2021-04-09T18:26:26.329 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.329 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.329 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.329 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.329 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.330 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.330 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.330 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.330 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.330 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.331 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.331 INFO:teuthology.orchestra.run.smithi079.stdout: "username": { 2021-04-09T18:26:26.331 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "username", 2021-04-09T18:26:26.331 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.336 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.337 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.337 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.337 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.337 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.337 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.338 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.338 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.338 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.338 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.338 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.339 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.339 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "deepsea", 2021-04-09T18:26:26.340 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.340 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.340 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.340 INFO:teuthology.orchestra.run.smithi079.stdout: "salt_api_eauth": { 2021-04-09T18:26:26.340 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "salt_api_eauth", 2021-04-09T18:26:26.341 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.341 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.341 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.341 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "sharedsecret", 2021-04-09T18:26:26.341 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.342 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.342 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.342 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.342 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.342 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.343 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.343 INFO:teuthology.orchestra.run.smithi079.stdout: "salt_api_password": { 2021-04-09T18:26:26.343 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "salt_api_password", 2021-04-09T18:26:26.343 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.344 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.344 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.344 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.344 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.344 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.345 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.345 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.345 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.345 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.345 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.346 INFO:teuthology.orchestra.run.smithi079.stdout: "salt_api_url": { 2021-04-09T18:26:26.346 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "salt_api_url", 2021-04-09T18:26:26.346 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.346 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.347 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.347 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.347 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.347 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.347 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.348 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.348 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.348 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.348 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.349 INFO:teuthology.orchestra.run.smithi079.stdout: "salt_api_username": { 2021-04-09T18:26:26.349 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "salt_api_username", 2021-04-09T18:26:26.349 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.349 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.350 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.350 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.350 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.350 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.350 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.351 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.351 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.351 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.351 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.351 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.352 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.352 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "devicehealth", 2021-04-09T18:26:26.352 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.353 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.353 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.353 INFO:teuthology.orchestra.run.smithi079.stdout: "enable_monitoring": { 2021-04-09T18:26:26.353 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enable_monitoring", 2021-04-09T18:26:26.353 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.354 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.354 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.354 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2021-04-09T18:26:26.354 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.354 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.355 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.355 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "monitor device health metrics", 2021-04-09T18:26:26.355 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.355 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.355 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.356 INFO:teuthology.orchestra.run.smithi079.stdout: "mark_out_threshold": { 2021-04-09T18:26:26.356 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mark_out_threshold", 2021-04-09T18:26:26.356 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:26.356 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.357 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.357 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "2419200", 2021-04-09T18:26:26.357 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.357 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.357 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.358 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically mark OSD if it may fail before this long", 2021-04-09T18:26:26.358 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.358 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.358 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.359 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": { 2021-04-09T18:26:26.359 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pool_name", 2021-04-09T18:26:26.359 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.359 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.360 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.360 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "device_health_metrics", 2021-04-09T18:26:26.360 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.360 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.360 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.361 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "name of pool in which to store device health metrics", 2021-04-09T18:26:26.361 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.361 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.361 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.362 INFO:teuthology.orchestra.run.smithi079.stdout: "retention_period": { 2021-04-09T18:26:26.362 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "retention_period", 2021-04-09T18:26:26.362 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:26.362 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.362 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.363 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15552000", 2021-04-09T18:26:26.363 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.363 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.363 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.363 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long to retain device health metrics", 2021-04-09T18:26:26.364 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.364 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.364 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.364 INFO:teuthology.orchestra.run.smithi079.stdout: "scrape_frequency": { 2021-04-09T18:26:26.365 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "scrape_frequency", 2021-04-09T18:26:26.365 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:26.365 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.365 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.365 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "86400", 2021-04-09T18:26:26.366 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.366 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.366 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.366 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to scrape device health metrics", 2021-04-09T18:26:26.366 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.367 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.367 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.367 INFO:teuthology.orchestra.run.smithi079.stdout: "self_heal": { 2021-04-09T18:26:26.367 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "self_heal", 2021-04-09T18:26:26.368 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.368 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.368 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.368 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.368 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.369 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.369 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.369 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "preemptively heal cluster around devices that may fail", 2021-04-09T18:26:26.369 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.370 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.370 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.370 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2021-04-09T18:26:26.370 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2021-04-09T18:26:26.371 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:26.371 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.371 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.371 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2021-04-09T18:26:26.371 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.372 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.372 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.372 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to wake up and check device health", 2021-04-09T18:26:26.372 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.372 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.373 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.373 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_threshold": { 2021-04-09T18:26:26.373 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_threshold", 2021-04-09T18:26:26.373 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:26.374 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.374 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.374 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "7257600", 2021-04-09T18:26:26.374 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.375 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.375 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.375 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise health warning if OSD may fail before this long", 2021-04-09T18:26:26.375 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.375 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.376 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.376 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.376 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.377 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_cloud", 2021-04-09T18:26:26.377 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.377 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.377 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.377 INFO:teuthology.orchestra.run.smithi079.stdout: "diskprediction_cert_context": { 2021-04-09T18:26:26.378 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_cert_context", 2021-04-09T18:26:26.378 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.378 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.378 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.378 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.379 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.379 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.379 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.379 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.379 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.380 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.380 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.380 INFO:teuthology.orchestra.run.smithi079.stdout: "diskprediction_default_authority": { 2021-04-09T18:26:26.380 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_default_authority", 2021-04-09T18:26:26.381 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.381 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.381 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.381 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "localhost", 2021-04-09T18:26:26.381 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.382 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.382 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.382 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.382 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.382 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.383 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.383 INFO:teuthology.orchestra.run.smithi079.stdout: "diskprediction_password": { 2021-04-09T18:26:26.383 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_password", 2021-04-09T18:26:26.383 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.384 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.384 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.384 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.384 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.384 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.385 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.385 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.385 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.385 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.385 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.386 INFO:teuthology.orchestra.run.smithi079.stdout: "diskprediction_port": { 2021-04-09T18:26:26.386 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_port", 2021-04-09T18:26:26.386 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.387 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.387 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.387 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "31400", 2021-04-09T18:26:26.387 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.387 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.388 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.388 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.388 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.388 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.388 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.389 INFO:teuthology.orchestra.run.smithi079.stdout: "diskprediction_retrieve_prediction_interval": { 2021-04-09T18:26:26.389 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_retrieve_prediction_interval", 2021-04-09T18:26:26.389 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.389 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.390 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.390 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "43200", 2021-04-09T18:26:26.390 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.390 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.390 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.391 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.391 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.391 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.391 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.392 INFO:teuthology.orchestra.run.smithi079.stdout: "diskprediction_server": { 2021-04-09T18:26:26.392 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_server", 2021-04-09T18:26:26.392 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.392 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.392 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.393 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.393 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.393 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.393 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.393 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.394 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.394 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.394 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.394 INFO:teuthology.orchestra.run.smithi079.stdout: "diskprediction_ssl_target_name_override": { 2021-04-09T18:26:26.395 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_ssl_target_name_override", 2021-04-09T18:26:26.395 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.395 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.395 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.396 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "localhost", 2021-04-09T18:26:26.396 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.396 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.396 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.396 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.397 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.397 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.397 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.397 INFO:teuthology.orchestra.run.smithi079.stdout: "diskprediction_upload_metrics_interval": { 2021-04-09T18:26:26.398 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_upload_metrics_interval", 2021-04-09T18:26:26.398 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.398 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.398 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.398 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2021-04-09T18:26:26.399 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.399 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.399 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.399 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.399 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.400 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.400 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.400 INFO:teuthology.orchestra.run.smithi079.stdout: "diskprediction_upload_smart_interval": { 2021-04-09T18:26:26.400 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_upload_smart_interval", 2021-04-09T18:26:26.401 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.401 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.401 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.401 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "43200", 2021-04-09T18:26:26.401 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.402 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.402 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.402 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.402 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.402 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.403 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.403 INFO:teuthology.orchestra.run.smithi079.stdout: "diskprediction_user": { 2021-04-09T18:26:26.403 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_user", 2021-04-09T18:26:26.403 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.404 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.404 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.404 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.404 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.404 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.405 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.405 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.405 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.405 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.405 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.406 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2021-04-09T18:26:26.406 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2021-04-09T18:26:26.406 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.407 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.407 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.407 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2021-04-09T18:26:26.407 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.407 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.408 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.408 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.408 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.408 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.408 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.409 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.409 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.409 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_local", 2021-04-09T18:26:26.410 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.410 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.410 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.410 INFO:teuthology.orchestra.run.smithi079.stdout: "predict_interval": { 2021-04-09T18:26:26.410 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "predict_interval", 2021-04-09T18:26:26.411 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.411 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.411 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.411 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "86400", 2021-04-09T18:26:26.411 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.412 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.412 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.412 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.412 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.412 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.413 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.413 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2021-04-09T18:26:26.413 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2021-04-09T18:26:26.413 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.414 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.414 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.414 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2021-04-09T18:26:26.414 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.414 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.415 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.415 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.415 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.415 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.415 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.416 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.416 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.417 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "influx", 2021-04-09T18:26:26.417 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": false, 2021-04-09T18:26:26.417 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "influxdb python module not found", 2021-04-09T18:26:26.417 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.417 INFO:teuthology.orchestra.run.smithi079.stdout: "batch_size": { 2021-04-09T18:26:26.418 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "batch_size", 2021-04-09T18:26:26.418 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.418 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.418 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.418 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5000", 2021-04-09T18:26:26.419 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.419 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.419 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.419 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.419 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.420 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.420 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.420 INFO:teuthology.orchestra.run.smithi079.stdout: "database": { 2021-04-09T18:26:26.420 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "database", 2021-04-09T18:26:26.421 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.421 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.421 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.421 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "ceph", 2021-04-09T18:26:26.421 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.422 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.422 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.422 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.422 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.422 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.423 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.423 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": { 2021-04-09T18:26:26.423 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "hostname", 2021-04-09T18:26:26.423 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.424 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.424 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.424 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "None", 2021-04-09T18:26:26.424 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.424 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.425 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.425 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.425 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.425 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.425 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.426 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2021-04-09T18:26:26.426 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2021-04-09T18:26:26.426 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.427 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.427 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.427 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "30", 2021-04-09T18:26:26.427 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.427 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.428 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.428 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.428 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.428 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.428 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.429 INFO:teuthology.orchestra.run.smithi079.stdout: "password": { 2021-04-09T18:26:26.429 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "password", 2021-04-09T18:26:26.429 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.429 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.430 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.430 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "None", 2021-04-09T18:26:26.430 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.430 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.430 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.431 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.431 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.431 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.431 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.432 INFO:teuthology.orchestra.run.smithi079.stdout: "port": { 2021-04-09T18:26:26.432 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "port", 2021-04-09T18:26:26.432 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.432 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.432 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.433 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8086", 2021-04-09T18:26:26.433 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.433 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.433 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.434 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.434 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.434 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.434 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.435 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl": { 2021-04-09T18:26:26.435 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl", 2021-04-09T18:26:26.435 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.435 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.435 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.436 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "false", 2021-04-09T18:26:26.436 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.436 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.436 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.436 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.437 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.437 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.437 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.437 INFO:teuthology.orchestra.run.smithi079.stdout: "threads": { 2021-04-09T18:26:26.438 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "threads", 2021-04-09T18:26:26.438 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.438 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.438 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.438 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2021-04-09T18:26:26.439 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.439 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.439 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.439 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.439 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.440 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.440 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.440 INFO:teuthology.orchestra.run.smithi079.stdout: "username": { 2021-04-09T18:26:26.440 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "username", 2021-04-09T18:26:26.441 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.441 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.441 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.441 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "None", 2021-04-09T18:26:26.441 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.442 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.442 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.442 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.442 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.442 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.443 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.443 INFO:teuthology.orchestra.run.smithi079.stdout: "verify_ssl": { 2021-04-09T18:26:26.443 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "verify_ssl", 2021-04-09T18:26:26.444 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.444 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.444 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.444 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "true", 2021-04-09T18:26:26.444 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.445 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.445 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.445 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.445 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.445 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.446 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.446 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.446 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.447 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "insights", 2021-04-09T18:26:26.447 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.447 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.447 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": {} 2021-04-09T18:26:26.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.448 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "iostat", 2021-04-09T18:26:26.448 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.448 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.448 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": {} 2021-04-09T18:26:26.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.449 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "localpool", 2021-04-09T18:26:26.449 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.449 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.450 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.450 INFO:teuthology.orchestra.run.smithi079.stdout: "failure_domain": { 2021-04-09T18:26:26.450 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "failure_domain", 2021-04-09T18:26:26.450 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.450 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.451 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.451 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "host", 2021-04-09T18:26:26.451 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.451 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.452 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.452 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "failure domain for any created local pool", 2021-04-09T18:26:26.452 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.452 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.452 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.453 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": { 2021-04-09T18:26:26.453 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "min_size", 2021-04-09T18:26:26.453 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.453 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.454 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.454 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.454 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.454 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.454 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.455 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default min_size for any created local pool", 2021-04-09T18:26:26.455 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.455 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.455 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.456 INFO:teuthology.orchestra.run.smithi079.stdout: "num_rep": { 2021-04-09T18:26:26.456 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "num_rep", 2021-04-09T18:26:26.456 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.456 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.456 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.457 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3", 2021-04-09T18:26:26.457 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.457 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.457 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.457 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default replica count for any created local pool", 2021-04-09T18:26:26.458 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.458 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.458 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.458 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": { 2021-04-09T18:26:26.459 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pg_num", 2021-04-09T18:26:26.459 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.459 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.459 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.459 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "128", 2021-04-09T18:26:26.460 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.460 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.460 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.460 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default pg_num for any created local pool", 2021-04-09T18:26:26.461 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.461 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.461 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.461 INFO:teuthology.orchestra.run.smithi079.stdout: "prefix": { 2021-04-09T18:26:26.462 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prefix", 2021-04-09T18:26:26.462 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.462 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.462 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.462 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.463 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.463 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.463 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.463 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "name prefix for any created local pool", 2021-04-09T18:26:26.464 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.464 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.464 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.464 INFO:teuthology.orchestra.run.smithi079.stdout: "subtree": { 2021-04-09T18:26:26.465 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "subtree", 2021-04-09T18:26:26.465 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.465 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.465 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.465 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "rack", 2021-04-09T18:26:26.466 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.466 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.466 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.466 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "CRUSH level for which to create a local pool", 2021-04-09T18:26:26.466 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.467 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.467 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.467 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.467 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.468 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "orchestrator_cli", 2021-04-09T18:26:26.468 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.468 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.469 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.469 INFO:teuthology.orchestra.run.smithi079.stdout: "orchestrator": { 2021-04-09T18:26:26.469 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "orchestrator", 2021-04-09T18:26:26.469 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.469 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.470 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.470 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.470 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.470 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.470 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.471 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.471 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.471 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.471 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.471 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.472 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.472 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pg_autoscaler", 2021-04-09T18:26:26.472 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.473 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.473 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.473 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2021-04-09T18:26:26.473 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2021-04-09T18:26:26.473 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.474 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.474 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.474 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2021-04-09T18:26:26.474 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.474 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.475 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.475 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.475 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.475 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.475 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.476 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.476 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.477 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "progress", 2021-04-09T18:26:26.477 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.477 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.477 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.477 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": { 2021-04-09T18:26:26.477 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enabled", 2021-04-09T18:26:26.478 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.478 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.478 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.478 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.478 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.479 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.479 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.479 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.479 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.480 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.480 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.480 INFO:teuthology.orchestra.run.smithi079.stdout: "max_completed_events": { 2021-04-09T18:26:26.480 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_completed_events", 2021-04-09T18:26:26.481 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.481 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.481 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.481 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "50", 2021-04-09T18:26:26.481 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.482 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.482 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.482 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "number of past completed events to remember", 2021-04-09T18:26:26.482 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.482 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.483 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.483 INFO:teuthology.orchestra.run.smithi079.stdout: "persist_interval": { 2021-04-09T18:26:26.483 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "persist_interval", 2021-04-09T18:26:26.483 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:26.484 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.484 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:26.484 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2021-04-09T18:26:26.484 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.484 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.485 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.485 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to persist completed events", 2021-04-09T18:26:26.485 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.485 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.485 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.486 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prometheus", 2021-04-09T18:26:26.487 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.487 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.487 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.487 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_stats_pools": { 2021-04-09T18:26:26.487 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_stats_pools", 2021-04-09T18:26:26.488 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.488 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.488 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.488 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.488 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.489 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.489 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.489 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.489 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.489 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.490 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.490 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_stats_pools_refresh_interval": { 2021-04-09T18:26:26.490 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_stats_pools_refresh_interval", 2021-04-09T18:26:26.490 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.491 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.491 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.491 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "300", 2021-04-09T18:26:26.491 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.492 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.492 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.492 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.492 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.492 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.493 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.493 INFO:teuthology.orchestra.run.smithi079.stdout: "scrape_interval": { 2021-04-09T18:26:26.493 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "scrape_interval", 2021-04-09T18:26:26.493 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.494 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.494 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.494 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.494 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.494 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.495 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.495 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.495 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.495 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.495 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.496 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2021-04-09T18:26:26.496 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2021-04-09T18:26:26.496 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.496 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.497 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.497 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.497 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.497 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.497 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.498 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.498 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.498 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.498 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.499 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2021-04-09T18:26:26.499 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2021-04-09T18:26:26.499 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.499 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.499 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.500 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.500 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.500 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.500 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.500 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.501 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.501 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.501 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.501 INFO:teuthology.orchestra.run.smithi079.stdout: "stale_cache_strategy": { 2021-04-09T18:26:26.502 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "stale_cache_strategy", 2021-04-09T18:26:26.502 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.502 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.502 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.503 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.503 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.503 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.503 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.503 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.504 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.504 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.504 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.505 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_support", 2021-04-09T18:26:26.505 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.505 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.506 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": {} 2021-04-09T18:26:26.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.506 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "restful", 2021-04-09T18:26:26.506 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.507 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.507 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.507 INFO:teuthology.orchestra.run.smithi079.stdout: "key_file": { 2021-04-09T18:26:26.507 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "key_file", 2021-04-09T18:26:26.508 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.508 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.508 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.508 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.508 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.509 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.509 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.509 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.509 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.509 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.510 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.510 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2021-04-09T18:26:26.510 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2021-04-09T18:26:26.511 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.511 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.511 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.511 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.511 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.512 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.512 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.512 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.512 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.513 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.513 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.513 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2021-04-09T18:26:26.514 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2021-04-09T18:26:26.514 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.514 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.514 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.514 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.515 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.515 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.515 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.515 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.516 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.516 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.516 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.516 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.517 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.518 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rook", 2021-04-09T18:26:26.518 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.518 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.518 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": {} 2021-04-09T18:26:26.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.519 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "selftest", 2021-04-09T18:26:26.519 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.520 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.520 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.520 INFO:teuthology.orchestra.run.smithi079.stdout: "roption1": { 2021-04-09T18:26:26.521 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "roption1", 2021-04-09T18:26:26.521 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.521 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.521 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.521 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.522 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.522 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.522 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.522 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.522 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.523 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.523 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.523 INFO:teuthology.orchestra.run.smithi079.stdout: "roption2": { 2021-04-09T18:26:26.524 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "roption2", 2021-04-09T18:26:26.524 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.524 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.524 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.524 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "xyz", 2021-04-09T18:26:26.525 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.525 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.525 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.525 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.525 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.526 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.526 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.526 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption1": { 2021-04-09T18:26:26.526 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption1", 2021-04-09T18:26:26.527 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.527 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.527 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.527 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.527 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.528 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.528 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.528 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.528 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.528 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.529 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.529 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption2": { 2021-04-09T18:26:26.529 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption2", 2021-04-09T18:26:26.529 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.530 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.530 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.530 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.530 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.530 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.531 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.531 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.531 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.531 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.532 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.532 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption3": { 2021-04-09T18:26:26.532 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption3", 2021-04-09T18:26:26.532 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2021-04-09T18:26:26.533 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.533 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.533 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.533 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.533 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.534 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.534 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.534 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.534 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.534 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.535 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption4": { 2021-04-09T18:26:26.535 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption4", 2021-04-09T18:26:26.535 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.535 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.536 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.536 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.536 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.536 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.536 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.537 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.537 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.537 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.537 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.538 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption5": { 2021-04-09T18:26:26.538 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption5", 2021-04-09T18:26:26.538 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.538 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.539 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.539 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.539 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.539 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.539 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.540 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.540 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.540 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.540 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.541 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption6": { 2021-04-09T18:26:26.541 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption6", 2021-04-09T18:26:26.541 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.541 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.541 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.542 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.542 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.542 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.542 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.542 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.543 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.543 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.543 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.543 INFO:teuthology.orchestra.run.smithi079.stdout: "testkey": { 2021-04-09T18:26:26.544 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testkey", 2021-04-09T18:26:26.544 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.544 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.544 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.544 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.545 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.545 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.545 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.545 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.545 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.546 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.546 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.546 INFO:teuthology.orchestra.run.smithi079.stdout: "testlkey": { 2021-04-09T18:26:26.546 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testlkey", 2021-04-09T18:26:26.547 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.547 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.547 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.547 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.548 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.548 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.548 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.548 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.548 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.548 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.549 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.549 INFO:teuthology.orchestra.run.smithi079.stdout: "testnewline": { 2021-04-09T18:26:26.549 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testnewline", 2021-04-09T18:26:26.550 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.550 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.550 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.550 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.550 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.551 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.551 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.551 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.551 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.551 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.552 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.552 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.552 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.553 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssh", 2021-04-09T18:26:26.553 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.553 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.553 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.554 INFO:teuthology.orchestra.run.smithi079.stdout: "inventory_cache_timeout_min": { 2021-04-09T18:26:26.554 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "inventory_cache_timeout_min", 2021-04-09T18:26:26.554 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.554 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.555 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.555 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.555 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.555 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.555 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.556 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.556 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.556 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.556 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.557 INFO:teuthology.orchestra.run.smithi079.stdout: "ssh_config_file": { 2021-04-09T18:26:26.557 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssh_config_file", 2021-04-09T18:26:26.557 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.557 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.557 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.558 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.558 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.558 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.558 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.558 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.559 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.559 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.559 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.559 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.559 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.560 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "status", 2021-04-09T18:26:26.560 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.561 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.561 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": {} 2021-04-09T18:26:26.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.561 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "telegraf", 2021-04-09T18:26:26.562 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.562 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.562 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.562 INFO:teuthology.orchestra.run.smithi079.stdout: "address": { 2021-04-09T18:26:26.562 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "address", 2021-04-09T18:26:26.563 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.563 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.563 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.563 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2021-04-09T18:26:26.563 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.564 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.564 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.564 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.564 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.564 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.565 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.565 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2021-04-09T18:26:26.565 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2021-04-09T18:26:26.565 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:26.566 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.566 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.566 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15", 2021-04-09T18:26:26.566 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.566 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.567 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.567 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.567 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.567 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.567 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.568 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.568 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.568 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "telemetry", 2021-04-09T18:26:26.569 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.569 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.569 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.569 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_basic": { 2021-04-09T18:26:26.569 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_basic", 2021-04-09T18:26:26.570 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.570 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.570 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.570 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.570 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.571 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.571 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.571 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share basic cluster information (size, version)", 2021-04-09T18:26:26.571 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.571 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.572 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.572 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_crash": { 2021-04-09T18:26:26.572 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_crash", 2021-04-09T18:26:26.572 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.573 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.573 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.573 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.573 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.573 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.574 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.574 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.574 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.574 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.574 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.575 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_device": { 2021-04-09T18:26:26.575 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_device", 2021-04-09T18:26:26.575 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.576 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.576 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.576 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2021-04-09T18:26:26.576 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.576 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.577 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.577 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.577 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.577 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.577 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.578 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_ident": { 2021-04-09T18:26:26.578 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_ident", 2021-04-09T18:26:26.578 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.578 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.579 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.579 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2021-04-09T18:26:26.579 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.579 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.579 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.580 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.580 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.580 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.580 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.581 INFO:teuthology.orchestra.run.smithi079.stdout: "contact": { 2021-04-09T18:26:26.581 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "contact", 2021-04-09T18:26:26.581 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.581 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.581 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.582 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "None", 2021-04-09T18:26:26.582 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.582 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.582 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.582 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.583 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.583 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.583 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.583 INFO:teuthology.orchestra.run.smithi079.stdout: "description": { 2021-04-09T18:26:26.584 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "description", 2021-04-09T18:26:26.584 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.584 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.584 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.585 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "None", 2021-04-09T18:26:26.585 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.585 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.585 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.585 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.586 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.586 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.586 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.586 INFO:teuthology.orchestra.run.smithi079.stdout: "device_url": { 2021-04-09T18:26:26.587 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "device_url", 2021-04-09T18:26:26.587 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.587 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.587 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.587 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "https://telemetry.ceph.com/device", 2021-04-09T18:26:26.588 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.588 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.588 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.588 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.588 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.589 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.589 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.589 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": { 2021-04-09T18:26:26.589 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enabled", 2021-04-09T18:26:26.590 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.590 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.590 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.590 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2021-04-09T18:26:26.590 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.591 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.591 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.591 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.591 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.591 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.592 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.592 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2021-04-09T18:26:26.592 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2021-04-09T18:26:26.592 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.593 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.593 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.593 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "24", 2021-04-09T18:26:26.593 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "8", 2021-04-09T18:26:26.594 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.594 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.594 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.594 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.594 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.595 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.595 INFO:teuthology.orchestra.run.smithi079.stdout: "last_opt_revision": { 2021-04-09T18:26:26.595 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "last_opt_revision", 2021-04-09T18:26:26.595 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.596 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.596 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.596 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1", 2021-04-09T18:26:26.597 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.597 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.597 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.597 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.597 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.598 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.598 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.598 INFO:teuthology.orchestra.run.smithi079.stdout: "leaderboard": { 2021-04-09T18:26:26.599 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "leaderboard", 2021-04-09T18:26:26.599 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2021-04-09T18:26:26.599 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.599 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.600 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2021-04-09T18:26:26.600 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.600 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.600 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.601 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.601 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.601 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.601 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.602 INFO:teuthology.orchestra.run.smithi079.stdout: "organization": { 2021-04-09T18:26:26.603 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "organization", 2021-04-09T18:26:26.603 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.603 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.603 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.603 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "None", 2021-04-09T18:26:26.604 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.604 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.604 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.604 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.605 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.605 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.605 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.605 INFO:teuthology.orchestra.run.smithi079.stdout: "proxy": { 2021-04-09T18:26:26.606 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "proxy", 2021-04-09T18:26:26.606 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.606 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.606 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.607 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "None", 2021-04-09T18:26:26.607 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.607 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.607 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.608 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.608 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.608 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.608 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.609 INFO:teuthology.orchestra.run.smithi079.stdout: "url": { 2021-04-09T18:26:26.609 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "url", 2021-04-09T18:26:26.609 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.609 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.609 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.610 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "https://telemetry.ceph.com/report", 2021-04-09T18:26:26.610 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.610 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.610 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.611 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.611 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.611 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.612 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.613 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "test_orchestrator", 2021-04-09T18:26:26.613 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.613 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.613 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": {} 2021-04-09T18:26:26.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.614 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "volumes", 2021-04-09T18:26:26.615 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.615 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.615 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.616 INFO:teuthology.orchestra.run.smithi079.stdout: "max_concurrent_clones": { 2021-04-09T18:26:26.616 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_concurrent_clones", 2021-04-09T18:26:26.616 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.617 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.617 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.617 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "4", 2021-04-09T18:26:26.617 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.618 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.618 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.618 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Number of asynchronous cloner threads", 2021-04-09T18:26:26.618 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.618 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.619 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.619 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.619 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:26.620 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix", 2021-04-09T18:26:26.620 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2021-04-09T18:26:26.620 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2021-04-09T18:26:26.620 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2021-04-09T18:26:26.621 INFO:teuthology.orchestra.run.smithi079.stdout: "identifier": { 2021-04-09T18:26:26.621 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "identifier", 2021-04-09T18:26:26.621 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.621 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.622 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.622 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2021-04-09T18:26:26.622 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.623 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.623 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.624 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.624 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.624 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.625 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.625 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2021-04-09T18:26:26.626 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2021-04-09T18:26:26.626 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2021-04-09T18:26:26.627 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.627 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.627 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2021-04-09T18:26:26.628 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.628 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.629 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.629 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.629 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.630 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.630 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.631 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_host": { 2021-04-09T18:26:26.631 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_host", 2021-04-09T18:26:26.632 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.632 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.632 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.633 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "None", 2021-04-09T18:26:26.633 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.634 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.634 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.634 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.635 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.635 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.635 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.636 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_port": { 2021-04-09T18:26:26.636 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_port", 2021-04-09T18:26:26.636 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2021-04-09T18:26:26.637 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.637 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.637 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10051", 2021-04-09T18:26:26.637 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.637 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.638 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.638 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.638 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.638 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.639 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.639 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_sender": { 2021-04-09T18:26:26.640 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_sender", 2021-04-09T18:26:26.640 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2021-04-09T18:26:26.640 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2021-04-09T18:26:26.641 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2021-04-09T18:26:26.641 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "/usr/bin/zabbix_sender", 2021-04-09T18:26:26.641 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2021-04-09T18:26:26.642 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2021-04-09T18:26:26.642 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2021-04-09T18:26:26.643 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2021-04-09T18:26:26.643 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2021-04-09T18:26:26.643 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2021-04-09T18:26:26.644 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2021-04-09T18:26:26.644 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.644 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.645 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.645 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:26:26.645 INFO:teuthology.orchestra.run.smithi079.stdout: "services": {}, 2021-04-09T18:26:26.646 INFO:teuthology.orchestra.run.smithi079.stdout: "always_on_modules": { 2021-04-09T18:26:26.646 INFO:teuthology.orchestra.run.smithi079.stdout: "nautilus": [ 2021-04-09T18:26:26.647 INFO:teuthology.orchestra.run.smithi079.stdout: "balancer", 2021-04-09T18:26:26.647 INFO:teuthology.orchestra.run.smithi079.stdout: "crash", 2021-04-09T18:26:26.647 INFO:teuthology.orchestra.run.smithi079.stdout: "devicehealth", 2021-04-09T18:26:26.648 INFO:teuthology.orchestra.run.smithi079.stdout: "orchestrator_cli", 2021-04-09T18:26:26.648 INFO:teuthology.orchestra.run.smithi079.stdout: "progress", 2021-04-09T18:26:26.648 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_support", 2021-04-09T18:26:26.648 INFO:teuthology.orchestra.run.smithi079.stdout: "status", 2021-04-09T18:26:26.648 INFO:teuthology.orchestra.run.smithi079.stdout: "volumes" 2021-04-09T18:26:26.649 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:26.649 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:26.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.649 INFO:teuthology.orchestra.run.smithi079.stdout: "servicemap": { 2021-04-09T18:26:26.649 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 1, 2021-04-09T18:26:26.650 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "0.000000", 2021-04-09T18:26:26.650 INFO:teuthology.orchestra.run.smithi079.stdout: "services": {} 2021-04-09T18:26:26.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:26.650 INFO:teuthology.orchestra.run.smithi079.stdout: "progress_events": {} 2021-04-09T18:26:26.650 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:26:26.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.562 7f56253d1700 1 -- 172.21.15.79:0/752927305 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5604029100 msgr2=0x7f560402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:26.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.562 7f56253d1700 1 --2- 172.21.15.79:0/752927305 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5604029100 0x7f560402b650 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:26.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.566 7f56253d1700 1 -- 172.21.15.79:0/752927305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56200ceda0 msgr2=0x7f562008fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:26.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.566 7f56253d1700 1 --2- 172.21.15.79:0/752927305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56200ceda0 0x7f562008fd10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f56200d61e0 tx=0x7f5618006c10).stop 2021-04-09T18:26:26.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.566 7f56253d1700 1 -- 172.21.15.79:0/752927305 shutdown_connections 2021-04-09T18:26:26.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.566 7f56253d1700 1 --2- 172.21.15.79:0/752927305 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5604029100 0x7f560402b650 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:26.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.566 7f56253d1700 1 --2- 172.21.15.79:0/752927305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56200cfea0 0x7f562008efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:26.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.566 7f56253d1700 1 --2- 172.21.15.79:0/752927305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56200ceda0 0x7f562008fd10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:26.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.566 7f56253d1700 1 --2- 172.21.15.79:0/752927305 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56200d6560 0x7f56200ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:26.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.566 7f56253d1700 1 -- 172.21.15.79:0/752927305 >> 172.21.15.79:0/752927305 conn(0x7f5620093580 msgr2=0x7f56200d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:26.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.566 7f56253d1700 1 -- 172.21.15.79:0/752927305 shutdown_connections 2021-04-09T18:26:26.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:25.566 7f56253d1700 1 -- 172.21.15.79:0/752927305 wait complete. 2021-04-09T18:26:26.657 INFO:tasks.ceph.ceph_manager.ceph:{'fsid': 'fc927781-121d-4817-b30c-0c6f9e107f84', 'health': {'checks': {}, 'status': 'HEALTH_OK'}, 'election_epoch': 8, 'quorum': [0, 1, 2], 'quorum_names': ['a', 'b', 'c'], 'quorum_age': 32, 'monmap': {'epoch': 1, 'min_mon_release_name': '14', 'num_mons': 3}, 'osdmap': {'osdmap': {'epoch': 22, 'num_osds': 8, 'num_up_osds': 8, 'num_in_osds': 8, 'num_remapped_pgs': 0}}, 'pgmap': {'pgs_by_state': [{'state_name': 'active+clean', 'count': 24}], 'num_pgs': 24, 'num_pools': 3, 'num_objects': 21, 'data_bytes': 2286, 'bytes_used': 8591900672, 'bytes_avail': 764502212608, 'bytes_total': 773094113280}, 'fsmap': {'epoch': 6, 'id': 1, 'up': 1, 'in': 1, 'max': 1, 'by_rank': [{'filesystem_id': 1, 'rank': 0, 'name': 'a', 'status': 'up:active', 'gid': 4338}], 'up:standby': 1}, 'mgrmap': {'epoch': 3, 'active_gid': 4100, 'active_name': 'x', 'active_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6800', 'nonce': 13779}, {'type': 'v1', 'addr': '172.21.15.89:6801', 'nonce': 13779}]}, 'active_addr': '172.21.15.89:6801/13779', 'active_change': '2021-04-09 18:25:55.935878', 'available': True, 'standbys': [{'gid': 4104, 'name': 'y', 'available_modules': [{'name': 'alerts', 'can_run': True, 'error_string': '', 'module_options': {'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'How frequently to reexamine health status', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_destination': {'name': 'smtp_destination', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email address to send alerts to', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_from_name': {'name': 'smtp_from_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'Ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email From: name', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_host': {'name': 'smtp_host', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_password': {'name': 'smtp_password', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Password to authenticate with', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_port': {'name': 'smtp_port', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '465', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP port', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_sender': {'name': 'smtp_sender', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP envelope sender', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_ssl': {'name': 'smtp_ssl', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Use SSL to connect to SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_user': {'name': 'smtp_user', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'User to authenticate as', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ansible', 'can_run': True, 'error_string': '', 'module_options': {'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_url': {'name': 'server_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_server': {'name': 'verify_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'balancer', 'can_run': True, 'error_string': '', 'module_options': {'active': {'name': 'active', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically balance PGs across cluster', 'long_desc': '', 'tags': [], 'see_also': []}, 'begin_time': {'name': 'begin_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '0000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'beginning time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'begin_weekday': {'name': 'begin_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to this day of the week or later', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'crush_compat_max_iterations': {'name': 'crush_compat_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '25', 'min': '1', 'max': '250', 'enum_allowed': [], 'desc': 'maximum number of iterations to attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'crush_compat_metrics': {'name': 'crush_compat_metrics', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'pgs,objects,bytes', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'metrics with which to calculate OSD utilization', 'long_desc': 'Value is a list of one or more of "pgs", "objects", or "bytes", and indicates which metrics to use to balance utilization.', 'tags': [], 'see_also': []}, 'crush_compat_step': {'name': 'crush_compat_step', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0.5', 'min': '0.001', 'max': '0.999', 'enum_allowed': [], 'desc': 'aggressiveness of optimization', 'long_desc': '.99 is very aggressive, .01 is less aggressive', 'tags': [], 'see_also': []}, 'end_time': {'name': 'end_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '2400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'ending time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'end_weekday': {'name': 'end_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '7', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to days of the week earlier than this', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'min_score': {'name': 'min_score', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'minimum score, below which no optimization is attempted', 'long_desc': '', 'tags': [], 'see_also': []}, 'mode': {'name': 'mode', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'none', 'min': '', 'max': '', 'enum_allowed': ['crush-compat', 'none', 'upmap'], 'desc': 'Balancer mode', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_ids': {'name': 'pool_ids', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'pools which the automatic balancing will be limited to', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'upmap_max_deviation': {'name': 'upmap_max_deviation', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '1', 'max': '', 'enum_allowed': [], 'desc': 'deviation below which no optimization is attempted', 'long_desc': 'If the number of PGs are within this count then no optimization is attempted', 'tags': [], 'see_also': []}, 'upmap_max_iterations': {'name': 'upmap_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '10', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'maximum upmap optimization iterations', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'crash', 'can_run': True, 'error_string': '', 'module_options': {'retain_interval': {'name': 'retain_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '31536000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain crashes before pruning them', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_recent_interval': {'name': 'warn_recent_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '1209600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'time interval in which to warn about recent crashes', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'dashboard', 'can_run': True, 'error_string': '', 'module_options': {'ALERTMANAGER_API_HOST': {'name': 'ALERTMANAGER_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_ENABLED': {'name': 'AUDIT_API_ENABLED', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_LOG_PAYLOAD': {'name': 'AUDIT_API_LOG_PAYLOAD', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ENABLE_BROWSABLE_API': {'name': 'ENABLE_BROWSABLE_API', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_cephfs': {'name': 'FEATURE_TOGGLE_cephfs', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_iscsi': {'name': 'FEATURE_TOGGLE_iscsi', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_mirroring': {'name': 'FEATURE_TOGGLE_mirroring', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rbd': {'name': 'FEATURE_TOGGLE_rbd', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rgw': {'name': 'FEATURE_TOGGLE_rgw', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE': {'name': 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_PASSWORD': {'name': 'GRAFANA_API_PASSWORD', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_SSL_VERIFY': {'name': 'GRAFANA_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_URL': {'name': 'GRAFANA_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_USERNAME': {'name': 'GRAFANA_API_USERNAME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_FRONTEND_API_URL': {'name': 'GRAFANA_FRONTEND_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_UPDATE_DASHBOARDS': {'name': 'GRAFANA_UPDATE_DASHBOARDS', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ISCSI_API_SSL_VERIFICATION': {'name': 'ISCSI_API_SSL_VERIFICATION', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'PROMETHEUS_API_HOST': {'name': 'PROMETHEUS_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'REST_REQUESTS_TIMEOUT': {'name': 'REST_REQUESTS_TIMEOUT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '45', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ACCESS_KEY': {'name': 'RGW_API_ACCESS_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ADMIN_RESOURCE': {'name': 'RGW_API_ADMIN_RESOURCE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_HOST': {'name': 'RGW_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_PORT': {'name': 'RGW_API_PORT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '80', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SCHEME': {'name': 'RGW_API_SCHEME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'http', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SECRET_KEY': {'name': 'RGW_API_SECRET_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SSL_VERIFY': {'name': 'RGW_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_USER_ID': {'name': 'RGW_API_USER_ID', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'crt_file': {'name': 'crt_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'debug': {'name': 'debug', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Enable/disable debug options', 'long_desc': '', 'tags': [], 'see_also': []}, 'jwt_token_ttl': {'name': 'jwt_token_ttl', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '28800', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '::', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8080', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl_server_port': {'name': 'ssl_server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8443', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_behaviour': {'name': 'standby_behaviour', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'redirect', 'min': '', 'max': '', 'enum_allowed': ['error', 'redirect'], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_error_status_code': {'name': 'standby_error_status_code', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '500', 'min': '400', 'max': '599', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url_prefix': {'name': 'url_prefix', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'deepsea', 'can_run': True, 'error_string': '', 'module_options': {'salt_api_eauth': {'name': 'salt_api_eauth', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'sharedsecret', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_password': {'name': 'salt_api_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_url': {'name': 'salt_api_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_username': {'name': 'salt_api_username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'devicehealth', 'can_run': True, 'error_string': '', 'module_options': {'enable_monitoring': {'name': 'enable_monitoring', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'monitor device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'mark_out_threshold': {'name': 'mark_out_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '2419200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically mark OSD if it may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_name': {'name': 'pool_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'device_health_metrics', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name of pool in which to store device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'retention_period': {'name': 'retention_period', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '15552000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_frequency': {'name': 'scrape_frequency', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to scrape device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'self_heal': {'name': 'self_heal', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'preemptively heal cluster around devices that may fail', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and check device health', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_threshold': {'name': 'warn_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '7257600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'raise health warning if OSD may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_cloud', 'can_run': True, 'error_string': '', 'module_options': {'diskprediction_cert_context': {'name': 'diskprediction_cert_context', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_default_authority': {'name': 'diskprediction_default_authority', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_password': {'name': 'diskprediction_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_port': {'name': 'diskprediction_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '31400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_retrieve_prediction_interval': {'name': 'diskprediction_retrieve_prediction_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_server': {'name': 'diskprediction_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_ssl_target_name_override': {'name': 'diskprediction_ssl_target_name_override', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_metrics_interval': {'name': 'diskprediction_upload_metrics_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_smart_interval': {'name': 'diskprediction_upload_smart_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_user': {'name': 'diskprediction_user', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_local', 'can_run': True, 'error_string': '', 'module_options': {'predict_interval': {'name': 'predict_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'influx', 'can_run': False, 'error_string': 'influxdb python module not found', 'module_options': {'batch_size': {'name': 'batch_size', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'database': {'name': 'database', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'hostname': {'name': 'hostname', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '30', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'port': {'name': 'port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '8086', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'false', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'threads': {'name': 'threads', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_ssl': {'name': 'verify_ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'true', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'insights', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'iostat', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'localpool', 'can_run': True, 'error_string': '', 'module_options': {'failure_domain': {'name': 'failure_domain', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'host', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'failure domain for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'min_size': {'name': 'min_size', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default min_size for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'num_rep': {'name': 'num_rep', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '3', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default replica count for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'pg_num': {'name': 'pg_num', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '128', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default pg_num for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'prefix': {'name': 'prefix', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name prefix for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'subtree': {'name': 'subtree', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'rack', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'CRUSH level for which to create a local pool', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'orchestrator_cli', 'can_run': True, 'error_string': '', 'module_options': {'orchestrator': {'name': 'orchestrator', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'pg_autoscaler', 'can_run': True, 'error_string': '', 'module_options': {'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'progress', 'can_run': True, 'error_string': '', 'module_options': {'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'max_completed_events': {'name': 'max_completed_events', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '50', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'number of past completed events to remember', 'long_desc': '', 'tags': [], 'see_also': []}, 'persist_interval': {'name': 'persist_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to persist completed events', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'prometheus', 'can_run': True, 'error_string': '', 'module_options': {'rbd_stats_pools': {'name': 'rbd_stats_pools', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rbd_stats_pools_refresh_interval': {'name': 'rbd_stats_pools_refresh_interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '300', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_interval': {'name': 'scrape_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'stale_cache_strategy': {'name': 'stale_cache_strategy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rbd_support', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'restful', 'can_run': True, 'error_string': '', 'module_options': {'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rook', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'selftest', 'can_run': True, 'error_string': '', 'module_options': {'roption1': {'name': 'roption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'roption2': {'name': 'roption2', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'xyz', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption1': {'name': 'rwoption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption2': {'name': 'rwoption2', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption3': {'name': 'rwoption3', 'type': 'float', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption4': {'name': 'rwoption4', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption5': {'name': 'rwoption5', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption6': {'name': 'rwoption6', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testkey': {'name': 'testkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testlkey': {'name': 'testlkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testnewline': {'name': 'testnewline', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ssh', 'can_run': True, 'error_string': '', 'module_options': {'inventory_cache_timeout_min': {'name': 'inventory_cache_timeout_min', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssh_config_file': {'name': 'ssh_config_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'status', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'telegraf', 'can_run': True, 'error_string': '', 'module_options': {'address': {'name': 'address', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'unixgram:///tmp/telegraf.sock', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '15', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'telemetry', 'can_run': True, 'error_string': '', 'module_options': {'channel_basic': {'name': 'channel_basic', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Share basic cluster information (size, version)', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_crash': {'name': 'channel_crash', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_device': {'name': 'channel_device', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_ident': {'name': 'channel_ident', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'contact': {'name': 'contact', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'description': {'name': 'description', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'device_url': {'name': 'device_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/device', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '24', 'min': '8', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'last_opt_revision': {'name': 'last_opt_revision', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '1', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'leaderboard': {'name': 'leaderboard', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'organization': {'name': 'organization', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'proxy': {'name': 'proxy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url': {'name': 'url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/report', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'test_orchestrator', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'volumes', 'can_run': True, 'error_string': '', 'module_options': {'max_concurrent_clones': {'name': 'max_concurrent_clones', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '4', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Number of asynchronous cloner threads', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'zabbix', 'can_run': True, 'error_string': '', 'module_options': {'identifier': {'name': 'identifier', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_host': {'name': 'zabbix_host', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_port': {'name': 'zabbix_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '10051', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_sender': {'name': 'zabbix_sender', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '/usr/bin/zabbix_sender', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}]}], 'modules': ['iostat', 'restful'], 'available_modules': [{'name': 'alerts', 'can_run': True, 'error_string': '', 'module_options': {'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'How frequently to reexamine health status', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_destination': {'name': 'smtp_destination', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email address to send alerts to', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_from_name': {'name': 'smtp_from_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'Ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email From: name', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_host': {'name': 'smtp_host', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_password': {'name': 'smtp_password', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Password to authenticate with', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_port': {'name': 'smtp_port', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '465', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP port', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_sender': {'name': 'smtp_sender', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP envelope sender', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_ssl': {'name': 'smtp_ssl', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Use SSL to connect to SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_user': {'name': 'smtp_user', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'User to authenticate as', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ansible', 'can_run': True, 'error_string': '', 'module_options': {'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_url': {'name': 'server_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_server': {'name': 'verify_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'balancer', 'can_run': True, 'error_string': '', 'module_options': {'active': {'name': 'active', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically balance PGs across cluster', 'long_desc': '', 'tags': [], 'see_also': []}, 'begin_time': {'name': 'begin_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '0000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'beginning time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'begin_weekday': {'name': 'begin_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to this day of the week or later', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'crush_compat_max_iterations': {'name': 'crush_compat_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '25', 'min': '1', 'max': '250', 'enum_allowed': [], 'desc': 'maximum number of iterations to attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'crush_compat_metrics': {'name': 'crush_compat_metrics', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'pgs,objects,bytes', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'metrics with which to calculate OSD utilization', 'long_desc': 'Value is a list of one or more of "pgs", "objects", or "bytes", and indicates which metrics to use to balance utilization.', 'tags': [], 'see_also': []}, 'crush_compat_step': {'name': 'crush_compat_step', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0.5', 'min': '0.001', 'max': '0.999', 'enum_allowed': [], 'desc': 'aggressiveness of optimization', 'long_desc': '.99 is very aggressive, .01 is less aggressive', 'tags': [], 'see_also': []}, 'end_time': {'name': 'end_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '2400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'ending time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'end_weekday': {'name': 'end_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '7', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to days of the week earlier than this', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'min_score': {'name': 'min_score', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'minimum score, below which no optimization is attempted', 'long_desc': '', 'tags': [], 'see_also': []}, 'mode': {'name': 'mode', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'none', 'min': '', 'max': '', 'enum_allowed': ['crush-compat', 'none', 'upmap'], 'desc': 'Balancer mode', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_ids': {'name': 'pool_ids', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'pools which the automatic balancing will be limited to', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'upmap_max_deviation': {'name': 'upmap_max_deviation', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '1', 'max': '', 'enum_allowed': [], 'desc': 'deviation below which no optimization is attempted', 'long_desc': 'If the number of PGs are within this count then no optimization is attempted', 'tags': [], 'see_also': []}, 'upmap_max_iterations': {'name': 'upmap_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '10', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'maximum upmap optimization iterations', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'crash', 'can_run': True, 'error_string': '', 'module_options': {'retain_interval': {'name': 'retain_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '31536000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain crashes before pruning them', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_recent_interval': {'name': 'warn_recent_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '1209600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'time interval in which to warn about recent crashes', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'dashboard', 'can_run': True, 'error_string': '', 'module_options': {'ALERTMANAGER_API_HOST': {'name': 'ALERTMANAGER_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_ENABLED': {'name': 'AUDIT_API_ENABLED', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_LOG_PAYLOAD': {'name': 'AUDIT_API_LOG_PAYLOAD', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ENABLE_BROWSABLE_API': {'name': 'ENABLE_BROWSABLE_API', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_cephfs': {'name': 'FEATURE_TOGGLE_cephfs', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_iscsi': {'name': 'FEATURE_TOGGLE_iscsi', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_mirroring': {'name': 'FEATURE_TOGGLE_mirroring', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rbd': {'name': 'FEATURE_TOGGLE_rbd', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rgw': {'name': 'FEATURE_TOGGLE_rgw', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE': {'name': 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_PASSWORD': {'name': 'GRAFANA_API_PASSWORD', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_SSL_VERIFY': {'name': 'GRAFANA_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_URL': {'name': 'GRAFANA_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_USERNAME': {'name': 'GRAFANA_API_USERNAME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_FRONTEND_API_URL': {'name': 'GRAFANA_FRONTEND_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_UPDATE_DASHBOARDS': {'name': 'GRAFANA_UPDATE_DASHBOARDS', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ISCSI_API_SSL_VERIFICATION': {'name': 'ISCSI_API_SSL_VERIFICATION', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'PROMETHEUS_API_HOST': {'name': 'PROMETHEUS_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'REST_REQUESTS_TIMEOUT': {'name': 'REST_REQUESTS_TIMEOUT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '45', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ACCESS_KEY': {'name': 'RGW_API_ACCESS_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ADMIN_RESOURCE': {'name': 'RGW_API_ADMIN_RESOURCE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_HOST': {'name': 'RGW_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_PORT': {'name': 'RGW_API_PORT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '80', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SCHEME': {'name': 'RGW_API_SCHEME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'http', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SECRET_KEY': {'name': 'RGW_API_SECRET_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SSL_VERIFY': {'name': 'RGW_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_USER_ID': {'name': 'RGW_API_USER_ID', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'crt_file': {'name': 'crt_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'debug': {'name': 'debug', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Enable/disable debug options', 'long_desc': '', 'tags': [], 'see_also': []}, 'jwt_token_ttl': {'name': 'jwt_token_ttl', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '28800', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '::', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8080', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl_server_port': {'name': 'ssl_server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8443', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_behaviour': {'name': 'standby_behaviour', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'redirect', 'min': '', 'max': '', 'enum_allowed': ['error', 'redirect'], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_error_status_code': {'name': 'standby_error_status_code', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '500', 'min': '400', 'max': '599', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url_prefix': {'name': 'url_prefix', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'deepsea', 'can_run': True, 'error_string': '', 'module_options': {'salt_api_eauth': {'name': 'salt_api_eauth', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'sharedsecret', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_password': {'name': 'salt_api_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_url': {'name': 'salt_api_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_username': {'name': 'salt_api_username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'devicehealth', 'can_run': True, 'error_string': '', 'module_options': {'enable_monitoring': {'name': 'enable_monitoring', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'monitor device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'mark_out_threshold': {'name': 'mark_out_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '2419200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically mark OSD if it may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_name': {'name': 'pool_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'device_health_metrics', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name of pool in which to store device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'retention_period': {'name': 'retention_period', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '15552000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_frequency': {'name': 'scrape_frequency', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to scrape device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'self_heal': {'name': 'self_heal', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'preemptively heal cluster around devices that may fail', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and check device health', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_threshold': {'name': 'warn_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '7257600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'raise health warning if OSD may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_cloud', 'can_run': True, 'error_string': '', 'module_options': {'diskprediction_cert_context': {'name': 'diskprediction_cert_context', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_default_authority': {'name': 'diskprediction_default_authority', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_password': {'name': 'diskprediction_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_port': {'name': 'diskprediction_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '31400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_retrieve_prediction_interval': {'name': 'diskprediction_retrieve_prediction_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_server': {'name': 'diskprediction_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_ssl_target_name_override': {'name': 'diskprediction_ssl_target_name_override', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_metrics_interval': {'name': 'diskprediction_upload_metrics_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_smart_interval': {'name': 'diskprediction_upload_smart_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_user': {'name': 'diskprediction_user', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_local', 'can_run': True, 'error_string': '', 'module_options': {'predict_interval': {'name': 'predict_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'influx', 'can_run': False, 'error_string': 'influxdb python module not found', 'module_options': {'batch_size': {'name': 'batch_size', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'database': {'name': 'database', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'hostname': {'name': 'hostname', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '30', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'port': {'name': 'port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '8086', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'false', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'threads': {'name': 'threads', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_ssl': {'name': 'verify_ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'true', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'insights', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'iostat', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'localpool', 'can_run': True, 'error_string': '', 'module_options': {'failure_domain': {'name': 'failure_domain', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'host', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'failure domain for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'min_size': {'name': 'min_size', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default min_size for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'num_rep': {'name': 'num_rep', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '3', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default replica count for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'pg_num': {'name': 'pg_num', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '128', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default pg_num for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'prefix': {'name': 'prefix', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name prefix for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'subtree': {'name': 'subtree', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'rack', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'CRUSH level for which to create a local pool', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'orchestrator_cli', 'can_run': True, 'error_string': '', 'module_options': {'orchestrator': {'name': 'orchestrator', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'pg_autoscaler', 'can_run': True, 'error_string': '', 'module_options': {'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'progress', 'can_run': True, 'error_string': '', 'module_options': {'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'max_completed_events': {'name': 'max_completed_events', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '50', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'number of past completed events to remember', 'long_desc': '', 'tags': [], 'see_also': []}, 'persist_interval': {'name': 'persist_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to persist completed events', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'prometheus', 'can_run': True, 'error_string': '', 'module_options': {'rbd_stats_pools': {'name': 'rbd_stats_pools', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rbd_stats_pools_refresh_interval': {'name': 'rbd_stats_pools_refresh_interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '300', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_interval': {'name': 'scrape_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'stale_cache_strategy': {'name': 'stale_cache_strategy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rbd_support', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'restful', 'can_run': True, 'error_string': '', 'module_options': {'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rook', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'selftest', 'can_run': True, 'error_string': '', 'module_options': {'roption1': {'name': 'roption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'roption2': {'name': 'roption2', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'xyz', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption1': {'name': 'rwoption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption2': {'name': 'rwoption2', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption3': {'name': 'rwoption3', 'type': 'float', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption4': {'name': 'rwoption4', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption5': {'name': 'rwoption5', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption6': {'name': 'rwoption6', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testkey': {'name': 'testkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testlkey': {'name': 'testlkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testnewline': {'name': 'testnewline', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ssh', 'can_run': True, 'error_string': '', 'module_options': {'inventory_cache_timeout_min': {'name': 'inventory_cache_timeout_min', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssh_config_file': {'name': 'ssh_config_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'status', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'telegraf', 'can_run': True, 'error_string': '', 'module_options': {'address': {'name': 'address', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'unixgram:///tmp/telegraf.sock', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '15', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'telemetry', 'can_run': True, 'error_string': '', 'module_options': {'channel_basic': {'name': 'channel_basic', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Share basic cluster information (size, version)', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_crash': {'name': 'channel_crash', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_device': {'name': 'channel_device', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_ident': {'name': 'channel_ident', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'contact': {'name': 'contact', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'description': {'name': 'description', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'device_url': {'name': 'device_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/device', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '24', 'min': '8', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'last_opt_revision': {'name': 'last_opt_revision', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '1', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'leaderboard': {'name': 'leaderboard', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'organization': {'name': 'organization', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'proxy': {'name': 'proxy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url': {'name': 'url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/report', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'test_orchestrator', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'volumes', 'can_run': True, 'error_string': '', 'module_options': {'max_concurrent_clones': {'name': 'max_concurrent_clones', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '4', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Number of asynchronous cloner threads', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'zabbix', 'can_run': True, 'error_string': '', 'module_options': {'identifier': {'name': 'identifier', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_host': {'name': 'zabbix_host', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_port': {'name': 'zabbix_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '10051', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_sender': {'name': 'zabbix_sender', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '/usr/bin/zabbix_sender', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}], 'services': {}, 'always_on_modules': {'nautilus': ['balancer', 'crash', 'devicehealth', 'orchestrator_cli', 'progress', 'rbd_support', 'status', 'volumes']}}, 'servicemap': {'epoch': 1, 'modified': '0.000000', 'services': {}}, 'progress_events': {}} 2021-04-09T18:26:26.660 INFO:tasks.ceph.ceph_manager.ceph:clean! 2021-04-09T18:26:26.661 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-04-09T18:26:26.661 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph health 2021-04-09T18:26:26.759 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.742 7f5b78c56700 1 Processor -- start 2021-04-09T18:26:26.759 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.742 7f5b78c56700 1 -- start start 2021-04-09T18:26:26.759 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.742 7f5b78c56700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5b740e9ae0 0x7f5b7409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:26.760 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.742 7f5b78c56700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b740fbb20 con 0x7f5b741c8010 2021-04-09T18:26:26.760 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.742 7f5b78c56700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b740e56d0 con 0x7f5b740f5520 2021-04-09T18:26:26.760 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.742 7f5b78c56700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b741c3dc0 con 0x7f5b740e9ae0 2021-04-09T18:26:26.760 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.742 7f5b72fe7700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5b741c8010 0x7f5b741ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50690/0 (socket says 172.21.15.79:50690) 2021-04-09T18:26:26.761 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.742 7f5b72fe7700 1 -- 172.21.15.79:0/2584026285 learned_addr learned my addr 172.21.15.79:0/2584026285 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:26.761 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b71fe5700 1 --2- 172.21.15.79:0/2584026285 >> v2:172.21.15.89:3300/0 conn(0x7f5b740e9ae0 0x7f5b7409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:26.761 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b717e4700 1 -- 172.21.15.79:0/2584026285 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866466942 0 0) 0x7f5b6c001450 con 0x7f5b741c8010 2021-04-09T18:26:26.761 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b717e4700 1 -- 172.21.15.79:0/2584026285 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b5c003240 con 0x7f5b741c8010 2021-04-09T18:26:26.761 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b717e4700 1 -- 172.21.15.79:0/2584026285 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104147647 0 0) 0x7f5b640010d0 con 0x7f5b740f5520 2021-04-09T18:26:26.762 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b717e4700 1 -- 172.21.15.79:0/2584026285 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b5c003620 con 0x7f5b740f5520 2021-04-09T18:26:26.762 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b717e4700 1 -- 172.21.15.79:0/2584026285 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3974410917 0 0) 0x7f5b6c0019d0 con 0x7f5b741c8010 2021-04-09T18:26:26.762 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b717e4700 1 -- 172.21.15.79:0/2584026285 >> v2:172.21.15.89:3300/0 conn(0x7f5b740e9ae0 msgr2=0x7f5b7409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:26.763 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b717e4700 1 --2- 172.21.15.79:0/2584026285 >> v2:172.21.15.89:3300/0 conn(0x7f5b740e9ae0 0x7f5b7409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:26.763 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b717e4700 1 -- 172.21.15.79:0/2584026285 >> v1:172.21.15.89:6789/0 conn(0x7f5b740f5520 legacy=0x7f5b740f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:26.763 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b717e4700 1 -- 172.21.15.79:0/2584026285 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b740e4330 con 0x7f5b741c8010 2021-04-09T18:26:26.763 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b717e4700 1 -- 172.21.15.79:0/2584026285 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f5b6c001f30 con 0x7f5b741c8010 2021-04-09T18:26:26.764 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b717e4700 1 -- 172.21.15.79:0/2584026285 >> v1:172.21.15.79:6789/0 conn(0x7f5b741c8010 legacy=0x7f5b741ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:26.764 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b717e4700 1 --2- 172.21.15.79:0/2584026285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b5c003d10 0x7f5b5c0045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:26.764 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b717e4700 1 --2- 172.21.15.79:0/2584026285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b5c004bd0 0x7f5b5c0097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:26.764 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b717e4700 1 --2- 172.21.15.79:0/2584026285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b5c005020 0x7f5b5c00be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:26.765 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b717e4700 1 -- 172.21.15.79:0/2584026285 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b741c3dc0 con 0x7f5b5c005020 2021-04-09T18:26:26.765 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b717e4700 1 -- 172.21.15.79:0/2584026285 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c050600 con 0x7f5b5c004bd0 2021-04-09T18:26:26.765 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b717e4700 1 -- 172.21.15.79:0/2584026285 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c050830 con 0x7f5b5c003d10 2021-04-09T18:26:26.765 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b72fe7700 1 --2- 172.21.15.79:0/2584026285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b5c005020 0x7f5b5c00be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:26.766 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b727e6700 1 --2- 172.21.15.79:0/2584026285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b5c003d10 0x7f5b5c0045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:26.766 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b71fe5700 1 --2- 172.21.15.79:0/2584026285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b5c004bd0 0x7f5b5c0097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:26.766 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b72fe7700 1 -- 172.21.15.79:0/2584026285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b5c003d10 msgr2=0x7f5b5c0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:26.766 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b72fe7700 1 --2- 172.21.15.79:0/2584026285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b5c003d10 0x7f5b5c0045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:26.766 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b72fe7700 1 -- 172.21.15.79:0/2584026285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b5c004bd0 msgr2=0x7f5b5c0097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:26.767 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b72fe7700 1 --2- 172.21.15.79:0/2584026285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b5c004bd0 0x7f5b5c0097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:26.767 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b72fe7700 1 -- 172.21.15.79:0/2584026285 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c050ac0 con 0x7f5b5c005020 2021-04-09T18:26:26.767 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b72fe7700 1 -- 172.21.15.79:0/2584026285 reap_dead start 2021-04-09T18:26:26.767 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b72fe7700 1 --2- 172.21.15.79:0/2584026285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b5c005020 0x7f5b5c00be20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f5b6c001d00 tx=0x7f5b6c00ae00).ready entity=mon.0 client_cookie=1f6161a4e71e0a89 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:26.767 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b717e4700 1 -- 172.21.15.79:0/2584026285 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b5c050ac0 con 0x7f5b5c005020 2021-04-09T18:26:26.768 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b717e4700 1 -- 172.21.15.79:0/2584026285 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c005c50 con 0x7f5b5c005020 2021-04-09T18:26:26.768 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b717e4700 1 -- 172.21.15.79:0/2584026285 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b740e4330 con 0x7f5b5c005020 2021-04-09T18:26:26.768 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b78c56700 1 -- 172.21.15.79:0/2584026285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b5c005020 msgr2=0x7f5b5c00be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:26.768 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b78c56700 1 --2- 172.21.15.79:0/2584026285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b5c005020 0x7f5b5c00be20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f5b6c001d00 tx=0x7f5b6c00ae00).stop 2021-04-09T18:26:26.769 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b78c56700 1 -- 172.21.15.79:0/2584026285 shutdown_connections 2021-04-09T18:26:26.769 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b78c56700 1 --2- 172.21.15.79:0/2584026285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b5c005020 0x7f5b5c00be20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:26.769 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b78c56700 1 -- 172.21.15.79:0/2584026285 >> 172.21.15.79:0/2584026285 conn(0x7f5b740e5fe0 msgr2=0x7f5b740e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:26.769 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b78c56700 1 -- 172.21.15.79:0/2584026285 shutdown_connections 2021-04-09T18:26:26.769 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.746 7f5b78c56700 1 -- 172.21.15.79:0/2584026285 wait complete. 2021-04-09T18:26:26.772 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b78c56700 1 Processor -- start 2021-04-09T18:26:26.773 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b78c56700 1 -- start start 2021-04-09T18:26:26.773 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b78c56700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b740985d0 0x7f5b74098a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:26.773 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b78c56700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b741ad1a0 0x7f5b741ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:26.773 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b78c56700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b741b13c0 0x7f5b741b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:26.774 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b78c56700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b740e9f30 con 0x7f5b741ad1a0 2021-04-09T18:26:26.774 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b78c56700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b740982d0 con 0x7f5b740985d0 2021-04-09T18:26:26.774 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b78c56700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b74097e60 con 0x7f5b741b13c0 2021-04-09T18:26:26.774 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b71fe5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b741ad1a0 0x7f5b741ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:26.775 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b71fe5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b741ad1a0 0x7f5b741ad5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55992/0 (socket says 172.21.15.79:55992) 2021-04-09T18:26:26.775 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b71fe5700 1 -- 172.21.15.79:0/2847995428 learned_addr learned my addr 172.21.15.79:0/2847995428 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:26.775 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b72fe7700 1 --2- 172.21.15.79:0/2847995428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b741b13c0 0x7f5b741b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:26.776 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b727e6700 1 --2- 172.21.15.79:0/2847995428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b740985d0 0x7f5b74098a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:26.776 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b71fe5700 1 -- 172.21.15.79:0/2847995428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b741b13c0 msgr2=0x7f5b741b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:26.776 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b71fe5700 1 --2- 172.21.15.79:0/2847995428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b741b13c0 0x7f5b741b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:26.776 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b71fe5700 1 -- 172.21.15.79:0/2847995428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b740985d0 msgr2=0x7f5b74098a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:26.776 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b71fe5700 1 --2- 172.21.15.79:0/2847995428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b740985d0 0x7f5b74098a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:26.777 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b71fe5700 1 -- 172.21.15.79:0/2847995428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b741adc20 con 0x7f5b741ad1a0 2021-04-09T18:26:26.777 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b71fe5700 1 --2- 172.21.15.79:0/2847995428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b741ad1a0 0x7f5b741ad5f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f5b740d7ec0 tx=0x7f5b6800f520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:26.777 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b62ffd700 1 -- 172.21.15.79:0/2847995428 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b741adc20 con 0x7f5b741ad1a0 2021-04-09T18:26:26.778 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b62ffd700 1 -- 172.21.15.79:0/2847995428 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6800fa50 con 0x7f5b741ad1a0 2021-04-09T18:26:26.778 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b62ffd700 1 -- 172.21.15.79:0/2847995428 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b6800f040 con 0x7f5b741ad1a0 2021-04-09T18:26:26.778 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b78c56700 1 -- 172.21.15.79:0/2847995428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b741b1e40 con 0x7f5b741ad1a0 2021-04-09T18:26:26.778 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.754 7f5b78c56700 1 -- 172.21.15.79:0/2847995428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b740967e0 con 0x7f5b741ad1a0 2021-04-09T18:26:26.779 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.758 7f5b62ffd700 1 -- 172.21.15.79:0/2847995428 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5b6800fc30 con 0x7f5b741ad1a0 2021-04-09T18:26:26.779 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.758 7f5b62ffd700 1 --2- 172.21.15.79:0/2847995428 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5b58029100 0x7f5b5802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:26.779 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.758 7f5b62ffd700 1 -- 172.21.15.79:0/2847995428 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f5b68010040 con 0x7f5b741ad1a0 2021-04-09T18:26:26.779 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.758 7f5b727e6700 1 --2- 172.21.15.79:0/2847995428 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5b58029100 0x7f5b5802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:26.780 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.758 7f5b727e6700 1 --2- 172.21.15.79:0/2847995428 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5b58029100 0x7f5b5802b650 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:26.780 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.774 7f5b78c56700 1 -- 172.21.15.79:0/2847995428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b740e39e0 con 0x7f5b741ad1a0 2021-04-09T18:26:26.788 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.782 7f5b62ffd700 1 -- 172.21.15.79:0/2847995428 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5b68011d90 con 0x7f5b741ad1a0 2021-04-09T18:26:26.958 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.950 7f5b78c56700 1 -- 172.21.15.79:0/2847995428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health"} v 0) v1 -- 0x7f5b741b2380 con 0x7f5b741ad1a0 2021-04-09T18:26:26.959 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.950 7f5b62ffd700 1 -- 172.21.15.79:0/2847995428 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health"}]=0 v0) v1 ==== 54+0+10 (secure 0 0 0) 0x7f5b68000bf0 con 0x7f5b741ad1a0 2021-04-09T18:26:26.960 INFO:teuthology.misc.health.smithi079.stdout:HEALTH_OK 2021-04-09T18:26:26.963 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.954 7f5b78c56700 1 -- 172.21.15.79:0/2847995428 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5b58029100 msgr2=0x7f5b5802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:26.963 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.954 7f5b78c56700 1 --2- 172.21.15.79:0/2847995428 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5b58029100 0x7f5b5802b650 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:26.964 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.954 7f5b78c56700 1 -- 172.21.15.79:0/2847995428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b741ad1a0 msgr2=0x7f5b741ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:26.964 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.954 7f5b78c56700 1 --2- 172.21.15.79:0/2847995428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b741ad1a0 0x7f5b741ad5f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f5b740d7ec0 tx=0x7f5b6800f520).stop 2021-04-09T18:26:26.964 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.954 7f5b78c56700 1 -- 172.21.15.79:0/2847995428 shutdown_connections 2021-04-09T18:26:26.964 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.954 7f5b78c56700 1 --2- 172.21.15.79:0/2847995428 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5b58029100 0x7f5b5802b650 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:26.965 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.954 7f5b78c56700 1 --2- 172.21.15.79:0/2847995428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b740985d0 0x7f5b74098a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:26.965 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.954 7f5b78c56700 1 --2- 172.21.15.79:0/2847995428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b741b13c0 0x7f5b741b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:26.965 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.954 7f5b78c56700 1 --2- 172.21.15.79:0/2847995428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b741ad1a0 0x7f5b741ad5f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:26.965 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.954 7f5b78c56700 1 -- 172.21.15.79:0/2847995428 >> 172.21.15.79:0/2847995428 conn(0x7f5b7409ad30 msgr2=0x7f5b7409a290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:26.966 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.954 7f5b78c56700 1 -- 172.21.15.79:0/2847995428 shutdown_connections 2021-04-09T18:26:26.966 INFO:teuthology.misc.health.smithi079.stderr:2021-04-09 18:26:26.954 7f5b78c56700 1 -- 172.21.15.79:0/2847995428 wait complete. 2021-04-09T18:26:26.970 DEBUG:teuthology.misc:Ceph health: HEALTH_OK 2021-04-09T18:26:26.971 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:27.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb39e94b700 1 Processor -- start 2021-04-09T18:26:27.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb39e94b700 1 -- start start 2021-04-09T18:26:27.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb39e94b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3980f5510 0x7fb3980f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb39e94b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb3980e9ad0 0x7fb39809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb39e94b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb3981c2da0 0x7fb3981c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb39e94b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3980e9f20 con 0x7fb3981c2da0 2021-04-09T18:26:27.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb39e94b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3980e59c0 con 0x7fb3980e9ad0 2021-04-09T18:26:27.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb39e94b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3980fbb10 con 0x7fb3980f5510 2021-04-09T18:26:27.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb39cef0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb3981c2da0 0x7fb3981c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb39cef0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb3981c2da0 0x7fb3981c31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56000/0 (socket says 172.21.15.79:56000) 2021-04-09T18:26:27.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb39cef0700 1 -- 172.21.15.79:0/1990636832 learned_addr learned my addr 172.21.15.79:0/1990636832 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:27.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb38f7fe700 1 --2- 172.21.15.79:0/1990636832 >> v2:172.21.15.89:3300/0 conn(0x7fb3980e9ad0 0x7fb39809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb397fff700 1 --2- 172.21.15.79:0/1990636832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3980f5510 0x7fb3980f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb39cef0700 1 -- 172.21.15.79:0/1990636832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3980f5510 msgr2=0x7fb3980f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:27.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb39cef0700 1 --2- 172.21.15.79:0/1990636832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3980f5510 0x7fb3980f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb39cef0700 1 -- 172.21.15.79:0/1990636832 >> v2:172.21.15.89:3300/0 conn(0x7fb3980e9ad0 msgr2=0x7fb39809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:27.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb39cef0700 1 --2- 172.21.15.79:0/1990636832 >> v2:172.21.15.89:3300/0 conn(0x7fb3980e9ad0 0x7fb39809f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb39cef0700 1 -- 172.21.15.79:0/1990636832 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3980e56c0 con 0x7fb3981c2da0 2021-04-09T18:26:27.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb397fff700 1 --2- 172.21.15.79:0/1990636832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3980f5510 0x7fb3980f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:27.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb39cef0700 1 --2- 172.21.15.79:0/1990636832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3981c2da0 0x7fb3981c31f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb3900032b0 tx=0x7fb39000b3c0).ready entity=mon.0 client_cookie=989f45e09ecebe23 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:27.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb3977fe700 1 -- 172.21.15.79:0/1990636832 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb3980e56c0 con 0x7fb3981c2da0 2021-04-09T18:26:27.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb3977fe700 1 -- 172.21.15.79:0/1990636832 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39000bc20 con 0x7fb3981c2da0 2021-04-09T18:26:27.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb3977fe700 1 -- 172.21.15.79:0/1990636832 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb390002020 con 0x7fb3981c2da0 2021-04-09T18:26:27.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb39e94b700 1 -- 172.21.15.79:0/1990636832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3981c2da0 msgr2=0x7fb3981c31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.054 7fb39e94b700 1 --2- 172.21.15.79:0/1990636832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3981c2da0 0x7fb3981c31f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb3900032b0 tx=0x7fb39000b3c0).stop 2021-04-09T18:26:27.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.058 7fb39e94b700 1 -- 172.21.15.79:0/1990636832 shutdown_connections 2021-04-09T18:26:27.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.058 7fb39e94b700 1 --2- 172.21.15.79:0/1990636832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3980f5510 0x7fb3980f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.058 7fb39e94b700 1 --2- 172.21.15.79:0/1990636832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3981c2da0 0x7fb3981c31f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.058 7fb39e94b700 1 --2- 172.21.15.79:0/1990636832 >> v2:172.21.15.89:3300/0 conn(0x7fb3980e9ad0 0x7fb39809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.058 7fb39e94b700 1 -- 172.21.15.79:0/1990636832 >> 172.21.15.79:0/1990636832 conn(0x7fb3980e5fd0 msgr2=0x7fb3980e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:27.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.058 7fb39e94b700 1 -- 172.21.15.79:0/1990636832 shutdown_connections 2021-04-09T18:26:27.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.058 7fb39e94b700 1 -- 172.21.15.79:0/1990636832 wait complete. 2021-04-09T18:26:27.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb39e94b700 1 Processor -- start 2021-04-09T18:26:27.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb39e94b700 1 -- start start 2021-04-09T18:26:27.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb39e94b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb398099fb0 0x7fb398091200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb39e94b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb398091a30 0x7fb3981a7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb39e94b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3980d84c0 0x7fb3980d8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb39e94b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3980921a0 con 0x7fb3980d84c0 2021-04-09T18:26:27.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb39e94b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3980924a0 con 0x7fb398091a30 2021-04-09T18:26:27.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb39e94b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb398091e80 con 0x7fb398099fb0 2021-04-09T18:26:27.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb39cef0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3980d84c0 0x7fb3980d8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb39cef0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3980d84c0 0x7fb3980d8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56004/0 (socket says 172.21.15.79:56004) 2021-04-09T18:26:27.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb39cef0700 1 -- 172.21.15.79:0/2803431652 learned_addr learned my addr 172.21.15.79:0/2803431652 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:27.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb397fff700 1 --2- 172.21.15.79:0/2803431652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb398099fb0 0x7fb398091200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb38f7fe700 1 --2- 172.21.15.79:0/2803431652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb398091a30 0x7fb3981a7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb39cef0700 1 -- 172.21.15.79:0/2803431652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb398099fb0 msgr2=0x7fb398091200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb39cef0700 1 --2- 172.21.15.79:0/2803431652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb398099fb0 0x7fb398091200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb39cef0700 1 -- 172.21.15.79:0/2803431652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb398091a30 msgr2=0x7fb3981a7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb39cef0700 1 --2- 172.21.15.79:0/2803431652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb398091a30 0x7fb3981a7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb39cef0700 1 -- 172.21.15.79:0/2803431652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3981a8180 con 0x7fb3980d84c0 2021-04-09T18:26:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb39cef0700 1 --2- 172.21.15.79:0/2803431652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3980d84c0 0x7fb3980d8910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fb3980d5a60 tx=0x7fb390006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:27.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb3957fa700 1 -- 172.21.15.79:0/2803431652 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb39001b670 con 0x7fb3980d84c0 2021-04-09T18:26:27.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb3957fa700 1 -- 172.21.15.79:0/2803431652 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39001b870 con 0x7fb3980d84c0 2021-04-09T18:26:27.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb39e94b700 1 -- 172.21.15.79:0/2803431652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3980d08c0 con 0x7fb3980d84c0 2021-04-09T18:26:27.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb3957fa700 1 -- 172.21.15.79:0/2803431652 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb39001bc40 con 0x7fb3980d84c0 2021-04-09T18:26:27.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb39e94b700 1 -- 172.21.15.79:0/2803431652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3980d0d60 con 0x7fb3980d84c0 2021-04-09T18:26:27.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb3957fa700 1 -- 172.21.15.79:0/2803431652 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb390019040 con 0x7fb3980d84c0 2021-04-09T18:26:27.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.062 7fb3957fa700 1 --2- 172.21.15.79:0/2803431652 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb37c029100 0x7fb37c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.066 7fb3957fa700 1 -- 172.21.15.79:0/2803431652 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fb390018040 con 0x7fb3980d84c0 2021-04-09T18:26:27.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.066 7fb397fff700 1 --2- 172.21.15.79:0/2803431652 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb37c029100 0x7fb37c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.066 7fb397fff700 1 --2- 172.21.15.79:0/2803431652 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb37c029100 0x7fb37c02b650 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:27.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.066 7fb39e94b700 1 -- 172.21.15.79:0/2803431652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3980e39d0 con 0x7fb3980d84c0 2021-04-09T18:26:27.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.070 7fb3957fa700 1 -- 172.21.15.79:0/2803431652 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb39001b460 con 0x7fb3980d84c0 2021-04-09T18:26:27.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.234 7fb39e94b700 1 -- 172.21.15.79:0/2803431652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3980f5b10 con 0x7fb3980d84c0 2021-04-09T18:26:27.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.234 7fb3957fa700 1 -- 172.21.15.79:0/2803431652 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14254 (secure 0 0 0) 0x7fb3980f76b0 con 0x7fb3980d84c0 2021-04-09T18:26:27.244 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:27.245 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:14.412296","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:26:09.311735","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:26:12.130710","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:26:27.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.238 7fb39e94b700 1 -- 172.21.15.79:0/2803431652 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb37c029100 msgr2=0x7fb37c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.238 7fb39e94b700 1 --2- 172.21.15.79:0/2803431652 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb37c029100 0x7fb37c02b650 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.238 7fb39e94b700 1 -- 172.21.15.79:0/2803431652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3980d84c0 msgr2=0x7fb3980d8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.238 7fb39e94b700 1 --2- 172.21.15.79:0/2803431652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3980d84c0 0x7fb3980d8910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fb3980d5a60 tx=0x7fb390006c10).stop 2021-04-09T18:26:27.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.238 7fb39e94b700 1 -- 172.21.15.79:0/2803431652 shutdown_connections 2021-04-09T18:26:27.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.238 7fb39e94b700 1 --2- 172.21.15.79:0/2803431652 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb37c029100 0x7fb37c02b650 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.238 7fb39e94b700 1 --2- 172.21.15.79:0/2803431652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3980d84c0 0x7fb3980d8910 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.238 7fb39e94b700 1 --2- 172.21.15.79:0/2803431652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb398099fb0 0x7fb398091200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.238 7fb39e94b700 1 --2- 172.21.15.79:0/2803431652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb398091a30 0x7fb3981a7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.238 7fb39e94b700 1 -- 172.21.15.79:0/2803431652 >> 172.21.15.79:0/2803431652 conn(0x7fb398092940 msgr2=0x7fb3980baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:27.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.238 7fb39e94b700 1 -- 172.21.15.79:0/2803431652 shutdown_connections 2021-04-09T18:26:27.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.238 7fb39e94b700 1 -- 172.21.15.79:0/2803431652 wait complete. 2021-04-09T18:26:27.261 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:26:09.311735', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:26:12.130710', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:26:27.262 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:26:27.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.350 7efc33a0b700 1 Processor -- start 2021-04-09T18:26:27.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.350 7efc33a0b700 1 -- start start 2021-04-09T18:26:27.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc33a0b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc2c0e9b10 0x7efc2c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc33a0b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2c0fbb50 con 0x7efc2c0f5550 2021-04-09T18:26:27.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc33a0b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2c0e5700 con 0x7efc2c1c8040 2021-04-09T18:26:27.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc33a0b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c1c3df0 con 0x7efc2c0e9b10 2021-04-09T18:26:27.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc317af700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7efc2c0f5550 0x7efc2c0f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50722/0 (socket says 172.21.15.79:50722) 2021-04-09T18:26:27.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc317af700 1 -- 172.21.15.79:0/1709348126 learned_addr learned my addr 172.21.15.79:0/1709348126 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:27.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc30fae700 1 --2- 172.21.15.79:0/1709348126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc2c0e9b10 0x7efc2c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc23fff700 1 -- 172.21.15.79:0/1709348126 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572793182 0 0) 0x7efc280010d0 con 0x7efc2c0f5550 2021-04-09T18:26:27.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc23fff700 1 -- 172.21.15.79:0/1709348126 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc18003240 con 0x7efc2c0f5550 2021-04-09T18:26:27.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc23fff700 1 -- 172.21.15.79:0/1709348126 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3929538750 0 0) 0x7efc24001450 con 0x7efc2c1c8040 2021-04-09T18:26:27.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc23fff700 1 -- 172.21.15.79:0/1709348126 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc18003620 con 0x7efc2c1c8040 2021-04-09T18:26:27.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc30fae700 1 -- 172.21.15.79:0/1709348126 >> v1:172.21.15.89:6789/0 conn(0x7efc2c1c8040 legacy=0x7efc2c1ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc30fae700 1 -- 172.21.15.79:0/1709348126 >> v1:172.21.15.79:6789/0 conn(0x7efc2c0f5550 legacy=0x7efc2c0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc23fff700 1 -- 172.21.15.79:0/1709348126 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2713023420 0 0) 0x7efc28001650 con 0x7efc2c0f5550 2021-04-09T18:26:27.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc30fae700 1 -- 172.21.15.79:0/1709348126 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c0e4360 con 0x7efc2c0e9b10 2021-04-09T18:26:27.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc30fae700 1 --2- 172.21.15.79:0/1709348126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc2c0e9b10 0x7efc2c09f110 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7efc28001980 tx=0x7efc1c00bcf0).ready entity=mon.2 client_cookie=9310357cce10cf87 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:27.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc23fff700 1 -- 172.21.15.79:0/1709348126 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efc2c0e4360 con 0x7efc2c0e9b10 2021-04-09T18:26:27.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc23fff700 1 -- 172.21.15.79:0/1709348126 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c009790 con 0x7efc2c0e9b10 2021-04-09T18:26:27.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc23fff700 1 -- 172.21.15.79:0/1709348126 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efc28001bb0 con 0x7efc2c0e9b10 2021-04-09T18:26:27.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc33a0b700 1 -- 172.21.15.79:0/1709348126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc2c0e9b10 msgr2=0x7efc2c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.354 7efc33a0b700 1 --2- 172.21.15.79:0/1709348126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc2c0e9b10 0x7efc2c09f110 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7efc28001980 tx=0x7efc1c00bcf0).stop 2021-04-09T18:26:27.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.358 7efc33a0b700 1 -- 172.21.15.79:0/1709348126 shutdown_connections 2021-04-09T18:26:27.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.358 7efc33a0b700 1 --2- 172.21.15.79:0/1709348126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc2c0e9b10 0x7efc2c09f110 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.358 7efc33a0b700 1 -- 172.21.15.79:0/1709348126 >> 172.21.15.79:0/1709348126 conn(0x7efc2c0e6010 msgr2=0x7efc2c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:27.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.358 7efc33a0b700 1 -- 172.21.15.79:0/1709348126 shutdown_connections 2021-04-09T18:26:27.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.358 7efc33a0b700 1 -- 172.21.15.79:0/1709348126 wait complete. 2021-04-09T18:26:27.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc33a0b700 1 Processor -- start 2021-04-09T18:26:27.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc33a0b700 1 -- start start 2021-04-09T18:26:27.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc33a0b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc2c090610 0x7efc2c096280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc33a0b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc2c0ad8d0 0x7efc2c0add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc33a0b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc2c0918f0 0x7efc2c091d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc33a0b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0e9f60 con 0x7efc2c090610 2021-04-09T18:26:27.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc33a0b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0915f0 con 0x7efc2c0918f0 2021-04-09T18:26:27.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc33a0b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c092370 con 0x7efc2c0ad8d0 2021-04-09T18:26:27.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc317af700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc2c090610 0x7efc2c096280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc317af700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc2c090610 0x7efc2c096280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56018/0 (socket says 172.21.15.79:56018) 2021-04-09T18:26:27.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc317af700 1 -- 172.21.15.79:0/2005004632 learned_addr learned my addr 172.21.15.79:0/2005004632 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:27.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc30fae700 1 --2- 172.21.15.79:0/2005004632 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc2c0ad8d0 0x7efc2c0add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc31fb0700 1 --2- 172.21.15.79:0/2005004632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc2c0918f0 0x7efc2c091d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc317af700 1 -- 172.21.15.79:0/2005004632 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc2c0ad8d0 msgr2=0x7efc2c0add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc317af700 1 --2- 172.21.15.79:0/2005004632 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc2c0ad8d0 0x7efc2c0add20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc317af700 1 -- 172.21.15.79:0/2005004632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc2c0918f0 msgr2=0x7efc2c091d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc317af700 1 --2- 172.21.15.79:0/2005004632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc2c0918f0 0x7efc2c091d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc317af700 1 -- 172.21.15.79:0/2005004632 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c090e80 con 0x7efc2c090610 2021-04-09T18:26:27.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc317af700 1 --2- 172.21.15.79:0/2005004632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc2c090610 0x7efc2c096280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7efc28001e80 tx=0x7efc2800cb00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:27.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc21ffb700 1 -- 172.21.15.79:0/2005004632 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efc2c090e80 con 0x7efc2c090610 2021-04-09T18:26:27.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc21ffb700 1 -- 172.21.15.79:0/2005004632 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc28007170 con 0x7efc2c090610 2021-04-09T18:26:27.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc33a0b700 1 -- 172.21.15.79:0/2005004632 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c0ba130 con 0x7efc2c090610 2021-04-09T18:26:27.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc21ffb700 1 -- 172.21.15.79:0/2005004632 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efc28004900 con 0x7efc2c090610 2021-04-09T18:26:27.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc33a0b700 1 -- 172.21.15.79:0/2005004632 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c0954d0 con 0x7efc2c090610 2021-04-09T18:26:27.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc21ffb700 1 -- 172.21.15.79:0/2005004632 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7efc28004b00 con 0x7efc2c090610 2021-04-09T18:26:27.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc21ffb700 1 --2- 172.21.15.79:0/2005004632 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efc0c029100 0x7efc0c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.362 7efc21ffb700 1 -- 172.21.15.79:0/2005004632 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7efc28039350 con 0x7efc2c090610 2021-04-09T18:26:27.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.366 7efc30fae700 1 --2- 172.21.15.79:0/2005004632 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efc0c029100 0x7efc0c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.366 7efc30fae700 1 --2- 172.21.15.79:0/2005004632 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efc0c029100 0x7efc0c02b650 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:27.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.366 7efc33a0b700 1 -- 172.21.15.79:0/2005004632 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2c0e39f0 con 0x7efc2c090610 2021-04-09T18:26:27.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.374 7efc21ffb700 1 -- 172.21.15.79:0/2005004632 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7efc28004500 con 0x7efc2c090610 2021-04-09T18:26:27.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.526 7efc33a0b700 1 -- 172.21.15.79:0/2005004632 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7efc2c0ba4d0 con 0x7efc2c090610 2021-04-09T18:26:27.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.526 7efc21ffb700 1 -- 172.21.15.79:0/2005004632 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7efc2c107f80 con 0x7efc2c090610 2021-04-09T18:26:27.535 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:27.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.530 7efc33a0b700 1 -- 172.21.15.79:0/2005004632 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efc0c029100 msgr2=0x7efc0c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.530 7efc33a0b700 1 --2- 172.21.15.79:0/2005004632 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efc0c029100 0x7efc0c02b650 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.530 7efc33a0b700 1 -- 172.21.15.79:0/2005004632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc2c090610 msgr2=0x7efc2c096280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.530 7efc33a0b700 1 --2- 172.21.15.79:0/2005004632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc2c090610 0x7efc2c096280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7efc28001e80 tx=0x7efc2800cb00).stop 2021-04-09T18:26:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.530 7efc33a0b700 1 -- 172.21.15.79:0/2005004632 shutdown_connections 2021-04-09T18:26:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.530 7efc33a0b700 1 --2- 172.21.15.79:0/2005004632 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efc0c029100 0x7efc0c02b650 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.530 7efc33a0b700 1 --2- 172.21.15.79:0/2005004632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc2c0918f0 0x7efc2c091d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.530 7efc33a0b700 1 --2- 172.21.15.79:0/2005004632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc2c090610 0x7efc2c096280 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.530 7efc33a0b700 1 --2- 172.21.15.79:0/2005004632 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc2c0ad8d0 0x7efc2c0add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.530 7efc33a0b700 1 -- 172.21.15.79:0/2005004632 >> 172.21.15.79:0/2005004632 conn(0x7efc2c0d42a0 msgr2=0x7efc2c0d8190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:27.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.530 7efc33a0b700 1 -- 172.21.15.79:0/2005004632 shutdown_connections 2021-04-09T18:26:27.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.530 7efc33a0b700 1 -- 172.21.15.79:0/2005004632 wait complete. 2021-04-09T18:26:27.547 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:26:27.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.634 7f59e71ed700 1 Processor -- start 2021-04-09T18:26:27.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.634 7f59e71ed700 1 -- start start 2021-04-09T18:26:27.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59e71ed700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f59e00e9b10 0x7f59e009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59e71ed700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59e01c8040 0x7f59e01ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59e71ed700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e00fbb50 con 0x7f59e00f5550 2021-04-09T18:26:27.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59e71ed700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e01c3df0 con 0x7f59e00e9b10 2021-04-09T18:26:27.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59e71ed700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e00e9f60 con 0x7f59e01c8040 2021-04-09T18:26:27.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59d7fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f59e00e9b10 0x7f59e009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59d7fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f59e00e9b10 0x7f59e009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56028/0 (socket says 172.21.15.79:56028) 2021-04-09T18:26:27.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59d7fff700 1 -- 172.21.15.79:0/1286630003 learned_addr learned my addr 172.21.15.79:0/1286630003 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:27.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59e5792700 1 --2- 172.21.15.79:0/1286630003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59e01c8040 0x7f59e01ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59d7fff700 1 -- 172.21.15.79:0/1286630003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59e01c8040 msgr2=0x7f59e01ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:27.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59d7fff700 1 --2- 172.21.15.79:0/1286630003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59e01c8040 0x7f59e01ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59d7fff700 1 -- 172.21.15.79:0/1286630003 >> v1:172.21.15.89:6789/0 conn(0x7f59e00f5550 legacy=0x7f59e00f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59d7fff700 1 -- 172.21.15.79:0/1286630003 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e00e5700 con 0x7f59e00e9b10 2021-04-09T18:26:27.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59e5792700 1 --2- 172.21.15.79:0/1286630003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59e01c8040 0x7f59e01ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:27.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59d7fff700 1 --2- 172.21.15.79:0/1286630003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59e00e9b10 0x7f59e009f110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f59e00f6f30 tx=0x7f59d000bdd0).ready entity=mon.0 client_cookie=19363055846614ba server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:27.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59d77fe700 1 -- 172.21.15.79:0/1286630003 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59e00e5700 con 0x7f59e00e9b10 2021-04-09T18:26:27.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59d77fe700 1 -- 172.21.15.79:0/1286630003 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d0009990 con 0x7f59e00e9b10 2021-04-09T18:26:27.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59d77fe700 1 -- 172.21.15.79:0/1286630003 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59d0009d60 con 0x7f59e00e9b10 2021-04-09T18:26:27.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59e71ed700 1 -- 172.21.15.79:0/1286630003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59e00e9b10 msgr2=0x7f59e009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59e71ed700 1 --2- 172.21.15.79:0/1286630003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59e00e9b10 0x7f59e009f110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f59e00f6f30 tx=0x7f59d000bdd0).stop 2021-04-09T18:26:27.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59e71ed700 1 -- 172.21.15.79:0/1286630003 shutdown_connections 2021-04-09T18:26:27.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59e71ed700 1 --2- 172.21.15.79:0/1286630003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59e01c8040 0x7f59e01ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59e71ed700 1 --2- 172.21.15.79:0/1286630003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59e00e9b10 0x7f59e009f110 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59e71ed700 1 -- 172.21.15.79:0/1286630003 >> 172.21.15.79:0/1286630003 conn(0x7f59e00e6010 msgr2=0x7f59e00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:27.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59e71ed700 1 -- 172.21.15.79:0/1286630003 shutdown_connections 2021-04-09T18:26:27.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.638 7f59e71ed700 1 -- 172.21.15.79:0/1286630003 wait complete. 2021-04-09T18:26:27.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.642 7f59e71ed700 1 Processor -- start 2021-04-09T18:26:27.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.642 7f59e71ed700 1 -- start start 2021-04-09T18:26:27.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59e71ed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59e00a95e0 0x7f59e0090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59e71ed700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59e00a8a60 0x7f59e009a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59e71ed700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59e009afc0 0x7f59e00d4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59e71ed700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e009a690 con 0x7f59e00a95e0 2021-04-09T18:26:27.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59e71ed700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e0091390 con 0x7f59e009afc0 2021-04-09T18:26:27.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59e71ed700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e009b410 con 0x7f59e00a8a60 2021-04-09T18:26:27.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59e4f91700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59e00a95e0 0x7f59e0090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59e4f91700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59e00a95e0 0x7f59e0090d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56036/0 (socket says 172.21.15.79:56036) 2021-04-09T18:26:27.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59e4f91700 1 -- 172.21.15.79:0/969376108 learned_addr learned my addr 172.21.15.79:0/969376108 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:27.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59e5792700 1 --2- 172.21.15.79:0/969376108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59e009afc0 0x7f59e00d4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59d7fff700 1 --2- 172.21.15.79:0/969376108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59e00a8a60 0x7f59e009a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59e4f91700 1 -- 172.21.15.79:0/969376108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59e00a8a60 msgr2=0x7f59e009a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59e4f91700 1 --2- 172.21.15.79:0/969376108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59e00a8a60 0x7f59e009a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59e4f91700 1 -- 172.21.15.79:0/969376108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59e009afc0 msgr2=0x7f59e00d4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59e4f91700 1 --2- 172.21.15.79:0/969376108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59e009afc0 0x7f59e00d4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59e4f91700 1 -- 172.21.15.79:0/969376108 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e00a8eb0 con 0x7f59e00a95e0 2021-04-09T18:26:27.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59e4f91700 1 --2- 172.21.15.79:0/969376108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59e00a95e0 0x7f59e0090d60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f59e00d43e0 tx=0x7f59dc00cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:27.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59d57fa700 1 -- 172.21.15.79:0/969376108 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59e00a8eb0 con 0x7f59e00a95e0 2021-04-09T18:26:27.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59e71ed700 1 -- 172.21.15.79:0/969376108 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e00d4bb0 con 0x7f59e00a95e0 2021-04-09T18:26:27.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59d57fa700 1 -- 172.21.15.79:0/969376108 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59dc010510 con 0x7f59e00a95e0 2021-04-09T18:26:27.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59d57fa700 1 -- 172.21.15.79:0/969376108 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59dc0106f0 con 0x7f59e00a95e0 2021-04-09T18:26:27.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59e71ed700 1 -- 172.21.15.79:0/969376108 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e00d50f0 con 0x7f59e00a95e0 2021-04-09T18:26:27.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59d57fa700 1 -- 172.21.15.79:0/969376108 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f59dc019020 con 0x7f59e00a95e0 2021-04-09T18:26:27.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59d57fa700 1 --2- 172.21.15.79:0/969376108 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f59c0029100 0x7f59c002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59d57fa700 1 -- 172.21.15.79:0/969376108 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f59dc038ee0 con 0x7f59e00a95e0 2021-04-09T18:26:27.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.646 7f59d7fff700 1 --2- 172.21.15.79:0/969376108 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f59c0029100 0x7f59c002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.650 7f59d7fff700 1 --2- 172.21.15.79:0/969376108 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f59c0029100 0x7f59c002b650 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:27.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.650 7f59e71ed700 1 -- 172.21.15.79:0/969376108 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e00e39f0 con 0x7f59e00a95e0 2021-04-09T18:26:27.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.654 7f59d57fa700 1 -- 172.21.15.79:0/969376108 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f59dc000bf0 con 0x7f59e00a95e0 2021-04-09T18:26:27.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.806 7f59e71ed700 1 -- 172.21.15.79:0/969376108 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f59e00a1c90 con 0x7f59e00a95e0 2021-04-09T18:26:27.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.810 7f59d57fa700 1 -- 172.21.15.79:0/969376108 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7f59dc010300 con 0x7f59e00a95e0 2021-04-09T18:26:27.816 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:27.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.810 7f59e71ed700 1 -- 172.21.15.79:0/969376108 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f59c0029100 msgr2=0x7f59c002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.810 7f59e71ed700 1 --2- 172.21.15.79:0/969376108 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f59c0029100 0x7f59c002b650 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.810 7f59e71ed700 1 -- 172.21.15.79:0/969376108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59e00a95e0 msgr2=0x7f59e0090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.810 7f59e71ed700 1 --2- 172.21.15.79:0/969376108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59e00a95e0 0x7f59e0090d60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f59e00d43e0 tx=0x7f59dc00cab0).stop 2021-04-09T18:26:27.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.810 7f59e71ed700 1 -- 172.21.15.79:0/969376108 shutdown_connections 2021-04-09T18:26:27.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.810 7f59e71ed700 1 --2- 172.21.15.79:0/969376108 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f59c0029100 0x7f59c002b650 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.810 7f59e71ed700 1 --2- 172.21.15.79:0/969376108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59e009afc0 0x7f59e00d4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.810 7f59e71ed700 1 --2- 172.21.15.79:0/969376108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59e00a95e0 0x7f59e0090d60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.810 7f59e71ed700 1 --2- 172.21.15.79:0/969376108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59e00a8a60 0x7f59e009a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.810 7f59e71ed700 1 -- 172.21.15.79:0/969376108 >> 172.21.15.79:0/969376108 conn(0x7f59e00d84d0 msgr2=0x7f59e0093700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:27.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.810 7f59e71ed700 1 -- 172.21.15.79:0/969376108 shutdown_connections 2021-04-09T18:26:27.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.810 7f59e71ed700 1 -- 172.21.15.79:0/969376108 wait complete. 2021-04-09T18:26:27.834 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:26:27.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.918 7f7bbc04b700 1 Processor -- start 2021-04-09T18:26:27.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.918 7f7bbc04b700 1 -- start start 2021-04-09T18:26:27.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.918 7f7bbc04b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7bb40f5550 0x7f7bb40f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.918 7f7bbc04b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bb40e9b10 0x7f7bb409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.918 7f7bbc04b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb40fbb50 con 0x7f7bb41c2de0 2021-04-09T18:26:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.918 7f7bbc04b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb40e9f60 con 0x7f7bb40f5550 2021-04-09T18:26:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.918 7f7bbc04b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb40e5a00 con 0x7f7bb40e9b10 2021-04-09T18:26:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bb95ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bb40e9b10 0x7f7bb409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bb9def700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7bb40f5550 0x7f7bb40f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bb95ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bb40e9b10 0x7f7bb409f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:53038/0 (socket says 172.21.15.79:53038) 2021-04-09T18:26:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bb95ee700 1 -- 172.21.15.79:0/3201766329 learned_addr learned my addr 172.21.15.79:0/3201766329 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bb9def700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7bb40f5550 0x7f7bb40f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:44382/0 (socket says 172.21.15.79:44382) 2021-04-09T18:26:27.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bba5f0700 1 --1- 172.21.15.79:0/3201766329 >> v1:172.21.15.89:6789/0 conn(0x7f7bb41c2de0 0x7f7bb41c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:51224/0 (socket says 172.21.15.79:51224) 2021-04-09T18:26:27.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bb8ded700 1 -- 172.21.15.79:0/3201766329 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668172003 0 0) 0x7f7bac001450 con 0x7f7bb41c2de0 2021-04-09T18:26:27.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bb95ee700 1 -- 172.21.15.79:0/3201766329 >> v2:172.21.15.89:3300/0 conn(0x7f7bb40f5550 msgr2=0x7f7bb40f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bb95ee700 1 --2- 172.21.15.79:0/3201766329 >> v2:172.21.15.89:3300/0 conn(0x7f7bb40f5550 0x7f7bb40f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bb95ee700 1 -- 172.21.15.79:0/3201766329 >> v1:172.21.15.89:6789/0 conn(0x7f7bb41c2de0 legacy=0x7f7bb41c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bb95ee700 1 -- 172.21.15.79:0/3201766329 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb40e5700 con 0x7f7bb40e9b10 2021-04-09T18:26:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bb95ee700 1 --2- 172.21.15.79:0/3201766329 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bb40e9b10 0x7f7bb409f110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7ba4002f30 tx=0x7f7ba400bd20).ready entity=mon.2 client_cookie=415d04dbfe61453d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bb8ded700 1 -- 172.21.15.79:0/3201766329 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7bb40e5700 con 0x7f7bb40e9b10 2021-04-09T18:26:27.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bb8ded700 1 -- 172.21.15.79:0/3201766329 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba4009980 con 0x7f7bb40e9b10 2021-04-09T18:26:27.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bb8ded700 1 -- 172.21.15.79:0/3201766329 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7ba4009d50 con 0x7f7bb40e9b10 2021-04-09T18:26:27.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bbc04b700 1 -- 172.21.15.79:0/3201766329 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bb40e9b10 msgr2=0x7f7bb409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bbc04b700 1 --2- 172.21.15.79:0/3201766329 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bb40e9b10 0x7f7bb409f110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7ba4002f30 tx=0x7f7ba400bd20).stop 2021-04-09T18:26:27.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bbc04b700 1 -- 172.21.15.79:0/3201766329 shutdown_connections 2021-04-09T18:26:27.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bbc04b700 1 --2- 172.21.15.79:0/3201766329 >> v2:172.21.15.89:3300/0 conn(0x7f7bb40f5550 0x7f7bb40f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bbc04b700 1 --2- 172.21.15.79:0/3201766329 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bb40e9b10 0x7f7bb409f110 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bbc04b700 1 -- 172.21.15.79:0/3201766329 >> 172.21.15.79:0/3201766329 conn(0x7f7bb40e6010 msgr2=0x7f7bb40e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:27.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bbc04b700 1 -- 172.21.15.79:0/3201766329 shutdown_connections 2021-04-09T18:26:27.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.922 7f7bbc04b700 1 -- 172.21.15.79:0/3201766329 wait complete. 2021-04-09T18:26:27.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.926 7f7bbc04b700 1 Processor -- start 2021-04-09T18:26:27.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.926 7f7bbc04b700 1 -- start start 2021-04-09T18:26:27.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.926 7f7bbc04b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb40adeb0 0x7f7bb40d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.926 7f7bbc04b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bb40d1510 0x7f7bb41a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.926 7f7bbc04b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bb40ae300 0x7f7bb41a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.926 7f7bbc04b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb40ab0f0 con 0x7f7bb40adeb0 2021-04-09T18:26:27.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.926 7f7bbc04b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb40ab3f0 con 0x7f7bb40d1510 2021-04-09T18:26:27.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.926 7f7bbc04b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb40d4b60 con 0x7f7bb40ae300 2021-04-09T18:26:27.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.926 7f7bb9def700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb40adeb0 0x7f7bb40d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.926 7f7bb9def700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb40adeb0 0x7f7bb40d0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56046/0 (socket says 172.21.15.79:56046) 2021-04-09T18:26:27.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.926 7f7bb9def700 1 -- 172.21.15.79:0/2900043077 learned_addr learned my addr 172.21.15.79:0/2900043077 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:27.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.926 7f7bb95ee700 1 --2- 172.21.15.79:0/2900043077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bb40d1510 0x7f7bb41a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.926 7f7bba5f0700 1 --2- 172.21.15.79:0/2900043077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bb40ae300 0x7f7bb41a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.926 7f7bb9def700 1 -- 172.21.15.79:0/2900043077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bb40ae300 msgr2=0x7f7bb41a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.926 7f7bb9def700 1 --2- 172.21.15.79:0/2900043077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bb40ae300 0x7f7bb41a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.926 7f7bb9def700 1 -- 172.21.15.79:0/2900043077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bb40d1510 msgr2=0x7f7bb41a7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.926 7f7bb9def700 1 --2- 172.21.15.79:0/2900043077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bb40d1510 0x7f7bb41a7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.926 7f7bb9def700 1 -- 172.21.15.79:0/2900043077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb40aa8c0 con 0x7f7bb40adeb0 2021-04-09T18:26:27.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.926 7f7bb9def700 1 --2- 172.21.15.79:0/2900043077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb40adeb0 0x7f7bb40d0ee0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f7bb4094fe0 tx=0x7f7b9c00c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:27.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.930 7f7bb27fc700 1 -- 172.21.15.79:0/2900043077 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7bb40aa8c0 con 0x7f7bb40adeb0 2021-04-09T18:26:27.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.930 7f7bb27fc700 1 -- 172.21.15.79:0/2900043077 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9c00cd60 con 0x7f7bb40adeb0 2021-04-09T18:26:27.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.930 7f7bbc04b700 1 -- 172.21.15.79:0/2900043077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb40aac80 con 0x7f7bb40adeb0 2021-04-09T18:26:27.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.930 7f7bb27fc700 1 -- 172.21.15.79:0/2900043077 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7b9c00f040 con 0x7f7bb40adeb0 2021-04-09T18:26:27.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.930 7f7bbc04b700 1 -- 172.21.15.79:0/2900043077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb41a8c70 con 0x7f7bb40adeb0 2021-04-09T18:26:27.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.930 7f7bb27fc700 1 -- 172.21.15.79:0/2900043077 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7b9c011070 con 0x7f7bb40adeb0 2021-04-09T18:26:27.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.930 7f7bb27fc700 1 --2- 172.21.15.79:0/2900043077 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7b98029100 0x7f7b9802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.930 7f7bb27fc700 1 -- 172.21.15.79:0/2900043077 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f7b9c010040 con 0x7f7bb40adeb0 2021-04-09T18:26:27.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.930 7f7bb95ee700 1 --2- 172.21.15.79:0/2900043077 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7b98029100 0x7f7b9802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.930 7f7bb95ee700 1 --2- 172.21.15.79:0/2900043077 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7b98029100 0x7f7b9802b650 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:27.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.934 7f7bbc04b700 1 -- 172.21.15.79:0/2900043077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb40e39f0 con 0x7f7bb40adeb0 2021-04-09T18:26:27.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:27.942 7f7bb27fc700 1 -- 172.21.15.79:0/2900043077 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7b9c00c960 con 0x7f7bb40adeb0 2021-04-09T18:26:28.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.102 7f7bbc04b700 1 -- 172.21.15.79:0/2900043077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f7bb40f5b50 con 0x7f7bb40adeb0 2021-04-09T18:26:28.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.106 7f7bb27fc700 1 -- 172.21.15.79:0/2900043077 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7b9c000bf0 con 0x7f7bb40adeb0 2021-04-09T18:26:28.113 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:28.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.106 7f7bbc04b700 1 -- 172.21.15.79:0/2900043077 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7b98029100 msgr2=0x7f7b9802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:28.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.106 7f7bbc04b700 1 --2- 172.21.15.79:0/2900043077 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7b98029100 0x7f7b9802b650 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.106 7f7bbc04b700 1 -- 172.21.15.79:0/2900043077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb40adeb0 msgr2=0x7f7bb40d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:28.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.106 7f7bbc04b700 1 --2- 172.21.15.79:0/2900043077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb40adeb0 0x7f7bb40d0ee0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f7bb4094fe0 tx=0x7f7b9c00c430).stop 2021-04-09T18:26:28.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.106 7f7bbc04b700 1 -- 172.21.15.79:0/2900043077 shutdown_connections 2021-04-09T18:26:28.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.106 7f7bbc04b700 1 --2- 172.21.15.79:0/2900043077 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7b98029100 0x7f7b9802b650 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.106 7f7bbc04b700 1 --2- 172.21.15.79:0/2900043077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bb40ae300 0x7f7bb41a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.106 7f7bbc04b700 1 --2- 172.21.15.79:0/2900043077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb40adeb0 0x7f7bb40d0ee0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.106 7f7bbc04b700 1 --2- 172.21.15.79:0/2900043077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bb40d1510 0x7f7bb41a7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.106 7f7bbc04b700 1 -- 172.21.15.79:0/2900043077 >> 172.21.15.79:0/2900043077 conn(0x7f7bb40d8b80 msgr2=0x7f7bb40b9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:28.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.106 7f7bbc04b700 1 -- 172.21.15.79:0/2900043077 shutdown_connections 2021-04-09T18:26:28.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.106 7f7bbc04b700 1 -- 172.21.15.79:0/2900043077 wait complete. 2021-04-09T18:26:28.129 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:26:28.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8d1339700 1 Processor -- start 2021-04-09T18:26:28.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8d1339700 1 -- start start 2021-04-09T18:26:28.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8d1339700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb8cc0f5510 0x7fb8cc0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:28.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8d1339700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8cc0e9ad0 0x7fb8cc09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:28.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8d1339700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb8cc1c2da0 0x7fb8cc1c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:28.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8d1339700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8cc0e9f20 con 0x7fb8cc1c2da0 2021-04-09T18:26:28.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8d1339700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8cc0e59c0 con 0x7fb8cc0f5510 2021-04-09T18:26:28.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8d1339700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc0fbb10 con 0x7fb8cc0e9ad0 2021-04-09T18:26:28.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8cb806700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb8cc1c2da0 0x7fb8cc1c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:28.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8cb806700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb8cc1c2da0 0x7fb8cc1c31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56058/0 (socket says 172.21.15.79:56058) 2021-04-09T18:26:28.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8cb806700 1 -- 172.21.15.79:0/970120598 learned_addr learned my addr 172.21.15.79:0/970120598 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:28.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8cb005700 1 --2- 172.21.15.79:0/970120598 >> v2:172.21.15.89:3300/0 conn(0x7fb8cc0f5510 0x7fb8cc0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:28.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8ca804700 1 --2- 172.21.15.79:0/970120598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8cc0e9ad0 0x7fb8cc09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:28.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8cb806700 1 -- 172.21.15.79:0/970120598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8cc0e9ad0 msgr2=0x7fb8cc09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:28.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8cb806700 1 --2- 172.21.15.79:0/970120598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8cc0e9ad0 0x7fb8cc09f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8cb806700 1 -- 172.21.15.79:0/970120598 >> v2:172.21.15.89:3300/0 conn(0x7fb8cc0f5510 msgr2=0x7fb8cc0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:28.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8cb806700 1 --2- 172.21.15.79:0/970120598 >> v2:172.21.15.89:3300/0 conn(0x7fb8cc0f5510 0x7fb8cc0f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8cb806700 1 -- 172.21.15.79:0/970120598 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc0e56c0 con 0x7fb8cc1c2da0 2021-04-09T18:26:28.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8cb806700 1 --2- 172.21.15.79:0/970120598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8cc1c2da0 0x7fb8cc1c31f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fb8c40032b0 tx=0x7fb8c400b3c0).ready entity=mon.0 client_cookie=d0595a7bf325020c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:28.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8ca003700 1 -- 172.21.15.79:0/970120598 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb8cc0e56c0 con 0x7fb8cc1c2da0 2021-04-09T18:26:28.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8ca003700 1 -- 172.21.15.79:0/970120598 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c400bc20 con 0x7fb8cc1c2da0 2021-04-09T18:26:28.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8ca003700 1 -- 172.21.15.79:0/970120598 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb8c4002020 con 0x7fb8cc1c2da0 2021-04-09T18:26:28.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8d1339700 1 -- 172.21.15.79:0/970120598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8cc1c2da0 msgr2=0x7fb8cc1c31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:28.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.214 7fb8d1339700 1 --2- 172.21.15.79:0/970120598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8cc1c2da0 0x7fb8cc1c31f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fb8c40032b0 tx=0x7fb8c400b3c0).stop 2021-04-09T18:26:28.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.218 7fb8d1339700 1 -- 172.21.15.79:0/970120598 shutdown_connections 2021-04-09T18:26:28.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.218 7fb8d1339700 1 --2- 172.21.15.79:0/970120598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8cc1c2da0 0x7fb8cc1c31f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.218 7fb8d1339700 1 --2- 172.21.15.79:0/970120598 >> v2:172.21.15.89:3300/0 conn(0x7fb8cc0f5510 0x7fb8cc0f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.218 7fb8d1339700 1 --2- 172.21.15.79:0/970120598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8cc0e9ad0 0x7fb8cc09f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.218 7fb8d1339700 1 -- 172.21.15.79:0/970120598 >> 172.21.15.79:0/970120598 conn(0x7fb8cc0e5fd0 msgr2=0x7fb8cc0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:28.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.218 7fb8d1339700 1 -- 172.21.15.79:0/970120598 shutdown_connections 2021-04-09T18:26:28.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.218 7fb8d1339700 1 -- 172.21.15.79:0/970120598 wait complete. 2021-04-09T18:26:28.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.218 7fb8d1339700 1 Processor -- start 2021-04-09T18:26:28.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.218 7fb8d1339700 1 -- start start 2021-04-09T18:26:28.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8d1339700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8cc1ab740 0x7fb8cc0c11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:28.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8d1339700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8cc0c1e70 0x7fb8cc0d4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:28.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8d1339700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8cc0d5230 0x7fb8cc1aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:28.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8d1339700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc0c3350 con 0x7fb8cc0d5230 2021-04-09T18:26:28.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8d1339700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc0c3650 con 0x7fb8cc1ab740 2021-04-09T18:26:28.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8d1339700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc0c1820 con 0x7fb8cc0c1e70 2021-04-09T18:26:28.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8cb806700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8cc0d5230 0x7fb8cc1aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:28.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8cb806700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8cc0d5230 0x7fb8cc1aed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56064/0 (socket says 172.21.15.79:56064) 2021-04-09T18:26:28.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8cb806700 1 -- 172.21.15.79:0/3745708880 learned_addr learned my addr 172.21.15.79:0/3745708880 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:28.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8ca804700 1 --2- 172.21.15.79:0/3745708880 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8cc0c1e70 0x7fb8cc0d4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:28.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8cb005700 1 --2- 172.21.15.79:0/3745708880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8cc1ab740 0x7fb8cc0c11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:28.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8cb806700 1 -- 172.21.15.79:0/3745708880 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8cc0c1e70 msgr2=0x7fb8cc0d4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:28.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8cb806700 1 --2- 172.21.15.79:0/3745708880 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8cc0c1e70 0x7fb8cc0d4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8cb806700 1 -- 172.21.15.79:0/3745708880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8cc1ab740 msgr2=0x7fb8cc0c11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:28.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8cb806700 1 --2- 172.21.15.79:0/3745708880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8cc1ab740 0x7fb8cc0c11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8cb806700 1 -- 172.21.15.79:0/3745708880 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc0c4bf0 con 0x7fb8cc0d5230 2021-04-09T18:26:28.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8cb806700 1 --2- 172.21.15.79:0/3745708880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8cc0d5230 0x7fb8cc1aed40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fb8cc0d7ea0 tx=0x7fb8c4006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:28.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8b3fff700 1 -- 172.21.15.79:0/3745708880 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb8cc0c4bf0 con 0x7fb8cc0d5230 2021-04-09T18:26:28.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8b3fff700 1 -- 172.21.15.79:0/3745708880 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c401b670 con 0x7fb8cc0d5230 2021-04-09T18:26:28.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8d1339700 1 -- 172.21.15.79:0/3745708880 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8cc1abb90 con 0x7fb8cc0d5230 2021-04-09T18:26:28.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8b3fff700 1 -- 172.21.15.79:0/3745708880 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb8c401ba40 con 0x7fb8cc0d5230 2021-04-09T18:26:28.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8d1339700 1 -- 172.21.15.79:0/3745708880 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8cc0c24b0 con 0x7fb8cc0d5230 2021-04-09T18:26:28.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8b3fff700 1 -- 172.21.15.79:0/3745708880 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb8c4019040 con 0x7fb8cc0d5230 2021-04-09T18:26:28.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8b3fff700 1 --2- 172.21.15.79:0/3745708880 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb8ac029100 0x7fb8ac02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:28.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8b3fff700 1 -- 172.21.15.79:0/3745708880 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fb8c4018040 con 0x7fb8cc0d5230 2021-04-09T18:26:28.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.222 7fb8cb005700 1 --2- 172.21.15.79:0/3745708880 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb8ac029100 0x7fb8ac02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:28.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.226 7fb8cb005700 1 --2- 172.21.15.79:0/3745708880 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb8ac029100 0x7fb8ac02b650 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:28.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.226 7fb8d1339700 1 -- 172.21.15.79:0/3745708880 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8cc0e39d0 con 0x7fb8cc0d5230 2021-04-09T18:26:28.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.234 7fb8b3fff700 1 -- 172.21.15.79:0/3745708880 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb8c401b460 con 0x7fb8cc0d5230 2021-04-09T18:26:28.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.406 7fb8d1339700 1 -- 172.21.15.79:0/3745708880 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8cc0f5b10 con 0x7fb8cc0d5230 2021-04-09T18:26:28.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.410 7fb8b3fff700 1 -- 172.21.15.79:0/3745708880 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2097 (secure 0 0 0) 0x7fb8c400ba10 con 0x7fb8cc0d5230 2021-04-09T18:26:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:28.416 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1857210510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1857210510},{"type":"v1","addr":"172.21.15.89:6835","nonce":1857210510}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:26:14.412596","modified":"2021-04-09 18:26:22.142731","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4338},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4338":{"gid":4338,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/4138856363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4138856363},{"type":"v1","addr":"172.21.15.79:6833","nonce":4138856363}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:26:28.417 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 6 2021-04-09T18:26:28.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.410 7fb8d1339700 1 -- 172.21.15.79:0/3745708880 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb8ac029100 msgr2=0x7fb8ac02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:28.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.410 7fb8d1339700 1 --2- 172.21.15.79:0/3745708880 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb8ac029100 0x7fb8ac02b650 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.410 7fb8d1339700 1 -- 172.21.15.79:0/3745708880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8cc0d5230 msgr2=0x7fb8cc1aed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:28.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.410 7fb8d1339700 1 --2- 172.21.15.79:0/3745708880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8cc0d5230 0x7fb8cc1aed40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fb8cc0d7ea0 tx=0x7fb8c4006c10).stop 2021-04-09T18:26:28.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.410 7fb8d1339700 1 -- 172.21.15.79:0/3745708880 shutdown_connections 2021-04-09T18:26:28.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.410 7fb8d1339700 1 --2- 172.21.15.79:0/3745708880 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb8ac029100 0x7fb8ac02b650 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.410 7fb8d1339700 1 --2- 172.21.15.79:0/3745708880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8cc1ab740 0x7fb8cc0c11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.410 7fb8d1339700 1 --2- 172.21.15.79:0/3745708880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8cc0d5230 0x7fb8cc1aed40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.410 7fb8d1339700 1 --2- 172.21.15.79:0/3745708880 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8cc0c1e70 0x7fb8cc0d4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.410 7fb8d1339700 1 -- 172.21.15.79:0/3745708880 >> 172.21.15.79:0/3745708880 conn(0x7fb8cc0a3be0 msgr2=0x7fb8cc099dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:28.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.410 7fb8d1339700 1 -- 172.21.15.79:0/3745708880 shutdown_connections 2021-04-09T18:26:28.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.410 7fb8d1339700 1 -- 172.21.15.79:0/3745708880 wait complete. 2021-04-09T18:26:28.633 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:26:14.412596', 'modified': '2021-04-09 18:26:22.142731', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4338}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4338': {'gid': 4338, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6833/4138856363', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 4138856363}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 4138856363}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:26:28.633 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:26:28.634 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2021-04-09T18:26:28.734 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:26:28.735 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:26:28.735 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2021-04-09T18:26:28.735 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4338, 2021-04-09T18:26:28.736 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2021-04-09T18:26:28.736 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2021-04-09T18:26:28.736 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 7.5890289949999996, 2021-04-09T18:26:28.736 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 6, 2021-04-09T18:26:28.736 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 22, 2021-04-09T18:26:28.737 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 22, 2021-04-09T18:26:28.737 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 11.878321594000001 2021-04-09T18:26:28.737 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:26:28.741 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 4338, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.5890289949999996, "mdsmap_epoch": 6, "osdmap_epoch": 22, "osdmap_epoch_barrier": 22, "uptime": 11.878321594000001 } 2021-04-09T18:26:28.742 INFO:teuthology.run_tasks:Running task ceph-fuse... 2021-04-09T18:26:28.761 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2021-04-09T18:26:28.762 INFO:tasks.ceph_fuse:config is None 2021-04-09T18:26:28.763 INFO:tasks.ceph_fuse:new config is {'client.0': None, 'client.1': None, 'client.2': None} 2021-04-09T18:26:28.764 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2021-04-09T18:26:28.764 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:28.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.854 7f81d06a7700 1 Processor -- start 2021-04-09T18:26:28.870 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.854 7f81d06a7700 1 -- start start 2021-04-09T18:26:28.870 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.854 7f81d06a7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f81c80e9ae0 0x7f81c809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:28.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.854 7f81d06a7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81c81c8010 0x7f81c81ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:28.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.854 7f81d06a7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c80fbb20 con 0x7f81c80f5520 2021-04-09T18:26:28.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.854 7f81d06a7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c81c3dc0 con 0x7f81c80e9ae0 2021-04-09T18:26:28.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.854 7f81d06a7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c80e9f30 con 0x7f81c81c8010 2021-04-09T18:26:28.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.854 7f81cdc4a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f81c80e9ae0 0x7f81c809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:28.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.854 7f81cdc4a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f81c80e9ae0 0x7f81c809f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56072/0 (socket says 172.21.15.79:56072) 2021-04-09T18:26:28.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.854 7f81cdc4a700 1 -- 172.21.15.79:0/2568668861 learned_addr learned my addr 172.21.15.79:0/2568668861 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:28.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.854 7f81ce44b700 1 --1- 172.21.15.79:0/2568668861 >> v1:172.21.15.79:6789/0 conn(0x7f81c80f5520 0x7f81c80f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50778/0 (socket says 172.21.15.79:50778) 2021-04-09T18:26:28.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.858 7f81cec4c700 1 --2- 172.21.15.79:0/2568668861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81c81c8010 0x7f81c81ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:28.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.858 7f81cdc4a700 1 -- 172.21.15.79:0/2568668861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81c81c8010 msgr2=0x7f81c81ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:28.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.858 7f81cdc4a700 1 --2- 172.21.15.79:0/2568668861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81c81c8010 0x7f81c81ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.858 7f81cdc4a700 1 -- 172.21.15.79:0/2568668861 >> v1:172.21.15.79:6789/0 conn(0x7f81c80f5520 legacy=0x7f81c80f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:28.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.858 7f81cdc4a700 1 -- 172.21.15.79:0/2568668861 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c80e56d0 con 0x7f81c80e9ae0 2021-04-09T18:26:28.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.858 7f81cec4c700 1 --2- 172.21.15.79:0/2568668861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81c81c8010 0x7f81c81ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:26:28.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.858 7f81cdc4a700 1 --2- 172.21.15.79:0/2568668861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81c80e9ae0 0x7f81c809f110 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f81c80f6f00 tx=0x7f81b800bdd0).ready entity=mon.0 client_cookie=16f4af59d8761737 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:28.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.858 7f81cd449700 1 -- 172.21.15.79:0/2568668861 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f81c80e56d0 con 0x7f81c80e9ae0 2021-04-09T18:26:28.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.858 7f81cd449700 1 -- 172.21.15.79:0/2568668861 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b8009990 con 0x7f81c80e9ae0 2021-04-09T18:26:28.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.858 7f81cd449700 1 -- 172.21.15.79:0/2568668861 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f81b8009d60 con 0x7f81c80e9ae0 2021-04-09T18:26:28.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.858 7f81d06a7700 1 -- 172.21.15.79:0/2568668861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81c80e9ae0 msgr2=0x7f81c809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:28.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.858 7f81d06a7700 1 --2- 172.21.15.79:0/2568668861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81c80e9ae0 0x7f81c809f110 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f81c80f6f00 tx=0x7f81b800bdd0).stop 2021-04-09T18:26:28.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.858 7f81d06a7700 1 -- 172.21.15.79:0/2568668861 shutdown_connections 2021-04-09T18:26:28.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.858 7f81d06a7700 1 --2- 172.21.15.79:0/2568668861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81c81c8010 0x7f81c81ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.858 7f81d06a7700 1 --2- 172.21.15.79:0/2568668861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81c80e9ae0 0x7f81c809f110 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.858 7f81d06a7700 1 -- 172.21.15.79:0/2568668861 >> 172.21.15.79:0/2568668861 conn(0x7f81c80e5fe0 msgr2=0x7f81c80e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:28.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.858 7f81d06a7700 1 -- 172.21.15.79:0/2568668861 shutdown_connections 2021-04-09T18:26:28.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.858 7f81d06a7700 1 -- 172.21.15.79:0/2568668861 wait complete. 2021-04-09T18:26:28.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.862 7f81d06a7700 1 Processor -- start 2021-04-09T18:26:28.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.862 7f81d06a7700 1 -- start start 2021-04-09T18:26:28.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.862 7f81d06a7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81c80d5a20 0x7f81c80a7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:28.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.862 7f81d06a7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81c80a9410 0x7f81c80d6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:28.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.862 7f81d06a7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81c80a8c60 0x7f81c80d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:28.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.862 7f81d06a7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c80ae010 con 0x7f81c80a9410 2021-04-09T18:26:28.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.862 7f81d06a7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8094bf0 con 0x7f81c80a8c60 2021-04-09T18:26:28.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.862 7f81d06a7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c80a8200 con 0x7f81c80d5a20 2021-04-09T18:26:28.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.862 7f81cdc4a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81c80a9410 0x7f81c80d6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:28.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.862 7f81cdc4a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81c80a9410 0x7f81c80d6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56078/0 (socket says 172.21.15.79:56078) 2021-04-09T18:26:28.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.862 7f81cdc4a700 1 -- 172.21.15.79:0/2134972823 learned_addr learned my addr 172.21.15.79:0/2134972823 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:28.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.862 7f81cec4c700 1 --2- 172.21.15.79:0/2134972823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81c80a8c60 0x7f81c80d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:28.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.862 7f81ce44b700 1 --2- 172.21.15.79:0/2134972823 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81c80d5a20 0x7f81c80a7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:28.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.866 7f81cdc4a700 1 -- 172.21.15.79:0/2134972823 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81c80d5a20 msgr2=0x7f81c80a7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:28.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.866 7f81cdc4a700 1 --2- 172.21.15.79:0/2134972823 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81c80d5a20 0x7f81c80a7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.866 7f81cdc4a700 1 -- 172.21.15.79:0/2134972823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81c80a8c60 msgr2=0x7f81c80d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:28.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.866 7f81cdc4a700 1 --2- 172.21.15.79:0/2134972823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81c80a8c60 0x7f81c80d00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:28.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.866 7f81cdc4a700 1 -- 172.21.15.79:0/2134972823 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c80d75e0 con 0x7f81c80a9410 2021-04-09T18:26:28.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.866 7f81ce44b700 1 --2- 172.21.15.79:0/2134972823 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81c80d5a20 0x7f81c80a7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:28.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.866 7f81cdc4a700 1 --2- 172.21.15.79:0/2134972823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81c80a9410 0x7f81c80d6fb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f81c80ba450 tx=0x7f81b8006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:28.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.866 7f81beffd700 1 -- 172.21.15.79:0/2134972823 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f81c80d75e0 con 0x7f81c80a9410 2021-04-09T18:26:28.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.866 7f81d06a7700 1 -- 172.21.15.79:0/2134972823 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c80d06f0 con 0x7f81c80a9410 2021-04-09T18:26:28.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.866 7f81beffd700 1 -- 172.21.15.79:0/2134972823 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b801d450 con 0x7f81c80a9410 2021-04-09T18:26:28.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.866 7f81beffd700 1 -- 172.21.15.79:0/2134972823 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f81b801d820 con 0x7f81c80a9410 2021-04-09T18:26:28.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.866 7f81d06a7700 1 -- 172.21.15.79:0/2134972823 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c809a500 con 0x7f81c80a9410 2021-04-09T18:26:28.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.866 7f81beffd700 1 -- 172.21.15.79:0/2134972823 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f81b801da20 con 0x7f81c80a9410 2021-04-09T18:26:28.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.866 7f81beffd700 1 --2- 172.21.15.79:0/2134972823 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f81b0029100 0x7f81b002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:28.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.866 7f81beffd700 1 -- 172.21.15.79:0/2134972823 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f81b803ccd0 con 0x7f81c80a9410 2021-04-09T18:26:28.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.866 7f81ce44b700 1 --2- 172.21.15.79:0/2134972823 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f81b0029100 0x7f81b002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:28.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.866 7f81d06a7700 1 -- 172.21.15.79:0/2134972823 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c80e39e0 con 0x7f81c80a9410 2021-04-09T18:26:28.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.870 7f81ce44b700 1 --2- 172.21.15.79:0/2134972823 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f81b0029100 0x7f81b002b650 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:28.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:28.874 7f81beffd700 1 -- 172.21.15.79:0/2134972823 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f81b8009780 con 0x7f81c80a9410 2021-04-09T18:26:29.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.038 7f81d06a7700 1 -- 172.21.15.79:0/2134972823 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81c80a1cc0 con 0x7f81c80a9410 2021-04-09T18:26:29.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.038 7f81beffd700 1 -- 172.21.15.79:0/2134972823 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14254 (secure 0 0 0) 0x7f81b80397c0 con 0x7f81c80a9410 2021-04-09T18:26:29.048 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:29.049 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:14.412296","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:26:09.311735","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:26:12.130710","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:26:29.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.042 7f81d06a7700 1 -- 172.21.15.79:0/2134972823 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f81b0029100 msgr2=0x7f81b002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.042 7f81d06a7700 1 --2- 172.21.15.79:0/2134972823 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f81b0029100 0x7f81b002b650 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.042 7f81d06a7700 1 -- 172.21.15.79:0/2134972823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81c80a9410 msgr2=0x7f81c80d6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.042 7f81d06a7700 1 --2- 172.21.15.79:0/2134972823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81c80a9410 0x7f81c80d6fb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f81c80ba450 tx=0x7f81b8006890).stop 2021-04-09T18:26:29.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.042 7f81d06a7700 1 -- 172.21.15.79:0/2134972823 shutdown_connections 2021-04-09T18:26:29.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.042 7f81d06a7700 1 --2- 172.21.15.79:0/2134972823 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f81b0029100 0x7f81b002b650 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.042 7f81d06a7700 1 --2- 172.21.15.79:0/2134972823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81c80a8c60 0x7f81c80d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.042 7f81d06a7700 1 --2- 172.21.15.79:0/2134972823 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81c80d5a20 0x7f81c80a7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.042 7f81d06a7700 1 --2- 172.21.15.79:0/2134972823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81c80a9410 0x7f81c80d6fb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.042 7f81d06a7700 1 -- 172.21.15.79:0/2134972823 >> 172.21.15.79:0/2134972823 conn(0x7f81c80bb160 msgr2=0x7f81c80bce10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:29.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.042 7f81d06a7700 1 -- 172.21.15.79:0/2134972823 shutdown_connections 2021-04-09T18:26:29.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.042 7f81d06a7700 1 -- 172.21.15.79:0/2134972823 wait complete. 2021-04-09T18:26:29.061 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:26:09.311735', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:26:12.130710', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:26:29.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:26:29.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.150 7f709dff4700 1 Processor -- start 2021-04-09T18:26:29.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.150 7f709dff4700 1 -- start start 2021-04-09T18:26:29.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.150 7f709dff4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f70980e9b10 0x7f709809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:29.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.150 7f709dff4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70981c8040 0x7f70981ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:29.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.150 7f709dff4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70980fbb50 con 0x7f70980f5550 2021-04-09T18:26:29.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.150 7f709dff4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70981c3df0 con 0x7f70980e9b10 2021-04-09T18:26:29.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.150 7f709dff4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70980e9f60 con 0x7f70981c8040 2021-04-09T18:26:29.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.150 7f7096ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f70980e9b10 0x7f709809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:29.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.150 7f7096ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f70980e9b10 0x7f709809f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56082/0 (socket says 172.21.15.79:56082) 2021-04-09T18:26:29.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.150 7f7096ffd700 1 -- 172.21.15.79:0/3922899121 learned_addr learned my addr 172.21.15.79:0/3922899121 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:29.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.150 7f7097fff700 1 --2- 172.21.15.79:0/3922899121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70981c8040 0x7f70981ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:29.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.150 7f7096ffd700 1 -- 172.21.15.79:0/3922899121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70981c8040 msgr2=0x7f70981ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:29.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.150 7f7096ffd700 1 --2- 172.21.15.79:0/3922899121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70981c8040 0x7f70981ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.150 7f7096ffd700 1 -- 172.21.15.79:0/3922899121 >> v1:172.21.15.89:6789/0 conn(0x7f70980f5550 legacy=0x7f70980f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.150 7f7096ffd700 1 -- 172.21.15.79:0/3922899121 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70980e5700 con 0x7f70980e9b10 2021-04-09T18:26:29.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.150 7f7096ffd700 1 --2- 172.21.15.79:0/3922899121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70980e9b10 0x7f709809f110 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f70980f6f30 tx=0x7f708c00bdd0).ready entity=mon.0 client_cookie=c20e06f2459f2f7e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:29.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.154 7f70967fc700 1 -- 172.21.15.79:0/3922899121 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f70980e5700 con 0x7f70980e9b10 2021-04-09T18:26:29.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.154 7f70967fc700 1 -- 172.21.15.79:0/3922899121 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c009990 con 0x7f70980e9b10 2021-04-09T18:26:29.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.154 7f70967fc700 1 -- 172.21.15.79:0/3922899121 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f708c009d60 con 0x7f70980e9b10 2021-04-09T18:26:29.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.154 7f709dff4700 1 -- 172.21.15.79:0/3922899121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70980e9b10 msgr2=0x7f709809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.154 7f709dff4700 1 --2- 172.21.15.79:0/3922899121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70980e9b10 0x7f709809f110 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f70980f6f30 tx=0x7f708c00bdd0).stop 2021-04-09T18:26:29.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.154 7f709dff4700 1 -- 172.21.15.79:0/3922899121 shutdown_connections 2021-04-09T18:26:29.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.154 7f709dff4700 1 --2- 172.21.15.79:0/3922899121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70981c8040 0x7f70981ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.154 7f709dff4700 1 --2- 172.21.15.79:0/3922899121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70980e9b10 0x7f709809f110 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.154 7f709dff4700 1 -- 172.21.15.79:0/3922899121 >> 172.21.15.79:0/3922899121 conn(0x7f70980e6010 msgr2=0x7f70980e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:29.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.154 7f709dff4700 1 -- 172.21.15.79:0/3922899121 shutdown_connections 2021-04-09T18:26:29.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.154 7f709dff4700 1 -- 172.21.15.79:0/3922899121 wait complete. 2021-04-09T18:26:29.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f709dff4700 1 Processor -- start 2021-04-09T18:26:29.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f709dff4700 1 -- start start 2021-04-09T18:26:29.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f709dff4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70980d6b60 0x7f70980cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:29.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f709dff4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70980cf6b0 0x7f7098099c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:29.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f709dff4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f709809a290 0x7f70980d5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:29.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f709dff4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70980d6860 con 0x7f70980d6b60 2021-04-09T18:26:29.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f709dff4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709809a6e0 con 0x7f70980cf6b0 2021-04-09T18:26:29.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f709dff4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7098091db0 con 0x7f709809a290 2021-04-09T18:26:29.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f70977fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70980d6b60 0x7f70980cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:29.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f70977fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70980d6b60 0x7f70980cf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56088/0 (socket says 172.21.15.79:56088) 2021-04-09T18:26:29.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f70977fe700 1 -- 172.21.15.79:0/1992301774 learned_addr learned my addr 172.21.15.79:0/1992301774 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:29.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f7096ffd700 1 --2- 172.21.15.79:0/1992301774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70980cf6b0 0x7f7098099c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:29.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f7097fff700 1 --2- 172.21.15.79:0/1992301774 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f709809a290 0x7f70980d5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:29.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f70977fe700 1 -- 172.21.15.79:0/1992301774 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f709809a290 msgr2=0x7f70980d5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f70977fe700 1 --2- 172.21.15.79:0/1992301774 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f709809a290 0x7f70980d5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f70977fe700 1 -- 172.21.15.79:0/1992301774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70980cf6b0 msgr2=0x7f7098099c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f70977fe700 1 --2- 172.21.15.79:0/1992301774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70980cf6b0 0x7f7098099c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f70977fe700 1 -- 172.21.15.79:0/1992301774 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70980b9390 con 0x7f70980d6b60 2021-04-09T18:26:29.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f7096ffd700 1 --2- 172.21.15.79:0/1992301774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70980cf6b0 0x7f7098099c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:29.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f70977fe700 1 --2- 172.21.15.79:0/1992301774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70980d6b60 0x7f70980cf080 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f7088000b80 tx=0x7f708800ca80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:29.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.158 7f707ffff700 1 -- 172.21.15.79:0/1992301774 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f70980b9390 con 0x7f70980d6b60 2021-04-09T18:26:29.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.162 7f707ffff700 1 -- 172.21.15.79:0/1992301774 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7088010510 con 0x7f70980d6b60 2021-04-09T18:26:29.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.162 7f709dff4700 1 -- 172.21.15.79:0/1992301774 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7098091500 con 0x7f70980d6b60 2021-04-09T18:26:29.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.162 7f707ffff700 1 -- 172.21.15.79:0/1992301774 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f70880106f0 con 0x7f70980d6b60 2021-04-09T18:26:29.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.162 7f709dff4700 1 -- 172.21.15.79:0/1992301774 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70980d58c0 con 0x7f70980d6b60 2021-04-09T18:26:29.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.162 7f707ffff700 1 -- 172.21.15.79:0/1992301774 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7088019020 con 0x7f70980d6b60 2021-04-09T18:26:29.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.162 7f707ffff700 1 --2- 172.21.15.79:0/1992301774 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7078029100 0x7f707802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:29.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.162 7f707ffff700 1 -- 172.21.15.79:0/1992301774 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f7088038e10 con 0x7f70980d6b60 2021-04-09T18:26:29.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.162 7f7096ffd700 1 --2- 172.21.15.79:0/1992301774 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7078029100 0x7f707802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:29.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.162 7f7096ffd700 1 --2- 172.21.15.79:0/1992301774 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7078029100 0x7f707802b650 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:29.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.162 7f709dff4700 1 -- 172.21.15.79:0/1992301774 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70980e39f0 con 0x7f70980d6b60 2021-04-09T18:26:29.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.170 7f707ffff700 1 -- 172.21.15.79:0/1992301774 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7088010300 con 0x7f70980d6b60 2021-04-09T18:26:29.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.322 7f709dff4700 1 -- 172.21.15.79:0/1992301774 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f70980a1c90 con 0x7f70980d6b60 2021-04-09T18:26:29.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.326 7f707ffff700 1 -- 172.21.15.79:0/1992301774 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7088000bf0 con 0x7f70980d6b60 2021-04-09T18:26:29.334 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:29.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.330 7f709dff4700 1 -- 172.21.15.79:0/1992301774 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7078029100 msgr2=0x7f707802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.330 7f709dff4700 1 --2- 172.21.15.79:0/1992301774 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7078029100 0x7f707802b650 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.330 7f709dff4700 1 -- 172.21.15.79:0/1992301774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70980d6b60 msgr2=0x7f70980cf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.330 7f709dff4700 1 --2- 172.21.15.79:0/1992301774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70980d6b60 0x7f70980cf080 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f7088000b80 tx=0x7f708800ca80).stop 2021-04-09T18:26:29.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.330 7f709dff4700 1 -- 172.21.15.79:0/1992301774 shutdown_connections 2021-04-09T18:26:29.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.330 7f709dff4700 1 --2- 172.21.15.79:0/1992301774 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7078029100 0x7f707802b650 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.330 7f709dff4700 1 --2- 172.21.15.79:0/1992301774 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f709809a290 0x7f70980d5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.330 7f709dff4700 1 --2- 172.21.15.79:0/1992301774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70980d6b60 0x7f70980cf080 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.330 7f709dff4700 1 --2- 172.21.15.79:0/1992301774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70980cf6b0 0x7f7098099c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.330 7f709dff4700 1 -- 172.21.15.79:0/1992301774 >> 172.21.15.79:0/1992301774 conn(0x7f7098093b70 msgr2=0x7f70980d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:29.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.330 7f709dff4700 1 -- 172.21.15.79:0/1992301774 shutdown_connections 2021-04-09T18:26:29.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.330 7f709dff4700 1 -- 172.21.15.79:0/1992301774 wait complete. 2021-04-09T18:26:29.347 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:26:29.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.434 7f542014f700 1 Processor -- start 2021-04-09T18:26:29.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.434 7f542014f700 1 -- start start 2021-04-09T18:26:29.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f542014f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f54180e9b10 0x7f541809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:29.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f542014f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54180fbb50 con 0x7f54181c8040 2021-04-09T18:26:29.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f542014f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54180e5700 con 0x7f54180f5550 2021-04-09T18:26:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f542014f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54181c3df0 con 0x7f54180e9b10 2021-04-09T18:26:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f541e6f4700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f54181c8040 0x7f54181ca4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50810/0 (socket says 172.21.15.79:50810) 2021-04-09T18:26:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f541e6f4700 1 -- 172.21.15.79:0/213735990 learned_addr learned my addr 172.21.15.79:0/213735990 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:29.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f541d6f2700 1 --2- 172.21.15.79:0/213735990 >> v2:172.21.15.89:3300/0 conn(0x7f54180e9b10 0x7f541809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:29.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f541cef1700 1 -- 172.21.15.79:0/213735990 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875701111 0 0) 0x7f5410001450 con 0x7f54181c8040 2021-04-09T18:26:29.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f541cef1700 1 -- 172.21.15.79:0/213735990 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5404003240 con 0x7f54181c8040 2021-04-09T18:26:29.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f541cef1700 1 -- 172.21.15.79:0/213735990 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1028779219 0 0) 0x7f54100019d0 con 0x7f54181c8040 2021-04-09T18:26:29.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f541d6f2700 1 -- 172.21.15.79:0/213735990 >> v1:172.21.15.89:6789/0 conn(0x7f54180f5550 legacy=0x7f54180f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f541d6f2700 1 -- 172.21.15.79:0/213735990 >> v1:172.21.15.79:6789/0 conn(0x7f54181c8040 legacy=0x7f54181ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f541d6f2700 1 -- 172.21.15.79:0/213735990 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54180e4360 con 0x7f54180e9b10 2021-04-09T18:26:29.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f541d6f2700 1 --2- 172.21.15.79:0/213735990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54180e9b10 0x7f541809f110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f5410002130 tx=0x7f540800bcc0).ready entity=mon.1 client_cookie=90bd3fbb2e537d10 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:29.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f541cef1700 1 -- 172.21.15.79:0/213735990 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f54180e4360 con 0x7f54180e9b10 2021-04-09T18:26:29.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f541cef1700 1 -- 172.21.15.79:0/213735990 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54080096c0 con 0x7f54180e9b10 2021-04-09T18:26:29.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f541cef1700 1 -- 172.21.15.79:0/213735990 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5410001f30 con 0x7f54180e9b10 2021-04-09T18:26:29.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f542014f700 1 -- 172.21.15.79:0/213735990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54180e9b10 msgr2=0x7f541809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f542014f700 1 --2- 172.21.15.79:0/213735990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54180e9b10 0x7f541809f110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f5410002130 tx=0x7f540800bcc0).stop 2021-04-09T18:26:29.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f542014f700 1 -- 172.21.15.79:0/213735990 shutdown_connections 2021-04-09T18:26:29.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f542014f700 1 --2- 172.21.15.79:0/213735990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54180e9b10 0x7f541809f110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f542014f700 1 -- 172.21.15.79:0/213735990 >> 172.21.15.79:0/213735990 conn(0x7f54180e6010 msgr2=0x7f54180e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:29.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f542014f700 1 -- 172.21.15.79:0/213735990 shutdown_connections 2021-04-09T18:26:29.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.438 7f542014f700 1 -- 172.21.15.79:0/213735990 wait complete. 2021-04-09T18:26:29.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f542014f700 1 Processor -- start 2021-04-09T18:26:29.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f542014f700 1 -- start start 2021-04-09T18:26:29.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f542014f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54180d7e00 0x7f54180cf610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:29.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f542014f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54180cfc40 0x7f54180b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:29.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f542014f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54180b55c0 0x7f54180d4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:29.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f542014f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54180e9f60 con 0x7f54180d7e00 2021-04-09T18:26:29.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f542014f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54180d8d50 con 0x7f54180cfc40 2021-04-09T18:26:29.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f542014f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5418099770 con 0x7f54180b55c0 2021-04-09T18:26:29.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f541def3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54180d7e00 0x7f54180cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:29.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f541def3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54180d7e00 0x7f54180cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56102/0 (socket says 172.21.15.79:56102) 2021-04-09T18:26:29.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f541def3700 1 -- 172.21.15.79:0/2855194011 learned_addr learned my addr 172.21.15.79:0/2855194011 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:29.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f541d6f2700 1 --2- 172.21.15.79:0/2855194011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54180cfc40 0x7f54180b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:29.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f541e6f4700 1 --2- 172.21.15.79:0/2855194011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54180b55c0 0x7f54180d4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:29.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f541def3700 1 -- 172.21.15.79:0/2855194011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54180b55c0 msgr2=0x7f54180d4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f541def3700 1 --2- 172.21.15.79:0/2855194011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54180b55c0 0x7f54180d4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f541def3700 1 -- 172.21.15.79:0/2855194011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54180cfc40 msgr2=0x7f54180b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f541def3700 1 --2- 172.21.15.79:0/2855194011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54180cfc40 0x7f54180b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f541def3700 1 -- 172.21.15.79:0/2855194011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54180b5a10 con 0x7f54180d7e00 2021-04-09T18:26:29.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f541def3700 1 --2- 172.21.15.79:0/2855194011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54180d7e00 0x7f54180cf610 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f54180d7cf0 tx=0x7f541400cb60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:29.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f540e7fc700 1 -- 172.21.15.79:0/2855194011 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f54180b5a10 con 0x7f54180d7e00 2021-04-09T18:26:29.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f540e7fc700 1 -- 172.21.15.79:0/2855194011 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5414010510 con 0x7f54180d7e00 2021-04-09T18:26:29.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f542014f700 1 -- 172.21.15.79:0/2855194011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54180d85e0 con 0x7f54180d7e00 2021-04-09T18:26:29.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f540e7fc700 1 -- 172.21.15.79:0/2855194011 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f54140106f0 con 0x7f54180d7e00 2021-04-09T18:26:29.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f542014f700 1 -- 172.21.15.79:0/2855194011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54180d88b0 con 0x7f54180d7e00 2021-04-09T18:26:29.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f540e7fc700 1 -- 172.21.15.79:0/2855194011 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5414019020 con 0x7f54180d7e00 2021-04-09T18:26:29.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f540e7fc700 1 --2- 172.21.15.79:0/2855194011 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5400029100 0x7f540002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:29.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.446 7f540e7fc700 1 -- 172.21.15.79:0/2855194011 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f5414038ef0 con 0x7f54180d7e00 2021-04-09T18:26:29.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.450 7f541d6f2700 1 --2- 172.21.15.79:0/2855194011 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5400029100 0x7f540002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:29.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.450 7f542014f700 1 -- 172.21.15.79:0/2855194011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54180e39f0 con 0x7f54180d7e00 2021-04-09T18:26:29.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.450 7f541d6f2700 1 --2- 172.21.15.79:0/2855194011 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5400029100 0x7f540002b650 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:29.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.458 7f540e7fc700 1 -- 172.21.15.79:0/2855194011 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5418107f80 con 0x7f54180d7e00 2021-04-09T18:26:29.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.614 7f542014f700 1 -- 172.21.15.79:0/2855194011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f54180a1c90 con 0x7f54180d7e00 2021-04-09T18:26:29.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.618 7f540e7fc700 1 -- 172.21.15.79:0/2855194011 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5414010300 con 0x7f54180d7e00 2021-04-09T18:26:29.624 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:29.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.618 7f542014f700 1 -- 172.21.15.79:0/2855194011 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5400029100 msgr2=0x7f540002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.618 7f542014f700 1 --2- 172.21.15.79:0/2855194011 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5400029100 0x7f540002b650 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.618 7f542014f700 1 -- 172.21.15.79:0/2855194011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54180d7e00 msgr2=0x7f54180cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.618 7f542014f700 1 --2- 172.21.15.79:0/2855194011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54180d7e00 0x7f54180cf610 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f54180d7cf0 tx=0x7f541400cb60).stop 2021-04-09T18:26:29.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.618 7f542014f700 1 -- 172.21.15.79:0/2855194011 shutdown_connections 2021-04-09T18:26:29.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.618 7f542014f700 1 --2- 172.21.15.79:0/2855194011 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5400029100 0x7f540002b650 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.618 7f542014f700 1 --2- 172.21.15.79:0/2855194011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54180b55c0 0x7f54180d4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.618 7f542014f700 1 --2- 172.21.15.79:0/2855194011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54180d7e00 0x7f54180cf610 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.618 7f542014f700 1 --2- 172.21.15.79:0/2855194011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54180cfc40 0x7f54180b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.618 7f542014f700 1 -- 172.21.15.79:0/2855194011 >> 172.21.15.79:0/2855194011 conn(0x7f541809b260 msgr2=0x7f541808e320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:29.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.618 7f542014f700 1 -- 172.21.15.79:0/2855194011 shutdown_connections 2021-04-09T18:26:29.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.618 7f542014f700 1 -- 172.21.15.79:0/2855194011 wait complete. 2021-04-09T18:26:29.636 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:26:29.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.722 7f0f55b7d700 1 Processor -- start 2021-04-09T18:26:29.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.722 7f0f55b7d700 1 -- start start 2021-04-09T18:26:29.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.722 7f0f55b7d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0f500f5550 0x7f0f500f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:29.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.722 7f0f55b7d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0f501c8040 0x7f0f501ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:29.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.722 7f0f55b7d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f500fbb50 con 0x7f0f500e9b10 2021-04-09T18:26:29.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.722 7f0f55b7d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f500e9f60 con 0x7f0f501c8040 2021-04-09T18:26:29.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.722 7f0f55b7d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f501c3df0 con 0x7f0f500f5550 2021-04-09T18:26:29.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.722 7f0f4ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0f501c8040 0x7f0f501ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:29.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.722 7f0f4effd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0f500e9b10 0x7f0f5009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50822/0 (socket says 172.21.15.79:50822) 2021-04-09T18:26:29.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.722 7f0f4ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0f501c8040 0x7f0f501ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56114/0 (socket says 172.21.15.79:56114) 2021-04-09T18:26:29.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.722 7f0f4effd700 1 -- 172.21.15.79:0/2556424363 learned_addr learned my addr 172.21.15.79:0/2556424363 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:29.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.722 7f0f4f7fe700 1 --2- 172.21.15.79:0/2556424363 >> v2:172.21.15.89:3300/0 conn(0x7f0f500f5550 0x7f0f500f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:29.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.726 7f0f4ffff700 1 -- 172.21.15.79:0/2556424363 >> v2:172.21.15.89:3300/0 conn(0x7f0f500f5550 msgr2=0x7f0f500f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:29.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.726 7f0f4ffff700 1 --2- 172.21.15.79:0/2556424363 >> v2:172.21.15.89:3300/0 conn(0x7f0f500f5550 0x7f0f500f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.726 7f0f4ffff700 1 -- 172.21.15.79:0/2556424363 >> v1:172.21.15.79:6789/0 conn(0x7f0f500e9b10 legacy=0x7f0f5009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.726 7f0f4ffff700 1 -- 172.21.15.79:0/2556424363 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5009f910 con 0x7f0f501c8040 2021-04-09T18:26:29.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.726 7f0f4ffff700 1 --2- 172.21.15.79:0/2556424363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f501c8040 0x7f0f501ca4a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f0f480032b0 tx=0x7f0f4800b3c0).ready entity=mon.0 client_cookie=63969f665d1cf3e1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:29.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.726 7f0f4e7fc700 1 -- 172.21.15.79:0/2556424363 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0f5009f910 con 0x7f0f501c8040 2021-04-09T18:26:29.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.726 7f0f4e7fc700 1 -- 172.21.15.79:0/2556424363 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4800bc20 con 0x7f0f501c8040 2021-04-09T18:26:29.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.726 7f0f4e7fc700 1 -- 172.21.15.79:0/2556424363 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0f48002020 con 0x7f0f501c8040 2021-04-09T18:26:29.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.726 7f0f55b7d700 1 -- 172.21.15.79:0/2556424363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f501c8040 msgr2=0x7f0f501ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.726 7f0f55b7d700 1 --2- 172.21.15.79:0/2556424363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f501c8040 0x7f0f501ca4a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f0f480032b0 tx=0x7f0f4800b3c0).stop 2021-04-09T18:26:29.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.726 7f0f55b7d700 1 -- 172.21.15.79:0/2556424363 shutdown_connections 2021-04-09T18:26:29.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.726 7f0f55b7d700 1 --2- 172.21.15.79:0/2556424363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f501c8040 0x7f0f501ca4a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.726 7f0f55b7d700 1 --2- 172.21.15.79:0/2556424363 >> v2:172.21.15.89:3300/0 conn(0x7f0f500f5550 0x7f0f500f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.726 7f0f55b7d700 1 -- 172.21.15.79:0/2556424363 >> 172.21.15.79:0/2556424363 conn(0x7f0f500e6010 msgr2=0x7f0f500e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:29.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.726 7f0f55b7d700 1 -- 172.21.15.79:0/2556424363 shutdown_connections 2021-04-09T18:26:29.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.726 7f0f55b7d700 1 -- 172.21.15.79:0/2556424363 wait complete. 2021-04-09T18:26:29.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f55b7d700 1 Processor -- start 2021-04-09T18:26:29.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f55b7d700 1 -- start start 2021-04-09T18:26:29.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f55b7d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f500b7d30 0x7f0f50090970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:29.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f55b7d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f50096300 0x7f0f500910e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:29.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f55b7d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f50091ce0 0x7f0f50092130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:29.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f55b7d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f50047500 con 0x7f0f500b7d30 2021-04-09T18:26:29.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f55b7d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f500919e0 con 0x7f0f50096300 2021-04-09T18:26:29.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f55b7d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f50096750 con 0x7f0f50091ce0 2021-04-09T18:26:29.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f4f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f500b7d30 0x7f0f50090970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:29.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f4f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f500b7d30 0x7f0f50090970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56116/0 (socket says 172.21.15.79:56116) 2021-04-09T18:26:29.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f4f7fe700 1 -- 172.21.15.79:0/2062952123 learned_addr learned my addr 172.21.15.79:0/2062952123 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:29.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f4ffff700 1 --2- 172.21.15.79:0/2062952123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f50091ce0 0x7f0f50092130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:29.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f4effd700 1 --2- 172.21.15.79:0/2062952123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f50096300 0x7f0f500910e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:29.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f4f7fe700 1 -- 172.21.15.79:0/2062952123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f50091ce0 msgr2=0x7f0f50092130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f4f7fe700 1 --2- 172.21.15.79:0/2062952123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f50091ce0 0x7f0f50092130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f4f7fe700 1 -- 172.21.15.79:0/2062952123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f50096300 msgr2=0x7f0f500910e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f4f7fe700 1 --2- 172.21.15.79:0/2062952123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f50096300 0x7f0f500910e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f4f7fe700 1 -- 172.21.15.79:0/2062952123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f500928a0 con 0x7f0f500b7d30 2021-04-09T18:26:29.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f4f7fe700 1 --2- 172.21.15.79:0/2062952123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f500b7d30 0x7f0f50090970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f0f50095250 tx=0x7f0f4000c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:29.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f37fff700 1 -- 172.21.15.79:0/2062952123 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0f500928a0 con 0x7f0f500b7d30 2021-04-09T18:26:29.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f37fff700 1 -- 172.21.15.79:0/2062952123 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4000cd60 con 0x7f0f500b7d30 2021-04-09T18:26:29.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f55b7d700 1 -- 172.21.15.79:0/2062952123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f500d1840 con 0x7f0f500b7d30 2021-04-09T18:26:29.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f37fff700 1 -- 172.21.15.79:0/2062952123 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0f4000f040 con 0x7f0f500b7d30 2021-04-09T18:26:29.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f55b7d700 1 -- 172.21.15.79:0/2062952123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f500d1d40 con 0x7f0f500b7d30 2021-04-09T18:26:29.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f37fff700 1 -- 172.21.15.79:0/2062952123 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0f40011070 con 0x7f0f500b7d30 2021-04-09T18:26:29.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f37fff700 1 --2- 172.21.15.79:0/2062952123 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0f30029100 0x7f0f3002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:29.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f37fff700 1 -- 172.21.15.79:0/2062952123 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f0f40010040 con 0x7f0f500b7d30 2021-04-09T18:26:29.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.730 7f0f4effd700 1 --2- 172.21.15.79:0/2062952123 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0f30029100 0x7f0f3002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:29.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.734 7f0f4effd700 1 --2- 172.21.15.79:0/2062952123 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0f30029100 0x7f0f3002b650 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:29.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.738 7f0f55b7d700 1 -- 172.21.15.79:0/2062952123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f500e39f0 con 0x7f0f500b7d30 2021-04-09T18:26:29.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.746 7f0f37fff700 1 -- 172.21.15.79:0/2062952123 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0f4000c960 con 0x7f0f500b7d30 2021-04-09T18:26:29.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.906 7f0f55b7d700 1 -- 172.21.15.79:0/2062952123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f0f500f5b50 con 0x7f0f500b7d30 2021-04-09T18:26:29.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.906 7f0f37fff700 1 -- 172.21.15.79:0/2062952123 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f0f40000bf0 con 0x7f0f500b7d30 2021-04-09T18:26:29.916 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:29.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.910 7f0f55b7d700 1 -- 172.21.15.79:0/2062952123 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0f30029100 msgr2=0x7f0f3002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.910 7f0f55b7d700 1 --2- 172.21.15.79:0/2062952123 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0f30029100 0x7f0f3002b650 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.910 7f0f55b7d700 1 -- 172.21.15.79:0/2062952123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f500b7d30 msgr2=0x7f0f50090970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:29.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.910 7f0f55b7d700 1 --2- 172.21.15.79:0/2062952123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f500b7d30 0x7f0f50090970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f0f50095250 tx=0x7f0f4000c430).stop 2021-04-09T18:26:29.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.910 7f0f55b7d700 1 -- 172.21.15.79:0/2062952123 shutdown_connections 2021-04-09T18:26:29.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.910 7f0f55b7d700 1 --2- 172.21.15.79:0/2062952123 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0f30029100 0x7f0f3002b650 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.910 7f0f55b7d700 1 --2- 172.21.15.79:0/2062952123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f50091ce0 0x7f0f50092130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.910 7f0f55b7d700 1 --2- 172.21.15.79:0/2062952123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f500b7d30 0x7f0f50090970 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.910 7f0f55b7d700 1 --2- 172.21.15.79:0/2062952123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f50096300 0x7f0f500910e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:29.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.910 7f0f55b7d700 1 -- 172.21.15.79:0/2062952123 >> 172.21.15.79:0/2062952123 conn(0x7f0f500d8a20 msgr2=0x7f0f500d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:29.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.910 7f0f55b7d700 1 -- 172.21.15.79:0/2062952123 shutdown_connections 2021-04-09T18:26:29.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:29.910 7f0f55b7d700 1 -- 172.21.15.79:0/2062952123 wait complete. 2021-04-09T18:26:29.928 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:26:29.929 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:26:30.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.018 7f0ae8ebc700 1 Processor -- start 2021-04-09T18:26:30.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.018 7f0ae8ebc700 1 -- start start 2021-04-09T18:26:30.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.018 7f0ae8ebc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0ae40e9ad0 0x7f0ae409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:30.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.018 7f0ae8ebc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ae41c8000 0x7f0ae41ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:30.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.018 7f0ae8ebc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae40fbb10 con 0x7f0ae40f5510 2021-04-09T18:26:30.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.018 7f0ae8ebc700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae41c3db0 con 0x7f0ae40e9ad0 2021-04-09T18:26:30.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.018 7f0ae8ebc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae40e9f20 con 0x7f0ae41c8000 2021-04-09T18:26:30.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae22ee700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0ae40e9ad0 0x7f0ae409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:30.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae32f0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ae41c8000 0x7f0ae41ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:30.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae22ee700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0ae40e9ad0 0x7f0ae409f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:44468/0 (socket says 172.21.15.79:44468) 2021-04-09T18:26:30.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae22ee700 1 -- 172.21.15.79:0/1643341768 learned_addr learned my addr 172.21.15.79:0/1643341768 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:30.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae2aef700 1 --1- 172.21.15.79:0/1643341768 >> v1:172.21.15.89:6789/0 conn(0x7f0ae40f5510 0x7f0ae40f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:51304/0 (socket says 172.21.15.79:51304) 2021-04-09T18:26:30.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae32f0700 1 -- 172.21.15.79:0/1643341768 >> v2:172.21.15.89:3300/0 conn(0x7f0ae40e9ad0 msgr2=0x7f0ae409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:30.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae32f0700 1 --2- 172.21.15.79:0/1643341768 >> v2:172.21.15.89:3300/0 conn(0x7f0ae40e9ad0 0x7f0ae409f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:30.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae32f0700 1 -- 172.21.15.79:0/1643341768 >> v1:172.21.15.89:6789/0 conn(0x7f0ae40f5510 legacy=0x7f0ae40f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:30.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae32f0700 1 -- 172.21.15.79:0/1643341768 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae40e56c0 con 0x7f0ae41c8000 2021-04-09T18:26:30.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae22ee700 1 --2- 172.21.15.79:0/1643341768 >> v2:172.21.15.89:3300/0 conn(0x7f0ae40e9ad0 0x7f0ae409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:30.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae32f0700 1 --2- 172.21.15.79:0/1643341768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ae41c8000 0x7f0ae41ca460 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0adc002f30 tx=0x7f0adc00bcc0).ready entity=mon.2 client_cookie=9e83e9c552c411bb server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:30.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae1aed700 1 -- 172.21.15.79:0/1643341768 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ae40e56c0 con 0x7f0ae41c8000 2021-04-09T18:26:30.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae1aed700 1 -- 172.21.15.79:0/1643341768 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc009800 con 0x7f0ae41c8000 2021-04-09T18:26:30.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae1aed700 1 -- 172.21.15.79:0/1643341768 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0adc009bd0 con 0x7f0ae41c8000 2021-04-09T18:26:30.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae8ebc700 1 -- 172.21.15.79:0/1643341768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ae41c8000 msgr2=0x7f0ae41ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:30.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae8ebc700 1 --2- 172.21.15.79:0/1643341768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ae41c8000 0x7f0ae41ca460 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0adc002f30 tx=0x7f0adc00bcc0).stop 2021-04-09T18:26:30.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae8ebc700 1 -- 172.21.15.79:0/1643341768 shutdown_connections 2021-04-09T18:26:30.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae8ebc700 1 --2- 172.21.15.79:0/1643341768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ae41c8000 0x7f0ae41ca460 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:30.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae8ebc700 1 --2- 172.21.15.79:0/1643341768 >> v2:172.21.15.89:3300/0 conn(0x7f0ae40e9ad0 0x7f0ae409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:30.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae8ebc700 1 -- 172.21.15.79:0/1643341768 >> 172.21.15.79:0/1643341768 conn(0x7f0ae40e5fd0 msgr2=0x7f0ae40e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:30.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae8ebc700 1 -- 172.21.15.79:0/1643341768 shutdown_connections 2021-04-09T18:26:30.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.022 7f0ae8ebc700 1 -- 172.21.15.79:0/1643341768 wait complete. 2021-04-09T18:26:30.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.026 7f0ae8ebc700 1 Processor -- start 2021-04-09T18:26:30.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.026 7f0ae8ebc700 1 -- start start 2021-04-09T18:26:30.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.026 7f0ae8ebc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ae4094ee0 0x7f0ae40d4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:30.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.026 7f0ae8ebc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ae409ace0 0x7f0ae409a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:30.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.026 7f0ae8ebc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ae40d0830 0x7f0ae40d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:30.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.026 7f0ae8ebc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4094be0 con 0x7f0ae40d0830 2021-04-09T18:26:30.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.026 7f0ae8ebc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae409aa50 con 0x7f0ae409ace0 2021-04-09T18:26:30.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.026 7f0ae8ebc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae409a700 con 0x7f0ae4094ee0 2021-04-09T18:26:30.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ae32f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ae40d0830 0x7f0ae40d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:30.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ae32f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ae40d0830 0x7f0ae40d0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56134/0 (socket says 172.21.15.79:56134) 2021-04-09T18:26:30.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ae32f0700 1 -- 172.21.15.79:0/2857420745 learned_addr learned my addr 172.21.15.79:0/2857420745 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:30.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ae22ee700 1 --2- 172.21.15.79:0/2857420745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ae409ace0 0x7f0ae409a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:30.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ae2aef700 1 --2- 172.21.15.79:0/2857420745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ae4094ee0 0x7f0ae40d4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:30.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ae32f0700 1 -- 172.21.15.79:0/2857420745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ae4094ee0 msgr2=0x7f0ae40d4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:30.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ae32f0700 1 --2- 172.21.15.79:0/2857420745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ae4094ee0 0x7f0ae40d4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:30.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ae32f0700 1 -- 172.21.15.79:0/2857420745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ae409ace0 msgr2=0x7f0ae409a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:30.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ae32f0700 1 --2- 172.21.15.79:0/2857420745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ae409ace0 0x7f0ae409a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:30.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ae32f0700 1 -- 172.21.15.79:0/2857420745 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae409b130 con 0x7f0ae40d0830 2021-04-09T18:26:30.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ae32f0700 1 --2- 172.21.15.79:0/2857420745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ae40d0830 0x7f0ae40d0c80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f0adc002f30 tx=0x7f0adc006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:30.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ad37fe700 1 -- 172.21.15.79:0/2857420745 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ae409b130 con 0x7f0ae40d0830 2021-04-09T18:26:30.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ad37fe700 1 -- 172.21.15.79:0/2857420745 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc011d60 con 0x7f0ae40d0830 2021-04-09T18:26:30.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ae8ebc700 1 -- 172.21.15.79:0/2857420745 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae4094790 con 0x7f0ae40d0830 2021-04-09T18:26:30.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ad37fe700 1 -- 172.21.15.79:0/2857420745 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0adc022020 con 0x7f0ae40d0830 2021-04-09T18:26:30.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ae8ebc700 1 -- 172.21.15.79:0/2857420745 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae41a8470 con 0x7f0ae40d0830 2021-04-09T18:26:30.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ad37fe700 1 -- 172.21.15.79:0/2857420745 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0adc01d640 con 0x7f0ae40d0830 2021-04-09T18:26:30.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ad37fe700 1 --2- 172.21.15.79:0/2857420745 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0ac8029100 0x7f0ac802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:30.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ad37fe700 1 -- 172.21.15.79:0/2857420745 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f0adc03c690 con 0x7f0ae40d0830 2021-04-09T18:26:30.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ae2aef700 1 --2- 172.21.15.79:0/2857420745 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0ac8029100 0x7f0ac802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:30.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ae2aef700 1 --2- 172.21.15.79:0/2857420745 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0ac8029100 0x7f0ac802b650 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:30.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.030 7f0ae8ebc700 1 -- 172.21.15.79:0/2857420745 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae40e39d0 con 0x7f0ae40d0830 2021-04-09T18:26:30.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.038 7f0ad37fe700 1 -- 172.21.15.79:0/2857420745 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0adc0095f0 con 0x7f0ae40d0830 2021-04-09T18:26:30.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.202 7f0ae8ebc700 1 -- 172.21.15.79:0/2857420745 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ae40f5b10 con 0x7f0ae40d0830 2021-04-09T18:26:30.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.206 7f0ad37fe700 1 -- 172.21.15.79:0/2857420745 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2097 (secure 0 0 0) 0x7f0adc011b50 con 0x7f0ae40d0830 2021-04-09T18:26:30.214 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:30.215 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1857210510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1857210510},{"type":"v1","addr":"172.21.15.89:6835","nonce":1857210510}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:26:14.412596","modified":"2021-04-09 18:26:22.142731","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4338},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4338":{"gid":4338,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/4138856363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4138856363},{"type":"v1","addr":"172.21.15.79:6833","nonce":4138856363}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:26:30.216 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 6 2021-04-09T18:26:30.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.210 7f0ae8ebc700 1 -- 172.21.15.79:0/2857420745 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0ac8029100 msgr2=0x7f0ac802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:30.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.210 7f0ae8ebc700 1 --2- 172.21.15.79:0/2857420745 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0ac8029100 0x7f0ac802b650 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:30.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.210 7f0ae8ebc700 1 -- 172.21.15.79:0/2857420745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ae40d0830 msgr2=0x7f0ae40d0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:30.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.210 7f0ae8ebc700 1 --2- 172.21.15.79:0/2857420745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ae40d0830 0x7f0ae40d0c80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f0adc002f30 tx=0x7f0adc006890).stop 2021-04-09T18:26:30.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.210 7f0ae8ebc700 1 -- 172.21.15.79:0/2857420745 shutdown_connections 2021-04-09T18:26:30.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.210 7f0ae8ebc700 1 --2- 172.21.15.79:0/2857420745 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0ac8029100 0x7f0ac802b650 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:30.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.210 7f0ae8ebc700 1 --2- 172.21.15.79:0/2857420745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ae40d0830 0x7f0ae40d0c80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:30.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.210 7f0ae8ebc700 1 --2- 172.21.15.79:0/2857420745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ae4094ee0 0x7f0ae40d4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:30.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.210 7f0ae8ebc700 1 --2- 172.21.15.79:0/2857420745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ae409ace0 0x7f0ae409a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:30.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.210 7f0ae8ebc700 1 -- 172.21.15.79:0/2857420745 >> 172.21.15.79:0/2857420745 conn(0x7f0ae4093c50 msgr2=0x7f0ae40d8810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:30.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.210 7f0ae8ebc700 1 -- 172.21.15.79:0/2857420745 shutdown_connections 2021-04-09T18:26:30.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:30.210 7f0ae8ebc700 1 -- 172.21.15.79:0/2857420745 wait complete. 2021-04-09T18:26:30.430 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:26:14.412596', 'modified': '2021-04-09 18:26:22.142731', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4338}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4338': {'gid': 4338, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6833/4138856363', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 4138856363}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 4138856363}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:26:30.430 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:26:30.431 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2021-04-09T18:26:30.523 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:26:30.524 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:26:30.524 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2021-04-09T18:26:30.525 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4338, 2021-04-09T18:26:30.525 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2021-04-09T18:26:30.526 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2021-04-09T18:26:30.526 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 9.3778496239999996, 2021-04-09T18:26:30.526 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 6, 2021-04-09T18:26:30.527 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 22, 2021-04-09T18:26:30.527 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 22, 2021-04-09T18:26:30.527 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 13.667143492999999 2021-04-09T18:26:30.528 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:26:30.530 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 4338, "want_state": "up:active", "state": "up:active", "rank_uptime": 9.3778496239999996, "mdsmap_epoch": 6, "osdmap_epoch": 22, "osdmap_epoch_barrier": 22, "uptime": 13.667143492999999 } 2021-04-09T18:26:30.531 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:26:30.531 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-04-09T18:26:30.532 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi090.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-04-09T18:26:30.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:30.533 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:26:30.549 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:26:30.617 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:26:30.617 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:26:30.684 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:26:30.685 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:26:30.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:30.687 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:26:30.746 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:26:30.747 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:26:30.798 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:26:30.817 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:26:30.818 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:26:30.875 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:2021-04-09 18:26:30.868 7f94a93870c0 -1 init, newargv = 0x55de65497230 newargc=9ceph-fuse[12996]: starting ceph client 2021-04-09T18:26:30.876 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr: 2021-04-09T18:26:30.877 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:26:30.877 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:26:30.878 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:30.878 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:26:30.881 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[12996]: starting fuse 2021-04-09T18:26:30.890 INFO:teuthology.orchestra.run.smithi090.stdout:49 2021-04-09T18:26:30.891 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:26:30.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:30.892 DEBUG:teuthology.orchestra.run.smithi090:> sudo python3 -c ' 2021-04-09T18:26:30.892 DEBUG:teuthology.orchestra.run.smithi090:> import glob 2021-04-09T18:26:30.893 DEBUG:teuthology.orchestra.run.smithi090:> import re 2021-04-09T18:26:30.893 DEBUG:teuthology.orchestra.run.smithi090:> import os 2021-04-09T18:26:30.893 DEBUG:teuthology.orchestra.run.smithi090:> import subprocess 2021-04-09T18:26:30.894 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:26:30.894 DEBUG:teuthology.orchestra.run.smithi090:> def find_socket(client_name): 2021-04-09T18:26:30.895 DEBUG:teuthology.orchestra.run.smithi090:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-04-09T18:26:30.895 DEBUG:teuthology.orchestra.run.smithi090:> files = glob.glob(asok_path) 2021-04-09T18:26:30.895 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:26:30.900 DEBUG:teuthology.orchestra.run.smithi090:> # Given a non-glob path, it better be there 2021-04-09T18:26:30.901 DEBUG:teuthology.orchestra.run.smithi090:> if "*" not in asok_path: 2021-04-09T18:26:30.901 DEBUG:teuthology.orchestra.run.smithi090:> assert(len(files) == 1) 2021-04-09T18:26:30.902 DEBUG:teuthology.orchestra.run.smithi090:> return files[0] 2021-04-09T18:26:30.903 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:26:30.903 DEBUG:teuthology.orchestra.run.smithi090:> for f in files: 2021-04-09T18:26:30.904 DEBUG:teuthology.orchestra.run.smithi090:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:26:30.905 DEBUG:teuthology.orchestra.run.smithi090:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:26:30.905 DEBUG:teuthology.orchestra.run.smithi090:> return f 2021-04-09T18:26:30.905 DEBUG:teuthology.orchestra.run.smithi090:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:26:30.906 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:26:30.906 DEBUG:teuthology.orchestra.run.smithi090:> print(find_socket("client.0")) 2021-04-09T18:26:30.906 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:26:30.986 INFO:teuthology.orchestra.run.smithi090.stdout:/var/run/ceph/ceph-client.0.12996.asok 2021-04-09T18:26:30.987 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.12996.asok 2021-04-09T18:26:30.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:30.989 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.12996.asok status 2021-04-09T18:26:31.142 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2021-04-09T18:26:31.142 INFO:teuthology.orchestra.run.smithi090.stdout: "metadata": { 2021-04-09T18:26:31.142 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:26:31.143 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:26:31.143 INFO:teuthology.orchestra.run.smithi090.stdout: "entity_id": "0", 2021-04-09T18:26:31.143 INFO:teuthology.orchestra.run.smithi090.stdout: "hostname": "smithi090", 2021-04-09T18:26:31.143 INFO:teuthology.orchestra.run.smithi090.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-04-09T18:26:31.144 INFO:teuthology.orchestra.run.smithi090.stdout: "pid": "12996", 2021-04-09T18:26:31.144 INFO:teuthology.orchestra.run.smithi090.stdout: "root": "/" 2021-04-09T18:26:31.144 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:26:31.144 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_count": 0, 2021-04-09T18:26:31.145 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_pinned_count": 0, 2021-04-09T18:26:31.145 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4593, 2021-04-09T18:26:31.145 INFO:teuthology.orchestra.run.smithi090.stdout: "inst": { 2021-04-09T18:26:31.145 INFO:teuthology.orchestra.run.smithi090.stdout: "name": { 2021-04-09T18:26:31.145 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "client", 2021-04-09T18:26:31.146 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4593 2021-04-09T18:26:31.146 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:26:31.146 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:26:31.146 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:26:31.146 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:26:31.147 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 2441326336 2021-04-09T18:26:31.147 INFO:teuthology.orchestra.run.smithi090.stdout: } 2021-04-09T18:26:31.147 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:26:31.147 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:26:31.148 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:26:31.148 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:26:31.148 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 2441326336 2021-04-09T18:26:31.148 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:26:31.149 INFO:teuthology.orchestra.run.smithi090.stdout: "inst_str": "client.4593 172.21.15.90:0/2441326336", 2021-04-09T18:26:31.149 INFO:teuthology.orchestra.run.smithi090.stdout: "addr_str": "172.21.15.90:0/2441326336", 2021-04-09T18:26:31.150 INFO:teuthology.orchestra.run.smithi090.stdout: "inode_count": 1, 2021-04-09T18:26:31.150 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_epoch": 6, 2021-04-09T18:26:31.150 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch": 22, 2021-04-09T18:26:31.151 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:26:31.152 INFO:teuthology.orchestra.run.smithi090.stdout: "blacklisted": false, 2021-04-09T18:26:31.153 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs" 2021-04-09T18:26:31.154 INFO:teuthology.orchestra.run.smithi090.stdout:} 2021-04-09T18:26:31.155 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:31.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.246 7f2e50a6e700 1 Processor -- start 2021-04-09T18:26:31.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.246 7f2e50a6e700 1 -- start start 2021-04-09T18:26:31.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.246 7f2e50a6e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e4c0f5510 0x7f2e4c0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:31.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.246 7f2e50a6e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4c0fbb10 con 0x7f2e4c0e9ad0 2021-04-09T18:26:31.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.246 7f2e50a6e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4c09f900 con 0x7f2e4c1c8000 2021-04-09T18:26:31.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.246 7f2e50a6e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0e9f20 con 0x7f2e4c0f5510 2021-04-09T18:26:31.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.246 7f2e49fe5700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2e4c0e9ad0 0x7f2e4c09f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50850/0 (socket says 172.21.15.79:50850) 2021-04-09T18:26:31.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.246 7f2e49fe5700 1 -- 172.21.15.79:0/2987996533 learned_addr learned my addr 172.21.15.79:0/2987996533 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:31.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.250 7f2e4a7e6700 1 --2- 172.21.15.79:0/2987996533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e4c0f5510 0x7f2e4c0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:31.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.250 7f2e497e4700 1 -- 172.21.15.79:0/2987996533 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2857309927 0 0) 0x7f2e340010d0 con 0x7f2e4c0e9ad0 2021-04-09T18:26:31.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.250 7f2e497e4700 1 -- 172.21.15.79:0/2987996533 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e38003240 con 0x7f2e4c0e9ad0 2021-04-09T18:26:31.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.250 7f2e497e4700 1 -- 172.21.15.79:0/2987996533 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845355516 0 0) 0x7f2e44001450 con 0x7f2e4c1c8000 2021-04-09T18:26:31.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.250 7f2e497e4700 1 -- 172.21.15.79:0/2987996533 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e38003620 con 0x7f2e4c1c8000 2021-04-09T18:26:31.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.250 7f2e4a7e6700 1 -- 172.21.15.79:0/2987996533 >> v1:172.21.15.89:6789/0 conn(0x7f2e4c1c8000 legacy=0x7f2e4c1ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:31.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.250 7f2e4a7e6700 1 -- 172.21.15.79:0/2987996533 >> v1:172.21.15.79:6789/0 conn(0x7f2e4c0e9ad0 legacy=0x7f2e4c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:31.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.250 7f2e4a7e6700 1 -- 172.21.15.79:0/2987996533 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c0e56c0 con 0x7f2e4c0f5510 2021-04-09T18:26:31.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.250 7f2e4a7e6700 1 --2- 172.21.15.79:0/2987996533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e4c0f5510 0x7f2e4c0f64a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f2e3c002f30 tx=0x7f2e3c00bcf0).ready entity=mon.2 client_cookie=a2e1ffc0bb362369 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:31.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.250 7f2e497e4700 1 -- 172.21.15.79:0/2987996533 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2e4c0e56c0 con 0x7f2e4c0f5510 2021-04-09T18:26:31.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.250 7f2e497e4700 1 -- 172.21.15.79:0/2987996533 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c009920 con 0x7f2e4c0f5510 2021-04-09T18:26:31.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.250 7f2e497e4700 1 -- 172.21.15.79:0/2987996533 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2e3c009cf0 con 0x7f2e4c0f5510 2021-04-09T18:26:31.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.250 7f2e50a6e700 1 -- 172.21.15.79:0/2987996533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e4c0f5510 msgr2=0x7f2e4c0f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:31.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.250 7f2e50a6e700 1 --2- 172.21.15.79:0/2987996533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e4c0f5510 0x7f2e4c0f64a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f2e3c002f30 tx=0x7f2e3c00bcf0).stop 2021-04-09T18:26:31.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.250 7f2e50a6e700 1 -- 172.21.15.79:0/2987996533 shutdown_connections 2021-04-09T18:26:31.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.250 7f2e50a6e700 1 --2- 172.21.15.79:0/2987996533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e4c0f5510 0x7f2e4c0f64a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.250 7f2e50a6e700 1 -- 172.21.15.79:0/2987996533 >> 172.21.15.79:0/2987996533 conn(0x7f2e4c0e5fd0 msgr2=0x7f2e4c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:31.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.250 7f2e50a6e700 1 -- 172.21.15.79:0/2987996533 shutdown_connections 2021-04-09T18:26:31.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.250 7f2e50a6e700 1 -- 172.21.15.79:0/2987996533 wait complete. 2021-04-09T18:26:31.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e50a6e700 1 Processor -- start 2021-04-09T18:26:31.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e50a6e700 1 -- start start 2021-04-09T18:26:31.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e50a6e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e4c0902d0 0x7f2e4c090970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:31.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e50a6e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e4c0d89c0 0x7f2e4c0ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:31.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e50a6e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e4c0ada20 0x7f2e4c0914a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:31.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e50a6e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c1c3db0 con 0x7f2e4c0902d0 2021-04-09T18:26:31.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e50a6e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0911a0 con 0x7f2e4c0d89c0 2021-04-09T18:26:31.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e50a6e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0d8e10 con 0x7f2e4c0ada20 2021-04-09T18:26:31.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e4a7e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e4c0902d0 0x7f2e4c090970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:31.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e4a7e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e4c0902d0 0x7f2e4c090970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56148/0 (socket says 172.21.15.79:56148) 2021-04-09T18:26:31.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e4a7e6700 1 -- 172.21.15.79:0/4225911456 learned_addr learned my addr 172.21.15.79:0/4225911456 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:31.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e4afe7700 1 --2- 172.21.15.79:0/4225911456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e4c0ada20 0x7f2e4c0914a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:31.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e49fe5700 1 --2- 172.21.15.79:0/4225911456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e4c0d89c0 0x7f2e4c0ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:31.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e4a7e6700 1 -- 172.21.15.79:0/4225911456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e4c0ada20 msgr2=0x7f2e4c0914a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:31.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e4a7e6700 1 --2- 172.21.15.79:0/4225911456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e4c0ada20 0x7f2e4c0914a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e4a7e6700 1 -- 172.21.15.79:0/4225911456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e4c0d89c0 msgr2=0x7f2e4c0ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:31.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e4a7e6700 1 --2- 172.21.15.79:0/4225911456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e4c0d89c0 0x7f2e4c0ad3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e4a7e6700 1 -- 172.21.15.79:0/4225911456 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c0aec00 con 0x7f2e4c0902d0 2021-04-09T18:26:31.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e4afe7700 1 --2- 172.21.15.79:0/4225911456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e4c0ada20 0x7f2e4c0914a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:31.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e4a7e6700 1 --2- 172.21.15.79:0/4225911456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e4c0902d0 0x7f2e4c090970 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f2e4c0ba990 tx=0x7f2e3c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:31.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e42ffd700 1 -- 172.21.15.79:0/4225911456 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2e4c0aec00 con 0x7f2e4c0902d0 2021-04-09T18:26:31.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e42ffd700 1 -- 172.21.15.79:0/4225911456 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c01d450 con 0x7f2e4c0902d0 2021-04-09T18:26:31.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e42ffd700 1 -- 172.21.15.79:0/4225911456 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2e3c022020 con 0x7f2e4c0902d0 2021-04-09T18:26:31.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e50a6e700 1 -- 172.21.15.79:0/4225911456 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4c091ad0 con 0x7f2e4c0902d0 2021-04-09T18:26:31.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.254 7f2e50a6e700 1 -- 172.21.15.79:0/4225911456 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4c091f50 con 0x7f2e4c0902d0 2021-04-09T18:26:31.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.258 7f2e42ffd700 1 -- 172.21.15.79:0/4225911456 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2e3c01d820 con 0x7f2e4c0902d0 2021-04-09T18:26:31.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.258 7f2e42ffd700 1 --2- 172.21.15.79:0/4225911456 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2e30029100 0x7f2e3002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:31.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.258 7f2e42ffd700 1 -- 172.21.15.79:0/4225911456 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f2e3c03c4f0 con 0x7f2e4c0902d0 2021-04-09T18:26:31.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.258 7f2e49fe5700 1 --2- 172.21.15.79:0/4225911456 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2e30029100 0x7f2e3002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:31.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.258 7f2e49fe5700 1 --2- 172.21.15.79:0/4225911456 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2e30029100 0x7f2e3002b650 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:31.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.262 7f2e50a6e700 1 -- 172.21.15.79:0/4225911456 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4c0e39d0 con 0x7f2e4c0902d0 2021-04-09T18:26:31.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.266 7f2e42ffd700 1 -- 172.21.15.79:0/4225911456 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2e3c009710 con 0x7f2e4c0902d0 2021-04-09T18:26:31.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.430 7f2e50a6e700 1 -- 172.21.15.79:0/4225911456 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e4c0a1cb0 con 0x7f2e4c0902d0 2021-04-09T18:26:31.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.430 7f2e42ffd700 1 -- 172.21.15.79:0/4225911456 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14254 (secure 0 0 0) 0x7f2e3c0387c0 con 0x7f2e4c0902d0 2021-04-09T18:26:31.438 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:31.439 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:14.412296","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:26:09.311735","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:26:12.130710","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:26:31.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.434 7f2e50a6e700 1 -- 172.21.15.79:0/4225911456 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2e30029100 msgr2=0x7f2e3002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:31.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.434 7f2e50a6e700 1 --2- 172.21.15.79:0/4225911456 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2e30029100 0x7f2e3002b650 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.434 7f2e50a6e700 1 -- 172.21.15.79:0/4225911456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e4c0902d0 msgr2=0x7f2e4c090970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.434 7f2e50a6e700 1 --2- 172.21.15.79:0/4225911456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e4c0902d0 0x7f2e4c090970 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f2e4c0ba990 tx=0x7f2e3c006890).stop 2021-04-09T18:26:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.434 7f2e50a6e700 1 -- 172.21.15.79:0/4225911456 shutdown_connections 2021-04-09T18:26:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.434 7f2e50a6e700 1 --2- 172.21.15.79:0/4225911456 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2e30029100 0x7f2e3002b650 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.434 7f2e50a6e700 1 --2- 172.21.15.79:0/4225911456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e4c0ada20 0x7f2e4c0914a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.434 7f2e50a6e700 1 --2- 172.21.15.79:0/4225911456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e4c0902d0 0x7f2e4c090970 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.434 7f2e50a6e700 1 --2- 172.21.15.79:0/4225911456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e4c0d89c0 0x7f2e4c0ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.434 7f2e50a6e700 1 -- 172.21.15.79:0/4225911456 >> 172.21.15.79:0/4225911456 conn(0x7f2e4c0baeb0 msgr2=0x7f2e4c0d51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:31.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.434 7f2e50a6e700 1 -- 172.21.15.79:0/4225911456 shutdown_connections 2021-04-09T18:26:31.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.434 7f2e50a6e700 1 -- 172.21.15.79:0/4225911456 wait complete. 2021-04-09T18:26:31.451 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:26:09.311735', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:26:12.130710', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:26:31.452 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:26:31.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.542 7fe9b7148700 1 Processor -- start 2021-04-09T18:26:31.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.542 7fe9b7148700 1 -- start start 2021-04-09T18:26:31.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.542 7fe9b7148700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe9b00f5550 0x7fe9b00f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:31.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.542 7fe9b7148700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe9b00e9b10 0x7fe9b009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:31.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.542 7fe9b7148700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b00fbb50 con 0x7fe9b01c2de0 2021-04-09T18:26:31.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.542 7fe9b7148700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b00e9f60 con 0x7fe9b00e9b10 2021-04-09T18:26:31.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.542 7fe9b7148700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b00e5a00 con 0x7fe9b00f5550 2021-04-09T18:26:31.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.542 7fe9affff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe9b00e9b10 0x7fe9b009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:31.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.542 7fe9affff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe9b00e9b10 0x7fe9b009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56152/0 (socket says 172.21.15.79:56152) 2021-04-09T18:26:31.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.542 7fe9affff700 1 -- 172.21.15.79:0/650617288 learned_addr learned my addr 172.21.15.79:0/650617288 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:31.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.542 7fe9b4eec700 1 --2- 172.21.15.79:0/650617288 >> v2:172.21.15.89:3300/0 conn(0x7fe9b00f5550 0x7fe9b00f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:31.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.542 7fe9affff700 1 -- 172.21.15.79:0/650617288 >> v2:172.21.15.89:3300/0 conn(0x7fe9b00f5550 msgr2=0x7fe9b00f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:31.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.542 7fe9affff700 1 --2- 172.21.15.79:0/650617288 >> v2:172.21.15.89:3300/0 conn(0x7fe9b00f5550 0x7fe9b00f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.542 7fe9affff700 1 -- 172.21.15.79:0/650617288 >> v1:172.21.15.89:6789/0 conn(0x7fe9b01c2de0 legacy=0x7fe9b01c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:31.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.542 7fe9affff700 1 -- 172.21.15.79:0/650617288 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b00e5700 con 0x7fe9b00e9b10 2021-04-09T18:26:31.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.542 7fe9affff700 1 --2- 172.21.15.79:0/650617288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b00e9b10 0x7fe9b009f110 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fe9a4002f30 tx=0x7fe9a400bd70).ready entity=mon.0 client_cookie=5be4ed8c35bcf4f9 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:31.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.546 7fe9af7fe700 1 -- 172.21.15.79:0/650617288 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe9b00e5700 con 0x7fe9b00e9b10 2021-04-09T18:26:31.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.546 7fe9af7fe700 1 -- 172.21.15.79:0/650617288 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a4009950 con 0x7fe9b00e9b10 2021-04-09T18:26:31.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.546 7fe9af7fe700 1 -- 172.21.15.79:0/650617288 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe9a4009d20 con 0x7fe9b00e9b10 2021-04-09T18:26:31.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.546 7fe9b7148700 1 -- 172.21.15.79:0/650617288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b00e9b10 msgr2=0x7fe9b009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:31.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.546 7fe9b7148700 1 --2- 172.21.15.79:0/650617288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b00e9b10 0x7fe9b009f110 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fe9a4002f30 tx=0x7fe9a400bd70).stop 2021-04-09T18:26:31.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.546 7fe9b7148700 1 -- 172.21.15.79:0/650617288 shutdown_connections 2021-04-09T18:26:31.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.546 7fe9b7148700 1 --2- 172.21.15.79:0/650617288 >> v2:172.21.15.89:3300/0 conn(0x7fe9b00f5550 0x7fe9b00f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.546 7fe9b7148700 1 --2- 172.21.15.79:0/650617288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b00e9b10 0x7fe9b009f110 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.546 7fe9b7148700 1 -- 172.21.15.79:0/650617288 >> 172.21.15.79:0/650617288 conn(0x7fe9b00e6010 msgr2=0x7fe9b00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:31.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.546 7fe9b7148700 1 -- 172.21.15.79:0/650617288 shutdown_connections 2021-04-09T18:26:31.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.546 7fe9b7148700 1 -- 172.21.15.79:0/650617288 wait complete. 2021-04-09T18:26:31.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.550 7fe9b7148700 1 Processor -- start 2021-04-09T18:26:31.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.550 7fe9b7148700 1 -- start start 2021-04-09T18:26:31.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.550 7fe9b7148700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9b00a2c70 0x7fe9b0093fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:31.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.550 7fe9b7148700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b00cde40 0x7fe9b01a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:31.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.550 7fe9b7148700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b00ce290 0x7fe9b01a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:31.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.550 7fe9b7148700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b0088590 con 0x7fe9b00ce290 2021-04-09T18:26:31.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.550 7fe9b7148700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b00d64a0 con 0x7fe9b00a2c70 2021-04-09T18:26:31.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.550 7fe9b7148700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b00a4260 con 0x7fe9b00cde40 2021-04-09T18:26:31.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.550 7fe9b56ed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b00ce290 0x7fe9b01a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:31.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.550 7fe9b56ed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b00ce290 0x7fe9b01a5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56160/0 (socket says 172.21.15.79:56160) 2021-04-09T18:26:31.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.550 7fe9b56ed700 1 -- 172.21.15.79:0/2701712154 learned_addr learned my addr 172.21.15.79:0/2701712154 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:31.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.550 7fe9b4eec700 1 --2- 172.21.15.79:0/2701712154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9b00a2c70 0x7fe9b0093fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:31.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.550 7fe9affff700 1 --2- 172.21.15.79:0/2701712154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b00cde40 0x7fe9b01a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:31.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.550 7fe9b56ed700 1 -- 172.21.15.79:0/2701712154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b00cde40 msgr2=0x7fe9b01a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:31.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.550 7fe9b56ed700 1 --2- 172.21.15.79:0/2701712154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b00cde40 0x7fe9b01a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.550 7fe9b56ed700 1 -- 172.21.15.79:0/2701712154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9b00a2c70 msgr2=0x7fe9b0093fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:31.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.550 7fe9b56ed700 1 --2- 172.21.15.79:0/2701712154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9b00a2c70 0x7fe9b0093fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.550 7fe9b56ed700 1 -- 172.21.15.79:0/2701712154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b00a2490 con 0x7fe9b00ce290 2021-04-09T18:26:31.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.550 7fe9b56ed700 1 --2- 172.21.15.79:0/2701712154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b00ce290 0x7fe9b01a5350 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fe9a8001210 tx=0x7fe9a800ce30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:31.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.554 7fe9ad7fa700 1 -- 172.21.15.79:0/2701712154 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe9b00a2490 con 0x7fe9b00ce290 2021-04-09T18:26:31.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.554 7fe9ad7fa700 1 -- 172.21.15.79:0/2701712154 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a8006870 con 0x7fe9b00ce290 2021-04-09T18:26:31.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.554 7fe9b7148700 1 -- 172.21.15.79:0/2701712154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b00945f0 con 0x7fe9b00ce290 2021-04-09T18:26:31.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.554 7fe9ad7fa700 1 -- 172.21.15.79:0/2701712154 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe9a8006c40 con 0x7fe9b00ce290 2021-04-09T18:26:31.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.554 7fe9b7148700 1 -- 172.21.15.79:0/2701712154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b01a5b10 con 0x7fe9b00ce290 2021-04-09T18:26:31.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.554 7fe9ad7fa700 1 -- 172.21.15.79:0/2701712154 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe9a800a780 con 0x7fe9b00ce290 2021-04-09T18:26:31.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.554 7fe9ad7fa700 1 --2- 172.21.15.79:0/2701712154 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe990029100 0x7fe99002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:31.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.554 7fe9ad7fa700 1 -- 172.21.15.79:0/2701712154 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fe9a8039160 con 0x7fe9b00ce290 2021-04-09T18:26:31.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.554 7fe9b4eec700 1 --2- 172.21.15.79:0/2701712154 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe990029100 0x7fe99002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:31.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.554 7fe9b4eec700 1 --2- 172.21.15.79:0/2701712154 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe990029100 0x7fe99002b650 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:31.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.554 7fe9b7148700 1 -- 172.21.15.79:0/2701712154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b00e39f0 con 0x7fe9b00ce290 2021-04-09T18:26:31.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.562 7fe9ad7fa700 1 -- 172.21.15.79:0/2701712154 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe9a800a570 con 0x7fe9b00ce290 2021-04-09T18:26:31.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.718 7fe9b7148700 1 -- 172.21.15.79:0/2701712154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fe9b00f5b50 con 0x7fe9b00ce290 2021-04-09T18:26:31.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.718 7fe9ad7fa700 1 -- 172.21.15.79:0/2701712154 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe9b00f76f0 con 0x7fe9b00ce290 2021-04-09T18:26:31.725 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:31.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.718 7fe9b7148700 1 -- 172.21.15.79:0/2701712154 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe990029100 msgr2=0x7fe99002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:31.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.718 7fe9b7148700 1 --2- 172.21.15.79:0/2701712154 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe990029100 0x7fe99002b650 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.718 7fe9b7148700 1 -- 172.21.15.79:0/2701712154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b00ce290 msgr2=0x7fe9b01a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:31.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.718 7fe9b7148700 1 --2- 172.21.15.79:0/2701712154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b00ce290 0x7fe9b01a5350 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fe9a8001210 tx=0x7fe9a800ce30).stop 2021-04-09T18:26:31.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.718 7fe9b7148700 1 -- 172.21.15.79:0/2701712154 shutdown_connections 2021-04-09T18:26:31.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.718 7fe9b7148700 1 --2- 172.21.15.79:0/2701712154 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe990029100 0x7fe99002b650 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.718 7fe9b7148700 1 --2- 172.21.15.79:0/2701712154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9b00a2c70 0x7fe9b0093fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.718 7fe9b7148700 1 --2- 172.21.15.79:0/2701712154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b00ce290 0x7fe9b01a5350 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.718 7fe9b7148700 1 --2- 172.21.15.79:0/2701712154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b00cde40 0x7fe9b01a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.718 7fe9b7148700 1 -- 172.21.15.79:0/2701712154 >> 172.21.15.79:0/2701712154 conn(0x7fe9b00d3210 msgr2=0x7fe9b00a77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:31.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.718 7fe9b7148700 1 -- 172.21.15.79:0/2701712154 shutdown_connections 2021-04-09T18:26:31.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.718 7fe9b7148700 1 -- 172.21.15.79:0/2701712154 wait complete. 2021-04-09T18:26:31.737 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:26:31.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.822 7fe9dc2ee700 1 Processor -- start 2021-04-09T18:26:31.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.822 7fe9dc2ee700 1 -- start start 2021-04-09T18:26:31.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9dc2ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9d40f5550 0x7fe9d40f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:31.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9dc2ee700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d40fbb50 con 0x7fe9d40e9b10 2021-04-09T18:26:31.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9dc2ee700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d409f910 con 0x7fe9d41c8040 2021-04-09T18:26:31.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9dc2ee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d40e9f60 con 0x7fe9d40f5550 2021-04-09T18:26:31.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9d9891700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe9d40e9b10 0x7fe9d409f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50878/0 (socket says 172.21.15.79:50878) 2021-04-09T18:26:31.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9d9891700 1 -- 172.21.15.79:0/3462884833 learned_addr learned my addr 172.21.15.79:0/3462884833 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:31.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9da092700 1 --2- 172.21.15.79:0/3462884833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9d40f5550 0x7fe9d40f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:31.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9d9090700 1 -- 172.21.15.79:0/3462884833 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700320362 0 0) 0x7fe9d00010d0 con 0x7fe9d40e9b10 2021-04-09T18:26:31.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9d9090700 1 -- 172.21.15.79:0/3462884833 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9c0003240 con 0x7fe9d40e9b10 2021-04-09T18:26:31.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9d9090700 1 -- 172.21.15.79:0/3462884833 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132688253 0 0) 0x7fe9cc001450 con 0x7fe9d41c8040 2021-04-09T18:26:31.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9d9090700 1 -- 172.21.15.79:0/3462884833 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9c0003620 con 0x7fe9d41c8040 2021-04-09T18:26:31.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9d9090700 1 -- 172.21.15.79:0/3462884833 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3396369214 0 0) 0x7fe9d0001650 con 0x7fe9d40e9b10 2021-04-09T18:26:31.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9da092700 1 -- 172.21.15.79:0/3462884833 >> v1:172.21.15.89:6789/0 conn(0x7fe9d41c8040 legacy=0x7fe9d41ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:31.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9da092700 1 -- 172.21.15.79:0/3462884833 >> v1:172.21.15.79:6789/0 conn(0x7fe9d40e9b10 legacy=0x7fe9d409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:31.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9da092700 1 -- 172.21.15.79:0/3462884833 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d40e5700 con 0x7fe9d40f5550 2021-04-09T18:26:31.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9da092700 1 --2- 172.21.15.79:0/3462884833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9d40f5550 0x7fe9d40f64e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fe9d0001df0 tx=0x7fe9c800bcf0).ready entity=mon.2 client_cookie=d4d79cdbdb9b5668 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:31.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9d9090700 1 -- 172.21.15.79:0/3462884833 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe9d40e5700 con 0x7fe9d40f5550 2021-04-09T18:26:31.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9d9090700 1 -- 172.21.15.79:0/3462884833 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c8009790 con 0x7fe9d40f5550 2021-04-09T18:26:31.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9d9090700 1 -- 172.21.15.79:0/3462884833 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe9d0001bb0 con 0x7fe9d40f5550 2021-04-09T18:26:31.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9dc2ee700 1 -- 172.21.15.79:0/3462884833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9d40f5550 msgr2=0x7fe9d40f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:31.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9dc2ee700 1 --2- 172.21.15.79:0/3462884833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9d40f5550 0x7fe9d40f64e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fe9d0001df0 tx=0x7fe9c800bcf0).stop 2021-04-09T18:26:31.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9dc2ee700 1 -- 172.21.15.79:0/3462884833 shutdown_connections 2021-04-09T18:26:31.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9dc2ee700 1 --2- 172.21.15.79:0/3462884833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9d40f5550 0x7fe9d40f64e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9dc2ee700 1 -- 172.21.15.79:0/3462884833 >> 172.21.15.79:0/3462884833 conn(0x7fe9d40e6010 msgr2=0x7fe9d40e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:31.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9dc2ee700 1 -- 172.21.15.79:0/3462884833 shutdown_connections 2021-04-09T18:26:31.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.826 7fe9dc2ee700 1 -- 172.21.15.79:0/3462884833 wait complete. 2021-04-09T18:26:31.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.830 7fe9dc2ee700 1 Processor -- start 2021-04-09T18:26:31.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.830 7fe9dc2ee700 1 -- start start 2021-04-09T18:26:31.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.830 7fe9dc2ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9d40d8b60 0x7fe9d40b9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:31.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.830 7fe9dc2ee700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d40ae940 0x7fe9d408f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:31.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.830 7fe9dc2ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9d40ad510 0x7fe9d40ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:31.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.830 7fe9dc2ee700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d41c3df0 con 0x7fe9d40d8b60 2021-04-09T18:26:31.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.830 7fe9dc2ee700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d40aed90 con 0x7fe9d40ae940 2021-04-09T18:26:31.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.830 7fe9dc2ee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d408e5e0 con 0x7fe9d40ad510 2021-04-09T18:26:31.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.830 7fe9da092700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9d40d8b60 0x7fe9d40b9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:31.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.830 7fe9da092700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9d40d8b60 0x7fe9d40b9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56172/0 (socket says 172.21.15.79:56172) 2021-04-09T18:26:31.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.830 7fe9da092700 1 -- 172.21.15.79:0/1495599675 learned_addr learned my addr 172.21.15.79:0/1495599675 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:31.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.830 7fe9d9891700 1 --2- 172.21.15.79:0/1495599675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d40ae940 0x7fe9d408f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:31.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.830 7fe9da893700 1 --2- 172.21.15.79:0/1495599675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9d40ad510 0x7fe9d40ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:31.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.830 7fe9da092700 1 -- 172.21.15.79:0/1495599675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9d40ad510 msgr2=0x7fe9d40ad960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:31.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.830 7fe9da092700 1 --2- 172.21.15.79:0/1495599675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9d40ad510 0x7fe9d40ad960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.830 7fe9da092700 1 -- 172.21.15.79:0/1495599675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d40ae940 msgr2=0x7fe9d408f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:31.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.830 7fe9da092700 1 --2- 172.21.15.79:0/1495599675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d40ae940 0x7fe9d408f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:31.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.830 7fe9da092700 1 -- 172.21.15.79:0/1495599675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d40915f0 con 0x7fe9d40d8b60 2021-04-09T18:26:31.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.834 7fe9da092700 1 --2- 172.21.15.79:0/1495599675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9d40d8b60 0x7fe9d40b9c90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fe9d40aef90 tx=0x7fe9c8006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:31.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.834 7fe9c6ffd700 1 -- 172.21.15.79:0/1495599675 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe9d40915f0 con 0x7fe9d40d8b60 2021-04-09T18:26:31.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.834 7fe9c6ffd700 1 -- 172.21.15.79:0/1495599675 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c8009790 con 0x7fe9d40d8b60 2021-04-09T18:26:31.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.834 7fe9c6ffd700 1 -- 172.21.15.79:0/1495599675 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe9c801d450 con 0x7fe9d40d8b60 2021-04-09T18:26:31.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.834 7fe9dc2ee700 1 -- 172.21.15.79:0/1495599675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d4091850 con 0x7fe9d40d8b60 2021-04-09T18:26:31.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.834 7fe9dc2ee700 1 -- 172.21.15.79:0/1495599675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d4091d60 con 0x7fe9d40d8b60 2021-04-09T18:26:31.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.834 7fe9c6ffd700 1 -- 172.21.15.79:0/1495599675 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe9c8018370 con 0x7fe9d40d8b60 2021-04-09T18:26:31.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.834 7fe9c6ffd700 1 --2- 172.21.15.79:0/1495599675 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe9bc029100 0x7fe9bc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:31.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.834 7fe9c6ffd700 1 -- 172.21.15.79:0/1495599675 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fe9c803a920 con 0x7fe9d40d8b60 2021-04-09T18:26:31.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.834 7fe9d9891700 1 --2- 172.21.15.79:0/1495599675 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe9bc029100 0x7fe9bc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:31.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.834 7fe9d9891700 1 --2- 172.21.15.79:0/1495599675 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe9bc029100 0x7fe9bc02b650 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:31.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.838 7fe9dc2ee700 1 -- 172.21.15.79:0/1495599675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d40e39f0 con 0x7fe9d40d8b60 2021-04-09T18:26:31.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:31.846 7fe9c6ffd700 1 -- 172.21.15.79:0/1495599675 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe9c8011dd0 con 0x7fe9d40d8b60 2021-04-09T18:26:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.002 7fe9dc2ee700 1 -- 172.21.15.79:0/1495599675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fe9d40a1c90 con 0x7fe9d40d8b60 2021-04-09T18:26:32.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.002 7fe9c6ffd700 1 -- 172.21.15.79:0/1495599675 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe9c8009580 con 0x7fe9d40d8b60 2021-04-09T18:26:32.012 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:32.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.006 7fe9dc2ee700 1 -- 172.21.15.79:0/1495599675 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe9bc029100 msgr2=0x7fe9bc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:32.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.006 7fe9dc2ee700 1 --2- 172.21.15.79:0/1495599675 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe9bc029100 0x7fe9bc02b650 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.006 7fe9dc2ee700 1 -- 172.21.15.79:0/1495599675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9d40d8b60 msgr2=0x7fe9d40b9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:32.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.006 7fe9dc2ee700 1 --2- 172.21.15.79:0/1495599675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9d40d8b60 0x7fe9d40b9c90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fe9d40aef90 tx=0x7fe9c8006890).stop 2021-04-09T18:26:32.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.006 7fe9dc2ee700 1 -- 172.21.15.79:0/1495599675 shutdown_connections 2021-04-09T18:26:32.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.006 7fe9dc2ee700 1 --2- 172.21.15.79:0/1495599675 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe9bc029100 0x7fe9bc02b650 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.006 7fe9dc2ee700 1 --2- 172.21.15.79:0/1495599675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9d40ad510 0x7fe9d40ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.006 7fe9dc2ee700 1 --2- 172.21.15.79:0/1495599675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9d40d8b60 0x7fe9d40b9c90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.006 7fe9dc2ee700 1 --2- 172.21.15.79:0/1495599675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d40ae940 0x7fe9d408f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.006 7fe9dc2ee700 1 -- 172.21.15.79:0/1495599675 >> 172.21.15.79:0/1495599675 conn(0x7fe9d40d52f0 msgr2=0x7fe9d40bae70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:32.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.006 7fe9dc2ee700 1 -- 172.21.15.79:0/1495599675 shutdown_connections 2021-04-09T18:26:32.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.006 7fe9dc2ee700 1 -- 172.21.15.79:0/1495599675 wait complete. 2021-04-09T18:26:32.023 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:26:32.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.110 7f321d84b700 1 Processor -- start 2021-04-09T18:26:32.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.110 7f321d84b700 1 -- start start 2021-04-09T18:26:32.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f321d84b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32180f5550 0x7f32180f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:32.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f321d84b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32180fbb50 con 0x7f32180e9b10 2021-04-09T18:26:32.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f321d84b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321809f910 con 0x7f32181c8040 2021-04-09T18:26:32.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f321d84b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32180e9f60 con 0x7f32180f5550 2021-04-09T18:26:32.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f3216d4f700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f32180e9b10 0x7f321809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50894/0 (socket says 172.21.15.79:50894) 2021-04-09T18:26:32.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f3216d4f700 1 -- 172.21.15.79:0/2342077225 learned_addr learned my addr 172.21.15.79:0/2342077225 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:32.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f3217550700 1 --2- 172.21.15.79:0/2342077225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32180f5550 0x7f32180f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:32.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f321654e700 1 -- 172.21.15.79:0/2342077225 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692640592 0 0) 0x7f320c0010d0 con 0x7f32180e9b10 2021-04-09T18:26:32.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f321654e700 1 -- 172.21.15.79:0/2342077225 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3200003240 con 0x7f32180e9b10 2021-04-09T18:26:32.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f321654e700 1 -- 172.21.15.79:0/2342077225 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302166433 0 0) 0x7f3210001450 con 0x7f32181c8040 2021-04-09T18:26:32.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f321654e700 1 -- 172.21.15.79:0/2342077225 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3200003620 con 0x7f32181c8040 2021-04-09T18:26:32.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f3217550700 1 -- 172.21.15.79:0/2342077225 >> v1:172.21.15.89:6789/0 conn(0x7f32181c8040 legacy=0x7f32181ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:32.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f3217550700 1 -- 172.21.15.79:0/2342077225 >> v1:172.21.15.79:6789/0 conn(0x7f32180e9b10 legacy=0x7f321809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:32.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f321654e700 1 -- 172.21.15.79:0/2342077225 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1339149107 0 0) 0x7f320c001650 con 0x7f32180e9b10 2021-04-09T18:26:32.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f3217550700 1 -- 172.21.15.79:0/2342077225 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32180e5700 con 0x7f32180f5550 2021-04-09T18:26:32.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f3217550700 1 --2- 172.21.15.79:0/2342077225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32180f5550 0x7f32180f64e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f320c001980 tx=0x7f320800bcf0).ready entity=mon.2 client_cookie=93d464f9eb138172 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:32.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f321654e700 1 -- 172.21.15.79:0/2342077225 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f32180e5700 con 0x7f32180f5550 2021-04-09T18:26:32.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f321654e700 1 -- 172.21.15.79:0/2342077225 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3208009790 con 0x7f32180f5550 2021-04-09T18:26:32.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f321654e700 1 -- 172.21.15.79:0/2342077225 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f320c001bb0 con 0x7f32180f5550 2021-04-09T18:26:32.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f321d84b700 1 -- 172.21.15.79:0/2342077225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32180f5550 msgr2=0x7f32180f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:32.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.114 7f321d84b700 1 --2- 172.21.15.79:0/2342077225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32180f5550 0x7f32180f64e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f320c001980 tx=0x7f320800bcf0).stop 2021-04-09T18:26:32.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.118 7f321d84b700 1 -- 172.21.15.79:0/2342077225 shutdown_connections 2021-04-09T18:26:32.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.118 7f321d84b700 1 --2- 172.21.15.79:0/2342077225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32180f5550 0x7f32180f64e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.118 7f321d84b700 1 -- 172.21.15.79:0/2342077225 >> 172.21.15.79:0/2342077225 conn(0x7f32180e6010 msgr2=0x7f32180e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:32.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.118 7f321d84b700 1 -- 172.21.15.79:0/2342077225 shutdown_connections 2021-04-09T18:26:32.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.118 7f321d84b700 1 -- 172.21.15.79:0/2342077225 wait complete. 2021-04-09T18:26:32.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f321d84b700 1 Processor -- start 2021-04-09T18:26:32.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f321d84b700 1 -- start start 2021-04-09T18:26:32.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f321d84b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32180aa880 0x7f32180aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:32.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f321d84b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32180ab920 0x7f32180abd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:32.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f321d84b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32180ac3a0 0x7f32180b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:32.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f321d84b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32181c3df0 con 0x7f32180ab920 2021-04-09T18:26:32.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f321d84b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32180a9000 con 0x7f32180ac3a0 2021-04-09T18:26:32.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f321d84b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32180a9300 con 0x7f32180aa880 2021-04-09T18:26:32.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f3216d4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32180ab920 0x7f32180abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:32.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f3216d4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32180ab920 0x7f32180abd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56188/0 (socket says 172.21.15.79:56188) 2021-04-09T18:26:32.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f3216d4f700 1 -- 172.21.15.79:0/3582308525 learned_addr learned my addr 172.21.15.79:0/3582308525 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:32.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f3217550700 1 --2- 172.21.15.79:0/3582308525 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32180aa880 0x7f32180aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:32.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f3217d51700 1 --2- 172.21.15.79:0/3582308525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32180ac3a0 0x7f32180b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:32.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f3216d4f700 1 -- 172.21.15.79:0/3582308525 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32180aa880 msgr2=0x7f32180aacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:32.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f3216d4f700 1 --2- 172.21.15.79:0/3582308525 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32180aa880 0x7f32180aacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f3216d4f700 1 -- 172.21.15.79:0/3582308525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32180ac3a0 msgr2=0x7f32180b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:32.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f3216d4f700 1 --2- 172.21.15.79:0/3582308525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32180ac3a0 0x7f32180b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f3216d4f700 1 -- 172.21.15.79:0/3582308525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32180ab300 con 0x7f32180ab920 2021-04-09T18:26:32.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f3217d51700 1 --2- 172.21.15.79:0/3582308525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32180ac3a0 0x7f32180b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:32.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f3216d4f700 1 --2- 172.21.15.79:0/3582308525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32180ab920 0x7f32180abd70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f32180bb540 tx=0x7f320c00cbe0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:32.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f31fffff700 1 -- 172.21.15.79:0/3582308525 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f32180ab300 con 0x7f32180ab920 2021-04-09T18:26:32.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f321d84b700 1 -- 172.21.15.79:0/3582308525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32180a8b90 con 0x7f32180ab920 2021-04-09T18:26:32.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f31fffff700 1 -- 172.21.15.79:0/3582308525 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320c007170 con 0x7f32180ab920 2021-04-09T18:26:32.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f31fffff700 1 -- 172.21.15.79:0/3582308525 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f320c004900 con 0x7f32180ab920 2021-04-09T18:26:32.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.122 7f321d84b700 1 -- 172.21.15.79:0/3582308525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32180b4940 con 0x7f32180ab920 2021-04-09T18:26:32.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.126 7f31fffff700 1 -- 172.21.15.79:0/3582308525 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f320c004b00 con 0x7f32180ab920 2021-04-09T18:26:32.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.126 7f31fffff700 1 --2- 172.21.15.79:0/3582308525 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f31f8029100 0x7f31f802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:32.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.126 7f31fffff700 1 -- 172.21.15.79:0/3582308525 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f320c039000 con 0x7f32180ab920 2021-04-09T18:26:32.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.126 7f3217550700 1 --2- 172.21.15.79:0/3582308525 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f31f8029100 0x7f31f802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:32.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.126 7f3217550700 1 --2- 172.21.15.79:0/3582308525 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f31f8029100 0x7f31f802b650 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:32.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.126 7f321d84b700 1 -- 172.21.15.79:0/3582308525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32180e39f0 con 0x7f32180ab920 2021-04-09T18:26:32.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.130 7f31fffff700 1 -- 172.21.15.79:0/3582308525 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f32180e5cd0 con 0x7f32180ab920 2021-04-09T18:26:32.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.286 7f321d84b700 1 -- 172.21.15.79:0/3582308525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f32180a1c90 con 0x7f32180ab920 2021-04-09T18:26:32.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.286 7f31fffff700 1 -- 172.21.15.79:0/3582308525 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f320c004500 con 0x7f32180ab920 2021-04-09T18:26:32.296 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:32.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.290 7f321d84b700 1 -- 172.21.15.79:0/3582308525 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f31f8029100 msgr2=0x7f31f802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:32.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.290 7f321d84b700 1 --2- 172.21.15.79:0/3582308525 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f31f8029100 0x7f31f802b650 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.290 7f321d84b700 1 -- 172.21.15.79:0/3582308525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32180ab920 msgr2=0x7f32180abd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:32.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.290 7f321d84b700 1 --2- 172.21.15.79:0/3582308525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32180ab920 0x7f32180abd70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f32180bb540 tx=0x7f320c00cbe0).stop 2021-04-09T18:26:32.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.290 7f321d84b700 1 -- 172.21.15.79:0/3582308525 shutdown_connections 2021-04-09T18:26:32.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.290 7f321d84b700 1 --2- 172.21.15.79:0/3582308525 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f31f8029100 0x7f31f802b650 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.290 7f321d84b700 1 --2- 172.21.15.79:0/3582308525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32180ac3a0 0x7f32180b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.290 7f321d84b700 1 --2- 172.21.15.79:0/3582308525 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32180aa880 0x7f32180aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.290 7f321d84b700 1 --2- 172.21.15.79:0/3582308525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32180ab920 0x7f32180abd70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.290 7f321d84b700 1 -- 172.21.15.79:0/3582308525 >> 172.21.15.79:0/3582308525 conn(0x7f32180a3360 msgr2=0x7f321809a910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:32.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.290 7f321d84b700 1 -- 172.21.15.79:0/3582308525 shutdown_connections 2021-04-09T18:26:32.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.290 7f321d84b700 1 -- 172.21.15.79:0/3582308525 wait complete. 2021-04-09T18:26:32.309 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:26:32.310 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:26:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d2d8b3700 1 Processor -- start 2021-04-09T18:26:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d2d8b3700 1 -- start start 2021-04-09T18:26:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d2d8b3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6d280f5510 0x7f6d280f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:32.411 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d2d8b3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6d280e9ad0 0x7f6d2809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:32.411 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d2d8b3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d280fbb10 con 0x7f6d281c2da0 2021-04-09T18:26:32.412 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d2d8b3700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d280e9f20 con 0x7f6d280f5510 2021-04-09T18:26:32.412 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d2d8b3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d280e59c0 con 0x7f6d280e9ad0 2021-04-09T18:26:32.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d27550700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6d280f5510 0x7f6d280f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:32.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d27550700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6d280f5510 0x7f6d280f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56194/0 (socket says 172.21.15.79:56194) 2021-04-09T18:26:32.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d27550700 1 -- 172.21.15.79:0/3793323793 learned_addr learned my addr 172.21.15.79:0/3793323793 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:32.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d27d51700 1 --1- 172.21.15.79:0/3793323793 >> v1:172.21.15.79:6789/0 conn(0x7f6d281c2da0 0x7f6d281c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50908/0 (socket says 172.21.15.79:50908) 2021-04-09T18:26:32.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d26d4f700 1 --2- 172.21.15.79:0/3793323793 >> v2:172.21.15.89:3300/0 conn(0x7f6d280e9ad0 0x7f6d2809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:32.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d27550700 1 -- 172.21.15.79:0/3793323793 >> v2:172.21.15.89:3300/0 conn(0x7f6d280e9ad0 msgr2=0x7f6d2809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:32.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d27550700 1 --2- 172.21.15.79:0/3793323793 >> v2:172.21.15.89:3300/0 conn(0x7f6d280e9ad0 0x7f6d2809f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d27550700 1 -- 172.21.15.79:0/3793323793 >> v1:172.21.15.79:6789/0 conn(0x7f6d281c2da0 legacy=0x7f6d281c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:32.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d27550700 1 -- 172.21.15.79:0/3793323793 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d280e56c0 con 0x7f6d280f5510 2021-04-09T18:26:32.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d26d4f700 1 --2- 172.21.15.79:0/3793323793 >> v2:172.21.15.89:3300/0 conn(0x7f6d280e9ad0 0x7f6d2809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:32.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d27550700 1 --2- 172.21.15.79:0/3793323793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d280f5510 0x7f6d280f64a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f6d180032b0 tx=0x7f6d1800b3c0).ready entity=mon.0 client_cookie=c4428ea54a3f047f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:32.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d2654e700 1 -- 172.21.15.79:0/3793323793 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6d280e56c0 con 0x7f6d280f5510 2021-04-09T18:26:32.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d2654e700 1 -- 172.21.15.79:0/3793323793 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1800bc20 con 0x7f6d280f5510 2021-04-09T18:26:32.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d2654e700 1 -- 172.21.15.79:0/3793323793 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6d18002020 con 0x7f6d280f5510 2021-04-09T18:26:32.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d2d8b3700 1 -- 172.21.15.79:0/3793323793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d280f5510 msgr2=0x7f6d280f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:32.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d2d8b3700 1 --2- 172.21.15.79:0/3793323793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d280f5510 0x7f6d280f64a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f6d180032b0 tx=0x7f6d1800b3c0).stop 2021-04-09T18:26:32.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d2d8b3700 1 -- 172.21.15.79:0/3793323793 shutdown_connections 2021-04-09T18:26:32.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d2d8b3700 1 --2- 172.21.15.79:0/3793323793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d280f5510 0x7f6d280f64a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d2d8b3700 1 --2- 172.21.15.79:0/3793323793 >> v2:172.21.15.89:3300/0 conn(0x7f6d280e9ad0 0x7f6d2809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d2d8b3700 1 -- 172.21.15.79:0/3793323793 >> 172.21.15.79:0/3793323793 conn(0x7f6d280e5fd0 msgr2=0x7f6d280e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:32.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d2d8b3700 1 -- 172.21.15.79:0/3793323793 shutdown_connections 2021-04-09T18:26:32.429 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.398 7f6d2d8b3700 1 -- 172.21.15.79:0/3793323793 wait complete. 2021-04-09T18:26:32.429 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.402 7f6d2d8b3700 1 Processor -- start 2021-04-09T18:26:32.430 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.402 7f6d2d8b3700 1 -- start start 2021-04-09T18:26:32.430 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.402 7f6d2d8b3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d280c19a0 0x7f6d280b70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:32.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.402 7f6d2d8b3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d280c6830 0x7f6d280c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:32.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.402 7f6d2d8b3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d280c72b0 0x7f6d280b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:32.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.402 7f6d2d8b3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d280b79a0 con 0x7f6d280c6830 2021-04-09T18:26:32.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.402 7f6d2d8b3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d280b7ca0 con 0x7f6d280c72b0 2021-04-09T18:26:32.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.402 7f6d2d8b3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d28099680 con 0x7f6d280c19a0 2021-04-09T18:26:32.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.402 7f6d26d4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d280c6830 0x7f6d280c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:32.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.402 7f6d26d4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d280c6830 0x7f6d280c6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56202/0 (socket says 172.21.15.79:56202) 2021-04-09T18:26:32.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.402 7f6d26d4f700 1 -- 172.21.15.79:0/3720701528 learned_addr learned my addr 172.21.15.79:0/3720701528 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:32.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.402 7f6d27d51700 1 --2- 172.21.15.79:0/3720701528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d280c72b0 0x7f6d280b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:32.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.402 7f6d27550700 1 --2- 172.21.15.79:0/3720701528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d280c19a0 0x7f6d280b70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:32.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.406 7f6d26d4f700 1 -- 172.21.15.79:0/3720701528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d280c19a0 msgr2=0x7f6d280b70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:32.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.406 7f6d26d4f700 1 --2- 172.21.15.79:0/3720701528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d280c19a0 0x7f6d280b70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.406 7f6d26d4f700 1 -- 172.21.15.79:0/3720701528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d280c72b0 msgr2=0x7f6d280b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:32.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.406 7f6d26d4f700 1 --2- 172.21.15.79:0/3720701528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d280c72b0 0x7f6d280b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.406 7f6d26d4f700 1 -- 172.21.15.79:0/3720701528 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d28098a90 con 0x7f6d280c6830 2021-04-09T18:26:32.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.406 7f6d26d4f700 1 --2- 172.21.15.79:0/3720701528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d280c6830 0x7f6d280c6c80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6d280874c0 tx=0x7f6d1000df60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:32.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.406 7f6d1ffff700 1 -- 172.21.15.79:0/3720701528 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6d28098a90 con 0x7f6d280c6830 2021-04-09T18:26:32.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.406 7f6d1ffff700 1 -- 172.21.15.79:0/3720701528 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d100099e0 con 0x7f6d280c6830 2021-04-09T18:26:32.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.406 7f6d2d8b3700 1 -- 172.21.15.79:0/3720701528 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d280b6570 con 0x7f6d280c6830 2021-04-09T18:26:32.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.406 7f6d1ffff700 1 -- 172.21.15.79:0/3720701528 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6d1000f040 con 0x7f6d280c6830 2021-04-09T18:26:32.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.406 7f6d2d8b3700 1 -- 172.21.15.79:0/3720701528 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d280b6ad0 con 0x7f6d280c6830 2021-04-09T18:26:32.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.406 7f6d1ffff700 1 -- 172.21.15.79:0/3720701528 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6d10013480 con 0x7f6d280c6830 2021-04-09T18:26:32.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.406 7f6d1ffff700 1 --2- 172.21.15.79:0/3720701528 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6d0c029100 0x7f6d0c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:32.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.406 7f6d1ffff700 1 -- 172.21.15.79:0/3720701528 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f6d10010070 con 0x7f6d280c6830 2021-04-09T18:26:32.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.406 7f6d27550700 1 --2- 172.21.15.79:0/3720701528 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6d0c029100 0x7f6d0c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:32.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.406 7f6d27550700 1 --2- 172.21.15.79:0/3720701528 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6d0c029100 0x7f6d0c02b650 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:32.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.410 7f6d2d8b3700 1 -- 172.21.15.79:0/3720701528 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d280e39d0 con 0x7f6d280c6830 2021-04-09T18:26:32.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.418 7f6d1ffff700 1 -- 172.21.15.79:0/3720701528 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6d100095e0 con 0x7f6d280c6830 2021-04-09T18:26:32.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.590 7f6d2d8b3700 1 -- 172.21.15.79:0/3720701528 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d28098c90 con 0x7f6d280c6830 2021-04-09T18:26:32.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.590 7f6d1ffff700 1 -- 172.21.15.79:0/3720701528 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2097 (secure 0 0 0) 0x7f6d10000bf0 con 0x7f6d280c6830 2021-04-09T18:26:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 6 2021-04-09T18:26:32.601 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:32.601 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1857210510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1857210510},{"type":"v1","addr":"172.21.15.89:6835","nonce":1857210510}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:26:14.412596","modified":"2021-04-09 18:26:22.142731","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4338},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4338":{"gid":4338,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/4138856363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4138856363},{"type":"v1","addr":"172.21.15.79:6833","nonce":4138856363}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:26:32.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.594 7f6d2d8b3700 1 -- 172.21.15.79:0/3720701528 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6d0c029100 msgr2=0x7f6d0c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:32.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.594 7f6d2d8b3700 1 --2- 172.21.15.79:0/3720701528 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6d0c029100 0x7f6d0c02b650 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.594 7f6d2d8b3700 1 -- 172.21.15.79:0/3720701528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d280c6830 msgr2=0x7f6d280c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:32.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.594 7f6d2d8b3700 1 --2- 172.21.15.79:0/3720701528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d280c6830 0x7f6d280c6c80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6d280874c0 tx=0x7f6d1000df60).stop 2021-04-09T18:26:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.598 7f6d2d8b3700 1 -- 172.21.15.79:0/3720701528 shutdown_connections 2021-04-09T18:26:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.598 7f6d2d8b3700 1 --2- 172.21.15.79:0/3720701528 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6d0c029100 0x7f6d0c02b650 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.598 7f6d2d8b3700 1 --2- 172.21.15.79:0/3720701528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d280c72b0 0x7f6d280b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.598 7f6d2d8b3700 1 --2- 172.21.15.79:0/3720701528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d280c19a0 0x7f6d280b70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.598 7f6d2d8b3700 1 --2- 172.21.15.79:0/3720701528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d280c6830 0x7f6d280c6c80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:32.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.598 7f6d2d8b3700 1 -- 172.21.15.79:0/3720701528 >> 172.21.15.79:0/3720701528 conn(0x7f6d280a24b0 msgr2=0x7f6d280d83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:32.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.598 7f6d2d8b3700 1 -- 172.21.15.79:0/3720701528 shutdown_connections 2021-04-09T18:26:32.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:32.598 7f6d2d8b3700 1 -- 172.21.15.79:0/3720701528 wait complete. 2021-04-09T18:26:32.816 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:26:14.412596', 'modified': '2021-04-09 18:26:22.142731', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4338}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4338': {'gid': 4338, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6833/4138856363', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 4138856363}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 4138856363}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:26:32.816 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:26:32.817 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2021-04-09T18:26:32.913 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:26:32.913 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:26:32.913 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2021-04-09T18:26:32.914 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4338, 2021-04-09T18:26:32.914 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2021-04-09T18:26:32.914 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2021-04-09T18:26:32.914 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 11.767458819, 2021-04-09T18:26:32.915 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 6, 2021-04-09T18:26:32.915 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 22, 2021-04-09T18:26:32.915 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 22, 2021-04-09T18:26:32.915 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 16.056744843000001 2021-04-09T18:26:32.915 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:26:32.919 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 4338, "want_state": "up:active", "state": "up:active", "rank_uptime": 11.767458819, "mdsmap_epoch": 6, "osdmap_epoch": 22, "osdmap_epoch_barrier": 22, "uptime": 16.056744843000001 } 2021-04-09T18:26:32.920 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:26:32.920 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-04-09T18:26:32.920 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi136.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-04-09T18:26:32.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:32.921 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:26:32.930 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:26:32.988 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:26:32.989 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:26:33.047 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:26:33.049 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:26:33.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:33.051 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:26:33.100 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:26:33.100 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:26:33.143 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:26:33.159 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:26:33.160 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:26:33.214 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:26:33.215 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:26:33.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:33.216 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:26:33.227 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:2021-04-09 18:26:33.220 7f9b089b30c0 -1 init, newargv = 0x558a9fbf9ae0 newargc=9 2021-04-09T18:26:33.227 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13090]: starting ceph client 2021-04-09T18:26:33.235 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13090]: starting fuse 2021-04-09T18:26:34.333 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:26:34.348 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:26:34.348 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:26:34.402 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:26:34.403 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:26:34.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:34.404 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:26:34.451 INFO:teuthology.orchestra.run.smithi136.stdout:49 2021-04-09T18:26:34.451 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:26:34.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:34.452 DEBUG:teuthology.orchestra.run.smithi136:> sudo python3 -c ' 2021-04-09T18:26:34.452 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2021-04-09T18:26:34.453 DEBUG:teuthology.orchestra.run.smithi136:> import re 2021-04-09T18:26:34.453 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-04-09T18:26:34.453 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2021-04-09T18:26:34.454 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:26:34.454 DEBUG:teuthology.orchestra.run.smithi136:> def find_socket(client_name): 2021-04-09T18:26:34.454 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-04-09T18:26:34.455 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2021-04-09T18:26:34.455 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:26:34.456 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2021-04-09T18:26:34.456 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2021-04-09T18:26:34.456 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2021-04-09T18:26:34.457 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2021-04-09T18:26:34.457 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:26:34.457 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2021-04-09T18:26:34.458 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:26:34.458 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:26:34.458 DEBUG:teuthology.orchestra.run.smithi136:> return f 2021-04-09T18:26:34.459 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:26:34.459 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:26:34.459 DEBUG:teuthology.orchestra.run.smithi136:> print(find_socket("client.1")) 2021-04-09T18:26:34.460 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-04-09T18:26:34.537 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.1.13090.asok 2021-04-09T18:26:34.542 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13090.asok 2021-04-09T18:26:34.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:34.543 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13090.asok status 2021-04-09T18:26:34.677 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2021-04-09T18:26:34.677 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2021-04-09T18:26:34.678 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:26:34.678 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:26:34.678 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "1", 2021-04-09T18:26:34.679 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2021-04-09T18:26:34.679 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-04-09T18:26:34.679 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "13090", 2021-04-09T18:26:34.679 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2021-04-09T18:26:34.679 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:26:34.680 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2021-04-09T18:26:34.680 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2021-04-09T18:26:34.680 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 4642, 2021-04-09T18:26:34.680 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2021-04-09T18:26:34.681 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2021-04-09T18:26:34.681 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2021-04-09T18:26:34.681 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 4642 2021-04-09T18:26:34.681 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:26:34.681 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-04-09T18:26:34.682 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-04-09T18:26:34.682 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-04-09T18:26:34.682 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 3293192867 2021-04-09T18:26:34.682 INFO:teuthology.orchestra.run.smithi136.stdout: } 2021-04-09T18:26:34.682 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:26:34.683 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-04-09T18:26:34.683 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-04-09T18:26:34.683 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-04-09T18:26:34.683 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 3293192867 2021-04-09T18:26:34.683 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:26:34.684 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.4642 172.21.15.136:0/3293192867", 2021-04-09T18:26:34.684 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "172.21.15.136:0/3293192867", 2021-04-09T18:26:34.684 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2021-04-09T18:26:34.685 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 6, 2021-04-09T18:26:34.685 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 22, 2021-04-09T18:26:34.685 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:26:34.685 INFO:teuthology.orchestra.run.smithi136.stdout: "blacklisted": false, 2021-04-09T18:26:34.686 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2021-04-09T18:26:34.686 INFO:teuthology.orchestra.run.smithi136.stdout:} 2021-04-09T18:26:34.704 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:34.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.798 7f6993c04700 1 Processor -- start 2021-04-09T18:26:34.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.798 7f6993c04700 1 -- start start 2021-04-09T18:26:34.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.798 7f6993c04700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f698c0f5510 0x7f698c0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:34.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.798 7f6993c04700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f698c0e9ad0 0x7f698c09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:34.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.798 7f6993c04700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698c0fbb10 con 0x7f698c1c2da0 2021-04-09T18:26:34.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.798 7f6993c04700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698c0e9f20 con 0x7f698c0f5510 2021-04-09T18:26:34.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.798 7f6993c04700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698c0e59c0 con 0x7f698c0e9ad0 2021-04-09T18:26:34.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.798 7f69921a9700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f698c1c2da0 0x7f698c1c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50922/0 (socket says 172.21.15.79:50922) 2021-04-09T18:26:34.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.798 7f69921a9700 1 -- 172.21.15.79:0/1553005179 learned_addr learned my addr 172.21.15.79:0/1553005179 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:34.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.798 7f69919a8700 1 --2- 172.21.15.79:0/1553005179 >> v2:172.21.15.89:3300/0 conn(0x7f698c0f5510 0x7f698c0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:34.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.798 7f69911a7700 1 --2- 172.21.15.79:0/1553005179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f698c0e9ad0 0x7f698c09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:34.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.802 7f69909a6700 1 -- 172.21.15.79:0/1553005179 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165997816 0 0) 0x7f69840010d0 con 0x7f698c1c2da0 2021-04-09T18:26:34.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.802 7f69909a6700 1 -- 172.21.15.79:0/1553005179 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6978003240 con 0x7f698c1c2da0 2021-04-09T18:26:34.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.802 7f69919a8700 1 -- 172.21.15.79:0/1553005179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f698c0e9ad0 msgr2=0x7f698c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:34.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.802 7f69919a8700 1 --2- 172.21.15.79:0/1553005179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f698c0e9ad0 0x7f698c09f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:34.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.802 7f69919a8700 1 -- 172.21.15.79:0/1553005179 >> v1:172.21.15.79:6789/0 conn(0x7f698c1c2da0 legacy=0x7f698c1c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.802 7f69919a8700 1 -- 172.21.15.79:0/1553005179 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698c0e56c0 con 0x7f698c0f5510 2021-04-09T18:26:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.802 7f69911a7700 1 --2- 172.21.15.79:0/1553005179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f698c0e9ad0 0x7f698c09f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.802 7f69919a8700 1 --2- 172.21.15.79:0/1553005179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f698c0f5510 0x7f698c0f64a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f697c002f30 tx=0x7f697c00bd40).ready entity=mon.1 client_cookie=67d3bc6f5ca2f7d4 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.802 7f69909a6700 1 -- 172.21.15.79:0/1553005179 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f698c0e56c0 con 0x7f698c0f5510 2021-04-09T18:26:34.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.802 7f69909a6700 1 -- 172.21.15.79:0/1553005179 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c009850 con 0x7f698c0f5510 2021-04-09T18:26:34.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.802 7f69909a6700 1 -- 172.21.15.79:0/1553005179 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f697c009c20 con 0x7f698c0f5510 2021-04-09T18:26:34.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.802 7f6993c04700 1 -- 172.21.15.79:0/1553005179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f698c0f5510 msgr2=0x7f698c0f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:34.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.802 7f6993c04700 1 --2- 172.21.15.79:0/1553005179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f698c0f5510 0x7f698c0f64a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f697c002f30 tx=0x7f697c00bd40).stop 2021-04-09T18:26:34.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.802 7f6993c04700 1 -- 172.21.15.79:0/1553005179 shutdown_connections 2021-04-09T18:26:34.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.802 7f6993c04700 1 --2- 172.21.15.79:0/1553005179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f698c0f5510 0x7f698c0f64a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:34.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.802 7f6993c04700 1 --2- 172.21.15.79:0/1553005179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f698c0e9ad0 0x7f698c09f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:34.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.802 7f6993c04700 1 -- 172.21.15.79:0/1553005179 >> 172.21.15.79:0/1553005179 conn(0x7f698c0e5fd0 msgr2=0x7f698c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:34.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.802 7f6993c04700 1 -- 172.21.15.79:0/1553005179 shutdown_connections 2021-04-09T18:26:34.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.802 7f6993c04700 1 -- 172.21.15.79:0/1553005179 wait complete. 2021-04-09T18:26:34.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f6993c04700 1 Processor -- start 2021-04-09T18:26:34.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f6993c04700 1 -- start start 2021-04-09T18:26:34.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f6993c04700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f698c1a7cb0 0x7f698c0d2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:34.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f6993c04700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f698c1a8100 0x7f698c0d1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:34.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f6993c04700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f698c0d1660 0x7f698c0adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:34.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f6993c04700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c0ab1a0 con 0x7f698c1a7cb0 2021-04-09T18:26:34.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f6993c04700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c0ab4a0 con 0x7f698c0d1660 2021-04-09T18:26:34.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f6993c04700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698c0aaa30 con 0x7f698c1a8100 2021-04-09T18:26:34.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f69919a8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f698c1a7cb0 0x7f698c0d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:34.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f69919a8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f698c1a7cb0 0x7f698c0d2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56214/0 (socket says 172.21.15.79:56214) 2021-04-09T18:26:34.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f69919a8700 1 -- 172.21.15.79:0/1797630405 learned_addr learned my addr 172.21.15.79:0/1797630405 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:34.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f69911a7700 1 --2- 172.21.15.79:0/1797630405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f698c1a8100 0x7f698c0d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:34.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f69921a9700 1 --2- 172.21.15.79:0/1797630405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f698c0d1660 0x7f698c0adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:34.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f69919a8700 1 -- 172.21.15.79:0/1797630405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f698c1a8100 msgr2=0x7f698c0d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:34.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f69919a8700 1 --2- 172.21.15.79:0/1797630405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f698c1a8100 0x7f698c0d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:34.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f69919a8700 1 -- 172.21.15.79:0/1797630405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f698c0d1660 msgr2=0x7f698c0adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:34.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f69919a8700 1 --2- 172.21.15.79:0/1797630405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f698c0d1660 0x7f698c0adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:34.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f69919a8700 1 -- 172.21.15.79:0/1797630405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698c0d2a60 con 0x7f698c1a7cb0 2021-04-09T18:26:34.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f69919a8700 1 --2- 172.21.15.79:0/1797630405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f698c1a7cb0 0x7f698c0d2100 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f698c0bab10 tx=0x7f697c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:34.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f698a7fc700 1 -- 172.21.15.79:0/1797630405 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f697c011a10 con 0x7f698c1a7cb0 2021-04-09T18:26:34.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f698a7fc700 1 -- 172.21.15.79:0/1797630405 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c011c10 con 0x7f698c1a7cb0 2021-04-09T18:26:34.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f698a7fc700 1 -- 172.21.15.79:0/1797630405 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f697c01d440 con 0x7f698c1a7cb0 2021-04-09T18:26:34.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f6993c04700 1 -- 172.21.15.79:0/1797630405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698c0d2730 con 0x7f698c1a7cb0 2021-04-09T18:26:34.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.806 7f6993c04700 1 -- 172.21.15.79:0/1797630405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698c0ae450 con 0x7f698c1a7cb0 2021-04-09T18:26:34.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.810 7f698a7fc700 1 -- 172.21.15.79:0/1797630405 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f697c01d640 con 0x7f698c1a7cb0 2021-04-09T18:26:34.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.810 7f698a7fc700 1 --2- 172.21.15.79:0/1797630405 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6970029100 0x7f697002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:34.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.810 7f698a7fc700 1 -- 172.21.15.79:0/1797630405 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f697c03b440 con 0x7f698c1a7cb0 2021-04-09T18:26:34.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.810 7f69911a7700 1 --2- 172.21.15.79:0/1797630405 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6970029100 0x7f697002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:34.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.810 7f69911a7700 1 --2- 172.21.15.79:0/1797630405 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6970029100 0x7f697002b650 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:34.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.814 7f6993c04700 1 -- 172.21.15.79:0/1797630405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698c0e39d0 con 0x7f698c1a7cb0 2021-04-09T18:26:34.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.822 7f698a7fc700 1 -- 172.21.15.79:0/1797630405 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f697c009640 con 0x7f698c1a7cb0 2021-04-09T18:26:34.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.982 7f6993c04700 1 -- 172.21.15.79:0/1797630405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f698c0f5b10 con 0x7f698c1a7cb0 2021-04-09T18:26:34.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.986 7f698a7fc700 1 -- 172.21.15.79:0/1797630405 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14254 (secure 0 0 0) 0x7f697c0377c0 con 0x7f698c1a7cb0 2021-04-09T18:26:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:34.996 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:14.412296","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:26:09.311735","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:26:12.130710","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:26:34.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.990 7f6993c04700 1 -- 172.21.15.79:0/1797630405 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6970029100 msgr2=0x7f697002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:34.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.990 7f6993c04700 1 --2- 172.21.15.79:0/1797630405 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6970029100 0x7f697002b650 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:34.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.990 7f6993c04700 1 -- 172.21.15.79:0/1797630405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f698c1a7cb0 msgr2=0x7f698c0d2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:34.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.990 7f6993c04700 1 --2- 172.21.15.79:0/1797630405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f698c1a7cb0 0x7f698c0d2100 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f698c0bab10 tx=0x7f697c006890).stop 2021-04-09T18:26:34.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.990 7f6993c04700 1 -- 172.21.15.79:0/1797630405 shutdown_connections 2021-04-09T18:26:34.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.990 7f6993c04700 1 --2- 172.21.15.79:0/1797630405 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6970029100 0x7f697002b650 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:34.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.990 7f6993c04700 1 --2- 172.21.15.79:0/1797630405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f698c0d1660 0x7f698c0adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:34.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.990 7f6993c04700 1 --2- 172.21.15.79:0/1797630405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f698c1a7cb0 0x7f698c0d2100 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.990 7f6993c04700 1 --2- 172.21.15.79:0/1797630405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f698c1a8100 0x7f698c0d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.990 7f6993c04700 1 -- 172.21.15.79:0/1797630405 >> 172.21.15.79:0/1797630405 conn(0x7f698c0bb030 msgr2=0x7f698c0d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:35.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.990 7f6993c04700 1 -- 172.21.15.79:0/1797630405 shutdown_connections 2021-04-09T18:26:35.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:34.990 7f6993c04700 1 -- 172.21.15.79:0/1797630405 wait complete. 2021-04-09T18:26:35.008 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:26:09.311735', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:26:12.130710', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:26:35.009 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:26:35.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efef1619700 1 Processor -- start 2021-04-09T18:26:35.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efef1619700 1 -- start start 2021-04-09T18:26:35.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efef1619700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeec0f5550 0x7efeec0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efef1619700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efeec0e9b10 0x7efeec09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efef1619700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeec0fbb50 con 0x7efeec1c2de0 2021-04-09T18:26:35.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efef1619700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeec0e9f60 con 0x7efeec0e9b10 2021-04-09T18:26:35.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efef1619700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec0e5a00 con 0x7efeec0f5550 2021-04-09T18:26:35.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efeeba48700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7efeec1c2de0 0x7efeec1c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50936/0 (socket says 172.21.15.79:50936) 2021-04-09T18:26:35.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efeeba48700 1 -- 172.21.15.79:0/74054025 learned_addr learned my addr 172.21.15.79:0/74054025 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:35.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efeeaa46700 1 --2- 172.21.15.79:0/74054025 >> v2:172.21.15.89:3300/0 conn(0x7efeec0e9b10 0x7efeec09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efeeb247700 1 --2- 172.21.15.79:0/74054025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeec0f5550 0x7efeec0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efeea245700 1 -- 172.21.15.79:0/74054025 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113627132 0 0) 0x7efee40010d0 con 0x7efeec1c2de0 2021-04-09T18:26:35.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efeea245700 1 -- 172.21.15.79:0/74054025 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efecc003240 con 0x7efeec1c2de0 2021-04-09T18:26:35.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efeeaa46700 1 -- 172.21.15.79:0/74054025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeec0f5550 msgr2=0x7efeec0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:35.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efeeaa46700 1 --2- 172.21.15.79:0/74054025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeec0f5550 0x7efeec0f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efeeaa46700 1 -- 172.21.15.79:0/74054025 >> v1:172.21.15.79:6789/0 conn(0x7efeec1c2de0 legacy=0x7efeec1c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efeeaa46700 1 -- 172.21.15.79:0/74054025 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec0e5700 con 0x7efeec0e9b10 2021-04-09T18:26:35.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efeeb247700 1 --2- 172.21.15.79:0/74054025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeec0f5550 0x7efeec0f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:35.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efeeaa46700 1 --2- 172.21.15.79:0/74054025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efeec0e9b10 0x7efeec09f110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7efed40032b0 tx=0x7efed400b3c0).ready entity=mon.1 client_cookie=4e48eceaf25213d4 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:35.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efeea245700 1 -- 172.21.15.79:0/74054025 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efeec0e5700 con 0x7efeec0e9b10 2021-04-09T18:26:35.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efeea245700 1 -- 172.21.15.79:0/74054025 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed400bc20 con 0x7efeec0e9b10 2021-04-09T18:26:35.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efeea245700 1 -- 172.21.15.79:0/74054025 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efed4002020 con 0x7efeec0e9b10 2021-04-09T18:26:35.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efef1619700 1 -- 172.21.15.79:0/74054025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efeec0e9b10 msgr2=0x7efeec09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efef1619700 1 --2- 172.21.15.79:0/74054025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efeec0e9b10 0x7efeec09f110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7efed40032b0 tx=0x7efed400b3c0).stop 2021-04-09T18:26:35.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efef1619700 1 -- 172.21.15.79:0/74054025 shutdown_connections 2021-04-09T18:26:35.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efef1619700 1 --2- 172.21.15.79:0/74054025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeec0f5550 0x7efeec0f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efef1619700 1 --2- 172.21.15.79:0/74054025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efeec0e9b10 0x7efeec09f110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efef1619700 1 -- 172.21.15.79:0/74054025 >> 172.21.15.79:0/74054025 conn(0x7efeec0e6010 msgr2=0x7efeec0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:35.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efef1619700 1 -- 172.21.15.79:0/74054025 shutdown_connections 2021-04-09T18:26:35.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.098 7efef1619700 1 -- 172.21.15.79:0/74054025 wait complete. 2021-04-09T18:26:35.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.102 7efef1619700 1 Processor -- start 2021-04-09T18:26:35.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.102 7efef1619700 1 -- start start 2021-04-09T18:26:35.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.102 7efef1619700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efeec090230 0x7efeec091a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.102 7efef1619700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeec0aeaa0 0x7efeec0aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.102 7efef1619700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efeec0ad6b0 0x7efeec0adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.102 7efef1619700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec091720 con 0x7efeec0ad6b0 2021-04-09T18:26:35.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.102 7efef1619700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec0ba490 con 0x7efeec090230 2021-04-09T18:26:35.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.102 7efef1619700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec08fb10 con 0x7efeec0aeaa0 2021-04-09T18:26:35.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.102 7efeeba48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efeec0ad6b0 0x7efeec0adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.102 7efeeba48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efeec0ad6b0 0x7efeec0adb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56232/0 (socket says 172.21.15.79:56232) 2021-04-09T18:26:35.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.102 7efeeba48700 1 -- 172.21.15.79:0/3574183148 learned_addr learned my addr 172.21.15.79:0/3574183148 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:35.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.102 7efeeaa46700 1 --2- 172.21.15.79:0/3574183148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeec0aeaa0 0x7efeec0aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.102 7efeeb247700 1 --2- 172.21.15.79:0/3574183148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efeec090230 0x7efeec091a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.102 7efeeba48700 1 -- 172.21.15.79:0/3574183148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeec0aeaa0 msgr2=0x7efeec0aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.102 7efeeba48700 1 --2- 172.21.15.79:0/3574183148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeec0aeaa0 0x7efeec0aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.102 7efeeba48700 1 -- 172.21.15.79:0/3574183148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efeec090230 msgr2=0x7efeec091a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.102 7efeeba48700 1 --2- 172.21.15.79:0/3574183148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efeec090230 0x7efeec091a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.102 7efeeba48700 1 -- 172.21.15.79:0/3574183148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec092050 con 0x7efeec0ad6b0 2021-04-09T18:26:35.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.102 7efeeba48700 1 --2- 172.21.15.79:0/3574183148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efeec0ad6b0 0x7efeec0adb00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7efee4000b80 tx=0x7efee400cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:35.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.106 7efee3fff700 1 -- 172.21.15.79:0/3574183148 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efeec092050 con 0x7efeec0ad6b0 2021-04-09T18:26:35.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.106 7efef1619700 1 -- 172.21.15.79:0/3574183148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeec090680 con 0x7efeec0ad6b0 2021-04-09T18:26:35.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.106 7efee3fff700 1 -- 172.21.15.79:0/3574183148 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee40072e0 con 0x7efeec0ad6b0 2021-04-09T18:26:35.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.106 7efee3fff700 1 -- 172.21.15.79:0/3574183148 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efee40057e0 con 0x7efeec0ad6b0 2021-04-09T18:26:35.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.106 7efef1619700 1 -- 172.21.15.79:0/3574183148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeec0af7b0 con 0x7efeec0ad6b0 2021-04-09T18:26:35.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.106 7efee3fff700 1 -- 172.21.15.79:0/3574183148 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7efee401b070 con 0x7efeec0ad6b0 2021-04-09T18:26:35.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.106 7efee3fff700 1 --2- 172.21.15.79:0/3574183148 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efec4029100 0x7efec402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.106 7efee3fff700 1 -- 172.21.15.79:0/3574183148 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7efee4038ae0 con 0x7efeec0ad6b0 2021-04-09T18:26:35.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.106 7efeeb247700 1 --2- 172.21.15.79:0/3574183148 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efec4029100 0x7efec402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.106 7efeeb247700 1 --2- 172.21.15.79:0/3574183148 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efec4029100 0x7efec402b650 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:35.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.110 7efef1619700 1 -- 172.21.15.79:0/3574183148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeec0e39f0 con 0x7efeec0ad6b0 2021-04-09T18:26:35.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.118 7efee3fff700 1 -- 172.21.15.79:0/3574183148 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7efee40070d0 con 0x7efeec0ad6b0 2021-04-09T18:26:35.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.278 7efef1619700 1 -- 172.21.15.79:0/3574183148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7efeec0f5b50 con 0x7efeec0ad6b0 2021-04-09T18:26:35.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.282 7efee3fff700 1 -- 172.21.15.79:0/3574183148 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7efeec0f76f0 con 0x7efeec0ad6b0 2021-04-09T18:26:35.288 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.282 7efef1619700 1 -- 172.21.15.79:0/3574183148 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efec4029100 msgr2=0x7efec402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.282 7efef1619700 1 --2- 172.21.15.79:0/3574183148 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efec4029100 0x7efec402b650 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.282 7efef1619700 1 -- 172.21.15.79:0/3574183148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efeec0ad6b0 msgr2=0x7efeec0adb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.282 7efef1619700 1 --2- 172.21.15.79:0/3574183148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efeec0ad6b0 0x7efeec0adb00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7efee4000b80 tx=0x7efee400cab0).stop 2021-04-09T18:26:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.282 7efef1619700 1 -- 172.21.15.79:0/3574183148 shutdown_connections 2021-04-09T18:26:35.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.282 7efef1619700 1 --2- 172.21.15.79:0/3574183148 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efec4029100 0x7efec402b650 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.282 7efef1619700 1 --2- 172.21.15.79:0/3574183148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efeec090230 0x7efeec091a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.282 7efef1619700 1 --2- 172.21.15.79:0/3574183148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efeec0ad6b0 0x7efeec0adb00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.282 7efef1619700 1 --2- 172.21.15.79:0/3574183148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeec0aeaa0 0x7efeec0aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.282 7efef1619700 1 -- 172.21.15.79:0/3574183148 >> 172.21.15.79:0/3574183148 conn(0x7efeec0d8b60 msgr2=0x7efeec0d4140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:35.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.282 7efef1619700 1 -- 172.21.15.79:0/3574183148 shutdown_connections 2021-04-09T18:26:35.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.282 7efef1619700 1 -- 172.21.15.79:0/3574183148 wait complete. 2021-04-09T18:26:35.300 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:26:35.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f07642ed700 1 Processor -- start 2021-04-09T18:26:35.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f07642ed700 1 -- start start 2021-04-09T18:26:35.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f07642ed700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f075c0f5550 0x7f075c0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f07642ed700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f075c1c8040 0x7f075c1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f07642ed700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075c0fbb50 con 0x7f075c0e9b10 2021-04-09T18:26:35.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f07642ed700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075c0e9f60 con 0x7f075c0f5550 2021-04-09T18:26:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f07642ed700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075c1c3df0 con 0x7f075c1c8040 2021-04-09T18:26:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f0762091700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f075c0f5550 0x7f075c0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f0762091700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f075c0f5550 0x7f075c0f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56236/0 (socket says 172.21.15.79:56236) 2021-04-09T18:26:35.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f0762091700 1 -- 172.21.15.79:0/2709107655 learned_addr learned my addr 172.21.15.79:0/2709107655 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:35.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f0762892700 1 --2- 172.21.15.79:0/2709107655 >> v2:172.21.15.89:3300/0 conn(0x7f075c1c8040 0x7f075c1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f0762091700 1 -- 172.21.15.79:0/2709107655 >> v2:172.21.15.89:3300/0 conn(0x7f075c1c8040 msgr2=0x7f075c1ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:35.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f0762091700 1 --2- 172.21.15.79:0/2709107655 >> v2:172.21.15.89:3300/0 conn(0x7f075c1c8040 0x7f075c1ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f0762091700 1 -- 172.21.15.79:0/2709107655 >> v1:172.21.15.89:6789/0 conn(0x7f075c0e9b10 legacy=0x7f075c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f0762091700 1 -- 172.21.15.79:0/2709107655 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c09f910 con 0x7f075c0f5550 2021-04-09T18:26:35.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f0762892700 1 --2- 172.21.15.79:0/2709107655 >> v2:172.21.15.89:3300/0 conn(0x7f075c1c8040 0x7f075c1ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:35.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f0762091700 1 --2- 172.21.15.79:0/2709107655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075c0f5550 0x7f075c0f64e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f0758002f30 tx=0x7f075800bd70).ready entity=mon.0 client_cookie=2a21f90f104559da server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:35.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f076108f700 1 -- 172.21.15.79:0/2709107655 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f075c09f910 con 0x7f075c0f5550 2021-04-09T18:26:35.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f076108f700 1 -- 172.21.15.79:0/2709107655 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0758009950 con 0x7f075c0f5550 2021-04-09T18:26:35.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f076108f700 1 -- 172.21.15.79:0/2709107655 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0758009d20 con 0x7f075c0f5550 2021-04-09T18:26:35.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f07642ed700 1 -- 172.21.15.79:0/2709107655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075c0f5550 msgr2=0x7f075c0f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.386 7f07642ed700 1 --2- 172.21.15.79:0/2709107655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075c0f5550 0x7f075c0f64e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f0758002f30 tx=0x7f075800bd70).stop 2021-04-09T18:26:35.410 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.390 7f07642ed700 1 -- 172.21.15.79:0/2709107655 shutdown_connections 2021-04-09T18:26:35.410 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.390 7f07642ed700 1 --2- 172.21.15.79:0/2709107655 >> v2:172.21.15.89:3300/0 conn(0x7f075c1c8040 0x7f075c1ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.410 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.390 7f07642ed700 1 --2- 172.21.15.79:0/2709107655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075c0f5550 0x7f075c0f64e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.411 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.390 7f07642ed700 1 -- 172.21.15.79:0/2709107655 >> 172.21.15.79:0/2709107655 conn(0x7f075c0e6010 msgr2=0x7f075c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:35.411 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.390 7f07642ed700 1 -- 172.21.15.79:0/2709107655 shutdown_connections 2021-04-09T18:26:35.412 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.390 7f07642ed700 1 -- 172.21.15.79:0/2709107655 wait complete. 2021-04-09T18:26:35.412 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f07642ed700 1 Processor -- start 2021-04-09T18:26:35.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f07642ed700 1 -- start start 2021-04-09T18:26:35.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f07642ed700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f075c0d33f0 0x7f075c0d3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f07642ed700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f075c0bba70 0x7f075c0bbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f07642ed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075c0a7b60 0x7f075c0a7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f07642ed700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c0bd560 con 0x7f075c0a7b60 2021-04-09T18:26:35.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f07642ed700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c0bd860 con 0x7f075c0d33f0 2021-04-09T18:26:35.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f07642ed700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075c0bd0f0 con 0x7f075c0bba70 2021-04-09T18:26:35.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f0762892700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075c0a7b60 0x7f075c0a7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f0762892700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075c0a7b60 0x7f075c0a7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56246/0 (socket says 172.21.15.79:56246) 2021-04-09T18:26:35.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f0762892700 1 -- 172.21.15.79:0/302742705 learned_addr learned my addr 172.21.15.79:0/302742705 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:35.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f0762091700 1 --2- 172.21.15.79:0/302742705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f075c0d33f0 0x7f075c0d3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f0761890700 1 --2- 172.21.15.79:0/302742705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f075c0bba70 0x7f075c0bbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f0762892700 1 -- 172.21.15.79:0/302742705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f075c0bba70 msgr2=0x7f075c0bbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f0762892700 1 --2- 172.21.15.79:0/302742705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f075c0bba70 0x7f075c0bbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f0762892700 1 -- 172.21.15.79:0/302742705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f075c0d33f0 msgr2=0x7f075c0d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f0762892700 1 --2- 172.21.15.79:0/302742705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f075c0d33f0 0x7f075c0d3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f0762892700 1 -- 172.21.15.79:0/302742705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c0bc4f0 con 0x7f075c0a7b60 2021-04-09T18:26:35.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f0762091700 1 --2- 172.21.15.79:0/302742705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f075c0d33f0 0x7f075c0d3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:35.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f0762892700 1 --2- 172.21.15.79:0/302742705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075c0a7b60 0x7f075c0a7fb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f0754006de0 tx=0x7f075400c3d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:35.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f0752ffd700 1 -- 172.21.15.79:0/302742705 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f075c0bc4f0 con 0x7f075c0a7b60 2021-04-09T18:26:35.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f0752ffd700 1 -- 172.21.15.79:0/302742705 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075400cb50 con 0x7f075c0a7b60 2021-04-09T18:26:35.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f0752ffd700 1 -- 172.21.15.79:0/302742705 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0754013430 con 0x7f075c0a7b60 2021-04-09T18:26:35.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f07642ed700 1 -- 172.21.15.79:0/302742705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075c0a85e0 con 0x7f075c0a7b60 2021-04-09T18:26:35.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.394 7f07642ed700 1 -- 172.21.15.79:0/302742705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075c0a8af0 con 0x7f075c0a7b60 2021-04-09T18:26:35.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.398 7f0752ffd700 1 -- 172.21.15.79:0/302742705 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0754013630 con 0x7f075c0a7b60 2021-04-09T18:26:35.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.398 7f0752ffd700 1 --2- 172.21.15.79:0/302742705 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0744029100 0x7f074402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.398 7f0752ffd700 1 -- 172.21.15.79:0/302742705 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f0754039b90 con 0x7f075c0a7b60 2021-04-09T18:26:35.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.398 7f0762091700 1 --2- 172.21.15.79:0/302742705 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0744029100 0x7f074402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.398 7f0762091700 1 --2- 172.21.15.79:0/302742705 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0744029100 0x7f074402b650 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:35.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.398 7f07642ed700 1 -- 172.21.15.79:0/302742705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075c0e39f0 con 0x7f075c0a7b60 2021-04-09T18:26:35.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.402 7f0752ffd700 1 -- 172.21.15.79:0/302742705 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0754010040 con 0x7f075c0a7b60 2021-04-09T18:26:35.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.558 7f07642ed700 1 -- 172.21.15.79:0/302742705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f075c0aa870 con 0x7f075c0a7b60 2021-04-09T18:26:35.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.558 7f0752ffd700 1 -- 172.21.15.79:0/302742705 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7f075c0f76f0 con 0x7f075c0a7b60 2021-04-09T18:26:35.565 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:35.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.558 7f07642ed700 1 -- 172.21.15.79:0/302742705 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0744029100 msgr2=0x7f074402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.558 7f07642ed700 1 --2- 172.21.15.79:0/302742705 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0744029100 0x7f074402b650 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.558 7f07642ed700 1 -- 172.21.15.79:0/302742705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075c0a7b60 msgr2=0x7f075c0a7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.558 7f07642ed700 1 --2- 172.21.15.79:0/302742705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075c0a7b60 0x7f075c0a7fb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f0754006de0 tx=0x7f075400c3d0).stop 2021-04-09T18:26:35.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.558 7f07642ed700 1 -- 172.21.15.79:0/302742705 shutdown_connections 2021-04-09T18:26:35.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.558 7f07642ed700 1 --2- 172.21.15.79:0/302742705 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0744029100 0x7f074402b650 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.558 7f07642ed700 1 --2- 172.21.15.79:0/302742705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f075c0d33f0 0x7f075c0d3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.558 7f07642ed700 1 --2- 172.21.15.79:0/302742705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075c0a7b60 0x7f075c0a7fb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.558 7f07642ed700 1 --2- 172.21.15.79:0/302742705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f075c0bba70 0x7f075c0bbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.558 7f07642ed700 1 -- 172.21.15.79:0/302742705 >> 172.21.15.79:0/302742705 conn(0x7f075c0901f0 msgr2=0x7f075c094730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:35.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.562 7f07642ed700 1 -- 172.21.15.79:0/302742705 shutdown_connections 2021-04-09T18:26:35.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.562 7f07642ed700 1 -- 172.21.15.79:0/302742705 wait complete. 2021-04-09T18:26:35.577 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:26:35.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.662 7f7436102700 1 Processor -- start 2021-04-09T18:26:35.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.662 7f7436102700 1 -- start start 2021-04-09T18:26:35.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f7436102700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f74300f5550 0x7f74300f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f7436102700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f74300e9b10 0x7f743009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f7436102700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74300fbb50 con 0x7f74301c2de0 2021-04-09T18:26:35.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f7436102700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74300e9f60 con 0x7f74300e9b10 2021-04-09T18:26:35.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f7436102700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74300e5a00 con 0x7f74300f5550 2021-04-09T18:26:35.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f742effd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f74300e9b10 0x7f743009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f742effd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f74300e9b10 0x7f743009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56252/0 (socket says 172.21.15.79:56252) 2021-04-09T18:26:35.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f742effd700 1 -- 172.21.15.79:0/2442836205 learned_addr learned my addr 172.21.15.79:0/2442836205 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:35.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f742ffff700 1 --1- 172.21.15.79:0/2442836205 >> v1:172.21.15.79:6789/0 conn(0x7f74301c2de0 0x7f74301c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50964/0 (socket says 172.21.15.79:50964) 2021-04-09T18:26:35.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f742f7fe700 1 --2- 172.21.15.79:0/2442836205 >> v2:172.21.15.89:3300/0 conn(0x7f74300f5550 0x7f74300f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f742effd700 1 -- 172.21.15.79:0/2442836205 >> v2:172.21.15.89:3300/0 conn(0x7f74300f5550 msgr2=0x7f74300f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:35.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f742effd700 1 --2- 172.21.15.79:0/2442836205 >> v2:172.21.15.89:3300/0 conn(0x7f74300f5550 0x7f74300f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f742effd700 1 -- 172.21.15.79:0/2442836205 >> v1:172.21.15.79:6789/0 conn(0x7f74301c2de0 legacy=0x7f74301c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f742effd700 1 -- 172.21.15.79:0/2442836205 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74300e5700 con 0x7f74300e9b10 2021-04-09T18:26:35.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f742effd700 1 --2- 172.21.15.79:0/2442836205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74300e9b10 0x7f743009f110 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f7418002f30 tx=0x7f741800bd70).ready entity=mon.0 client_cookie=d70548a15bb5103b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:35.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f742e7fc700 1 -- 172.21.15.79:0/2442836205 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f74300e5700 con 0x7f74300e9b10 2021-04-09T18:26:35.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f742e7fc700 1 -- 172.21.15.79:0/2442836205 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7418009950 con 0x7f74300e9b10 2021-04-09T18:26:35.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f742e7fc700 1 -- 172.21.15.79:0/2442836205 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7418009d20 con 0x7f74300e9b10 2021-04-09T18:26:35.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f7436102700 1 -- 172.21.15.79:0/2442836205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74300e9b10 msgr2=0x7f743009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f7436102700 1 --2- 172.21.15.79:0/2442836205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74300e9b10 0x7f743009f110 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f7418002f30 tx=0x7f741800bd70).stop 2021-04-09T18:26:35.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f7436102700 1 -- 172.21.15.79:0/2442836205 shutdown_connections 2021-04-09T18:26:35.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f7436102700 1 --2- 172.21.15.79:0/2442836205 >> v2:172.21.15.89:3300/0 conn(0x7f74300f5550 0x7f74300f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f7436102700 1 --2- 172.21.15.79:0/2442836205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74300e9b10 0x7f743009f110 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f7436102700 1 -- 172.21.15.79:0/2442836205 >> 172.21.15.79:0/2442836205 conn(0x7f74300e6010 msgr2=0x7f74300e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:35.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f7436102700 1 -- 172.21.15.79:0/2442836205 shutdown_connections 2021-04-09T18:26:35.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.666 7f7436102700 1 -- 172.21.15.79:0/2442836205 wait complete. 2021-04-09T18:26:35.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.670 7f7436102700 1 Processor -- start 2021-04-09T18:26:35.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.670 7f7436102700 1 -- start start 2021-04-09T18:26:35.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.670 7f7436102700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74300d6960 0x7f74300b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.670 7f7436102700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74300d4320 0x7f7430093ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.670 7f7436102700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7430094510 0x7f7430099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.670 7f7436102700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74300d50c0 con 0x7f74300d4320 2021-04-09T18:26:35.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.670 7f7436102700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74300d4770 con 0x7f74300d6960 2021-04-09T18:26:35.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.670 7f7436102700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74300d53c0 con 0x7f7430094510 2021-04-09T18:26:35.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f742effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74300d4320 0x7f7430093ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f742effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74300d4320 0x7f7430093ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56256/0 (socket says 172.21.15.79:56256) 2021-04-09T18:26:35.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f742effd700 1 -- 172.21.15.79:0/938576402 learned_addr learned my addr 172.21.15.79:0/938576402 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:35.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f742ffff700 1 --2- 172.21.15.79:0/938576402 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7430094510 0x7f7430099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f742f7fe700 1 --2- 172.21.15.79:0/938576402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74300d6960 0x7f74300b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f742effd700 1 -- 172.21.15.79:0/938576402 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7430094510 msgr2=0x7f7430099a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f742effd700 1 --2- 172.21.15.79:0/938576402 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7430094510 0x7f7430099a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f742effd700 1 -- 172.21.15.79:0/938576402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74300d6960 msgr2=0x7f74300b8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f742effd700 1 --2- 172.21.15.79:0/938576402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74300d6960 0x7f74300b8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f742effd700 1 -- 172.21.15.79:0/938576402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7430094b40 con 0x7f74300d4320 2021-04-09T18:26:35.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f742f7fe700 1 --2- 172.21.15.79:0/938576402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74300d6960 0x7f74300b8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:35.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f742effd700 1 --2- 172.21.15.79:0/938576402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74300d4320 0x7f7430093ee0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f74300874d0 tx=0x7f7418006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:35.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f7427fff700 1 -- 172.21.15.79:0/938576402 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7430094b40 con 0x7f74300d4320 2021-04-09T18:26:35.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f7427fff700 1 -- 172.21.15.79:0/938576402 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741801d440 con 0x7f74300d4320 2021-04-09T18:26:35.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f7427fff700 1 -- 172.21.15.79:0/938576402 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f741801d810 con 0x7f74300d4320 2021-04-09T18:26:35.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f7436102700 1 -- 172.21.15.79:0/938576402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74300b9390 con 0x7f74300d4320 2021-04-09T18:26:35.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f7436102700 1 -- 172.21.15.79:0/938576402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7430094d80 con 0x7f74300d4320 2021-04-09T18:26:35.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f7427fff700 1 -- 172.21.15.79:0/938576402 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7418026450 con 0x7f74300d4320 2021-04-09T18:26:35.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f7427fff700 1 --2- 172.21.15.79:0/938576402 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7414029100 0x7f741402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f7427fff700 1 -- 172.21.15.79:0/938576402 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f741803b220 con 0x7f74300d4320 2021-04-09T18:26:35.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f742f7fe700 1 --2- 172.21.15.79:0/938576402 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7414029100 0x7f741402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.674 7f742f7fe700 1 --2- 172.21.15.79:0/938576402 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7414029100 0x7f741402b650 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:35.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.678 7f7436102700 1 -- 172.21.15.79:0/938576402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74300e39f0 con 0x7f74300d4320 2021-04-09T18:26:35.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.686 7f7427fff700 1 -- 172.21.15.79:0/938576402 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7418011c50 con 0x7f74300d4320 2021-04-09T18:26:35.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.842 7f7436102700 1 -- 172.21.15.79:0/938576402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f74300f5b50 con 0x7f74300d4320 2021-04-09T18:26:35.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.842 7f7427fff700 1 -- 172.21.15.79:0/938576402 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7418009740 con 0x7f74300d4320 2021-04-09T18:26:35.850 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:35.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.846 7f7436102700 1 -- 172.21.15.79:0/938576402 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7414029100 msgr2=0x7f741402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.846 7f7436102700 1 --2- 172.21.15.79:0/938576402 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7414029100 0x7f741402b650 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.846 7f7436102700 1 -- 172.21.15.79:0/938576402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74300d4320 msgr2=0x7f7430093ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.846 7f7436102700 1 --2- 172.21.15.79:0/938576402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74300d4320 0x7f7430093ee0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f74300874d0 tx=0x7f7418006890).stop 2021-04-09T18:26:35.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.846 7f7436102700 1 -- 172.21.15.79:0/938576402 shutdown_connections 2021-04-09T18:26:35.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.846 7f7436102700 1 --2- 172.21.15.79:0/938576402 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7414029100 0x7f741402b650 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.846 7f7436102700 1 --2- 172.21.15.79:0/938576402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74300d6960 0x7f74300b8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.846 7f7436102700 1 --2- 172.21.15.79:0/938576402 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7430094510 0x7f7430099a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.846 7f7436102700 1 --2- 172.21.15.79:0/938576402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74300d4320 0x7f7430093ee0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.846 7f7436102700 1 -- 172.21.15.79:0/938576402 >> 172.21.15.79:0/938576402 conn(0x7f7430099380 msgr2=0x7f74300baec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:35.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.846 7f7436102700 1 -- 172.21.15.79:0/938576402 shutdown_connections 2021-04-09T18:26:35.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.846 7f7436102700 1 -- 172.21.15.79:0/938576402 wait complete. 2021-04-09T18:26:35.862 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:26:35.863 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:26:35.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa699b05700 1 Processor -- start 2021-04-09T18:26:35.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa699b05700 1 -- start start 2021-04-09T18:26:35.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa699b05700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6940f5510 0x7fa6940f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa699b05700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6940e9ad0 0x7fa69409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa699b05700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6940fbb10 con 0x7fa6941c2da0 2021-04-09T18:26:35.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa699b05700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6940e9f20 con 0x7fa6940e9ad0 2021-04-09T18:26:35.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa699b05700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940e59c0 con 0x7fa6940f5510 2021-04-09T18:26:35.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa692ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6940e9ad0 0x7fa69409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa692ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6940e9ad0 0x7fa69409f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56268/0 (socket says 172.21.15.79:56268) 2021-04-09T18:26:35.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa692ffd700 1 -- 172.21.15.79:0/1248801598 learned_addr learned my addr 172.21.15.79:0/1248801598 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:35.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa6937fe700 1 --2- 172.21.15.79:0/1248801598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6940f5510 0x7fa6940f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa692ffd700 1 -- 172.21.15.79:0/1248801598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6940f5510 msgr2=0x7fa6940f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:35.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa692ffd700 1 --2- 172.21.15.79:0/1248801598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6940f5510 0x7fa6940f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa692ffd700 1 -- 172.21.15.79:0/1248801598 >> v1:172.21.15.89:6789/0 conn(0x7fa6941c2da0 legacy=0x7fa6941c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa692ffd700 1 -- 172.21.15.79:0/1248801598 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6940e56c0 con 0x7fa6940e9ad0 2021-04-09T18:26:35.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa692ffd700 1 --2- 172.21.15.79:0/1248801598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6940e9ad0 0x7fa69409f100 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fa688002f30 tx=0x7fa68800bda0).ready entity=mon.0 client_cookie=727323b0008d1e84 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:35.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa6927fc700 1 -- 172.21.15.79:0/1248801598 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa6940e56c0 con 0x7fa6940e9ad0 2021-04-09T18:26:35.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa6927fc700 1 -- 172.21.15.79:0/1248801598 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6880099d0 con 0x7fa6940e9ad0 2021-04-09T18:26:35.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa6927fc700 1 -- 172.21.15.79:0/1248801598 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa688009da0 con 0x7fa6940e9ad0 2021-04-09T18:26:35.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa699b05700 1 -- 172.21.15.79:0/1248801598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6940e9ad0 msgr2=0x7fa69409f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa699b05700 1 --2- 172.21.15.79:0/1248801598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6940e9ad0 0x7fa69409f100 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fa688002f30 tx=0x7fa68800bda0).stop 2021-04-09T18:26:35.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa699b05700 1 -- 172.21.15.79:0/1248801598 shutdown_connections 2021-04-09T18:26:35.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa699b05700 1 --2- 172.21.15.79:0/1248801598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6940f5510 0x7fa6940f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa699b05700 1 --2- 172.21.15.79:0/1248801598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6940e9ad0 0x7fa69409f100 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.954 7fa699b05700 1 -- 172.21.15.79:0/1248801598 >> 172.21.15.79:0/1248801598 conn(0x7fa6940e5fd0 msgr2=0x7fa6940e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:35.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.958 7fa699b05700 1 -- 172.21.15.79:0/1248801598 shutdown_connections 2021-04-09T18:26:35.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.958 7fa699b05700 1 -- 172.21.15.79:0/1248801598 wait complete. 2021-04-09T18:26:35.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.958 7fa699b05700 1 Processor -- start 2021-04-09T18:26:35.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.958 7fa699b05700 1 -- start start 2021-04-09T18:26:35.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.958 7fa699b05700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6940aeac0 0x7fa6940902a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.958 7fa699b05700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa694091b10 0x7fa6940ad260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.958 7fa699b05700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa694091f60 0x7fa6940ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.958 7fa699b05700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa694091810 con 0x7fa694091b10 2021-04-09T18:26:35.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.958 7fa699b05700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940908d0 con 0x7fa6940aeac0 2021-04-09T18:26:35.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.958 7fa699b05700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940ba390 con 0x7fa694091f60 2021-04-09T18:26:35.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.958 7fa692ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa694091b10 0x7fa6940ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.958 7fa692ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa694091b10 0x7fa6940ad260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56272/0 (socket says 172.21.15.79:56272) 2021-04-09T18:26:35.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.958 7fa692ffd700 1 -- 172.21.15.79:0/2177579477 learned_addr learned my addr 172.21.15.79:0/2177579477 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:35.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.958 7fa6937fe700 1 --2- 172.21.15.79:0/2177579477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6940aeac0 0x7fa6940902a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.958 7fa693fff700 1 --2- 172.21.15.79:0/2177579477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa694091f60 0x7fa6940ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.962 7fa692ffd700 1 -- 172.21.15.79:0/2177579477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa694091f60 msgr2=0x7fa6940ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.962 7fa692ffd700 1 --2- 172.21.15.79:0/2177579477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa694091f60 0x7fa6940ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.962 7fa692ffd700 1 -- 172.21.15.79:0/2177579477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6940aeac0 msgr2=0x7fa6940902a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:35.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.962 7fa692ffd700 1 --2- 172.21.15.79:0/2177579477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6940aeac0 0x7fa6940902a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:35.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.962 7fa692ffd700 1 -- 172.21.15.79:0/2177579477 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6940adec0 con 0x7fa694091b10 2021-04-09T18:26:35.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.962 7fa692ffd700 1 --2- 172.21.15.79:0/2177579477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa694091b10 0x7fa6940ad260 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fa688002f30 tx=0x7fa688006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:35.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.962 7fa67bfff700 1 -- 172.21.15.79:0/2177579477 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa6940adec0 con 0x7fa694091b10 2021-04-09T18:26:35.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.962 7fa67bfff700 1 -- 172.21.15.79:0/2177579477 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68801d440 con 0x7fa694091b10 2021-04-09T18:26:35.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.962 7fa699b05700 1 -- 172.21.15.79:0/2177579477 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6940aef10 con 0x7fa694091b10 2021-04-09T18:26:35.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.962 7fa67bfff700 1 -- 172.21.15.79:0/2177579477 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa68801d810 con 0x7fa694091b10 2021-04-09T18:26:35.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.962 7fa699b05700 1 -- 172.21.15.79:0/2177579477 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6940af6f0 con 0x7fa694091b10 2021-04-09T18:26:35.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.962 7fa67bfff700 1 -- 172.21.15.79:0/2177579477 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa688026450 con 0x7fa694091b10 2021-04-09T18:26:35.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.962 7fa67bfff700 1 --2- 172.21.15.79:0/2177579477 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa674029100 0x7fa67402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:35.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.962 7fa67bfff700 1 -- 172.21.15.79:0/2177579477 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fa68803b220 con 0x7fa694091b10 2021-04-09T18:26:35.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.962 7fa6937fe700 1 --2- 172.21.15.79:0/2177579477 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa674029100 0x7fa67402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:35.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.962 7fa6937fe700 1 --2- 172.21.15.79:0/2177579477 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa674029100 0x7fa67402b650 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:35.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.970 7fa699b05700 1 -- 172.21.15.79:0/2177579477 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6940e39d0 con 0x7fa694091b10 2021-04-09T18:26:35.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:35.974 7fa67bfff700 1 -- 172.21.15.79:0/2177579477 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa6880097c0 con 0x7fa694091b10 2021-04-09T18:26:36.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:36.142 7fa699b05700 1 -- 172.21.15.79:0/2177579477 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6940f5b10 con 0x7fa694091b10 2021-04-09T18:26:36.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:36.146 7fa67bfff700 1 -- 172.21.15.79:0/2177579477 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2097 (secure 0 0 0) 0x7fa688011c90 con 0x7fa694091b10 2021-04-09T18:26:36.153 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:36.154 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1857210510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1857210510},{"type":"v1","addr":"172.21.15.89:6835","nonce":1857210510}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:26:14.412596","modified":"2021-04-09 18:26:22.142731","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4338},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4338":{"gid":4338,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/4138856363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4138856363},{"type":"v1","addr":"172.21.15.79:6833","nonce":4138856363}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:26:36.154 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 6 2021-04-09T18:26:36.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:36.150 7fa699b05700 1 -- 172.21.15.79:0/2177579477 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa674029100 msgr2=0x7fa67402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:36.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:36.150 7fa699b05700 1 --2- 172.21.15.79:0/2177579477 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa674029100 0x7fa67402b650 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:36.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:36.150 7fa699b05700 1 -- 172.21.15.79:0/2177579477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa694091b10 msgr2=0x7fa6940ad260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:36.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:36.150 7fa699b05700 1 --2- 172.21.15.79:0/2177579477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa694091b10 0x7fa6940ad260 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fa688002f30 tx=0x7fa688006890).stop 2021-04-09T18:26:36.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:36.150 7fa699b05700 1 -- 172.21.15.79:0/2177579477 shutdown_connections 2021-04-09T18:26:36.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:36.150 7fa699b05700 1 --2- 172.21.15.79:0/2177579477 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa674029100 0x7fa67402b650 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:36.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:36.150 7fa699b05700 1 --2- 172.21.15.79:0/2177579477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6940aeac0 0x7fa6940902a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:36.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:36.150 7fa699b05700 1 --2- 172.21.15.79:0/2177579477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa694091f60 0x7fa6940ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:36.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:36.150 7fa699b05700 1 --2- 172.21.15.79:0/2177579477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa694091b10 0x7fa6940ad260 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:36.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:36.150 7fa699b05700 1 -- 172.21.15.79:0/2177579477 >> 172.21.15.79:0/2177579477 conn(0x7fa6940d8b80 msgr2=0x7fa6940d4160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:36.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:36.150 7fa699b05700 1 -- 172.21.15.79:0/2177579477 shutdown_connections 2021-04-09T18:26:36.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:36.150 7fa699b05700 1 -- 172.21.15.79:0/2177579477 wait complete. 2021-04-09T18:26:36.367 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:26:14.412596', 'modified': '2021-04-09 18:26:22.142731', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4338}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4338': {'gid': 4338, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6833/4138856363', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 4138856363}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 4138856363}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:26:36.368 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:26:36.368 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2021-04-09T18:26:36.459 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:26:36.459 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:26:36.459 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2021-04-09T18:26:36.460 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4338, 2021-04-09T18:26:36.460 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2021-04-09T18:26:36.460 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2021-04-09T18:26:36.460 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 15.313558721, 2021-04-09T18:26:36.461 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 6, 2021-04-09T18:26:36.461 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 22, 2021-04-09T18:26:36.461 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 22, 2021-04-09T18:26:36.461 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 19.602845092999999 2021-04-09T18:26:36.461 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:26:36.465 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 4338, "want_state": "up:active", "state": "up:active", "rank_uptime": 15.313558721, "mdsmap_epoch": 6, "osdmap_epoch": 22, "osdmap_epoch_barrier": 22, "uptime": 19.602845092999999 } 2021-04-09T18:26:36.466 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:26:36.466 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2021-04-09T18:26:36.467 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.2 at ubuntu@smithi144.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2... 2021-04-09T18:26:36.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:36.467 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:26:36.475 DEBUG:teuthology.orchestra.run.smithi144:> sudo modprobe fuse 2021-04-09T18:26:36.535 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:26:36.536 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:26:36.591 INFO:teuthology.orchestra.run.smithi144.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:26:36.592 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:26:36.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:36.593 DEBUG:teuthology.orchestra.run.smithi144:> ls /sys/fs/fuse/connections 2021-04-09T18:26:36.643 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:26:36.643 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.2 /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:26:36.687 DEBUG:teuthology.orchestra.run.smithi144:> sudo modprobe fuse 2021-04-09T18:26:36.701 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:26:36.702 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:26:36.759 INFO:teuthology.orchestra.run.smithi144.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:26:36.760 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:26:36.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:36.761 DEBUG:teuthology.orchestra.run.smithi144:> ls /sys/fs/fuse/connections 2021-04-09T18:26:36.762 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi144.stderr:2021-04-09 18:26:36.760 7ff1dd54b0c0 -1 init, newargv = 0x557cb59c7e20 newargc=9 2021-04-09T18:26:36.762 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi144.stderr:ceph-fuse[12963]: starting ceph client 2021-04-09T18:26:36.771 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi144.stderr:ceph-fuse[12963]: starting fuse 2021-04-09T18:26:37.869 DEBUG:teuthology.orchestra.run.smithi144:> sudo modprobe fuse 2021-04-09T18:26:37.885 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:26:37.885 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:26:37.944 INFO:teuthology.orchestra.run.smithi144.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:26:37.945 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:26:37.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:37.946 DEBUG:teuthology.orchestra.run.smithi144:> ls /sys/fs/fuse/connections 2021-04-09T18:26:37.995 INFO:teuthology.orchestra.run.smithi144.stdout:49 2021-04-09T18:26:37.995 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:26:37.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:37.996 DEBUG:teuthology.orchestra.run.smithi144:> sudo python3 -c ' 2021-04-09T18:26:37.996 DEBUG:teuthology.orchestra.run.smithi144:> import glob 2021-04-09T18:26:37.997 DEBUG:teuthology.orchestra.run.smithi144:> import re 2021-04-09T18:26:37.997 DEBUG:teuthology.orchestra.run.smithi144:> import os 2021-04-09T18:26:37.997 DEBUG:teuthology.orchestra.run.smithi144:> import subprocess 2021-04-09T18:26:37.998 DEBUG:teuthology.orchestra.run.smithi144:> 2021-04-09T18:26:37.998 DEBUG:teuthology.orchestra.run.smithi144:> def find_socket(client_name): 2021-04-09T18:26:37.998 DEBUG:teuthology.orchestra.run.smithi144:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2021-04-09T18:26:37.999 DEBUG:teuthology.orchestra.run.smithi144:> files = glob.glob(asok_path) 2021-04-09T18:26:37.999 DEBUG:teuthology.orchestra.run.smithi144:> 2021-04-09T18:26:38.000 DEBUG:teuthology.orchestra.run.smithi144:> # Given a non-glob path, it better be there 2021-04-09T18:26:38.000 DEBUG:teuthology.orchestra.run.smithi144:> if "*" not in asok_path: 2021-04-09T18:26:38.000 DEBUG:teuthology.orchestra.run.smithi144:> assert(len(files) == 1) 2021-04-09T18:26:38.001 DEBUG:teuthology.orchestra.run.smithi144:> return files[0] 2021-04-09T18:26:38.001 DEBUG:teuthology.orchestra.run.smithi144:> 2021-04-09T18:26:38.001 DEBUG:teuthology.orchestra.run.smithi144:> for f in files: 2021-04-09T18:26:38.002 DEBUG:teuthology.orchestra.run.smithi144:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:26:38.002 DEBUG:teuthology.orchestra.run.smithi144:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:26:38.002 DEBUG:teuthology.orchestra.run.smithi144:> return f 2021-04-09T18:26:38.003 DEBUG:teuthology.orchestra.run.smithi144:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:26:38.003 DEBUG:teuthology.orchestra.run.smithi144:> 2021-04-09T18:26:38.003 DEBUG:teuthology.orchestra.run.smithi144:> print(find_socket("client.2")) 2021-04-09T18:26:38.004 DEBUG:teuthology.orchestra.run.smithi144:> ' 2021-04-09T18:26:38.084 INFO:teuthology.orchestra.run.smithi144.stdout:/var/run/ceph/ceph-client.2.12963.asok 2021-04-09T18:26:38.089 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.12963.asok 2021-04-09T18:26:38.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:38.090 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.12963.asok status 2021-04-09T18:26:38.347 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2021-04-09T18:26:38.348 INFO:teuthology.orchestra.run.smithi144.stdout: "metadata": { 2021-04-09T18:26:38.348 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:26:38.348 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:26:38.349 INFO:teuthology.orchestra.run.smithi144.stdout: "entity_id": "2", 2021-04-09T18:26:38.349 INFO:teuthology.orchestra.run.smithi144.stdout: "hostname": "smithi144", 2021-04-09T18:26:38.349 INFO:teuthology.orchestra.run.smithi144.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2021-04-09T18:26:38.349 INFO:teuthology.orchestra.run.smithi144.stdout: "pid": "12963", 2021-04-09T18:26:38.350 INFO:teuthology.orchestra.run.smithi144.stdout: "root": "/" 2021-04-09T18:26:38.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2021-04-09T18:26:38.350 INFO:teuthology.orchestra.run.smithi144.stdout: "dentry_count": 0, 2021-04-09T18:26:38.350 INFO:teuthology.orchestra.run.smithi144.stdout: "dentry_pinned_count": 0, 2021-04-09T18:26:38.350 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 4684, 2021-04-09T18:26:38.351 INFO:teuthology.orchestra.run.smithi144.stdout: "inst": { 2021-04-09T18:26:38.351 INFO:teuthology.orchestra.run.smithi144.stdout: "name": { 2021-04-09T18:26:38.351 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "client", 2021-04-09T18:26:38.351 INFO:teuthology.orchestra.run.smithi144.stdout: "num": 4684 2021-04-09T18:26:38.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2021-04-09T18:26:38.352 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": { 2021-04-09T18:26:38.352 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v1", 2021-04-09T18:26:38.352 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:0", 2021-04-09T18:26:38.352 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 2669375121 2021-04-09T18:26:38.353 INFO:teuthology.orchestra.run.smithi144.stdout: } 2021-04-09T18:26:38.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2021-04-09T18:26:38.353 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": { 2021-04-09T18:26:38.353 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v1", 2021-04-09T18:26:38.354 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:0", 2021-04-09T18:26:38.354 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 2669375121 2021-04-09T18:26:38.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2021-04-09T18:26:38.354 INFO:teuthology.orchestra.run.smithi144.stdout: "inst_str": "client.4684 172.21.15.144:0/2669375121", 2021-04-09T18:26:38.354 INFO:teuthology.orchestra.run.smithi144.stdout: "addr_str": "172.21.15.144:0/2669375121", 2021-04-09T18:26:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: "inode_count": 1, 2021-04-09T18:26:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_epoch": 6, 2021-04-09T18:26:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_epoch": 22, 2021-04-09T18:26:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:26:38.356 INFO:teuthology.orchestra.run.smithi144.stdout: "blacklisted": false, 2021-04-09T18:26:38.356 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs" 2021-04-09T18:26:38.356 INFO:teuthology.orchestra.run.smithi144.stdout:} 2021-04-09T18:26:38.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:38.368 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:26:38.368 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:26:38.376 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:26:38.377 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:26:38.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:38.378 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:26:38.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:38.441 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:26:38.441 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:26:38.449 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-04-09T18:26:38.450 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-04-09T18:26:38.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:38.451 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:26:38.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:38.517 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:26:38.518 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:26:38.526 INFO:teuthology.orchestra.run.smithi144.stdout:fuseblk 2021-04-09T18:26:38.527 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2021-04-09T18:26:38.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:38.528 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:26:38.591 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2021-04-09T18:26:38.610 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:38.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e9e4f700 1 Processor -- start 2021-04-09T18:26:38.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e9e4f700 1 -- start start 2021-04-09T18:26:38.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e9e4f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff1e40f5520 0x7ff1e40f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:38.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e9e4f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e40fbb20 con 0x7ff1e41c8010 2021-04-09T18:26:38.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e9e4f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e409f910 con 0x7ff1e40e9ae0 2021-04-09T18:26:38.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e9e4f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e40e9f30 con 0x7ff1e40f5520 2021-04-09T18:26:38.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e3fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff1e41c8010 0x7ff1e41ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50990/0 (socket says 172.21.15.79:50990) 2021-04-09T18:26:38.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e3fff700 1 -- 172.21.15.79:0/3673698889 learned_addr learned my addr 172.21.15.79:0/3673698889 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:38.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e37fe700 1 --2- 172.21.15.79:0/3673698889 >> v2:172.21.15.89:3300/0 conn(0x7ff1e40f5520 0x7ff1e40f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:38.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e27fc700 1 -- 172.21.15.79:0/3673698889 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 628623090 0 0) 0x7ff1dc001450 con 0x7ff1e41c8010 2021-04-09T18:26:38.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e27fc700 1 -- 172.21.15.79:0/3673698889 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1cc003240 con 0x7ff1e41c8010 2021-04-09T18:26:38.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e27fc700 1 -- 172.21.15.79:0/3673698889 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418506200 0 0) 0x7ff1d80010d0 con 0x7ff1e40e9ae0 2021-04-09T18:26:38.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e27fc700 1 -- 172.21.15.79:0/3673698889 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1cc003620 con 0x7ff1e40e9ae0 2021-04-09T18:26:38.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e27fc700 1 -- 172.21.15.79:0/3673698889 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1886960195 0 0) 0x7ff1dc0019d0 con 0x7ff1e41c8010 2021-04-09T18:26:38.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e27fc700 1 -- 172.21.15.79:0/3673698889 >> v2:172.21.15.89:3300/0 conn(0x7ff1e40f5520 msgr2=0x7ff1e40f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:38.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e27fc700 1 --2- 172.21.15.79:0/3673698889 >> v2:172.21.15.89:3300/0 conn(0x7ff1e40f5520 0x7ff1e40f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:38.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e27fc700 1 -- 172.21.15.79:0/3673698889 >> v1:172.21.15.89:6789/0 conn(0x7ff1e40e9ae0 legacy=0x7ff1e409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:38.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e27fc700 1 -- 172.21.15.79:0/3673698889 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e40e56d0 con 0x7ff1e41c8010 2021-04-09T18:26:38.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e27fc700 1 -- 172.21.15.79:0/3673698889 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7ff1dc001f30 con 0x7ff1e41c8010 2021-04-09T18:26:38.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e27fc700 1 -- 172.21.15.79:0/3673698889 >> v1:172.21.15.79:6789/0 conn(0x7ff1e41c8010 legacy=0x7ff1e41ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:38.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e27fc700 1 --2- 172.21.15.79:0/3673698889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1cc003d60 0x7ff1cc0045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:38.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e27fc700 1 --2- 172.21.15.79:0/3673698889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1cc004bd0 0x7ff1cc0097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:38.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e27fc700 1 --2- 172.21.15.79:0/3673698889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1cc005070 0x7ff1cc00be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:38.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e27fc700 1 -- 172.21.15.79:0/3673698889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40e9f30 con 0x7ff1cc005070 2021-04-09T18:26:38.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e27fc700 1 -- 172.21.15.79:0/3673698889 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc050600 con 0x7ff1cc003d60 2021-04-09T18:26:38.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e3fff700 1 --2- 172.21.15.79:0/3673698889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1cc005070 0x7ff1cc00be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:38.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.702 7ff1e27fc700 1 -- 172.21.15.79:0/3673698889 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc050800 con 0x7ff1cc004bd0 2021-04-09T18:26:38.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.706 7ff1e37fe700 1 --2- 172.21.15.79:0/3673698889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1cc003d60 0x7ff1cc0045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:38.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.706 7ff1e2ffd700 1 --2- 172.21.15.79:0/3673698889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1cc004bd0 0x7ff1cc0097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:38.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.706 7ff1e3fff700 1 -- 172.21.15.79:0/3673698889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1cc004bd0 msgr2=0x7ff1cc0097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:38.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.706 7ff1e3fff700 1 --2- 172.21.15.79:0/3673698889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1cc004bd0 0x7ff1cc0097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:38.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.706 7ff1e3fff700 1 -- 172.21.15.79:0/3673698889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1cc003d60 msgr2=0x7ff1cc0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:38.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.706 7ff1e3fff700 1 --2- 172.21.15.79:0/3673698889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1cc003d60 0x7ff1cc0045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:38.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.706 7ff1e3fff700 1 -- 172.21.15.79:0/3673698889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc050af0 con 0x7ff1cc005070 2021-04-09T18:26:38.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.706 7ff1e3fff700 1 -- 172.21.15.79:0/3673698889 reap_dead start 2021-04-09T18:26:38.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.706 7ff1e3fff700 1 --2- 172.21.15.79:0/3673698889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1cc005070 0x7ff1cc00be20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7ff1dc001d00 tx=0x7ff1dc00ad80).ready entity=mon.0 client_cookie=fe2646cd8d4fb861 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:38.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.706 7ff1e27fc700 1 -- 172.21.15.79:0/3673698889 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff1cc050af0 con 0x7ff1cc005070 2021-04-09T18:26:38.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.706 7ff1e27fc700 1 -- 172.21.15.79:0/3673698889 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc007110 con 0x7ff1cc005070 2021-04-09T18:26:38.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.706 7ff1e27fc700 1 -- 172.21.15.79:0/3673698889 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff1e40e56d0 con 0x7ff1cc005070 2021-04-09T18:26:38.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.706 7ff1e9e4f700 1 -- 172.21.15.79:0/3673698889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1cc005070 msgr2=0x7ff1cc00be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:38.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.706 7ff1e9e4f700 1 --2- 172.21.15.79:0/3673698889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1cc005070 0x7ff1cc00be20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7ff1dc001d00 tx=0x7ff1dc00ad80).stop 2021-04-09T18:26:38.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.706 7ff1e9e4f700 1 -- 172.21.15.79:0/3673698889 shutdown_connections 2021-04-09T18:26:38.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.706 7ff1e9e4f700 1 --2- 172.21.15.79:0/3673698889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1cc005070 0x7ff1cc00be20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:38.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.706 7ff1e9e4f700 1 -- 172.21.15.79:0/3673698889 >> 172.21.15.79:0/3673698889 conn(0x7ff1e40e5fe0 msgr2=0x7ff1e40e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:38.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.706 7ff1e9e4f700 1 -- 172.21.15.79:0/3673698889 shutdown_connections 2021-04-09T18:26:38.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.706 7ff1e9e4f700 1 -- 172.21.15.79:0/3673698889 wait complete. 2021-04-09T18:26:38.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.710 7ff1e9e4f700 1 Processor -- start 2021-04-09T18:26:38.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.710 7ff1e9e4f700 1 -- start start 2021-04-09T18:26:38.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.710 7ff1e9e4f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1e4097220 0x7ff1e4096990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:38.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.710 7ff1e9e4f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1e40bb2a0 0x7ff1e40c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:38.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.710 7ff1e9e4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1e40c3af0 0x7ff1e40c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:38.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.710 7ff1e9e4f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e41c3dc0 con 0x7ff1e40c3af0 2021-04-09T18:26:38.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.710 7ff1e9e4f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e4097970 con 0x7ff1e4097220 2021-04-09T18:26:38.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.710 7ff1e9e4f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40bb6f0 con 0x7ff1e40bb2a0 2021-04-09T18:26:38.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.710 7ff1e3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1e40c3af0 0x7ff1e40c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:38.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.710 7ff1e3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1e40c3af0 0x7ff1e40c56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56294/0 (socket says 172.21.15.79:56294) 2021-04-09T18:26:38.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.710 7ff1e3fff700 1 -- 172.21.15.79:0/1963975604 learned_addr learned my addr 172.21.15.79:0/1963975604 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:38.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.710 7ff1e37fe700 1 --2- 172.21.15.79:0/1963975604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1e4097220 0x7ff1e4096990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:38.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.710 7ff1e2ffd700 1 --2- 172.21.15.79:0/1963975604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1e40bb2a0 0x7ff1e40c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:38.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.710 7ff1e3fff700 1 -- 172.21.15.79:0/1963975604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1e40bb2a0 msgr2=0x7ff1e40c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:38.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.710 7ff1e3fff700 1 --2- 172.21.15.79:0/1963975604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1e40bb2a0 0x7ff1e40c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:38.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.710 7ff1e3fff700 1 -- 172.21.15.79:0/1963975604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1e4097220 msgr2=0x7ff1e4096990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:38.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.710 7ff1e3fff700 1 --2- 172.21.15.79:0/1963975604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1e4097220 0x7ff1e4096990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:38.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.714 7ff1e3fff700 1 -- 172.21.15.79:0/1963975604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e40c3f40 con 0x7ff1e40c3af0 2021-04-09T18:26:38.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.714 7ff1e37fe700 1 --2- 172.21.15.79:0/1963975604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1e4097220 0x7ff1e4096990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:38.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.714 7ff1e3fff700 1 --2- 172.21.15.79:0/1963975604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1e40c3af0 0x7ff1e40c56e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7ff1e40874d0 tx=0x7ff1dc007a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:38.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.714 7ff1cbfff700 1 -- 172.21.15.79:0/1963975604 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff1e40c3f40 con 0x7ff1e40c3af0 2021-04-09T18:26:38.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.714 7ff1cbfff700 1 -- 172.21.15.79:0/1963975604 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc001f50 con 0x7ff1e40c3af0 2021-04-09T18:26:38.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.714 7ff1cbfff700 1 -- 172.21.15.79:0/1963975604 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff1dc01a020 con 0x7ff1e40c3af0 2021-04-09T18:26:38.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.714 7ff1e9e4f700 1 -- 172.21.15.79:0/1963975604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e40991f0 con 0x7ff1e40c3af0 2021-04-09T18:26:38.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.714 7ff1e9e4f700 1 -- 172.21.15.79:0/1963975604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e40c5ea0 con 0x7ff1e40c3af0 2021-04-09T18:26:38.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.714 7ff1cbfff700 1 -- 172.21.15.79:0/1963975604 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff1dc0074f0 con 0x7ff1e40c3af0 2021-04-09T18:26:38.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.714 7ff1cbfff700 1 --2- 172.21.15.79:0/1963975604 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff1c4029100 0x7ff1c402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:38.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.714 7ff1cbfff700 1 -- 172.21.15.79:0/1963975604 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7ff1dc03a210 con 0x7ff1e40c3af0 2021-04-09T18:26:38.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.714 7ff1e37fe700 1 --2- 172.21.15.79:0/1963975604 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff1c4029100 0x7ff1c402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:38.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.714 7ff1e37fe700 1 --2- 172.21.15.79:0/1963975604 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff1c4029100 0x7ff1c402b650 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:38.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.730 7ff1e9e4f700 1 -- 172.21.15.79:0/1963975604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e40e39e0 con 0x7ff1e40c3af0 2021-04-09T18:26:38.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.738 7ff1cbfff700 1 -- 172.21.15.79:0/1963975604 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff1dc001d40 con 0x7ff1e40c3af0 2021-04-09T18:26:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.910 7ff1e9e4f700 1 -- 172.21.15.79:0/1963975604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1e40a1cc0 con 0x7ff1e40c3af0 2021-04-09T18:26:38.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.914 7ff1cbfff700 1 -- 172.21.15.79:0/1963975604 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14254 (secure 0 0 0) 0x7ff1e40f76c0 con 0x7ff1e40c3af0 2021-04-09T18:26:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:38.921 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:14.412296","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:26:09.311735","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:26:12.130710","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:26:38.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.914 7ff1e9e4f700 1 -- 172.21.15.79:0/1963975604 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff1c4029100 msgr2=0x7ff1c402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:38.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.914 7ff1e9e4f700 1 --2- 172.21.15.79:0/1963975604 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff1c4029100 0x7ff1c402b650 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:38.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.914 7ff1e9e4f700 1 -- 172.21.15.79:0/1963975604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1e40c3af0 msgr2=0x7ff1e40c56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:38.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.914 7ff1e9e4f700 1 --2- 172.21.15.79:0/1963975604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1e40c3af0 0x7ff1e40c56e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7ff1e40874d0 tx=0x7ff1dc007a20).stop 2021-04-09T18:26:38.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.918 7ff1e9e4f700 1 -- 172.21.15.79:0/1963975604 shutdown_connections 2021-04-09T18:26:38.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.918 7ff1e9e4f700 1 --2- 172.21.15.79:0/1963975604 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff1c4029100 0x7ff1c402b650 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:38.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.918 7ff1e9e4f700 1 --2- 172.21.15.79:0/1963975604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1e4097220 0x7ff1e4096990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:38.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.918 7ff1e9e4f700 1 --2- 172.21.15.79:0/1963975604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1e40c3af0 0x7ff1e40c56e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:38.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.918 7ff1e9e4f700 1 --2- 172.21.15.79:0/1963975604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1e40bb2a0 0x7ff1e40c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:38.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.918 7ff1e9e4f700 1 -- 172.21.15.79:0/1963975604 >> 172.21.15.79:0/1963975604 conn(0x7ff1e40c0460 msgr2=0x7ff1e4095da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:38.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.918 7ff1e9e4f700 1 -- 172.21.15.79:0/1963975604 shutdown_connections 2021-04-09T18:26:38.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:38.918 7ff1e9e4f700 1 -- 172.21.15.79:0/1963975604 wait complete. 2021-04-09T18:26:38.934 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:26:09.311735', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:26:12.130710', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:26:38.934 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:26:39.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.018 7f1ee3150700 1 Processor -- start 2021-04-09T18:26:39.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.018 7f1ee3150700 1 -- start start 2021-04-09T18:26:39.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.018 7f1ee3150700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1edc1c9050 0x7f1edc1cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.018 7f1ee3150700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1edc0fbb50 con 0x7f1edc0f5550 2021-04-09T18:26:39.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.018 7f1ee3150700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1edc09f910 con 0x7f1edc0e9b10 2021-04-09T18:26:39.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.018 7f1ee3150700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1edc1c3df0 con 0x7f1edc1c9050 2021-04-09T18:26:39.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.022 7f1ee0ef4700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1edc0f5550 0x7f1edc0f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51008/0 (socket says 172.21.15.79:51008) 2021-04-09T18:26:39.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.022 7f1ee16f5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1edc1c9050 0x7f1edc1cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.022 7f1ee0ef4700 1 -- 172.21.15.79:0/174526976 learned_addr learned my addr 172.21.15.79:0/174526976 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:39.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.022 7f1edb7fe700 1 -- 172.21.15.79:0/174526976 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414327608 0 0) 0x7f1ec40010d0 con 0x7f1edc0f5550 2021-04-09T18:26:39.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.022 7f1edb7fe700 1 -- 172.21.15.79:0/174526976 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ec8003240 con 0x7f1edc0f5550 2021-04-09T18:26:39.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.022 7f1ee16f5700 1 -- 172.21.15.79:0/174526976 >> v1:172.21.15.89:6789/0 conn(0x7f1edc0e9b10 legacy=0x7f1edc09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.022 7f1ee16f5700 1 -- 172.21.15.79:0/174526976 >> v1:172.21.15.79:6789/0 conn(0x7f1edc0f5550 legacy=0x7f1edc0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.022 7f1ee16f5700 1 -- 172.21.15.79:0/174526976 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc0e5700 con 0x7f1edc1c9050 2021-04-09T18:26:39.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.022 7f1ee16f5700 1 --2- 172.21.15.79:0/174526976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1edc1c9050 0x7f1edc1cb4b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f1ecc002f30 tx=0x7f1ecc00bcc0).ready entity=mon.0 client_cookie=ff9d3dcdda181fe1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:39.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.022 7f1edb7fe700 1 -- 172.21.15.79:0/174526976 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1edc0e5700 con 0x7f1edc1c9050 2021-04-09T18:26:39.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.022 7f1edb7fe700 1 -- 172.21.15.79:0/174526976 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc009800 con 0x7f1edc1c9050 2021-04-09T18:26:39.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.022 7f1edb7fe700 1 -- 172.21.15.79:0/174526976 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ecc009bd0 con 0x7f1edc1c9050 2021-04-09T18:26:39.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.022 7f1ee3150700 1 -- 172.21.15.79:0/174526976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1edc1c9050 msgr2=0x7f1edc1cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.022 7f1ee3150700 1 --2- 172.21.15.79:0/174526976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1edc1c9050 0x7f1edc1cb4b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f1ecc002f30 tx=0x7f1ecc00bcc0).stop 2021-04-09T18:26:39.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.022 7f1ee3150700 1 -- 172.21.15.79:0/174526976 shutdown_connections 2021-04-09T18:26:39.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.022 7f1ee3150700 1 --2- 172.21.15.79:0/174526976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1edc1c9050 0x7f1edc1cb4b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.022 7f1ee3150700 1 -- 172.21.15.79:0/174526976 >> 172.21.15.79:0/174526976 conn(0x7f1edc0e6010 msgr2=0x7f1edc0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:39.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.022 7f1ee3150700 1 -- 172.21.15.79:0/174526976 shutdown_connections 2021-04-09T18:26:39.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.022 7f1ee3150700 1 -- 172.21.15.79:0/174526976 wait complete. 2021-04-09T18:26:39.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee3150700 1 Processor -- start 2021-04-09T18:26:39.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee3150700 1 -- start start 2021-04-09T18:26:39.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee3150700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1edc1b1680 0x7f1edc0c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee3150700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1edc1b1ad0 0x7f1edc0d30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee3150700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1edc0d36e0 0x7f1edc19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee3150700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc0e9f60 con 0x7f1edc1b1680 2021-04-09T18:26:39.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee3150700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc1a1e20 con 0x7f1edc1b1ad0 2021-04-09T18:26:39.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee3150700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc0c5770 con 0x7f1edc0d36e0 2021-04-09T18:26:39.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee0ef4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1edc1b1680 0x7f1edc0c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee0ef4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1edc1b1680 0x7f1edc0c5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56304/0 (socket says 172.21.15.79:56304) 2021-04-09T18:26:39.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee0ef4700 1 -- 172.21.15.79:0/2382280158 learned_addr learned my addr 172.21.15.79:0/2382280158 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:39.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee16f5700 1 --2- 172.21.15.79:0/2382280158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1edc0d36e0 0x7f1edc19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1edbfff700 1 --2- 172.21.15.79:0/2382280158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1edc1b1ad0 0x7f1edc0d30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee0ef4700 1 -- 172.21.15.79:0/2382280158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1edc0d36e0 msgr2=0x7f1edc19ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee0ef4700 1 --2- 172.21.15.79:0/2382280158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1edc0d36e0 0x7f1edc19ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee0ef4700 1 -- 172.21.15.79:0/2382280158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1edc1b1ad0 msgr2=0x7f1edc0d30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee0ef4700 1 --2- 172.21.15.79:0/2382280158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1edc1b1ad0 0x7f1edc0d30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee0ef4700 1 -- 172.21.15.79:0/2382280158 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc1a19b0 con 0x7f1edc1b1680 2021-04-09T18:26:39.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee16f5700 1 --2- 172.21.15.79:0/2382280158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1edc0d36e0 0x7f1edc19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:39.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1edbfff700 1 --2- 172.21.15.79:0/2382280158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1edc1b1ad0 0x7f1edc0d30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:39.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee0ef4700 1 --2- 172.21.15.79:0/2382280158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1edc1b1680 0x7f1edc0c5140 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f1edc0969c0 tx=0x7f1ec400cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:39.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ed97fa700 1 -- 172.21.15.79:0/2382280158 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1edc1a19b0 con 0x7f1edc1b1680 2021-04-09T18:26:39.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ed97fa700 1 -- 172.21.15.79:0/2382280158 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec4007320 con 0x7f1edc1b1680 2021-04-09T18:26:39.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee3150700 1 -- 172.21.15.79:0/2382280158 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1edc19d4b0 con 0x7f1edc1b1680 2021-04-09T18:26:39.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ed97fa700 1 -- 172.21.15.79:0/2382280158 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ec40057e0 con 0x7f1edc1b1680 2021-04-09T18:26:39.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ee3150700 1 -- 172.21.15.79:0/2382280158 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1edc19d960 con 0x7f1edc1b1680 2021-04-09T18:26:39.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ed97fa700 1 -- 172.21.15.79:0/2382280158 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1ec401a060 con 0x7f1edc1b1680 2021-04-09T18:26:39.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ed97fa700 1 --2- 172.21.15.79:0/2382280158 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1ec0029100 0x7f1ec002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.026 7f1ed97fa700 1 -- 172.21.15.79:0/2382280158 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f1ec4038c60 con 0x7f1edc1b1680 2021-04-09T18:26:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.030 7f1edbfff700 1 --2- 172.21.15.79:0/2382280158 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1ec0029100 0x7f1ec002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.030 7f1edbfff700 1 --2- 172.21.15.79:0/2382280158 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1ec0029100 0x7f1ec002b650 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.034 7f1ee3150700 1 -- 172.21.15.79:0/2382280158 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1edc0e39f0 con 0x7f1edc1b1680 2021-04-09T18:26:39.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.042 7f1ed97fa700 1 -- 172.21.15.79:0/2382280158 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1edc107f80 con 0x7f1edc1b1680 2021-04-09T18:26:39.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.202 7f1ee3150700 1 -- 172.21.15.79:0/2382280158 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f1edc0a1c90 con 0x7f1edc1b1680 2021-04-09T18:26:39.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.202 7f1ed97fa700 1 -- 172.21.15.79:0/2382280158 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1ec4007110 con 0x7f1edc1b1680 2021-04-09T18:26:39.211 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:39.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.206 7f1ee3150700 1 -- 172.21.15.79:0/2382280158 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1ec0029100 msgr2=0x7f1ec002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.206 7f1ee3150700 1 --2- 172.21.15.79:0/2382280158 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1ec0029100 0x7f1ec002b650 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.206 7f1ee3150700 1 -- 172.21.15.79:0/2382280158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1edc1b1680 msgr2=0x7f1edc0c5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.206 7f1ee3150700 1 --2- 172.21.15.79:0/2382280158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1edc1b1680 0x7f1edc0c5140 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f1edc0969c0 tx=0x7f1ec400cae0).stop 2021-04-09T18:26:39.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.206 7f1ee3150700 1 -- 172.21.15.79:0/2382280158 shutdown_connections 2021-04-09T18:26:39.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.206 7f1ee3150700 1 --2- 172.21.15.79:0/2382280158 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1ec0029100 0x7f1ec002b650 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.206 7f1ee3150700 1 --2- 172.21.15.79:0/2382280158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1edc0d36e0 0x7f1edc19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.206 7f1ee3150700 1 --2- 172.21.15.79:0/2382280158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1edc1b1680 0x7f1edc0c5140 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.206 7f1ee3150700 1 --2- 172.21.15.79:0/2382280158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1edc1b1ad0 0x7f1edc0d30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.206 7f1ee3150700 1 -- 172.21.15.79:0/2382280158 >> 172.21.15.79:0/2382280158 conn(0x7f1edc0ba8f0 msgr2=0x7f1edc0d85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:39.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.206 7f1ee3150700 1 -- 172.21.15.79:0/2382280158 shutdown_connections 2021-04-09T18:26:39.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.206 7f1ee3150700 1 -- 172.21.15.79:0/2382280158 wait complete. 2021-04-09T18:26:39.223 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:26:39.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.310 7fd417fbb700 1 Processor -- start 2021-04-09T18:26:39.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.310 7fd417fbb700 1 -- start start 2021-04-09T18:26:39.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.310 7fd417fbb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd4100e9b10 0x7fd41009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.310 7fd417fbb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd4101c8040 0x7fd4101ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.310 7fd417fbb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4100fbb50 con 0x7fd4100f5550 2021-04-09T18:26:39.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.310 7fd417fbb700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4101c3df0 con 0x7fd4100e9b10 2021-04-09T18:26:39.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.310 7fd417fbb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4100e9f60 con 0x7fd4101c8040 2021-04-09T18:26:39.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd41555e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd4100e9b10 0x7fd41009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd41555e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd4100e9b10 0x7fd41009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56314/0 (socket says 172.21.15.79:56314) 2021-04-09T18:26:39.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd41555e700 1 -- 172.21.15.79:0/1254981570 learned_addr learned my addr 172.21.15.79:0/1254981570 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:39.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd416560700 1 --2- 172.21.15.79:0/1254981570 >> v2:172.21.15.89:3300/0 conn(0x7fd4101c8040 0x7fd4101ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd41555e700 1 -- 172.21.15.79:0/1254981570 >> v2:172.21.15.89:3300/0 conn(0x7fd4101c8040 msgr2=0x7fd4101ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:39.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd41555e700 1 --2- 172.21.15.79:0/1254981570 >> v2:172.21.15.89:3300/0 conn(0x7fd4101c8040 0x7fd4101ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd414d5d700 1 -- 172.21.15.79:0/1254981570 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429012312 0 0) 0x7fd3f80010d0 con 0x7fd4100f5550 2021-04-09T18:26:39.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd41555e700 1 -- 172.21.15.79:0/1254981570 >> v1:172.21.15.89:6789/0 conn(0x7fd4100f5550 legacy=0x7fd4100f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd41555e700 1 -- 172.21.15.79:0/1254981570 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4100e5700 con 0x7fd4100e9b10 2021-04-09T18:26:39.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd41555e700 1 --2- 172.21.15.79:0/1254981570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4100e9b10 0x7fd41009f110 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fd400002f30 tx=0x7fd40000bd70).ready entity=mon.0 client_cookie=ff3abb6f54e814ab server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:39.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd414d5d700 1 -- 172.21.15.79:0/1254981570 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd4100e5700 con 0x7fd4100e9b10 2021-04-09T18:26:39.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd414d5d700 1 -- 172.21.15.79:0/1254981570 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd400009950 con 0x7fd4100e9b10 2021-04-09T18:26:39.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd414d5d700 1 -- 172.21.15.79:0/1254981570 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd400009d20 con 0x7fd4100e9b10 2021-04-09T18:26:39.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd417fbb700 1 -- 172.21.15.79:0/1254981570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4100e9b10 msgr2=0x7fd41009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd417fbb700 1 --2- 172.21.15.79:0/1254981570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4100e9b10 0x7fd41009f110 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fd400002f30 tx=0x7fd40000bd70).stop 2021-04-09T18:26:39.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd417fbb700 1 -- 172.21.15.79:0/1254981570 shutdown_connections 2021-04-09T18:26:39.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd417fbb700 1 --2- 172.21.15.79:0/1254981570 >> v2:172.21.15.89:3300/0 conn(0x7fd4101c8040 0x7fd4101ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd417fbb700 1 --2- 172.21.15.79:0/1254981570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4100e9b10 0x7fd41009f110 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd417fbb700 1 -- 172.21.15.79:0/1254981570 >> 172.21.15.79:0/1254981570 conn(0x7fd4100e6010 msgr2=0x7fd4100e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:39.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd417fbb700 1 -- 172.21.15.79:0/1254981570 shutdown_connections 2021-04-09T18:26:39.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.314 7fd417fbb700 1 -- 172.21.15.79:0/1254981570 wait complete. 2021-04-09T18:26:39.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd417fbb700 1 Processor -- start 2021-04-09T18:26:39.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd417fbb700 1 -- start start 2021-04-09T18:26:39.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd417fbb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4100ab2e0 0x7fd410090a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd417fbb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd410091070 0x7fd4101a66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd417fbb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4101a6cd0 0x7fd4101aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd417fbb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd410047500 con 0x7fd4100ab2e0 2021-04-09T18:26:39.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd417fbb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4100ad190 con 0x7fd4101a6cd0 2021-04-09T18:26:39.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd417fbb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4100ab730 con 0x7fd410091070 2021-04-09T18:26:39.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd415d5f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4100ab2e0 0x7fd410090a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd415d5f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4100ab2e0 0x7fd410090a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56318/0 (socket says 172.21.15.79:56318) 2021-04-09T18:26:39.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd415d5f700 1 -- 172.21.15.79:0/2656480442 learned_addr learned my addr 172.21.15.79:0/2656480442 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:39.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd416560700 1 --2- 172.21.15.79:0/2656480442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4101a6cd0 0x7fd4101aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd41555e700 1 --2- 172.21.15.79:0/2656480442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd410091070 0x7fd4101a66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd415d5f700 1 -- 172.21.15.79:0/2656480442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd410091070 msgr2=0x7fd4101a66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd415d5f700 1 --2- 172.21.15.79:0/2656480442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd410091070 0x7fd4101a66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd415d5f700 1 -- 172.21.15.79:0/2656480442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4101a6cd0 msgr2=0x7fd4101aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd415d5f700 1 --2- 172.21.15.79:0/2656480442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4101a6cd0 0x7fd4101aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd415d5f700 1 -- 172.21.15.79:0/2656480442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4101a7120 con 0x7fd4100ab2e0 2021-04-09T18:26:39.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd415d5f700 1 --2- 172.21.15.79:0/2656480442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4100ab2e0 0x7fd410090a40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fd4100bb3a0 tx=0x7fd3f800cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:39.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd40e7fc700 1 -- 172.21.15.79:0/2656480442 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd4101a7120 con 0x7fd4100ab2e0 2021-04-09T18:26:39.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd40e7fc700 1 -- 172.21.15.79:0/2656480442 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f8010510 con 0x7fd4100ab2e0 2021-04-09T18:26:39.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd40e7fc700 1 -- 172.21.15.79:0/2656480442 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd3f80106f0 con 0x7fd4100ab2e0 2021-04-09T18:26:39.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd417fbb700 1 -- 172.21.15.79:0/2656480442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4101aaec0 con 0x7fd4100ab2e0 2021-04-09T18:26:39.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd417fbb700 1 -- 172.21.15.79:0/2656480442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4101ab240 con 0x7fd4100ab2e0 2021-04-09T18:26:39.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.318 7fd40e7fc700 1 -- 172.21.15.79:0/2656480442 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd3f8019020 con 0x7fd4100ab2e0 2021-04-09T18:26:39.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.322 7fd40e7fc700 1 --2- 172.21.15.79:0/2656480442 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3f4029100 0x7fd3f402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.322 7fd40e7fc700 1 -- 172.21.15.79:0/2656480442 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fd3f8038e10 con 0x7fd4100ab2e0 2021-04-09T18:26:39.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.322 7fd41555e700 1 --2- 172.21.15.79:0/2656480442 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3f4029100 0x7fd3f402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.322 7fd41555e700 1 --2- 172.21.15.79:0/2656480442 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3f4029100 0x7fd3f402b650 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:39.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.326 7fd417fbb700 1 -- 172.21.15.79:0/2656480442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4100e39f0 con 0x7fd4100ab2e0 2021-04-09T18:26:39.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.334 7fd40e7fc700 1 -- 172.21.15.79:0/2656480442 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd3f8000bf0 con 0x7fd4100ab2e0 2021-04-09T18:26:39.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.486 7fd417fbb700 1 -- 172.21.15.79:0/2656480442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fd4100f5b50 con 0x7fd4100ab2e0 2021-04-09T18:26:39.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.490 7fd40e7fc700 1 -- 172.21.15.79:0/2656480442 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd3f8010300 con 0x7fd4100ab2e0 2021-04-09T18:26:39.496 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:39.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.490 7fd417fbb700 1 -- 172.21.15.79:0/2656480442 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3f4029100 msgr2=0x7fd3f402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.490 7fd417fbb700 1 --2- 172.21.15.79:0/2656480442 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3f4029100 0x7fd3f402b650 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.490 7fd417fbb700 1 -- 172.21.15.79:0/2656480442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4100ab2e0 msgr2=0x7fd410090a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.490 7fd417fbb700 1 --2- 172.21.15.79:0/2656480442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4100ab2e0 0x7fd410090a40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fd4100bb3a0 tx=0x7fd3f800cab0).stop 2021-04-09T18:26:39.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.490 7fd417fbb700 1 -- 172.21.15.79:0/2656480442 shutdown_connections 2021-04-09T18:26:39.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.490 7fd417fbb700 1 --2- 172.21.15.79:0/2656480442 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3f4029100 0x7fd3f402b650 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.490 7fd417fbb700 1 --2- 172.21.15.79:0/2656480442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4101a6cd0 0x7fd4101aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.490 7fd417fbb700 1 --2- 172.21.15.79:0/2656480442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4100ab2e0 0x7fd410090a40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.490 7fd417fbb700 1 --2- 172.21.15.79:0/2656480442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd410091070 0x7fd4101a66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.490 7fd417fbb700 1 -- 172.21.15.79:0/2656480442 >> 172.21.15.79:0/2656480442 conn(0x7fd4100ba650 msgr2=0x7fd4100ab9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:39.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.490 7fd417fbb700 1 -- 172.21.15.79:0/2656480442 shutdown_connections 2021-04-09T18:26:39.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.490 7fd417fbb700 1 -- 172.21.15.79:0/2656480442 wait complete. 2021-04-09T18:26:39.508 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:26:39.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.594 7f59adb6d700 1 Processor -- start 2021-04-09T18:26:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.594 7f59adb6d700 1 -- start start 2021-04-09T18:26:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.594 7f59adb6d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a80f5550 0x7f59a80f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.594 7f59adb6d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a80fbb50 con 0x7f59a81c8040 2021-04-09T18:26:39.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.594 7f59adb6d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a809f910 con 0x7f59a80e9b10 2021-04-09T18:26:39.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.594 7f59adb6d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a80e9f60 con 0x7f59a80f5550 2021-04-09T18:26:39.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.594 7f59a7fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f59a81c8040 0x7f59a81ca4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51040/0 (socket says 172.21.15.79:51040) 2021-04-09T18:26:39.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.594 7f59a7fff700 1 -- 172.21.15.79:0/3310054912 learned_addr learned my addr 172.21.15.79:0/3310054912 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:39.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.594 7f59a77fe700 1 --2- 172.21.15.79:0/3310054912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a80f5550 0x7f59a80f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.598 7f59a67fc700 1 -- 172.21.15.79:0/3310054912 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1610128031 0 0) 0x7f59a00010d0 con 0x7f59a81c8040 2021-04-09T18:26:39.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.598 7f59a67fc700 1 -- 172.21.15.79:0/3310054912 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5994003240 con 0x7f59a81c8040 2021-04-09T18:26:39.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.598 7f59a67fc700 1 -- 172.21.15.79:0/3310054912 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661905601 0 0) 0x7f5998001450 con 0x7f59a80e9b10 2021-04-09T18:26:39.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.598 7f59a67fc700 1 -- 172.21.15.79:0/3310054912 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5994004680 con 0x7f59a80e9b10 2021-04-09T18:26:39.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.598 7f59a77fe700 1 -- 172.21.15.79:0/3310054912 >> v1:172.21.15.89:6789/0 conn(0x7f59a80e9b10 legacy=0x7f59a809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.598 7f59a77fe700 1 -- 172.21.15.79:0/3310054912 >> v1:172.21.15.79:6789/0 conn(0x7f59a81c8040 legacy=0x7f59a81ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.598 7f59a67fc700 1 -- 172.21.15.79:0/3310054912 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3805446603 0 0) 0x7f59a0001650 con 0x7f59a81c8040 2021-04-09T18:26:39.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.598 7f59a77fe700 1 -- 172.21.15.79:0/3310054912 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a80e5700 con 0x7f59a80f5550 2021-04-09T18:26:39.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.598 7f59a77fe700 1 --2- 172.21.15.79:0/3310054912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a80f5550 0x7f59a80f64e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f59a0001df0 tx=0x7f599000bcf0).ready entity=mon.2 client_cookie=4f8c54c7cdf43202 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:39.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.598 7f59a67fc700 1 -- 172.21.15.79:0/3310054912 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59a80e5700 con 0x7f59a80f5550 2021-04-09T18:26:39.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.598 7f59a67fc700 1 -- 172.21.15.79:0/3310054912 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5990009790 con 0x7f59a80f5550 2021-04-09T18:26:39.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.598 7f59a67fc700 1 -- 172.21.15.79:0/3310054912 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59a0001bb0 con 0x7f59a80f5550 2021-04-09T18:26:39.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.598 7f59adb6d700 1 -- 172.21.15.79:0/3310054912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a80f5550 msgr2=0x7f59a80f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.598 7f59adb6d700 1 --2- 172.21.15.79:0/3310054912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a80f5550 0x7f59a80f64e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f59a0001df0 tx=0x7f599000bcf0).stop 2021-04-09T18:26:39.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.598 7f59adb6d700 1 -- 172.21.15.79:0/3310054912 shutdown_connections 2021-04-09T18:26:39.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.598 7f59adb6d700 1 --2- 172.21.15.79:0/3310054912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a80f5550 0x7f59a80f64e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.598 7f59adb6d700 1 -- 172.21.15.79:0/3310054912 >> 172.21.15.79:0/3310054912 conn(0x7f59a80e6010 msgr2=0x7f59a80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:39.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.598 7f59adb6d700 1 -- 172.21.15.79:0/3310054912 shutdown_connections 2021-04-09T18:26:39.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.598 7f59adb6d700 1 -- 172.21.15.79:0/3310054912 wait complete. 2021-04-09T18:26:39.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59adb6d700 1 Processor -- start 2021-04-09T18:26:39.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59adb6d700 1 -- start start 2021-04-09T18:26:39.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59adb6d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a80994b0 0x7f59a80d5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59adb6d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59a80d5790 0x7f59a80b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59adb6d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59a8099900 0x7f59a80b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59adb6d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a81c3df0 con 0x7f59a8099900 2021-04-09T18:26:39.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59adb6d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a80978b0 con 0x7f59a80d5790 2021-04-09T18:26:39.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59adb6d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a8099d50 con 0x7f59a80994b0 2021-04-09T18:26:39.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59a7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59a8099900 0x7f59a80b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59a7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59a8099900 0x7f59a80b1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56336/0 (socket says 172.21.15.79:56336) 2021-04-09T18:26:39.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59a7fff700 1 -- 172.21.15.79:0/619294106 learned_addr learned my addr 172.21.15.79:0/619294106 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:39.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59a6ffd700 1 --2- 172.21.15.79:0/619294106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59a80d5790 0x7f59a80b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59a77fe700 1 --2- 172.21.15.79:0/619294106 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a80994b0 0x7f59a80d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59a7fff700 1 -- 172.21.15.79:0/619294106 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a80994b0 msgr2=0x7f59a80d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59a7fff700 1 --2- 172.21.15.79:0/619294106 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a80994b0 0x7f59a80d5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59a7fff700 1 -- 172.21.15.79:0/619294106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59a80d5790 msgr2=0x7f59a80b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59a7fff700 1 --2- 172.21.15.79:0/619294106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59a80d5790 0x7f59a80b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59a7fff700 1 -- 172.21.15.79:0/619294106 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a81b19e0 con 0x7f59a8099900 2021-04-09T18:26:39.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59a77fe700 1 --2- 172.21.15.79:0/619294106 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a80994b0 0x7f59a80d5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:39.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59a7fff700 1 --2- 172.21.15.79:0/619294106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59a8099900 0x7f59a80b1100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f59a80d83f0 tx=0x7f59a000cb90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:39.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f599ffff700 1 -- 172.21.15.79:0/619294106 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59a81b19e0 con 0x7f59a8099900 2021-04-09T18:26:39.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f599ffff700 1 -- 172.21.15.79:0/619294106 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a0007170 con 0x7f59a8099900 2021-04-09T18:26:39.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59adb6d700 1 -- 172.21.15.79:0/619294106 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a80b1730 con 0x7f59a8099900 2021-04-09T18:26:39.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f599ffff700 1 -- 172.21.15.79:0/619294106 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59a00049d0 con 0x7f59a8099900 2021-04-09T18:26:39.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59adb6d700 1 -- 172.21.15.79:0/619294106 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a8096250 con 0x7f59a8099900 2021-04-09T18:26:39.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f599ffff700 1 -- 172.21.15.79:0/619294106 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f59a0004bd0 con 0x7f59a8099900 2021-04-09T18:26:39.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f599ffff700 1 --2- 172.21.15.79:0/619294106 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f598c029100 0x7f598c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f599ffff700 1 -- 172.21.15.79:0/619294106 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f59a00396c0 con 0x7f59a8099900 2021-04-09T18:26:39.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.602 7f59a77fe700 1 --2- 172.21.15.79:0/619294106 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f598c029100 0x7f598c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.606 7f59a77fe700 1 --2- 172.21.15.79:0/619294106 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f598c029100 0x7f598c02b650 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:39.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.610 7f59adb6d700 1 -- 172.21.15.79:0/619294106 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a80e39f0 con 0x7f59a8099900 2021-04-09T18:26:39.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.614 7f599ffff700 1 -- 172.21.15.79:0/619294106 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f59a00045d0 con 0x7f59a8099900 2021-04-09T18:26:39.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.770 7f59adb6d700 1 -- 172.21.15.79:0/619294106 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f59a80a1c90 con 0x7f59a8099900 2021-04-09T18:26:39.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.770 7f599ffff700 1 -- 172.21.15.79:0/619294106 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f59a80f76f0 con 0x7f59a8099900 2021-04-09T18:26:39.779 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:39.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.774 7f59adb6d700 1 -- 172.21.15.79:0/619294106 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f598c029100 msgr2=0x7f598c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.774 7f59adb6d700 1 --2- 172.21.15.79:0/619294106 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f598c029100 0x7f598c02b650 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.774 7f59adb6d700 1 -- 172.21.15.79:0/619294106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59a8099900 msgr2=0x7f59a80b1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.774 7f59adb6d700 1 --2- 172.21.15.79:0/619294106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59a8099900 0x7f59a80b1100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f59a80d83f0 tx=0x7f59a000cb90).stop 2021-04-09T18:26:39.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.774 7f59adb6d700 1 -- 172.21.15.79:0/619294106 shutdown_connections 2021-04-09T18:26:39.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.774 7f59adb6d700 1 --2- 172.21.15.79:0/619294106 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f598c029100 0x7f598c02b650 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.774 7f59adb6d700 1 --2- 172.21.15.79:0/619294106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59a8099900 0x7f59a80b1100 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.774 7f59adb6d700 1 --2- 172.21.15.79:0/619294106 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a80994b0 0x7f59a80d5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.774 7f59adb6d700 1 --2- 172.21.15.79:0/619294106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59a80d5790 0x7f59a80b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.774 7f59adb6d700 1 -- 172.21.15.79:0/619294106 >> 172.21.15.79:0/619294106 conn(0x7f59a80ba840 msgr2=0x7f59a80a2640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:39.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.774 7f59adb6d700 1 -- 172.21.15.79:0/619294106 shutdown_connections 2021-04-09T18:26:39.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.774 7f59adb6d700 1 -- 172.21.15.79:0/619294106 wait complete. 2021-04-09T18:26:39.791 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:39.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.874 7ff0b518d700 1 Processor -- start 2021-04-09T18:26:39.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.874 7ff0b518d700 1 -- start start 2021-04-09T18:26:39.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0b518d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff0b00e9ad0 0x7ff0b009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0b518d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0b01c8000 0x7ff0b01ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0b518d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b00fbb10 con 0x7ff0b00f5510 2021-04-09T18:26:39.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0b518d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b01c3db0 con 0x7ff0b01c8000 2021-04-09T18:26:39.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0b518d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b00e9f20 con 0x7ff0b00e9ad0 2021-04-09T18:26:39.898 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0af59e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0b01c8000 0x7ff0b01ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.898 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0af59e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0b01c8000 0x7ff0b01ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56344/0 (socket says 172.21.15.79:56344) 2021-04-09T18:26:39.898 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0af59e700 1 -- 172.21.15.79:0/59514696 learned_addr learned my addr 172.21.15.79:0/59514696 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:39.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0ae59c700 1 --2- 172.21.15.79:0/59514696 >> v2:172.21.15.89:3300/0 conn(0x7ff0b00e9ad0 0x7ff0b009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0af59e700 1 -- 172.21.15.79:0/59514696 >> v2:172.21.15.89:3300/0 conn(0x7ff0b00e9ad0 msgr2=0x7ff0b009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:39.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0af59e700 1 --2- 172.21.15.79:0/59514696 >> v2:172.21.15.89:3300/0 conn(0x7ff0b00e9ad0 0x7ff0b009f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0af59e700 1 -- 172.21.15.79:0/59514696 >> v1:172.21.15.89:6789/0 conn(0x7ff0b00f5510 legacy=0x7ff0b00f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0af59e700 1 -- 172.21.15.79:0/59514696 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b00e56c0 con 0x7ff0b01c8000 2021-04-09T18:26:39.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0af59e700 1 --2- 172.21.15.79:0/59514696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0b01c8000 0x7ff0b01ca460 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7ff0a80032b0 tx=0x7ff0a800b3c0).ready entity=mon.0 client_cookie=3f49409ec73ecf2d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:39.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0add9b700 1 -- 172.21.15.79:0/59514696 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff0b00e56c0 con 0x7ff0b01c8000 2021-04-09T18:26:39.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0add9b700 1 -- 172.21.15.79:0/59514696 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a800bc20 con 0x7ff0b01c8000 2021-04-09T18:26:39.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0add9b700 1 -- 172.21.15.79:0/59514696 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff0a8002020 con 0x7ff0b01c8000 2021-04-09T18:26:39.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0b518d700 1 -- 172.21.15.79:0/59514696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0b01c8000 msgr2=0x7ff0b01ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0b518d700 1 --2- 172.21.15.79:0/59514696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0b01c8000 0x7ff0b01ca460 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7ff0a80032b0 tx=0x7ff0a800b3c0).stop 2021-04-09T18:26:39.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0b518d700 1 -- 172.21.15.79:0/59514696 shutdown_connections 2021-04-09T18:26:39.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0b518d700 1 --2- 172.21.15.79:0/59514696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0b01c8000 0x7ff0b01ca460 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0b518d700 1 --2- 172.21.15.79:0/59514696 >> v2:172.21.15.89:3300/0 conn(0x7ff0b00e9ad0 0x7ff0b009f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0b518d700 1 -- 172.21.15.79:0/59514696 >> 172.21.15.79:0/59514696 conn(0x7ff0b00e5fd0 msgr2=0x7ff0b00e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:39.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0b518d700 1 -- 172.21.15.79:0/59514696 shutdown_connections 2021-04-09T18:26:39.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.878 7ff0b518d700 1 -- 172.21.15.79:0/59514696 wait complete. 2021-04-09T18:26:39.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.882 7ff0b518d700 1 Processor -- start 2021-04-09T18:26:39.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.882 7ff0b518d700 1 -- start start 2021-04-09T18:26:39.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.882 7ff0b518d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0b00bd610 0x7ff0b008f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.882 7ff0b518d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0b008f740 0x7ff0b019cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.882 7ff0b518d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0b019d150 0x7ff0b00d1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.882 7ff0b518d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b00bd310 con 0x7ff0b008f740 2021-04-09T18:26:39.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.882 7ff0b518d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b00bcea0 con 0x7ff0b019d150 2021-04-09T18:26:39.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.882 7ff0b518d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b019d5a0 con 0x7ff0b00bd610 2021-04-09T18:26:39.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.882 7ff0ae59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0b008f740 0x7ff0b019cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.882 7ff0ae59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0b008f740 0x7ff0b019cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56348/0 (socket says 172.21.15.79:56348) 2021-04-09T18:26:39.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.882 7ff0ae59c700 1 -- 172.21.15.79:0/3296835832 learned_addr learned my addr 172.21.15.79:0/3296835832 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:39.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.882 7ff0aed9d700 1 --2- 172.21.15.79:0/3296835832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0b00bd610 0x7ff0b008f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.886 7ff0af59e700 1 --2- 172.21.15.79:0/3296835832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0b019d150 0x7ff0b00d1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.886 7ff0ae59c700 1 -- 172.21.15.79:0/3296835832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0b00bd610 msgr2=0x7ff0b008f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.886 7ff0ae59c700 1 --2- 172.21.15.79:0/3296835832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0b00bd610 0x7ff0b008f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.886 7ff0ae59c700 1 -- 172.21.15.79:0/3296835832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0b019d150 msgr2=0x7ff0b00d1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.886 7ff0ae59c700 1 --2- 172.21.15.79:0/3296835832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0b019d150 0x7ff0b00d1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.886 7ff0ae59c700 1 -- 172.21.15.79:0/3296835832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b019d7d0 con 0x7ff0b008f740 2021-04-09T18:26:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.886 7ff0ae59c700 1 --2- 172.21.15.79:0/3296835832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0b008f740 0x7ff0b019cb20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7ff0a400c000 tx=0x7ff0a400ef70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:39.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.886 7ff09f7fe700 1 -- 172.21.15.79:0/3296835832 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff0b019d7d0 con 0x7ff0b008f740 2021-04-09T18:26:39.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.886 7ff09f7fe700 1 -- 172.21.15.79:0/3296835832 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a400cb80 con 0x7ff0b008f740 2021-04-09T18:26:39.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.886 7ff09f7fe700 1 -- 172.21.15.79:0/3296835832 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff0a400f040 con 0x7ff0b008f740 2021-04-09T18:26:39.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.886 7ff0b518d700 1 -- 172.21.15.79:0/3296835832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b00d2610 con 0x7ff0b008f740 2021-04-09T18:26:39.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.886 7ff0b518d700 1 -- 172.21.15.79:0/3296835832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b00d2b20 con 0x7ff0b008f740 2021-04-09T18:26:39.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.886 7ff09f7fe700 1 -- 172.21.15.79:0/3296835832 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff0a4011070 con 0x7ff0b008f740 2021-04-09T18:26:39.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.886 7ff09f7fe700 1 --2- 172.21.15.79:0/3296835832 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff094029100 0x7ff09402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:39.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.886 7ff09f7fe700 1 -- 172.21.15.79:0/3296835832 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7ff0a4010040 con 0x7ff0b008f740 2021-04-09T18:26:39.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.886 7ff0aed9d700 1 --2- 172.21.15.79:0/3296835832 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff094029100 0x7ff09402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:39.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.886 7ff0aed9d700 1 --2- 172.21.15.79:0/3296835832 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff094029100 0x7ff09402b650 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:39.912 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.890 7ff0b518d700 1 -- 172.21.15.79:0/3296835832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b00e39d0 con 0x7ff0b008f740 2021-04-09T18:26:39.913 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:39.894 7ff09f7fe700 1 -- 172.21.15.79:0/3296835832 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff0a400c780 con 0x7ff0b008f740 2021-04-09T18:26:40.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.054 7ff0b518d700 1 -- 172.21.15.79:0/3296835832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0b00a1cb0 con 0x7ff0b008f740 2021-04-09T18:26:40.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.058 7ff09f7fe700 1 -- 172.21.15.79:0/3296835832 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14254 (secure 0 0 0) 0x7ff0a4000bf0 con 0x7ff0b008f740 2021-04-09T18:26:40.065 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:40.066 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:14.412296","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:26:09.311735","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:26:12.130710","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:26:40.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.062 7ff0b518d700 1 -- 172.21.15.79:0/3296835832 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff094029100 msgr2=0x7ff09402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.062 7ff0b518d700 1 --2- 172.21.15.79:0/3296835832 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff094029100 0x7ff09402b650 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.062 7ff0b518d700 1 -- 172.21.15.79:0/3296835832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0b008f740 msgr2=0x7ff0b019cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.062 7ff0b518d700 1 --2- 172.21.15.79:0/3296835832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0b008f740 0x7ff0b019cb20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7ff0a400c000 tx=0x7ff0a400ef70).stop 2021-04-09T18:26:40.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.062 7ff0b518d700 1 -- 172.21.15.79:0/3296835832 shutdown_connections 2021-04-09T18:26:40.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.062 7ff0b518d700 1 --2- 172.21.15.79:0/3296835832 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff094029100 0x7ff09402b650 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.062 7ff0b518d700 1 --2- 172.21.15.79:0/3296835832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0b019d150 0x7ff0b00d1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.062 7ff0b518d700 1 --2- 172.21.15.79:0/3296835832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0b00bd610 0x7ff0b008f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.062 7ff0b518d700 1 --2- 172.21.15.79:0/3296835832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0b008f740 0x7ff0b019cb20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.062 7ff0b518d700 1 -- 172.21.15.79:0/3296835832 >> 172.21.15.79:0/3296835832 conn(0x7ff0b0095260 msgr2=0x7ff0b0094850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:40.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.062 7ff0b518d700 1 -- 172.21.15.79:0/3296835832 shutdown_connections 2021-04-09T18:26:40.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.062 7ff0b518d700 1 -- 172.21.15.79:0/3296835832 wait complete. 2021-04-09T18:26:40.079 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:26:09.311735', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:26:12.130710', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:26:40.080 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:26:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.166 7f72542c0700 1 Processor -- start 2021-04-09T18:26:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.166 7f72542c0700 1 -- start start 2021-04-09T18:26:40.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f72542c0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f724c1c9050 0x7f724c1cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f72542c0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f724c0fbb50 con 0x7f724c0f5550 2021-04-09T18:26:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f72542c0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f724c09f910 con 0x7f724c0e9b10 2021-04-09T18:26:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f72542c0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724c1c3df0 con 0x7f724c1c9050 2021-04-09T18:26:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7252064700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f724c0f5550 0x7f724c0f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51064/0 (socket says 172.21.15.79:51064) 2021-04-09T18:26:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7252064700 1 -- 172.21.15.79:0/2966956360 learned_addr learned my addr 172.21.15.79:0/2966956360 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7252865700 1 --2- 172.21.15.79:0/2966956360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f724c1c9050 0x7f724c1cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251062700 1 -- 172.21.15.79:0/2966956360 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3908416651 0 0) 0x7f72480010d0 con 0x7f724c0f5550 2021-04-09T18:26:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251062700 1 -- 172.21.15.79:0/2966956360 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7238003240 con 0x7f724c0f5550 2021-04-09T18:26:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251062700 1 -- 172.21.15.79:0/2966956360 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199079119 0 0) 0x7f723c0010d0 con 0x7f724c0e9b10 2021-04-09T18:26:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251062700 1 -- 172.21.15.79:0/2966956360 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7238003620 con 0x7f724c0e9b10 2021-04-09T18:26:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251062700 1 -- 172.21.15.79:0/2966956360 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1850713591 0 0) 0x7f7248001650 con 0x7f724c0f5550 2021-04-09T18:26:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251062700 1 -- 172.21.15.79:0/2966956360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f724c1c9050 msgr2=0x7f724c1cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251062700 1 --2- 172.21.15.79:0/2966956360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f724c1c9050 0x7f724c1cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251062700 1 -- 172.21.15.79:0/2966956360 >> v1:172.21.15.89:6789/0 conn(0x7f724c0e9b10 legacy=0x7f724c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251062700 1 -- 172.21.15.79:0/2966956360 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724c0e5700 con 0x7f724c0f5550 2021-04-09T18:26:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251062700 1 -- 172.21.15.79:0/2966956360 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f7248001bb0 con 0x7f724c0f5550 2021-04-09T18:26:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251062700 1 -- 172.21.15.79:0/2966956360 >> v1:172.21.15.79:6789/0 conn(0x7f724c0f5550 legacy=0x7f724c0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251062700 1 --2- 172.21.15.79:0/2966956360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7238003d40 0x7f72380045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:40.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251062700 1 --2- 172.21.15.79:0/2966956360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7238004bd0 0x7f72380097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:40.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251062700 1 --2- 172.21.15.79:0/2966956360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7238005020 0x7f723800be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:40.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251062700 1 -- 172.21.15.79:0/2966956360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724c1c3df0 con 0x7f7238005020 2021-04-09T18:26:40.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251062700 1 -- 172.21.15.79:0/2966956360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7238050460 con 0x7f7238003d40 2021-04-09T18:26:40.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251062700 1 -- 172.21.15.79:0/2966956360 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7238050610 con 0x7f7238004bd0 2021-04-09T18:26:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7252865700 1 --2- 172.21.15.79:0/2966956360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7238005020 0x7f723800be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7252064700 1 --2- 172.21.15.79:0/2966956360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7238003d40 0x7f72380045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251863700 1 --2- 172.21.15.79:0/2966956360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7238004bd0 0x7f72380097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7252865700 1 -- 172.21.15.79:0/2966956360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7238004bd0 msgr2=0x7f72380097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7252865700 1 --2- 172.21.15.79:0/2966956360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7238004bd0 0x7f72380097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7252865700 1 -- 172.21.15.79:0/2966956360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7238003d40 msgr2=0x7f72380045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7252865700 1 --2- 172.21.15.79:0/2966956360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7238003d40 0x7f72380045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7252865700 1 -- 172.21.15.79:0/2966956360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7238050880 con 0x7f7238005020 2021-04-09T18:26:40.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7252865700 1 --2- 172.21.15.79:0/2966956360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7238005020 0x7f723800be20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f724400c000 tx=0x7f7244009f70).ready entity=mon.0 client_cookie=d65c7fffcc406c5f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:40.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251062700 1 -- 172.21.15.79:0/2966956360 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7238050880 con 0x7f7238005020 2021-04-09T18:26:40.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251062700 1 -- 172.21.15.79:0/2966956360 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724400ecf0 con 0x7f7238005020 2021-04-09T18:26:40.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7251062700 1 -- 172.21.15.79:0/2966956360 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f724400f040 con 0x7f7238005020 2021-04-09T18:26:40.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f72542c0700 1 -- 172.21.15.79:0/2966956360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7238005020 msgr2=0x7f723800be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f72542c0700 1 --2- 172.21.15.79:0/2966956360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7238005020 0x7f723800be20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f724400c000 tx=0x7f7244009f70).stop 2021-04-09T18:26:40.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.170 7f7252865700 1 -- 172.21.15.79:0/2966956360 reap_dead start 2021-04-09T18:26:40.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.174 7f72542c0700 1 -- 172.21.15.79:0/2966956360 shutdown_connections 2021-04-09T18:26:40.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.174 7f72542c0700 1 -- 172.21.15.79:0/2966956360 >> 172.21.15.79:0/2966956360 conn(0x7f724c0e6010 msgr2=0x7f724c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:40.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.174 7f72542c0700 1 -- 172.21.15.79:0/2966956360 shutdown_connections 2021-04-09T18:26:40.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.174 7f72542c0700 1 -- 172.21.15.79:0/2966956360 wait complete. 2021-04-09T18:26:40.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.174 7f72542c0700 1 Processor -- start 2021-04-09T18:26:40.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.174 7f72542c0700 1 -- start start 2021-04-09T18:26:40.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f72542c0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f724c19e580 0x7f724c0c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:40.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f72542c0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f724c0b0bc0 0x7f724c0c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:40.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f72542c0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f724c0b1010 0x7f724c0c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:40.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f72542c0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724c0e9f60 con 0x7f724c19e580 2021-04-09T18:26:40.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f72542c0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724c0af220 con 0x7f724c0b1010 2021-04-09T18:26:40.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f72542c0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724c0af520 con 0x7f724c0b0bc0 2021-04-09T18:26:40.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f7252064700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f724c19e580 0x7f724c0c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:40.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f7252064700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f724c19e580 0x7f724c0c50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56370/0 (socket says 172.21.15.79:56370) 2021-04-09T18:26:40.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f7252064700 1 -- 172.21.15.79:0/4988963 learned_addr learned my addr 172.21.15.79:0/4988963 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:40.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f7251863700 1 --2- 172.21.15.79:0/4988963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f724c0b0bc0 0x7f724c0c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:40.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f7252865700 1 --2- 172.21.15.79:0/4988963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f724c0b1010 0x7f724c0c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:40.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f7252064700 1 -- 172.21.15.79:0/4988963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f724c0b0bc0 msgr2=0x7f724c0c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f7252064700 1 --2- 172.21.15.79:0/4988963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f724c0b0bc0 0x7f724c0c6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f7252064700 1 -- 172.21.15.79:0/4988963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f724c0b1010 msgr2=0x7f724c0c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f7252064700 1 --2- 172.21.15.79:0/4988963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f724c0b1010 0x7f724c0c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f7252064700 1 -- 172.21.15.79:0/4988963 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724c0aedb0 con 0x7f724c19e580 2021-04-09T18:26:40.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f7252064700 1 --2- 172.21.15.79:0/4988963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f724c19e580 0x7f724c0c50e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f724c0af040 tx=0x7f724800f1d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:40.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f7242ffd700 1 -- 172.21.15.79:0/4988963 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f724c0aedb0 con 0x7f724c19e580 2021-04-09T18:26:40.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f7242ffd700 1 -- 172.21.15.79:0/4988963 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724800fc90 con 0x7f724c19e580 2021-04-09T18:26:40.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f72542c0700 1 -- 172.21.15.79:0/4988963 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f724c0c5710 con 0x7f724c19e580 2021-04-09T18:26:40.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f7242ffd700 1 -- 172.21.15.79:0/4988963 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7248010040 con 0x7f724c19e580 2021-04-09T18:26:40.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f72542c0700 1 -- 172.21.15.79:0/4988963 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f724c0c7c60 con 0x7f724c19e580 2021-04-09T18:26:40.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f7242ffd700 1 -- 172.21.15.79:0/4988963 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7248012070 con 0x7f724c19e580 2021-04-09T18:26:40.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f7242ffd700 1 --2- 172.21.15.79:0/4988963 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7234029100 0x7f723402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:40.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f7242ffd700 1 -- 172.21.15.79:0/4988963 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f7248011040 con 0x7f724c19e580 2021-04-09T18:26:40.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f7251863700 1 --2- 172.21.15.79:0/4988963 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7234029100 0x7f723402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:40.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.178 7f7251863700 1 --2- 172.21.15.79:0/4988963 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7234029100 0x7f723402b650 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:40.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.182 7f72542c0700 1 -- 172.21.15.79:0/4988963 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f724c0e39f0 con 0x7f724c19e580 2021-04-09T18:26:40.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.190 7f7242ffd700 1 -- 172.21.15.79:0/4988963 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f724800f890 con 0x7f724c19e580 2021-04-09T18:26:40.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.350 7f72542c0700 1 -- 172.21.15.79:0/4988963 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f724c0a1c90 con 0x7f724c19e580 2021-04-09T18:26:40.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.354 7f7242ffd700 1 -- 172.21.15.79:0/4988963 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7248000bf0 con 0x7f724c19e580 2021-04-09T18:26:40.361 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:40.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.358 7f72542c0700 1 -- 172.21.15.79:0/4988963 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7234029100 msgr2=0x7f723402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.358 7f72542c0700 1 --2- 172.21.15.79:0/4988963 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7234029100 0x7f723402b650 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.358 7f72542c0700 1 -- 172.21.15.79:0/4988963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f724c19e580 msgr2=0x7f724c0c50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.358 7f72542c0700 1 --2- 172.21.15.79:0/4988963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f724c19e580 0x7f724c0c50e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f724c0af040 tx=0x7f724800f1d0).stop 2021-04-09T18:26:40.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.358 7f72542c0700 1 -- 172.21.15.79:0/4988963 shutdown_connections 2021-04-09T18:26:40.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.358 7f72542c0700 1 --2- 172.21.15.79:0/4988963 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7234029100 0x7f723402b650 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.358 7f72542c0700 1 --2- 172.21.15.79:0/4988963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f724c0b1010 0x7f724c0c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.358 7f72542c0700 1 --2- 172.21.15.79:0/4988963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f724c19e580 0x7f724c0c50e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.358 7f72542c0700 1 --2- 172.21.15.79:0/4988963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f724c0b0bc0 0x7f724c0c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.358 7f72542c0700 1 -- 172.21.15.79:0/4988963 >> 172.21.15.79:0/4988963 conn(0x7f724c0ba880 msgr2=0x7f724c0a2710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:40.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.358 7f72542c0700 1 -- 172.21.15.79:0/4988963 shutdown_connections 2021-04-09T18:26:40.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.358 7f72542c0700 1 -- 172.21.15.79:0/4988963 wait complete. 2021-04-09T18:26:40.380 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:26:40.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb059195700 1 Processor -- start 2021-04-09T18:26:40.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb059195700 1 -- start start 2021-04-09T18:26:40.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb059195700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0541c9050 0x7fb0541cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:40.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb059195700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0540fbb50 con 0x7fb0540e9b10 2021-04-09T18:26:40.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb059195700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb05409f910 con 0x7fb0540f5550 2021-04-09T18:26:40.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb059195700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0541c3df0 con 0x7fb0541c9050 2021-04-09T18:26:40.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb05259c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb0540e9b10 0x7fb05409f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51084/0 (socket says 172.21.15.79:51084) 2021-04-09T18:26:40.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb05259c700 1 -- 172.21.15.79:0/4039841979 learned_addr learned my addr 172.21.15.79:0/4039841979 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:40.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb05359e700 1 --2- 172.21.15.79:0/4039841979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0541c9050 0x7fb0541cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:40.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb051d9b700 1 -- 172.21.15.79:0/4039841979 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469367847 0 0) 0x7fb03c0010d0 con 0x7fb0540e9b10 2021-04-09T18:26:40.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb051d9b700 1 -- 172.21.15.79:0/4039841979 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb034003240 con 0x7fb0540e9b10 2021-04-09T18:26:40.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb051d9b700 1 -- 172.21.15.79:0/4039841979 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509578 0 0) 0x7fb04c0010d0 con 0x7fb0540f5550 2021-04-09T18:26:40.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb051d9b700 1 -- 172.21.15.79:0/4039841979 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb034003620 con 0x7fb0540f5550 2021-04-09T18:26:40.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb05359e700 1 -- 172.21.15.79:0/4039841979 >> v1:172.21.15.89:6789/0 conn(0x7fb0540f5550 legacy=0x7fb0540f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb05359e700 1 -- 172.21.15.79:0/4039841979 >> v1:172.21.15.79:6789/0 conn(0x7fb0540e9b10 legacy=0x7fb05409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb051d9b700 1 -- 172.21.15.79:0/4039841979 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3893792599 0 0) 0x7fb03c001650 con 0x7fb0540e9b10 2021-04-09T18:26:40.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb05359e700 1 -- 172.21.15.79:0/4039841979 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0540e5700 con 0x7fb0541c9050 2021-04-09T18:26:40.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb05359e700 1 --2- 172.21.15.79:0/4039841979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0541c9050 0x7fb0541cb4b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb03c001980 tx=0x7fb04400b0e0).ready entity=mon.2 client_cookie=d35ff6d3350efcf2 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:40.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb051d9b700 1 -- 172.21.15.79:0/4039841979 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb0540e5700 con 0x7fb0541c9050 2021-04-09T18:26:40.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb051d9b700 1 -- 172.21.15.79:0/4039841979 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04400b9b0 con 0x7fb0541c9050 2021-04-09T18:26:40.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb051d9b700 1 -- 172.21.15.79:0/4039841979 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb044002020 con 0x7fb0541c9050 2021-04-09T18:26:40.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb059195700 1 -- 172.21.15.79:0/4039841979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0541c9050 msgr2=0x7fb0541cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb059195700 1 --2- 172.21.15.79:0/4039841979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0541c9050 0x7fb0541cb4b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb03c001980 tx=0x7fb04400b0e0).stop 2021-04-09T18:26:40.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb059195700 1 -- 172.21.15.79:0/4039841979 shutdown_connections 2021-04-09T18:26:40.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb059195700 1 --2- 172.21.15.79:0/4039841979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0541c9050 0x7fb0541cb4b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.462 7fb059195700 1 -- 172.21.15.79:0/4039841979 >> 172.21.15.79:0/4039841979 conn(0x7fb0540e6010 msgr2=0x7fb0540e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:40.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.466 7fb059195700 1 -- 172.21.15.79:0/4039841979 shutdown_connections 2021-04-09T18:26:40.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.466 7fb059195700 1 -- 172.21.15.79:0/4039841979 wait complete. 2021-04-09T18:26:40.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.466 7fb059195700 1 Processor -- start 2021-04-09T18:26:40.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.466 7fb059195700 1 -- start start 2021-04-09T18:26:40.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.466 7fb059195700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0540a4020 0x7fb0540a3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:40.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.466 7fb059195700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0540c1710 0x7fb0540d2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:40.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.466 7fb059195700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0540d3540 0x7fb0540c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:40.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.466 7fb059195700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb054088590 con 0x7fb0540c1710 2021-04-09T18:26:40.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.466 7fb059195700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0540e9f60 con 0x7fb0540a4020 2021-04-09T18:26:40.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.466 7fb059195700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0541a1d90 con 0x7fb0540d3540 2021-04-09T18:26:40.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.466 7fb05259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0540c1710 0x7fb0540d2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:40.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.466 7fb05259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0540c1710 0x7fb0540d2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56382/0 (socket says 172.21.15.79:56382) 2021-04-09T18:26:40.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.466 7fb05259c700 1 -- 172.21.15.79:0/2441462074 learned_addr learned my addr 172.21.15.79:0/2441462074 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:40.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.466 7fb052d9d700 1 --2- 172.21.15.79:0/2441462074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0540a4020 0x7fb0540a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:40.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.466 7fb05359e700 1 --2- 172.21.15.79:0/2441462074 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0540d3540 0x7fb0540c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:40.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.470 7fb05259c700 1 -- 172.21.15.79:0/2441462074 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0540d3540 msgr2=0x7fb0540c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.470 7fb05259c700 1 --2- 172.21.15.79:0/2441462074 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0540d3540 0x7fb0540c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.470 7fb05259c700 1 -- 172.21.15.79:0/2441462074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0540a4020 msgr2=0x7fb0540a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.470 7fb05259c700 1 --2- 172.21.15.79:0/2441462074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0540a4020 0x7fb0540a3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.470 7fb05259c700 1 -- 172.21.15.79:0/2441462074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0540a3a70 con 0x7fb0540c1710 2021-04-09T18:26:40.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.470 7fb05259c700 1 --2- 172.21.15.79:0/2441462074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0540c1710 0x7fb0540d2f10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fb0540d81b0 tx=0x7fb03c00cec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:40.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.470 7fb04b7fe700 1 -- 172.21.15.79:0/2441462074 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb0540a3a70 con 0x7fb0540c1710 2021-04-09T18:26:40.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.470 7fb04b7fe700 1 -- 172.21.15.79:0/2441462074 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c007320 con 0x7fb0540c1710 2021-04-09T18:26:40.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.470 7fb059195700 1 -- 172.21.15.79:0/2441462074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0541a1920 con 0x7fb0540c1710 2021-04-09T18:26:40.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.470 7fb04b7fe700 1 -- 172.21.15.79:0/2441462074 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb03c0057e0 con 0x7fb0540c1710 2021-04-09T18:26:40.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.470 7fb059195700 1 -- 172.21.15.79:0/2441462074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0540c4090 con 0x7fb0540c1710 2021-04-09T18:26:40.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.470 7fb04b7fe700 1 -- 172.21.15.79:0/2441462074 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb03c01a060 con 0x7fb0540c1710 2021-04-09T18:26:40.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.470 7fb04b7fe700 1 --2- 172.21.15.79:0/2441462074 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb02c029100 0x7fb02c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:40.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.470 7fb04b7fe700 1 -- 172.21.15.79:0/2441462074 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fb03c0390a0 con 0x7fb0540c1710 2021-04-09T18:26:40.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.470 7fb052d9d700 1 --2- 172.21.15.79:0/2441462074 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb02c029100 0x7fb02c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:40.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.470 7fb052d9d700 1 --2- 172.21.15.79:0/2441462074 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb02c029100 0x7fb02c02b650 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:40.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.474 7fb059195700 1 -- 172.21.15.79:0/2441462074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0540e39f0 con 0x7fb0540c1710 2021-04-09T18:26:40.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.486 7fb04b7fe700 1 -- 172.21.15.79:0/2441462074 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb03c007110 con 0x7fb0540c1710 2021-04-09T18:26:40.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.642 7fb059195700 1 -- 172.21.15.79:0/2441462074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fb0540f5b50 con 0x7fb0540c1710 2021-04-09T18:26:40.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.646 7fb04b7fe700 1 -- 172.21.15.79:0/2441462074 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb0540e5cd0 con 0x7fb0540c1710 2021-04-09T18:26:40.653 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:40.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.650 7fb059195700 1 -- 172.21.15.79:0/2441462074 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb02c029100 msgr2=0x7fb02c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.650 7fb059195700 1 --2- 172.21.15.79:0/2441462074 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb02c029100 0x7fb02c02b650 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.650 7fb059195700 1 -- 172.21.15.79:0/2441462074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0540c1710 msgr2=0x7fb0540d2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.650 7fb059195700 1 --2- 172.21.15.79:0/2441462074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0540c1710 0x7fb0540d2f10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fb0540d81b0 tx=0x7fb03c00cec0).stop 2021-04-09T18:26:40.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.650 7fb059195700 1 -- 172.21.15.79:0/2441462074 shutdown_connections 2021-04-09T18:26:40.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.650 7fb059195700 1 --2- 172.21.15.79:0/2441462074 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb02c029100 0x7fb02c02b650 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.650 7fb059195700 1 --2- 172.21.15.79:0/2441462074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0540a4020 0x7fb0540a3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.650 7fb059195700 1 --2- 172.21.15.79:0/2441462074 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0540d3540 0x7fb0540c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.650 7fb059195700 1 --2- 172.21.15.79:0/2441462074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0540c1710 0x7fb0540d2f10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.650 7fb059195700 1 -- 172.21.15.79:0/2441462074 >> 172.21.15.79:0/2441462074 conn(0x7fb05409aa70 msgr2=0x7fb0540a2490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:40.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.650 7fb059195700 1 -- 172.21.15.79:0/2441462074 shutdown_connections 2021-04-09T18:26:40.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.650 7fb059195700 1 -- 172.21.15.79:0/2441462074 wait complete. 2021-04-09T18:26:40.667 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:26:40.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83cd665700 1 Processor -- start 2021-04-09T18:26:40.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83cd665700 1 -- start start 2021-04-09T18:26:40.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83cd665700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c81c9050 0x7f83c81cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:40.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83cd665700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c80fbb50 con 0x7f83c80e9b10 2021-04-09T18:26:40.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83cd665700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c809f910 con 0x7f83c80f5550 2021-04-09T18:26:40.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83cd665700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c81c3df0 con 0x7f83c81c9050 2021-04-09T18:26:40.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83c6a46700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f83c80e9b10 0x7f83c809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51098/0 (socket says 172.21.15.79:51098) 2021-04-09T18:26:40.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83c6a46700 1 -- 172.21.15.79:0/3914770125 learned_addr learned my addr 172.21.15.79:0/3914770125 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:40.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83c7a48700 1 --2- 172.21.15.79:0/3914770125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c81c9050 0x7f83c81cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:40.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83c6245700 1 -- 172.21.15.79:0/3914770125 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473514605 0 0) 0x7f83bc0010d0 con 0x7f83c80e9b10 2021-04-09T18:26:40.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83c6245700 1 -- 172.21.15.79:0/3914770125 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83b0003240 con 0x7f83c80e9b10 2021-04-09T18:26:40.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83c6245700 1 -- 172.21.15.79:0/3914770125 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020642439 0 0) 0x7f83b80010d0 con 0x7f83c80f5550 2021-04-09T18:26:40.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83c6245700 1 -- 172.21.15.79:0/3914770125 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83b0003620 con 0x7f83c80f5550 2021-04-09T18:26:40.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83c7a48700 1 -- 172.21.15.79:0/3914770125 >> v1:172.21.15.89:6789/0 conn(0x7f83c80f5550 legacy=0x7f83c80f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83c7a48700 1 -- 172.21.15.79:0/3914770125 >> v1:172.21.15.79:6789/0 conn(0x7f83c80e9b10 legacy=0x7f83c809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83c7a48700 1 -- 172.21.15.79:0/3914770125 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c80e5700 con 0x7f83c81c9050 2021-04-09T18:26:40.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83c7a48700 1 --2- 172.21.15.79:0/3914770125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c81c9050 0x7f83c81cb4b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f83c00032b0 tx=0x7f83c000b0e0).ready entity=mon.2 client_cookie=53a5973bea42c7be server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83c6245700 1 -- 172.21.15.79:0/3914770125 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83c80e5700 con 0x7f83c81c9050 2021-04-09T18:26:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83c6245700 1 -- 172.21.15.79:0/3914770125 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c000baf0 con 0x7f83c81c9050 2021-04-09T18:26:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83c6245700 1 -- 172.21.15.79:0/3914770125 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83c0002020 con 0x7f83c81c9050 2021-04-09T18:26:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83cd665700 1 -- 172.21.15.79:0/3914770125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c81c9050 msgr2=0x7f83c81cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.758 7f83cd665700 1 --2- 172.21.15.79:0/3914770125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c81c9050 0x7f83c81cb4b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f83c00032b0 tx=0x7f83c000b0e0).stop 2021-04-09T18:26:40.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.762 7f83cd665700 1 -- 172.21.15.79:0/3914770125 shutdown_connections 2021-04-09T18:26:40.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.762 7f83cd665700 1 --2- 172.21.15.79:0/3914770125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c81c9050 0x7f83c81cb4b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.762 7f83cd665700 1 -- 172.21.15.79:0/3914770125 >> 172.21.15.79:0/3914770125 conn(0x7f83c80e6010 msgr2=0x7f83c80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:40.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.762 7f83cd665700 1 -- 172.21.15.79:0/3914770125 shutdown_connections 2021-04-09T18:26:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.762 7f83cd665700 1 -- 172.21.15.79:0/3914770125 wait complete. 2021-04-09T18:26:40.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.766 7f83cd665700 1 Processor -- start 2021-04-09T18:26:40.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.766 7f83cd665700 1 -- start start 2021-04-09T18:26:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.766 7f83cd665700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c808fc30 0x7f83c80d26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.766 7f83cd665700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c80d5c90 0x7f83c80ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.766 7f83cd665700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c80d60e0 0x7f83c81a66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.766 7f83cd665700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c80e9f60 con 0x7f83c808fc30 2021-04-09T18:26:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.766 7f83cd665700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c8090b80 con 0x7f83c80d60e0 2021-04-09T18:26:40.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.766 7f83cd665700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c8090080 con 0x7f83c80d5c90 2021-04-09T18:26:40.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.766 7f83c7247700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c808fc30 0x7f83c80d26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:40.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.766 7f83c7247700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c808fc30 0x7f83c80d26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56394/0 (socket says 172.21.15.79:56394) 2021-04-09T18:26:40.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.766 7f83c7247700 1 -- 172.21.15.79:0/2761740573 learned_addr learned my addr 172.21.15.79:0/2761740573 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:40.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.766 7f83c7a48700 1 --2- 172.21.15.79:0/2761740573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c80d60e0 0x7f83c81a66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:40.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.766 7f83c6a46700 1 --2- 172.21.15.79:0/2761740573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c80d5c90 0x7f83c80ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:40.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.766 7f83c7247700 1 -- 172.21.15.79:0/2761740573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c80d5c90 msgr2=0x7f83c80ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.766 7f83c7247700 1 --2- 172.21.15.79:0/2761740573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c80d5c90 0x7f83c80ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.766 7f83c7247700 1 -- 172.21.15.79:0/2761740573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c80d60e0 msgr2=0x7f83c81a66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.766 7f83c7247700 1 --2- 172.21.15.79:0/2761740573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c80d60e0 0x7f83c81a66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.766 7f83c7247700 1 -- 172.21.15.79:0/2761740573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c80b8e70 con 0x7f83c808fc30 2021-04-09T18:26:40.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.766 7f83c7247700 1 --2- 172.21.15.79:0/2761740573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c808fc30 0x7f83c80d26f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f83c808e990 tx=0x7f83b800ed20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:40.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.770 7f83affff700 1 -- 172.21.15.79:0/2761740573 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83c80b8e70 con 0x7f83c808fc30 2021-04-09T18:26:40.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.770 7f83affff700 1 -- 172.21.15.79:0/2761740573 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b800cac0 con 0x7f83c808fc30 2021-04-09T18:26:40.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.770 7f83cd665700 1 -- 172.21.15.79:0/2761740573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c80d2d20 con 0x7f83c808fc30 2021-04-09T18:26:40.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.770 7f83affff700 1 -- 172.21.15.79:0/2761740573 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83b8011470 con 0x7f83c808fc30 2021-04-09T18:26:40.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.770 7f83cd665700 1 -- 172.21.15.79:0/2761740573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c8090e80 con 0x7f83c808fc30 2021-04-09T18:26:40.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.770 7f83affff700 1 -- 172.21.15.79:0/2761740573 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f83b8011670 con 0x7f83c808fc30 2021-04-09T18:26:40.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.770 7f83affff700 1 --2- 172.21.15.79:0/2761740573 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f83a8029100 0x7f83a802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:40.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.770 7f83affff700 1 -- 172.21.15.79:0/2761740573 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f83b803be10 con 0x7f83c808fc30 2021-04-09T18:26:40.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.770 7f83c6a46700 1 --2- 172.21.15.79:0/2761740573 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f83a8029100 0x7f83a802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:40.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.770 7f83c6a46700 1 --2- 172.21.15.79:0/2761740573 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f83a8029100 0x7f83a802b650 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:40.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.770 7f83cd665700 1 -- 172.21.15.79:0/2761740573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c80e39f0 con 0x7f83c808fc30 2021-04-09T18:26:40.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.778 7f83affff700 1 -- 172.21.15.79:0/2761740573 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f83c8107f80 con 0x7f83c808fc30 2021-04-09T18:26:40.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.930 7f83cd665700 1 -- 172.21.15.79:0/2761740573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f83c80f5b50 con 0x7f83c808fc30 2021-04-09T18:26:40.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.930 7f83affff700 1 -- 172.21.15.79:0/2761740573 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f83b800c6c0 con 0x7f83c808fc30 2021-04-09T18:26:40.936 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:40.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.930 7f83cd665700 1 -- 172.21.15.79:0/2761740573 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f83a8029100 msgr2=0x7f83a802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.930 7f83cd665700 1 --2- 172.21.15.79:0/2761740573 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f83a8029100 0x7f83a802b650 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.930 7f83cd665700 1 -- 172.21.15.79:0/2761740573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c808fc30 msgr2=0x7f83c80d26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:40.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.930 7f83cd665700 1 --2- 172.21.15.79:0/2761740573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c808fc30 0x7f83c80d26f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f83c808e990 tx=0x7f83b800ed20).stop 2021-04-09T18:26:40.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.930 7f83cd665700 1 -- 172.21.15.79:0/2761740573 shutdown_connections 2021-04-09T18:26:40.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.930 7f83cd665700 1 --2- 172.21.15.79:0/2761740573 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f83a8029100 0x7f83a802b650 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.930 7f83cd665700 1 --2- 172.21.15.79:0/2761740573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c80d60e0 0x7f83c81a66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.930 7f83cd665700 1 --2- 172.21.15.79:0/2761740573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c808fc30 0x7f83c80d26f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.930 7f83cd665700 1 --2- 172.21.15.79:0/2761740573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c80d5c90 0x7f83c80ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:40.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.930 7f83cd665700 1 -- 172.21.15.79:0/2761740573 >> 172.21.15.79:0/2761740573 conn(0x7f83c808df30 msgr2=0x7f83c80d3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:40.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.930 7f83cd665700 1 -- 172.21.15.79:0/2761740573 shutdown_connections 2021-04-09T18:26:40.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:40.930 7f83cd665700 1 -- 172.21.15.79:0/2761740573 wait complete. 2021-04-09T18:26:40.948 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:41.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc28be40700 1 Processor -- start 2021-04-09T18:26:41.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc28be40700 1 -- start start 2021-04-09T18:26:41.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc28be40700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc2840f5520 0x7fc2840f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc28be40700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2841c8010 0x7fc2841ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc28be40700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2840fbb20 con 0x7fc2840e9ae0 2021-04-09T18:26:41.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc28be40700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2840e9f30 con 0x7fc2840f5520 2021-04-09T18:26:41.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc28be40700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2841c3dc0 con 0x7fc2841c8010 2021-04-09T18:26:41.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc2893e3700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc2840e9ae0 0x7fc28409f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51112/0 (socket says 172.21.15.79:51112) 2021-04-09T18:26:41.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc2893e3700 1 -- 172.21.15.79:0/260956832 learned_addr learned my addr 172.21.15.79:0/260956832 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:41.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc289be4700 1 --2- 172.21.15.79:0/260956832 >> v2:172.21.15.89:3300/0 conn(0x7fc2840f5520 0x7fc2840f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc28a3e5700 1 --2- 172.21.15.79:0/260956832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2841c8010 0x7fc2841ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc288be2700 1 -- 172.21.15.79:0/260956832 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592323078 0 0) 0x7fc2740010d0 con 0x7fc2840e9ae0 2021-04-09T18:26:41.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc288be2700 1 -- 172.21.15.79:0/260956832 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc270003240 con 0x7fc2840e9ae0 2021-04-09T18:26:41.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc28a3e5700 1 -- 172.21.15.79:0/260956832 >> v2:172.21.15.89:3300/0 conn(0x7fc2840f5520 msgr2=0x7fc2840f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:41.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc28a3e5700 1 --2- 172.21.15.79:0/260956832 >> v2:172.21.15.89:3300/0 conn(0x7fc2840f5520 0x7fc2840f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc28a3e5700 1 -- 172.21.15.79:0/260956832 >> v1:172.21.15.79:6789/0 conn(0x7fc2840e9ae0 legacy=0x7fc28409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc288be2700 1 -- 172.21.15.79:0/260956832 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3492842419 0 0) 0x7fc274001650 con 0x7fc2840e9ae0 2021-04-09T18:26:41.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc28a3e5700 1 -- 172.21.15.79:0/260956832 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28409f910 con 0x7fc2841c8010 2021-04-09T18:26:41.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc28a3e5700 1 --2- 172.21.15.79:0/260956832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2841c8010 0x7fc2841ca470 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fc274001df0 tx=0x7fc27c00b0e0).ready entity=mon.2 client_cookie=46f585d026736d82 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:41.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc288be2700 1 -- 172.21.15.79:0/260956832 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc28409f910 con 0x7fc2841c8010 2021-04-09T18:26:41.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc288be2700 1 -- 172.21.15.79:0/260956832 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27c00b9b0 con 0x7fc2841c8010 2021-04-09T18:26:41.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc288be2700 1 -- 172.21.15.79:0/260956832 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc27c002020 con 0x7fc2841c8010 2021-04-09T18:26:41.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc28be40700 1 -- 172.21.15.79:0/260956832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2841c8010 msgr2=0x7fc2841ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.038 7fc28be40700 1 --2- 172.21.15.79:0/260956832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2841c8010 0x7fc2841ca470 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fc274001df0 tx=0x7fc27c00b0e0).stop 2021-04-09T18:26:41.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.042 7fc28be40700 1 -- 172.21.15.79:0/260956832 shutdown_connections 2021-04-09T18:26:41.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.042 7fc28be40700 1 --2- 172.21.15.79:0/260956832 >> v2:172.21.15.89:3300/0 conn(0x7fc2840f5520 0x7fc2840f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.042 7fc28be40700 1 --2- 172.21.15.79:0/260956832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2841c8010 0x7fc2841ca470 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.042 7fc28be40700 1 -- 172.21.15.79:0/260956832 >> 172.21.15.79:0/260956832 conn(0x7fc2840e5fe0 msgr2=0x7fc2840e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:41.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.042 7fc28be40700 1 -- 172.21.15.79:0/260956832 shutdown_connections 2021-04-09T18:26:41.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.042 7fc28be40700 1 -- 172.21.15.79:0/260956832 wait complete. 2021-04-09T18:26:41.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.042 7fc28be40700 1 Processor -- start 2021-04-09T18:26:41.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.042 7fc28be40700 1 -- start start 2021-04-09T18:26:41.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.042 7fc28be40700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc284096040 0x7fc2840d5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.042 7fc28be40700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc284096490 0x7fc2841ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.042 7fc28be40700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2840d64c0 0x7fc2841abf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.042 7fc28be40700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2840973c0 con 0x7fc284096040 2021-04-09T18:26:41.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.042 7fc28be40700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2840976c0 con 0x7fc284096490 2021-04-09T18:26:41.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.042 7fc28be40700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc284096c50 con 0x7fc2840d64c0 2021-04-09T18:26:41.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.042 7fc289be4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc284096040 0x7fc2840d5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.042 7fc289be4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc284096040 0x7fc2840d5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56408/0 (socket says 172.21.15.79:56408) 2021-04-09T18:26:41.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.042 7fc289be4700 1 -- 172.21.15.79:0/2935072926 learned_addr learned my addr 172.21.15.79:0/2935072926 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:41.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.042 7fc2893e3700 1 --2- 172.21.15.79:0/2935072926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc284096490 0x7fc2841ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.042 7fc28a3e5700 1 --2- 172.21.15.79:0/2935072926 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2840d64c0 0x7fc2841abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.046 7fc289be4700 1 -- 172.21.15.79:0/2935072926 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2840d64c0 msgr2=0x7fc2841abf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.046 7fc289be4700 1 --2- 172.21.15.79:0/2935072926 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2840d64c0 0x7fc2841abf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.046 7fc289be4700 1 -- 172.21.15.79:0/2935072926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc284096490 msgr2=0x7fc2841ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.046 7fc289be4700 1 --2- 172.21.15.79:0/2935072926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc284096490 0x7fc2841ab940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.046 7fc289be4700 1 -- 172.21.15.79:0/2935072926 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc284096f70 con 0x7fc284096040 2021-04-09T18:26:41.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.046 7fc2893e3700 1 --2- 172.21.15.79:0/2935072926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc284096490 0x7fc2841ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:41.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.046 7fc28a3e5700 1 --2- 172.21.15.79:0/2935072926 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2840d64c0 0x7fc2841abf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:41.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.046 7fc289be4700 1 --2- 172.21.15.79:0/2935072926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc284096040 0x7fc2840d5e90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fc28409a810 tx=0x7fc28000c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:41.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.046 7fc27a7fc700 1 -- 172.21.15.79:0/2935072926 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc284096f70 con 0x7fc284096040 2021-04-09T18:26:41.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.046 7fc27a7fc700 1 -- 172.21.15.79:0/2935072926 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28000cdc0 con 0x7fc284096040 2021-04-09T18:26:41.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.046 7fc28be40700 1 -- 172.21.15.79:0/2935072926 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc284098e10 con 0x7fc284096040 2021-04-09T18:26:41.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.046 7fc27a7fc700 1 -- 172.21.15.79:0/2935072926 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc28000f040 con 0x7fc284096040 2021-04-09T18:26:41.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.046 7fc28be40700 1 -- 172.21.15.79:0/2935072926 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2841ac730 con 0x7fc284096040 2021-04-09T18:26:41.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.046 7fc27a7fc700 1 -- 172.21.15.79:0/2935072926 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc280011070 con 0x7fc284096040 2021-04-09T18:26:41.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.046 7fc27a7fc700 1 --2- 172.21.15.79:0/2935072926 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc26c029100 0x7fc26c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.046 7fc27a7fc700 1 -- 172.21.15.79:0/2935072926 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fc280010040 con 0x7fc284096040 2021-04-09T18:26:41.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.046 7fc2893e3700 1 --2- 172.21.15.79:0/2935072926 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc26c029100 0x7fc26c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.050 7fc2893e3700 1 --2- 172.21.15.79:0/2935072926 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc26c029100 0x7fc26c02b650 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:41.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.050 7fc28be40700 1 -- 172.21.15.79:0/2935072926 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2840e39e0 con 0x7fc284096040 2021-04-09T18:26:41.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.054 7fc27a7fc700 1 -- 172.21.15.79:0/2935072926 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc280000bf0 con 0x7fc284096040 2021-04-09T18:26:41.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.218 7fc28be40700 1 -- 172.21.15.79:0/2935072926 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2840f5b20 con 0x7fc284096040 2021-04-09T18:26:41.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.218 7fc27a7fc700 1 -- 172.21.15.79:0/2935072926 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14254 (secure 0 0 0) 0x7fc28000c9c0 con 0x7fc284096040 2021-04-09T18:26:41.227 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:41.228 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:14.412296","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:26:09.311735","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:26:12.130710","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:26:41.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.222 7fc28be40700 1 -- 172.21.15.79:0/2935072926 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc26c029100 msgr2=0x7fc26c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.222 7fc28be40700 1 --2- 172.21.15.79:0/2935072926 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc26c029100 0x7fc26c02b650 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.222 7fc28be40700 1 -- 172.21.15.79:0/2935072926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc284096040 msgr2=0x7fc2840d5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.222 7fc28be40700 1 --2- 172.21.15.79:0/2935072926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc284096040 0x7fc2840d5e90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fc28409a810 tx=0x7fc28000c430).stop 2021-04-09T18:26:41.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.222 7fc28be40700 1 -- 172.21.15.79:0/2935072926 shutdown_connections 2021-04-09T18:26:41.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.222 7fc28be40700 1 --2- 172.21.15.79:0/2935072926 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc26c029100 0x7fc26c02b650 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.222 7fc28be40700 1 --2- 172.21.15.79:0/2935072926 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2840d64c0 0x7fc2841abf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.222 7fc28be40700 1 --2- 172.21.15.79:0/2935072926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc284096040 0x7fc2840d5e90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.222 7fc28be40700 1 --2- 172.21.15.79:0/2935072926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc284096490 0x7fc2841ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.222 7fc28be40700 1 -- 172.21.15.79:0/2935072926 >> 172.21.15.79:0/2935072926 conn(0x7fc2840afde0 msgr2=0x7fc2840af500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:41.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.222 7fc28be40700 1 -- 172.21.15.79:0/2935072926 shutdown_connections 2021-04-09T18:26:41.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.222 7fc28be40700 1 -- 172.21.15.79:0/2935072926 wait complete. 2021-04-09T18:26:41.240 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:26:09.311735', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:26:12.130710', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:26:41.240 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:26:41.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.330 7f1248190700 1 Processor -- start 2021-04-09T18:26:41.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.330 7f1248190700 1 -- start start 2021-04-09T18:26:41.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.330 7f1248190700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f12401c9050 0x7f12401cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.330 7f1248190700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12400fbb50 con 0x7f12400f5550 2021-04-09T18:26:41.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.330 7f1248190700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124009f910 con 0x7f12400e9b10 2021-04-09T18:26:41.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.330 7f1248190700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12401c3df0 con 0x7f12401c9050 2021-04-09T18:26:41.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.330 7f1245f34700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f12400f5550 0x7f12400f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51128/0 (socket says 172.21.15.79:51128) 2021-04-09T18:26:41.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.330 7f1245f34700 1 -- 172.21.15.79:0/4040886121 learned_addr learned my addr 172.21.15.79:0/4040886121 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:41.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.330 7f1246735700 1 --2- 172.21.15.79:0/4040886121 >> v2:172.21.15.89:3300/0 conn(0x7f12401c9050 0x7f12401cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.330 7f1244f32700 1 -- 172.21.15.79:0/4040886121 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234940993 0 0) 0x7f12380010d0 con 0x7f12400f5550 2021-04-09T18:26:41.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.330 7f1244f32700 1 -- 172.21.15.79:0/4040886121 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f122c003240 con 0x7f12400f5550 2021-04-09T18:26:41.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1244f32700 1 -- 172.21.15.79:0/4040886121 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228174899 0 0) 0x7f12280010d0 con 0x7f12400e9b10 2021-04-09T18:26:41.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1244f32700 1 -- 172.21.15.79:0/4040886121 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f122c003620 con 0x7f12400e9b10 2021-04-09T18:26:41.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1244f32700 1 -- 172.21.15.79:0/4040886121 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4244627603 0 0) 0x7f1238001650 con 0x7f12400f5550 2021-04-09T18:26:41.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1244f32700 1 -- 172.21.15.79:0/4040886121 >> v2:172.21.15.89:3300/0 conn(0x7f12401c9050 msgr2=0x7f12401cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:41.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1244f32700 1 --2- 172.21.15.79:0/4040886121 >> v2:172.21.15.89:3300/0 conn(0x7f12401c9050 0x7f12401cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1244f32700 1 -- 172.21.15.79:0/4040886121 >> v1:172.21.15.89:6789/0 conn(0x7f12400e9b10 legacy=0x7f124009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1244f32700 1 -- 172.21.15.79:0/4040886121 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12400e5700 con 0x7f12400f5550 2021-04-09T18:26:41.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1244f32700 1 -- 172.21.15.79:0/4040886121 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f1238001bb0 con 0x7f12400f5550 2021-04-09T18:26:41.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1246735700 1 --2- 172.21.15.79:0/4040886121 >> v2:172.21.15.89:3300/0 conn(0x7f12401c9050 0x7f12401cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:41.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1244f32700 1 -- 172.21.15.79:0/4040886121 >> v1:172.21.15.79:6789/0 conn(0x7f12400f5550 legacy=0x7f12400f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1244f32700 1 --2- 172.21.15.79:0/4040886121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f122c003d60 0x7f122c0045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1244f32700 1 --2- 172.21.15.79:0/4040886121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f122c004bd0 0x7f122c0097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1244f32700 1 --2- 172.21.15.79:0/4040886121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f122c005070 0x7f122c00be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1244f32700 1 -- 172.21.15.79:0/4040886121 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12401c3df0 con 0x7f122c005070 2021-04-09T18:26:41.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1244f32700 1 -- 172.21.15.79:0/4040886121 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122c050600 con 0x7f122c004bd0 2021-04-09T18:26:41.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1244f32700 1 -- 172.21.15.79:0/4040886121 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122c050800 con 0x7f122c003d60 2021-04-09T18:26:41.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1246735700 1 --2- 172.21.15.79:0/4040886121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f122c005070 0x7f122c00be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1245733700 1 --2- 172.21.15.79:0/4040886121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f122c004bd0 0x7f122c0097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1245f34700 1 --2- 172.21.15.79:0/4040886121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f122c003d60 0x7f122c0045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1246735700 1 -- 172.21.15.79:0/4040886121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f122c003d60 msgr2=0x7f122c0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:41.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1246735700 1 --2- 172.21.15.79:0/4040886121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f122c003d60 0x7f122c0045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1246735700 1 -- 172.21.15.79:0/4040886121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f122c004bd0 msgr2=0x7f122c0097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:41.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1246735700 1 --2- 172.21.15.79:0/4040886121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f122c004bd0 0x7f122c0097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1246735700 1 -- 172.21.15.79:0/4040886121 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122c050af0 con 0x7f122c005070 2021-04-09T18:26:41.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1246735700 1 -- 172.21.15.79:0/4040886121 reap_dead start 2021-04-09T18:26:41.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1246735700 1 --2- 172.21.15.79:0/4040886121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f122c005070 0x7f122c00be20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f123000c000 tx=0x7f123000e6a0).ready entity=mon.0 client_cookie=fbb78a92aefb1bd4 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:41.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1244f32700 1 -- 172.21.15.79:0/4040886121 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f122c050af0 con 0x7f122c005070 2021-04-09T18:26:41.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1244f32700 1 -- 172.21.15.79:0/4040886121 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12300123f0 con 0x7f122c005070 2021-04-09T18:26:41.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1244f32700 1 -- 172.21.15.79:0/4040886121 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f123000f040 con 0x7f122c005070 2021-04-09T18:26:41.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1248190700 1 -- 172.21.15.79:0/4040886121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f122c005070 msgr2=0x7f122c00be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1248190700 1 --2- 172.21.15.79:0/4040886121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f122c005070 0x7f122c00be20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f123000c000 tx=0x7f123000e6a0).stop 2021-04-09T18:26:41.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1248190700 1 -- 172.21.15.79:0/4040886121 shutdown_connections 2021-04-09T18:26:41.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1248190700 1 --2- 172.21.15.79:0/4040886121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f122c005070 0x7f122c00be20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1248190700 1 -- 172.21.15.79:0/4040886121 >> 172.21.15.79:0/4040886121 conn(0x7f12400e6010 msgr2=0x7f12400e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:41.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1248190700 1 -- 172.21.15.79:0/4040886121 shutdown_connections 2021-04-09T18:26:41.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.334 7f1248190700 1 -- 172.21.15.79:0/4040886121 wait complete. 2021-04-09T18:26:41.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1248190700 1 Processor -- start 2021-04-09T18:26:41.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1248190700 1 -- start start 2021-04-09T18:26:41.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1248190700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12400c5960 0x7f12400a8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1248190700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12400c5db0 0x7f12400d51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1248190700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12400d5800 0x7f12401a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1248190700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12400e9f60 con 0x7f12400c5960 2021-04-09T18:26:41.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1248190700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12400c0870 con 0x7f12400d5800 2021-04-09T18:26:41.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1248190700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12400c0b70 con 0x7f12400c5db0 2021-04-09T18:26:41.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1245f34700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12400c5960 0x7f12400a8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1245f34700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12400c5960 0x7f12400a8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56428/0 (socket says 172.21.15.79:56428) 2021-04-09T18:26:41.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1245f34700 1 -- 172.21.15.79:0/258146134 learned_addr learned my addr 172.21.15.79:0/258146134 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:41.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1245733700 1 --2- 172.21.15.79:0/258146134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12400c5db0 0x7f12400d51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1246735700 1 --2- 172.21.15.79:0/258146134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12400d5800 0x7f12401a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1245f34700 1 -- 172.21.15.79:0/258146134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12400c5db0 msgr2=0x7f12400d51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1245f34700 1 --2- 172.21.15.79:0/258146134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12400c5db0 0x7f12400d51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1245f34700 1 -- 172.21.15.79:0/258146134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12400d5800 msgr2=0x7f12401a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1245f34700 1 --2- 172.21.15.79:0/258146134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12400d5800 0x7f12401a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1245f34700 1 -- 172.21.15.79:0/258146134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12400a89c0 con 0x7f12400c5960 2021-04-09T18:26:41.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1245f34700 1 --2- 172.21.15.79:0/258146134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12400c5960 0x7f12400a8390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f12400874d0 tx=0x7f12380012f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:41.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f123e7fc700 1 -- 172.21.15.79:0/258146134 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f12400a89c0 con 0x7f12400c5960 2021-04-09T18:26:41.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f123e7fc700 1 -- 172.21.15.79:0/258146134 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123800fbc0 con 0x7f12400c5960 2021-04-09T18:26:41.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1248190700 1 -- 172.21.15.79:0/258146134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12401a1b90 con 0x7f12400c5960 2021-04-09T18:26:41.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f123e7fc700 1 -- 172.21.15.79:0/258146134 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1238010040 con 0x7f12400c5960 2021-04-09T18:26:41.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.338 7f1248190700 1 -- 172.21.15.79:0/258146134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12401a00d0 con 0x7f12400c5960 2021-04-09T18:26:41.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.342 7f123e7fc700 1 -- 172.21.15.79:0/258146134 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f123801b060 con 0x7f12400c5960 2021-04-09T18:26:41.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.342 7f123e7fc700 1 --2- 172.21.15.79:0/258146134 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1224029100 0x7f122402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.342 7f123e7fc700 1 -- 172.21.15.79:0/258146134 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f1238011040 con 0x7f12400c5960 2021-04-09T18:26:41.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.342 7f1245733700 1 --2- 172.21.15.79:0/258146134 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1224029100 0x7f122402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.342 7f1245733700 1 --2- 172.21.15.79:0/258146134 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1224029100 0x7f122402b650 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:41.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.346 7f1248190700 1 -- 172.21.15.79:0/258146134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12400e39f0 con 0x7f12400c5960 2021-04-09T18:26:41.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.354 7f123e7fc700 1 -- 172.21.15.79:0/258146134 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f123800f9b0 con 0x7f12400c5960 2021-04-09T18:26:41.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.514 7f1248190700 1 -- 172.21.15.79:0/258146134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f12400a1c90 con 0x7f12400c5960 2021-04-09T18:26:41.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.514 7f123e7fc700 1 -- 172.21.15.79:0/258146134 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1238000bf0 con 0x7f12400c5960 2021-04-09T18:26:41.522 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:41.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.518 7f1248190700 1 -- 172.21.15.79:0/258146134 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1224029100 msgr2=0x7f122402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.518 7f1248190700 1 --2- 172.21.15.79:0/258146134 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1224029100 0x7f122402b650 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.518 7f1248190700 1 -- 172.21.15.79:0/258146134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12400c5960 msgr2=0x7f12400a8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.518 7f1248190700 1 --2- 172.21.15.79:0/258146134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12400c5960 0x7f12400a8390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f12400874d0 tx=0x7f12380012f0).stop 2021-04-09T18:26:41.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.518 7f1248190700 1 -- 172.21.15.79:0/258146134 shutdown_connections 2021-04-09T18:26:41.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.518 7f1248190700 1 --2- 172.21.15.79:0/258146134 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1224029100 0x7f122402b650 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.518 7f1248190700 1 --2- 172.21.15.79:0/258146134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12400d5800 0x7f12401a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.518 7f1248190700 1 --2- 172.21.15.79:0/258146134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12400c5960 0x7f12400a8390 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.518 7f1248190700 1 --2- 172.21.15.79:0/258146134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12400c5db0 0x7f12400d51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.518 7f1248190700 1 -- 172.21.15.79:0/258146134 >> 172.21.15.79:0/258146134 conn(0x7f12400a2520 msgr2=0x7f12400d8460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:41.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.518 7f1248190700 1 -- 172.21.15.79:0/258146134 shutdown_connections 2021-04-09T18:26:41.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.518 7f1248190700 1 -- 172.21.15.79:0/258146134 wait complete. 2021-04-09T18:26:41.534 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:26:41.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.618 7f5ffd07e700 1 Processor -- start 2021-04-09T18:26:41.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.618 7f5ffd07e700 1 -- start start 2021-04-09T18:26:41.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ffd07e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5ff80f5550 0x7f5ff80f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ffd07e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff80fbb50 con 0x7f5ff80e9b10 2021-04-09T18:26:41.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ffd07e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff809f910 con 0x7f5ff81c8040 2021-04-09T18:26:41.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ffd07e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff80e9f60 con 0x7f5ff80f5550 2021-04-09T18:26:41.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ff659c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5ff80e9b10 0x7f5ff809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51146/0 (socket says 172.21.15.79:51146) 2021-04-09T18:26:41.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ff659c700 1 -- 172.21.15.79:0/1156535577 learned_addr learned my addr 172.21.15.79:0/1156535577 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:41.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ff6d9d700 1 --2- 172.21.15.79:0/1156535577 >> v2:172.21.15.89:3300/0 conn(0x7f5ff80f5550 0x7f5ff80f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ff5d9b700 1 -- 172.21.15.79:0/1156535577 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113571896 0 0) 0x7f5fe00010d0 con 0x7f5ff80e9b10 2021-04-09T18:26:41.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ff5d9b700 1 -- 172.21.15.79:0/1156535577 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fe4003240 con 0x7f5ff80e9b10 2021-04-09T18:26:41.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ff6d9d700 1 -- 172.21.15.79:0/1156535577 >> v1:172.21.15.89:6789/0 conn(0x7f5ff81c8040 legacy=0x7f5ff81ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ff6d9d700 1 -- 172.21.15.79:0/1156535577 >> v1:172.21.15.79:6789/0 conn(0x7f5ff80e9b10 legacy=0x7f5ff809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ff6d9d700 1 -- 172.21.15.79:0/1156535577 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff80e5700 con 0x7f5ff80f5550 2021-04-09T18:26:41.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ff6d9d700 1 --2- 172.21.15.79:0/1156535577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ff80f5550 0x7f5ff80f64e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f5fe80032b0 tx=0x7f5fe800b0e0).ready entity=mon.1 client_cookie=10196ad0a901e3ef server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:41.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ff5d9b700 1 -- 172.21.15.79:0/1156535577 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5ff80e5700 con 0x7f5ff80f5550 2021-04-09T18:26:41.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ff5d9b700 1 -- 172.21.15.79:0/1156535577 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe800bab0 con 0x7f5ff80f5550 2021-04-09T18:26:41.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ff5d9b700 1 -- 172.21.15.79:0/1156535577 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5fe8002020 con 0x7f5ff80f5550 2021-04-09T18:26:41.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ffd07e700 1 -- 172.21.15.79:0/1156535577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ff80f5550 msgr2=0x7f5ff80f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ffd07e700 1 --2- 172.21.15.79:0/1156535577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ff80f5550 0x7f5ff80f64e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f5fe80032b0 tx=0x7f5fe800b0e0).stop 2021-04-09T18:26:41.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ffd07e700 1 -- 172.21.15.79:0/1156535577 shutdown_connections 2021-04-09T18:26:41.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ffd07e700 1 --2- 172.21.15.79:0/1156535577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ff80f5550 0x7f5ff80f64e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ffd07e700 1 -- 172.21.15.79:0/1156535577 >> 172.21.15.79:0/1156535577 conn(0x7f5ff80e6010 msgr2=0x7f5ff80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:41.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ffd07e700 1 -- 172.21.15.79:0/1156535577 shutdown_connections 2021-04-09T18:26:41.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.622 7f5ffd07e700 1 -- 172.21.15.79:0/1156535577 wait complete. 2021-04-09T18:26:41.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.626 7f5ffd07e700 1 Processor -- start 2021-04-09T18:26:41.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.626 7f5ffd07e700 1 -- start start 2021-04-09T18:26:41.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.626 7f5ffd07e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ff81a0ae0 0x7f5ff81aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.626 7f5ffd07e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ff80c4d10 0x7f5ff80d3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.626 7f5ffd07e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ff80c7550 0x7f5ff81ae470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.626 7f5ffd07e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff81c3df0 con 0x7f5ff80c4d10 2021-04-09T18:26:41.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.626 7f5ffd07e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80c5c60 con 0x7f5ff81a0ae0 2021-04-09T18:26:41.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.626 7f5ffd07e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80c5f60 con 0x7f5ff80c7550 2021-04-09T18:26:41.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.626 7f5ff659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ff80c4d10 0x7f5ff80d3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.626 7f5ff659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ff80c4d10 0x7f5ff80d3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56444/0 (socket says 172.21.15.79:56444) 2021-04-09T18:26:41.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.626 7f5ff659c700 1 -- 172.21.15.79:0/1574213835 learned_addr learned my addr 172.21.15.79:0/1574213835 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:41.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.626 7f5ff6d9d700 1 --2- 172.21.15.79:0/1574213835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ff81a0ae0 0x7f5ff81aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.626 7f5ff759e700 1 --2- 172.21.15.79:0/1574213835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ff80c7550 0x7f5ff81ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.626 7f5ff659c700 1 -- 172.21.15.79:0/1574213835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ff80c7550 msgr2=0x7f5ff81ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.626 7f5ff659c700 1 --2- 172.21.15.79:0/1574213835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ff80c7550 0x7f5ff81ae470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.626 7f5ff659c700 1 -- 172.21.15.79:0/1574213835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ff81a0ae0 msgr2=0x7f5ff81aaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.626 7f5ff659c700 1 --2- 172.21.15.79:0/1574213835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ff81a0ae0 0x7f5ff81aaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.626 7f5ff659c700 1 -- 172.21.15.79:0/1574213835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff80d3850 con 0x7f5ff80c4d10 2021-04-09T18:26:41.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.626 7f5ff6d9d700 1 --2- 172.21.15.79:0/1574213835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ff81a0ae0 0x7f5ff81aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:41.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.630 7f5ff659c700 1 --2- 172.21.15.79:0/1574213835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ff80c4d10 0x7f5ff80d3220 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f5ff80c5be0 tx=0x7f5fe000cb10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:41.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.630 7f5fef7fe700 1 -- 172.21.15.79:0/1574213835 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5ff80d3850 con 0x7f5ff80c4d10 2021-04-09T18:26:41.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.630 7f5fef7fe700 1 -- 172.21.15.79:0/1574213835 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe0007320 con 0x7f5ff80c4d10 2021-04-09T18:26:41.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.630 7f5ffd07e700 1 -- 172.21.15.79:0/1574213835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff80c57f0 con 0x7f5ff80c4d10 2021-04-09T18:26:41.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.630 7f5fef7fe700 1 -- 172.21.15.79:0/1574213835 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5fe00057e0 con 0x7f5ff80c4d10 2021-04-09T18:26:41.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.630 7f5ffd07e700 1 -- 172.21.15.79:0/1574213835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff80c79a0 con 0x7f5ff80c4d10 2021-04-09T18:26:41.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.630 7f5fef7fe700 1 -- 172.21.15.79:0/1574213835 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5fe001a060 con 0x7f5ff80c4d10 2021-04-09T18:26:41.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.630 7f5fef7fe700 1 --2- 172.21.15.79:0/1574213835 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5fdc029100 0x7f5fdc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.630 7f5fef7fe700 1 -- 172.21.15.79:0/1574213835 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f5fe0038ca0 con 0x7f5ff80c4d10 2021-04-09T18:26:41.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.630 7f5ff6d9d700 1 --2- 172.21.15.79:0/1574213835 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5fdc029100 0x7f5fdc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.630 7f5ff6d9d700 1 --2- 172.21.15.79:0/1574213835 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5fdc029100 0x7f5fdc02b650 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:41.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.634 7f5ffd07e700 1 -- 172.21.15.79:0/1574213835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff80e39f0 con 0x7f5ff80c4d10 2021-04-09T18:26:41.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.642 7f5fef7fe700 1 -- 172.21.15.79:0/1574213835 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5fe0007110 con 0x7f5ff80c4d10 2021-04-09T18:26:41.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.802 7f5ffd07e700 1 -- 172.21.15.79:0/1574213835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f5ff80a1c90 con 0x7f5ff80c4d10 2021-04-09T18:26:41.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.806 7f5fef7fe700 1 -- 172.21.15.79:0/1574213835 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5fe0000bf0 con 0x7f5ff80c4d10 2021-04-09T18:26:41.812 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:41.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.806 7f5ffd07e700 1 -- 172.21.15.79:0/1574213835 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5fdc029100 msgr2=0x7f5fdc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.806 7f5ffd07e700 1 --2- 172.21.15.79:0/1574213835 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5fdc029100 0x7f5fdc02b650 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.806 7f5ffd07e700 1 -- 172.21.15.79:0/1574213835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ff80c4d10 msgr2=0x7f5ff80d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.806 7f5ffd07e700 1 --2- 172.21.15.79:0/1574213835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ff80c4d10 0x7f5ff80d3220 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f5ff80c5be0 tx=0x7f5fe000cb10).stop 2021-04-09T18:26:41.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.806 7f5ffd07e700 1 -- 172.21.15.79:0/1574213835 shutdown_connections 2021-04-09T18:26:41.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.806 7f5ffd07e700 1 --2- 172.21.15.79:0/1574213835 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5fdc029100 0x7f5fdc02b650 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.806 7f5ffd07e700 1 --2- 172.21.15.79:0/1574213835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ff81a0ae0 0x7f5ff81aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.806 7f5ffd07e700 1 --2- 172.21.15.79:0/1574213835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ff80c7550 0x7f5ff81ae470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.806 7f5ffd07e700 1 --2- 172.21.15.79:0/1574213835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ff80c4d10 0x7f5ff80d3220 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.806 7f5ffd07e700 1 -- 172.21.15.79:0/1574213835 >> 172.21.15.79:0/1574213835 conn(0x7f5ff80d8490 msgr2=0x7f5ff81a1220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:41.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.806 7f5ffd07e700 1 -- 172.21.15.79:0/1574213835 shutdown_connections 2021-04-09T18:26:41.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.806 7f5ffd07e700 1 -- 172.21.15.79:0/1574213835 wait complete. 2021-04-09T18:26:41.824 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:26:41.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.910 7f6961a5a700 1 Processor -- start 2021-04-09T18:26:41.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.910 7f6961a5a700 1 -- start start 2021-04-09T18:26:41.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.910 7f6961a5a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f695c1c9050 0x7f695c1cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.910 7f6961a5a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695c0fbb50 con 0x7f695c0f5550 2021-04-09T18:26:41.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.910 7f6961a5a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695c09f910 con 0x7f695c0e9b10 2021-04-09T18:26:41.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.910 7f6961a5a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c1c3df0 con 0x7f695c1c9050 2021-04-09T18:26:41.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.910 7f695b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f695c0f5550 0x7f695c0f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51160/0 (socket says 172.21.15.79:51160) 2021-04-09T18:26:41.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.910 7f695b7fe700 1 -- 172.21.15.79:0/396878438 learned_addr learned my addr 172.21.15.79:0/396878438 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:41.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.910 7f695bfff700 1 --2- 172.21.15.79:0/396878438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f695c1c9050 0x7f695c1cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.910 7f695a7fc700 1 -- 172.21.15.79:0/396878438 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655239780 0 0) 0x7f694c0010d0 con 0x7f695c0f5550 2021-04-09T18:26:41.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.910 7f695a7fc700 1 -- 172.21.15.79:0/396878438 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6948003240 con 0x7f695c0f5550 2021-04-09T18:26:41.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.914 7f695a7fc700 1 -- 172.21.15.79:0/396878438 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767398214 0 0) 0x7f69440010d0 con 0x7f695c0e9b10 2021-04-09T18:26:41.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.914 7f695a7fc700 1 -- 172.21.15.79:0/396878438 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6948003620 con 0x7f695c0e9b10 2021-04-09T18:26:41.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.914 7f695bfff700 1 -- 172.21.15.79:0/396878438 >> v1:172.21.15.89:6789/0 conn(0x7f695c0e9b10 legacy=0x7f695c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.914 7f695bfff700 1 -- 172.21.15.79:0/396878438 >> v1:172.21.15.79:6789/0 conn(0x7f695c0f5550 legacy=0x7f695c0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.914 7f695bfff700 1 -- 172.21.15.79:0/396878438 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c0e5700 con 0x7f695c1c9050 2021-04-09T18:26:41.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.914 7f695bfff700 1 --2- 172.21.15.79:0/396878438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f695c1c9050 0x7f695c1cb4b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f69540032b0 tx=0x7f695400b0e0).ready entity=mon.2 client_cookie=253583c523e7961 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:41.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.914 7f695a7fc700 1 -- 172.21.15.79:0/396878438 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f695c0e5700 con 0x7f695c1c9050 2021-04-09T18:26:41.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.914 7f695a7fc700 1 -- 172.21.15.79:0/396878438 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695400baf0 con 0x7f695c1c9050 2021-04-09T18:26:41.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.914 7f695a7fc700 1 -- 172.21.15.79:0/396878438 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6954002020 con 0x7f695c1c9050 2021-04-09T18:26:41.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.914 7f6961a5a700 1 -- 172.21.15.79:0/396878438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f695c1c9050 msgr2=0x7f695c1cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.914 7f6961a5a700 1 --2- 172.21.15.79:0/396878438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f695c1c9050 0x7f695c1cb4b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f69540032b0 tx=0x7f695400b0e0).stop 2021-04-09T18:26:41.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.914 7f6961a5a700 1 -- 172.21.15.79:0/396878438 shutdown_connections 2021-04-09T18:26:41.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.914 7f6961a5a700 1 --2- 172.21.15.79:0/396878438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f695c1c9050 0x7f695c1cb4b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.914 7f6961a5a700 1 -- 172.21.15.79:0/396878438 >> 172.21.15.79:0/396878438 conn(0x7f695c0e6010 msgr2=0x7f695c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:41.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.914 7f6961a5a700 1 -- 172.21.15.79:0/396878438 shutdown_connections 2021-04-09T18:26:41.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.914 7f6961a5a700 1 -- 172.21.15.79:0/396878438 wait complete. 2021-04-09T18:26:41.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.914 7f6961a5a700 1 Processor -- start 2021-04-09T18:26:41.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.914 7f6961a5a700 1 -- start start 2021-04-09T18:26:41.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f6961a5a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f695c0d5b70 0x7f695c19c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f6961a5a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f695c08e020 0x7f695c0d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f6961a5a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f695c0d0ad0 0x7f695c094a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f6961a5a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c088590 con 0x7f695c0d0ad0 2021-04-09T18:26:41.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f6961a5a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c0e9f60 con 0x7f695c08e020 2021-04-09T18:26:41.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f6961a5a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c08f3a0 con 0x7f695c0d5b70 2021-04-09T18:26:41.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f695bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f695c0d0ad0 0x7f695c094a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f695bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f695c0d0ad0 0x7f695c094a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56458/0 (socket says 172.21.15.79:56458) 2021-04-09T18:26:41.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f695bfff700 1 -- 172.21.15.79:0/3759031731 learned_addr learned my addr 172.21.15.79:0/3759031731 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:41.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f695affd700 1 --2- 172.21.15.79:0/3759031731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f695c08e020 0x7f695c0d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f695b7fe700 1 --2- 172.21.15.79:0/3759031731 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f695c0d5b70 0x7f695c19c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f695bfff700 1 -- 172.21.15.79:0/3759031731 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f695c0d5b70 msgr2=0x7f695c19c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f695bfff700 1 --2- 172.21.15.79:0/3759031731 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f695c0d5b70 0x7f695c19c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f695bfff700 1 -- 172.21.15.79:0/3759031731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f695c08e020 msgr2=0x7f695c0d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:41.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f695bfff700 1 --2- 172.21.15.79:0/3759031731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f695c08e020 0x7f695c0d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:41.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f695bfff700 1 -- 172.21.15.79:0/3759031731 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c0d5fc0 con 0x7f695c0d0ad0 2021-04-09T18:26:41.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f695bfff700 1 --2- 172.21.15.79:0/3759031731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f695c0d0ad0 0x7f695c094a00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f695c19ca30 tx=0x7f6954006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:41.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f6953fff700 1 -- 172.21.15.79:0/3759031731 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f695c0d5fc0 con 0x7f695c0d0ad0 2021-04-09T18:26:41.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f6961a5a700 1 -- 172.21.15.79:0/3759031731 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695c19c6d0 con 0x7f695c0d0ad0 2021-04-09T18:26:41.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f6953fff700 1 -- 172.21.15.79:0/3759031731 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695401f030 con 0x7f695c0d0ad0 2021-04-09T18:26:41.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f6953fff700 1 -- 172.21.15.79:0/3759031731 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6954002020 con 0x7f695c0d0ad0 2021-04-09T18:26:41.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f6961a5a700 1 -- 172.21.15.79:0/3759031731 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695c08f8e0 con 0x7f695c0d0ad0 2021-04-09T18:26:41.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f6953fff700 1 -- 172.21.15.79:0/3759031731 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f695402a060 con 0x7f695c0d0ad0 2021-04-09T18:26:41.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f6953fff700 1 --2- 172.21.15.79:0/3759031731 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6940029100 0x7f694002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:41.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f6953fff700 1 -- 172.21.15.79:0/3759031731 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f695403b5d0 con 0x7f695c0d0ad0 2021-04-09T18:26:41.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.918 7f695b7fe700 1 --2- 172.21.15.79:0/3759031731 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6940029100 0x7f694002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:41.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.922 7f695b7fe700 1 --2- 172.21.15.79:0/3759031731 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6940029100 0x7f694002b650 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:41.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.926 7f6961a5a700 1 -- 172.21.15.79:0/3759031731 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695c0e39f0 con 0x7f695c0d0ad0 2021-04-09T18:26:41.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:41.930 7f6953fff700 1 -- 172.21.15.79:0/3759031731 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f695400b8e0 con 0x7f695c0d0ad0 2021-04-09T18:26:41.950 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:26:41.953 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:26:41.955 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:26:41.958 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:26:41.960 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:26:42.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.086 7f6961a5a700 1 -- 172.21.15.79:0/3759031731 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f695c0f5b50 con 0x7f695c0d0ad0 2021-04-09T18:26:42.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.086 7f6953fff700 1 -- 172.21.15.79:0/3759031731 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f695401b430 con 0x7f695c0d0ad0 2021-04-09T18:26:42.095 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:42.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.090 7f6961a5a700 1 -- 172.21.15.79:0/3759031731 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6940029100 msgr2=0x7f694002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.090 7f6961a5a700 1 --2- 172.21.15.79:0/3759031731 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6940029100 0x7f694002b650 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.090 7f6961a5a700 1 -- 172.21.15.79:0/3759031731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f695c0d0ad0 msgr2=0x7f695c094a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.090 7f6961a5a700 1 --2- 172.21.15.79:0/3759031731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f695c0d0ad0 0x7f695c094a00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f695c19ca30 tx=0x7f6954006c10).stop 2021-04-09T18:26:42.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.090 7f6961a5a700 1 -- 172.21.15.79:0/3759031731 shutdown_connections 2021-04-09T18:26:42.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.090 7f6961a5a700 1 --2- 172.21.15.79:0/3759031731 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6940029100 0x7f694002b650 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.090 7f6961a5a700 1 --2- 172.21.15.79:0/3759031731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f695c0d0ad0 0x7f695c094a00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.090 7f6961a5a700 1 --2- 172.21.15.79:0/3759031731 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f695c0d5b70 0x7f695c19c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.090 7f6961a5a700 1 --2- 172.21.15.79:0/3759031731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f695c08e020 0x7f695c0d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.090 7f6961a5a700 1 -- 172.21.15.79:0/3759031731 >> 172.21.15.79:0/3759031731 conn(0x7f695c0bac30 msgr2=0x7f695c0938c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:42.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.090 7f6961a5a700 1 -- 172.21.15.79:0/3759031731 shutdown_connections 2021-04-09T18:26:42.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.090 7f6961a5a700 1 -- 172.21.15.79:0/3759031731 wait complete. 2021-04-09T18:26:42.109 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:42.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efdec560700 1 Processor -- start 2021-04-09T18:26:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efdec560700 1 -- start start 2021-04-09T18:26:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efdec560700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efde40f5520 0x7efde40f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efdec560700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efde40e9ae0 0x7efde409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:42.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efdec560700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40fbb20 con 0x7efde41c2db0 2021-04-09T18:26:42.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efdec560700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40e9f30 con 0x7efde40f5520 2021-04-09T18:26:42.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efdec560700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde40e59d0 con 0x7efde40e9ae0 2021-04-09T18:26:42.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efdeab05700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7efde41c2db0 0x7efde41c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51178/0 (socket says 172.21.15.79:51178) 2021-04-09T18:26:42.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efdeab05700 1 -- 172.21.15.79:0/1330692139 learned_addr learned my addr 172.21.15.79:0/1330692139 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:42.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efde9b03700 1 --2- 172.21.15.79:0/1330692139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efde40e9ae0 0x7efde409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:42.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efdea304700 1 --2- 172.21.15.79:0/1330692139 >> v2:172.21.15.89:3300/0 conn(0x7efde40f5520 0x7efde40f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:42.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efde9302700 1 -- 172.21.15.79:0/1330692139 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422224768 0 0) 0x7efddc001450 con 0x7efde41c2db0 2021-04-09T18:26:42.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efde9302700 1 -- 172.21.15.79:0/1330692139 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdd0003240 con 0x7efde41c2db0 2021-04-09T18:26:42.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efdea304700 1 -- 172.21.15.79:0/1330692139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efde40e9ae0 msgr2=0x7efde409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:42.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efdea304700 1 --2- 172.21.15.79:0/1330692139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efde40e9ae0 0x7efde409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efde9302700 1 -- 172.21.15.79:0/1330692139 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1826981061 0 0) 0x7efddc0019d0 con 0x7efde41c2db0 2021-04-09T18:26:42.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efdea304700 1 -- 172.21.15.79:0/1330692139 >> v1:172.21.15.79:6789/0 conn(0x7efde41c2db0 legacy=0x7efde41c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efdea304700 1 -- 172.21.15.79:0/1330692139 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde40e56d0 con 0x7efde40f5520 2021-04-09T18:26:42.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efde9b03700 1 --2- 172.21.15.79:0/1330692139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efde40e9ae0 0x7efde409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:42.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efdea304700 1 --2- 172.21.15.79:0/1330692139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efde40f5520 0x7efde40f64b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7efddc002170 tx=0x7efdd800bd40).ready entity=mon.1 client_cookie=2e5185959aecd086 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:42.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efde9302700 1 -- 172.21.15.79:0/1330692139 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efde40e56d0 con 0x7efde40f5520 2021-04-09T18:26:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efde9302700 1 -- 172.21.15.79:0/1330692139 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd8009710 con 0x7efde40f5520 2021-04-09T18:26:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.202 7efde9302700 1 -- 172.21.15.79:0/1330692139 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efddc001f30 con 0x7efde40f5520 2021-04-09T18:26:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.206 7efdec560700 1 -- 172.21.15.79:0/1330692139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efde40f5520 msgr2=0x7efde40f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.206 7efdec560700 1 --2- 172.21.15.79:0/1330692139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efde40f5520 0x7efde40f64b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7efddc002170 tx=0x7efdd800bd40).stop 2021-04-09T18:26:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.206 7efdec560700 1 -- 172.21.15.79:0/1330692139 shutdown_connections 2021-04-09T18:26:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.206 7efdec560700 1 --2- 172.21.15.79:0/1330692139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efde40f5520 0x7efde40f64b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.206 7efdec560700 1 --2- 172.21.15.79:0/1330692139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efde40e9ae0 0x7efde409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.206 7efdec560700 1 -- 172.21.15.79:0/1330692139 >> 172.21.15.79:0/1330692139 conn(0x7efde40e5fe0 msgr2=0x7efde40e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.206 7efdec560700 1 -- 172.21.15.79:0/1330692139 shutdown_connections 2021-04-09T18:26:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.206 7efdec560700 1 -- 172.21.15.79:0/1330692139 wait complete. 2021-04-09T18:26:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.206 7efdec560700 1 Processor -- start 2021-04-09T18:26:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.206 7efdec560700 1 -- start start 2021-04-09T18:26:42.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdec560700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efde41c06f0 0x7efde40ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:42.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdec560700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efde419dbf0 0x7efde419e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:42.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdec560700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efde41aee80 0x7efde41af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:42.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdec560700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde40aca80 con 0x7efde419dbf0 2021-04-09T18:26:42.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdec560700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde40acd80 con 0x7efde41aee80 2021-04-09T18:26:42.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdec560700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde40ac310 con 0x7efde41c06f0 2021-04-09T18:26:42.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efde9b03700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efde419dbf0 0x7efde419e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:42.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efde9b03700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efde419dbf0 0x7efde419e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56472/0 (socket says 172.21.15.79:56472) 2021-04-09T18:26:42.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efde9b03700 1 -- 172.21.15.79:0/2454184202 learned_addr learned my addr 172.21.15.79:0/2454184202 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:42.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdeab05700 1 --2- 172.21.15.79:0/2454184202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efde41aee80 0x7efde41af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:42.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdea304700 1 --2- 172.21.15.79:0/2454184202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efde41c06f0 0x7efde40ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:42.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdeab05700 1 -- 172.21.15.79:0/2454184202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efde41c06f0 msgr2=0x7efde40ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdeab05700 1 --2- 172.21.15.79:0/2454184202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efde41c06f0 0x7efde40ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdeab05700 1 -- 172.21.15.79:0/2454184202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efde419dbf0 msgr2=0x7efde419e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdeab05700 1 --2- 172.21.15.79:0/2454184202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efde419dbf0 0x7efde419e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdeab05700 1 -- 172.21.15.79:0/2454184202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde40aee00 con 0x7efde41aee80 2021-04-09T18:26:42.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efde9b03700 1 --2- 172.21.15.79:0/2454184202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efde419dbf0 0x7efde419e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:42.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdeab05700 1 --2- 172.21.15.79:0/2454184202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efde41aee80 0x7efde41af2d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7efde40ac5a0 tx=0x7efddc00cec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:42.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdd6ffd700 1 -- 172.21.15.79:0/2454184202 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efde40aee00 con 0x7efde41aee80 2021-04-09T18:26:42.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdd6ffd700 1 -- 172.21.15.79:0/2454184202 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efddc004c60 con 0x7efde41aee80 2021-04-09T18:26:42.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdec560700 1 -- 172.21.15.79:0/2454184202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde4098d00 con 0x7efde41aee80 2021-04-09T18:26:42.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdd6ffd700 1 -- 172.21.15.79:0/2454184202 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efddc007360 con 0x7efde41aee80 2021-04-09T18:26:42.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdec560700 1 -- 172.21.15.79:0/2454184202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde40ac630 con 0x7efde41aee80 2021-04-09T18:26:42.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdd6ffd700 1 -- 172.21.15.79:0/2454184202 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7efddc007560 con 0x7efde41aee80 2021-04-09T18:26:42.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdd6ffd700 1 --2- 172.21.15.79:0/2454184202 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efdcc029100 0x7efdcc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:42.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdd6ffd700 1 -- 172.21.15.79:0/2454184202 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7efddc0399a0 con 0x7efde41aee80 2021-04-09T18:26:42.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.210 7efdea304700 1 --2- 172.21.15.79:0/2454184202 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efdcc029100 0x7efdcc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:42.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.214 7efdea304700 1 --2- 172.21.15.79:0/2454184202 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efdcc029100 0x7efdcc02b650 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:42.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.218 7efdec560700 1 -- 172.21.15.79:0/2454184202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde40e39e0 con 0x7efde41aee80 2021-04-09T18:26:42.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.226 7efdd6ffd700 1 -- 172.21.15.79:0/2454184202 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7efde40f76c0 con 0x7efde41aee80 2021-04-09T18:26:42.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.394 7efdec560700 1 -- 172.21.15.79:0/2454184202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efde40f5b20 con 0x7efde41aee80 2021-04-09T18:26:42.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.394 7efdd6ffd700 1 -- 172.21.15.79:0/2454184202 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14254 (secure 0 0 0) 0x7efddc004a50 con 0x7efde41aee80 2021-04-09T18:26:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:42.404 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:14.412296","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:26:09.311735","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:26:12.130710","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:26:42.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.398 7efdec560700 1 -- 172.21.15.79:0/2454184202 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efdcc029100 msgr2=0x7efdcc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.398 7efdec560700 1 --2- 172.21.15.79:0/2454184202 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efdcc029100 0x7efdcc02b650 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.398 7efdec560700 1 -- 172.21.15.79:0/2454184202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efde41aee80 msgr2=0x7efde41af2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.398 7efdec560700 1 --2- 172.21.15.79:0/2454184202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efde41aee80 0x7efde41af2d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7efde40ac5a0 tx=0x7efddc00cec0).stop 2021-04-09T18:26:42.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.398 7efdec560700 1 -- 172.21.15.79:0/2454184202 shutdown_connections 2021-04-09T18:26:42.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.398 7efdec560700 1 --2- 172.21.15.79:0/2454184202 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efdcc029100 0x7efdcc02b650 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.398 7efdec560700 1 --2- 172.21.15.79:0/2454184202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efde41aee80 0x7efde41af2d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.398 7efdec560700 1 --2- 172.21.15.79:0/2454184202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efde41c06f0 0x7efde40ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.398 7efdec560700 1 --2- 172.21.15.79:0/2454184202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efde419dbf0 0x7efde419e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.398 7efdec560700 1 -- 172.21.15.79:0/2454184202 >> 172.21.15.79:0/2454184202 conn(0x7efde40afdc0 msgr2=0x7efde40a6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.398 7efdec560700 1 -- 172.21.15.79:0/2454184202 shutdown_connections 2021-04-09T18:26:42.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.398 7efdec560700 1 -- 172.21.15.79:0/2454184202 wait complete. 2021-04-09T18:26:42.416 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:26:09.311735', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:26:12.130710', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:26:42.417 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:26:42.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b09f5c700 1 Processor -- start 2021-04-09T18:26:42.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b09f5c700 1 -- start start 2021-04-09T18:26:42.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b09f5c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8b040e9b10 0x7f8b0409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:42.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b09f5c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8b041c8040 0x7f8b041ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:42.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b09f5c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b040fbb50 con 0x7f8b040f5550 2021-04-09T18:26:42.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b09f5c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b041c3df0 con 0x7f8b040e9b10 2021-04-09T18:26:42.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b09f5c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b040e9f60 con 0x7f8b041c8040 2021-04-09T18:26:42.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b02ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8b040e9b10 0x7f8b0409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:42.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b02ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8b040e9b10 0x7f8b0409f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56480/0 (socket says 172.21.15.79:56480) 2021-04-09T18:26:42.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b02ffd700 1 -- 172.21.15.79:0/3683794546 learned_addr learned my addr 172.21.15.79:0/3683794546 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:42.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b03fff700 1 --2- 172.21.15.79:0/3683794546 >> v2:172.21.15.89:3300/0 conn(0x7f8b041c8040 0x7f8b041ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:42.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b02ffd700 1 -- 172.21.15.79:0/3683794546 >> v2:172.21.15.89:3300/0 conn(0x7f8b041c8040 msgr2=0x7f8b041ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:42.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b02ffd700 1 --2- 172.21.15.79:0/3683794546 >> v2:172.21.15.89:3300/0 conn(0x7f8b041c8040 0x7f8b041ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b02ffd700 1 -- 172.21.15.79:0/3683794546 >> v1:172.21.15.89:6789/0 conn(0x7f8b040f5550 legacy=0x7f8b040f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b02ffd700 1 -- 172.21.15.79:0/3683794546 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b040e5700 con 0x7f8b040e9b10 2021-04-09T18:26:42.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b02ffd700 1 --2- 172.21.15.79:0/3683794546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b040e9b10 0x7f8b0409f110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f8af4002f30 tx=0x7f8af400bd70).ready entity=mon.0 client_cookie=ca993a5cf92bd630 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:42.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b027fc700 1 -- 172.21.15.79:0/3683794546 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b040e5700 con 0x7f8b040e9b10 2021-04-09T18:26:42.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b027fc700 1 -- 172.21.15.79:0/3683794546 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af4009950 con 0x7f8b040e9b10 2021-04-09T18:26:42.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b027fc700 1 -- 172.21.15.79:0/3683794546 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8af4009d20 con 0x7f8b040e9b10 2021-04-09T18:26:42.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b09f5c700 1 -- 172.21.15.79:0/3683794546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b040e9b10 msgr2=0x7f8b0409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.502 7f8b09f5c700 1 --2- 172.21.15.79:0/3683794546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b040e9b10 0x7f8b0409f110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f8af4002f30 tx=0x7f8af400bd70).stop 2021-04-09T18:26:42.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.506 7f8b09f5c700 1 -- 172.21.15.79:0/3683794546 shutdown_connections 2021-04-09T18:26:42.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.506 7f8b09f5c700 1 --2- 172.21.15.79:0/3683794546 >> v2:172.21.15.89:3300/0 conn(0x7f8b041c8040 0x7f8b041ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.506 7f8b09f5c700 1 --2- 172.21.15.79:0/3683794546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b040e9b10 0x7f8b0409f110 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.506 7f8b09f5c700 1 -- 172.21.15.79:0/3683794546 >> 172.21.15.79:0/3683794546 conn(0x7f8b040e6010 msgr2=0x7f8b040e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:42.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.506 7f8b09f5c700 1 -- 172.21.15.79:0/3683794546 shutdown_connections 2021-04-09T18:26:42.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.506 7f8b09f5c700 1 -- 172.21.15.79:0/3683794546 wait complete. 2021-04-09T18:26:42.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.506 7f8b09f5c700 1 Processor -- start 2021-04-09T18:26:42.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.506 7f8b09f5c700 1 -- start start 2021-04-09T18:26:42.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8b09f5c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b040c17c0 0x7f8b040b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:42.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8b09f5c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b041b11c0 0x7f8b041b1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:42.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8b09f5c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b040c64e0 0x7f8b040c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:42.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8b09f5c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b04047500 con 0x7f8b040c64e0 2021-04-09T18:26:42.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8b09f5c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b04097ef0 con 0x7f8b040c17c0 2021-04-09T18:26:42.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8b09f5c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b040981f0 con 0x7f8b041b11c0 2021-04-09T18:26:42.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8b03fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b040c64e0 0x7f8b040c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:42.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8b037fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b040c17c0 0x7f8b040b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:42.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8b03fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b040c64e0 0x7f8b040c6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56488/0 (socket says 172.21.15.79:56488) 2021-04-09T18:26:42.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8b03fff700 1 -- 172.21.15.79:0/1210794639 learned_addr learned my addr 172.21.15.79:0/1210794639 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:42.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8b02ffd700 1 --2- 172.21.15.79:0/1210794639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b041b11c0 0x7f8b041b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:42.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8b03fff700 1 -- 172.21.15.79:0/1210794639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b041b11c0 msgr2=0x7f8b041b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8b03fff700 1 --2- 172.21.15.79:0/1210794639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b041b11c0 0x7f8b041b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8b03fff700 1 -- 172.21.15.79:0/1210794639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b040c17c0 msgr2=0x7f8b040b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8b03fff700 1 --2- 172.21.15.79:0/1210794639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b040c17c0 0x7f8b040b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8b03fff700 1 -- 172.21.15.79:0/1210794639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b041aeea0 con 0x7f8b040c64e0 2021-04-09T18:26:42.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8b03fff700 1 --2- 172.21.15.79:0/1210794639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b040c64e0 0x7f8b040c6930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f8b04097e70 tx=0x7f8afc00c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:42.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8afbfff700 1 -- 172.21.15.79:0/1210794639 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b041aeea0 con 0x7f8b040c64e0 2021-04-09T18:26:42.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8afbfff700 1 -- 172.21.15.79:0/1210794639 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc00cca0 con 0x7f8b040c64e0 2021-04-09T18:26:42.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8afbfff700 1 -- 172.21.15.79:0/1210794639 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8afc00f040 con 0x7f8b040c64e0 2021-04-09T18:26:42.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8b09f5c700 1 -- 172.21.15.79:0/1210794639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b04097380 con 0x7f8b040c64e0 2021-04-09T18:26:42.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8b09f5c700 1 -- 172.21.15.79:0/1210794639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b040acc70 con 0x7f8b040c64e0 2021-04-09T18:26:42.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8afbfff700 1 -- 172.21.15.79:0/1210794639 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8afc022060 con 0x7f8b040c64e0 2021-04-09T18:26:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8afbfff700 1 --2- 172.21.15.79:0/1210794639 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8ae8029100 0x7f8ae802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.510 7f8afbfff700 1 -- 172.21.15.79:0/1210794639 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f8afc010040 con 0x7f8b040c64e0 2021-04-09T18:26:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.514 7f8b037fe700 1 --2- 172.21.15.79:0/1210794639 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8ae8029100 0x7f8ae802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.514 7f8b037fe700 1 --2- 172.21.15.79:0/1210794639 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8ae8029100 0x7f8ae802b650 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:42.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.518 7f8b09f5c700 1 -- 172.21.15.79:0/1210794639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b040e39f0 con 0x7f8b040c64e0 2021-04-09T18:26:42.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.522 7f8afbfff700 1 -- 172.21.15.79:0/1210794639 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8b040f76f0 con 0x7f8b040c64e0 2021-04-09T18:26:42.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.674 7f8b09f5c700 1 -- 172.21.15.79:0/1210794639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f8b040f5b50 con 0x7f8b040c64e0 2021-04-09T18:26:42.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.674 7f8afbfff700 1 -- 172.21.15.79:0/1210794639 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8afc00ca90 con 0x7f8b040c64e0 2021-04-09T18:26:42.682 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:42.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.678 7f8b09f5c700 1 -- 172.21.15.79:0/1210794639 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8ae8029100 msgr2=0x7f8ae802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.678 7f8b09f5c700 1 --2- 172.21.15.79:0/1210794639 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8ae8029100 0x7f8ae802b650 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.678 7f8b09f5c700 1 -- 172.21.15.79:0/1210794639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b040c64e0 msgr2=0x7f8b040c6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.678 7f8b09f5c700 1 --2- 172.21.15.79:0/1210794639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b040c64e0 0x7f8b040c6930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f8b04097e70 tx=0x7f8afc00c430).stop 2021-04-09T18:26:42.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.678 7f8b09f5c700 1 -- 172.21.15.79:0/1210794639 shutdown_connections 2021-04-09T18:26:42.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.678 7f8b09f5c700 1 --2- 172.21.15.79:0/1210794639 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8ae8029100 0x7f8ae802b650 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.678 7f8b09f5c700 1 --2- 172.21.15.79:0/1210794639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b040c17c0 0x7f8b040b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.678 7f8b09f5c700 1 --2- 172.21.15.79:0/1210794639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b040c64e0 0x7f8b040c6930 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.678 7f8b09f5c700 1 --2- 172.21.15.79:0/1210794639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b041b11c0 0x7f8b041b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.678 7f8b09f5c700 1 -- 172.21.15.79:0/1210794639 >> 172.21.15.79:0/1210794639 conn(0x7f8b0409b050 msgr2=0x7f8b040d81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:42.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.678 7f8b09f5c700 1 -- 172.21.15.79:0/1210794639 shutdown_connections 2021-04-09T18:26:42.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.678 7f8b09f5c700 1 -- 172.21.15.79:0/1210794639 wait complete. 2021-04-09T18:26:42.694 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:26:42.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67c0674700 1 Processor -- start 2021-04-09T18:26:42.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67c0674700 1 -- start start 2021-04-09T18:26:42.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67c0674700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67b81c9050 0x7f67b81cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:42.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67c0674700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b80fbb50 con 0x7f67b80f5550 2021-04-09T18:26:42.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67c0674700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b809f910 con 0x7f67b80e9b10 2021-04-09T18:26:42.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67c0674700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b81c3df0 con 0x7f67b81c9050 2021-04-09T18:26:42.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67be418700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f67b80f5550 0x7f67b80f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51202/0 (socket says 172.21.15.79:51202) 2021-04-09T18:26:42.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67be418700 1 -- 172.21.15.79:0/1812949494 learned_addr learned my addr 172.21.15.79:0/1812949494 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:42.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67bec19700 1 --2- 172.21.15.79:0/1812949494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67b81c9050 0x7f67b81cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:42.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67bd416700 1 -- 172.21.15.79:0/1812949494 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614443662 0 0) 0x7f67b40010d0 con 0x7f67b80f5550 2021-04-09T18:26:42.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67bd416700 1 -- 172.21.15.79:0/1812949494 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67a4003240 con 0x7f67b80f5550 2021-04-09T18:26:42.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67bd416700 1 -- 172.21.15.79:0/1812949494 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974547714 0 0) 0x7f67a80010d0 con 0x7f67b80e9b10 2021-04-09T18:26:42.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67bd416700 1 -- 172.21.15.79:0/1812949494 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67a4003620 con 0x7f67b80e9b10 2021-04-09T18:26:42.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67bd416700 1 -- 172.21.15.79:0/1812949494 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2242706739 0 0) 0x7f67b4001650 con 0x7f67b80f5550 2021-04-09T18:26:42.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67bec19700 1 -- 172.21.15.79:0/1812949494 >> v1:172.21.15.89:6789/0 conn(0x7f67b80e9b10 legacy=0x7f67b809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67bec19700 1 -- 172.21.15.79:0/1812949494 >> v1:172.21.15.79:6789/0 conn(0x7f67b80f5550 legacy=0x7f67b80f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67bec19700 1 -- 172.21.15.79:0/1812949494 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b80e5700 con 0x7f67b81c9050 2021-04-09T18:26:42.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67bec19700 1 --2- 172.21.15.79:0/1812949494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67b81c9050 0x7f67b81cb4b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f67b4001980 tx=0x7f67b000b0e0).ready entity=mon.2 client_cookie=61ab13d5c69ba8a4 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:42.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67bd416700 1 -- 172.21.15.79:0/1812949494 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67b80e5700 con 0x7f67b81c9050 2021-04-09T18:26:42.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67bd416700 1 -- 172.21.15.79:0/1812949494 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b000b9b0 con 0x7f67b81c9050 2021-04-09T18:26:42.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67bd416700 1 -- 172.21.15.79:0/1812949494 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67b0002020 con 0x7f67b81c9050 2021-04-09T18:26:42.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67c0674700 1 -- 172.21.15.79:0/1812949494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67b81c9050 msgr2=0x7f67b81cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.802 7f67c0674700 1 --2- 172.21.15.79:0/1812949494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67b81c9050 0x7f67b81cb4b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f67b4001980 tx=0x7f67b000b0e0).stop 2021-04-09T18:26:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.806 7f67c0674700 1 -- 172.21.15.79:0/1812949494 shutdown_connections 2021-04-09T18:26:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.806 7f67c0674700 1 --2- 172.21.15.79:0/1812949494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67b81c9050 0x7f67b81cb4b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.806 7f67c0674700 1 -- 172.21.15.79:0/1812949494 >> 172.21.15.79:0/1812949494 conn(0x7f67b80e6010 msgr2=0x7f67b80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.806 7f67c0674700 1 -- 172.21.15.79:0/1812949494 shutdown_connections 2021-04-09T18:26:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.806 7f67c0674700 1 -- 172.21.15.79:0/1812949494 wait complete. 2021-04-09T18:26:42.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.806 7f67c0674700 1 Processor -- start 2021-04-09T18:26:42.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.806 7f67c0674700 1 -- start start 2021-04-09T18:26:42.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.806 7f67c0674700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67b80a7b70 0x7f67b80d4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:42.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.806 7f67c0674700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67b80a7fc0 0x7f67b80b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.806 7f67c0674700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67b80d5560 0x7f67b80b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.806 7f67c0674700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b80e9f60 con 0x7f67b80a7b70 2021-04-09T18:26:42.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.806 7f67c0674700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b80c0760 con 0x7f67b80d5560 2021-04-09T18:26:42.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.806 7f67c0674700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b80c0a60 con 0x7f67b80a7fc0 2021-04-09T18:26:42.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67be418700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67b80a7b70 0x7f67b80d4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:42.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67be418700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67b80a7b70 0x7f67b80d4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56502/0 (socket says 172.21.15.79:56502) 2021-04-09T18:26:42.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67be418700 1 -- 172.21.15.79:0/2155129823 learned_addr learned my addr 172.21.15.79:0/2155129823 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:42.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67bec19700 1 --2- 172.21.15.79:0/2155129823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67b80d5560 0x7f67b80b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:42.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67bdc17700 1 --2- 172.21.15.79:0/2155129823 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67b80a7fc0 0x7f67b80b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:42.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67be418700 1 -- 172.21.15.79:0/2155129823 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67b80a7fc0 msgr2=0x7f67b80b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67be418700 1 --2- 172.21.15.79:0/2155129823 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67b80a7fc0 0x7f67b80b5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67be418700 1 -- 172.21.15.79:0/2155129823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67b80d5560 msgr2=0x7f67b80b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67be418700 1 --2- 172.21.15.79:0/2155129823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67b80d5560 0x7f67b80b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67be418700 1 -- 172.21.15.79:0/2155129823 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b80c02f0 con 0x7f67b80a7b70 2021-04-09T18:26:42.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67be418700 1 --2- 172.21.15.79:0/2155129823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67b80a7b70 0x7f67b80d4f30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f67b80d8090 tx=0x7f67b40018f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:42.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67aeffd700 1 -- 172.21.15.79:0/2155129823 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67b80c02f0 con 0x7f67b80a7b70 2021-04-09T18:26:42.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67aeffd700 1 -- 172.21.15.79:0/2155129823 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b4007170 con 0x7f67b80a7b70 2021-04-09T18:26:42.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67c0674700 1 -- 172.21.15.79:0/2155129823 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b80c5750 con 0x7f67b80a7b70 2021-04-09T18:26:42.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67aeffd700 1 -- 172.21.15.79:0/2155129823 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67b400ac40 con 0x7f67b80a7b70 2021-04-09T18:26:42.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67c0674700 1 -- 172.21.15.79:0/2155129823 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b80b6c40 con 0x7f67b80a7b70 2021-04-09T18:26:42.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67aeffd700 1 -- 172.21.15.79:0/2155129823 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f67b4004500 con 0x7f67b80a7b70 2021-04-09T18:26:42.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67aeffd700 1 --2- 172.21.15.79:0/2155129823 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f67a0029100 0x7f67a002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:42.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67aeffd700 1 -- 172.21.15.79:0/2155129823 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f67b4039860 con 0x7f67b80a7b70 2021-04-09T18:26:42.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67bdc17700 1 --2- 172.21.15.79:0/2155129823 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f67a0029100 0x7f67a002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:42.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.810 7f67bdc17700 1 --2- 172.21.15.79:0/2155129823 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f67a0029100 0x7f67a002b650 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:42.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.818 7f67c0674700 1 -- 172.21.15.79:0/2155129823 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b80e39f0 con 0x7f67b80a7b70 2021-04-09T18:26:42.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.822 7f67aeffd700 1 -- 172.21.15.79:0/2155129823 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f67b8107f80 con 0x7f67b80a7b70 2021-04-09T18:26:42.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.978 7f67c0674700 1 -- 172.21.15.79:0/2155129823 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f67b80f5b50 con 0x7f67b80a7b70 2021-04-09T18:26:42.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.978 7f67aeffd700 1 -- 172.21.15.79:0/2155129823 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7f67b400a840 con 0x7f67b80a7b70 2021-04-09T18:26:42.985 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:42.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.982 7f67c0674700 1 -- 172.21.15.79:0/2155129823 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f67a0029100 msgr2=0x7f67a002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.982 7f67c0674700 1 --2- 172.21.15.79:0/2155129823 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f67a0029100 0x7f67a002b650 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.982 7f67c0674700 1 -- 172.21.15.79:0/2155129823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67b80a7b70 msgr2=0x7f67b80d4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:42.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.982 7f67c0674700 1 --2- 172.21.15.79:0/2155129823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67b80a7b70 0x7f67b80d4f30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f67b80d8090 tx=0x7f67b40018f0).stop 2021-04-09T18:26:42.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.982 7f67c0674700 1 -- 172.21.15.79:0/2155129823 shutdown_connections 2021-04-09T18:26:42.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.982 7f67c0674700 1 --2- 172.21.15.79:0/2155129823 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f67a0029100 0x7f67a002b650 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.982 7f67c0674700 1 --2- 172.21.15.79:0/2155129823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67b80d5560 0x7f67b80b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.982 7f67c0674700 1 --2- 172.21.15.79:0/2155129823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67b80a7b70 0x7f67b80d4f30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.982 7f67c0674700 1 --2- 172.21.15.79:0/2155129823 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67b80a7fc0 0x7f67b80b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:42.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.982 7f67c0674700 1 -- 172.21.15.79:0/2155129823 >> 172.21.15.79:0/2155129823 conn(0x7f67b80a2520 msgr2=0x7f67b80d82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:42.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.982 7f67c0674700 1 -- 172.21.15.79:0/2155129823 shutdown_connections 2021-04-09T18:26:42.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:42.982 7f67c0674700 1 -- 172.21.15.79:0/2155129823 wait complete. 2021-04-09T18:26:42.998 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:26:43.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.090 7fa32eb70700 1 Processor -- start 2021-04-09T18:26:43.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.090 7fa32eb70700 1 -- start start 2021-04-09T18:26:43.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.090 7fa32eb70700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa3280f5550 0x7fa3280f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:43.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.090 7fa32eb70700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa3281c8040 0x7fa3281ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:43.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.090 7fa32eb70700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3280fbb50 con 0x7fa3280e9b10 2021-04-09T18:26:43.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.090 7fa32eb70700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3280e9f60 con 0x7fa3281c8040 2021-04-09T18:26:43.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.090 7fa32eb70700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3281c3df0 con 0x7fa3280f5550 2021-04-09T18:26:43.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.090 7fa32d115700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa3281c8040 0x7fa3281ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:43.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.090 7fa32d115700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa3281c8040 0x7fa3281ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56510/0 (socket says 172.21.15.79:56510) 2021-04-09T18:26:43.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.090 7fa32d115700 1 -- 172.21.15.79:0/2416728205 learned_addr learned my addr 172.21.15.79:0/2416728205 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:43.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.090 7fa32c914700 1 --2- 172.21.15.79:0/2416728205 >> v2:172.21.15.89:3300/0 conn(0x7fa3280f5550 0x7fa3280f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:43.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.090 7fa32d115700 1 -- 172.21.15.79:0/2416728205 >> v2:172.21.15.89:3300/0 conn(0x7fa3280f5550 msgr2=0x7fa3280f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:43.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.090 7fa32d115700 1 --2- 172.21.15.79:0/2416728205 >> v2:172.21.15.89:3300/0 conn(0x7fa3280f5550 0x7fa3280f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:43.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.090 7fa32d115700 1 -- 172.21.15.79:0/2416728205 >> v1:172.21.15.89:6789/0 conn(0x7fa3280e9b10 legacy=0x7fa32809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:43.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.090 7fa3277fe700 1 -- 172.21.15.79:0/2416728205 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217391506 0 0) 0x7fa31c0010d0 con 0x7fa3280e9b10 2021-04-09T18:26:43.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.090 7fa32d115700 1 -- 172.21.15.79:0/2416728205 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32809f910 con 0x7fa3281c8040 2021-04-09T18:26:43.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.094 7fa32d115700 1 --2- 172.21.15.79:0/2416728205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3281c8040 0x7fa3281ca4a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fa3200032b0 tx=0x7fa32000b3c0).ready entity=mon.0 client_cookie=6eaec039eae2f88b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:43.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.094 7fa3277fe700 1 -- 172.21.15.79:0/2416728205 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa32809f910 con 0x7fa3281c8040 2021-04-09T18:26:43.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.094 7fa3277fe700 1 -- 172.21.15.79:0/2416728205 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32000bc20 con 0x7fa3281c8040 2021-04-09T18:26:43.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.094 7fa3277fe700 1 -- 172.21.15.79:0/2416728205 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa320002020 con 0x7fa3281c8040 2021-04-09T18:26:43.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.094 7fa32eb70700 1 -- 172.21.15.79:0/2416728205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3281c8040 msgr2=0x7fa3281ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:43.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.094 7fa32eb70700 1 --2- 172.21.15.79:0/2416728205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3281c8040 0x7fa3281ca4a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fa3200032b0 tx=0x7fa32000b3c0).stop 2021-04-09T18:26:43.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.094 7fa32eb70700 1 -- 172.21.15.79:0/2416728205 shutdown_connections 2021-04-09T18:26:43.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.094 7fa32eb70700 1 --2- 172.21.15.79:0/2416728205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3281c8040 0x7fa3281ca4a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:43.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.094 7fa32eb70700 1 --2- 172.21.15.79:0/2416728205 >> v2:172.21.15.89:3300/0 conn(0x7fa3280f5550 0x7fa3280f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:43.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.094 7fa32eb70700 1 -- 172.21.15.79:0/2416728205 >> 172.21.15.79:0/2416728205 conn(0x7fa3280e6010 msgr2=0x7fa3280e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:43.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.094 7fa32eb70700 1 -- 172.21.15.79:0/2416728205 shutdown_connections 2021-04-09T18:26:43.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.094 7fa32eb70700 1 -- 172.21.15.79:0/2416728205 wait complete. 2021-04-09T18:26:43.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.098 7fa32eb70700 1 Processor -- start 2021-04-09T18:26:43.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.098 7fa32eb70700 1 -- start start 2021-04-09T18:26:43.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.098 7fa32eb70700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3280d6cb0 0x7fa328090bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:43.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.098 7fa32eb70700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3280d55d0 0x7fa3280a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:43.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.098 7fa32eb70700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3280cf990 0x7fa3280cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:43.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.098 7fa32eb70700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32809a330 con 0x7fa3280d6cb0 2021-04-09T18:26:43.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.098 7fa32eb70700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3280d5a20 con 0x7fa3280d55d0 2021-04-09T18:26:43.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.098 7fa32eb70700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32809a630 con 0x7fa3280cf990 2021-04-09T18:26:43.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.098 7fa32c914700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3280d6cb0 0x7fa328090bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:43.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.098 7fa32c914700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3280d6cb0 0x7fa328090bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56512/0 (socket says 172.21.15.79:56512) 2021-04-09T18:26:43.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.098 7fa32c914700 1 -- 172.21.15.79:0/3618919624 learned_addr learned my addr 172.21.15.79:0/3618919624 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:43.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.098 7fa327fff700 1 --2- 172.21.15.79:0/3618919624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3280d55d0 0x7fa3280a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:43.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.098 7fa32d115700 1 --2- 172.21.15.79:0/3618919624 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3280cf990 0x7fa3280cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:43.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.102 7fa32c914700 1 -- 172.21.15.79:0/3618919624 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3280cf990 msgr2=0x7fa3280cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:43.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.102 7fa32c914700 1 --2- 172.21.15.79:0/3618919624 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3280cf990 0x7fa3280cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:43.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.102 7fa32c914700 1 -- 172.21.15.79:0/3618919624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3280d55d0 msgr2=0x7fa3280a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:43.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.102 7fa32c914700 1 --2- 172.21.15.79:0/3618919624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3280d55d0 0x7fa3280a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:43.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.102 7fa32c914700 1 -- 172.21.15.79:0/3618919624 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3280a5210 con 0x7fa3280d6cb0 2021-04-09T18:26:43.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.102 7fa32c914700 1 --2- 172.21.15.79:0/3618919624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3280d6cb0 0x7fa328090bd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fa32808e6c0 tx=0x7fa31800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:43.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.102 7fa3257fa700 1 -- 172.21.15.79:0/3618919624 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa3280a5210 con 0x7fa3280d6cb0 2021-04-09T18:26:43.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.102 7fa3257fa700 1 -- 172.21.15.79:0/3618919624 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31800cd60 con 0x7fa3280d6cb0 2021-04-09T18:26:43.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.102 7fa32eb70700 1 -- 172.21.15.79:0/3618919624 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3280918a0 con 0x7fa3280d6cb0 2021-04-09T18:26:43.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.102 7fa3257fa700 1 -- 172.21.15.79:0/3618919624 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa31800f040 con 0x7fa3280d6cb0 2021-04-09T18:26:43.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.102 7fa32eb70700 1 -- 172.21.15.79:0/3618919624 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3280a4cd0 con 0x7fa3280d6cb0 2021-04-09T18:26:43.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.102 7fa3257fa700 1 -- 172.21.15.79:0/3618919624 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa318011070 con 0x7fa3280d6cb0 2021-04-09T18:26:43.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.102 7fa3257fa700 1 --2- 172.21.15.79:0/3618919624 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa308029100 0x7fa30802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:43.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.102 7fa3257fa700 1 -- 172.21.15.79:0/3618919624 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fa318010040 con 0x7fa3280d6cb0 2021-04-09T18:26:43.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.102 7fa327fff700 1 --2- 172.21.15.79:0/3618919624 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa308029100 0x7fa30802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:43.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.102 7fa327fff700 1 --2- 172.21.15.79:0/3618919624 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa308029100 0x7fa30802b650 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:43.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.102 7fa32eb70700 1 -- 172.21.15.79:0/3618919624 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3280e39f0 con 0x7fa3280d6cb0 2021-04-09T18:26:43.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.110 7fa3257fa700 1 -- 172.21.15.79:0/3618919624 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa31800c960 con 0x7fa3280d6cb0 2021-04-09T18:26:43.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.270 7fa32eb70700 1 -- 172.21.15.79:0/3618919624 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fa3281a9680 con 0x7fa3280d6cb0 2021-04-09T18:26:43.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.274 7fa3257fa700 1 -- 172.21.15.79:0/3618919624 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa318000bf0 con 0x7fa3280d6cb0 2021-04-09T18:26:43.280 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:43.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.274 7fa32eb70700 1 -- 172.21.15.79:0/3618919624 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa308029100 msgr2=0x7fa30802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:43.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.274 7fa32eb70700 1 --2- 172.21.15.79:0/3618919624 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa308029100 0x7fa30802b650 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:43.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.274 7fa32eb70700 1 -- 172.21.15.79:0/3618919624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3280d6cb0 msgr2=0x7fa328090bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:43.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.274 7fa32eb70700 1 --2- 172.21.15.79:0/3618919624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3280d6cb0 0x7fa328090bd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fa32808e6c0 tx=0x7fa31800c430).stop 2021-04-09T18:26:43.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.274 7fa32eb70700 1 -- 172.21.15.79:0/3618919624 shutdown_connections 2021-04-09T18:26:43.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.274 7fa32eb70700 1 --2- 172.21.15.79:0/3618919624 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa308029100 0x7fa30802b650 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:43.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.274 7fa32eb70700 1 --2- 172.21.15.79:0/3618919624 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3280cf990 0x7fa3280cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:43.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.274 7fa32eb70700 1 --2- 172.21.15.79:0/3618919624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3280d6cb0 0x7fa328090bd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:43.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.274 7fa32eb70700 1 --2- 172.21.15.79:0/3618919624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3280d55d0 0x7fa3280a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:43.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.274 7fa32eb70700 1 -- 172.21.15.79:0/3618919624 >> 172.21.15.79:0/3618919624 conn(0x7fa3280d8290 msgr2=0x7fa328093f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:43.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.274 7fa32eb70700 1 -- 172.21.15.79:0/3618919624 shutdown_connections 2021-04-09T18:26:43.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.274 7fa32eb70700 1 -- 172.21.15.79:0/3618919624 wait complete. 2021-04-09T18:26:43.296 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) 2021-04-09T18:26:43.297 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2021-04-09T18:26:43.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f753cb9f700 1 Processor -- start 2021-04-09T18:26:43.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f753cb9f700 1 -- start start 2021-04-09T18:26:43.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f753cb9f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75380e9ae0 0x7f753809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:43.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f753cb9f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f75381c8010 0x7f75381ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:43.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f753cb9f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75380fbb20 con 0x7f75380f5520 2021-04-09T18:26:43.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f753cb9f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75381c3dc0 con 0x7f75381c8010 2021-04-09T18:26:43.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f753cb9f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75380e9f30 con 0x7f75380e9ae0 2021-04-09T18:26:43.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f7535fe5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75380e9ae0 0x7f753809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:43.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f7536fe7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f75381c8010 0x7f75381ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:43.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f7535fe5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75380e9ae0 0x7f753809f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:53516/0 (socket says 172.21.15.79:53516) 2021-04-09T18:26:43.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f7536fe7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f75381c8010 0x7f75381ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:44866/0 (socket says 172.21.15.79:44866) 2021-04-09T18:26:43.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f7535fe5700 1 -- 172.21.15.79:0/4228334050 learned_addr learned my addr 172.21.15.79:0/4228334050 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:43.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f75367e6700 1 --1- 172.21.15.79:0/4228334050 >> v1:172.21.15.89:6789/0 conn(0x7f75380f5520 0x7f75380f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:51702/0 (socket says 172.21.15.79:51702) 2021-04-09T18:26:43.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f7536fe7700 1 -- 172.21.15.79:0/4228334050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75380e9ae0 msgr2=0x7f753809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:43.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f7536fe7700 1 --2- 172.21.15.79:0/4228334050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75380e9ae0 0x7f753809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:43.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f7536fe7700 1 -- 172.21.15.79:0/4228334050 >> v1:172.21.15.89:6789/0 conn(0x7f75380f5520 legacy=0x7f75380f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:43.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f7536fe7700 1 -- 172.21.15.79:0/4228334050 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75380e56d0 con 0x7f75381c8010 2021-04-09T18:26:43.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f7535fe5700 1 --2- 172.21.15.79:0/4228334050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75380e9ae0 0x7f753809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:43.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f7536fe7700 1 --2- 172.21.15.79:0/4228334050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75381c8010 0x7f75381ca470 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f7520001340 tx=0x7f7520001040).ready entity=mon.1 client_cookie=ae1d1fd8bbb9bdde server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:43.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f75357e4700 1 -- 172.21.15.79:0/4228334050 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f75380e56d0 con 0x7f75381c8010 2021-04-09T18:26:43.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f75357e4700 1 -- 172.21.15.79:0/4228334050 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753000ba50 con 0x7f75381c8010 2021-04-09T18:26:43.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f75357e4700 1 -- 172.21.15.79:0/4228334050 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7530002020 con 0x7f75381c8010 2021-04-09T18:26:43.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f753cb9f700 1 -- 172.21.15.79:0/4228334050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75381c8010 msgr2=0x7f75381ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:43.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f753cb9f700 1 --2- 172.21.15.79:0/4228334050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75381c8010 0x7f75381ca470 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f7520001340 tx=0x7f7520001040).stop 2021-04-09T18:26:43.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f753cb9f700 1 -- 172.21.15.79:0/4228334050 shutdown_connections 2021-04-09T18:26:43.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f753cb9f700 1 --2- 172.21.15.79:0/4228334050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75381c8010 0x7f75381ca470 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:43.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f753cb9f700 1 --2- 172.21.15.79:0/4228334050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75380e9ae0 0x7f753809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:43.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.390 7f753cb9f700 1 -- 172.21.15.79:0/4228334050 >> 172.21.15.79:0/4228334050 conn(0x7f75380e5fe0 msgr2=0x7f75380e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:43.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.394 7f753cb9f700 1 -- 172.21.15.79:0/4228334050 shutdown_connections 2021-04-09T18:26:43.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.394 7f753cb9f700 1 -- 172.21.15.79:0/4228334050 wait complete. 2021-04-09T18:26:43.412 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.394 7f753cb9f700 1 Processor -- start 2021-04-09T18:26:43.412 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.394 7f753cb9f700 1 -- start start 2021-04-09T18:26:43.412 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.394 7f753cb9f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7538090080 0x7f753808f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:43.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.394 7f753cb9f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75381aa550 0x7f75381a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:43.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.394 7f753cb9f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7538092030 0x7f75381a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:43.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.394 7f753cb9f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75380927a0 con 0x7f7538090080 2021-04-09T18:26:43.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.394 7f753cb9f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75380b7a10 con 0x7f75381aa550 2021-04-09T18:26:43.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.394 7f753cb9f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7538092480 con 0x7f7538092030 2021-04-09T18:26:43.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f75367e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7538090080 0x7f753808f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:43.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f75367e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7538090080 0x7f753808f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56526/0 (socket says 172.21.15.79:56526) 2021-04-09T18:26:43.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f75367e6700 1 -- 172.21.15.79:0/1952583372 learned_addr learned my addr 172.21.15.79:0/1952583372 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:43.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f7536fe7700 1 --2- 172.21.15.79:0/1952583372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7538092030 0x7f75381a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:43.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f7535fe5700 1 --2- 172.21.15.79:0/1952583372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75381aa550 0x7f75381a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:43.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f75367e6700 1 -- 172.21.15.79:0/1952583372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7538092030 msgr2=0x7f75381a69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:43.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f75367e6700 1 --2- 172.21.15.79:0/1952583372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7538092030 0x7f75381a69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:43.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f75367e6700 1 -- 172.21.15.79:0/1952583372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75381aa550 msgr2=0x7f75381a6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:43.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f75367e6700 1 --2- 172.21.15.79:0/1952583372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75381aa550 0x7f75381a6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:43.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f75367e6700 1 -- 172.21.15.79:0/1952583372 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753808f9a0 con 0x7f7538090080 2021-04-09T18:26:43.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f75367e6700 1 --2- 172.21.15.79:0/1952583372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7538090080 0x7f753808f370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f7538095160 tx=0x7f752000cec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:43.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f752effd700 1 -- 172.21.15.79:0/1952583372 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f753808f9a0 con 0x7f7538090080 2021-04-09T18:26:43.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f752effd700 1 -- 172.21.15.79:0/1952583372 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7520007320 con 0x7f7538090080 2021-04-09T18:26:43.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f753cb9f700 1 -- 172.21.15.79:0/1952583372 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75380b8f30 con 0x7f7538090080 2021-04-09T18:26:43.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f752effd700 1 -- 172.21.15.79:0/1952583372 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f752000a770 con 0x7f7538090080 2021-04-09T18:26:43.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f753cb9f700 1 -- 172.21.15.79:0/1952583372 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75380b9430 con 0x7f7538090080 2021-04-09T18:26:43.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f752effd700 1 -- 172.21.15.79:0/1952583372 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f752001a060 con 0x7f7538090080 2021-04-09T18:26:43.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f752effd700 1 --2- 172.21.15.79:0/1952583372 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f751c029100 0x7f751c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:43.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f752effd700 1 -- 172.21.15.79:0/1952583372 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f75200390e0 con 0x7f7538090080 2021-04-09T18:26:43.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f7535fe5700 1 --2- 172.21.15.79:0/1952583372 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f751c029100 0x7f751c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:43.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.398 7f7535fe5700 1 --2- 172.21.15.79:0/1952583372 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f751c029100 0x7f751c02b650 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:43.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.402 7f753cb9f700 1 -- 172.21.15.79:0/1952583372 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75380e39e0 con 0x7f7538090080 2021-04-09T18:26:43.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.406 7f752effd700 1 -- 172.21.15.79:0/1952583372 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7520007110 con 0x7f7538090080 2021-04-09T18:26:43.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:43.570 7f753cb9f700 1 -- 172.21.15.79:0/1952583372 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7f75380f5b20 con 0x7f7538090080 2021-04-09T18:26:44.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.034 7f752effd700 1 -- 172.21.15.79:0/1952583372 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v46) v1 ==== 142+0+0 (secure 0 0 0) 0x7f7520000bf0 con 0x7f7538090080 2021-04-09T18:26:44.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.090 7f753cb9f700 1 -- 172.21.15.79:0/1952583372 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f751c029100 msgr2=0x7f751c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:44.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.090 7f753cb9f700 1 --2- 172.21.15.79:0/1952583372 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f751c029100 0x7f751c02b650 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:44.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.090 7f753cb9f700 1 -- 172.21.15.79:0/1952583372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7538090080 msgr2=0x7f753808f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:44.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.090 7f753cb9f700 1 --2- 172.21.15.79:0/1952583372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7538090080 0x7f753808f370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f7538095160 tx=0x7f752000cec0).stop 2021-04-09T18:26:44.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.090 7f753cb9f700 1 -- 172.21.15.79:0/1952583372 shutdown_connections 2021-04-09T18:26:44.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.090 7f753cb9f700 1 --2- 172.21.15.79:0/1952583372 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f751c029100 0x7f751c02b650 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:44.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.090 7f753cb9f700 1 --2- 172.21.15.79:0/1952583372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7538092030 0x7f75381a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:44.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.090 7f753cb9f700 1 --2- 172.21.15.79:0/1952583372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7538090080 0x7f753808f370 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:44.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.090 7f753cb9f700 1 --2- 172.21.15.79:0/1952583372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75381aa550 0x7f75381a6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:44.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.090 7f753cb9f700 1 -- 172.21.15.79:0/1952583372 >> 172.21.15.79:0/1952583372 conn(0x7f75380d4c20 msgr2=0x7f75380d8820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:44.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.090 7f753cb9f700 1 -- 172.21.15.79:0/1952583372 shutdown_connections 2021-04-09T18:26:44.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.090 7f753cb9f700 1 -- 172.21.15.79:0/1952583372 wait complete. 2021-04-09T18:26:44.113 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-04-09T18:26:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fcb4d0700 1 Processor -- start 2021-04-09T18:26:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fcb4d0700 1 -- start start 2021-04-09T18:26:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fcb4d0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6fc40f5550 0x7f6fc40f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fcb4d0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6fc40e9b10 0x7f6fc409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:44.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fcb4d0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc40fbb50 con 0x7f6fc41c2de0 2021-04-09T18:26:44.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fcb4d0700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc40e9f60 con 0x7f6fc40e9b10 2021-04-09T18:26:44.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fcb4d0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc40e5a00 con 0x7f6fc40f5550 2021-04-09T18:26:44.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fc8a73700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6fc40e9b10 0x7f6fc409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:44.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fc9a75700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6fc41c2de0 0x7f6fc41c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51248/0 (socket says 172.21.15.79:51248) 2021-04-09T18:26:44.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fc9a75700 1 -- 172.21.15.79:0/2781778511 learned_addr learned my addr 172.21.15.79:0/2781778511 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:44.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fc9274700 1 --2- 172.21.15.79:0/2781778511 >> v2:172.21.15.89:3300/0 conn(0x7f6fc40f5550 0x7f6fc40f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:44.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fc8a73700 1 -- 172.21.15.79:0/2781778511 >> v2:172.21.15.89:3300/0 conn(0x7f6fc40f5550 msgr2=0x7f6fc40f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:44.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fc8a73700 1 --2- 172.21.15.79:0/2781778511 >> v2:172.21.15.89:3300/0 conn(0x7f6fc40f5550 0x7f6fc40f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:44.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fc8a73700 1 -- 172.21.15.79:0/2781778511 >> v1:172.21.15.79:6789/0 conn(0x7f6fc41c2de0 legacy=0x7f6fc41c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:44.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fc3fff700 1 -- 172.21.15.79:0/2781778511 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333973598 0 0) 0x7f6fb40010d0 con 0x7f6fc41c2de0 2021-04-09T18:26:44.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fc8a73700 1 -- 172.21.15.79:0/2781778511 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc40e5700 con 0x7f6fc40e9b10 2021-04-09T18:26:44.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fc8a73700 1 --2- 172.21.15.79:0/2781778511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fc40e9b10 0x7f6fc409f110 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f6fbc0032b0 tx=0x7f6fbc00b3c0).ready entity=mon.0 client_cookie=dc28f89f1b14eeed server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:44.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fc3fff700 1 -- 172.21.15.79:0/2781778511 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6fc40e5700 con 0x7f6fc40e9b10 2021-04-09T18:26:44.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fc3fff700 1 -- 172.21.15.79:0/2781778511 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc00bc20 con 0x7f6fc40e9b10 2021-04-09T18:26:44.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fcb4d0700 1 -- 172.21.15.79:0/2781778511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fc40e9b10 msgr2=0x7f6fc409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:44.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fc3fff700 1 -- 172.21.15.79:0/2781778511 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6fbc002020 con 0x7f6fc40e9b10 2021-04-09T18:26:44.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.218 7f6fcb4d0700 1 --2- 172.21.15.79:0/2781778511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fc40e9b10 0x7f6fc409f110 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f6fbc0032b0 tx=0x7f6fbc00b3c0).stop 2021-04-09T18:26:44.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.222 7f6fcb4d0700 1 -- 172.21.15.79:0/2781778511 shutdown_connections 2021-04-09T18:26:44.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.222 7f6fcb4d0700 1 --2- 172.21.15.79:0/2781778511 >> v2:172.21.15.89:3300/0 conn(0x7f6fc40f5550 0x7f6fc40f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:44.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.222 7f6fcb4d0700 1 --2- 172.21.15.79:0/2781778511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fc40e9b10 0x7f6fc409f110 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:44.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.222 7f6fcb4d0700 1 -- 172.21.15.79:0/2781778511 >> 172.21.15.79:0/2781778511 conn(0x7f6fc40e6010 msgr2=0x7f6fc40e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:44.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.222 7f6fcb4d0700 1 -- 172.21.15.79:0/2781778511 shutdown_connections 2021-04-09T18:26:44.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.222 7f6fcb4d0700 1 -- 172.21.15.79:0/2781778511 wait complete. 2021-04-09T18:26:44.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.222 7f6fcb4d0700 1 Processor -- start 2021-04-09T18:26:44.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.222 7f6fcb4d0700 1 -- start start 2021-04-09T18:26:44.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.222 7f6fcb4d0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fc41c0730 0x7f6fc40ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:44.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.222 7f6fcb4d0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fc40baf00 0x7f6fc40d6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:44.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.222 7f6fcb4d0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fc40bff60 0x7f6fc41b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:44.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.222 7f6fcb4d0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc40e8b20 con 0x7f6fc40baf00 2021-04-09T18:26:44.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.222 7f6fcb4d0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc40d5d40 con 0x7f6fc40bff60 2021-04-09T18:26:44.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.222 7f6fcb4d0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc40aece0 con 0x7f6fc41c0730 2021-04-09T18:26:44.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fc8a73700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fc40baf00 0x7f6fc40d6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:44.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fc8a73700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fc40baf00 0x7f6fc40d6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56542/0 (socket says 172.21.15.79:56542) 2021-04-09T18:26:44.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fc8a73700 1 -- 172.21.15.79:0/1220123209 learned_addr learned my addr 172.21.15.79:0/1220123209 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:44.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fc9a75700 1 --2- 172.21.15.79:0/1220123209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fc40bff60 0x7f6fc41b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:44.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fc9274700 1 --2- 172.21.15.79:0/1220123209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fc41c0730 0x7f6fc40ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:44.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fc8a73700 1 -- 172.21.15.79:0/1220123209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fc41c0730 msgr2=0x7f6fc40ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:44.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fc8a73700 1 --2- 172.21.15.79:0/1220123209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fc41c0730 0x7f6fc40ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:44.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fc8a73700 1 -- 172.21.15.79:0/1220123209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fc40bff60 msgr2=0x7f6fc41b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:44.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fc8a73700 1 --2- 172.21.15.79:0/1220123209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fc40bff60 0x7f6fc41b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:44.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fc8a73700 1 -- 172.21.15.79:0/1220123209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc40adc80 con 0x7f6fc40baf00 2021-04-09T18:26:44.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fc9274700 1 --2- 172.21.15.79:0/1220123209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fc41c0730 0x7f6fc40ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:44.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fc8a73700 1 --2- 172.21.15.79:0/1220123209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fc40baf00 0x7f6fc40d6040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f6fc40d7c90 tx=0x7f6fbc006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:44.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fc1ffb700 1 -- 172.21.15.79:0/1220123209 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6fc40adc80 con 0x7f6fc40baf00 2021-04-09T18:26:44.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fc1ffb700 1 -- 172.21.15.79:0/1220123209 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc01f020 con 0x7f6fc40baf00 2021-04-09T18:26:44.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fcb4d0700 1 -- 172.21.15.79:0/1220123209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc40bb350 con 0x7f6fc40baf00 2021-04-09T18:26:44.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fc1ffb700 1 -- 172.21.15.79:0/1220123209 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6fbc010b00 con 0x7f6fc40baf00 2021-04-09T18:26:44.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fcb4d0700 1 -- 172.21.15.79:0/1220123209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc40d5960 con 0x7f6fc40baf00 2021-04-09T18:26:44.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fc1ffb700 1 -- 172.21.15.79:0/1220123209 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6fbc00b0e0 con 0x7f6fc40baf00 2021-04-09T18:26:44.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fc1ffb700 1 --2- 172.21.15.79:0/1220123209 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6fa4029100 0x7f6fa402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:44.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fc1ffb700 1 -- 172.21.15.79:0/1220123209 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f6fbc03bfb0 con 0x7f6fc40baf00 2021-04-09T18:26:44.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.226 7f6fc9274700 1 --2- 172.21.15.79:0/1220123209 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6fa4029100 0x7f6fa402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:44.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.230 7f6fc9274700 1 --2- 172.21.15.79:0/1220123209 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6fa4029100 0x7f6fa402b650 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:44.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.230 7f6fcb4d0700 1 -- 172.21.15.79:0/1220123209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc40e39f0 con 0x7f6fc40baf00 2021-04-09T18:26:44.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.238 7f6fc1ffb700 1 -- 172.21.15.79:0/1220123209 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6fbc00ba10 con 0x7f6fc40baf00 2021-04-09T18:26:44.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.426 7f6fcb4d0700 1 -- 172.21.15.79:0/1220123209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6fc40f5b50 con 0x7f6fc40baf00 2021-04-09T18:26:44.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.434 7f6fc1ffb700 1 -- 172.21.15.79:0/1220123209 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6fbc010700 con 0x7f6fc40baf00 2021-04-09T18:26:44.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.446 7f6fcb4d0700 1 -- 172.21.15.79:0/1220123209 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6fa4029100 msgr2=0x7f6fa402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:44.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.446 7f6fcb4d0700 1 --2- 172.21.15.79:0/1220123209 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6fa4029100 0x7f6fa402b650 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:44.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.446 7f6fcb4d0700 1 -- 172.21.15.79:0/1220123209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fc40baf00 msgr2=0x7f6fc40d6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:44.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.446 7f6fcb4d0700 1 --2- 172.21.15.79:0/1220123209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fc40baf00 0x7f6fc40d6040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f6fc40d7c90 tx=0x7f6fbc006c10).stop 2021-04-09T18:26:44.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.446 7f6fcb4d0700 1 -- 172.21.15.79:0/1220123209 shutdown_connections 2021-04-09T18:26:44.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.446 7f6fcb4d0700 1 --2- 172.21.15.79:0/1220123209 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6fa4029100 0x7f6fa402b650 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:44.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.446 7f6fcb4d0700 1 --2- 172.21.15.79:0/1220123209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fc40bff60 0x7f6fc41b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:44.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.446 7f6fcb4d0700 1 --2- 172.21.15.79:0/1220123209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fc41c0730 0x7f6fc40ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:44.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.446 7f6fcb4d0700 1 --2- 172.21.15.79:0/1220123209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fc40baf00 0x7f6fc40d6040 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:44.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.446 7f6fcb4d0700 1 -- 172.21.15.79:0/1220123209 >> 172.21.15.79:0/1220123209 conn(0x7f6fc4098a00 msgr2=0x7f6fc40d7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:44.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.446 7f6fcb4d0700 1 -- 172.21.15.79:0/1220123209 shutdown_connections 2021-04-09T18:26:44.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:44.446 7f6fcb4d0700 1 -- 172.21.15.79:0/1220123209 wait complete. 2021-04-09T18:26:44.463 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:26:44.464 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:26:44.476 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:26:44.496 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:26:44.515 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:26:44.535 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:26:44.553 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:26:44.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:44.554 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:26:44.555 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:26:44.564 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:26:44.565 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:26:44.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:44.566 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:26:44.567 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:26:44.615 INFO:teuthology.orchestra.run.smithi090.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-04-09T18:26:44.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:26:44.617 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-04-09T18:26:44.618 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi090.front.sepia.ceph.com... 2021-04-09T18:26:44.618 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:26:44.618 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:26:44.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:44.728 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:26:44.729 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:26:44.735 INFO:teuthology.orchestra.run.smithi090.stdout:ext2/ext3 2021-04-09T18:26:44.736 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:26:44.737 INFO:teuthology.orchestra.run:waiting for 900 2021-04-09T18:26:44.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:26:44.739 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:26:44.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:44.792 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:26:44.792 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:26:44.800 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-04-09T18:26:44.801 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-04-09T18:26:44.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:44.802 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:26:44.802 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:26:44.851 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': Transport endpoint is not connected 2021-04-09T18:26:44.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:26:44.853 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.1 2021-04-09T18:26:44.853 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2021-04-09T18:26:44.854 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:26:44.854 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:26:44.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:44.940 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:26:44.940 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:26:44.987 INFO:teuthology.orchestra.run.smithi136.stdout:ext2/ext3 2021-04-09T18:26:44.988 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:26:44.988 INFO:teuthology.orchestra.run:waiting for 900 2021-04-09T18:26:44.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:26:44.989 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:26:45.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:45.039 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:26:45.040 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:26:45.047 INFO:teuthology.orchestra.run.smithi144.stdout:fuseblk 2021-04-09T18:26:45.048 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2021-04-09T18:26:45.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:45.050 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:26:45.050 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:26:45.095 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': Transport endpoint is not connected 2021-04-09T18:26:45.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:26:45.097 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.2 2021-04-09T18:26:45.097 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi144.front.sepia.ceph.com... 2021-04-09T18:26:45.098 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:26:45.098 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:26:45.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:26:45.208 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:26:45.208 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:26:45.215 INFO:teuthology.orchestra.run.smithi144.stdout:ext2/ext3 2021-04-09T18:26:45.216 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:26:45.217 INFO:teuthology.orchestra.run:waiting for 900 2021-04-09T18:26:45.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:26:45.218 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:26:45.306 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:26:45.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd20bb25700 1 Processor -- start 2021-04-09T18:26:45.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd20bb25700 1 -- start start 2021-04-09T18:26:45.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd20bb25700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd2040f5520 0x7fd2040f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:45.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd20bb25700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2040fbb20 con 0x7fd2040e9ae0 2021-04-09T18:26:45.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd20bb25700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20409f910 con 0x7fd2041c8010 2021-04-09T18:26:45.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd20bb25700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2040e9f30 con 0x7fd2040f5520 2021-04-09T18:26:45.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2090c8700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd2040e9ae0 0x7fd20409f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51260/0 (socket says 172.21.15.79:51260) 2021-04-09T18:26:45.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2090c8700 1 -- 172.21.15.79:0/1703897056 learned_addr learned my addr 172.21.15.79:0/1703897056 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:45.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2098c9700 1 --2- 172.21.15.79:0/1703897056 >> v2:172.21.15.89:3300/0 conn(0x7fd2040f5520 0x7fd2040f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:45.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2088c7700 1 -- 172.21.15.79:0/1703897056 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943833640 0 0) 0x7fd1f80010d0 con 0x7fd2040e9ae0 2021-04-09T18:26:45.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2088c7700 1 -- 172.21.15.79:0/1703897056 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1f0003240 con 0x7fd2040e9ae0 2021-04-09T18:26:45.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2088c7700 1 -- 172.21.15.79:0/1703897056 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1417791692 0 0) 0x7fd1fc0010d0 con 0x7fd2041c8010 2021-04-09T18:26:45.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2088c7700 1 -- 172.21.15.79:0/1703897056 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1f0003620 con 0x7fd2041c8010 2021-04-09T18:26:45.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2088c7700 1 -- 172.21.15.79:0/1703897056 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1430080212 0 0) 0x7fd1f8001650 con 0x7fd2040e9ae0 2021-04-09T18:26:45.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2088c7700 1 -- 172.21.15.79:0/1703897056 >> v2:172.21.15.89:3300/0 conn(0x7fd2040f5520 msgr2=0x7fd2040f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:45.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2088c7700 1 --2- 172.21.15.79:0/1703897056 >> v2:172.21.15.89:3300/0 conn(0x7fd2040f5520 0x7fd2040f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:45.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2088c7700 1 -- 172.21.15.79:0/1703897056 >> v1:172.21.15.89:6789/0 conn(0x7fd2041c8010 legacy=0x7fd2041ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:45.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2088c7700 1 -- 172.21.15.79:0/1703897056 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2040e56d0 con 0x7fd2040e9ae0 2021-04-09T18:26:45.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2088c7700 1 -- 172.21.15.79:0/1703897056 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7fd1f8001bb0 con 0x7fd2040e9ae0 2021-04-09T18:26:45.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2098c9700 1 --2- 172.21.15.79:0/1703897056 >> v2:172.21.15.89:3300/0 conn(0x7fd2040f5520 0x7fd2040f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:45.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2088c7700 1 -- 172.21.15.79:0/1703897056 >> v1:172.21.15.79:6789/0 conn(0x7fd2040e9ae0 legacy=0x7fd20409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:45.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2088c7700 1 --2- 172.21.15.79:0/1703897056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1f0003d10 0x7fd1f00045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:45.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2088c7700 1 --2- 172.21.15.79:0/1703897056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1f0004bd0 0x7fd1f00097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:45.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2088c7700 1 --2- 172.21.15.79:0/1703897056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f0005020 0x7fd1f000be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:45.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2098c9700 1 --2- 172.21.15.79:0/1703897056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1f0003d10 0x7fd1f00045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:45.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2088c7700 1 -- 172.21.15.79:0/1703897056 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2040e9f30 con 0x7fd1f0003d10 2021-04-09T18:26:45.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2088c7700 1 -- 172.21.15.79:0/1703897056 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f0050510 con 0x7fd1f0005020 2021-04-09T18:26:45.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2088c7700 1 -- 172.21.15.79:0/1703897056 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f0050740 con 0x7fd1f0004bd0 2021-04-09T18:26:45.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd2090c8700 1 --2- 172.21.15.79:0/1703897056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1f0004bd0 0x7fd1f00097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:45.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.402 7fd20a0ca700 1 --2- 172.21.15.79:0/1703897056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f0005020 0x7fd1f000be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:45.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.406 7fd2098c9700 1 -- 172.21.15.79:0/1703897056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1f0004bd0 msgr2=0x7fd1f00097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:45.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.406 7fd2098c9700 1 --2- 172.21.15.79:0/1703897056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1f0004bd0 0x7fd1f00097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:45.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.406 7fd2098c9700 1 -- 172.21.15.79:0/1703897056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f0005020 msgr2=0x7fd1f000be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:45.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.406 7fd2098c9700 1 --2- 172.21.15.79:0/1703897056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f0005020 0x7fd1f000be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:45.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.406 7fd2098c9700 1 -- 172.21.15.79:0/1703897056 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc001b10 con 0x7fd1f0003d10 2021-04-09T18:26:45.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.406 7fd20a0ca700 1 --2- 172.21.15.79:0/1703897056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f0005020 0x7fd1f000be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:45.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.406 7fd20a0ca700 1 -- 172.21.15.79:0/1703897056 reap_dead start 2021-04-09T18:26:45.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.406 7fd2098c9700 1 --2- 172.21.15.79:0/1703897056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1f0003d10 0x7fd1f00045a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fd20000c000 tx=0x7fd20000e6a0).ready entity=mon.0 client_cookie=56cc99cbc9d9389a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:45.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.406 7fd2088c7700 1 -- 172.21.15.79:0/1703897056 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1fc001b10 con 0x7fd1f0003d10 2021-04-09T18:26:45.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.406 7fd2088c7700 1 -- 172.21.15.79:0/1703897056 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2000123f0 con 0x7fd1f0003d10 2021-04-09T18:26:45.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.406 7fd2088c7700 1 -- 172.21.15.79:0/1703897056 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd20000f040 con 0x7fd1f0003d10 2021-04-09T18:26:45.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.406 7fd20bb25700 1 -- 172.21.15.79:0/1703897056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1f0003d10 msgr2=0x7fd1f00045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:45.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.406 7fd20bb25700 1 --2- 172.21.15.79:0/1703897056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1f0003d10 0x7fd1f00045a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fd20000c000 tx=0x7fd20000e6a0).stop 2021-04-09T18:26:45.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.406 7fd20bb25700 1 -- 172.21.15.79:0/1703897056 shutdown_connections 2021-04-09T18:26:45.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.406 7fd20bb25700 1 --2- 172.21.15.79:0/1703897056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1f0003d10 0x7fd1f00045a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:45.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.406 7fd20bb25700 1 -- 172.21.15.79:0/1703897056 >> 172.21.15.79:0/1703897056 conn(0x7fd2040e5fe0 msgr2=0x7fd2040e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:45.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.406 7fd20bb25700 1 -- 172.21.15.79:0/1703897056 shutdown_connections 2021-04-09T18:26:45.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.406 7fd20bb25700 1 -- 172.21.15.79:0/1703897056 wait complete. 2021-04-09T18:26:45.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd20bb25700 1 Processor -- start 2021-04-09T18:26:45.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd20bb25700 1 -- start start 2021-04-09T18:26:45.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd20bb25700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2041ae320 0x7fd20419ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:45.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd20bb25700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2040d51f0 0x7fd2040d5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:45.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd20bb25700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2040a3c60 0x7fd2040a40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:45.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd20bb25700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2041c3dc0 con 0x7fd2041ae320 2021-04-09T18:26:45.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd20bb25700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20419f9f0 con 0x7fd2040d51f0 2021-04-09T18:26:45.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd20bb25700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20419fcf0 con 0x7fd2040a3c60 2021-04-09T18:26:45.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd2098c9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2041ae320 0x7fd20419ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:45.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd2098c9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2041ae320 0x7fd20419ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56560/0 (socket says 172.21.15.79:56560) 2021-04-09T18:26:45.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd2098c9700 1 -- 172.21.15.79:0/69097047 learned_addr learned my addr 172.21.15.79:0/69097047 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:45.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd20a0ca700 1 --2- 172.21.15.79:0/69097047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2040a3c60 0x7fd2040a40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:45.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd2090c8700 1 --2- 172.21.15.79:0/69097047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2040d51f0 0x7fd2040d5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:45.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd2098c9700 1 -- 172.21.15.79:0/69097047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2040a3c60 msgr2=0x7fd2040a40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:45.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd2098c9700 1 --2- 172.21.15.79:0/69097047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2040a3c60 0x7fd2040a40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:45.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd2098c9700 1 -- 172.21.15.79:0/69097047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2040d51f0 msgr2=0x7fd2040d5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:45.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd2098c9700 1 --2- 172.21.15.79:0/69097047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2040d51f0 0x7fd2040d5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:45.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd2098c9700 1 -- 172.21.15.79:0/69097047 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20419ea50 con 0x7fd2041ae320 2021-04-09T18:26:45.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd2090c8700 1 --2- 172.21.15.79:0/69097047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2040d51f0 0x7fd2040d5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:45.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd20a0ca700 1 --2- 172.21.15.79:0/69097047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2040a3c60 0x7fd2040a40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:45.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd2098c9700 1 --2- 172.21.15.79:0/69097047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2041ae320 0x7fd20419ddd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fd20409b310 tx=0x7fd200006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:45.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd1f67fc700 1 -- 172.21.15.79:0/69097047 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd20419ea50 con 0x7fd2041ae320 2021-04-09T18:26:45.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd1f67fc700 1 -- 172.21.15.79:0/69097047 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20001bb50 con 0x7fd2041ae320 2021-04-09T18:26:45.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd20bb25700 1 -- 172.21.15.79:0/69097047 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20419e400 con 0x7fd2041ae320 2021-04-09T18:26:45.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd1f67fc700 1 -- 172.21.15.79:0/69097047 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd200022020 con 0x7fd2041ae320 2021-04-09T18:26:45.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.410 7fd20bb25700 1 -- 172.21.15.79:0/69097047 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20419f0f0 con 0x7fd2041ae320 2021-04-09T18:26:45.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.414 7fd1f67fc700 1 -- 172.21.15.79:0/69097047 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd200011070 con 0x7fd2041ae320 2021-04-09T18:26:45.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.414 7fd1f67fc700 1 --2- 172.21.15.79:0/69097047 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd1ec029100 0x7fd1ec02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:45.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.414 7fd1f67fc700 1 -- 172.21.15.79:0/69097047 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fd200010040 con 0x7fd2041ae320 2021-04-09T18:26:45.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.414 7fd2090c8700 1 --2- 172.21.15.79:0/69097047 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd1ec029100 0x7fd1ec02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:45.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.414 7fd2090c8700 1 --2- 172.21.15.79:0/69097047 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd1ec029100 0x7fd1ec02b650 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:45.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.418 7fd20bb25700 1 -- 172.21.15.79:0/69097047 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2040e39e0 con 0x7fd2041ae320 2021-04-09T18:26:45.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.422 7fd1f67fc700 1 -- 172.21.15.79:0/69097047 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd20000ed60 con 0x7fd2041ae320 2021-04-09T18:26:45.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.586 7fd20bb25700 1 -- 172.21.15.79:0/69097047 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd2040a1cc0 con 0x7fd2041ae320 2021-04-09T18:26:45.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.586 7fd1f67fc700 1 -- 172.21.15.79:0/69097047 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v22) v1 ==== 81+0+30780 (secure 0 0 0) 0x7fd20001b750 con 0x7fd2041ae320 2021-04-09T18:26:45.596 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:45.597 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:26:45.597 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 22, 2021-04-09T18:26:45.597 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:26:45.597 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:26:45.597 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:26:14.412296", 2021-04-09T18:26:45.598 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:26:45.598 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:26:45.598 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:26:45.598 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:26:45.598 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:26:45.599 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:26:45.599 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:26:45.599 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:26:45.599 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:26:45.600 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:26:45.600 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:26:45.600 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:26:45.600 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:26:45.600 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:26:45.601 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:26:45.601 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 3, 2021-04-09T18:26:45.601 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:26:45.601 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:26:45.601 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:26:45.602 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:26:45.602 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:26:45.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.602 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:26:45.602 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:26:45.603 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:26:45.603 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:45.603 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:26:45.603 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:26:45.603 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:26:45.604 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:26:45.604 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:26:45.604 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:26:45.604 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:26:45.604 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:26:45.605 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:26:45.605 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:26:45.605 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:26:45.605 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:26:45.606 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:26:45.606 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:26:45.606 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:26:45.606 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:26:45.606 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:26:45.607 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:26:45.607 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:26:45.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.607 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:26:45.607 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:26:45.608 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:26:45.608 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:26:45.608 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:26:45.608 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:26:45.608 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:26:45.609 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:26:45.609 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:26:45.609 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:26:45.609 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:26:45.609 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:26:45.610 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:26:45.610 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:26:45.610 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:26:45.610 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:26:45.610 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:26:45.611 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:26:45.611 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:26:45.611 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:26:45.611 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:26:45.612 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:26:45.612 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:26:45.612 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:26:45.612 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:26:45.612 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:26:45.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:26:45.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.613 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:26:45.613 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:26:45.614 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:26:45.614 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:26:45.614 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:26:45.614 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:26:45.614 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:26:45.615 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:26:45.615 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:26:45.615 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:26:45.615 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:26:45.615 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:26:45.616 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:26:45.616 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:26:45.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.617 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 2, 2021-04-09T18:26:45.617 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2021-04-09T18:26:45.617 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:09.311735", 2021-04-09T18:26:45.617 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:26:45.617 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:26:45.618 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:26:45.618 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:26:45.618 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:26:45.618 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:26:45.618 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:26:45.619 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:26:45.619 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:26:45.619 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:26:45.619 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:26:45.620 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:26:45.620 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:26:45.620 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:26:45.620 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:26:45.620 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:26:45.621 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:26:45.621 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:26:45.621 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:26:45.621 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:26:45.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.622 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "22", 2021-04-09T18:26:45.622 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:26:45.622 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:26:45.622 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:26:45.622 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:26:45.623 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:26:45.623 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:26:45.623 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:26:45.623 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:26:45.624 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:26:45.624 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:26:45.624 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:26:45.624 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:26:45.624 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:26:45.625 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:26:45.625 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:26:45.625 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:26:45.625 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:26:45.625 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:26:45.626 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:26:45.626 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:26:45.626 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:26:45.626 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:26:45.626 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:26:45.627 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:26:45.627 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:26:45.627 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:26:45.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.627 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:26:45.628 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:26:45.628 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:26:45.628 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:26:45.628 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:26:45.628 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:26:45.629 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:26:45.629 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:26:45.629 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:26:45.629 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:26:45.629 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:26:45.630 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2021-04-09T18:26:45.630 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2021-04-09T18:26:45.630 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2021-04-09T18:26:45.630 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2021-04-09T18:26:45.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.631 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:26:45.631 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:26:45.631 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2021-04-09T18:26:45.632 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.632 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.632 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2021-04-09T18:26:45.633 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2021-04-09T18:26:45.633 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:12.130710", 2021-04-09T18:26:45.633 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 5, 2021-04-09T18:26:45.633 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,ec_overwrites", 2021-04-09T18:26:45.633 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 3, 2021-04-09T18:26:45.634 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 4, 2021-04-09T18:26:45.634 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 3, 2021-04-09T18:26:45.634 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 1, 2021-04-09T18:26:45.634 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:26:45.634 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:26:45.635 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:26:45.635 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:26:45.635 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:26:45.635 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:26:45.636 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:26:45.636 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:26:45.636 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:26:45.636 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:26:45.636 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:26:45.637 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:26:45.637 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:26:45.637 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:26:45.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.637 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "22", 2021-04-09T18:26:45.638 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:26:45.638 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:26:45.638 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:26:45.638 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:26:45.638 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:26:45.639 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:26:45.639 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:26:45.639 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:26:45.639 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:26:45.640 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:26:45.640 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:26:45.640 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:26:45.640 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:26:45.641 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:26:45.641 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:26:45.641 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:26:45.641 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:26:45.641 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:26:45.642 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:26:45.642 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:26:45.642 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:26:45.642 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:26:45.642 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:26:45.643 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "cephfs_data", 2021-04-09T18:26:45.643 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:26:45.643 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:26:45.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.644 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:26:45.644 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:26:45.644 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:26:45.644 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:26:45.645 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:26:45.645 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:26:45.645 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:26:45.645 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:26:45.646 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 8192, 2021-04-09T18:26:45.646 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:26:45.646 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:26:45.646 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:26:45.646 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:26:45.647 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:26:45.647 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2021-04-09T18:26:45.647 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.647 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.648 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:26:45.648 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:26:45.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.648 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:26:45.649 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:26:45.649 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:26:45.649 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:26:45.649 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:26:45.649 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:26:45.650 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:26:45.650 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:26:45.650 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:26:45.650 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 20, 2021-04-09T18:26:45.651 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:26:45.651 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:26:45.651 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:26:45.651 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.652 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.652 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:26:45.652 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:26:45.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.653 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.653 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:26:45.653 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:26:45.653 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.653 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.654 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:26:45.654 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.655 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.655 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:26:45.655 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:26:45.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.656 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.656 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:26:45.656 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:26:45.656 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.657 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.657 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:26:45.657 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.658 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.658 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:26:45.658 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:26:45.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.659 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.659 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:26:45.659 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:26:45.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.660 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.660 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:26:45.660 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.661 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.661 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:26:45.661 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:26:45.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.662 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.662 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:26:45.663 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:26:45.663 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.663 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.664 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:26:45.664 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:26:45.664 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:26:45.664 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:26:45.664 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:26:45.665 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:26:45.665 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:26:45.665 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.666 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:26:45.666 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:26:45.666 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:26:45.667 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:26:45.667 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:26:45.667 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:26:45.667 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:26:45.668 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:26:45.668 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:26:45.668 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 20, 2021-04-09T18:26:45.668 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:26:45.668 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:26:45.669 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:26:45.669 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.669 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.670 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:26:45.670 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:26:45.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.671 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.671 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:26:45.671 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:26:45.671 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.671 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.672 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:26:45.672 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.673 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.673 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:26:45.673 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:26:45.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.674 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.674 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:26:45.674 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:26:45.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.675 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.675 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:26:45.676 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.676 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.676 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:26:45.676 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:26:45.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.677 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.677 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:26:45.678 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:26:45.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.678 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.678 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:26:45.679 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.679 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.679 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:26:45.679 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:26:45.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.680 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.680 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:26:45.680 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:26:45.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.681 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.681 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:26:45.681 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:26:45.682 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:26:45.682 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:26:45.682 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:26:45.682 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:26:45.682 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:26:45.683 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.683 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:26:45.684 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:26:45.684 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:26:45.684 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:26:45.684 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:26:45.684 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:26:45.685 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:26:45.685 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:26:45.685 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:26:45.685 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 17, 2021-04-09T18:26:45.685 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:26:45.686 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:26:45.686 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:26:45.686 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.686 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.687 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:26:45.687 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:26:45.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.687 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.688 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:26:45.688 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:26:45.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.688 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.689 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:26:45.689 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.689 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.690 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:26:45.690 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:26:45.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.690 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.691 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:26:45.691 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:26:45.691 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.691 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.692 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:26:45.692 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.692 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.692 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:26:45.693 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:26:45.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.693 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.693 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:26:45.694 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:26:45.694 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.694 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.694 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:26:45.695 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.695 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.695 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:26:45.696 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:26:45.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.696 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.696 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:26:45.697 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:26:45.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.697 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.697 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:26:45.698 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:26:45.698 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:26:45.698 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:26:45.698 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:26:45.698 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:26:45.699 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:26:45.699 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.699 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:26:45.700 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:26:45.700 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:26:45.700 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:26:45.700 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:26:45.700 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:26:45.701 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:26:45.701 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:26:45.701 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:26:45.701 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 20, 2021-04-09T18:26:45.701 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:26:45.702 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:26:45.702 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:26:45.702 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.702 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.703 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:26:45.703 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:26:45.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.703 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.704 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:26:45.704 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:26:45.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.704 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.705 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:26:45.705 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.705 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.706 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:26:45.706 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:26:45.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.706 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.707 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:26:45.707 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:26:45.707 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.707 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.708 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:26:45.708 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.708 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.708 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:26:45.709 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:26:45.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.709 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.709 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:26:45.710 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:26:45.710 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.710 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.711 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:26:45.711 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.711 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.711 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:26:45.712 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:26:45.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.712 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.712 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:26:45.713 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:26:45.713 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.713 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.714 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:26:45.714 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:26:45.714 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:26:45.714 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:26:45.714 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:26:45.715 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:26:45.715 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:26:45.715 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.716 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:26:45.716 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:26:45.716 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:26:45.716 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:26:45.716 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:26:45.717 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:26:45.717 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:26:45.717 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:26:45.717 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:26:45.717 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 20, 2021-04-09T18:26:45.718 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:26:45.718 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:26:45.718 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:26:45.718 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.719 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.719 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:26:45.719 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:26:45.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.720 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.720 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:26:45.720 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:26:45.720 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.721 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.721 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:26:45.721 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.722 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.722 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:26:45.722 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:26:45.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.723 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.723 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:26:45.723 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:26:45.723 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.723 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.724 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:26:45.724 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.724 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.725 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:26:45.725 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:26:45.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.725 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.726 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:26:45.726 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:26:45.726 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.726 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.727 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:26:45.727 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.727 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.727 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:26:45.728 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:26:45.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.728 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.728 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:26:45.729 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:26:45.729 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.729 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.729 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:26:45.730 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:26:45.730 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:26:45.730 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:26:45.730 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:26:45.730 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:26:45.731 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:26:45.731 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.732 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:26:45.732 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:26:45.732 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:26:45.732 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:26:45.732 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:26:45.733 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:26:45.733 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:26:45.733 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:26:45.733 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:26:45.733 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 20, 2021-04-09T18:26:45.734 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:26:45.734 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:26:45.734 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:26:45.734 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.735 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.735 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:26:45.735 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:26:45.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.736 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.736 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:26:45.736 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:26:45.736 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.736 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.737 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:26:45.737 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.737 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.738 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:26:45.738 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:26:45.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.738 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.739 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:26:45.739 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:26:45.739 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.739 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.740 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:26:45.740 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.740 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.741 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:26:45.741 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:26:45.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.741 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.742 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:26:45.742 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:26:45.742 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.742 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.743 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:26:45.743 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.743 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.744 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:26:45.744 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:26:45.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.744 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.745 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:26:45.745 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:26:45.745 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.745 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.746 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:26:45.746 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:26:45.746 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:26:45.746 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:26:45.746 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:26:45.747 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:26:45.747 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:26:45.747 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.748 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:26:45.748 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:26:45.748 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:26:45.748 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:26:45.748 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:26:45.749 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:26:45.749 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:26:45.749 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:26:45.749 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:26:45.749 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 17, 2021-04-09T18:26:45.750 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:26:45.750 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:26:45.750 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:26:45.750 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.751 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.751 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:26:45.751 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:26:45.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.752 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.752 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:26:45.752 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:26:45.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.753 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.753 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:26:45.753 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.754 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.754 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:26:45.754 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:26:45.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.755 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.755 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:26:45.755 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:26:45.755 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.756 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.756 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:26:45.756 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.757 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.757 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:26:45.757 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:26:45.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.758 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.758 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:26:45.758 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:26:45.758 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.758 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.759 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:26:45.759 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.759 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.760 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:26:45.760 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:26:45.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.760 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.761 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:26:45.761 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:26:45.761 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.761 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.762 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:26:45.762 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:26:45.762 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:26:45.762 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:26:45.762 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:26:45.763 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:26:45.763 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:26:45.763 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.764 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:26:45.764 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:26:45.764 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:26:45.764 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:26:45.764 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:26:45.765 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:26:45.765 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:26:45.765 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:26:45.765 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:26:45.765 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 17, 2021-04-09T18:26:45.766 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:26:45.766 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:26:45.766 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:26:45.766 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.767 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.767 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:26:45.767 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:26:45.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.768 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.768 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:26:45.768 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:26:45.768 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.769 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.769 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:26:45.769 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:26:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:26:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.771 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:26:45.771 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:26:45.771 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.771 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.772 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:26:45.772 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.772 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.773 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:26:45.773 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:26:45.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.773 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:26:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:26:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.775 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:26:45.775 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:26:45.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.775 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:26:45.775 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:26:45.776 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:26:45.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.776 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:26:45.776 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:26:45.777 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:26:45.777 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.777 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.777 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:26:45.778 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:26:45.778 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:26:45.778 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:26:45.778 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:26:45.778 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:26:45.779 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:26:45.779 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:45.779 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.779 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:26:45.780 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:26:45.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.780 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:26:45.780 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:26:45.780 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:26:45.781 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:26:45.781 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:26:45.781 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:26:45.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.782 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:26:45.782 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:26:45.782 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:26:45.782 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:26:45.782 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:26:45.783 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:26:45.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.783 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:26:45.783 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:26:45.784 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:26:45.784 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:26:45.784 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:26:45.784 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:26:45.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.785 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:26:45.785 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:26:45.785 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:26:45.785 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:26:45.786 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:26:45.786 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:26:45.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.786 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:26:45.787 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:26:45.787 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:26:45.787 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:26:45.787 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:26:45.788 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:26:45.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.788 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:26:45.788 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:26:45.789 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:26:45.789 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:26:45.789 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:26:45.789 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:26:45.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.790 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:26:45.790 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:26:45.790 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:26:45.790 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:26:45.791 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:26:45.791 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:26:45.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:45.791 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:26:45.792 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:26:45.792 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:26:45.792 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:26:45.792 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:26:45.792 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:26:45.793 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.793 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:26:45.793 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:26:45.793 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:26:45.793 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:26:45.794 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:26:45.794 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": {}, 2021-04-09T18:26:45.794 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:26:45.794 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:26:45.794 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:26:45.795 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:26:45.795 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:26:45.795 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:26:45.795 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:26:45.795 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:26:45.796 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:26:45.796 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:26:45.796 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:26:45.796 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:26:45.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.797 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:26:45.797 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:26:45.797 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:26:45.797 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:26:45.797 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:26:45.798 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:26:45.798 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:26:45.798 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:45.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:45.798 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:26:45.799 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:26:45.799 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:26:45.799 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:26:45.799 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:26:45.800 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:26:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.590 7fd20bb25700 1 -- 172.21.15.79:0/69097047 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd1ec029100 msgr2=0x7fd1ec02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.590 7fd20bb25700 1 --2- 172.21.15.79:0/69097047 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd1ec029100 0x7fd1ec02b650 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.590 7fd20bb25700 1 -- 172.21.15.79:0/69097047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2041ae320 msgr2=0x7fd20419ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.590 7fd20bb25700 1 --2- 172.21.15.79:0/69097047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2041ae320 0x7fd20419ddd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fd20409b310 tx=0x7fd200006c10).stop 2021-04-09T18:26:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.590 7fd20bb25700 1 -- 172.21.15.79:0/69097047 shutdown_connections 2021-04-09T18:26:45.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.590 7fd20bb25700 1 --2- 172.21.15.79:0/69097047 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd1ec029100 0x7fd1ec02b650 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:45.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.590 7fd20bb25700 1 --2- 172.21.15.79:0/69097047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2040a3c60 0x7fd2040a40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:45.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.590 7fd20bb25700 1 --2- 172.21.15.79:0/69097047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2041ae320 0x7fd20419ddd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:45.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.590 7fd20bb25700 1 --2- 172.21.15.79:0/69097047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2040d51f0 0x7fd2040d5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:45.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.590 7fd20bb25700 1 -- 172.21.15.79:0/69097047 >> 172.21.15.79:0/69097047 conn(0x7fd204099380 msgr2=0x7fd20409a630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:45.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.590 7fd20bb25700 1 -- 172.21.15.79:0/69097047 shutdown_connections 2021-04-09T18:26:45.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.590 7fd20bb25700 1 -- 172.21.15.79:0/69097047 wait complete. 2021-04-09T18:26:45.805 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:26:45.912 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.898 7f97b92ab700 1 Processor -- start 2021-04-09T18:26:45.913 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.898 7f97b92ab700 1 -- start start 2021-04-09T18:26:45.913 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.898 7f97b92ab700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f97b40e9ae0 0x7f97b409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:45.913 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.898 7f97b92ab700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97b41c8010 0x7f97b41ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:45.913 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.898 7f97b92ab700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b40fbb20 con 0x7f97b40f5520 2021-04-09T18:26:45.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.898 7f97b92ab700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b41c3dc0 con 0x7f97b40e9ae0 2021-04-09T18:26:45.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.898 7f97b92ab700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40e9f30 con 0x7f97b41c8010 2021-04-09T18:26:45.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.898 7f97b3806700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97b41c8010 0x7f97b41ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:45.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.898 7f97b3806700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97b41c8010 0x7f97b41ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:53568/0 (socket says 172.21.15.79:53568) 2021-04-09T18:26:45.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.898 7f97b2804700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f97b40e9ae0 0x7f97b409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:45.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.898 7f97b3806700 1 -- 172.21.15.79:0/2643668593 learned_addr learned my addr 172.21.15.79:0/2643668593 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:45.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.902 7f97b2804700 1 -- 172.21.15.79:0/2643668593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97b41c8010 msgr2=0x7f97b41ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:45.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.902 7f97b2804700 1 --2- 172.21.15.79:0/2643668593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97b41c8010 0x7f97b41ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:45.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.902 7f97b2804700 1 -- 172.21.15.79:0/2643668593 >> v1:172.21.15.89:6789/0 conn(0x7f97b40f5520 legacy=0x7f97b40f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:45.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.902 7f97b2003700 1 -- 172.21.15.79:0/2643668593 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105838397 0 0) 0x7f97a40010d0 con 0x7f97b40f5520 2021-04-09T18:26:45.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.902 7f97b2804700 1 -- 172.21.15.79:0/2643668593 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b40e56d0 con 0x7f97b40e9ae0 2021-04-09T18:26:45.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.902 7f97b2804700 1 --2- 172.21.15.79:0/2643668593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97b40e9ae0 0x7f97b409f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f97b40f6f00 tx=0x7f97a800bd70).ready entity=mon.1 client_cookie=f03e2462be98b489 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:45.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.902 7f97b2003700 1 -- 172.21.15.79:0/2643668593 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f97b40e56d0 con 0x7f97b40e9ae0 2021-04-09T18:26:45.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.902 7f97b2003700 1 -- 172.21.15.79:0/2643668593 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a8009810 con 0x7f97b40e9ae0 2021-04-09T18:26:45.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.902 7f97b2003700 1 -- 172.21.15.79:0/2643668593 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f97a8009be0 con 0x7f97b40e9ae0 2021-04-09T18:26:45.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.902 7f97b92ab700 1 -- 172.21.15.79:0/2643668593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97b40e9ae0 msgr2=0x7f97b409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:45.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.902 7f97b92ab700 1 --2- 172.21.15.79:0/2643668593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97b40e9ae0 0x7f97b409f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f97b40f6f00 tx=0x7f97a800bd70).stop 2021-04-09T18:26:45.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.902 7f97b92ab700 1 -- 172.21.15.79:0/2643668593 shutdown_connections 2021-04-09T18:26:45.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.902 7f97b92ab700 1 --2- 172.21.15.79:0/2643668593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97b41c8010 0x7f97b41ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:45.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.902 7f97b92ab700 1 --2- 172.21.15.79:0/2643668593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97b40e9ae0 0x7f97b409f110 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:45.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.902 7f97b92ab700 1 -- 172.21.15.79:0/2643668593 >> 172.21.15.79:0/2643668593 conn(0x7f97b40e5fe0 msgr2=0x7f97b40e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:45.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.902 7f97b92ab700 1 -- 172.21.15.79:0/2643668593 shutdown_connections 2021-04-09T18:26:45.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.902 7f97b92ab700 1 -- 172.21.15.79:0/2643668593 wait complete. 2021-04-09T18:26:45.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b92ab700 1 Processor -- start 2021-04-09T18:26:45.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b92ab700 1 -- start start 2021-04-09T18:26:45.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b92ab700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97b40bfc40 0x7f97b40d62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:45.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b92ab700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97b40d5050 0x7f97b40d54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:45.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b92ab700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97b41ae440 0x7f97b41ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:45.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b92ab700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40bf940 con 0x7f97b41ae440 2021-04-09T18:26:45.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b92ab700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40bf1d0 con 0x7f97b40bfc40 2021-04-09T18:26:45.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b92ab700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40bedd0 con 0x7f97b40d5050 2021-04-09T18:26:45.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b3806700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97b41ae440 0x7f97b41ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:45.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b3806700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97b41ae440 0x7f97b41ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56576/0 (socket says 172.21.15.79:56576) 2021-04-09T18:26:45.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b3806700 1 -- 172.21.15.79:0/422100160 learned_addr learned my addr 172.21.15.79:0/422100160 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:45.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b2804700 1 --2- 172.21.15.79:0/422100160 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97b40d5050 0x7f97b40d54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:45.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b3005700 1 --2- 172.21.15.79:0/422100160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97b40bfc40 0x7f97b40d62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:45.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b3806700 1 -- 172.21.15.79:0/422100160 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97b40d5050 msgr2=0x7f97b40d54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:45.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b3806700 1 --2- 172.21.15.79:0/422100160 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97b40d5050 0x7f97b40d54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:45.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b3806700 1 -- 172.21.15.79:0/422100160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97b40bfc40 msgr2=0x7f97b40d62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:45.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b3806700 1 --2- 172.21.15.79:0/422100160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97b40bfc40 0x7f97b40d62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:45.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b3806700 1 -- 172.21.15.79:0/422100160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b40d68f0 con 0x7f97b41ae440 2021-04-09T18:26:45.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b3005700 1 --2- 172.21.15.79:0/422100160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97b40bfc40 0x7f97b40d62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:45.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b3806700 1 --2- 172.21.15.79:0/422100160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97b41ae440 0x7f97b41ae890 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f97b409ae10 tx=0x7f97ac00c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:45.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f979bfff700 1 -- 172.21.15.79:0/422100160 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f97b40d68f0 con 0x7f97b41ae440 2021-04-09T18:26:45.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f979bfff700 1 -- 172.21.15.79:0/422100160 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ac00cca0 con 0x7f97b41ae440 2021-04-09T18:26:45.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b92ab700 1 -- 172.21.15.79:0/422100160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b40bf4f0 con 0x7f97b41ae440 2021-04-09T18:26:45.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f979bfff700 1 -- 172.21.15.79:0/422100160 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f97ac00f040 con 0x7f97b41ae440 2021-04-09T18:26:45.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.906 7f97b92ab700 1 -- 172.21.15.79:0/422100160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b41af050 con 0x7f97b41ae440 2021-04-09T18:26:45.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.910 7f979bfff700 1 -- 172.21.15.79:0/422100160 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f97ac022060 con 0x7f97b41ae440 2021-04-09T18:26:45.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.910 7f979bfff700 1 --2- 172.21.15.79:0/422100160 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9794029100 0x7f979402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:45.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.910 7f979bfff700 1 -- 172.21.15.79:0/422100160 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f97ac010040 con 0x7f97b41ae440 2021-04-09T18:26:45.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.910 7f97b3005700 1 --2- 172.21.15.79:0/422100160 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9794029100 0x7f979402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:45.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.910 7f97b3005700 1 --2- 172.21.15.79:0/422100160 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9794029100 0x7f979402b650 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:45.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.910 7f97b92ab700 1 -- 172.21.15.79:0/422100160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b40e39e0 con 0x7f97b41ae440 2021-04-09T18:26:45.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:45.914 7f979bfff700 1 -- 172.21.15.79:0/422100160 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f97ac00ca90 con 0x7f97b41ae440 2021-04-09T18:26:46.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.086 7f97b92ab700 1 -- 172.21.15.79:0/422100160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97b40a1cc0 con 0x7f97b41ae440 2021-04-09T18:26:46.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.086 7f979bfff700 1 -- 172.21.15.79:0/422100160 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2097 (secure 0 0 0) 0x7f97b40f76c0 con 0x7f97b41ae440 2021-04-09T18:26:46.092 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 6 2021-04-09T18:26:46.092 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:46.093 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1857210510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1857210510},{"type":"v1","addr":"172.21.15.89:6835","nonce":1857210510}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:26:14.412596","modified":"2021-04-09 18:26:22.142731","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4338},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4338":{"gid":4338,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/4138856363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4138856363},{"type":"v1","addr":"172.21.15.79:6833","nonce":4138856363}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:26:46.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.086 7f97b92ab700 1 -- 172.21.15.79:0/422100160 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9794029100 msgr2=0x7f979402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:46.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.086 7f97b92ab700 1 --2- 172.21.15.79:0/422100160 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9794029100 0x7f979402b650 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:46.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.086 7f97b92ab700 1 -- 172.21.15.79:0/422100160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97b41ae440 msgr2=0x7f97b41ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:46.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.086 7f97b92ab700 1 --2- 172.21.15.79:0/422100160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97b41ae440 0x7f97b41ae890 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f97b409ae10 tx=0x7f97ac00c430).stop 2021-04-09T18:26:46.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.086 7f97b92ab700 1 -- 172.21.15.79:0/422100160 shutdown_connections 2021-04-09T18:26:46.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.086 7f97b92ab700 1 --2- 172.21.15.79:0/422100160 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9794029100 0x7f979402b650 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:46.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.086 7f97b92ab700 1 --2- 172.21.15.79:0/422100160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97b40bfc40 0x7f97b40d62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:46.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.086 7f97b92ab700 1 --2- 172.21.15.79:0/422100160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97b41ae440 0x7f97b41ae890 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:46.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.086 7f97b92ab700 1 --2- 172.21.15.79:0/422100160 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97b40d5050 0x7f97b40d54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:46.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.086 7f97b92ab700 1 -- 172.21.15.79:0/422100160 >> 172.21.15.79:0/422100160 conn(0x7f97b409a3b0 msgr2=0x7f97b40d83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:46.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.086 7f97b92ab700 1 -- 172.21.15.79:0/422100160 shutdown_connections 2021-04-09T18:26:46.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.086 7f97b92ab700 1 -- 172.21.15.79:0/422100160 wait complete. 2021-04-09T18:26:46.105 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-04-09T18:26:46.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.186 7feaf7fe0700 1 Processor -- start 2021-04-09T18:26:46.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.186 7feaf7fe0700 1 -- start start 2021-04-09T18:26:46.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.186 7feaf7fe0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaf00f5520 0x7feaf00f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:46.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.186 7feaf7fe0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feaf00e9ae0 0x7feaf009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:46.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.186 7feaf7fe0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf00fbb20 con 0x7feaf01c2db0 2021-04-09T18:26:46.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.186 7feaf7fe0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf00e9f30 con 0x7feaf00e9ae0 2021-04-09T18:26:46.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.186 7feaf7fe0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00e59d0 con 0x7feaf00f5520 2021-04-09T18:26:46.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.186 7feaf6585700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7feaf01c2db0 0x7feaf01c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51294/0 (socket says 172.21.15.79:51294) 2021-04-09T18:26:46.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.186 7feaf6585700 1 -- 172.21.15.79:0/1817446185 learned_addr learned my addr 172.21.15.79:0/1817446185 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:46.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf5583700 1 --2- 172.21.15.79:0/1817446185 >> v2:172.21.15.89:3300/0 conn(0x7feaf00e9ae0 0x7feaf009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:46.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf5d84700 1 --2- 172.21.15.79:0/1817446185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaf00f5520 0x7feaf00f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:46.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf4d82700 1 -- 172.21.15.79:0/1817446185 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392174147 0 0) 0x7feae8001450 con 0x7feaf01c2db0 2021-04-09T18:26:46.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf4d82700 1 -- 172.21.15.79:0/1817446185 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feadc003240 con 0x7feaf01c2db0 2021-04-09T18:26:46.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf4d82700 1 -- 172.21.15.79:0/1817446185 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3980043743 0 0) 0x7feae80019d0 con 0x7feaf01c2db0 2021-04-09T18:26:46.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf4d82700 1 -- 172.21.15.79:0/1817446185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaf00f5520 msgr2=0x7feaf00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:46.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf4d82700 1 --2- 172.21.15.79:0/1817446185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaf00f5520 0x7feaf00f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:46.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf4d82700 1 -- 172.21.15.79:0/1817446185 >> v2:172.21.15.89:3300/0 conn(0x7feaf00e9ae0 msgr2=0x7feaf009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:46.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf4d82700 1 --2- 172.21.15.79:0/1817446185 >> v2:172.21.15.89:3300/0 conn(0x7feaf00e9ae0 0x7feaf009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:46.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf4d82700 1 -- 172.21.15.79:0/1817446185 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf00e56d0 con 0x7feaf01c2db0 2021-04-09T18:26:46.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf4d82700 1 -- 172.21.15.79:0/1817446185 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7feae8001f30 con 0x7feaf01c2db0 2021-04-09T18:26:46.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf4d82700 1 -- 172.21.15.79:0/1817446185 >> v1:172.21.15.79:6789/0 conn(0x7feaf01c2db0 legacy=0x7feaf01c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:46.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf4d82700 1 --2- 172.21.15.79:0/1817446185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feadc0038c0 0x7feadc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:46.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf4d82700 1 --2- 172.21.15.79:0/1817446185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feadc0045a0 0x7feadc0049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:46.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf4d82700 1 --2- 172.21.15.79:0/1817446185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feadc04d7f0 0x7feadc04fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:46.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf4d82700 1 -- 172.21.15.79:0/1817446185 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00e9f30 con 0x7feadc0045a0 2021-04-09T18:26:46.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf4d82700 1 -- 172.21.15.79:0/1817446185 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00e59d0 con 0x7feadc0038c0 2021-04-09T18:26:46.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf4d82700 1 -- 172.21.15.79:0/1817446185 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc0052a0 con 0x7feadc04d7f0 2021-04-09T18:26:46.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf5583700 1 --2- 172.21.15.79:0/1817446185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feadc0045a0 0x7feadc0049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:46.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf5d84700 1 --2- 172.21.15.79:0/1817446185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feadc0038c0 0x7feadc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:46.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf6585700 1 --2- 172.21.15.79:0/1817446185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feadc04d7f0 0x7feadc04fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:46.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf5583700 1 -- 172.21.15.79:0/1817446185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feadc04d7f0 msgr2=0x7feadc04fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:46.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf5583700 1 --2- 172.21.15.79:0/1817446185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feadc04d7f0 0x7feadc04fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:46.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf5583700 1 -- 172.21.15.79:0/1817446185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feadc0038c0 msgr2=0x7feadc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:46.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf5583700 1 --2- 172.21.15.79:0/1817446185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feadc0038c0 0x7feadc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:46.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf5583700 1 -- 172.21.15.79:0/1817446185 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc050280 con 0x7feadc0045a0 2021-04-09T18:26:46.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf5d84700 1 --2- 172.21.15.79:0/1817446185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feadc0038c0 0x7feadc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:46.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf5583700 1 --2- 172.21.15.79:0/1817446185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feadc0045a0 0x7feadc0049f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7feae000c000 tx=0x7feae000e1d0).ready entity=mon.0 client_cookie=bed10e9422e70559 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:46.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf4d82700 1 -- 172.21.15.79:0/1817446185 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feadc050280 con 0x7feadc0045a0 2021-04-09T18:26:46.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf4d82700 1 -- 172.21.15.79:0/1817446185 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae000ec90 con 0x7feadc0045a0 2021-04-09T18:26:46.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf4d82700 1 -- 172.21.15.79:0/1817446185 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feae000f040 con 0x7feadc0045a0 2021-04-09T18:26:46.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf7fe0700 1 -- 172.21.15.79:0/1817446185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feadc0045a0 msgr2=0x7feadc0049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:46.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf7fe0700 1 --2- 172.21.15.79:0/1817446185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feadc0045a0 0x7feadc0049f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7feae000c000 tx=0x7feae000e1d0).stop 2021-04-09T18:26:46.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf6585700 1 -- 172.21.15.79:0/1817446185 reap_dead start 2021-04-09T18:26:46.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf7fe0700 1 -- 172.21.15.79:0/1817446185 shutdown_connections 2021-04-09T18:26:46.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf7fe0700 1 -- 172.21.15.79:0/1817446185 >> 172.21.15.79:0/1817446185 conn(0x7feaf00e5fe0 msgr2=0x7feaf00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:46.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf7fe0700 1 -- 172.21.15.79:0/1817446185 shutdown_connections 2021-04-09T18:26:46.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.190 7feaf7fe0700 1 -- 172.21.15.79:0/1817446185 wait complete. 2021-04-09T18:26:46.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf7fe0700 1 Processor -- start 2021-04-09T18:26:46.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf7fe0700 1 -- start start 2021-04-09T18:26:46.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf7fe0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf01adf70 0x7feaf01c0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:46.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf7fe0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf00ae7e0 0x7feaf00bb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:46.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf7fe0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaf00c37a0 0x7feaf00bd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:46.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf7fe0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00bbd10 con 0x7feaf01adf70 2021-04-09T18:26:46.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf7fe0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00bc010 con 0x7feaf00ae7e0 2021-04-09T18:26:46.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf7fe0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00d6a50 con 0x7feaf00c37a0 2021-04-09T18:26:46.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf5d84700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf01adf70 0x7feaf01c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:46.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf5d84700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf01adf70 0x7feaf01c0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56594/0 (socket says 172.21.15.79:56594) 2021-04-09T18:26:46.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf5d84700 1 -- 172.21.15.79:0/4127985411 learned_addr learned my addr 172.21.15.79:0/4127985411 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:46.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf5583700 1 --2- 172.21.15.79:0/4127985411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf00ae7e0 0x7feaf00bb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:46.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf6585700 1 --2- 172.21.15.79:0/4127985411 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaf00c37a0 0x7feaf00bd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:46.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf5d84700 1 -- 172.21.15.79:0/4127985411 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaf00c37a0 msgr2=0x7feaf00bd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:46.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf5d84700 1 --2- 172.21.15.79:0/4127985411 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaf00c37a0 0x7feaf00bd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:46.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf5d84700 1 -- 172.21.15.79:0/4127985411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf00ae7e0 msgr2=0x7feaf00bb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:46.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf5d84700 1 --2- 172.21.15.79:0/4127985411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf00ae7e0 0x7feaf00bb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:46.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf5d84700 1 -- 172.21.15.79:0/4127985411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf00be800 con 0x7feaf01adf70 2021-04-09T18:26:46.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf5d84700 1 --2- 172.21.15.79:0/4127985411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf01adf70 0x7feaf01c0490 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7feaf00bbf90 tx=0x7feaec00e4b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:46.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feae67fc700 1 -- 172.21.15.79:0/4127985411 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feaf00be800 con 0x7feaf01adf70 2021-04-09T18:26:46.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feae67fc700 1 -- 172.21.15.79:0/4127985411 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaec010e40 con 0x7feaf01adf70 2021-04-09T18:26:46.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feae67fc700 1 -- 172.21.15.79:0/4127985411 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feaec00f040 con 0x7feaf01adf70 2021-04-09T18:26:46.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf7fe0700 1 -- 172.21.15.79:0/4127985411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf00c3bf0 con 0x7feaf01adf70 2021-04-09T18:26:46.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.198 7feaf7fe0700 1 -- 172.21.15.79:0/4127985411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf00bdbe0 con 0x7feaf01adf70 2021-04-09T18:26:46.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.202 7feae67fc700 1 -- 172.21.15.79:0/4127985411 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7feaec024060 con 0x7feaf01adf70 2021-04-09T18:26:46.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.202 7feae67fc700 1 --2- 172.21.15.79:0/4127985411 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fead8029100 0x7fead802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:46.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.202 7feae67fc700 1 -- 172.21.15.79:0/4127985411 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7feaec0396e0 con 0x7feaf01adf70 2021-04-09T18:26:46.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.202 7feaf5583700 1 --2- 172.21.15.79:0/4127985411 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fead8029100 0x7fead802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:46.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.202 7feaf7fe0700 1 -- 172.21.15.79:0/4127985411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf00e39e0 con 0x7feaf01adf70 2021-04-09T18:26:46.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.202 7feaf5583700 1 --2- 172.21.15.79:0/4127985411 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fead8029100 0x7fead802b650 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:46.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.206 7feae67fc700 1 -- 172.21.15.79:0/4127985411 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7feaec00ea40 con 0x7feaf01adf70 2021-04-09T18:26:46.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:46.362 7feaf7fe0700 1 -- 172.21.15.79:0/4127985411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7feaf00f5b20 con 0x7feaf01adf70 2021-04-09T18:26:47.049 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:26:47.046 7fbcd0516700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:26:47.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.058 7feae67fc700 1 -- 172.21.15.79:0/4127985411 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7feaec000bf0 con 0x7feaf01adf70 2021-04-09T18:26:47.085 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-04-09T18:26:47.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.082 7feaf7fe0700 1 -- 172.21.15.79:0/4127985411 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fead8029100 msgr2=0x7fead802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:47.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.082 7feaf7fe0700 1 --2- 172.21.15.79:0/4127985411 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fead8029100 0x7fead802b650 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.082 7feaf7fe0700 1 -- 172.21.15.79:0/4127985411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf01adf70 msgr2=0x7feaf01c0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:47.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.082 7feaf7fe0700 1 --2- 172.21.15.79:0/4127985411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf01adf70 0x7feaf01c0490 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7feaf00bbf90 tx=0x7feaec00e4b0).stop 2021-04-09T18:26:47.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.082 7feaf7fe0700 1 -- 172.21.15.79:0/4127985411 shutdown_connections 2021-04-09T18:26:47.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.082 7feaf7fe0700 1 --2- 172.21.15.79:0/4127985411 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fead8029100 0x7fead802b650 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.082 7feaf7fe0700 1 --2- 172.21.15.79:0/4127985411 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaf00c37a0 0x7feaf00bd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.082 7feaf7fe0700 1 --2- 172.21.15.79:0/4127985411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf01adf70 0x7feaf01c0490 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.082 7feaf7fe0700 1 --2- 172.21.15.79:0/4127985411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf00ae7e0 0x7feaf00bb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.082 7feaf7fe0700 1 -- 172.21.15.79:0/4127985411 >> 172.21.15.79:0/4127985411 conn(0x7feaf009ace0 msgr2=0x7feaf00c03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:47.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.082 7feaf7fe0700 1 -- 172.21.15.79:0/4127985411 shutdown_connections 2021-04-09T18:26:47.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.082 7feaf7fe0700 1 -- 172.21.15.79:0/4127985411 wait complete. 2021-04-09T18:26:47.095 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2021-04-09T18:26:47.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:26:47.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f795e700 1 Processor -- start 2021-04-09T18:26:47.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f795e700 1 -- start start 2021-04-09T18:26:47.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f795e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44f00f5520 0x7f44f00f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:47.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f795e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f44f00e9ae0 0x7f44f009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:47.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f795e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f44f01c2db0 0x7f44f01c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:47.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f795e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f00e9f30 con 0x7f44f01c2db0 2021-04-09T18:26:47.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f795e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f00e59d0 con 0x7f44f00e9ae0 2021-04-09T18:26:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f795e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f00fbb20 con 0x7f44f00f5520 2021-04-09T18:26:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f5f03700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f44f01c2db0 0x7f44f01c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f5f03700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f44f01c2db0 0x7f44f01c3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56618/0 (socket says 172.21.15.79:56618) 2021-04-09T18:26:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f5f03700 1 -- 172.21.15.79:0/2928532396 learned_addr learned my addr 172.21.15.79:0/2928532396 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f5702700 1 --2- 172.21.15.79:0/2928532396 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44f00f5520 0x7f44f00f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f4f01700 1 --2- 172.21.15.79:0/2928532396 >> v2:172.21.15.89:3300/0 conn(0x7f44f00e9ae0 0x7f44f009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f5f03700 1 -- 172.21.15.79:0/2928532396 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44f00f5520 msgr2=0x7f44f00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f5f03700 1 --2- 172.21.15.79:0/2928532396 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44f00f5520 0x7f44f00f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f5f03700 1 -- 172.21.15.79:0/2928532396 >> v2:172.21.15.89:3300/0 conn(0x7f44f00e9ae0 msgr2=0x7f44f009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f5f03700 1 --2- 172.21.15.79:0/2928532396 >> v2:172.21.15.89:3300/0 conn(0x7f44f00e9ae0 0x7f44f009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f5f03700 1 -- 172.21.15.79:0/2928532396 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f00e56d0 con 0x7f44f01c2db0 2021-04-09T18:26:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f4f01700 1 --2- 172.21.15.79:0/2928532396 >> v2:172.21.15.89:3300/0 conn(0x7f44f00e9ae0 0x7f44f009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:26:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f5f03700 1 --2- 172.21.15.79:0/2928532396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44f01c2db0 0x7f44f01c3200 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f44e80032b0 tx=0x7f44e800b3c0).ready entity=mon.0 client_cookie=30a8e293fcc3effe server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44e7fff700 1 -- 172.21.15.79:0/2928532396 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f44f00e56d0 con 0x7f44f01c2db0 2021-04-09T18:26:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44e7fff700 1 -- 172.21.15.79:0/2928532396 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e800bc20 con 0x7f44f01c2db0 2021-04-09T18:26:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44e7fff700 1 -- 172.21.15.79:0/2928532396 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f44e8002020 con 0x7f44f01c2db0 2021-04-09T18:26:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.190 7f44f795e700 1 -- 172.21.15.79:0/2928532396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44f01c2db0 msgr2=0x7f44f01c3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.194 7f44f795e700 1 --2- 172.21.15.79:0/2928532396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44f01c2db0 0x7f44f01c3200 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f44e80032b0 tx=0x7f44e800b3c0).stop 2021-04-09T18:26:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.194 7f44f795e700 1 -- 172.21.15.79:0/2928532396 shutdown_connections 2021-04-09T18:26:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.194 7f44f795e700 1 --2- 172.21.15.79:0/2928532396 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44f00f5520 0x7f44f00f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.194 7f44f795e700 1 --2- 172.21.15.79:0/2928532396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44f01c2db0 0x7f44f01c3200 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.194 7f44f795e700 1 --2- 172.21.15.79:0/2928532396 >> v2:172.21.15.89:3300/0 conn(0x7f44f00e9ae0 0x7f44f009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.194 7f44f795e700 1 -- 172.21.15.79:0/2928532396 >> 172.21.15.79:0/2928532396 conn(0x7f44f00e5fe0 msgr2=0x7f44f00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:47.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.194 7f44f795e700 1 -- 172.21.15.79:0/2928532396 shutdown_connections 2021-04-09T18:26:47.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.194 7f44f795e700 1 -- 172.21.15.79:0/2928532396 wait complete. 2021-04-09T18:26:47.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f795e700 1 Processor -- start 2021-04-09T18:26:47.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f795e700 1 -- start start 2021-04-09T18:26:47.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f795e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44f00d6330 0x7f44f0097660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:47.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f795e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44f00bfeb0 0x7f44f0098260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:47.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f795e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44f0098890 0x7f44f00c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:47.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f795e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f00885c0 con 0x7f44f00bfeb0 2021-04-09T18:26:47.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f795e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f0097f60 con 0x7f44f0098890 2021-04-09T18:26:47.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f795e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f00c09c0 con 0x7f44f00d6330 2021-04-09T18:26:47.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f4f01700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44f00bfeb0 0x7f44f0098260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:47.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f4f01700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44f00bfeb0 0x7f44f0098260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56624/0 (socket says 172.21.15.79:56624) 2021-04-09T18:26:47.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f5702700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44f00d6330 0x7f44f0097660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:47.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f4f01700 1 -- 172.21.15.79:0/224499451 learned_addr learned my addr 172.21.15.79:0/224499451 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:47.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f5f03700 1 --2- 172.21.15.79:0/224499451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44f0098890 0x7f44f00c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:47.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f4f01700 1 -- 172.21.15.79:0/224499451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44f00d6330 msgr2=0x7f44f0097660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:47.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f4f01700 1 --2- 172.21.15.79:0/224499451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44f00d6330 0x7f44f0097660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f4f01700 1 -- 172.21.15.79:0/224499451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44f0098890 msgr2=0x7f44f00c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:47.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f4f01700 1 --2- 172.21.15.79:0/224499451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44f0098890 0x7f44f00c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f4f01700 1 -- 172.21.15.79:0/224499451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f019eae0 con 0x7f44f00bfeb0 2021-04-09T18:26:47.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f4f01700 1 --2- 172.21.15.79:0/224499451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44f00bfeb0 0x7f44f0098260 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f44f00bafe0 tx=0x7f44e000ae20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:47.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44e5ffb700 1 -- 172.21.15.79:0/224499451 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f44f019eae0 con 0x7f44f00bfeb0 2021-04-09T18:26:47.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44e5ffb700 1 -- 172.21.15.79:0/224499451 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e00076f0 con 0x7f44f00bfeb0 2021-04-09T18:26:47.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44e5ffb700 1 -- 172.21.15.79:0/224499451 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f44e0007ac0 con 0x7f44f00bfeb0 2021-04-09T18:26:47.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f795e700 1 -- 172.21.15.79:0/224499451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f00c0300 con 0x7f44f00bfeb0 2021-04-09T18:26:47.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44f795e700 1 -- 172.21.15.79:0/224499451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f00c6bd0 con 0x7f44f00bfeb0 2021-04-09T18:26:47.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.198 7f44e5ffb700 1 -- 172.21.15.79:0/224499451 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f44e0007cc0 con 0x7f44f00bfeb0 2021-04-09T18:26:47.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.202 7f44e5ffb700 1 --2- 172.21.15.79:0/224499451 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f44d0029100 0x7f44d002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:47.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.202 7f44e5ffb700 1 -- 172.21.15.79:0/224499451 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f44e00397a0 con 0x7f44f00bfeb0 2021-04-09T18:26:47.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.202 7f44f5702700 1 --2- 172.21.15.79:0/224499451 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f44d0029100 0x7f44d002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:47.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.202 7f44f5702700 1 --2- 172.21.15.79:0/224499451 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f44d0029100 0x7f44d002b650 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:47.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.202 7f44f795e700 1 -- 172.21.15.79:0/224499451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f00e39e0 con 0x7f44f00bfeb0 2021-04-09T18:26:47.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.206 7f44e5ffb700 1 -- 172.21.15.79:0/224499451 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f44e00074e0 con 0x7f44f00bfeb0 2021-04-09T18:26:47.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.370 7f44f795e700 1 -- 172.21.15.79:0/224499451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44f00f5b20 con 0x7f44f00bfeb0 2021-04-09T18:26:47.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.374 7f44e5ffb700 1 -- 172.21.15.79:0/224499451 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+1753 (secure 0 0 0) 0x7f44e0000bf0 con 0x7f44f00bfeb0 2021-04-09T18:26:47.380 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:47.380 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1857210510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1857210510},{"type":"v1","addr":"172.21.15.89:6835","nonce":1857210510}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":7,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:26:14.412596","modified":"2021-04-09 18:26:47.048098","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":23,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:26:47.381 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 7 2021-04-09T18:26:47.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.374 7f44f795e700 1 -- 172.21.15.79:0/224499451 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f44d0029100 msgr2=0x7f44d002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:47.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.374 7f44f795e700 1 --2- 172.21.15.79:0/224499451 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f44d0029100 0x7f44d002b650 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.374 7f44f795e700 1 -- 172.21.15.79:0/224499451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44f00bfeb0 msgr2=0x7f44f0098260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:47.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.374 7f44f795e700 1 --2- 172.21.15.79:0/224499451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44f00bfeb0 0x7f44f0098260 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f44f00bafe0 tx=0x7f44e000ae20).stop 2021-04-09T18:26:47.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.374 7f44f795e700 1 -- 172.21.15.79:0/224499451 shutdown_connections 2021-04-09T18:26:47.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.374 7f44f795e700 1 --2- 172.21.15.79:0/224499451 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f44d0029100 0x7f44d002b650 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.374 7f44f795e700 1 --2- 172.21.15.79:0/224499451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44f0098890 0x7f44f00c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.374 7f44f795e700 1 --2- 172.21.15.79:0/224499451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44f00d6330 0x7f44f0097660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.374 7f44f795e700 1 --2- 172.21.15.79:0/224499451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44f00bfeb0 0x7f44f0098260 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.374 7f44f795e700 1 -- 172.21.15.79:0/224499451 >> 172.21.15.79:0/224499451 conn(0x7f44f00afe10 msgr2=0x7f44f009a680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:47.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.374 7f44f795e700 1 -- 172.21.15.79:0/224499451 shutdown_connections 2021-04-09T18:26:47.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.374 7f44f795e700 1 -- 172.21.15.79:0/224499451 wait complete. 2021-04-09T18:26:47.391 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-04-09T18:26:47.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.478 7f62e810c700 1 Processor -- start 2021-04-09T18:26:47.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.478 7f62e810c700 1 -- start start 2021-04-09T18:26:47.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.478 7f62e810c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f62e00f5520 0x7f62e00f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:47.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.478 7f62e810c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f62e00e9ae0 0x7f62e009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:47.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.478 7f62e810c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e00fbb20 con 0x7f62e01c2db0 2021-04-09T18:26:47.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.478 7f62e810c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e00e9f30 con 0x7f62e00e9ae0 2021-04-09T18:26:47.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.478 7f62e810c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e00e59d0 con 0x7f62e00f5520 2021-04-09T18:26:47.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.482 7f62e56af700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f62e00e9ae0 0x7f62e009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:47.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.482 7f62e56af700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f62e00e9ae0 0x7f62e009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56630/0 (socket says 172.21.15.79:56630) 2021-04-09T18:26:47.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.482 7f62e56af700 1 -- 172.21.15.79:0/855939549 learned_addr learned my addr 172.21.15.79:0/855939549 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:47.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.482 7f62e5eb0700 1 --2- 172.21.15.79:0/855939549 >> v2:172.21.15.89:3300/0 conn(0x7f62e00f5520 0x7f62e00f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:47.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.482 7f62e56af700 1 -- 172.21.15.79:0/855939549 >> v2:172.21.15.89:3300/0 conn(0x7f62e00f5520 msgr2=0x7f62e00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:47.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.482 7f62e56af700 1 --2- 172.21.15.79:0/855939549 >> v2:172.21.15.89:3300/0 conn(0x7f62e00f5520 0x7f62e00f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.482 7f62e56af700 1 -- 172.21.15.79:0/855939549 >> v1:172.21.15.89:6789/0 conn(0x7f62e01c2db0 legacy=0x7f62e01c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:47.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.482 7f62e56af700 1 -- 172.21.15.79:0/855939549 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e00e56d0 con 0x7f62e00e9ae0 2021-04-09T18:26:47.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.482 7f62e56af700 1 --2- 172.21.15.79:0/855939549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62e00e9ae0 0x7f62e009f110 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f62d40032b0 tx=0x7f62d400b3c0).ready entity=mon.0 client_cookie=45349465e924652 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:47.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.482 7f62e4eae700 1 -- 172.21.15.79:0/855939549 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f62e00e56d0 con 0x7f62e00e9ae0 2021-04-09T18:26:47.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.482 7f62e4eae700 1 -- 172.21.15.79:0/855939549 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d400bc20 con 0x7f62e00e9ae0 2021-04-09T18:26:47.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.482 7f62e4eae700 1 -- 172.21.15.79:0/855939549 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f62d4002020 con 0x7f62e00e9ae0 2021-04-09T18:26:47.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.482 7f62e810c700 1 -- 172.21.15.79:0/855939549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62e00e9ae0 msgr2=0x7f62e009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:47.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.482 7f62e810c700 1 --2- 172.21.15.79:0/855939549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62e00e9ae0 0x7f62e009f110 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f62d40032b0 tx=0x7f62d400b3c0).stop 2021-04-09T18:26:47.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.482 7f62e810c700 1 -- 172.21.15.79:0/855939549 shutdown_connections 2021-04-09T18:26:47.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.482 7f62e810c700 1 --2- 172.21.15.79:0/855939549 >> v2:172.21.15.89:3300/0 conn(0x7f62e00f5520 0x7f62e00f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.482 7f62e810c700 1 --2- 172.21.15.79:0/855939549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62e00e9ae0 0x7f62e009f110 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.482 7f62e810c700 1 -- 172.21.15.79:0/855939549 >> 172.21.15.79:0/855939549 conn(0x7f62e00e5fe0 msgr2=0x7f62e00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:47.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.482 7f62e810c700 1 -- 172.21.15.79:0/855939549 shutdown_connections 2021-04-09T18:26:47.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.482 7f62e810c700 1 -- 172.21.15.79:0/855939549 wait complete. 2021-04-09T18:26:47.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e810c700 1 Processor -- start 2021-04-09T18:26:47.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e810c700 1 -- start start 2021-04-09T18:26:47.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e810c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62e00acf70 0x7f62e00ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:47.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e810c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62e01a4d30 0x7f62e01a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:47.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e810c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62e01a57b0 0x7f62e01b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:47.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e810c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e0047500 con 0x7f62e00acf70 2021-04-09T18:26:47.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e810c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e00ab6d0 con 0x7f62e01a57b0 2021-04-09T18:26:47.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e810c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e00ab9d0 con 0x7f62e01a4d30 2021-04-09T18:26:47.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e5eb0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62e00acf70 0x7f62e00ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:47.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e5eb0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62e00acf70 0x7f62e00ad3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56634/0 (socket says 172.21.15.79:56634) 2021-04-09T18:26:47.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e5eb0700 1 -- 172.21.15.79:0/1256010951 learned_addr learned my addr 172.21.15.79:0/1256010951 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:47.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e66b1700 1 --2- 172.21.15.79:0/1256010951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62e01a57b0 0x7f62e01b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:47.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e56af700 1 --2- 172.21.15.79:0/1256010951 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62e01a4d30 0x7f62e01a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:47.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e5eb0700 1 -- 172.21.15.79:0/1256010951 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62e01a4d30 msgr2=0x7f62e01a5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:47.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e5eb0700 1 --2- 172.21.15.79:0/1256010951 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62e01a4d30 0x7f62e01a5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e5eb0700 1 -- 172.21.15.79:0/1256010951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62e01a57b0 msgr2=0x7f62e01b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:47.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e5eb0700 1 --2- 172.21.15.79:0/1256010951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62e01a57b0 0x7f62e01b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:47.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e5eb0700 1 -- 172.21.15.79:0/1256010951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e00aadd0 con 0x7f62e00acf70 2021-04-09T18:26:47.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e66b1700 1 --2- 172.21.15.79:0/1256010951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62e01a57b0 0x7f62e01b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:47.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e5eb0700 1 --2- 172.21.15.79:0/1256010951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62e00acf70 0x7f62e00ad3c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f62e01aa3f0 tx=0x7f62dc00c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:47.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62d27fc700 1 -- 172.21.15.79:0/1256010951 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f62e00aadd0 con 0x7f62e00acf70 2021-04-09T18:26:47.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62d27fc700 1 -- 172.21.15.79:0/1256010951 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc00cd60 con 0x7f62e00acf70 2021-04-09T18:26:47.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e810c700 1 -- 172.21.15.79:0/1256010951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e00ab260 con 0x7f62e00acf70 2021-04-09T18:26:47.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62d27fc700 1 -- 172.21.15.79:0/1256010951 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f62dc00f040 con 0x7f62e00acf70 2021-04-09T18:26:47.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.486 7f62e810c700 1 -- 172.21.15.79:0/1256010951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e01b5990 con 0x7f62e00acf70 2021-04-09T18:26:47.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.490 7f62d27fc700 1 -- 172.21.15.79:0/1256010951 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f62dc011070 con 0x7f62e00acf70 2021-04-09T18:26:47.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.490 7f62d27fc700 1 --2- 172.21.15.79:0/1256010951 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f62c8029100 0x7f62c802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:47.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.490 7f62d27fc700 1 -- 172.21.15.79:0/1256010951 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f62dc010040 con 0x7f62e00acf70 2021-04-09T18:26:47.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.490 7f62e56af700 1 --2- 172.21.15.79:0/1256010951 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f62c8029100 0x7f62c802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:47.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.490 7f62e56af700 1 --2- 172.21.15.79:0/1256010951 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f62c8029100 0x7f62c802b650 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:47.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.494 7f62e810c700 1 -- 172.21.15.79:0/1256010951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e00e39e0 con 0x7f62e00acf70 2021-04-09T18:26:47.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.502 7f62d27fc700 1 -- 172.21.15.79:0/1256010951 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f62dc000bf0 con 0x7f62e00acf70 2021-04-09T18:26:47.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:47.678 7f62e810c700 1 -- 172.21.15.79:0/1256010951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f62e00f5b20 con 0x7f62e00acf70 2021-04-09T18:26:48.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.062 7f62d27fc700 1 -- 172.21.15.79:0/1256010951 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f62dc00c960 con 0x7f62e00acf70 2021-04-09T18:26:48.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.094 7f62e810c700 1 -- 172.21.15.79:0/1256010951 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f62c8029100 msgr2=0x7f62c802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:48.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.094 7f62e810c700 1 --2- 172.21.15.79:0/1256010951 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f62c8029100 0x7f62c802b650 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:48.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.094 7f62e810c700 1 -- 172.21.15.79:0/1256010951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62e00acf70 msgr2=0x7f62e00ad3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:48.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.094 7f62e810c700 1 --2- 172.21.15.79:0/1256010951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62e00acf70 0x7f62e00ad3c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f62e01aa3f0 tx=0x7f62dc00c430).stop 2021-04-09T18:26:48.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.094 7f62e810c700 1 -- 172.21.15.79:0/1256010951 shutdown_connections 2021-04-09T18:26:48.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.094 7f62e810c700 1 --2- 172.21.15.79:0/1256010951 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f62c8029100 0x7f62c802b650 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:48.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.094 7f62e810c700 1 --2- 172.21.15.79:0/1256010951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62e01a57b0 0x7f62e01b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:48.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.094 7f62e810c700 1 --2- 172.21.15.79:0/1256010951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62e00acf70 0x7f62e00ad3c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:48.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.094 7f62e810c700 1 --2- 172.21.15.79:0/1256010951 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62e01a4d30 0x7f62e01a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:48.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.094 7f62e810c700 1 -- 172.21.15.79:0/1256010951 >> 172.21.15.79:0/1256010951 conn(0x7f62e00aea50 msgr2=0x7f62e00955c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:48.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.094 7f62e810c700 1 -- 172.21.15.79:0/1256010951 shutdown_connections 2021-04-09T18:26:48.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.094 7f62e810c700 1 -- 172.21.15.79:0/1256010951 wait complete. 2021-04-09T18:26:48.121 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-04-09T18:26:48.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.218 7f33ff79d700 1 Processor -- start 2021-04-09T18:26:48.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.218 7f33ff79d700 1 -- start start 2021-04-09T18:26:48.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33ff79d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f33f80f5550 0x7f33f80f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:48.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33ff79d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f80fbb50 con 0x7f33f81c8040 2021-04-09T18:26:48.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33ff79d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f809f910 con 0x7f33f80e9b10 2021-04-09T18:26:48.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33ff79d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f80e9f60 con 0x7f33f80f5550 2021-04-09T18:26:48.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33fdd42700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f33f81c8040 0x7f33f81ca4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51354/0 (socket says 172.21.15.79:51354) 2021-04-09T18:26:48.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33fdd42700 1 -- 172.21.15.79:0/2446094646 learned_addr learned my addr 172.21.15.79:0/2446094646 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:48.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33fd541700 1 --2- 172.21.15.79:0/2446094646 >> v2:172.21.15.89:3300/0 conn(0x7f33f80f5550 0x7f33f80f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:48.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33effff700 1 -- 172.21.15.79:0/2446094646 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808803156 0 0) 0x7f33f0001450 con 0x7f33f81c8040 2021-04-09T18:26:48.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33effff700 1 -- 172.21.15.79:0/2446094646 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33e4003240 con 0x7f33f81c8040 2021-04-09T18:26:48.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33fd541700 1 -- 172.21.15.79:0/2446094646 >> v1:172.21.15.89:6789/0 conn(0x7f33f80e9b10 legacy=0x7f33f809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:48.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33effff700 1 -- 172.21.15.79:0/2446094646 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672169955 0 0) 0x7f33e80010d0 con 0x7f33f80e9b10 2021-04-09T18:26:48.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33fd541700 1 -- 172.21.15.79:0/2446094646 >> v1:172.21.15.79:6789/0 conn(0x7f33f81c8040 legacy=0x7f33f81ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:48.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33fd541700 1 -- 172.21.15.79:0/2446094646 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f80e5700 con 0x7f33f80f5550 2021-04-09T18:26:48.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33fd541700 1 --2- 172.21.15.79:0/2446094646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f80f5550 0x7f33f80f64e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f33f4002f30 tx=0x7f33f400bcc0).ready entity=mon.1 client_cookie=22992a18e0d15b5e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:48.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33effff700 1 -- 172.21.15.79:0/2446094646 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33f80e5700 con 0x7f33f80f5550 2021-04-09T18:26:48.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33effff700 1 -- 172.21.15.79:0/2446094646 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f4009800 con 0x7f33f80f5550 2021-04-09T18:26:48.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33effff700 1 -- 172.21.15.79:0/2446094646 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33f4009bd0 con 0x7f33f80f5550 2021-04-09T18:26:48.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33ff79d700 1 -- 172.21.15.79:0/2446094646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f80f5550 msgr2=0x7f33f80f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:48.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33ff79d700 1 --2- 172.21.15.79:0/2446094646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f80f5550 0x7f33f80f64e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f33f4002f30 tx=0x7f33f400bcc0).stop 2021-04-09T18:26:48.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33ff79d700 1 -- 172.21.15.79:0/2446094646 shutdown_connections 2021-04-09T18:26:48.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33ff79d700 1 --2- 172.21.15.79:0/2446094646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f80f5550 0x7f33f80f64e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:48.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33ff79d700 1 -- 172.21.15.79:0/2446094646 >> 172.21.15.79:0/2446094646 conn(0x7f33f80e6010 msgr2=0x7f33f80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:48.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33ff79d700 1 -- 172.21.15.79:0/2446094646 shutdown_connections 2021-04-09T18:26:48.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.222 7f33ff79d700 1 -- 172.21.15.79:0/2446094646 wait complete. 2021-04-09T18:26:48.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.226 7f33ff79d700 1 Processor -- start 2021-04-09T18:26:48.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.226 7f33ff79d700 1 -- start start 2021-04-09T18:26:48.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.226 7f33ff79d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33f80b9500 0x7f33f80d7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:48.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.226 7f33ff79d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33f8094720 0x7f33f80ce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.226 7f33ff79d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f80ceaa0 0x7f33f80ba3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.226 7f33ff79d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f81c3df0 con 0x7f33f8094720 2021-04-09T18:26:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.226 7f33ff79d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f80d60b0 con 0x7f33f80ceaa0 2021-04-09T18:26:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.226 7f33ff79d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f8098e70 con 0x7f33f80b9500 2021-04-09T18:26:48.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.226 7f33fcd40700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33f8094720 0x7f33f80ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:48.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.226 7f33fcd40700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33f8094720 0x7f33f80ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56648/0 (socket says 172.21.15.79:56648) 2021-04-09T18:26:48.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.226 7f33fcd40700 1 -- 172.21.15.79:0/1142249209 learned_addr learned my addr 172.21.15.79:0/1142249209 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:48.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.226 7f33fdd42700 1 --2- 172.21.15.79:0/1142249209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f80ceaa0 0x7f33f80ba3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:48.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.226 7f33fd541700 1 --2- 172.21.15.79:0/1142249209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33f80b9500 0x7f33f80d7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:48.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.226 7f33fcd40700 1 -- 172.21.15.79:0/1142249209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33f80b9500 msgr2=0x7f33f80d7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:48.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.226 7f33fcd40700 1 --2- 172.21.15.79:0/1142249209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33f80b9500 0x7f33f80d7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:48.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.226 7f33fcd40700 1 -- 172.21.15.79:0/1142249209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f80ceaa0 msgr2=0x7f33f80ba3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:48.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.230 7f33fcd40700 1 --2- 172.21.15.79:0/1142249209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f80ceaa0 0x7f33f80ba3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:48.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.230 7f33fcd40700 1 -- 172.21.15.79:0/1142249209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f80d5c60 con 0x7f33f8094720 2021-04-09T18:26:48.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.230 7f33fcd40700 1 --2- 172.21.15.79:0/1142249209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33f8094720 0x7f33f80ce470 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f33f80d26f0 tx=0x7f33e8007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:48.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.230 7f33edffb700 1 -- 172.21.15.79:0/1142249209 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33f80d5c60 con 0x7f33f8094720 2021-04-09T18:26:48.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.230 7f33edffb700 1 -- 172.21.15.79:0/1142249209 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e800e4a0 con 0x7f33f8094720 2021-04-09T18:26:48.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.230 7f33ff79d700 1 -- 172.21.15.79:0/1142249209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f80d8380 con 0x7f33f8094720 2021-04-09T18:26:48.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.230 7f33edffb700 1 -- 172.21.15.79:0/1142249209 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33e800e870 con 0x7f33f8094720 2021-04-09T18:26:48.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.230 7f33ff79d700 1 -- 172.21.15.79:0/1142249209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f80d8eb0 con 0x7f33f8094720 2021-04-09T18:26:48.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.230 7f33edffb700 1 -- 172.21.15.79:0/1142249209 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f33e801a020 con 0x7f33f8094720 2021-04-09T18:26:48.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.230 7f33edffb700 1 --2- 172.21.15.79:0/1142249209 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f33d8029100 0x7f33d802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:48.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.230 7f33edffb700 1 -- 172.21.15.79:0/1142249209 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f33e80393a0 con 0x7f33f8094720 2021-04-09T18:26:48.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.230 7f33fd541700 1 --2- 172.21.15.79:0/1142249209 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f33d8029100 0x7f33d802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:48.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.234 7f33fd541700 1 --2- 172.21.15.79:0/1142249209 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f33d8029100 0x7f33d802b650 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:48.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.234 7f33ff79d700 1 -- 172.21.15.79:0/1142249209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f80e39f0 con 0x7f33f8094720 2021-04-09T18:26:48.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.242 7f33edffb700 1 -- 172.21.15.79:0/1142249209 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f33e8000bf0 con 0x7f33f8094720 2021-04-09T18:26:48.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:48.410 7f33ff79d700 1 -- 172.21.15.79:0/1142249209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f33f80a1c90 con 0x7f33f8094720 2021-04-09T18:26:49.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.066 7f33edffb700 1 -- 172.21.15.79:0/1142249209 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 185+0+0 (secure 0 0 0) 0x7f33e800e290 con 0x7f33f8094720 2021-04-09T18:26:49.082 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2021-04-09T18:26:49.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.078 7f33ff79d700 1 -- 172.21.15.79:0/1142249209 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f33d8029100 msgr2=0x7f33d802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:49.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.078 7f33ff79d700 1 --2- 172.21.15.79:0/1142249209 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f33d8029100 0x7f33d802b650 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:49.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.078 7f33ff79d700 1 -- 172.21.15.79:0/1142249209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33f8094720 msgr2=0x7f33f80ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:49.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.078 7f33ff79d700 1 --2- 172.21.15.79:0/1142249209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33f8094720 0x7f33f80ce470 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f33f80d26f0 tx=0x7f33e8007f70).stop 2021-04-09T18:26:49.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.078 7f33ff79d700 1 -- 172.21.15.79:0/1142249209 shutdown_connections 2021-04-09T18:26:49.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.078 7f33ff79d700 1 --2- 172.21.15.79:0/1142249209 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f33d8029100 0x7f33d802b650 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:49.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.078 7f33ff79d700 1 --2- 172.21.15.79:0/1142249209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f80ceaa0 0x7f33f80ba3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:49.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.078 7f33ff79d700 1 --2- 172.21.15.79:0/1142249209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33f80b9500 0x7f33f80d7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:49.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.078 7f33ff79d700 1 --2- 172.21.15.79:0/1142249209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33f8094720 0x7f33f80ce470 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:49.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.078 7f33ff79d700 1 -- 172.21.15.79:0/1142249209 >> 172.21.15.79:0/1142249209 conn(0x7f33f8093500 msgr2=0x7f33f80d73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:49.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.078 7f33ff79d700 1 -- 172.21.15.79:0/1142249209 shutdown_connections 2021-04-09T18:26:49.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.078 7f33ff79d700 1 -- 172.21.15.79:0/1142249209 wait complete. 2021-04-09T18:26:49.099 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-04-09T18:26:49.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.186 7f97c89cb700 1 Processor -- start 2021-04-09T18:26:49.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.186 7f97c89cb700 1 -- start start 2021-04-09T18:26:49.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c89cb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f97c41c9040 0x7f97c41cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:49.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c89cb700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c40fbb40 con 0x7f97c40f5540 2021-04-09T18:26:49.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c89cb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c409f900 con 0x7f97c40e9b00 2021-04-09T18:26:49.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c89cb700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c41c3de0 con 0x7f97c41c9040 2021-04-09T18:26:49.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c2da5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f97c41c9040 0x7f97c41cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:49.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c2da5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f97c41c9040 0x7f97c41cb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56658/0 (socket says 172.21.15.79:56658) 2021-04-09T18:26:49.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c2da5700 1 -- 172.21.15.79:0/3122926075 learned_addr learned my addr 172.21.15.79:0/3122926075 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:49.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c25a4700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f97c40f5540 0x7f97c40f64d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51366/0 (socket says 172.21.15.79:51366) 2021-04-09T18:26:49.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c2da5700 1 -- 172.21.15.79:0/3122926075 >> v1:172.21.15.89:6789/0 conn(0x7f97c40e9b00 legacy=0x7f97c409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:49.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c2da5700 1 -- 172.21.15.79:0/3122926075 >> v1:172.21.15.79:6789/0 conn(0x7f97c40f5540 legacy=0x7f97c40f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:49.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c2da5700 1 -- 172.21.15.79:0/3122926075 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c40e56f0 con 0x7f97c41c9040 2021-04-09T18:26:49.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c15a2700 1 -- 172.21.15.79:0/3122926075 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1422363603 0 0) 0x7f97b4001450 con 0x7f97c40f5540 2021-04-09T18:26:49.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c2da5700 1 --2- 172.21.15.79:0/3122926075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c41c9040 0x7f97c41cb4a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f97bc002f30 tx=0x7f97bc00bd20).ready entity=mon.0 client_cookie=6dc6b2f269038a72 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:49.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c15a2700 1 -- 172.21.15.79:0/3122926075 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f97c40e56f0 con 0x7f97c41c9040 2021-04-09T18:26:49.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c15a2700 1 -- 172.21.15.79:0/3122926075 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97bc009a20 con 0x7f97c41c9040 2021-04-09T18:26:49.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c15a2700 1 -- 172.21.15.79:0/3122926075 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f97bc009df0 con 0x7f97c41c9040 2021-04-09T18:26:49.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c89cb700 1 -- 172.21.15.79:0/3122926075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c41c9040 msgr2=0x7f97c41cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:49.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c89cb700 1 --2- 172.21.15.79:0/3122926075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c41c9040 0x7f97c41cb4a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f97bc002f30 tx=0x7f97bc00bd20).stop 2021-04-09T18:26:49.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c89cb700 1 -- 172.21.15.79:0/3122926075 shutdown_connections 2021-04-09T18:26:49.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c89cb700 1 --2- 172.21.15.79:0/3122926075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c41c9040 0x7f97c41cb4a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:49.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c89cb700 1 -- 172.21.15.79:0/3122926075 >> 172.21.15.79:0/3122926075 conn(0x7f97c40e6000 msgr2=0x7f97c40e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:49.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c89cb700 1 -- 172.21.15.79:0/3122926075 shutdown_connections 2021-04-09T18:26:49.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.190 7f97c89cb700 1 -- 172.21.15.79:0/3122926075 wait complete. 2021-04-09T18:26:49.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.194 7f97c89cb700 1 Processor -- start 2021-04-09T18:26:49.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.194 7f97c89cb700 1 -- start start 2021-04-09T18:26:49.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.194 7f97c89cb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97c40b7b90 0x7f97c40b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:49.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.194 7f97c89cb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c40b3070 0x7f97c40b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:49.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.194 7f97c89cb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97c40d4c30 0x7f97c40d5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:49.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.194 7f97c89cb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c40e9f50 con 0x7f97c40b3070 2021-04-09T18:26:49.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.194 7f97c89cb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c40b6140 con 0x7f97c40b7b90 2021-04-09T18:26:49.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.194 7f97c89cb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c40b6440 con 0x7f97c40d4c30 2021-04-09T18:26:49.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.194 7f97c1da3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c40b3070 0x7f97c40b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:49.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.194 7f97c1da3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c40b3070 0x7f97c40b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56664/0 (socket says 172.21.15.79:56664) 2021-04-09T18:26:49.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.194 7f97c1da3700 1 -- 172.21.15.79:0/3918791595 learned_addr learned my addr 172.21.15.79:0/3918791595 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:49.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.194 7f97c2da5700 1 --2- 172.21.15.79:0/3918791595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97c40d4c30 0x7f97c40d5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:49.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.194 7f97c25a4700 1 --2- 172.21.15.79:0/3918791595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97c40b7b90 0x7f97c40b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:49.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.198 7f97c1da3700 1 -- 172.21.15.79:0/3918791595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97c40d4c30 msgr2=0x7f97c40d5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:49.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.198 7f97c1da3700 1 --2- 172.21.15.79:0/3918791595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97c40d4c30 0x7f97c40d5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:49.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.198 7f97c1da3700 1 -- 172.21.15.79:0/3918791595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97c40b7b90 msgr2=0x7f97c40b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:49.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.198 7f97c1da3700 1 --2- 172.21.15.79:0/3918791595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97c40b7b90 0x7f97c40b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:49.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.198 7f97c1da3700 1 -- 172.21.15.79:0/3918791595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c41a08b0 con 0x7f97c40b3070 2021-04-09T18:26:49.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.198 7f97c1da3700 1 --2- 172.21.15.79:0/3918791595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c40b3070 0x7f97c40b34c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f97c409b020 tx=0x7f97ac00cb10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:49.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.198 7f97baffd700 1 -- 172.21.15.79:0/3918791595 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f97c41a08b0 con 0x7f97c40b3070 2021-04-09T18:26:49.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.198 7f97c89cb700 1 -- 172.21.15.79:0/3918791595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c40bb470 con 0x7f97c40b3070 2021-04-09T18:26:49.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.198 7f97baffd700 1 -- 172.21.15.79:0/3918791595 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ac00e4a0 con 0x7f97c40b3070 2021-04-09T18:26:49.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.198 7f97baffd700 1 -- 172.21.15.79:0/3918791595 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f97ac00e870 con 0x7f97c40b3070 2021-04-09T18:26:49.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.198 7f97c89cb700 1 -- 172.21.15.79:0/3918791595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c41ae180 con 0x7f97c40b3070 2021-04-09T18:26:49.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.198 7f97baffd700 1 -- 172.21.15.79:0/3918791595 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f97ac01a060 con 0x7f97c40b3070 2021-04-09T18:26:49.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.198 7f97baffd700 1 --2- 172.21.15.79:0/3918791595 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f97a8029100 0x7f97a802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:49.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.198 7f97baffd700 1 -- 172.21.15.79:0/3918791595 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5583+0+0 (secure 0 0 0) 0x7f97ac038d80 con 0x7f97c40b3070 2021-04-09T18:26:49.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.198 7f97c25a4700 1 --2- 172.21.15.79:0/3918791595 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f97a8029100 0x7f97a802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:49.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.198 7f97c25a4700 1 --2- 172.21.15.79:0/3918791595 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f97a8029100 0x7f97a802b650 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:49.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.202 7f97c89cb700 1 -- 172.21.15.79:0/3918791595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c40e39e0 con 0x7f97c40b3070 2021-04-09T18:26:49.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.210 7f97baffd700 1 -- 172.21.15.79:0/3918791595 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f97ac00e290 con 0x7f97c40b3070 2021-04-09T18:26:49.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:49.366 7f97c89cb700 1 -- 172.21.15.79:0/3918791595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f97c40a1c80 con 0x7f97c40b3070 2021-04-09T18:26:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.078 7f97baffd700 1 -- 172.21.15.79:0/3918791595 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 173+0+0 (secure 0 0 0) 0x7f97ac000bf0 con 0x7f97c40b3070 2021-04-09T18:26:50.088 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2021-04-09T18:26:50.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.086 7f97c89cb700 1 -- 172.21.15.79:0/3918791595 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f97a8029100 msgr2=0x7f97a802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:50.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.086 7f97c89cb700 1 --2- 172.21.15.79:0/3918791595 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f97a8029100 0x7f97a802b650 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:50.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.086 7f97c89cb700 1 -- 172.21.15.79:0/3918791595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c40b3070 msgr2=0x7f97c40b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:50.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.086 7f97c89cb700 1 --2- 172.21.15.79:0/3918791595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c40b3070 0x7f97c40b34c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f97c409b020 tx=0x7f97ac00cb10).stop 2021-04-09T18:26:50.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.086 7f97c89cb700 1 -- 172.21.15.79:0/3918791595 shutdown_connections 2021-04-09T18:26:50.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.086 7f97c89cb700 1 --2- 172.21.15.79:0/3918791595 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f97a8029100 0x7f97a802b650 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:50.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.086 7f97c89cb700 1 --2- 172.21.15.79:0/3918791595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97c40b7b90 0x7f97c40b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:50.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.086 7f97c89cb700 1 --2- 172.21.15.79:0/3918791595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97c40d4c30 0x7f97c40d5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:50.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.086 7f97c89cb700 1 --2- 172.21.15.79:0/3918791595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c40b3070 0x7f97c40b34c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:50.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.086 7f97c89cb700 1 -- 172.21.15.79:0/3918791595 >> 172.21.15.79:0/3918791595 conn(0x7f97c40c3f30 msgr2=0x7f97c40d84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:50.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.086 7f97c89cb700 1 -- 172.21.15.79:0/3918791595 shutdown_connections 2021-04-09T18:26:50.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.086 7f97c89cb700 1 -- 172.21.15.79:0/3918791595 wait complete. 2021-04-09T18:26:50.104 INFO:tasks.ceph.mds.a:Restarting daemon 2021-04-09T18:26:50.104 INFO:tasks.ceph.mds.a:Stopping old one... 2021-04-09T18:26:50.105 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-04-09T18:26:50.105 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:26:50.106 INFO:tasks.ceph.mds.b:Restarting daemon 2021-04-09T18:26:50.106 INFO:tasks.ceph.mds.b:Stopping old one... 2021-04-09T18:26:50.107 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-04-09T18:26:50.107 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:26:50.116 INFO:tasks.ceph.mds.a:Stopped 2021-04-09T18:26:50.116 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-04-09T18:26:50.121 INFO:tasks.ceph.mds.b:Stopped 2021-04-09T18:26:50.122 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-04-09T18:26:50.160 INFO:tasks.ceph.mds.a:Started 2021-04-09T18:26:50.161 DEBUG:teuthology.parallel:result is None 2021-04-09T18:26:50.166 INFO:tasks.ceph.mds.b:Started 2021-04-09T18:26:50.166 DEBUG:teuthology.parallel:result is None 2021-04-09T18:26:50.167 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-04-09T18:26:50.238 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2021-04-09T18:26:50.241 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2021-04-09T18:26:50.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.246 7f0d7665f700 1 Processor -- start 2021-04-09T18:26:50.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.246 7f0d7665f700 1 -- start start 2021-04-09T18:26:50.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d7665f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d700f5520 0x7f0d700f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:50.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d7665f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0d700e9ae0 0x7f0d7009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:50.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d7665f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0d701c2db0 0x7f0d701c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:50.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d7665f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d700e9f30 con 0x7f0d701c2db0 2021-04-09T18:26:50.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d7665f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d700e59d0 con 0x7f0d700e9ae0 2021-04-09T18:26:50.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d7665f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d700fbb20 con 0x7f0d700f5520 2021-04-09T18:26:50.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d74c04700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0d701c2db0 0x7f0d701c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:50.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d74c04700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0d701c2db0 0x7f0d701c3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56684/0 (socket says 172.21.15.79:56684) 2021-04-09T18:26:50.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d74c04700 1 -- 172.21.15.79:0/3892881144 learned_addr learned my addr 172.21.15.79:0/3892881144 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:50.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d6ffff700 1 --2- 172.21.15.79:0/3892881144 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d700f5520 0x7f0d700f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:50.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d6f7fe700 1 --2- 172.21.15.79:0/3892881144 >> v2:172.21.15.89:3300/0 conn(0x7f0d700e9ae0 0x7f0d7009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:50.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d74c04700 1 -- 172.21.15.79:0/3892881144 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d700f5520 msgr2=0x7f0d700f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:50.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d74c04700 1 --2- 172.21.15.79:0/3892881144 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d700f5520 0x7f0d700f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:50.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d74c04700 1 -- 172.21.15.79:0/3892881144 >> v2:172.21.15.89:3300/0 conn(0x7f0d700e9ae0 msgr2=0x7f0d7009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:50.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d74c04700 1 --2- 172.21.15.79:0/3892881144 >> v2:172.21.15.89:3300/0 conn(0x7f0d700e9ae0 0x7f0d7009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:50.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d74c04700 1 -- 172.21.15.79:0/3892881144 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d700e56d0 con 0x7f0d701c2db0 2021-04-09T18:26:50.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d74c04700 1 --2- 172.21.15.79:0/3892881144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d701c2db0 0x7f0d701c3200 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f0d60002f30 tx=0x7f0d6000bd70).ready entity=mon.0 client_cookie=c18a212fa0ec3d3e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:50.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d6effd700 1 -- 172.21.15.79:0/3892881144 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d700e56d0 con 0x7f0d701c2db0 2021-04-09T18:26:50.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d6effd700 1 -- 172.21.15.79:0/3892881144 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d600098b0 con 0x7f0d701c2db0 2021-04-09T18:26:50.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d6effd700 1 -- 172.21.15.79:0/3892881144 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d60009c80 con 0x7f0d701c2db0 2021-04-09T18:26:50.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d7665f700 1 -- 172.21.15.79:0/3892881144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d701c2db0 msgr2=0x7f0d701c3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:50.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d7665f700 1 --2- 172.21.15.79:0/3892881144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d701c2db0 0x7f0d701c3200 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f0d60002f30 tx=0x7f0d6000bd70).stop 2021-04-09T18:26:50.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d7665f700 1 -- 172.21.15.79:0/3892881144 shutdown_connections 2021-04-09T18:26:50.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d7665f700 1 --2- 172.21.15.79:0/3892881144 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d700f5520 0x7f0d700f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:50.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d7665f700 1 --2- 172.21.15.79:0/3892881144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d701c2db0 0x7f0d701c3200 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:50.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d7665f700 1 --2- 172.21.15.79:0/3892881144 >> v2:172.21.15.89:3300/0 conn(0x7f0d700e9ae0 0x7f0d7009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:50.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d7665f700 1 -- 172.21.15.79:0/3892881144 >> 172.21.15.79:0/3892881144 conn(0x7f0d700e5fe0 msgr2=0x7f0d700e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:50.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d7665f700 1 -- 172.21.15.79:0/3892881144 shutdown_connections 2021-04-09T18:26:50.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.250 7f0d7665f700 1 -- 172.21.15.79:0/3892881144 wait complete. 2021-04-09T18:26:50.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.254 7f0d7665f700 1 Processor -- start 2021-04-09T18:26:50.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.254 7f0d7665f700 1 -- start start 2021-04-09T18:26:50.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.254 7f0d7665f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d7019edd0 0x7f0d700d7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:50.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.254 7f0d7665f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d70099560 0x7f0d700999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:50.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.254 7f0d7665f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d70099fe0 0x7f0d700ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:50.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.254 7f0d7665f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d700885c0 con 0x7f0d7019edd0 2021-04-09T18:26:50.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.254 7f0d7665f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7019f540 con 0x7f0d70099560 2021-04-09T18:26:50.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.254 7f0d7665f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7019f220 con 0x7f0d70099fe0 2021-04-09T18:26:50.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.254 7f0d6ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d7019edd0 0x7f0d700d7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:50.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.254 7f0d6ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d7019edd0 0x7f0d700d7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56688/0 (socket says 172.21.15.79:56688) 2021-04-09T18:26:50.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.254 7f0d6ffff700 1 -- 172.21.15.79:0/3843678529 learned_addr learned my addr 172.21.15.79:0/3843678529 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:50.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.254 7f0d6f7fe700 1 --2- 172.21.15.79:0/3843678529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d70099560 0x7f0d700999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:50.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.254 7f0d74c04700 1 --2- 172.21.15.79:0/3843678529 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d70099fe0 0x7f0d700ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:50.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.254 7f0d6ffff700 1 -- 172.21.15.79:0/3843678529 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d70099fe0 msgr2=0x7f0d700ad970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:50.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.254 7f0d6ffff700 1 --2- 172.21.15.79:0/3843678529 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d70099fe0 0x7f0d700ad970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:50.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.254 7f0d6ffff700 1 -- 172.21.15.79:0/3843678529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d70099560 msgr2=0x7f0d700999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:50.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.254 7f0d6ffff700 1 --2- 172.21.15.79:0/3843678529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d70099560 0x7f0d700999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:50.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.254 7f0d6ffff700 1 -- 172.21.15.79:0/3843678529 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7019f840 con 0x7f0d7019edd0 2021-04-09T18:26:50.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.254 7f0d74c04700 1 --2- 172.21.15.79:0/3843678529 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d70099fe0 0x7f0d700ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:50.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.254 7f0d6ffff700 1 --2- 172.21.15.79:0/3843678529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d7019edd0 0x7f0d700d7760 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f0d6800efc0 tx=0x7f0d6800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:50.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.258 7f0d6cff9700 1 -- 172.21.15.79:0/3843678529 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d7019f840 con 0x7f0d7019edd0 2021-04-09T18:26:50.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.258 7f0d6cff9700 1 -- 172.21.15.79:0/3843678529 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6800cca0 con 0x7f0d7019edd0 2021-04-09T18:26:50.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.258 7f0d7665f700 1 -- 172.21.15.79:0/3843678529 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d700d7d90 con 0x7f0d7019edd0 2021-04-09T18:26:50.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.258 7f0d6cff9700 1 -- 172.21.15.79:0/3843678529 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d6800f040 con 0x7f0d7019edd0 2021-04-09T18:26:50.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.258 7f0d7665f700 1 -- 172.21.15.79:0/3843678529 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d700ae130 con 0x7f0d7019edd0 2021-04-09T18:26:50.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.258 7f0d6cff9700 1 -- 172.21.15.79:0/3843678529 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0d68011070 con 0x7f0d7019edd0 2021-04-09T18:26:50.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.258 7f0d6cff9700 1 --2- 172.21.15.79:0/3843678529 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0d50029100 0x7f0d5002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:50.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.258 7f0d6cff9700 1 -- 172.21.15.79:0/3843678529 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f0d68010040 con 0x7f0d7019edd0 2021-04-09T18:26:50.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.258 7f0d6f7fe700 1 --2- 172.21.15.79:0/3843678529 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0d50029100 0x7f0d5002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:50.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.258 7f0d6f7fe700 1 --2- 172.21.15.79:0/3843678529 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0d50029100 0x7f0d5002b650 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:50.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.262 7f0d7665f700 1 -- 172.21.15.79:0/3843678529 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d700e39e0 con 0x7f0d7019edd0 2021-04-09T18:26:50.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.270 7f0d6cff9700 1 -- 172.21.15.79:0/3843678529 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0d6800ca90 con 0x7f0d7019edd0 2021-04-09T18:26:50.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:50.442 7f0d7665f700 1 -- 172.21.15.79:0/3843678529 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f0d700f5b20 con 0x7f0d7019edd0 2021-04-09T18:26:51.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.082 7f0d6cff9700 1 -- 172.21.15.79:0/3843678529 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0d68000f70 con 0x7f0d7019edd0 2021-04-09T18:26:51.112 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blacklist entries 2021-04-09T18:26:51.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.110 7f0d7665f700 1 -- 172.21.15.79:0/3843678529 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0d50029100 msgr2=0x7f0d5002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:51.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.110 7f0d7665f700 1 --2- 172.21.15.79:0/3843678529 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0d50029100 0x7f0d5002b650 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.110 7f0d7665f700 1 -- 172.21.15.79:0/3843678529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d7019edd0 msgr2=0x7f0d700d7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:51.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.110 7f0d7665f700 1 --2- 172.21.15.79:0/3843678529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d7019edd0 0x7f0d700d7760 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f0d6800efc0 tx=0x7f0d6800c430).stop 2021-04-09T18:26:51.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.110 7f0d7665f700 1 -- 172.21.15.79:0/3843678529 shutdown_connections 2021-04-09T18:26:51.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.110 7f0d7665f700 1 --2- 172.21.15.79:0/3843678529 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0d50029100 0x7f0d5002b650 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.110 7f0d7665f700 1 --2- 172.21.15.79:0/3843678529 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d70099fe0 0x7f0d700ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.110 7f0d7665f700 1 --2- 172.21.15.79:0/3843678529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d7019edd0 0x7f0d700d7760 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.110 7f0d7665f700 1 --2- 172.21.15.79:0/3843678529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d70099560 0x7f0d700999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.110 7f0d7665f700 1 -- 172.21.15.79:0/3843678529 >> 172.21.15.79:0/3843678529 conn(0x7f0d70097dd0 msgr2=0x7f0d700af160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:51.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.110 7f0d7665f700 1 -- 172.21.15.79:0/3843678529 shutdown_connections 2021-04-09T18:26:51.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.110 7f0d7665f700 1 -- 172.21.15.79:0/3843678529 wait complete. 2021-04-09T18:26:51.128 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-04-09T18:26:51.129 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-04-09T18:26:51.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.214 7f5a0a14f700 1 Processor -- start 2021-04-09T18:26:51.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.214 7f5a0a14f700 1 -- start start 2021-04-09T18:26:51.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.214 7f5a0a14f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a040e9ae0 0x7f5a0409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.214 7f5a0a14f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a040fbb20 con 0x7f5a040f5520 2021-04-09T18:26:51.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.214 7f5a0a14f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a040e56d0 con 0x7f5a041c8010 2021-04-09T18:26:51.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.214 7f5a0a14f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a041c3dc0 con 0x7f5a040e9ae0 2021-04-09T18:26:51.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.214 7f5a037fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5a040f5520 0x7f5a040f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51406/0 (socket says 172.21.15.79:51406) 2021-04-09T18:26:51.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.214 7f5a037fe700 1 -- 172.21.15.79:0/1748158499 learned_addr learned my addr 172.21.15.79:0/1748158499 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:51.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a02ffd700 1 --2- 172.21.15.79:0/1748158499 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a040e9ae0 0x7f5a0409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a027fc700 1 -- 172.21.15.79:0/1748158499 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1064213561 0 0) 0x7f59f40010d0 con 0x7f5a040f5520 2021-04-09T18:26:51.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a027fc700 1 -- 172.21.15.79:0/1748158499 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59ec003240 con 0x7f5a040f5520 2021-04-09T18:26:51.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a027fc700 1 -- 172.21.15.79:0/1748158499 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958253423 0 0) 0x7f59fc001450 con 0x7f5a041c8010 2021-04-09T18:26:51.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a027fc700 1 -- 172.21.15.79:0/1748158499 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59ec003620 con 0x7f5a041c8010 2021-04-09T18:26:51.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a027fc700 1 -- 172.21.15.79:0/1748158499 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 85981137 0 0) 0x7f59f4001650 con 0x7f5a040f5520 2021-04-09T18:26:51.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a027fc700 1 -- 172.21.15.79:0/1748158499 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a040e9ae0 msgr2=0x7f5a0409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:51.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a027fc700 1 --2- 172.21.15.79:0/1748158499 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a040e9ae0 0x7f5a0409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a027fc700 1 -- 172.21.15.79:0/1748158499 >> v1:172.21.15.89:6789/0 conn(0x7f5a041c8010 legacy=0x7f5a041ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:51.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a027fc700 1 -- 172.21.15.79:0/1748158499 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a040e4330 con 0x7f5a040f5520 2021-04-09T18:26:51.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a027fc700 1 -- 172.21.15.79:0/1748158499 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f59f4001bb0 con 0x7f5a040f5520 2021-04-09T18:26:51.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a027fc700 1 -- 172.21.15.79:0/1748158499 >> v1:172.21.15.79:6789/0 conn(0x7f5a040f5520 legacy=0x7f5a040f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:51.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a027fc700 1 --2- 172.21.15.79:0/1748158499 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59ec003d40 0x7f59ec0045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a027fc700 1 --2- 172.21.15.79:0/1748158499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ec004bd0 0x7f59ec0097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a027fc700 1 --2- 172.21.15.79:0/1748158499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59ec005020 0x7f59ec00be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a027fc700 1 -- 172.21.15.79:0/1748158499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a041c3dc0 con 0x7f59ec004bd0 2021-04-09T18:26:51.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a027fc700 1 -- 172.21.15.79:0/1748158499 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec050460 con 0x7f59ec005020 2021-04-09T18:26:51.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a027fc700 1 -- 172.21.15.79:0/1748158499 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec050610 con 0x7f59ec003d40 2021-04-09T18:26:51.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a02ffd700 1 --2- 172.21.15.79:0/1748158499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ec004bd0 0x7f59ec0097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a037fe700 1 --2- 172.21.15.79:0/1748158499 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59ec003d40 0x7f59ec0045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a03fff700 1 --2- 172.21.15.79:0/1748158499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59ec005020 0x7f59ec00be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a02ffd700 1 -- 172.21.15.79:0/1748158499 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59ec003d40 msgr2=0x7f59ec0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:51.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a02ffd700 1 --2- 172.21.15.79:0/1748158499 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59ec003d40 0x7f59ec0045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a02ffd700 1 -- 172.21.15.79:0/1748158499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59ec005020 msgr2=0x7f59ec00be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:51.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a02ffd700 1 --2- 172.21.15.79:0/1748158499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59ec005020 0x7f59ec00be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a02ffd700 1 -- 172.21.15.79:0/1748158499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec0508b0 con 0x7f59ec004bd0 2021-04-09T18:26:51.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a03fff700 1 --2- 172.21.15.79:0/1748158499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59ec005020 0x7f59ec00be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:51.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a02ffd700 1 --2- 172.21.15.79:0/1748158499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ec004bd0 0x7f59ec0097e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f59f800c000 tx=0x7f59f800e1d0).ready entity=mon.0 client_cookie=37d8fd0d2e37cafd server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:51.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a027fc700 1 -- 172.21.15.79:0/1748158499 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59ec0508b0 con 0x7f59ec004bd0 2021-04-09T18:26:51.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a027fc700 1 -- 172.21.15.79:0/1748158499 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f800ec90 con 0x7f59ec004bd0 2021-04-09T18:26:51.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a027fc700 1 -- 172.21.15.79:0/1748158499 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59f800f040 con 0x7f59ec004bd0 2021-04-09T18:26:51.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a0a14f700 1 -- 172.21.15.79:0/1748158499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ec004bd0 msgr2=0x7f59ec0097e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:51.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a0a14f700 1 --2- 172.21.15.79:0/1748158499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ec004bd0 0x7f59ec0097e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f59f800c000 tx=0x7f59f800e1d0).stop 2021-04-09T18:26:51.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a03fff700 1 -- 172.21.15.79:0/1748158499 reap_dead start 2021-04-09T18:26:51.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a0a14f700 1 -- 172.21.15.79:0/1748158499 shutdown_connections 2021-04-09T18:26:51.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a0a14f700 1 -- 172.21.15.79:0/1748158499 >> 172.21.15.79:0/1748158499 conn(0x7f5a040e5fe0 msgr2=0x7f5a040e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:51.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a0a14f700 1 -- 172.21.15.79:0/1748158499 shutdown_connections 2021-04-09T18:26:51.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.218 7f5a0a14f700 1 -- 172.21.15.79:0/1748158499 wait complete. 2021-04-09T18:26:51.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a0a14f700 1 Processor -- start 2021-04-09T18:26:51.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a0a14f700 1 -- start start 2021-04-09T18:26:51.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a0a14f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a040d5460 0x7f5a041aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a0a14f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a041ae500 0x7f5a041ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a0a14f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a040c29f0 0x7f5a040c2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a0a14f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f4001150 con 0x7f5a040d5460 2021-04-09T18:26:51.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a0a14f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a040e9f30 con 0x7f5a040c29f0 2021-04-09T18:26:51.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a0a14f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a040c1470 con 0x7f5a041ae500 2021-04-09T18:26:51.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a037fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a040d5460 0x7f5a041aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a037fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a040d5460 0x7f5a041aded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56708/0 (socket says 172.21.15.79:56708) 2021-04-09T18:26:51.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a037fe700 1 -- 172.21.15.79:0/3330319449 learned_addr learned my addr 172.21.15.79:0/3330319449 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:51.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a02ffd700 1 --2- 172.21.15.79:0/3330319449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a041ae500 0x7f5a041ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a03fff700 1 --2- 172.21.15.79:0/3330319449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a040c29f0 0x7f5a040c2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a037fe700 1 -- 172.21.15.79:0/3330319449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a041ae500 msgr2=0x7f5a041ae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:51.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a037fe700 1 --2- 172.21.15.79:0/3330319449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a041ae500 0x7f5a041ae950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a037fe700 1 -- 172.21.15.79:0/3330319449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a040c29f0 msgr2=0x7f5a040c2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:51.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a037fe700 1 --2- 172.21.15.79:0/3330319449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a040c29f0 0x7f5a040c2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a037fe700 1 -- 172.21.15.79:0/3330319449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a04098e10 con 0x7f5a040d5460 2021-04-09T18:26:51.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a037fe700 1 --2- 172.21.15.79:0/3330319449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a040d5460 0x7f5a041aded0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f59f400d000 tx=0x7f59f400f820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:51.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f59ebfff700 1 -- 172.21.15.79:0/3330319449 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5a04098e10 con 0x7f5a040d5460 2021-04-09T18:26:51.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f59ebfff700 1 -- 172.21.15.79:0/3330319449 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f40135e0 con 0x7f5a040d5460 2021-04-09T18:26:51.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a0a14f700 1 -- 172.21.15.79:0/3330319449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a040d58b0 con 0x7f5a040d5460 2021-04-09T18:26:51.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f59ebfff700 1 -- 172.21.15.79:0/3330319449 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59f4010040 con 0x7f5a040d5460 2021-04-09T18:26:51.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.226 7f5a0a14f700 1 -- 172.21.15.79:0/3330319449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a040b44c0 con 0x7f5a040d5460 2021-04-09T18:26:51.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.230 7f59ebfff700 1 -- 172.21.15.79:0/3330319449 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f59f4012070 con 0x7f5a040d5460 2021-04-09T18:26:51.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.230 7f59ebfff700 1 --2- 172.21.15.79:0/3330319449 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f59e4029100 0x7f59e402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.230 7f59ebfff700 1 -- 172.21.15.79:0/3330319449 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f59f4011040 con 0x7f5a040d5460 2021-04-09T18:26:51.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.230 7f5a02ffd700 1 --2- 172.21.15.79:0/3330319449 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f59e4029100 0x7f59e402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.230 7f5a02ffd700 1 --2- 172.21.15.79:0/3330319449 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f59e4029100 0x7f59e402b650 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:51.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.246 7f5a0a14f700 1 -- 172.21.15.79:0/3330319449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a040e39e0 con 0x7f5a040d5460 2021-04-09T18:26:51.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.254 7f59ebfff700 1 -- 172.21.15.79:0/3330319449 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f59f400fd50 con 0x7f5a040d5460 2021-04-09T18:26:51.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.418 7f5a0a14f700 1 -- 172.21.15.79:0/3330319449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5a040f5b20 con 0x7f5a040d5460 2021-04-09T18:26:51.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.418 7f59ebfff700 1 -- 172.21.15.79:0/3330319449 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+5627 (secure 0 0 0) 0x7f59f402c610 con 0x7f5a040d5460 2021-04-09T18:26:51.428 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:51.428 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:26:51.428 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2021-04-09T18:26:51.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.429 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2021-04-09T18:26:51.429 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgovEoMhAAbDfArG3lSFAdk80rS/4iEQ==", 2021-04-09T18:26:51.429 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.429 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:26:51.429 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:26:51.430 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:26:51.430 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:26:51.430 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.431 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2021-04-09T18:26:51.431 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgN4sfOBAAPjvDX11uLM+vgdFpdP49Kw==", 2021-04-09T18:26:51.431 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.432 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:26:51.432 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:26:51.433 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:26:51.433 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:26:51.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.434 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2021-04-09T18:26:51.434 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQALnHBgro0COxAAgbe5jxAZH9bD7zDLbtdkhQ==", 2021-04-09T18:26:51.434 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.435 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:26:51.435 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:26:51.435 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:26:51.435 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.436 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2021-04-09T18:26:51.436 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAPnHBghZ/oARAAhkN+fnZJiskmHnvvs+G8NA==", 2021-04-09T18:26:51.436 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.437 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:26:51.437 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:26:51.437 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:26:51.437 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.438 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2021-04-09T18:26:51.438 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQASnHBgWT2FBxAACrSTbwbF18k9aPeYNohelw==", 2021-04-09T18:26:51.438 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.439 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:26:51.439 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:26:51.439 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:26:51.439 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.440 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2021-04-09T18:26:51.440 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAVnHBgPHy6CxAAFq+yki4AZe5ybodgTO/4/Q==", 2021-04-09T18:26:51.440 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.441 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:26:51.441 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:26:51.441 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:26:51.441 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.442 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2021-04-09T18:26:51.442 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAanHBgfbs4NhAAQzxM9dDML4RgQP8yamkuVw==", 2021-04-09T18:26:51.442 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.442 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:26:51.443 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:26:51.443 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:26:51.443 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.444 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2021-04-09T18:26:51.444 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAdnHBgi0WLOhAA4OBguOCjtmzqulUjTJ+GhQ==", 2021-04-09T18:26:51.444 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.444 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:26:51.445 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:26:51.445 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:26:51.445 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.446 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2021-04-09T18:26:51.446 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAhnHBgCs+PAxAAOm0wSMe/1Bu9vfTrpmrLkg==", 2021-04-09T18:26:51.446 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.446 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:26:51.446 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:26:51.447 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:26:51.447 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.447 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2021-04-09T18:26:51.448 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAknHBgH1S3CBAAUcdUIW7O6wH482l1yZBKBw==", 2021-04-09T18:26:51.448 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.448 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:26:51.448 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:26:51.449 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:26:51.449 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.449 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2021-04-09T18:26:51.450 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgxEq9BxAAap2nrjhcrf2aHzygtMclVw==", 2021-04-09T18:26:51.450 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.450 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:26:51.450 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2021-04-09T18:26:51.450 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2021-04-09T18:26:51.451 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2021-04-09T18:26:51.451 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.451 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2021-04-09T18:26:51.452 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBguJFeDRAAWL4NV4tsYRAqcwJ26kjm2Q==", 2021-04-09T18:26:51.452 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.452 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:26:51.452 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2021-04-09T18:26:51.453 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2021-04-09T18:26:51.453 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2021-04-09T18:26:51.453 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.454 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2021-04-09T18:26:51.454 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgN9X5EhAA3DBPdlRHVBHXJNH9nRFW0A==", 2021-04-09T18:26:51.454 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.454 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:26:51.455 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2021-04-09T18:26:51.455 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2021-04-09T18:26:51.455 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2021-04-09T18:26:51.455 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.456 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2021-04-09T18:26:51.456 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgHOSVDBAAMMqd8paqBSTQRgR7n4EXGQ==", 2021-04-09T18:26:51.457 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.457 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:26:51.457 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:26:51.457 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:26:51.457 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:26:51.458 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.458 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-mds", 2021-04-09T18:26:51.458 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAxnHBgjkqtBhAAeZ5Fzxd/Rb1oVqRa1BLDbw==", 2021-04-09T18:26:51.459 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.459 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-mds" 2021-04-09T18:26:51.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.460 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-mgr", 2021-04-09T18:26:51.460 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAxnHBgUVStBhAAq2nMEfbmm9UsFphaOyh8NA==", 2021-04-09T18:26:51.460 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.460 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-mgr" 2021-04-09T18:26:51.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.461 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-osd", 2021-04-09T18:26:51.461 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAxnHBgQmKtBhAA00wbmXD72FOoSAHcTPqFLg==", 2021-04-09T18:26:51.462 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.462 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-osd" 2021-04-09T18:26:51.462 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.463 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-rbd", 2021-04-09T18:26:51.463 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAxnHBggmqtBhAAXG979v5OaCXbSNZQZkQ/1Q==", 2021-04-09T18:26:51.463 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.464 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-rbd" 2021-04-09T18:26:51.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.464 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-rbd-mirror", 2021-04-09T18:26:51.465 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAxnHBgLXOtBhAAAfIzypQ/I0YOTSEB2fcajg==", 2021-04-09T18:26:51.465 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.465 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2021-04-09T18:26:51.465 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.466 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-rgw", 2021-04-09T18:26:51.466 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAxnHBgF3ytBhAA1kgdQk95D3sDAa7z9IYgrQ==", 2021-04-09T18:26:51.466 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.466 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-rgw" 2021-04-09T18:26:51.467 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.467 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2021-04-09T18:26:51.468 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgmHJhLxAAyhBrx08J7ZFKu34MYC2Wyg==", 2021-04-09T18:26:51.468 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.468 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:26:51.469 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:26:51.469 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:26:51.469 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:26:51.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:51.470 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2021-04-09T18:26:51.470 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgNCCXKhAA/bKOzzjVHldj6RpMGu0c8g==", 2021-04-09T18:26:51.470 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:26:51.470 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:26:51.470 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:26:51.471 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:26:51.471 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.471 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:51.472 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:26:51.472 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:26:51.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.422 7f5a0a14f700 1 -- 172.21.15.79:0/3330319449 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f59e4029100 msgr2=0x7f59e402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:51.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.422 7f5a0a14f700 1 --2- 172.21.15.79:0/3330319449 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f59e4029100 0x7f59e402b650 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.422 7f5a0a14f700 1 -- 172.21.15.79:0/3330319449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a040d5460 msgr2=0x7f5a041aded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:51.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.422 7f5a0a14f700 1 --2- 172.21.15.79:0/3330319449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a040d5460 0x7f5a041aded0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f59f400d000 tx=0x7f59f400f820).stop 2021-04-09T18:26:51.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.422 7f5a0a14f700 1 -- 172.21.15.79:0/3330319449 shutdown_connections 2021-04-09T18:26:51.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.422 7f5a0a14f700 1 --2- 172.21.15.79:0/3330319449 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f59e4029100 0x7f59e402b650 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.422 7f5a0a14f700 1 --2- 172.21.15.79:0/3330319449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a040c29f0 0x7f5a040c2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.422 7f5a0a14f700 1 --2- 172.21.15.79:0/3330319449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a040d5460 0x7f5a041aded0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.422 7f5a0a14f700 1 --2- 172.21.15.79:0/3330319449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a041ae500 0x7f5a041ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.422 7f5a0a14f700 1 -- 172.21.15.79:0/3330319449 >> 172.21.15.79:0/3330319449 conn(0x7f5a040c0460 msgr2=0x7f5a04095cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:51.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.422 7f5a0a14f700 1 -- 172.21.15.79:0/3330319449 shutdown_connections 2021-04-09T18:26:51.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.422 7f5a0a14f700 1 -- 172.21.15.79:0/3330319449 wait complete. 2021-04-09T18:26:51.477 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2021-04-09T18:26:51.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.558 7f326dc2c700 1 Processor -- start 2021-04-09T18:26:51.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.558 7f326dc2c700 1 -- start start 2021-04-09T18:26:51.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.558 7f326dc2c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f32680f5520 0x7f32680f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.558 7f326dc2c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32681c8010 0x7f32681ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.558 7f326dc2c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32680fbb20 con 0x7f32680e9ae0 2021-04-09T18:26:51.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.558 7f326dc2c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32680e9f30 con 0x7f32680f5520 2021-04-09T18:26:51.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.558 7f326dc2c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32681c3dc0 con 0x7f32681c8010 2021-04-09T18:26:51.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.558 7f3266ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f32680e9ae0 0x7f326809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51428/0 (socket says 172.21.15.79:51428) 2021-04-09T18:26:51.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.558 7f3266ffd700 1 -- 172.21.15.79:0/866641259 learned_addr learned my addr 172.21.15.79:0/866641259 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:51.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.558 7f3267fff700 1 --2- 172.21.15.79:0/866641259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32681c8010 0x7f32681ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.558 7f32677fe700 1 --2- 172.21.15.79:0/866641259 >> v2:172.21.15.89:3300/0 conn(0x7f32680f5520 0x7f32680f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.562 7f32667fc700 1 -- 172.21.15.79:0/866641259 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760185266 0 0) 0x7f325c0010d0 con 0x7f32680e9ae0 2021-04-09T18:26:51.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.562 7f32667fc700 1 -- 172.21.15.79:0/866641259 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3250003240 con 0x7f32680e9ae0 2021-04-09T18:26:51.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.562 7f3267fff700 1 -- 172.21.15.79:0/866641259 >> v2:172.21.15.89:3300/0 conn(0x7f32680f5520 msgr2=0x7f32680f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:51.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.562 7f3267fff700 1 --2- 172.21.15.79:0/866641259 >> v2:172.21.15.89:3300/0 conn(0x7f32680f5520 0x7f32680f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.562 7f3267fff700 1 -- 172.21.15.79:0/866641259 >> v1:172.21.15.79:6789/0 conn(0x7f32680e9ae0 legacy=0x7f326809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:51.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.562 7f3267fff700 1 -- 172.21.15.79:0/866641259 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326809f910 con 0x7f32681c8010 2021-04-09T18:26:51.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.562 7f3267fff700 1 --2- 172.21.15.79:0/866641259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32681c8010 0x7f32681ca470 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3260002f30 tx=0x7f326000bcc0).ready entity=mon.2 client_cookie=f1f39e6d9a842f0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:51.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.562 7f32667fc700 1 -- 172.21.15.79:0/866641259 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f326809f910 con 0x7f32681c8010 2021-04-09T18:26:51.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.562 7f32667fc700 1 -- 172.21.15.79:0/866641259 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3260009800 con 0x7f32681c8010 2021-04-09T18:26:51.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.562 7f32667fc700 1 -- 172.21.15.79:0/866641259 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3260009bd0 con 0x7f32681c8010 2021-04-09T18:26:51.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.562 7f326dc2c700 1 -- 172.21.15.79:0/866641259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32681c8010 msgr2=0x7f32681ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:51.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.562 7f326dc2c700 1 --2- 172.21.15.79:0/866641259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32681c8010 0x7f32681ca470 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3260002f30 tx=0x7f326000bcc0).stop 2021-04-09T18:26:51.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.562 7f326dc2c700 1 -- 172.21.15.79:0/866641259 shutdown_connections 2021-04-09T18:26:51.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.562 7f326dc2c700 1 --2- 172.21.15.79:0/866641259 >> v2:172.21.15.89:3300/0 conn(0x7f32680f5520 0x7f32680f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.562 7f326dc2c700 1 --2- 172.21.15.79:0/866641259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32681c8010 0x7f32681ca470 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.562 7f326dc2c700 1 -- 172.21.15.79:0/866641259 >> 172.21.15.79:0/866641259 conn(0x7f32680e5fe0 msgr2=0x7f32680e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:51.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.562 7f326dc2c700 1 -- 172.21.15.79:0/866641259 shutdown_connections 2021-04-09T18:26:51.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.562 7f326dc2c700 1 -- 172.21.15.79:0/866641259 wait complete. 2021-04-09T18:26:51.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.566 7f326dc2c700 1 Processor -- start 2021-04-09T18:26:51.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.566 7f326dc2c700 1 -- start start 2021-04-09T18:26:51.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.566 7f326dc2c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32681a1470 0x7f32680982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.566 7f326dc2c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3268098900 0x7f32680d5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.566 7f326dc2c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32680d6120 0x7f32680ae190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.566 7f326dc2c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3268096d50 con 0x7f3268098900 2021-04-09T18:26:51.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.566 7f326dc2c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3268096270 con 0x7f32680d6120 2021-04-09T18:26:51.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.566 7f326dc2c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32680ae7c0 con 0x7f32681a1470 2021-04-09T18:26:51.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.566 7f3266ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3268098900 0x7f32680d5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.566 7f3266ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3268098900 0x7f32680d5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56722/0 (socket says 172.21.15.79:56722) 2021-04-09T18:26:51.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.566 7f3266ffd700 1 -- 172.21.15.79:0/334427059 learned_addr learned my addr 172.21.15.79:0/334427059 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:51.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.566 7f32677fe700 1 --2- 172.21.15.79:0/334427059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32681a1470 0x7f32680982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.566 7f3267fff700 1 --2- 172.21.15.79:0/334427059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32680d6120 0x7f32680ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.566 7f3266ffd700 1 -- 172.21.15.79:0/334427059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32681a1470 msgr2=0x7f32680982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:51.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.566 7f3266ffd700 1 --2- 172.21.15.79:0/334427059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32681a1470 0x7f32680982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.570 7f3266ffd700 1 -- 172.21.15.79:0/334427059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32680d6120 msgr2=0x7f32680ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:51.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.570 7f3266ffd700 1 --2- 172.21.15.79:0/334427059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32680d6120 0x7f32680ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.570 7f3266ffd700 1 -- 172.21.15.79:0/334427059 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32680ae9f0 con 0x7f3268098900 2021-04-09T18:26:51.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.570 7f3266ffd700 1 --2- 172.21.15.79:0/334427059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3268098900 0x7f32680d5af0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f325c000b80 tx=0x7f325c00ca80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:51.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.570 7f324ffff700 1 -- 172.21.15.79:0/334427059 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f32680ae9f0 con 0x7f3268098900 2021-04-09T18:26:51.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.570 7f324ffff700 1 -- 172.21.15.79:0/334427059 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325c007320 con 0x7f3268098900 2021-04-09T18:26:51.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.570 7f324ffff700 1 -- 172.21.15.79:0/334427059 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f325c0057e0 con 0x7f3268098900 2021-04-09T18:26:51.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.570 7f326dc2c700 1 -- 172.21.15.79:0/334427059 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32680aecb0 con 0x7f3268098900 2021-04-09T18:26:51.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.570 7f326dc2c700 1 -- 172.21.15.79:0/334427059 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32680c4520 con 0x7f3268098900 2021-04-09T18:26:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.570 7f324ffff700 1 -- 172.21.15.79:0/334427059 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f325c01a060 con 0x7f3268098900 2021-04-09T18:26:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.570 7f324ffff700 1 --2- 172.21.15.79:0/334427059 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3248029100 0x7f324802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.570 7f324ffff700 1 -- 172.21.15.79:0/334427059 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f325c038960 con 0x7f3268098900 2021-04-09T18:26:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.570 7f32677fe700 1 --2- 172.21.15.79:0/334427059 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3248029100 0x7f324802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.570 7f32677fe700 1 --2- 172.21.15.79:0/334427059 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3248029100 0x7f324802b650 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:51.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.574 7f326dc2c700 1 -- 172.21.15.79:0/334427059 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32680e39e0 con 0x7f3268098900 2021-04-09T18:26:51.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.574 7f324ffff700 1 -- 172.21.15.79:0/334427059 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f325c007110 con 0x7f3268098900 2021-04-09T18:26:51.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.738 7f326dc2c700 1 -- 172.21.15.79:0/334427059 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f32680f5b20 con 0x7f3268098900 2021-04-09T18:26:51.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.742 7f324ffff700 1 -- 172.21.15.79:0/334427059 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v3) v1 ==== 97+0+0 (secure 0 0 0) 0x7f32680e5ca0 con 0x7f3268098900 2021-04-09T18:26:51.751 INFO:teuthology.orchestra.run.smithi079.stderr:updated 2021-04-09T18:26:51.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.750 7f326dc2c700 1 -- 172.21.15.79:0/334427059 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3248029100 msgr2=0x7f324802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:51.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.750 7f326dc2c700 1 --2- 172.21.15.79:0/334427059 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3248029100 0x7f324802b650 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.750 7f326dc2c700 1 -- 172.21.15.79:0/334427059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3268098900 msgr2=0x7f32680d5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:51.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.750 7f326dc2c700 1 --2- 172.21.15.79:0/334427059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3268098900 0x7f32680d5af0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f325c000b80 tx=0x7f325c00ca80).stop 2021-04-09T18:26:51.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.750 7f326dc2c700 1 -- 172.21.15.79:0/334427059 shutdown_connections 2021-04-09T18:26:51.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.750 7f326dc2c700 1 --2- 172.21.15.79:0/334427059 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3248029100 0x7f324802b650 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.750 7f326dc2c700 1 --2- 172.21.15.79:0/334427059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32680d6120 0x7f32680ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.750 7f326dc2c700 1 --2- 172.21.15.79:0/334427059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32681a1470 0x7f32680982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.750 7f326dc2c700 1 --2- 172.21.15.79:0/334427059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3268098900 0x7f32680d5af0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.750 7f326dc2c700 1 -- 172.21.15.79:0/334427059 >> 172.21.15.79:0/334427059 conn(0x7f32680afe00 msgr2=0x7f32680a6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:51.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.750 7f326dc2c700 1 -- 172.21.15.79:0/334427059 shutdown_connections 2021-04-09T18:26:51.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.750 7f326dc2c700 1 -- 172.21.15.79:0/334427059 wait complete. 2021-04-09T18:26:51.769 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2021-04-09T18:26:51.870 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.854 7ff1eb99a700 1 Processor -- start 2021-04-09T18:26:51.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.854 7ff1eb99a700 1 -- start start 2021-04-09T18:26:51.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.854 7ff1eb99a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1e40e9ae0 0x7ff1e409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.854 7ff1eb99a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e40fbb20 con 0x7ff1e40f5520 2021-04-09T18:26:51.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.854 7ff1eb99a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e40e56d0 con 0x7ff1e41c8010 2021-04-09T18:26:51.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.854 7ff1eb99a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e41c3dc0 con 0x7ff1e40e9ae0 2021-04-09T18:26:51.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.854 7ff1e973e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff1e40f5520 0x7ff1e40f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51440/0 (socket says 172.21.15.79:51440) 2021-04-09T18:26:51.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.854 7ff1e973e700 1 -- 172.21.15.79:0/3428292464 learned_addr learned my addr 172.21.15.79:0/3428292464 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:51.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.854 7ff1e8f3d700 1 --2- 172.21.15.79:0/3428292464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1e40e9ae0 0x7ff1e409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1dbfff700 1 -- 172.21.15.79:0/3428292464 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206946035 0 0) 0x7ff1e00010d0 con 0x7ff1e40f5520 2021-04-09T18:26:51.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1dbfff700 1 -- 172.21.15.79:0/3428292464 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1d0003240 con 0x7ff1e40f5520 2021-04-09T18:26:51.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1dbfff700 1 -- 172.21.15.79:0/3428292464 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3492264781 0 0) 0x7ff1e0001650 con 0x7ff1e40f5520 2021-04-09T18:26:51.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1dbfff700 1 -- 172.21.15.79:0/3428292464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1e40e9ae0 msgr2=0x7ff1e409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:51.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1dbfff700 1 --2- 172.21.15.79:0/3428292464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1e40e9ae0 0x7ff1e409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1dbfff700 1 -- 172.21.15.79:0/3428292464 >> v1:172.21.15.89:6789/0 conn(0x7ff1e41c8010 legacy=0x7ff1e41ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:51.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1dbfff700 1 -- 172.21.15.79:0/3428292464 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e40e4330 con 0x7ff1e40f5520 2021-04-09T18:26:51.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1dbfff700 1 -- 172.21.15.79:0/3428292464 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7ff1e0001bb0 con 0x7ff1e40f5520 2021-04-09T18:26:51.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1dbfff700 1 -- 172.21.15.79:0/3428292464 >> v1:172.21.15.79:6789/0 conn(0x7ff1e40f5520 legacy=0x7ff1e40f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:51.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1dbfff700 1 --2- 172.21.15.79:0/3428292464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1d00038f0 0x7ff1d0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1dbfff700 1 --2- 172.21.15.79:0/3428292464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1d00045a0 0x7ff1d00049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1dbfff700 1 --2- 172.21.15.79:0/3428292464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1d00097e0 0x7ff1d000bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1dbfff700 1 -- 172.21.15.79:0/3428292464 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e41c3dc0 con 0x7ff1d00038f0 2021-04-09T18:26:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1dbfff700 1 -- 172.21.15.79:0/3428292464 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d0005340 con 0x7ff1d00097e0 2021-04-09T18:26:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1dbfff700 1 -- 172.21.15.79:0/3428292464 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d0050280 con 0x7ff1d00045a0 2021-04-09T18:26:51.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1e8f3d700 1 --2- 172.21.15.79:0/3428292464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1d00045a0 0x7ff1d00049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1e973e700 1 --2- 172.21.15.79:0/3428292464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1d00038f0 0x7ff1d0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1e9f3f700 1 --2- 172.21.15.79:0/3428292464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1d00097e0 0x7ff1d000bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1e8f3d700 1 -- 172.21.15.79:0/3428292464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1d00097e0 msgr2=0x7ff1d000bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:51.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1e8f3d700 1 --2- 172.21.15.79:0/3428292464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1d00097e0 0x7ff1d000bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1e8f3d700 1 -- 172.21.15.79:0/3428292464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1d00038f0 msgr2=0x7ff1d0003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:51.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1e8f3d700 1 --2- 172.21.15.79:0/3428292464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1d00038f0 0x7ff1d0003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1e8f3d700 1 -- 172.21.15.79:0/3428292464 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d0050540 con 0x7ff1d00045a0 2021-04-09T18:26:51.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1e973e700 1 --2- 172.21.15.79:0/3428292464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1d00038f0 0x7ff1d0003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:51.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1e8f3d700 1 --2- 172.21.15.79:0/3428292464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1d00045a0 0x7ff1d00049f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff1d400c000 tx=0x7ff1d400bdb0).ready entity=mon.2 client_cookie=913ef80f3525c1dd server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1dbfff700 1 -- 172.21.15.79:0/3428292464 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff1d0050540 con 0x7ff1d00045a0 2021-04-09T18:26:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1dbfff700 1 -- 172.21.15.79:0/3428292464 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d400eb70 con 0x7ff1d00045a0 2021-04-09T18:26:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1dbfff700 1 -- 172.21.15.79:0/3428292464 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff1d400f040 con 0x7ff1d00045a0 2021-04-09T18:26:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1eb99a700 1 -- 172.21.15.79:0/3428292464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1d00045a0 msgr2=0x7ff1d00049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1eb99a700 1 --2- 172.21.15.79:0/3428292464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1d00045a0 0x7ff1d00049f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff1d400c000 tx=0x7ff1d400bdb0).stop 2021-04-09T18:26:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1e9f3f700 1 -- 172.21.15.79:0/3428292464 reap_dead start 2021-04-09T18:26:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1eb99a700 1 -- 172.21.15.79:0/3428292464 shutdown_connections 2021-04-09T18:26:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1eb99a700 1 -- 172.21.15.79:0/3428292464 >> 172.21.15.79:0/3428292464 conn(0x7ff1e40e5fe0 msgr2=0x7ff1e40e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1eb99a700 1 -- 172.21.15.79:0/3428292464 shutdown_connections 2021-04-09T18:26:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.858 7ff1eb99a700 1 -- 172.21.15.79:0/3428292464 wait complete. 2021-04-09T18:26:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.862 7ff1eb99a700 1 Processor -- start 2021-04-09T18:26:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.862 7ff1eb99a700 1 -- start start 2021-04-09T18:26:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.862 7ff1eb99a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1e40c1130 0x7ff1e4097930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.862 7ff1eb99a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1e4096850 0x7ff1e4098530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.862 7ff1eb99a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1e4098b60 0x7ff1e41ad350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.862 7ff1eb99a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e0001150 con 0x7ff1e4098b60 2021-04-09T18:26:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.862 7ff1eb99a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40e9f30 con 0x7ff1e40c1130 2021-04-09T18:26:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.862 7ff1eb99a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e4098230 con 0x7ff1e4096850 2021-04-09T18:26:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1e8f3d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1e4096850 0x7ff1e4098530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1e9f3f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1e4098b60 0x7ff1e41ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1e973e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1e40c1130 0x7ff1e4097930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1e8f3d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1e4096850 0x7ff1e4098530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:53738/0 (socket says 172.21.15.79:53738) 2021-04-09T18:26:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1e8f3d700 1 -- 172.21.15.79:0/3281066841 learned_addr learned my addr 172.21.15.79:0/3281066841 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1e973e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1e40c1130 0x7ff1e4097930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:45084/0 (socket says 172.21.15.79:45084) 2021-04-09T18:26:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1e973e700 1 -- 172.21.15.79:0/3281066841 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1e4096850 msgr2=0x7ff1e4098530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1e973e700 1 --2- 172.21.15.79:0/3281066841 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1e4096850 0x7ff1e4098530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1e973e700 1 -- 172.21.15.79:0/3281066841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1e4098b60 msgr2=0x7ff1e41ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1e973e700 1 --2- 172.21.15.79:0/3281066841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1e4098b60 0x7ff1e41ad350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1e973e700 1 -- 172.21.15.79:0/3281066841 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e4099250 con 0x7ff1e40c1130 2021-04-09T18:26:51.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1e9f3f700 1 --2- 172.21.15.79:0/3281066841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1e4098b60 0x7ff1e41ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:51.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1e973e700 1 --2- 172.21.15.79:0/3281066841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1e40c1130 0x7ff1e4097930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7ff1e0007870 tx=0x7ff1e000c750).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:51.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1d9ffb700 1 -- 172.21.15.79:0/3281066841 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff1e4099250 con 0x7ff1e40c1130 2021-04-09T18:26:51.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1d9ffb700 1 -- 172.21.15.79:0/3281066841 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e0014400 con 0x7ff1e40c1130 2021-04-09T18:26:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1eb99a700 1 -- 172.21.15.79:0/3281066841 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e41ad980 con 0x7ff1e40c1130 2021-04-09T18:26:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1d9ffb700 1 -- 172.21.15.79:0/3281066841 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff1e0010040 con 0x7ff1e40c1130 2021-04-09T18:26:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1eb99a700 1 -- 172.21.15.79:0/3281066841 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e4096e30 con 0x7ff1e40c1130 2021-04-09T18:26:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1d9ffb700 1 -- 172.21.15.79:0/3281066841 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff1e001b060 con 0x7ff1e40c1130 2021-04-09T18:26:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1d9ffb700 1 --2- 172.21.15.79:0/3281066841 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff1c4029100 0x7ff1c402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:51.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1d9ffb700 1 -- 172.21.15.79:0/3281066841 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5104+0+0 (secure 0 0 0) 0x7ff1e0011040 con 0x7ff1e40c1130 2021-04-09T18:26:51.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.866 7ff1e8f3d700 1 --2- 172.21.15.79:0/3281066841 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff1c4029100 0x7ff1c402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:51.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.870 7ff1e8f3d700 1 --2- 172.21.15.79:0/3281066841 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff1c4029100 0x7ff1c402b650 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:51.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.882 7ff1eb99a700 1 -- 172.21.15.79:0/3281066841 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e40e39e0 con 0x7ff1e40c1130 2021-04-09T18:26:51.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:51.894 7ff1d9ffb700 1 -- 172.21.15.79:0/3281066841 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff1e000cdb0 con 0x7ff1e40c1130 2021-04-09T18:26:52.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.058 7ff1eb99a700 1 -- 172.21.15.79:0/3281066841 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7ff1e40f5b20 con 0x7ff1e40c1130 2021-04-09T18:26:52.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.066 7ff1d9ffb700 1 -- 172.21.15.79:0/3281066841 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v4) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff1e0000bf0 con 0x7ff1e40c1130 2021-04-09T18:26:52.074 INFO:teuthology.orchestra.run.smithi079.stderr:updated 2021-04-09T18:26:52.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.070 7ff1eb99a700 1 -- 172.21.15.79:0/3281066841 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff1c4029100 msgr2=0x7ff1c402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:52.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.070 7ff1eb99a700 1 --2- 172.21.15.79:0/3281066841 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff1c4029100 0x7ff1c402b650 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.070 7ff1eb99a700 1 -- 172.21.15.79:0/3281066841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1e40c1130 msgr2=0x7ff1e4097930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:52.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.070 7ff1eb99a700 1 --2- 172.21.15.79:0/3281066841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1e40c1130 0x7ff1e4097930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7ff1e0007870 tx=0x7ff1e000c750).stop 2021-04-09T18:26:52.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.070 7ff1eb99a700 1 -- 172.21.15.79:0/3281066841 shutdown_connections 2021-04-09T18:26:52.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.070 7ff1eb99a700 1 --2- 172.21.15.79:0/3281066841 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff1c4029100 0x7ff1c402b650 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.070 7ff1eb99a700 1 --2- 172.21.15.79:0/3281066841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1e40c1130 0x7ff1e4097930 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.070 7ff1eb99a700 1 --2- 172.21.15.79:0/3281066841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1e4098b60 0x7ff1e41ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.070 7ff1eb99a700 1 --2- 172.21.15.79:0/3281066841 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1e4096850 0x7ff1e4098530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.070 7ff1eb99a700 1 -- 172.21.15.79:0/3281066841 >> 172.21.15.79:0/3281066841 conn(0x7ff1e40998e0 msgr2=0x7ff1e40c0460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:52.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.070 7ff1eb99a700 1 -- 172.21.15.79:0/3281066841 shutdown_connections 2021-04-09T18:26:52.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.070 7ff1eb99a700 1 -- 172.21.15.79:0/3281066841 wait complete. 2021-04-09T18:26:52.090 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2021-04-09T18:26:52.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c71b2d700 1 Processor -- start 2021-04-09T18:26:52.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c71b2d700 1 -- start start 2021-04-09T18:26:52.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c71b2d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5c6c0f5520 0x7f5c6c0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:52.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c71b2d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c6c1c8010 0x7f5c6c1ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:52.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c71b2d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c6c0fbb20 con 0x7f5c6c0e9ae0 2021-04-09T18:26:52.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c71b2d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c6c0e9f30 con 0x7f5c6c0f5520 2021-04-09T18:26:52.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c71b2d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c1c3dc0 con 0x7f5c6c1c8010 2021-04-09T18:26:52.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c6b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5c6c0f5520 0x7f5c6c0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:52.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c6bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c6c1c8010 0x7f5c6c1ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:52.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c6affd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5c6c0e9ae0 0x7f5c6c09f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:51932/0 (socket says 172.21.15.79:51932) 2021-04-09T18:26:52.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c6b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5c6c0f5520 0x7f5c6c0f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56750/0 (socket says 172.21.15.79:56750) 2021-04-09T18:26:52.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c6affd700 1 -- 172.21.15.79:0/3778000913 learned_addr learned my addr 172.21.15.79:0/3778000913 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:52.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c6a7fc700 1 -- 172.21.15.79:0/3778000913 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726526137 0 0) 0x7f5c600010d0 con 0x7f5c6c0e9ae0 2021-04-09T18:26:52.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c6a7fc700 1 -- 172.21.15.79:0/3778000913 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c54003240 con 0x7f5c6c0e9ae0 2021-04-09T18:26:52.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c6b7fe700 1 -- 172.21.15.79:0/3778000913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c6c1c8010 msgr2=0x7f5c6c1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:52.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c6b7fe700 1 --2- 172.21.15.79:0/3778000913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c6c1c8010 0x7f5c6c1ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c6b7fe700 1 -- 172.21.15.79:0/3778000913 >> v1:172.21.15.89:6789/0 conn(0x7f5c6c0e9ae0 legacy=0x7f5c6c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:52.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c6b7fe700 1 -- 172.21.15.79:0/3778000913 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c09f910 con 0x7f5c6c0f5520 2021-04-09T18:26:52.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c6bfff700 1 --2- 172.21.15.79:0/3778000913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c6c1c8010 0x7f5c6c1ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:52.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c6b7fe700 1 --2- 172.21.15.79:0/3778000913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c6c0f5520 0x7f5c6c0f64b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f5c6c0f6f00 tx=0x7f5c5c00bd70).ready entity=mon.0 client_cookie=f1736dcd5c91afb5 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:52.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c6a7fc700 1 -- 172.21.15.79:0/3778000913 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5c6c09f910 con 0x7f5c6c0f5520 2021-04-09T18:26:52.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c6a7fc700 1 -- 172.21.15.79:0/3778000913 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5c009810 con 0x7f5c6c0f5520 2021-04-09T18:26:52.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c6a7fc700 1 -- 172.21.15.79:0/3778000913 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5c5c009be0 con 0x7f5c6c0f5520 2021-04-09T18:26:52.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c71b2d700 1 -- 172.21.15.79:0/3778000913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c6c0f5520 msgr2=0x7f5c6c0f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:52.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.182 7f5c71b2d700 1 --2- 172.21.15.79:0/3778000913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c6c0f5520 0x7f5c6c0f64b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f5c6c0f6f00 tx=0x7f5c5c00bd70).stop 2021-04-09T18:26:52.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.186 7f5c71b2d700 1 -- 172.21.15.79:0/3778000913 shutdown_connections 2021-04-09T18:26:52.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.186 7f5c71b2d700 1 --2- 172.21.15.79:0/3778000913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c6c1c8010 0x7f5c6c1ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.186 7f5c71b2d700 1 --2- 172.21.15.79:0/3778000913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c6c0f5520 0x7f5c6c0f64b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.186 7f5c71b2d700 1 -- 172.21.15.79:0/3778000913 >> 172.21.15.79:0/3778000913 conn(0x7f5c6c0e5fe0 msgr2=0x7f5c6c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:52.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.186 7f5c71b2d700 1 -- 172.21.15.79:0/3778000913 shutdown_connections 2021-04-09T18:26:52.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.186 7f5c71b2d700 1 -- 172.21.15.79:0/3778000913 wait complete. 2021-04-09T18:26:52.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.186 7f5c71b2d700 1 Processor -- start 2021-04-09T18:26:52.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.186 7f5c71b2d700 1 -- start start 2021-04-09T18:26:52.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c71b2d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c6c0ac270 0x7f5c6c0afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:52.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c71b2d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c6c0c3230 0x7f5c6c0d4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:52.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c71b2d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c6c0c3680 0x7f5c6c0ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:52.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c71b2d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c0ac9e0 con 0x7f5c6c0c3680 2021-04-09T18:26:52.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c71b2d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c0acce0 con 0x7f5c6c0c3230 2021-04-09T18:26:52.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c71b2d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c0ac6c0 con 0x7f5c6c0ac270 2021-04-09T18:26:52.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c6bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c6c0c3680 0x7f5c6c0ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:52.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c6bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c6c0c3680 0x7f5c6c0ae260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56758/0 (socket says 172.21.15.79:56758) 2021-04-09T18:26:52.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c6bfff700 1 -- 172.21.15.79:0/3884446068 learned_addr learned my addr 172.21.15.79:0/3884446068 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:52.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c6affd700 1 --2- 172.21.15.79:0/3884446068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c6c0c3230 0x7f5c6c0d4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:52.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c6b7fe700 1 --2- 172.21.15.79:0/3884446068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c6c0ac270 0x7f5c6c0afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:52.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c6bfff700 1 -- 172.21.15.79:0/3884446068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c6c0ac270 msgr2=0x7f5c6c0afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:52.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c6bfff700 1 --2- 172.21.15.79:0/3884446068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c6c0ac270 0x7f5c6c0afc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c6bfff700 1 -- 172.21.15.79:0/3884446068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c6c0c3230 msgr2=0x7f5c6c0d4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:52.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c6bfff700 1 --2- 172.21.15.79:0/3884446068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c6c0c3230 0x7f5c6c0d4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c6bfff700 1 -- 172.21.15.79:0/3884446068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c0d5180 con 0x7f5c6c0c3680 2021-04-09T18:26:52.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c6b7fe700 1 --2- 172.21.15.79:0/3884446068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c6c0ac270 0x7f5c6c0afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:26:52.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c6bfff700 1 --2- 172.21.15.79:0/3884446068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c6c0c3680 0x7f5c6c0ae260 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f5c64009fc0 tx=0x7f5c6400c570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:52.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c53fff700 1 -- 172.21.15.79:0/3884446068 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5c6c0d5180 con 0x7f5c6c0c3680 2021-04-09T18:26:52.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c53fff700 1 -- 172.21.15.79:0/3884446068 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6400ce40 con 0x7f5c6c0c3680 2021-04-09T18:26:52.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c53fff700 1 -- 172.21.15.79:0/3884446068 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5c6400f040 con 0x7f5c6c0c3680 2021-04-09T18:26:52.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c71b2d700 1 -- 172.21.15.79:0/3884446068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c6c0d54a0 con 0x7f5c6c0c3680 2021-04-09T18:26:52.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c71b2d700 1 -- 172.21.15.79:0/3884446068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6c0ae890 con 0x7f5c6c0c3680 2021-04-09T18:26:52.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c53fff700 1 -- 172.21.15.79:0/3884446068 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5c64022060 con 0x7f5c6c0c3680 2021-04-09T18:26:52.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c53fff700 1 --2- 172.21.15.79:0/3884446068 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5c4c029100 0x7f5c4c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:52.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c53fff700 1 -- 172.21.15.79:0/3884446068 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f5c64010040 con 0x7f5c6c0c3680 2021-04-09T18:26:52.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.190 7f5c6b7fe700 1 --2- 172.21.15.79:0/3884446068 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5c4c029100 0x7f5c4c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:52.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.194 7f5c6b7fe700 1 --2- 172.21.15.79:0/3884446068 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5c4c029100 0x7f5c4c02b650 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:52.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.194 7f5c71b2d700 1 -- 172.21.15.79:0/3884446068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6c0e39e0 con 0x7f5c6c0c3680 2021-04-09T18:26:52.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.202 7f5c53fff700 1 -- 172.21.15.79:0/3884446068 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5c6c0f76c0 con 0x7f5c6c0c3680 2021-04-09T18:26:52.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.370 7f5c71b2d700 1 -- 172.21.15.79:0/3884446068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f5c6c0f5b20 con 0x7f5c6c0c3680 2021-04-09T18:26:52.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.374 7f5c53fff700 1 -- 172.21.15.79:0/3884446068 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v5) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5c6400cc30 con 0x7f5c6c0c3680 2021-04-09T18:26:52.384 INFO:teuthology.orchestra.run.smithi079.stderr:updated 2021-04-09T18:26:52.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.378 7f5c71b2d700 1 -- 172.21.15.79:0/3884446068 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5c4c029100 msgr2=0x7f5c4c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.378 7f5c71b2d700 1 --2- 172.21.15.79:0/3884446068 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5c4c029100 0x7f5c4c02b650 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.378 7f5c71b2d700 1 -- 172.21.15.79:0/3884446068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c6c0c3680 msgr2=0x7f5c6c0ae260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:52.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.378 7f5c71b2d700 1 --2- 172.21.15.79:0/3884446068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c6c0c3680 0x7f5c6c0ae260 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f5c64009fc0 tx=0x7f5c6400c570).stop 2021-04-09T18:26:52.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.378 7f5c71b2d700 1 -- 172.21.15.79:0/3884446068 shutdown_connections 2021-04-09T18:26:52.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.378 7f5c71b2d700 1 --2- 172.21.15.79:0/3884446068 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5c4c029100 0x7f5c4c02b650 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.378 7f5c71b2d700 1 --2- 172.21.15.79:0/3884446068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c6c0c3680 0x7f5c6c0ae260 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.378 7f5c71b2d700 1 --2- 172.21.15.79:0/3884446068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c6c0ac270 0x7f5c6c0afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.378 7f5c71b2d700 1 --2- 172.21.15.79:0/3884446068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c6c0c3230 0x7f5c6c0d4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.378 7f5c71b2d700 1 -- 172.21.15.79:0/3884446068 >> 172.21.15.79:0/3884446068 conn(0x7f5c6c1a11d0 msgr2=0x7f5c6c099f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:52.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.382 7f5c71b2d700 1 -- 172.21.15.79:0/3884446068 shutdown_connections 2021-04-09T18:26:52.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.382 7f5c71b2d700 1 -- 172.21.15.79:0/3884446068 wait complete. 2021-04-09T18:26:52.398 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2021-04-09T18:26:52.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f5067820700 1 Processor -- start 2021-04-09T18:26:52.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f5067820700 1 -- start start 2021-04-09T18:26:52.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f5067820700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f50600f5520 0x7f50600f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:52.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f5067820700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f50601c8010 0x7f50601ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:52.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f5067820700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50600fbb20 con 0x7f50600e9ae0 2021-04-09T18:26:52.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f5067820700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50600e9f30 con 0x7f50600f5520 2021-04-09T18:26:52.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f5067820700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50601c3dc0 con 0x7f50601c8010 2021-04-09T18:26:52.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f5064dc3700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f50600e9ae0 0x7f506009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51474/0 (socket says 172.21.15.79:51474) 2021-04-09T18:26:52.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f50655c4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f50600f5520 0x7f50600f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:52.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f5064dc3700 1 -- 172.21.15.79:0/3269387799 learned_addr learned my addr 172.21.15.79:0/3269387799 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:52.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f5065dc5700 1 --2- 172.21.15.79:0/3269387799 >> v2:172.21.15.89:3300/0 conn(0x7f50601c8010 0x7f50601ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:52.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f50655c4700 1 -- 172.21.15.79:0/3269387799 >> v2:172.21.15.89:3300/0 conn(0x7f50601c8010 msgr2=0x7f50601ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:52.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f50655c4700 1 --2- 172.21.15.79:0/3269387799 >> v2:172.21.15.89:3300/0 conn(0x7f50601c8010 0x7f50601ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f50655c4700 1 -- 172.21.15.79:0/3269387799 >> v1:172.21.15.79:6789/0 conn(0x7f50600e9ae0 legacy=0x7f506009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:52.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f50655c4700 1 -- 172.21.15.79:0/3269387799 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506009f910 con 0x7f50600f5520 2021-04-09T18:26:52.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f5057fff700 1 -- 172.21.15.79:0/3269387799 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377350953 0 0) 0x7f50500010d0 con 0x7f50600e9ae0 2021-04-09T18:26:52.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f50655c4700 1 --2- 172.21.15.79:0/3269387799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50600f5520 0x7f50600f64b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f505c002f30 tx=0x7f505c00bd10).ready entity=mon.0 client_cookie=36846c8b05d33c66 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:52.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f5057fff700 1 -- 172.21.15.79:0/3269387799 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f506009f910 con 0x7f50600f5520 2021-04-09T18:26:52.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f5057fff700 1 -- 172.21.15.79:0/3269387799 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505c0098a0 con 0x7f50600f5520 2021-04-09T18:26:52.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f5057fff700 1 -- 172.21.15.79:0/3269387799 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f505c009c70 con 0x7f50600f5520 2021-04-09T18:26:52.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f5067820700 1 -- 172.21.15.79:0/3269387799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50600f5520 msgr2=0x7f50600f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:52.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.482 7f5067820700 1 --2- 172.21.15.79:0/3269387799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50600f5520 0x7f50600f64b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f505c002f30 tx=0x7f505c00bd10).stop 2021-04-09T18:26:52.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.486 7f5067820700 1 -- 172.21.15.79:0/3269387799 shutdown_connections 2021-04-09T18:26:52.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.486 7f5067820700 1 --2- 172.21.15.79:0/3269387799 >> v2:172.21.15.89:3300/0 conn(0x7f50601c8010 0x7f50601ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.486 7f5067820700 1 --2- 172.21.15.79:0/3269387799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50600f5520 0x7f50600f64b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.486 7f5067820700 1 -- 172.21.15.79:0/3269387799 >> 172.21.15.79:0/3269387799 conn(0x7f50600e5fe0 msgr2=0x7f50600e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:52.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.486 7f5067820700 1 -- 172.21.15.79:0/3269387799 shutdown_connections 2021-04-09T18:26:52.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.486 7f5067820700 1 -- 172.21.15.79:0/3269387799 wait complete. 2021-04-09T18:26:52.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5067820700 1 Processor -- start 2021-04-09T18:26:52.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5067820700 1 -- start start 2021-04-09T18:26:52.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5067820700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50600bbb30 0x7f50601ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:52.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5067820700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50601adb80 0x7f5060098470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:52.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5067820700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5060098aa0 0x7f50600bc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:52.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5067820700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5060098170 con 0x7f5060098aa0 2021-04-09T18:26:52.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5067820700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5060097a00 con 0x7f50601adb80 2021-04-09T18:26:52.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5067820700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50600bbf80 con 0x7f50600bbb30 2021-04-09T18:26:52.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5065dc5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5060098aa0 0x7f50600bc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:52.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5065dc5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5060098aa0 0x7f50600bc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56774/0 (socket says 172.21.15.79:56774) 2021-04-09T18:26:52.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f50655c4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50600bbb30 0x7f50601ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:52.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5064dc3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50601adb80 0x7f5060098470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:52.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5065dc5700 1 -- 172.21.15.79:0/4197618165 learned_addr learned my addr 172.21.15.79:0/4197618165 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:52.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5065dc5700 1 -- 172.21.15.79:0/4197618165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50600bbb30 msgr2=0x7f50601ad550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:52.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5065dc5700 1 --2- 172.21.15.79:0/4197618165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50600bbb30 0x7f50601ad550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5065dc5700 1 -- 172.21.15.79:0/4197618165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50601adb80 msgr2=0x7f5060098470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:52.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5065dc5700 1 --2- 172.21.15.79:0/4197618165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50601adb80 0x7f5060098470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5065dc5700 1 -- 172.21.15.79:0/4197618165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50600bc8c0 con 0x7f5060098aa0 2021-04-09T18:26:52.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5065dc5700 1 --2- 172.21.15.79:0/4197618165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5060098aa0 0x7f50600bc290 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f5058006de0 tx=0x7f505800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:52.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5055ffb700 1 -- 172.21.15.79:0/4197618165 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f50600bc8c0 con 0x7f5060098aa0 2021-04-09T18:26:52.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5055ffb700 1 -- 172.21.15.79:0/4197618165 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505800cca0 con 0x7f5060098aa0 2021-04-09T18:26:52.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5055ffb700 1 -- 172.21.15.79:0/4197618165 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f505800f040 con 0x7f5060098aa0 2021-04-09T18:26:52.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5067820700 1 -- 172.21.15.79:0/4197618165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50600bcac0 con 0x7f5060098aa0 2021-04-09T18:26:52.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.490 7f5067820700 1 -- 172.21.15.79:0/4197618165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50600b0a20 con 0x7f5060098aa0 2021-04-09T18:26:52.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.494 7f5055ffb700 1 -- 172.21.15.79:0/4197618165 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5058022060 con 0x7f5060098aa0 2021-04-09T18:26:52.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.494 7f5055ffb700 1 --2- 172.21.15.79:0/4197618165 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5040029100 0x7f504002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:52.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.494 7f5055ffb700 1 -- 172.21.15.79:0/4197618165 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f5058010040 con 0x7f5060098aa0 2021-04-09T18:26:52.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.494 7f50655c4700 1 --2- 172.21.15.79:0/4197618165 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5040029100 0x7f504002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:52.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.494 7f50655c4700 1 --2- 172.21.15.79:0/4197618165 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5040029100 0x7f504002b650 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:52.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.494 7f5067820700 1 -- 172.21.15.79:0/4197618165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50600e39e0 con 0x7f5060098aa0 2021-04-09T18:26:52.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.502 7f5055ffb700 1 -- 172.21.15.79:0/4197618165 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f505800ca90 con 0x7f5060098aa0 2021-04-09T18:26:52.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.658 7f5067820700 1 -- 172.21.15.79:0/4197618165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f50600a1cc0 con 0x7f5060098aa0 2021-04-09T18:26:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.666 7f5055ffb700 1 -- 172.21.15.79:0/4197618165 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v6) v1 ==== 97+0+0 (secure 0 0 0) 0x7f50600f76c0 con 0x7f5060098aa0 2021-04-09T18:26:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:updated 2021-04-09T18:26:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.670 7f5067820700 1 -- 172.21.15.79:0/4197618165 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5040029100 msgr2=0x7f504002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.670 7f5067820700 1 --2- 172.21.15.79:0/4197618165 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5040029100 0x7f504002b650 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.670 7f5067820700 1 -- 172.21.15.79:0/4197618165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5060098aa0 msgr2=0x7f50600bc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:52.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.670 7f5067820700 1 --2- 172.21.15.79:0/4197618165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5060098aa0 0x7f50600bc290 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f5058006de0 tx=0x7f505800c430).stop 2021-04-09T18:26:52.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.670 7f5067820700 1 -- 172.21.15.79:0/4197618165 shutdown_connections 2021-04-09T18:26:52.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.670 7f5067820700 1 --2- 172.21.15.79:0/4197618165 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5040029100 0x7f504002b650 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.670 7f5067820700 1 --2- 172.21.15.79:0/4197618165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5060098aa0 0x7f50600bc290 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.670 7f5067820700 1 --2- 172.21.15.79:0/4197618165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50600bbb30 0x7f50601ad550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.670 7f5067820700 1 --2- 172.21.15.79:0/4197618165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50601adb80 0x7f5060098470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.670 7f5067820700 1 -- 172.21.15.79:0/4197618165 >> 172.21.15.79:0/4197618165 conn(0x7f506009ace0 msgr2=0x7f506009a240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:52.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.670 7f5067820700 1 -- 172.21.15.79:0/4197618165 shutdown_connections 2021-04-09T18:26:52.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.670 7f5067820700 1 -- 172.21.15.79:0/4197618165 wait complete. 2021-04-09T18:26:52.685 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2021-04-09T18:26:52.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.774 7f19320f4700 1 Processor -- start 2021-04-09T18:26:52.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.774 7f19320f4700 1 -- start start 2021-04-09T18:26:52.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f19320f4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f192c0f5520 0x7f192c0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:52.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f19320f4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f192c1c8010 0x7f192c1ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:52.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f19320f4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192c0fbb20 con 0x7f192c0e9ae0 2021-04-09T18:26:52.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f19320f4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192c0e9f30 con 0x7f192c0f5520 2021-04-09T18:26:52.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f19320f4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192c1c3dc0 con 0x7f192c1c8010 2021-04-09T18:26:52.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f192b7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f192c0f5520 0x7f192c0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:52.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f192b7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f192c0f5520 0x7f192c0f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:45122/0 (socket says 172.21.15.79:45122) 2021-04-09T18:26:52.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f192b7fe700 1 -- 172.21.15.79:0/2157197866 learned_addr learned my addr 172.21.15.79:0/2157197866 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:52.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f192affd700 1 --1- 172.21.15.79:0/2157197866 >> v1:172.21.15.89:6789/0 conn(0x7f192c0e9ae0 0x7f192c09f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:51958/0 (socket says 172.21.15.79:51958) 2021-04-09T18:26:52.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f192bfff700 1 --2- 172.21.15.79:0/2157197866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f192c1c8010 0x7f192c1ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:52.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f192b7fe700 1 -- 172.21.15.79:0/2157197866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f192c1c8010 msgr2=0x7f192c1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:52.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f192b7fe700 1 --2- 172.21.15.79:0/2157197866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f192c1c8010 0x7f192c1ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f192b7fe700 1 -- 172.21.15.79:0/2157197866 >> v1:172.21.15.89:6789/0 conn(0x7f192c0e9ae0 legacy=0x7f192c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:52.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f192b7fe700 1 -- 172.21.15.79:0/2157197866 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c09f910 con 0x7f192c0f5520 2021-04-09T18:26:52.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f192b7fe700 1 --2- 172.21.15.79:0/2157197866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f192c0f5520 0x7f192c0f64b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f192c0f6f00 tx=0x7f191400bdd0).ready entity=mon.1 client_cookie=819f521b7f141ef4 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:52.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f192a7fc700 1 -- 172.21.15.79:0/2157197866 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f192c09f910 con 0x7f192c0f5520 2021-04-09T18:26:52.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f192a7fc700 1 -- 172.21.15.79:0/2157197866 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1914009990 con 0x7f192c0f5520 2021-04-09T18:26:52.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f192a7fc700 1 -- 172.21.15.79:0/2157197866 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1914009d60 con 0x7f192c0f5520 2021-04-09T18:26:52.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f19320f4700 1 -- 172.21.15.79:0/2157197866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f192c0f5520 msgr2=0x7f192c0f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:52.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f19320f4700 1 --2- 172.21.15.79:0/2157197866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f192c0f5520 0x7f192c0f64b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f192c0f6f00 tx=0x7f191400bdd0).stop 2021-04-09T18:26:52.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f19320f4700 1 -- 172.21.15.79:0/2157197866 shutdown_connections 2021-04-09T18:26:52.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f19320f4700 1 --2- 172.21.15.79:0/2157197866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f192c1c8010 0x7f192c1ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f19320f4700 1 --2- 172.21.15.79:0/2157197866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f192c0f5520 0x7f192c0f64b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f19320f4700 1 -- 172.21.15.79:0/2157197866 >> 172.21.15.79:0/2157197866 conn(0x7f192c0e5fe0 msgr2=0x7f192c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:52.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f19320f4700 1 -- 172.21.15.79:0/2157197866 shutdown_connections 2021-04-09T18:26:52.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.778 7f19320f4700 1 -- 172.21.15.79:0/2157197866 wait complete. 2021-04-09T18:26:52.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.782 7f19320f4700 1 Processor -- start 2021-04-09T18:26:52.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.782 7f19320f4700 1 -- start start 2021-04-09T18:26:52.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.782 7f19320f4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f192c09a4c0 0x7f192c0a7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:52.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.782 7f19320f4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f192c0d0160 0x7f192c0d6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:52.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.782 7f19320f4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f192c0d05b0 0x7f192c0d7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:52.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.782 7f19320f4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192c09b2b0 con 0x7f192c0d0160 2021-04-09T18:26:52.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.782 7f19320f4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192c0b9d70 con 0x7f192c09a4c0 2021-04-09T18:26:52.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.782 7f19320f4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192c0a8a90 con 0x7f192c0d05b0 2021-04-09T18:26:52.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.782 7f192affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f192c0d0160 0x7f192c0d6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:52.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.782 7f192affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f192c0d0160 0x7f192c0d6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56784/0 (socket says 172.21.15.79:56784) 2021-04-09T18:26:52.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.782 7f192affd700 1 -- 172.21.15.79:0/2289555733 learned_addr learned my addr 172.21.15.79:0/2289555733 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:52.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.782 7f192b7fe700 1 --2- 172.21.15.79:0/2289555733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f192c09a4c0 0x7f192c0a7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:52.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.782 7f192bfff700 1 --2- 172.21.15.79:0/2289555733 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f192c0d05b0 0x7f192c0d7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:52.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.782 7f192affd700 1 -- 172.21.15.79:0/2289555733 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f192c0d05b0 msgr2=0x7f192c0d7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:52.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.782 7f192affd700 1 --2- 172.21.15.79:0/2289555733 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f192c0d05b0 0x7f192c0d7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.782 7f192affd700 1 -- 172.21.15.79:0/2289555733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f192c09a4c0 msgr2=0x7f192c0a7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:52.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.782 7f192affd700 1 --2- 172.21.15.79:0/2289555733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f192c09a4c0 0x7f192c0a7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.786 7f192affd700 1 -- 172.21.15.79:0/2289555733 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c0a8cc0 con 0x7f192c0d0160 2021-04-09T18:26:52.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.786 7f192affd700 1 --2- 172.21.15.79:0/2289555733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f192c0d0160 0x7f192c0d6d30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f1924000f00 tx=0x7f192400ce30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:52.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.786 7f1923fff700 1 -- 172.21.15.79:0/2289555733 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f192c0a8cc0 con 0x7f192c0d0160 2021-04-09T18:26:52.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.786 7f19320f4700 1 -- 172.21.15.79:0/2289555733 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192c0a8f80 con 0x7f192c0d0160 2021-04-09T18:26:52.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.786 7f1923fff700 1 -- 172.21.15.79:0/2289555733 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1924005ac0 con 0x7f192c0d0160 2021-04-09T18:26:52.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.786 7f1923fff700 1 -- 172.21.15.79:0/2289555733 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1924007110 con 0x7f192c0d0160 2021-04-09T18:26:52.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.786 7f19320f4700 1 -- 172.21.15.79:0/2289555733 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192c0a9350 con 0x7f192c0d0160 2021-04-09T18:26:52.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.786 7f1923fff700 1 -- 172.21.15.79:0/2289555733 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f192401a020 con 0x7f192c0d0160 2021-04-09T18:26:52.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.786 7f1923fff700 1 --2- 172.21.15.79:0/2289555733 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1904029100 0x7f190402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:52.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.786 7f1923fff700 1 -- 172.21.15.79:0/2289555733 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f19240391e0 con 0x7f192c0d0160 2021-04-09T18:26:52.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.786 7f192b7fe700 1 --2- 172.21.15.79:0/2289555733 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1904029100 0x7f190402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:52.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.786 7f192b7fe700 1 --2- 172.21.15.79:0/2289555733 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1904029100 0x7f190402b650 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:52.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.790 7f19320f4700 1 -- 172.21.15.79:0/2289555733 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192c0e39e0 con 0x7f192c0d0160 2021-04-09T18:26:52.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.798 7f1923fff700 1 -- 172.21.15.79:0/2289555733 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f19240058b0 con 0x7f192c0d0160 2021-04-09T18:26:52.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.958 7f19320f4700 1 -- 172.21.15.79:0/2289555733 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f192c0a1cc0 con 0x7f192c0d0160 2021-04-09T18:26:52.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.962 7f1923fff700 1 -- 172.21.15.79:0/2289555733 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1924000f70 con 0x7f192c0d0160 2021-04-09T18:26:52.973 INFO:teuthology.orchestra.run.smithi079.stderr:updated 2021-04-09T18:26:52.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.970 7f19320f4700 1 -- 172.21.15.79:0/2289555733 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1904029100 msgr2=0x7f190402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:52.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.970 7f19320f4700 1 --2- 172.21.15.79:0/2289555733 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1904029100 0x7f190402b650 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.970 7f19320f4700 1 -- 172.21.15.79:0/2289555733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f192c0d0160 msgr2=0x7f192c0d6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:52.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.970 7f19320f4700 1 --2- 172.21.15.79:0/2289555733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f192c0d0160 0x7f192c0d6d30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f1924000f00 tx=0x7f192400ce30).stop 2021-04-09T18:26:52.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.970 7f19320f4700 1 -- 172.21.15.79:0/2289555733 shutdown_connections 2021-04-09T18:26:52.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.970 7f19320f4700 1 --2- 172.21.15.79:0/2289555733 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1904029100 0x7f190402b650 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.970 7f19320f4700 1 --2- 172.21.15.79:0/2289555733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f192c09a4c0 0x7f192c0a7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.970 7f19320f4700 1 --2- 172.21.15.79:0/2289555733 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f192c0d05b0 0x7f192c0d7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.970 7f19320f4700 1 --2- 172.21.15.79:0/2289555733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f192c0d0160 0x7f192c0d6d30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:52.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.970 7f19320f4700 1 -- 172.21.15.79:0/2289555733 >> 172.21.15.79:0/2289555733 conn(0x7f192c0bb060 msgr2=0x7f192c093850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:52.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.970 7f19320f4700 1 -- 172.21.15.79:0/2289555733 shutdown_connections 2021-04-09T18:26:52.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:52.970 7f19320f4700 1 -- 172.21.15.79:0/2289555733 wait complete. 2021-04-09T18:26:52.989 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2021-04-09T18:26:53.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc3cdcd700 1 Processor -- start 2021-04-09T18:26:53.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc3cdcd700 1 -- start start 2021-04-09T18:26:53.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc3cdcd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbc380e9ae0 0x7fbc3809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc3cdcd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbc381c8010 0x7fbc381ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc3cdcd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc380fbb20 con 0x7fbc380f5520 2021-04-09T18:26:53.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc3cdcd700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc381c3dc0 con 0x7fbc380e9ae0 2021-04-09T18:26:53.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc3cdcd700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc380e9f30 con 0x7fbc381c8010 2021-04-09T18:26:53.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc362ee700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbc380e9ae0 0x7fbc3809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc372f0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbc381c8010 0x7fbc381ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc362ee700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbc380e9ae0 0x7fbc3809f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56796/0 (socket says 172.21.15.79:56796) 2021-04-09T18:26:53.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc372f0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbc381c8010 0x7fbc381ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:45134/0 (socket says 172.21.15.79:45134) 2021-04-09T18:26:53.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc362ee700 1 -- 172.21.15.79:0/3481225903 learned_addr learned my addr 172.21.15.79:0/3481225903 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc36aef700 1 --1- 172.21.15.79:0/3481225903 >> v1:172.21.15.89:6789/0 conn(0x7fbc380f5520 0x7fbc380f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:51974/0 (socket says 172.21.15.79:51974) 2021-04-09T18:26:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc362ee700 1 -- 172.21.15.79:0/3481225903 >> v2:172.21.15.89:3300/0 conn(0x7fbc381c8010 msgr2=0x7fbc381ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc362ee700 1 --2- 172.21.15.79:0/3481225903 >> v2:172.21.15.89:3300/0 conn(0x7fbc381c8010 0x7fbc381ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc362ee700 1 -- 172.21.15.79:0/3481225903 >> v1:172.21.15.89:6789/0 conn(0x7fbc380f5520 legacy=0x7fbc380f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc362ee700 1 -- 172.21.15.79:0/3481225903 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc380e56d0 con 0x7fbc380e9ae0 2021-04-09T18:26:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc372f0700 1 --2- 172.21.15.79:0/3481225903 >> v2:172.21.15.89:3300/0 conn(0x7fbc381c8010 0x7fbc381ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc362ee700 1 --2- 172.21.15.79:0/3481225903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc380e9ae0 0x7fbc3809f110 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fbc28002f30 tx=0x7fbc2800bd70).ready entity=mon.0 client_cookie=e115487ff443ec5e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc35aed700 1 -- 172.21.15.79:0/3481225903 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbc380e56d0 con 0x7fbc380e9ae0 2021-04-09T18:26:53.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc35aed700 1 -- 172.21.15.79:0/3481225903 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc28009950 con 0x7fbc380e9ae0 2021-04-09T18:26:53.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc35aed700 1 -- 172.21.15.79:0/3481225903 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbc28009d20 con 0x7fbc380e9ae0 2021-04-09T18:26:53.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc3cdcd700 1 -- 172.21.15.79:0/3481225903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc380e9ae0 msgr2=0x7fbc3809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.074 7fbc3cdcd700 1 --2- 172.21.15.79:0/3481225903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc380e9ae0 0x7fbc3809f110 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fbc28002f30 tx=0x7fbc2800bd70).stop 2021-04-09T18:26:53.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.078 7fbc3cdcd700 1 -- 172.21.15.79:0/3481225903 shutdown_connections 2021-04-09T18:26:53.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.078 7fbc3cdcd700 1 --2- 172.21.15.79:0/3481225903 >> v2:172.21.15.89:3300/0 conn(0x7fbc381c8010 0x7fbc381ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.078 7fbc3cdcd700 1 --2- 172.21.15.79:0/3481225903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc380e9ae0 0x7fbc3809f110 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.078 7fbc3cdcd700 1 -- 172.21.15.79:0/3481225903 >> 172.21.15.79:0/3481225903 conn(0x7fbc380e5fe0 msgr2=0x7fbc380e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:53.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.078 7fbc3cdcd700 1 -- 172.21.15.79:0/3481225903 shutdown_connections 2021-04-09T18:26:53.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.078 7fbc3cdcd700 1 -- 172.21.15.79:0/3481225903 wait complete. 2021-04-09T18:26:53.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.078 7fbc3cdcd700 1 Processor -- start 2021-04-09T18:26:53.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.078 7fbc3cdcd700 1 -- start start 2021-04-09T18:26:53.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.078 7fbc3cdcd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc380afad0 0x7fbc381ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.078 7fbc3cdcd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc381a2150 0x7fbc380aced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.078 7fbc3cdcd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc380d4ce0 0x7fbc381aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.078 7fbc3cdcd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380ae250 con 0x7fbc380afad0 2021-04-09T18:26:53.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.078 7fbc3cdcd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380ae550 con 0x7fbc381a2150 2021-04-09T18:26:53.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.078 7fbc3cdcd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380adae0 con 0x7fbc380d4ce0 2021-04-09T18:26:53.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.078 7fbc36aef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc380afad0 0x7fbc381ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.082 7fbc36aef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc380afad0 0x7fbc381ab6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56798/0 (socket says 172.21.15.79:56798) 2021-04-09T18:26:53.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.082 7fbc36aef700 1 -- 172.21.15.79:0/3347497182 learned_addr learned my addr 172.21.15.79:0/3347497182 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:53.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.082 7fbc362ee700 1 --2- 172.21.15.79:0/3347497182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc381a2150 0x7fbc380aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.082 7fbc372f0700 1 --2- 172.21.15.79:0/3347497182 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc380d4ce0 0x7fbc381aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.082 7fbc36aef700 1 -- 172.21.15.79:0/3347497182 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc380d4ce0 msgr2=0x7fbc381aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.082 7fbc36aef700 1 --2- 172.21.15.79:0/3347497182 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc380d4ce0 0x7fbc381aec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.082 7fbc36aef700 1 -- 172.21.15.79:0/3347497182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc381a2150 msgr2=0x7fbc380aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.082 7fbc36aef700 1 --2- 172.21.15.79:0/3347497182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc381a2150 0x7fbc380aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.082 7fbc36aef700 1 -- 172.21.15.79:0/3347497182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc380ad500 con 0x7fbc380afad0 2021-04-09T18:26:53.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.082 7fbc36aef700 1 --2- 172.21.15.79:0/3347497182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc380afad0 0x7fbc381ab6c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fbc380c1d80 tx=0x7fbc2c00cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:53.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.082 7fbc277fe700 1 -- 172.21.15.79:0/3347497182 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbc380ad500 con 0x7fbc380afad0 2021-04-09T18:26:53.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.082 7fbc3cdcd700 1 -- 172.21.15.79:0/3347497182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc380ade00 con 0x7fbc380afad0 2021-04-09T18:26:53.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.082 7fbc3cdcd700 1 -- 172.21.15.79:0/3347497182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc380d5130 con 0x7fbc380afad0 2021-04-09T18:26:53.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.082 7fbc277fe700 1 -- 172.21.15.79:0/3347497182 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2c007320 con 0x7fbc380afad0 2021-04-09T18:26:53.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.082 7fbc277fe700 1 -- 172.21.15.79:0/3347497182 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbc2c005720 con 0x7fbc380afad0 2021-04-09T18:26:53.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.082 7fbc277fe700 1 -- 172.21.15.79:0/3347497182 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fbc2c01a020 con 0x7fbc380afad0 2021-04-09T18:26:53.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.082 7fbc277fe700 1 --2- 172.21.15.79:0/3347497182 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbc1c029100 0x7fbc1c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.082 7fbc277fe700 1 -- 172.21.15.79:0/3347497182 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fbc2c038e30 con 0x7fbc380afad0 2021-04-09T18:26:53.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.082 7fbc362ee700 1 --2- 172.21.15.79:0/3347497182 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbc1c029100 0x7fbc1c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.086 7fbc362ee700 1 --2- 172.21.15.79:0/3347497182 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbc1c029100 0x7fbc1c02b650 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:53.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.086 7fbc3cdcd700 1 -- 172.21.15.79:0/3347497182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc380e39e0 con 0x7fbc380afad0 2021-04-09T18:26:53.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.098 7fbc277fe700 1 -- 172.21.15.79:0/3347497182 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fbc2c000bf0 con 0x7fbc380afad0 2021-04-09T18:26:53.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.266 7fbc3cdcd700 1 -- 172.21.15.79:0/3347497182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fbc380f5b20 con 0x7fbc380afad0 2021-04-09T18:26:53.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.270 7fbc277fe700 1 -- 172.21.15.79:0/3347497182 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbc2c007110 con 0x7fbc380afad0 2021-04-09T18:26:53.278 INFO:teuthology.orchestra.run.smithi079.stderr:updated 2021-04-09T18:26:53.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.274 7fbc3cdcd700 1 -- 172.21.15.79:0/3347497182 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbc1c029100 msgr2=0x7fbc1c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.274 7fbc3cdcd700 1 --2- 172.21.15.79:0/3347497182 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbc1c029100 0x7fbc1c02b650 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.274 7fbc3cdcd700 1 -- 172.21.15.79:0/3347497182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc380afad0 msgr2=0x7fbc381ab6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.274 7fbc3cdcd700 1 --2- 172.21.15.79:0/3347497182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc380afad0 0x7fbc381ab6c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fbc380c1d80 tx=0x7fbc2c00cae0).stop 2021-04-09T18:26:53.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.274 7fbc3cdcd700 1 -- 172.21.15.79:0/3347497182 shutdown_connections 2021-04-09T18:26:53.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.274 7fbc3cdcd700 1 --2- 172.21.15.79:0/3347497182 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbc1c029100 0x7fbc1c02b650 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.274 7fbc3cdcd700 1 --2- 172.21.15.79:0/3347497182 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc380d4ce0 0x7fbc381aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.274 7fbc3cdcd700 1 --2- 172.21.15.79:0/3347497182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc380afad0 0x7fbc381ab6c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.274 7fbc3cdcd700 1 --2- 172.21.15.79:0/3347497182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc381a2150 0x7fbc380aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.274 7fbc3cdcd700 1 -- 172.21.15.79:0/3347497182 >> 172.21.15.79:0/3347497182 conn(0x7fbc3809ae20 msgr2=0x7fbc380d7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:53.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.274 7fbc3cdcd700 1 -- 172.21.15.79:0/3347497182 shutdown_connections 2021-04-09T18:26:53.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.274 7fbc3cdcd700 1 -- 172.21.15.79:0/3347497182 wait complete. 2021-04-09T18:26:53.292 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:53.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae3e84700 1 Processor -- start 2021-04-09T18:26:53.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae3e84700 1 -- start start 2021-04-09T18:26:53.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae3e84700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6adc0f5510 0x7f6adc0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae3e84700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6adc0e9ad0 0x7f6adc09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae3e84700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6adc1c2da0 0x7f6adc1c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae3e84700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6adc0e9f20 con 0x7f6adc0e9ad0 2021-04-09T18:26:53.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae3e84700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6adc0e59c0 con 0x7f6adc1c2da0 2021-04-09T18:26:53.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae3e84700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0fbb10 con 0x7f6adc0f5510 2021-04-09T18:26:53.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae1427700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6adc0e9ad0 0x7f6adc09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae1427700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6adc0e9ad0 0x7f6adc09f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56808/0 (socket says 172.21.15.79:56808) 2021-04-09T18:26:53.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae1427700 1 -- 172.21.15.79:0/1849380370 learned_addr learned my addr 172.21.15.79:0/1849380370 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:53.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae2429700 1 --2- 172.21.15.79:0/1849380370 >> v2:172.21.15.89:3300/0 conn(0x7f6adc1c2da0 0x7f6adc1c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae1c28700 1 --2- 172.21.15.79:0/1849380370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6adc0f5510 0x7f6adc0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae1427700 1 -- 172.21.15.79:0/1849380370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6adc0f5510 msgr2=0x7f6adc0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:53.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae1427700 1 --2- 172.21.15.79:0/1849380370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6adc0f5510 0x7f6adc0f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae1427700 1 -- 172.21.15.79:0/1849380370 >> v2:172.21.15.89:3300/0 conn(0x7f6adc1c2da0 msgr2=0x7f6adc1c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:53.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae1427700 1 --2- 172.21.15.79:0/1849380370 >> v2:172.21.15.89:3300/0 conn(0x7f6adc1c2da0 0x7f6adc1c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae1427700 1 -- 172.21.15.79:0/1849380370 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc0e56c0 con 0x7f6adc0e9ad0 2021-04-09T18:26:53.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae1427700 1 --2- 172.21.15.79:0/1849380370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc0e9ad0 0x7f6adc09f100 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f6ac4002f30 tx=0x7f6ac400bd70).ready entity=mon.0 client_cookie=89010a48229228e3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:53.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae0c26700 1 -- 172.21.15.79:0/1849380370 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6adc0e56c0 con 0x7f6adc0e9ad0 2021-04-09T18:26:53.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae0c26700 1 -- 172.21.15.79:0/1849380370 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac40098b0 con 0x7f6adc0e9ad0 2021-04-09T18:26:53.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae0c26700 1 -- 172.21.15.79:0/1849380370 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6ac4009c80 con 0x7f6adc0e9ad0 2021-04-09T18:26:53.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae3e84700 1 -- 172.21.15.79:0/1849380370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc0e9ad0 msgr2=0x7f6adc09f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.374 7f6ae3e84700 1 --2- 172.21.15.79:0/1849380370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc0e9ad0 0x7f6adc09f100 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f6ac4002f30 tx=0x7f6ac400bd70).stop 2021-04-09T18:26:53.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.378 7f6ae3e84700 1 -- 172.21.15.79:0/1849380370 shutdown_connections 2021-04-09T18:26:53.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.378 7f6ae3e84700 1 --2- 172.21.15.79:0/1849380370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6adc0f5510 0x7f6adc0f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.378 7f6ae3e84700 1 --2- 172.21.15.79:0/1849380370 >> v2:172.21.15.89:3300/0 conn(0x7f6adc1c2da0 0x7f6adc1c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.378 7f6ae3e84700 1 --2- 172.21.15.79:0/1849380370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc0e9ad0 0x7f6adc09f100 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.378 7f6ae3e84700 1 -- 172.21.15.79:0/1849380370 >> 172.21.15.79:0/1849380370 conn(0x7f6adc0e5fd0 msgr2=0x7f6adc0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:53.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.378 7f6ae3e84700 1 -- 172.21.15.79:0/1849380370 shutdown_connections 2021-04-09T18:26:53.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.378 7f6ae3e84700 1 -- 172.21.15.79:0/1849380370 wait complete. 2021-04-09T18:26:53.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.378 7f6ae3e84700 1 Processor -- start 2021-04-09T18:26:53.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.378 7f6ae3e84700 1 -- start start 2021-04-09T18:26:53.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.378 7f6ae3e84700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc097190 0x7f6adc0ad400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.378 7f6ae3e84700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6adc0d4b70 0x7f6adc0c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.378 7f6ae3e84700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6adc0d4fc0 0x7f6adc0c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.378 7f6ae3e84700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc098060 con 0x7f6adc097190 2021-04-09T18:26:53.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.378 7f6ae3e84700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0ad1b0 con 0x7f6adc0d4fc0 2021-04-09T18:26:53.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.378 7f6ae3e84700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0c4b90 con 0x7f6adc0d4b70 2021-04-09T18:26:53.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.382 7f6ae1c28700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc097190 0x7f6adc0ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.382 7f6ae1c28700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc097190 0x7f6adc0ad400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56812/0 (socket says 172.21.15.79:56812) 2021-04-09T18:26:53.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.382 7f6ae1c28700 1 -- 172.21.15.79:0/146466548 learned_addr learned my addr 172.21.15.79:0/146466548 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:53.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.382 7f6ae1427700 1 --2- 172.21.15.79:0/146466548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6adc0d4b70 0x7f6adc0c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.382 7f6ae2429700 1 --2- 172.21.15.79:0/146466548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6adc0d4fc0 0x7f6adc0c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.382 7f6ae1c28700 1 -- 172.21.15.79:0/146466548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6adc0d4b70 msgr2=0x7f6adc0c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.382 7f6ae1c28700 1 --2- 172.21.15.79:0/146466548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6adc0d4b70 0x7f6adc0c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.382 7f6ae1c28700 1 -- 172.21.15.79:0/146466548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6adc0d4fc0 msgr2=0x7f6adc0c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.382 7f6ae1c28700 1 --2- 172.21.15.79:0/146466548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6adc0d4fc0 0x7f6adc0c58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.382 7f6ae1c28700 1 -- 172.21.15.79:0/146466548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc097bf0 con 0x7f6adc097190 2021-04-09T18:26:53.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.382 7f6ae1c28700 1 --2- 172.21.15.79:0/146466548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc097190 0x7f6adc0ad400 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f6acc00c000 tx=0x7f6acc00c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:53.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.382 7f6ada7fc700 1 -- 172.21.15.79:0/146466548 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6adc097bf0 con 0x7f6adc097190 2021-04-09T18:26:53.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.382 7f6ada7fc700 1 -- 172.21.15.79:0/146466548 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc00cca0 con 0x7f6adc097190 2021-04-09T18:26:53.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.382 7f6ae3e84700 1 -- 172.21.15.79:0/146466548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6adc0c5f20 con 0x7f6adc097190 2021-04-09T18:26:53.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.382 7f6ada7fc700 1 -- 172.21.15.79:0/146466548 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6acc00f040 con 0x7f6adc097190 2021-04-09T18:26:53.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.382 7f6ae3e84700 1 -- 172.21.15.79:0/146466548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6adc0984f0 con 0x7f6adc097190 2021-04-09T18:26:53.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.382 7f6ada7fc700 1 -- 172.21.15.79:0/146466548 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6acc022060 con 0x7f6adc097190 2021-04-09T18:26:53.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.382 7f6ada7fc700 1 --2- 172.21.15.79:0/146466548 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6ac0029100 0x7f6ac002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.382 7f6ada7fc700 1 -- 172.21.15.79:0/146466548 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f6acc010040 con 0x7f6adc097190 2021-04-09T18:26:53.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.382 7f6ae1427700 1 --2- 172.21.15.79:0/146466548 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6ac0029100 0x7f6ac002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.386 7f6ae1427700 1 --2- 172.21.15.79:0/146466548 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6ac0029100 0x7f6ac002b650 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:53.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.390 7f6ae3e84700 1 -- 172.21.15.79:0/146466548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6adc0e39d0 con 0x7f6adc097190 2021-04-09T18:26:53.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.394 7f6ada7fc700 1 -- 172.21.15.79:0/146466548 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6acc000f70 con 0x7f6adc097190 2021-04-09T18:26:53.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.554 7f6ae3e84700 1 -- 172.21.15.79:0/146466548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6adc0f5b10 con 0x7f6adc097190 2021-04-09T18:26:53.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.558 7f6ada7fc700 1 -- 172.21.15.79:0/146466548 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+11377 (secure 0 0 0) 0x7f6acc00ca90 con 0x7f6adc097190 2021-04-09T18:26:53.565 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:53.566 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":26,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:51.079148","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:26:53.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.562 7f6ae3e84700 1 -- 172.21.15.79:0/146466548 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6ac0029100 msgr2=0x7f6ac002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.562 7f6ae3e84700 1 --2- 172.21.15.79:0/146466548 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6ac0029100 0x7f6ac002b650 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.562 7f6ae3e84700 1 -- 172.21.15.79:0/146466548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc097190 msgr2=0x7f6adc0ad400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.562 7f6ae3e84700 1 --2- 172.21.15.79:0/146466548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc097190 0x7f6adc0ad400 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f6acc00c000 tx=0x7f6acc00c430).stop 2021-04-09T18:26:53.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.562 7f6ae3e84700 1 -- 172.21.15.79:0/146466548 shutdown_connections 2021-04-09T18:26:53.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.562 7f6ae3e84700 1 --2- 172.21.15.79:0/146466548 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6ac0029100 0x7f6ac002b650 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.562 7f6ae3e84700 1 --2- 172.21.15.79:0/146466548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6adc0d4fc0 0x7f6adc0c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.562 7f6ae3e84700 1 --2- 172.21.15.79:0/146466548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc097190 0x7f6adc0ad400 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.562 7f6ae3e84700 1 --2- 172.21.15.79:0/146466548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6adc0d4b70 0x7f6adc0c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.562 7f6ae3e84700 1 -- 172.21.15.79:0/146466548 >> 172.21.15.79:0/146466548 conn(0x7f6adc0bb1a0 msgr2=0x7f6adc099430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:53.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.562 7f6ae3e84700 1 -- 172.21.15.79:0/146466548 shutdown_connections 2021-04-09T18:26:53.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.562 7f6ae3e84700 1 -- 172.21.15.79:0/146466548 wait complete. 2021-04-09T18:26:53.578 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-04-09T18:26:53.579 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:26:53.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f668f09f700 1 Processor -- start 2021-04-09T18:26:53.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f668f09f700 1 -- start start 2021-04-09T18:26:53.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f668f09f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f66880e9b10 0x7f668809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f668f09f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66881c8040 0x7f66881ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f668f09f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66880fbb50 con 0x7f66880f5550 2021-04-09T18:26:53.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f668f09f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66881c3df0 con 0x7f66880e9b10 2021-04-09T18:26:53.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f668f09f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66880e9f60 con 0x7f66881c8040 2021-04-09T18:26:53.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f668d644700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66881c8040 0x7f66881ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f668d644700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66881c8040 0x7f66881ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:53816/0 (socket says 172.21.15.79:53816) 2021-04-09T18:26:53.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f668d644700 1 -- 172.21.15.79:0/3081604151 learned_addr learned my addr 172.21.15.79:0/3081604151 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:53.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f6687fff700 1 --2- 172.21.15.79:0/3081604151 >> v2:172.21.15.89:3300/0 conn(0x7f66880e9b10 0x7f668809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f668d644700 1 -- 172.21.15.79:0/3081604151 >> v2:172.21.15.89:3300/0 conn(0x7f66880e9b10 msgr2=0x7f668809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:53.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f668d644700 1 --2- 172.21.15.79:0/3081604151 >> v2:172.21.15.89:3300/0 conn(0x7f66880e9b10 0x7f668809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f668d644700 1 -- 172.21.15.79:0/3081604151 >> v1:172.21.15.89:6789/0 conn(0x7f66880f5550 legacy=0x7f66880f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f668d644700 1 -- 172.21.15.79:0/3081604151 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66880e5700 con 0x7f66881c8040 2021-04-09T18:26:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f668d644700 1 --2- 172.21.15.79:0/3081604151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66881c8040 0x7f66881ca4a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f66800032b0 tx=0x7f668000b3c0).ready entity=mon.2 client_cookie=a7d0ef506cdfe3b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f66877fe700 1 -- 172.21.15.79:0/3081604151 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f66880e5700 con 0x7f66881c8040 2021-04-09T18:26:53.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f66877fe700 1 -- 172.21.15.79:0/3081604151 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668000bca0 con 0x7f66881c8040 2021-04-09T18:26:53.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f66877fe700 1 -- 172.21.15.79:0/3081604151 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6680002020 con 0x7f66881c8040 2021-04-09T18:26:53.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f668f09f700 1 -- 172.21.15.79:0/3081604151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66881c8040 msgr2=0x7f66881ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.678 7f668f09f700 1 --2- 172.21.15.79:0/3081604151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66881c8040 0x7f66881ca4a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f66800032b0 tx=0x7f668000b3c0).stop 2021-04-09T18:26:53.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.682 7f668f09f700 1 -- 172.21.15.79:0/3081604151 shutdown_connections 2021-04-09T18:26:53.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.682 7f668f09f700 1 --2- 172.21.15.79:0/3081604151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66881c8040 0x7f66881ca4a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.682 7f668f09f700 1 --2- 172.21.15.79:0/3081604151 >> v2:172.21.15.89:3300/0 conn(0x7f66880e9b10 0x7f668809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.682 7f668f09f700 1 -- 172.21.15.79:0/3081604151 >> 172.21.15.79:0/3081604151 conn(0x7f66880e6010 msgr2=0x7f66880e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:53.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.682 7f668f09f700 1 -- 172.21.15.79:0/3081604151 shutdown_connections 2021-04-09T18:26:53.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.682 7f668f09f700 1 -- 172.21.15.79:0/3081604151 wait complete. 2021-04-09T18:26:53.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.682 7f668f09f700 1 Processor -- start 2021-04-09T18:26:53.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.682 7f668f09f700 1 -- start start 2021-04-09T18:26:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.682 7f668f09f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66880b90c0 0x7f66880b9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.682 7f668f09f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f668808f740 0x7f668808fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.682 7f668f09f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66880d55d0 0x7f66880d5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.682 7f668f09f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66880951b0 con 0x7f66880d55d0 2021-04-09T18:26:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f668f09f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66880901c0 con 0x7f66880b90c0 2021-04-09T18:26:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f668f09f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6688094a40 con 0x7f668808f740 2021-04-09T18:26:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f668d644700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66880d55d0 0x7f66880d5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f668d644700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66880d55d0 0x7f66880d5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56826/0 (socket says 172.21.15.79:56826) 2021-04-09T18:26:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f668d644700 1 -- 172.21.15.79:0/2420409189 learned_addr learned my addr 172.21.15.79:0/2420409189 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f6687fff700 1 --2- 172.21.15.79:0/2420409189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f668808f740 0x7f668808fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f668ce43700 1 --2- 172.21.15.79:0/2420409189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66880b90c0 0x7f66880b9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f668d644700 1 -- 172.21.15.79:0/2420409189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f668808f740 msgr2=0x7f668808fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f668d644700 1 --2- 172.21.15.79:0/2420409189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f668808f740 0x7f668808fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f668d644700 1 -- 172.21.15.79:0/2420409189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66880b90c0 msgr2=0x7f66880b9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f668d644700 1 --2- 172.21.15.79:0/2420409189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66880b90c0 0x7f66880b9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f668d644700 1 -- 172.21.15.79:0/2420409189 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66880954b0 con 0x7f66880d55d0 2021-04-09T18:26:53.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f668d644700 1 --2- 172.21.15.79:0/2420409189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66880d55d0 0x7f66880d5a20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f66880945b0 tx=0x7f6680006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:53.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f66857fa700 1 -- 172.21.15.79:0/2420409189 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f66880954b0 con 0x7f66880d55d0 2021-04-09T18:26:53.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f66857fa700 1 -- 172.21.15.79:0/2420409189 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668001b670 con 0x7f66880d55d0 2021-04-09T18:26:53.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f668f09f700 1 -- 172.21.15.79:0/2420409189 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66880d6050 con 0x7f66880d55d0 2021-04-09T18:26:53.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f66857fa700 1 -- 172.21.15.79:0/2420409189 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f668001ba40 con 0x7f66880d55d0 2021-04-09T18:26:53.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f668f09f700 1 -- 172.21.15.79:0/2420409189 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66880d6500 con 0x7f66880d55d0 2021-04-09T18:26:53.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f66857fa700 1 -- 172.21.15.79:0/2420409189 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6680019040 con 0x7f66880d55d0 2021-04-09T18:26:53.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f66857fa700 1 --2- 172.21.15.79:0/2420409189 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6668029100 0x7f666802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f66857fa700 1 -- 172.21.15.79:0/2420409189 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f6680018040 con 0x7f66880d55d0 2021-04-09T18:26:53.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.686 7f668ce43700 1 --2- 172.21.15.79:0/2420409189 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6668029100 0x7f666802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.690 7f668ce43700 1 --2- 172.21.15.79:0/2420409189 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6668029100 0x7f666802b650 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:53.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.690 7f668f09f700 1 -- 172.21.15.79:0/2420409189 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66880e39f0 con 0x7f66880d55d0 2021-04-09T18:26:53.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.698 7f66857fa700 1 -- 172.21.15.79:0/2420409189 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f668001b460 con 0x7f66880d55d0 2021-04-09T18:26:53.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.854 7f668f09f700 1 -- 172.21.15.79:0/2420409189 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f66880f5b50 con 0x7f66880d55d0 2021-04-09T18:26:53.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.854 7f66857fa700 1 -- 172.21.15.79:0/2420409189 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f668000ba90 con 0x7f66880d55d0 2021-04-09T18:26:53.861 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:26:53.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.854 7f668f09f700 1 -- 172.21.15.79:0/2420409189 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6668029100 msgr2=0x7f666802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.854 7f668f09f700 1 --2- 172.21.15.79:0/2420409189 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6668029100 0x7f666802b650 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.854 7f668f09f700 1 -- 172.21.15.79:0/2420409189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66880d55d0 msgr2=0x7f66880d5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.854 7f668f09f700 1 --2- 172.21.15.79:0/2420409189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66880d55d0 0x7f66880d5a20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f66880945b0 tx=0x7f6680006c10).stop 2021-04-09T18:26:53.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.854 7f668f09f700 1 -- 172.21.15.79:0/2420409189 shutdown_connections 2021-04-09T18:26:53.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.854 7f668f09f700 1 --2- 172.21.15.79:0/2420409189 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6668029100 0x7f666802b650 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.854 7f668f09f700 1 --2- 172.21.15.79:0/2420409189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66880b90c0 0x7f66880b9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.854 7f668f09f700 1 --2- 172.21.15.79:0/2420409189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66880d55d0 0x7f66880d5a20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.854 7f668f09f700 1 --2- 172.21.15.79:0/2420409189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f668808f740 0x7f668808fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.858 7f668f09f700 1 -- 172.21.15.79:0/2420409189 >> 172.21.15.79:0/2420409189 conn(0x7f66880d3b00 msgr2=0x7f66880ba6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:53.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.858 7f668f09f700 1 -- 172.21.15.79:0/2420409189 shutdown_connections 2021-04-09T18:26:53.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.858 7f668f09f700 1 -- 172.21.15.79:0/2420409189 wait complete. 2021-04-09T18:26:53.873 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-04-09T18:26:53.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.954 7f9b4f324700 1 Processor -- start 2021-04-09T18:26:53.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.954 7f9b4f324700 1 -- start start 2021-04-09T18:26:53.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.954 7f9b4f324700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9b480e9ad0 0x7f9b4809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.954 7f9b4f324700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b480fbb10 con 0x7f9b480f5510 2021-04-09T18:26:53.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.954 7f9b4f324700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b480e56c0 con 0x7f9b481c8000 2021-04-09T18:26:53.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.954 7f9b4f324700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b481c3db0 con 0x7f9b480e9ad0 2021-04-09T18:26:53.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.954 7f9b4c8c7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9b480e9ad0 0x7f9b4809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.954 7f9b4c8c7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9b480e9ad0 0x7f9b4809f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56834/0 (socket says 172.21.15.79:56834) 2021-04-09T18:26:53.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.954 7f9b4c8c7700 1 -- 172.21.15.79:0/410313750 learned_addr learned my addr 172.21.15.79:0/410313750 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:53.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.954 7f9b4d0c8700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9b480f5510 0x7f9b480f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51542/0 (socket says 172.21.15.79:51542) 2021-04-09T18:26:53.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.954 7f9b4c8c7700 1 -- 172.21.15.79:0/410313750 >> v1:172.21.15.89:6789/0 conn(0x7f9b481c8000 legacy=0x7f9b481ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.954 7f9b3ffff700 1 -- 172.21.15.79:0/410313750 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398882740 0 0) 0x7f9b40001450 con 0x7f9b481c8000 2021-04-09T18:26:53.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.954 7f9b4c8c7700 1 -- 172.21.15.79:0/410313750 >> v1:172.21.15.79:6789/0 conn(0x7f9b480f5510 legacy=0x7f9b480f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.954 7f9b4c8c7700 1 -- 172.21.15.79:0/410313750 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b480e4320 con 0x7f9b480e9ad0 2021-04-09T18:26:53.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.954 7f9b4c8c7700 1 --2- 172.21.15.79:0/410313750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b480e9ad0 0x7f9b4809f100 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f9b44001340 tx=0x7f9b44001040).ready entity=mon.0 client_cookie=476b7c5aa5b59184 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:53.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.954 7f9b3ffff700 1 -- 172.21.15.79:0/410313750 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b480e4320 con 0x7f9b480e9ad0 2021-04-09T18:26:53.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.954 7f9b3ffff700 1 -- 172.21.15.79:0/410313750 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b38009720 con 0x7f9b480e9ad0 2021-04-09T18:26:53.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.958 7f9b3ffff700 1 -- 172.21.15.79:0/410313750 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b38009af0 con 0x7f9b480e9ad0 2021-04-09T18:26:53.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.958 7f9b4f324700 1 -- 172.21.15.79:0/410313750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b480e9ad0 msgr2=0x7f9b4809f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.958 7f9b4f324700 1 --2- 172.21.15.79:0/410313750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b480e9ad0 0x7f9b4809f100 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f9b44001340 tx=0x7f9b44001040).stop 2021-04-09T18:26:53.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.958 7f9b4f324700 1 -- 172.21.15.79:0/410313750 shutdown_connections 2021-04-09T18:26:53.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.958 7f9b4f324700 1 --2- 172.21.15.79:0/410313750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b480e9ad0 0x7f9b4809f100 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.958 7f9b4f324700 1 -- 172.21.15.79:0/410313750 >> 172.21.15.79:0/410313750 conn(0x7f9b480e5fd0 msgr2=0x7f9b480e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:53.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.958 7f9b4f324700 1 -- 172.21.15.79:0/410313750 shutdown_connections 2021-04-09T18:26:53.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.958 7f9b4f324700 1 -- 172.21.15.79:0/410313750 wait complete. 2021-04-09T18:26:53.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.962 7f9b4f324700 1 Processor -- start 2021-04-09T18:26:53.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.962 7f9b4f324700 1 -- start start 2021-04-09T18:26:53.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.962 7f9b4f324700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b480b15a0 0x7f9b480ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.962 7f9b4f324700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b481d2eb0 0x7f9b480b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.962 7f9b4f324700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b481d3300 0x7f9b480b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.962 7f9b4f324700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b480e9f20 con 0x7f9b480b15a0 2021-04-09T18:26:53.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.962 7f9b4f324700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b480b0fa0 con 0x7f9b481d2eb0 2021-04-09T18:26:53.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.962 7f9b4f324700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b480b12a0 con 0x7f9b481d3300 2021-04-09T18:26:53.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.962 7f9b4d0c8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b480b15a0 0x7f9b480ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.962 7f9b4d0c8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b480b15a0 0x7f9b480ab250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56838/0 (socket says 172.21.15.79:56838) 2021-04-09T18:26:53.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.962 7f9b4d0c8700 1 -- 172.21.15.79:0/1580913858 learned_addr learned my addr 172.21.15.79:0/1580913858 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:53.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.962 7f9b4d8c9700 1 --2- 172.21.15.79:0/1580913858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b481d3300 0x7f9b480b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.962 7f9b4c8c7700 1 --2- 172.21.15.79:0/1580913858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b481d2eb0 0x7f9b480b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.966 7f9b4c8c7700 1 -- 172.21.15.79:0/1580913858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b481d3300 msgr2=0x7f9b480b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.966 7f9b4c8c7700 1 --2- 172.21.15.79:0/1580913858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b481d3300 0x7f9b480b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.966 7f9b4c8c7700 1 -- 172.21.15.79:0/1580913858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b480b15a0 msgr2=0x7f9b480ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:53.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.966 7f9b4c8c7700 1 --2- 172.21.15.79:0/1580913858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b480b15a0 0x7f9b480ab250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:53.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.966 7f9b4c8c7700 1 -- 172.21.15.79:0/1580913858 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b480ab880 con 0x7f9b481d2eb0 2021-04-09T18:26:53.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.966 7f9b4d0c8700 1 --2- 172.21.15.79:0/1580913858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b480b15a0 0x7f9b480ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:53.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.966 7f9b4c8c7700 1 --2- 172.21.15.79:0/1580913858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b481d2eb0 0x7f9b480b2b20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f9b480bb500 tx=0x7f9b38006890).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:53.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.966 7f9b3dffb700 1 -- 172.21.15.79:0/1580913858 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b480ab880 con 0x7f9b481d2eb0 2021-04-09T18:26:53.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.966 7f9b3dffb700 1 -- 172.21.15.79:0/1580913858 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b38011c90 con 0x7f9b481d2eb0 2021-04-09T18:26:53.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.966 7f9b3dffb700 1 -- 172.21.15.79:0/1580913858 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b3801d630 con 0x7f9b481d2eb0 2021-04-09T18:26:53.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.966 7f9b4f324700 1 -- 172.21.15.79:0/1580913858 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b480b3780 con 0x7f9b481d2eb0 2021-04-09T18:26:53.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.966 7f9b4f324700 1 -- 172.21.15.79:0/1580913858 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b481d6d50 con 0x7f9b481d2eb0 2021-04-09T18:26:53.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.966 7f9b3dffb700 1 -- 172.21.15.79:0/1580913858 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9b3801c3e0 con 0x7f9b481d2eb0 2021-04-09T18:26:53.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.966 7f9b3dffb700 1 --2- 172.21.15.79:0/1580913858 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9b280290a0 0x7f9b2802b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:53.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.966 7f9b3dffb700 1 -- 172.21.15.79:0/1580913858 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f9b3803b440 con 0x7f9b481d2eb0 2021-04-09T18:26:53.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.966 7f9b4d0c8700 1 --2- 172.21.15.79:0/1580913858 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9b280290a0 0x7f9b2802b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:53.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.966 7f9b4d0c8700 1 --2- 172.21.15.79:0/1580913858 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9b280290a0 0x7f9b2802b5f0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:53.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.982 7f9b4f324700 1 -- 172.21.15.79:0/1580913858 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b480e39d0 con 0x7f9b481d2eb0 2021-04-09T18:26:53.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:53.990 7f9b3dffb700 1 -- 172.21.15.79:0/1580913858 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9b38011a80 con 0x7f9b481d2eb0 2021-04-09T18:26:54.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.150 7f9b4f324700 1 -- 172.21.15.79:0/1580913858 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9b480a1cb0 con 0x7f9b481d2eb0 2021-04-09T18:26:54.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.154 7f9b3dffb700 1 -- 172.21.15.79:0/1580913858 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v26) v1 ==== 84+0+64 (secure 0 0 0) 0x7f9b38009510 con 0x7f9b481d2eb0 2021-04-09T18:26:54.160 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:54.161 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2021-04-09T18:26:54.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:26:54.161 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2021-04-09T18:26:54.162 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": "rbd" 2021-04-09T18:26:54.162 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:26:54.163 INFO:teuthology.orchestra.run.smithi079.stdout:] 2021-04-09T18:26:54.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.154 7f9b4f324700 1 -- 172.21.15.79:0/1580913858 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9b280290a0 msgr2=0x7f9b2802b5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:54.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.154 7f9b4f324700 1 --2- 172.21.15.79:0/1580913858 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9b280290a0 0x7f9b2802b5f0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:54.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.154 7f9b4f324700 1 -- 172.21.15.79:0/1580913858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b481d2eb0 msgr2=0x7f9b480b2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:54.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.154 7f9b4f324700 1 --2- 172.21.15.79:0/1580913858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b481d2eb0 0x7f9b480b2b20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f9b480bb500 tx=0x7f9b38006890).stop 2021-04-09T18:26:54.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.154 7f9b4f324700 1 -- 172.21.15.79:0/1580913858 shutdown_connections 2021-04-09T18:26:54.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.154 7f9b4f324700 1 --2- 172.21.15.79:0/1580913858 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9b280290a0 0x7f9b2802b5f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:54.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.154 7f9b4f324700 1 --2- 172.21.15.79:0/1580913858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b481d3300 0x7f9b480b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:54.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.154 7f9b4f324700 1 --2- 172.21.15.79:0/1580913858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b480b15a0 0x7f9b480ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:54.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.154 7f9b4f324700 1 --2- 172.21.15.79:0/1580913858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b481d2eb0 0x7f9b480b2b20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:54.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.154 7f9b4f324700 1 -- 172.21.15.79:0/1580913858 >> 172.21.15.79:0/1580913858 conn(0x7f9b480af3e0 msgr2=0x7f9b480a2950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:54.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.154 7f9b4f324700 1 -- 172.21.15.79:0/1580913858 shutdown_connections 2021-04-09T18:26:54.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.154 7f9b4f324700 1 -- 172.21.15.79:0/1580913858 wait complete. 2021-04-09T18:26:54.172 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-04-09T18:26:54.173 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-04-09T18:26:54.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.270 7f60cfbfb700 1 Processor -- start 2021-04-09T18:26:54.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.270 7f60cfbfb700 1 -- start start 2021-04-09T18:26:54.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.270 7f60cfbfb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60c80f5550 0x7f60c80f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:54.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.270 7f60cfbfb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f60c81c8040 0x7f60c81ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:54.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.270 7f60cfbfb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c80fbb50 con 0x7f60c80e9b10 2021-04-09T18:26:54.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.270 7f60cfbfb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c80e9f60 con 0x7f60c81c8040 2021-04-09T18:26:54.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.270 7f60cfbfb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c81c3df0 con 0x7f60c80f5550 2021-04-09T18:26:54.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.270 7f60ce1a0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f60c81c8040 0x7f60c81ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:54.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.270 7f60cd99f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60c80f5550 0x7f60c80f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:54.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.270 7f60cd19e700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f60c80e9b10 0x7f60c809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:52028/0 (socket says 172.21.15.79:52028) 2021-04-09T18:26:54.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.274 7f60ce1a0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f60c81c8040 0x7f60c81ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:45192/0 (socket says 172.21.15.79:45192) 2021-04-09T18:26:54.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.274 7f60cd19e700 1 -- 172.21.15.79:0/3425840947 learned_addr learned my addr 172.21.15.79:0/3425840947 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:54.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.274 7f60cd99f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60c80f5550 0x7f60c80f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:53842/0 (socket says 172.21.15.79:53842) 2021-04-09T18:26:54.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.274 7f60cd99f700 1 -- 172.21.15.79:0/3425840947 >> v2:172.21.15.89:3300/0 conn(0x7f60c81c8040 msgr2=0x7f60c81ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:54.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.274 7f60cd99f700 1 --2- 172.21.15.79:0/3425840947 >> v2:172.21.15.89:3300/0 conn(0x7f60c81c8040 0x7f60c81ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:54.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.274 7f60cd99f700 1 -- 172.21.15.79:0/3425840947 >> v1:172.21.15.89:6789/0 conn(0x7f60c80e9b10 legacy=0x7f60c809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:54.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.274 7f60cd99f700 1 -- 172.21.15.79:0/3425840947 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c809f910 con 0x7f60c80f5550 2021-04-09T18:26:54.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.274 7f60cd99f700 1 --2- 172.21.15.79:0/3425840947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60c80f5550 0x7f60c80f64e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f60c00032b0 tx=0x7f60c000b0e0).ready entity=mon.2 client_cookie=bc0cb77a5d9386fe server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:54.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.274 7f60cc99d700 1 -- 172.21.15.79:0/3425840947 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f60c809f910 con 0x7f60c80f5550 2021-04-09T18:26:54.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.274 7f60cc99d700 1 -- 172.21.15.79:0/3425840947 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c000bab0 con 0x7f60c80f5550 2021-04-09T18:26:54.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.274 7f60cc99d700 1 -- 172.21.15.79:0/3425840947 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f60c0002020 con 0x7f60c80f5550 2021-04-09T18:26:54.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.274 7f60cfbfb700 1 -- 172.21.15.79:0/3425840947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60c80f5550 msgr2=0x7f60c80f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:54.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.274 7f60cfbfb700 1 --2- 172.21.15.79:0/3425840947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60c80f5550 0x7f60c80f64e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f60c00032b0 tx=0x7f60c000b0e0).stop 2021-04-09T18:26:54.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.274 7f60cfbfb700 1 -- 172.21.15.79:0/3425840947 shutdown_connections 2021-04-09T18:26:54.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.274 7f60cfbfb700 1 --2- 172.21.15.79:0/3425840947 >> v2:172.21.15.89:3300/0 conn(0x7f60c81c8040 0x7f60c81ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:54.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.274 7f60cfbfb700 1 --2- 172.21.15.79:0/3425840947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60c80f5550 0x7f60c80f64e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:54.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.274 7f60cfbfb700 1 -- 172.21.15.79:0/3425840947 >> 172.21.15.79:0/3425840947 conn(0x7f60c80e6010 msgr2=0x7f60c80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:54.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.274 7f60cfbfb700 1 -- 172.21.15.79:0/3425840947 shutdown_connections 2021-04-09T18:26:54.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.274 7f60cfbfb700 1 -- 172.21.15.79:0/3425840947 wait complete. 2021-04-09T18:26:54.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60cfbfb700 1 Processor -- start 2021-04-09T18:26:54.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60cfbfb700 1 -- start start 2021-04-09T18:26:54.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60cfbfb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60c809aec0 0x7f60c80bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:54.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60cfbfb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c80d0f30 0x7f60c80d1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:54.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60cfbfb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60c80bba70 0x7f60c80bbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:54.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60cfbfb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c8088590 con 0x7f60c809aec0 2021-04-09T18:26:54.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60cfbfb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c809abc0 con 0x7f60c80d0f30 2021-04-09T18:26:54.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60cfbfb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c80bcee0 con 0x7f60c80bba70 2021-04-09T18:26:54.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60cd99f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60c809aec0 0x7f60c80bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:54.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60cd99f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60c809aec0 0x7f60c80bc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56852/0 (socket says 172.21.15.79:56852) 2021-04-09T18:26:54.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60cd99f700 1 -- 172.21.15.79:0/2748901011 learned_addr learned my addr 172.21.15.79:0/2748901011 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:54.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60cd19e700 1 --2- 172.21.15.79:0/2748901011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c80d0f30 0x7f60c80d1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:54.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60ce1a0700 1 --2- 172.21.15.79:0/2748901011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60c80bba70 0x7f60c80bbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:54.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60cd99f700 1 -- 172.21.15.79:0/2748901011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60c80bba70 msgr2=0x7f60c80bbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:54.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60cd99f700 1 --2- 172.21.15.79:0/2748901011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60c80bba70 0x7f60c80bbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:54.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60cd99f700 1 -- 172.21.15.79:0/2748901011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c80d0f30 msgr2=0x7f60c80d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:54.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60cd99f700 1 --2- 172.21.15.79:0/2748901011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c80d0f30 0x7f60c80d1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:54.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60cd99f700 1 -- 172.21.15.79:0/2748901011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c809a350 con 0x7f60c809aec0 2021-04-09T18:26:54.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60cd99f700 1 --2- 172.21.15.79:0/2748901011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60c809aec0 0x7f60c80bc8b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f60c80d4100 tx=0x7f60c0006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:54.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60ba7fc700 1 -- 172.21.15.79:0/2748901011 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f60c809a350 con 0x7f60c809aec0 2021-04-09T18:26:54.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60ba7fc700 1 -- 172.21.15.79:0/2748901011 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c001f020 con 0x7f60c809aec0 2021-04-09T18:26:54.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60cfbfb700 1 -- 172.21.15.79:0/2748901011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c809b310 con 0x7f60c809aec0 2021-04-09T18:26:54.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60ba7fc700 1 -- 172.21.15.79:0/2748901011 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f60c001b620 con 0x7f60c809aec0 2021-04-09T18:26:54.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.278 7f60cfbfb700 1 -- 172.21.15.79:0/2748901011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c80bc680 con 0x7f60c809aec0 2021-04-09T18:26:54.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.282 7f60ba7fc700 1 -- 172.21.15.79:0/2748901011 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f60c0009ce0 con 0x7f60c809aec0 2021-04-09T18:26:54.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.282 7f60ba7fc700 1 --2- 172.21.15.79:0/2748901011 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f60b0029100 0x7f60b002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:54.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.282 7f60ba7fc700 1 -- 172.21.15.79:0/2748901011 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f60c003bad0 con 0x7f60c809aec0 2021-04-09T18:26:54.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.282 7f60cd19e700 1 --2- 172.21.15.79:0/2748901011 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f60b0029100 0x7f60b002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:54.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.282 7f60cd19e700 1 --2- 172.21.15.79:0/2748901011 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f60b0029100 0x7f60b002b650 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:54.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.286 7f60cfbfb700 1 -- 172.21.15.79:0/2748901011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c80e39f0 con 0x7f60c809aec0 2021-04-09T18:26:54.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.294 7f60ba7fc700 1 -- 172.21.15.79:0/2748901011 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f60c000b8a0 con 0x7f60c809aec0 2021-04-09T18:26:54.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:54.446 7f60cfbfb700 1 -- 172.21.15.79:0/2748901011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f60c80f5b50 con 0x7f60c809aec0 2021-04-09T18:26:55.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.298 7f60ba7fc700 1 -- 172.21.15.79:0/2748901011 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v28) v1 ==== 133+0+0 (secure 0 0 0) 0x7f60c80bc680 con 0x7f60c809aec0 2021-04-09T18:26:55.319 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2021-04-09T18:26:55.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.314 7f60cfbfb700 1 -- 172.21.15.79:0/2748901011 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f60b0029100 msgr2=0x7f60b002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:55.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.314 7f60cfbfb700 1 --2- 172.21.15.79:0/2748901011 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f60b0029100 0x7f60b002b650 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:55.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.314 7f60cfbfb700 1 -- 172.21.15.79:0/2748901011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60c809aec0 msgr2=0x7f60c80bc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:55.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.314 7f60cfbfb700 1 --2- 172.21.15.79:0/2748901011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60c809aec0 0x7f60c80bc8b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f60c80d4100 tx=0x7f60c0006c10).stop 2021-04-09T18:26:55.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.318 7f60cfbfb700 1 -- 172.21.15.79:0/2748901011 shutdown_connections 2021-04-09T18:26:55.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.318 7f60cfbfb700 1 --2- 172.21.15.79:0/2748901011 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f60b0029100 0x7f60b002b650 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:55.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.318 7f60cfbfb700 1 --2- 172.21.15.79:0/2748901011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60c80bba70 0x7f60c80bbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:55.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.318 7f60cfbfb700 1 --2- 172.21.15.79:0/2748901011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60c809aec0 0x7f60c80bc8b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:55.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.318 7f60cfbfb700 1 --2- 172.21.15.79:0/2748901011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c80d0f30 0x7f60c80d1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:55.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.318 7f60cfbfb700 1 -- 172.21.15.79:0/2748901011 >> 172.21.15.79:0/2748901011 conn(0x7f60c80a5110 msgr2=0x7f60c808eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:55.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.318 7f60cfbfb700 1 -- 172.21.15.79:0/2748901011 shutdown_connections 2021-04-09T18:26:55.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.318 7f60cfbfb700 1 -- 172.21.15.79:0/2748901011 wait complete. 2021-04-09T18:26:55.335 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-04-09T18:26:55.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.422 7f85c72d5700 1 Processor -- start 2021-04-09T18:26:55.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.422 7f85c72d5700 1 -- start start 2021-04-09T18:26:55.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c72d5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f85c00f5550 0x7f85c00f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:55.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c72d5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f85c00e9b10 0x7f85c009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:55.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c72d5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c00fbb50 con 0x7f85c01c2de0 2021-04-09T18:26:55.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c72d5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c00e9f60 con 0x7f85c00e9b10 2021-04-09T18:26:55.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c72d5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c00e5a00 con 0x7f85c00f5550 2021-04-09T18:26:55.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c4878700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f85c00e9b10 0x7f85c009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:55.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c4878700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f85c00e9b10 0x7f85c009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56862/0 (socket says 172.21.15.79:56862) 2021-04-09T18:26:55.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c4878700 1 -- 172.21.15.79:0/866489530 learned_addr learned my addr 172.21.15.79:0/866489530 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:55.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c5079700 1 --2- 172.21.15.79:0/866489530 >> v2:172.21.15.89:3300/0 conn(0x7f85c00f5550 0x7f85c00f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:55.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c4878700 1 -- 172.21.15.79:0/866489530 >> v2:172.21.15.89:3300/0 conn(0x7f85c00f5550 msgr2=0x7f85c00f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:55.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c4878700 1 --2- 172.21.15.79:0/866489530 >> v2:172.21.15.89:3300/0 conn(0x7f85c00f5550 0x7f85c00f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:55.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c4878700 1 -- 172.21.15.79:0/866489530 >> v1:172.21.15.89:6789/0 conn(0x7f85c01c2de0 legacy=0x7f85c01c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:55.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c4878700 1 -- 172.21.15.79:0/866489530 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c00e5700 con 0x7f85c00e9b10 2021-04-09T18:26:55.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c4878700 1 --2- 172.21.15.79:0/866489530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85c00e9b10 0x7f85c009f110 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f85b0002f30 tx=0x7f85b000bd70).ready entity=mon.0 client_cookie=b70f53d2c255fcf5 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:55.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85b7fff700 1 -- 172.21.15.79:0/866489530 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f85c00e5700 con 0x7f85c00e9b10 2021-04-09T18:26:55.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85b7fff700 1 -- 172.21.15.79:0/866489530 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b0009950 con 0x7f85c00e9b10 2021-04-09T18:26:55.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85b7fff700 1 -- 172.21.15.79:0/866489530 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f85b0009d20 con 0x7f85c00e9b10 2021-04-09T18:26:55.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c72d5700 1 -- 172.21.15.79:0/866489530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85c00e9b10 msgr2=0x7f85c009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:55.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c72d5700 1 --2- 172.21.15.79:0/866489530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85c00e9b10 0x7f85c009f110 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f85b0002f30 tx=0x7f85b000bd70).stop 2021-04-09T18:26:55.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c72d5700 1 -- 172.21.15.79:0/866489530 shutdown_connections 2021-04-09T18:26:55.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c72d5700 1 --2- 172.21.15.79:0/866489530 >> v2:172.21.15.89:3300/0 conn(0x7f85c00f5550 0x7f85c00f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:55.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c72d5700 1 --2- 172.21.15.79:0/866489530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85c00e9b10 0x7f85c009f110 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:55.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c72d5700 1 -- 172.21.15.79:0/866489530 >> 172.21.15.79:0/866489530 conn(0x7f85c00e6010 msgr2=0x7f85c00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:55.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c72d5700 1 -- 172.21.15.79:0/866489530 shutdown_connections 2021-04-09T18:26:55.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.426 7f85c72d5700 1 -- 172.21.15.79:0/866489530 wait complete. 2021-04-09T18:26:55.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.430 7f85c72d5700 1 Processor -- start 2021-04-09T18:26:55.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.430 7f85c72d5700 1 -- start start 2021-04-09T18:26:55.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.430 7f85c72d5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85c01adde0 0x7f85c0097800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:55.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.430 7f85c72d5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85c0098160 0x7f85c00985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:55.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.430 7f85c72d5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85c00d4430 0x7f85c00d4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:55.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.430 7f85c72d5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c00e8b20 con 0x7f85c00d4430 2021-04-09T18:26:55.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.430 7f85c72d5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c00c2570 con 0x7f85c0098160 2021-04-09T18:26:55.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.430 7f85c72d5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c00c2870 con 0x7f85c01adde0 2021-04-09T18:26:55.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.430 7f85c587a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85c00d4430 0x7f85c00d4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:55.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.430 7f85c4878700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85c0098160 0x7f85c00985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:55.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.430 7f85c5079700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85c01adde0 0x7f85c0097800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:55.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.430 7f85c587a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85c00d4430 0x7f85c00d4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56870/0 (socket says 172.21.15.79:56870) 2021-04-09T18:26:55.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.430 7f85c587a700 1 -- 172.21.15.79:0/2062960797 learned_addr learned my addr 172.21.15.79:0/2062960797 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:55.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.430 7f85c587a700 1 -- 172.21.15.79:0/2062960797 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85c01adde0 msgr2=0x7f85c0097800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:55.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.430 7f85c587a700 1 --2- 172.21.15.79:0/2062960797 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85c01adde0 0x7f85c0097800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:55.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.430 7f85c587a700 1 -- 172.21.15.79:0/2062960797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85c0098160 msgr2=0x7f85c00985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:55.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.430 7f85c587a700 1 --2- 172.21.15.79:0/2062960797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85c0098160 0x7f85c00985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:55.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.430 7f85c587a700 1 -- 172.21.15.79:0/2062960797 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c0098dd0 con 0x7f85c00d4430 2021-04-09T18:26:55.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.430 7f85c4878700 1 --2- 172.21.15.79:0/2062960797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85c0098160 0x7f85c00985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:55.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.430 7f85c5079700 1 --2- 172.21.15.79:0/2062960797 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85c01adde0 0x7f85c0097800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:55.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.434 7f85c587a700 1 --2- 172.21.15.79:0/2062960797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85c00d4430 0x7f85c00d4880 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f85b8000f00 tx=0x7f85b8001660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:55.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.434 7f85b5ffb700 1 -- 172.21.15.79:0/2062960797 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f85c0098dd0 con 0x7f85c00d4430 2021-04-09T18:26:55.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.434 7f85b5ffb700 1 -- 172.21.15.79:0/2062960797 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b8006a80 con 0x7f85c00d4430 2021-04-09T18:26:55.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.434 7f85b5ffb700 1 -- 172.21.15.79:0/2062960797 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f85b8007030 con 0x7f85c00d4430 2021-04-09T18:26:55.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.434 7f85c72d5700 1 -- 172.21.15.79:0/2062960797 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c0097e30 con 0x7f85c00d4430 2021-04-09T18:26:55.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.434 7f85c72d5700 1 -- 172.21.15.79:0/2062960797 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c00a52e0 con 0x7f85c00d4430 2021-04-09T18:26:55.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.434 7f85b5ffb700 1 -- 172.21.15.79:0/2062960797 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f85b8018020 con 0x7f85c00d4430 2021-04-09T18:26:55.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.434 7f85b5ffb700 1 --2- 172.21.15.79:0/2062960797 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f85a0029100 0x7f85a002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:55.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.434 7f85b5ffb700 1 -- 172.21.15.79:0/2062960797 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5458+0+0 (secure 0 0 0) 0x7f85b803b940 con 0x7f85c00d4430 2021-04-09T18:26:55.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.434 7f85c5079700 1 --2- 172.21.15.79:0/2062960797 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f85a0029100 0x7f85a002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:55.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.434 7f85c5079700 1 --2- 172.21.15.79:0/2062960797 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f85a0029100 0x7f85a002b650 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:55.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.438 7f85c72d5700 1 -- 172.21.15.79:0/2062960797 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c00e39f0 con 0x7f85c00d4430 2021-04-09T18:26:55.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.446 7f85b5ffb700 1 -- 172.21.15.79:0/2062960797 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f85b8000f70 con 0x7f85c00d4430 2021-04-09T18:26:55.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:55.606 7f85c72d5700 1 -- 172.21.15.79:0/2062960797 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f85c00f5b50 con 0x7f85c00d4430 2021-04-09T18:26:56.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.306 7f85b5ffb700 1 -- 172.21.15.79:0/2062960797 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v29) v1 ==== 125+0+0 (secure 0 0 0) 0x7f85b8006870 con 0x7f85c00d4430 2021-04-09T18:26:56.329 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2021-04-09T18:26:56.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.326 7f85c72d5700 1 -- 172.21.15.79:0/2062960797 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f85a0029100 msgr2=0x7f85a002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:56.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.326 7f85c72d5700 1 --2- 172.21.15.79:0/2062960797 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f85a0029100 0x7f85a002b650 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.326 7f85c72d5700 1 -- 172.21.15.79:0/2062960797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85c00d4430 msgr2=0x7f85c00d4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:56.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.326 7f85c72d5700 1 --2- 172.21.15.79:0/2062960797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85c00d4430 0x7f85c00d4880 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f85b8000f00 tx=0x7f85b8001660).stop 2021-04-09T18:26:56.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.326 7f85c72d5700 1 -- 172.21.15.79:0/2062960797 shutdown_connections 2021-04-09T18:26:56.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.326 7f85c72d5700 1 --2- 172.21.15.79:0/2062960797 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f85a0029100 0x7f85a002b650 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.326 7f85c72d5700 1 --2- 172.21.15.79:0/2062960797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85c00d4430 0x7f85c00d4880 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.326 7f85c72d5700 1 --2- 172.21.15.79:0/2062960797 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85c01adde0 0x7f85c0097800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.326 7f85c72d5700 1 --2- 172.21.15.79:0/2062960797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85c0098160 0x7f85c00985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.326 7f85c72d5700 1 -- 172.21.15.79:0/2062960797 >> 172.21.15.79:0/2062960797 conn(0x7f85c00afd40 msgr2=0x7f85c00a6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:56.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.326 7f85c72d5700 1 -- 172.21.15.79:0/2062960797 shutdown_connections 2021-04-09T18:26:56.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.326 7f85c72d5700 1 -- 172.21.15.79:0/2062960797 wait complete. 2021-04-09T18:26:56.343 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-04-09T18:26:56.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.430 7f61b734f700 1 Processor -- start 2021-04-09T18:26:56.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.430 7f61b734f700 1 -- start start 2021-04-09T18:26:56.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.430 7f61b734f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f61b00f5550 0x7f61b00f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:56.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.430 7f61b734f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f61b00e9b10 0x7f61b009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:56.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.430 7f61b734f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b00fbb50 con 0x7f61b01c2de0 2021-04-09T18:26:56.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.430 7f61b734f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b00e9f60 con 0x7f61b00e9b10 2021-04-09T18:26:56.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.430 7f61b734f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b00e5a00 con 0x7f61b00f5550 2021-04-09T18:26:56.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.430 7f61b48f2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f61b00e9b10 0x7f61b009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:56.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.430 7f61b48f2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f61b00e9b10 0x7f61b009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56878/0 (socket says 172.21.15.79:56878) 2021-04-09T18:26:56.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.430 7f61b48f2700 1 -- 172.21.15.79:0/534195076 learned_addr learned my addr 172.21.15.79:0/534195076 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:56.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.430 7f61b50f3700 1 --2- 172.21.15.79:0/534195076 >> v2:172.21.15.89:3300/0 conn(0x7f61b00f5550 0x7f61b00f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:56.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.430 7f61b48f2700 1 -- 172.21.15.79:0/534195076 >> v2:172.21.15.89:3300/0 conn(0x7f61b00f5550 msgr2=0x7f61b00f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:56.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.434 7f61b48f2700 1 --2- 172.21.15.79:0/534195076 >> v2:172.21.15.89:3300/0 conn(0x7f61b00f5550 0x7f61b00f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.434 7f61b48f2700 1 -- 172.21.15.79:0/534195076 >> v1:172.21.15.79:6789/0 conn(0x7f61b01c2de0 legacy=0x7f61b01c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:56.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.434 7f61a7fff700 1 -- 172.21.15.79:0/534195076 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2806763474 0 0) 0x7f61a8001450 con 0x7f61b01c2de0 2021-04-09T18:26:56.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.434 7f61b48f2700 1 -- 172.21.15.79:0/534195076 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b00e5700 con 0x7f61b00e9b10 2021-04-09T18:26:56.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.434 7f61b48f2700 1 --2- 172.21.15.79:0/534195076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b00e9b10 0x7f61b009f110 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f61a0002f30 tx=0x7f61a000bd70).ready entity=mon.0 client_cookie=f140232d0e8dfb9b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:56.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.434 7f61a7fff700 1 -- 172.21.15.79:0/534195076 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f61b00e5700 con 0x7f61b00e9b10 2021-04-09T18:26:56.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.434 7f61a7fff700 1 -- 172.21.15.79:0/534195076 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a0009950 con 0x7f61b00e9b10 2021-04-09T18:26:56.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.434 7f61a7fff700 1 -- 172.21.15.79:0/534195076 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f61a0009d20 con 0x7f61b00e9b10 2021-04-09T18:26:56.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.434 7f61b734f700 1 -- 172.21.15.79:0/534195076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b00e9b10 msgr2=0x7f61b009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:56.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.434 7f61b734f700 1 --2- 172.21.15.79:0/534195076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b00e9b10 0x7f61b009f110 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f61a0002f30 tx=0x7f61a000bd70).stop 2021-04-09T18:26:56.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.434 7f61b734f700 1 -- 172.21.15.79:0/534195076 shutdown_connections 2021-04-09T18:26:56.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.434 7f61b734f700 1 --2- 172.21.15.79:0/534195076 >> v2:172.21.15.89:3300/0 conn(0x7f61b00f5550 0x7f61b00f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.434 7f61b734f700 1 --2- 172.21.15.79:0/534195076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b00e9b10 0x7f61b009f110 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.434 7f61b734f700 1 -- 172.21.15.79:0/534195076 >> 172.21.15.79:0/534195076 conn(0x7f61b00e6010 msgr2=0x7f61b00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:56.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.434 7f61b734f700 1 -- 172.21.15.79:0/534195076 shutdown_connections 2021-04-09T18:26:56.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.434 7f61b734f700 1 -- 172.21.15.79:0/534195076 wait complete. 2021-04-09T18:26:56.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b734f700 1 Processor -- start 2021-04-09T18:26:56.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b734f700 1 -- start start 2021-04-09T18:26:56.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b734f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61b01a23f0 0x7f61b0097280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:56.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b734f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b0097d90 0x7f61b00987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:56.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b734f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61b0098e10 0x7f61b01b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:56.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b734f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b00984e0 con 0x7f61b0097d90 2021-04-09T18:26:56.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b734f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b00981e0 con 0x7f61b01a23f0 2021-04-09T18:26:56.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b734f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b0096ff0 con 0x7f61b0098e10 2021-04-09T18:26:56.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b48f2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b0097d90 0x7f61b00987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:56.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b48f2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b0097d90 0x7f61b00987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56882/0 (socket says 172.21.15.79:56882) 2021-04-09T18:26:56.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b48f2700 1 -- 172.21.15.79:0/212311336 learned_addr learned my addr 172.21.15.79:0/212311336 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:56.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b50f3700 1 --2- 172.21.15.79:0/212311336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61b01a23f0 0x7f61b0097280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:56.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b58f4700 1 --2- 172.21.15.79:0/212311336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61b0098e10 0x7f61b01b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:56.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b48f2700 1 -- 172.21.15.79:0/212311336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61b0098e10 msgr2=0x7f61b01b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:56.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b48f2700 1 --2- 172.21.15.79:0/212311336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61b0098e10 0x7f61b01b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b48f2700 1 -- 172.21.15.79:0/212311336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61b01a23f0 msgr2=0x7f61b0097280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:56.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b48f2700 1 --2- 172.21.15.79:0/212311336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61b01a23f0 0x7f61b0097280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b48f2700 1 -- 172.21.15.79:0/212311336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b00978b0 con 0x7f61b0097d90 2021-04-09T18:26:56.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b48f2700 1 --2- 172.21.15.79:0/212311336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b0097d90 0x7f61b00987e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f61b00d7db0 tx=0x7f61a0006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:56.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61a5ffb700 1 -- 172.21.15.79:0/212311336 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f61b00978b0 con 0x7f61b0097d90 2021-04-09T18:26:56.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61a5ffb700 1 -- 172.21.15.79:0/212311336 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a0011df0 con 0x7f61b0097d90 2021-04-09T18:26:56.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b734f700 1 -- 172.21.15.79:0/212311336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b01ada60 con 0x7f61b0097d90 2021-04-09T18:26:56.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61a5ffb700 1 -- 172.21.15.79:0/212311336 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f61a001d670 con 0x7f61b0097d90 2021-04-09T18:26:56.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.438 7f61b734f700 1 -- 172.21.15.79:0/212311336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b01b16c0 con 0x7f61b0097d90 2021-04-09T18:26:56.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.442 7f61a5ffb700 1 -- 172.21.15.79:0/212311336 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f61a00253a0 con 0x7f61b0097d90 2021-04-09T18:26:56.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.442 7f61a5ffb700 1 --2- 172.21.15.79:0/212311336 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6190029100 0x7f619002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:56.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.442 7f61a5ffb700 1 -- 172.21.15.79:0/212311336 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f61a003ad20 con 0x7f61b0097d90 2021-04-09T18:26:56.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.442 7f61b50f3700 1 --2- 172.21.15.79:0/212311336 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6190029100 0x7f619002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:56.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.442 7f61b50f3700 1 --2- 172.21.15.79:0/212311336 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6190029100 0x7f619002b650 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:56.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.442 7f61b734f700 1 -- 172.21.15.79:0/212311336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b00e39f0 con 0x7f61b0097d90 2021-04-09T18:26:56.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.446 7f61a5ffb700 1 -- 172.21.15.79:0/212311336 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f61a0011be0 con 0x7f61b0097d90 2021-04-09T18:26:56.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.606 7f61b734f700 1 -- 172.21.15.79:0/212311336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f61b00f5b50 con 0x7f61b0097d90 2021-04-09T18:26:56.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.614 7f61a5ffb700 1 -- 172.21.15.79:0/212311336 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 4 and data pool 5 v10) v1 ==== 187+0+0 (secure 0 0 0) 0x7f61a0009740 con 0x7f61b0097d90 2021-04-09T18:26:56.629 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 4 and data pool 5 2021-04-09T18:26:56.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.630 7f61b734f700 1 -- 172.21.15.79:0/212311336 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6190029100 msgr2=0x7f619002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:56.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.630 7f61b734f700 1 --2- 172.21.15.79:0/212311336 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6190029100 0x7f619002b650 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.630 7f61b734f700 1 -- 172.21.15.79:0/212311336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b0097d90 msgr2=0x7f61b00987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:56.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.630 7f61b734f700 1 --2- 172.21.15.79:0/212311336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b0097d90 0x7f61b00987e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f61b00d7db0 tx=0x7f61a0006890).stop 2021-04-09T18:26:56.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.630 7f61b734f700 1 -- 172.21.15.79:0/212311336 shutdown_connections 2021-04-09T18:26:56.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.630 7f61b734f700 1 --2- 172.21.15.79:0/212311336 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6190029100 0x7f619002b650 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.630 7f61b734f700 1 --2- 172.21.15.79:0/212311336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61b01a23f0 0x7f61b0097280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.630 7f61b734f700 1 --2- 172.21.15.79:0/212311336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61b0098e10 0x7f61b01b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.630 7f61b734f700 1 --2- 172.21.15.79:0/212311336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b0097d90 0x7f61b00987e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.630 7f61b734f700 1 -- 172.21.15.79:0/212311336 >> 172.21.15.79:0/212311336 conn(0x7f61b00a2640 msgr2=0x7f61b009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:56.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.630 7f61b734f700 1 -- 172.21.15.79:0/212311336 shutdown_connections 2021-04-09T18:26:56.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.630 7f61b734f700 1 -- 172.21.15.79:0/212311336 wait complete. 2021-04-09T18:26:56.648 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:56.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e9b8e700 1 Processor -- start 2021-04-09T18:26:56.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e9b8e700 1 -- start start 2021-04-09T18:26:56.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e9b8e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f28e40f5510 0x7f28e40f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:56.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e9b8e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f28e40e9ad0 0x7f28e409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:56.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e9b8e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e40fbb10 con 0x7f28e41c2da0 2021-04-09T18:26:56.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e9b8e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e40e9f20 con 0x7f28e40e9ad0 2021-04-09T18:26:56.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e9b8e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e40e59c0 con 0x7f28e40f5510 2021-04-09T18:26:56.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e2ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f28e40e9ad0 0x7f28e409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:56.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e2ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f28e40e9ad0 0x7f28e409f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56892/0 (socket says 172.21.15.79:56892) 2021-04-09T18:26:56.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e2ffd700 1 -- 172.21.15.79:0/900008178 learned_addr learned my addr 172.21.15.79:0/900008178 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:56.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e37fe700 1 --2- 172.21.15.79:0/900008178 >> v2:172.21.15.89:3300/0 conn(0x7f28e40f5510 0x7f28e40f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:56.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e2ffd700 1 -- 172.21.15.79:0/900008178 >> v2:172.21.15.89:3300/0 conn(0x7f28e40f5510 msgr2=0x7f28e40f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:56.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e2ffd700 1 --2- 172.21.15.79:0/900008178 >> v2:172.21.15.89:3300/0 conn(0x7f28e40f5510 0x7f28e40f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e2ffd700 1 -- 172.21.15.79:0/900008178 >> v1:172.21.15.89:6789/0 conn(0x7f28e41c2da0 legacy=0x7f28e41c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:56.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e2ffd700 1 -- 172.21.15.79:0/900008178 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e40e56c0 con 0x7f28e40e9ad0 2021-04-09T18:26:56.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e37fe700 1 --2- 172.21.15.79:0/900008178 >> v2:172.21.15.89:3300/0 conn(0x7f28e40f5510 0x7f28e40f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:26:56.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e2ffd700 1 --2- 172.21.15.79:0/900008178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e40e9ad0 0x7f28e409f100 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f28cc002f30 tx=0x7f28cc00bd70).ready entity=mon.0 client_cookie=23c0a349693e3612 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:56.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e27fc700 1 -- 172.21.15.79:0/900008178 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f28e40e56c0 con 0x7f28e40e9ad0 2021-04-09T18:26:56.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e27fc700 1 -- 172.21.15.79:0/900008178 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc009900 con 0x7f28e40e9ad0 2021-04-09T18:26:56.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e27fc700 1 -- 172.21.15.79:0/900008178 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f28cc009cd0 con 0x7f28e40e9ad0 2021-04-09T18:26:56.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e9b8e700 1 -- 172.21.15.79:0/900008178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e40e9ad0 msgr2=0x7f28e409f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:56.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e9b8e700 1 --2- 172.21.15.79:0/900008178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e40e9ad0 0x7f28e409f100 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f28cc002f30 tx=0x7f28cc00bd70).stop 2021-04-09T18:26:56.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e9b8e700 1 -- 172.21.15.79:0/900008178 shutdown_connections 2021-04-09T18:26:56.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e9b8e700 1 --2- 172.21.15.79:0/900008178 >> v2:172.21.15.89:3300/0 conn(0x7f28e40f5510 0x7f28e40f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e9b8e700 1 --2- 172.21.15.79:0/900008178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e40e9ad0 0x7f28e409f100 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e9b8e700 1 -- 172.21.15.79:0/900008178 >> 172.21.15.79:0/900008178 conn(0x7f28e40e5fd0 msgr2=0x7f28e40e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:56.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e9b8e700 1 -- 172.21.15.79:0/900008178 shutdown_connections 2021-04-09T18:26:56.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.726 7f28e9b8e700 1 -- 172.21.15.79:0/900008178 wait complete. 2021-04-09T18:26:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.730 7f28e9b8e700 1 Processor -- start 2021-04-09T18:26:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.730 7f28e9b8e700 1 -- start start 2021-04-09T18:26:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.730 7f28e9b8e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28e4099af0 0x7f28e40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.730 7f28e9b8e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e40d0e20 0x7f28e40cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:56.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.730 7f28e9b8e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28e40d1270 0x7f28e4093fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:56.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.730 7f28e9b8e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e409abf0 con 0x7f28e40d0e20 2021-04-09T18:26:56.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.730 7f28e9b8e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e40b92f0 con 0x7f28e40d1270 2021-04-09T18:26:56.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.730 7f28e9b8e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e40b7ce0 con 0x7f28e4099af0 2021-04-09T18:26:56.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.730 7f28e2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e40d0e20 0x7f28e40cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:56.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.730 7f28e2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e40d0e20 0x7f28e40cfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56900/0 (socket says 172.21.15.79:56900) 2021-04-09T18:26:56.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.730 7f28e2ffd700 1 -- 172.21.15.79:0/3730995796 learned_addr learned my addr 172.21.15.79:0/3730995796 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:56.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.730 7f28e37fe700 1 --2- 172.21.15.79:0/3730995796 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28e4099af0 0x7f28e40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:56.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.730 7f28e3fff700 1 --2- 172.21.15.79:0/3730995796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28e40d1270 0x7f28e4093fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:56.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.730 7f28e2ffd700 1 -- 172.21.15.79:0/3730995796 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28e4099af0 msgr2=0x7f28e40b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:56.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.730 7f28e2ffd700 1 --2- 172.21.15.79:0/3730995796 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28e4099af0 0x7f28e40b7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.730 7f28e2ffd700 1 -- 172.21.15.79:0/3730995796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28e40d1270 msgr2=0x7f28e4093fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:56.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.730 7f28e2ffd700 1 --2- 172.21.15.79:0/3730995796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28e40d1270 0x7f28e4093fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.730 7f28e2ffd700 1 -- 172.21.15.79:0/3730995796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e4099f40 con 0x7f28e40d0e20 2021-04-09T18:26:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.734 7f28e2ffd700 1 --2- 172.21.15.79:0/3730995796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e40d0e20 0x7f28e40cfd30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f28e4093890 tx=0x7f28cc006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.734 7f28dbfff700 1 -- 172.21.15.79:0/3730995796 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f28e4099f40 con 0x7f28e40d0e20 2021-04-09T18:26:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.734 7f28dbfff700 1 -- 172.21.15.79:0/3730995796 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc01b5e0 con 0x7f28e40d0e20 2021-04-09T18:26:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.734 7f28e9b8e700 1 -- 172.21.15.79:0/3730995796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e40d17a0 con 0x7f28e40d0e20 2021-04-09T18:26:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.734 7f28dbfff700 1 -- 172.21.15.79:0/3730995796 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f28cc017040 con 0x7f28e40d0e20 2021-04-09T18:26:56.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.734 7f28e9b8e700 1 -- 172.21.15.79:0/3730995796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e41aa110 con 0x7f28e40d0e20 2021-04-09T18:26:56.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.734 7f28dbfff700 1 -- 172.21.15.79:0/3730995796 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f28cc01b9b0 con 0x7f28e40d0e20 2021-04-09T18:26:56.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.734 7f28dbfff700 1 --2- 172.21.15.79:0/3730995796 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f28c8029100 0x7f28c802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:56.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.734 7f28dbfff700 1 -- 172.21.15.79:0/3730995796 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f28cc018030 con 0x7f28e40d0e20 2021-04-09T18:26:56.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.734 7f28e37fe700 1 --2- 172.21.15.79:0/3730995796 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f28c8029100 0x7f28c802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:56.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.734 7f28e37fe700 1 --2- 172.21.15.79:0/3730995796 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f28c8029100 0x7f28c802b650 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:56.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.738 7f28e9b8e700 1 -- 172.21.15.79:0/3730995796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e40e39d0 con 0x7f28e40d0e20 2021-04-09T18:26:56.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.746 7f28dbfff700 1 -- 172.21.15.79:0/3730995796 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f28cc01b3d0 con 0x7f28e40d0e20 2021-04-09T18:26:56.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.914 7f28e9b8e700 1 -- 172.21.15.79:0/3730995796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28e40f5b10 con 0x7f28e40d0e20 2021-04-09T18:26:56.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.918 7f28dbfff700 1 -- 172.21.15.79:0/3730995796 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+14239 (secure 0 0 0) 0x7f28cc0096f0 con 0x7f28e40d0e20 2021-04-09T18:26:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:56.925 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":30,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:56.613674","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:26:54.507577","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2021-04-09 18:26:55.665017","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:26:56.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.922 7f28e9b8e700 1 -- 172.21.15.79:0/3730995796 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f28c8029100 msgr2=0x7f28c802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:56.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.922 7f28e9b8e700 1 --2- 172.21.15.79:0/3730995796 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f28c8029100 0x7f28c802b650 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.922 7f28e9b8e700 1 -- 172.21.15.79:0/3730995796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e40d0e20 msgr2=0x7f28e40cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:56.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.922 7f28e9b8e700 1 --2- 172.21.15.79:0/3730995796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e40d0e20 0x7f28e40cfd30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f28e4093890 tx=0x7f28cc006890).stop 2021-04-09T18:26:56.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.922 7f28e9b8e700 1 -- 172.21.15.79:0/3730995796 shutdown_connections 2021-04-09T18:26:56.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.922 7f28e9b8e700 1 --2- 172.21.15.79:0/3730995796 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f28c8029100 0x7f28c802b650 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.922 7f28e9b8e700 1 --2- 172.21.15.79:0/3730995796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28e40d1270 0x7f28e4093fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.922 7f28e9b8e700 1 --2- 172.21.15.79:0/3730995796 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28e4099af0 0x7f28e40b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.922 7f28e9b8e700 1 --2- 172.21.15.79:0/3730995796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e40d0e20 0x7f28e40cfd30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:56.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.922 7f28e9b8e700 1 -- 172.21.15.79:0/3730995796 >> 172.21.15.79:0/3730995796 conn(0x7f28e40938d0 msgr2=0x7f28e40d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:56.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.922 7f28e9b8e700 1 -- 172.21.15.79:0/3730995796 shutdown_connections 2021-04-09T18:26:56.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:56.922 7f28e9b8e700 1 -- 172.21.15.79:0/3730995796 wait complete. 2021-04-09T18:26:56.945 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:57.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc0842e700 1 Processor -- start 2021-04-09T18:26:57.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc0842e700 1 -- start start 2021-04-09T18:26:57.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc0842e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdc000e9ad0 0x7fdc0009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:57.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc0842e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc001c8000 0x7fdc001ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:57.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc0842e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc000fbb10 con 0x7fdc000f5510 2021-04-09T18:26:57.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc0842e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc001c3db0 con 0x7fdc000e9ad0 2021-04-09T18:26:57.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc0842e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc000e9f20 con 0x7fdc001c8000 2021-04-09T18:26:57.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc059d1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdc000e9ad0 0x7fdc0009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:57.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc059d1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdc000e9ad0 0x7fdc0009f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56906/0 (socket says 172.21.15.79:56906) 2021-04-09T18:26:57.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc059d1700 1 -- 172.21.15.79:0/3861805525 learned_addr learned my addr 172.21.15.79:0/3861805525 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:57.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc069d3700 1 --2- 172.21.15.79:0/3861805525 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc001c8000 0x7fdc001ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:57.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc059d1700 1 -- 172.21.15.79:0/3861805525 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc001c8000 msgr2=0x7fdc001ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:57.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc059d1700 1 --2- 172.21.15.79:0/3861805525 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc001c8000 0x7fdc001ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc059d1700 1 -- 172.21.15.79:0/3861805525 >> v1:172.21.15.89:6789/0 conn(0x7fdc000f5510 legacy=0x7fdc000f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:57.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc059d1700 1 -- 172.21.15.79:0/3861805525 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc000e56c0 con 0x7fdc000e9ad0 2021-04-09T18:26:57.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc059d1700 1 --2- 172.21.15.79:0/3861805525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc000e9ad0 0x7fdc0009f100 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fdc000f6ef0 tx=0x7fdbf000bdd0).ready entity=mon.0 client_cookie=62600e4c1716b31f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:57.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc051d0700 1 -- 172.21.15.79:0/3861805525 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdc000e56c0 con 0x7fdc000e9ad0 2021-04-09T18:26:57.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc051d0700 1 -- 172.21.15.79:0/3861805525 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf0009990 con 0x7fdc000e9ad0 2021-04-09T18:26:57.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc051d0700 1 -- 172.21.15.79:0/3861805525 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdbf0009d60 con 0x7fdc000e9ad0 2021-04-09T18:26:57.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc0842e700 1 -- 172.21.15.79:0/3861805525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc000e9ad0 msgr2=0x7fdc0009f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:57.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc0842e700 1 --2- 172.21.15.79:0/3861805525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc000e9ad0 0x7fdc0009f100 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fdc000f6ef0 tx=0x7fdbf000bdd0).stop 2021-04-09T18:26:57.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc0842e700 1 -- 172.21.15.79:0/3861805525 shutdown_connections 2021-04-09T18:26:57.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc0842e700 1 --2- 172.21.15.79:0/3861805525 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc001c8000 0x7fdc001ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc0842e700 1 --2- 172.21.15.79:0/3861805525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc000e9ad0 0x7fdc0009f100 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc0842e700 1 -- 172.21.15.79:0/3861805525 >> 172.21.15.79:0/3861805525 conn(0x7fdc000e5fd0 msgr2=0x7fdc000e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:57.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc0842e700 1 -- 172.21.15.79:0/3861805525 shutdown_connections 2021-04-09T18:26:57.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.054 7fdc0842e700 1 -- 172.21.15.79:0/3861805525 wait complete. 2021-04-09T18:26:57.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.058 7fdc0842e700 1 Processor -- start 2021-04-09T18:26:57.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.058 7fdc0842e700 1 -- start start 2021-04-09T18:26:57.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.058 7fdc0842e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc000d6190 0x7fdc0008f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:57.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.058 7fdc0842e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc000d7c80 0x7fdc000d24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:57.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.058 7fdc0842e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc000bcc20 0x7fdc000bd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:57.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.058 7fdc0842e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc000ba9d0 con 0x7fdc000d7c80 2021-04-09T18:26:57.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.058 7fdc0842e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc000d80d0 con 0x7fdc000d6190 2021-04-09T18:26:57.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.058 7fdc0842e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc000d86d0 con 0x7fdc000bcc20 2021-04-09T18:26:57.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.058 7fdc059d1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc000d7c80 0x7fdc000d24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:57.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.058 7fdc059d1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc000d7c80 0x7fdc000d24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56910/0 (socket says 172.21.15.79:56910) 2021-04-09T18:26:57.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.058 7fdc059d1700 1 -- 172.21.15.79:0/1895152798 learned_addr learned my addr 172.21.15.79:0/1895152798 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:57.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.058 7fdc061d2700 1 --2- 172.21.15.79:0/1895152798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc000d6190 0x7fdc0008f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:57.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.058 7fdc069d3700 1 --2- 172.21.15.79:0/1895152798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc000bcc20 0x7fdc000bd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:57.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.058 7fdc059d1700 1 -- 172.21.15.79:0/1895152798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc000bcc20 msgr2=0x7fdc000bd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:57.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.058 7fdc059d1700 1 --2- 172.21.15.79:0/1895152798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc000bcc20 0x7fdc000bd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.058 7fdc059d1700 1 -- 172.21.15.79:0/1895152798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc000d6190 msgr2=0x7fdc0008f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:57.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.058 7fdc059d1700 1 --2- 172.21.15.79:0/1895152798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc000d6190 0x7fdc0008f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.058 7fdc059d1700 1 -- 172.21.15.79:0/1895152798 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc000d2b00 con 0x7fdc000d7c80 2021-04-09T18:26:57.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.062 7fdc059d1700 1 --2- 172.21.15.79:0/1895152798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc000d7c80 0x7fdc000d24d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fdc000d5410 tx=0x7fdbf0006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:57.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.062 7fdbf6ffd700 1 -- 172.21.15.79:0/1895152798 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdc000d2b00 con 0x7fdc000d7c80 2021-04-09T18:26:57.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.062 7fdbf6ffd700 1 -- 172.21.15.79:0/1895152798 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf0011d40 con 0x7fdc000d7c80 2021-04-09T18:26:57.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.062 7fdc0842e700 1 -- 172.21.15.79:0/1895152798 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc000bd6a0 con 0x7fdc000d7c80 2021-04-09T18:26:57.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.062 7fdbf6ffd700 1 -- 172.21.15.79:0/1895152798 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdbf001d640 con 0x7fdc000d7c80 2021-04-09T18:26:57.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.062 7fdc0842e700 1 -- 172.21.15.79:0/1895152798 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc001a85c0 con 0x7fdc000d7c80 2021-04-09T18:26:57.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.062 7fdbf6ffd700 1 -- 172.21.15.79:0/1895152798 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fdbf001d840 con 0x7fdc000d7c80 2021-04-09T18:26:57.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.062 7fdbf6ffd700 1 --2- 172.21.15.79:0/1895152798 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdbe8029100 0x7fdbe802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:57.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.062 7fdbf6ffd700 1 -- 172.21.15.79:0/1895152798 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fdbf003c7f0 con 0x7fdc000d7c80 2021-04-09T18:26:57.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.062 7fdc061d2700 1 --2- 172.21.15.79:0/1895152798 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdbe8029100 0x7fdbe802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:57.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.062 7fdc061d2700 1 --2- 172.21.15.79:0/1895152798 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdbe8029100 0x7fdbe802b650 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:57.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.066 7fdc0842e700 1 -- 172.21.15.79:0/1895152798 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc000e39d0 con 0x7fdc000d7c80 2021-04-09T18:26:57.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.074 7fdbf6ffd700 1 -- 172.21.15.79:0/1895152798 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fdbf0009780 con 0x7fdc000d7c80 2021-04-09T18:26:57.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.246 7fdc0842e700 1 -- 172.21.15.79:0/1895152798 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc000a1cb0 con 0x7fdc000d7c80 2021-04-09T18:26:57.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.246 7fdbf6ffd700 1 -- 172.21.15.79:0/1895152798 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+14239 (secure 0 0 0) 0x7fdbf00397b0 con 0x7fdc000d7c80 2021-04-09T18:26:57.254 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:57.255 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":30,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:56.613674","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:26:54.507577","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2021-04-09 18:26:55.665017","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:26:57.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.250 7fdc0842e700 1 -- 172.21.15.79:0/1895152798 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdbe8029100 msgr2=0x7fdbe802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:57.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.250 7fdc0842e700 1 --2- 172.21.15.79:0/1895152798 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdbe8029100 0x7fdbe802b650 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.250 7fdc0842e700 1 -- 172.21.15.79:0/1895152798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc000d7c80 msgr2=0x7fdc000d24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:57.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.250 7fdc0842e700 1 --2- 172.21.15.79:0/1895152798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc000d7c80 0x7fdc000d24d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fdc000d5410 tx=0x7fdbf0006890).stop 2021-04-09T18:26:57.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.250 7fdc0842e700 1 -- 172.21.15.79:0/1895152798 shutdown_connections 2021-04-09T18:26:57.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.250 7fdc0842e700 1 --2- 172.21.15.79:0/1895152798 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdbe8029100 0x7fdbe802b650 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.250 7fdc0842e700 1 --2- 172.21.15.79:0/1895152798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc000d6190 0x7fdc0008f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.250 7fdc0842e700 1 --2- 172.21.15.79:0/1895152798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc000bcc20 0x7fdc000bd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.250 7fdc0842e700 1 --2- 172.21.15.79:0/1895152798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc000d7c80 0x7fdc000d24d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.250 7fdc0842e700 1 -- 172.21.15.79:0/1895152798 >> 172.21.15.79:0/1895152798 conn(0x7fdc000957a0 msgr2=0x7fdc00096430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:57.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.250 7fdc0842e700 1 -- 172.21.15.79:0/1895152798 shutdown_connections 2021-04-09T18:26:57.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.250 7fdc0842e700 1 -- 172.21.15.79:0/1895152798 wait complete. 2021-04-09T18:26:57.267 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-04-09T18:26:57.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.366 7f1fe8d18700 1 Processor -- start 2021-04-09T18:26:57.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.366 7f1fe8d18700 1 -- start start 2021-04-09T18:26:57.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.366 7f1fe8d18700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1fe40f5550 0x7f1fe40f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:57.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.366 7f1fe8d18700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1fe40e9b10 0x7f1fe409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:57.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.366 7f1fe8d18700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe40fbb50 con 0x7f1fe41c2de0 2021-04-09T18:26:57.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.366 7f1fe8d18700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe40e9f60 con 0x7f1fe40e9b10 2021-04-09T18:26:57.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.366 7f1fe8d18700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe40e5a00 con 0x7f1fe40f5550 2021-04-09T18:26:57.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.366 7f1fe2293700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1fe40e9b10 0x7f1fe409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:57.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.366 7f1fe3295700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1fe41c2de0 0x7f1fe41c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51632/0 (socket says 172.21.15.79:51632) 2021-04-09T18:26:57.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.366 7f1fe3295700 1 -- 172.21.15.79:0/3806887245 learned_addr learned my addr 172.21.15.79:0/3806887245 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:57.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.366 7f1fe2a94700 1 --2- 172.21.15.79:0/3806887245 >> v2:172.21.15.89:3300/0 conn(0x7f1fe40f5550 0x7f1fe40f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:57.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.366 7f1fe2293700 1 -- 172.21.15.79:0/3806887245 >> v2:172.21.15.89:3300/0 conn(0x7f1fe40f5550 msgr2=0x7f1fe40f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:57.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.366 7f1fe2293700 1 --2- 172.21.15.79:0/3806887245 >> v2:172.21.15.89:3300/0 conn(0x7f1fe40f5550 0x7f1fe40f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.366 7f1fe2293700 1 -- 172.21.15.79:0/3806887245 >> v1:172.21.15.79:6789/0 conn(0x7f1fe41c2de0 legacy=0x7f1fe41c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:57.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.366 7f1fe2293700 1 -- 172.21.15.79:0/3806887245 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe40e5700 con 0x7f1fe40e9b10 2021-04-09T18:26:57.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.366 7f1fe1a92700 1 -- 172.21.15.79:0/3806887245 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4124910603 0 0) 0x7f1fd40010d0 con 0x7f1fe41c2de0 2021-04-09T18:26:57.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.370 7f1fe2293700 1 --2- 172.21.15.79:0/3806887245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fe40e9b10 0x7f1fe409f110 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f1fcc002f30 tx=0x7f1fcc00bd10).ready entity=mon.0 client_cookie=a467eb01334e271e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:57.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.370 7f1fe1a92700 1 -- 172.21.15.79:0/3806887245 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1fe40e5700 con 0x7f1fe40e9b10 2021-04-09T18:26:57.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.370 7f1fe1a92700 1 -- 172.21.15.79:0/3806887245 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc0098a0 con 0x7f1fe40e9b10 2021-04-09T18:26:57.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.370 7f1fe1a92700 1 -- 172.21.15.79:0/3806887245 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1fcc009c70 con 0x7f1fe40e9b10 2021-04-09T18:26:57.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.370 7f1fe8d18700 1 -- 172.21.15.79:0/3806887245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fe40e9b10 msgr2=0x7f1fe409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:57.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.370 7f1fe8d18700 1 --2- 172.21.15.79:0/3806887245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fe40e9b10 0x7f1fe409f110 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f1fcc002f30 tx=0x7f1fcc00bd10).stop 2021-04-09T18:26:57.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.370 7f1fe8d18700 1 -- 172.21.15.79:0/3806887245 shutdown_connections 2021-04-09T18:26:57.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.370 7f1fe8d18700 1 --2- 172.21.15.79:0/3806887245 >> v2:172.21.15.89:3300/0 conn(0x7f1fe40f5550 0x7f1fe40f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.370 7f1fe8d18700 1 --2- 172.21.15.79:0/3806887245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fe40e9b10 0x7f1fe409f110 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.370 7f1fe8d18700 1 -- 172.21.15.79:0/3806887245 >> 172.21.15.79:0/3806887245 conn(0x7f1fe40e6010 msgr2=0x7f1fe40e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:57.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.370 7f1fe8d18700 1 -- 172.21.15.79:0/3806887245 shutdown_connections 2021-04-09T18:26:57.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.370 7f1fe8d18700 1 -- 172.21.15.79:0/3806887245 wait complete. 2021-04-09T18:26:57.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe8d18700 1 Processor -- start 2021-04-09T18:26:57.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe8d18700 1 -- start start 2021-04-09T18:26:57.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe8d18700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fe4099360 0x7f1fe40d5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:57.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe8d18700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fe4091280 0x7f1fe4099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:57.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe8d18700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fe409a0c0 0x7f1fe40ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:57.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe8d18700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe4090f80 con 0x7f1fe4099360 2021-04-09T18:26:57.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe8d18700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40d6a50 con 0x7f1fe409a0c0 2021-04-09T18:26:57.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe8d18700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe4090810 con 0x7f1fe4091280 2021-04-09T18:26:57.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe2a94700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fe4099360 0x7f1fe40d5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:57.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe2a94700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fe4099360 0x7f1fe40d5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56924/0 (socket says 172.21.15.79:56924) 2021-04-09T18:26:57.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe2a94700 1 -- 172.21.15.79:0/1431867485 learned_addr learned my addr 172.21.15.79:0/1431867485 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:57.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe2293700 1 --2- 172.21.15.79:0/1431867485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fe4091280 0x7f1fe4099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:57.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe3295700 1 --2- 172.21.15.79:0/1431867485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fe409a0c0 0x7f1fe40ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:57.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe2a94700 1 -- 172.21.15.79:0/1431867485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fe4091280 msgr2=0x7f1fe4099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:57.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe2a94700 1 --2- 172.21.15.79:0/1431867485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fe4091280 0x7f1fe4099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe2a94700 1 -- 172.21.15.79:0/1431867485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fe409a0c0 msgr2=0x7f1fe40ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:57.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe2a94700 1 --2- 172.21.15.79:0/1431867485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fe409a0c0 0x7f1fe40ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe2a94700 1 -- 172.21.15.79:0/1431867485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe409ab10 con 0x7f1fe4099360 2021-04-09T18:26:57.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe2a94700 1 --2- 172.21.15.79:0/1431867485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fe4099360 0x7f1fe40d5fb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f1fdc00c000 tx=0x7f1fdc00c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:57.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fdb7fe700 1 -- 172.21.15.79:0/1431867485 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1fe409ab10 con 0x7f1fe4099360 2021-04-09T18:26:57.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fdb7fe700 1 -- 172.21.15.79:0/1431867485 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc00cca0 con 0x7f1fe4099360 2021-04-09T18:26:57.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe8d18700 1 -- 172.21.15.79:0/1431867485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe4090190 con 0x7f1fe4099360 2021-04-09T18:26:57.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fdb7fe700 1 -- 172.21.15.79:0/1431867485 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1fdc00f040 con 0x7f1fe4099360 2021-04-09T18:26:57.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.374 7f1fe8d18700 1 -- 172.21.15.79:0/1431867485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe40cfe30 con 0x7f1fe4099360 2021-04-09T18:26:57.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.378 7f1fdb7fe700 1 -- 172.21.15.79:0/1431867485 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1fdc022060 con 0x7f1fe4099360 2021-04-09T18:26:57.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.378 7f1fdb7fe700 1 --2- 172.21.15.79:0/1431867485 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1fc8029100 0x7f1fc802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:57.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.378 7f1fdb7fe700 1 -- 172.21.15.79:0/1431867485 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f1fdc010040 con 0x7f1fe4099360 2021-04-09T18:26:57.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.378 7f1fe2293700 1 --2- 172.21.15.79:0/1431867485 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1fc8029100 0x7f1fc802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:57.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.378 7f1fe2293700 1 --2- 172.21.15.79:0/1431867485 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1fc8029100 0x7f1fc802b650 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:57.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.382 7f1fe8d18700 1 -- 172.21.15.79:0/1431867485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe40e39f0 con 0x7f1fe4099360 2021-04-09T18:26:57.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.390 7f1fdb7fe700 1 -- 172.21.15.79:0/1431867485 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1fdc00ca90 con 0x7f1fe4099360 2021-04-09T18:26:57.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.562 7f1fe8d18700 1 -- 172.21.15.79:0/1431867485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f1fe40f5b50 con 0x7f1fe4099360 2021-04-09T18:26:57.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.618 7f1fdb7fe700 1 -- 172.21.15.79:0/1431867485 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v11) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1fdc000f70 con 0x7f1fe4099360 2021-04-09T18:26:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.630 7f1fe8d18700 1 -- 172.21.15.79:0/1431867485 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1fc8029100 msgr2=0x7f1fc802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.630 7f1fe8d18700 1 --2- 172.21.15.79:0/1431867485 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1fc8029100 0x7f1fc802b650 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.630 7f1fe8d18700 1 -- 172.21.15.79:0/1431867485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fe4099360 msgr2=0x7f1fe40d5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.630 7f1fe8d18700 1 --2- 172.21.15.79:0/1431867485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fe4099360 0x7f1fe40d5fb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f1fdc00c000 tx=0x7f1fdc00c430).stop 2021-04-09T18:26:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.630 7f1fe8d18700 1 -- 172.21.15.79:0/1431867485 shutdown_connections 2021-04-09T18:26:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.630 7f1fe8d18700 1 --2- 172.21.15.79:0/1431867485 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1fc8029100 0x7f1fc802b650 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.630 7f1fe8d18700 1 --2- 172.21.15.79:0/1431867485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fe409a0c0 0x7f1fe40ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.630 7f1fe8d18700 1 --2- 172.21.15.79:0/1431867485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fe4099360 0x7f1fe40d5fb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.630 7f1fe8d18700 1 --2- 172.21.15.79:0/1431867485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fe4091280 0x7f1fe4099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.630 7f1fe8d18700 1 -- 172.21.15.79:0/1431867485 >> 172.21.15.79:0/1431867485 conn(0x7f1fe40938a0 msgr2=0x7f1fe40d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.634 7f1fe8d18700 1 -- 172.21.15.79:0/1431867485 shutdown_connections 2021-04-09T18:26:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.634 7f1fe8d18700 1 -- 172.21.15.79:0/1431867485 wait complete. 2021-04-09T18:26:57.651 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:26:57.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a28c30700 1 Processor -- start 2021-04-09T18:26:57.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a28c30700 1 -- start start 2021-04-09T18:26:57.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a28c30700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4a240e9ad0 0x7f4a2409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:57.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a28c30700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4a241c8000 0x7f4a241ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:57.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a28c30700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a240fbb10 con 0x7f4a240f5510 2021-04-09T18:26:57.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a28c30700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a241c3db0 con 0x7f4a241c8000 2021-04-09T18:26:57.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a28c30700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a240e9f20 con 0x7f4a240e9ad0 2021-04-09T18:26:57.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a22fe7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4a241c8000 0x7f4a241ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:57.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a227e6700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4a240f5510 0x7f4a240f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51642/0 (socket says 172.21.15.79:51642) 2021-04-09T18:26:57.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a227e6700 1 -- 172.21.15.79:0/1554215754 learned_addr learned my addr 172.21.15.79:0/1554215754 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:57.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a19fe5700 1 --2- 172.21.15.79:0/1554215754 >> v2:172.21.15.89:3300/0 conn(0x7f4a240e9ad0 0x7f4a2409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:57.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a22fe7700 1 -- 172.21.15.79:0/1554215754 >> v2:172.21.15.89:3300/0 conn(0x7f4a240e9ad0 msgr2=0x7f4a2409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:57.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a22fe7700 1 --2- 172.21.15.79:0/1554215754 >> v2:172.21.15.89:3300/0 conn(0x7f4a240e9ad0 0x7f4a2409f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a22fe7700 1 -- 172.21.15.79:0/1554215754 >> v1:172.21.15.79:6789/0 conn(0x7f4a240f5510 legacy=0x7f4a240f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:57.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a21fe5700 1 -- 172.21.15.79:0/1554215754 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135562818 0 0) 0x7f4a140010d0 con 0x7f4a240f5510 2021-04-09T18:26:57.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a22fe7700 1 -- 172.21.15.79:0/1554215754 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a240e56c0 con 0x7f4a241c8000 2021-04-09T18:26:57.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a22fe7700 1 --2- 172.21.15.79:0/1554215754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a241c8000 0x7f4a241ca460 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f4a1c0032b0 tx=0x7f4a1c00b3c0).ready entity=mon.0 client_cookie=b5d4da0a7b1d2e3d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:57.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a21fe5700 1 -- 172.21.15.79:0/1554215754 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a240e56c0 con 0x7f4a241c8000 2021-04-09T18:26:57.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a21fe5700 1 -- 172.21.15.79:0/1554215754 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c00bc20 con 0x7f4a241c8000 2021-04-09T18:26:57.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a21fe5700 1 -- 172.21.15.79:0/1554215754 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a1c002020 con 0x7f4a241c8000 2021-04-09T18:26:57.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a28c30700 1 -- 172.21.15.79:0/1554215754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a241c8000 msgr2=0x7f4a241ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:57.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.742 7f4a28c30700 1 --2- 172.21.15.79:0/1554215754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a241c8000 0x7f4a241ca460 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f4a1c0032b0 tx=0x7f4a1c00b3c0).stop 2021-04-09T18:26:57.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.746 7f4a28c30700 1 -- 172.21.15.79:0/1554215754 shutdown_connections 2021-04-09T18:26:57.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.746 7f4a28c30700 1 --2- 172.21.15.79:0/1554215754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a241c8000 0x7f4a241ca460 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.746 7f4a28c30700 1 --2- 172.21.15.79:0/1554215754 >> v2:172.21.15.89:3300/0 conn(0x7f4a240e9ad0 0x7f4a2409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.746 7f4a28c30700 1 -- 172.21.15.79:0/1554215754 >> 172.21.15.79:0/1554215754 conn(0x7f4a240e5fd0 msgr2=0x7f4a240e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:57.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.746 7f4a28c30700 1 -- 172.21.15.79:0/1554215754 shutdown_connections 2021-04-09T18:26:57.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.746 7f4a28c30700 1 -- 172.21.15.79:0/1554215754 wait complete. 2021-04-09T18:26:57.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a28c30700 1 Processor -- start 2021-04-09T18:26:57.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a28c30700 1 -- start start 2021-04-09T18:26:57.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a28c30700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a240d5120 0x7f4a241a6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:57.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a28c30700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a241a6e90 0x7f4a24099c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:57.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a28c30700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a2409a2b0 0x7f4a2409a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:57.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a28c30700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a240d6b00 con 0x7f4a240d5120 2021-04-09T18:26:57.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a28c30700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a241a72e0 con 0x7f4a2409a2b0 2021-04-09T18:26:57.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a28c30700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a240d8070 con 0x7f4a241a6e90 2021-04-09T18:26:57.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a227e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a240d5120 0x7f4a241a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:57.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a227e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a240d5120 0x7f4a241a6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56938/0 (socket says 172.21.15.79:56938) 2021-04-09T18:26:57.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a227e6700 1 -- 172.21.15.79:0/2111603483 learned_addr learned my addr 172.21.15.79:0/2111603483 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:57.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a19fe5700 1 --2- 172.21.15.79:0/2111603483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a241a6e90 0x7f4a24099c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:57.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a22fe7700 1 --2- 172.21.15.79:0/2111603483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a2409a2b0 0x7f4a2409a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:57.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a227e6700 1 -- 172.21.15.79:0/2111603483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a241a6e90 msgr2=0x7f4a24099c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:57.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a227e6700 1 --2- 172.21.15.79:0/2111603483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a241a6e90 0x7f4a24099c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a227e6700 1 -- 172.21.15.79:0/2111603483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a2409a2b0 msgr2=0x7f4a2409a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:57.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a227e6700 1 --2- 172.21.15.79:0/2111603483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a2409a2b0 0x7f4a2409a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a227e6700 1 -- 172.21.15.79:0/2111603483 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a240d66b0 con 0x7f4a240d5120 2021-04-09T18:26:57.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a227e6700 1 --2- 172.21.15.79:0/2111603483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a240d5120 0x7f4a241a6860 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f4a14000b80 tx=0x7f4a1400cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:57.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a1b7fe700 1 -- 172.21.15.79:0/2111603483 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a240d66b0 con 0x7f4a240d5120 2021-04-09T18:26:57.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a1b7fe700 1 -- 172.21.15.79:0/2111603483 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a14007320 con 0x7f4a240d5120 2021-04-09T18:26:57.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a28c30700 1 -- 172.21.15.79:0/2111603483 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a240d6e00 con 0x7f4a240d5120 2021-04-09T18:26:57.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a1b7fe700 1 -- 172.21.15.79:0/2111603483 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a140057e0 con 0x7f4a240d5120 2021-04-09T18:26:57.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.750 7f4a28c30700 1 -- 172.21.15.79:0/2111603483 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a240b8400 con 0x7f4a240d5120 2021-04-09T18:26:57.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.754 7f4a1b7fe700 1 -- 172.21.15.79:0/2111603483 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4a1401a020 con 0x7f4a240d5120 2021-04-09T18:26:57.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.754 7f4a1b7fe700 1 --2- 172.21.15.79:0/2111603483 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a08029100 0x7f4a0802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:57.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.754 7f4a1b7fe700 1 -- 172.21.15.79:0/2111603483 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f4a14039280 con 0x7f4a240d5120 2021-04-09T18:26:57.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.754 7f4a19fe5700 1 --2- 172.21.15.79:0/2111603483 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a08029100 0x7f4a0802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:57.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.754 7f4a28c30700 1 -- 172.21.15.79:0/2111603483 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a240e39d0 con 0x7f4a240d5120 2021-04-09T18:26:57.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.754 7f4a19fe5700 1 --2- 172.21.15.79:0/2111603483 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a08029100 0x7f4a0802b650 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:57.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.762 7f4a1b7fe700 1 -- 172.21.15.79:0/2111603483 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4a14007110 con 0x7f4a240d5120 2021-04-09T18:26:57.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.938 7f4a28c30700 1 -- 172.21.15.79:0/2111603483 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a240a1cb0 con 0x7f4a240d5120 2021-04-09T18:26:57.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.938 7f4a1b7fe700 1 -- 172.21.15.79:0/2111603483 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2100 (secure 0 0 0) 0x7f4a14000bf0 con 0x7f4a240d5120 2021-04-09T18:26:57.948 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 11 2021-04-09T18:26:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:57.949 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3417656822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3417656822},{"type":"v1","addr":"172.21.15.79:6833","nonce":3417656822}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":9}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:26:56.614049","modified":"2021-04-09 18:26:57.616754","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4634":{"gid":4634,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/3906387944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3906387944},{"type":"v1","addr":"172.21.15.89:6835","nonce":3906387944}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-04-09T18:26:57.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.942 7f4a28c30700 1 -- 172.21.15.79:0/2111603483 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a08029100 msgr2=0x7f4a0802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:57.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.942 7f4a28c30700 1 --2- 172.21.15.79:0/2111603483 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a08029100 0x7f4a0802b650 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.942 7f4a28c30700 1 -- 172.21.15.79:0/2111603483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a240d5120 msgr2=0x7f4a241a6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:57.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.942 7f4a28c30700 1 --2- 172.21.15.79:0/2111603483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a240d5120 0x7f4a241a6860 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f4a14000b80 tx=0x7f4a1400cae0).stop 2021-04-09T18:26:57.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.942 7f4a28c30700 1 -- 172.21.15.79:0/2111603483 shutdown_connections 2021-04-09T18:26:57.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.942 7f4a28c30700 1 --2- 172.21.15.79:0/2111603483 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a08029100 0x7f4a0802b650 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.942 7f4a28c30700 1 --2- 172.21.15.79:0/2111603483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a2409a2b0 0x7f4a2409a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.942 7f4a28c30700 1 --2- 172.21.15.79:0/2111603483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a240d5120 0x7f4a241a6860 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.942 7f4a28c30700 1 --2- 172.21.15.79:0/2111603483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a241a6e90 0x7f4a24099c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:57.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.942 7f4a28c30700 1 -- 172.21.15.79:0/2111603483 >> 172.21.15.79:0/2111603483 conn(0x7f4a240d8c40 msgr2=0x7f4a240d3380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:57.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.946 7f4a28c30700 1 -- 172.21.15.79:0/2111603483 shutdown_connections 2021-04-09T18:26:57.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:57.946 7f4a28c30700 1 -- 172.21.15.79:0/2111603483 wait complete. 2021-04-09T18:26:57.961 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:58.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f795e310700 1 Processor -- start 2021-04-09T18:26:58.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f795e310700 1 -- start start 2021-04-09T18:26:58.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f795e310700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f79581c9010 0x7f79581cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:58.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f795e310700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79580fbb10 con 0x7f79580f5510 2021-04-09T18:26:58.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f795e310700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795809f900 con 0x7f79580e9ad0 2021-04-09T18:26:58.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f795e310700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79581c3db0 con 0x7f79581c9010 2021-04-09T18:26:58.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f7957fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f79580f5510 0x7f79580f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51656/0 (socket says 172.21.15.79:51656) 2021-04-09T18:26:58.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f7957fff700 1 -- 172.21.15.79:0/2692796801 learned_addr learned my addr 172.21.15.79:0/2692796801 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:58.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f795c8b5700 1 --2- 172.21.15.79:0/2692796801 >> v2:172.21.15.89:3300/0 conn(0x7f79581c9010 0x7f79581cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:58.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f7956ffd700 1 -- 172.21.15.79:0/2692796801 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951519935 0 0) 0x7f79480010d0 con 0x7f79580f5510 2021-04-09T18:26:58.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f7956ffd700 1 -- 172.21.15.79:0/2692796801 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7944003240 con 0x7f79580f5510 2021-04-09T18:26:58.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f7956ffd700 1 -- 172.21.15.79:0/2692796801 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2596540500 0 0) 0x7f7948001650 con 0x7f79580f5510 2021-04-09T18:26:58.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f7956ffd700 1 -- 172.21.15.79:0/2692796801 >> v2:172.21.15.89:3300/0 conn(0x7f79581c9010 msgr2=0x7f79581cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:58.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f7956ffd700 1 --2- 172.21.15.79:0/2692796801 >> v2:172.21.15.89:3300/0 conn(0x7f79581c9010 0x7f79581cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f7956ffd700 1 -- 172.21.15.79:0/2692796801 >> v1:172.21.15.89:6789/0 conn(0x7f79580e9ad0 legacy=0x7f795809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:58.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f7956ffd700 1 -- 172.21.15.79:0/2692796801 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79580e56c0 con 0x7f79580f5510 2021-04-09T18:26:58.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f7956ffd700 1 -- 172.21.15.79:0/2692796801 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f7948001bb0 con 0x7f79580f5510 2021-04-09T18:26:58.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f7956ffd700 1 -- 172.21.15.79:0/2692796801 >> v1:172.21.15.79:6789/0 conn(0x7f79580f5510 legacy=0x7f79580f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:58.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f7956ffd700 1 --2- 172.21.15.79:0/2692796801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79440038c0 0x7f7944003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:58.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f7956ffd700 1 --2- 172.21.15.79:0/2692796801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79440045a0 0x7f7944004a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:58.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f7956ffd700 1 --2- 172.21.15.79:0/2692796801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79440097e0 0x7f794400bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:58.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f7956ffd700 1 -- 172.21.15.79:0/2692796801 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79581c3db0 con 0x7f79440097e0 2021-04-09T18:26:58.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f7956ffd700 1 -- 172.21.15.79:0/2692796801 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794400c270 con 0x7f79440038c0 2021-04-09T18:26:58.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f7956ffd700 1 -- 172.21.15.79:0/2692796801 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7944050430 con 0x7f79440045a0 2021-04-09T18:26:58.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f795c8b5700 1 --2- 172.21.15.79:0/2692796801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79440097e0 0x7f794400bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:58.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f79577fe700 1 --2- 172.21.15.79:0/2692796801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79440045a0 0x7f7944004a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:58.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f7957fff700 1 --2- 172.21.15.79:0/2692796801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79440038c0 0x7f7944003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:58.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f795c8b5700 1 -- 172.21.15.79:0/2692796801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79440045a0 msgr2=0x7f7944004a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:58.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f795c8b5700 1 --2- 172.21.15.79:0/2692796801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79440045a0 0x7f7944004a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f795c8b5700 1 -- 172.21.15.79:0/2692796801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79440038c0 msgr2=0x7f7944003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:58.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f795c8b5700 1 --2- 172.21.15.79:0/2692796801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79440038c0 0x7f7944003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f795c8b5700 1 -- 172.21.15.79:0/2692796801 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79440506a0 con 0x7f79440097e0 2021-04-09T18:26:58.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f795c8b5700 1 -- 172.21.15.79:0/2692796801 reap_dead start 2021-04-09T18:26:58.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.050 7f795c8b5700 1 --2- 172.21.15.79:0/2692796801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79440097e0 0x7f794400bc40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f795000c000 tx=0x7f795000e4b0).ready entity=mon.0 client_cookie=d026c378813e9055 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:58.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.054 7f7956ffd700 1 -- 172.21.15.79:0/2692796801 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f79440506a0 con 0x7f79440097e0 2021-04-09T18:26:58.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.054 7f7956ffd700 1 -- 172.21.15.79:0/2692796801 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795000ed20 con 0x7f79440097e0 2021-04-09T18:26:58.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.054 7f7956ffd700 1 -- 172.21.15.79:0/2692796801 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f795000f040 con 0x7f79440097e0 2021-04-09T18:26:58.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.054 7f795e310700 1 -- 172.21.15.79:0/2692796801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79440097e0 msgr2=0x7f794400bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:58.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.054 7f795e310700 1 --2- 172.21.15.79:0/2692796801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79440097e0 0x7f794400bc40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f795000c000 tx=0x7f795000e4b0).stop 2021-04-09T18:26:58.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.054 7f795e310700 1 -- 172.21.15.79:0/2692796801 shutdown_connections 2021-04-09T18:26:58.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.054 7f795e310700 1 --2- 172.21.15.79:0/2692796801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79440097e0 0x7f794400bc40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.054 7f795e310700 1 -- 172.21.15.79:0/2692796801 >> 172.21.15.79:0/2692796801 conn(0x7f79580e5fd0 msgr2=0x7f79580e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:58.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.054 7f795e310700 1 -- 172.21.15.79:0/2692796801 shutdown_connections 2021-04-09T18:26:58.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.054 7f795e310700 1 -- 172.21.15.79:0/2692796801 wait complete. 2021-04-09T18:26:58.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f795e310700 1 Processor -- start 2021-04-09T18:26:58.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f795e310700 1 -- start start 2021-04-09T18:26:58.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f795e310700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7958098510 0x7f795819b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:58.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f795e310700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f795819e230 0x7f79581af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:58.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f795e310700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79581c0130 0x7f79581abda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:58.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f795e310700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79580e9f20 con 0x7f795819e230 2021-04-09T18:26:58.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f795e310700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795819c9b0 con 0x7f79581c0130 2021-04-09T18:26:58.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f795e310700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795819ccb0 con 0x7f7958098510 2021-04-09T18:26:58.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f79577fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f795819e230 0x7f79581af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:58.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f79577fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f795819e230 0x7f79581af360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56960/0 (socket says 172.21.15.79:56960) 2021-04-09T18:26:58.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f79577fe700 1 -- 172.21.15.79:0/292320888 learned_addr learned my addr 172.21.15.79:0/292320888 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:58.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f7957fff700 1 --2- 172.21.15.79:0/292320888 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7958098510 0x7f795819b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:58.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f795c8b5700 1 --2- 172.21.15.79:0/292320888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79581c0130 0x7f79581abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:58.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f79577fe700 1 -- 172.21.15.79:0/292320888 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7958098510 msgr2=0x7f795819b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:58.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f79577fe700 1 --2- 172.21.15.79:0/292320888 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7958098510 0x7f795819b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f79577fe700 1 -- 172.21.15.79:0/292320888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79581c0130 msgr2=0x7f79581abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:58.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f79577fe700 1 --2- 172.21.15.79:0/292320888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79581c0130 0x7f79581abda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f79577fe700 1 -- 172.21.15.79:0/292320888 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79580bb620 con 0x7f795819e230 2021-04-09T18:26:58.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f795c8b5700 1 --2- 172.21.15.79:0/292320888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79581c0130 0x7f79581abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:58.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f79577fe700 1 --2- 172.21.15.79:0/292320888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f795819e230 0x7f79581af360 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f79581a1ea0 tx=0x7f7940002e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:58.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f7954ff9700 1 -- 172.21.15.79:0/292320888 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f79580bb620 con 0x7f795819e230 2021-04-09T18:26:58.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f7954ff9700 1 -- 172.21.15.79:0/292320888 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7940007220 con 0x7f795819e230 2021-04-09T18:26:58.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f795e310700 1 -- 172.21.15.79:0/292320888 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795819c540 con 0x7f795819e230 2021-04-09T18:26:58.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f7954ff9700 1 -- 172.21.15.79:0/292320888 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7940010040 con 0x7f795819e230 2021-04-09T18:26:58.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.058 7f795e310700 1 -- 172.21.15.79:0/292320888 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795819e680 con 0x7f795819e230 2021-04-09T18:26:58.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.062 7f7954ff9700 1 -- 172.21.15.79:0/292320888 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7940012070 con 0x7f795819e230 2021-04-09T18:26:58.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.062 7f7954ff9700 1 --2- 172.21.15.79:0/292320888 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f793c029100 0x7f793c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:58.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.062 7f7954ff9700 1 -- 172.21.15.79:0/292320888 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f7940011040 con 0x7f795819e230 2021-04-09T18:26:58.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.062 7f7957fff700 1 --2- 172.21.15.79:0/292320888 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f793c029100 0x7f793c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:58.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.062 7f7957fff700 1 --2- 172.21.15.79:0/292320888 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f793c029100 0x7f793c02b650 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:58.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.066 7f795e310700 1 -- 172.21.15.79:0/292320888 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79580e39d0 con 0x7f795819e230 2021-04-09T18:26:58.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.070 7f7954ff9700 1 -- 172.21.15.79:0/292320888 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7940000bf0 con 0x7f795819e230 2021-04-09T18:26:58.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.234 7f795e310700 1 -- 172.21.15.79:0/292320888 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79580a1cb0 con 0x7f795819e230 2021-04-09T18:26:58.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.234 7f7954ff9700 1 -- 172.21.15.79:0/292320888 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+14226 (secure 0 0 0) 0x7f794000d5a0 con 0x7f795819e230 2021-04-09T18:26:58.242 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:58.243 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":31,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:57.617381","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:26:54.507577","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2021-04-09 18:26:55.665017","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:26:58.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.238 7f795e310700 1 -- 172.21.15.79:0/292320888 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f793c029100 msgr2=0x7f793c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:58.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.238 7f795e310700 1 --2- 172.21.15.79:0/292320888 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f793c029100 0x7f793c02b650 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.238 7f795e310700 1 -- 172.21.15.79:0/292320888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f795819e230 msgr2=0x7f79581af360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:58.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.238 7f795e310700 1 --2- 172.21.15.79:0/292320888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f795819e230 0x7f79581af360 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f79581a1ea0 tx=0x7f7940002e60).stop 2021-04-09T18:26:58.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.238 7f795e310700 1 -- 172.21.15.79:0/292320888 shutdown_connections 2021-04-09T18:26:58.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.238 7f795e310700 1 --2- 172.21.15.79:0/292320888 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f793c029100 0x7f793c02b650 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.238 7f795e310700 1 --2- 172.21.15.79:0/292320888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79581c0130 0x7f79581abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.238 7f795e310700 1 --2- 172.21.15.79:0/292320888 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7958098510 0x7f795819b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.238 7f795e310700 1 --2- 172.21.15.79:0/292320888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f795819e230 0x7f79581af360 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.238 7f795e310700 1 -- 172.21.15.79:0/292320888 >> 172.21.15.79:0/292320888 conn(0x7f79580d8700 msgr2=0x7f79580c3550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:58.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.238 7f795e310700 1 -- 172.21.15.79:0/292320888 shutdown_connections 2021-04-09T18:26:58.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.238 7f795e310700 1 -- 172.21.15.79:0/292320888 wait complete. 2021-04-09T18:26:58.263 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:26:58.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f677b9af700 1 Processor -- start 2021-04-09T18:26:58.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f677b9af700 1 -- start start 2021-04-09T18:26:58.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f677b9af700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f67740e9b40 0x7f677409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:58.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f677b9af700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67740fbb80 con 0x7f67741c7e40 2021-04-09T18:26:58.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f677b9af700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67740e56b0 con 0x7f67740f5580 2021-04-09T18:26:58.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f677b9af700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67740e9f90 con 0x7f67740e9b40 2021-04-09T18:26:58.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f6778f52700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f67740e9b40 0x7f677409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:58.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f6778f52700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f67740e9b40 0x7f677409f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56968/0 (socket says 172.21.15.79:56968) 2021-04-09T18:26:58.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f6778f52700 1 -- 172.21.15.79:0/3548823386 learned_addr learned my addr 172.21.15.79:0/3548823386 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:58.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f6778f52700 1 -- 172.21.15.79:0/3548823386 >> v1:172.21.15.89:6789/0 conn(0x7f67740f5580 legacy=0x7f67740f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:58.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f6778f52700 1 -- 172.21.15.79:0/3548823386 >> v1:172.21.15.79:6789/0 conn(0x7f67741c7e40 legacy=0x7f67741ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:58.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f6778f52700 1 -- 172.21.15.79:0/3548823386 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67740e4310 con 0x7f67740e9b40 2021-04-09T18:26:58.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f6778f52700 1 --2- 172.21.15.79:0/3548823386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67740e9b40 0x7f677409f110 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f6768002f30 tx=0x7f676800bd20).ready entity=mon.0 client_cookie=735c9d903d683bd9 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:58.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f6773fff700 1 -- 172.21.15.79:0/3548823386 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67740e4310 con 0x7f67740e9b40 2021-04-09T18:26:58.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f6773fff700 1 -- 172.21.15.79:0/3548823386 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67680099d0 con 0x7f67740e9b40 2021-04-09T18:26:58.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f6773fff700 1 -- 172.21.15.79:0/3548823386 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6768009de0 con 0x7f67740e9b40 2021-04-09T18:26:58.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f677b9af700 1 -- 172.21.15.79:0/3548823386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67740e9b40 msgr2=0x7f677409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:58.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f677b9af700 1 --2- 172.21.15.79:0/3548823386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67740e9b40 0x7f677409f110 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f6768002f30 tx=0x7f676800bd20).stop 2021-04-09T18:26:58.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f677b9af700 1 -- 172.21.15.79:0/3548823386 shutdown_connections 2021-04-09T18:26:58.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f677b9af700 1 --2- 172.21.15.79:0/3548823386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67740e9b40 0x7f677409f110 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.358 7f677b9af700 1 -- 172.21.15.79:0/3548823386 >> 172.21.15.79:0/3548823386 conn(0x7f67740e6040 msgr2=0x7f67740e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:58.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f677b9af700 1 -- 172.21.15.79:0/3548823386 shutdown_connections 2021-04-09T18:26:58.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f677b9af700 1 -- 172.21.15.79:0/3548823386 wait complete. 2021-04-09T18:26:58.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f677b9af700 1 Processor -- start 2021-04-09T18:26:58.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f677b9af700 1 -- start start 2021-04-09T18:26:58.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f677b9af700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67740bab10 0x7f67740b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:58.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f677b9af700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67740d51c0 0x7f67740d5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:58.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f677b9af700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67740c4450 0x7f67740c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:58.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f677b9af700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6774088820 con 0x7f67740d51c0 2021-04-09T18:26:58.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f677b9af700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67740c5b80 con 0x7f67740c4450 2021-04-09T18:26:58.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f677b9af700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67740c5e80 con 0x7f67740bab10 2021-04-09T18:26:58.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f6778f52700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67740d51c0 0x7f67740d5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:58.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f6778f52700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67740d51c0 0x7f67740d5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56976/0 (socket says 172.21.15.79:56976) 2021-04-09T18:26:58.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f6778f52700 1 -- 172.21.15.79:0/2352026908 learned_addr learned my addr 172.21.15.79:0/2352026908 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:58.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f6779753700 1 --2- 172.21.15.79:0/2352026908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67740bab10 0x7f67740b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:58.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f6779f54700 1 --2- 172.21.15.79:0/2352026908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67740c4450 0x7f67740c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:58.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f6778f52700 1 -- 172.21.15.79:0/2352026908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67740bab10 msgr2=0x7f67740b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:58.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f6778f52700 1 --2- 172.21.15.79:0/2352026908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67740bab10 0x7f67740b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f6778f52700 1 -- 172.21.15.79:0/2352026908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67740c4450 msgr2=0x7f67740c48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:58.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f6778f52700 1 --2- 172.21.15.79:0/2352026908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67740c4450 0x7f67740c48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f6778f52700 1 -- 172.21.15.79:0/2352026908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67740baf60 con 0x7f67740d51c0 2021-04-09T18:26:58.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.362 7f6778f52700 1 --2- 172.21.15.79:0/2352026908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67740d51c0 0x7f67740d5610 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f677409b600 tx=0x7f6768006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:58.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.366 7f6771ffb700 1 -- 172.21.15.79:0/2352026908 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67740baf60 con 0x7f67740d51c0 2021-04-09T18:26:58.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.366 7f6771ffb700 1 -- 172.21.15.79:0/2352026908 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6768010950 con 0x7f67740d51c0 2021-04-09T18:26:58.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.366 7f677b9af700 1 -- 172.21.15.79:0/2352026908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67740b34e0 con 0x7f67740d51c0 2021-04-09T18:26:58.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.366 7f6771ffb700 1 -- 172.21.15.79:0/2352026908 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6768010d20 con 0x7f67740d51c0 2021-04-09T18:26:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.366 7f677b9af700 1 -- 172.21.15.79:0/2352026908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67741d6570 con 0x7f67740d51c0 2021-04-09T18:26:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.366 7f6771ffb700 1 -- 172.21.15.79:0/2352026908 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6768019030 con 0x7f67740d51c0 2021-04-09T18:26:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.366 7f6771ffb700 1 --2- 172.21.15.79:0/2352026908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6754029100 0x7f675402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.366 7f6771ffb700 1 -- 172.21.15.79:0/2352026908 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f6768018040 con 0x7f67740d51c0 2021-04-09T18:26:58.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.366 7f6779753700 1 --2- 172.21.15.79:0/2352026908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6754029100 0x7f675402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:58.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.366 7f6779753700 1 --2- 172.21.15.79:0/2352026908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6754029100 0x7f675402b650 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:58.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.374 7f677b9af700 1 -- 172.21.15.79:0/2352026908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6774088d30 con 0x7f67740d51c0 2021-04-09T18:26:58.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.378 7f6771ffb700 1 -- 172.21.15.79:0/2352026908 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f67680097c0 con 0x7f67740d51c0 2021-04-09T18:26:58.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.538 7f677b9af700 1 -- 172.21.15.79:0/2352026908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f67740e39a0 con 0x7f67740d51c0 2021-04-09T18:26:58.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.546 7f6771ffb700 1 -- 172.21.15.79:0/2352026908 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v9) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6768010740 con 0x7f67740d51c0 2021-04-09T18:26:58.560 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2021-04-09T18:26:58.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.558 7f677b9af700 1 -- 172.21.15.79:0/2352026908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6754029100 msgr2=0x7f675402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:58.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.558 7f677b9af700 1 --2- 172.21.15.79:0/2352026908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6754029100 0x7f675402b650 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.558 7f677b9af700 1 -- 172.21.15.79:0/2352026908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67740d51c0 msgr2=0x7f67740d5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:58.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.558 7f677b9af700 1 --2- 172.21.15.79:0/2352026908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67740d51c0 0x7f67740d5610 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f677409b600 tx=0x7f6768006890).stop 2021-04-09T18:26:58.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.558 7f677b9af700 1 -- 172.21.15.79:0/2352026908 shutdown_connections 2021-04-09T18:26:58.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.558 7f677b9af700 1 --2- 172.21.15.79:0/2352026908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6754029100 0x7f675402b650 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.558 7f677b9af700 1 --2- 172.21.15.79:0/2352026908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67740c4450 0x7f67740c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.558 7f677b9af700 1 --2- 172.21.15.79:0/2352026908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67740bab10 0x7f67740b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.558 7f677b9af700 1 --2- 172.21.15.79:0/2352026908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67740d51c0 0x7f67740d5610 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.558 7f677b9af700 1 -- 172.21.15.79:0/2352026908 >> 172.21.15.79:0/2352026908 conn(0x7f67740bb280 msgr2=0x7f6774095b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:58.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.558 7f677b9af700 1 -- 172.21.15.79:0/2352026908 shutdown_connections 2021-04-09T18:26:58.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.558 7f677b9af700 1 -- 172.21.15.79:0/2352026908 wait complete. 2021-04-09T18:26:58.575 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:26:58.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.670 7f1ab295e700 1 Processor -- start 2021-04-09T18:26:58.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.670 7f1ab295e700 1 -- start start 2021-04-09T18:26:58.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1ab295e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1aac0e9b40 0x7f1aac09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:58.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1ab295e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aac0fbb80 con 0x7f1aac0f5580 2021-04-09T18:26:58.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1ab295e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aac0e56b0 con 0x7f1aac1c7e40 2021-04-09T18:26:58.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1ab295e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aac0e9f90 con 0x7f1aac0e9b40 2021-04-09T18:26:58.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1aabfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1aac0f5580 0x7f1aac0f6510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51690/0 (socket says 172.21.15.79:51690) 2021-04-09T18:26:58.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1aabfff700 1 -- 172.21.15.79:0/933496215 learned_addr learned my addr 172.21.15.79:0/933496215 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:58.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1aab7fe700 1 --2- 172.21.15.79:0/933496215 >> v2:172.21.15.89:3300/0 conn(0x7f1aac0e9b40 0x7f1aac09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:58.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1aaaffd700 1 -- 172.21.15.79:0/933496215 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248634958 0 0) 0x7f1a9c0010d0 con 0x7f1aac0f5580 2021-04-09T18:26:58.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1aaaffd700 1 -- 172.21.15.79:0/933496215 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a94003240 con 0x7f1aac0f5580 2021-04-09T18:26:58.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1aab7fe700 1 -- 172.21.15.79:0/933496215 >> v1:172.21.15.89:6789/0 conn(0x7f1aac1c7e40 legacy=0x7f1aac1ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:58.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1aab7fe700 1 -- 172.21.15.79:0/933496215 >> v1:172.21.15.79:6789/0 conn(0x7f1aac0f5580 legacy=0x7f1aac0f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:58.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1aaaffd700 1 -- 172.21.15.79:0/933496215 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335960362 0 0) 0x7f1aa40010d0 con 0x7f1aac1c7e40 2021-04-09T18:26:58.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1aab7fe700 1 -- 172.21.15.79:0/933496215 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac0e4310 con 0x7f1aac0e9b40 2021-04-09T18:26:58.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1aab7fe700 1 --2- 172.21.15.79:0/933496215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1aac0e9b40 0x7f1aac09f110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f1aa00032b0 tx=0x7f1aa000b0e0).ready entity=mon.1 client_cookie=326ad429bd738928 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:58.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1aaaffd700 1 -- 172.21.15.79:0/933496215 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1aac0e4310 con 0x7f1aac0e9b40 2021-04-09T18:26:58.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1aaaffd700 1 -- 172.21.15.79:0/933496215 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa000bab0 con 0x7f1aac0e9b40 2021-04-09T18:26:58.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1aaaffd700 1 -- 172.21.15.79:0/933496215 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1aa0002020 con 0x7f1aac0e9b40 2021-04-09T18:26:58.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1ab295e700 1 -- 172.21.15.79:0/933496215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1aac0e9b40 msgr2=0x7f1aac09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:58.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1ab295e700 1 --2- 172.21.15.79:0/933496215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1aac0e9b40 0x7f1aac09f110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f1aa00032b0 tx=0x7f1aa000b0e0).stop 2021-04-09T18:26:58.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1ab295e700 1 -- 172.21.15.79:0/933496215 shutdown_connections 2021-04-09T18:26:58.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1ab295e700 1 --2- 172.21.15.79:0/933496215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1aac0e9b40 0x7f1aac09f110 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1ab295e700 1 -- 172.21.15.79:0/933496215 >> 172.21.15.79:0/933496215 conn(0x7f1aac0e6040 msgr2=0x7f1aac0e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:58.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1ab295e700 1 -- 172.21.15.79:0/933496215 shutdown_connections 2021-04-09T18:26:58.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.674 7f1ab295e700 1 -- 172.21.15.79:0/933496215 wait complete. 2021-04-09T18:26:58.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1ab295e700 1 Processor -- start 2021-04-09T18:26:58.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1ab295e700 1 -- start start 2021-04-09T18:26:58.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1ab295e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1aac0c4030 0x7f1aac1c0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:58.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1ab295e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1aac1c0730 0x7f1aac0c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:58.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1ab295e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1aac0c4480 0x7f1aac0ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:58.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1ab295e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0e59b0 con 0x7f1aac1c0730 2021-04-09T18:26:58.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1ab295e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0bc1a0 con 0x7f1aac0c4480 2021-04-09T18:26:58.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1ab295e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0bc4a0 con 0x7f1aac0c4030 2021-04-09T18:26:58.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1aab7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1aac1c0730 0x7f1aac0c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:58.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1aab7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1aac1c0730 0x7f1aac0c7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56988/0 (socket says 172.21.15.79:56988) 2021-04-09T18:26:58.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1aab7fe700 1 -- 172.21.15.79:0/1148327991 learned_addr learned my addr 172.21.15.79:0/1148327991 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:58.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1ab0f03700 1 --2- 172.21.15.79:0/1148327991 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1aac0c4480 0x7f1aac0ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:58.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1aabfff700 1 --2- 172.21.15.79:0/1148327991 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1aac0c4030 0x7f1aac1c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:58.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1aab7fe700 1 -- 172.21.15.79:0/1148327991 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1aac0c4030 msgr2=0x7f1aac1c0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:58.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1aab7fe700 1 --2- 172.21.15.79:0/1148327991 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1aac0c4030 0x7f1aac1c0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1aab7fe700 1 -- 172.21.15.79:0/1148327991 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1aac0c4480 msgr2=0x7f1aac0ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:58.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1aab7fe700 1 --2- 172.21.15.79:0/1148327991 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1aac0c4480 0x7f1aac0ca370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1aab7fe700 1 -- 172.21.15.79:0/1148327991 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac099a60 con 0x7f1aac1c0730 2021-04-09T18:26:58.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1aab7fe700 1 --2- 172.21.15.79:0/1148327991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1aac1c0730 0x7f1aac0c7d30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f1aac09abc0 tx=0x7f1aa0006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:58.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1aa8ff9700 1 -- 172.21.15.79:0/1148327991 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1aac099a60 con 0x7f1aac1c0730 2021-04-09T18:26:58.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1aa8ff9700 1 -- 172.21.15.79:0/1148327991 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa001d840 con 0x7f1aac1c0730 2021-04-09T18:26:58.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1ab295e700 1 -- 172.21.15.79:0/1148327991 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aac1aefc0 con 0x7f1aac1c0730 2021-04-09T18:26:58.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.678 7f1aa8ff9700 1 -- 172.21.15.79:0/1148327991 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1aa001dc10 con 0x7f1aac1c0730 2021-04-09T18:26:58.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.682 7f1ab295e700 1 -- 172.21.15.79:0/1148327991 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aac19dc10 con 0x7f1aac1c0730 2021-04-09T18:26:58.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.682 7f1aa8ff9700 1 -- 172.21.15.79:0/1148327991 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1aa0027460 con 0x7f1aac1c0730 2021-04-09T18:26:58.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.682 7f1aa8ff9700 1 --2- 172.21.15.79:0/1148327991 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1a8c029100 0x7f1a8c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:58.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.682 7f1aa8ff9700 1 -- 172.21.15.79:0/1148327991 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f1aa0003020 con 0x7f1aac1c0730 2021-04-09T18:26:58.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.682 7f1aabfff700 1 --2- 172.21.15.79:0/1148327991 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1a8c029100 0x7f1a8c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:58.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.682 7f1aabfff700 1 --2- 172.21.15.79:0/1148327991 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1a8c029100 0x7f1a8c02b650 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:58.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.686 7f1ab295e700 1 -- 172.21.15.79:0/1148327991 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aac088d30 con 0x7f1aac1c0730 2021-04-09T18:26:58.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.694 7f1aa8ff9700 1 -- 172.21.15.79:0/1148327991 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1aa001d440 con 0x7f1aac1c0730 2021-04-09T18:26:58.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.862 7f1ab295e700 1 -- 172.21.15.79:0/1148327991 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1aac0e39a0 con 0x7f1aac1c0730 2021-04-09T18:26:58.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.870 7f1aa8ff9700 1 -- 172.21.15.79:0/1148327991 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v10) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1aa000b8a0 con 0x7f1aac1c0730 2021-04-09T18:26:58.884 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.1 2021-04-09T18:26:58.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.878 7f1ab295e700 1 -- 172.21.15.79:0/1148327991 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1a8c029100 msgr2=0x7f1a8c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:58.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.878 7f1ab295e700 1 --2- 172.21.15.79:0/1148327991 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1a8c029100 0x7f1a8c02b650 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.878 7f1ab295e700 1 -- 172.21.15.79:0/1148327991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1aac1c0730 msgr2=0x7f1aac0c7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:58.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.878 7f1ab295e700 1 --2- 172.21.15.79:0/1148327991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1aac1c0730 0x7f1aac0c7d30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f1aac09abc0 tx=0x7f1aa0006c10).stop 2021-04-09T18:26:58.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.882 7f1ab295e700 1 -- 172.21.15.79:0/1148327991 shutdown_connections 2021-04-09T18:26:58.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.882 7f1ab295e700 1 --2- 172.21.15.79:0/1148327991 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1a8c029100 0x7f1a8c02b650 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.882 7f1ab295e700 1 --2- 172.21.15.79:0/1148327991 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1aac0c4480 0x7f1aac0ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.882 7f1ab295e700 1 --2- 172.21.15.79:0/1148327991 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1aac0c4030 0x7f1aac1c0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.882 7f1ab295e700 1 --2- 172.21.15.79:0/1148327991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1aac1c0730 0x7f1aac0c7d30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:58.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.882 7f1ab295e700 1 -- 172.21.15.79:0/1148327991 >> 172.21.15.79:0/1148327991 conn(0x7f1aac0a29f0 msgr2=0x7f1aac0d7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:58.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.882 7f1ab295e700 1 -- 172.21.15.79:0/1148327991 shutdown_connections 2021-04-09T18:26:58.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.882 7f1ab295e700 1 -- 172.21.15.79:0/1148327991 wait complete. 2021-04-09T18:26:58.902 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:26:59.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.994 7f3190bda700 1 Processor -- start 2021-04-09T18:26:59.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.994 7f3190bda700 1 -- start start 2021-04-09T18:26:59.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.994 7f3190bda700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f318c0f5580 0x7f318c0f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.994 7f3190bda700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f318c0e9b40 0x7f318c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.994 7f3190bda700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f318c0fbb80 con 0x7f318c1c6e30 2021-04-09T18:26:59.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.994 7f3190bda700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318c0e9f90 con 0x7f318c0f5580 2021-04-09T18:26:59.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.994 7f3190bda700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0e59b0 con 0x7f318c0e9b40 2021-04-09T18:26:59.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f318afe7700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f318c1c6e30 0x7f318c1c9290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51706/0 (socket says 172.21.15.79:51706) 2021-04-09T18:26:59.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f318afe7700 1 -- 172.21.15.79:0/3227101952 learned_addr learned my addr 172.21.15.79:0/3227101952 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:59.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f3189fe5700 1 --2- 172.21.15.79:0/3227101952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f318c0e9b40 0x7f318c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f318a7e6700 1 --2- 172.21.15.79:0/3227101952 >> v2:172.21.15.89:3300/0 conn(0x7f318c0f5580 0x7f318c0f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f31897e4700 1 -- 172.21.15.79:0/3227101952 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987734344 0 0) 0x7f3184001450 con 0x7f318c1c6e30 2021-04-09T18:26:59.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f31897e4700 1 -- 172.21.15.79:0/3227101952 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3178003240 con 0x7f318c1c6e30 2021-04-09T18:26:59.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f3189fe5700 1 -- 172.21.15.79:0/3227101952 >> v2:172.21.15.89:3300/0 conn(0x7f318c0f5580 msgr2=0x7f318c0f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:59.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f3189fe5700 1 --2- 172.21.15.79:0/3227101952 >> v2:172.21.15.89:3300/0 conn(0x7f318c0f5580 0x7f318c0f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f3189fe5700 1 -- 172.21.15.79:0/3227101952 >> v1:172.21.15.79:6789/0 conn(0x7f318c1c6e30 legacy=0x7f318c1c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:59.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f3189fe5700 1 -- 172.21.15.79:0/3227101952 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c0e56b0 con 0x7f318c0e9b40 2021-04-09T18:26:59.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f3189fe5700 1 --2- 172.21.15.79:0/3227101952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f318c0e9b40 0x7f318c09f110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f317c002f30 tx=0x7f317c00bcc0).ready entity=mon.2 client_cookie=a306fcae3354c8b6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:59.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f31897e4700 1 -- 172.21.15.79:0/3227101952 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f318c0e56b0 con 0x7f318c0e9b40 2021-04-09T18:26:59.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f31897e4700 1 -- 172.21.15.79:0/3227101952 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c009800 con 0x7f318c0e9b40 2021-04-09T18:26:59.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f31897e4700 1 -- 172.21.15.79:0/3227101952 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f317c009bd0 con 0x7f318c0e9b40 2021-04-09T18:26:59.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f3190bda700 1 -- 172.21.15.79:0/3227101952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f318c0e9b40 msgr2=0x7f318c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:59.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f3190bda700 1 --2- 172.21.15.79:0/3227101952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f318c0e9b40 0x7f318c09f110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f317c002f30 tx=0x7f317c00bcc0).stop 2021-04-09T18:26:59.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f3190bda700 1 -- 172.21.15.79:0/3227101952 shutdown_connections 2021-04-09T18:26:59.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f3190bda700 1 --2- 172.21.15.79:0/3227101952 >> v2:172.21.15.89:3300/0 conn(0x7f318c0f5580 0x7f318c0f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f3190bda700 1 --2- 172.21.15.79:0/3227101952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f318c0e9b40 0x7f318c09f110 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f3190bda700 1 -- 172.21.15.79:0/3227101952 >> 172.21.15.79:0/3227101952 conn(0x7f318c0e6040 msgr2=0x7f318c0e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:59.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f3190bda700 1 -- 172.21.15.79:0/3227101952 shutdown_connections 2021-04-09T18:26:59.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:58.998 7f3190bda700 1 -- 172.21.15.79:0/3227101952 wait complete. 2021-04-09T18:26:59.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f3190bda700 1 Processor -- start 2021-04-09T18:26:59.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f3190bda700 1 -- start start 2021-04-09T18:26:59.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f3190bda700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f318c1aa940 0x7f318c0d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f3190bda700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f318c0d1920 0x7f318c09a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f3190bda700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f318c09aab0 0x7f318c1a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f3190bda700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0d1620 con 0x7f318c09aab0 2021-04-09T18:26:59.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f3190bda700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c091bf0 con 0x7f318c0d1920 2021-04-09T18:26:59.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f3190bda700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c091e20 con 0x7f318c1aa940 2021-04-09T18:26:59.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f318afe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f318c09aab0 0x7f318c1a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f3189fe5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f318c0d1920 0x7f318c09a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f318afe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f318c09aab0 0x7f318c1a6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57000/0 (socket says 172.21.15.79:57000) 2021-04-09T18:26:59.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f318a7e6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f318c1aa940 0x7f318c0d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f3189fe5700 1 --2- 172.21.15.79:0/1424960029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f318c0d1920 0x7f318c09a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:45340/0 (socket says 172.21.15.79:45340) 2021-04-09T18:26:59.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f318afe7700 1 -- 172.21.15.79:0/1424960029 learned_addr learned my addr 172.21.15.79:0/1424960029 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:59.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f318afe7700 1 -- 172.21.15.79:0/1424960029 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f318c1aa940 msgr2=0x7f318c0d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:59.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f318afe7700 1 --2- 172.21.15.79:0/1424960029 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f318c1aa940 0x7f318c0d0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f318afe7700 1 -- 172.21.15.79:0/1424960029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f318c0d1920 msgr2=0x7f318c09a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:59.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f318afe7700 1 --2- 172.21.15.79:0/1424960029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f318c0d1920 0x7f318c09a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f318afe7700 1 -- 172.21.15.79:0/1424960029 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c09af00 con 0x7f318c09aab0 2021-04-09T18:26:59.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f318afe7700 1 --2- 172.21.15.79:0/1424960029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f318c09aab0 0x7f318c1a6280 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f3184000f00 tx=0x7f318400ce60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:59.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f3182ffd700 1 -- 172.21.15.79:0/1424960029 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f318c09af00 con 0x7f318c09aab0 2021-04-09T18:26:59.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f3182ffd700 1 -- 172.21.15.79:0/1424960029 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3184005b80 con 0x7f318c09aab0 2021-04-09T18:26:59.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f3190bda700 1 -- 172.21.15.79:0/1424960029 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318c09b220 con 0x7f318c09aab0 2021-04-09T18:26:59.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f3182ffd700 1 -- 172.21.15.79:0/1424960029 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3184007110 con 0x7f318c09aab0 2021-04-09T18:26:59.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.002 7f3190bda700 1 -- 172.21.15.79:0/1424960029 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318c1a6a40 con 0x7f318c09aab0 2021-04-09T18:26:59.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.006 7f3182ffd700 1 -- 172.21.15.79:0/1424960029 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f318401a060 con 0x7f318c09aab0 2021-04-09T18:26:59.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.006 7f3182ffd700 1 --2- 172.21.15.79:0/1424960029 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3170029100 0x7f317002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.006 7f3182ffd700 1 -- 172.21.15.79:0/1424960029 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f3184038f60 con 0x7f318c09aab0 2021-04-09T18:26:59.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.006 7f318a7e6700 1 --2- 172.21.15.79:0/1424960029 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3170029100 0x7f317002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.006 7f318a7e6700 1 --2- 172.21.15.79:0/1424960029 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3170029100 0x7f317002b650 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:59.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.010 7f3190bda700 1 -- 172.21.15.79:0/1424960029 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318c088d30 con 0x7f318c09aab0 2021-04-09T18:26:59.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.018 7f3182ffd700 1 -- 172.21.15.79:0/1424960029 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f318c0f7720 con 0x7f318c09aab0 2021-04-09T18:26:59.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.174 7f3190bda700 1 -- 172.21.15.79:0/1424960029 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f318c0e39a0 con 0x7f318c09aab0 2021-04-09T18:26:59.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.182 7f3182ffd700 1 -- 172.21.15.79:0/1424960029 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v11) v1 ==== 184+0+0 (secure 0 0 0) 0x7f3184005970 con 0x7f318c09aab0 2021-04-09T18:26:59.188 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.2 2021-04-09T18:26:59.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.182 7f3190bda700 1 -- 172.21.15.79:0/1424960029 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3170029100 msgr2=0x7f317002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:59.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.182 7f3190bda700 1 --2- 172.21.15.79:0/1424960029 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3170029100 0x7f317002b650 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.182 7f3190bda700 1 -- 172.21.15.79:0/1424960029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f318c09aab0 msgr2=0x7f318c1a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:59.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.182 7f3190bda700 1 --2- 172.21.15.79:0/1424960029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f318c09aab0 0x7f318c1a6280 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f3184000f00 tx=0x7f318400ce60).stop 2021-04-09T18:26:59.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.186 7f3190bda700 1 -- 172.21.15.79:0/1424960029 shutdown_connections 2021-04-09T18:26:59.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.186 7f3190bda700 1 --2- 172.21.15.79:0/1424960029 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3170029100 0x7f317002b650 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.186 7f3190bda700 1 --2- 172.21.15.79:0/1424960029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f318c09aab0 0x7f318c1a6280 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.186 7f3190bda700 1 --2- 172.21.15.79:0/1424960029 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f318c1aa940 0x7f318c0d0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.186 7f3190bda700 1 --2- 172.21.15.79:0/1424960029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f318c0d1920 0x7f318c09a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.186 7f3190bda700 1 -- 172.21.15.79:0/1424960029 >> 172.21.15.79:0/1424960029 conn(0x7f318c092050 msgr2=0x7f318c0bcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:59.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.186 7f3190bda700 1 -- 172.21.15.79:0/1424960029 shutdown_connections 2021-04-09T18:26:59.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.186 7f3190bda700 1 -- 172.21.15.79:0/1424960029 wait complete. 2021-04-09T18:26:59.205 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:26:59.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.290 7fe1c5ed4700 1 Processor -- start 2021-04-09T18:26:59.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.290 7fe1c5ed4700 1 -- start start 2021-04-09T18:26:59.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1c5ed4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe1c00f5510 0x7fe1c00f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1c5ed4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe1c01c8000 0x7fe1c01ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1c5ed4700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c00fbb10 con 0x7fe1c00e9ad0 2021-04-09T18:26:59.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1c5ed4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c00e9f20 con 0x7fe1c00f5510 2021-04-09T18:26:59.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1c5ed4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c01c3db0 con 0x7fe1c01c8000 2021-04-09T18:26:59.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1bf7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe1c00f5510 0x7fe1c00f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1beffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe1c00e9ad0 0x7fe1c009f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51716/0 (socket says 172.21.15.79:51716) 2021-04-09T18:26:59.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1beffd700 1 -- 172.21.15.79:0/511682144 learned_addr learned my addr 172.21.15.79:0/511682144 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:59.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1bffff700 1 --2- 172.21.15.79:0/511682144 >> v2:172.21.15.89:3300/0 conn(0x7fe1c01c8000 0x7fe1c01ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1be7fc700 1 -- 172.21.15.79:0/511682144 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287265775 0 0) 0x7fe1b40010d0 con 0x7fe1c00e9ad0 2021-04-09T18:26:59.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1be7fc700 1 -- 172.21.15.79:0/511682144 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1a8003240 con 0x7fe1c00e9ad0 2021-04-09T18:26:59.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1be7fc700 1 -- 172.21.15.79:0/511682144 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3529583849 0 0) 0x7fe1b4001650 con 0x7fe1c00e9ad0 2021-04-09T18:26:59.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1be7fc700 1 -- 172.21.15.79:0/511682144 >> v2:172.21.15.89:3300/0 conn(0x7fe1c01c8000 msgr2=0x7fe1c01ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:59.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1be7fc700 1 --2- 172.21.15.79:0/511682144 >> v2:172.21.15.89:3300/0 conn(0x7fe1c01c8000 0x7fe1c01ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1be7fc700 1 -- 172.21.15.79:0/511682144 >> v2:172.21.15.79:3300/0 conn(0x7fe1c00f5510 msgr2=0x7fe1c00f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:59.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1be7fc700 1 --2- 172.21.15.79:0/511682144 >> v2:172.21.15.79:3300/0 conn(0x7fe1c00f5510 0x7fe1c00f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1be7fc700 1 -- 172.21.15.79:0/511682144 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c009f900 con 0x7fe1c00e9ad0 2021-04-09T18:26:59.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1be7fc700 1 -- 172.21.15.79:0/511682144 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7fe1b4001bb0 con 0x7fe1c00e9ad0 2021-04-09T18:26:59.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1be7fc700 1 -- 172.21.15.79:0/511682144 >> v1:172.21.15.79:6789/0 conn(0x7fe1c00e9ad0 legacy=0x7fe1c009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:59.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1be7fc700 1 --2- 172.21.15.79:0/511682144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1a8003890 0x7fe1a8003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1be7fc700 1 --2- 172.21.15.79:0/511682144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a80045a0 0x7fe1a8004a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1be7fc700 1 --2- 172.21.15.79:0/511682144 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1a804d7f0 0x7fe1a804fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1be7fc700 1 -- 172.21.15.79:0/511682144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00e9f20 con 0x7fe1a80045a0 2021-04-09T18:26:59.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1be7fc700 1 -- 172.21.15.79:0/511682144 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c01c3db0 con 0x7fe1a8003890 2021-04-09T18:26:59.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1be7fc700 1 -- 172.21.15.79:0/511682144 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a8050280 con 0x7fe1a804d7f0 2021-04-09T18:26:59.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1beffd700 1 --2- 172.21.15.79:0/511682144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a80045a0 0x7fe1a8004a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1bffff700 1 --2- 172.21.15.79:0/511682144 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1a804d7f0 0x7fe1a804fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1bf7fe700 1 --2- 172.21.15.79:0/511682144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1a8003890 0x7fe1a8003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1beffd700 1 -- 172.21.15.79:0/511682144 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1a804d7f0 msgr2=0x7fe1a804fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:59.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1beffd700 1 --2- 172.21.15.79:0/511682144 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1a804d7f0 0x7fe1a804fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1beffd700 1 -- 172.21.15.79:0/511682144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1a8003890 msgr2=0x7fe1a8003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:59.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1beffd700 1 --2- 172.21.15.79:0/511682144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1a8003890 0x7fe1a8003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1beffd700 1 -- 172.21.15.79:0/511682144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a80504f0 con 0x7fe1a80045a0 2021-04-09T18:26:59.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1bffff700 1 -- 172.21.15.79:0/511682144 reap_dead start 2021-04-09T18:26:59.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1bf7fe700 1 --2- 172.21.15.79:0/511682144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1a8003890 0x7fe1a8003d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:59.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1beffd700 1 --2- 172.21.15.79:0/511682144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a80045a0 0x7fe1a8004a10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fe1b4004640 tx=0x7fe1b4005050).ready entity=mon.0 client_cookie=4b9b1d403acf88a6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:59.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1be7fc700 1 -- 172.21.15.79:0/511682144 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1a80504f0 con 0x7fe1a80045a0 2021-04-09T18:26:59.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1be7fc700 1 -- 172.21.15.79:0/511682144 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b4008170 con 0x7fe1a80045a0 2021-04-09T18:26:59.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1be7fc700 1 -- 172.21.15.79:0/511682144 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1c009f900 con 0x7fe1a80045a0 2021-04-09T18:26:59.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1c5ed4700 1 -- 172.21.15.79:0/511682144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a80045a0 msgr2=0x7fe1a8004a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:59.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.294 7fe1c5ed4700 1 --2- 172.21.15.79:0/511682144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a80045a0 0x7fe1a8004a10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fe1b4004640 tx=0x7fe1b4005050).stop 2021-04-09T18:26:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.298 7fe1c5ed4700 1 -- 172.21.15.79:0/511682144 shutdown_connections 2021-04-09T18:26:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.298 7fe1c5ed4700 1 --2- 172.21.15.79:0/511682144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a80045a0 0x7fe1a8004a10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.298 7fe1c5ed4700 1 -- 172.21.15.79:0/511682144 >> 172.21.15.79:0/511682144 conn(0x7fe1c00e5fd0 msgr2=0x7fe1c00e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.298 7fe1c5ed4700 1 -- 172.21.15.79:0/511682144 shutdown_connections 2021-04-09T18:26:59.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.298 7fe1c5ed4700 1 -- 172.21.15.79:0/511682144 wait complete. 2021-04-09T18:26:59.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1c5ed4700 1 Processor -- start 2021-04-09T18:26:59.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1c5ed4700 1 -- start start 2021-04-09T18:26:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1c5ed4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1c00baeb0 0x7fe1c01a0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1c5ed4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c00bb300 0x7fe1c00ae450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1c5ed4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c00aea80 0x7fe1c00d4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1c5ed4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00acbb0 con 0x7fe1c00aea80 2021-04-09T18:26:59.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1c5ed4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00aceb0 con 0x7fe1c00baeb0 2021-04-09T18:26:59.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1c5ed4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00ac440 con 0x7fe1c00bb300 2021-04-09T18:26:59.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1bffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c00aea80 0x7fe1c00d4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1bffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c00aea80 0x7fe1c00d4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57022/0 (socket says 172.21.15.79:57022) 2021-04-09T18:26:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1bffff700 1 -- 172.21.15.79:0/3270531844 learned_addr learned my addr 172.21.15.79:0/3270531844 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1beffd700 1 --2- 172.21.15.79:0/3270531844 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c00bb300 0x7fe1c00ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1bf7fe700 1 --2- 172.21.15.79:0/3270531844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1c00baeb0 0x7fe1c01a0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1bffff700 1 -- 172.21.15.79:0/3270531844 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c00bb300 msgr2=0x7fe1c00ae450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1bffff700 1 --2- 172.21.15.79:0/3270531844 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c00bb300 0x7fe1c00ae450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1bffff700 1 -- 172.21.15.79:0/3270531844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1c00baeb0 msgr2=0x7fe1c01a0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1bffff700 1 --2- 172.21.15.79:0/3270531844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1c00baeb0 0x7fe1c01a0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1bffff700 1 -- 172.21.15.79:0/3270531844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c00ac040 con 0x7fe1c00aea80 2021-04-09T18:26:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1bffff700 1 --2- 172.21.15.79:0/3270531844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c00aea80 0x7fe1c00d4ab0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fe1b800b000 tx=0x7fe1b800a040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1a7fff700 1 -- 172.21.15.79:0/3270531844 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1c00ac040 con 0x7fe1c00aea80 2021-04-09T18:26:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1a7fff700 1 -- 172.21.15.79:0/3270531844 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b800fb40 con 0x7fe1c00aea80 2021-04-09T18:26:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1c5ed4700 1 -- 172.21.15.79:0/3270531844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c01a0b50 con 0x7fe1c00aea80 2021-04-09T18:26:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1a7fff700 1 -- 172.21.15.79:0/3270531844 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1b800f040 con 0x7fe1c00aea80 2021-04-09T18:26:59.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1c5ed4700 1 -- 172.21.15.79:0/3270531844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c00ac760 con 0x7fe1c00aea80 2021-04-09T18:26:59.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1a7fff700 1 -- 172.21.15.79:0/3270531844 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe1b8014440 con 0x7fe1c00aea80 2021-04-09T18:26:59.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.302 7fe1a7fff700 1 --2- 172.21.15.79:0/3270531844 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe1a0029100 0x7fe1a002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.306 7fe1a7fff700 1 -- 172.21.15.79:0/3270531844 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fe1b8010040 con 0x7fe1c00aea80 2021-04-09T18:26:59.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.306 7fe1bf7fe700 1 --2- 172.21.15.79:0/3270531844 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe1a0029100 0x7fe1a002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.306 7fe1bf7fe700 1 --2- 172.21.15.79:0/3270531844 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe1a0029100 0x7fe1a002b650 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:59.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.306 7fe1c5ed4700 1 -- 172.21.15.79:0/3270531844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c00e39d0 con 0x7fe1c00aea80 2021-04-09T18:26:59.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.314 7fe1a7fff700 1 -- 172.21.15.79:0/3270531844 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe1b8000f70 con 0x7fe1c00aea80 2021-04-09T18:26:59.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.482 7fe1c5ed4700 1 -- 172.21.15.79:0/3270531844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1c00f5b10 con 0x7fe1c00aea80 2021-04-09T18:26:59.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.482 7fe1a7fff700 1 -- 172.21.15.79:0/3270531844 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2100 (secure 0 0 0) 0x7fe1b800f930 con 0x7fe1c00aea80 2021-04-09T18:26:59.491 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 11 2021-04-09T18:26:59.492 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:26:59.493 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3417656822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3417656822},{"type":"v1","addr":"172.21.15.79:6833","nonce":3417656822}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":9}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:26:56.614049","modified":"2021-04-09 18:26:57.616754","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4634":{"gid":4634,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/3906387944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3906387944},{"type":"v1","addr":"172.21.15.89:6835","nonce":3906387944}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-04-09T18:26:59.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.486 7fe1c5ed4700 1 -- 172.21.15.79:0/3270531844 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe1a0029100 msgr2=0x7fe1a002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:59.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.486 7fe1c5ed4700 1 --2- 172.21.15.79:0/3270531844 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe1a0029100 0x7fe1a002b650 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.486 7fe1c5ed4700 1 -- 172.21.15.79:0/3270531844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c00aea80 msgr2=0x7fe1c00d4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:59.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.486 7fe1c5ed4700 1 --2- 172.21.15.79:0/3270531844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c00aea80 0x7fe1c00d4ab0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fe1b800b000 tx=0x7fe1b800a040).stop 2021-04-09T18:26:59.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.486 7fe1c5ed4700 1 -- 172.21.15.79:0/3270531844 shutdown_connections 2021-04-09T18:26:59.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.486 7fe1c5ed4700 1 --2- 172.21.15.79:0/3270531844 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe1a0029100 0x7fe1a002b650 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.486 7fe1c5ed4700 1 --2- 172.21.15.79:0/3270531844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1c00baeb0 0x7fe1c01a0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.486 7fe1c5ed4700 1 --2- 172.21.15.79:0/3270531844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c00aea80 0x7fe1c00d4ab0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.486 7fe1c5ed4700 1 --2- 172.21.15.79:0/3270531844 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c00bb300 0x7fe1c00ae450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.486 7fe1c5ed4700 1 -- 172.21.15.79:0/3270531844 >> 172.21.15.79:0/3270531844 conn(0x7fe1c01a12d0 msgr2=0x7fe1c00d7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:59.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.486 7fe1c5ed4700 1 -- 172.21.15.79:0/3270531844 shutdown_connections 2021-04-09T18:26:59.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.486 7fe1c5ed4700 1 -- 172.21.15.79:0/3270531844 wait complete. 2021-04-09T18:26:59.705 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:26:56.614049', 'modified': '2021-04-09 18:26:57.616754', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4634}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4634': {'gid': 4634, 'name': 'b', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6835/3906387944', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 3906387944}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 3906387944}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:26:59.706 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:26:59.706 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2021-04-09T18:26:59.801 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:26:59.801 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:26:59.801 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2021-04-09T18:26:59.802 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 4634, 2021-04-09T18:26:59.802 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2021-04-09T18:26:59.802 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2021-04-09T18:26:59.802 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 3.1814427200000002, 2021-04-09T18:26:59.803 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 11, 2021-04-09T18:26:59.803 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 31, 2021-04-09T18:26:59.803 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 30, 2021-04-09T18:26:59.803 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 9.5572233769999997 2021-04-09T18:26:59.803 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:26:59.807 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 4634, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.1814427200000002, "mdsmap_epoch": 11, "osdmap_epoch": 31, "osdmap_epoch_barrier": 30, "uptime": 9.5572233769999997 } 2021-04-09T18:26:59.808 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:26:59.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.898 7fe05971f700 1 Processor -- start 2021-04-09T18:26:59.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.898 7fe05971f700 1 -- start start 2021-04-09T18:26:59.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.898 7fe05971f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe0541c9010 0x7fe0541cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.898 7fe05971f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0540fbb10 con 0x7fe0540e9ad0 2021-04-09T18:26:59.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.898 7fe05971f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05409f900 con 0x7fe0540f5510 2021-04-09T18:26:59.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.898 7fe05971f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0541c3db0 con 0x7fe0541c9010 2021-04-09T18:26:59.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.898 7fe052a46700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe0540e9ad0 0x7fe05409f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51736/0 (socket says 172.21.15.79:51736) 2021-04-09T18:26:59.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.898 7fe052a46700 1 -- 172.21.15.79:0/3251941069 learned_addr learned my addr 172.21.15.79:0/3251941069 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:26:59.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.898 7fe053a48700 1 --2- 172.21.15.79:0/3251941069 >> v2:172.21.15.89:3300/0 conn(0x7fe0541c9010 0x7fe0541cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.898 7fe052245700 1 -- 172.21.15.79:0/3251941069 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2917903916 0 0) 0x7fe0440010d0 con 0x7fe0540e9ad0 2021-04-09T18:26:59.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.898 7fe052245700 1 -- 172.21.15.79:0/3251941069 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe040003240 con 0x7fe0540e9ad0 2021-04-09T18:26:59.922 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052245700 1 -- 172.21.15.79:0/3251941069 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1855676213 0 0) 0x7fe044001650 con 0x7fe0540e9ad0 2021-04-09T18:26:59.922 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052245700 1 -- 172.21.15.79:0/3251941069 >> v2:172.21.15.89:3300/0 conn(0x7fe0541c9010 msgr2=0x7fe0541cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:59.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052245700 1 --2- 172.21.15.79:0/3251941069 >> v2:172.21.15.89:3300/0 conn(0x7fe0541c9010 0x7fe0541cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052245700 1 -- 172.21.15.79:0/3251941069 >> v1:172.21.15.89:6789/0 conn(0x7fe0540f5510 legacy=0x7fe0540f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:59.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052245700 1 -- 172.21.15.79:0/3251941069 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0540e56c0 con 0x7fe0540e9ad0 2021-04-09T18:26:59.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052245700 1 -- 172.21.15.79:0/3251941069 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7fe044001bb0 con 0x7fe0540e9ad0 2021-04-09T18:26:59.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052245700 1 -- 172.21.15.79:0/3251941069 >> v1:172.21.15.79:6789/0 conn(0x7fe0540e9ad0 legacy=0x7fe05409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:59.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052245700 1 --2- 172.21.15.79:0/3251941069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0400038c0 0x7fe040003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052245700 1 --2- 172.21.15.79:0/3251941069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0400045a0 0x7fe040004a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052245700 1 --2- 172.21.15.79:0/3251941069 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0400097e0 0x7fe04000bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052245700 1 -- 172.21.15.79:0/3251941069 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0541c3db0 con 0x7fe0400038c0 2021-04-09T18:26:59.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052245700 1 -- 172.21.15.79:0/3251941069 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04000c270 con 0x7fe0400045a0 2021-04-09T18:26:59.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052245700 1 -- 172.21.15.79:0/3251941069 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe040050430 con 0x7fe0400097e0 2021-04-09T18:26:59.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052a46700 1 --2- 172.21.15.79:0/3251941069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0400045a0 0x7fe040004a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe053247700 1 --2- 172.21.15.79:0/3251941069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0400038c0 0x7fe040003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe053a48700 1 --2- 172.21.15.79:0/3251941069 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0400097e0 0x7fe04000bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052a46700 1 -- 172.21.15.79:0/3251941069 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0400097e0 msgr2=0x7fe04000bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:59.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052a46700 1 --2- 172.21.15.79:0/3251941069 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0400097e0 0x7fe04000bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052a46700 1 -- 172.21.15.79:0/3251941069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0400038c0 msgr2=0x7fe040003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:59.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052a46700 1 --2- 172.21.15.79:0/3251941069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0400038c0 0x7fe040003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052a46700 1 -- 172.21.15.79:0/3251941069 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0400506a0 con 0x7fe0400045a0 2021-04-09T18:26:59.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe053a48700 1 -- 172.21.15.79:0/3251941069 reap_dead start 2021-04-09T18:26:59.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052a46700 1 --2- 172.21.15.79:0/3251941069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0400045a0 0x7fe040004a10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fe044001db0 tx=0x7fe044005290).ready entity=mon.1 client_cookie=aa5fcd07459e94f9 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:59.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052245700 1 -- 172.21.15.79:0/3251941069 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe0400506a0 con 0x7fe0400045a0 2021-04-09T18:26:59.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052245700 1 -- 172.21.15.79:0/3251941069 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0440053d0 con 0x7fe0400045a0 2021-04-09T18:26:59.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe052245700 1 -- 172.21.15.79:0/3251941069 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe0540e56c0 con 0x7fe0400045a0 2021-04-09T18:26:59.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe05971f700 1 -- 172.21.15.79:0/3251941069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0400045a0 msgr2=0x7fe040004a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:59.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe05971f700 1 --2- 172.21.15.79:0/3251941069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0400045a0 0x7fe040004a10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fe044001db0 tx=0x7fe044005290).stop 2021-04-09T18:26:59.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe05971f700 1 -- 172.21.15.79:0/3251941069 shutdown_connections 2021-04-09T18:26:59.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe05971f700 1 --2- 172.21.15.79:0/3251941069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0400045a0 0x7fe040004a10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe05971f700 1 -- 172.21.15.79:0/3251941069 >> 172.21.15.79:0/3251941069 conn(0x7fe0540e5fd0 msgr2=0x7fe0540e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:59.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe05971f700 1 -- 172.21.15.79:0/3251941069 shutdown_connections 2021-04-09T18:26:59.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.902 7fe05971f700 1 -- 172.21.15.79:0/3251941069 wait complete. 2021-04-09T18:26:59.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe05971f700 1 Processor -- start 2021-04-09T18:26:59.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe05971f700 1 -- start start 2021-04-09T18:26:59.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe05971f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0541af110 0x7fe0540ae440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe05971f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe05419e750 0x7fe05419b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe05971f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0540d7b40 0x7fe0540d7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe05971f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540e9f20 con 0x7fe05419e750 2021-04-09T18:26:59.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe05971f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05419ceb0 con 0x7fe0540d7b40 2021-04-09T18:26:59.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe05971f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05419d1b0 con 0x7fe0541af110 2021-04-09T18:26:59.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe052a46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe05419e750 0x7fe05419b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe052a46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe05419e750 0x7fe05419b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57040/0 (socket says 172.21.15.79:57040) 2021-04-09T18:26:59.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe052a46700 1 -- 172.21.15.79:0/3484359373 learned_addr learned my addr 172.21.15.79:0/3484359373 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:26:59.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe053247700 1 --2- 172.21.15.79:0/3484359373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0541af110 0x7fe0540ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe053a48700 1 --2- 172.21.15.79:0/3484359373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0540d7b40 0x7fe0540d7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe052a46700 1 -- 172.21.15.79:0/3484359373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0541af110 msgr2=0x7fe0540ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:59.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe052a46700 1 --2- 172.21.15.79:0/3484359373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0541af110 0x7fe0540ae440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe052a46700 1 -- 172.21.15.79:0/3484359373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0540d7b40 msgr2=0x7fe0540d7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:59.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe052a46700 1 --2- 172.21.15.79:0/3484359373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0540d7b40 0x7fe0540d7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:59.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe052a46700 1 -- 172.21.15.79:0/3484359373 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05419c740 con 0x7fe05419e750 2021-04-09T18:26:59.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe052a46700 1 --2- 172.21.15.79:0/3484359373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe05419e750 0x7fe05419b9d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fe044001db0 tx=0x7fe0440086f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:59.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe04bfff700 1 -- 172.21.15.79:0/3484359373 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe05419c740 con 0x7fe05419e750 2021-04-09T18:26:59.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe04bfff700 1 -- 172.21.15.79:0/3484359373 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe044001250 con 0x7fe05419e750 2021-04-09T18:26:59.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe05971f700 1 -- 172.21.15.79:0/3484359373 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0540aea70 con 0x7fe05419e750 2021-04-09T18:26:59.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe04bfff700 1 -- 172.21.15.79:0/3484359373 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe04401c070 con 0x7fe05419e750 2021-04-09T18:26:59.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.906 7fe05971f700 1 -- 172.21.15.79:0/3484359373 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05419c190 con 0x7fe05419e750 2021-04-09T18:26:59.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.910 7fe04bfff700 1 -- 172.21.15.79:0/3484359373 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe044005b00 con 0x7fe05419e750 2021-04-09T18:26:59.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.910 7fe04bfff700 1 --2- 172.21.15.79:0/3484359373 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe038029100 0x7fe03802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:59.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.910 7fe04bfff700 1 -- 172.21.15.79:0/3484359373 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fe04403a810 con 0x7fe05419e750 2021-04-09T18:26:59.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.910 7fe053247700 1 --2- 172.21.15.79:0/3484359373 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe038029100 0x7fe03802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:59.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.910 7fe053247700 1 --2- 172.21.15.79:0/3484359373 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe038029100 0x7fe03802b650 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:59.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.914 7fe05971f700 1 -- 172.21.15.79:0/3484359373 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0540e39d0 con 0x7fe05419e750 2021-04-09T18:26:59.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:26:59.922 7fe04bfff700 1 -- 172.21.15.79:0/3484359373 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe0440055f0 con 0x7fe05419e750 2021-04-09T18:27:00.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.094 7fe05971f700 1 -- 172.21.15.79:0/3484359373 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0540a1cb0 con 0x7fe05419e750 2021-04-09T18:27:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.094 7fe04bfff700 1 -- 172.21.15.79:0/3484359373 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+14226 (secure 0 0 0) 0x7fe044000e50 con 0x7fe05419e750 2021-04-09T18:27:00.102 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:27:00.102 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":31,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:26:57.617381","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:26:54.507577","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2021-04-09 18:26:55.665017","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:27:00.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.098 7fe05971f700 1 -- 172.21.15.79:0/3484359373 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe038029100 msgr2=0x7fe03802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:00.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.098 7fe05971f700 1 --2- 172.21.15.79:0/3484359373 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe038029100 0x7fe03802b650 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.098 7fe05971f700 1 -- 172.21.15.79:0/3484359373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe05419e750 msgr2=0x7fe05419b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:00.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.098 7fe05971f700 1 --2- 172.21.15.79:0/3484359373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe05419e750 0x7fe05419b9d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fe044001db0 tx=0x7fe0440086f0).stop 2021-04-09T18:27:00.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.098 7fe05971f700 1 -- 172.21.15.79:0/3484359373 shutdown_connections 2021-04-09T18:27:00.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.098 7fe05971f700 1 --2- 172.21.15.79:0/3484359373 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe038029100 0x7fe03802b650 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.098 7fe05971f700 1 --2- 172.21.15.79:0/3484359373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0540d7b40 0x7fe0540d7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.098 7fe05971f700 1 --2- 172.21.15.79:0/3484359373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0541af110 0x7fe0540ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.098 7fe05971f700 1 --2- 172.21.15.79:0/3484359373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe05419e750 0x7fe05419b9d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.098 7fe05971f700 1 -- 172.21.15.79:0/3484359373 >> 172.21.15.79:0/3484359373 conn(0x7fe05409b0a0 msgr2=0x7fe0540af6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:00.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.098 7fe05971f700 1 -- 172.21.15.79:0/3484359373 shutdown_connections 2021-04-09T18:27:00.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.098 7fe05971f700 1 -- 172.21.15.79:0/3484359373 wait complete. 2021-04-09T18:27:00.116 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:26:54.507577', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:26:55.665017', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:27:00.117 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:27:00.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.206 7f027ab41700 1 Processor -- start 2021-04-09T18:27:00.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.206 7f027ab41700 1 -- start start 2021-04-09T18:27:00.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f027ab41700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02740f5540 0x7f02740f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f027ab41700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f02740e9b00 0x7f027409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f027ab41700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f02741c2dd0 0x7f02741c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f027ab41700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02740e9f50 con 0x7f02741c2dd0 2021-04-09T18:27:00.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f027ab41700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02740e59f0 con 0x7f02740e9b00 2021-04-09T18:27:00.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f027ab41700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02740fbb40 con 0x7f02740f5540 2021-04-09T18:27:00.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f02790e6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f02741c2dd0 0x7f02741c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f02790e6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f02741c2dd0 0x7f02741c3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57050/0 (socket says 172.21.15.79:57050) 2021-04-09T18:27:00.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f02790e6700 1 -- 172.21.15.79:0/2349029554 learned_addr learned my addr 172.21.15.79:0/2349029554 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:27:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f0273fff700 1 --2- 172.21.15.79:0/2349029554 >> v2:172.21.15.89:3300/0 conn(0x7f02740e9b00 0x7f027409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f02788e5700 1 --2- 172.21.15.79:0/2349029554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02740f5540 0x7f02740f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f02790e6700 1 -- 172.21.15.79:0/2349029554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02740f5540 msgr2=0x7f02740f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f02790e6700 1 --2- 172.21.15.79:0/2349029554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02740f5540 0x7f02740f64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f02790e6700 1 -- 172.21.15.79:0/2349029554 >> v2:172.21.15.89:3300/0 conn(0x7f02740e9b00 msgr2=0x7f027409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f02790e6700 1 --2- 172.21.15.79:0/2349029554 >> v2:172.21.15.89:3300/0 conn(0x7f02740e9b00 0x7f027409f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f02790e6700 1 -- 172.21.15.79:0/2349029554 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02740e56f0 con 0x7f02741c2dd0 2021-04-09T18:27:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f02788e5700 1 --2- 172.21.15.79:0/2349029554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02740f5540 0x7f02740f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:27:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f02790e6700 1 --2- 172.21.15.79:0/2349029554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02741c2dd0 0x7f02741c3220 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f026c0032b0 tx=0x7f026c00b3c0).ready entity=mon.0 client_cookie=70ec56ba94b43d7c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f02737fe700 1 -- 172.21.15.79:0/2349029554 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f02740e56f0 con 0x7f02741c2dd0 2021-04-09T18:27:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f02737fe700 1 -- 172.21.15.79:0/2349029554 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026c00bc20 con 0x7f02741c2dd0 2021-04-09T18:27:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f02737fe700 1 -- 172.21.15.79:0/2349029554 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f026c002020 con 0x7f02741c2dd0 2021-04-09T18:27:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f027ab41700 1 -- 172.21.15.79:0/2349029554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02741c2dd0 msgr2=0x7f02741c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:00.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f027ab41700 1 --2- 172.21.15.79:0/2349029554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02741c2dd0 0x7f02741c3220 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f026c0032b0 tx=0x7f026c00b3c0).stop 2021-04-09T18:27:00.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f027ab41700 1 -- 172.21.15.79:0/2349029554 shutdown_connections 2021-04-09T18:27:00.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f027ab41700 1 --2- 172.21.15.79:0/2349029554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02740f5540 0x7f02740f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f027ab41700 1 --2- 172.21.15.79:0/2349029554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02741c2dd0 0x7f02741c3220 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f027ab41700 1 --2- 172.21.15.79:0/2349029554 >> v2:172.21.15.89:3300/0 conn(0x7f02740e9b00 0x7f027409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f027ab41700 1 -- 172.21.15.79:0/2349029554 >> 172.21.15.79:0/2349029554 conn(0x7f02740e6000 msgr2=0x7f02740e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f027ab41700 1 -- 172.21.15.79:0/2349029554 shutdown_connections 2021-04-09T18:27:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.210 7f027ab41700 1 -- 172.21.15.79:0/2349029554 wait complete. 2021-04-09T18:27:00.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f027ab41700 1 Processor -- start 2021-04-09T18:27:00.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f027ab41700 1 -- start start 2021-04-09T18:27:00.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f027ab41700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0274091470 0x7f02740be5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f027ab41700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02740add10 0x7f02740ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f027ab41700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0274099c90 0x7f027409a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f027ab41700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0274099990 con 0x7f02740add10 2021-04-09T18:27:00.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f027ab41700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027409a710 con 0x7f0274099c90 2021-04-09T18:27:00.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f027ab41700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02740918c0 con 0x7f0274091470 2021-04-09T18:27:00.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f0273fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02740add10 0x7f02740ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f0273fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02740add10 0x7f02740ae160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57054/0 (socket says 172.21.15.79:57054) 2021-04-09T18:27:00.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f0273fff700 1 -- 172.21.15.79:0/803093078 learned_addr learned my addr 172.21.15.79:0/803093078 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:27:00.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f02790e6700 1 --2- 172.21.15.79:0/803093078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0274099c90 0x7f027409a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f02788e5700 1 --2- 172.21.15.79:0/803093078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0274091470 0x7f02740be5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f0273fff700 1 -- 172.21.15.79:0/803093078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0274091470 msgr2=0x7f02740be5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:00.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f0273fff700 1 --2- 172.21.15.79:0/803093078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0274091470 0x7f02740be5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f0273fff700 1 -- 172.21.15.79:0/803093078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0274099c90 msgr2=0x7f027409a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:00.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f0273fff700 1 --2- 172.21.15.79:0/803093078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0274099c90 0x7f027409a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f0273fff700 1 -- 172.21.15.79:0/803093078 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02740bebf0 con 0x7f02740add10 2021-04-09T18:27:00.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f02788e5700 1 --2- 172.21.15.79:0/803093078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0274091470 0x7f02740be5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:27:00.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f0273fff700 1 --2- 172.21.15.79:0/803093078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02740add10 0x7f02740ae160 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f0268006920 tx=0x7f026800c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:00.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f02717fa700 1 -- 172.21.15.79:0/803093078 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f02740bebf0 con 0x7f02740add10 2021-04-09T18:27:00.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.214 7f02717fa700 1 -- 172.21.15.79:0/803093078 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026800cbb0 con 0x7f02740add10 2021-04-09T18:27:00.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.218 7f027ab41700 1 -- 172.21.15.79:0/803093078 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0274098420 con 0x7f02740add10 2021-04-09T18:27:00.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.218 7f02717fa700 1 -- 172.21.15.79:0/803093078 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f026800f040 con 0x7f02740add10 2021-04-09T18:27:00.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.218 7f027ab41700 1 -- 172.21.15.79:0/803093078 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02740973a0 con 0x7f02740add10 2021-04-09T18:27:00.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.218 7f02717fa700 1 -- 172.21.15.79:0/803093078 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0268011070 con 0x7f02740add10 2021-04-09T18:27:00.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.218 7f02717fa700 1 --2- 172.21.15.79:0/803093078 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0254029100 0x7f025402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.218 7f02717fa700 1 -- 172.21.15.79:0/803093078 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f0268010040 con 0x7f02740add10 2021-04-09T18:27:00.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.218 7f02788e5700 1 --2- 172.21.15.79:0/803093078 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0254029100 0x7f025402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.218 7f02788e5700 1 --2- 172.21.15.79:0/803093078 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0254029100 0x7f025402b650 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:00.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.222 7f027ab41700 1 -- 172.21.15.79:0/803093078 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02740e39e0 con 0x7f02740add10 2021-04-09T18:27:00.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.226 7f02717fa700 1 -- 172.21.15.79:0/803093078 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0268000bf0 con 0x7f02740add10 2021-04-09T18:27:00.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.382 7f027ab41700 1 -- 172.21.15.79:0/803093078 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f02740f5b40 con 0x7f02740add10 2021-04-09T18:27:00.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.382 7f02717fa700 1 -- 172.21.15.79:0/803093078 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f026800c7b0 con 0x7f02740add10 2021-04-09T18:27:00.389 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:27:00.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.386 7f027ab41700 1 -- 172.21.15.79:0/803093078 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0254029100 msgr2=0x7f025402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:00.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.386 7f027ab41700 1 --2- 172.21.15.79:0/803093078 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0254029100 0x7f025402b650 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.386 7f027ab41700 1 -- 172.21.15.79:0/803093078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02740add10 msgr2=0x7f02740ae160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:00.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.386 7f027ab41700 1 --2- 172.21.15.79:0/803093078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02740add10 0x7f02740ae160 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f0268006920 tx=0x7f026800c150).stop 2021-04-09T18:27:00.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.386 7f027ab41700 1 -- 172.21.15.79:0/803093078 shutdown_connections 2021-04-09T18:27:00.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.386 7f027ab41700 1 --2- 172.21.15.79:0/803093078 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0254029100 0x7f025402b650 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.386 7f027ab41700 1 --2- 172.21.15.79:0/803093078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0274099c90 0x7f027409a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.386 7f027ab41700 1 --2- 172.21.15.79:0/803093078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0274091470 0x7f02740be5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.386 7f027ab41700 1 --2- 172.21.15.79:0/803093078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02740add10 0x7f02740ae160 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.386 7f027ab41700 1 -- 172.21.15.79:0/803093078 >> 172.21.15.79:0/803093078 conn(0x7f02740901e0 msgr2=0x7f027408f580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.386 7f027ab41700 1 -- 172.21.15.79:0/803093078 shutdown_connections 2021-04-09T18:27:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.386 7f027ab41700 1 -- 172.21.15.79:0/803093078 wait complete. 2021-04-09T18:27:00.401 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:27:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c1d330700 1 Processor -- start 2021-04-09T18:27:00.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c1d330700 1 -- start start 2021-04-09T18:27:00.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c1d330700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2c180f5550 0x7f2c180f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c1d330700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c181c8040 0x7f2c181ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c1d330700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c180fbb50 con 0x7f2c180e9b10 2021-04-09T18:27:00.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c1d330700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c180e9f60 con 0x7f2c180f5550 2021-04-09T18:27:00.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c1d330700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c181c3df0 con 0x7f2c181c8040 2021-04-09T18:27:00.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16804700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2c180e9b10 0x7f2c1809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51770/0 (socket says 172.21.15.79:51770) 2021-04-09T18:27:00.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16804700 1 -- 172.21.15.79:0/1693825368 learned_addr learned my addr 172.21.15.79:0/1693825368 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:27:00.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c17806700 1 --2- 172.21.15.79:0/1693825368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c181c8040 0x7f2c181ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c17005700 1 --2- 172.21.15.79:0/1693825368 >> v2:172.21.15.89:3300/0 conn(0x7f2c180f5550 0x7f2c180f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16003700 1 -- 172.21.15.79:0/1693825368 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038335602 0 0) 0x7f2c00001450 con 0x7f2c180e9b10 2021-04-09T18:27:00.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16003700 1 -- 172.21.15.79:0/1693825368 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c04003240 con 0x7f2c180e9b10 2021-04-09T18:27:00.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16003700 1 -- 172.21.15.79:0/1693825368 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1279737949 0 0) 0x7f2c000019d0 con 0x7f2c180e9b10 2021-04-09T18:27:00.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16003700 1 -- 172.21.15.79:0/1693825368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c181c8040 msgr2=0x7f2c181ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:00.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16003700 1 --2- 172.21.15.79:0/1693825368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c181c8040 0x7f2c181ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16003700 1 -- 172.21.15.79:0/1693825368 >> v2:172.21.15.89:3300/0 conn(0x7f2c180f5550 msgr2=0x7f2c180f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:00.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16003700 1 --2- 172.21.15.79:0/1693825368 >> v2:172.21.15.89:3300/0 conn(0x7f2c180f5550 0x7f2c180f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16003700 1 -- 172.21.15.79:0/1693825368 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1809f910 con 0x7f2c180e9b10 2021-04-09T18:27:00.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16003700 1 -- 172.21.15.79:0/1693825368 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f2c00001f30 con 0x7f2c180e9b10 2021-04-09T18:27:00.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c17806700 1 --2- 172.21.15.79:0/1693825368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c181c8040 0x7f2c181ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:27:00.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16003700 1 -- 172.21.15.79:0/1693825368 >> v1:172.21.15.79:6789/0 conn(0x7f2c180e9b10 legacy=0x7f2c1809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:00.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16003700 1 --2- 172.21.15.79:0/1693825368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c040038f0 0x7f2c04003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16003700 1 --2- 172.21.15.79:0/1693825368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c040045a0 0x7f2c040049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16003700 1 --2- 172.21.15.79:0/1693825368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c04005020 0x7f2c0404f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16003700 1 -- 172.21.15.79:0/1693825368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c180e9f60 con 0x7f2c04005020 2021-04-09T18:27:00.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16003700 1 -- 172.21.15.79:0/1693825368 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c181c3df0 con 0x7f2c040038f0 2021-04-09T18:27:00.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16003700 1 -- 172.21.15.79:0/1693825368 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0404ffc0 con 0x7f2c040045a0 2021-04-09T18:27:00.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c17005700 1 --2- 172.21.15.79:0/1693825368 >> v2:172.21.15.89:3300/0 conn(0x7f2c180f5550 0x7f2c180f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:27:00.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c17806700 1 --2- 172.21.15.79:0/1693825368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c04005020 0x7f2c0404f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16804700 1 --2- 172.21.15.79:0/1693825368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c040045a0 0x7f2c040049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c17806700 1 -- 172.21.15.79:0/1693825368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c040045a0 msgr2=0x7f2c040049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:00.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c17806700 1 --2- 172.21.15.79:0/1693825368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c040045a0 0x7f2c040049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c17005700 1 --2- 172.21.15.79:0/1693825368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c040038f0 0x7f2c04003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c17806700 1 -- 172.21.15.79:0/1693825368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c040038f0 msgr2=0x7f2c04003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:00.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c17806700 1 --2- 172.21.15.79:0/1693825368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c040038f0 0x7f2c04003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c17806700 1 -- 172.21.15.79:0/1693825368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c04050220 con 0x7f2c04005020 2021-04-09T18:27:00.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c17005700 1 --2- 172.21.15.79:0/1693825368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c040038f0 0x7f2c04003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:27:00.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c17806700 1 --2- 172.21.15.79:0/1693825368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c04005020 0x7f2c0404f800 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f2c1000c000 tx=0x7f2c1000e4b0).ready entity=mon.0 client_cookie=b2ca07dc906edfd2 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:00.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16003700 1 -- 172.21.15.79:0/1693825368 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c04050220 con 0x7f2c04005020 2021-04-09T18:27:00.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16003700 1 -- 172.21.15.79:0/1693825368 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c100123f0 con 0x7f2c04005020 2021-04-09T18:27:00.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c16003700 1 -- 172.21.15.79:0/1693825368 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c1000f040 con 0x7f2c04005020 2021-04-09T18:27:00.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c1d330700 1 -- 172.21.15.79:0/1693825368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c04005020 msgr2=0x7f2c0404f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:00.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c1d330700 1 --2- 172.21.15.79:0/1693825368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c04005020 0x7f2c0404f800 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f2c1000c000 tx=0x7f2c1000e4b0).stop 2021-04-09T18:27:00.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.494 7f2c17806700 1 -- 172.21.15.79:0/1693825368 reap_dead start 2021-04-09T18:27:00.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.498 7f2c1d330700 1 -- 172.21.15.79:0/1693825368 shutdown_connections 2021-04-09T18:27:00.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.498 7f2c1d330700 1 -- 172.21.15.79:0/1693825368 >> 172.21.15.79:0/1693825368 conn(0x7f2c180e6010 msgr2=0x7f2c180e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:00.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.498 7f2c1d330700 1 -- 172.21.15.79:0/1693825368 shutdown_connections 2021-04-09T18:27:00.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.498 7f2c1d330700 1 -- 172.21.15.79:0/1693825368 wait complete. 2021-04-09T18:27:00.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.498 7f2c1d330700 1 Processor -- start 2021-04-09T18:27:00.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.498 7f2c1d330700 1 -- start start 2021-04-09T18:27:00.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.498 7f2c1d330700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c180d6410 0x7f2c1819de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.498 7f2c1d330700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c180d6860 0x7f2c1819e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.498 7f2c1d330700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c181abd00 0x7f2c181ac150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.498 7f2c1d330700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1819c880 con 0x7f2c180d6410 2021-04-09T18:27:00.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.498 7f2c1d330700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1819ba10 con 0x7f2c180d6860 2021-04-09T18:27:00.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.498 7f2c1d330700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1819bd50 con 0x7f2c181abd00 2021-04-09T18:27:00.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.502 7f2c17005700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c180d6410 0x7f2c1819de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.502 7f2c17005700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c180d6410 0x7f2c1819de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57074/0 (socket says 172.21.15.79:57074) 2021-04-09T18:27:00.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.502 7f2c17005700 1 -- 172.21.15.79:0/2950014406 learned_addr learned my addr 172.21.15.79:0/2950014406 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:27:00.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.502 7f2c17806700 1 --2- 172.21.15.79:0/2950014406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c181abd00 0x7f2c181ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.502 7f2c16804700 1 --2- 172.21.15.79:0/2950014406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c180d6860 0x7f2c1819e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.502 7f2c17005700 1 -- 172.21.15.79:0/2950014406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c181abd00 msgr2=0x7f2c181ac150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:00.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.502 7f2c17005700 1 --2- 172.21.15.79:0/2950014406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c181abd00 0x7f2c181ac150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.502 7f2c17005700 1 -- 172.21.15.79:0/2950014406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c180d6860 msgr2=0x7f2c1819e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:00.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.502 7f2c17005700 1 --2- 172.21.15.79:0/2950014406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c180d6860 0x7f2c1819e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.502 7f2c17005700 1 -- 172.21.15.79:0/2950014406 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c180a35e0 con 0x7f2c180d6410 2021-04-09T18:27:00.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.502 7f2c17005700 1 --2- 172.21.15.79:0/2950014406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c180d6410 0x7f2c1819de20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f2c0800b000 tx=0x7f2c0800fd30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:00.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.502 7f2c0ffff700 1 -- 172.21.15.79:0/2950014406 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c180a35e0 con 0x7f2c180d6410 2021-04-09T18:27:00.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.502 7f2c0ffff700 1 -- 172.21.15.79:0/2950014406 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0800d9b0 con 0x7f2c180d6410 2021-04-09T18:27:00.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.502 7f2c0ffff700 1 -- 172.21.15.79:0/2950014406 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c08018070 con 0x7f2c180d6410 2021-04-09T18:27:00.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.502 7f2c1d330700 1 -- 172.21.15.79:0/2950014406 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c181ac780 con 0x7f2c180d6410 2021-04-09T18:27:00.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.502 7f2c1d330700 1 -- 172.21.15.79:0/2950014406 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c181af2f0 con 0x7f2c180d6410 2021-04-09T18:27:00.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.502 7f2c0ffff700 1 -- 172.21.15.79:0/2950014406 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2c08013400 con 0x7f2c180d6410 2021-04-09T18:27:00.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.502 7f2c0ffff700 1 --2- 172.21.15.79:0/2950014406 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2bfc029100 0x7f2bfc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.502 7f2c0ffff700 1 -- 172.21.15.79:0/2950014406 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f2c08039940 con 0x7f2c180d6410 2021-04-09T18:27:00.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.502 7f2c16804700 1 --2- 172.21.15.79:0/2950014406 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2bfc029100 0x7f2bfc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.506 7f2c16804700 1 --2- 172.21.15.79:0/2950014406 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2bfc029100 0x7f2bfc02b650 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:00.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.506 7f2c1d330700 1 -- 172.21.15.79:0/2950014406 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c180e39f0 con 0x7f2c180d6410 2021-04-09T18:27:00.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.514 7f2c0ffff700 1 -- 172.21.15.79:0/2950014406 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2c18107f80 con 0x7f2c180d6410 2021-04-09T18:27:00.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.666 7f2c1d330700 1 -- 172.21.15.79:0/2950014406 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f2c18087550 con 0x7f2c180d6410 2021-04-09T18:27:00.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.666 7f2c0ffff700 1 -- 172.21.15.79:0/2950014406 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v31) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2c0800d5b0 con 0x7f2c180d6410 2021-04-09T18:27:00.674 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:27:00.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.670 7f2c1d330700 1 -- 172.21.15.79:0/2950014406 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2bfc029100 msgr2=0x7f2bfc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:00.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.670 7f2c1d330700 1 --2- 172.21.15.79:0/2950014406 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2bfc029100 0x7f2bfc02b650 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.670 7f2c1d330700 1 -- 172.21.15.79:0/2950014406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c180d6410 msgr2=0x7f2c1819de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:00.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.670 7f2c1d330700 1 --2- 172.21.15.79:0/2950014406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c180d6410 0x7f2c1819de20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f2c0800b000 tx=0x7f2c0800fd30).stop 2021-04-09T18:27:00.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.670 7f2c1d330700 1 -- 172.21.15.79:0/2950014406 shutdown_connections 2021-04-09T18:27:00.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.670 7f2c1d330700 1 --2- 172.21.15.79:0/2950014406 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2bfc029100 0x7f2bfc02b650 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.670 7f2c1d330700 1 --2- 172.21.15.79:0/2950014406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c181abd00 0x7f2c181ac150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.670 7f2c1d330700 1 --2- 172.21.15.79:0/2950014406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c180d6410 0x7f2c1819de20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.670 7f2c1d330700 1 --2- 172.21.15.79:0/2950014406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c180d6860 0x7f2c1819e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.670 7f2c1d330700 1 -- 172.21.15.79:0/2950014406 >> 172.21.15.79:0/2950014406 conn(0x7f2c180c3690 msgr2=0x7f2c180d8570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:00.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.670 7f2c1d330700 1 -- 172.21.15.79:0/2950014406 shutdown_connections 2021-04-09T18:27:00.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.670 7f2c1d330700 1 -- 172.21.15.79:0/2950014406 wait complete. 2021-04-09T18:27:00.686 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:27:00.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.786 7f1273e66700 1 Processor -- start 2021-04-09T18:27:00.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1273e66700 1 -- start start 2021-04-09T18:27:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1273e66700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f126c0f5550 0x7f126c0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1273e66700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f126c1c8040 0x7f126c1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1273e66700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126c0fbb50 con 0x7f126c0e9b10 2021-04-09T18:27:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1273e66700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c0e9f60 con 0x7f126c0f5550 2021-04-09T18:27:00.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1273e66700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c1c3df0 con 0x7f126c1c8040 2021-04-09T18:27:00.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1271c0a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f126c0f5550 0x7f126c0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1271c0a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f126c0f5550 0x7f126c0f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57080/0 (socket says 172.21.15.79:57080) 2021-04-09T18:27:00.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1271c0a700 1 -- 172.21.15.79:0/1634272951 learned_addr learned my addr 172.21.15.79:0/1634272951 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:27:00.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f127240b700 1 --2- 172.21.15.79:0/1634272951 >> v2:172.21.15.89:3300/0 conn(0x7f126c1c8040 0x7f126c1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1271c0a700 1 -- 172.21.15.79:0/1634272951 >> v2:172.21.15.89:3300/0 conn(0x7f126c1c8040 msgr2=0x7f126c1ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:00.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1271c0a700 1 --2- 172.21.15.79:0/1634272951 >> v2:172.21.15.89:3300/0 conn(0x7f126c1c8040 0x7f126c1ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1271c0a700 1 -- 172.21.15.79:0/1634272951 >> v1:172.21.15.89:6789/0 conn(0x7f126c0e9b10 legacy=0x7f126c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:00.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1271c0a700 1 -- 172.21.15.79:0/1634272951 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c09f910 con 0x7f126c0f5550 2021-04-09T18:27:00.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f127240b700 1 --2- 172.21.15.79:0/1634272951 >> v2:172.21.15.89:3300/0 conn(0x7f126c1c8040 0x7f126c1ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:27:00.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1271c0a700 1 --2- 172.21.15.79:0/1634272951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f126c0f5550 0x7f126c0f64e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f1268002f30 tx=0x7f126800bd70).ready entity=mon.0 client_cookie=a5d592b7b9d306d6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:00.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1270c08700 1 -- 172.21.15.79:0/1634272951 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f126c09f910 con 0x7f126c0f5550 2021-04-09T18:27:00.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1270c08700 1 -- 172.21.15.79:0/1634272951 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1268009950 con 0x7f126c0f5550 2021-04-09T18:27:00.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1270c08700 1 -- 172.21.15.79:0/1634272951 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1268009d20 con 0x7f126c0f5550 2021-04-09T18:27:00.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1273e66700 1 -- 172.21.15.79:0/1634272951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f126c0f5550 msgr2=0x7f126c0f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:00.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1273e66700 1 --2- 172.21.15.79:0/1634272951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f126c0f5550 0x7f126c0f64e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f1268002f30 tx=0x7f126800bd70).stop 2021-04-09T18:27:00.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1273e66700 1 -- 172.21.15.79:0/1634272951 shutdown_connections 2021-04-09T18:27:00.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1273e66700 1 --2- 172.21.15.79:0/1634272951 >> v2:172.21.15.89:3300/0 conn(0x7f126c1c8040 0x7f126c1ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1273e66700 1 --2- 172.21.15.79:0/1634272951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f126c0f5550 0x7f126c0f64e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1273e66700 1 -- 172.21.15.79:0/1634272951 >> 172.21.15.79:0/1634272951 conn(0x7f126c0e6010 msgr2=0x7f126c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:00.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1273e66700 1 -- 172.21.15.79:0/1634272951 shutdown_connections 2021-04-09T18:27:00.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.790 7f1273e66700 1 -- 172.21.15.79:0/1634272951 wait complete. 2021-04-09T18:27:00.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.794 7f1273e66700 1 Processor -- start 2021-04-09T18:27:00.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.794 7f1273e66700 1 -- start start 2021-04-09T18:27:00.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.794 7f1273e66700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f126c0d0160 0x7f126c0d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.794 7f1273e66700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f126c1a87f0 0x7f126c1a8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.794 7f1273e66700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f126c0d7c10 0x7f126c0d8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.794 7f1273e66700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c19d370 con 0x7f126c0d7c10 2021-04-09T18:27:00.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.794 7f1273e66700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c1a9270 con 0x7f126c0d0160 2021-04-09T18:27:00.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.794 7f1273e66700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c0aa750 con 0x7f126c1a87f0 2021-04-09T18:27:00.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.794 7f127240b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f126c0d7c10 0x7f126c0d8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.794 7f127240b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f126c0d7c10 0x7f126c0d8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57086/0 (socket says 172.21.15.79:57086) 2021-04-09T18:27:00.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.794 7f127240b700 1 -- 172.21.15.79:0/2493981897 learned_addr learned my addr 172.21.15.79:0/2493981897 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:27:00.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.794 7f1271c0a700 1 --2- 172.21.15.79:0/2493981897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f126c0d0160 0x7f126c0d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.794 7f1271409700 1 --2- 172.21.15.79:0/2493981897 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f126c1a87f0 0x7f126c1a8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.794 7f127240b700 1 -- 172.21.15.79:0/2493981897 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f126c1a87f0 msgr2=0x7f126c1a8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:00.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.794 7f127240b700 1 --2- 172.21.15.79:0/2493981897 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f126c1a87f0 0x7f126c1a8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.794 7f127240b700 1 -- 172.21.15.79:0/2493981897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f126c0d0160 msgr2=0x7f126c0d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:00.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.794 7f127240b700 1 --2- 172.21.15.79:0/2493981897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f126c0d0160 0x7f126c0d05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.794 7f127240b700 1 -- 172.21.15.79:0/2493981897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c19cf00 con 0x7f126c0d7c10 2021-04-09T18:27:00.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.798 7f127240b700 1 --2- 172.21.15.79:0/2493981897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f126c0d7c10 0x7f126c0d8060 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f1264006de0 tx=0x7f126400c3d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:00.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.798 7f125e7fc700 1 -- 172.21.15.79:0/2493981897 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f126c19cf00 con 0x7f126c0d7c10 2021-04-09T18:27:00.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.798 7f125e7fc700 1 -- 172.21.15.79:0/2493981897 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126400cb50 con 0x7f126c0d7c10 2021-04-09T18:27:00.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.798 7f1273e66700 1 -- 172.21.15.79:0/2493981897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126c19d670 con 0x7f126c0d7c10 2021-04-09T18:27:00.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.798 7f125e7fc700 1 -- 172.21.15.79:0/2493981897 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1264013430 con 0x7f126c0d7c10 2021-04-09T18:27:00.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.798 7f1273e66700 1 -- 172.21.15.79:0/2493981897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c0d8820 con 0x7f126c0d7c10 2021-04-09T18:27:00.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.798 7f125e7fc700 1 -- 172.21.15.79:0/2493981897 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1264013630 con 0x7f126c0d7c10 2021-04-09T18:27:00.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.798 7f125e7fc700 1 --2- 172.21.15.79:0/2493981897 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1254029100 0x7f125402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:00.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.798 7f125e7fc700 1 -- 172.21.15.79:0/2493981897 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f1264039b90 con 0x7f126c0d7c10 2021-04-09T18:27:00.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.798 7f1271c0a700 1 --2- 172.21.15.79:0/2493981897 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1254029100 0x7f125402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:00.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.798 7f1271c0a700 1 --2- 172.21.15.79:0/2493981897 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1254029100 0x7f125402b650 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:00.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.802 7f1273e66700 1 -- 172.21.15.79:0/2493981897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c0e39f0 con 0x7f126c0d7c10 2021-04-09T18:27:00.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.810 7f125e7fc700 1 -- 172.21.15.79:0/2493981897 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1264010040 con 0x7f126c0d7c10 2021-04-09T18:27:00.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.966 7f1273e66700 1 -- 172.21.15.79:0/2493981897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f126c0a1c90 con 0x7f126c0d7c10 2021-04-09T18:27:00.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.966 7f125e7fc700 1 -- 172.21.15.79:0/2493981897 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v31) v1 ==== 100+0+10 (secure 0 0 0) 0x7f126c0f76f0 con 0x7f126c0d7c10 2021-04-09T18:27:00.972 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:27:00.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.966 7f1273e66700 1 -- 172.21.15.79:0/2493981897 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1254029100 msgr2=0x7f125402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:00.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.966 7f1273e66700 1 --2- 172.21.15.79:0/2493981897 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1254029100 0x7f125402b650 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.966 7f1273e66700 1 -- 172.21.15.79:0/2493981897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f126c0d7c10 msgr2=0x7f126c0d8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:00.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.966 7f1273e66700 1 --2- 172.21.15.79:0/2493981897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f126c0d7c10 0x7f126c0d8060 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f1264006de0 tx=0x7f126400c3d0).stop 2021-04-09T18:27:00.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.966 7f1273e66700 1 -- 172.21.15.79:0/2493981897 shutdown_connections 2021-04-09T18:27:00.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.966 7f1273e66700 1 --2- 172.21.15.79:0/2493981897 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1254029100 0x7f125402b650 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.966 7f1273e66700 1 --2- 172.21.15.79:0/2493981897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f126c0d0160 0x7f126c0d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.966 7f1273e66700 1 --2- 172.21.15.79:0/2493981897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f126c0d7c10 0x7f126c0d8060 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.966 7f1273e66700 1 --2- 172.21.15.79:0/2493981897 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f126c1a87f0 0x7f126c1a8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:00.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.966 7f1273e66700 1 -- 172.21.15.79:0/2493981897 >> 172.21.15.79:0/2493981897 conn(0x7f126c0901b0 msgr2=0x7f126c0d5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:00.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.966 7f1273e66700 1 -- 172.21.15.79:0/2493981897 shutdown_connections 2021-04-09T18:27:00.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:00.966 7f1273e66700 1 -- 172.21.15.79:0/2493981897 wait complete. 2021-04-09T18:27:00.984 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:27:00.985 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:27:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49e6973700 1 Processor -- start 2021-04-09T18:27:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49e6973700 1 -- start start 2021-04-09T18:27:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49e6973700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49e01c9010 0x7f49e01cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49e6973700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e00fbb10 con 0x7f49e00f5510 2021-04-09T18:27:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49e6973700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e009f900 con 0x7f49e00e9ad0 2021-04-09T18:27:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49e6973700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e01c3db0 con 0x7f49e01c9010 2021-04-09T18:27:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49dffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f49e00f5510 0x7f49e00f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51804/0 (socket says 172.21.15.79:51804) 2021-04-09T18:27:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49dffff700 1 -- 172.21.15.79:0/882811490 learned_addr learned my addr 172.21.15.79:0/882811490 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:27:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49e4f18700 1 --2- 172.21.15.79:0/882811490 >> v2:172.21.15.89:3300/0 conn(0x7f49e01c9010 0x7f49e01cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49df7fe700 1 -- 172.21.15.79:0/882811490 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4009234668 0 0) 0x7f49d00010d0 con 0x7f49e00f5510 2021-04-09T18:27:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49df7fe700 1 -- 172.21.15.79:0/882811490 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49cc003240 con 0x7f49e00f5510 2021-04-09T18:27:01.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49df7fe700 1 -- 172.21.15.79:0/882811490 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3374456091 0 0) 0x7f49d0001650 con 0x7f49e00f5510 2021-04-09T18:27:01.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49df7fe700 1 -- 172.21.15.79:0/882811490 >> v2:172.21.15.89:3300/0 conn(0x7f49e01c9010 msgr2=0x7f49e01cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:01.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49df7fe700 1 --2- 172.21.15.79:0/882811490 >> v2:172.21.15.89:3300/0 conn(0x7f49e01c9010 0x7f49e01cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:01.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49df7fe700 1 -- 172.21.15.79:0/882811490 >> v1:172.21.15.89:6789/0 conn(0x7f49e00e9ad0 legacy=0x7f49e009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49df7fe700 1 -- 172.21.15.79:0/882811490 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e00e56c0 con 0x7f49e00f5510 2021-04-09T18:27:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49df7fe700 1 -- 172.21.15.79:0/882811490 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f49d0001bb0 con 0x7f49e00f5510 2021-04-09T18:27:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49df7fe700 1 -- 172.21.15.79:0/882811490 >> v1:172.21.15.79:6789/0 conn(0x7f49e00f5510 legacy=0x7f49e00f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49df7fe700 1 --2- 172.21.15.79:0/882811490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49cc0038c0 0x7f49cc003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:01.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49df7fe700 1 --2- 172.21.15.79:0/882811490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49cc0045a0 0x7f49cc004a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:01.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49df7fe700 1 --2- 172.21.15.79:0/882811490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49cc0097e0 0x7f49cc00bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:01.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49df7fe700 1 -- 172.21.15.79:0/882811490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e01c3db0 con 0x7f49cc0045a0 2021-04-09T18:27:01.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49df7fe700 1 -- 172.21.15.79:0/882811490 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc00c270 con 0x7f49cc0038c0 2021-04-09T18:27:01.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49df7fe700 1 -- 172.21.15.79:0/882811490 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc050430 con 0x7f49cc0097e0 2021-04-09T18:27:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49d77fe700 1 --2- 172.21.15.79:0/882811490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49cc0045a0 0x7f49cc004a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49dffff700 1 --2- 172.21.15.79:0/882811490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49cc0038c0 0x7f49cc003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49e4f18700 1 --2- 172.21.15.79:0/882811490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49cc0097e0 0x7f49cc00bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49d77fe700 1 -- 172.21.15.79:0/882811490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49cc0097e0 msgr2=0x7f49cc00bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:01.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49d77fe700 1 --2- 172.21.15.79:0/882811490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49cc0097e0 0x7f49cc00bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:01.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49d77fe700 1 -- 172.21.15.79:0/882811490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49cc0038c0 msgr2=0x7f49cc003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:01.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49d77fe700 1 --2- 172.21.15.79:0/882811490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49cc0038c0 0x7f49cc003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:01.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49d77fe700 1 -- 172.21.15.79:0/882811490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc0506a0 con 0x7f49cc0045a0 2021-04-09T18:27:01.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49e4f18700 1 --2- 172.21.15.79:0/882811490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49cc0097e0 0x7f49cc00bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:27:01.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49dffff700 1 --2- 172.21.15.79:0/882811490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49cc0038c0 0x7f49cc003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:27:01.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49e4f18700 1 -- 172.21.15.79:0/882811490 reap_dead start 2021-04-09T18:27:01.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49d77fe700 1 --2- 172.21.15.79:0/882811490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49cc0045a0 0x7f49cc004a10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f49c8001020 tx=0x7f49c8001cb0).ready entity=mon.0 client_cookie=f540e52d1a0c13b6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:01.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49df7fe700 1 -- 172.21.15.79:0/882811490 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f49cc0506a0 con 0x7f49cc0045a0 2021-04-09T18:27:01.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49df7fe700 1 -- 172.21.15.79:0/882811490 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c800c800 con 0x7f49cc0045a0 2021-04-09T18:27:01.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49df7fe700 1 -- 172.21.15.79:0/882811490 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f49c800cbd0 con 0x7f49cc0045a0 2021-04-09T18:27:01.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49e6973700 1 -- 172.21.15.79:0/882811490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49cc0045a0 msgr2=0x7f49cc004a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:01.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.074 7f49e6973700 1 --2- 172.21.15.79:0/882811490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49cc0045a0 0x7f49cc004a10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f49c8001020 tx=0x7f49c8001cb0).stop 2021-04-09T18:27:01.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.078 7f49e6973700 1 -- 172.21.15.79:0/882811490 shutdown_connections 2021-04-09T18:27:01.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.078 7f49e6973700 1 --2- 172.21.15.79:0/882811490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49cc0045a0 0x7f49cc004a10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:01.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.078 7f49e6973700 1 -- 172.21.15.79:0/882811490 >> 172.21.15.79:0/882811490 conn(0x7f49e00e5fd0 msgr2=0x7f49e00e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:01.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.078 7f49e6973700 1 -- 172.21.15.79:0/882811490 shutdown_connections 2021-04-09T18:27:01.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.078 7f49e6973700 1 -- 172.21.15.79:0/882811490 wait complete. 2021-04-09T18:27:01.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.078 7f49e6973700 1 Processor -- start 2021-04-09T18:27:01.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49e6973700 1 -- start start 2021-04-09T18:27:01.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49e6973700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49e00b00c0 0x7f49e0098c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:01.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49e6973700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49e00b0510 0x7f49e01b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:01.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49e6973700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49e01b1c70 0x7f49e01b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:01.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49e6973700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e00e9f20 con 0x7f49e00b00c0 2021-04-09T18:27:01.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49e6973700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e0096fc0 con 0x7f49e01b1c70 2021-04-09T18:27:01.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49e6973700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e00972c0 con 0x7f49e00b0510 2021-04-09T18:27:01.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49dffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49e00b00c0 0x7f49e0098c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:01.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49dffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49e00b00c0 0x7f49e0098c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57106/0 (socket says 172.21.15.79:57106) 2021-04-09T18:27:01.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49dffff700 1 -- 172.21.15.79:0/2470411660 learned_addr learned my addr 172.21.15.79:0/2470411660 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:27:01.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49d77fe700 1 --2- 172.21.15.79:0/2470411660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49e00b0510 0x7f49e01b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:01.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49e4f18700 1 --2- 172.21.15.79:0/2470411660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49e01b1c70 0x7f49e01b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:01.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49dffff700 1 -- 172.21.15.79:0/2470411660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49e00b0510 msgr2=0x7f49e01b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:01.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49dffff700 1 --2- 172.21.15.79:0/2470411660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49e00b0510 0x7f49e01b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:01.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49dffff700 1 -- 172.21.15.79:0/2470411660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49e01b1c70 msgr2=0x7f49e01b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:01.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49dffff700 1 --2- 172.21.15.79:0/2470411660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49e01b1c70 0x7f49e01b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:01.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49dffff700 1 -- 172.21.15.79:0/2470411660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e00c0ce0 con 0x7f49e00b00c0 2021-04-09T18:27:01.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49d77fe700 1 --2- 172.21.15.79:0/2470411660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49e00b0510 0x7f49e01b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:27:01.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49e4f18700 1 --2- 172.21.15.79:0/2470411660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49e01b1c70 0x7f49e01b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:27:01.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49dffff700 1 --2- 172.21.15.79:0/2470411660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49e00b00c0 0x7f49e0098c30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f49e00d8370 tx=0x7f49d000e430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:01.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49dd7fa700 1 -- 172.21.15.79:0/2470411660 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f49e00c0ce0 con 0x7f49e00b00c0 2021-04-09T18:27:01.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49dd7fa700 1 -- 172.21.15.79:0/2470411660 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d000e9c0 con 0x7f49e00b00c0 2021-04-09T18:27:01.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49e6973700 1 -- 172.21.15.79:0/2470411660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e0099260 con 0x7f49e00b00c0 2021-04-09T18:27:01.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49dd7fa700 1 -- 172.21.15.79:0/2470411660 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f49e00e56c0 con 0x7f49e00b00c0 2021-04-09T18:27:01.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49e6973700 1 -- 172.21.15.79:0/2470411660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e01ad780 con 0x7f49e00b00c0 2021-04-09T18:27:01.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49dd7fa700 1 -- 172.21.15.79:0/2470411660 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f49d001b060 con 0x7f49e00b00c0 2021-04-09T18:27:01.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49dd7fa700 1 --2- 172.21.15.79:0/2470411660 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f49c4029100 0x7f49c402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:01.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49dd7fa700 1 -- 172.21.15.79:0/2470411660 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f49d0038bc0 con 0x7f49e00b00c0 2021-04-09T18:27:01.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.082 7f49d77fe700 1 --2- 172.21.15.79:0/2470411660 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f49c4029100 0x7f49c402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:01.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.086 7f49d77fe700 1 --2- 172.21.15.79:0/2470411660 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f49c4029100 0x7f49c402b650 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:01.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.086 7f49e6973700 1 -- 172.21.15.79:0/2470411660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e00e39d0 con 0x7f49e00b00c0 2021-04-09T18:27:01.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.094 7f49dd7fa700 1 -- 172.21.15.79:0/2470411660 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f49d0000bf0 con 0x7f49e00b00c0 2021-04-09T18:27:01.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.262 7f49e6973700 1 -- 172.21.15.79:0/2470411660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49e00a1cb0 con 0x7f49e00b00c0 2021-04-09T18:27:01.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.266 7f49dd7fa700 1 -- 172.21.15.79:0/2470411660 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2100 (secure 0 0 0) 0x7f49d0005d40 con 0x7f49e00b00c0 2021-04-09T18:27:01.272 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 11 2021-04-09T18:27:01.272 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:27:01.272 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3417656822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3417656822},{"type":"v1","addr":"172.21.15.79:6833","nonce":3417656822}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":9}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:26:56.614049","modified":"2021-04-09 18:26:57.616754","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4634":{"gid":4634,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/3906387944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3906387944},{"type":"v1","addr":"172.21.15.89:6835","nonce":3906387944}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-04-09T18:27:01.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.266 7f49e6973700 1 -- 172.21.15.79:0/2470411660 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f49c4029100 msgr2=0x7f49c402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:01.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.266 7f49e6973700 1 --2- 172.21.15.79:0/2470411660 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f49c4029100 0x7f49c402b650 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:01.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.266 7f49e6973700 1 -- 172.21.15.79:0/2470411660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49e00b00c0 msgr2=0x7f49e0098c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:01.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.266 7f49e6973700 1 --2- 172.21.15.79:0/2470411660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49e00b00c0 0x7f49e0098c30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f49e00d8370 tx=0x7f49d000e430).stop 2021-04-09T18:27:01.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.266 7f49e6973700 1 -- 172.21.15.79:0/2470411660 shutdown_connections 2021-04-09T18:27:01.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.266 7f49e6973700 1 --2- 172.21.15.79:0/2470411660 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f49c4029100 0x7f49c402b650 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:01.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.266 7f49e6973700 1 --2- 172.21.15.79:0/2470411660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49e01b1c70 0x7f49e01b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:01.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.266 7f49e6973700 1 --2- 172.21.15.79:0/2470411660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49e00b00c0 0x7f49e0098c30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:01.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.266 7f49e6973700 1 --2- 172.21.15.79:0/2470411660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49e00b0510 0x7f49e01b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:01.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.266 7f49e6973700 1 -- 172.21.15.79:0/2470411660 >> 172.21.15.79:0/2470411660 conn(0x7f49e00d85b0 msgr2=0x7f49e009a620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:01.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.266 7f49e6973700 1 -- 172.21.15.79:0/2470411660 shutdown_connections 2021-04-09T18:27:01.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:01.266 7f49e6973700 1 -- 172.21.15.79:0/2470411660 wait complete. 2021-04-09T18:27:01.485 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:26:56.614049', 'modified': '2021-04-09 18:26:57.616754', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4634}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4634': {'gid': 4634, 'name': 'b', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6835/3906387944', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 3906387944}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 3906387944}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:27:01.485 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:27:01.486 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2021-04-09T18:27:01.590 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:27:01.590 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:27:01.591 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2021-04-09T18:27:01.591 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 4634, 2021-04-09T18:27:01.591 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2021-04-09T18:27:01.592 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2021-04-09T18:27:01.592 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 4.9703117690000003, 2021-04-09T18:27:01.593 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 11, 2021-04-09T18:27:01.593 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 31, 2021-04-09T18:27:01.593 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 30, 2021-04-09T18:27:01.594 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 11.346100461000001 2021-04-09T18:27:01.594 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:27:01.596 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 4634, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.9703117690000003, "mdsmap_epoch": 11, "osdmap_epoch": 31, "osdmap_epoch_barrier": 30, "uptime": 11.346100461000001 } 2021-04-09T18:27:01.597 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:27:01.598 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-04-09T18:27:01.598 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi090.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-04-09T18:27:01.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:27:01.600 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:27:01.615 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:27:01.680 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:27:01.680 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:27:01.742 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:27:01.743 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:27:01.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:27:01.744 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:27:01.797 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:27:01.798 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:27:01.846 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:27:01.868 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:27:01.868 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:27:01.926 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13073]: starting ceph client 2021-04-09T18:27:01.927 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:2021-04-09 18:27:01.920 7fac6cc000c0 -1 init, newargv = 0x55d5dde739e0 newargc=9 2021-04-09T18:27:01.930 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:27:01.931 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:27:01.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:27:01.933 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:27:01.934 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13073]: starting fuse 2021-04-09T18:27:01.989 INFO:teuthology.orchestra.run.smithi090.stdout:49 2021-04-09T18:27:01.989 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:27:01.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:27:01.991 DEBUG:teuthology.orchestra.run.smithi090:> sudo python3 -c ' 2021-04-09T18:27:01.992 DEBUG:teuthology.orchestra.run.smithi090:> import glob 2021-04-09T18:27:01.992 DEBUG:teuthology.orchestra.run.smithi090:> import re 2021-04-09T18:27:01.993 DEBUG:teuthology.orchestra.run.smithi090:> import os 2021-04-09T18:27:01.993 DEBUG:teuthology.orchestra.run.smithi090:> import subprocess 2021-04-09T18:27:01.994 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:27:01.994 DEBUG:teuthology.orchestra.run.smithi090:> def find_socket(client_name): 2021-04-09T18:27:01.995 DEBUG:teuthology.orchestra.run.smithi090:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-04-09T18:27:01.996 DEBUG:teuthology.orchestra.run.smithi090:> files = glob.glob(asok_path) 2021-04-09T18:27:01.996 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:27:01.997 DEBUG:teuthology.orchestra.run.smithi090:> # Given a non-glob path, it better be there 2021-04-09T18:27:01.997 DEBUG:teuthology.orchestra.run.smithi090:> if "*" not in asok_path: 2021-04-09T18:27:01.998 DEBUG:teuthology.orchestra.run.smithi090:> assert(len(files) == 1) 2021-04-09T18:27:01.999 DEBUG:teuthology.orchestra.run.smithi090:> return files[0] 2021-04-09T18:27:01.999 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:27:02.000 DEBUG:teuthology.orchestra.run.smithi090:> for f in files: 2021-04-09T18:27:02.000 DEBUG:teuthology.orchestra.run.smithi090:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:27:02.000 DEBUG:teuthology.orchestra.run.smithi090:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:27:02.001 DEBUG:teuthology.orchestra.run.smithi090:> return f 2021-04-09T18:27:02.001 DEBUG:teuthology.orchestra.run.smithi090:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:27:02.002 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:27:02.002 DEBUG:teuthology.orchestra.run.smithi090:> print(find_socket("client.0")) 2021-04-09T18:27:02.002 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:27:02.078 INFO:teuthology.orchestra.run.smithi090.stdout:/var/run/ceph/ceph-client.0.13073.asok 2021-04-09T18:27:02.083 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13073.asok 2021-04-09T18:27:02.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:27:02.084 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13073.asok status 2021-04-09T18:27:02.214 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2021-04-09T18:27:02.215 INFO:teuthology.orchestra.run.smithi090.stdout: "metadata": { 2021-04-09T18:27:02.215 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:27:02.216 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:27:02.216 INFO:teuthology.orchestra.run.smithi090.stdout: "entity_id": "0", 2021-04-09T18:27:02.217 INFO:teuthology.orchestra.run.smithi090.stdout: "hostname": "smithi090", 2021-04-09T18:27:02.217 INFO:teuthology.orchestra.run.smithi090.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-04-09T18:27:02.217 INFO:teuthology.orchestra.run.smithi090.stdout: "pid": "13073", 2021-04-09T18:27:02.218 INFO:teuthology.orchestra.run.smithi090.stdout: "root": "/" 2021-04-09T18:27:02.218 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:27:02.218 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_count": 0, 2021-04-09T18:27:02.218 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_pinned_count": 0, 2021-04-09T18:27:02.219 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 5031, 2021-04-09T18:27:02.219 INFO:teuthology.orchestra.run.smithi090.stdout: "inst": { 2021-04-09T18:27:02.219 INFO:teuthology.orchestra.run.smithi090.stdout: "name": { 2021-04-09T18:27:02.220 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "client", 2021-04-09T18:27:02.220 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5031 2021-04-09T18:27:02.220 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:27:02.221 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:27:02.221 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:27:02.221 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:27:02.222 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 5233270 2021-04-09T18:27:02.222 INFO:teuthology.orchestra.run.smithi090.stdout: } 2021-04-09T18:27:02.222 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:27:02.223 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:27:02.223 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:27:02.223 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:27:02.224 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 5233270 2021-04-09T18:27:02.224 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:27:02.224 INFO:teuthology.orchestra.run.smithi090.stdout: "inst_str": "client.5031 172.21.15.90:0/5233270", 2021-04-09T18:27:02.225 INFO:teuthology.orchestra.run.smithi090.stdout: "addr_str": "172.21.15.90:0/5233270", 2021-04-09T18:27:02.225 INFO:teuthology.orchestra.run.smithi090.stdout: "inode_count": 1, 2021-04-09T18:27:02.225 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_epoch": 11, 2021-04-09T18:27:02.225 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch": 31, 2021-04-09T18:27:02.226 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:27:02.226 INFO:teuthology.orchestra.run.smithi090.stdout: "blacklisted": false, 2021-04-09T18:27:02.227 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs" 2021-04-09T18:27:02.227 INFO:teuthology.orchestra.run.smithi090.stdout:} 2021-04-09T18:27:02.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:27:02.229 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:27:02.230 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:27:02.242 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:27:02.244 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:27:02.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:27:02.245 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:27:02.302 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config get mds_min_caps_per_client 2021-04-09T18:27:02.401 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:27:02.401 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_min_caps_per_client": "100" 2021-04-09T18:27:02.401 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:27:02.407 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_min_caps_per_client": "100" } 2021-04-09T18:27:02.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:27:02.408 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:27:02.409 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:27:02.416 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:27:02.417 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:27:02.418 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-04-09T18:27:02.419 DEBUG:teuthology.orchestra.run.smithi090:> import sys 2021-04-09T18:27:02.419 DEBUG:teuthology.orchestra.run.smithi090:> import time 2021-04-09T18:27:02.420 DEBUG:teuthology.orchestra.run.smithi090:> import os 2021-04-09T18:27:02.420 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:27:02.420 DEBUG:teuthology.orchestra.run.smithi090:> n = 1000 2021-04-09T18:27:02.421 DEBUG:teuthology.orchestra.run.smithi090:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-04-09T18:27:02.421 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:27:02.422 DEBUG:teuthology.orchestra.run.smithi090:> if not os.path.exists(os.path.dirname(abs_path)): 2021-04-09T18:27:02.422 DEBUG:teuthology.orchestra.run.smithi090:> os.makedirs(os.path.dirname(abs_path)) 2021-04-09T18:27:02.423 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:27:02.423 DEBUG:teuthology.orchestra.run.smithi090:> for i in range(0, n): 2021-04-09T18:27:02.423 DEBUG:teuthology.orchestra.run.smithi090:> fname = "{0}_{1}".format(abs_path, i) 2021-04-09T18:27:02.424 DEBUG:teuthology.orchestra.run.smithi090:> with open(fname, '"'"'w'"'"') as f: 2021-04-09T18:27:02.424 DEBUG:teuthology.orchestra.run.smithi090:> f.write('"'"'content'"'"') 2021-04-09T18:27:02.425 DEBUG:teuthology.orchestra.run.smithi090:> if True: 2021-04-09T18:27:02.425 DEBUG:teuthology.orchestra.run.smithi090:> f.flush() 2021-04-09T18:27:02.426 DEBUG:teuthology.orchestra.run.smithi090:> os.fsync(f.fileno()) 2021-04-09T18:27:02.426 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:27:12.066 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:27:12.069 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:27:12.071 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:27:12.074 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:27:12.076 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:27:15.745 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:27:15.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.838 7f998e17d700 1 Processor -- start 2021-04-09T18:27:15.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.838 7f998e17d700 1 -- start start 2021-04-09T18:27:15.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.838 7f998e17d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99880f5520 0x7f99880f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:15.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.838 7f998e17d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99880e9ae0 0x7f998809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:15.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.838 7f998e17d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99880fbb20 con 0x7f99881c2db0 2021-04-09T18:27:15.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.838 7f998e17d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99880e9f30 con 0x7f99880f5520 2021-04-09T18:27:15.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.838 7f998e17d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99880e59d0 con 0x7f99880e9ae0 2021-04-09T18:27:15.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.838 7f99877fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99880f5520 0x7f99880f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:15.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.838 7f99877fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99880f5520 0x7f99880f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57116/0 (socket says 172.21.15.79:57116) 2021-04-09T18:27:15.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.838 7f99877fe700 1 -- 172.21.15.79:0/3627357659 learned_addr learned my addr 172.21.15.79:0/3627357659 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:27:15.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.838 7f9986ffd700 1 --2- 172.21.15.79:0/3627357659 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99880e9ae0 0x7f998809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:15.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.838 7f99877fe700 1 -- 172.21.15.79:0/3627357659 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99880e9ae0 msgr2=0x7f998809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:15.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.838 7f99877fe700 1 --2- 172.21.15.79:0/3627357659 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99880e9ae0 0x7f998809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:15.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.838 7f99877fe700 1 -- 172.21.15.79:0/3627357659 >> v1:172.21.15.89:6789/0 conn(0x7f99881c2db0 legacy=0x7f99881c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:15.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.838 7f99877fe700 1 -- 172.21.15.79:0/3627357659 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99880e56d0 con 0x7f99880f5520 2021-04-09T18:27:15.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.838 7f99877fe700 1 --2- 172.21.15.79:0/3627357659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99880f5520 0x7f99880f64b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f9978002f30 tx=0x7f997800bda0).ready entity=mon.0 client_cookie=76c4423ac2a11820 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:15.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.842 7f99867fc700 1 -- 172.21.15.79:0/3627357659 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f99880e56d0 con 0x7f99880f5520 2021-04-09T18:27:15.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.842 7f99867fc700 1 -- 172.21.15.79:0/3627357659 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99780099d0 con 0x7f99880f5520 2021-04-09T18:27:15.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.842 7f99867fc700 1 -- 172.21.15.79:0/3627357659 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9978009da0 con 0x7f99880f5520 2021-04-09T18:27:15.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.842 7f998e17d700 1 -- 172.21.15.79:0/3627357659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99880f5520 msgr2=0x7f99880f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:15.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.842 7f998e17d700 1 --2- 172.21.15.79:0/3627357659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99880f5520 0x7f99880f64b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f9978002f30 tx=0x7f997800bda0).stop 2021-04-09T18:27:15.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.842 7f998e17d700 1 -- 172.21.15.79:0/3627357659 shutdown_connections 2021-04-09T18:27:15.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.842 7f998e17d700 1 --2- 172.21.15.79:0/3627357659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99880f5520 0x7f99880f64b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:15.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.842 7f998e17d700 1 --2- 172.21.15.79:0/3627357659 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99880e9ae0 0x7f998809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:15.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.842 7f998e17d700 1 -- 172.21.15.79:0/3627357659 >> 172.21.15.79:0/3627357659 conn(0x7f99880e5fe0 msgr2=0x7f99880e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:15.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.842 7f998e17d700 1 -- 172.21.15.79:0/3627357659 shutdown_connections 2021-04-09T18:27:15.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.842 7f998e17d700 1 -- 172.21.15.79:0/3627357659 wait complete. 2021-04-09T18:27:15.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.846 7f998e17d700 1 Processor -- start 2021-04-09T18:27:15.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.846 7f998e17d700 1 -- start start 2021-04-09T18:27:15.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.846 7f998e17d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99880b2890 0x7f99881c0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:15.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.846 7f998e17d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9988095980 0x7f99880c2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:15.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.846 7f998e17d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99880b1c00 0x7f99881b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:15.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.846 7f998e17d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99880b0360 con 0x7f99880b1c00 2021-04-09T18:27:15.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.846 7f998e17d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99880b0660 con 0x7f99880b2890 2021-04-09T18:27:15.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.846 7f998e17d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99880c2990 con 0x7f9988095980 2021-04-09T18:27:15.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.846 7f9987fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99880b1c00 0x7f99881b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:15.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.846 7f9987fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99880b1c00 0x7f99881b0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57124/0 (socket says 172.21.15.79:57124) 2021-04-09T18:27:15.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.846 7f9987fff700 1 -- 172.21.15.79:0/764674302 learned_addr learned my addr 172.21.15.79:0/764674302 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:27:15.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.846 7f9986ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9988095980 0x7f99880c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:15.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.846 7f99877fe700 1 --2- 172.21.15.79:0/764674302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99880b2890 0x7f99881c0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:15.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.850 7f9987fff700 1 -- 172.21.15.79:0/764674302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9988095980 msgr2=0x7f99880c2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:15.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.850 7f9987fff700 1 --2- 172.21.15.79:0/764674302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9988095980 0x7f99880c2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:15.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.850 7f9987fff700 1 -- 172.21.15.79:0/764674302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99880b2890 msgr2=0x7f99881c0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:15.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.850 7f9987fff700 1 --2- 172.21.15.79:0/764674302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99880b2890 0x7f99881c0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:15.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.850 7f9987fff700 1 -- 172.21.15.79:0/764674302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99880aff50 con 0x7f99880b1c00 2021-04-09T18:27:15.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.850 7f9987fff700 1 --2- 172.21.15.79:0/764674302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99880b1c00 0x7f99881b0ed0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f99880b02e0 tx=0x7f998000cec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:15.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.850 7f996ffff700 1 -- 172.21.15.79:0/764674302 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f99880aff50 con 0x7f99880b1c00 2021-04-09T18:27:15.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.850 7f996ffff700 1 -- 172.21.15.79:0/764674302 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9980006a80 con 0x7f99880b1c00 2021-04-09T18:27:15.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.850 7f998e17d700 1 -- 172.21.15.79:0/764674302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9988095dd0 con 0x7f99880b1c00 2021-04-09T18:27:15.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.850 7f996ffff700 1 -- 172.21.15.79:0/764674302 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9980007030 con 0x7f99880b1c00 2021-04-09T18:27:15.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.850 7f998e17d700 1 -- 172.21.15.79:0/764674302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99880b21e0 con 0x7f99880b1c00 2021-04-09T18:27:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.850 7f996ffff700 1 -- 172.21.15.79:0/764674302 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f998001a020 con 0x7f99880b1c00 2021-04-09T18:27:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.850 7f996ffff700 1 --2- 172.21.15.79:0/764674302 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9968029100 0x7f996802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.850 7f996ffff700 1 -- 172.21.15.79:0/764674302 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f9980039560 con 0x7f99880b1c00 2021-04-09T18:27:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.850 7f99877fe700 1 --2- 172.21.15.79:0/764674302 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9968029100 0x7f996802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.850 7f99877fe700 1 --2- 172.21.15.79:0/764674302 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9968029100 0x7f996802b650 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:15.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.866 7f998e17d700 1 -- 172.21.15.79:0/764674302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99880e39e0 con 0x7f99880b1c00 2021-04-09T18:27:15.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:15.874 7f996ffff700 1 -- 172.21.15.79:0/764674302 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9980000f70 con 0x7f99880b1c00 2021-04-09T18:27:16.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.042 7f998e17d700 1 -- 172.21.15.79:0/764674302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99880f5b20 con 0x7f99880b1c00 2021-04-09T18:27:16.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.042 7f996ffff700 1 -- 172.21.15.79:0/764674302 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2100 (secure 0 0 0) 0x7f9980006870 con 0x7f99880b1c00 2021-04-09T18:27:16.047 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 11 2021-04-09T18:27:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:27:16.048 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3417656822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3417656822},{"type":"v1","addr":"172.21.15.79:6833","nonce":3417656822}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":9}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:26:56.614049","modified":"2021-04-09 18:26:57.616754","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4634":{"gid":4634,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/3906387944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3906387944},{"type":"v1","addr":"172.21.15.89:6835","nonce":3906387944}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-04-09T18:27:16.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.042 7f998e17d700 1 -- 172.21.15.79:0/764674302 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9968029100 msgr2=0x7f996802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:16.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.042 7f998e17d700 1 --2- 172.21.15.79:0/764674302 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9968029100 0x7f996802b650 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.042 7f998e17d700 1 -- 172.21.15.79:0/764674302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99880b1c00 msgr2=0x7f99881b0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:16.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.042 7f998e17d700 1 --2- 172.21.15.79:0/764674302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99880b1c00 0x7f99881b0ed0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f99880b02e0 tx=0x7f998000cec0).stop 2021-04-09T18:27:16.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.042 7f998e17d700 1 -- 172.21.15.79:0/764674302 shutdown_connections 2021-04-09T18:27:16.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.042 7f998e17d700 1 --2- 172.21.15.79:0/764674302 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9968029100 0x7f996802b650 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.042 7f998e17d700 1 --2- 172.21.15.79:0/764674302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99880b2890 0x7f99881c0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.042 7f998e17d700 1 --2- 172.21.15.79:0/764674302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99880b1c00 0x7f99881b0ed0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.042 7f998e17d700 1 --2- 172.21.15.79:0/764674302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9988095980 0x7f99880c2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.042 7f998e17d700 1 -- 172.21.15.79:0/764674302 >> 172.21.15.79:0/764674302 conn(0x7f998809b1e0 msgr2=0x7f9988099dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:16.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.042 7f998e17d700 1 -- 172.21.15.79:0/764674302 shutdown_connections 2021-04-09T18:27:16.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.042 7f998e17d700 1 -- 172.21.15.79:0/764674302 wait complete. 2021-04-09T18:27:16.066 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok config set mds_recall_max_caps 20 2021-04-09T18:27:16.154 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:27:16.154 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " 2021-04-09T18:27:16.155 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:27:16.161 INFO:tasks.cephfs.filesystem:_json_asok output: { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-04-09T18:27:16.161 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:27:16.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.254 7f4426bdc700 1 Processor -- start 2021-04-09T18:27:16.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.254 7f4426bdc700 1 -- start start 2021-04-09T18:27:16.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.254 7f4426bdc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44200f5520 0x7f44200f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:16.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.254 7f4426bdc700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44200fbb20 con 0x7f44200e9ae0 2021-04-09T18:27:16.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.254 7f4426bdc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442009f910 con 0x7f44201c8010 2021-04-09T18:27:16.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.254 7f4426bdc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44200e9f30 con 0x7f44200f5520 2021-04-09T18:27:16.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.254 7f441ffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f44200e9ae0 0x7f442009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51840/0 (socket says 172.21.15.79:51840) 2021-04-09T18:27:16.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.254 7f441ffff700 1 -- 172.21.15.79:0/3131221521 learned_addr learned my addr 172.21.15.79:0/3131221521 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:27:16.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.254 7f4424980700 1 --2- 172.21.15.79:0/3131221521 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44200f5520 0x7f44200f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:16.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.254 7f441f7fe700 1 -- 172.21.15.79:0/3131221521 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900926030 0 0) 0x7f44140010d0 con 0x7f44200e9ae0 2021-04-09T18:27:16.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.254 7f441f7fe700 1 -- 172.21.15.79:0/3131221521 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4408003240 con 0x7f44200e9ae0 2021-04-09T18:27:16.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f441f7fe700 1 -- 172.21.15.79:0/3131221521 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357325008 0 0) 0x7f4418001450 con 0x7f44201c8010 2021-04-09T18:27:16.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f441f7fe700 1 -- 172.21.15.79:0/3131221521 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4408003620 con 0x7f44201c8010 2021-04-09T18:27:16.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f441f7fe700 1 -- 172.21.15.79:0/3131221521 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2491652440 0 0) 0x7f4414001650 con 0x7f44200e9ae0 2021-04-09T18:27:16.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f441f7fe700 1 -- 172.21.15.79:0/3131221521 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44200f5520 msgr2=0x7f44200f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:16.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f441f7fe700 1 --2- 172.21.15.79:0/3131221521 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44200f5520 0x7f44200f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f441f7fe700 1 -- 172.21.15.79:0/3131221521 >> v1:172.21.15.89:6789/0 conn(0x7f44201c8010 legacy=0x7f44201ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:16.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f441f7fe700 1 -- 172.21.15.79:0/3131221521 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44200e56d0 con 0x7f44200e9ae0 2021-04-09T18:27:16.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f441f7fe700 1 -- 172.21.15.79:0/3131221521 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f4414001bb0 con 0x7f44200e9ae0 2021-04-09T18:27:16.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f441f7fe700 1 -- 172.21.15.79:0/3131221521 >> v1:172.21.15.79:6789/0 conn(0x7f44200e9ae0 legacy=0x7f442009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:16.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f441f7fe700 1 --2- 172.21.15.79:0/3131221521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4408003d40 0x7f44080045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:16.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f441f7fe700 1 --2- 172.21.15.79:0/3131221521 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4408004bd0 0x7f44080097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:16.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f441f7fe700 1 --2- 172.21.15.79:0/3131221521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4408005020 0x7f440800be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:16.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f441f7fe700 1 -- 172.21.15.79:0/3131221521 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44200e9f30 con 0x7f4408005020 2021-04-09T18:27:16.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f4425181700 1 --2- 172.21.15.79:0/3131221521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4408005020 0x7f440800be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:16.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f441f7fe700 1 -- 172.21.15.79:0/3131221521 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4408050460 con 0x7f4408003d40 2021-04-09T18:27:16.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f441f7fe700 1 -- 172.21.15.79:0/3131221521 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4408050610 con 0x7f4408004bd0 2021-04-09T18:27:16.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f441ffff700 1 --2- 172.21.15.79:0/3131221521 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4408004bd0 0x7f44080097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:16.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f4424980700 1 --2- 172.21.15.79:0/3131221521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4408003d40 0x7f44080045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:16.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f4425181700 1 -- 172.21.15.79:0/3131221521 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4408004bd0 msgr2=0x7f44080097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:16.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f4425181700 1 --2- 172.21.15.79:0/3131221521 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4408004bd0 0x7f44080097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f4425181700 1 -- 172.21.15.79:0/3131221521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4408003d40 msgr2=0x7f44080045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:16.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f4425181700 1 --2- 172.21.15.79:0/3131221521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4408003d40 0x7f44080045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f4425181700 1 -- 172.21.15.79:0/3131221521 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4408050880 con 0x7f4408005020 2021-04-09T18:27:16.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f4425181700 1 --2- 172.21.15.79:0/3131221521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4408005020 0x7f440800be20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f4418001360 tx=0x7f441800c470).ready entity=mon.0 client_cookie=fc343ddf22c715f1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:16.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f441f7fe700 1 -- 172.21.15.79:0/3131221521 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4408050880 con 0x7f4408005020 2021-04-09T18:27:16.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f441f7fe700 1 -- 172.21.15.79:0/3131221521 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441800cda0 con 0x7f4408005020 2021-04-09T18:27:16.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f441f7fe700 1 -- 172.21.15.79:0/3131221521 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4418006a60 con 0x7f4408005020 2021-04-09T18:27:16.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f4426bdc700 1 -- 172.21.15.79:0/3131221521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4408005020 msgr2=0x7f440800be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:16.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f4426bdc700 1 --2- 172.21.15.79:0/3131221521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4408005020 0x7f440800be20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f4418001360 tx=0x7f441800c470).stop 2021-04-09T18:27:16.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f4425181700 1 -- 172.21.15.79:0/3131221521 reap_dead start 2021-04-09T18:27:16.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f4426bdc700 1 -- 172.21.15.79:0/3131221521 shutdown_connections 2021-04-09T18:27:16.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f4426bdc700 1 -- 172.21.15.79:0/3131221521 >> 172.21.15.79:0/3131221521 conn(0x7f44200e5fe0 msgr2=0x7f44200e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:16.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f4426bdc700 1 -- 172.21.15.79:0/3131221521 shutdown_connections 2021-04-09T18:27:16.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.258 7f4426bdc700 1 -- 172.21.15.79:0/3131221521 wait complete. 2021-04-09T18:27:16.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.262 7f4426bdc700 1 Processor -- start 2021-04-09T18:27:16.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.262 7f4426bdc700 1 -- start start 2021-04-09T18:27:16.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.262 7f4426bdc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f442019c060 0x7f44200b98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:16.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.262 7f4426bdc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f442019cae0 0x7f442019dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:16.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.262 7f4426bdc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f442019cf30 0x7f442019e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:16.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.262 7f4426bdc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44201c3dc0 con 0x7f442019c060 2021-04-09T18:27:16.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.262 7f4426bdc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442019c7e0 con 0x7f442019cf30 2021-04-09T18:27:16.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.262 7f4426bdc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442019c4b0 con 0x7f442019cae0 2021-04-09T18:27:16.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.262 7f4424980700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f442019c060 0x7f44200b98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:16.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.262 7f4424980700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f442019c060 0x7f44200b98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57140/0 (socket says 172.21.15.79:57140) 2021-04-09T18:27:16.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.262 7f4424980700 1 -- 172.21.15.79:0/584324272 learned_addr learned my addr 172.21.15.79:0/584324272 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:27:16.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.262 7f441ffff700 1 --2- 172.21.15.79:0/584324272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f442019cae0 0x7f442019dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:16.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.262 7f4425181700 1 --2- 172.21.15.79:0/584324272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f442019cf30 0x7f442019e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:16.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.266 7f4424980700 1 -- 172.21.15.79:0/584324272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f442019cae0 msgr2=0x7f442019dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:16.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.266 7f4424980700 1 --2- 172.21.15.79:0/584324272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f442019cae0 0x7f442019dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.266 7f4424980700 1 -- 172.21.15.79:0/584324272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f442019cf30 msgr2=0x7f442019e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:16.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.266 7f4424980700 1 --2- 172.21.15.79:0/584324272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f442019cf30 0x7f442019e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.266 7f4424980700 1 -- 172.21.15.79:0/584324272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44200ba2d0 con 0x7f442019c060 2021-04-09T18:27:16.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.266 7f4424980700 1 --2- 172.21.15.79:0/584324272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f442019c060 0x7f44200b98c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f441000b000 tx=0x7f441000f520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:16.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.266 7f441d7fa700 1 -- 172.21.15.79:0/584324272 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f44200ba2d0 con 0x7f442019c060 2021-04-09T18:27:16.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.266 7f441d7fa700 1 -- 172.21.15.79:0/584324272 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441000fa50 con 0x7f442019c060 2021-04-09T18:27:16.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.266 7f441d7fa700 1 -- 172.21.15.79:0/584324272 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f441000f040 con 0x7f442019c060 2021-04-09T18:27:16.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.266 7f4426bdc700 1 -- 172.21.15.79:0/584324272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44200b9ef0 con 0x7f442019c060 2021-04-09T18:27:16.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.266 7f4426bdc700 1 -- 172.21.15.79:0/584324272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442019eab0 con 0x7f442019c060 2021-04-09T18:27:16.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.266 7f441d7fa700 1 -- 172.21.15.79:0/584324272 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f441000fc30 con 0x7f442019c060 2021-04-09T18:27:16.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.266 7f441d7fa700 1 --2- 172.21.15.79:0/584324272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4400029100 0x7f440002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:16.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.266 7f441d7fa700 1 -- 172.21.15.79:0/584324272 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f4410023060 con 0x7f442019c060 2021-04-09T18:27:16.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.266 7f441ffff700 1 --2- 172.21.15.79:0/584324272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4400029100 0x7f440002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:16.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.266 7f441ffff700 1 --2- 172.21.15.79:0/584324272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4400029100 0x7f440002b650 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:16.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.282 7f4426bdc700 1 -- 172.21.15.79:0/584324272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44200e39e0 con 0x7f442019c060 2021-04-09T18:27:16.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.290 7f441d7fa700 1 -- 172.21.15.79:0/584324272 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4410011d50 con 0x7f442019c060 2021-04-09T18:27:16.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.466 7f4426bdc700 1 -- 172.21.15.79:0/584324272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44200f5b20 con 0x7f442019c060 2021-04-09T18:27:16.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.466 7f441d7fa700 1 -- 172.21.15.79:0/584324272 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2100 (secure 0 0 0) 0x7f4410000bf0 con 0x7f442019c060 2021-04-09T18:27:16.475 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 11 2021-04-09T18:27:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:27:16.476 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3417656822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3417656822},{"type":"v1","addr":"172.21.15.79:6833","nonce":3417656822}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":9}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:26:56.614049","modified":"2021-04-09 18:26:57.616754","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4634":{"gid":4634,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/3906387944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3906387944},{"type":"v1","addr":"172.21.15.89:6835","nonce":3906387944}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-04-09T18:27:16.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.470 7f4426bdc700 1 -- 172.21.15.79:0/584324272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4400029100 msgr2=0x7f440002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:16.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.470 7f4426bdc700 1 --2- 172.21.15.79:0/584324272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4400029100 0x7f440002b650 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.470 7f4426bdc700 1 -- 172.21.15.79:0/584324272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f442019c060 msgr2=0x7f44200b98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:16.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.470 7f4426bdc700 1 --2- 172.21.15.79:0/584324272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f442019c060 0x7f44200b98c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f441000b000 tx=0x7f441000f520).stop 2021-04-09T18:27:16.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.470 7f4426bdc700 1 -- 172.21.15.79:0/584324272 shutdown_connections 2021-04-09T18:27:16.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.470 7f4426bdc700 1 --2- 172.21.15.79:0/584324272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4400029100 0x7f440002b650 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.470 7f4426bdc700 1 --2- 172.21.15.79:0/584324272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f442019cf30 0x7f442019e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.470 7f4426bdc700 1 --2- 172.21.15.79:0/584324272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f442019c060 0x7f44200b98c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.470 7f4426bdc700 1 --2- 172.21.15.79:0/584324272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f442019cae0 0x7f442019dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.470 7f4426bdc700 1 -- 172.21.15.79:0/584324272 >> 172.21.15.79:0/584324272 conn(0x7f442009b1f0 msgr2=0x7f442009a870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:16.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.470 7f4426bdc700 1 -- 172.21.15.79:0/584324272 shutdown_connections 2021-04-09T18:27:16.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.470 7f4426bdc700 1 -- 172.21.15.79:0/584324272 wait complete. 2021-04-09T18:27:16.488 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok config set mds_recall_max_decay_threshold 400 2021-04-09T18:27:16.577 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:27:16.578 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " 2021-04-09T18:27:16.578 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:27:16.584 INFO:tasks.cephfs.filesystem:_json_asok output: { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-04-09T18:27:16.585 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:27:16.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51e72bb700 1 Processor -- start 2021-04-09T18:27:16.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51e72bb700 1 -- start start 2021-04-09T18:27:16.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51e72bb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f51e00f5510 0x7f51e00f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:16.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51e72bb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51e00e9ad0 0x7f51e009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:16.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51e72bb700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e00fbb10 con 0x7f51e01c2da0 2021-04-09T18:27:16.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51e72bb700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e00e9f20 con 0x7f51e00f5510 2021-04-09T18:27:16.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51e72bb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00e59c0 con 0x7f51e00e9ad0 2021-04-09T18:27:16.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51e505f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f51e00f5510 0x7f51e00f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:16.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51e5860700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f51e01c2da0 0x7f51e01c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51862/0 (socket says 172.21.15.79:51862) 2021-04-09T18:27:16.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51e5860700 1 -- 172.21.15.79:0/3011903040 learned_addr learned my addr 172.21.15.79:0/3011903040 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:27:16.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51e485e700 1 --2- 172.21.15.79:0/3011903040 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51e00e9ad0 0x7f51e009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:16.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51e505f700 1 -- 172.21.15.79:0/3011903040 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51e00e9ad0 msgr2=0x7f51e009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:16.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51d7fff700 1 -- 172.21.15.79:0/3011903040 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731471692 0 0) 0x7f51d8001450 con 0x7f51e01c2da0 2021-04-09T18:27:16.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51e505f700 1 --2- 172.21.15.79:0/3011903040 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51e00e9ad0 0x7f51e009f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51e505f700 1 -- 172.21.15.79:0/3011903040 >> v1:172.21.15.79:6789/0 conn(0x7f51e01c2da0 legacy=0x7f51e01c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:16.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51e505f700 1 -- 172.21.15.79:0/3011903040 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e00e56c0 con 0x7f51e00f5510 2021-04-09T18:27:16.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51e505f700 1 --2- 172.21.15.79:0/3011903040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51e00f5510 0x7f51e00f64a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f51d0002f30 tx=0x7f51d000bd40).ready entity=mon.0 client_cookie=ef1c85f236cd555b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:16.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51d7fff700 1 -- 172.21.15.79:0/3011903040 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f51e00e56c0 con 0x7f51e00f5510 2021-04-09T18:27:16.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51d7fff700 1 -- 172.21.15.79:0/3011903040 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d0009850 con 0x7f51e00f5510 2021-04-09T18:27:16.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51d7fff700 1 -- 172.21.15.79:0/3011903040 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f51d0009c20 con 0x7f51e00f5510 2021-04-09T18:27:16.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51e72bb700 1 -- 172.21.15.79:0/3011903040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51e00f5510 msgr2=0x7f51e00f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:16.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.678 7f51e72bb700 1 --2- 172.21.15.79:0/3011903040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51e00f5510 0x7f51e00f64a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f51d0002f30 tx=0x7f51d000bd40).stop 2021-04-09T18:27:16.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.682 7f51e72bb700 1 -- 172.21.15.79:0/3011903040 shutdown_connections 2021-04-09T18:27:16.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.682 7f51e72bb700 1 --2- 172.21.15.79:0/3011903040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51e00f5510 0x7f51e00f64a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.682 7f51e72bb700 1 --2- 172.21.15.79:0/3011903040 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51e00e9ad0 0x7f51e009f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.682 7f51e72bb700 1 -- 172.21.15.79:0/3011903040 >> 172.21.15.79:0/3011903040 conn(0x7f51e00e5fd0 msgr2=0x7f51e00e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:16.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.682 7f51e72bb700 1 -- 172.21.15.79:0/3011903040 shutdown_connections 2021-04-09T18:27:16.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.682 7f51e72bb700 1 -- 172.21.15.79:0/3011903040 wait complete. 2021-04-09T18:27:16.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.682 7f51e72bb700 1 Processor -- start 2021-04-09T18:27:16.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.682 7f51e72bb700 1 -- start start 2021-04-09T18:27:16.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.682 7f51e72bb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51e00910b0 0x7f51e0091500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:16.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.682 7f51e72bb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51e00d0ee0 0x7f51e00d1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:16.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.682 7f51e72bb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51e00aa880 0x7f51e00aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:16.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.682 7f51e72bb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e0090db0 con 0x7f51e00aa880 2021-04-09T18:27:16.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.682 7f51e72bb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00ae680 con 0x7f51e00910b0 2021-04-09T18:27:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.682 7f51e72bb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00ab300 con 0x7f51e00d0ee0 2021-04-09T18:27:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51e5860700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51e00aa880 0x7f51e00aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51e485e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51e00d0ee0 0x7f51e00d1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:16.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51e5860700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51e00aa880 0x7f51e00aacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57158/0 (socket says 172.21.15.79:57158) 2021-04-09T18:27:16.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51e5860700 1 -- 172.21.15.79:0/3634796654 learned_addr learned my addr 172.21.15.79:0/3634796654 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:27:16.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51e505f700 1 --2- 172.21.15.79:0/3634796654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51e00910b0 0x7f51e0091500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:16.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51e485e700 1 -- 172.21.15.79:0/3634796654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51e00910b0 msgr2=0x7f51e0091500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:16.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51e485e700 1 --2- 172.21.15.79:0/3634796654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51e00910b0 0x7f51e0091500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51e485e700 1 -- 172.21.15.79:0/3634796654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51e00aa880 msgr2=0x7f51e00aacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:16.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51e485e700 1 --2- 172.21.15.79:0/3634796654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51e00aa880 0x7f51e00aacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51e485e700 1 -- 172.21.15.79:0/3634796654 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e00ab530 con 0x7f51e00d0ee0 2021-04-09T18:27:16.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51e5860700 1 --2- 172.21.15.79:0/3634796654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51e00aa880 0x7f51e00aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:27:16.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51e485e700 1 --2- 172.21.15.79:0/3634796654 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51e00d0ee0 0x7f51e00d1330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f51dc00c000 tx=0x7f51dc00eec0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:16.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51d5ffb700 1 -- 172.21.15.79:0/3634796654 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f51e00ab530 con 0x7f51e00d0ee0 2021-04-09T18:27:16.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51d5ffb700 1 -- 172.21.15.79:0/3634796654 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc00caf0 con 0x7f51e00d0ee0 2021-04-09T18:27:16.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51e72bb700 1 -- 172.21.15.79:0/3634796654 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e01aa030 con 0x7f51e00d0ee0 2021-04-09T18:27:16.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51d5ffb700 1 -- 172.21.15.79:0/3634796654 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f51dc00f040 con 0x7f51e00d0ee0 2021-04-09T18:27:16.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51e72bb700 1 -- 172.21.15.79:0/3634796654 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e01aa560 con 0x7f51e00d0ee0 2021-04-09T18:27:16.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51d5ffb700 1 -- 172.21.15.79:0/3634796654 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f51dc011070 con 0x7f51e00d0ee0 2021-04-09T18:27:16.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51d5ffb700 1 --2- 172.21.15.79:0/3634796654 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f51c0029100 0x7f51c002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:16.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51d5ffb700 1 -- 172.21.15.79:0/3634796654 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f51dc010040 con 0x7f51e00d0ee0 2021-04-09T18:27:16.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.686 7f51e505f700 1 --2- 172.21.15.79:0/3634796654 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f51c0029100 0x7f51c002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:16.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.690 7f51e505f700 1 --2- 172.21.15.79:0/3634796654 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f51c0029100 0x7f51c002b650 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:16.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.690 7f51e72bb700 1 -- 172.21.15.79:0/3634796654 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e00e39d0 con 0x7f51e00d0ee0 2021-04-09T18:27:16.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.698 7f51d5ffb700 1 -- 172.21.15.79:0/3634796654 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f51dc00c6f0 con 0x7f51e00d0ee0 2021-04-09T18:27:16.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.870 7f51e72bb700 1 -- 172.21.15.79:0/3634796654 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51e00f5b10 con 0x7f51e00d0ee0 2021-04-09T18:27:16.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.870 7f51d5ffb700 1 -- 172.21.15.79:0/3634796654 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2100 (secure 0 0 0) 0x7f51dc000bf0 con 0x7f51e00d0ee0 2021-04-09T18:27:16.878 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:27:16.879 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3417656822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3417656822},{"type":"v1","addr":"172.21.15.79:6833","nonce":3417656822}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":9}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:26:56.614049","modified":"2021-04-09 18:26:57.616754","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4634":{"gid":4634,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/3906387944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3906387944},{"type":"v1","addr":"172.21.15.89:6835","nonce":3906387944}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-04-09T18:27:16.879 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 11 2021-04-09T18:27:16.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.874 7f51e72bb700 1 -- 172.21.15.79:0/3634796654 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f51c0029100 msgr2=0x7f51c002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:16.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.874 7f51e72bb700 1 --2- 172.21.15.79:0/3634796654 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f51c0029100 0x7f51c002b650 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.874 7f51e72bb700 1 -- 172.21.15.79:0/3634796654 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51e00d0ee0 msgr2=0x7f51e00d1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:16.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.874 7f51e72bb700 1 --2- 172.21.15.79:0/3634796654 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51e00d0ee0 0x7f51e00d1330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f51dc00c000 tx=0x7f51dc00eec0).stop 2021-04-09T18:27:16.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.874 7f51e72bb700 1 -- 172.21.15.79:0/3634796654 shutdown_connections 2021-04-09T18:27:16.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.874 7f51e72bb700 1 --2- 172.21.15.79:0/3634796654 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f51c0029100 0x7f51c002b650 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.874 7f51e72bb700 1 --2- 172.21.15.79:0/3634796654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51e00910b0 0x7f51e0091500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.874 7f51e72bb700 1 --2- 172.21.15.79:0/3634796654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51e00aa880 0x7f51e00aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.874 7f51e72bb700 1 --2- 172.21.15.79:0/3634796654 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51e00d0ee0 0x7f51e00d1330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.874 7f51e72bb700 1 -- 172.21.15.79:0/3634796654 >> 172.21.15.79:0/3634796654 conn(0x7f51e00bb0e0 msgr2=0x7f51e00d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:16.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.874 7f51e72bb700 1 -- 172.21.15.79:0/3634796654 shutdown_connections 2021-04-09T18:27:16.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.874 7f51e72bb700 1 -- 172.21.15.79:0/3634796654 wait complete. 2021-04-09T18:27:16.890 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b cache drop 2021-04-09T18:27:16.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.978 7f4f03ebc700 1 Processor -- start 2021-04-09T18:27:16.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.978 7f4f03ebc700 1 -- start start 2021-04-09T18:27:16.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.978 7f4f03ebc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4efc0e9ae0 0x7f4efc09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:16.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.978 7f4f03ebc700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4efc0fbb20 con 0x7f4efc0f5520 2021-04-09T18:27:16.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.978 7f4f03ebc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4efc0e56d0 con 0x7f4efc1c8010 2021-04-09T18:27:16.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.978 7f4f03ebc700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4efc1c3dc0 con 0x7f4efc0e9ae0 2021-04-09T18:27:16.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.982 7f4f0145f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4efc0e9ae0 0x7f4efc09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:16.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.982 7f4f01c60700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4efc0f5520 0x7f4efc0f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51872/0 (socket says 172.21.15.79:51872) 2021-04-09T18:27:16.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.982 7f4f01c60700 1 -- 172.21.15.79:0/162998478 learned_addr learned my addr 172.21.15.79:0/162998478 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:27:16.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.982 7f4f0145f700 1 -- 172.21.15.79:0/162998478 >> v1:172.21.15.89:6789/0 conn(0x7f4efc1c8010 legacy=0x7f4efc1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:16.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.982 7f4f0145f700 1 -- 172.21.15.79:0/162998478 >> v1:172.21.15.79:6789/0 conn(0x7f4efc0f5520 legacy=0x7f4efc0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:16.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.982 7f4f00c5e700 1 -- 172.21.15.79:0/162998478 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197124220 0 0) 0x7f4ef00010d0 con 0x7f4efc0f5520 2021-04-09T18:27:16.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.982 7f4f0145f700 1 -- 172.21.15.79:0/162998478 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4efc0e4330 con 0x7f4efc0e9ae0 2021-04-09T18:27:16.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.982 7f4f0145f700 1 --2- 172.21.15.79:0/162998478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4efc0e9ae0 0x7f4efc09f110 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f4ef80032b0 tx=0x7f4ef800b0e0).ready entity=mon.0 client_cookie=401b71af931cf396 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:16.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.982 7f4f00c5e700 1 -- 172.21.15.79:0/162998478 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4efc0e4330 con 0x7f4efc0e9ae0 2021-04-09T18:27:16.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.982 7f4f00c5e700 1 -- 172.21.15.79:0/162998478 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef800bab0 con 0x7f4efc0e9ae0 2021-04-09T18:27:16.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.982 7f4f00c5e700 1 -- 172.21.15.79:0/162998478 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4ef8002020 con 0x7f4efc0e9ae0 2021-04-09T18:27:16.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.982 7f4f03ebc700 1 -- 172.21.15.79:0/162998478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4efc0e9ae0 msgr2=0x7f4efc09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:16.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.982 7f4f03ebc700 1 --2- 172.21.15.79:0/162998478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4efc0e9ae0 0x7f4efc09f110 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f4ef80032b0 tx=0x7f4ef800b0e0).stop 2021-04-09T18:27:16.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.982 7f4f03ebc700 1 -- 172.21.15.79:0/162998478 shutdown_connections 2021-04-09T18:27:16.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.982 7f4f03ebc700 1 --2- 172.21.15.79:0/162998478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4efc0e9ae0 0x7f4efc09f110 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:16.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.982 7f4f03ebc700 1 -- 172.21.15.79:0/162998478 >> 172.21.15.79:0/162998478 conn(0x7f4efc0e5fe0 msgr2=0x7f4efc0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:16.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.982 7f4f03ebc700 1 -- 172.21.15.79:0/162998478 shutdown_connections 2021-04-09T18:27:16.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.982 7f4f03ebc700 1 -- 172.21.15.79:0/162998478 wait complete. 2021-04-09T18:27:17.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.986 7f4f03ebc700 1 Processor -- start 2021-04-09T18:27:17.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.986 7f4f03ebc700 1 -- start start 2021-04-09T18:27:17.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f03ebc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4efc0af1e0 0x7f4efc095c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:17.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f03ebc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4efc0b11f0 0x7f4efc0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:17.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f03ebc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4efc1cf790 0x7f4efc1cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:17.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f03ebc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc0e9f30 con 0x7f4efc0b11f0 2021-04-09T18:27:17.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f03ebc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc0af950 con 0x7f4efc1cf790 2021-04-09T18:27:17.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f03ebc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc0afc50 con 0x7f4efc0af1e0 2021-04-09T18:27:17.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f0145f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4efc0b11f0 0x7f4efc0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:17.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f0145f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4efc0b11f0 0x7f4efc0b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57170/0 (socket says 172.21.15.79:57170) 2021-04-09T18:27:17.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f0145f700 1 -- 172.21.15.79:0/2094396554 learned_addr learned my addr 172.21.15.79:0/2094396554 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:27:17.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f01c60700 1 --2- 172.21.15.79:0/2094396554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4efc0af1e0 0x7f4efc095c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:17.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f02461700 1 --2- 172.21.15.79:0/2094396554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4efc1cf790 0x7f4efc1cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:17.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f0145f700 1 -- 172.21.15.79:0/2094396554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4efc0af1e0 msgr2=0x7f4efc095c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:17.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f0145f700 1 --2- 172.21.15.79:0/2094396554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4efc0af1e0 0x7f4efc095c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:17.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f0145f700 1 -- 172.21.15.79:0/2094396554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4efc1cf790 msgr2=0x7f4efc1cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:17.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f0145f700 1 --2- 172.21.15.79:0/2094396554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4efc1cf790 0x7f4efc1cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:17.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f0145f700 1 -- 172.21.15.79:0/2094396554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4efc096270 con 0x7f4efc0b11f0 2021-04-09T18:27:17.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f02461700 1 --2- 172.21.15.79:0/2094396554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4efc1cf790 0x7f4efc1cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:27:17.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f0145f700 1 --2- 172.21.15.79:0/2094396554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4efc0b11f0 0x7f4efc0b1640 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f4ef8011fc0 tx=0x7f4ef8006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:17.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4eee7fc700 1 -- 172.21.15.79:0/2094396554 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4efc096270 con 0x7f4efc0b11f0 2021-04-09T18:27:17.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4eee7fc700 1 -- 172.21.15.79:0/2094396554 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef8020020 con 0x7f4efc0b11f0 2021-04-09T18:27:17.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4eee7fc700 1 -- 172.21.15.79:0/2094396554 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4ef801b930 con 0x7f4efc0b11f0 2021-04-09T18:27:17.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f03ebc700 1 -- 172.21.15.79:0/2094396554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4efc09aae0 con 0x7f4efc0b11f0 2021-04-09T18:27:17.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f03ebc700 1 -- 172.21.15.79:0/2094396554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4efc1d0210 con 0x7f4efc0b11f0 2021-04-09T18:27:17.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4eee7fc700 1 -- 172.21.15.79:0/2094396554 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4ef802b060 con 0x7f4efc0b11f0 2021-04-09T18:27:17.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4eee7fc700 1 --2- 172.21.15.79:0/2094396554 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4ee4029100 0x7f4ee402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:17.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4eee7fc700 1 -- 172.21.15.79:0/2094396554 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f4ef8003020 con 0x7f4efc0b11f0 2021-04-09T18:27:17.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f01c60700 1 --2- 172.21.15.79:0/2094396554 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4ee4029100 0x7f4ee402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:17.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.990 7f4f01c60700 1 --2- 172.21.15.79:0/2094396554 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4ee4029100 0x7f4ee402b650 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:17.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.998 7f4f12f42740 1 Processor -- start 2021-04-09T18:27:17.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.998 7f4f12f42740 1 -- start start 2021-04-09T18:27:17.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.998 7f4f12f42740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d374740 0x55ff2d3a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:17.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.998 7f4f12f42740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d374b90 0x55ff2d3a33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:17.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.998 7f4f12f42740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3b4770 0x55ff2d3b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:17.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.998 7f4f12f42740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff2d179200 con 0x55ff2d374740 2021-04-09T18:27:17.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.998 7f4f12f42740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff2d15c320 con 0x55ff2d3b4770 2021-04-09T18:27:17.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.998 7f4f12f42740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff2d2487a0 con 0x55ff2d374b90 2021-04-09T18:27:17.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.998 7f4f01c60700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d374740 0x55ff2d3a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:17.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.998 7f4f01c60700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d374740 0x55ff2d3a2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57176/0 (socket says 172.21.15.79:57176) 2021-04-09T18:27:17.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.998 7f4f01c60700 1 -- 172.21.15.79:0/2819675272 learned_addr learned my addr 172.21.15.79:0/2819675272 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:27:17.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.998 7f4f0145f700 1 --2- 172.21.15.79:0/2819675272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d374b90 0x55ff2d3a33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:17.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.998 7f4f02461700 1 --2- 172.21.15.79:0/2819675272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3b4770 0x55ff2d3b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:17.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.998 7f4f01c60700 1 -- 172.21.15.79:0/2819675272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d374b90 msgr2=0x55ff2d3a33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:17.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.998 7f4f01c60700 1 --2- 172.21.15.79:0/2819675272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d374b90 0x55ff2d3a33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:17.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.998 7f4f01c60700 1 -- 172.21.15.79:0/2819675272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3b4770 msgr2=0x55ff2d3b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:17.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.998 7f4f01c60700 1 --2- 172.21.15.79:0/2819675272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3b4770 0x55ff2d3b6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:17.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.998 7f4f01c60700 1 -- 172.21.15.79:0/2819675272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff2d35de40 con 0x55ff2d374740 2021-04-09T18:27:17.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.998 7f4f0145f700 1 --2- 172.21.15.79:0/2819675272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d374b90 0x55ff2d3a33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:27:17.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:16.998 7f4f02461700 1 --2- 172.21.15.79:0/2819675272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3b4770 0x55ff2d3b6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:27:17.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.002 7f4f01c60700 1 --2- 172.21.15.79:0/2819675272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d374740 0x55ff2d3a2da0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f4ef0008000 tx=0x7f4ef8006e80).ready entity=mon.0 client_cookie=ce29b6d3f0a0b93e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:17.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.002 7f4f03ebc700 1 -- 172.21.15.79:0/2819675272 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55ff2d35de40 con 0x55ff2d374740 2021-04-09T18:27:17.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.002 7f4f03ebc700 1 -- 172.21.15.79:0/2819675272 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef0014460 con 0x55ff2d374740 2021-04-09T18:27:17.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.002 7f4f03ebc700 1 -- 172.21.15.79:0/2819675272 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4ef0010040 con 0x55ff2d374740 2021-04-09T18:27:17.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.002 7f4f12f42740 1 -- 172.21.15.79:0/2819675272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d374740 msgr2=0x55ff2d3a2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:17.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.002 7f4f12f42740 1 --2- 172.21.15.79:0/2819675272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d374740 0x55ff2d3a2da0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f4ef0008000 tx=0x7f4ef8006e80).stop 2021-04-09T18:27:17.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.002 7f4f12f42740 1 -- 172.21.15.79:0/2819675272 shutdown_connections 2021-04-09T18:27:17.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.002 7f4f12f42740 1 --2- 172.21.15.79:0/2819675272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3b4770 0x55ff2d3b6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:17.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.002 7f4f12f42740 1 --2- 172.21.15.79:0/2819675272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d374740 0x55ff2d3a2da0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:17.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.002 7f4f12f42740 1 --2- 172.21.15.79:0/2819675272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d374b90 0x55ff2d3a33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:17.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.002 7f4f12f42740 1 -- 172.21.15.79:0/2819675272 >> 172.21.15.79:0/2819675272 conn(0x55ff2d367d00 msgr2=0x55ff2d3a72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:17.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.002 7f4f12f42740 1 -- 172.21.15.79:0/2819675272 shutdown_connections 2021-04-09T18:27:17.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.002 7f4f12f42740 1 -- 172.21.15.79:0/2819675272 wait complete. 2021-04-09T18:27:17.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.002 7f4f12f42740 1 -- start start 2021-04-09T18:27:17.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.002 7f4f12f42740 1 Processor -- start 2021-04-09T18:27:17.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f12f42740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3775f0 0x55ff2d3b4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:17.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f12f42740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d377a40 0x55ff2d3b86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:17.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f12f42740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3b8ce0 0x55ff2d3b9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:17.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f12f42740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff2d375d70 con 0x55ff2d3775f0 2021-04-09T18:27:17.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f12f42740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff2d36f7e0 con 0x55ff2d3b8ce0 2021-04-09T18:27:17.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f12f42740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff2d376070 con 0x55ff2d377a40 2021-04-09T18:27:17.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f01c60700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3775f0 0x55ff2d3b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:17.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f12f42740 10 client.0 ll_register_callbacks cb 0x55ff2d3244b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-04-09T18:27:17.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f01c60700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3775f0 0x55ff2d3b4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57182/0 (socket says 172.21.15.79:57182) 2021-04-09T18:27:17.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f01c60700 1 -- 172.21.15.79:0/157344864 learned_addr learned my addr 172.21.15.79:0/157344864 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:27:17.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f0145f700 1 --2- 172.21.15.79:0/157344864 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d377a40 0x55ff2d3b86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:17.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f02461700 1 --2- 172.21.15.79:0/157344864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3b8ce0 0x55ff2d3b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:17.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f01c60700 1 -- 172.21.15.79:0/157344864 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d377a40 msgr2=0x55ff2d3b86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:17.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f01c60700 1 --2- 172.21.15.79:0/157344864 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d377a40 0x55ff2d3b86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:17.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f01c60700 1 -- 172.21.15.79:0/157344864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3b8ce0 msgr2=0x55ff2d3b9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:17.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f01c60700 1 --2- 172.21.15.79:0/157344864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3b8ce0 0x55ff2d3b9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:17.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f01c60700 1 -- 172.21.15.79:0/157344864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff2d25ac80 con 0x55ff2d3775f0 2021-04-09T18:27:17.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f01c60700 1 --2- 172.21.15.79:0/157344864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3775f0 0x55ff2d3b4730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f4ef0008000 tx=0x7f4ef000b040).ready entity=mon.0 client_cookie=4885cddaef05e34b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:17.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4ed3fff700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2021-04-09T18:27:17.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4ed3fff700 1 -- 172.21.15.79:0/157344864 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55ff2d25ac80 con 0x55ff2d3775f0 2021-04-09T18:27:17.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4ed3fff700 1 -- 172.21.15.79:0/157344864 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f4ef0011040 con 0x55ff2d3775f0 2021-04-09T18:27:17.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f12f42740 1 -- 172.21.15.79:0/157344864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ff2d265b00 con 0x55ff2d3775f0 2021-04-09T18:27:17.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4ed3fff700 1 -- 172.21.15.79:0/157344864 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=11) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ef0006830 con 0x55ff2d3775f0 2021-04-09T18:27:17.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f12f42740 10 client.5067 fetch_fsmap learned FSMap version 11 2021-04-09T18:27:17.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f12f42740 1 -- 172.21.15.79:0/157344864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=11,monmap=2+}) v3 -- 0x55ff2d24c700 con 0x55ff2d3775f0 2021-04-09T18:27:17.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4ed3fff700 1 -- 172.21.15.79:0/157344864 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ff2d265b00 con 0x55ff2d3775f0 2021-04-09T18:27:17.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4ed3fff700 1 -- 172.21.15.79:0/157344864 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 11) v1 ==== 1247+0+0 (secure 0 0 0) 0x7f4ef0017980 con 0x55ff2d3775f0 2021-04-09T18:27:17.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f12f42740 10 client.5067 fetch_fsmap finished waiting for FSMap version 11 2021-04-09T18:27:17.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f12f42740 10 client.5067 resolve_mds: resolved ID 'b' to GID 4634 2021-04-09T18:27:17.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f12f42740 20 client.5067 populate_metadata read hostname 'smithi079' 2021-04-09T18:27:17.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f12f42740 1 --2- 172.21.15.79:0/157344864 >> [v2:172.21.15.89:6834/3906387944,v1:172.21.15.89:6835/3906387944] conn(0x55ff2d378440 0x55ff2d378890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:17.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f12f42740 4 client.5067 mds_command: new command op to 4634 tid=0[{"prefix": "get_command_descriptions"}] 2021-04-09T18:27:17.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f12f42740 1 -- 172.21.15.79:0/157344864 --> [v2:172.21.15.89:6834/3906387944,v1:172.21.15.89:6835/3906387944] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ff2d0ebfd0 con 0x55ff2d378440 2021-04-09T18:27:17.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f0145f700 1 --2- 172.21.15.79:0/157344864 >> [v2:172.21.15.89:6834/3906387944,v1:172.21.15.89:6835/3906387944] conn(0x55ff2d378440 0x55ff2d378890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:17.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4ed3fff700 10 client.5067 ms_handle_connect on v2:172.21.15.89:6834/3906387944 2021-04-09T18:27:17.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f0145f700 1 --2- 172.21.15.79:0/157344864 >> [v2:172.21.15.89:6834/3906387944,v1:172.21.15.89:6835/3906387944] conn(0x55ff2d378440 0x55ff2d378890 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fec17f6c28273251 server_cookie=d085b60b32d1a68f in_seq=0 out_seq=0 2021-04-09T18:27:17.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4ed3fff700 1 -- 172.21.15.79:0/157344864 <== mds.0 v2:172.21.15.89:6834/3906387944 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3729 (crc 0 0 0) 0x55ff2d0ebfd0 con 0x55ff2d378440 2021-04-09T18:27:17.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4ed3fff700 10 client.5067 handle_command_reply: tid=0 2021-04-09T18:27:17.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.006 7f4f12f42740 1 client.5067 shutdown 2021-04-09T18:27:17.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.010 7f4f12f42740 1 -- 172.21.15.79:0/157344864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3775f0 msgr2=0x55ff2d3b4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:17.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.010 7f4f12f42740 1 --2- 172.21.15.79:0/157344864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3775f0 0x55ff2d3b4730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f4ef0008000 tx=0x7f4ef000b040).stop 2021-04-09T18:27:17.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.010 7f4f12f42740 1 -- 172.21.15.79:0/157344864 shutdown_connections 2021-04-09T18:27:17.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.010 7f4f12f42740 1 --2- 172.21.15.79:0/157344864 >> [v2:172.21.15.89:6834/3906387944,v1:172.21.15.89:6835/3906387944] conn(0x55ff2d378440 0x55ff2d378890 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:17.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.010 7f4f12f42740 1 --2- 172.21.15.79:0/157344864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3b8ce0 0x55ff2d3b9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:17.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.010 7f4f12f42740 1 --2- 172.21.15.79:0/157344864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3775f0 0x55ff2d3b4730 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:17.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.010 7f4f12f42740 1 --2- 172.21.15.79:0/157344864 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d377a40 0x55ff2d3b86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:17.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.010 7f4f12f42740 1 -- 172.21.15.79:0/157344864 >> 172.21.15.79:0/157344864 conn(0x55ff2d367d00 msgr2=0x55ff2d35c590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:17.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.010 7f4ed3fff700 0 client.5067 ms_handle_reset on v2:172.21.15.89:6834/3906387944 2021-04-09T18:27:17.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.010 7f4f12f42740 1 -- 172.21.15.79:0/157344864 shutdown_connections 2021-04-09T18:27:17.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.010 7f4f12f42740 1 -- 172.21.15.79:0/157344864 wait complete. 2021-04-09T18:27:17.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.010 7f4f12f42740 20 client.5067 trim_cache size 0 max 16384 2021-04-09T18:27:17.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.018 7f4f12f42740 1 Processor -- start 2021-04-09T18:27:17.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.018 7f4f12f42740 1 -- start start 2021-04-09T18:27:17.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f12f42740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3dc090 0x55ff2d37a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:17.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f12f42740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d3dc4e0 0x55ff2d37aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:17.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f12f42740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3e47d0 0x55ff2d3e4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:17.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f12f42740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff2d3a39a0 con 0x55ff2d3e47d0 2021-04-09T18:27:17.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f12f42740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff2d375a70 con 0x55ff2d3dc090 2021-04-09T18:27:17.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f12f42740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff2d3a4f00 con 0x55ff2d3dc4e0 2021-04-09T18:27:17.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f02461700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3e47d0 0x55ff2d3e4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:17.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f02461700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3e47d0 0x55ff2d3e4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57192/0 (socket says 172.21.15.79:57192) 2021-04-09T18:27:17.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f02461700 1 -- 172.21.15.79:0/3990037055 learned_addr learned my addr 172.21.15.79:0/3990037055 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:27:17.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f01c60700 1 --2- 172.21.15.79:0/3990037055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3dc090 0x55ff2d37a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:17.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f0145f700 1 --2- 172.21.15.79:0/3990037055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d3dc4e0 0x55ff2d37aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:17.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f02461700 1 -- 172.21.15.79:0/3990037055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d3dc4e0 msgr2=0x55ff2d37aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:17.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f02461700 1 --2- 172.21.15.79:0/3990037055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d3dc4e0 0x55ff2d37aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:17.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f02461700 1 -- 172.21.15.79:0/3990037055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3dc090 msgr2=0x55ff2d37a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:17.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f02461700 1 --2- 172.21.15.79:0/3990037055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3dc090 0x55ff2d37a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:17.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f02461700 1 -- 172.21.15.79:0/3990037055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff2d3db7d0 con 0x55ff2d3e47d0 2021-04-09T18:27:17.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f01c60700 1 --2- 172.21.15.79:0/3990037055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3dc090 0x55ff2d37a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:27:17.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f02461700 1 --2- 172.21.15.79:0/3990037055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3e47d0 0x55ff2d3e4c20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f4ef400d000 tx=0x7f4ef4011af0).ready entity=mon.0 client_cookie=beb7874a0b4b0bdb server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:17.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4ede7fc700 1 -- 172.21.15.79:0/3990037055 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55ff2d3db7d0 con 0x55ff2d3e47d0 2021-04-09T18:27:17.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4ede7fc700 1 -- 172.21.15.79:0/3990037055 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef4013960 con 0x55ff2d3e47d0 2021-04-09T18:27:17.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4ede7fc700 1 -- 172.21.15.79:0/3990037055 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4ef4010030 con 0x55ff2d3e47d0 2021-04-09T18:27:17.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f12f42740 1 -- 172.21.15.79:0/3990037055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3e47d0 msgr2=0x55ff2d3e4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:17.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f12f42740 1 --2- 172.21.15.79:0/3990037055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3e47d0 0x55ff2d3e4c20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f4ef400d000 tx=0x7f4ef4011af0).stop 2021-04-09T18:27:17.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f12f42740 1 -- 172.21.15.79:0/3990037055 shutdown_connections 2021-04-09T18:27:17.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f12f42740 1 --2- 172.21.15.79:0/3990037055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3dc090 0x55ff2d37a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:17.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f12f42740 1 --2- 172.21.15.79:0/3990037055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3e47d0 0x55ff2d3e4c20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:17.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f12f42740 1 --2- 172.21.15.79:0/3990037055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d3dc4e0 0x55ff2d37aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:17.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f12f42740 1 -- 172.21.15.79:0/3990037055 >> 172.21.15.79:0/3990037055 conn(0x55ff2d39df60 msgr2=0x55ff2d3c1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:17.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f12f42740 1 -- 172.21.15.79:0/3990037055 shutdown_connections 2021-04-09T18:27:17.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f12f42740 1 -- 172.21.15.79:0/3990037055 wait complete. 2021-04-09T18:27:17.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f12f42740 1 -- start start 2021-04-09T18:27:17.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.022 7f4f12f42740 1 Processor -- start 2021-04-09T18:27:17.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f12f42740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3b9860 0x55ff2d379b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:17.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f12f42740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d3d8090 0x55ff2d37b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:17.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f12f42740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3d84e0 0x55ff2d37bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:17.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f12f42740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff2d37b630 con 0x55ff2d3b9860 2021-04-09T18:27:17.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f12f42740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff2d3d8930 con 0x55ff2d3d84e0 2021-04-09T18:27:17.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f12f42740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff2d37c590 con 0x55ff2d3d8090 2021-04-09T18:27:17.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f12f42740 10 client.0 ll_register_callbacks cb 0x7f4efc0cd090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-04-09T18:27:17.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f01c60700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3b9860 0x55ff2d379b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:17.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f01c60700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3b9860 0x55ff2d379b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57196/0 (socket says 172.21.15.79:57196) 2021-04-09T18:27:17.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f01c60700 1 -- 172.21.15.79:0/909913223 learned_addr learned my addr 172.21.15.79:0/909913223 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:27:17.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f0145f700 1 --2- 172.21.15.79:0/909913223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d3d8090 0x55ff2d37b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:17.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f02461700 1 --2- 172.21.15.79:0/909913223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3d84e0 0x55ff2d37bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:17.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f01c60700 1 -- 172.21.15.79:0/909913223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d3d8090 msgr2=0x55ff2d37b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:17.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f01c60700 1 --2- 172.21.15.79:0/909913223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d3d8090 0x55ff2d37b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:17.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f01c60700 1 -- 172.21.15.79:0/909913223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3d84e0 msgr2=0x55ff2d37bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:17.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f01c60700 1 --2- 172.21.15.79:0/909913223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3d84e0 0x55ff2d37bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:17.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f01c60700 1 -- 172.21.15.79:0/909913223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff2d3b9cb0 con 0x55ff2d3b9860 2021-04-09T18:27:17.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f01c60700 1 --2- 172.21.15.79:0/909913223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3b9860 0x55ff2d379b40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x55ff2d3a3bc0 tx=0x7f4ef8006e80).ready entity=mon.0 client_cookie=1b7b797a20db2ac1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:17.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4edd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2021-04-09T18:27:17.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4edd7fa700 1 -- 172.21.15.79:0/909913223 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55ff2d3b9cb0 con 0x55ff2d3b9860 2021-04-09T18:27:17.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4edd7fa700 1 -- 172.21.15.79:0/909913223 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f4ef0006040 con 0x55ff2d3b9860 2021-04-09T18:27:17.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f12f42740 1 -- 172.21.15.79:0/909913223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ff2d25ac80 con 0x55ff2d3b9860 2021-04-09T18:27:17.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4edd7fa700 1 -- 172.21.15.79:0/909913223 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=11) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ef00062b0 con 0x55ff2d3b9860 2021-04-09T18:27:17.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f12f42740 10 client.5073 fetch_fsmap learned FSMap version 11 2021-04-09T18:27:17.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f12f42740 1 -- 172.21.15.79:0/909913223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=11,monmap=2+}) v3 -- 0x55ff2d37b1e0 con 0x55ff2d3b9860 2021-04-09T18:27:17.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4edd7fa700 1 -- 172.21.15.79:0/909913223 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ff2d25ac80 con 0x55ff2d3b9860 2021-04-09T18:27:17.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4edd7fa700 1 -- 172.21.15.79:0/909913223 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 11) v1 ==== 1247+0+0 (secure 0 0 0) 0x7f4ef0017980 con 0x55ff2d3b9860 2021-04-09T18:27:17.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f12f42740 10 client.5073 fetch_fsmap finished waiting for FSMap version 11 2021-04-09T18:27:17.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f12f42740 10 client.5073 resolve_mds: resolved ID 'b' to GID 4634 2021-04-09T18:27:17.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f12f42740 20 client.5073 populate_metadata read hostname 'smithi079' 2021-04-09T18:27:17.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f12f42740 1 --2- 172.21.15.79:0/909913223 >> [v2:172.21.15.89:6834/3906387944,v1:172.21.15.89:6835/3906387944] conn(0x55ff2d3ba5f0 0x55ff2d3baa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:17.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f12f42740 4 client.5073 mds_command: new command op to 4634 tid=0[{"prefix": "cache drop"}] 2021-04-09T18:27:17.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f12f42740 1 -- 172.21.15.79:0/909913223 --> [v2:172.21.15.89:6834/3906387944,v1:172.21.15.89:6835/3906387944] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x55ff2d0ebfd0 con 0x55ff2d3ba5f0 2021-04-09T18:27:17.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f0145f700 1 --2- 172.21.15.79:0/909913223 >> [v2:172.21.15.89:6834/3906387944,v1:172.21.15.89:6835/3906387944] conn(0x55ff2d3ba5f0 0x55ff2d3baa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:17.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4edd7fa700 10 client.5073 ms_handle_connect on v2:172.21.15.89:6834/3906387944 2021-04-09T18:27:17.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:27:17.026 7f4f0145f700 1 --2- 172.21.15.79:0/909913223 >> [v2:172.21.15.89:6834/3906387944,v1:172.21.15.89:6835/3906387944] conn(0x55ff2d3ba5f0 0x55ff2d3baa40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=40e3316203f2b57c server_cookie=9aa994d7fc31f8a0 in_seq=0 out_seq=0 2021-04-09T18:27:42.152 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:27:42.155 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:27:42.157 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:27:42.160 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:27:42.163 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:28:01.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4edd7fa700 1 -- 172.21.15.79:0/909913223 <== mds.0 v2:172.21.15.89:6834/3906387944 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+386 (crc 0 0 0) 0x55ff2d0ebfd0 con 0x55ff2d3ba5f0 2021-04-09T18:28:01.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4edd7fa700 10 client.5073 handle_command_reply: tid=0 2021-04-09T18:28:01.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f12f42740 1 client.5073 shutdown 2021-04-09T18:28:01.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f12f42740 1 -- 172.21.15.79:0/909913223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3b9860 msgr2=0x55ff2d379b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:01.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f12f42740 1 --2- 172.21.15.79:0/909913223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3b9860 0x55ff2d379b40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x55ff2d3a3bc0 tx=0x7f4ef8006e80).stop 2021-04-09T18:28:01.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f12f42740 1 -- 172.21.15.79:0/909913223 shutdown_connections 2021-04-09T18:28:01.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f12f42740 1 --2- 172.21.15.79:0/909913223 >> [v2:172.21.15.89:6834/3906387944,v1:172.21.15.89:6835/3906387944] conn(0x55ff2d3ba5f0 0x55ff2d3baa40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f12f42740 1 --2- 172.21.15.79:0/909913223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff2d3d84e0 0x55ff2d37bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4edd7fa700 0 client.5073 ms_handle_reset on v2:172.21.15.89:6834/3906387944 2021-04-09T18:28:01.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f12f42740 1 --2- 172.21.15.79:0/909913223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff2d3b9860 0x55ff2d379b40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f12f42740 1 --2- 172.21.15.79:0/909913223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ff2d3d8090 0x55ff2d37b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f12f42740 1 -- 172.21.15.79:0/909913223 >> 172.21.15.79:0/909913223 conn(0x55ff2d3885d0 msgr2=0x55ff2d387ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:01.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f12f42740 1 -- 172.21.15.79:0/909913223 shutdown_connections 2021-04-09T18:28:01.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f12f42740 1 -- 172.21.15.79:0/909913223 wait complete. 2021-04-09T18:28:01.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f12f42740 20 client.5073 trim_cache size 0 max 16384 2021-04-09T18:28:01.420 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:28:01.420 INFO:teuthology.orchestra.run.smithi079.stdout: "client_recall": { 2021-04-09T18:28:01.420 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2021-04-09T18:28:01.421 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "(0) Success", 2021-04-09T18:28:01.421 INFO:teuthology.orchestra.run.smithi079.stdout: "recalled": 920 2021-04-09T18:28:01.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:01.421 INFO:teuthology.orchestra.run.smithi079.stdout: "flush_journal": { 2021-04-09T18:28:01.422 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2021-04-09T18:28:01.422 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "" 2021-04-09T18:28:01.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:01.422 INFO:teuthology.orchestra.run.smithi079.stdout: "trim_cache": { 2021-04-09T18:28:01.422 INFO:teuthology.orchestra.run.smithi079.stdout: "trimmed": 900 2021-04-09T18:28:01.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:01.423 INFO:teuthology.orchestra.run.smithi079.stdout: "cache": { 2021-04-09T18:28:01.423 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": { 2021-04-09T18:28:01.423 INFO:teuthology.orchestra.run.smithi079.stdout: "items": 2499, 2021-04-09T18:28:01.424 INFO:teuthology.orchestra.run.smithi079.stdout: "bytes": 411776 2021-04-09T18:28:01.424 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:01.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:01.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 44.381891056000001 2021-04-09T18:28:01.424 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:28:01.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f03ebc700 1 -- 172.21.15.79:0/2094396554 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4ee4029100 msgr2=0x7f4ee402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:01.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f03ebc700 1 --2- 172.21.15.79:0/2094396554 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4ee4029100 0x7f4ee402b650 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f03ebc700 1 -- 172.21.15.79:0/2094396554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4efc0b11f0 msgr2=0x7f4efc0b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:01.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f03ebc700 1 --2- 172.21.15.79:0/2094396554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4efc0b11f0 0x7f4efc0b1640 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f4ef8011fc0 tx=0x7f4ef8006c10).stop 2021-04-09T18:28:01.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f03ebc700 1 -- 172.21.15.79:0/2094396554 shutdown_connections 2021-04-09T18:28:01.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f03ebc700 1 --2- 172.21.15.79:0/2094396554 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4ee4029100 0x7f4ee402b650 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f03ebc700 1 --2- 172.21.15.79:0/2094396554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4efc1cf790 0x7f4efc1cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f03ebc700 1 --2- 172.21.15.79:0/2094396554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4efc0af1e0 0x7f4efc095c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f03ebc700 1 --2- 172.21.15.79:0/2094396554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4efc0b11f0 0x7f4efc0b1640 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f03ebc700 1 -- 172.21.15.79:0/2094396554 >> 172.21.15.79:0/2094396554 conn(0x7f4efc097650 msgr2=0x7f4efc0ac8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:01.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f03ebc700 1 -- 172.21.15.79:0/2094396554 shutdown_connections 2021-04-09T18:28:01.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:01.410 7f4f03ebc700 1 -- 172.21.15.79:0/2094396554 wait complete. 2021-04-09T18:28:01.429 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:28:01.430 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:28:01.446 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:28:01.464 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:28:01.483 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:28:01.499 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:28:01.519 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:28:01.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:28:01.520 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:28:01.520 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:28:01.531 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:28:01.532 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:28:01.533 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi090.front.sepia.ceph.com... 2021-04-09T18:28:01.533 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:28:01.533 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:28:01.613 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13073]: fuse finished with error 0 and tester_r 0 2021-04-09T18:28:01.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:28:01.615 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:28:01.615 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:28:01.662 INFO:teuthology.orchestra.run.smithi090.stdout:ext2/ext3 2021-04-09T18:28:01.663 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:28:01.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:28:01.779 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:28:01.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:28:01.828 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:28:01.828 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:28:01.835 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-04-09T18:28:01.836 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:28:01.837 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-04-09T18:28:01.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:28:01.838 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:28:01.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:28:01.887 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:28:01.887 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:28:01.895 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:28:01.896 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:28:01.897 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:28:01.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:28:01.899 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:28:01.946 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:28:02.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13fa221700 1 Processor -- start 2021-04-09T18:28:02.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13fa221700 1 -- start start 2021-04-09T18:28:02.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13fa221700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f13f41c9010 0x7f13f41cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:02.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13fa221700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f40fbb10 con 0x7f13f40e9ad0 2021-04-09T18:28:02.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13fa221700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f409f900 con 0x7f13f40f5510 2021-04-09T18:28:02.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13fa221700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f41c3db0 con 0x7f13f41c9010 2021-04-09T18:28:02.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13f2ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f13f40e9ad0 0x7f13f409f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51916/0 (socket says 172.21.15.79:51916) 2021-04-09T18:28:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13f2ffd700 1 -- 172.21.15.79:0/3832314709 learned_addr learned my addr 172.21.15.79:0/3832314709 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:28:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13f3fff700 1 --2- 172.21.15.79:0/3832314709 >> v2:172.21.15.89:3300/0 conn(0x7f13f41c9010 0x7f13f41cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13f27fc700 1 -- 172.21.15.79:0/3832314709 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608489841 0 0) 0x7f13e4001450 con 0x7f13f40e9ad0 2021-04-09T18:28:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13f27fc700 1 -- 172.21.15.79:0/3832314709 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13e0003240 con 0x7f13f40e9ad0 2021-04-09T18:28:02.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13f27fc700 1 -- 172.21.15.79:0/3832314709 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 256773967 0 0) 0x7f13e40019d0 con 0x7f13f40e9ad0 2021-04-09T18:28:02.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13f27fc700 1 -- 172.21.15.79:0/3832314709 >> v2:172.21.15.89:3300/0 conn(0x7f13f41c9010 msgr2=0x7f13f41cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:02.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13f27fc700 1 --2- 172.21.15.79:0/3832314709 >> v2:172.21.15.89:3300/0 conn(0x7f13f41c9010 0x7f13f41cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13f27fc700 1 -- 172.21.15.79:0/3832314709 >> v1:172.21.15.89:6789/0 conn(0x7f13f40f5510 legacy=0x7f13f40f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:02.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13f27fc700 1 -- 172.21.15.79:0/3832314709 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f40e56c0 con 0x7f13f40e9ad0 2021-04-09T18:28:02.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13f27fc700 1 -- 172.21.15.79:0/3832314709 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f13e4001f30 con 0x7f13f40e9ad0 2021-04-09T18:28:02.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13f3fff700 1 --2- 172.21.15.79:0/3832314709 >> v2:172.21.15.89:3300/0 conn(0x7f13f41c9010 0x7f13f41cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:02.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13f27fc700 1 -- 172.21.15.79:0/3832314709 >> v1:172.21.15.79:6789/0 conn(0x7f13f40e9ad0 legacy=0x7f13f409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:02.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13f27fc700 1 --2- 172.21.15.79:0/3832314709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13e00038c0 0x7f13e0003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:02.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13f27fc700 1 --2- 172.21.15.79:0/3832314709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13e00045a0 0x7f13e0004a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:02.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13f27fc700 1 --2- 172.21.15.79:0/3832314709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13e00097e0 0x7f13e000bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:02.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13f27fc700 1 -- 172.21.15.79:0/3832314709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f41c3db0 con 0x7f13e00038c0 2021-04-09T18:28:02.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13f27fc700 1 -- 172.21.15.79:0/3832314709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e000c270 con 0x7f13e00045a0 2021-04-09T18:28:02.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13f27fc700 1 -- 172.21.15.79:0/3832314709 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e0050430 con 0x7f13e00097e0 2021-04-09T18:28:02.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.038 7f13f37fe700 1 --2- 172.21.15.79:0/3832314709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13e00038c0 0x7f13e0003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:02.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.042 7f13f2ffd700 1 --2- 172.21.15.79:0/3832314709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13e00045a0 0x7f13e0004a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:02.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.042 7f13f3fff700 1 --2- 172.21.15.79:0/3832314709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13e00097e0 0x7f13e000bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:02.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.042 7f13f37fe700 1 -- 172.21.15.79:0/3832314709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13e00097e0 msgr2=0x7f13e000bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:02.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.042 7f13f37fe700 1 --2- 172.21.15.79:0/3832314709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13e00097e0 0x7f13e000bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.042 7f13f37fe700 1 -- 172.21.15.79:0/3832314709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13e00045a0 msgr2=0x7f13e0004a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:02.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.042 7f13f37fe700 1 --2- 172.21.15.79:0/3832314709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13e00045a0 0x7f13e0004a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.042 7f13f37fe700 1 -- 172.21.15.79:0/3832314709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e00506a0 con 0x7f13e00038c0 2021-04-09T18:28:02.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.042 7f13f3fff700 1 -- 172.21.15.79:0/3832314709 reap_dead start 2021-04-09T18:28:02.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.042 7f13f37fe700 1 --2- 172.21.15.79:0/3832314709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13e00038c0 0x7f13e0003d70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f13dc001020 tx=0x7f13dc001ce0).ready entity=mon.0 client_cookie=46e3b8ed85764c77 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:02.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.042 7f13f27fc700 1 -- 172.21.15.79:0/3832314709 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f13e00506a0 con 0x7f13e00038c0 2021-04-09T18:28:02.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.042 7f13f27fc700 1 -- 172.21.15.79:0/3832314709 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13dc00c780 con 0x7f13e00038c0 2021-04-09T18:28:02.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.042 7f13f27fc700 1 -- 172.21.15.79:0/3832314709 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f13dc00cb50 con 0x7f13e00038c0 2021-04-09T18:28:02.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.042 7f13fa221700 1 -- 172.21.15.79:0/3832314709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13e00038c0 msgr2=0x7f13e0003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:02.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.042 7f13fa221700 1 --2- 172.21.15.79:0/3832314709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13e00038c0 0x7f13e0003d70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f13dc001020 tx=0x7f13dc001ce0).stop 2021-04-09T18:28:02.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.042 7f13fa221700 1 -- 172.21.15.79:0/3832314709 shutdown_connections 2021-04-09T18:28:02.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.042 7f13fa221700 1 --2- 172.21.15.79:0/3832314709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13e00038c0 0x7f13e0003d70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.042 7f13fa221700 1 -- 172.21.15.79:0/3832314709 >> 172.21.15.79:0/3832314709 conn(0x7f13f40e5fd0 msgr2=0x7f13f40e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:02.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.042 7f13fa221700 1 -- 172.21.15.79:0/3832314709 shutdown_connections 2021-04-09T18:28:02.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.042 7f13fa221700 1 -- 172.21.15.79:0/3832314709 wait complete. 2021-04-09T18:28:02.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13fa221700 1 Processor -- start 2021-04-09T18:28:02.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13fa221700 1 -- start start 2021-04-09T18:28:02.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13fa221700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13f40a2cb0 0x7f13f40d5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:02.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13fa221700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13f40a3100 0x7f13f41ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:02.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13fa221700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13f40d56b0 0x7f13f41aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:02.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13fa221700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f40e9f20 con 0x7f13f40a3100 2021-04-09T18:28:02.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13fa221700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f40bf760 con 0x7f13f40d56b0 2021-04-09T18:28:02.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13fa221700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f40bfa60 con 0x7f13f40a2cb0 2021-04-09T18:28:02.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13f2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13f40a3100 0x7f13f41ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:02.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13f2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13f40a3100 0x7f13f41ae4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57218/0 (socket says 172.21.15.79:57218) 2021-04-09T18:28:02.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13f2ffd700 1 -- 172.21.15.79:0/241871458 learned_addr learned my addr 172.21.15.79:0/241871458 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:02.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13f3fff700 1 --2- 172.21.15.79:0/241871458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13f40d56b0 0x7f13f41aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:02.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13f37fe700 1 --2- 172.21.15.79:0/241871458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13f40a2cb0 0x7f13f40d5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:02.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13f2ffd700 1 -- 172.21.15.79:0/241871458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13f40a2cb0 msgr2=0x7f13f40d5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:02.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13f2ffd700 1 --2- 172.21.15.79:0/241871458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13f40a2cb0 0x7f13f40d5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13f2ffd700 1 -- 172.21.15.79:0/241871458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13f40d56b0 msgr2=0x7f13f41aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:02.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13f2ffd700 1 --2- 172.21.15.79:0/241871458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13f40d56b0 0x7f13f41aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13f2ffd700 1 -- 172.21.15.79:0/241871458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f40bf2f0 con 0x7f13f40a3100 2021-04-09T18:28:02.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13f2ffd700 1 --2- 172.21.15.79:0/241871458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13f40a3100 0x7f13f41ae4e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f13f40d8240 tx=0x7f13e400e430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:02.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13ebfff700 1 -- 172.21.15.79:0/241871458 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f13f40bf2f0 con 0x7f13f40a3100 2021-04-09T18:28:02.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13ebfff700 1 -- 172.21.15.79:0/241871458 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e400ed70 con 0x7f13f40a3100 2021-04-09T18:28:02.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13fa221700 1 -- 172.21.15.79:0/241871458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f41af140 con 0x7f13f40a3100 2021-04-09T18:28:02.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.046 7f13ebfff700 1 -- 172.21.15.79:0/241871458 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f13f40e56c0 con 0x7f13f40a3100 2021-04-09T18:28:02.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.050 7f13fa221700 1 -- 172.21.15.79:0/241871458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f41aad70 con 0x7f13f40a3100 2021-04-09T18:28:02.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.050 7f13ebfff700 1 -- 172.21.15.79:0/241871458 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f13e4014610 con 0x7f13f40a3100 2021-04-09T18:28:02.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.050 7f13ebfff700 1 --2- 172.21.15.79:0/241871458 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f13d8029100 0x7f13d802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:02.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.050 7f13ebfff700 1 -- 172.21.15.79:0/241871458 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f13e401a030 con 0x7f13f40a3100 2021-04-09T18:28:02.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.050 7f13f37fe700 1 --2- 172.21.15.79:0/241871458 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f13d8029100 0x7f13d802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:02.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.050 7f13f37fe700 1 --2- 172.21.15.79:0/241871458 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f13d8029100 0x7f13d802b650 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:02.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.054 7f13fa221700 1 -- 172.21.15.79:0/241871458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f40e39d0 con 0x7f13f40a3100 2021-04-09T18:28:02.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.062 7f13ebfff700 1 -- 172.21.15.79:0/241871458 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f13e4000f70 con 0x7f13f40a3100 2021-04-09T18:28:02.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.234 7f13fa221700 1 -- 172.21.15.79:0/241871458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f13f40a1cb0 con 0x7f13f40a3100 2021-04-09T18:28:02.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.234 7f13ebfff700 1 -- 172.21.15.79:0/241871458 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v31) v1 ==== 81+0+30752 (secure 0 0 0) 0x7f13e400eb60 con 0x7f13f40a3100 2021-04-09T18:28:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:28:02.242 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:28:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 31, 2021-04-09T18:28:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:28:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:28:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:26:57.617381", 2021-04-09T18:28:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:28:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:28:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:28:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:28:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:28:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:28:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:28:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:28:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:28:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:28:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:28:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:28:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:28:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:28:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:28:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 5, 2021-04-09T18:28:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:28:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:28:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:28:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:28:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:28:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:28:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:28:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:28:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:28:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:28:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:28:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:28:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:28:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:28:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:28:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:28:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:28:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:28:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:28:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:28:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:28:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:28:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:28:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:28:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:28:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:28:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:28:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:28:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.254 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:28:02.254 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:28:02.254 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:28:02.254 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:28:02.254 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:28:02.255 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:28:02.255 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:28:02.255 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:28:02.255 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:28:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:28:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:28:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:28:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:28:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:28:02.257 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:28:02.257 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:28:02.257 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:28:02.258 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:28:02.258 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:28:02.258 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:28:02.258 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:28:02.259 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:28:02.259 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:28:02.259 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:28:02.259 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:28:02.259 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:28:02.260 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:28:02.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.260 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:28:02.261 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:28:02.261 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:28:02.261 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:28:02.261 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:28:02.262 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:28:02.262 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:28:02.262 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:28:02.262 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:28:02.262 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:28:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:28:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:28:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:28:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:28:02.264 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.264 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 4, 2021-04-09T18:28:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2021-04-09T18:28:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:54.507577", 2021-04-09T18:28:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:28:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:28:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:28:02.266 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:28:02.266 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:28:02.266 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:28:02.266 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:28:02.266 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:28:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:28:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:28:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:28:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:28:02.268 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:28:02.268 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:28:02.268 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:28:02.269 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:28:02.269 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:28:02.269 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:28:02.269 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:28:02.269 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:28:02.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.270 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "30", 2021-04-09T18:28:02.270 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:28:02.270 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:28:02.271 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:28:02.271 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:28:02.271 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:28:02.271 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:28:02.271 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:28:02.272 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:28:02.272 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:28:02.272 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:28:02.272 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:28:02.273 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:28:02.273 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:28:02.273 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:28:02.273 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:28:02.273 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:28:02.274 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:28:02.274 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:28:02.274 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:28:02.274 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:28:02.274 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:28:02.275 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:28:02.275 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:28:02.275 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:28:02.275 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:28:02.276 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:28:02.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.276 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:28:02.276 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:28:02.276 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:28:02.277 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:28:02.277 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:28:02.277 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:28:02.277 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:28:02.278 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:28:02.278 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:28:02.278 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:28:02.279 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:28:02.279 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2021-04-09T18:28:02.279 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2021-04-09T18:28:02.279 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2021-04-09T18:28:02.280 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2021-04-09T18:28:02.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.280 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:28:02.280 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:28:02.280 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2021-04-09T18:28:02.281 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.281 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.281 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 5, 2021-04-09T18:28:02.282 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2021-04-09T18:28:02.282 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:55.665017", 2021-04-09T18:28:02.282 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:28:02.282 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:28:02.283 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:28:02.283 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:28:02.283 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:28:02.283 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:28:02.284 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:28:02.284 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:28:02.284 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:28:02.284 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:28:02.284 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:28:02.285 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:28:02.285 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:28:02.285 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:28:02.285 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:28:02.286 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:28:02.286 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:28:02.286 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:28:02.286 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:28:02.287 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:28:02.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.287 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "31", 2021-04-09T18:28:02.288 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:28:02.288 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:28:02.288 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:28:02.289 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:28:02.289 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:28:02.289 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:28:02.289 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:28:02.290 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:28:02.290 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:28:02.290 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:28:02.290 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:28:02.290 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:28:02.291 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:28:02.291 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:28:02.291 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:28:02.291 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:28:02.292 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:28:02.292 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:28:02.292 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:28:02.292 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:28:02.292 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:28:02.293 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:28:02.293 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:28:02.293 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:28:02.293 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:28:02.293 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:28:02.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.294 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:28:02.294 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:28:02.294 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:28:02.294 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:28:02.295 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:28:02.295 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:28:02.295 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:28:02.295 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:28:02.296 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:28:02.296 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:28:02.296 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:28:02.296 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:28:02.296 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:28:02.297 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:28:02.297 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2021-04-09T18:28:02.297 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.297 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.297 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.298 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:28:02.298 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:28:02.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.298 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:28:02.299 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:28:02.299 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:28:02.299 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:28:02.300 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:28:02.300 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:28:02.300 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:28:02.300 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:28:02.300 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:28:02.301 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 29, 2021-04-09T18:28:02.301 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:28:02.301 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:28:02.301 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:28:02.301 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.302 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.302 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:28:02.302 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:28:02.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.303 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.303 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:28:02.303 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:28:02.304 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.304 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.304 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:28:02.304 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.305 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.305 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:28:02.305 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:28:02.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.306 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.306 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:28:02.307 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:28:02.307 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.307 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.307 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:28:02.308 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.308 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.308 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:28:02.308 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:28:02.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.310 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.310 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:28:02.311 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:28:02.311 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.311 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.312 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:28:02.312 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.312 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.313 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:28:02.313 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:28:02.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.313 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.314 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:28:02.314 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:28:02.314 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.314 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.315 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:28:02.315 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:28:02.315 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:28:02.316 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:28:02.316 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:28:02.316 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:28:02.316 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:28:02.317 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.317 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:28:02.318 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:28:02.318 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:28:02.318 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:28:02.319 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:28:02.319 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:28:02.319 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:28:02.319 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:28:02.320 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:28:02.320 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 28, 2021-04-09T18:28:02.320 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:28:02.320 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:28:02.320 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:28:02.321 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.321 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.321 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:28:02.322 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:28:02.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.322 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.323 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:28:02.323 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:28:02.323 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.323 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.324 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:28:02.324 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.324 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.325 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:28:02.325 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:28:02.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.326 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.326 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:28:02.326 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:28:02.326 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.326 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.327 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:28:02.327 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.328 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.328 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:28:02.328 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:28:02.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.329 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.329 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:28:02.329 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:28:02.330 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.330 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.330 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:28:02.330 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.331 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.331 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:28:02.331 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:28:02.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.332 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.332 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:28:02.332 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:28:02.333 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.333 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.333 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:28:02.333 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:28:02.334 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:28:02.334 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:28:02.334 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:28:02.334 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:28:02.335 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:28:02.335 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.336 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:28:02.336 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:28:02.336 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:28:02.336 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:28:02.337 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:28:02.337 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:28:02.337 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:28:02.337 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:28:02.337 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:28:02.338 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 29, 2021-04-09T18:28:02.338 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:28:02.338 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:28:02.338 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:28:02.338 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.339 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.339 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:28:02.339 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:28:02.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.340 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.340 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:28:02.340 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:28:02.341 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.341 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.341 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:28:02.341 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.342 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.342 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:28:02.342 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:28:02.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.343 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.343 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:28:02.343 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:28:02.344 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.344 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.344 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:28:02.344 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.345 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.345 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:28:02.345 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:28:02.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.346 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.346 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:28:02.346 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:28:02.346 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.347 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.347 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:28:02.347 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.348 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.348 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:28:02.348 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:28:02.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.349 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.349 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:28:02.349 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:28:02.349 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.350 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.350 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:28:02.350 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:28:02.350 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:28:02.351 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:28:02.351 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:28:02.351 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:28:02.351 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:28:02.352 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.352 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:28:02.352 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:28:02.353 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:28:02.353 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:28:02.353 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:28:02.353 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:28:02.353 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:28:02.354 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:28:02.354 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:28:02.354 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 29, 2021-04-09T18:28:02.354 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:28:02.354 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:28:02.355 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:28:02.355 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.355 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.355 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:28:02.356 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:28:02.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.356 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.357 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:28:02.357 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:28:02.357 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.357 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.358 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:28:02.358 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.358 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.358 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:28:02.359 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:28:02.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.359 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.360 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:28:02.360 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:28:02.360 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.360 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.361 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:28:02.361 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.361 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.361 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:28:02.362 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:28:02.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.362 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.362 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:28:02.363 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:28:02.363 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.363 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.364 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:28:02.364 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.364 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.364 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:28:02.365 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:28:02.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.365 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.366 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:28:02.366 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:28:02.366 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.366 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.367 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:28:02.367 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:28:02.367 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:28:02.368 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:28:02.368 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:28:02.368 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:28:02.368 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:28:02.368 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.369 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:28:02.369 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:28:02.369 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:28:02.370 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:28:02.370 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:28:02.370 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:28:02.370 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:28:02.370 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:28:02.371 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:28:02.371 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 29, 2021-04-09T18:28:02.371 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:28:02.371 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:28:02.372 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:28:02.372 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.372 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.372 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:28:02.373 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:28:02.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.373 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.373 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:28:02.374 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:28:02.374 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.374 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.375 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:28:02.375 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.375 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.376 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:28:02.376 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:28:02.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.377 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.377 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:28:02.377 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:28:02.378 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.378 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.378 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:28:02.378 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.379 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.379 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:28:02.379 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:28:02.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.380 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.380 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:28:02.380 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:28:02.381 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.381 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.381 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:28:02.381 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.382 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.382 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:28:02.382 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:28:02.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.383 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.383 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:28:02.383 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:28:02.383 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.384 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.384 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:28:02.384 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:28:02.385 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:28:02.385 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:28:02.385 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:28:02.385 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:28:02.386 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:28:02.386 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.387 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:28:02.387 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:28:02.387 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:28:02.387 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:28:02.387 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:28:02.388 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:28:02.388 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:28:02.388 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:28:02.388 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:28:02.389 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 29, 2021-04-09T18:28:02.389 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:28:02.389 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:28:02.389 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:28:02.389 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.390 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.390 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:28:02.390 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:28:02.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.391 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.391 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:28:02.391 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:28:02.391 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.392 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.392 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:28:02.392 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.393 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.393 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:28:02.393 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:28:02.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.394 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.394 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:28:02.394 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:28:02.394 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.395 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.395 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:28:02.395 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.396 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.396 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:28:02.396 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:28:02.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.397 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.397 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:28:02.398 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:28:02.398 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.398 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.398 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:28:02.399 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.399 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.399 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:28:02.399 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:28:02.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.400 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.400 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:28:02.400 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:28:02.401 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.401 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.401 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:28:02.402 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:28:02.402 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:28:02.402 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:28:02.402 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:28:02.402 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:28:02.403 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:28:02.403 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.403 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:28:02.404 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:28:02.404 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:28:02.404 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:28:02.404 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:28:02.404 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:28:02.405 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:28:02.405 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:28:02.405 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:28:02.405 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 29, 2021-04-09T18:28:02.406 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:28:02.406 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:28:02.406 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:28:02.406 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.407 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.407 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:28:02.407 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:28:02.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.408 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.408 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:28:02.408 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:28:02.409 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.409 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.409 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:28:02.409 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.410 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.410 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:28:02.410 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:28:02.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.411 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.411 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:28:02.411 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:28:02.412 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.412 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.412 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:28:02.412 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.413 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.413 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:28:02.413 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:28:02.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.414 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.414 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:28:02.414 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:28:02.414 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.415 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.415 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:28:02.415 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.416 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.416 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:28:02.416 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:28:02.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.417 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.417 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:28:02.417 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:28:02.418 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.418 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.419 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:28:02.419 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:28:02.419 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:28:02.419 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:28:02.419 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:28:02.420 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:28:02.420 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:28:02.420 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.421 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:28:02.421 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:28:02.421 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:28:02.421 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:28:02.421 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:28:02.422 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:28:02.422 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:28:02.422 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:28:02.422 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:28:02.422 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 29, 2021-04-09T18:28:02.423 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:28:02.423 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:28:02.423 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:28:02.423 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.424 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.424 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:28:02.424 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:28:02.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.425 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.425 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:28:02.425 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:28:02.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.426 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.426 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:28:02.426 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.427 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.427 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:28:02.427 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:28:02.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.428 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.428 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:28:02.428 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:28:02.428 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.429 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.429 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:28:02.429 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.430 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.430 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:28:02.430 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:28:02.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.431 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.431 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:28:02.432 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:28:02.432 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.432 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.432 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:28:02.433 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:02.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.433 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:02.433 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:28:02.433 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:28:02.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.434 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:02.434 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:28:02.434 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:28:02.435 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.435 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.435 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:28:02.436 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:28:02.436 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:28:02.436 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:28:02.436 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:28:02.436 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:28:02.437 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:28:02.437 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:02.437 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.437 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:28:02.437 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:28:02.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.438 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:28:02.438 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:28:02.438 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:28:02.438 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:28:02.439 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:28:02.439 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:28:02.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.440 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:28:02.440 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:28:02.440 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:28:02.440 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:28:02.440 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:28:02.441 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:28:02.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.441 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:28:02.442 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:28:02.442 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:28:02.442 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:28:02.442 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:28:02.443 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:28:02.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.443 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:28:02.444 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:28:02.444 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:28:02.444 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:28:02.444 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:28:02.444 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:28:02.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.445 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:28:02.445 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:28:02.445 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:28:02.446 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:28:02.446 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:28:02.446 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:28:02.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.447 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:28:02.447 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:28:02.447 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:28:02.447 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:28:02.448 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:28:02.448 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:28:02.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.448 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:28:02.449 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:28:02.449 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:28:02.449 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:28:02.449 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:28:02.449 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:28:02.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:02.450 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:28:02.450 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:28:02.450 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:28:02.451 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:28:02.451 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:28:02.451 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:28:02.451 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.451 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:28:02.452 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:28:02.452 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:28:02.452 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:28:02.452 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:28:02.453 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": {}, 2021-04-09T18:28:02.453 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:28:02.453 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:28:02.453 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:28:02.454 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:28:02.454 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:28:02.454 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:28:02.454 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:28:02.455 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:28:02.455 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:28:02.455 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:28:02.455 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:28:02.456 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:28:02.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.456 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:28:02.456 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:28:02.456 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:28:02.457 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:28:02.457 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:28:02.457 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:28:02.457 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:28:02.457 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:02.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:02.458 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:28:02.458 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:28:02.458 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:28:02.458 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:28:02.459 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:28:02.459 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:28:02.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.238 7f13fa221700 1 -- 172.21.15.79:0/241871458 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f13d8029100 msgr2=0x7f13d802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:02.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.238 7f13fa221700 1 --2- 172.21.15.79:0/241871458 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f13d8029100 0x7f13d802b650 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.238 7f13fa221700 1 -- 172.21.15.79:0/241871458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13f40a3100 msgr2=0x7f13f41ae4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:02.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.238 7f13fa221700 1 --2- 172.21.15.79:0/241871458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13f40a3100 0x7f13f41ae4e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f13f40d8240 tx=0x7f13e400e430).stop 2021-04-09T18:28:02.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.238 7f13fa221700 1 -- 172.21.15.79:0/241871458 shutdown_connections 2021-04-09T18:28:02.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.238 7f13fa221700 1 --2- 172.21.15.79:0/241871458 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f13d8029100 0x7f13d802b650 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.238 7f13fa221700 1 --2- 172.21.15.79:0/241871458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13f40d56b0 0x7f13f41aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.238 7f13fa221700 1 --2- 172.21.15.79:0/241871458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13f40a2cb0 0x7f13f40d5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.238 7f13fa221700 1 --2- 172.21.15.79:0/241871458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13f40a3100 0x7f13f41ae4e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.238 7f13fa221700 1 -- 172.21.15.79:0/241871458 >> 172.21.15.79:0/241871458 conn(0x7f13f409a650 msgr2=0x7f13f40d8480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:02.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.238 7f13fa221700 1 -- 172.21.15.79:0/241871458 shutdown_connections 2021-04-09T18:28:02.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.238 7f13fa221700 1 -- 172.21.15.79:0/241871458 wait complete. 2021-04-09T18:28:02.464 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:02.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.558 7f3a6e279700 1 Processor -- start 2021-04-09T18:28:02.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.558 7f3a6e279700 1 -- start start 2021-04-09T18:28:02.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6e279700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a680e9ae0 0x7f3a6809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:02.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6e279700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a681c8010 0x7f3a681ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:02.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6e279700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a680fbb20 con 0x7f3a680f5520 2021-04-09T18:28:02.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6e279700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a681c3dc0 con 0x7f3a681c8010 2021-04-09T18:28:02.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6e279700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680e9f30 con 0x7f3a680e9ae0 2021-04-09T18:28:02.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6c81e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a681c8010 0x7f3a681ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:02.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6c81e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a681c8010 0x7f3a681ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57228/0 (socket says 172.21.15.79:57228) 2021-04-09T18:28:02.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6c81e700 1 -- 172.21.15.79:0/1559193930 learned_addr learned my addr 172.21.15.79:0/1559193930 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:02.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a677fe700 1 --2- 172.21.15.79:0/1559193930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a680e9ae0 0x7f3a6809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:02.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6c81e700 1 -- 172.21.15.79:0/1559193930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a680e9ae0 msgr2=0x7f3a6809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:02.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6c81e700 1 --2- 172.21.15.79:0/1559193930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a680e9ae0 0x7f3a6809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6c81e700 1 -- 172.21.15.79:0/1559193930 >> v1:172.21.15.89:6789/0 conn(0x7f3a680f5520 legacy=0x7f3a680f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:02.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6c81e700 1 -- 172.21.15.79:0/1559193930 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a680e56d0 con 0x7f3a681c8010 2021-04-09T18:28:02.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6c81e700 1 --2- 172.21.15.79:0/1559193930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a681c8010 0x7f3a681ca470 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f3a600032b0 tx=0x7f3a6000b3c0).ready entity=mon.0 client_cookie=5e257ec666b7a00c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:02.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a66ffd700 1 -- 172.21.15.79:0/1559193930 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a680e56d0 con 0x7f3a681c8010 2021-04-09T18:28:02.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a66ffd700 1 -- 172.21.15.79:0/1559193930 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6000bc20 con 0x7f3a681c8010 2021-04-09T18:28:02.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a66ffd700 1 -- 172.21.15.79:0/1559193930 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a60002020 con 0x7f3a681c8010 2021-04-09T18:28:02.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6e279700 1 -- 172.21.15.79:0/1559193930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a681c8010 msgr2=0x7f3a681ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:02.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6e279700 1 --2- 172.21.15.79:0/1559193930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a681c8010 0x7f3a681ca470 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f3a600032b0 tx=0x7f3a6000b3c0).stop 2021-04-09T18:28:02.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6e279700 1 -- 172.21.15.79:0/1559193930 shutdown_connections 2021-04-09T18:28:02.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6e279700 1 --2- 172.21.15.79:0/1559193930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a681c8010 0x7f3a681ca470 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6e279700 1 --2- 172.21.15.79:0/1559193930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a680e9ae0 0x7f3a6809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6e279700 1 -- 172.21.15.79:0/1559193930 >> 172.21.15.79:0/1559193930 conn(0x7f3a680e5fe0 msgr2=0x7f3a680e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:02.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6e279700 1 -- 172.21.15.79:0/1559193930 shutdown_connections 2021-04-09T18:28:02.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.562 7f3a6e279700 1 -- 172.21.15.79:0/1559193930 wait complete. 2021-04-09T18:28:02.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.566 7f3a6e279700 1 Processor -- start 2021-04-09T18:28:02.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.566 7f3a6e279700 1 -- start start 2021-04-09T18:28:02.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a6e279700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a6809a160 0x7f3a6808f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:02.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a6e279700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a680b94d0 0x7f3a68094bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:02.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a6e279700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a680b9920 0x7f3a681a6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:02.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a6e279700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6809b0b0 con 0x7f3a680b9920 2021-04-09T18:28:02.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a6e279700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6809a5b0 con 0x7f3a6809a160 2021-04-09T18:28:02.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a6e279700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6809b3b0 con 0x7f3a680b94d0 2021-04-09T18:28:02.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a6c81e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a680b9920 0x7f3a681a6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:02.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a6c81e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a680b9920 0x7f3a681a6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57234/0 (socket says 172.21.15.79:57234) 2021-04-09T18:28:02.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a677fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a680b94d0 0x7f3a68094bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:02.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a6c81e700 1 -- 172.21.15.79:0/662623589 learned_addr learned my addr 172.21.15.79:0/662623589 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:02.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a67fff700 1 --2- 172.21.15.79:0/662623589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a6809a160 0x7f3a6808f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:02.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a6c81e700 1 -- 172.21.15.79:0/662623589 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a680b94d0 msgr2=0x7f3a68094bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:02.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a6c81e700 1 --2- 172.21.15.79:0/662623589 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a680b94d0 0x7f3a68094bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a6c81e700 1 -- 172.21.15.79:0/662623589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a6809a160 msgr2=0x7f3a6808f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:02.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a6c81e700 1 --2- 172.21.15.79:0/662623589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a6809a160 0x7f3a6808f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a6c81e700 1 -- 172.21.15.79:0/662623589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a68095660 con 0x7f3a680b9920 2021-04-09T18:28:02.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a6c81e700 1 --2- 172.21.15.79:0/662623589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a680b9920 0x7f3a681a6670 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f3a68093e90 tx=0x7f3a60006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a64ff9700 1 -- 172.21.15.79:0/662623589 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a68095660 con 0x7f3a680b9920 2021-04-09T18:28:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a64ff9700 1 -- 172.21.15.79:0/662623589 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6001a6a0 con 0x7f3a680b9920 2021-04-09T18:28:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a6e279700 1 -- 172.21.15.79:0/662623589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6809ac40 con 0x7f3a680b9920 2021-04-09T18:28:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a64ff9700 1 -- 172.21.15.79:0/662623589 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a60020020 con 0x7f3a680b9920 2021-04-09T18:28:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.570 7f3a6e279700 1 -- 172.21.15.79:0/662623589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a681a6ca0 con 0x7f3a680b9920 2021-04-09T18:28:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.574 7f3a64ff9700 1 -- 172.21.15.79:0/662623589 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3a60019040 con 0x7f3a680b9920 2021-04-09T18:28:02.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.574 7f3a64ff9700 1 --2- 172.21.15.79:0/662623589 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a480290a0 0x7f3a4802b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:02.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.574 7f3a64ff9700 1 -- 172.21.15.79:0/662623589 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f3a60018040 con 0x7f3a680b9920 2021-04-09T18:28:02.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.574 7f3a67fff700 1 --2- 172.21.15.79:0/662623589 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a480290a0 0x7f3a4802b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:02.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.574 7f3a67fff700 1 --2- 172.21.15.79:0/662623589 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a480290a0 0x7f3a4802b5f0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.590 7f3a6e279700 1 -- 172.21.15.79:0/662623589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a680e39e0 con 0x7f3a680b9920 2021-04-09T18:28:02.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.598 7f3a64ff9700 1 -- 172.21.15.79:0/662623589 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3a6001a490 con 0x7f3a680b9920 2021-04-09T18:28:02.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.770 7f3a6e279700 1 -- 172.21.15.79:0/662623589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a680f5b20 con 0x7f3a680b9920 2021-04-09T18:28:02.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.770 7f3a64ff9700 1 -- 172.21.15.79:0/662623589 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2100 (secure 0 0 0) 0x7f3a60033850 con 0x7f3a680b9920 2021-04-09T18:28:02.777 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:28:02.777 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3417656822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3417656822},{"type":"v1","addr":"172.21.15.79:6833","nonce":3417656822}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":9}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:26:56.614049","modified":"2021-04-09 18:26:57.616754","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4634":{"gid":4634,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/3906387944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3906387944},{"type":"v1","addr":"172.21.15.89:6835","nonce":3906387944}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-04-09T18:28:02.778 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 11 2021-04-09T18:28:02.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.774 7f3a6e279700 1 -- 172.21.15.79:0/662623589 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a480290a0 msgr2=0x7f3a4802b5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:02.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.774 7f3a6e279700 1 --2- 172.21.15.79:0/662623589 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a480290a0 0x7f3a4802b5f0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.774 7f3a6e279700 1 -- 172.21.15.79:0/662623589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a680b9920 msgr2=0x7f3a681a6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:02.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.774 7f3a6e279700 1 --2- 172.21.15.79:0/662623589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a680b9920 0x7f3a681a6670 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f3a68093e90 tx=0x7f3a60006c10).stop 2021-04-09T18:28:02.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.774 7f3a6e279700 1 -- 172.21.15.79:0/662623589 shutdown_connections 2021-04-09T18:28:02.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.774 7f3a6e279700 1 --2- 172.21.15.79:0/662623589 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a480290a0 0x7f3a4802b5f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.774 7f3a6e279700 1 --2- 172.21.15.79:0/662623589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a6809a160 0x7f3a6808f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.774 7f3a6e279700 1 --2- 172.21.15.79:0/662623589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a680b9920 0x7f3a681a6670 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.774 7f3a6e279700 1 --2- 172.21.15.79:0/662623589 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a680b94d0 0x7f3a68094bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.774 7f3a6e279700 1 -- 172.21.15.79:0/662623589 >> 172.21.15.79:0/662623589 conn(0x7f3a680d8c30 msgr2=0x7f3a680d76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:02.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.774 7f3a6e279700 1 -- 172.21.15.79:0/662623589 shutdown_connections 2021-04-09T18:28:02.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.774 7f3a6e279700 1 -- 172.21.15.79:0/662623589 wait complete. 2021-04-09T18:28:02.789 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-04-09T18:28:02.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.874 7f4aae0d8700 1 Processor -- start 2021-04-09T18:28:02.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.874 7f4aae0d8700 1 -- start start 2021-04-09T18:28:02.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aae0d8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4aa80f5520 0x7f4aa80f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aae0d8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4aa81c8010 0x7f4aa81ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aae0d8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa80fbb20 con 0x7f4aa80e9ae0 2021-04-09T18:28:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aae0d8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa80e9f30 con 0x7f4aa80f5520 2021-04-09T18:28:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aae0d8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa81c3dc0 con 0x7f4aa81c8010 2021-04-09T18:28:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aa77fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4aa80f5520 0x7f4aa80f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aa6ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4aa80e9ae0 0x7f4aa809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51952/0 (socket says 172.21.15.79:51952) 2021-04-09T18:28:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aa6ffd700 1 -- 172.21.15.79:0/716288937 learned_addr learned my addr 172.21.15.79:0/716288937 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:28:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aa7fff700 1 --2- 172.21.15.79:0/716288937 >> v2:172.21.15.89:3300/0 conn(0x7f4aa81c8010 0x7f4aa81ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:02.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aa67fc700 1 -- 172.21.15.79:0/716288937 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435427287 0 0) 0x7f4a9c0010d0 con 0x7f4aa80e9ae0 2021-04-09T18:28:02.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aa67fc700 1 -- 172.21.15.79:0/716288937 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a90003240 con 0x7f4aa80e9ae0 2021-04-09T18:28:02.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aa7fff700 1 -- 172.21.15.79:0/716288937 >> v2:172.21.15.79:3300/0 conn(0x7f4aa80f5520 msgr2=0x7f4aa80f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:02.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aa7fff700 1 --2- 172.21.15.79:0/716288937 >> v2:172.21.15.79:3300/0 conn(0x7f4aa80f5520 0x7f4aa80f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aa7fff700 1 -- 172.21.15.79:0/716288937 >> v1:172.21.15.79:6789/0 conn(0x7f4aa80e9ae0 legacy=0x7f4aa809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aa7fff700 1 -- 172.21.15.79:0/716288937 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa809f910 con 0x7f4aa81c8010 2021-04-09T18:28:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aa77fe700 1 --2- 172.21.15.79:0/716288937 >> v2:172.21.15.79:3300/0 conn(0x7f4aa80f5520 0x7f4aa80f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:02.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aa7fff700 1 --2- 172.21.15.79:0/716288937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4aa81c8010 0x7f4aa81ca470 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f4aa00032b0 tx=0x7f4aa000b0e0).ready entity=mon.1 client_cookie=50a43496d661d1f7 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:02.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aa67fc700 1 -- 172.21.15.79:0/716288937 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4aa809f910 con 0x7f4aa81c8010 2021-04-09T18:28:02.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aa67fc700 1 -- 172.21.15.79:0/716288937 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa000ba90 con 0x7f4aa81c8010 2021-04-09T18:28:02.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aa67fc700 1 -- 172.21.15.79:0/716288937 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4aa0002020 con 0x7f4aa81c8010 2021-04-09T18:28:02.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aae0d8700 1 -- 172.21.15.79:0/716288937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4aa81c8010 msgr2=0x7f4aa81ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:02.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aae0d8700 1 --2- 172.21.15.79:0/716288937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4aa81c8010 0x7f4aa81ca470 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f4aa00032b0 tx=0x7f4aa000b0e0).stop 2021-04-09T18:28:02.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aae0d8700 1 -- 172.21.15.79:0/716288937 shutdown_connections 2021-04-09T18:28:02.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aae0d8700 1 --2- 172.21.15.79:0/716288937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4aa81c8010 0x7f4aa81ca470 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aae0d8700 1 --2- 172.21.15.79:0/716288937 >> v2:172.21.15.79:3300/0 conn(0x7f4aa80f5520 0x7f4aa80f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aae0d8700 1 -- 172.21.15.79:0/716288937 >> 172.21.15.79:0/716288937 conn(0x7f4aa80e5fe0 msgr2=0x7f4aa80e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:02.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aae0d8700 1 -- 172.21.15.79:0/716288937 shutdown_connections 2021-04-09T18:28:02.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.878 7f4aae0d8700 1 -- 172.21.15.79:0/716288937 wait complete. 2021-04-09T18:28:02.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.882 7f4aae0d8700 1 Processor -- start 2021-04-09T18:28:02.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.882 7f4aae0d8700 1 -- start start 2021-04-09T18:28:02.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.882 7f4aae0d8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa80c06e0 0x7f4aa80afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:02.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.882 7f4aae0d8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4aa80bdcb0 0x7f4aa80d5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:02.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.882 7f4aae0d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa80be100 0x7f4aa80985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:02.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.882 7f4aae0d8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa80c03e0 con 0x7f4aa80c06e0 2021-04-09T18:28:02.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.882 7f4aae0d8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa80b0330 con 0x7f4aa80bdcb0 2021-04-09T18:28:02.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.882 7f4aae0d8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa80d57b0 con 0x7f4aa80be100 2021-04-09T18:28:02.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.882 7f4aa77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa80c06e0 0x7f4aa80afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:02.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.882 7f4aa77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa80c06e0 0x7f4aa80afd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57244/0 (socket says 172.21.15.79:57244) 2021-04-09T18:28:02.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.882 7f4aa77fe700 1 -- 172.21.15.79:0/437557673 learned_addr learned my addr 172.21.15.79:0/437557673 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:02.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.886 7f4aa7fff700 1 --2- 172.21.15.79:0/437557673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa80be100 0x7f4aa80985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:02.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.886 7f4aa6ffd700 1 --2- 172.21.15.79:0/437557673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4aa80bdcb0 0x7f4aa80d5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:02.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.886 7f4aa77fe700 1 -- 172.21.15.79:0/437557673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa80be100 msgr2=0x7f4aa80985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:02.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.886 7f4aa77fe700 1 --2- 172.21.15.79:0/437557673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa80be100 0x7f4aa80985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.886 7f4aa77fe700 1 -- 172.21.15.79:0/437557673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4aa80bdcb0 msgr2=0x7f4aa80d5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:02.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.886 7f4aa77fe700 1 --2- 172.21.15.79:0/437557673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4aa80bdcb0 0x7f4aa80d5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:02.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.886 7f4aa77fe700 1 -- 172.21.15.79:0/437557673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa8098be0 con 0x7f4aa80c06e0 2021-04-09T18:28:02.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.886 7f4aa7fff700 1 --2- 172.21.15.79:0/437557673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa80be100 0x7f4aa80985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:28:02.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.886 7f4aa77fe700 1 --2- 172.21.15.79:0/437557673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa80c06e0 0x7f4aa80afd00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f4a9800efc0 tx=0x7f4a9800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:02.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.886 7f4a8ffff700 1 -- 172.21.15.79:0/437557673 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4aa8098be0 con 0x7f4aa80c06e0 2021-04-09T18:28:02.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.886 7f4aae0d8700 1 -- 172.21.15.79:0/437557673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa80c48d0 con 0x7f4aa80c06e0 2021-04-09T18:28:02.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.886 7f4a8ffff700 1 -- 172.21.15.79:0/437557673 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a980123f0 con 0x7f4aa80c06e0 2021-04-09T18:28:02.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.886 7f4a8ffff700 1 -- 172.21.15.79:0/437557673 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a9800f040 con 0x7f4aa80c06e0 2021-04-09T18:28:02.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.886 7f4aae0d8700 1 -- 172.21.15.79:0/437557673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa80c4de0 con 0x7f4aa80c06e0 2021-04-09T18:28:02.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.886 7f4a8ffff700 1 -- 172.21.15.79:0/437557673 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4a98011070 con 0x7f4aa80c06e0 2021-04-09T18:28:02.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.886 7f4a8ffff700 1 --2- 172.21.15.79:0/437557673 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a88029100 0x7f4a8802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:02.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.886 7f4a8ffff700 1 -- 172.21.15.79:0/437557673 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f4a98010040 con 0x7f4aa80c06e0 2021-04-09T18:28:02.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.886 7f4aa6ffd700 1 --2- 172.21.15.79:0/437557673 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a88029100 0x7f4a8802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:02.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.886 7f4aa6ffd700 1 --2- 172.21.15.79:0/437557673 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a88029100 0x7f4a8802b650 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:02.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.890 7f4aae0d8700 1 -- 172.21.15.79:0/437557673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa80e39e0 con 0x7f4aa80c06e0 2021-04-09T18:28:02.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:02.894 7f4a8ffff700 1 -- 172.21.15.79:0/437557673 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4a9800ca90 con 0x7f4aa80c06e0 2021-04-09T18:28:03.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:03.050 7f4aae0d8700 1 -- 172.21.15.79:0/437557673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4aa80a1cc0 con 0x7f4aa80c06e0 2021-04-09T18:28:04.037 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:28:04.034 7fbcd0516700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:28:04.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.042 7f4a8ffff700 1 -- 172.21.15.79:0/437557673 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v12) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4a98000bf0 con 0x7f4aa80c06e0 2021-04-09T18:28:04.072 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-04-09T18:28:04.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.070 7f4aae0d8700 1 -- 172.21.15.79:0/437557673 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a88029100 msgr2=0x7f4a8802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:04.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.070 7f4aae0d8700 1 --2- 172.21.15.79:0/437557673 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a88029100 0x7f4a8802b650 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.070 7f4aae0d8700 1 -- 172.21.15.79:0/437557673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa80c06e0 msgr2=0x7f4aa80afd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:04.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.070 7f4aae0d8700 1 --2- 172.21.15.79:0/437557673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa80c06e0 0x7f4aa80afd00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f4a9800efc0 tx=0x7f4a9800c430).stop 2021-04-09T18:28:04.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.070 7f4aae0d8700 1 -- 172.21.15.79:0/437557673 shutdown_connections 2021-04-09T18:28:04.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.070 7f4aae0d8700 1 --2- 172.21.15.79:0/437557673 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a88029100 0x7f4a8802b650 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.070 7f4aae0d8700 1 --2- 172.21.15.79:0/437557673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa80be100 0x7f4aa80985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.070 7f4aae0d8700 1 --2- 172.21.15.79:0/437557673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa80c06e0 0x7f4aa80afd00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.070 7f4aae0d8700 1 --2- 172.21.15.79:0/437557673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4aa80bdcb0 0x7f4aa80d5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.070 7f4aae0d8700 1 -- 172.21.15.79:0/437557673 >> 172.21.15.79:0/437557673 conn(0x7f4aa809a310 msgr2=0x7f4aa80d8310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:04.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.070 7f4aae0d8700 1 -- 172.21.15.79:0/437557673 shutdown_connections 2021-04-09T18:28:04.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.070 7f4aae0d8700 1 -- 172.21.15.79:0/437557673 wait complete. 2021-04-09T18:28:04.090 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:04.092 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2021-04-09T18:28:04.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fd1e14700 1 Processor -- start 2021-04-09T18:28:04.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fd1e14700 1 -- start start 2021-04-09T18:28:04.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fd1e14700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3fcc0f5520 0x7f3fcc0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:04.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fd1e14700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3fcc0e9ae0 0x7f3fcc09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:04.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fd1e14700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fcc1c2db0 0x7f3fcc1c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:04.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fd1e14700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fcc0e9f30 con 0x7f3fcc0f5520 2021-04-09T18:28:04.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fd1e14700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fcc0e59d0 con 0x7f3fcc0e9ae0 2021-04-09T18:28:04.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fd1e14700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0fbb20 con 0x7f3fcc1c2db0 2021-04-09T18:28:04.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fcb7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3fcc0f5520 0x7f3fcc0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:04.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fcb7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3fcc0f5520 0x7f3fcc0f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57252/0 (socket says 172.21.15.79:57252) 2021-04-09T18:28:04.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fcb7fe700 1 -- 172.21.15.79:0/1582218662 learned_addr learned my addr 172.21.15.79:0/1582218662 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:04.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fcbfff700 1 --2- 172.21.15.79:0/1582218662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fcc1c2db0 0x7f3fcc1c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:04.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fc2ffd700 1 --2- 172.21.15.79:0/1582218662 >> v2:172.21.15.89:3300/0 conn(0x7f3fcc0e9ae0 0x7f3fcc09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:04.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fcb7fe700 1 -- 172.21.15.79:0/1582218662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fcc1c2db0 msgr2=0x7f3fcc1c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:04.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fcb7fe700 1 --2- 172.21.15.79:0/1582218662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fcc1c2db0 0x7f3fcc1c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fcb7fe700 1 -- 172.21.15.79:0/1582218662 >> v2:172.21.15.89:3300/0 conn(0x7f3fcc0e9ae0 msgr2=0x7f3fcc09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:04.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fcb7fe700 1 --2- 172.21.15.79:0/1582218662 >> v2:172.21.15.89:3300/0 conn(0x7f3fcc0e9ae0 0x7f3fcc09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fcb7fe700 1 -- 172.21.15.79:0/1582218662 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc0e56d0 con 0x7f3fcc0f5520 2021-04-09T18:28:04.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fc2ffd700 1 --2- 172.21.15.79:0/1582218662 >> v2:172.21.15.89:3300/0 conn(0x7f3fcc0e9ae0 0x7f3fcc09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:28:04.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fcb7fe700 1 --2- 172.21.15.79:0/1582218662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fcc0f5520 0x7f3fcc0f64b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f3fcc125440 tx=0x7f3fbc00bda0).ready entity=mon.0 client_cookie=76d44679796e4dc1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:04.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fcaffd700 1 -- 172.21.15.79:0/1582218662 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3fcc0e56d0 con 0x7f3fcc0f5520 2021-04-09T18:28:04.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fcaffd700 1 -- 172.21.15.79:0/1582218662 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fbc009940 con 0x7f3fcc0f5520 2021-04-09T18:28:04.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fcaffd700 1 -- 172.21.15.79:0/1582218662 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3fbc009d10 con 0x7f3fcc0f5520 2021-04-09T18:28:04.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fd1e14700 1 -- 172.21.15.79:0/1582218662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fcc0f5520 msgr2=0x7f3fcc0f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:04.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.182 7f3fd1e14700 1 --2- 172.21.15.79:0/1582218662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fcc0f5520 0x7f3fcc0f64b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f3fcc125440 tx=0x7f3fbc00bda0).stop 2021-04-09T18:28:04.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.186 7f3fd1e14700 1 -- 172.21.15.79:0/1582218662 shutdown_connections 2021-04-09T18:28:04.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.186 7f3fd1e14700 1 --2- 172.21.15.79:0/1582218662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fcc1c2db0 0x7f3fcc1c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.186 7f3fd1e14700 1 --2- 172.21.15.79:0/1582218662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fcc0f5520 0x7f3fcc0f64b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.186 7f3fd1e14700 1 --2- 172.21.15.79:0/1582218662 >> v2:172.21.15.89:3300/0 conn(0x7f3fcc0e9ae0 0x7f3fcc09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.186 7f3fd1e14700 1 -- 172.21.15.79:0/1582218662 >> 172.21.15.79:0/1582218662 conn(0x7f3fcc0e5fe0 msgr2=0x7f3fcc0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:04.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.186 7f3fd1e14700 1 -- 172.21.15.79:0/1582218662 shutdown_connections 2021-04-09T18:28:04.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.186 7f3fd1e14700 1 -- 172.21.15.79:0/1582218662 wait complete. 2021-04-09T18:28:04.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fd1e14700 1 Processor -- start 2021-04-09T18:28:04.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fd1e14700 1 -- start start 2021-04-09T18:28:04.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fd1e14700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fcc0af150 0x7f3fcc1a6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:04.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fd1e14700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fcc1a74e0 0x7f3fcc1aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:04.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fd1e14700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fcc1a7930 0x7f3fcc1ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:04.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fd1e14700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc097b90 con 0x7f3fcc1a74e0 2021-04-09T18:28:04.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fd1e14700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc097e90 con 0x7f3fcc1a7930 2021-04-09T18:28:04.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fd1e14700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0973b0 con 0x7f3fcc0af150 2021-04-09T18:28:04.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fc2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fcc1a74e0 0x7f3fcc1aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:04.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fc2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fcc1a74e0 0x7f3fcc1aafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57260/0 (socket says 172.21.15.79:57260) 2021-04-09T18:28:04.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fc2ffd700 1 -- 172.21.15.79:0/1276178930 learned_addr learned my addr 172.21.15.79:0/1276178930 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:04.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fcbfff700 1 --2- 172.21.15.79:0/1276178930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fcc1a7930 0x7f3fcc1ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:04.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fcb7fe700 1 --2- 172.21.15.79:0/1276178930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fcc0af150 0x7f3fcc1a6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:04.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fcbfff700 1 -- 172.21.15.79:0/1276178930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fcc0af150 msgr2=0x7f3fcc1a6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:04.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fcbfff700 1 --2- 172.21.15.79:0/1276178930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fcc0af150 0x7f3fcc1a6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fcbfff700 1 -- 172.21.15.79:0/1276178930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fcc1a74e0 msgr2=0x7f3fcc1aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:04.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fcbfff700 1 --2- 172.21.15.79:0/1276178930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fcc1a74e0 0x7f3fcc1aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fcbfff700 1 -- 172.21.15.79:0/1276178930 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc0943b0 con 0x7f3fcc1a7930 2021-04-09T18:28:04.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fc2ffd700 1 --2- 172.21.15.79:0/1276178930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fcc1a74e0 0x7f3fcc1aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:04.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fcbfff700 1 --2- 172.21.15.79:0/1276178930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fcc1a7930 0x7f3fcc1ab5f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f3fc400c000 tx=0x7f3fc400c430).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:04.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fc8ff9700 1 -- 172.21.15.79:0/1276178930 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3fcc0943b0 con 0x7f3fcc1a7930 2021-04-09T18:28:04.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fd1e14700 1 -- 172.21.15.79:0/1276178930 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fcc0af5a0 con 0x7f3fcc1a7930 2021-04-09T18:28:04.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fc8ff9700 1 -- 172.21.15.79:0/1276178930 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc400cb70 con 0x7f3fcc1a7930 2021-04-09T18:28:04.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fd1e14700 1 -- 172.21.15.79:0/1276178930 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fcc1abc20 con 0x7f3fcc1a7930 2021-04-09T18:28:04.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.190 7f3fc8ff9700 1 -- 172.21.15.79:0/1276178930 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3fc400f040 con 0x7f3fcc1a7930 2021-04-09T18:28:04.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.194 7f3fc8ff9700 1 -- 172.21.15.79:0/1276178930 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3fc4022060 con 0x7f3fcc1a7930 2021-04-09T18:28:04.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.194 7f3fc8ff9700 1 --2- 172.21.15.79:0/1276178930 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3fb0029100 0x7f3fb002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:04.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.194 7f3fc8ff9700 1 -- 172.21.15.79:0/1276178930 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f3fc4010040 con 0x7f3fcc1a7930 2021-04-09T18:28:04.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.194 7f3fcb7fe700 1 --2- 172.21.15.79:0/1276178930 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3fb0029100 0x7f3fb002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:04.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.194 7f3fd1e14700 1 -- 172.21.15.79:0/1276178930 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fcc0e39e0 con 0x7f3fcc1a7930 2021-04-09T18:28:04.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.194 7f3fcb7fe700 1 --2- 172.21.15.79:0/1276178930 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3fb0029100 0x7f3fb002b650 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:04.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.202 7f3fc8ff9700 1 -- 172.21.15.79:0/1276178930 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3fc4000f70 con 0x7f3fcc1a7930 2021-04-09T18:28:04.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.374 7f3fd1e14700 1 -- 172.21.15.79:0/1276178930 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fcc0f5b20 con 0x7f3fcc1a7930 2021-04-09T18:28:04.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.374 7f3fc8ff9700 1 -- 172.21.15.79:0/1276178930 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+1755 (secure 0 0 0) 0x7f3fc400c960 con 0x7f3fcc1a7930 2021-04-09T18:28:04.381 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:28:04.382 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3417656822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3417656822},{"type":"v1","addr":"172.21.15.79:6833","nonce":3417656822}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:26:56.614049","modified":"2021-04-09 18:28:04.037061","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-04-09T18:28:04.382 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 12 2021-04-09T18:28:04.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.378 7f3fd1e14700 1 -- 172.21.15.79:0/1276178930 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3fb0029100 msgr2=0x7f3fb002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:04.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.378 7f3fd1e14700 1 --2- 172.21.15.79:0/1276178930 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3fb0029100 0x7f3fb002b650 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.378 7f3fd1e14700 1 -- 172.21.15.79:0/1276178930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fcc1a7930 msgr2=0x7f3fcc1ab5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:04.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.378 7f3fd1e14700 1 --2- 172.21.15.79:0/1276178930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fcc1a7930 0x7f3fcc1ab5f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f3fc400c000 tx=0x7f3fc400c430).stop 2021-04-09T18:28:04.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.378 7f3fd1e14700 1 -- 172.21.15.79:0/1276178930 shutdown_connections 2021-04-09T18:28:04.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.378 7f3fd1e14700 1 --2- 172.21.15.79:0/1276178930 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3fb0029100 0x7f3fb002b650 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.378 7f3fd1e14700 1 --2- 172.21.15.79:0/1276178930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fcc1a7930 0x7f3fcc1ab5f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.378 7f3fd1e14700 1 --2- 172.21.15.79:0/1276178930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fcc0af150 0x7f3fcc1a6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.378 7f3fd1e14700 1 --2- 172.21.15.79:0/1276178930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fcc1a74e0 0x7f3fcc1aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.378 7f3fd1e14700 1 -- 172.21.15.79:0/1276178930 >> 172.21.15.79:0/1276178930 conn(0x7f3fcc0bb0f0 msgr2=0x7f3fcc0b9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:04.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.378 7f3fd1e14700 1 -- 172.21.15.79:0/1276178930 shutdown_connections 2021-04-09T18:28:04.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.378 7f3fd1e14700 1 -- 172.21.15.79:0/1276178930 wait complete. 2021-04-09T18:28:04.393 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-04-09T18:28:04.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd503bfb700 1 Processor -- start 2021-04-09T18:28:04.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd503bfb700 1 -- start start 2021-04-09T18:28:04.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd503bfb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd4fc0f5520 0x7fd4fc0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:04.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd503bfb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd4fc0e9ae0 0x7fd4fc09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:04.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd503bfb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4fc0fbb20 con 0x7fd4fc1c2db0 2021-04-09T18:28:04.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd503bfb700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4fc0e9f30 con 0x7fd4fc0f5520 2021-04-09T18:28:04.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd503bfb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4fc0e59d0 con 0x7fd4fc0e9ae0 2021-04-09T18:28:04.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd50199f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd4fc0f5520 0x7fd4fc0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:04.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd50199f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd4fc0f5520 0x7fd4fc0f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57266/0 (socket says 172.21.15.79:57266) 2021-04-09T18:28:04.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd50199f700 1 -- 172.21.15.79:0/682422700 learned_addr learned my addr 172.21.15.79:0/682422700 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:04.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd50119e700 1 --2- 172.21.15.79:0/682422700 >> v2:172.21.15.89:3300/0 conn(0x7fd4fc0e9ae0 0x7fd4fc09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:04.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd50199f700 1 -- 172.21.15.79:0/682422700 >> v2:172.21.15.89:3300/0 conn(0x7fd4fc0e9ae0 msgr2=0x7fd4fc09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:04.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd50199f700 1 --2- 172.21.15.79:0/682422700 >> v2:172.21.15.89:3300/0 conn(0x7fd4fc0e9ae0 0x7fd4fc09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd50199f700 1 -- 172.21.15.79:0/682422700 >> v1:172.21.15.89:6789/0 conn(0x7fd4fc1c2db0 legacy=0x7fd4fc1c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:04.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd50199f700 1 -- 172.21.15.79:0/682422700 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc0e56d0 con 0x7fd4fc0f5520 2021-04-09T18:28:04.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd50199f700 1 --2- 172.21.15.79:0/682422700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4fc0f5520 0x7fd4fc0f64b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fd4f8002f30 tx=0x7fd4f800bd70).ready entity=mon.0 client_cookie=203e3dbfab977c3a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd50099d700 1 -- 172.21.15.79:0/682422700 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd4fc0e56d0 con 0x7fd4fc0f5520 2021-04-09T18:28:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd50099d700 1 -- 172.21.15.79:0/682422700 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f8009950 con 0x7fd4fc0f5520 2021-04-09T18:28:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd50099d700 1 -- 172.21.15.79:0/682422700 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd4f8009d20 con 0x7fd4fc0f5520 2021-04-09T18:28:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd503bfb700 1 -- 172.21.15.79:0/682422700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4fc0f5520 msgr2=0x7fd4fc0f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.482 7fd503bfb700 1 --2- 172.21.15.79:0/682422700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4fc0f5520 0x7fd4fc0f64b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fd4f8002f30 tx=0x7fd4f800bd70).stop 2021-04-09T18:28:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.486 7fd503bfb700 1 -- 172.21.15.79:0/682422700 shutdown_connections 2021-04-09T18:28:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.486 7fd503bfb700 1 --2- 172.21.15.79:0/682422700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4fc0f5520 0x7fd4fc0f64b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.486 7fd503bfb700 1 --2- 172.21.15.79:0/682422700 >> v2:172.21.15.89:3300/0 conn(0x7fd4fc0e9ae0 0x7fd4fc09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.486 7fd503bfb700 1 -- 172.21.15.79:0/682422700 >> 172.21.15.79:0/682422700 conn(0x7fd4fc0e5fe0 msgr2=0x7fd4fc0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.486 7fd503bfb700 1 -- 172.21.15.79:0/682422700 shutdown_connections 2021-04-09T18:28:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.486 7fd503bfb700 1 -- 172.21.15.79:0/682422700 wait complete. 2021-04-09T18:28:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.486 7fd503bfb700 1 Processor -- start 2021-04-09T18:28:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.486 7fd503bfb700 1 -- start start 2021-04-09T18:28:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd503bfb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4fc09ae40 0x7fd4fc09a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd503bfb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4fc09b290 0x7fd4fc0d5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd503bfb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4fc0d5850 0x7fd4fc0b97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd503bfb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0b7b70 con 0x7fd4fc09b290 2021-04-09T18:28:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd503bfb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc09aac0 con 0x7fd4fc0d5850 2021-04-09T18:28:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd503bfb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0c1a60 con 0x7fd4fc09ae40 2021-04-09T18:28:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd50119e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4fc09b290 0x7fd4fc0d5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd50119e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4fc09b290 0x7fd4fc0d5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57274/0 (socket says 172.21.15.79:57274) 2021-04-09T18:28:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd50119e700 1 -- 172.21.15.79:0/1134365281 learned_addr learned my addr 172.21.15.79:0/1134365281 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd50199f700 1 --2- 172.21.15.79:0/1134365281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4fc09ae40 0x7fd4fc09a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd5021a0700 1 --2- 172.21.15.79:0/1134365281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4fc0d5850 0x7fd4fc0b97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd50119e700 1 -- 172.21.15.79:0/1134365281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4fc09ae40 msgr2=0x7fd4fc09a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd50119e700 1 --2- 172.21.15.79:0/1134365281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4fc09ae40 0x7fd4fc09a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd50119e700 1 -- 172.21.15.79:0/1134365281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4fc0d5850 msgr2=0x7fd4fc0b97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd50119e700 1 --2- 172.21.15.79:0/1134365281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4fc0d5850 0x7fd4fc0b97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd50119e700 1 -- 172.21.15.79:0/1134365281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc0c1c90 con 0x7fd4fc09b290 2021-04-09T18:28:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd50119e700 1 --2- 172.21.15.79:0/1134365281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4fc09b290 0x7fd4fc0d5220 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fd4f000c000 tx=0x7fd4f000c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd4ee7fc700 1 -- 172.21.15.79:0/1134365281 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd4fc0c1c90 con 0x7fd4fc09b290 2021-04-09T18:28:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd4ee7fc700 1 -- 172.21.15.79:0/1134365281 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f000cca0 con 0x7fd4fc09b290 2021-04-09T18:28:04.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd503bfb700 1 -- 172.21.15.79:0/1134365281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4fc0b9e00 con 0x7fd4fc09b290 2021-04-09T18:28:04.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd4ee7fc700 1 -- 172.21.15.79:0/1134365281 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd4f000f040 con 0x7fd4fc09b290 2021-04-09T18:28:04.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd503bfb700 1 -- 172.21.15.79:0/1134365281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4fc0ba360 con 0x7fd4fc09b290 2021-04-09T18:28:04.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd4ee7fc700 1 -- 172.21.15.79:0/1134365281 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd4f0022060 con 0x7fd4fc09b290 2021-04-09T18:28:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd4ee7fc700 1 --2- 172.21.15.79:0/1134365281 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd4e4029100 0x7fd4e402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.490 7fd4ee7fc700 1 -- 172.21.15.79:0/1134365281 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fd4f0010040 con 0x7fd4fc09b290 2021-04-09T18:28:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.494 7fd50199f700 1 --2- 172.21.15.79:0/1134365281 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd4e4029100 0x7fd4e402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.494 7fd50199f700 1 --2- 172.21.15.79:0/1134365281 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd4e4029100 0x7fd4e402b650 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.498 7fd503bfb700 1 -- 172.21.15.79:0/1134365281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4fc0e39e0 con 0x7fd4fc09b290 2021-04-09T18:28:04.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.506 7fd4ee7fc700 1 -- 172.21.15.79:0/1134365281 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd4f000ca90 con 0x7fd4fc09b290 2021-04-09T18:28:04.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:04.694 7fd503bfb700 1 -- 172.21.15.79:0/1134365281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd4fc0f5b20 con 0x7fd4fc09b290 2021-04-09T18:28:05.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.062 7fd4ee7fc700 1 -- 172.21.15.79:0/1134365281 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd4f0000f70 con 0x7fd4fc09b290 2021-04-09T18:28:05.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.110 7fd503bfb700 1 -- 172.21.15.79:0/1134365281 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd4e4029100 msgr2=0x7fd4e402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:05.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.110 7fd503bfb700 1 --2- 172.21.15.79:0/1134365281 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd4e4029100 0x7fd4e402b650 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:05.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.110 7fd503bfb700 1 -- 172.21.15.79:0/1134365281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4fc09b290 msgr2=0x7fd4fc0d5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:05.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.110 7fd503bfb700 1 --2- 172.21.15.79:0/1134365281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4fc09b290 0x7fd4fc0d5220 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fd4f000c000 tx=0x7fd4f000c430).stop 2021-04-09T18:28:05.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.110 7fd503bfb700 1 -- 172.21.15.79:0/1134365281 shutdown_connections 2021-04-09T18:28:05.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.110 7fd503bfb700 1 --2- 172.21.15.79:0/1134365281 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd4e4029100 0x7fd4e402b650 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:05.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.110 7fd503bfb700 1 --2- 172.21.15.79:0/1134365281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4fc0d5850 0x7fd4fc0b97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:05.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.110 7fd503bfb700 1 --2- 172.21.15.79:0/1134365281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4fc09ae40 0x7fd4fc09a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:05.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.110 7fd503bfb700 1 --2- 172.21.15.79:0/1134365281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4fc09b290 0x7fd4fc0d5220 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:05.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.110 7fd503bfb700 1 -- 172.21.15.79:0/1134365281 >> 172.21.15.79:0/1134365281 conn(0x7fd4fc0a24c0 msgr2=0x7fd4fc0d8510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:05.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.110 7fd503bfb700 1 -- 172.21.15.79:0/1134365281 shutdown_connections 2021-04-09T18:28:05.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.110 7fd503bfb700 1 -- 172.21.15.79:0/1134365281 wait complete. 2021-04-09T18:28:05.135 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-04-09T18:28:05.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.230 7f4949b22700 1 Processor -- start 2021-04-09T18:28:05.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.230 7f4949b22700 1 -- start start 2021-04-09T18:28:05.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.230 7f4949b22700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49440f5540 0x7f49440f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:05.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.230 7f4949b22700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f49440e9b00 0x7f494409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:05.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.230 7f4949b22700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49441c2dd0 0x7f49441c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:05.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.230 7f4949b22700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49440e9f50 con 0x7f49440e9b00 2021-04-09T18:28:05.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.230 7f4949b22700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49440e59f0 con 0x7f49441c2dd0 2021-04-09T18:28:05.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.230 7f4949b22700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49440fbb40 con 0x7f49440f5540 2021-04-09T18:28:05.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.230 7f4942ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f49440e9b00 0x7f494409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:05.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.230 7f4942ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f49440e9b00 0x7f494409f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57282/0 (socket says 172.21.15.79:57282) 2021-04-09T18:28:05.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.230 7f4942ffd700 1 -- 172.21.15.79:0/3456181274 learned_addr learned my addr 172.21.15.79:0/3456181274 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:05.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.230 7f49437fe700 1 --2- 172.21.15.79:0/3456181274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49440f5540 0x7f49440f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:05.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.230 7f4943fff700 1 --2- 172.21.15.79:0/3456181274 >> v2:172.21.15.89:3300/0 conn(0x7f49441c2dd0 0x7f49441c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:05.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.234 7f4942ffd700 1 -- 172.21.15.79:0/3456181274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49440f5540 msgr2=0x7f49440f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:05.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.234 7f4942ffd700 1 --2- 172.21.15.79:0/3456181274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49440f5540 0x7f49440f64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:05.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.234 7f4942ffd700 1 -- 172.21.15.79:0/3456181274 >> v2:172.21.15.89:3300/0 conn(0x7f49441c2dd0 msgr2=0x7f49441c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:05.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.234 7f4942ffd700 1 --2- 172.21.15.79:0/3456181274 >> v2:172.21.15.89:3300/0 conn(0x7f49441c2dd0 0x7f49441c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:05.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.234 7f4942ffd700 1 -- 172.21.15.79:0/3456181274 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49440e56f0 con 0x7f49440e9b00 2021-04-09T18:28:05.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.234 7f4942ffd700 1 --2- 172.21.15.79:0/3456181274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440e9b00 0x7f494409f100 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f4938002f30 tx=0x7f493800bd70).ready entity=mon.0 client_cookie=4d703256cc35ff5 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:05.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.234 7f49427fc700 1 -- 172.21.15.79:0/3456181274 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f49440e56f0 con 0x7f49440e9b00 2021-04-09T18:28:05.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.234 7f49427fc700 1 -- 172.21.15.79:0/3456181274 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49380098b0 con 0x7f49440e9b00 2021-04-09T18:28:05.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.234 7f49427fc700 1 -- 172.21.15.79:0/3456181274 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4938009c80 con 0x7f49440e9b00 2021-04-09T18:28:05.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.234 7f4949b22700 1 -- 172.21.15.79:0/3456181274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440e9b00 msgr2=0x7f494409f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:05.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.234 7f4949b22700 1 --2- 172.21.15.79:0/3456181274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440e9b00 0x7f494409f100 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f4938002f30 tx=0x7f493800bd70).stop 2021-04-09T18:28:05.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.234 7f4949b22700 1 -- 172.21.15.79:0/3456181274 shutdown_connections 2021-04-09T18:28:05.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.234 7f4949b22700 1 --2- 172.21.15.79:0/3456181274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49440f5540 0x7f49440f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:05.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.234 7f4949b22700 1 --2- 172.21.15.79:0/3456181274 >> v2:172.21.15.89:3300/0 conn(0x7f49441c2dd0 0x7f49441c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:05.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.234 7f4949b22700 1 --2- 172.21.15.79:0/3456181274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440e9b00 0x7f494409f100 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:05.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.234 7f4949b22700 1 -- 172.21.15.79:0/3456181274 >> 172.21.15.79:0/3456181274 conn(0x7f49440e6000 msgr2=0x7f49440e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:05.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.234 7f4949b22700 1 -- 172.21.15.79:0/3456181274 shutdown_connections 2021-04-09T18:28:05.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.234 7f4949b22700 1 -- 172.21.15.79:0/3456181274 wait complete. 2021-04-09T18:28:05.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.238 7f4949b22700 1 Processor -- start 2021-04-09T18:28:05.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.238 7f4949b22700 1 -- start start 2021-04-09T18:28:05.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.238 7f4949b22700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440ac190 0x7f49440d5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:05.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.238 7f4949b22700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49440bac60 0x7f49440ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:05.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.238 7f4949b22700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49440bb0b0 0x7f49440d4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:05.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.238 7f4949b22700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49440e56f0 con 0x7f49440ac190 2021-04-09T18:28:05.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.238 7f4949b22700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49440ac8e0 con 0x7f49440bb0b0 2021-04-09T18:28:05.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.238 7f4949b22700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49440ac5e0 con 0x7f49440bac60 2021-04-09T18:28:05.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.238 7f49437fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440ac190 0x7f49440d5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:05.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.238 7f49437fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440ac190 0x7f49440d5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57286/0 (socket says 172.21.15.79:57286) 2021-04-09T18:28:05.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.238 7f49437fe700 1 -- 172.21.15.79:0/1655990323 learned_addr learned my addr 172.21.15.79:0/1655990323 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:05.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.242 7f4942ffd700 1 --2- 172.21.15.79:0/1655990323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49440bac60 0x7f49440ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:05.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.242 7f4943fff700 1 --2- 172.21.15.79:0/1655990323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49440bb0b0 0x7f49440d4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:05.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.242 7f49437fe700 1 -- 172.21.15.79:0/1655990323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49440bac60 msgr2=0x7f49440ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:05.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.242 7f49437fe700 1 --2- 172.21.15.79:0/1655990323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49440bac60 0x7f49440ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:05.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.242 7f49437fe700 1 -- 172.21.15.79:0/1655990323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49440bb0b0 msgr2=0x7f49440d4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:05.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.242 7f49437fe700 1 --2- 172.21.15.79:0/1655990323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49440bb0b0 0x7f49440d4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:05.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.242 7f49437fe700 1 -- 172.21.15.79:0/1655990323 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49440d62e0 con 0x7f49440ac190 2021-04-09T18:28:05.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.242 7f49437fe700 1 --2- 172.21.15.79:0/1655990323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440ac190 0x7f49440d5cb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f49440d7bd0 tx=0x7f49340104d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:05.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.242 7f492bfff700 1 -- 172.21.15.79:0/1655990323 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f49440d62e0 con 0x7f49440ac190 2021-04-09T18:28:05.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.242 7f492bfff700 1 -- 172.21.15.79:0/1655990323 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493400e070 con 0x7f49440ac190 2021-04-09T18:28:05.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.242 7f492bfff700 1 -- 172.21.15.79:0/1655990323 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4934014600 con 0x7f49440ac190 2021-04-09T18:28:05.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.242 7f4949b22700 1 -- 172.21.15.79:0/1655990323 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49440ae7b0 con 0x7f49440ac190 2021-04-09T18:28:05.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.242 7f4949b22700 1 -- 172.21.15.79:0/1655990323 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49440d50b0 con 0x7f49440ac190 2021-04-09T18:28:05.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.242 7f492bfff700 1 -- 172.21.15.79:0/1655990323 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4934014800 con 0x7f49440ac190 2021-04-09T18:28:05.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.242 7f492bfff700 1 --2- 172.21.15.79:0/1655990323 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4924029100 0x7f492402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:05.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.242 7f492bfff700 1 -- 172.21.15.79:0/1655990323 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f493403bf40 con 0x7f49440ac190 2021-04-09T18:28:05.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.242 7f4942ffd700 1 --2- 172.21.15.79:0/1655990323 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4924029100 0x7f492402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:05.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.242 7f4942ffd700 1 --2- 172.21.15.79:0/1655990323 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4924029100 0x7f492402b650 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:05.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.242 7f4949b22700 1 -- 172.21.15.79:0/1655990323 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49440e39e0 con 0x7f49440ac190 2021-04-09T18:28:05.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.250 7f492bfff700 1 -- 172.21.15.79:0/1655990323 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4934010a60 con 0x7f49440ac190 2021-04-09T18:28:05.412 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:05.406 7f4949b22700 1 -- 172.21.15.79:0/1655990323 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f49440f5b40 con 0x7f49440ac190 2021-04-09T18:28:06.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.070 7f492bfff700 1 -- 172.21.15.79:0/1655990323 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 185+0+0 (secure 0 0 0) 0x7f4934000bf0 con 0x7f49440ac190 2021-04-09T18:28:06.077 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2021-04-09T18:28:06.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.074 7f4949b22700 1 -- 172.21.15.79:0/1655990323 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4924029100 msgr2=0x7f492402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:06.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.074 7f4949b22700 1 --2- 172.21.15.79:0/1655990323 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4924029100 0x7f492402b650 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:06.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.074 7f4949b22700 1 -- 172.21.15.79:0/1655990323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440ac190 msgr2=0x7f49440d5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:06.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.074 7f4949b22700 1 --2- 172.21.15.79:0/1655990323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440ac190 0x7f49440d5cb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f49440d7bd0 tx=0x7f49340104d0).stop 2021-04-09T18:28:06.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.078 7f4949b22700 1 -- 172.21.15.79:0/1655990323 shutdown_connections 2021-04-09T18:28:06.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.078 7f4949b22700 1 --2- 172.21.15.79:0/1655990323 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4924029100 0x7f492402b650 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:06.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.078 7f4949b22700 1 --2- 172.21.15.79:0/1655990323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49440bb0b0 0x7f49440d4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:06.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.078 7f4949b22700 1 --2- 172.21.15.79:0/1655990323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440ac190 0x7f49440d5cb0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:06.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.078 7f4949b22700 1 --2- 172.21.15.79:0/1655990323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49440bac60 0x7f49440ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:06.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.078 7f4949b22700 1 -- 172.21.15.79:0/1655990323 >> 172.21.15.79:0/1655990323 conn(0x7f494409a9d0 msgr2=0x7f49440955c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:06.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.078 7f4949b22700 1 -- 172.21.15.79:0/1655990323 shutdown_connections 2021-04-09T18:28:06.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.078 7f4949b22700 1 -- 172.21.15.79:0/1655990323 wait complete. 2021-04-09T18:28:06.093 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-04-09T18:28:06.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b95f1700 1 Processor -- start 2021-04-09T18:28:06.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b95f1700 1 -- start start 2021-04-09T18:28:06.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b95f1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f81b40e9b10 0x7f81b409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:06.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b95f1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81b41c8040 0x7f81b41ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:06.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b95f1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b40fbb50 con 0x7f81b40f5550 2021-04-09T18:28:06.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b95f1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b41c3df0 con 0x7f81b40e9b10 2021-04-09T18:28:06.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b95f1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b40e9f60 con 0x7f81b41c8040 2021-04-09T18:28:06.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b2a46700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f81b40e9b10 0x7f81b409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:06.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b3a48700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81b41c8040 0x7f81b41ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:06.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b3247700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f81b40f5550 0x7f81b40f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:52476/0 (socket says 172.21.15.79:52476) 2021-04-09T18:28:06.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b3247700 1 -- 172.21.15.79:0/2162709230 learned_addr learned my addr 172.21.15.79:0/2162709230 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:28:06.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b2a46700 1 -- 172.21.15.79:0/2162709230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81b41c8040 msgr2=0x7f81b41ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:06.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b2a46700 1 --2- 172.21.15.79:0/2162709230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81b41c8040 0x7f81b41ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:06.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b2a46700 1 -- 172.21.15.79:0/2162709230 >> v1:172.21.15.89:6789/0 conn(0x7f81b40f5550 legacy=0x7f81b40f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:06.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b2a46700 1 -- 172.21.15.79:0/2162709230 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b40e5700 con 0x7f81b40e9b10 2021-04-09T18:28:06.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b2a46700 1 --2- 172.21.15.79:0/2162709230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81b40e9b10 0x7f81b409f110 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f81b40f6f30 tx=0x7f81a800bd70).ready entity=mon.1 client_cookie=7856b62ca84b73b1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:06.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b2245700 1 -- 172.21.15.79:0/2162709230 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f81b40e5700 con 0x7f81b40e9b10 2021-04-09T18:28:06.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b2245700 1 -- 172.21.15.79:0/2162709230 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a8009810 con 0x7f81b40e9b10 2021-04-09T18:28:06.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b2245700 1 -- 172.21.15.79:0/2162709230 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f81a8009be0 con 0x7f81b40e9b10 2021-04-09T18:28:06.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b95f1700 1 -- 172.21.15.79:0/2162709230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81b40e9b10 msgr2=0x7f81b409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:06.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.194 7f81b95f1700 1 --2- 172.21.15.79:0/2162709230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81b40e9b10 0x7f81b409f110 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f81b40f6f30 tx=0x7f81a800bd70).stop 2021-04-09T18:28:06.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.198 7f81b95f1700 1 -- 172.21.15.79:0/2162709230 shutdown_connections 2021-04-09T18:28:06.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.198 7f81b95f1700 1 --2- 172.21.15.79:0/2162709230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81b41c8040 0x7f81b41ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:06.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.198 7f81b95f1700 1 --2- 172.21.15.79:0/2162709230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81b40e9b10 0x7f81b409f110 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:06.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.198 7f81b95f1700 1 -- 172.21.15.79:0/2162709230 >> 172.21.15.79:0/2162709230 conn(0x7f81b40e6010 msgr2=0x7f81b40e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:06.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.198 7f81b95f1700 1 -- 172.21.15.79:0/2162709230 shutdown_connections 2021-04-09T18:28:06.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.198 7f81b95f1700 1 -- 172.21.15.79:0/2162709230 wait complete. 2021-04-09T18:28:06.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b95f1700 1 Processor -- start 2021-04-09T18:28:06.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b95f1700 1 -- start start 2021-04-09T18:28:06.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b95f1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81b40bdc80 0x7f81b40d6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:06.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b95f1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81b40986a0 0x7f81b40d5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:06.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b95f1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81b4098af0 0x7f81b40c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:06.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b95f1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b40c03b0 con 0x7f81b40bdc80 2021-04-09T18:28:06.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b95f1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b41acfd0 con 0x7f81b4098af0 2021-04-09T18:28:06.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b95f1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b40d68b0 con 0x7f81b40986a0 2021-04-09T18:28:06.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b3247700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81b40bdc80 0x7f81b40d6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:06.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b3247700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81b40bdc80 0x7f81b40d6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57300/0 (socket says 172.21.15.79:57300) 2021-04-09T18:28:06.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b3247700 1 -- 172.21.15.79:0/460082031 learned_addr learned my addr 172.21.15.79:0/460082031 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:06.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b3a48700 1 --2- 172.21.15.79:0/460082031 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81b4098af0 0x7f81b40c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:06.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b2a46700 1 --2- 172.21.15.79:0/460082031 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81b40986a0 0x7f81b40d5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:06.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b3247700 1 -- 172.21.15.79:0/460082031 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81b40986a0 msgr2=0x7f81b40d5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:06.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b3247700 1 --2- 172.21.15.79:0/460082031 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81b40986a0 0x7f81b40d5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:06.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b3247700 1 -- 172.21.15.79:0/460082031 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81b4098af0 msgr2=0x7f81b40c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:06.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b3247700 1 --2- 172.21.15.79:0/460082031 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81b4098af0 0x7f81b40c47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:06.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b3247700 1 -- 172.21.15.79:0/460082031 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b40c06b0 con 0x7f81b40bdc80 2021-04-09T18:28:06.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b3247700 1 --2- 172.21.15.79:0/460082031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81b40bdc80 0x7f81b40d6280 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f81b4087490 tx=0x7f81a400cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:06.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f819bfff700 1 -- 172.21.15.79:0/460082031 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f81b40c06b0 con 0x7f81b40bdc80 2021-04-09T18:28:06.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f819bfff700 1 -- 172.21.15.79:0/460082031 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a4007320 con 0x7f81b40bdc80 2021-04-09T18:28:06.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b95f1700 1 -- 172.21.15.79:0/460082031 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b40bff60 con 0x7f81b40bdc80 2021-04-09T18:28:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f819bfff700 1 -- 172.21.15.79:0/460082031 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f81a40057e0 con 0x7f81b40bdc80 2021-04-09T18:28:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f81b95f1700 1 -- 172.21.15.79:0/460082031 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b40c0bc0 con 0x7f81b40bdc80 2021-04-09T18:28:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.202 7f819bfff700 1 -- 172.21.15.79:0/460082031 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f81a401a060 con 0x7f81b40bdc80 2021-04-09T18:28:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.206 7f819bfff700 1 --2- 172.21.15.79:0/460082031 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8194029100 0x7f819402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:06.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.206 7f819bfff700 1 -- 172.21.15.79:0/460082031 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5572+0+0 (secure 0 0 0) 0x7f81a4038ce0 con 0x7f81b40bdc80 2021-04-09T18:28:06.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.206 7f81b2a46700 1 --2- 172.21.15.79:0/460082031 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8194029100 0x7f819402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:06.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.206 7f81b2a46700 1 --2- 172.21.15.79:0/460082031 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8194029100 0x7f819402b650 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:06.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.206 7f81b95f1700 1 -- 172.21.15.79:0/460082031 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b40e39f0 con 0x7f81b40bdc80 2021-04-09T18:28:06.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.210 7f819bfff700 1 -- 172.21.15.79:0/460082031 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f81a4007110 con 0x7f81b40bdc80 2021-04-09T18:28:06.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:06.374 7f81b95f1700 1 -- 172.21.15.79:0/460082031 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f81b40d6ae0 con 0x7f81b40bdc80 2021-04-09T18:28:07.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.082 7f819bfff700 1 -- 172.21.15.79:0/460082031 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 173+0+0 (secure 0 0 0) 0x7f81a4000bf0 con 0x7f81b40bdc80 2021-04-09T18:28:07.095 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2021-04-09T18:28:07.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.090 7f81b95f1700 1 -- 172.21.15.79:0/460082031 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8194029100 msgr2=0x7f819402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:07.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.090 7f81b95f1700 1 --2- 172.21.15.79:0/460082031 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8194029100 0x7f819402b650 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:07.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.090 7f81b95f1700 1 -- 172.21.15.79:0/460082031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81b40bdc80 msgr2=0x7f81b40d6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:07.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.090 7f81b95f1700 1 --2- 172.21.15.79:0/460082031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81b40bdc80 0x7f81b40d6280 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f81b4087490 tx=0x7f81a400cae0).stop 2021-04-09T18:28:07.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.090 7f81b95f1700 1 -- 172.21.15.79:0/460082031 shutdown_connections 2021-04-09T18:28:07.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.090 7f81b95f1700 1 --2- 172.21.15.79:0/460082031 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8194029100 0x7f819402b650 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:07.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.090 7f81b95f1700 1 --2- 172.21.15.79:0/460082031 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81b4098af0 0x7f81b40c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:07.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.090 7f81b95f1700 1 --2- 172.21.15.79:0/460082031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81b40bdc80 0x7f81b40d6280 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:07.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.090 7f81b95f1700 1 --2- 172.21.15.79:0/460082031 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81b40986a0 0x7f81b40d5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:07.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.090 7f81b95f1700 1 -- 172.21.15.79:0/460082031 >> 172.21.15.79:0/460082031 conn(0x7f81b409a350 msgr2=0x7f81b40d8300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:07.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.090 7f81b95f1700 1 -- 172.21.15.79:0/460082031 shutdown_connections 2021-04-09T18:28:07.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.090 7f81b95f1700 1 -- 172.21.15.79:0/460082031 wait complete. 2021-04-09T18:28:07.107 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-04-09T18:28:07.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.194 7f951cf3f700 1 Processor -- start 2021-04-09T18:28:07.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.194 7f951cf3f700 1 -- start start 2021-04-09T18:28:07.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f951cf3f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f95180f5520 0x7f95180f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:07.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f951cf3f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95180e9ae0 0x7f951809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:07.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f951cf3f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95180fbb20 con 0x7f95181c2db0 2021-04-09T18:28:07.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f951cf3f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95180e9f30 con 0x7f95180f5520 2021-04-09T18:28:07.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f951cf3f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95180e59d0 con 0x7f95180e9ae0 2021-04-09T18:28:07.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f95162ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95180e9ae0 0x7f951809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:07.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f9516aef700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f95180f5520 0x7f95180f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:07.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f95172f0700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f95181c2db0 0x7f95181c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:52490/0 (socket says 172.21.15.79:52490) 2021-04-09T18:28:07.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f95172f0700 1 -- 172.21.15.79:0/1785655686 learned_addr learned my addr 172.21.15.79:0/1785655686 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:28:07.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f9515aed700 1 -- 172.21.15.79:0/1785655686 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957456468 0 0) 0x7f9510001450 con 0x7f95181c2db0 2021-04-09T18:28:07.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f9515aed700 1 -- 172.21.15.79:0/1785655686 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9504003240 con 0x7f95181c2db0 2021-04-09T18:28:07.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f95162ee700 1 -- 172.21.15.79:0/1785655686 >> v2:172.21.15.89:3300/0 conn(0x7f95180f5520 msgr2=0x7f95180f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:07.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f95162ee700 1 --2- 172.21.15.79:0/1785655686 >> v2:172.21.15.89:3300/0 conn(0x7f95180f5520 0x7f95180f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:07.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f95162ee700 1 -- 172.21.15.79:0/1785655686 >> v1:172.21.15.89:6789/0 conn(0x7f95181c2db0 legacy=0x7f95181c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:07.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f95162ee700 1 -- 172.21.15.79:0/1785655686 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95180e56d0 con 0x7f95180e9ae0 2021-04-09T18:28:07.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f9516aef700 1 --2- 172.21.15.79:0/1785655686 >> v2:172.21.15.89:3300/0 conn(0x7f95180f5520 0x7f95180f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:07.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f95162ee700 1 --2- 172.21.15.79:0/1785655686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95180e9ae0 0x7f951809f110 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f9500002f30 tx=0x7f950000bcc0).ready entity=mon.2 client_cookie=a20f9d74d618d499 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:07.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f9515aed700 1 -- 172.21.15.79:0/1785655686 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f95180e56d0 con 0x7f95180e9ae0 2021-04-09T18:28:07.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f9515aed700 1 -- 172.21.15.79:0/1785655686 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9500009800 con 0x7f95180e9ae0 2021-04-09T18:28:07.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f9515aed700 1 -- 172.21.15.79:0/1785655686 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9500009bd0 con 0x7f95180e9ae0 2021-04-09T18:28:07.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f951cf3f700 1 -- 172.21.15.79:0/1785655686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95180e9ae0 msgr2=0x7f951809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:07.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f951cf3f700 1 --2- 172.21.15.79:0/1785655686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95180e9ae0 0x7f951809f110 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f9500002f30 tx=0x7f950000bcc0).stop 2021-04-09T18:28:07.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f951cf3f700 1 -- 172.21.15.79:0/1785655686 shutdown_connections 2021-04-09T18:28:07.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f951cf3f700 1 --2- 172.21.15.79:0/1785655686 >> v2:172.21.15.89:3300/0 conn(0x7f95180f5520 0x7f95180f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:07.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f951cf3f700 1 --2- 172.21.15.79:0/1785655686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95180e9ae0 0x7f951809f110 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:07.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f951cf3f700 1 -- 172.21.15.79:0/1785655686 >> 172.21.15.79:0/1785655686 conn(0x7f95180e5fe0 msgr2=0x7f95180e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:07.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f951cf3f700 1 -- 172.21.15.79:0/1785655686 shutdown_connections 2021-04-09T18:28:07.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.198 7f951cf3f700 1 -- 172.21.15.79:0/1785655686 wait complete. 2021-04-09T18:28:07.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f951cf3f700 1 Processor -- start 2021-04-09T18:28:07.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f951cf3f700 1 -- start start 2021-04-09T18:28:07.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f951cf3f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95180d01c0 0x7f95180d6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:07.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f951cf3f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95180d69c0 0x7f9518093fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:07.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f951cf3f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95180945f0 0x7f9518099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:07.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f951cf3f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9518094d90 con 0x7f95180d01c0 2021-04-09T18:28:07.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f951cf3f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9518094a40 con 0x7f95180d69c0 2021-04-09T18:28:07.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f951cf3f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95180d0610 con 0x7f95180945f0 2021-04-09T18:28:07.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f9516aef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95180d01c0 0x7f95180d6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:07.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f95172f0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95180945f0 0x7f9518099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:07.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f9516aef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95180d01c0 0x7f95180d6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57312/0 (socket says 172.21.15.79:57312) 2021-04-09T18:28:07.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f9516aef700 1 -- 172.21.15.79:0/3517072579 learned_addr learned my addr 172.21.15.79:0/3517072579 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:07.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f95162ee700 1 --2- 172.21.15.79:0/3517072579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95180d69c0 0x7f9518093fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:07.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f9516aef700 1 -- 172.21.15.79:0/3517072579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95180945f0 msgr2=0x7f9518099a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:07.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f9516aef700 1 --2- 172.21.15.79:0/3517072579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95180945f0 0x7f9518099a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:07.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f9516aef700 1 -- 172.21.15.79:0/3517072579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95180d69c0 msgr2=0x7f9518093fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:07.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f9516aef700 1 --2- 172.21.15.79:0/3517072579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95180d69c0 0x7f9518093fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:07.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f9516aef700 1 -- 172.21.15.79:0/3517072579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95180b93e0 con 0x7f95180d01c0 2021-04-09T18:28:07.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f95172f0700 1 --2- 172.21.15.79:0/3517072579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95180945f0 0x7f9518099a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:07.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f95162ee700 1 --2- 172.21.15.79:0/3517072579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95180d69c0 0x7f9518093fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:07.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f9516aef700 1 --2- 172.21.15.79:0/3517072579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95180d01c0 0x7f95180d6390 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f950800efc0 tx=0x7f950800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:07.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f950f7fe700 1 -- 172.21.15.79:0/3517072579 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f95180b93e0 con 0x7f95180d01c0 2021-04-09T18:28:07.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.202 7f950f7fe700 1 -- 172.21.15.79:0/3517072579 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95080123f0 con 0x7f95180d01c0 2021-04-09T18:28:07.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.206 7f950f7fe700 1 -- 172.21.15.79:0/3517072579 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f950800f040 con 0x7f95180d01c0 2021-04-09T18:28:07.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.206 7f951cf3f700 1 -- 172.21.15.79:0/3517072579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95180b8ef0 con 0x7f95180d01c0 2021-04-09T18:28:07.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.206 7f951cf3f700 1 -- 172.21.15.79:0/3517072579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951809a230 con 0x7f95180d01c0 2021-04-09T18:28:07.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.206 7f950f7fe700 1 -- 172.21.15.79:0/3517072579 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9508011070 con 0x7f95180d01c0 2021-04-09T18:28:07.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.206 7f950f7fe700 1 --2- 172.21.15.79:0/3517072579 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f94fc029100 0x7f94fc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:07.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.206 7f950f7fe700 1 -- 172.21.15.79:0/3517072579 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f9508010040 con 0x7f95180d01c0 2021-04-09T18:28:07.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.206 7f95162ee700 1 --2- 172.21.15.79:0/3517072579 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f94fc029100 0x7f94fc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:07.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.206 7f95162ee700 1 --2- 172.21.15.79:0/3517072579 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f94fc029100 0x7f94fc02b650 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:07.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.210 7f951cf3f700 1 -- 172.21.15.79:0/3517072579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95180e39e0 con 0x7f95180d01c0 2021-04-09T18:28:07.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.218 7f950f7fe700 1 -- 172.21.15.79:0/3517072579 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f950800ca90 con 0x7f95180d01c0 2021-04-09T18:28:07.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.398 7f951cf3f700 1 -- 172.21.15.79:0/3517072579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f95180f5b20 con 0x7f95180d01c0 2021-04-09T18:28:07.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.406 7f950f7fe700 1 -- 172.21.15.79:0/3517072579 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9508000bf0 con 0x7f95180d01c0 2021-04-09T18:28:07.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.410 7f951cf3f700 1 -- 172.21.15.79:0/3517072579 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f94fc029100 msgr2=0x7f94fc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:07.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.410 7f951cf3f700 1 --2- 172.21.15.79:0/3517072579 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f94fc029100 0x7f94fc02b650 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:07.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.410 7f951cf3f700 1 -- 172.21.15.79:0/3517072579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95180d01c0 msgr2=0x7f95180d6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:07.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.410 7f951cf3f700 1 --2- 172.21.15.79:0/3517072579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95180d01c0 0x7f95180d6390 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f950800efc0 tx=0x7f950800c430).stop 2021-04-09T18:28:07.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.410 7f951cf3f700 1 -- 172.21.15.79:0/3517072579 shutdown_connections 2021-04-09T18:28:07.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.410 7f951cf3f700 1 --2- 172.21.15.79:0/3517072579 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f94fc029100 0x7f94fc02b650 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:07.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.410 7f951cf3f700 1 --2- 172.21.15.79:0/3517072579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95180945f0 0x7f9518099a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:07.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.410 7f951cf3f700 1 --2- 172.21.15.79:0/3517072579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95180d01c0 0x7f95180d6390 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:07.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.410 7f951cf3f700 1 --2- 172.21.15.79:0/3517072579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95180d69c0 0x7f9518093fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:07.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.410 7f951cf3f700 1 -- 172.21.15.79:0/3517072579 >> 172.21.15.79:0/3517072579 conn(0x7f9518092e00 msgr2=0x7f95180baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:07.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.410 7f951cf3f700 1 -- 172.21.15.79:0/3517072579 shutdown_connections 2021-04-09T18:28:07.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.410 7f951cf3f700 1 -- 172.21.15.79:0/3517072579 wait complete. 2021-04-09T18:28:07.424 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2021-04-09T18:28:07.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.514 7f5f067bc700 1 Processor -- start 2021-04-09T18:28:07.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.514 7f5f067bc700 1 -- start start 2021-04-09T18:28:07.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5f067bc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f000e9ad0 0x7f5f0009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:07.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5f067bc700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f000fbb10 con 0x7f5f001c8000 2021-04-09T18:28:07.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5f067bc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f000e56c0 con 0x7f5f000f5510 2021-04-09T18:28:07.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5f067bc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f001c3db0 con 0x7f5f000e9ad0 2021-04-09T18:28:07.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5f04d61700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5f001c8000 0x7f5f001ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52034/0 (socket says 172.21.15.79:52034) 2021-04-09T18:28:07.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5f04d61700 1 -- 172.21.15.79:0/837629957 learned_addr learned my addr 172.21.15.79:0/837629957 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:28:07.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5eff7fe700 1 --2- 172.21.15.79:0/837629957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f000e9ad0 0x7f5f0009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:07.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5efeffd700 1 -- 172.21.15.79:0/837629957 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3764219264 0 0) 0x7f5ef8001450 con 0x7f5f001c8000 2021-04-09T18:28:07.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5efeffd700 1 -- 172.21.15.79:0/837629957 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ee8003240 con 0x7f5f001c8000 2021-04-09T18:28:07.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5efeffd700 1 -- 172.21.15.79:0/837629957 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180116617 0 0) 0x7f5ef00010d0 con 0x7f5f000f5510 2021-04-09T18:28:07.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5efeffd700 1 -- 172.21.15.79:0/837629957 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ee8003620 con 0x7f5f000f5510 2021-04-09T18:28:07.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5efeffd700 1 -- 172.21.15.79:0/837629957 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3823771149 0 0) 0x7f5ef80019d0 con 0x7f5f001c8000 2021-04-09T18:28:07.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5eff7fe700 1 -- 172.21.15.79:0/837629957 >> v1:172.21.15.89:6789/0 conn(0x7f5f000f5510 legacy=0x7f5f000f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:07.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5eff7fe700 1 -- 172.21.15.79:0/837629957 >> v1:172.21.15.79:6789/0 conn(0x7f5f001c8000 legacy=0x7f5f001ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:07.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5eff7fe700 1 -- 172.21.15.79:0/837629957 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f000e4320 con 0x7f5f000e9ad0 2021-04-09T18:28:07.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5eff7fe700 1 --2- 172.21.15.79:0/837629957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f000e9ad0 0x7f5f0009f100 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f5ef8002170 tx=0x7f5ef400bcf0).ready entity=mon.2 client_cookie=6fb63e178c75b420 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:07.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5efeffd700 1 -- 172.21.15.79:0/837629957 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5f000e4320 con 0x7f5f000e9ad0 2021-04-09T18:28:07.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5efeffd700 1 -- 172.21.15.79:0/837629957 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef4009790 con 0x7f5f000e9ad0 2021-04-09T18:28:07.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5efeffd700 1 -- 172.21.15.79:0/837629957 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5ef8001f30 con 0x7f5f000e9ad0 2021-04-09T18:28:07.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5f067bc700 1 -- 172.21.15.79:0/837629957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f000e9ad0 msgr2=0x7f5f0009f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:07.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5f067bc700 1 --2- 172.21.15.79:0/837629957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f000e9ad0 0x7f5f0009f100 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f5ef8002170 tx=0x7f5ef400bcf0).stop 2021-04-09T18:28:07.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5f067bc700 1 -- 172.21.15.79:0/837629957 shutdown_connections 2021-04-09T18:28:07.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5f067bc700 1 --2- 172.21.15.79:0/837629957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f000e9ad0 0x7f5f0009f100 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:07.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5f067bc700 1 -- 172.21.15.79:0/837629957 >> 172.21.15.79:0/837629957 conn(0x7f5f000e5fd0 msgr2=0x7f5f000e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:07.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5f067bc700 1 -- 172.21.15.79:0/837629957 shutdown_connections 2021-04-09T18:28:07.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.518 7f5f067bc700 1 -- 172.21.15.79:0/837629957 wait complete. 2021-04-09T18:28:07.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.522 7f5f067bc700 1 Processor -- start 2021-04-09T18:28:07.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.522 7f5f067bc700 1 -- start start 2021-04-09T18:28:07.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.522 7f5f067bc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f0008f430 0x7f5f000cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:07.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.522 7f5f067bc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f00099960 0x7f5f00099db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:07.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.522 7f5f067bc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f0009a3e0 0x7f5f000d5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:07.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.522 7f5f067bc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f000e9f20 con 0x7f5f0009a3e0 2021-04-09T18:28:07.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.522 7f5f067bc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f000d5910 con 0x7f5f0008f430 2021-04-09T18:28:07.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.522 7f5f067bc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f000d51a0 con 0x7f5f00099960 2021-04-09T18:28:07.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.526 7f5f04d61700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f0009a3e0 0x7f5f000d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:07.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.526 7f5f04d61700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f0009a3e0 0x7f5f000d5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57328/0 (socket says 172.21.15.79:57328) 2021-04-09T18:28:07.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.526 7f5f04d61700 1 -- 172.21.15.79:0/4258768478 learned_addr learned my addr 172.21.15.79:0/4258768478 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:07.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.526 7f5eff7fe700 1 --2- 172.21.15.79:0/4258768478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f00099960 0x7f5f00099db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:07.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.526 7f5efffff700 1 --2- 172.21.15.79:0/4258768478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f0008f430 0x7f5f000cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:07.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.526 7f5f04d61700 1 -- 172.21.15.79:0/4258768478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f00099960 msgr2=0x7f5f00099db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:07.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.526 7f5f04d61700 1 --2- 172.21.15.79:0/4258768478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f00099960 0x7f5f00099db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:07.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.526 7f5f04d61700 1 -- 172.21.15.79:0/4258768478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f0008f430 msgr2=0x7f5f000cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.526 7f5f04d61700 1 --2- 172.21.15.79:0/4258768478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f0008f430 0x7f5f000cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.526 7f5f04d61700 1 -- 172.21.15.79:0/4258768478 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0008f880 con 0x7f5f0009a3e0 2021-04-09T18:28:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.526 7f5f04d61700 1 --2- 172.21.15.79:0/4258768478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f0009a3e0 0x7f5f000d5c10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f5f000d5890 tx=0x7f5ef800cec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.526 7f5efcff9700 1 -- 172.21.15.79:0/4258768478 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5f0008f880 con 0x7f5f0009a3e0 2021-04-09T18:28:07.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.526 7f5efcff9700 1 -- 172.21.15.79:0/4258768478 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef8004a90 con 0x7f5f0009a3e0 2021-04-09T18:28:07.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.526 7f5f067bc700 1 -- 172.21.15.79:0/4258768478 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f0008f080 con 0x7f5f0009a3e0 2021-04-09T18:28:07.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.526 7f5efcff9700 1 -- 172.21.15.79:0/4258768478 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5ef8007170 con 0x7f5f0009a3e0 2021-04-09T18:28:07.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.526 7f5f067bc700 1 -- 172.21.15.79:0/4258768478 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f000cf080 con 0x7f5f0009a3e0 2021-04-09T18:28:07.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.526 7f5efcff9700 1 -- 172.21.15.79:0/4258768478 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5ef8007370 con 0x7f5f0009a3e0 2021-04-09T18:28:07.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.526 7f5efcff9700 1 --2- 172.21.15.79:0/4258768478 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5ee0029100 0x7f5ee002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:07.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.526 7f5efcff9700 1 -- 172.21.15.79:0/4258768478 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f5ef80393c0 con 0x7f5f0009a3e0 2021-04-09T18:28:07.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.526 7f5efffff700 1 --2- 172.21.15.79:0/4258768478 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5ee0029100 0x7f5ee002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:07.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.530 7f5efffff700 1 --2- 172.21.15.79:0/4258768478 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5ee0029100 0x7f5ee002b650 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:07.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.530 7f5f067bc700 1 -- 172.21.15.79:0/4258768478 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f000e39d0 con 0x7f5f0009a3e0 2021-04-09T18:28:07.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.534 7f5efcff9700 1 -- 172.21.15.79:0/4258768478 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5ef8004880 con 0x7f5f0009a3e0 2021-04-09T18:28:07.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:07.694 7f5f067bc700 1 -- 172.21.15.79:0/4258768478 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7f5f000a1cb0 con 0x7f5f0009a3e0 2021-04-09T18:28:08.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.082 7f5efcff9700 1 -- 172.21.15.79:0/4258768478 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v75) v1 ==== 139+0+0 (secure 0 0 0) 0x7f5ef8000f70 con 0x7f5f0009a3e0 2021-04-09T18:28:08.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.114 7f5f067bc700 1 -- 172.21.15.79:0/4258768478 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5ee0029100 msgr2=0x7f5ee002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:08.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.114 7f5f067bc700 1 --2- 172.21.15.79:0/4258768478 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5ee0029100 0x7f5ee002b650 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.114 7f5f067bc700 1 -- 172.21.15.79:0/4258768478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f0009a3e0 msgr2=0x7f5f000d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:08.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.114 7f5f067bc700 1 --2- 172.21.15.79:0/4258768478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f0009a3e0 0x7f5f000d5c10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f5f000d5890 tx=0x7f5ef800cec0).stop 2021-04-09T18:28:08.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.114 7f5f067bc700 1 -- 172.21.15.79:0/4258768478 shutdown_connections 2021-04-09T18:28:08.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.114 7f5f067bc700 1 --2- 172.21.15.79:0/4258768478 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5ee0029100 0x7f5ee002b650 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.114 7f5f067bc700 1 --2- 172.21.15.79:0/4258768478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f0008f430 0x7f5f000cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.114 7f5f067bc700 1 --2- 172.21.15.79:0/4258768478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f0009a3e0 0x7f5f000d5c10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.114 7f5f067bc700 1 --2- 172.21.15.79:0/4258768478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f00099960 0x7f5f00099db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.114 7f5f067bc700 1 -- 172.21.15.79:0/4258768478 >> 172.21.15.79:0/4258768478 conn(0x7f5f000d6fb0 msgr2=0x7f5f0008e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:08.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.114 7f5f067bc700 1 -- 172.21.15.79:0/4258768478 shutdown_connections 2021-04-09T18:28:08.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.114 7f5f067bc700 1 -- 172.21.15.79:0/4258768478 wait complete. 2021-04-09T18:28:08.130 INFO:tasks.cephfs_test_runner:test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-04-09T18:28:08.130 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) 2021-04-09T18:28:08.131 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2021-04-09T18:28:08.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.222 7f0efca82700 1 Processor -- start 2021-04-09T18:28:08.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.222 7f0efca82700 1 -- start start 2021-04-09T18:28:08.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.222 7f0efca82700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0ef81c9010 0x7f0ef81cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:08.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.222 7f0efca82700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef80fbb10 con 0x7f0ef80f5510 2021-04-09T18:28:08.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.222 7f0efca82700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef809f900 con 0x7f0ef80e9ad0 2021-04-09T18:28:08.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.222 7f0efca82700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef81c3db0 con 0x7f0ef81c9010 2021-04-09T18:28:08.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.222 7f0ef67e6700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0ef80f5510 0x7f0ef80f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52044/0 (socket says 172.21.15.79:52044) 2021-04-09T18:28:08.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.222 7f0ef67e6700 1 -- 172.21.15.79:0/4256548919 learned_addr learned my addr 172.21.15.79:0/4256548919 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:28:08.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.222 7f0ef6fe7700 1 --2- 172.21.15.79:0/4256548919 >> v2:172.21.15.89:3300/0 conn(0x7f0ef81c9010 0x7f0ef81cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:08.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.222 7f0ef57e4700 1 -- 172.21.15.79:0/4256548919 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089918067 0 0) 0x7f0ee80010d0 con 0x7f0ef80f5510 2021-04-09T18:28:08.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.222 7f0ef57e4700 1 -- 172.21.15.79:0/4256548919 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ee4003240 con 0x7f0ef80f5510 2021-04-09T18:28:08.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef57e4700 1 -- 172.21.15.79:0/4256548919 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4121097460 0 0) 0x7f0ee8001650 con 0x7f0ef80f5510 2021-04-09T18:28:08.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef57e4700 1 -- 172.21.15.79:0/4256548919 >> v2:172.21.15.89:3300/0 conn(0x7f0ef81c9010 msgr2=0x7f0ef81cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:08.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef57e4700 1 --2- 172.21.15.79:0/4256548919 >> v2:172.21.15.89:3300/0 conn(0x7f0ef81c9010 0x7f0ef81cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef57e4700 1 -- 172.21.15.79:0/4256548919 >> v1:172.21.15.89:6789/0 conn(0x7f0ef80e9ad0 legacy=0x7f0ef809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:08.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef57e4700 1 -- 172.21.15.79:0/4256548919 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef80e56c0 con 0x7f0ef80f5510 2021-04-09T18:28:08.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef57e4700 1 -- 172.21.15.79:0/4256548919 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f0ee8001bb0 con 0x7f0ef80f5510 2021-04-09T18:28:08.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef57e4700 1 -- 172.21.15.79:0/4256548919 >> v1:172.21.15.79:6789/0 conn(0x7f0ef80f5510 legacy=0x7f0ef80f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:08.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef57e4700 1 --2- 172.21.15.79:0/4256548919 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ee40038c0 0x7f0ee4003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:08.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef57e4700 1 --2- 172.21.15.79:0/4256548919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ee40045a0 0x7f0ee40049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:08.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef57e4700 1 --2- 172.21.15.79:0/4256548919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ee40097e0 0x7f0ee400bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:08.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef57e4700 1 -- 172.21.15.79:0/4256548919 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef81c3db0 con 0x7f0ee40097e0 2021-04-09T18:28:08.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef57e4700 1 -- 172.21.15.79:0/4256548919 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40053f0 con 0x7f0ee40045a0 2021-04-09T18:28:08.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef57e4700 1 -- 172.21.15.79:0/4256548919 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee4050300 con 0x7f0ee40038c0 2021-04-09T18:28:08.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef6fe7700 1 --2- 172.21.15.79:0/4256548919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ee40097e0 0x7f0ee400bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:08.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef5fe5700 1 --2- 172.21.15.79:0/4256548919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ee40045a0 0x7f0ee40049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:08.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef67e6700 1 --2- 172.21.15.79:0/4256548919 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ee40038c0 0x7f0ee4003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:08.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef6fe7700 1 -- 172.21.15.79:0/4256548919 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ee40038c0 msgr2=0x7f0ee4003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:08.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef6fe7700 1 --2- 172.21.15.79:0/4256548919 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ee40038c0 0x7f0ee4003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef6fe7700 1 -- 172.21.15.79:0/4256548919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ee40045a0 msgr2=0x7f0ee40049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:08.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef6fe7700 1 --2- 172.21.15.79:0/4256548919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ee40045a0 0x7f0ee40049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef6fe7700 1 -- 172.21.15.79:0/4256548919 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee40505f0 con 0x7f0ee40097e0 2021-04-09T18:28:08.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef67e6700 1 --2- 172.21.15.79:0/4256548919 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ee40038c0 0x7f0ee4003d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:28:08.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef6fe7700 1 -- 172.21.15.79:0/4256548919 reap_dead start 2021-04-09T18:28:08.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef6fe7700 1 --2- 172.21.15.79:0/4256548919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ee40097e0 0x7f0ee400bc40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f0ef000c000 tx=0x7f0ef000e1d0).ready entity=mon.0 client_cookie=c29b250fa4d2fd16 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:08.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef57e4700 1 -- 172.21.15.79:0/4256548919 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ee40505f0 con 0x7f0ee40097e0 2021-04-09T18:28:08.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef57e4700 1 -- 172.21.15.79:0/4256548919 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef000eaa0 con 0x7f0ee40097e0 2021-04-09T18:28:08.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0ef57e4700 1 -- 172.21.15.79:0/4256548919 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ef000f040 con 0x7f0ee40097e0 2021-04-09T18:28:08.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0efca82700 1 -- 172.21.15.79:0/4256548919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ee40097e0 msgr2=0x7f0ee400bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:08.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0efca82700 1 --2- 172.21.15.79:0/4256548919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ee40097e0 0x7f0ee400bc40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f0ef000c000 tx=0x7f0ef000e1d0).stop 2021-04-09T18:28:08.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0efca82700 1 -- 172.21.15.79:0/4256548919 shutdown_connections 2021-04-09T18:28:08.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0efca82700 1 --2- 172.21.15.79:0/4256548919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ee40097e0 0x7f0ee400bc40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0efca82700 1 -- 172.21.15.79:0/4256548919 >> 172.21.15.79:0/4256548919 conn(0x7f0ef80e5fd0 msgr2=0x7f0ef80e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:08.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0efca82700 1 -- 172.21.15.79:0/4256548919 shutdown_connections 2021-04-09T18:28:08.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.226 7f0efca82700 1 -- 172.21.15.79:0/4256548919 wait complete. 2021-04-09T18:28:08.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.230 7f0efca82700 1 Processor -- start 2021-04-09T18:28:08.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.230 7f0efca82700 1 -- start start 2021-04-09T18:28:08.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0efca82700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ef80b38e0 0x7f0ef8096330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:08.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0efca82700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ef80ae3d0 0x7f0ef80d7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:08.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0efca82700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ef80ae820 0x7f0ef80d79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0efca82700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef80e9f20 con 0x7f0ef80ae3d0 2021-04-09T18:28:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0efca82700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef80b4110 con 0x7f0ef80ae820 2021-04-09T18:28:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0efca82700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef80b3d30 con 0x7f0ef80b38e0 2021-04-09T18:28:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0ef5fe5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ef80ae3d0 0x7f0ef80d7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0ef5fe5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ef80ae3d0 0x7f0ef80d7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57348/0 (socket says 172.21.15.79:57348) 2021-04-09T18:28:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0ef5fe5700 1 -- 172.21.15.79:0/242879173 learned_addr learned my addr 172.21.15.79:0/242879173 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:08.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0ef6fe7700 1 --2- 172.21.15.79:0/242879173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ef80ae820 0x7f0ef80d79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:08.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0ef67e6700 1 --2- 172.21.15.79:0/242879173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ef80b38e0 0x7f0ef8096330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0ef5fe5700 1 -- 172.21.15.79:0/242879173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ef80b38e0 msgr2=0x7f0ef8096330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0ef5fe5700 1 --2- 172.21.15.79:0/242879173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ef80b38e0 0x7f0ef8096330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0ef5fe5700 1 -- 172.21.15.79:0/242879173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ef80ae820 msgr2=0x7f0ef80d79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0ef5fe5700 1 --2- 172.21.15.79:0/242879173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ef80ae820 0x7f0ef80d79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0ef5fe5700 1 -- 172.21.15.79:0/242879173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef81ae260 con 0x7f0ef80ae3d0 2021-04-09T18:28:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0ef67e6700 1 --2- 172.21.15.79:0/242879173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ef80b38e0 0x7f0ef8096330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:28:08.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0ef6fe7700 1 --2- 172.21.15.79:0/242879173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ef80ae820 0x7f0ef80d79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:28:08.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0ef5fe5700 1 --2- 172.21.15.79:0/242879173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ef80ae3d0 0x7f0ef80d7390 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f0ee000d000 tx=0x7f0ee000d430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:08.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0eeeffd700 1 -- 172.21.15.79:0/242879173 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ef81ae260 con 0x7f0ef80ae3d0 2021-04-09T18:28:08.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0eeeffd700 1 -- 172.21.15.79:0/242879173 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee000dd60 con 0x7f0ef80ae3d0 2021-04-09T18:28:08.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0eeeffd700 1 -- 172.21.15.79:0/242879173 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ee0010040 con 0x7f0ef80ae3d0 2021-04-09T18:28:08.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0efca82700 1 -- 172.21.15.79:0/242879173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef81ae580 con 0x7f0ef80ae3d0 2021-04-09T18:28:08.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0efca82700 1 -- 172.21.15.79:0/242879173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef81aea80 con 0x7f0ef80ae3d0 2021-04-09T18:28:08.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0eeeffd700 1 -- 172.21.15.79:0/242879173 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0ee0012070 con 0x7f0ef80ae3d0 2021-04-09T18:28:08.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.234 7f0eeeffd700 1 --2- 172.21.15.79:0/242879173 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0edc029100 0x7f0edc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:08.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.238 7f0eeeffd700 1 -- 172.21.15.79:0/242879173 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f0ee0011040 con 0x7f0ef80ae3d0 2021-04-09T18:28:08.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.238 7f0ef67e6700 1 --2- 172.21.15.79:0/242879173 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0edc029100 0x7f0edc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:08.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.238 7f0ef67e6700 1 --2- 172.21.15.79:0/242879173 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0edc029100 0x7f0edc02b650 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:08.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.238 7f0efca82700 1 -- 172.21.15.79:0/242879173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef80e39d0 con 0x7f0ef80ae3d0 2021-04-09T18:28:08.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.246 7f0eeeffd700 1 -- 172.21.15.79:0/242879173 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0ee000d960 con 0x7f0ef80ae3d0 2021-04-09T18:28:08.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:08.418 7f0efca82700 1 -- 172.21.15.79:0/242879173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f0ef80a1cb0 con 0x7f0ef80ae3d0 2021-04-09T18:28:09.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.090 7f0eeeffd700 1 -- 172.21.15.79:0/242879173 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v76) v1 ==== 147+0+0 (secure 0 0 0) 0x7f0ee0000f70 con 0x7f0ef80ae3d0 2021-04-09T18:28:09.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.138 7f0efca82700 1 -- 172.21.15.79:0/242879173 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0edc029100 msgr2=0x7f0edc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:09.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.138 7f0efca82700 1 --2- 172.21.15.79:0/242879173 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0edc029100 0x7f0edc02b650 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:09.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.138 7f0efca82700 1 -- 172.21.15.79:0/242879173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ef80ae3d0 msgr2=0x7f0ef80d7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:09.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.138 7f0efca82700 1 --2- 172.21.15.79:0/242879173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ef80ae3d0 0x7f0ef80d7390 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f0ee000d000 tx=0x7f0ee000d430).stop 2021-04-09T18:28:09.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.138 7f0efca82700 1 -- 172.21.15.79:0/242879173 shutdown_connections 2021-04-09T18:28:09.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.138 7f0efca82700 1 --2- 172.21.15.79:0/242879173 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0edc029100 0x7f0edc02b650 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:09.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.138 7f0efca82700 1 --2- 172.21.15.79:0/242879173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ef80ae820 0x7f0ef80d79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:09.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.138 7f0efca82700 1 --2- 172.21.15.79:0/242879173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ef80b38e0 0x7f0ef8096330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:09.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.138 7f0efca82700 1 --2- 172.21.15.79:0/242879173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ef80ae3d0 0x7f0ef80d7390 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:09.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.138 7f0efca82700 1 -- 172.21.15.79:0/242879173 >> 172.21.15.79:0/242879173 conn(0x7f0ef80baf50 msgr2=0x7f0ef80af750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:09.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.138 7f0efca82700 1 -- 172.21.15.79:0/242879173 shutdown_connections 2021-04-09T18:28:09.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.138 7f0efca82700 1 -- 172.21.15.79:0/242879173 wait complete. 2021-04-09T18:28:09.155 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-04-09T18:28:09.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.250 7f912e70b700 1 Processor -- start 2021-04-09T18:28:09.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.250 7f912e70b700 1 -- start start 2021-04-09T18:28:09.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912e70b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91280e9b10 0x7f912809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:09.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912e70b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f91281c8040 0x7f91281ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:09.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912e70b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91280fbb50 con 0x7f91280f5550 2021-04-09T18:28:09.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912e70b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91281c3df0 con 0x7f91281c8040 2021-04-09T18:28:09.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912e70b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91280e9f60 con 0x7f91280e9b10 2021-04-09T18:28:09.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912ccb0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f91281c8040 0x7f91281ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:09.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912ccb0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f91281c8040 0x7f91281ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57358/0 (socket says 172.21.15.79:57358) 2021-04-09T18:28:09.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912ccb0700 1 -- 172.21.15.79:0/879286591 learned_addr learned my addr 172.21.15.79:0/879286591 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:09.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f9127fff700 1 --1- 172.21.15.79:0/879286591 >> v1:172.21.15.79:6789/0 conn(0x7f91280f5550 0x7f91280f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52064/0 (socket says 172.21.15.79:52064) 2021-04-09T18:28:09.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f91277fe700 1 --2- 172.21.15.79:0/879286591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91280e9b10 0x7f912809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:09.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912ccb0700 1 -- 172.21.15.79:0/879286591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91280e9b10 msgr2=0x7f912809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:09.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912ccb0700 1 --2- 172.21.15.79:0/879286591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91280e9b10 0x7f912809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:09.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912ccb0700 1 -- 172.21.15.79:0/879286591 >> v1:172.21.15.79:6789/0 conn(0x7f91280f5550 legacy=0x7f91280f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:09.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912ccb0700 1 -- 172.21.15.79:0/879286591 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91280e5700 con 0x7f91281c8040 2021-04-09T18:28:09.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912ccb0700 1 --2- 172.21.15.79:0/879286591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91281c8040 0x7f91281ca4a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f91200032b0 tx=0x7f912000b3c0).ready entity=mon.0 client_cookie=8e017d7ccfa79a57 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:09.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f9126ffd700 1 -- 172.21.15.79:0/879286591 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f91280e5700 con 0x7f91281c8040 2021-04-09T18:28:09.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f9126ffd700 1 -- 172.21.15.79:0/879286591 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912000bc20 con 0x7f91281c8040 2021-04-09T18:28:09.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f9126ffd700 1 -- 172.21.15.79:0/879286591 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9120002020 con 0x7f91281c8040 2021-04-09T18:28:09.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912e70b700 1 -- 172.21.15.79:0/879286591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91281c8040 msgr2=0x7f91281ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:09.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912e70b700 1 --2- 172.21.15.79:0/879286591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91281c8040 0x7f91281ca4a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f91200032b0 tx=0x7f912000b3c0).stop 2021-04-09T18:28:09.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912e70b700 1 -- 172.21.15.79:0/879286591 shutdown_connections 2021-04-09T18:28:09.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912e70b700 1 --2- 172.21.15.79:0/879286591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91281c8040 0x7f91281ca4a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:09.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912e70b700 1 --2- 172.21.15.79:0/879286591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91280e9b10 0x7f912809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:09.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912e70b700 1 -- 172.21.15.79:0/879286591 >> 172.21.15.79:0/879286591 conn(0x7f91280e6010 msgr2=0x7f91280e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:09.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912e70b700 1 -- 172.21.15.79:0/879286591 shutdown_connections 2021-04-09T18:28:09.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.254 7f912e70b700 1 -- 172.21.15.79:0/879286591 wait complete. 2021-04-09T18:28:09.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f912e70b700 1 Processor -- start 2021-04-09T18:28:09.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f912e70b700 1 -- start start 2021-04-09T18:28:09.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f912e70b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f912809a960 0x7f91280d67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:09.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f912e70b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91280d6e00 0x7f91280cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:09.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f912e70b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91280d00b0 0x7f91280a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:09.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f912e70b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9128088590 con 0x7f91280d6e00 2021-04-09T18:28:09.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f912e70b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912809b190 con 0x7f91280d00b0 2021-04-09T18:28:09.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f912e70b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912809b490 con 0x7f912809a960 2021-04-09T18:28:09.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f91277fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91280d6e00 0x7f91280cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:09.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f91277fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91280d6e00 0x7f91280cfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57362/0 (socket says 172.21.15.79:57362) 2021-04-09T18:28:09.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f91277fe700 1 -- 172.21.15.79:0/726438287 learned_addr learned my addr 172.21.15.79:0/726438287 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:09.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f9127fff700 1 --2- 172.21.15.79:0/726438287 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f912809a960 0x7f91280d67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:09.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f912ccb0700 1 --2- 172.21.15.79:0/726438287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91280d00b0 0x7f91280a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:09.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f91277fe700 1 -- 172.21.15.79:0/726438287 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f912809a960 msgr2=0x7f91280d67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:09.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f91277fe700 1 --2- 172.21.15.79:0/726438287 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f912809a960 0x7f91280d67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:09.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f91277fe700 1 -- 172.21.15.79:0/726438287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91280d00b0 msgr2=0x7f91280a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:09.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f91277fe700 1 --2- 172.21.15.79:0/726438287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91280d00b0 0x7f91280a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:09.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f91277fe700 1 -- 172.21.15.79:0/726438287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912809adb0 con 0x7f91280d6e00 2021-04-09T18:28:09.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f91277fe700 1 --2- 172.21.15.79:0/726438287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91280d6e00 0x7f91280cfa80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f911000a000 tx=0x7f911000dd20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:09.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f9124ff9700 1 -- 172.21.15.79:0/726438287 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f912809adb0 con 0x7f91280d6e00 2021-04-09T18:28:09.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f9124ff9700 1 -- 172.21.15.79:0/726438287 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91100098f0 con 0x7f91280d6e00 2021-04-09T18:28:09.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f912e70b700 1 -- 172.21.15.79:0/726438287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f912809a4c0 con 0x7f91280d6e00 2021-04-09T18:28:09.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f9124ff9700 1 -- 172.21.15.79:0/726438287 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f911000f040 con 0x7f91280d6e00 2021-04-09T18:28:09.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f912e70b700 1 -- 172.21.15.79:0/726438287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91280a4cd0 con 0x7f91280d6e00 2021-04-09T18:28:09.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f9124ff9700 1 -- 172.21.15.79:0/726438287 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9110009cc0 con 0x7f91280d6e00 2021-04-09T18:28:09.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.258 7f9124ff9700 1 --2- 172.21.15.79:0/726438287 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f910c029100 0x7f910c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:09.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.262 7f9124ff9700 1 -- 172.21.15.79:0/726438287 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f9110010070 con 0x7f91280d6e00 2021-04-09T18:28:09.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.262 7f9127fff700 1 --2- 172.21.15.79:0/726438287 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f910c029100 0x7f910c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:09.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.262 7f9127fff700 1 --2- 172.21.15.79:0/726438287 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f910c029100 0x7f910c02b650 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:09.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.266 7f912e70b700 1 -- 172.21.15.79:0/726438287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91280e39f0 con 0x7f91280d6e00 2021-04-09T18:28:09.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.274 7f9124ff9700 1 -- 172.21.15.79:0/726438287 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f91100094f0 con 0x7f91280d6e00 2021-04-09T18:28:09.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.454 7f912e70b700 1 -- 172.21.15.79:0/726438287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f91280f5b50 con 0x7f91280d6e00 2021-04-09T18:28:09.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.458 7f9124ff9700 1 -- 172.21.15.79:0/726438287 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9110000bf0 con 0x7f91280d6e00 2021-04-09T18:28:09.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.466 7f912e70b700 1 -- 172.21.15.79:0/726438287 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f910c029100 msgr2=0x7f910c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:09.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.466 7f912e70b700 1 --2- 172.21.15.79:0/726438287 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f910c029100 0x7f910c02b650 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:09.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.466 7f912e70b700 1 -- 172.21.15.79:0/726438287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91280d6e00 msgr2=0x7f91280cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:09.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.466 7f912e70b700 1 --2- 172.21.15.79:0/726438287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91280d6e00 0x7f91280cfa80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f911000a000 tx=0x7f911000dd20).stop 2021-04-09T18:28:09.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.466 7f912e70b700 1 -- 172.21.15.79:0/726438287 shutdown_connections 2021-04-09T18:28:09.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.466 7f912e70b700 1 --2- 172.21.15.79:0/726438287 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f910c029100 0x7f910c02b650 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:09.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.466 7f912e70b700 1 --2- 172.21.15.79:0/726438287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91280d00b0 0x7f91280a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:09.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.466 7f912e70b700 1 --2- 172.21.15.79:0/726438287 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f912809a960 0x7f91280d67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:09.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.466 7f912e70b700 1 --2- 172.21.15.79:0/726438287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91280d6e00 0x7f91280cfa80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:09.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.466 7f912e70b700 1 -- 172.21.15.79:0/726438287 >> 172.21.15.79:0/726438287 conn(0x7f9128093ff0 msgr2=0x7f91280d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:09.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.466 7f912e70b700 1 -- 172.21.15.79:0/726438287 shutdown_connections 2021-04-09T18:28:09.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.466 7f912e70b700 1 -- 172.21.15.79:0/726438287 wait complete. 2021-04-09T18:28:09.484 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:28:09.485 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:28:09.497 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:28:09.516 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:28:09.534 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:28:09.552 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:28:09.572 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:28:09.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:28:09.573 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:28:09.573 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:28:09.581 INFO:teuthology.orchestra.run.smithi090.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-04-09T18:28:09.582 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:28:09.583 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-04-09T18:28:09.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:28:09.584 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:28:09.584 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:28:09.601 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-04-09T18:28:09.602 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:28:09.602 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-04-09T18:28:09.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:28:09.603 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:28:09.604 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:28:09.621 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:28:09.622 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:28:09.623 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:28:09.624 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:28:09.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.718 7fd190f78700 1 Processor -- start 2021-04-09T18:28:09.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.718 7fd190f78700 1 -- start start 2021-04-09T18:28:09.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.722 7fd190f78700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd18c0e9ae0 0x7fd18c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:09.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.722 7fd190f78700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd18c0fbb20 con 0x7fd18c1c8010 2021-04-09T18:28:09.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.722 7fd190f78700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd18c0e56d0 con 0x7fd18c0f5520 2021-04-09T18:28:09.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.722 7fd190f78700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c1c3dc0 con 0x7fd18c0e9ae0 2021-04-09T18:28:09.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.722 7fd18b2f0700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd18c1c8010 0x7fd18c1ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52082/0 (socket says 172.21.15.79:52082) 2021-04-09T18:28:09.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.722 7fd18b2f0700 1 -- 172.21.15.79:0/527122141 learned_addr learned my addr 172.21.15.79:0/527122141 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:28:09.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.722 7fd18a2ee700 1 --2- 172.21.15.79:0/527122141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd18c0e9ae0 0x7fd18c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:09.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.722 7fd189aed700 1 -- 172.21.15.79:0/527122141 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531773709 0 0) 0x7fd184001450 con 0x7fd18c1c8010 2021-04-09T18:28:09.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.722 7fd189aed700 1 -- 172.21.15.79:0/527122141 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd174003240 con 0x7fd18c1c8010 2021-04-09T18:28:09.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.722 7fd189aed700 1 -- 172.21.15.79:0/527122141 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269896981 0 0) 0x7fd17c0010d0 con 0x7fd18c0f5520 2021-04-09T18:28:09.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.722 7fd189aed700 1 -- 172.21.15.79:0/527122141 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd174003620 con 0x7fd18c0f5520 2021-04-09T18:28:09.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.722 7fd18a2ee700 1 -- 172.21.15.79:0/527122141 >> v1:172.21.15.89:6789/0 conn(0x7fd18c0f5520 legacy=0x7fd18c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:09.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.722 7fd18a2ee700 1 -- 172.21.15.79:0/527122141 >> v1:172.21.15.79:6789/0 conn(0x7fd18c1c8010 legacy=0x7fd18c1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:09.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.722 7fd18a2ee700 1 -- 172.21.15.79:0/527122141 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c0e4330 con 0x7fd18c0e9ae0 2021-04-09T18:28:09.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.722 7fd18a2ee700 1 --2- 172.21.15.79:0/527122141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd18c0e9ae0 0x7fd18c09f110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd180002f30 tx=0x7fd18000bcf0).ready entity=mon.2 client_cookie=fd5c4036718a4946 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:09.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.722 7fd189aed700 1 -- 172.21.15.79:0/527122141 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd18c0e4330 con 0x7fd18c0e9ae0 2021-04-09T18:28:09.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.722 7fd189aed700 1 -- 172.21.15.79:0/527122141 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd180009920 con 0x7fd18c0e9ae0 2021-04-09T18:28:09.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.722 7fd189aed700 1 -- 172.21.15.79:0/527122141 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd180009cf0 con 0x7fd18c0e9ae0 2021-04-09T18:28:09.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.722 7fd190f78700 1 -- 172.21.15.79:0/527122141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd18c0e9ae0 msgr2=0x7fd18c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:09.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.722 7fd190f78700 1 --2- 172.21.15.79:0/527122141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd18c0e9ae0 0x7fd18c09f110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd180002f30 tx=0x7fd18000bcf0).stop 2021-04-09T18:28:09.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.726 7fd190f78700 1 -- 172.21.15.79:0/527122141 shutdown_connections 2021-04-09T18:28:09.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.726 7fd190f78700 1 --2- 172.21.15.79:0/527122141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd18c0e9ae0 0x7fd18c09f110 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:09.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.726 7fd190f78700 1 -- 172.21.15.79:0/527122141 >> 172.21.15.79:0/527122141 conn(0x7fd18c0e5fe0 msgr2=0x7fd18c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:09.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.726 7fd190f78700 1 -- 172.21.15.79:0/527122141 shutdown_connections 2021-04-09T18:28:09.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.726 7fd190f78700 1 -- 172.21.15.79:0/527122141 wait complete. 2021-04-09T18:28:09.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.730 7fd190f78700 1 Processor -- start 2021-04-09T18:28:09.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.730 7fd190f78700 1 -- start start 2021-04-09T18:28:09.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.730 7fd190f78700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd18c0d4f10 0x7fd18c0d6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:09.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.730 7fd190f78700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18c091150 0x7fd18c0915a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:09.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.730 7fd190f78700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd18c0ce6e0 0x7fd18c0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:09.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.730 7fd190f78700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0e9f30 con 0x7fd18c091150 2021-04-09T18:28:09.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.730 7fd190f78700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c090e50 con 0x7fd18c0ce6e0 2021-04-09T18:28:09.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.730 7fd190f78700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0d6d50 con 0x7fd18c0d4f10 2021-04-09T18:28:09.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.730 7fd18a2ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18c091150 0x7fd18c0915a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:09.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.730 7fd18a2ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18c091150 0x7fd18c0915a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57376/0 (socket says 172.21.15.79:57376) 2021-04-09T18:28:09.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.730 7fd18a2ee700 1 -- 172.21.15.79:0/2976396950 learned_addr learned my addr 172.21.15.79:0/2976396950 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:09.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.730 7fd18aaef700 1 --2- 172.21.15.79:0/2976396950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd18c0d4f10 0x7fd18c0d6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:09.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.730 7fd18b2f0700 1 --2- 172.21.15.79:0/2976396950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd18c0ce6e0 0x7fd18c0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:09.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.730 7fd18a2ee700 1 -- 172.21.15.79:0/2976396950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd18c0d4f10 msgr2=0x7fd18c0d6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:09.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.730 7fd18a2ee700 1 --2- 172.21.15.79:0/2976396950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd18c0d4f10 0x7fd18c0d6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:09.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.730 7fd18a2ee700 1 -- 172.21.15.79:0/2976396950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd18c0ce6e0 msgr2=0x7fd18c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:09.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.730 7fd18a2ee700 1 --2- 172.21.15.79:0/2976396950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd18c0ce6e0 0x7fd18c0ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:09.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.730 7fd18a2ee700 1 -- 172.21.15.79:0/2976396950 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c0cf160 con 0x7fd18c091150 2021-04-09T18:28:09.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.730 7fd18a2ee700 1 --2- 172.21.15.79:0/2976396950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18c091150 0x7fd18c0915a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fd180002f30 tx=0x7fd180006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:09.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.730 7fd17b7fe700 1 -- 172.21.15.79:0/2976396950 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd18c0cf160 con 0x7fd18c091150 2021-04-09T18:28:09.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.734 7fd17b7fe700 1 -- 172.21.15.79:0/2976396950 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd180011c70 con 0x7fd18c091150 2021-04-09T18:28:09.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.734 7fd190f78700 1 -- 172.21.15.79:0/2976396950 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18c091c80 con 0x7fd18c091150 2021-04-09T18:28:09.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.734 7fd17b7fe700 1 -- 172.21.15.79:0/2976396950 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd18001d670 con 0x7fd18c091150 2021-04-09T18:28:09.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.734 7fd190f78700 1 -- 172.21.15.79:0/2976396950 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18c0d56e0 con 0x7fd18c091150 2021-04-09T18:28:09.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.734 7fd17b7fe700 1 -- 172.21.15.79:0/2976396950 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd18001c3e0 con 0x7fd18c091150 2021-04-09T18:28:09.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.734 7fd17b7fe700 1 --2- 172.21.15.79:0/2976396950 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd170029100 0x7fd17002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:09.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.734 7fd17b7fe700 1 -- 172.21.15.79:0/2976396950 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5190+0+0 (secure 0 0 0) 0x7fd18003ac90 con 0x7fd18c091150 2021-04-09T18:28:09.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.734 7fd18aaef700 1 --2- 172.21.15.79:0/2976396950 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd170029100 0x7fd17002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:09.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.734 7fd18aaef700 1 --2- 172.21.15.79:0/2976396950 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd170029100 0x7fd17002b650 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:09.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.750 7fd190f78700 1 -- 172.21.15.79:0/2976396950 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18c0e39e0 con 0x7fd18c091150 2021-04-09T18:28:09.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.758 7fd17b7fe700 1 -- 172.21.15.79:0/2976396950 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd180000bf0 con 0x7fd18c091150 2021-04-09T18:28:09.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.930 7fd190f78700 1 -- 172.21.15.79:0/2976396950 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd18c0a1cc0 con 0x7fd18c091150 2021-04-09T18:28:09.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.930 7fd17b7fe700 1 -- 172.21.15.79:0/2976396950 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v34) v1 ==== 81+0+25932 (secure 0 0 0) 0x7fd180011a60 con 0x7fd18c091150 2021-04-09T18:28:09.937 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:28:09.937 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:28:09.937 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 34, 2021-04-09T18:28:09.938 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:28:09.938 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:28:09.938 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:28:07.072876", 2021-04-09T18:28:09.938 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:28:09.939 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:28:09.939 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:28:09.939 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:28:09.939 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:28:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:28:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:28:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:28:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:28:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:28:09.941 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:28:09.941 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:28:09.941 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:28:09.941 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:28:09.941 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:28:09.942 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 5, 2021-04-09T18:28:09.942 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:28:09.942 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:28:09.942 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:28:09.943 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:28:09.943 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:28:09.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.943 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:28:09.944 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:28:09.944 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:28:09.944 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:28:09.944 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:28:09.944 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:28:09.945 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:28:09.945 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:28:09.945 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:28:09.945 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:28:09.945 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:28:09.946 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:28:09.946 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:28:09.946 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:28:09.946 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:28:09.946 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:28:09.947 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:28:09.947 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:28:09.947 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:28:09.947 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:28:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:28:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:28:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:28:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:28:09.949 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:28:09.949 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:28:09.949 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:28:09.949 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:28:09.949 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:28:09.950 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:28:09.950 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:28:09.950 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:28:09.950 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:28:09.950 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:28:09.951 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:28:09.951 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:28:09.951 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:28:09.951 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:28:09.952 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:28:09.952 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:28:09.952 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:28:09.952 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:28:09.952 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:28:09.953 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:28:09.953 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:28:09.953 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:28:09.953 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:28:09.953 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:28:09.954 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:28:09.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:28:09.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.954 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:28:09.954 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:28:09.955 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:28:09.955 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:28:09.955 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:28:09.955 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:28:09.955 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:28:09.956 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:28:09.956 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:28:09.956 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:28:09.956 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:28:09.957 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:28:09.957 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:28:09.957 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:28:09.957 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:09.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:09.958 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:28:09.958 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:28:09.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.959 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:28:09.959 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:28:09.959 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:28:09.959 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:28:09.959 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:28:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:28:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:28:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:28:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:28:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 29, 2021-04-09T18:28:09.961 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:28:09.961 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:28:09.961 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:28:09.961 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:09.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.962 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:09.962 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:28:09.962 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:28:09.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.963 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:09.963 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:28:09.963 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:28:09.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:09.964 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:09.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.964 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:28:09.964 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:09.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:09.965 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:28:09.965 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:28:09.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.966 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:09.966 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:28:09.966 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:28:09.966 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:09.966 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:09.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.967 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:28:09.967 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:09.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.968 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:09.968 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:28:09.968 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:28:09.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:28:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:28:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:09.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.970 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:28:09.970 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:09.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.971 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:09.971 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:28:09.971 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:28:09.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:28:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:28:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:28:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:28:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:28:09.974 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:28:09.974 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:28:09.974 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:28:09.974 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:28:09.975 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:09.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.975 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:28:09.976 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:28:09.976 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:28:09.976 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:28:09.976 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:28:09.976 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:28:09.977 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:28:09.977 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:28:09.977 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:28:09.977 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 28, 2021-04-09T18:28:09.978 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:28:09.978 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:28:09.978 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:28:09.978 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:09.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.979 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:09.979 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:28:09.979 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:28:09.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.980 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:09.980 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:28:09.980 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:28:09.980 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:09.981 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:09.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.981 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:28:09.981 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:09.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.982 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:09.982 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:28:09.982 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:28:09.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.983 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:09.983 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:28:09.983 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:28:09.983 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:09.984 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:09.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.984 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:28:09.984 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:09.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:09.985 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:28:09.985 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:28:09.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.986 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:09.986 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:28:09.986 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:28:09.986 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:09.987 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:09.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.987 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:28:09.987 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:09.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.988 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:09.988 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:28:09.988 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:28:09.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.989 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:09.989 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:28:09.989 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:28:09.989 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:28:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:28:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:28:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:28:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:28:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:28:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:28:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:28:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:28:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:28:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:28:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:28:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:28:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:28:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:28:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:28:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 29, 2021-04-09T18:28:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:28:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:28:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:28:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:28:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:28:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:28:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:28:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:28:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:28:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:28:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:28:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:28:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:28:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:28:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:28:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:28:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:28:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:28:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:28:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:28:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:28:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:28:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:28:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:28:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:28:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:28:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:28:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:28:10.008 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:28:10.008 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.008 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:28:10.009 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:28:10.009 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:28:10.009 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:28:10.009 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:28:10.009 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:28:10.010 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:28:10.010 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:28:10.010 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:28:10.010 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 29, 2021-04-09T18:28:10.010 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:28:10.011 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:28:10.011 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:28:10.011 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.011 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.012 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:28:10.012 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:28:10.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.013 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.013 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:28:10.013 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:28:10.013 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.013 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.014 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:28:10.014 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.014 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.015 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:28:10.015 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:28:10.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.015 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.016 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:28:10.016 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:28:10.016 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.016 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.017 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:28:10.017 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.017 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.018 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:28:10.018 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:28:10.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.018 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.019 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:28:10.019 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:28:10.019 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.019 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.020 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:28:10.020 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.020 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.020 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:28:10.021 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:28:10.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.021 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.022 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:28:10.022 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:28:10.022 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.022 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.023 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:28:10.023 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:28:10.023 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:28:10.023 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:28:10.024 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:28:10.024 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:28:10.024 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:28:10.024 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.025 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:28:10.025 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:28:10.025 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:28:10.026 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:28:10.026 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:28:10.026 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:28:10.026 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:28:10.026 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:28:10.027 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:28:10.027 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 29, 2021-04-09T18:28:10.027 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:28:10.027 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:28:10.027 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:28:10.028 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.028 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.028 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:28:10.029 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:28:10.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.029 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.029 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:28:10.030 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:28:10.030 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.030 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.030 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:28:10.031 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.031 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.031 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:28:10.031 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:28:10.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.032 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.032 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:28:10.032 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:28:10.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.033 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.033 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:28:10.033 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.034 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.034 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:28:10.034 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:28:10.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.035 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.035 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:28:10.035 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:28:10.036 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.036 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.036 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:28:10.036 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.037 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.037 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:28:10.037 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:28:10.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.038 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.038 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:28:10.038 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:28:10.039 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.039 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.039 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:28:10.039 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:28:10.040 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:28:10.040 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:28:10.040 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:28:10.040 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:28:10.041 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:28:10.041 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.041 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:28:10.042 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:28:10.042 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:28:10.042 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:28:10.042 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:28:10.042 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:28:10.043 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:28:10.043 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:28:10.043 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:28:10.043 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 29, 2021-04-09T18:28:10.043 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:28:10.044 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:28:10.044 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:28:10.044 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.044 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.045 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:28:10.045 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:28:10.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.046 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.046 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:28:10.046 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:28:10.046 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.046 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.047 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:28:10.047 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.047 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.048 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:28:10.048 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:28:10.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.049 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.049 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:28:10.049 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:28:10.049 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.049 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.050 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:28:10.050 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.050 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.051 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:28:10.051 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:28:10.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.051 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.052 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:28:10.052 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:28:10.052 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.052 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.053 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:28:10.053 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.053 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.054 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:28:10.054 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:28:10.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.054 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.055 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:28:10.055 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:28:10.055 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.055 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.056 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:28:10.056 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:28:10.056 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:28:10.056 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:28:10.057 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:28:10.057 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:28:10.057 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:28:10.058 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.058 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:28:10.058 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:28:10.059 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:28:10.059 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:28:10.059 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:28:10.059 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:28:10.060 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:28:10.060 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:28:10.060 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:28:10.060 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 29, 2021-04-09T18:28:10.060 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:28:10.061 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:28:10.061 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:28:10.061 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.061 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.062 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:28:10.062 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:28:10.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.062 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.063 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:28:10.063 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:28:10.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.063 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.064 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:28:10.064 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.064 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.065 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:28:10.065 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:28:10.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.065 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.066 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:28:10.066 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:28:10.066 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.066 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.067 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:28:10.067 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.067 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.068 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:28:10.068 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:28:10.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.068 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.069 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:28:10.069 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:28:10.069 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.069 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.070 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:28:10.070 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.070 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.071 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:28:10.071 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:28:10.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.072 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.072 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:28:10.073 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:28:10.073 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.073 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.074 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:28:10.074 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:28:10.075 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:28:10.075 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:28:10.076 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:28:10.076 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:28:10.076 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:28:10.077 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.078 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:28:10.078 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:28:10.078 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:28:10.079 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:28:10.079 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:28:10.080 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:28:10.080 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:28:10.080 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:28:10.081 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:28:10.081 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 29, 2021-04-09T18:28:10.081 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:28:10.082 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:28:10.082 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:28:10.082 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.083 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.084 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:28:10.084 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:28:10.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.085 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.085 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:28:10.086 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:28:10.086 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.086 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.087 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:28:10.088 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.088 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.089 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:28:10.089 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:28:10.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.090 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.090 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:28:10.091 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:28:10.091 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.091 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.092 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:28:10.093 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.093 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.094 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:28:10.094 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:28:10.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.095 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.095 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:28:10.096 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:28:10.096 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.096 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.097 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:28:10.098 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:28:10.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.098 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:28:10.099 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:28:10.099 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:28:10.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.100 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:28:10.100 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:28:10.101 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:28:10.101 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.102 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.102 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:28:10.103 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:28:10.103 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:28:10.103 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:28:10.104 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:28:10.104 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:28:10.104 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:28:10.105 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:10.105 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.106 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:28:10.106 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:28:10.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.107 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:28:10.107 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:28:10.108 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:28:10.108 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:28:10.108 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:28:10.109 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:28:10.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.110 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:28:10.110 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:28:10.111 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:28:10.111 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:28:10.112 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:28:10.112 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:28:10.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.113 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:28:10.114 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:28:10.114 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:28:10.115 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:28:10.115 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:28:10.115 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:28:10.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.117 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:28:10.117 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:28:10.117 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:28:10.118 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:28:10.118 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:28:10.119 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:28:10.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.120 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:28:10.120 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:28:10.120 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:28:10.120 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:28:10.121 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:28:10.121 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:28:10.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.121 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:28:10.122 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:28:10.122 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:28:10.122 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:28:10.122 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:28:10.122 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:28:10.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.123 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:28:10.123 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:28:10.123 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:28:10.124 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:28:10.124 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:28:10.124 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:28:10.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:10.125 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:28:10.125 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:28:10.125 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:28:10.125 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:28:10.125 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:28:10.126 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:28:10.126 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.126 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:28:10.126 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:28:10.127 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:28:10.127 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:28:10.127 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:28:10.127 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": { 2021-04-09T18:28:10.127 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6835/3906387944": "2021-04-10 18:28:03.057537", 2021-04-09T18:28:10.128 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6834/3906387944": "2021-04-10 18:28:03.057537" 2021-04-09T18:28:10.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.128 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:28:10.128 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:28:10.128 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:28:10.129 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:28:10.129 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:28:10.129 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:28:10.129 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:28:10.129 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:28:10.130 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:28:10.130 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:28:10.130 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:28:10.130 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:28:10.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.131 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:28:10.131 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:28:10.131 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:28:10.131 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:28:10.131 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:28:10.132 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:28:10.132 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:28:10.132 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:10.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:10.132 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:28:10.133 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:28:10.133 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:28:10.133 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:28:10.133 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:28:10.133 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:28:10.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.934 7fd190f78700 1 -- 172.21.15.79:0/2976396950 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd170029100 msgr2=0x7fd17002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.934 7fd190f78700 1 --2- 172.21.15.79:0/2976396950 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd170029100 0x7fd17002b650 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.934 7fd190f78700 1 -- 172.21.15.79:0/2976396950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18c091150 msgr2=0x7fd18c0915a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.934 7fd190f78700 1 --2- 172.21.15.79:0/2976396950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18c091150 0x7fd18c0915a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fd180002f30 tx=0x7fd180006890).stop 2021-04-09T18:28:10.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.934 7fd190f78700 1 -- 172.21.15.79:0/2976396950 shutdown_connections 2021-04-09T18:28:10.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.934 7fd190f78700 1 --2- 172.21.15.79:0/2976396950 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd170029100 0x7fd17002b650 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.934 7fd190f78700 1 --2- 172.21.15.79:0/2976396950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd18c0ce6e0 0x7fd18c0ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.934 7fd190f78700 1 --2- 172.21.15.79:0/2976396950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd18c0d4f10 0x7fd18c0d6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.934 7fd190f78700 1 --2- 172.21.15.79:0/2976396950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18c091150 0x7fd18c0915a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.934 7fd190f78700 1 -- 172.21.15.79:0/2976396950 >> 172.21.15.79:0/2976396950 conn(0x7fd18c0d8310 msgr2=0x7fd18c092d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:10.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.934 7fd190f78700 1 -- 172.21.15.79:0/2976396950 shutdown_connections 2021-04-09T18:28:10.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:09.934 7fd190f78700 1 -- 172.21.15.79:0/2976396950 wait complete. 2021-04-09T18:28:10.138 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:10.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f3669130700 1 Processor -- start 2021-04-09T18:28:10.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f3669130700 1 -- start start 2021-04-09T18:28:10.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f3669130700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f36640e9ae0 0x7f366409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f3669130700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36641c8010 0x7f36641ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f3669130700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36640fbb20 con 0x7f36640f5520 2021-04-09T18:28:10.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f3669130700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36641c3dc0 con 0x7f36640e9ae0 2021-04-09T18:28:10.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f3669130700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36640e9f30 con 0x7f36641c8010 2021-04-09T18:28:10.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f366259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f36640e9ae0 0x7f366409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f366259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f36640e9ae0 0x7f366409f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57384/0 (socket says 172.21.15.79:57384) 2021-04-09T18:28:10.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f366259c700 1 -- 172.21.15.79:0/3587071 learned_addr learned my addr 172.21.15.79:0/3587071 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:10.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f366359e700 1 --2- 172.21.15.79:0/3587071 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36641c8010 0x7f36641ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f366259c700 1 -- 172.21.15.79:0/3587071 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36641c8010 msgr2=0x7f36641ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:10.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f366259c700 1 --2- 172.21.15.79:0/3587071 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36641c8010 0x7f36641ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f366259c700 1 -- 172.21.15.79:0/3587071 >> v1:172.21.15.89:6789/0 conn(0x7f36640f5520 legacy=0x7f36640f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f366259c700 1 -- 172.21.15.79:0/3587071 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36640e56d0 con 0x7f36640e9ae0 2021-04-09T18:28:10.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f366259c700 1 --2- 172.21.15.79:0/3587071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36640e9ae0 0x7f366409f110 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f36640f6f00 tx=0x7f365800bdd0).ready entity=mon.0 client_cookie=f5922acfc82c9e28 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:10.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f3661d9b700 1 -- 172.21.15.79:0/3587071 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f36640e56d0 con 0x7f36640e9ae0 2021-04-09T18:28:10.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f3661d9b700 1 -- 172.21.15.79:0/3587071 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3658009990 con 0x7f36640e9ae0 2021-04-09T18:28:10.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f3661d9b700 1 -- 172.21.15.79:0/3587071 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3658009d60 con 0x7f36640e9ae0 2021-04-09T18:28:10.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f3669130700 1 -- 172.21.15.79:0/3587071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36640e9ae0 msgr2=0x7f366409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.230 7f3669130700 1 --2- 172.21.15.79:0/3587071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36640e9ae0 0x7f366409f110 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f36640f6f00 tx=0x7f365800bdd0).stop 2021-04-09T18:28:10.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.234 7f3669130700 1 -- 172.21.15.79:0/3587071 shutdown_connections 2021-04-09T18:28:10.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.234 7f3669130700 1 --2- 172.21.15.79:0/3587071 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36641c8010 0x7f36641ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.234 7f3669130700 1 --2- 172.21.15.79:0/3587071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36640e9ae0 0x7f366409f110 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.234 7f3669130700 1 -- 172.21.15.79:0/3587071 >> 172.21.15.79:0/3587071 conn(0x7f36640e5fe0 msgr2=0x7f36640e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:10.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.234 7f3669130700 1 -- 172.21.15.79:0/3587071 shutdown_connections 2021-04-09T18:28:10.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.234 7f3669130700 1 -- 172.21.15.79:0/3587071 wait complete. 2021-04-09T18:28:10.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.234 7f3669130700 1 Processor -- start 2021-04-09T18:28:10.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.234 7f3669130700 1 -- start start 2021-04-09T18:28:10.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.234 7f3669130700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3664094f00 0x7f36641a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.234 7f3669130700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36640cfff0 0x7f36640d0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.234 7f3669130700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36640a8c90 0x7f36640a90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.234 7f3669130700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3664095670 con 0x7f36640cfff0 2021-04-09T18:28:10.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.234 7f3669130700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3664095350 con 0x7f36640a8c90 2021-04-09T18:28:10.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.234 7f3669130700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36641a4770 con 0x7f3664094f00 2021-04-09T18:28:10.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.238 7f366259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36640cfff0 0x7f36640d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.238 7f366259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36640cfff0 0x7f36640d0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57390/0 (socket says 172.21.15.79:57390) 2021-04-09T18:28:10.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.238 7f366259c700 1 -- 172.21.15.79:0/3065491716 learned_addr learned my addr 172.21.15.79:0/3065491716 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:10.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.238 7f366359e700 1 --2- 172.21.15.79:0/3065491716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36640a8c90 0x7f36640a90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.238 7f3662d9d700 1 --2- 172.21.15.79:0/3065491716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3664094f00 0x7f36641a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.238 7f366259c700 1 -- 172.21.15.79:0/3065491716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3664094f00 msgr2=0x7f36641a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.238 7f366259c700 1 --2- 172.21.15.79:0/3065491716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3664094f00 0x7f36641a4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.238 7f366259c700 1 -- 172.21.15.79:0/3065491716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36640a8c90 msgr2=0x7f36640a90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.238 7f366259c700 1 --2- 172.21.15.79:0/3065491716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36640a8c90 0x7f36640a90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.238 7f366259c700 1 -- 172.21.15.79:0/3065491716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3664095970 con 0x7f36640cfff0 2021-04-09T18:28:10.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.238 7f366259c700 1 --2- 172.21.15.79:0/3065491716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36640cfff0 0x7f36640d0440 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f36640955f0 tx=0x7f3658006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:10.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.238 7f36537fe700 1 -- 172.21.15.79:0/3065491716 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3664095970 con 0x7f36640cfff0 2021-04-09T18:28:10.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.238 7f36537fe700 1 -- 172.21.15.79:0/3065491716 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365801d550 con 0x7f36640cfff0 2021-04-09T18:28:10.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.238 7f3669130700 1 -- 172.21.15.79:0/3065491716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36641a5410 con 0x7f36640cfff0 2021-04-09T18:28:10.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.238 7f36537fe700 1 -- 172.21.15.79:0/3065491716 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f365801d920 con 0x7f36640cfff0 2021-04-09T18:28:10.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.238 7f3669130700 1 -- 172.21.15.79:0/3065491716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36640a9710 con 0x7f36640cfff0 2021-04-09T18:28:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.238 7f36537fe700 1 -- 172.21.15.79:0/3065491716 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f365801db20 con 0x7f36640cfff0 2021-04-09T18:28:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.238 7f36537fe700 1 --2- 172.21.15.79:0/3065491716 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3648029100 0x7f364802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.238 7f36537fe700 1 -- 172.21.15.79:0/3065491716 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f365803ded0 con 0x7f36640cfff0 2021-04-09T18:28:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.238 7f3662d9d700 1 --2- 172.21.15.79:0/3065491716 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3648029100 0x7f364802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.242 7f3662d9d700 1 --2- 172.21.15.79:0/3065491716 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3648029100 0x7f364802b650 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:10.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.246 7f3669130700 1 -- 172.21.15.79:0/3065491716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36640e39e0 con 0x7f36640cfff0 2021-04-09T18:28:10.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.254 7f36537fe700 1 -- 172.21.15.79:0/3065491716 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3658011c50 con 0x7f36640cfff0 2021-04-09T18:28:10.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.422 7f3669130700 1 -- 172.21.15.79:0/3065491716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f366409a040 con 0x7f36640cfff0 2021-04-09T18:28:10.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.422 7f36537fe700 1 -- 172.21.15.79:0/3065491716 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+1173 (secure 0 0 0) 0x7f3658009780 con 0x7f36640cfff0 2021-04-09T18:28:10.430 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:28:10.430 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":14,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3417656822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3417656822},{"type":"v1","addr":"172.21.15.79:6833","nonce":3417656822}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":9},{"gid":5143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/468851998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":468851998},{"type":"v1","addr":"172.21.15.89:6835","nonce":468851998}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":14}],"filesystems":[]} 2021-04-09T18:28:10.430 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 14 2021-04-09T18:28:10.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.426 7f3669130700 1 -- 172.21.15.79:0/3065491716 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3648029100 msgr2=0x7f364802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.426 7f3669130700 1 --2- 172.21.15.79:0/3065491716 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3648029100 0x7f364802b650 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.426 7f3669130700 1 -- 172.21.15.79:0/3065491716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36640cfff0 msgr2=0x7f36640d0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.426 7f3669130700 1 --2- 172.21.15.79:0/3065491716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36640cfff0 0x7f36640d0440 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f36640955f0 tx=0x7f3658006890).stop 2021-04-09T18:28:10.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.426 7f3669130700 1 -- 172.21.15.79:0/3065491716 shutdown_connections 2021-04-09T18:28:10.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.426 7f3669130700 1 --2- 172.21.15.79:0/3065491716 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3648029100 0x7f364802b650 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.426 7f3669130700 1 --2- 172.21.15.79:0/3065491716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36640a8c90 0x7f36640a90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.426 7f3669130700 1 --2- 172.21.15.79:0/3065491716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3664094f00 0x7f36641a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.426 7f3669130700 1 --2- 172.21.15.79:0/3065491716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36640cfff0 0x7f36640d0440 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.426 7f3669130700 1 -- 172.21.15.79:0/3065491716 >> 172.21.15.79:0/3065491716 conn(0x7f36640bafb0 msgr2=0x7f36640937e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:10.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.426 7f3669130700 1 -- 172.21.15.79:0/3065491716 shutdown_connections 2021-04-09T18:28:10.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.426 7f3669130700 1 -- 172.21.15.79:0/3065491716 wait complete. 2021-04-09T18:28:10.442 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:10.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9eeba06700 1 Processor -- start 2021-04-09T18:28:10.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9eeba06700 1 -- start start 2021-04-09T18:28:10.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9eeba06700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9ee40f5510 0x7f9ee40f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9eeba06700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee40fbb10 con 0x7f9ee41c8000 2021-04-09T18:28:10.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9eeba06700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee409f900 con 0x7f9ee40e9ad0 2021-04-09T18:28:10.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9eeba06700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee40e9f20 con 0x7f9ee40f5510 2021-04-09T18:28:10.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9ee9fab700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9ee41c8000 0x7f9ee41ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52110/0 (socket says 172.21.15.79:52110) 2021-04-09T18:28:10.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9ee9fab700 1 -- 172.21.15.79:0/1868112460 learned_addr learned my addr 172.21.15.79:0/1868112460 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:28:10.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9ee97aa700 1 --2- 172.21.15.79:0/1868112460 >> v2:172.21.15.89:3300/0 conn(0x7f9ee40f5510 0x7f9ee40f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9edbfff700 1 -- 172.21.15.79:0/1868112460 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1169770267 0 0) 0x7f9edc001450 con 0x7f9ee41c8000 2021-04-09T18:28:10.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9edbfff700 1 -- 172.21.15.79:0/1868112460 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ed0003240 con 0x7f9ee41c8000 2021-04-09T18:28:10.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9ee97aa700 1 -- 172.21.15.79:0/1868112460 >> v1:172.21.15.89:6789/0 conn(0x7f9ee40e9ad0 legacy=0x7f9ee409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9ee97aa700 1 -- 172.21.15.79:0/1868112460 >> v1:172.21.15.79:6789/0 conn(0x7f9ee41c8000 legacy=0x7f9ee41ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9edbfff700 1 -- 172.21.15.79:0/1868112460 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1463628179 0 0) 0x7f9edc0019d0 con 0x7f9ee41c8000 2021-04-09T18:28:10.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9ee97aa700 1 -- 172.21.15.79:0/1868112460 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee40e56c0 con 0x7f9ee40f5510 2021-04-09T18:28:10.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9ee97aa700 1 --2- 172.21.15.79:0/1868112460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee40f5510 0x7f9ee40f64a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f9edc002170 tx=0x7f9ee000bcc0).ready entity=mon.1 client_cookie=a4a41a2410d2b07a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:10.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9edbfff700 1 -- 172.21.15.79:0/1868112460 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9ee40e56c0 con 0x7f9ee40f5510 2021-04-09T18:28:10.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9edbfff700 1 -- 172.21.15.79:0/1868112460 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee00096c0 con 0x7f9ee40f5510 2021-04-09T18:28:10.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9edbfff700 1 -- 172.21.15.79:0/1868112460 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9edc001f30 con 0x7f9ee40f5510 2021-04-09T18:28:10.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9eeba06700 1 -- 172.21.15.79:0/1868112460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee40f5510 msgr2=0x7f9ee40f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9eeba06700 1 --2- 172.21.15.79:0/1868112460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee40f5510 0x7f9ee40f64a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f9edc002170 tx=0x7f9ee000bcc0).stop 2021-04-09T18:28:10.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9eeba06700 1 -- 172.21.15.79:0/1868112460 shutdown_connections 2021-04-09T18:28:10.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9eeba06700 1 --2- 172.21.15.79:0/1868112460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee40f5510 0x7f9ee40f64a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9eeba06700 1 -- 172.21.15.79:0/1868112460 >> 172.21.15.79:0/1868112460 conn(0x7f9ee40e5fd0 msgr2=0x7f9ee40e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:10.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9eeba06700 1 -- 172.21.15.79:0/1868112460 shutdown_connections 2021-04-09T18:28:10.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.530 7f9eeba06700 1 -- 172.21.15.79:0/1868112460 wait complete. 2021-04-09T18:28:10.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.534 7f9eeba06700 1 Processor -- start 2021-04-09T18:28:10.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.534 7f9eeba06700 1 -- start start 2021-04-09T18:28:10.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.534 7f9eeba06700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ee41b1710 0x7f9ee40d5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.534 7f9eeba06700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ee40d5650 0x7f9ee4097b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9eeba06700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee40a41f0 0x7f9ee4098190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9eeba06700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee41c3db0 con 0x7f9ee41b1710 2021-04-09T18:28:10.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9eeba06700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40aff80 con 0x7f9ee40a41f0 2021-04-09T18:28:10.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9eeba06700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40d5aa0 con 0x7f9ee40d5650 2021-04-09T18:28:10.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9ee97aa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ee41b1710 0x7f9ee40d5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9ee97aa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ee41b1710 0x7f9ee40d5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57402/0 (socket says 172.21.15.79:57402) 2021-04-09T18:28:10.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9ee97aa700 1 -- 172.21.15.79:0/953336426 learned_addr learned my addr 172.21.15.79:0/953336426 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:10.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9ee9fab700 1 --2- 172.21.15.79:0/953336426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee40a41f0 0x7f9ee4098190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9ee8fa9700 1 --2- 172.21.15.79:0/953336426 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ee40d5650 0x7f9ee4097b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9ee97aa700 1 -- 172.21.15.79:0/953336426 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ee40d5650 msgr2=0x7f9ee4097b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9ee97aa700 1 --2- 172.21.15.79:0/953336426 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ee40d5650 0x7f9ee4097b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9ee97aa700 1 -- 172.21.15.79:0/953336426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee40a41f0 msgr2=0x7f9ee4098190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9ee97aa700 1 --2- 172.21.15.79:0/953336426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee40a41f0 0x7f9ee4098190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9ee97aa700 1 -- 172.21.15.79:0/953336426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee40b0280 con 0x7f9ee41b1710 2021-04-09T18:28:10.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9ee8fa9700 1 --2- 172.21.15.79:0/953336426 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ee40d5650 0x7f9ee4097b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:28:10.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9ee97aa700 1 --2- 172.21.15.79:0/953336426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ee41b1710 0x7f9ee40d5020 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f9ee40aff00 tx=0x7f9ee0006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:10.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9ed9ffb700 1 -- 172.21.15.79:0/953336426 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9ee40b0280 con 0x7f9ee41b1710 2021-04-09T18:28:10.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9ed9ffb700 1 -- 172.21.15.79:0/953336426 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee0011c50 con 0x7f9ee41b1710 2021-04-09T18:28:10.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9eeba06700 1 -- 172.21.15.79:0/953336426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee40afb10 con 0x7f9ee41b1710 2021-04-09T18:28:10.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9ed9ffb700 1 -- 172.21.15.79:0/953336426 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9ee001d640 con 0x7f9ee41b1710 2021-04-09T18:28:10.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9eeba06700 1 -- 172.21.15.79:0/953336426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee40987c0 con 0x7f9ee41b1710 2021-04-09T18:28:10.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9ed9ffb700 1 -- 172.21.15.79:0/953336426 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9ee001d840 con 0x7f9ee41b1710 2021-04-09T18:28:10.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9ed9ffb700 1 --2- 172.21.15.79:0/953336426 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9ec4029100 0x7f9ec402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9ed9ffb700 1 -- 172.21.15.79:0/953336426 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f9ee003be90 con 0x7f9ee41b1710 2021-04-09T18:28:10.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9ee8fa9700 1 --2- 172.21.15.79:0/953336426 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9ec4029100 0x7f9ec402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.538 7f9ee8fa9700 1 --2- 172.21.15.79:0/953336426 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9ec4029100 0x7f9ec402b650 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:10.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.542 7f9eeba06700 1 -- 172.21.15.79:0/953336426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee40e39d0 con 0x7f9ee41b1710 2021-04-09T18:28:10.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.550 7f9ed9ffb700 1 -- 172.21.15.79:0/953336426 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9ee0011a40 con 0x7f9ee41b1710 2021-04-09T18:28:10.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.722 7f9eeba06700 1 -- 172.21.15.79:0/953336426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ee40a1cb0 con 0x7f9ee41b1710 2021-04-09T18:28:10.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.722 7f9ed9ffb700 1 -- 172.21.15.79:0/953336426 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+1173 (secure 0 0 0) 0x7f9ee00094b0 con 0x7f9ee41b1710 2021-04-09T18:28:10.726 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 14 2021-04-09T18:28:10.727 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:28:10.727 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":14,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3417656822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3417656822},{"type":"v1","addr":"172.21.15.79:6833","nonce":3417656822}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":9},{"gid":5143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/468851998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":468851998},{"type":"v1","addr":"172.21.15.89:6835","nonce":468851998}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":14}],"filesystems":[]} 2021-04-09T18:28:10.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.722 7f9eeba06700 1 -- 172.21.15.79:0/953336426 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9ec4029100 msgr2=0x7f9ec402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.722 7f9eeba06700 1 --2- 172.21.15.79:0/953336426 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9ec4029100 0x7f9ec402b650 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.722 7f9eeba06700 1 -- 172.21.15.79:0/953336426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ee41b1710 msgr2=0x7f9ee40d5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.722 7f9eeba06700 1 --2- 172.21.15.79:0/953336426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ee41b1710 0x7f9ee40d5020 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f9ee40aff00 tx=0x7f9ee0006890).stop 2021-04-09T18:28:10.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.722 7f9eeba06700 1 -- 172.21.15.79:0/953336426 shutdown_connections 2021-04-09T18:28:10.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.722 7f9eeba06700 1 --2- 172.21.15.79:0/953336426 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9ec4029100 0x7f9ec402b650 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.722 7f9eeba06700 1 --2- 172.21.15.79:0/953336426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee40a41f0 0x7f9ee4098190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.726 7f9eeba06700 1 --2- 172.21.15.79:0/953336426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ee41b1710 0x7f9ee40d5020 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.726 7f9eeba06700 1 --2- 172.21.15.79:0/953336426 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ee40d5650 0x7f9ee4097b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.726 7f9eeba06700 1 -- 172.21.15.79:0/953336426 >> 172.21.15.79:0/953336426 conn(0x7f9ee40ba660 msgr2=0x7f9ee40d8400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:10.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.726 7f9eeba06700 1 -- 172.21.15.79:0/953336426 shutdown_connections 2021-04-09T18:28:10.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.726 7f9eeba06700 1 -- 172.21.15.79:0/953336426 wait complete. 2021-04-09T18:28:10.738 INFO:tasks.ceph.mds.a:Restarting daemon 2021-04-09T18:28:10.739 INFO:tasks.ceph.mds.a:Stopping old one... 2021-04-09T18:28:10.739 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-04-09T18:28:10.740 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:28:10.740 INFO:tasks.ceph.mds.b:Restarting daemon 2021-04-09T18:28:10.740 INFO:tasks.ceph.mds.b:Stopping old one... 2021-04-09T18:28:10.741 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-04-09T18:28:10.741 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:28:10.753 INFO:tasks.ceph.mds.a:Stopped 2021-04-09T18:28:10.754 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-04-09T18:28:10.756 INFO:tasks.ceph.mds.b:Stopped 2021-04-09T18:28:10.756 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-04-09T18:28:10.798 INFO:tasks.ceph.mds.a:Started 2021-04-09T18:28:10.799 DEBUG:teuthology.parallel:result is None 2021-04-09T18:28:10.801 INFO:tasks.ceph.mds.b:Started 2021-04-09T18:28:10.801 DEBUG:teuthology.parallel:result is None 2021-04-09T18:28:10.802 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-04-09T18:28:10.872 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2021-04-09T18:28:10.880 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2021-04-09T18:28:10.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f154b8a0700 1 Processor -- start 2021-04-09T18:28:10.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f154b8a0700 1 -- start start 2021-04-09T18:28:10.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f154b8a0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f15440e9ae0 0x7f154409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f154b8a0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f15441c8010 0x7f15441ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f154b8a0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15440fbb20 con 0x7f15440f5520 2021-04-09T18:28:10.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f154b8a0700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15441c3dc0 con 0x7f15440e9ae0 2021-04-09T18:28:10.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f154b8a0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15440e9f30 con 0x7f15441c8010 2021-04-09T18:28:10.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f1548e43700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f15440e9ae0 0x7f154409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f1548e43700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f15440e9ae0 0x7f154409f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57424/0 (socket says 172.21.15.79:57424) 2021-04-09T18:28:10.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f1548e43700 1 -- 172.21.15.79:0/4059973229 learned_addr learned my addr 172.21.15.79:0/4059973229 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:10.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f1549e45700 1 --2- 172.21.15.79:0/4059973229 >> v2:172.21.15.89:3300/0 conn(0x7f15441c8010 0x7f15441ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f1548e43700 1 -- 172.21.15.79:0/4059973229 >> v2:172.21.15.89:3300/0 conn(0x7f15441c8010 msgr2=0x7f15441ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:10.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f1548e43700 1 --2- 172.21.15.79:0/4059973229 >> v2:172.21.15.89:3300/0 conn(0x7f15441c8010 0x7f15441ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f1548e43700 1 -- 172.21.15.79:0/4059973229 >> v1:172.21.15.89:6789/0 conn(0x7f15440f5520 legacy=0x7f15440f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:10.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f1548e43700 1 -- 172.21.15.79:0/4059973229 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15440e56d0 con 0x7f15440e9ae0 2021-04-09T18:28:10.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f1548e43700 1 --2- 172.21.15.79:0/4059973229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15440e9ae0 0x7f154409f110 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f1538002f30 tx=0x7f153800bd70).ready entity=mon.0 client_cookie=1c967ad2c459d8f8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:10.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f1543fff700 1 -- 172.21.15.79:0/4059973229 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f15440e56d0 con 0x7f15440e9ae0 2021-04-09T18:28:10.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f1543fff700 1 -- 172.21.15.79:0/4059973229 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1538009950 con 0x7f15440e9ae0 2021-04-09T18:28:10.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f1543fff700 1 -- 172.21.15.79:0/4059973229 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1538009d20 con 0x7f15440e9ae0 2021-04-09T18:28:10.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f154b8a0700 1 -- 172.21.15.79:0/4059973229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15440e9ae0 msgr2=0x7f154409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.886 7f154b8a0700 1 --2- 172.21.15.79:0/4059973229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15440e9ae0 0x7f154409f110 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f1538002f30 tx=0x7f153800bd70).stop 2021-04-09T18:28:10.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.890 7f154b8a0700 1 -- 172.21.15.79:0/4059973229 shutdown_connections 2021-04-09T18:28:10.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.890 7f154b8a0700 1 --2- 172.21.15.79:0/4059973229 >> v2:172.21.15.89:3300/0 conn(0x7f15441c8010 0x7f15441ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.890 7f154b8a0700 1 --2- 172.21.15.79:0/4059973229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15440e9ae0 0x7f154409f110 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.890 7f154b8a0700 1 -- 172.21.15.79:0/4059973229 >> 172.21.15.79:0/4059973229 conn(0x7f15440e5fe0 msgr2=0x7f15440e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.890 7f154b8a0700 1 -- 172.21.15.79:0/4059973229 shutdown_connections 2021-04-09T18:28:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.890 7f154b8a0700 1 -- 172.21.15.79:0/4059973229 wait complete. 2021-04-09T18:28:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.890 7f154b8a0700 1 Processor -- start 2021-04-09T18:28:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.890 7f154b8a0700 1 -- start start 2021-04-09T18:28:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f154b8a0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15440d5bd0 0x7f15441ae920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f154b8a0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15441aef50 0x7f15441af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f154b8a0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15441aa8b0 0x7f15441aad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f154b8a0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154408f130 con 0x7f15441aa8b0 2021-04-09T18:28:10.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f154b8a0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15440909d0 con 0x7f15440d5bd0 2021-04-09T18:28:10.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f154b8a0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15441ac4d0 con 0x7f15441aef50 2021-04-09T18:28:10.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f1549e45700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15441aa8b0 0x7f15441aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f1548e43700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15441aef50 0x7f15441af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f1549e45700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15441aa8b0 0x7f15441aad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57432/0 (socket says 172.21.15.79:57432) 2021-04-09T18:28:10.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f1549e45700 1 -- 172.21.15.79:0/3724790100 learned_addr learned my addr 172.21.15.79:0/3724790100 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:10.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f1549644700 1 --2- 172.21.15.79:0/3724790100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15440d5bd0 0x7f15441ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f1549e45700 1 -- 172.21.15.79:0/3724790100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15441aef50 msgr2=0x7f15441af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f1549e45700 1 --2- 172.21.15.79:0/3724790100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15441aef50 0x7f15441af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f1549e45700 1 -- 172.21.15.79:0/3724790100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15440d5bd0 msgr2=0x7f15441ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f1549e45700 1 --2- 172.21.15.79:0/3724790100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15440d5bd0 0x7f15441ae920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f1549e45700 1 -- 172.21.15.79:0/3724790100 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15440d6020 con 0x7f15441aa8b0 2021-04-09T18:28:10.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f1549e45700 1 --2- 172.21.15.79:0/3724790100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15441aa8b0 0x7f15441aad00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f154408f0b0 tx=0x7f153400dd60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:10.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f1541ffb700 1 -- 172.21.15.79:0/3724790100 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f15440d6020 con 0x7f15441aa8b0 2021-04-09T18:28:10.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f1541ffb700 1 -- 172.21.15.79:0/3724790100 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15340098b0 con 0x7f15441aa8b0 2021-04-09T18:28:10.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f154b8a0700 1 -- 172.21.15.79:0/3724790100 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154408f430 con 0x7f15441aa8b0 2021-04-09T18:28:10.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f1541ffb700 1 -- 172.21.15.79:0/3724790100 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f153400f040 con 0x7f15441aa8b0 2021-04-09T18:28:10.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f154b8a0700 1 -- 172.21.15.79:0/3724790100 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15440d8120 con 0x7f15441aa8b0 2021-04-09T18:28:10.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f1541ffb700 1 -- 172.21.15.79:0/3724790100 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1534009c80 con 0x7f15441aa8b0 2021-04-09T18:28:10.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f1541ffb700 1 --2- 172.21.15.79:0/3724790100 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1524029100 0x7f152402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.912 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f1541ffb700 1 -- 172.21.15.79:0/3724790100 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f1534010070 con 0x7f15441aa8b0 2021-04-09T18:28:10.912 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.894 7f1549644700 1 --2- 172.21.15.79:0/3724790100 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1524029100 0x7f152402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.912 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.898 7f1549644700 1 --2- 172.21.15.79:0/3724790100 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1524029100 0x7f152402b650 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:10.912 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.898 7f154b8a0700 1 -- 172.21.15.79:0/3724790100 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15440e39e0 con 0x7f15441aa8b0 2021-04-09T18:28:10.913 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:10.906 7f1541ffb700 1 -- 172.21.15.79:0/3724790100 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f15340094b0 con 0x7f15441aa8b0 2021-04-09T18:28:11.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.078 7f154b8a0700 1 -- 172.21.15.79:0/3724790100 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f15440f5b20 con 0x7f15441aa8b0 2021-04-09T18:28:11.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.466 7f1541ffb700 1 -- 172.21.15.79:0/3724790100 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7f15440f76c0 con 0x7f15441aa8b0 2021-04-09T18:28:11.496 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blacklist entries 2021-04-09T18:28:11.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.498 7f154b8a0700 1 -- 172.21.15.79:0/3724790100 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1524029100 msgr2=0x7f152402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:11.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.498 7f154b8a0700 1 --2- 172.21.15.79:0/3724790100 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1524029100 0x7f152402b650 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:11.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.498 7f154b8a0700 1 -- 172.21.15.79:0/3724790100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15441aa8b0 msgr2=0x7f15441aad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:11.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.498 7f154b8a0700 1 --2- 172.21.15.79:0/3724790100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15441aa8b0 0x7f15441aad00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f154408f0b0 tx=0x7f153400dd60).stop 2021-04-09T18:28:11.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.498 7f154b8a0700 1 -- 172.21.15.79:0/3724790100 shutdown_connections 2021-04-09T18:28:11.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.498 7f154b8a0700 1 --2- 172.21.15.79:0/3724790100 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1524029100 0x7f152402b650 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:11.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.498 7f154b8a0700 1 --2- 172.21.15.79:0/3724790100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15440d5bd0 0x7f15441ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:11.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.498 7f154b8a0700 1 --2- 172.21.15.79:0/3724790100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15441aa8b0 0x7f15441aad00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:11.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.498 7f154b8a0700 1 --2- 172.21.15.79:0/3724790100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15441aef50 0x7f15441af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:11.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.498 7f154b8a0700 1 -- 172.21.15.79:0/3724790100 >> 172.21.15.79:0/3724790100 conn(0x7f1544092b10 msgr2=0x7f15440d2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:11.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.498 7f154b8a0700 1 -- 172.21.15.79:0/3724790100 shutdown_connections 2021-04-09T18:28:11.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.498 7f154b8a0700 1 -- 172.21.15.79:0/3724790100 wait complete. 2021-04-09T18:28:11.519 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-04-09T18:28:11.520 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-04-09T18:28:11.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2eb8ff700 1 Processor -- start 2021-04-09T18:28:11.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2eb8ff700 1 -- start start 2021-04-09T18:28:11.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2eb8ff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe2e40f5510 0x7fe2e40f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:11.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2eb8ff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2e40e9ad0 0x7fe2e409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:11.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2eb8ff700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e40fbb10 con 0x7fe2e41c2da0 2021-04-09T18:28:11.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2eb8ff700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e40e9f20 con 0x7fe2e40f5510 2021-04-09T18:28:11.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2eb8ff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e40e59c0 con 0x7fe2e40e9ad0 2021-04-09T18:28:11.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2e96a3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe2e40f5510 0x7fe2e40f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:11.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2e9ea4700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe2e41c2da0 0x7fe2e41c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52150/0 (socket says 172.21.15.79:52150) 2021-04-09T18:28:11.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2e9ea4700 1 -- 172.21.15.79:0/2484824689 learned_addr learned my addr 172.21.15.79:0/2484824689 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:28:11.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2e8ea2700 1 --2- 172.21.15.79:0/2484824689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2e40e9ad0 0x7fe2e409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:11.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2e96a3700 1 -- 172.21.15.79:0/2484824689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2e40e9ad0 msgr2=0x7fe2e409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:11.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2e96a3700 1 --2- 172.21.15.79:0/2484824689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2e40e9ad0 0x7fe2e409f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:11.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2e96a3700 1 -- 172.21.15.79:0/2484824689 >> v1:172.21.15.79:6789/0 conn(0x7fe2e41c2da0 legacy=0x7fe2e41c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:11.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2e96a3700 1 -- 172.21.15.79:0/2484824689 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e40e56c0 con 0x7fe2e40f5510 2021-04-09T18:28:11.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2dbfff700 1 -- 172.21.15.79:0/2484824689 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3160284978 0 0) 0x7fe2dc001450 con 0x7fe2e41c2da0 2021-04-09T18:28:11.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2e96a3700 1 --2- 172.21.15.79:0/2484824689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2e40f5510 0x7fe2e40f64a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fe2e0002f30 tx=0x7fe2e000bd40).ready entity=mon.0 client_cookie=533d6b11fd8c852f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:11.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2dbfff700 1 -- 172.21.15.79:0/2484824689 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe2e40e56c0 con 0x7fe2e40f5510 2021-04-09T18:28:11.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2dbfff700 1 -- 172.21.15.79:0/2484824689 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e0009850 con 0x7fe2e40f5510 2021-04-09T18:28:11.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2dbfff700 1 -- 172.21.15.79:0/2484824689 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe2e0009c20 con 0x7fe2e40f5510 2021-04-09T18:28:11.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.626 7fe2eb8ff700 1 -- 172.21.15.79:0/2484824689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2e40f5510 msgr2=0x7fe2e40f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:11.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.630 7fe2eb8ff700 1 --2- 172.21.15.79:0/2484824689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2e40f5510 0x7fe2e40f64a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fe2e0002f30 tx=0x7fe2e000bd40).stop 2021-04-09T18:28:11.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.630 7fe2eb8ff700 1 -- 172.21.15.79:0/2484824689 shutdown_connections 2021-04-09T18:28:11.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.630 7fe2eb8ff700 1 --2- 172.21.15.79:0/2484824689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2e40f5510 0x7fe2e40f64a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:11.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.630 7fe2eb8ff700 1 --2- 172.21.15.79:0/2484824689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2e40e9ad0 0x7fe2e409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:11.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.630 7fe2eb8ff700 1 -- 172.21.15.79:0/2484824689 >> 172.21.15.79:0/2484824689 conn(0x7fe2e40e5fd0 msgr2=0x7fe2e40e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:11.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.630 7fe2eb8ff700 1 -- 172.21.15.79:0/2484824689 shutdown_connections 2021-04-09T18:28:11.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.630 7fe2eb8ff700 1 -- 172.21.15.79:0/2484824689 wait complete. 2021-04-09T18:28:11.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.634 7fe2eb8ff700 1 Processor -- start 2021-04-09T18:28:11.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.634 7fe2eb8ff700 1 -- start start 2021-04-09T18:28:11.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.634 7fe2eb8ff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2e40cedc0 0x7fe2e40cf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:11.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.634 7fe2eb8ff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2e40d4060 0x7fe2e40d44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:11.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.634 7fe2eb8ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2e40d5f60 0x7fe2e40d63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:11.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.634 7fe2eb8ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e40d5c60 con 0x7fe2e40d5f60 2021-04-09T18:28:11.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.634 7fe2eb8ff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e40d5130 con 0x7fe2e40cedc0 2021-04-09T18:28:11.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.634 7fe2eb8ff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e40d4ae0 con 0x7fe2e40d4060 2021-04-09T18:28:11.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.634 7fe2e9ea4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2e40d5f60 0x7fe2e40d63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:11.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.634 7fe2e9ea4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2e40d5f60 0x7fe2e40d63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57446/0 (socket says 172.21.15.79:57446) 2021-04-09T18:28:11.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.634 7fe2e9ea4700 1 -- 172.21.15.79:0/898420603 learned_addr learned my addr 172.21.15.79:0/898420603 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:11.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.634 7fe2e96a3700 1 --2- 172.21.15.79:0/898420603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2e40cedc0 0x7fe2e40cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:11.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.634 7fe2e8ea2700 1 --2- 172.21.15.79:0/898420603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2e40d4060 0x7fe2e40d44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:11.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.638 7fe2e9ea4700 1 -- 172.21.15.79:0/898420603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2e40d4060 msgr2=0x7fe2e40d44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:11.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.638 7fe2e9ea4700 1 --2- 172.21.15.79:0/898420603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2e40d4060 0x7fe2e40d44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:11.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.638 7fe2e9ea4700 1 -- 172.21.15.79:0/898420603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2e40cedc0 msgr2=0x7fe2e40cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:11.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.638 7fe2e9ea4700 1 --2- 172.21.15.79:0/898420603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2e40cedc0 0x7fe2e40cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:11.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.638 7fe2e9ea4700 1 -- 172.21.15.79:0/898420603 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e40d54f0 con 0x7fe2e40d5f60 2021-04-09T18:28:11.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.638 7fe2e9ea4700 1 --2- 172.21.15.79:0/898420603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2e40d5f60 0x7fe2e40d63b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fe2e40d52e0 tx=0x7fe2dc00ceb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:11.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.638 7fe2d9ffb700 1 -- 172.21.15.79:0/898420603 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe2e40d54f0 con 0x7fe2e40d5f60 2021-04-09T18:28:11.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.638 7fe2d9ffb700 1 -- 172.21.15.79:0/898420603 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc005b80 con 0x7fe2e40d5f60 2021-04-09T18:28:11.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.638 7fe2eb8ff700 1 -- 172.21.15.79:0/898420603 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e40d69e0 con 0x7fe2e40d5f60 2021-04-09T18:28:11.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.638 7fe2d9ffb700 1 -- 172.21.15.79:0/898420603 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe2dc007110 con 0x7fe2e40d5f60 2021-04-09T18:28:11.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.638 7fe2eb8ff700 1 -- 172.21.15.79:0/898420603 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e41aa0e0 con 0x7fe2e40d5f60 2021-04-09T18:28:11.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.638 7fe2d9ffb700 1 -- 172.21.15.79:0/898420603 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe2dc01a020 con 0x7fe2e40d5f60 2021-04-09T18:28:11.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.638 7fe2d9ffb700 1 --2- 172.21.15.79:0/898420603 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe2c4029100 0x7fe2c402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:11.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.638 7fe2d9ffb700 1 -- 172.21.15.79:0/898420603 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fe2dc039160 con 0x7fe2e40d5f60 2021-04-09T18:28:11.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.638 7fe2e96a3700 1 --2- 172.21.15.79:0/898420603 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe2c4029100 0x7fe2c402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:11.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.638 7fe2e96a3700 1 --2- 172.21.15.79:0/898420603 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe2c4029100 0x7fe2c402b650 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:11.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.642 7fe2eb8ff700 1 -- 172.21.15.79:0/898420603 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e40e39d0 con 0x7fe2e40d5f60 2021-04-09T18:28:11.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.650 7fe2d9ffb700 1 -- 172.21.15.79:0/898420603 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe2dc005970 con 0x7fe2e40d5f60 2021-04-09T18:28:11.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.810 7fe2eb8ff700 1 -- 172.21.15.79:0/898420603 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe2e40f5b10 con 0x7fe2e40d5f60 2021-04-09T18:28:11.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.814 7fe2d9ffb700 1 -- 172.21.15.79:0/898420603 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fe2dc000f70 con 0x7fe2e40d5f60 2021-04-09T18:28:11.820 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:28:11.820 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:28:11.820 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2021-04-09T18:28:11.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:11.820 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2021-04-09T18:28:11.821 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgovEoMhAAbDfArG3lSFAdk80rS/4iEQ==", 2021-04-09T18:28:11.821 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:28:11.821 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:28:11.821 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:28:11.822 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:28:11.822 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:28:11.822 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:11.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:11.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:11.823 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2021-04-09T18:28:11.823 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgN4sfOBAAPjvDX11uLM+vgdFpdP49Kw==", 2021-04-09T18:28:11.823 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:28:11.824 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:28:11.824 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:28:11.824 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:28:11.824 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:28:11.824 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:11.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:11.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:11.825 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2021-04-09T18:28:11.825 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQALnHBgro0COxAAgbe5jxAZH9bD7zDLbtdkhQ==", 2021-04-09T18:28:11.825 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:28:11.826 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:28:11.826 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:28:11.826 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:28:11.826 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:11.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:11.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:11.827 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2021-04-09T18:28:11.827 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAPnHBghZ/oARAAhkN+fnZJiskmHnvvs+G8NA==", 2021-04-09T18:28:11.828 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:28:11.828 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:28:11.828 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:28:11.828 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:28:11.828 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:11.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:11.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:11.829 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2021-04-09T18:28:11.829 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQASnHBgWT2FBxAACrSTbwbF18k9aPeYNohelw==", 2021-04-09T18:28:11.829 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:28:11.830 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:28:11.830 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:28:11.830 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:28:11.830 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:11.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:11.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:11.831 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2021-04-09T18:28:11.831 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAVnHBgPHy6CxAAFq+yki4AZe5ybodgTO/4/Q==", 2021-04-09T18:28:11.831 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:28:11.831 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:28:11.832 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:28:11.832 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:28:11.832 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:11.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:11.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:11.833 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2021-04-09T18:28:11.833 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAanHBgfbs4NhAAQzxM9dDML4RgQP8yamkuVw==", 2021-04-09T18:28:11.833 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:28:11.833 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:28:11.834 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:28:11.834 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:28:11.834 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:11.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:11.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:11.835 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2021-04-09T18:28:11.835 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAdnHBgi0WLOhAA4OBguOCjtmzqulUjTJ+GhQ==", 2021-04-09T18:28:11.835 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:28:11.836 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:28:11.836 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:28:11.836 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:28:11.836 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:11.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:11.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:11.837 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2021-04-09T18:28:11.837 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAhnHBgCs+PAxAAOm0wSMe/1Bu9vfTrpmrLkg==", 2021-04-09T18:28:11.837 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:28:11.837 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:28:11.838 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:28:11.838 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:28:11.838 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:11.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:11.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:11.839 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2021-04-09T18:28:11.839 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAknHBgH1S3CBAAUcdUIW7O6wH482l1yZBKBw==", 2021-04-09T18:28:11.839 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:28:11.839 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:28:11.839 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:28:11.840 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:28:11.840 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:11.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:11.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:11.840 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2021-04-09T18:28:11.841 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgxEq9BxAAap2nrjhcrf2aHzygtMclVw==", 2021-04-09T18:28:11.841 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:28:11.841 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:28:11.841 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:28:11.842 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:28:11.842 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:11.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:11.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:11.842 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2021-04-09T18:28:11.843 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBguJFeDRAAWL4NV4tsYRAqcwJ26kjm2Q==", 2021-04-09T18:28:11.843 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:28:11.843 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:28:11.844 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:28:11.844 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:28:11.844 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:11.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:11.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:11.845 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2021-04-09T18:28:11.845 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgN9X5EhAA3DBPdlRHVBHXJNH9nRFW0A==", 2021-04-09T18:28:11.845 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:28:11.845 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:28:11.846 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:28:11.846 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:28:11.846 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:11.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:11.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:11.847 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2021-04-09T18:28:11.847 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgHOSVDBAAMMqd8paqBSTQRgR7n4EXGQ==", 2021-04-09T18:28:11.847 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:28:11.847 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:28:11.847 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:28:11.848 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:28:11.848 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:28:11.848 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:11.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:11.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:11.849 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2021-04-09T18:28:11.849 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgmHJhLxAAyhBrx08J7ZFKu34MYC2Wyg==", 2021-04-09T18:28:11.849 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:28:11.849 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:28:11.850 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:28:11.850 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:28:11.850 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:11.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:28:11.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:11.851 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2021-04-09T18:28:11.851 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgNCCXKhAA/bKOzzjVHldj6RpMGu0c8g==", 2021-04-09T18:28:11.851 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:28:11.851 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:28:11.851 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:28:11.852 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:28:11.852 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:11.852 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:11.852 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:28:11.852 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:28:11.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.818 7fe2eb8ff700 1 -- 172.21.15.79:0/898420603 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe2c4029100 msgr2=0x7fe2c402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:11.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.818 7fe2eb8ff700 1 --2- 172.21.15.79:0/898420603 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe2c4029100 0x7fe2c402b650 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:11.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.818 7fe2eb8ff700 1 -- 172.21.15.79:0/898420603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2e40d5f60 msgr2=0x7fe2e40d63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:11.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.818 7fe2eb8ff700 1 --2- 172.21.15.79:0/898420603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2e40d5f60 0x7fe2e40d63b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fe2e40d52e0 tx=0x7fe2dc00ceb0).stop 2021-04-09T18:28:11.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.818 7fe2eb8ff700 1 -- 172.21.15.79:0/898420603 shutdown_connections 2021-04-09T18:28:11.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.818 7fe2eb8ff700 1 --2- 172.21.15.79:0/898420603 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe2c4029100 0x7fe2c402b650 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:11.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.818 7fe2eb8ff700 1 --2- 172.21.15.79:0/898420603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2e40cedc0 0x7fe2e40cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:11.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.818 7fe2eb8ff700 1 --2- 172.21.15.79:0/898420603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2e40d5f60 0x7fe2e40d63b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:11.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.818 7fe2eb8ff700 1 --2- 172.21.15.79:0/898420603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2e40d4060 0x7fe2e40d44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:11.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.818 7fe2eb8ff700 1 -- 172.21.15.79:0/898420603 >> 172.21.15.79:0/898420603 conn(0x7fe2e40d30d0 msgr2=0x7fe2e408e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:11.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.818 7fe2eb8ff700 1 -- 172.21.15.79:0/898420603 shutdown_connections 2021-04-09T18:28:11.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.818 7fe2eb8ff700 1 -- 172.21.15.79:0/898420603 wait complete. 2021-04-09T18:28:11.857 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:28:11.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4ffe1700 1 Processor -- start 2021-04-09T18:28:11.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4ffe1700 1 -- start start 2021-04-09T18:28:11.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4ffe1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a480f5510 0x7f3a480f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:11.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4ffe1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3a480e9ad0 0x7f3a4809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:11.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4ffe1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a480fbb10 con 0x7f3a481c2da0 2021-04-09T18:28:11.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4ffe1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a480e9f20 con 0x7f3a480f5510 2021-04-09T18:28:11.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4ffe1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a480e59c0 con 0x7f3a480e9ad0 2021-04-09T18:28:11.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4dd85700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a480f5510 0x7f3a480f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:11.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4e586700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3a481c2da0 0x7f3a481c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52164/0 (socket says 172.21.15.79:52164) 2021-04-09T18:28:11.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4e586700 1 -- 172.21.15.79:0/360702427 learned_addr learned my addr 172.21.15.79:0/360702427 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:28:11.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4d584700 1 --2- 172.21.15.79:0/360702427 >> v2:172.21.15.89:3300/0 conn(0x7f3a480e9ad0 0x7f3a4809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:11.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4dd85700 1 -- 172.21.15.79:0/360702427 >> v2:172.21.15.89:3300/0 conn(0x7f3a480e9ad0 msgr2=0x7f3a4809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:11.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4dd85700 1 --2- 172.21.15.79:0/360702427 >> v2:172.21.15.89:3300/0 conn(0x7f3a480e9ad0 0x7f3a4809f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:11.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4dd85700 1 -- 172.21.15.79:0/360702427 >> v1:172.21.15.79:6789/0 conn(0x7f3a481c2da0 legacy=0x7f3a481c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:11.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4dd85700 1 -- 172.21.15.79:0/360702427 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a480e56c0 con 0x7f3a480f5510 2021-04-09T18:28:11.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4dd85700 1 --2- 172.21.15.79:0/360702427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a480f5510 0x7f3a480f64a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f3a44002f30 tx=0x7f3a4400bd10).ready entity=mon.0 client_cookie=6b021e8d8440f369 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:11.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4cd83700 1 -- 172.21.15.79:0/360702427 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a480e56c0 con 0x7f3a480f5510 2021-04-09T18:28:11.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4cd83700 1 -- 172.21.15.79:0/360702427 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a440098a0 con 0x7f3a480f5510 2021-04-09T18:28:11.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4cd83700 1 -- 172.21.15.79:0/360702427 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a44009cb0 con 0x7f3a480f5510 2021-04-09T18:28:11.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4ffe1700 1 -- 172.21.15.79:0/360702427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a480f5510 msgr2=0x7f3a480f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:11.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.946 7f3a4ffe1700 1 --2- 172.21.15.79:0/360702427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a480f5510 0x7f3a480f64a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f3a44002f30 tx=0x7f3a4400bd10).stop 2021-04-09T18:28:11.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.950 7f3a4ffe1700 1 -- 172.21.15.79:0/360702427 shutdown_connections 2021-04-09T18:28:11.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.950 7f3a4ffe1700 1 --2- 172.21.15.79:0/360702427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a480f5510 0x7f3a480f64a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:11.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.950 7f3a4ffe1700 1 --2- 172.21.15.79:0/360702427 >> v2:172.21.15.89:3300/0 conn(0x7f3a480e9ad0 0x7f3a4809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:11.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.950 7f3a4ffe1700 1 -- 172.21.15.79:0/360702427 >> 172.21.15.79:0/360702427 conn(0x7f3a480e5fd0 msgr2=0x7f3a480e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:11.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.950 7f3a4ffe1700 1 -- 172.21.15.79:0/360702427 shutdown_connections 2021-04-09T18:28:11.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.950 7f3a4ffe1700 1 -- 172.21.15.79:0/360702427 wait complete. 2021-04-09T18:28:11.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4ffe1700 1 Processor -- start 2021-04-09T18:28:11.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4ffe1700 1 -- start start 2021-04-09T18:28:11.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4ffe1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a480c18b0 0x7f3a481b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:11.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4ffe1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a481b1880 0x7f3a480c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4ffe1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a481b1cd0 0x7f3a480c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4ffe1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a48099380 con 0x7f3a480c18b0 2021-04-09T18:28:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4ffe1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a48099680 con 0x7f3a481b1cd0 2021-04-09T18:28:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4ffe1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a48098c10 con 0x7f3a481b1880 2021-04-09T18:28:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4dd85700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a480c18b0 0x7f3a481b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:11.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4dd85700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a480c18b0 0x7f3a481b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57456/0 (socket says 172.21.15.79:57456) 2021-04-09T18:28:11.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4dd85700 1 -- 172.21.15.79:0/1700460974 learned_addr learned my addr 172.21.15.79:0/1700460974 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:11.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4e586700 1 --2- 172.21.15.79:0/1700460974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a481b1cd0 0x7f3a480c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:11.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4d584700 1 --2- 172.21.15.79:0/1700460974 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a481b1880 0x7f3a480c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:11.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4dd85700 1 -- 172.21.15.79:0/1700460974 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a481b1880 msgr2=0x7f3a480c6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:11.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4dd85700 1 --2- 172.21.15.79:0/1700460974 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a481b1880 0x7f3a480c6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:11.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4dd85700 1 -- 172.21.15.79:0/1700460974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a481b1cd0 msgr2=0x7f3a480c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:11.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4dd85700 1 --2- 172.21.15.79:0/1700460974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a481b1cd0 0x7f3a480c6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:11.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4dd85700 1 -- 172.21.15.79:0/1700460974 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a480c72c0 con 0x7f3a480c18b0 2021-04-09T18:28:11.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4dd85700 1 --2- 172.21.15.79:0/1700460974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a480c18b0 0x7f3a481b1250 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f3a480d8250 tx=0x7f3a44006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:11.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a3e7fc700 1 -- 172.21.15.79:0/1700460974 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a480c72c0 con 0x7f3a480c18b0 2021-04-09T18:28:11.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a3e7fc700 1 -- 172.21.15.79:0/1700460974 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a44011c70 con 0x7f3a480c18b0 2021-04-09T18:28:11.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a3e7fc700 1 -- 172.21.15.79:0/1700460974 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a4401d630 con 0x7f3a480c18b0 2021-04-09T18:28:11.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4ffe1700 1 -- 172.21.15.79:0/1700460974 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a48098e50 con 0x7f3a480c18b0 2021-04-09T18:28:11.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a4ffe1700 1 -- 172.21.15.79:0/1700460974 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a480c3660 con 0x7f3a480c18b0 2021-04-09T18:28:11.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a3e7fc700 1 -- 172.21.15.79:0/1700460974 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3a44026450 con 0x7f3a480c18b0 2021-04-09T18:28:11.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a3e7fc700 1 --2- 172.21.15.79:0/1700460974 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a30029100 0x7f3a3002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:11.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.954 7f3a3e7fc700 1 -- 172.21.15.79:0/1700460974 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f3a4403aa00 con 0x7f3a480c18b0 2021-04-09T18:28:11.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.958 7f3a4d584700 1 --2- 172.21.15.79:0/1700460974 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a30029100 0x7f3a3002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:11.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.958 7f3a4d584700 1 --2- 172.21.15.79:0/1700460974 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a30029100 0x7f3a3002b650 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:11.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.958 7f3a4ffe1700 1 -- 172.21.15.79:0/1700460974 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a480e39d0 con 0x7f3a480c18b0 2021-04-09T18:28:11.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:11.962 7f3a3e7fc700 1 -- 172.21.15.79:0/1700460974 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3a44011a60 con 0x7f3a480c18b0 2021-04-09T18:28:12.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.126 7f3a4ffe1700 1 -- 172.21.15.79:0/1700460974 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a480f5b10 con 0x7f3a480c18b0 2021-04-09T18:28:12.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.130 7f3a3e7fc700 1 -- 172.21.15.79:0/1700460974 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+11377 (secure 0 0 0) 0x7f3a44009690 con 0x7f3a480c18b0 2021-04-09T18:28:12.136 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:28:12.136 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":35,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:28:11.464152","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:28:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.134 7f3a4ffe1700 1 -- 172.21.15.79:0/1700460974 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a30029100 msgr2=0x7f3a3002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.134 7f3a4ffe1700 1 --2- 172.21.15.79:0/1700460974 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a30029100 0x7f3a3002b650 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.134 7f3a4ffe1700 1 -- 172.21.15.79:0/1700460974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a480c18b0 msgr2=0x7f3a481b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.134 7f3a4ffe1700 1 --2- 172.21.15.79:0/1700460974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a480c18b0 0x7f3a481b1250 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f3a480d8250 tx=0x7f3a44006890).stop 2021-04-09T18:28:12.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.134 7f3a4ffe1700 1 -- 172.21.15.79:0/1700460974 shutdown_connections 2021-04-09T18:28:12.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.134 7f3a4ffe1700 1 --2- 172.21.15.79:0/1700460974 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a30029100 0x7f3a3002b650 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.134 7f3a4ffe1700 1 --2- 172.21.15.79:0/1700460974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a481b1cd0 0x7f3a480c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.134 7f3a4ffe1700 1 --2- 172.21.15.79:0/1700460974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a480c18b0 0x7f3a481b1250 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.134 7f3a4ffe1700 1 --2- 172.21.15.79:0/1700460974 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a481b1880 0x7f3a480c6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.134 7f3a4ffe1700 1 -- 172.21.15.79:0/1700460974 >> 172.21.15.79:0/1700460974 conn(0x7f3a480b03d0 msgr2=0x7f3a480a24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:12.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.134 7f3a4ffe1700 1 -- 172.21.15.79:0/1700460974 shutdown_connections 2021-04-09T18:28:12.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.134 7f3a4ffe1700 1 -- 172.21.15.79:0/1700460974 wait complete. 2021-04-09T18:28:12.149 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-04-09T18:28:12.149 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:28:12.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.238 7fa8ec5af700 1 Processor -- start 2021-04-09T18:28:12.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.238 7fa8ec5af700 1 -- start start 2021-04-09T18:28:12.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.238 7fa8ec5af700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa8e40e9b10 0x7fa8e409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.238 7fa8ec5af700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8e41c8040 0x7fa8e41ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.238 7fa8ec5af700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e40fbb50 con 0x7fa8e40f5550 2021-04-09T18:28:12.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.238 7fa8ec5af700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e41c3df0 con 0x7fa8e40e9b10 2021-04-09T18:28:12.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.238 7fa8ec5af700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40e9f60 con 0x7fa8e41c8040 2021-04-09T18:28:12.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.238 7fa8ea353700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa8e40f5550 0x7fa8e40f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52174/0 (socket says 172.21.15.79:52174) 2021-04-09T18:28:12.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.238 7fa8e9b52700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa8e40e9b10 0x7fa8e409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.238 7fa8ea353700 1 -- 172.21.15.79:0/3106129020 learned_addr learned my addr 172.21.15.79:0/3106129020 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:28:12.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.238 7fa8eab54700 1 --2- 172.21.15.79:0/3106129020 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8e41c8040 0x7fa8e41ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.242 7fa8e9351700 1 -- 172.21.15.79:0/3106129020 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 858274247 0 0) 0x7fa8e00010d0 con 0x7fa8e40f5550 2021-04-09T18:28:12.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.242 7fa8e9351700 1 -- 172.21.15.79:0/3106129020 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8d0003240 con 0x7fa8e40f5550 2021-04-09T18:28:12.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.242 7fa8e9b52700 1 -- 172.21.15.79:0/3106129020 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8e41c8040 msgr2=0x7fa8e41ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:12.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.242 7fa8e9b52700 1 --2- 172.21.15.79:0/3106129020 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8e41c8040 0x7fa8e41ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.242 7fa8e9b52700 1 -- 172.21.15.79:0/3106129020 >> v1:172.21.15.79:6789/0 conn(0x7fa8e40f5550 legacy=0x7fa8e40f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.242 7fa8e9b52700 1 -- 172.21.15.79:0/3106129020 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e40e5700 con 0x7fa8e40e9b10 2021-04-09T18:28:12.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.242 7fa8e9b52700 1 --2- 172.21.15.79:0/3106129020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8e40e9b10 0x7fa8e409f110 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fa8e40f6f30 tx=0x7fa8d400bd70).ready entity=mon.0 client_cookie=b2b2163a48dd20e6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:12.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.242 7fa8e9351700 1 -- 172.21.15.79:0/3106129020 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa8e40e5700 con 0x7fa8e40e9b10 2021-04-09T18:28:12.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.242 7fa8e9351700 1 -- 172.21.15.79:0/3106129020 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d4009810 con 0x7fa8e40e9b10 2021-04-09T18:28:12.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.242 7fa8e9351700 1 -- 172.21.15.79:0/3106129020 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa8d4009be0 con 0x7fa8e40e9b10 2021-04-09T18:28:12.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.242 7fa8ec5af700 1 -- 172.21.15.79:0/3106129020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8e40e9b10 msgr2=0x7fa8e409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.242 7fa8ec5af700 1 --2- 172.21.15.79:0/3106129020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8e40e9b10 0x7fa8e409f110 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fa8e40f6f30 tx=0x7fa8d400bd70).stop 2021-04-09T18:28:12.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.242 7fa8ec5af700 1 -- 172.21.15.79:0/3106129020 shutdown_connections 2021-04-09T18:28:12.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.242 7fa8ec5af700 1 --2- 172.21.15.79:0/3106129020 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8e41c8040 0x7fa8e41ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.242 7fa8ec5af700 1 --2- 172.21.15.79:0/3106129020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8e40e9b10 0x7fa8e409f110 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.242 7fa8ec5af700 1 -- 172.21.15.79:0/3106129020 >> 172.21.15.79:0/3106129020 conn(0x7fa8e40e6010 msgr2=0x7fa8e40e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:12.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.242 7fa8ec5af700 1 -- 172.21.15.79:0/3106129020 shutdown_connections 2021-04-09T18:28:12.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.242 7fa8ec5af700 1 -- 172.21.15.79:0/3106129020 wait complete. 2021-04-09T18:28:12.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8ec5af700 1 Processor -- start 2021-04-09T18:28:12.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8ec5af700 1 -- start start 2021-04-09T18:28:12.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8ec5af700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8e4091ff0 0x7fa8e4099890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8ec5af700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8e40d0700 0x7fa8e40d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8ec5af700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8e40bba70 0x7fa8e40bbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8ec5af700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40e1ac0 con 0x7fa8e40bba70 2021-04-09T18:28:12.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8ec5af700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e4091cf0 con 0x7fa8e40d0700 2021-04-09T18:28:12.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8ec5af700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40ae340 con 0x7fa8e4091ff0 2021-04-09T18:28:12.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8eab54700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8e40bba70 0x7fa8e40bbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8eab54700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8e40bba70 0x7fa8e40bbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57472/0 (socket says 172.21.15.79:57472) 2021-04-09T18:28:12.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8eab54700 1 -- 172.21.15.79:0/3489197645 learned_addr learned my addr 172.21.15.79:0/3489197645 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:12.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8ea353700 1 --2- 172.21.15.79:0/3489197645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8e4091ff0 0x7fa8e4099890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8e9b52700 1 --2- 172.21.15.79:0/3489197645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8e40d0700 0x7fa8e40d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8eab54700 1 -- 172.21.15.79:0/3489197645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8e4091ff0 msgr2=0x7fa8e4099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8eab54700 1 --2- 172.21.15.79:0/3489197645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8e4091ff0 0x7fa8e4099890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8eab54700 1 -- 172.21.15.79:0/3489197645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8e40d0700 msgr2=0x7fa8e40d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8eab54700 1 --2- 172.21.15.79:0/3489197645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8e40d0700 0x7fa8e40d0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8eab54700 1 -- 172.21.15.79:0/3489197645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e4092440 con 0x7fa8e40bba70 2021-04-09T18:28:12.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8eab54700 1 --2- 172.21.15.79:0/3489197645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8e40bba70 0x7fa8e40bbec0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fa8dc00c000 tx=0x7fa8dc00c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:12.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8daffd700 1 -- 172.21.15.79:0/3489197645 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa8e4092440 con 0x7fa8e40bba70 2021-04-09T18:28:12.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8daffd700 1 -- 172.21.15.79:0/3489197645 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8dc00cb70 con 0x7fa8e40bba70 2021-04-09T18:28:12.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8ec5af700 1 -- 172.21.15.79:0/3489197645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e4091880 con 0x7fa8e40bba70 2021-04-09T18:28:12.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8daffd700 1 -- 172.21.15.79:0/3489197645 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa8dc00f040 con 0x7fa8e40bba70 2021-04-09T18:28:12.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.246 7fa8ec5af700 1 -- 172.21.15.79:0/3489197645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e40bc680 con 0x7fa8e40bba70 2021-04-09T18:28:12.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.250 7fa8daffd700 1 -- 172.21.15.79:0/3489197645 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa8dc022060 con 0x7fa8e40bba70 2021-04-09T18:28:12.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.250 7fa8daffd700 1 --2- 172.21.15.79:0/3489197645 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa8cc029100 0x7fa8cc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.250 7fa8daffd700 1 -- 172.21.15.79:0/3489197645 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fa8dc010040 con 0x7fa8e40bba70 2021-04-09T18:28:12.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.250 7fa8ea353700 1 --2- 172.21.15.79:0/3489197645 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa8cc029100 0x7fa8cc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.250 7fa8ea353700 1 --2- 172.21.15.79:0/3489197645 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa8cc029100 0x7fa8cc02b650 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:12.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.250 7fa8ec5af700 1 -- 172.21.15.79:0/3489197645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e40e39f0 con 0x7fa8e40bba70 2021-04-09T18:28:12.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.258 7fa8daffd700 1 -- 172.21.15.79:0/3489197645 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa8dc00c960 con 0x7fa8e40bba70 2021-04-09T18:28:12.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.414 7fa8ec5af700 1 -- 172.21.15.79:0/3489197645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fa8e40a1c90 con 0x7fa8e40bba70 2021-04-09T18:28:12.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.414 7fa8daffd700 1 -- 172.21.15.79:0/3489197645 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v35) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa8e40f76f0 con 0x7fa8e40bba70 2021-04-09T18:28:12.420 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:28:12.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.418 7fa8ec5af700 1 -- 172.21.15.79:0/3489197645 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa8cc029100 msgr2=0x7fa8cc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.418 7fa8ec5af700 1 --2- 172.21.15.79:0/3489197645 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa8cc029100 0x7fa8cc02b650 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.418 7fa8ec5af700 1 -- 172.21.15.79:0/3489197645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8e40bba70 msgr2=0x7fa8e40bbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.418 7fa8ec5af700 1 --2- 172.21.15.79:0/3489197645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8e40bba70 0x7fa8e40bbec0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fa8dc00c000 tx=0x7fa8dc00c430).stop 2021-04-09T18:28:12.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.418 7fa8ec5af700 1 -- 172.21.15.79:0/3489197645 shutdown_connections 2021-04-09T18:28:12.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.418 7fa8ec5af700 1 --2- 172.21.15.79:0/3489197645 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa8cc029100 0x7fa8cc02b650 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.418 7fa8ec5af700 1 --2- 172.21.15.79:0/3489197645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8e40bba70 0x7fa8e40bbec0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.418 7fa8ec5af700 1 --2- 172.21.15.79:0/3489197645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8e4091ff0 0x7fa8e4099890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.418 7fa8ec5af700 1 --2- 172.21.15.79:0/3489197645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8e40d0700 0x7fa8e40d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.418 7fa8ec5af700 1 -- 172.21.15.79:0/3489197645 >> 172.21.15.79:0/3489197645 conn(0x7fa8e409a040 msgr2=0x7fa8e40d3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:12.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.418 7fa8ec5af700 1 -- 172.21.15.79:0/3489197645 shutdown_connections 2021-04-09T18:28:12.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.418 7fa8ec5af700 1 -- 172.21.15.79:0/3489197645 wait complete. 2021-04-09T18:28:12.433 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-04-09T18:28:12.457 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:28:12.478 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:28:12.481 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:28:12.483 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:28:12.485 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:28:12.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.522 7fa834b74700 1 Processor -- start 2021-04-09T18:28:12.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.522 7fa834b74700 1 -- start start 2021-04-09T18:28:12.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa834b74700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8300f5520 0x7fa8300f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa834b74700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8300fbb20 con 0x7fa8300e9ae0 2021-04-09T18:28:12.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa834b74700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa83009f910 con 0x7fa8301c8010 2021-04-09T18:28:12.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa834b74700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8300e9f30 con 0x7fa8300f5520 2021-04-09T18:28:12.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa82dfe5700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa8300e9ae0 0x7fa83009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52188/0 (socket says 172.21.15.79:52188) 2021-04-09T18:28:12.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa82dfe5700 1 -- 172.21.15.79:0/1353580417 learned_addr learned my addr 172.21.15.79:0/1353580417 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:28:12.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa82e7e6700 1 --2- 172.21.15.79:0/1353580417 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8300f5520 0x7fa8300f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa82d7e4700 1 -- 172.21.15.79:0/1353580417 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469521987 0 0) 0x7fa8240010d0 con 0x7fa8300e9ae0 2021-04-09T18:28:12.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa82d7e4700 1 -- 172.21.15.79:0/1353580417 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa818003240 con 0x7fa8300e9ae0 2021-04-09T18:28:12.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa82d7e4700 1 -- 172.21.15.79:0/1353580417 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89292015 0 0) 0x7fa828001450 con 0x7fa8301c8010 2021-04-09T18:28:12.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa82d7e4700 1 -- 172.21.15.79:0/1353580417 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa818003620 con 0x7fa8301c8010 2021-04-09T18:28:12.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa82e7e6700 1 -- 172.21.15.79:0/1353580417 >> v1:172.21.15.89:6789/0 conn(0x7fa8301c8010 legacy=0x7fa8301ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa82e7e6700 1 -- 172.21.15.79:0/1353580417 >> v1:172.21.15.79:6789/0 conn(0x7fa8300e9ae0 legacy=0x7fa83009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa82d7e4700 1 -- 172.21.15.79:0/1353580417 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1654419773 0 0) 0x7fa824001650 con 0x7fa8300e9ae0 2021-04-09T18:28:12.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa82e7e6700 1 -- 172.21.15.79:0/1353580417 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8300e56d0 con 0x7fa8300f5520 2021-04-09T18:28:12.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa82e7e6700 1 --2- 172.21.15.79:0/1353580417 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8300f5520 0x7fa8300f64b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fa824001980 tx=0x7fa82000bcf0).ready entity=mon.2 client_cookie=a6d740bae05addbc server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:12.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa82d7e4700 1 -- 172.21.15.79:0/1353580417 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa8300e56d0 con 0x7fa8300f5520 2021-04-09T18:28:12.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa82d7e4700 1 -- 172.21.15.79:0/1353580417 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa820009790 con 0x7fa8300f5520 2021-04-09T18:28:12.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa82d7e4700 1 -- 172.21.15.79:0/1353580417 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa824001bb0 con 0x7fa8300f5520 2021-04-09T18:28:12.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa834b74700 1 -- 172.21.15.79:0/1353580417 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8300f5520 msgr2=0x7fa8300f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa834b74700 1 --2- 172.21.15.79:0/1353580417 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8300f5520 0x7fa8300f64b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fa824001980 tx=0x7fa82000bcf0).stop 2021-04-09T18:28:12.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa834b74700 1 -- 172.21.15.79:0/1353580417 shutdown_connections 2021-04-09T18:28:12.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa834b74700 1 --2- 172.21.15.79:0/1353580417 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8300f5520 0x7fa8300f64b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.526 7fa834b74700 1 -- 172.21.15.79:0/1353580417 >> 172.21.15.79:0/1353580417 conn(0x7fa8300e5fe0 msgr2=0x7fa8300e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:12.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.530 7fa834b74700 1 -- 172.21.15.79:0/1353580417 shutdown_connections 2021-04-09T18:28:12.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.530 7fa834b74700 1 -- 172.21.15.79:0/1353580417 wait complete. 2021-04-09T18:28:12.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.530 7fa834b74700 1 Processor -- start 2021-04-09T18:28:12.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.530 7fa834b74700 1 -- start start 2021-04-09T18:28:12.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa834b74700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8301c0180 0x7fa83019c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa834b74700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8301c05d0 0x7fa8301b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa834b74700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8301b2380 0x7fa8301b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa834b74700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8301c3dc0 con 0x7fa8301c0180 2021-04-09T18:28:12.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa834b74700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83019c430 con 0x7fa8301c05d0 2021-04-09T18:28:12.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa834b74700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83019bfc0 con 0x7fa8301b2380 2021-04-09T18:28:12.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa82e7e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8301c0180 0x7fa83019c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa82e7e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8301c0180 0x7fa83019c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57486/0 (socket says 172.21.15.79:57486) 2021-04-09T18:28:12.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa82e7e6700 1 -- 172.21.15.79:0/1273375741 learned_addr learned my addr 172.21.15.79:0/1273375741 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:12.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa82dfe5700 1 --2- 172.21.15.79:0/1273375741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8301c05d0 0x7fa8301b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa82efe7700 1 --2- 172.21.15.79:0/1273375741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8301b2380 0x7fa8301b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa82e7e6700 1 -- 172.21.15.79:0/1273375741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8301b2380 msgr2=0x7fa8301b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa82e7e6700 1 --2- 172.21.15.79:0/1273375741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8301b2380 0x7fa8301b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa82e7e6700 1 -- 172.21.15.79:0/1273375741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8301c05d0 msgr2=0x7fa8301b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa82e7e6700 1 --2- 172.21.15.79:0/1273375741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8301c05d0 0x7fa8301b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa82e7e6700 1 -- 172.21.15.79:0/1273375741 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8301a34b0 con 0x7fa8301c0180 2021-04-09T18:28:12.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa82dfe5700 1 --2- 172.21.15.79:0/1273375741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8301c05d0 0x7fa8301b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:28:12.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa82e7e6700 1 --2- 172.21.15.79:0/1273375741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8301c0180 0x7fa83019c730 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fa8300874d0 tx=0x7fa820006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:12.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa81effd700 1 -- 172.21.15.79:0/1273375741 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa8301a34b0 con 0x7fa8301c0180 2021-04-09T18:28:12.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa81effd700 1 -- 172.21.15.79:0/1273375741 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa820011c50 con 0x7fa8301c0180 2021-04-09T18:28:12.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa834b74700 1 -- 172.21.15.79:0/1273375741 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83019cd60 con 0x7fa8301c0180 2021-04-09T18:28:12.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa81effd700 1 -- 172.21.15.79:0/1273375741 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa820022020 con 0x7fa8301c0180 2021-04-09T18:28:12.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa834b74700 1 -- 172.21.15.79:0/1273375741 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8301ae950 con 0x7fa8301c0180 2021-04-09T18:28:12.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa81effd700 1 -- 172.21.15.79:0/1273375741 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa82001d640 con 0x7fa8301c0180 2021-04-09T18:28:12.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa81effd700 1 --2- 172.21.15.79:0/1273375741 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa814029100 0x7fa81402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa81effd700 1 -- 172.21.15.79:0/1273375741 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fa82003bb30 con 0x7fa8301c0180 2021-04-09T18:28:12.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa82dfe5700 1 --2- 172.21.15.79:0/1273375741 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa814029100 0x7fa81402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.534 7fa82dfe5700 1 --2- 172.21.15.79:0/1273375741 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa814029100 0x7fa81402b650 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:12.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.538 7fa834b74700 1 -- 172.21.15.79:0/1273375741 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8300e39e0 con 0x7fa8301c0180 2021-04-09T18:28:12.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.542 7fa81effd700 1 -- 172.21.15.79:0/1273375741 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa820009580 con 0x7fa8301c0180 2021-04-09T18:28:12.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.694 7fa834b74700 1 -- 172.21.15.79:0/1273375741 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa8300c4b30 con 0x7fa8301c0180 2021-04-09T18:28:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.698 7fa81effd700 1 -- 172.21.15.79:0/1273375741 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+64 (secure 0 0 0) 0x7fa820011a40 con 0x7fa8301c0180 2021-04-09T18:28:12.702 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:28:12.703 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2021-04-09T18:28:12.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:28:12.704 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2021-04-09T18:28:12.704 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": "rbd" 2021-04-09T18:28:12.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:28:12.705 INFO:teuthology.orchestra.run.smithi079.stdout:] 2021-04-09T18:28:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.698 7fa834b74700 1 -- 172.21.15.79:0/1273375741 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa814029100 msgr2=0x7fa81402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.698 7fa834b74700 1 --2- 172.21.15.79:0/1273375741 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa814029100 0x7fa81402b650 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.698 7fa834b74700 1 -- 172.21.15.79:0/1273375741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8301c0180 msgr2=0x7fa83019c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.698 7fa834b74700 1 --2- 172.21.15.79:0/1273375741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8301c0180 0x7fa83019c730 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fa8300874d0 tx=0x7fa820006890).stop 2021-04-09T18:28:12.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.698 7fa834b74700 1 -- 172.21.15.79:0/1273375741 shutdown_connections 2021-04-09T18:28:12.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.698 7fa834b74700 1 --2- 172.21.15.79:0/1273375741 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa814029100 0x7fa81402b650 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.698 7fa834b74700 1 --2- 172.21.15.79:0/1273375741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8301b2380 0x7fa8301b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.698 7fa834b74700 1 --2- 172.21.15.79:0/1273375741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8301c0180 0x7fa83019c730 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.698 7fa834b74700 1 --2- 172.21.15.79:0/1273375741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8301c05d0 0x7fa8301b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.698 7fa834b74700 1 -- 172.21.15.79:0/1273375741 >> 172.21.15.79:0/1273375741 conn(0x7fa8300baa00 msgr2=0x7fa83009a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.698 7fa834b74700 1 -- 172.21.15.79:0/1273375741 shutdown_connections 2021-04-09T18:28:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.698 7fa834b74700 1 -- 172.21.15.79:0/1273375741 wait complete. 2021-04-09T18:28:12.714 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-04-09T18:28:12.715 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-04-09T18:28:12.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.858 7f5a52277700 1 Processor -- start 2021-04-09T18:28:12.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.858 7f5a52277700 1 -- start start 2021-04-09T18:28:12.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.858 7f5a52277700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5a4c0f5550 0x7f5a4c0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.858 7f5a52277700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4c0fbb50 con 0x7f5a4c0e9b10 2021-04-09T18:28:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.858 7f5a52277700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4c09f910 con 0x7f5a4c1c8040 2021-04-09T18:28:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.858 7f5a52277700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4c0e9f60 con 0x7f5a4c0f5550 2021-04-09T18:28:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.858 7f5a4b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5a4c0e9b10 0x7f5a4c09f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52204/0 (socket says 172.21.15.79:52204) 2021-04-09T18:28:12.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.858 7f5a4b7fe700 1 -- 172.21.15.79:0/232388536 learned_addr learned my addr 172.21.15.79:0/232388536 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:28:12.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.858 7f5a4bfff700 1 --2- 172.21.15.79:0/232388536 >> v2:172.21.15.89:3300/0 conn(0x7f5a4c0f5550 0x7f5a4c0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.858 7f5a4affd700 1 -- 172.21.15.79:0/232388536 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381987929 0 0) 0x7f5a340010d0 con 0x7f5a4c0e9b10 2021-04-09T18:28:12.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.858 7f5a4affd700 1 -- 172.21.15.79:0/232388536 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a2c003240 con 0x7f5a4c0e9b10 2021-04-09T18:28:12.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.858 7f5a4affd700 1 -- 172.21.15.79:0/232388536 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866904345 0 0) 0x7f5a44001450 con 0x7f5a4c1c8040 2021-04-09T18:28:12.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.858 7f5a4affd700 1 -- 172.21.15.79:0/232388536 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a2c003620 con 0x7f5a4c1c8040 2021-04-09T18:28:12.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.858 7f5a4bfff700 1 -- 172.21.15.79:0/232388536 >> v1:172.21.15.89:6789/0 conn(0x7f5a4c1c8040 legacy=0x7f5a4c1ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.858 7f5a4affd700 1 -- 172.21.15.79:0/232388536 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2850017052 0 0) 0x7f5a34001650 con 0x7f5a4c0e9b10 2021-04-09T18:28:12.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.858 7f5a4bfff700 1 -- 172.21.15.79:0/232388536 >> v1:172.21.15.79:6789/0 conn(0x7f5a4c0e9b10 legacy=0x7f5a4c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.858 7f5a4bfff700 1 -- 172.21.15.79:0/232388536 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c0e5700 con 0x7f5a4c0f5550 2021-04-09T18:28:12.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.858 7f5a4bfff700 1 --2- 172.21.15.79:0/232388536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4c0f5550 0x7f5a4c0f64e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f5a34001980 tx=0x7f5a3c00bcc0).ready entity=mon.1 client_cookie=9024af94f0765f78 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:12.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.862 7f5a4affd700 1 -- 172.21.15.79:0/232388536 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5a4c0e5700 con 0x7f5a4c0f5550 2021-04-09T18:28:12.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.862 7f5a4affd700 1 -- 172.21.15.79:0/232388536 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c0096c0 con 0x7f5a4c0f5550 2021-04-09T18:28:12.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.862 7f5a4affd700 1 -- 172.21.15.79:0/232388536 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5a34001bb0 con 0x7f5a4c0f5550 2021-04-09T18:28:12.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.862 7f5a52277700 1 -- 172.21.15.79:0/232388536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4c0f5550 msgr2=0x7f5a4c0f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.862 7f5a52277700 1 --2- 172.21.15.79:0/232388536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4c0f5550 0x7f5a4c0f64e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f5a34001980 tx=0x7f5a3c00bcc0).stop 2021-04-09T18:28:12.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.862 7f5a52277700 1 -- 172.21.15.79:0/232388536 shutdown_connections 2021-04-09T18:28:12.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.862 7f5a52277700 1 --2- 172.21.15.79:0/232388536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4c0f5550 0x7f5a4c0f64e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.862 7f5a52277700 1 -- 172.21.15.79:0/232388536 >> 172.21.15.79:0/232388536 conn(0x7f5a4c0e6010 msgr2=0x7f5a4c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:12.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.862 7f5a52277700 1 -- 172.21.15.79:0/232388536 shutdown_connections 2021-04-09T18:28:12.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.862 7f5a52277700 1 -- 172.21.15.79:0/232388536 wait complete. 2021-04-09T18:28:12.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a52277700 1 Processor -- start 2021-04-09T18:28:12.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a52277700 1 -- start start 2021-04-09T18:28:12.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a52277700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4c097110 0x7f5a4c0d4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a52277700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a4c0d5580 0x7f5a4c1af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a52277700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a4c1afe50 0x7f5a4c1b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a52277700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c1c3df0 con 0x7f5a4c0d5580 2021-04-09T18:28:12.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a52277700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c097860 con 0x7f5a4c097110 2021-04-09T18:28:12.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a52277700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c097560 con 0x7f5a4c1afe50 2021-04-09T18:28:12.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a4b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a4c0d5580 0x7f5a4c1af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a4b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a4c0d5580 0x7f5a4c1af820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57500/0 (socket says 172.21.15.79:57500) 2021-04-09T18:28:12.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a4bfff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4c097110 0x7f5a4c0d4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a4b7fe700 1 -- 172.21.15.79:0/3904692601 learned_addr learned my addr 172.21.15.79:0/3904692601 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:12.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a5081c700 1 --2- 172.21.15.79:0/3904692601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a4c1afe50 0x7f5a4c1b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a4b7fe700 1 -- 172.21.15.79:0/3904692601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a4c1afe50 msgr2=0x7f5a4c1b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a4b7fe700 1 --2- 172.21.15.79:0/3904692601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a4c1afe50 0x7f5a4c1b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a4b7fe700 1 -- 172.21.15.79:0/3904692601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4c097110 msgr2=0x7f5a4c0d4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a4b7fe700 1 --2- 172.21.15.79:0/3904692601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4c097110 0x7f5a4c0d4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a4b7fe700 1 -- 172.21.15.79:0/3904692601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c0b09d0 con 0x7f5a4c0d5580 2021-04-09T18:28:12.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a4b7fe700 1 --2- 172.21.15.79:0/3904692601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a4c0d5580 0x7f5a4c1af820 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f5a4c0d5c60 tx=0x7f5a3400cbd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:12.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a48ff9700 1 -- 172.21.15.79:0/3904692601 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5a4c0b09d0 con 0x7f5a4c0d5580 2021-04-09T18:28:12.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a48ff9700 1 -- 172.21.15.79:0/3904692601 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a34007320 con 0x7f5a4c0d5580 2021-04-09T18:28:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a52277700 1 -- 172.21.15.79:0/3904692601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4c0aedc0 con 0x7f5a4c0d5580 2021-04-09T18:28:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a48ff9700 1 -- 172.21.15.79:0/3904692601 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5a340057e0 con 0x7f5a4c0d5580 2021-04-09T18:28:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.866 7f5a52277700 1 -- 172.21.15.79:0/3904692601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4c0af2d0 con 0x7f5a4c0d5580 2021-04-09T18:28:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.870 7f5a48ff9700 1 -- 172.21.15.79:0/3904692601 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5a3401a060 con 0x7f5a4c0d5580 2021-04-09T18:28:12.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.870 7f5a48ff9700 1 --2- 172.21.15.79:0/3904692601 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5a24029100 0x7f5a2402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.870 7f5a48ff9700 1 -- 172.21.15.79:0/3904692601 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f5a34038b50 con 0x7f5a4c0d5580 2021-04-09T18:28:12.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.870 7f5a4bfff700 1 --2- 172.21.15.79:0/3904692601 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5a24029100 0x7f5a2402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.870 7f5a4bfff700 1 --2- 172.21.15.79:0/3904692601 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5a24029100 0x7f5a2402b650 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:12.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.874 7f5a52277700 1 -- 172.21.15.79:0/3904692601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4c0e39f0 con 0x7f5a4c0d5580 2021-04-09T18:28:12.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:12.882 7f5a48ff9700 1 -- 172.21.15.79:0/3904692601 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5a34007110 con 0x7f5a4c0d5580 2021-04-09T18:28:13.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.038 7f5a52277700 1 -- 172.21.15.79:0/3904692601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f5a4c0a1c90 con 0x7f5a4c0d5580 2021-04-09T18:28:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.478 7f5a48ff9700 1 -- 172.21.15.79:0/3904692601 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v36) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5a34000bf0 con 0x7f5a4c0d5580 2021-04-09T18:28:13.508 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2021-04-09T18:28:13.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.506 7f5a52277700 1 -- 172.21.15.79:0/3904692601 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5a24029100 msgr2=0x7f5a2402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:13.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.506 7f5a52277700 1 --2- 172.21.15.79:0/3904692601 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5a24029100 0x7f5a2402b650 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:13.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.506 7f5a52277700 1 -- 172.21.15.79:0/3904692601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a4c0d5580 msgr2=0x7f5a4c1af820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:13.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.506 7f5a52277700 1 --2- 172.21.15.79:0/3904692601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a4c0d5580 0x7f5a4c1af820 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f5a4c0d5c60 tx=0x7f5a3400cbd0).stop 2021-04-09T18:28:13.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.506 7f5a52277700 1 -- 172.21.15.79:0/3904692601 shutdown_connections 2021-04-09T18:28:13.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.506 7f5a52277700 1 --2- 172.21.15.79:0/3904692601 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5a24029100 0x7f5a2402b650 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:13.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.506 7f5a52277700 1 --2- 172.21.15.79:0/3904692601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4c097110 0x7f5a4c0d4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:13.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.506 7f5a52277700 1 --2- 172.21.15.79:0/3904692601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a4c1afe50 0x7f5a4c1b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:13.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.506 7f5a52277700 1 --2- 172.21.15.79:0/3904692601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a4c0d5580 0x7f5a4c1af820 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:13.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.506 7f5a52277700 1 -- 172.21.15.79:0/3904692601 >> 172.21.15.79:0/3904692601 conn(0x7f5a4c0ba750 msgr2=0x7f5a4c0a2520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:13.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.506 7f5a52277700 1 -- 172.21.15.79:0/3904692601 shutdown_connections 2021-04-09T18:28:13.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.506 7f5a52277700 1 -- 172.21.15.79:0/3904692601 wait complete. 2021-04-09T18:28:13.525 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-04-09T18:28:13.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.618 7f3aa0659700 1 Processor -- start 2021-04-09T18:28:13.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.618 7f3aa0659700 1 -- start start 2021-04-09T18:28:13.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.618 7f3aa0659700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a980f5550 0x7f3a980f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:13.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.618 7f3aa0659700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3a981c8040 0x7f3a981ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:13.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.618 7f3aa0659700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a980fbb50 con 0x7f3a980e9b10 2021-04-09T18:28:13.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.618 7f3aa0659700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a980e9f60 con 0x7f3a981c8040 2021-04-09T18:28:13.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.618 7f3aa0659700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a981c3df0 con 0x7f3a980f5550 2021-04-09T18:28:13.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.618 7f3a9dbfc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3a980e9b10 0x7f3a9809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52216/0 (socket says 172.21.15.79:52216) 2021-04-09T18:28:13.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.618 7f3a9dbfc700 1 -- 172.21.15.79:0/1878477750 learned_addr learned my addr 172.21.15.79:0/1878477750 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:28:13.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.618 7f3a9ebfe700 1 --2- 172.21.15.79:0/1878477750 >> v2:172.21.15.89:3300/0 conn(0x7f3a981c8040 0x7f3a981ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:13.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.618 7f3a9e3fd700 1 --2- 172.21.15.79:0/1878477750 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a980f5550 0x7f3a980f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:13.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.618 7f3a9d3fb700 1 -- 172.21.15.79:0/1878477750 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060302956 0 0) 0x7f3a880010d0 con 0x7f3a980e9b10 2021-04-09T18:28:13.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.618 7f3a9d3fb700 1 -- 172.21.15.79:0/1878477750 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a84003240 con 0x7f3a980e9b10 2021-04-09T18:28:13.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.618 7f3a9ebfe700 1 -- 172.21.15.79:0/1878477750 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a980f5550 msgr2=0x7f3a980f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:13.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.618 7f3a9ebfe700 1 --2- 172.21.15.79:0/1878477750 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a980f5550 0x7f3a980f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:13.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.618 7f3a9ebfe700 1 -- 172.21.15.79:0/1878477750 >> v1:172.21.15.79:6789/0 conn(0x7f3a980e9b10 legacy=0x7f3a9809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:13.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.618 7f3a9ebfe700 1 -- 172.21.15.79:0/1878477750 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9809f910 con 0x7f3a981c8040 2021-04-09T18:28:13.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.618 7f3a9e3fd700 1 --2- 172.21.15.79:0/1878477750 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a980f5550 0x7f3a980f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:13.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.622 7f3a9ebfe700 1 --2- 172.21.15.79:0/1878477750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a981c8040 0x7f3a981ca4a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f3a900032b0 tx=0x7f3a9000b3c0).ready entity=mon.1 client_cookie=14e9693ffc54839a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:13.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.622 7f3a9d3fb700 1 -- 172.21.15.79:0/1878477750 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a9809f910 con 0x7f3a981c8040 2021-04-09T18:28:13.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.622 7f3a9d3fb700 1 -- 172.21.15.79:0/1878477750 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9000bc20 con 0x7f3a981c8040 2021-04-09T18:28:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.622 7f3a9d3fb700 1 -- 172.21.15.79:0/1878477750 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a90002020 con 0x7f3a981c8040 2021-04-09T18:28:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.622 7f3aa0659700 1 -- 172.21.15.79:0/1878477750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a981c8040 msgr2=0x7f3a981ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.622 7f3aa0659700 1 --2- 172.21.15.79:0/1878477750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a981c8040 0x7f3a981ca4a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f3a900032b0 tx=0x7f3a9000b3c0).stop 2021-04-09T18:28:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.622 7f3aa0659700 1 -- 172.21.15.79:0/1878477750 shutdown_connections 2021-04-09T18:28:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.622 7f3aa0659700 1 --2- 172.21.15.79:0/1878477750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a981c8040 0x7f3a981ca4a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:13.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.622 7f3aa0659700 1 --2- 172.21.15.79:0/1878477750 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a980f5550 0x7f3a980f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:13.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.622 7f3aa0659700 1 -- 172.21.15.79:0/1878477750 >> 172.21.15.79:0/1878477750 conn(0x7f3a980e6010 msgr2=0x7f3a980e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:13.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.622 7f3aa0659700 1 -- 172.21.15.79:0/1878477750 shutdown_connections 2021-04-09T18:28:13.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.622 7f3aa0659700 1 -- 172.21.15.79:0/1878477750 wait complete. 2021-04-09T18:28:13.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3aa0659700 1 Processor -- start 2021-04-09T18:28:13.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3aa0659700 1 -- start start 2021-04-09T18:28:13.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3aa0659700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a98099910 0x7f3a980d6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:13.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3aa0659700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a980d7ec0 0x7f3a980a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:13.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3aa0659700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a980a8bd0 0x7f3a980cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:13.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3aa0659700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9809a330 con 0x7f3a980d7ec0 2021-04-09T18:28:13.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3aa0659700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9809a630 con 0x7f3a980a8bd0 2021-04-09T18:28:13.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3aa0659700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a980d8310 con 0x7f3a98099910 2021-04-09T18:28:13.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3a9dbfc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a980d7ec0 0x7f3a980a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:13.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3a9dbfc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a980d7ec0 0x7f3a980a85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57514/0 (socket says 172.21.15.79:57514) 2021-04-09T18:28:13.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3a9dbfc700 1 -- 172.21.15.79:0/409892878 learned_addr learned my addr 172.21.15.79:0/409892878 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:13.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3a9e3fd700 1 --2- 172.21.15.79:0/409892878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a98099910 0x7f3a980d6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:13.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3a9ebfe700 1 --2- 172.21.15.79:0/409892878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a980a8bd0 0x7f3a980cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:13.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3a9dbfc700 1 -- 172.21.15.79:0/409892878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a98099910 msgr2=0x7f3a980d6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:13.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3a9dbfc700 1 --2- 172.21.15.79:0/409892878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a98099910 0x7f3a980d6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:13.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3a9dbfc700 1 -- 172.21.15.79:0/409892878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a980a8bd0 msgr2=0x7f3a980cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:13.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3a9dbfc700 1 --2- 172.21.15.79:0/409892878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a980a8bd0 0x7f3a980cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:13.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3a9dbfc700 1 -- 172.21.15.79:0/409892878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a980cfce0 con 0x7f3a980d7ec0 2021-04-09T18:28:13.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3a9dbfc700 1 --2- 172.21.15.79:0/409892878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a980d7ec0 0x7f3a980a85a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f3a88000b80 tx=0x7f3a8800cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:13.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3a8effd700 1 -- 172.21.15.79:0/409892878 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a980cfce0 con 0x7f3a980d7ec0 2021-04-09T18:28:13.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3a8effd700 1 -- 172.21.15.79:0/409892878 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a88007320 con 0x7f3a980d7ec0 2021-04-09T18:28:13.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3aa0659700 1 -- 172.21.15.79:0/409892878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a980d0000 con 0x7f3a980d7ec0 2021-04-09T18:28:13.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3a8effd700 1 -- 172.21.15.79:0/409892878 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a880057e0 con 0x7f3a980d7ec0 2021-04-09T18:28:13.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.626 7f3aa0659700 1 -- 172.21.15.79:0/409892878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a98094520 con 0x7f3a980d7ec0 2021-04-09T18:28:13.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.630 7f3a8effd700 1 -- 172.21.15.79:0/409892878 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3a8801a060 con 0x7f3a980d7ec0 2021-04-09T18:28:13.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.630 7f3a8effd700 1 --2- 172.21.15.79:0/409892878 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a80029100 0x7f3a8002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:13.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.630 7f3a8effd700 1 -- 172.21.15.79:0/409892878 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5458+0+0 (secure 0 0 0) 0x7f3a88038a60 con 0x7f3a980d7ec0 2021-04-09T18:28:13.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.630 7f3a9e3fd700 1 --2- 172.21.15.79:0/409892878 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a80029100 0x7f3a8002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:13.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.630 7f3a9e3fd700 1 --2- 172.21.15.79:0/409892878 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a80029100 0x7f3a8002b650 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:13.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.634 7f3aa0659700 1 -- 172.21.15.79:0/409892878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a980e39f0 con 0x7f3a980d7ec0 2021-04-09T18:28:13.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.638 7f3a8effd700 1 -- 172.21.15.79:0/409892878 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3a88007110 con 0x7f3a980d7ec0 2021-04-09T18:28:13.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:13.794 7f3aa0659700 1 -- 172.21.15.79:0/409892878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f3a980f5b50 con 0x7f3a980d7ec0 2021-04-09T18:28:14.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.494 7f3a8effd700 1 -- 172.21.15.79:0/409892878 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v37) v1 ==== 125+0+0 (secure 0 0 0) 0x7f3a980e5cd0 con 0x7f3a980d7ec0 2021-04-09T18:28:14.515 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2021-04-09T18:28:14.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.514 7f3aa0659700 1 -- 172.21.15.79:0/409892878 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a80029100 msgr2=0x7f3a8002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:14.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.514 7f3aa0659700 1 --2- 172.21.15.79:0/409892878 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a80029100 0x7f3a8002b650 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.514 7f3aa0659700 1 -- 172.21.15.79:0/409892878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a980d7ec0 msgr2=0x7f3a980a85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:14.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.514 7f3aa0659700 1 --2- 172.21.15.79:0/409892878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a980d7ec0 0x7f3a980a85a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f3a88000b80 tx=0x7f3a8800cab0).stop 2021-04-09T18:28:14.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.514 7f3aa0659700 1 -- 172.21.15.79:0/409892878 shutdown_connections 2021-04-09T18:28:14.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.514 7f3aa0659700 1 --2- 172.21.15.79:0/409892878 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a80029100 0x7f3a8002b650 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.514 7f3aa0659700 1 --2- 172.21.15.79:0/409892878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a980a8bd0 0x7f3a980cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.514 7f3aa0659700 1 --2- 172.21.15.79:0/409892878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a98099910 0x7f3a980d6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.514 7f3aa0659700 1 --2- 172.21.15.79:0/409892878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a980d7ec0 0x7f3a980a85a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.514 7f3aa0659700 1 -- 172.21.15.79:0/409892878 >> 172.21.15.79:0/409892878 conn(0x7f3a980d3b00 msgr2=0x7f3a980b9320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:14.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.514 7f3aa0659700 1 -- 172.21.15.79:0/409892878 shutdown_connections 2021-04-09T18:28:14.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.514 7f3aa0659700 1 -- 172.21.15.79:0/409892878 wait complete. 2021-04-09T18:28:14.530 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-04-09T18:28:14.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.618 7f15686b9700 1 Processor -- start 2021-04-09T18:28:14.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.618 7f15686b9700 1 -- start start 2021-04-09T18:28:14.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f15686b9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f15600f5550 0x7f15600f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:14.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f15686b9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f15600e9b10 0x7f156009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:14.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f15686b9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15600fbb50 con 0x7f15601c2de0 2021-04-09T18:28:14.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f15686b9700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15600e9f60 con 0x7f15600e9b10 2021-04-09T18:28:14.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f15686b9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15600e5a00 con 0x7f15600f5550 2021-04-09T18:28:14.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f1565c5c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f15600e9b10 0x7f156009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:14.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f156645d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f15600f5550 0x7f15600f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:14.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f1566c5e700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f15601c2de0 0x7f15601c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:52702/0 (socket says 172.21.15.79:52702) 2021-04-09T18:28:14.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f156645d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f15600f5550 0x7f15600f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:45862/0 (socket says 172.21.15.79:45862) 2021-04-09T18:28:14.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f1565c5c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f15600e9b10 0x7f156009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57522/0 (socket says 172.21.15.79:57522) 2021-04-09T18:28:14.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f156645d700 1 -- 172.21.15.79:0/754632826 learned_addr learned my addr 172.21.15.79:0/754632826 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:14.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f1565c5c700 1 -- 172.21.15.79:0/754632826 >> v2:172.21.15.89:3300/0 conn(0x7f15600f5550 msgr2=0x7f15600f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:14.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f1565c5c700 1 --2- 172.21.15.79:0/754632826 >> v2:172.21.15.89:3300/0 conn(0x7f15600f5550 0x7f15600f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f1565c5c700 1 -- 172.21.15.79:0/754632826 >> v1:172.21.15.89:6789/0 conn(0x7f15601c2de0 legacy=0x7f15601c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:14.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f156545b700 1 -- 172.21.15.79:0/754632826 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224239871 0 0) 0x7f15580010d0 con 0x7f15601c2de0 2021-04-09T18:28:14.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f1565c5c700 1 -- 172.21.15.79:0/754632826 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15600e5700 con 0x7f15600e9b10 2021-04-09T18:28:14.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f156645d700 1 --2- 172.21.15.79:0/754632826 >> v2:172.21.15.89:3300/0 conn(0x7f15600f5550 0x7f15600f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:14.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f1565c5c700 1 --2- 172.21.15.79:0/754632826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15600e9b10 0x7f156009f110 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f155c002f30 tx=0x7f155c00bd10).ready entity=mon.0 client_cookie=f8527e18fe630f14 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:14.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f156545b700 1 -- 172.21.15.79:0/754632826 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f15600e5700 con 0x7f15600e9b10 2021-04-09T18:28:14.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f156545b700 1 -- 172.21.15.79:0/754632826 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c0098a0 con 0x7f15600e9b10 2021-04-09T18:28:14.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f156545b700 1 -- 172.21.15.79:0/754632826 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f155c009c70 con 0x7f15600e9b10 2021-04-09T18:28:14.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f15686b9700 1 -- 172.21.15.79:0/754632826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15600e9b10 msgr2=0x7f156009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:14.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f15686b9700 1 --2- 172.21.15.79:0/754632826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15600e9b10 0x7f156009f110 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f155c002f30 tx=0x7f155c00bd10).stop 2021-04-09T18:28:14.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.622 7f15686b9700 1 -- 172.21.15.79:0/754632826 shutdown_connections 2021-04-09T18:28:14.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.626 7f15686b9700 1 --2- 172.21.15.79:0/754632826 >> v2:172.21.15.89:3300/0 conn(0x7f15600f5550 0x7f15600f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.626 7f15686b9700 1 --2- 172.21.15.79:0/754632826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15600e9b10 0x7f156009f110 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.626 7f15686b9700 1 -- 172.21.15.79:0/754632826 >> 172.21.15.79:0/754632826 conn(0x7f15600e6010 msgr2=0x7f15600e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:14.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.626 7f15686b9700 1 -- 172.21.15.79:0/754632826 shutdown_connections 2021-04-09T18:28:14.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.626 7f15686b9700 1 -- 172.21.15.79:0/754632826 wait complete. 2021-04-09T18:28:14.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.626 7f15686b9700 1 Processor -- start 2021-04-09T18:28:14.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f15686b9700 1 -- start start 2021-04-09T18:28:14.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f15686b9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1560093f80 0x7f1560090fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:14.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f15686b9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1560099ad0 0x7f1560099f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:14.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f15686b9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f156009a550 0x7f15600ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:14.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f15686b9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15600e8b20 con 0x7f1560093f80 2021-04-09T18:28:14.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f15686b9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1560090cc0 con 0x7f1560099ad0 2021-04-09T18:28:14.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f15686b9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15600d6cd0 con 0x7f156009a550 2021-04-09T18:28:14.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f156645d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1560093f80 0x7f1560090fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:14.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f156645d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1560093f80 0x7f1560090fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57526/0 (socket says 172.21.15.79:57526) 2021-04-09T18:28:14.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f156645d700 1 -- 172.21.15.79:0/252260188 learned_addr learned my addr 172.21.15.79:0/252260188 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:14.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f1565c5c700 1 --2- 172.21.15.79:0/252260188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1560099ad0 0x7f1560099f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:14.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f1566c5e700 1 --2- 172.21.15.79:0/252260188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f156009a550 0x7f15600ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:14.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f156645d700 1 -- 172.21.15.79:0/252260188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f156009a550 msgr2=0x7f15600ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:14.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f156645d700 1 --2- 172.21.15.79:0/252260188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f156009a550 0x7f15600ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f156645d700 1 -- 172.21.15.79:0/252260188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1560099ad0 msgr2=0x7f1560099f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:14.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f156645d700 1 --2- 172.21.15.79:0/252260188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1560099ad0 0x7f1560099f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f156645d700 1 -- 172.21.15.79:0/252260188 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1560090850 con 0x7f1560093f80 2021-04-09T18:28:14.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f156645d700 1 --2- 172.21.15.79:0/252260188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1560093f80 0x7f1560090fc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f15600b99f0 tx=0x7f155000c650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:14.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f1556ffd700 1 -- 172.21.15.79:0/252260188 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1560090850 con 0x7f1560093f80 2021-04-09T18:28:14.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f1556ffd700 1 -- 172.21.15.79:0/252260188 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15500123f0 con 0x7f1560093f80 2021-04-09T18:28:14.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f15686b9700 1 -- 172.21.15.79:0/252260188 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15600cea20 con 0x7f1560093f80 2021-04-09T18:28:14.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f1556ffd700 1 -- 172.21.15.79:0/252260188 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f155000f040 con 0x7f1560093f80 2021-04-09T18:28:14.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.630 7f15686b9700 1 -- 172.21.15.79:0/252260188 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15600ceef0 con 0x7f1560093f80 2021-04-09T18:28:14.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.634 7f1556ffd700 1 -- 172.21.15.79:0/252260188 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1550011070 con 0x7f1560093f80 2021-04-09T18:28:14.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.634 7f1556ffd700 1 --2- 172.21.15.79:0/252260188 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1540029100 0x7f154002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:14.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.634 7f1556ffd700 1 -- 172.21.15.79:0/252260188 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f1550003020 con 0x7f1560093f80 2021-04-09T18:28:14.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.634 7f1565c5c700 1 --2- 172.21.15.79:0/252260188 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1540029100 0x7f154002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:14.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.634 7f1565c5c700 1 --2- 172.21.15.79:0/252260188 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1540029100 0x7f154002b650 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:14.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.634 7f15686b9700 1 -- 172.21.15.79:0/252260188 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15600e39f0 con 0x7f1560093f80 2021-04-09T18:28:14.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.642 7f1556ffd700 1 -- 172.21.15.79:0/252260188 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f155000ccb0 con 0x7f1560093f80 2021-04-09T18:28:14.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.806 7f15686b9700 1 -- 172.21.15.79:0/252260188 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f15600f5b50 con 0x7f1560093f80 2021-04-09T18:28:14.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.814 7f1556ffd700 1 -- 172.21.15.79:0/252260188 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 6 and data pool 7 v15) v1 ==== 187+0+0 (secure 0 0 0) 0x7f1550000f70 con 0x7f1560093f80 2021-04-09T18:28:14.819 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 6 and data pool 7 2021-04-09T18:28:14.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.818 7f15686b9700 1 -- 172.21.15.79:0/252260188 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1540029100 msgr2=0x7f154002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:14.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.818 7f15686b9700 1 --2- 172.21.15.79:0/252260188 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1540029100 0x7f154002b650 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.818 7f15686b9700 1 -- 172.21.15.79:0/252260188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1560093f80 msgr2=0x7f1560090fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:14.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.818 7f15686b9700 1 --2- 172.21.15.79:0/252260188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1560093f80 0x7f1560090fc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f15600b99f0 tx=0x7f155000c650).stop 2021-04-09T18:28:14.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.818 7f15686b9700 1 -- 172.21.15.79:0/252260188 shutdown_connections 2021-04-09T18:28:14.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.818 7f15686b9700 1 --2- 172.21.15.79:0/252260188 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1540029100 0x7f154002b650 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.818 7f15686b9700 1 --2- 172.21.15.79:0/252260188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f156009a550 0x7f15600ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.818 7f15686b9700 1 --2- 172.21.15.79:0/252260188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1560093f80 0x7f1560090fc0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.818 7f15686b9700 1 --2- 172.21.15.79:0/252260188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1560099ad0 0x7f1560099f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.818 7f15686b9700 1 -- 172.21.15.79:0/252260188 >> 172.21.15.79:0/252260188 conn(0x7f15600935f0 msgr2=0x7f15600d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:14.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.818 7f15686b9700 1 -- 172.21.15.79:0/252260188 shutdown_connections 2021-04-09T18:28:14.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.818 7f15686b9700 1 -- 172.21.15.79:0/252260188 wait complete. 2021-04-09T18:28:14.839 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:28:14.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.922 7f3245019700 1 Processor -- start 2021-04-09T18:28:14.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.922 7f3245019700 1 -- start start 2021-04-09T18:28:14.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.922 7f3245019700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f32400f5510 0x7f32400f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:14.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.922 7f3245019700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f32401c8000 0x7f32401ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:14.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.922 7f3245019700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32400fbb10 con 0x7f32400e9ad0 2021-04-09T18:28:14.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.922 7f3245019700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32400e9f20 con 0x7f32400f5510 2021-04-09T18:28:14.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.922 7f3245019700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32401c3db0 con 0x7f32401c8000 2021-04-09T18:28:14.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.922 7f323ed9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f32400f5510 0x7f32400f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:14.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.922 7f323ed9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f32400f5510 0x7f32400f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57534/0 (socket says 172.21.15.79:57534) 2021-04-09T18:28:14.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.922 7f323ed9d700 1 -- 172.21.15.79:0/1866795659 learned_addr learned my addr 172.21.15.79:0/1866795659 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:14.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.922 7f323f59e700 1 --2- 172.21.15.79:0/1866795659 >> v2:172.21.15.89:3300/0 conn(0x7f32401c8000 0x7f32401ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:14.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.922 7f323ed9d700 1 -- 172.21.15.79:0/1866795659 >> v2:172.21.15.89:3300/0 conn(0x7f32401c8000 msgr2=0x7f32401ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:14.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.922 7f323ed9d700 1 --2- 172.21.15.79:0/1866795659 >> v2:172.21.15.89:3300/0 conn(0x7f32401c8000 0x7f32401ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.922 7f323ed9d700 1 -- 172.21.15.79:0/1866795659 >> v1:172.21.15.79:6789/0 conn(0x7f32400e9ad0 legacy=0x7f324009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:14.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.922 7f323ed9d700 1 -- 172.21.15.79:0/1866795659 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324009f900 con 0x7f32400f5510 2021-04-09T18:28:14.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.922 7f323ed9d700 1 --2- 172.21.15.79:0/1866795659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32400f5510 0x7f32400f64a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f3230002f30 tx=0x7f323000bd70).ready entity=mon.0 client_cookie=6f811f5d4e61a426 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:14.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.926 7f323e59c700 1 -- 172.21.15.79:0/1866795659 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f324009f900 con 0x7f32400f5510 2021-04-09T18:28:14.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.926 7f323e59c700 1 -- 172.21.15.79:0/1866795659 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3230009950 con 0x7f32400f5510 2021-04-09T18:28:14.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.926 7f323e59c700 1 -- 172.21.15.79:0/1866795659 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3230009d20 con 0x7f32400f5510 2021-04-09T18:28:14.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.926 7f3245019700 1 -- 172.21.15.79:0/1866795659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32400f5510 msgr2=0x7f32400f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:14.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.926 7f3245019700 1 --2- 172.21.15.79:0/1866795659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32400f5510 0x7f32400f64a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f3230002f30 tx=0x7f323000bd70).stop 2021-04-09T18:28:14.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.930 7f3245019700 1 -- 172.21.15.79:0/1866795659 shutdown_connections 2021-04-09T18:28:14.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.930 7f3245019700 1 --2- 172.21.15.79:0/1866795659 >> v2:172.21.15.89:3300/0 conn(0x7f32401c8000 0x7f32401ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.930 7f3245019700 1 --2- 172.21.15.79:0/1866795659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32400f5510 0x7f32400f64a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.930 7f3245019700 1 -- 172.21.15.79:0/1866795659 >> 172.21.15.79:0/1866795659 conn(0x7f32400e5fd0 msgr2=0x7f32400e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:14.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.930 7f3245019700 1 -- 172.21.15.79:0/1866795659 shutdown_connections 2021-04-09T18:28:14.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.930 7f3245019700 1 -- 172.21.15.79:0/1866795659 wait complete. 2021-04-09T18:28:14.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.930 7f3245019700 1 Processor -- start 2021-04-09T18:28:14.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.930 7f3245019700 1 -- start start 2021-04-09T18:28:14.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f3245019700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32400bba90 0x7f32400d5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:14.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f3245019700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32400d5850 0x7f32400bff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:14.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f3245019700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32400b0200 0x7f32400c0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:14.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f3245019700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32400bfc50 con 0x7f32400bba90 2021-04-09T18:28:14.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f3245019700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32400bf130 con 0x7f32400b0200 2021-04-09T18:28:14.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f3245019700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32400bf4e0 con 0x7f32400d5850 2021-04-09T18:28:14.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f323ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32400bba90 0x7f32400d5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:14.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f323ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32400bba90 0x7f32400d5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57540/0 (socket says 172.21.15.79:57540) 2021-04-09T18:28:14.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f323ed9d700 1 -- 172.21.15.79:0/3716837908 learned_addr learned my addr 172.21.15.79:0/3716837908 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:14.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f3237fff700 1 --2- 172.21.15.79:0/3716837908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32400d5850 0x7f32400bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:14.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f323f59e700 1 --2- 172.21.15.79:0/3716837908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32400b0200 0x7f32400c0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:14.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f323ed9d700 1 -- 172.21.15.79:0/3716837908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32400d5850 msgr2=0x7f32400bff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:14.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f323ed9d700 1 --2- 172.21.15.79:0/3716837908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32400d5850 0x7f32400bff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f323ed9d700 1 -- 172.21.15.79:0/3716837908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32400b0200 msgr2=0x7f32400c0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:14.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f323ed9d700 1 --2- 172.21.15.79:0/3716837908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32400b0200 0x7f32400c0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f323ed9d700 1 -- 172.21.15.79:0/3716837908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32401ae350 con 0x7f32400bba90 2021-04-09T18:28:14.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f323ed9d700 1 --2- 172.21.15.79:0/3716837908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32400bba90 0x7f32400d5220 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f3230002f30 tx=0x7f3230006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:14.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f32377fe700 1 -- 172.21.15.79:0/3716837908 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f32401ae350 con 0x7f32400bba90 2021-04-09T18:28:14.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f32377fe700 1 -- 172.21.15.79:0/3716837908 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3230011c10 con 0x7f32400bba90 2021-04-09T18:28:14.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f32377fe700 1 -- 172.21.15.79:0/3716837908 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f323001d440 con 0x7f32400bba90 2021-04-09T18:28:14.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f3245019700 1 -- 172.21.15.79:0/3716837908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32400c0bb0 con 0x7f32400bba90 2021-04-09T18:28:14.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f3245019700 1 -- 172.21.15.79:0/3716837908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32400bbfc0 con 0x7f32400bba90 2021-04-09T18:28:14.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f32377fe700 1 -- 172.21.15.79:0/3716837908 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3230026450 con 0x7f32400bba90 2021-04-09T18:28:14.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f32377fe700 1 --2- 172.21.15.79:0/3716837908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3224029100 0x7f322402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:14.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f32377fe700 1 -- 172.21.15.79:0/3716837908 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f323003af30 con 0x7f32400bba90 2021-04-09T18:28:14.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f3237fff700 1 --2- 172.21.15.79:0/3716837908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3224029100 0x7f322402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:14.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.934 7f3237fff700 1 --2- 172.21.15.79:0/3716837908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3224029100 0x7f322402b650 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:14.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.950 7f3245019700 1 -- 172.21.15.79:0/3716837908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32400e39d0 con 0x7f32400bba90 2021-04-09T18:28:14.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:14.954 7f32377fe700 1 -- 172.21.15.79:0/3716837908 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3230011a00 con 0x7f32400bba90 2021-04-09T18:28:15.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.118 7f3245019700 1 -- 172.21.15.79:0/3716837908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32400a1cb0 con 0x7f32400bba90 2021-04-09T18:28:15.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.122 7f32377fe700 1 -- 172.21.15.79:0/3716837908 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+14345 (secure 0 0 0) 0x7f3230009740 con 0x7f32400bba90 2021-04-09T18:28:15.127 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:28:15.128 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:28:14.925421","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:28:13.096102","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2021-04-09 18:28:13.852981","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.79:6833/3417656822":"2021-04-10 18:28:14.914231","172.21.15.79:6832/3417656822":"2021-04-10 18:28:14.914231"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:28:15.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.126 7f3245019700 1 -- 172.21.15.79:0/3716837908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3224029100 msgr2=0x7f322402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:15.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.126 7f3245019700 1 --2- 172.21.15.79:0/3716837908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3224029100 0x7f322402b650 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.126 7f3245019700 1 -- 172.21.15.79:0/3716837908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32400bba90 msgr2=0x7f32400d5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:15.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.126 7f3245019700 1 --2- 172.21.15.79:0/3716837908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32400bba90 0x7f32400d5220 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f3230002f30 tx=0x7f3230006890).stop 2021-04-09T18:28:15.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.126 7f3245019700 1 -- 172.21.15.79:0/3716837908 shutdown_connections 2021-04-09T18:28:15.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.126 7f3245019700 1 --2- 172.21.15.79:0/3716837908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3224029100 0x7f322402b650 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.126 7f3245019700 1 --2- 172.21.15.79:0/3716837908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32400b0200 0x7f32400c0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.126 7f3245019700 1 --2- 172.21.15.79:0/3716837908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32400bba90 0x7f32400d5220 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.126 7f3245019700 1 --2- 172.21.15.79:0/3716837908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32400d5850 0x7f32400bff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.126 7f3245019700 1 -- 172.21.15.79:0/3716837908 >> 172.21.15.79:0/3716837908 conn(0x7f324009a340 msgr2=0x7f32400d84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:15.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.126 7f3245019700 1 -- 172.21.15.79:0/3716837908 shutdown_connections 2021-04-09T18:28:15.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.126 7f3245019700 1 -- 172.21.15.79:0/3716837908 wait complete. 2021-04-09T18:28:15.141 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:28:15.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.226 7fc0251ef700 1 Processor -- start 2021-04-09T18:28:15.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.226 7fc0251ef700 1 -- start start 2021-04-09T18:28:15.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc0251ef700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc0200e9ad0 0x7fc02009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc0251ef700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc0201c8000 0x7fc0201ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc0251ef700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0200fbb10 con 0x7fc0200f5510 2021-04-09T18:28:15.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc0251ef700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0201c3db0 con 0x7fc0201c8000 2021-04-09T18:28:15.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc0251ef700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0200e9f20 con 0x7fc0200e9ad0 2021-04-09T18:28:15.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc01f59e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc0201c8000 0x7fc0201ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc01f59e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc0201c8000 0x7fc0201ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57552/0 (socket says 172.21.15.79:57552) 2021-04-09T18:28:15.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc01f59e700 1 -- 172.21.15.79:0/2662969818 learned_addr learned my addr 172.21.15.79:0/2662969818 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:15.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc01659c700 1 --2- 172.21.15.79:0/2662969818 >> v2:172.21.15.89:3300/0 conn(0x7fc0200e9ad0 0x7fc02009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc01f59e700 1 -- 172.21.15.79:0/2662969818 >> v2:172.21.15.89:3300/0 conn(0x7fc0200e9ad0 msgr2=0x7fc02009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:15.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc01f59e700 1 --2- 172.21.15.79:0/2662969818 >> v2:172.21.15.89:3300/0 conn(0x7fc0200e9ad0 0x7fc02009f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc01f59e700 1 -- 172.21.15.79:0/2662969818 >> v1:172.21.15.89:6789/0 conn(0x7fc0200f5510 legacy=0x7fc0200f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:15.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc01f59e700 1 -- 172.21.15.79:0/2662969818 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0200e56c0 con 0x7fc0201c8000 2021-04-09T18:28:15.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc01f59e700 1 --2- 172.21.15.79:0/2662969818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0201c8000 0x7fc0201ca460 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fc0180032b0 tx=0x7fc01800b3c0).ready entity=mon.0 client_cookie=5c4c138f9c01bce6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:15.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc01e59c700 1 -- 172.21.15.79:0/2662969818 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc0200e56c0 con 0x7fc0201c8000 2021-04-09T18:28:15.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc01e59c700 1 -- 172.21.15.79:0/2662969818 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01800bc20 con 0x7fc0201c8000 2021-04-09T18:28:15.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc01e59c700 1 -- 172.21.15.79:0/2662969818 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc018002020 con 0x7fc0201c8000 2021-04-09T18:28:15.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc0251ef700 1 -- 172.21.15.79:0/2662969818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0201c8000 msgr2=0x7fc0201ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:15.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc0251ef700 1 --2- 172.21.15.79:0/2662969818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0201c8000 0x7fc0201ca460 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fc0180032b0 tx=0x7fc01800b3c0).stop 2021-04-09T18:28:15.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc0251ef700 1 -- 172.21.15.79:0/2662969818 shutdown_connections 2021-04-09T18:28:15.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc0251ef700 1 --2- 172.21.15.79:0/2662969818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0201c8000 0x7fc0201ca460 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc0251ef700 1 --2- 172.21.15.79:0/2662969818 >> v2:172.21.15.89:3300/0 conn(0x7fc0200e9ad0 0x7fc02009f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc0251ef700 1 -- 172.21.15.79:0/2662969818 >> 172.21.15.79:0/2662969818 conn(0x7fc0200e5fd0 msgr2=0x7fc0200e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:15.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc0251ef700 1 -- 172.21.15.79:0/2662969818 shutdown_connections 2021-04-09T18:28:15.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.230 7fc0251ef700 1 -- 172.21.15.79:0/2662969818 wait complete. 2021-04-09T18:28:15.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc0251ef700 1 Processor -- start 2021-04-09T18:28:15.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc0251ef700 1 -- start start 2021-04-09T18:28:15.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc0251ef700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0200d61d0 0x7fc0201a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc0251ef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0200ba9d0 0x7fc0200d5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc0251ef700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0200bae20 0x7fc0200d2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc0251ef700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0200b9150 con 0x7fc0200ba9d0 2021-04-09T18:28:15.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc0251ef700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0200b9450 con 0x7fc0200bae20 2021-04-09T18:28:15.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc0251ef700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0201a5890 con 0x7fc0200d61d0 2021-04-09T18:28:15.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc01659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0200ba9d0 0x7fc0200d5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc01659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0200ba9d0 0x7fc0200d5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57556/0 (socket says 172.21.15.79:57556) 2021-04-09T18:28:15.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc01659c700 1 -- 172.21.15.79:0/1652458126 learned_addr learned my addr 172.21.15.79:0/1652458126 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:15.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc01ed9d700 1 --2- 172.21.15.79:0/1652458126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0200d61d0 0x7fc0201a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc01f59e700 1 --2- 172.21.15.79:0/1652458126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0200bae20 0x7fc0200d2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc01659c700 1 -- 172.21.15.79:0/1652458126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0200d61d0 msgr2=0x7fc0201a5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:15.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc01659c700 1 --2- 172.21.15.79:0/1652458126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0200d61d0 0x7fc0201a5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc01659c700 1 -- 172.21.15.79:0/1652458126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0200bae20 msgr2=0x7fc0200d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:15.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc01659c700 1 --2- 172.21.15.79:0/1652458126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0200bae20 0x7fc0200d2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc01659c700 1 -- 172.21.15.79:0/1652458126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc020090a80 con 0x7fc0200ba9d0 2021-04-09T18:28:15.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc01ed9d700 1 --2- 172.21.15.79:0/1652458126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0200d61d0 0x7fc0201a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:15.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc01659c700 1 --2- 172.21.15.79:0/1652458126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0200ba9d0 0x7fc0200d5740 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fc00800a000 tx=0x7fc00800dd20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:15.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc017fff700 1 -- 172.21.15.79:0/1652458126 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc020090a80 con 0x7fc0200ba9d0 2021-04-09T18:28:15.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc017fff700 1 -- 172.21.15.79:0/1652458126 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0080098f0 con 0x7fc0200ba9d0 2021-04-09T18:28:15.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc0251ef700 1 -- 172.21.15.79:0/1652458126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0200d5d70 con 0x7fc0200ba9d0 2021-04-09T18:28:15.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc017fff700 1 -- 172.21.15.79:0/1652458126 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc00800f040 con 0x7fc0200ba9d0 2021-04-09T18:28:15.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.234 7fc0251ef700 1 -- 172.21.15.79:0/1652458126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0200d2b30 con 0x7fc0200ba9d0 2021-04-09T18:28:15.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.238 7fc017fff700 1 -- 172.21.15.79:0/1652458126 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc008009cc0 con 0x7fc0200ba9d0 2021-04-09T18:28:15.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.238 7fc017fff700 1 --2- 172.21.15.79:0/1652458126 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc004029100 0x7fc00402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.238 7fc017fff700 1 -- 172.21.15.79:0/1652458126 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fc008010070 con 0x7fc0200ba9d0 2021-04-09T18:28:15.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.238 7fc01ed9d700 1 --2- 172.21.15.79:0/1652458126 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc004029100 0x7fc00402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.238 7fc01ed9d700 1 --2- 172.21.15.79:0/1652458126 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc004029100 0x7fc00402b650 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:15.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.242 7fc0251ef700 1 -- 172.21.15.79:0/1652458126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0200e39d0 con 0x7fc0200ba9d0 2021-04-09T18:28:15.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.246 7fc017fff700 1 -- 172.21.15.79:0/1652458126 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc0080094f0 con 0x7fc0200ba9d0 2021-04-09T18:28:15.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.410 7fc0251ef700 1 -- 172.21.15.79:0/1652458126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0200a1cb0 con 0x7fc0200ba9d0 2021-04-09T18:28:15.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.414 7fc017fff700 1 -- 172.21.15.79:0/1652458126 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+14345 (secure 0 0 0) 0x7fc008000bf0 con 0x7fc0200ba9d0 2021-04-09T18:28:15.418 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:28:15.418 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:28:14.925421","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:28:13.096102","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2021-04-09 18:28:13.852981","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.79:6833/3417656822":"2021-04-10 18:28:14.914231","172.21.15.79:6832/3417656822":"2021-04-10 18:28:14.914231"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:28:15.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.414 7fc0251ef700 1 -- 172.21.15.79:0/1652458126 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc004029100 msgr2=0x7fc00402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:15.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.414 7fc0251ef700 1 --2- 172.21.15.79:0/1652458126 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc004029100 0x7fc00402b650 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.414 7fc0251ef700 1 -- 172.21.15.79:0/1652458126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0200ba9d0 msgr2=0x7fc0200d5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:15.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.414 7fc0251ef700 1 --2- 172.21.15.79:0/1652458126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0200ba9d0 0x7fc0200d5740 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fc00800a000 tx=0x7fc00800dd20).stop 2021-04-09T18:28:15.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.418 7fc0251ef700 1 -- 172.21.15.79:0/1652458126 shutdown_connections 2021-04-09T18:28:15.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.418 7fc0251ef700 1 --2- 172.21.15.79:0/1652458126 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc004029100 0x7fc00402b650 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.418 7fc0251ef700 1 --2- 172.21.15.79:0/1652458126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0200bae20 0x7fc0200d2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.418 7fc0251ef700 1 --2- 172.21.15.79:0/1652458126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0200d61d0 0x7fc0201a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.418 7fc0251ef700 1 --2- 172.21.15.79:0/1652458126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0200ba9d0 0x7fc0200d5740 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.418 7fc0251ef700 1 -- 172.21.15.79:0/1652458126 >> 172.21.15.79:0/1652458126 conn(0x7fc020096820 msgr2=0x7fc020094940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:15.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.418 7fc0251ef700 1 -- 172.21.15.79:0/1652458126 shutdown_connections 2021-04-09T18:28:15.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.418 7fc0251ef700 1 -- 172.21.15.79:0/1652458126 wait complete. 2021-04-09T18:28:15.431 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-04-09T18:28:15.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.518 7f84c44d7700 1 Processor -- start 2021-04-09T18:28:15.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.518 7f84c44d7700 1 -- start start 2021-04-09T18:28:15.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c44d7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84bc0e9b10 0x7f84bc09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c44d7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f84bc1c8040 0x7f84bc1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c44d7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc0fbb50 con 0x7f84bc0f5550 2021-04-09T18:28:15.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c44d7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc1c3df0 con 0x7f84bc1c8040 2021-04-09T18:28:15.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c44d7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0e9f60 con 0x7f84bc0e9b10 2021-04-09T18:28:15.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c227b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f84bc0f5550 0x7f84bc0f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52272/0 (socket says 172.21.15.79:52272) 2021-04-09T18:28:15.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c227b700 1 -- 172.21.15.79:0/3383944348 learned_addr learned my addr 172.21.15.79:0/3383944348 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:28:15.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1a7a700 1 --2- 172.21.15.79:0/3383944348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84bc0e9b10 0x7f84bc09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c2a7c700 1 --2- 172.21.15.79:0/3383944348 >> v2:172.21.15.89:3300/0 conn(0x7f84bc1c8040 0x7f84bc1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1279700 1 -- 172.21.15.79:0/3383944348 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079950588 0 0) 0x7f84b80010d0 con 0x7f84bc0f5550 2021-04-09T18:28:15.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1279700 1 -- 172.21.15.79:0/3383944348 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84a8003240 con 0x7f84bc0f5550 2021-04-09T18:28:15.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1279700 1 -- 172.21.15.79:0/3383944348 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1442853448 0 0) 0x7f84b8001650 con 0x7f84bc0f5550 2021-04-09T18:28:15.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1279700 1 -- 172.21.15.79:0/3383944348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84bc0e9b10 msgr2=0x7f84bc09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:15.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1279700 1 --2- 172.21.15.79:0/3383944348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84bc0e9b10 0x7f84bc09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1279700 1 -- 172.21.15.79:0/3383944348 >> v2:172.21.15.89:3300/0 conn(0x7f84bc1c8040 msgr2=0x7f84bc1ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:15.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1279700 1 --2- 172.21.15.79:0/3383944348 >> v2:172.21.15.89:3300/0 conn(0x7f84bc1c8040 0x7f84bc1ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1279700 1 -- 172.21.15.79:0/3383944348 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc0e5700 con 0x7f84bc0f5550 2021-04-09T18:28:15.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1279700 1 -- 172.21.15.79:0/3383944348 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f84b8001bb0 con 0x7f84bc0f5550 2021-04-09T18:28:15.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1279700 1 -- 172.21.15.79:0/3383944348 >> v1:172.21.15.79:6789/0 conn(0x7f84bc0f5550 legacy=0x7f84bc0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:15.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1279700 1 --2- 172.21.15.79:0/3383944348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84a80038c0 0x7f84a8003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1279700 1 --2- 172.21.15.79:0/3383944348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a80045a0 0x7f84a80049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1279700 1 --2- 172.21.15.79:0/3383944348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84a8005020 0x7f84a804f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1279700 1 -- 172.21.15.79:0/3383944348 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc1c3df0 con 0x7f84a8005020 2021-04-09T18:28:15.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1279700 1 -- 172.21.15.79:0/3383944348 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0e9f60 con 0x7f84a80045a0 2021-04-09T18:28:15.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1279700 1 -- 172.21.15.79:0/3383944348 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a804ffa0 con 0x7f84a80038c0 2021-04-09T18:28:15.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c2a7c700 1 --2- 172.21.15.79:0/3383944348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84a8005020 0x7f84a804f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c227b700 1 --2- 172.21.15.79:0/3383944348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84a80038c0 0x7f84a8003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1a7a700 1 --2- 172.21.15.79:0/3383944348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a80045a0 0x7f84a80049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c2a7c700 1 -- 172.21.15.79:0/3383944348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84a80038c0 msgr2=0x7f84a8003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:15.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c2a7c700 1 --2- 172.21.15.79:0/3383944348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84a80038c0 0x7f84a8003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c2a7c700 1 -- 172.21.15.79:0/3383944348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a80045a0 msgr2=0x7f84a80049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:15.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c2a7c700 1 --2- 172.21.15.79:0/3383944348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a80045a0 0x7f84a80049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c2a7c700 1 -- 172.21.15.79:0/3383944348 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a8050290 con 0x7f84a8005020 2021-04-09T18:28:15.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c2a7c700 1 --2- 172.21.15.79:0/3383944348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84a8005020 0x7f84a804f800 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f84b400c000 tx=0x7f84b400e4b0).ready entity=mon.0 client_cookie=441a5c682ce93a84 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:15.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1279700 1 -- 172.21.15.79:0/3383944348 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f84a8050290 con 0x7f84a8005020 2021-04-09T18:28:15.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1279700 1 -- 172.21.15.79:0/3383944348 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b400ed20 con 0x7f84a8005020 2021-04-09T18:28:15.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c44d7700 1 -- 172.21.15.79:0/3383944348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84a8005020 msgr2=0x7f84a804f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:15.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c1279700 1 -- 172.21.15.79:0/3383944348 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f84b400f040 con 0x7f84a8005020 2021-04-09T18:28:15.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c44d7700 1 --2- 172.21.15.79:0/3383944348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84a8005020 0x7f84a804f800 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f84b400c000 tx=0x7f84b400e4b0).stop 2021-04-09T18:28:15.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c2a7c700 1 -- 172.21.15.79:0/3383944348 reap_dead start 2021-04-09T18:28:15.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c44d7700 1 -- 172.21.15.79:0/3383944348 shutdown_connections 2021-04-09T18:28:15.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c44d7700 1 -- 172.21.15.79:0/3383944348 >> 172.21.15.79:0/3383944348 conn(0x7f84bc0e6010 msgr2=0x7f84bc0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:15.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c44d7700 1 -- 172.21.15.79:0/3383944348 shutdown_connections 2021-04-09T18:28:15.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.522 7f84c44d7700 1 -- 172.21.15.79:0/3383944348 wait complete. 2021-04-09T18:28:15.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.526 7f84c44d7700 1 Processor -- start 2021-04-09T18:28:15.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.526 7f84c44d7700 1 -- start start 2021-04-09T18:28:15.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.526 7f84c44d7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84bc0c0640 0x7f84bc0966b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.526 7f84c44d7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84bc1a05b0 0x7f84bc096eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.526 7f84c44d7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84bc19dc80 0x7f84bc0d2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.526 7f84c44d7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc047500 con 0x7f84bc19dc80 2021-04-09T18:28:15.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.526 7f84c44d7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc19f030 con 0x7f84bc0c0640 2021-04-09T18:28:15.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.526 7f84c44d7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc1a0a00 con 0x7f84bc1a05b0 2021-04-09T18:28:15.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.526 7f84c2a7c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84bc19dc80 0x7f84bc0d2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.526 7f84c2a7c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84bc19dc80 0x7f84bc0d2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57578/0 (socket says 172.21.15.79:57578) 2021-04-09T18:28:15.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.526 7f84c2a7c700 1 -- 172.21.15.79:0/2825571079 learned_addr learned my addr 172.21.15.79:0/2825571079 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:15.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.526 7f84c1a7a700 1 --2- 172.21.15.79:0/2825571079 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84bc1a05b0 0x7f84bc096eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.526 7f84c227b700 1 --2- 172.21.15.79:0/2825571079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84bc0c0640 0x7f84bc0966b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.526 7f84c2a7c700 1 -- 172.21.15.79:0/2825571079 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84bc1a05b0 msgr2=0x7f84bc096eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:15.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.526 7f84c2a7c700 1 --2- 172.21.15.79:0/2825571079 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84bc1a05b0 0x7f84bc096eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.526 7f84c2a7c700 1 -- 172.21.15.79:0/2825571079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84bc0c0640 msgr2=0x7f84bc0966b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:15.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.526 7f84c2a7c700 1 --2- 172.21.15.79:0/2825571079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84bc0c0640 0x7f84bc0966b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.526 7f84c2a7c700 1 -- 172.21.15.79:0/2825571079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc0bb620 con 0x7f84bc19dc80 2021-04-09T18:28:15.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.526 7f84c2a7c700 1 --2- 172.21.15.79:0/2825571079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84bc19dc80 0x7f84bc0d2e50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f84b8001880 tx=0x7f84b400a040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:15.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.530 7f84aeffd700 1 -- 172.21.15.79:0/2825571079 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f84bc0bb620 con 0x7f84bc19dc80 2021-04-09T18:28:15.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.530 7f84aeffd700 1 -- 172.21.15.79:0/2825571079 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b401baf0 con 0x7f84bc19dc80 2021-04-09T18:28:15.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.530 7f84c44d7700 1 -- 172.21.15.79:0/2825571079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84bc19e0d0 con 0x7f84bc19dc80 2021-04-09T18:28:15.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.530 7f84aeffd700 1 -- 172.21.15.79:0/2825571079 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f84b401c430 con 0x7f84bc19dc80 2021-04-09T18:28:15.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.530 7f84c44d7700 1 -- 172.21.15.79:0/2825571079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84bc0d3480 con 0x7f84bc19dc80 2021-04-09T18:28:15.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.530 7f84aeffd700 1 -- 172.21.15.79:0/2825571079 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f84b400e1d0 con 0x7f84bc19dc80 2021-04-09T18:28:15.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.530 7f84aeffd700 1 --2- 172.21.15.79:0/2825571079 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f84a4029100 0x7f84a402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.530 7f84aeffd700 1 -- 172.21.15.79:0/2825571079 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f84b4028070 con 0x7f84bc19dc80 2021-04-09T18:28:15.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.530 7f84c227b700 1 --2- 172.21.15.79:0/2825571079 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f84a4029100 0x7f84a402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.530 7f84c227b700 1 --2- 172.21.15.79:0/2825571079 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f84a4029100 0x7f84a402b650 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:15.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.534 7f84c44d7700 1 -- 172.21.15.79:0/2825571079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84bc0e39f0 con 0x7f84bc19dc80 2021-04-09T18:28:15.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.542 7f84aeffd700 1 -- 172.21.15.79:0/2825571079 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f84b401b6f0 con 0x7f84bc19dc80 2021-04-09T18:28:15.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.706 7f84c44d7700 1 -- 172.21.15.79:0/2825571079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f84bc0f5b50 con 0x7f84bc19dc80 2021-04-09T18:28:15.815 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:28:15.810 7fbcd0516700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:28:15.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.814 7f84aeffd700 1 -- 172.21.15.79:0/2825571079 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f84b400eb10 con 0x7f84bc19dc80 2021-04-09T18:28:15.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.822 7f84c44d7700 1 -- 172.21.15.79:0/2825571079 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f84a4029100 msgr2=0x7f84a402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:15.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.822 7f84c44d7700 1 --2- 172.21.15.79:0/2825571079 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f84a4029100 0x7f84a402b650 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.822 7f84c44d7700 1 -- 172.21.15.79:0/2825571079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84bc19dc80 msgr2=0x7f84bc0d2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:15.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.822 7f84c44d7700 1 --2- 172.21.15.79:0/2825571079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84bc19dc80 0x7f84bc0d2e50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f84b8001880 tx=0x7f84b400a040).stop 2021-04-09T18:28:15.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.822 7f84c44d7700 1 -- 172.21.15.79:0/2825571079 shutdown_connections 2021-04-09T18:28:15.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.822 7f84c44d7700 1 --2- 172.21.15.79:0/2825571079 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f84a4029100 0x7f84a402b650 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.822 7f84c44d7700 1 --2- 172.21.15.79:0/2825571079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84bc0c0640 0x7f84bc0966b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.822 7f84c44d7700 1 --2- 172.21.15.79:0/2825571079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84bc19dc80 0x7f84bc0d2e50 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.822 7f84c44d7700 1 --2- 172.21.15.79:0/2825571079 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84bc1a05b0 0x7f84bc096eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.822 7f84c44d7700 1 -- 172.21.15.79:0/2825571079 >> 172.21.15.79:0/2825571079 conn(0x7f84bc09b0b0 msgr2=0x7f84bc095b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:15.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.826 7f84c44d7700 1 -- 172.21.15.79:0/2825571079 shutdown_connections 2021-04-09T18:28:15.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.826 7f84c44d7700 1 -- 172.21.15.79:0/2825571079 wait complete. 2021-04-09T18:28:15.845 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:15.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc841d7f700 1 Processor -- start 2021-04-09T18:28:15.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc841d7f700 1 -- start start 2021-04-09T18:28:15.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc841d7f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c0e9ae0 0x7fc83c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc841d7f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc83c1c8010 0x7fc83c1ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc841d7f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83c0fbb20 con 0x7fc83c0f5520 2021-04-09T18:28:15.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc841d7f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83c1c3dc0 con 0x7fc83c1c8010 2021-04-09T18:28:15.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc841d7f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0e9f30 con 0x7fc83c0e9ae0 2021-04-09T18:28:15.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc83bfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc83c1c8010 0x7fc83c1ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc83affd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c0e9ae0 0x7fc83c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc83bfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc83c1c8010 0x7fc83c1ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:45942/0 (socket says 172.21.15.79:45942) 2021-04-09T18:28:15.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc83bfff700 1 -- 172.21.15.79:0/1303976964 learned_addr learned my addr 172.21.15.79:0/1303976964 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:15.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc83b7fe700 1 --1- 172.21.15.79:0/1303976964 >> v1:172.21.15.89:6789/0 conn(0x7fc83c0f5520 0x7fc83c0f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:52776/0 (socket says 172.21.15.79:52776) 2021-04-09T18:28:15.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc83bfff700 1 -- 172.21.15.79:0/1303976964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c0e9ae0 msgr2=0x7fc83c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:15.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc83bfff700 1 --2- 172.21.15.79:0/1303976964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c0e9ae0 0x7fc83c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc83bfff700 1 -- 172.21.15.79:0/1303976964 >> v1:172.21.15.89:6789/0 conn(0x7fc83c0f5520 legacy=0x7fc83c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:15.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc83bfff700 1 -- 172.21.15.79:0/1303976964 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c0e56d0 con 0x7fc83c1c8010 2021-04-09T18:28:15.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc83bfff700 1 --2- 172.21.15.79:0/1303976964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc83c1c8010 0x7fc83c1ca470 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fc834002f30 tx=0x7fc83400bda0).ready entity=mon.1 client_cookie=12ec627f6ebc0c6b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:15.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc83a7fc700 1 -- 172.21.15.79:0/1303976964 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc83c0e56d0 con 0x7fc83c1c8010 2021-04-09T18:28:15.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc83a7fc700 1 -- 172.21.15.79:0/1303976964 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8340099d0 con 0x7fc83c1c8010 2021-04-09T18:28:15.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc841d7f700 1 -- 172.21.15.79:0/1303976964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc83c1c8010 msgr2=0x7fc83c1ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:15.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc841d7f700 1 --2- 172.21.15.79:0/1303976964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc83c1c8010 0x7fc83c1ca470 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fc834002f30 tx=0x7fc83400bda0).stop 2021-04-09T18:28:15.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc841d7f700 1 -- 172.21.15.79:0/1303976964 shutdown_connections 2021-04-09T18:28:15.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc841d7f700 1 --2- 172.21.15.79:0/1303976964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc83c1c8010 0x7fc83c1ca470 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc841d7f700 1 --2- 172.21.15.79:0/1303976964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c0e9ae0 0x7fc83c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc841d7f700 1 -- 172.21.15.79:0/1303976964 >> 172.21.15.79:0/1303976964 conn(0x7fc83c0e5fe0 msgr2=0x7fc83c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:15.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.930 7fc841d7f700 1 -- 172.21.15.79:0/1303976964 shutdown_connections 2021-04-09T18:28:15.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc841d7f700 1 -- 172.21.15.79:0/1303976964 wait complete. 2021-04-09T18:28:15.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc841d7f700 1 Processor -- start 2021-04-09T18:28:15.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc841d7f700 1 -- start start 2021-04-09T18:28:15.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc841d7f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc83c19b9e0 0x7fc83c19e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc841d7f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc83c0d4ec0 0x7fc83c0d5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc841d7f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c1addd0 0x7fc83c1ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc841d7f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c19c8a0 con 0x7fc83c0d4ec0 2021-04-09T18:28:15.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc841d7f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c19cba0 con 0x7fc83c19b9e0 2021-04-09T18:28:15.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc841d7f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c19e770 con 0x7fc83c1addd0 2021-04-09T18:28:15.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc83affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc83c0d4ec0 0x7fc83c0d5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc83affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc83c0d4ec0 0x7fc83c0d5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57602/0 (socket says 172.21.15.79:57602) 2021-04-09T18:28:15.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc83affd700 1 -- 172.21.15.79:0/3139767178 learned_addr learned my addr 172.21.15.79:0/3139767178 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:15.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc83bfff700 1 --2- 172.21.15.79:0/3139767178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c1addd0 0x7fc83c1ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc83b7fe700 1 --2- 172.21.15.79:0/3139767178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc83c19b9e0 0x7fc83c19e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc83affd700 1 -- 172.21.15.79:0/3139767178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c1addd0 msgr2=0x7fc83c1ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:15.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc83affd700 1 --2- 172.21.15.79:0/3139767178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c1addd0 0x7fc83c1ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc83affd700 1 -- 172.21.15.79:0/3139767178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc83c19b9e0 msgr2=0x7fc83c19e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:15.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc83affd700 1 --2- 172.21.15.79:0/3139767178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc83c19b9e0 0x7fc83c19e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc83affd700 1 -- 172.21.15.79:0/3139767178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c19c130 con 0x7fc83c0d4ec0 2021-04-09T18:28:15.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc83b7fe700 1 --2- 172.21.15.79:0/3139767178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc83c19b9e0 0x7fc83c19e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:28:15.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc83affd700 1 --2- 172.21.15.79:0/3139767178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc83c0d4ec0 0x7fc83c0d5310 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fc82c00c000 tx=0x7fc82c00ef70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:15.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc833fff700 1 -- 172.21.15.79:0/3139767178 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc83c19c130 con 0x7fc83c0d4ec0 2021-04-09T18:28:15.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc833fff700 1 -- 172.21.15.79:0/3139767178 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c00cb80 con 0x7fc83c0d4ec0 2021-04-09T18:28:15.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc833fff700 1 -- 172.21.15.79:0/3139767178 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc82c00f040 con 0x7fc83c0d4ec0 2021-04-09T18:28:15.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc841d7f700 1 -- 172.21.15.79:0/3139767178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83c1ae850 con 0x7fc83c0d4ec0 2021-04-09T18:28:15.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.934 7fc841d7f700 1 -- 172.21.15.79:0/3139767178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83c096340 con 0x7fc83c0d4ec0 2021-04-09T18:28:15.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.938 7fc833fff700 1 -- 172.21.15.79:0/3139767178 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc82c011070 con 0x7fc83c0d4ec0 2021-04-09T18:28:15.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.938 7fc833fff700 1 --2- 172.21.15.79:0/3139767178 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc814029100 0x7fc81402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:15.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.938 7fc833fff700 1 -- 172.21.15.79:0/3139767178 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fc82c010040 con 0x7fc83c0d4ec0 2021-04-09T18:28:15.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.938 7fc83b7fe700 1 --2- 172.21.15.79:0/3139767178 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc814029100 0x7fc81402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:15.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.938 7fc83b7fe700 1 --2- 172.21.15.79:0/3139767178 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc814029100 0x7fc81402b650 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:15.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.942 7fc841d7f700 1 -- 172.21.15.79:0/3139767178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83c0e39e0 con 0x7fc83c0d4ec0 2021-04-09T18:28:15.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:15.946 7fc833fff700 1 -- 172.21.15.79:0/3139767178 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc82c00c780 con 0x7fc83c0d4ec0 2021-04-09T18:28:16.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.110 7fc841d7f700 1 -- 172.21.15.79:0/3139767178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc83c0f5b20 con 0x7fc83c0d4ec0 2021-04-09T18:28:16.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.114 7fc833fff700 1 -- 172.21.15.79:0/3139767178 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+2101 (secure 0 0 0) 0x7fc82c000bf0 con 0x7fc83c0d4ec0 2021-04-09T18:28:16.120 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 17 2021-04-09T18:28:16.120 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:28:16.120 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":17,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5233,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/781814443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":781814443},{"type":"v1","addr":"172.21.15.89:6835","nonce":781814443}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":16}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:28:14.813896","modified":"2021-04-09 18:28:15.821510","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5169},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5169":{"gid":5169,"name":"a","rank":0,"incarnation":17,"state":"up:creating","state_seq":2,"addr":"172.21.15.79:6833/1928394900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1928394900},{"type":"v1","addr":"172.21.15.79:6833","nonce":1928394900}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-04-09T18:28:16.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.118 7fc841d7f700 1 -- 172.21.15.79:0/3139767178 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc814029100 msgr2=0x7fc81402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:16.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.118 7fc841d7f700 1 --2- 172.21.15.79:0/3139767178 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc814029100 0x7fc81402b650 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.118 7fc841d7f700 1 -- 172.21.15.79:0/3139767178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc83c0d4ec0 msgr2=0x7fc83c0d5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:16.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.118 7fc841d7f700 1 --2- 172.21.15.79:0/3139767178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc83c0d4ec0 0x7fc83c0d5310 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fc82c00c000 tx=0x7fc82c00ef70).stop 2021-04-09T18:28:16.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.118 7fc841d7f700 1 -- 172.21.15.79:0/3139767178 shutdown_connections 2021-04-09T18:28:16.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.118 7fc841d7f700 1 --2- 172.21.15.79:0/3139767178 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc814029100 0x7fc81402b650 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.118 7fc841d7f700 1 --2- 172.21.15.79:0/3139767178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc83c19b9e0 0x7fc83c19e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.118 7fc841d7f700 1 --2- 172.21.15.79:0/3139767178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c1addd0 0x7fc83c1ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.118 7fc841d7f700 1 --2- 172.21.15.79:0/3139767178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc83c0d4ec0 0x7fc83c0d5310 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.118 7fc841d7f700 1 -- 172.21.15.79:0/3139767178 >> 172.21.15.79:0/3139767178 conn(0x7fc83c0a7150 msgr2=0x7fc83c09a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:16.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.118 7fc841d7f700 1 -- 172.21.15.79:0/3139767178 shutdown_connections 2021-04-09T18:28:16.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.118 7fc841d7f700 1 -- 172.21.15.79:0/3139767178 wait complete. 2021-04-09T18:28:16.139 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:28:16.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.226 7feaefbdd700 1 Processor -- start 2021-04-09T18:28:16.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.226 7feaefbdd700 1 -- start start 2021-04-09T18:28:16.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.226 7feaefbdd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feae80e9ad0 0x7feae809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:16.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.226 7feaefbdd700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae80fbb10 con 0x7feae81c8000 2021-04-09T18:28:16.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.226 7feaefbdd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae80e56c0 con 0x7feae80f5510 2021-04-09T18:28:16.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.226 7feaefbdd700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae81c3db0 con 0x7feae80e9ad0 2021-04-09T18:28:16.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.226 7feaee182700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7feae81c8000 0x7feae81ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52324/0 (socket says 172.21.15.79:52324) 2021-04-09T18:28:16.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.230 7feaee182700 1 -- 172.21.15.79:0/427501701 learned_addr learned my addr 172.21.15.79:0/427501701 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:28:16.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.230 7feaed180700 1 --2- 172.21.15.79:0/427501701 >> v2:172.21.15.89:3300/0 conn(0x7feae80e9ad0 0x7feae809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:16.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.230 7feaec97f700 1 -- 172.21.15.79:0/427501701 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2293474215 0 0) 0x7feae0001450 con 0x7feae81c8000 2021-04-09T18:28:16.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.230 7feaec97f700 1 -- 172.21.15.79:0/427501701 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fead4003240 con 0x7feae81c8000 2021-04-09T18:28:16.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.230 7feaed180700 1 -- 172.21.15.79:0/427501701 >> v1:172.21.15.89:6789/0 conn(0x7feae80f5510 legacy=0x7feae80f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:16.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.230 7feaed180700 1 -- 172.21.15.79:0/427501701 >> v1:172.21.15.79:6789/0 conn(0x7feae81c8000 legacy=0x7feae81ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:16.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.230 7feaed180700 1 -- 172.21.15.79:0/427501701 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae80e4320 con 0x7feae80e9ad0 2021-04-09T18:28:16.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.230 7feaed180700 1 --2- 172.21.15.79:0/427501701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feae80e9ad0 0x7feae809f100 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fead8002f30 tx=0x7fead800bcc0).ready entity=mon.1 client_cookie=1d4136285390c0de server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:16.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.230 7feaec97f700 1 -- 172.21.15.79:0/427501701 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feae80e4320 con 0x7feae80e9ad0 2021-04-09T18:28:16.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.230 7feaec97f700 1 -- 172.21.15.79:0/427501701 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead8009800 con 0x7feae80e9ad0 2021-04-09T18:28:16.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.230 7feaec97f700 1 -- 172.21.15.79:0/427501701 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fead8009bd0 con 0x7feae80e9ad0 2021-04-09T18:28:16.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.230 7feaefbdd700 1 -- 172.21.15.79:0/427501701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feae80e9ad0 msgr2=0x7feae809f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:16.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.230 7feaefbdd700 1 --2- 172.21.15.79:0/427501701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feae80e9ad0 0x7feae809f100 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fead8002f30 tx=0x7fead800bcc0).stop 2021-04-09T18:28:16.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.230 7feaefbdd700 1 -- 172.21.15.79:0/427501701 shutdown_connections 2021-04-09T18:28:16.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.230 7feaefbdd700 1 --2- 172.21.15.79:0/427501701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feae80e9ad0 0x7feae809f100 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.230 7feaefbdd700 1 -- 172.21.15.79:0/427501701 >> 172.21.15.79:0/427501701 conn(0x7feae80e5fd0 msgr2=0x7feae80e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:16.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.230 7feaefbdd700 1 -- 172.21.15.79:0/427501701 shutdown_connections 2021-04-09T18:28:16.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.230 7feaefbdd700 1 -- 172.21.15.79:0/427501701 wait complete. 2021-04-09T18:28:16.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.234 7feaefbdd700 1 Processor -- start 2021-04-09T18:28:16.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.234 7feaefbdd700 1 -- start start 2021-04-09T18:28:16.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.234 7feaefbdd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feae8099170 0x7feae80c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:16.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.234 7feaefbdd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feae80985f0 0x7feae819b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:16.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.234 7feaefbdd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feae819c000 0x7feae81a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:16.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.234 7feaefbdd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae80e9f20 con 0x7feae8099170 2021-04-09T18:28:16.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.234 7feaefbdd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae8098c30 con 0x7feae819c000 2021-04-09T18:28:16.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.234 7feaefbdd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae8098f30 con 0x7feae80985f0 2021-04-09T18:28:16.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.234 7feaed981700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feae8099170 0x7feae80c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:16.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.238 7feaed981700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feae8099170 0x7feae80c42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57618/0 (socket says 172.21.15.79:57618) 2021-04-09T18:28:16.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.238 7feaed981700 1 -- 172.21.15.79:0/3795515089 learned_addr learned my addr 172.21.15.79:0/3795515089 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:16.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.238 7feaed180700 1 --2- 172.21.15.79:0/3795515089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feae80985f0 0x7feae819b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:16.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.238 7feaee182700 1 --2- 172.21.15.79:0/3795515089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feae819c000 0x7feae81a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:16.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.238 7feaed981700 1 -- 172.21.15.79:0/3795515089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feae80985f0 msgr2=0x7feae819b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:16.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.238 7feaed981700 1 --2- 172.21.15.79:0/3795515089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feae80985f0 0x7feae819b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.238 7feaed981700 1 -- 172.21.15.79:0/3795515089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feae819c000 msgr2=0x7feae81a76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:16.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.238 7feaed981700 1 --2- 172.21.15.79:0/3795515089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feae819c000 0x7feae81a76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.238 7feaed981700 1 -- 172.21.15.79:0/3795515089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae81b5ab0 con 0x7feae8099170 2021-04-09T18:28:16.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.238 7feaed981700 1 --2- 172.21.15.79:0/3795515089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feae8099170 0x7feae80c42a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7feae80bb230 tx=0x7feae400cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:16.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.238 7feade7fc700 1 -- 172.21.15.79:0/3795515089 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feae81b5ab0 con 0x7feae8099170 2021-04-09T18:28:16.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.238 7feade7fc700 1 -- 172.21.15.79:0/3795515089 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae4010510 con 0x7feae8099170 2021-04-09T18:28:16.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.238 7feaefbdd700 1 -- 172.21.15.79:0/3795515089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae819c450 con 0x7feae8099170 2021-04-09T18:28:16.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.238 7feade7fc700 1 -- 172.21.15.79:0/3795515089 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feae40106f0 con 0x7feae8099170 2021-04-09T18:28:16.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.238 7feaefbdd700 1 -- 172.21.15.79:0/3795515089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae81a7d20 con 0x7feae8099170 2021-04-09T18:28:16.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.238 7feade7fc700 1 -- 172.21.15.79:0/3795515089 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7feae4019020 con 0x7feae8099170 2021-04-09T18:28:16.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.238 7feade7fc700 1 --2- 172.21.15.79:0/3795515089 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fead0029100 0x7fead002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:16.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.238 7feade7fc700 1 -- 172.21.15.79:0/3795515089 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6010+0+0 (secure 0 0 0) 0x7feae4038e40 con 0x7feae8099170 2021-04-09T18:28:16.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.238 7feaed180700 1 --2- 172.21.15.79:0/3795515089 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fead0029100 0x7fead002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:16.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.238 7feaefbdd700 1 -- 172.21.15.79:0/3795515089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae80e39d0 con 0x7feae8099170 2021-04-09T18:28:16.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.242 7feaed180700 1 --2- 172.21.15.79:0/3795515089 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fead0029100 0x7fead002b650 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:16.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.242 7feade7fc700 1 -- 172.21.15.79:0/3795515089 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7feae4010300 con 0x7feae8099170 2021-04-09T18:28:16.411 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.406 7feaefbdd700 1 -- 172.21.15.79:0/3795515089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feae80a1cb0 con 0x7feae8099170 2021-04-09T18:28:16.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.410 7feade7fc700 1 -- 172.21.15.79:0/3795515089 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+14345 (secure 0 0 0) 0x7feae4000bf0 con 0x7feae8099170 2021-04-09T18:28:16.414 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:28:16.415 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:28:14.925421","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:28:13.096102","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2021-04-09 18:28:13.852981","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.79:6833/3417656822":"2021-04-10 18:28:14.914231","172.21.15.79:6832/3417656822":"2021-04-10 18:28:14.914231"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:28:16.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.410 7feaefbdd700 1 -- 172.21.15.79:0/3795515089 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fead0029100 msgr2=0x7fead002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:16.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.410 7feaefbdd700 1 --2- 172.21.15.79:0/3795515089 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fead0029100 0x7fead002b650 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.410 7feaefbdd700 1 -- 172.21.15.79:0/3795515089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feae8099170 msgr2=0x7feae80c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:16.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.410 7feaefbdd700 1 --2- 172.21.15.79:0/3795515089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feae8099170 0x7feae80c42a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7feae80bb230 tx=0x7feae400cae0).stop 2021-04-09T18:28:16.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.410 7feaefbdd700 1 -- 172.21.15.79:0/3795515089 shutdown_connections 2021-04-09T18:28:16.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.410 7feaefbdd700 1 --2- 172.21.15.79:0/3795515089 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fead0029100 0x7fead002b650 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.410 7feaefbdd700 1 --2- 172.21.15.79:0/3795515089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feae819c000 0x7feae81a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.414 7feaefbdd700 1 --2- 172.21.15.79:0/3795515089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feae8099170 0x7feae80c42a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.414 7feaefbdd700 1 --2- 172.21.15.79:0/3795515089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feae80985f0 0x7feae819b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.414 7feaefbdd700 1 -- 172.21.15.79:0/3795515089 >> 172.21.15.79:0/3795515089 conn(0x7feae809aee0 msgr2=0x7feae809a560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:16.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.414 7feaefbdd700 1 -- 172.21.15.79:0/3795515089 shutdown_connections 2021-04-09T18:28:16.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.414 7feaefbdd700 1 -- 172.21.15.79:0/3795515089 wait complete. 2021-04-09T18:28:16.428 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:28:16.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.530 7f687cc94700 1 Processor -- start 2021-04-09T18:28:16.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.530 7f687cc94700 1 -- start start 2021-04-09T18:28:16.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.530 7f687cc94700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68780f5580 0x7f68780f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:16.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.530 7f687cc94700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f68780e9b40 0x7f687809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:16.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.530 7f687cc94700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68780fbb80 con 0x7f68781c6e30 2021-04-09T18:28:16.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.530 7f687cc94700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68780e9f90 con 0x7f68780e9b40 2021-04-09T18:28:16.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.530 7f687cc94700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68780e59b0 con 0x7f68780f5580 2021-04-09T18:28:16.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.530 7f6876fe7700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f68781c6e30 0x7f68781c9290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52338/0 (socket says 172.21.15.79:52338) 2021-04-09T18:28:16.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.530 7f6876fe7700 1 -- 172.21.15.79:0/188885527 learned_addr learned my addr 172.21.15.79:0/188885527 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:28:16.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.530 7f68767e6700 1 --2- 172.21.15.79:0/188885527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68780f5580 0x7f68780f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:16.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.530 7f6875fe5700 1 --2- 172.21.15.79:0/188885527 >> v2:172.21.15.89:3300/0 conn(0x7f68780e9b40 0x7f687809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:16.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.530 7f68757e4700 1 -- 172.21.15.79:0/188885527 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462829923 0 0) 0x7f6870001450 con 0x7f68781c6e30 2021-04-09T18:28:16.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.530 7f68757e4700 1 -- 172.21.15.79:0/188885527 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6860003240 con 0x7f68781c6e30 2021-04-09T18:28:16.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.530 7f68767e6700 1 -- 172.21.15.79:0/188885527 >> v2:172.21.15.89:3300/0 conn(0x7f68780e9b40 msgr2=0x7f687809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:16.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.530 7f68767e6700 1 --2- 172.21.15.79:0/188885527 >> v2:172.21.15.89:3300/0 conn(0x7f68780e9b40 0x7f687809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.530 7f68767e6700 1 -- 172.21.15.79:0/188885527 >> v1:172.21.15.79:6789/0 conn(0x7f68781c6e30 legacy=0x7f68781c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:16.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.530 7f68757e4700 1 -- 172.21.15.79:0/188885527 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1510930626 0 0) 0x7f68700019d0 con 0x7f68781c6e30 2021-04-09T18:28:16.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.530 7f68767e6700 1 -- 172.21.15.79:0/188885527 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68780e56b0 con 0x7f68780f5580 2021-04-09T18:28:16.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.530 7f68767e6700 1 --2- 172.21.15.79:0/188885527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68780f5580 0x7f68780f6510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f6870002170 tx=0x7f686800bcc0).ready entity=mon.2 client_cookie=c4c6614ce5259ff1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:16.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.530 7f68757e4700 1 -- 172.21.15.79:0/188885527 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f68780e56b0 con 0x7f68780f5580 2021-04-09T18:28:16.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.534 7f68757e4700 1 -- 172.21.15.79:0/188885527 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68680096c0 con 0x7f68780f5580 2021-04-09T18:28:16.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.534 7f68757e4700 1 -- 172.21.15.79:0/188885527 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6870001f30 con 0x7f68780f5580 2021-04-09T18:28:16.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.534 7f687cc94700 1 -- 172.21.15.79:0/188885527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68780f5580 msgr2=0x7f68780f6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:16.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.534 7f687cc94700 1 --2- 172.21.15.79:0/188885527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68780f5580 0x7f68780f6510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f6870002170 tx=0x7f686800bcc0).stop 2021-04-09T18:28:16.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.534 7f687cc94700 1 -- 172.21.15.79:0/188885527 shutdown_connections 2021-04-09T18:28:16.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.534 7f687cc94700 1 --2- 172.21.15.79:0/188885527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68780f5580 0x7f68780f6510 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.534 7f687cc94700 1 --2- 172.21.15.79:0/188885527 >> v2:172.21.15.89:3300/0 conn(0x7f68780e9b40 0x7f687809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.534 7f687cc94700 1 -- 172.21.15.79:0/188885527 >> 172.21.15.79:0/188885527 conn(0x7f68780e6040 msgr2=0x7f68780e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:16.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.534 7f687cc94700 1 -- 172.21.15.79:0/188885527 shutdown_connections 2021-04-09T18:28:16.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.534 7f687cc94700 1 -- 172.21.15.79:0/188885527 wait complete. 2021-04-09T18:28:16.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f687cc94700 1 Processor -- start 2021-04-09T18:28:16.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f687cc94700 1 -- start start 2021-04-09T18:28:16.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f687cc94700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68780c3720 0x7f68780b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:16.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f687cc94700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68780c3b70 0x7f68780b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:16.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f687cc94700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68780d4a50 0x7f68780d4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:16.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f687cc94700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687819d2c0 con 0x7f68780d4a50 2021-04-09T18:28:16.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f687cc94700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687819d5c0 con 0x7f68780c3b70 2021-04-09T18:28:16.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f687cc94700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687819cb70 con 0x7f68780c3720 2021-04-09T18:28:16.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f6876fe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68780d4a50 0x7f68780d4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:16.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f6876fe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68780d4a50 0x7f68780d4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57630/0 (socket says 172.21.15.79:57630) 2021-04-09T18:28:16.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f6876fe7700 1 -- 172.21.15.79:0/3573293527 learned_addr learned my addr 172.21.15.79:0/3573293527 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:16.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f6875fe5700 1 --2- 172.21.15.79:0/3573293527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68780c3b70 0x7f68780b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:16.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f68767e6700 1 --2- 172.21.15.79:0/3573293527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68780c3720 0x7f68780b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:16.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f6876fe7700 1 -- 172.21.15.79:0/3573293527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68780c3720 msgr2=0x7f68780b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:16.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f6876fe7700 1 --2- 172.21.15.79:0/3573293527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68780c3720 0x7f68780b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f6876fe7700 1 -- 172.21.15.79:0/3573293527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68780c3b70 msgr2=0x7f68780b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:16.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f6876fe7700 1 --2- 172.21.15.79:0/3573293527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68780c3b70 0x7f68780b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f6876fe7700 1 -- 172.21.15.79:0/3573293527 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687819ce70 con 0x7f68780d4a50 2021-04-09T18:28:16.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f6876fe7700 1 --2- 172.21.15.79:0/3573293527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68780d4a50 0x7f68780d4ea0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f68780a6710 tx=0x7f687000ceb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:16.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f6866ffd700 1 -- 172.21.15.79:0/3573293527 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f687819ce70 con 0x7f68780d4a50 2021-04-09T18:28:16.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f6866ffd700 1 -- 172.21.15.79:0/3573293527 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6870004c60 con 0x7f68780d4a50 2021-04-09T18:28:16.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f6866ffd700 1 -- 172.21.15.79:0/3573293527 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6870007360 con 0x7f68780d4a50 2021-04-09T18:28:16.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f687cc94700 1 -- 172.21.15.79:0/3573293527 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68780b34d0 con 0x7f68780d4a50 2021-04-09T18:28:16.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f687cc94700 1 -- 172.21.15.79:0/3573293527 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68780a3330 con 0x7f68780d4a50 2021-04-09T18:28:16.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f6866ffd700 1 -- 172.21.15.79:0/3573293527 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6870007560 con 0x7f68780d4a50 2021-04-09T18:28:16.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f6866ffd700 1 --2- 172.21.15.79:0/3573293527 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f685c029100 0x7f685c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:16.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.538 7f6866ffd700 1 -- 172.21.15.79:0/3573293527 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f6870039290 con 0x7f68780d4a50 2021-04-09T18:28:16.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.542 7f68767e6700 1 --2- 172.21.15.79:0/3573293527 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f685c029100 0x7f685c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:16.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.542 7f68767e6700 1 --2- 172.21.15.79:0/3573293527 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f685c029100 0x7f685c02b650 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:16.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.542 7f687cc94700 1 -- 172.21.15.79:0/3573293527 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6878088d30 con 0x7f68780d4a50 2021-04-09T18:28:16.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.546 7f6866ffd700 1 -- 172.21.15.79:0/3573293527 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6870004a50 con 0x7f68780d4a50 2021-04-09T18:28:16.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.710 7f687cc94700 1 -- 172.21.15.79:0/3573293527 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f68780e39a0 con 0x7f68780d4a50 2021-04-09T18:28:16.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.714 7f6866ffd700 1 -- 172.21.15.79:0/3573293527 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v12) v1 ==== 184+0+0 (secure 0 0 0) 0x7f68780f7720 con 0x7f68780d4a50 2021-04-09T18:28:16.721 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2021-04-09T18:28:16.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.718 7f687cc94700 1 -- 172.21.15.79:0/3573293527 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f685c029100 msgr2=0x7f685c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:16.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.718 7f687cc94700 1 --2- 172.21.15.79:0/3573293527 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f685c029100 0x7f685c02b650 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.718 7f687cc94700 1 -- 172.21.15.79:0/3573293527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68780d4a50 msgr2=0x7f68780d4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:16.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.718 7f687cc94700 1 --2- 172.21.15.79:0/3573293527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68780d4a50 0x7f68780d4ea0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f68780a6710 tx=0x7f687000ceb0).stop 2021-04-09T18:28:16.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.718 7f687cc94700 1 -- 172.21.15.79:0/3573293527 shutdown_connections 2021-04-09T18:28:16.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.718 7f687cc94700 1 --2- 172.21.15.79:0/3573293527 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f685c029100 0x7f685c02b650 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.718 7f687cc94700 1 --2- 172.21.15.79:0/3573293527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68780d4a50 0x7f68780d4ea0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.718 7f687cc94700 1 --2- 172.21.15.79:0/3573293527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68780c3720 0x7f68780b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.718 7f687cc94700 1 --2- 172.21.15.79:0/3573293527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68780c3b70 0x7f68780b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.718 7f687cc94700 1 -- 172.21.15.79:0/3573293527 >> 172.21.15.79:0/3573293527 conn(0x7f6878099030 msgr2=0x7f68780d8360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:16.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.718 7f687cc94700 1 -- 172.21.15.79:0/3573293527 shutdown_connections 2021-04-09T18:28:16.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.718 7f687cc94700 1 -- 172.21.15.79:0/3573293527 wait complete. 2021-04-09T18:28:16.735 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:28:16.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.834 7f3f6de8c700 1 Processor -- start 2021-04-09T18:28:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.834 7f3f6de8c700 1 -- start start 2021-04-09T18:28:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.834 7f3f6de8c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f680f5580 0x7f3f680f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.834 7f3f6de8c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3f681c7e40 0x7f3f681ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.834 7f3f6de8c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f680fbb80 con 0x7f3f680e9b40 2021-04-09T18:28:16.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.834 7f3f6de8c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f680e9f90 con 0x7f3f681c7e40 2021-04-09T18:28:16.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.834 7f3f6de8c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f680e59b0 con 0x7f3f680f5580 2021-04-09T18:28:16.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.834 7f3f677fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f680f5580 0x7f3f680f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:16.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.834 7f3f67fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3f681c7e40 0x7f3f681ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:16.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.834 7f3f67fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3f681c7e40 0x7f3f681ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:45984/0 (socket says 172.21.15.79:45984) 2021-04-09T18:28:16.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.834 7f3f677fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f680f5580 0x7f3f680f6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:54634/0 (socket says 172.21.15.79:54634) 2021-04-09T18:28:16.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.834 7f3f67fff700 1 -- 172.21.15.79:0/3543070485 learned_addr learned my addr 172.21.15.79:0/3543070485 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:16.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.834 7f3f67fff700 1 -- 172.21.15.79:0/3543070485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f680f5580 msgr2=0x7f3f680f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:16.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.834 7f3f67fff700 1 --2- 172.21.15.79:0/3543070485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f680f5580 0x7f3f680f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.834 7f3f67fff700 1 -- 172.21.15.79:0/3543070485 >> v1:172.21.15.89:6789/0 conn(0x7f3f680e9b40 legacy=0x7f3f6809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:16.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.834 7f3f67fff700 1 -- 172.21.15.79:0/3543070485 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6809f910 con 0x7f3f681c7e40 2021-04-09T18:28:16.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.834 7f3f677fe700 1 --2- 172.21.15.79:0/3543070485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f680f5580 0x7f3f680f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:16.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.834 7f3f67fff700 1 --2- 172.21.15.79:0/3543070485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f681c7e40 0x7f3f681ca2a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f3f58002f30 tx=0x7f3f5800bda0).ready entity=mon.1 client_cookie=bf67b849e74bf4ea server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:16.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.834 7f3f667fc700 1 -- 172.21.15.79:0/3543070485 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f6809f910 con 0x7f3f681c7e40 2021-04-09T18:28:16.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.838 7f3f667fc700 1 -- 172.21.15.79:0/3543070485 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f580099d0 con 0x7f3f681c7e40 2021-04-09T18:28:16.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.838 7f3f667fc700 1 -- 172.21.15.79:0/3543070485 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f58009da0 con 0x7f3f681c7e40 2021-04-09T18:28:16.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.838 7f3f6de8c700 1 -- 172.21.15.79:0/3543070485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f681c7e40 msgr2=0x7f3f681ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:16.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.838 7f3f6de8c700 1 --2- 172.21.15.79:0/3543070485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f681c7e40 0x7f3f681ca2a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f3f58002f30 tx=0x7f3f5800bda0).stop 2021-04-09T18:28:16.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.838 7f3f6de8c700 1 -- 172.21.15.79:0/3543070485 shutdown_connections 2021-04-09T18:28:16.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.838 7f3f6de8c700 1 --2- 172.21.15.79:0/3543070485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f681c7e40 0x7f3f681ca2a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.838 7f3f6de8c700 1 --2- 172.21.15.79:0/3543070485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f680f5580 0x7f3f680f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.838 7f3f6de8c700 1 -- 172.21.15.79:0/3543070485 >> 172.21.15.79:0/3543070485 conn(0x7f3f680e6040 msgr2=0x7f3f680e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:16.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.838 7f3f6de8c700 1 -- 172.21.15.79:0/3543070485 shutdown_connections 2021-04-09T18:28:16.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.838 7f3f6de8c700 1 -- 172.21.15.79:0/3543070485 wait complete. 2021-04-09T18:28:16.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.838 7f3f6de8c700 1 Processor -- start 2021-04-09T18:28:16.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.838 7f3f6de8c700 1 -- start start 2021-04-09T18:28:16.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.838 7f3f6de8c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f680d0fe0 0x7f3f6809ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:16.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.838 7f3f6de8c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f6809a240 0x7f3f6809a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:16.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.838 7f3f6de8c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f681a6070 0x7f3f681a64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:16.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.838 7f3f6de8c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f680d1430 con 0x7f3f681a6070 2021-04-09T18:28:16.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.838 7f3f6de8c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6809b350 con 0x7f3f6809a240 2021-04-09T18:28:16.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.838 7f3f6de8c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f680b98d0 con 0x7f3f680d0fe0 2021-04-09T18:28:16.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.838 7f3f67fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f681a6070 0x7f3f681a64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:16.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f67fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f681a6070 0x7f3f681a64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57648/0 (socket says 172.21.15.79:57648) 2021-04-09T18:28:16.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f67fff700 1 -- 172.21.15.79:0/2386545130 learned_addr learned my addr 172.21.15.79:0/2386545130 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:16.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f677fe700 1 --2- 172.21.15.79:0/2386545130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f680d0fe0 0x7f3f6809ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:16.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f66ffd700 1 --2- 172.21.15.79:0/2386545130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f6809a240 0x7f3f6809a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:16.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f67fff700 1 -- 172.21.15.79:0/2386545130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f680d0fe0 msgr2=0x7f3f6809ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:16.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f67fff700 1 --2- 172.21.15.79:0/2386545130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f680d0fe0 0x7f3f6809ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f67fff700 1 -- 172.21.15.79:0/2386545130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f6809a240 msgr2=0x7f3f6809a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:16.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f67fff700 1 --2- 172.21.15.79:0/2386545130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f6809a240 0x7f3f6809a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:16.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f67fff700 1 -- 172.21.15.79:0/2386545130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f680d5710 con 0x7f3f681a6070 2021-04-09T18:28:16.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f66ffd700 1 --2- 172.21.15.79:0/2386545130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f6809a240 0x7f3f6809a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:28:16.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f67fff700 1 --2- 172.21.15.79:0/2386545130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f681a6070 0x7f3f681a64c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f3f58002f30 tx=0x7f3f58006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:16.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f5ffff700 1 -- 172.21.15.79:0/2386545130 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f680d5710 con 0x7f3f681a6070 2021-04-09T18:28:16.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f5ffff700 1 -- 172.21.15.79:0/2386545130 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f58018580 con 0x7f3f681a6070 2021-04-09T18:28:16.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f5ffff700 1 -- 172.21.15.79:0/2386545130 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f58018950 con 0x7f3f681a6070 2021-04-09T18:28:16.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f6de8c700 1 -- 172.21.15.79:0/2386545130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f681a6af0 con 0x7f3f681a6070 2021-04-09T18:28:16.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f6de8c700 1 -- 172.21.15.79:0/2386545130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f681a6f40 con 0x7f3f681a6070 2021-04-09T18:28:16.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f5ffff700 1 -- 172.21.15.79:0/2386545130 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3f58018b50 con 0x7f3f681a6070 2021-04-09T18:28:16.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f5ffff700 1 --2- 172.21.15.79:0/2386545130 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3f4c029100 0x7f3f4c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:16.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f5ffff700 1 -- 172.21.15.79:0/2386545130 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f3f5803c840 con 0x7f3f681a6070 2021-04-09T18:28:16.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f677fe700 1 --2- 172.21.15.79:0/2386545130 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3f4c029100 0x7f3f4c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:16.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.842 7f3f677fe700 1 --2- 172.21.15.79:0/2386545130 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3f4c029100 0x7f3f4c02b650 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:16.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.850 7f3f6de8c700 1 -- 172.21.15.79:0/2386545130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f68088d30 con 0x7f3f681a6070 2021-04-09T18:28:16.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:16.858 7f3f5ffff700 1 -- 172.21.15.79:0/2386545130 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3f58018370 con 0x7f3f681a6070 2021-04-09T18:28:17.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.026 7f3f6de8c700 1 -- 172.21.15.79:0/2386545130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f3f680e39a0 con 0x7f3f681a6070 2021-04-09T18:28:17.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.030 7f3f5ffff700 1 -- 172.21.15.79:0/2386545130 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7f3f580097c0 con 0x7f3f681a6070 2021-04-09T18:28:17.036 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.1 2021-04-09T18:28:17.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.034 7f3f6de8c700 1 -- 172.21.15.79:0/2386545130 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3f4c029100 msgr2=0x7f3f4c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:17.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.034 7f3f6de8c700 1 --2- 172.21.15.79:0/2386545130 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3f4c029100 0x7f3f4c02b650 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.034 7f3f6de8c700 1 -- 172.21.15.79:0/2386545130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f681a6070 msgr2=0x7f3f681a64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:17.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.034 7f3f6de8c700 1 --2- 172.21.15.79:0/2386545130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f681a6070 0x7f3f681a64c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f3f58002f30 tx=0x7f3f58006890).stop 2021-04-09T18:28:17.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.034 7f3f6de8c700 1 -- 172.21.15.79:0/2386545130 shutdown_connections 2021-04-09T18:28:17.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.034 7f3f6de8c700 1 --2- 172.21.15.79:0/2386545130 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3f4c029100 0x7f3f4c02b650 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.034 7f3f6de8c700 1 --2- 172.21.15.79:0/2386545130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f681a6070 0x7f3f681a64c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.034 7f3f6de8c700 1 --2- 172.21.15.79:0/2386545130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f680d0fe0 0x7f3f6809ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.034 7f3f6de8c700 1 --2- 172.21.15.79:0/2386545130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f6809a240 0x7f3f6809a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.034 7f3f6de8c700 1 -- 172.21.15.79:0/2386545130 >> 172.21.15.79:0/2386545130 conn(0x7f3f68093f90 msgr2=0x7f3f680d77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:17.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.034 7f3f6de8c700 1 -- 172.21.15.79:0/2386545130 shutdown_connections 2021-04-09T18:28:17.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.034 7f3f6de8c700 1 -- 172.21.15.79:0/2386545130 wait complete. 2021-04-09T18:28:17.050 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:28:17.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.150 7fa394200700 1 Processor -- start 2021-04-09T18:28:17.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.150 7fa394200700 1 -- start start 2021-04-09T18:28:17.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.150 7fa394200700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa38c1c8e50 0x7fa38c1cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:17.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.150 7fa394200700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38c0fbb80 con 0x7fa38c0e9b40 2021-04-09T18:28:17.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.150 7fa394200700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38c09f910 con 0x7fa38c0f5580 2021-04-09T18:28:17.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.150 7fa394200700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa38c0e9f90 con 0x7fa38c1c8e50 2021-04-09T18:28:17.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.150 7fa3927a5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa38c1c8e50 0x7fa38c1cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:17.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.150 7fa3917a3700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa38c0e9b40 0x7fa38c09f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52362/0 (socket says 172.21.15.79:52362) 2021-04-09T18:28:17.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.150 7fa3917a3700 1 -- 172.21.15.79:0/1365423840 learned_addr learned my addr 172.21.15.79:0/1365423840 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:28:17.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.150 7fa3927a5700 1 -- 172.21.15.79:0/1365423840 >> v1:172.21.15.89:6789/0 conn(0x7fa38c0f5580 legacy=0x7fa38c0f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:17.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.150 7fa3927a5700 1 -- 172.21.15.79:0/1365423840 >> v1:172.21.15.79:6789/0 conn(0x7fa38c0e9b40 legacy=0x7fa38c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:17.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.150 7fa3927a5700 1 -- 172.21.15.79:0/1365423840 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c0e56b0 con 0x7fa38c1c8e50 2021-04-09T18:28:17.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.150 7fa3927a5700 1 --2- 172.21.15.79:0/1365423840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c1c8e50 0x7fa38c1cb2b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fa384002f30 tx=0x7fa38400bcc0).ready entity=mon.0 client_cookie=9aca2d95b3c759ae server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:17.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.154 7fa390fa2700 1 -- 172.21.15.79:0/1365423840 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa38c0e56b0 con 0x7fa38c1c8e50 2021-04-09T18:28:17.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.154 7fa390fa2700 1 -- 172.21.15.79:0/1365423840 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa384009800 con 0x7fa38c1c8e50 2021-04-09T18:28:17.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.154 7fa390fa2700 1 -- 172.21.15.79:0/1365423840 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa384009bd0 con 0x7fa38c1c8e50 2021-04-09T18:28:17.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.154 7fa394200700 1 -- 172.21.15.79:0/1365423840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c1c8e50 msgr2=0x7fa38c1cb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:17.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.154 7fa394200700 1 --2- 172.21.15.79:0/1365423840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c1c8e50 0x7fa38c1cb2b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fa384002f30 tx=0x7fa38400bcc0).stop 2021-04-09T18:28:17.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.154 7fa394200700 1 -- 172.21.15.79:0/1365423840 shutdown_connections 2021-04-09T18:28:17.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.154 7fa394200700 1 --2- 172.21.15.79:0/1365423840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c1c8e50 0x7fa38c1cb2b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.154 7fa394200700 1 -- 172.21.15.79:0/1365423840 >> 172.21.15.79:0/1365423840 conn(0x7fa38c0e6040 msgr2=0x7fa38c0e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:17.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.154 7fa394200700 1 -- 172.21.15.79:0/1365423840 shutdown_connections 2021-04-09T18:28:17.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.154 7fa394200700 1 -- 172.21.15.79:0/1365423840 wait complete. 2021-04-09T18:28:17.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa394200700 1 Processor -- start 2021-04-09T18:28:17.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa394200700 1 -- start start 2021-04-09T18:28:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa394200700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa38c0bdc60 0x7fa38c1c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa394200700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa38c1c2670 0x7fa38c0be1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa394200700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c1c6730 0x7fa38c0d5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa394200700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c1c0df0 con 0x7fa38c1c6730 2021-04-09T18:28:17.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa394200700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c1c10f0 con 0x7fa38c1c2670 2021-04-09T18:28:17.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa394200700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c1c71c0 con 0x7fa38c0bdc60 2021-04-09T18:28:17.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa3927a5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c1c6730 0x7fa38c0d5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:17.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa3917a3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa38c1c2670 0x7fa38c0be1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:17.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa3917a3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa38c1c2670 0x7fa38c0be1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:46002/0 (socket says 172.21.15.79:46002) 2021-04-09T18:28:17.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa3917a3700 1 -- 172.21.15.79:0/96140391 learned_addr learned my addr 172.21.15.79:0/96140391 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:17.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa391fa4700 1 --2- 172.21.15.79:0/96140391 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa38c0bdc60 0x7fa38c1c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:17.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa3917a3700 1 -- 172.21.15.79:0/96140391 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa38c0bdc60 msgr2=0x7fa38c1c2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:17.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa3917a3700 1 --2- 172.21.15.79:0/96140391 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa38c0bdc60 0x7fa38c1c2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa3917a3700 1 -- 172.21.15.79:0/96140391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c1c6730 msgr2=0x7fa38c0d5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:17.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa3917a3700 1 --2- 172.21.15.79:0/96140391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c1c6730 0x7fa38c0d5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa3917a3700 1 -- 172.21.15.79:0/96140391 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c1c2ac0 con 0x7fa38c1c2670 2021-04-09T18:28:17.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa3927a5700 1 --2- 172.21.15.79:0/96140391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c1c6730 0x7fa38c0d5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:17.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa3917a3700 1 --2- 172.21.15.79:0/96140391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa38c1c2670 0x7fa38c0be1e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fa38c0d8220 tx=0x7fa37c00cae0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:17.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa3827fc700 1 -- 172.21.15.79:0/96140391 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa38c1c2ac0 con 0x7fa38c1c2670 2021-04-09T18:28:17.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa3827fc700 1 -- 172.21.15.79:0/96140391 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37c007320 con 0x7fa38c1c2670 2021-04-09T18:28:17.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa394200700 1 -- 172.21.15.79:0/96140391 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38c0d5870 con 0x7fa38c1c2670 2021-04-09T18:28:17.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa3827fc700 1 -- 172.21.15.79:0/96140391 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa37c0057e0 con 0x7fa38c1c2670 2021-04-09T18:28:17.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.158 7fa394200700 1 -- 172.21.15.79:0/96140391 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38c1c6d10 con 0x7fa38c1c2670 2021-04-09T18:28:17.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.162 7fa3827fc700 1 -- 172.21.15.79:0/96140391 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa37c01a060 con 0x7fa38c1c2670 2021-04-09T18:28:17.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.162 7fa3827fc700 1 --2- 172.21.15.79:0/96140391 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa374029100 0x7fa37402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:17.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.162 7fa3827fc700 1 -- 172.21.15.79:0/96140391 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fa37c038cb0 con 0x7fa38c1c2670 2021-04-09T18:28:17.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.162 7fa391fa4700 1 --2- 172.21.15.79:0/96140391 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa374029100 0x7fa37402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:17.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.162 7fa391fa4700 1 --2- 172.21.15.79:0/96140391 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa374029100 0x7fa37402b650 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:17.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.166 7fa394200700 1 -- 172.21.15.79:0/96140391 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38c088d30 con 0x7fa38c1c2670 2021-04-09T18:28:17.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.174 7fa3827fc700 1 -- 172.21.15.79:0/96140391 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa37c007110 con 0x7fa38c1c2670 2021-04-09T18:28:17.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.342 7fa394200700 1 -- 172.21.15.79:0/96140391 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fa38c0e39a0 con 0x7fa38c1c2670 2021-04-09T18:28:17.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.350 7fa3827fc700 1 -- 172.21.15.79:0/96140391 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v14) v1 ==== 184+0+0 (secure 0 0 0) 0x7fa37c000bf0 con 0x7fa38c1c2670 2021-04-09T18:28:17.361 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.2 2021-04-09T18:28:17.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.358 7fa394200700 1 -- 172.21.15.79:0/96140391 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa374029100 msgr2=0x7fa37402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:17.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.358 7fa394200700 1 --2- 172.21.15.79:0/96140391 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa374029100 0x7fa37402b650 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.358 7fa394200700 1 -- 172.21.15.79:0/96140391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa38c1c2670 msgr2=0x7fa38c0be1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:17.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.358 7fa394200700 1 --2- 172.21.15.79:0/96140391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa38c1c2670 0x7fa38c0be1e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fa38c0d8220 tx=0x7fa37c00cae0).stop 2021-04-09T18:28:17.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.358 7fa394200700 1 -- 172.21.15.79:0/96140391 shutdown_connections 2021-04-09T18:28:17.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.358 7fa394200700 1 --2- 172.21.15.79:0/96140391 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa374029100 0x7fa37402b650 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.358 7fa394200700 1 --2- 172.21.15.79:0/96140391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c1c6730 0x7fa38c0d5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.358 7fa394200700 1 --2- 172.21.15.79:0/96140391 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa38c0bdc60 0x7fa38c1c2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.358 7fa394200700 1 --2- 172.21.15.79:0/96140391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa38c1c2670 0x7fa38c0be1e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.358 7fa394200700 1 -- 172.21.15.79:0/96140391 >> 172.21.15.79:0/96140391 conn(0x7fa38c099060 msgr2=0x7fa38c09a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:17.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.358 7fa394200700 1 -- 172.21.15.79:0/96140391 shutdown_connections 2021-04-09T18:28:17.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.358 7fa394200700 1 -- 172.21.15.79:0/96140391 wait complete. 2021-04-09T18:28:17.376 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:17.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.462 7f6d7c7cf700 1 Processor -- start 2021-04-09T18:28:17.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.462 7f6d7c7cf700 1 -- start start 2021-04-09T18:28:17.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7c7cf700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6d740f5510 0x7f6d740f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:17.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7c7cf700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6d740e9ad0 0x7f6d7409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:17.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7c7cf700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d740fbb10 con 0x7f6d741c2da0 2021-04-09T18:28:17.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7c7cf700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d740e9f20 con 0x7f6d740f5510 2021-04-09T18:28:17.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7c7cf700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d740e59c0 con 0x7f6d740e9ad0 2021-04-09T18:28:17.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7a573700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6d740f5510 0x7f6d740f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:17.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7a573700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6d740f5510 0x7f6d740f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57666/0 (socket says 172.21.15.79:57666) 2021-04-09T18:28:17.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7a573700 1 -- 172.21.15.79:0/417725053 learned_addr learned my addr 172.21.15.79:0/417725053 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:17.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d79d72700 1 --2- 172.21.15.79:0/417725053 >> v2:172.21.15.89:3300/0 conn(0x7f6d740e9ad0 0x7f6d7409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:17.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d79571700 1 -- 172.21.15.79:0/417725053 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811961982 0 0) 0x7f6d6c001450 con 0x7f6d741c2da0 2021-04-09T18:28:17.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7a573700 1 -- 172.21.15.79:0/417725053 >> v2:172.21.15.89:3300/0 conn(0x7f6d740e9ad0 msgr2=0x7f6d7409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:17.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7a573700 1 --2- 172.21.15.79:0/417725053 >> v2:172.21.15.89:3300/0 conn(0x7f6d740e9ad0 0x7f6d7409f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7a573700 1 -- 172.21.15.79:0/417725053 >> v1:172.21.15.89:6789/0 conn(0x7f6d741c2da0 legacy=0x7f6d741c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:17.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7a573700 1 -- 172.21.15.79:0/417725053 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d740e56c0 con 0x7f6d740f5510 2021-04-09T18:28:17.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7a573700 1 --2- 172.21.15.79:0/417725053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d740f5510 0x7f6d740f64a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f6d68002f30 tx=0x7f6d6800bd70).ready entity=mon.0 client_cookie=e632955f6d12ca5e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:17.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d79571700 1 -- 172.21.15.79:0/417725053 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6d740e56c0 con 0x7f6d740f5510 2021-04-09T18:28:17.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d79571700 1 -- 172.21.15.79:0/417725053 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d68009950 con 0x7f6d740f5510 2021-04-09T18:28:17.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d79571700 1 -- 172.21.15.79:0/417725053 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6d68009d20 con 0x7f6d740f5510 2021-04-09T18:28:17.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7c7cf700 1 -- 172.21.15.79:0/417725053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d740f5510 msgr2=0x7f6d740f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:17.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7c7cf700 1 --2- 172.21.15.79:0/417725053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d740f5510 0x7f6d740f64a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f6d68002f30 tx=0x7f6d6800bd70).stop 2021-04-09T18:28:17.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7c7cf700 1 -- 172.21.15.79:0/417725053 shutdown_connections 2021-04-09T18:28:17.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7c7cf700 1 --2- 172.21.15.79:0/417725053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d740f5510 0x7f6d740f64a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7c7cf700 1 --2- 172.21.15.79:0/417725053 >> v2:172.21.15.89:3300/0 conn(0x7f6d740e9ad0 0x7f6d7409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7c7cf700 1 -- 172.21.15.79:0/417725053 >> 172.21.15.79:0/417725053 conn(0x7f6d740e5fd0 msgr2=0x7f6d740e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:17.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7c7cf700 1 -- 172.21.15.79:0/417725053 shutdown_connections 2021-04-09T18:28:17.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.466 7f6d7c7cf700 1 -- 172.21.15.79:0/417725053 wait complete. 2021-04-09T18:28:17.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.470 7f6d7c7cf700 1 Processor -- start 2021-04-09T18:28:17.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.470 7f6d7c7cf700 1 -- start start 2021-04-09T18:28:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d7c7cf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d74098540 0x7f6d740afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d7c7cf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d740bdca0 0x7f6d740d5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:17.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d7c7cf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d740d56b0 0x7f6d740c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:17.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d7c7cf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740c0350 con 0x7f6d74098540 2021-04-09T18:28:17.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d7c7cf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740be870 con 0x7f6d740d56b0 2021-04-09T18:28:17.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d7c7cf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740b01d0 con 0x7f6d740bdca0 2021-04-09T18:28:17.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d7a573700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d74098540 0x7f6d740afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:17.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d7a573700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d74098540 0x7f6d740afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57672/0 (socket says 172.21.15.79:57672) 2021-04-09T18:28:17.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d7a573700 1 -- 172.21.15.79:0/989033112 learned_addr learned my addr 172.21.15.79:0/989033112 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:17.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d7ad74700 1 --2- 172.21.15.79:0/989033112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d740d56b0 0x7f6d740c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:17.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d79d72700 1 --2- 172.21.15.79:0/989033112 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d740bdca0 0x7f6d740d5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:17.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d7a573700 1 -- 172.21.15.79:0/989033112 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d740bdca0 msgr2=0x7f6d740d5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:17.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d7a573700 1 --2- 172.21.15.79:0/989033112 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d740bdca0 0x7f6d740d5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d7a573700 1 -- 172.21.15.79:0/989033112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d740d56b0 msgr2=0x7f6d740c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:17.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d7a573700 1 --2- 172.21.15.79:0/989033112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d740d56b0 0x7f6d740c47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d7a573700 1 -- 172.21.15.79:0/989033112 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d740bff00 con 0x7f6d74098540 2021-04-09T18:28:17.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d7a573700 1 --2- 172.21.15.79:0/989033112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d74098540 0x7f6d740afba0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f6d68002f30 tx=0x7f6d68006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:17.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d66ffd700 1 -- 172.21.15.79:0/989033112 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6d740bff00 con 0x7f6d74098540 2021-04-09T18:28:17.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d66ffd700 1 -- 172.21.15.79:0/989033112 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d68011cd0 con 0x7f6d74098540 2021-04-09T18:28:17.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d7c7cf700 1 -- 172.21.15.79:0/989033112 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d740c0c30 con 0x7f6d74098540 2021-04-09T18:28:17.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d66ffd700 1 -- 172.21.15.79:0/989033112 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6d6801d670 con 0x7f6d74098540 2021-04-09T18:28:17.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d7c7cf700 1 -- 172.21.15.79:0/989033112 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d74098990 con 0x7f6d74098540 2021-04-09T18:28:17.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.474 7f6d66ffd700 1 -- 172.21.15.79:0/989033112 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6d6801c3e0 con 0x7f6d74098540 2021-04-09T18:28:17.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.478 7f6d66ffd700 1 --2- 172.21.15.79:0/989033112 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6d5c029100 0x7f6d5c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:17.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.478 7f6d66ffd700 1 -- 172.21.15.79:0/989033112 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f6d6803b970 con 0x7f6d74098540 2021-04-09T18:28:17.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.478 7f6d79d72700 1 --2- 172.21.15.79:0/989033112 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6d5c029100 0x7f6d5c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:17.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.478 7f6d79d72700 1 --2- 172.21.15.79:0/989033112 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6d5c029100 0x7f6d5c02b650 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:17.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.478 7f6d7c7cf700 1 -- 172.21.15.79:0/989033112 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d740e39d0 con 0x7f6d74098540 2021-04-09T18:28:17.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.486 7f6d66ffd700 1 -- 172.21.15.79:0/989033112 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6d68009740 con 0x7f6d74098540 2021-04-09T18:28:17.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.658 7f6d7c7cf700 1 -- 172.21.15.79:0/989033112 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d740a1cb0 con 0x7f6d74098540 2021-04-09T18:28:17.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.662 7f6d66ffd700 1 -- 172.21.15.79:0/989033112 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2099 (secure 0 0 0) 0x7f6d68011ac0 con 0x7f6d74098540 2021-04-09T18:28:17.665 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 18 2021-04-09T18:28:17.665 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:28:17.666 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5233,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/781814443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":781814443},{"type":"v1","addr":"172.21.15.89:6835","nonce":781814443}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:28:14.813896","modified":"2021-04-09 18:28:16.825652","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5169},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5169":{"gid":5169,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/1928394900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1928394900},{"type":"v1","addr":"172.21.15.79:6833","nonce":1928394900}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-04-09T18:28:17.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.662 7f6d7c7cf700 1 -- 172.21.15.79:0/989033112 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6d5c029100 msgr2=0x7f6d5c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:17.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.662 7f6d7c7cf700 1 --2- 172.21.15.79:0/989033112 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6d5c029100 0x7f6d5c02b650 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.662 7f6d7c7cf700 1 -- 172.21.15.79:0/989033112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d74098540 msgr2=0x7f6d740afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:17.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.662 7f6d7c7cf700 1 --2- 172.21.15.79:0/989033112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d74098540 0x7f6d740afba0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f6d68002f30 tx=0x7f6d68006890).stop 2021-04-09T18:28:17.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.662 7f6d7c7cf700 1 -- 172.21.15.79:0/989033112 shutdown_connections 2021-04-09T18:28:17.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.662 7f6d7c7cf700 1 --2- 172.21.15.79:0/989033112 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6d5c029100 0x7f6d5c02b650 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.662 7f6d7c7cf700 1 --2- 172.21.15.79:0/989033112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d740d56b0 0x7f6d740c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.662 7f6d7c7cf700 1 --2- 172.21.15.79:0/989033112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d74098540 0x7f6d740afba0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.662 7f6d7c7cf700 1 --2- 172.21.15.79:0/989033112 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d740bdca0 0x7f6d740d5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:17.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.662 7f6d7c7cf700 1 -- 172.21.15.79:0/989033112 >> 172.21.15.79:0/989033112 conn(0x7f6d7409a2c0 msgr2=0x7f6d740d8410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:17.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.662 7f6d7c7cf700 1 -- 172.21.15.79:0/989033112 shutdown_connections 2021-04-09T18:28:17.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:17.662 7f6d7c7cf700 1 -- 172.21.15.79:0/989033112 wait complete. 2021-04-09T18:28:17.879 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:28:14.813896', 'modified': '2021-04-09 18:28:16.825652', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 39, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5169}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5169': {'gid': 5169, 'name': 'a', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6833/1928394900', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 1928394900}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 1928394900}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:28:17.879 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:28:17.880 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2021-04-09T18:28:17.974 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:28:17.975 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:28:17.975 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2021-04-09T18:28:17.975 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 5169, 2021-04-09T18:28:17.976 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2021-04-09T18:28:17.976 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2021-04-09T18:28:17.976 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 2.1487062899999998, 2021-04-09T18:28:17.976 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 18, 2021-04-09T18:28:17.977 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 40, 2021-04-09T18:28:17.977 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 40, 2021-04-09T18:28:17.977 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 7.1004892279999998 2021-04-09T18:28:17.977 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:28:17.981 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 5169, "want_state": "up:active", "state": "up:active", "rank_uptime": 2.1487062899999998, "mdsmap_epoch": 18, "osdmap_epoch": 40, "osdmap_epoch_barrier": 40, "uptime": 7.1004892279999998 } 2021-04-09T18:28:17.982 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:28:18.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20d7515700 1 Processor -- start 2021-04-09T18:28:18.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20d7515700 1 -- start start 2021-04-09T18:28:18.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20d7515700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f20d00f5520 0x7f20d00f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20d7515700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f20d00e9ae0 0x7f20d009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20d7515700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d00fbb20 con 0x7f20d01c2db0 2021-04-09T18:28:18.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20d7515700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d00e9f30 con 0x7f20d00f5520 2021-04-09T18:28:18.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20d7515700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d00e59d0 con 0x7f20d00e9ae0 2021-04-09T18:28:18.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20d52b9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f20d00f5520 0x7f20d00f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20d4ab8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f20d00e9ae0 0x7f20d009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20d52b9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f20d00f5520 0x7f20d00f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57680/0 (socket says 172.21.15.79:57680) 2021-04-09T18:28:18.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20d52b9700 1 -- 172.21.15.79:0/1908503573 learned_addr learned my addr 172.21.15.79:0/1908503573 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:18.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20d5aba700 1 --1- 172.21.15.79:0/1908503573 >> v1:172.21.15.89:6789/0 conn(0x7f20d01c2db0 0x7f20d01c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:52864/0 (socket says 172.21.15.79:52864) 2021-04-09T18:28:18.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20d52b9700 1 -- 172.21.15.79:0/1908503573 >> v2:172.21.15.89:3300/0 conn(0x7f20d00e9ae0 msgr2=0x7f20d009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:18.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20d52b9700 1 --2- 172.21.15.79:0/1908503573 >> v2:172.21.15.89:3300/0 conn(0x7f20d00e9ae0 0x7f20d009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20d52b9700 1 -- 172.21.15.79:0/1908503573 >> v1:172.21.15.89:6789/0 conn(0x7f20d01c2db0 legacy=0x7f20d01c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20d52b9700 1 -- 172.21.15.79:0/1908503573 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d00e56d0 con 0x7f20d00f5520 2021-04-09T18:28:18.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20d52b9700 1 --2- 172.21.15.79:0/1908503573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20d00f5520 0x7f20d00f64b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f20c0002f30 tx=0x7f20c000bd70).ready entity=mon.0 client_cookie=c30ed73c7a71858f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:18.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20cffff700 1 -- 172.21.15.79:0/1908503573 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f20d00e56d0 con 0x7f20d00f5520 2021-04-09T18:28:18.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20cffff700 1 -- 172.21.15.79:0/1908503573 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c0009950 con 0x7f20d00f5520 2021-04-09T18:28:18.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20cffff700 1 -- 172.21.15.79:0/1908503573 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f20c0009d20 con 0x7f20d00f5520 2021-04-09T18:28:18.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20d7515700 1 -- 172.21.15.79:0/1908503573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20d00f5520 msgr2=0x7f20d00f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.074 7f20d7515700 1 --2- 172.21.15.79:0/1908503573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20d00f5520 0x7f20d00f64b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f20c0002f30 tx=0x7f20c000bd70).stop 2021-04-09T18:28:18.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.078 7f20d7515700 1 -- 172.21.15.79:0/1908503573 shutdown_connections 2021-04-09T18:28:18.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.078 7f20d7515700 1 --2- 172.21.15.79:0/1908503573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20d00f5520 0x7f20d00f64b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.078 7f20d7515700 1 --2- 172.21.15.79:0/1908503573 >> v2:172.21.15.89:3300/0 conn(0x7f20d00e9ae0 0x7f20d009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.078 7f20d7515700 1 -- 172.21.15.79:0/1908503573 >> 172.21.15.79:0/1908503573 conn(0x7f20d00e5fe0 msgr2=0x7f20d00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:18.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.078 7f20d7515700 1 -- 172.21.15.79:0/1908503573 shutdown_connections 2021-04-09T18:28:18.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.078 7f20d7515700 1 -- 172.21.15.79:0/1908503573 wait complete. 2021-04-09T18:28:18.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.078 7f20d7515700 1 Processor -- start 2021-04-09T18:28:18.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.078 7f20d7515700 1 -- start start 2021-04-09T18:28:18.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20d7515700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20d008f800 0x7f20d00d6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20d7515700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20d00acfb0 0x7f20d00ad400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20d7515700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20d00b8ae0 0x7f20d00b8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20d7515700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d00d6390 con 0x7f20d00b8ae0 2021-04-09T18:28:18.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20d7515700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d008fc50 con 0x7f20d00acfb0 2021-04-09T18:28:18.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20d7515700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d00d5c20 con 0x7f20d008f800 2021-04-09T18:28:18.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20d5aba700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20d00b8ae0 0x7f20d00b8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20d5aba700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20d00b8ae0 0x7f20d00b8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57688/0 (socket says 172.21.15.79:57688) 2021-04-09T18:28:18.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20d5aba700 1 -- 172.21.15.79:0/2548967895 learned_addr learned my addr 172.21.15.79:0/2548967895 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:18.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20d52b9700 1 --2- 172.21.15.79:0/2548967895 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20d008f800 0x7f20d00d6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20d4ab8700 1 --2- 172.21.15.79:0/2548967895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20d00acfb0 0x7f20d00ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20d5aba700 1 -- 172.21.15.79:0/2548967895 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20d008f800 msgr2=0x7f20d00d6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20d5aba700 1 --2- 172.21.15.79:0/2548967895 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20d008f800 0x7f20d00d6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20d5aba700 1 -- 172.21.15.79:0/2548967895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20d00acfb0 msgr2=0x7f20d00ad400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20d5aba700 1 --2- 172.21.15.79:0/2548967895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20d00acfb0 0x7f20d00ad400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20d5aba700 1 -- 172.21.15.79:0/2548967895 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d00d5f40 con 0x7f20d00b8ae0 2021-04-09T18:28:18.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20d5aba700 1 --2- 172.21.15.79:0/2548967895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20d00b8ae0 0x7f20d00b8f30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f20d00b9f30 tx=0x7f20c800cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:18.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20cdffb700 1 -- 172.21.15.79:0/2548967895 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f20d00d5f40 con 0x7f20d00b8ae0 2021-04-09T18:28:18.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20cdffb700 1 -- 172.21.15.79:0/2548967895 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c80072e0 con 0x7f20d00b8ae0 2021-04-09T18:28:18.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20cdffb700 1 -- 172.21.15.79:0/2548967895 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f20c8005720 con 0x7f20d00b8ae0 2021-04-09T18:28:18.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20d7515700 1 -- 172.21.15.79:0/2548967895 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d00d5740 con 0x7f20d00b8ae0 2021-04-09T18:28:18.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20d7515700 1 -- 172.21.15.79:0/2548967895 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d00d6e50 con 0x7f20d00b8ae0 2021-04-09T18:28:18.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20cdffb700 1 -- 172.21.15.79:0/2548967895 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f20c801b070 con 0x7f20d00b8ae0 2021-04-09T18:28:18.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20cdffb700 1 --2- 172.21.15.79:0/2548967895 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f20b0029100 0x7f20b002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20cdffb700 1 -- 172.21.15.79:0/2548967895 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f20c8038b70 con 0x7f20d00b8ae0 2021-04-09T18:28:18.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.082 7f20d52b9700 1 --2- 172.21.15.79:0/2548967895 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f20b0029100 0x7f20b002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.086 7f20d52b9700 1 --2- 172.21.15.79:0/2548967895 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f20b0029100 0x7f20b002b650 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:18.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.090 7f20d7515700 1 -- 172.21.15.79:0/2548967895 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d00e39e0 con 0x7f20d00b8ae0 2021-04-09T18:28:18.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.094 7f20cdffb700 1 -- 172.21.15.79:0/2548967895 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f20c8000bf0 con 0x7f20d00b8ae0 2021-04-09T18:28:18.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.266 7f20d7515700 1 -- 172.21.15.79:0/2548967895 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20d00f5b20 con 0x7f20d00b8ae0 2021-04-09T18:28:18.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.266 7f20cdffb700 1 -- 172.21.15.79:0/2548967895 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+14345 (secure 0 0 0) 0x7f20c80070d0 con 0x7f20d00b8ae0 2021-04-09T18:28:18.273 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:28:18.273 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:28:14.925421","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:28:13.096102","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2021-04-09 18:28:13.852981","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.79:6833/3417656822":"2021-04-10 18:28:14.914231","172.21.15.79:6832/3417656822":"2021-04-10 18:28:14.914231"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:28:18.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.270 7f20d7515700 1 -- 172.21.15.79:0/2548967895 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f20b0029100 msgr2=0x7f20b002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.270 7f20d7515700 1 --2- 172.21.15.79:0/2548967895 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f20b0029100 0x7f20b002b650 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.270 7f20d7515700 1 -- 172.21.15.79:0/2548967895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20d00b8ae0 msgr2=0x7f20d00b8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.270 7f20d7515700 1 --2- 172.21.15.79:0/2548967895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20d00b8ae0 0x7f20d00b8f30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f20d00b9f30 tx=0x7f20c800cab0).stop 2021-04-09T18:28:18.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.270 7f20d7515700 1 -- 172.21.15.79:0/2548967895 shutdown_connections 2021-04-09T18:28:18.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.270 7f20d7515700 1 --2- 172.21.15.79:0/2548967895 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f20b0029100 0x7f20b002b650 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.270 7f20d7515700 1 --2- 172.21.15.79:0/2548967895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20d00b8ae0 0x7f20d00b8f30 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.270 7f20d7515700 1 --2- 172.21.15.79:0/2548967895 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20d008f800 0x7f20d00d6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.270 7f20d7515700 1 --2- 172.21.15.79:0/2548967895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20d00acfb0 0x7f20d00ad400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.270 7f20d7515700 1 -- 172.21.15.79:0/2548967895 >> 172.21.15.79:0/2548967895 conn(0x7f20d00a92f0 msgr2=0x7f20d008ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:18.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.270 7f20d7515700 1 -- 172.21.15.79:0/2548967895 shutdown_connections 2021-04-09T18:28:18.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.270 7f20d7515700 1 -- 172.21.15.79:0/2548967895 wait complete. 2021-04-09T18:28:18.286 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:28:13.096102', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:28:13.852981', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:28:18.287 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:28:18.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9848fc6700 1 Processor -- start 2021-04-09T18:28:18.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9848fc6700 1 -- start start 2021-04-09T18:28:18.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9848fc6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f98440f5550 0x7f98440f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9848fc6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f98441c8040 0x7f98441ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9848fc6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98440fbb50 con 0x7f98440e9b10 2021-04-09T18:28:18.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9848fc6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98440e9f60 con 0x7f98440f5550 2021-04-09T18:28:18.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9848fc6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98441c3df0 con 0x7f98441c8040 2021-04-09T18:28:18.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9842aef700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f98440f5550 0x7f98440f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9842aef700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f98440f5550 0x7f98440f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57694/0 (socket says 172.21.15.79:57694) 2021-04-09T18:28:18.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9842aef700 1 -- 172.21.15.79:0/3871407745 learned_addr learned my addr 172.21.15.79:0/3871407745 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:18.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f98432f0700 1 --2- 172.21.15.79:0/3871407745 >> v2:172.21.15.89:3300/0 conn(0x7f98441c8040 0x7f98441ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9842aef700 1 -- 172.21.15.79:0/3871407745 >> v2:172.21.15.89:3300/0 conn(0x7f98441c8040 msgr2=0x7f98441ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:18.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9842aef700 1 --2- 172.21.15.79:0/3871407745 >> v2:172.21.15.89:3300/0 conn(0x7f98441c8040 0x7f98441ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9842aef700 1 -- 172.21.15.79:0/3871407745 >> v1:172.21.15.89:6789/0 conn(0x7f98440e9b10 legacy=0x7f984409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9842aef700 1 -- 172.21.15.79:0/3871407745 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984409f910 con 0x7f98440f5550 2021-04-09T18:28:18.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9842aef700 1 --2- 172.21.15.79:0/3871407745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98440f5550 0x7f98440f64e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f982c002f30 tx=0x7f982c00bd70).ready entity=mon.0 client_cookie=84aa3b7f75a9c4fb server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:18.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9841aed700 1 -- 172.21.15.79:0/3871407745 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f984409f910 con 0x7f98440f5550 2021-04-09T18:28:18.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9841aed700 1 -- 172.21.15.79:0/3871407745 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c009950 con 0x7f98440f5550 2021-04-09T18:28:18.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9841aed700 1 -- 172.21.15.79:0/3871407745 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f982c009d20 con 0x7f98440f5550 2021-04-09T18:28:18.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9848fc6700 1 -- 172.21.15.79:0/3871407745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98440f5550 msgr2=0x7f98440f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9848fc6700 1 --2- 172.21.15.79:0/3871407745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98440f5550 0x7f98440f64e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f982c002f30 tx=0x7f982c00bd70).stop 2021-04-09T18:28:18.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9848fc6700 1 -- 172.21.15.79:0/3871407745 shutdown_connections 2021-04-09T18:28:18.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9848fc6700 1 --2- 172.21.15.79:0/3871407745 >> v2:172.21.15.89:3300/0 conn(0x7f98441c8040 0x7f98441ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.382 7f9848fc6700 1 --2- 172.21.15.79:0/3871407745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98440f5550 0x7f98440f64e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.386 7f9848fc6700 1 -- 172.21.15.79:0/3871407745 >> 172.21.15.79:0/3871407745 conn(0x7f98440e6010 msgr2=0x7f98440e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:18.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.386 7f9848fc6700 1 -- 172.21.15.79:0/3871407745 shutdown_connections 2021-04-09T18:28:18.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.386 7f9848fc6700 1 -- 172.21.15.79:0/3871407745 wait complete. 2021-04-09T18:28:18.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.386 7f9848fc6700 1 Processor -- start 2021-04-09T18:28:18.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.386 7f9848fc6700 1 -- start start 2021-04-09T18:28:18.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.386 7f9848fc6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f984409b200 0x7f98441a2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.386 7f9848fc6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f984419bd20 0x7f98441ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.386 7f9848fc6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f984419dbe0 0x7f984419e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.386 7f9848fc6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984419c360 con 0x7f984409b200 2021-04-09T18:28:18.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.386 7f9848fc6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984419c660 con 0x7f984419dbe0 2021-04-09T18:28:18.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.386 7f9848fc6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984419e870 con 0x7f984419bd20 2021-04-09T18:28:18.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.386 7f9842aef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f984409b200 0x7f98441a2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.386 7f9842aef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f984409b200 0x7f98441a2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57702/0 (socket says 172.21.15.79:57702) 2021-04-09T18:28:18.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.386 7f9842aef700 1 -- 172.21.15.79:0/2571425908 learned_addr learned my addr 172.21.15.79:0/2571425908 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:18.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.386 7f98422ee700 1 --2- 172.21.15.79:0/2571425908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f984419bd20 0x7f98441ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.386 7f98432f0700 1 --2- 172.21.15.79:0/2571425908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f984419dbe0 0x7f984419e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.390 7f9842aef700 1 -- 172.21.15.79:0/2571425908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f984419bd20 msgr2=0x7f98441ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.390 7f9842aef700 1 --2- 172.21.15.79:0/2571425908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f984419bd20 0x7f98441ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.390 7f9842aef700 1 -- 172.21.15.79:0/2571425908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f984419dbe0 msgr2=0x7f984419e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.390 7f9842aef700 1 --2- 172.21.15.79:0/2571425908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f984419dbe0 0x7f984419e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.390 7f9842aef700 1 -- 172.21.15.79:0/2571425908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98441ae710 con 0x7f984409b200 2021-04-09T18:28:18.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.390 7f9842aef700 1 --2- 172.21.15.79:0/2571425908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f984409b200 0x7f98441a2aa0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f982c002f30 tx=0x7f982c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:18.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.390 7f983b7fe700 1 -- 172.21.15.79:0/2571425908 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f98441ae710 con 0x7f984409b200 2021-04-09T18:28:18.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.390 7f983b7fe700 1 -- 172.21.15.79:0/2571425908 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c011c50 con 0x7f984409b200 2021-04-09T18:28:18.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.390 7f9848fc6700 1 -- 172.21.15.79:0/2571425908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98441bfab0 con 0x7f984409b200 2021-04-09T18:28:18.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.390 7f983b7fe700 1 -- 172.21.15.79:0/2571425908 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f982c01d630 con 0x7f984409b200 2021-04-09T18:28:18.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.390 7f9848fc6700 1 -- 172.21.15.79:0/2571425908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98441bfe70 con 0x7f984409b200 2021-04-09T18:28:18.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.390 7f983b7fe700 1 -- 172.21.15.79:0/2571425908 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f982c026450 con 0x7f984409b200 2021-04-09T18:28:18.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.390 7f983b7fe700 1 --2- 172.21.15.79:0/2571425908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9828029100 0x7f982802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.390 7f983b7fe700 1 -- 172.21.15.79:0/2571425908 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f982c03b0d0 con 0x7f984409b200 2021-04-09T18:28:18.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.390 7f98422ee700 1 --2- 172.21.15.79:0/2571425908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9828029100 0x7f982802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.390 7f98422ee700 1 --2- 172.21.15.79:0/2571425908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9828029100 0x7f982802b650 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:18.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.394 7f9848fc6700 1 -- 172.21.15.79:0/2571425908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98440e39f0 con 0x7f984409b200 2021-04-09T18:28:18.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.402 7f983b7fe700 1 -- 172.21.15.79:0/2571425908 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f982c009740 con 0x7f984409b200 2021-04-09T18:28:18.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.554 7f9848fc6700 1 -- 172.21.15.79:0/2571425908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f98440a1c90 con 0x7f984409b200 2021-04-09T18:28:18.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.558 7f983b7fe700 1 -- 172.21.15.79:0/2571425908 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f982c011a40 con 0x7f984409b200 2021-04-09T18:28:18.562 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:28:18.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.558 7f9848fc6700 1 -- 172.21.15.79:0/2571425908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9828029100 msgr2=0x7f982802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.558 7f9848fc6700 1 --2- 172.21.15.79:0/2571425908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9828029100 0x7f982802b650 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.558 7f9848fc6700 1 -- 172.21.15.79:0/2571425908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f984409b200 msgr2=0x7f98441a2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.558 7f9848fc6700 1 --2- 172.21.15.79:0/2571425908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f984409b200 0x7f98441a2aa0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f982c002f30 tx=0x7f982c006890).stop 2021-04-09T18:28:18.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.558 7f9848fc6700 1 -- 172.21.15.79:0/2571425908 shutdown_connections 2021-04-09T18:28:18.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.558 7f9848fc6700 1 --2- 172.21.15.79:0/2571425908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9828029100 0x7f982802b650 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.558 7f9848fc6700 1 --2- 172.21.15.79:0/2571425908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f984419dbe0 0x7f984419e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.558 7f9848fc6700 1 --2- 172.21.15.79:0/2571425908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f984409b200 0x7f98441a2aa0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.558 7f9848fc6700 1 --2- 172.21.15.79:0/2571425908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f984419bd20 0x7f98441ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.558 7f9848fc6700 1 -- 172.21.15.79:0/2571425908 >> 172.21.15.79:0/2571425908 conn(0x7f984419f520 msgr2=0x7f98440d8500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:18.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.558 7f9848fc6700 1 -- 172.21.15.79:0/2571425908 shutdown_connections 2021-04-09T18:28:18.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.558 7f9848fc6700 1 -- 172.21.15.79:0/2571425908 wait complete. 2021-04-09T18:28:18.574 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:28:18.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.662 7fc660713700 1 Processor -- start 2021-04-09T18:28:18.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.662 7fc660713700 1 -- start start 2021-04-09T18:28:18.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc660713700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc6580e9b10 0x7fc65809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc660713700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6581c8040 0x7fc6581ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc660713700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6580fbb50 con 0x7fc6580f5550 2021-04-09T18:28:18.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc660713700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6581c3df0 con 0x7fc6581c8040 2021-04-09T18:28:18.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc660713700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6580e9f60 con 0x7fc6580e9b10 2021-04-09T18:28:18.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc65ecb8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6581c8040 0x7fc6581ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc65ecb8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6581c8040 0x7fc6581ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57712/0 (socket says 172.21.15.79:57712) 2021-04-09T18:28:18.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc65ecb8700 1 -- 172.21.15.79:0/2503649572 learned_addr learned my addr 172.21.15.79:0/2503649572 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:18.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc65dcb6700 1 --2- 172.21.15.79:0/2503649572 >> v2:172.21.15.89:3300/0 conn(0x7fc6580e9b10 0x7fc65809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc65ecb8700 1 -- 172.21.15.79:0/2503649572 >> v2:172.21.15.89:3300/0 conn(0x7fc6580e9b10 msgr2=0x7fc65809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:18.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc65ecb8700 1 --2- 172.21.15.79:0/2503649572 >> v2:172.21.15.89:3300/0 conn(0x7fc6580e9b10 0x7fc65809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc65ecb8700 1 -- 172.21.15.79:0/2503649572 >> v1:172.21.15.89:6789/0 conn(0x7fc6580f5550 legacy=0x7fc6580f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc65ecb8700 1 -- 172.21.15.79:0/2503649572 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6580e5700 con 0x7fc6581c8040 2021-04-09T18:28:18.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc65ecb8700 1 --2- 172.21.15.79:0/2503649572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6581c8040 0x7fc6581ca4a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fc6500032b0 tx=0x7fc65000b3c0).ready entity=mon.0 client_cookie=9c7606491f57d9c8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:18.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc65d4b5700 1 -- 172.21.15.79:0/2503649572 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc6580e5700 con 0x7fc6581c8040 2021-04-09T18:28:18.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc65d4b5700 1 -- 172.21.15.79:0/2503649572 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65000bc20 con 0x7fc6581c8040 2021-04-09T18:28:18.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc65d4b5700 1 -- 172.21.15.79:0/2503649572 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc650002020 con 0x7fc6581c8040 2021-04-09T18:28:18.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc660713700 1 -- 172.21.15.79:0/2503649572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6581c8040 msgr2=0x7fc6581ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc660713700 1 --2- 172.21.15.79:0/2503649572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6581c8040 0x7fc6581ca4a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fc6500032b0 tx=0x7fc65000b3c0).stop 2021-04-09T18:28:18.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc660713700 1 -- 172.21.15.79:0/2503649572 shutdown_connections 2021-04-09T18:28:18.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc660713700 1 --2- 172.21.15.79:0/2503649572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6581c8040 0x7fc6581ca4a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc660713700 1 --2- 172.21.15.79:0/2503649572 >> v2:172.21.15.89:3300/0 conn(0x7fc6580e9b10 0x7fc65809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc660713700 1 -- 172.21.15.79:0/2503649572 >> 172.21.15.79:0/2503649572 conn(0x7fc6580e6010 msgr2=0x7fc6580e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:18.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc660713700 1 -- 172.21.15.79:0/2503649572 shutdown_connections 2021-04-09T18:28:18.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.666 7fc660713700 1 -- 172.21.15.79:0/2503649572 wait complete. 2021-04-09T18:28:18.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.670 7fc660713700 1 Processor -- start 2021-04-09T18:28:18.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.670 7fc660713700 1 -- start start 2021-04-09T18:28:18.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc660713700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6581aadf0 0x7fc6580d62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc660713700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6580d50d0 0x7fc6580d5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc660713700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6581ae780 0x7fc6581aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc660713700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6580bf610 con 0x7fc6581ae780 2021-04-09T18:28:18.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc660713700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6580bf910 con 0x7fc6581aadf0 2021-04-09T18:28:18.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc660713700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6581ab240 con 0x7fc6580d50d0 2021-04-09T18:28:18.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc65ecb8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6581ae780 0x7fc6581aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc65ecb8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6581ae780 0x7fc6581aebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57718/0 (socket says 172.21.15.79:57718) 2021-04-09T18:28:18.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc65ecb8700 1 -- 172.21.15.79:0/2154584088 learned_addr learned my addr 172.21.15.79:0/2154584088 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:18.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc65e4b7700 1 --2- 172.21.15.79:0/2154584088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6581aadf0 0x7fc6580d62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc65dcb6700 1 --2- 172.21.15.79:0/2154584088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6580d50d0 0x7fc6580d5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc65ecb8700 1 -- 172.21.15.79:0/2154584088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6580d50d0 msgr2=0x7fc6580d5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc65ecb8700 1 --2- 172.21.15.79:0/2154584088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6580d50d0 0x7fc6580d5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc65ecb8700 1 -- 172.21.15.79:0/2154584088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6581aadf0 msgr2=0x7fc6580d62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc65ecb8700 1 --2- 172.21.15.79:0/2154584088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6581aadf0 0x7fc6580d62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc65ecb8700 1 -- 172.21.15.79:0/2154584088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6580d68e0 con 0x7fc6581ae780 2021-04-09T18:28:18.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc65ecb8700 1 --2- 172.21.15.79:0/2154584088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6581ae780 0x7fc6581aebd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fc65809af90 tx=0x7fc650006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:18.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc64effd700 1 -- 172.21.15.79:0/2154584088 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc6580d68e0 con 0x7fc6581ae780 2021-04-09T18:28:18.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc64effd700 1 -- 172.21.15.79:0/2154584088 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65001a5d0 con 0x7fc6581ae780 2021-04-09T18:28:18.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc660713700 1 -- 172.21.15.79:0/2154584088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6581af200 con 0x7fc6581ae780 2021-04-09T18:28:18.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc64effd700 1 -- 172.21.15.79:0/2154584088 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc650020020 con 0x7fc6581ae780 2021-04-09T18:28:18.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc660713700 1 -- 172.21.15.79:0/2154584088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6580beda0 con 0x7fc6581ae780 2021-04-09T18:28:18.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc64effd700 1 -- 172.21.15.79:0/2154584088 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc650019040 con 0x7fc6581ae780 2021-04-09T18:28:18.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc64effd700 1 --2- 172.21.15.79:0/2154584088 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc640029100 0x7fc64002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc64effd700 1 -- 172.21.15.79:0/2154584088 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fc650018040 con 0x7fc6581ae780 2021-04-09T18:28:18.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.674 7fc65e4b7700 1 --2- 172.21.15.79:0/2154584088 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc640029100 0x7fc64002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.678 7fc65e4b7700 1 --2- 172.21.15.79:0/2154584088 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc640029100 0x7fc64002b650 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:18.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.678 7fc660713700 1 -- 172.21.15.79:0/2154584088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6580e39f0 con 0x7fc6581ae780 2021-04-09T18:28:18.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.686 7fc64effd700 1 -- 172.21.15.79:0/2154584088 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc65001a3c0 con 0x7fc6581ae780 2021-04-09T18:28:18.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.842 7fc660713700 1 -- 172.21.15.79:0/2154584088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fc6580a1c90 con 0x7fc6581ae780 2021-04-09T18:28:18.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.842 7fc64effd700 1 -- 172.21.15.79:0/2154584088 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v40) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc65000ba10 con 0x7fc6581ae780 2021-04-09T18:28:18.848 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:28:18.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.846 7fc660713700 1 -- 172.21.15.79:0/2154584088 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc640029100 msgr2=0x7fc64002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.846 7fc660713700 1 --2- 172.21.15.79:0/2154584088 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc640029100 0x7fc64002b650 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.846 7fc660713700 1 -- 172.21.15.79:0/2154584088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6581ae780 msgr2=0x7fc6581aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.846 7fc660713700 1 --2- 172.21.15.79:0/2154584088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6581ae780 0x7fc6581aebd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fc65809af90 tx=0x7fc650006c10).stop 2021-04-09T18:28:18.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.846 7fc660713700 1 -- 172.21.15.79:0/2154584088 shutdown_connections 2021-04-09T18:28:18.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.846 7fc660713700 1 --2- 172.21.15.79:0/2154584088 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc640029100 0x7fc64002b650 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.846 7fc660713700 1 --2- 172.21.15.79:0/2154584088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6581aadf0 0x7fc6580d62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.846 7fc660713700 1 --2- 172.21.15.79:0/2154584088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6581ae780 0x7fc6581aebd0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.846 7fc660713700 1 --2- 172.21.15.79:0/2154584088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6580d50d0 0x7fc6580d5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.846 7fc660713700 1 -- 172.21.15.79:0/2154584088 >> 172.21.15.79:0/2154584088 conn(0x7fc65809afd0 msgr2=0x7fc65809a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:18.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.846 7fc660713700 1 -- 172.21.15.79:0/2154584088 shutdown_connections 2021-04-09T18:28:18.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.846 7fc660713700 1 -- 172.21.15.79:0/2154584088 wait complete. 2021-04-09T18:28:18.860 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:28:18.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.946 7fd36b6df700 1 Processor -- start 2021-04-09T18:28:18.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.946 7fd36b6df700 1 -- start start 2021-04-09T18:28:18.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd36b6df700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd3640f5550 0x7fd3640f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd36b6df700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3641c8040 0x7fd3641ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd36b6df700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3640fbb50 con 0x7fd3640e9b10 2021-04-09T18:28:18.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd36b6df700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3640e9f60 con 0x7fd3640f5550 2021-04-09T18:28:18.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd36b6df700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3641c3df0 con 0x7fd3641c8040 2021-04-09T18:28:18.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd369483700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd3640f5550 0x7fd3640f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd369483700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd3640f5550 0x7fd3640f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57722/0 (socket says 172.21.15.79:57722) 2021-04-09T18:28:18.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd369483700 1 -- 172.21.15.79:0/4188291798 learned_addr learned my addr 172.21.15.79:0/4188291798 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:18.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd369c84700 1 --2- 172.21.15.79:0/4188291798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3641c8040 0x7fd3641ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd369483700 1 -- 172.21.15.79:0/4188291798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3641c8040 msgr2=0x7fd3641ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:18.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd369483700 1 --2- 172.21.15.79:0/4188291798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3641c8040 0x7fd3641ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd369483700 1 -- 172.21.15.79:0/4188291798 >> v1:172.21.15.89:6789/0 conn(0x7fd3640e9b10 legacy=0x7fd36409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd35bfff700 1 -- 172.21.15.79:0/4188291798 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988290881 0 0) 0x7fd3540010d0 con 0x7fd3640e9b10 2021-04-09T18:28:18.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd369483700 1 -- 172.21.15.79:0/4188291798 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36409f910 con 0x7fd3640f5550 2021-04-09T18:28:18.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd369483700 1 --2- 172.21.15.79:0/4188291798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3640f5550 0x7fd3640f64e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7fd3640f6f30 tx=0x7fd36000b3c0).ready entity=mon.0 client_cookie=5d85584e44bcd72 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:18.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd35bfff700 1 -- 172.21.15.79:0/4188291798 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd36409f910 con 0x7fd3640f5550 2021-04-09T18:28:18.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd35bfff700 1 -- 172.21.15.79:0/4188291798 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36000bbe0 con 0x7fd3640f5550 2021-04-09T18:28:18.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd35bfff700 1 -- 172.21.15.79:0/4188291798 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd360002020 con 0x7fd3640f5550 2021-04-09T18:28:18.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd36b6df700 1 -- 172.21.15.79:0/4188291798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3640f5550 msgr2=0x7fd3640f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd36b6df700 1 --2- 172.21.15.79:0/4188291798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3640f5550 0x7fd3640f64e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7fd3640f6f30 tx=0x7fd36000b3c0).stop 2021-04-09T18:28:18.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd36b6df700 1 -- 172.21.15.79:0/4188291798 shutdown_connections 2021-04-09T18:28:18.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd36b6df700 1 --2- 172.21.15.79:0/4188291798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3641c8040 0x7fd3641ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd36b6df700 1 --2- 172.21.15.79:0/4188291798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3640f5550 0x7fd3640f64e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd36b6df700 1 -- 172.21.15.79:0/4188291798 >> 172.21.15.79:0/4188291798 conn(0x7fd3640e6010 msgr2=0x7fd3640e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:18.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd36b6df700 1 -- 172.21.15.79:0/4188291798 shutdown_connections 2021-04-09T18:28:18.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.950 7fd36b6df700 1 -- 172.21.15.79:0/4188291798 wait complete. 2021-04-09T18:28:18.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.954 7fd36b6df700 1 Processor -- start 2021-04-09T18:28:18.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.954 7fd36b6df700 1 -- start start 2021-04-09T18:28:18.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.954 7fd36b6df700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd364092be0 0x7fd364091660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.954 7fd36b6df700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3640d2000 0x7fd3640d2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.954 7fd36b6df700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3640d2a80 0x7fd3641aac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.954 7fd36b6df700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3640e1ac0 con 0x7fd364092be0 2021-04-09T18:28:18.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.954 7fd36b6df700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd364091360 con 0x7fd3640d2000 2021-04-09T18:28:18.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.954 7fd36b6df700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd364090520 con 0x7fd3640d2a80 2021-04-09T18:28:18.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.954 7fd369483700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd364092be0 0x7fd364091660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.954 7fd369483700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd364092be0 0x7fd364091660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57728/0 (socket says 172.21.15.79:57728) 2021-04-09T18:28:18.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.954 7fd369483700 1 -- 172.21.15.79:0/446223601 learned_addr learned my addr 172.21.15.79:0/446223601 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:18.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.954 7fd369c84700 1 --2- 172.21.15.79:0/446223601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3640d2a80 0x7fd3641aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.954 7fd368c82700 1 --2- 172.21.15.79:0/446223601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3640d2000 0x7fd3640d2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.958 7fd369483700 1 -- 172.21.15.79:0/446223601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3640d2a80 msgr2=0x7fd3641aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.958 7fd369483700 1 --2- 172.21.15.79:0/446223601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3640d2a80 0x7fd3641aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.958 7fd369483700 1 -- 172.21.15.79:0/446223601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3640d2000 msgr2=0x7fd3640d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:18.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.958 7fd369483700 1 --2- 172.21.15.79:0/446223601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3640d2000 0x7fd3640d2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:18.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.958 7fd369483700 1 -- 172.21.15.79:0/446223601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd364090f10 con 0x7fd364092be0 2021-04-09T18:28:18.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.958 7fd369483700 1 --2- 172.21.15.79:0/446223601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd364092be0 0x7fd364091660 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fd3640f6f30 tx=0x7fd360006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:18.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.958 7fd359ffb700 1 -- 172.21.15.79:0/446223601 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd364090f10 con 0x7fd364092be0 2021-04-09T18:28:18.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.958 7fd359ffb700 1 -- 172.21.15.79:0/446223601 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36001b670 con 0x7fd364092be0 2021-04-09T18:28:18.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.958 7fd359ffb700 1 -- 172.21.15.79:0/446223601 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd36001ba40 con 0x7fd364092be0 2021-04-09T18:28:18.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.958 7fd36b6df700 1 -- 172.21.15.79:0/446223601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3641ab270 con 0x7fd364092be0 2021-04-09T18:28:18.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.958 7fd36b6df700 1 -- 172.21.15.79:0/446223601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3641ab720 con 0x7fd364092be0 2021-04-09T18:28:18.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.958 7fd359ffb700 1 -- 172.21.15.79:0/446223601 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd360019040 con 0x7fd364092be0 2021-04-09T18:28:18.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.958 7fd359ffb700 1 --2- 172.21.15.79:0/446223601 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd344029100 0x7fd34402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:18.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.958 7fd359ffb700 1 -- 172.21.15.79:0/446223601 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fd360018040 con 0x7fd364092be0 2021-04-09T18:28:18.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.958 7fd368c82700 1 --2- 172.21.15.79:0/446223601 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd344029100 0x7fd34402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:18.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.958 7fd368c82700 1 --2- 172.21.15.79:0/446223601 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd344029100 0x7fd34402b650 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:18.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.962 7fd36b6df700 1 -- 172.21.15.79:0/446223601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3640e39f0 con 0x7fd364092be0 2021-04-09T18:28:18.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:18.970 7fd359ffb700 1 -- 172.21.15.79:0/446223601 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd36001b460 con 0x7fd364092be0 2021-04-09T18:28:19.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.130 7fd36b6df700 1 -- 172.21.15.79:0/446223601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fd3640a1c90 con 0x7fd364092be0 2021-04-09T18:28:19.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.134 7fd359ffb700 1 -- 172.21.15.79:0/446223601 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v40) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd36000b9d0 con 0x7fd364092be0 2021-04-09T18:28:19.138 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:28:19.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.134 7fd36b6df700 1 -- 172.21.15.79:0/446223601 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd344029100 msgr2=0x7fd34402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:19.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.134 7fd36b6df700 1 --2- 172.21.15.79:0/446223601 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd344029100 0x7fd34402b650 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:19.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.134 7fd36b6df700 1 -- 172.21.15.79:0/446223601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd364092be0 msgr2=0x7fd364091660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:19.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.134 7fd36b6df700 1 --2- 172.21.15.79:0/446223601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd364092be0 0x7fd364091660 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fd3640f6f30 tx=0x7fd360006c10).stop 2021-04-09T18:28:19.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.134 7fd36b6df700 1 -- 172.21.15.79:0/446223601 shutdown_connections 2021-04-09T18:28:19.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.134 7fd36b6df700 1 --2- 172.21.15.79:0/446223601 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd344029100 0x7fd34402b650 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:19.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.134 7fd36b6df700 1 --2- 172.21.15.79:0/446223601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3640d2a80 0x7fd3641aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:19.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.134 7fd36b6df700 1 --2- 172.21.15.79:0/446223601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd364092be0 0x7fd364091660 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:19.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.134 7fd36b6df700 1 --2- 172.21.15.79:0/446223601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3640d2000 0x7fd3640d2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:19.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.134 7fd36b6df700 1 -- 172.21.15.79:0/446223601 >> 172.21.15.79:0/446223601 conn(0x7fd3640953f0 msgr2=0x7fd364094950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:19.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.134 7fd36b6df700 1 -- 172.21.15.79:0/446223601 shutdown_connections 2021-04-09T18:28:19.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.134 7fd36b6df700 1 -- 172.21.15.79:0/446223601 wait complete. 2021-04-09T18:28:19.158 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:28:19.158 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:19.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.242 7f92e036d700 1 Processor -- start 2021-04-09T18:28:19.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.242 7f92e036d700 1 -- start start 2021-04-09T18:28:19.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92e036d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f92d80f5520 0x7f92d80f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:19.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92e036d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f92d80e9ae0 0x7f92d809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:19.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92e036d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92d81c2db0 0x7f92d81c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:19.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92e036d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d80e9f30 con 0x7f92d80f5520 2021-04-09T18:28:19.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92e036d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d80e59d0 con 0x7f92d80e9ae0 2021-04-09T18:28:19.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92e036d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80fbb20 con 0x7f92d81c2db0 2021-04-09T18:28:19.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92de111700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f92d80f5520 0x7f92d80f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:19.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92de111700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f92d80f5520 0x7f92d80f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57736/0 (socket says 172.21.15.79:57736) 2021-04-09T18:28:19.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92de111700 1 -- 172.21.15.79:0/755571635 learned_addr learned my addr 172.21.15.79:0/755571635 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:19.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92dd910700 1 --2- 172.21.15.79:0/755571635 >> v2:172.21.15.89:3300/0 conn(0x7f92d80e9ae0 0x7f92d809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:19.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92de912700 1 --2- 172.21.15.79:0/755571635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92d81c2db0 0x7f92d81c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:19.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92de111700 1 -- 172.21.15.79:0/755571635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92d81c2db0 msgr2=0x7f92d81c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:19.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92de111700 1 --2- 172.21.15.79:0/755571635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92d81c2db0 0x7f92d81c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:19.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92de111700 1 -- 172.21.15.79:0/755571635 >> v2:172.21.15.89:3300/0 conn(0x7f92d80e9ae0 msgr2=0x7f92d809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:19.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92de111700 1 --2- 172.21.15.79:0/755571635 >> v2:172.21.15.89:3300/0 conn(0x7f92d80e9ae0 0x7f92d809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:19.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92de111700 1 -- 172.21.15.79:0/755571635 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d80e56d0 con 0x7f92d80f5520 2021-04-09T18:28:19.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92de111700 1 --2- 172.21.15.79:0/755571635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92d80f5520 0x7f92d80f64b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f92d8125440 tx=0x7f92d400b3c0).ready entity=mon.0 client_cookie=2cd535260fd48045 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:19.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92dd10f700 1 -- 172.21.15.79:0/755571635 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f92d80e56d0 con 0x7f92d80f5520 2021-04-09T18:28:19.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92dd10f700 1 -- 172.21.15.79:0/755571635 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d400bbe0 con 0x7f92d80f5520 2021-04-09T18:28:19.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92dd10f700 1 -- 172.21.15.79:0/755571635 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f92d4002020 con 0x7f92d80f5520 2021-04-09T18:28:19.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92e036d700 1 -- 172.21.15.79:0/755571635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92d80f5520 msgr2=0x7f92d80f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:19.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92e036d700 1 --2- 172.21.15.79:0/755571635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92d80f5520 0x7f92d80f64b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f92d8125440 tx=0x7f92d400b3c0).stop 2021-04-09T18:28:19.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92e036d700 1 -- 172.21.15.79:0/755571635 shutdown_connections 2021-04-09T18:28:19.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92e036d700 1 --2- 172.21.15.79:0/755571635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92d81c2db0 0x7f92d81c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:19.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92e036d700 1 --2- 172.21.15.79:0/755571635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92d80f5520 0x7f92d80f64b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:19.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92e036d700 1 --2- 172.21.15.79:0/755571635 >> v2:172.21.15.89:3300/0 conn(0x7f92d80e9ae0 0x7f92d809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:19.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92e036d700 1 -- 172.21.15.79:0/755571635 >> 172.21.15.79:0/755571635 conn(0x7f92d80e5fe0 msgr2=0x7f92d80e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:19.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92e036d700 1 -- 172.21.15.79:0/755571635 shutdown_connections 2021-04-09T18:28:19.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.246 7f92e036d700 1 -- 172.21.15.79:0/755571635 wait complete. 2021-04-09T18:28:19.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.250 7f92e036d700 1 Processor -- start 2021-04-09T18:28:19.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.250 7f92e036d700 1 -- start start 2021-04-09T18:28:19.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.250 7f92e036d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92d80c1470 0x7f92d80d4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:19.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.250 7f92e036d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92d80c18c0 0x7f92d80d5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:19.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.250 7f92e036d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92d8099b20 0x7f92d8099f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:19.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.250 7f92e036d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80e1ad0 con 0x7f92d80c1470 2021-04-09T18:28:19.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.250 7f92e036d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80ad7f0 con 0x7f92d8099b20 2021-04-09T18:28:19.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.250 7f92e036d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80adaf0 con 0x7f92d80c18c0 2021-04-09T18:28:19.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.250 7f92de111700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92d80c1470 0x7f92d80d4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:19.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.250 7f92de111700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92d80c1470 0x7f92d80d4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57742/0 (socket says 172.21.15.79:57742) 2021-04-09T18:28:19.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.250 7f92de111700 1 -- 172.21.15.79:0/3041622381 learned_addr learned my addr 172.21.15.79:0/3041622381 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:19.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.250 7f92de912700 1 --2- 172.21.15.79:0/3041622381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92d8099b20 0x7f92d8099f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:19.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.250 7f92dd910700 1 --2- 172.21.15.79:0/3041622381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92d80c18c0 0x7f92d80d5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:19.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.254 7f92de111700 1 -- 172.21.15.79:0/3041622381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92d80c18c0 msgr2=0x7f92d80d5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:19.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.254 7f92de111700 1 --2- 172.21.15.79:0/3041622381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92d80c18c0 0x7f92d80d5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:19.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.254 7f92de111700 1 -- 172.21.15.79:0/3041622381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92d8099b20 msgr2=0x7f92d8099f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:19.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.254 7f92de111700 1 --2- 172.21.15.79:0/3041622381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92d8099b20 0x7f92d8099f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:19.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.254 7f92de111700 1 -- 172.21.15.79:0/3041622381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d8096dc0 con 0x7f92d80c1470 2021-04-09T18:28:19.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.254 7f92de111700 1 --2- 172.21.15.79:0/3041622381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92d80c1470 0x7f92d80d4c20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f92d8125440 tx=0x7f92d4006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:19.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.254 7f92ceffd700 1 -- 172.21.15.79:0/3041622381 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f92d8096dc0 con 0x7f92d80c1470 2021-04-09T18:28:19.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.254 7f92ceffd700 1 -- 172.21.15.79:0/3041622381 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d401b460 con 0x7f92d80c1470 2021-04-09T18:28:19.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.254 7f92ceffd700 1 -- 172.21.15.79:0/3041622381 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f92d4020070 con 0x7f92d80c1470 2021-04-09T18:28:19.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.254 7f92e036d700 1 -- 172.21.15.79:0/3041622381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d81aefd0 con 0x7f92d80c1470 2021-04-09T18:28:19.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.254 7f92e036d700 1 -- 172.21.15.79:0/3041622381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d80ad420 con 0x7f92d80c1470 2021-04-09T18:28:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.254 7f92ceffd700 1 -- 172.21.15.79:0/3041622381 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f92d4019040 con 0x7f92d80c1470 2021-04-09T18:28:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.254 7f92ceffd700 1 --2- 172.21.15.79:0/3041622381 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f92c0029100 0x7f92c002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.254 7f92ceffd700 1 -- 172.21.15.79:0/3041622381 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f92d4018040 con 0x7f92d80c1470 2021-04-09T18:28:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.254 7f92dd910700 1 --2- 172.21.15.79:0/3041622381 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f92c0029100 0x7f92c002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.254 7f92e036d700 1 -- 172.21.15.79:0/3041622381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d80e39e0 con 0x7f92d80c1470 2021-04-09T18:28:19.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.258 7f92dd910700 1 --2- 172.21.15.79:0/3041622381 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f92c0029100 0x7f92c002b650 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:19.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.262 7f92ceffd700 1 -- 172.21.15.79:0/3041622381 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f92d400b9d0 con 0x7f92d80c1470 2021-04-09T18:28:19.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.422 7f92e036d700 1 -- 172.21.15.79:0/3041622381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92d80f5b20 con 0x7f92d80c1470 2021-04-09T18:28:19.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.422 7f92ceffd700 1 -- 172.21.15.79:0/3041622381 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2099 (secure 0 0 0) 0x7f92d4011df0 con 0x7f92d80c1470 2021-04-09T18:28:19.428 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 18 2021-04-09T18:28:19.428 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:28:19.429 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5233,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/781814443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":781814443},{"type":"v1","addr":"172.21.15.89:6835","nonce":781814443}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:28:14.813896","modified":"2021-04-09 18:28:16.825652","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5169},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5169":{"gid":5169,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/1928394900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1928394900},{"type":"v1","addr":"172.21.15.79:6833","nonce":1928394900}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-04-09T18:28:19.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.426 7f92e036d700 1 -- 172.21.15.79:0/3041622381 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f92c0029100 msgr2=0x7f92c002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:19.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.426 7f92e036d700 1 --2- 172.21.15.79:0/3041622381 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f92c0029100 0x7f92c002b650 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:19.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.426 7f92e036d700 1 -- 172.21.15.79:0/3041622381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92d80c1470 msgr2=0x7f92d80d4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:19.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.426 7f92e036d700 1 --2- 172.21.15.79:0/3041622381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92d80c1470 0x7f92d80d4c20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f92d8125440 tx=0x7f92d4006c10).stop 2021-04-09T18:28:19.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.426 7f92e036d700 1 -- 172.21.15.79:0/3041622381 shutdown_connections 2021-04-09T18:28:19.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.426 7f92e036d700 1 --2- 172.21.15.79:0/3041622381 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f92c0029100 0x7f92c002b650 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:19.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.426 7f92e036d700 1 --2- 172.21.15.79:0/3041622381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92d8099b20 0x7f92d8099f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:19.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.426 7f92e036d700 1 --2- 172.21.15.79:0/3041622381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92d80c1470 0x7f92d80d4c20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:19.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.426 7f92e036d700 1 --2- 172.21.15.79:0/3041622381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92d80c18c0 0x7f92d80d5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:19.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.426 7f92e036d700 1 -- 172.21.15.79:0/3041622381 >> 172.21.15.79:0/3041622381 conn(0x7f92d81a2720 msgr2=0x7f92d80a24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:19.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.426 7f92e036d700 1 -- 172.21.15.79:0/3041622381 shutdown_connections 2021-04-09T18:28:19.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:19.426 7f92e036d700 1 -- 172.21.15.79:0/3041622381 wait complete. 2021-04-09T18:28:19.641 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:28:14.813896', 'modified': '2021-04-09 18:28:16.825652', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 39, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5169}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5169': {'gid': 5169, 'name': 'a', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6833/1928394900', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 1928394900}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 1928394900}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:28:19.642 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:28:19.643 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2021-04-09T18:28:19.736 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:28:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:28:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2021-04-09T18:28:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 5169, 2021-04-09T18:28:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2021-04-09T18:28:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2021-04-09T18:28:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 3.9101934169999999, 2021-04-09T18:28:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 18, 2021-04-09T18:28:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 40, 2021-04-09T18:28:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 40, 2021-04-09T18:28:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 8.8619770280000001 2021-04-09T18:28:19.741 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:28:19.743 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 5169, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.9101934169999999, "mdsmap_epoch": 18, "osdmap_epoch": 40, "osdmap_epoch_barrier": 40, "uptime": 8.8619770280000001 } 2021-04-09T18:28:19.744 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:28:19.745 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-04-09T18:28:19.745 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi090.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-04-09T18:28:19.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:28:19.747 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:28:19.756 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:28:19.814 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:28:19.815 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:28:19.869 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:28:19.870 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:28:19.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:28:19.872 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:28:19.921 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:28:19.922 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:28:19.969 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:28:19.985 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:28:19.985 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:28:20.042 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:28:20.043 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:28:20.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:28:20.045 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:28:20.046 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:2021-04-09 18:28:20.044 7fa5e74af0c0 -1 init, newargv = 0x564ff1111830 newargc=9ceph-fuse[13169]: starting ceph client 2021-04-09T18:28:20.046 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr: 2021-04-09T18:28:20.053 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13169]: starting fuse 2021-04-09T18:28:20.058 INFO:teuthology.orchestra.run.smithi090.stdout:49 2021-04-09T18:28:20.058 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:28:20.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:28:20.060 DEBUG:teuthology.orchestra.run.smithi090:> sudo python3 -c ' 2021-04-09T18:28:20.060 DEBUG:teuthology.orchestra.run.smithi090:> import glob 2021-04-09T18:28:20.061 DEBUG:teuthology.orchestra.run.smithi090:> import re 2021-04-09T18:28:20.062 DEBUG:teuthology.orchestra.run.smithi090:> import os 2021-04-09T18:28:20.062 DEBUG:teuthology.orchestra.run.smithi090:> import subprocess 2021-04-09T18:28:20.063 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:28:20.063 DEBUG:teuthology.orchestra.run.smithi090:> def find_socket(client_name): 2021-04-09T18:28:20.064 DEBUG:teuthology.orchestra.run.smithi090:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-04-09T18:28:20.065 DEBUG:teuthology.orchestra.run.smithi090:> files = glob.glob(asok_path) 2021-04-09T18:28:20.065 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:28:20.066 DEBUG:teuthology.orchestra.run.smithi090:> # Given a non-glob path, it better be there 2021-04-09T18:28:20.067 DEBUG:teuthology.orchestra.run.smithi090:> if "*" not in asok_path: 2021-04-09T18:28:20.067 DEBUG:teuthology.orchestra.run.smithi090:> assert(len(files) == 1) 2021-04-09T18:28:20.068 DEBUG:teuthology.orchestra.run.smithi090:> return files[0] 2021-04-09T18:28:20.069 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:28:20.069 DEBUG:teuthology.orchestra.run.smithi090:> for f in files: 2021-04-09T18:28:20.070 DEBUG:teuthology.orchestra.run.smithi090:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:28:20.070 DEBUG:teuthology.orchestra.run.smithi090:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:28:20.071 DEBUG:teuthology.orchestra.run.smithi090:> return f 2021-04-09T18:28:20.071 DEBUG:teuthology.orchestra.run.smithi090:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:28:20.072 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:28:20.072 DEBUG:teuthology.orchestra.run.smithi090:> print(find_socket("client.0")) 2021-04-09T18:28:20.072 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:28:20.144 INFO:teuthology.orchestra.run.smithi090.stdout:/var/run/ceph/ceph-client.0.13169.asok 2021-04-09T18:28:20.149 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13169.asok 2021-04-09T18:28:20.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:28:20.149 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13169.asok status 2021-04-09T18:28:20.224 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2021-04-09T18:28:20.225 INFO:teuthology.orchestra.run.smithi090.stdout: "metadata": { 2021-04-09T18:28:20.225 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:28:20.225 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:28:20.225 INFO:teuthology.orchestra.run.smithi090.stdout: "entity_id": "0", 2021-04-09T18:28:20.226 INFO:teuthology.orchestra.run.smithi090.stdout: "hostname": "smithi090", 2021-04-09T18:28:20.226 INFO:teuthology.orchestra.run.smithi090.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-04-09T18:28:20.226 INFO:teuthology.orchestra.run.smithi090.stdout: "pid": "13169", 2021-04-09T18:28:20.226 INFO:teuthology.orchestra.run.smithi090.stdout: "root": "/" 2021-04-09T18:28:20.226 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:28:20.227 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_count": 0, 2021-04-09T18:28:20.227 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_pinned_count": 0, 2021-04-09T18:28:20.227 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 5319, 2021-04-09T18:28:20.227 INFO:teuthology.orchestra.run.smithi090.stdout: "inst": { 2021-04-09T18:28:20.228 INFO:teuthology.orchestra.run.smithi090.stdout: "name": { 2021-04-09T18:28:20.228 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "client", 2021-04-09T18:28:20.228 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5319 2021-04-09T18:28:20.228 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:28:20.229 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:28:20.229 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:28:20.229 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:28:20.229 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 528006622 2021-04-09T18:28:20.230 INFO:teuthology.orchestra.run.smithi090.stdout: } 2021-04-09T18:28:20.230 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:28:20.230 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:28:20.230 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:28:20.230 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:28:20.231 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 528006622 2021-04-09T18:28:20.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:28:20.231 INFO:teuthology.orchestra.run.smithi090.stdout: "inst_str": "client.5319 172.21.15.90:0/528006622", 2021-04-09T18:28:20.231 INFO:teuthology.orchestra.run.smithi090.stdout: "addr_str": "172.21.15.90:0/528006622", 2021-04-09T18:28:20.232 INFO:teuthology.orchestra.run.smithi090.stdout: "inode_count": 1, 2021-04-09T18:28:20.232 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_epoch": 18, 2021-04-09T18:28:20.232 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch": 40, 2021-04-09T18:28:20.232 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:28:20.232 INFO:teuthology.orchestra.run.smithi090.stdout: "blacklisted": false, 2021-04-09T18:28:20.233 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs" 2021-04-09T18:28:20.233 INFO:teuthology.orchestra.run.smithi090.stdout:} 2021-04-09T18:28:20.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:28:20.234 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:28:20.235 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:28:20.241 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:28:20.242 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:28:20.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:28:20.243 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:28:20.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:28:20.301 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:28:20.302 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:28:20.350 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:28:20.352 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:28:20.353 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-04-09T18:28:20.354 DEBUG:teuthology.orchestra.run.smithi090:> import sys 2021-04-09T18:28:20.354 DEBUG:teuthology.orchestra.run.smithi090:> import time 2021-04-09T18:28:20.355 DEBUG:teuthology.orchestra.run.smithi090:> import os 2021-04-09T18:28:20.356 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:28:20.356 DEBUG:teuthology.orchestra.run.smithi090:> n = 1000 2021-04-09T18:28:20.357 DEBUG:teuthology.orchestra.run.smithi090:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-04-09T18:28:20.357 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:28:20.358 DEBUG:teuthology.orchestra.run.smithi090:> if not os.path.exists(os.path.dirname(abs_path)): 2021-04-09T18:28:20.358 DEBUG:teuthology.orchestra.run.smithi090:> os.makedirs(os.path.dirname(abs_path)) 2021-04-09T18:28:20.359 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:28:20.360 DEBUG:teuthology.orchestra.run.smithi090:> for i in range(0, n): 2021-04-09T18:28:20.360 DEBUG:teuthology.orchestra.run.smithi090:> fname = "{0}_{1}".format(abs_path, i) 2021-04-09T18:28:20.361 DEBUG:teuthology.orchestra.run.smithi090:> with open(fname, '"'"'w'"'"') as f: 2021-04-09T18:28:20.362 DEBUG:teuthology.orchestra.run.smithi090:> f.write('"'"'content'"'"') 2021-04-09T18:28:20.362 DEBUG:teuthology.orchestra.run.smithi090:> if True: 2021-04-09T18:28:20.363 DEBUG:teuthology.orchestra.run.smithi090:> f.flush() 2021-04-09T18:28:20.364 DEBUG:teuthology.orchestra.run.smithi090:> os.fsync(f.fileno()) 2021-04-09T18:28:20.364 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:28:33.073 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:33.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa50430e700 1 Processor -- start 2021-04-09T18:28:33.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa50430e700 1 -- start start 2021-04-09T18:28:33.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa50430e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa4fc1c9010 0x7fa4fc1cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:33.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa50430e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4fc0fbb10 con 0x7fa4fc0f5510 2021-04-09T18:28:33.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa50430e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4fc09f900 con 0x7fa4fc0e9ad0 2021-04-09T18:28:33.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa50430e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4fc1c3db0 con 0x7fa4fc1c9010 2021-04-09T18:28:33.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa5028b3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa4fc1c9010 0x7fa4fc1cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:33.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa5028b3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa4fc1c9010 0x7fa4fc1cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57754/0 (socket says 172.21.15.79:57754) 2021-04-09T18:28:33.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa5028b3700 1 -- 172.21.15.79:0/851198596 learned_addr learned my addr 172.21.15.79:0/851198596 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:33.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa5020b2700 1 --1- 172.21.15.79:0/851198596 >> v1:172.21.15.79:6789/0 conn(0x7fa4fc0f5510 0x7fa4fc0f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52460/0 (socket says 172.21.15.79:52460) 2021-04-09T18:28:33.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa5028b3700 1 -- 172.21.15.79:0/851198596 >> v1:172.21.15.89:6789/0 conn(0x7fa4fc0e9ad0 legacy=0x7fa4fc09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:33.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa5028b3700 1 -- 172.21.15.79:0/851198596 >> v1:172.21.15.79:6789/0 conn(0x7fa4fc0f5510 legacy=0x7fa4fc0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:33.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa5010b0700 1 -- 172.21.15.79:0/851198596 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446913735 0 0) 0x7fa4f80010d0 con 0x7fa4fc0f5510 2021-04-09T18:28:33.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa5028b3700 1 -- 172.21.15.79:0/851198596 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc0e56c0 con 0x7fa4fc1c9010 2021-04-09T18:28:33.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa5028b3700 1 --2- 172.21.15.79:0/851198596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4fc1c9010 0x7fa4fc1cb470 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fa4f40032b0 tx=0x7fa4f400b3c0).ready entity=mon.0 client_cookie=b521c607a41bdba7 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:33.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa5010b0700 1 -- 172.21.15.79:0/851198596 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa4fc0e56c0 con 0x7fa4fc1c9010 2021-04-09T18:28:33.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa5010b0700 1 -- 172.21.15.79:0/851198596 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f400bca0 con 0x7fa4fc1c9010 2021-04-09T18:28:33.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa5010b0700 1 -- 172.21.15.79:0/851198596 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa4f4002020 con 0x7fa4fc1c9010 2021-04-09T18:28:33.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa50430e700 1 -- 172.21.15.79:0/851198596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4fc1c9010 msgr2=0x7fa4fc1cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:33.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa50430e700 1 --2- 172.21.15.79:0/851198596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4fc1c9010 0x7fa4fc1cb470 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fa4f40032b0 tx=0x7fa4f400b3c0).stop 2021-04-09T18:28:33.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa50430e700 1 -- 172.21.15.79:0/851198596 shutdown_connections 2021-04-09T18:28:33.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa50430e700 1 --2- 172.21.15.79:0/851198596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4fc1c9010 0x7fa4fc1cb470 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa50430e700 1 -- 172.21.15.79:0/851198596 >> 172.21.15.79:0/851198596 conn(0x7fa4fc0e5fd0 msgr2=0x7fa4fc0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:33.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa50430e700 1 -- 172.21.15.79:0/851198596 shutdown_connections 2021-04-09T18:28:33.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.158 7fa50430e700 1 -- 172.21.15.79:0/851198596 wait complete. 2021-04-09T18:28:33.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.162 7fa50430e700 1 Processor -- start 2021-04-09T18:28:33.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.162 7fa50430e700 1 -- start start 2021-04-09T18:28:33.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.162 7fa50430e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4fc096180 0x7fa4fc09a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:33.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.162 7fa50430e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4fc0a8f50 0x7fa4fc0abd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:33.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.162 7fa50430e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4fc1d2b20 0x7fa4fc1d2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:33.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.162 7fa50430e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc0e9f20 con 0x7fa4fc0a8f50 2021-04-09T18:28:33.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.162 7fa50430e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc0a76b0 con 0x7fa4fc1d2b20 2021-04-09T18:28:33.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.162 7fa50430e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc0a79b0 con 0x7fa4fc096180 2021-04-09T18:28:33.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.162 7fa5018b1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4fc0a8f50 0x7fa4fc0abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:33.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.162 7fa5018b1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4fc0a8f50 0x7fa4fc0abd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57758/0 (socket says 172.21.15.79:57758) 2021-04-09T18:28:33.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.162 7fa5018b1700 1 -- 172.21.15.79:0/2193216010 learned_addr learned my addr 172.21.15.79:0/2193216010 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:33.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.162 7fa5028b3700 1 --2- 172.21.15.79:0/2193216010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4fc1d2b20 0x7fa4fc1d2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:33.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.162 7fa5020b2700 1 --2- 172.21.15.79:0/2193216010 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4fc096180 0x7fa4fc09a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:33.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.166 7fa5018b1700 1 -- 172.21.15.79:0/2193216010 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4fc096180 msgr2=0x7fa4fc09a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:33.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.166 7fa5018b1700 1 --2- 172.21.15.79:0/2193216010 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4fc096180 0x7fa4fc09a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.166 7fa5018b1700 1 -- 172.21.15.79:0/2193216010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4fc1d2b20 msgr2=0x7fa4fc1d2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:33.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.166 7fa5018b1700 1 --2- 172.21.15.79:0/2193216010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4fc1d2b20 0x7fa4fc1d2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.166 7fa5018b1700 1 -- 172.21.15.79:0/2193216010 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc09aa30 con 0x7fa4fc0a8f50 2021-04-09T18:28:33.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.166 7fa5018b1700 1 --2- 172.21.15.79:0/2193216010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4fc0a8f50 0x7fa4fc0abd20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fa4fc0d7f20 tx=0x7fa4ec00cb10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:33.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.166 7fa4f2ffd700 1 -- 172.21.15.79:0/2193216010 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa4ec00e4a0 con 0x7fa4fc0a8f50 2021-04-09T18:28:33.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.166 7fa4f2ffd700 1 -- 172.21.15.79:0/2193216010 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ec00e6a0 con 0x7fa4fc0a8f50 2021-04-09T18:28:33.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.166 7fa50430e700 1 -- 172.21.15.79:0/2193216010 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4fc0a6a70 con 0x7fa4fc0a8f50 2021-04-09T18:28:33.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.166 7fa4f2ffd700 1 -- 172.21.15.79:0/2193216010 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa4ec00ea70 con 0x7fa4fc0a8f50 2021-04-09T18:28:33.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.166 7fa50430e700 1 -- 172.21.15.79:0/2193216010 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4fc0a7240 con 0x7fa4fc0a8f50 2021-04-09T18:28:33.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.166 7fa4f2ffd700 1 -- 172.21.15.79:0/2193216010 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa4ec01a060 con 0x7fa4fc0a8f50 2021-04-09T18:28:33.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.166 7fa4f2ffd700 1 --2- 172.21.15.79:0/2193216010 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa4e4029100 0x7fa4e402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:33.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.166 7fa4f2ffd700 1 -- 172.21.15.79:0/2193216010 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fa4ec039030 con 0x7fa4fc0a8f50 2021-04-09T18:28:33.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.166 7fa5020b2700 1 --2- 172.21.15.79:0/2193216010 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa4e4029100 0x7fa4e402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:33.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.166 7fa5020b2700 1 --2- 172.21.15.79:0/2193216010 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa4e4029100 0x7fa4e402b650 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:33.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.170 7fa50430e700 1 -- 172.21.15.79:0/2193216010 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4fc0e39d0 con 0x7fa4fc0a8f50 2021-04-09T18:28:33.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.174 7fa4f2ffd700 1 -- 172.21.15.79:0/2193216010 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa4ec00e290 con 0x7fa4fc0a8f50 2021-04-09T18:28:33.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.342 7fa50430e700 1 -- 172.21.15.79:0/2193216010 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4fc0a1cb0 con 0x7fa4fc0a8f50 2021-04-09T18:28:33.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.342 7fa4f2ffd700 1 -- 172.21.15.79:0/2193216010 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2099 (secure 0 0 0) 0x7fa4fc0e5c90 con 0x7fa4fc0a8f50 2021-04-09T18:28:33.346 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 18 2021-04-09T18:28:33.346 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:28:33.347 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5233,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/781814443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":781814443},{"type":"v1","addr":"172.21.15.89:6835","nonce":781814443}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:28:14.813896","modified":"2021-04-09 18:28:16.825652","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5169},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5169":{"gid":5169,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/1928394900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1928394900},{"type":"v1","addr":"172.21.15.79:6833","nonce":1928394900}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-04-09T18:28:33.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.342 7fa50430e700 1 -- 172.21.15.79:0/2193216010 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa4e4029100 msgr2=0x7fa4e402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:33.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.342 7fa50430e700 1 --2- 172.21.15.79:0/2193216010 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa4e4029100 0x7fa4e402b650 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.342 7fa50430e700 1 -- 172.21.15.79:0/2193216010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4fc0a8f50 msgr2=0x7fa4fc0abd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:33.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.342 7fa50430e700 1 --2- 172.21.15.79:0/2193216010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4fc0a8f50 0x7fa4fc0abd20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fa4fc0d7f20 tx=0x7fa4ec00cb10).stop 2021-04-09T18:28:33.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.342 7fa50430e700 1 -- 172.21.15.79:0/2193216010 shutdown_connections 2021-04-09T18:28:33.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.342 7fa50430e700 1 --2- 172.21.15.79:0/2193216010 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa4e4029100 0x7fa4e402b650 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.342 7fa50430e700 1 --2- 172.21.15.79:0/2193216010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4fc1d2b20 0x7fa4fc1d2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.342 7fa50430e700 1 --2- 172.21.15.79:0/2193216010 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4fc096180 0x7fa4fc09a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.342 7fa50430e700 1 --2- 172.21.15.79:0/2193216010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4fc0a8f50 0x7fa4fc0abd20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.342 7fa50430e700 1 -- 172.21.15.79:0/2193216010 >> 172.21.15.79:0/2193216010 conn(0x7fa4fc097550 msgr2=0x7fa4fc0bdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:33.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.346 7fa50430e700 1 -- 172.21.15.79:0/2193216010 shutdown_connections 2021-04-09T18:28:33.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.346 7fa50430e700 1 -- 172.21.15.79:0/2193216010 wait complete. 2021-04-09T18:28:33.358 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config set mds_recall_max_caps 20 2021-04-09T18:28:33.440 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:28:33.440 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " 2021-04-09T18:28:33.441 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:28:33.446 INFO:tasks.cephfs.filesystem:_json_asok output: { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-04-09T18:28:33.446 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:33.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.530 7f7b1f6b5700 1 Processor -- start 2021-04-09T18:28:33.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.530 7f7b1f6b5700 1 -- start start 2021-04-09T18:28:33.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.530 7f7b1f6b5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b180e9ad0 0x7f7b1809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:33.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.530 7f7b1f6b5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b180fbb10 con 0x7f7b181c8000 2021-04-09T18:28:33.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.530 7f7b1f6b5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b180e56c0 con 0x7f7b180f5510 2021-04-09T18:28:33.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.530 7f7b1f6b5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b181c3db0 con 0x7f7b180e9ad0 2021-04-09T18:28:33.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.530 7f7b1dc5a700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7b181c8000 0x7f7b181ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52478/0 (socket says 172.21.15.79:52478) 2021-04-09T18:28:33.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.530 7f7b1dc5a700 1 -- 172.21.15.79:0/55012803 learned_addr learned my addr 172.21.15.79:0/55012803 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:28:33.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.530 7f7b1cc58700 1 --2- 172.21.15.79:0/55012803 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b180e9ad0 0x7f7b1809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:33.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.530 7f7b0ffff700 1 -- 172.21.15.79:0/55012803 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940602346 0 0) 0x7f7b100010d0 con 0x7f7b181c8000 2021-04-09T18:28:33.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.530 7f7b0ffff700 1 -- 172.21.15.79:0/55012803 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b00003240 con 0x7f7b181c8000 2021-04-09T18:28:33.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.530 7f7b0ffff700 1 -- 172.21.15.79:0/55012803 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008708367 0 0) 0x7f7b140010d0 con 0x7f7b180f5510 2021-04-09T18:28:33.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.530 7f7b0ffff700 1 -- 172.21.15.79:0/55012803 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b00003620 con 0x7f7b180f5510 2021-04-09T18:28:33.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.530 7f7b1cc58700 1 -- 172.21.15.79:0/55012803 >> v1:172.21.15.89:6789/0 conn(0x7f7b180f5510 legacy=0x7f7b180f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:33.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.530 7f7b1cc58700 1 -- 172.21.15.79:0/55012803 >> v1:172.21.15.79:6789/0 conn(0x7f7b181c8000 legacy=0x7f7b181ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:33.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.530 7f7b1cc58700 1 -- 172.21.15.79:0/55012803 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b180e4320 con 0x7f7b180e9ad0 2021-04-09T18:28:33.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.530 7f7b1cc58700 1 --2- 172.21.15.79:0/55012803 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b180e9ad0 0x7f7b1809f100 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7b080032b0 tx=0x7f7b0800b0e0).ready entity=mon.2 client_cookie=d74605770f0ce6b4 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:33.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.530 7f7b0ffff700 1 -- 172.21.15.79:0/55012803 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7b180e4320 con 0x7f7b180e9ad0 2021-04-09T18:28:33.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b0ffff700 1 -- 172.21.15.79:0/55012803 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0800baf0 con 0x7f7b180e9ad0 2021-04-09T18:28:33.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b0ffff700 1 -- 172.21.15.79:0/55012803 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7b08002020 con 0x7f7b180e9ad0 2021-04-09T18:28:33.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b1f6b5700 1 -- 172.21.15.79:0/55012803 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b180e9ad0 msgr2=0x7f7b1809f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:33.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b1f6b5700 1 --2- 172.21.15.79:0/55012803 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b180e9ad0 0x7f7b1809f100 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7b080032b0 tx=0x7f7b0800b0e0).stop 2021-04-09T18:28:33.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b1f6b5700 1 -- 172.21.15.79:0/55012803 shutdown_connections 2021-04-09T18:28:33.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b1f6b5700 1 --2- 172.21.15.79:0/55012803 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b180e9ad0 0x7f7b1809f100 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b1f6b5700 1 -- 172.21.15.79:0/55012803 >> 172.21.15.79:0/55012803 conn(0x7f7b180e5fd0 msgr2=0x7f7b180e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:33.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b1f6b5700 1 -- 172.21.15.79:0/55012803 shutdown_connections 2021-04-09T18:28:33.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b1f6b5700 1 -- 172.21.15.79:0/55012803 wait complete. 2021-04-09T18:28:33.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b1f6b5700 1 Processor -- start 2021-04-09T18:28:33.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b1f6b5700 1 -- start start 2021-04-09T18:28:33.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b1f6b5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b18090eb0 0x7f7b18091d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:33.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b1f6b5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b18090360 0x7f7b180d4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:33.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b1f6b5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b180d5560 0x7f7b180ad830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:33.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b1f6b5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b180e9f20 con 0x7f7b180d5560 2021-04-09T18:28:33.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b1f6b5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b180916e0 con 0x7f7b18090eb0 2021-04-09T18:28:33.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b1f6b5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b18092370 con 0x7f7b18090360 2021-04-09T18:28:33.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b1dc5a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b180d5560 0x7f7b180ad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:33.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b1dc5a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b180d5560 0x7f7b180ad830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57774/0 (socket says 172.21.15.79:57774) 2021-04-09T18:28:33.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b1dc5a700 1 -- 172.21.15.79:0/4252149842 learned_addr learned my addr 172.21.15.79:0/4252149842 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:33.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b1d459700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b18090eb0 0x7f7b18091d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:33.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.534 7f7b1cc58700 1 --2- 172.21.15.79:0/4252149842 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b18090360 0x7f7b180d4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:33.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.538 7f7b1dc5a700 1 -- 172.21.15.79:0/4252149842 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b18090360 msgr2=0x7f7b180d4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:33.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.538 7f7b1dc5a700 1 --2- 172.21.15.79:0/4252149842 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b18090360 0x7f7b180d4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.538 7f7b1dc5a700 1 -- 172.21.15.79:0/4252149842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b18090eb0 msgr2=0x7f7b18091d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:33.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.538 7f7b1dc5a700 1 --2- 172.21.15.79:0/4252149842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b18090eb0 0x7f7b18091d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.538 7f7b1dc5a700 1 -- 172.21.15.79:0/4252149842 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b180919e0 con 0x7f7b180d5560 2021-04-09T18:28:33.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.538 7f7b1dc5a700 1 --2- 172.21.15.79:0/4252149842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b180d5560 0x7f7b180ad830 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f7b18091960 tx=0x7f7b1000cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:33.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.538 7f7b0dffb700 1 -- 172.21.15.79:0/4252149842 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7b180919e0 con 0x7f7b180d5560 2021-04-09T18:28:33.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.538 7f7b1f6b5700 1 -- 172.21.15.79:0/4252149842 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b18091300 con 0x7f7b180d5560 2021-04-09T18:28:33.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.538 7f7b0dffb700 1 -- 172.21.15.79:0/4252149842 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b100072e0 con 0x7f7b180d5560 2021-04-09T18:28:33.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.538 7f7b1f6b5700 1 -- 172.21.15.79:0/4252149842 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b180adff0 con 0x7f7b180d5560 2021-04-09T18:28:33.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.538 7f7b0dffb700 1 -- 172.21.15.79:0/4252149842 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7b100057e0 con 0x7f7b180d5560 2021-04-09T18:28:33.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.538 7f7b0dffb700 1 -- 172.21.15.79:0/4252149842 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7b100059e0 con 0x7f7b180d5560 2021-04-09T18:28:33.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.538 7f7b0dffb700 1 --2- 172.21.15.79:0/4252149842 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7af8029100 0x7f7af802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:33.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.538 7f7b0dffb700 1 -- 172.21.15.79:0/4252149842 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f7b10038df0 con 0x7f7b180d5560 2021-04-09T18:28:33.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.538 7f7b1d459700 1 --2- 172.21.15.79:0/4252149842 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7af8029100 0x7f7af802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:33.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.538 7f7b1d459700 1 --2- 172.21.15.79:0/4252149842 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7af8029100 0x7f7af802b650 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:33.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.546 7f7b1f6b5700 1 -- 172.21.15.79:0/4252149842 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b180e39d0 con 0x7f7b180d5560 2021-04-09T18:28:33.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.550 7f7b0dffb700 1 -- 172.21.15.79:0/4252149842 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7b180f76b0 con 0x7f7b180d5560 2021-04-09T18:28:33.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.710 7f7b1f6b5700 1 -- 172.21.15.79:0/4252149842 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b180a1cb0 con 0x7f7b180d5560 2021-04-09T18:28:33.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.710 7f7b0dffb700 1 -- 172.21.15.79:0/4252149842 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2099 (secure 0 0 0) 0x7f7b100070d0 con 0x7f7b180d5560 2021-04-09T18:28:33.718 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:28:33.718 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5233,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/781814443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":781814443},{"type":"v1","addr":"172.21.15.89:6835","nonce":781814443}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:28:14.813896","modified":"2021-04-09 18:28:16.825652","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5169},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5169":{"gid":5169,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/1928394900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1928394900},{"type":"v1","addr":"172.21.15.79:6833","nonce":1928394900}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-04-09T18:28:33.719 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 18 2021-04-09T18:28:33.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.714 7f7b1f6b5700 1 -- 172.21.15.79:0/4252149842 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7af8029100 msgr2=0x7f7af802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:33.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.714 7f7b1f6b5700 1 --2- 172.21.15.79:0/4252149842 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7af8029100 0x7f7af802b650 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.714 7f7b1f6b5700 1 -- 172.21.15.79:0/4252149842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b180d5560 msgr2=0x7f7b180ad830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:33.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.714 7f7b1f6b5700 1 --2- 172.21.15.79:0/4252149842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b180d5560 0x7f7b180ad830 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f7b18091960 tx=0x7f7b1000cab0).stop 2021-04-09T18:28:33.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.714 7f7b1f6b5700 1 -- 172.21.15.79:0/4252149842 shutdown_connections 2021-04-09T18:28:33.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.714 7f7b1f6b5700 1 --2- 172.21.15.79:0/4252149842 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7af8029100 0x7f7af802b650 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.714 7f7b1f6b5700 1 --2- 172.21.15.79:0/4252149842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b18090eb0 0x7f7b18091d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.714 7f7b1f6b5700 1 --2- 172.21.15.79:0/4252149842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b180d5560 0x7f7b180ad830 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.714 7f7b1f6b5700 1 --2- 172.21.15.79:0/4252149842 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b18090360 0x7f7b180d4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.714 7f7b1f6b5700 1 -- 172.21.15.79:0/4252149842 >> 172.21.15.79:0/4252149842 conn(0x7f7b180baf60 msgr2=0x7f7b1808fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:33.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.718 7f7b1f6b5700 1 -- 172.21.15.79:0/4252149842 shutdown_connections 2021-04-09T18:28:33.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.718 7f7b1f6b5700 1 -- 172.21.15.79:0/4252149842 wait complete. 2021-04-09T18:28:33.730 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config set mds_recall_max_decay_threshold 400 2021-04-09T18:28:33.809 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:28:33.809 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " 2021-04-09T18:28:33.809 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:28:33.815 INFO:tasks.cephfs.filesystem:_json_asok output: { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-04-09T18:28:33.815 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi090.front.sepia.ceph.com... 2021-04-09T18:28:33.832 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:33.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.922 7f6717e9c700 1 Processor -- start 2021-04-09T18:28:33.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.922 7f6717e9c700 1 -- start start 2021-04-09T18:28:33.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.922 7f6717e9c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f67100f5520 0x7f67100f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:33.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.922 7f6717e9c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67101c8010 0x7f67101ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:33.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.922 7f6717e9c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67100fbb20 con 0x7f67100e9ae0 2021-04-09T18:28:33.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.922 7f6717e9c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67100e9f30 con 0x7f67100f5520 2021-04-09T18:28:33.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.922 7f6717e9c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67101c3dc0 con 0x7f67101c8010 2021-04-09T18:28:33.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6715c40700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f67100f5520 0x7f67100f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:33.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6715c40700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f67100f5520 0x7f67100f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57778/0 (socket says 172.21.15.79:57778) 2021-04-09T18:28:33.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6715c40700 1 -- 172.21.15.79:0/3364392107 learned_addr learned my addr 172.21.15.79:0/3364392107 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:33.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6716441700 1 --2- 172.21.15.79:0/3364392107 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67101c8010 0x7f67101ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:33.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6714c3e700 1 -- 172.21.15.79:0/3364392107 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167619878 0 0) 0x7f67000010d0 con 0x7f67100e9ae0 2021-04-09T18:28:33.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6716441700 1 -- 172.21.15.79:0/3364392107 >> v2:172.21.15.79:3300/0 conn(0x7f67100f5520 msgr2=0x7f67100f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:33.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6716441700 1 --2- 172.21.15.79:0/3364392107 >> v2:172.21.15.79:3300/0 conn(0x7f67100f5520 0x7f67100f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6716441700 1 -- 172.21.15.79:0/3364392107 >> v1:172.21.15.89:6789/0 conn(0x7f67100e9ae0 legacy=0x7f671009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:33.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6716441700 1 -- 172.21.15.79:0/3364392107 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671009f910 con 0x7f67101c8010 2021-04-09T18:28:33.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6716441700 1 --2- 172.21.15.79:0/3364392107 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67101c8010 0x7f67101ca470 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f67080032b0 tx=0x7f670800b0e0).ready entity=mon.2 client_cookie=fc618111d93f5a38 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:33.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6714c3e700 1 -- 172.21.15.79:0/3364392107 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f671009f910 con 0x7f67101c8010 2021-04-09T18:28:33.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6714c3e700 1 -- 172.21.15.79:0/3364392107 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670800bab0 con 0x7f67101c8010 2021-04-09T18:28:33.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6714c3e700 1 -- 172.21.15.79:0/3364392107 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6708002020 con 0x7f67101c8010 2021-04-09T18:28:33.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6717e9c700 1 -- 172.21.15.79:0/3364392107 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67101c8010 msgr2=0x7f67101ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:33.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6717e9c700 1 --2- 172.21.15.79:0/3364392107 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67101c8010 0x7f67101ca470 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f67080032b0 tx=0x7f670800b0e0).stop 2021-04-09T18:28:33.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6717e9c700 1 -- 172.21.15.79:0/3364392107 shutdown_connections 2021-04-09T18:28:33.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6717e9c700 1 --2- 172.21.15.79:0/3364392107 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67101c8010 0x7f67101ca470 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6717e9c700 1 --2- 172.21.15.79:0/3364392107 >> v2:172.21.15.79:3300/0 conn(0x7f67100f5520 0x7f67100f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6717e9c700 1 -- 172.21.15.79:0/3364392107 >> 172.21.15.79:0/3364392107 conn(0x7f67100e5fe0 msgr2=0x7f67100e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:33.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6717e9c700 1 -- 172.21.15.79:0/3364392107 shutdown_connections 2021-04-09T18:28:33.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.926 7f6717e9c700 1 -- 172.21.15.79:0/3364392107 wait complete. 2021-04-09T18:28:33.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f6717e9c700 1 Processor -- start 2021-04-09T18:28:33.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f6717e9c700 1 -- start start 2021-04-09T18:28:33.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f6717e9c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67100b7050 0x7f67100d4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:33.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f6717e9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67100d5620 0x7f67101aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:33.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f6717e9c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67100c1680 0x7f67101af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:33.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f6717e9c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67100b7690 con 0x7f67100d5620 2021-04-09T18:28:33.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f6717e9c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67100b7990 con 0x7f67100c1680 2021-04-09T18:28:33.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f6717e9c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67100c4dc0 con 0x7f67100b7050 2021-04-09T18:28:33.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f671543f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67100d5620 0x7f67101aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:33.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f671543f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67100d5620 0x7f67101aef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57786/0 (socket says 172.21.15.79:57786) 2021-04-09T18:28:33.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f671543f700 1 -- 172.21.15.79:0/4066091575 learned_addr learned my addr 172.21.15.79:0/4066091575 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:33.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f6715c40700 1 --2- 172.21.15.79:0/4066091575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67100b7050 0x7f67100d4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:33.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f6716441700 1 --2- 172.21.15.79:0/4066091575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67100c1680 0x7f67101af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:33.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f671543f700 1 -- 172.21.15.79:0/4066091575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67100b7050 msgr2=0x7f67100d4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:33.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f671543f700 1 --2- 172.21.15.79:0/4066091575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67100b7050 0x7f67100d4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f671543f700 1 -- 172.21.15.79:0/4066091575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67100c1680 msgr2=0x7f67101af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:33.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f671543f700 1 --2- 172.21.15.79:0/4066091575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67100c1680 0x7f67101af570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:33.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f671543f700 1 -- 172.21.15.79:0/4066091575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67101afba0 con 0x7f67100d5620 2021-04-09T18:28:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f6715c40700 1 --2- 172.21.15.79:0/4066091575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67100b7050 0x7f67100d4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:28:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f671543f700 1 --2- 172.21.15.79:0/4066091575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67100d5620 0x7f67101aef40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f6700000e90 tx=0x7f670000cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f67067fc700 1 -- 172.21.15.79:0/4066091575 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67101afba0 con 0x7f67100d5620 2021-04-09T18:28:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.930 7f67067fc700 1 -- 172.21.15.79:0/4066091575 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6700010510 con 0x7f67100d5620 2021-04-09T18:28:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.934 7f6717e9c700 1 -- 172.21.15.79:0/4066091575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67100c3280 con 0x7f67100d5620 2021-04-09T18:28:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.934 7f67067fc700 1 -- 172.21.15.79:0/4066091575 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67000106f0 con 0x7f67100d5620 2021-04-09T18:28:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.934 7f6717e9c700 1 -- 172.21.15.79:0/4066091575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67100c37b0 con 0x7f67100d5620 2021-04-09T18:28:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.934 7f67067fc700 1 -- 172.21.15.79:0/4066091575 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6700019020 con 0x7f67100d5620 2021-04-09T18:28:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.934 7f67067fc700 1 --2- 172.21.15.79:0/4066091575 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f66f8029100 0x7f66f802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.934 7f67067fc700 1 -- 172.21.15.79:0/4066091575 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f6700038ee0 con 0x7f67100d5620 2021-04-09T18:28:33.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.934 7f6715c40700 1 --2- 172.21.15.79:0/4066091575 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f66f8029100 0x7f66f802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:33.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.934 7f6715c40700 1 --2- 172.21.15.79:0/4066091575 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f66f8029100 0x7f66f802b650 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:33.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.938 7f6717e9c700 1 -- 172.21.15.79:0/4066091575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67100e39e0 con 0x7f67100d5620 2021-04-09T18:28:33.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:33.942 7f67067fc700 1 -- 172.21.15.79:0/4066091575 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6700010300 con 0x7f67100d5620 2021-04-09T18:28:34.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.102 7f6717e9c700 1 -- 172.21.15.79:0/4066091575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67100f5b20 con 0x7f67100d5620 2021-04-09T18:28:34.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.106 7f67067fc700 1 -- 172.21.15.79:0/4066091575 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2099 (secure 0 0 0) 0x7f6700000bf0 con 0x7f67100d5620 2021-04-09T18:28:34.111 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 18 2021-04-09T18:28:34.111 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:28:34.112 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5233,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/781814443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":781814443},{"type":"v1","addr":"172.21.15.89:6835","nonce":781814443}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:28:14.813896","modified":"2021-04-09 18:28:16.825652","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5169},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5169":{"gid":5169,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/1928394900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1928394900},{"type":"v1","addr":"172.21.15.79:6833","nonce":1928394900}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-04-09T18:28:34.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.110 7f6717e9c700 1 -- 172.21.15.79:0/4066091575 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f66f8029100 msgr2=0x7f66f802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:34.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.110 7f6717e9c700 1 --2- 172.21.15.79:0/4066091575 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f66f8029100 0x7f66f802b650 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.110 7f6717e9c700 1 -- 172.21.15.79:0/4066091575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67100d5620 msgr2=0x7f67101aef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:34.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.110 7f6717e9c700 1 --2- 172.21.15.79:0/4066091575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67100d5620 0x7f67101aef40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f6700000e90 tx=0x7f670000cab0).stop 2021-04-09T18:28:34.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.110 7f6717e9c700 1 -- 172.21.15.79:0/4066091575 shutdown_connections 2021-04-09T18:28:34.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.110 7f6717e9c700 1 --2- 172.21.15.79:0/4066091575 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f66f8029100 0x7f66f802b650 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.110 7f6717e9c700 1 --2- 172.21.15.79:0/4066091575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67100c1680 0x7f67101af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.110 7f6717e9c700 1 --2- 172.21.15.79:0/4066091575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67100b7050 0x7f67100d4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.110 7f6717e9c700 1 --2- 172.21.15.79:0/4066091575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67100d5620 0x7f67101aef40 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.110 7f6717e9c700 1 -- 172.21.15.79:0/4066091575 >> 172.21.15.79:0/4066091575 conn(0x7f67100a24c0 msgr2=0x7f67100d82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:34.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.110 7f6717e9c700 1 -- 172.21.15.79:0/4066091575 shutdown_connections 2021-04-09T18:28:34.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.110 7f6717e9c700 1 -- 172.21.15.79:0/4066091575 wait complete. 2021-04-09T18:28:34.124 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 2021-04-09T18:28:34.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48aa29a700 1 Processor -- start 2021-04-09T18:28:34.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48aa29a700 1 -- start start 2021-04-09T18:28:34.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48aa29a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f48a40f5520 0x7f48a40f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48aa29a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a40fbb20 con 0x7f48a40e9ae0 2021-04-09T18:28:34.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48aa29a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a409f910 con 0x7f48a41c8010 2021-04-09T18:28:34.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48aa29a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a40e9f30 con 0x7f48a40f5520 2021-04-09T18:28:34.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a37fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f48a40e9ae0 0x7f48a409f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52504/0 (socket says 172.21.15.79:52504) 2021-04-09T18:28:34.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a37fe700 1 -- 172.21.15.79:0/721045060 learned_addr learned my addr 172.21.15.79:0/721045060 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:28:34.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a3fff700 1 --2- 172.21.15.79:0/721045060 >> v2:172.21.15.89:3300/0 conn(0x7f48a40f5520 0x7f48a40f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a2ffd700 1 -- 172.21.15.79:0/721045060 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135229618 0 0) 0x7f4894001450 con 0x7f48a40e9ae0 2021-04-09T18:28:34.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a2ffd700 1 -- 172.21.15.79:0/721045060 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4890003240 con 0x7f48a40e9ae0 2021-04-09T18:28:34.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a2ffd700 1 -- 172.21.15.79:0/721045060 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1145320688 0 0) 0x7f48940019d0 con 0x7f48a40e9ae0 2021-04-09T18:28:34.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a2ffd700 1 -- 172.21.15.79:0/721045060 >> v2:172.21.15.89:3300/0 conn(0x7f48a40f5520 msgr2=0x7f48a40f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:34.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a2ffd700 1 --2- 172.21.15.79:0/721045060 >> v2:172.21.15.89:3300/0 conn(0x7f48a40f5520 0x7f48a40f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a2ffd700 1 -- 172.21.15.79:0/721045060 >> v1:172.21.15.89:6789/0 conn(0x7f48a41c8010 legacy=0x7f48a41ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:34.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a2ffd700 1 -- 172.21.15.79:0/721045060 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a40e56d0 con 0x7f48a40e9ae0 2021-04-09T18:28:34.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a2ffd700 1 -- 172.21.15.79:0/721045060 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f4894001f30 con 0x7f48a40e9ae0 2021-04-09T18:28:34.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a2ffd700 1 -- 172.21.15.79:0/721045060 >> v1:172.21.15.79:6789/0 conn(0x7f48a40e9ae0 legacy=0x7f48a409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:34.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a2ffd700 1 --2- 172.21.15.79:0/721045060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48900038c0 0x7f4890003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a2ffd700 1 --2- 172.21.15.79:0/721045060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48900045a0 0x7f48900049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a2ffd700 1 --2- 172.21.15.79:0/721045060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48900097e0 0x7f489000bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a2ffd700 1 -- 172.21.15.79:0/721045060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a40e9f30 con 0x7f48900045a0 2021-04-09T18:28:34.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a2ffd700 1 -- 172.21.15.79:0/721045060 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48900053f0 con 0x7f48900038c0 2021-04-09T18:28:34.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a37fe700 1 --2- 172.21.15.79:0/721045060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48900045a0 0x7f48900049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a2ffd700 1 -- 172.21.15.79:0/721045060 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4890050300 con 0x7f48900097e0 2021-04-09T18:28:34.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a3fff700 1 --2- 172.21.15.79:0/721045060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48900038c0 0x7f4890003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a37fe700 1 -- 172.21.15.79:0/721045060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48900097e0 msgr2=0x7f489000bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:34.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a883f700 1 --2- 172.21.15.79:0/721045060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48900097e0 0x7f489000bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a37fe700 1 --2- 172.21.15.79:0/721045060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48900097e0 0x7f489000bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a37fe700 1 -- 172.21.15.79:0/721045060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48900038c0 msgr2=0x7f4890003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:34.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a37fe700 1 --2- 172.21.15.79:0/721045060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48900038c0 0x7f4890003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a37fe700 1 -- 172.21.15.79:0/721045060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48900505f0 con 0x7f48900045a0 2021-04-09T18:28:34.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a3fff700 1 --2- 172.21.15.79:0/721045060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48900038c0 0x7f4890003d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:28:34.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a883f700 1 --2- 172.21.15.79:0/721045060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48900097e0 0x7f489000bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:28:34.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a883f700 1 -- 172.21.15.79:0/721045060 reap_dead start 2021-04-09T18:28:34.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a37fe700 1 --2- 172.21.15.79:0/721045060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48900045a0 0x7f48900049f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f4894001380 tx=0x7f4894005840).ready entity=mon.0 client_cookie=c768b2ba37bc34cc server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:34.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a2ffd700 1 -- 172.21.15.79:0/721045060 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48900505f0 con 0x7f48900045a0 2021-04-09T18:28:34.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a2ffd700 1 -- 172.21.15.79:0/721045060 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4894005b80 con 0x7f48900045a0 2021-04-09T18:28:34.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48a2ffd700 1 -- 172.21.15.79:0/721045060 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48a40e56d0 con 0x7f48900045a0 2021-04-09T18:28:34.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48aa29a700 1 -- 172.21.15.79:0/721045060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48900045a0 msgr2=0x7f48900049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:34.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.218 7f48aa29a700 1 --2- 172.21.15.79:0/721045060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48900045a0 0x7f48900049f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f4894001380 tx=0x7f4894005840).stop 2021-04-09T18:28:34.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.222 7f48aa29a700 1 -- 172.21.15.79:0/721045060 shutdown_connections 2021-04-09T18:28:34.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.222 7f48aa29a700 1 --2- 172.21.15.79:0/721045060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48900045a0 0x7f48900049f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.222 7f48aa29a700 1 -- 172.21.15.79:0/721045060 >> 172.21.15.79:0/721045060 conn(0x7f48a40e5fe0 msgr2=0x7f48a40e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:34.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.222 7f48aa29a700 1 -- 172.21.15.79:0/721045060 shutdown_connections 2021-04-09T18:28:34.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.222 7f48aa29a700 1 -- 172.21.15.79:0/721045060 wait complete. 2021-04-09T18:28:34.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.222 7f48aa29a700 1 Processor -- start 2021-04-09T18:28:34.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.222 7f48aa29a700 1 -- start start 2021-04-09T18:28:34.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48aa29a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48a4099020 0x7f48a40bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48aa29a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48a40968e0 0x7f48a40be2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48aa29a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a40c56e0 0x7f48a40c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48aa29a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a41c3dc0 con 0x7f48a40968e0 2021-04-09T18:28:34.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48aa29a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a40977a0 con 0x7f48a40c56e0 2021-04-09T18:28:34.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48aa29a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a4097aa0 con 0x7f48a4099020 2021-04-09T18:28:34.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48a37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48a40968e0 0x7f48a40be2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48a37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48a40968e0 0x7f48a40be2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57806/0 (socket says 172.21.15.79:57806) 2021-04-09T18:28:34.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48a37fe700 1 -- 172.21.15.79:0/2887947032 learned_addr learned my addr 172.21.15.79:0/2887947032 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:34.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48a883f700 1 --2- 172.21.15.79:0/2887947032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a40c56e0 0x7f48a40c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48a3fff700 1 --2- 172.21.15.79:0/2887947032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48a4099020 0x7f48a40bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48a37fe700 1 -- 172.21.15.79:0/2887947032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48a4099020 msgr2=0x7f48a40bdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:34.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48a37fe700 1 --2- 172.21.15.79:0/2887947032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48a4099020 0x7f48a40bdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48a37fe700 1 -- 172.21.15.79:0/2887947032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a40c56e0 msgr2=0x7f48a40c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:34.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48a37fe700 1 --2- 172.21.15.79:0/2887947032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a40c56e0 0x7f48a40c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48a37fe700 1 -- 172.21.15.79:0/2887947032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a4097030 con 0x7f48a40968e0 2021-04-09T18:28:34.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48a37fe700 1 --2- 172.21.15.79:0/2887947032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48a40968e0 0x7f48a40be2e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f48a40d8210 tx=0x7f489400c040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:34.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48a0ff9700 1 -- 172.21.15.79:0/2887947032 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48a4097030 con 0x7f48a40968e0 2021-04-09T18:28:34.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48a0ff9700 1 -- 172.21.15.79:0/2887947032 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4894002010 con 0x7f48a40968e0 2021-04-09T18:28:34.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48aa29a700 1 -- 172.21.15.79:0/2887947032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a40be910 con 0x7f48a40968e0 2021-04-09T18:28:34.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48a0ff9700 1 -- 172.21.15.79:0/2887947032 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f489400d690 con 0x7f48a40968e0 2021-04-09T18:28:34.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48aa29a700 1 -- 172.21.15.79:0/2887947032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a4097350 con 0x7f48a40968e0 2021-04-09T18:28:34.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48a0ff9700 1 -- 172.21.15.79:0/2887947032 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f489401e030 con 0x7f48a40968e0 2021-04-09T18:28:34.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48a0ff9700 1 --2- 172.21.15.79:0/2887947032 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4888029100 0x7f488802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.226 7f48a0ff9700 1 -- 172.21.15.79:0/2887947032 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f489403a6c0 con 0x7f48a40968e0 2021-04-09T18:28:34.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.230 7f48a3fff700 1 --2- 172.21.15.79:0/2887947032 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4888029100 0x7f488802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.230 7f48a3fff700 1 --2- 172.21.15.79:0/2887947032 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4888029100 0x7f488802b650 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:34.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.234 7f48b9320740 1 Processor -- start 2021-04-09T18:28:34.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48b9320740 1 -- start start 2021-04-09T18:28:34.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48b9320740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b9a9df7d80 0x55b9a9e1e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48b9320740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9df81d0 0x55b9a9e1e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48b9320740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9ddb5c0 0x55b9a9ddba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48b9320740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9a9beb200 con 0x55b9a9df81d0 2021-04-09T18:28:34.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48b9320740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9a9bce320 con 0x55b9a9df7d80 2021-04-09T18:28:34.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48b9320740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9a9cba7a0 con 0x55b9a9ddb5c0 2021-04-09T18:28:34.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48a37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9df81d0 0x55b9a9e1e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48a37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9df81d0 0x55b9a9e1e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57814/0 (socket says 172.21.15.79:57814) 2021-04-09T18:28:34.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48a37fe700 1 -- 172.21.15.79:0/1543096009 learned_addr learned my addr 172.21.15.79:0/1543096009 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:34.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48a3fff700 1 --2- 172.21.15.79:0/1543096009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b9a9df7d80 0x55b9a9e1e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48a883f700 1 --2- 172.21.15.79:0/1543096009 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9ddb5c0 0x55b9a9ddba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48a37fe700 1 -- 172.21.15.79:0/1543096009 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9ddb5c0 msgr2=0x55b9a9ddba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:34.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48a37fe700 1 --2- 172.21.15.79:0/1543096009 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9ddb5c0 0x55b9a9ddba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48a37fe700 1 -- 172.21.15.79:0/1543096009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b9a9df7d80 msgr2=0x55b9a9e1e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:34.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48a37fe700 1 --2- 172.21.15.79:0/1543096009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b9a9df7d80 0x55b9a9e1e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48a37fe700 1 -- 172.21.15.79:0/1543096009 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9a9dcfe40 con 0x55b9a9df81d0 2021-04-09T18:28:34.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48a37fe700 1 --2- 172.21.15.79:0/1543096009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9df81d0 0x55b9a9e1e970 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f48940089c0 tx=0x7f4894021dc0).ready entity=mon.0 client_cookie=882ed18952c403d5 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:34.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48aa29a700 1 -- 172.21.15.79:0/1543096009 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55b9a9dcfe40 con 0x55b9a9df81d0 2021-04-09T18:28:34.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48aa29a700 1 -- 172.21.15.79:0/1543096009 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4894020400 con 0x55b9a9df81d0 2021-04-09T18:28:34.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48aa29a700 1 -- 172.21.15.79:0/1543096009 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4894030070 con 0x55b9a9df81d0 2021-04-09T18:28:34.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48b9320740 1 -- 172.21.15.79:0/1543096009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9df81d0 msgr2=0x55b9a9e1e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:34.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48b9320740 1 --2- 172.21.15.79:0/1543096009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9df81d0 0x55b9a9e1e970 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f48940089c0 tx=0x7f4894021dc0).stop 2021-04-09T18:28:34.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48b9320740 1 -- 172.21.15.79:0/1543096009 shutdown_connections 2021-04-09T18:28:34.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48b9320740 1 --2- 172.21.15.79:0/1543096009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b9a9df7d80 0x55b9a9e1e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48b9320740 1 --2- 172.21.15.79:0/1543096009 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9ddb5c0 0x55b9a9ddba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48b9320740 1 --2- 172.21.15.79:0/1543096009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9df81d0 0x55b9a9e1e970 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48b9320740 1 -- 172.21.15.79:0/1543096009 >> 172.21.15.79:0/1543096009 conn(0x55b9a9de1700 msgr2=0x55b9a9dd9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:34.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48b9320740 1 -- 172.21.15.79:0/1543096009 shutdown_connections 2021-04-09T18:28:34.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.238 7f48b9320740 1 -- 172.21.15.79:0/1543096009 wait complete. 2021-04-09T18:28:34.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48b9320740 1 -- start start 2021-04-09T18:28:34.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48b9320740 1 Processor -- start 2021-04-09T18:28:34.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48b9320740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9e0b9a0 0x55b9a9e25ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48b9320740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9df64b0 0x55b9a9df6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48b9320740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b9a9df6f30 0x55b9a9e17040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48b9320740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9a9e18830 con 0x55b9a9df64b0 2021-04-09T18:28:34.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48b9320740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9a9df7820 con 0x55b9a9df6f30 2021-04-09T18:28:34.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48b9320740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9a9def9c0 con 0x55b9a9e0b9a0 2021-04-09T18:28:34.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48a37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9df64b0 0x55b9a9df6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48b9320740 10 client.0 ll_register_callbacks cb 0x55b9a9d964b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-04-09T18:28:34.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48a37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9df64b0 0x55b9a9df6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57820/0 (socket says 172.21.15.79:57820) 2021-04-09T18:28:34.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48a37fe700 1 -- 172.21.15.79:0/3393175322 learned_addr learned my addr 172.21.15.79:0/3393175322 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:34.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48a3fff700 1 --2- 172.21.15.79:0/3393175322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9e0b9a0 0x55b9a9e25ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48a883f700 1 --2- 172.21.15.79:0/3393175322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b9a9df6f30 0x55b9a9e17040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48a37fe700 1 -- 172.21.15.79:0/3393175322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9e0b9a0 msgr2=0x55b9a9e25ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48a37fe700 1 --2- 172.21.15.79:0/3393175322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9e0b9a0 0x55b9a9e25ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48a37fe700 1 -- 172.21.15.79:0/3393175322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b9a9df6f30 msgr2=0x55b9a9e17040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48a37fe700 1 --2- 172.21.15.79:0/3393175322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b9a9df6f30 0x55b9a9e17040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48a37fe700 1 -- 172.21.15.79:0/3393175322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b9a9cccc80 con 0x55b9a9df64b0 2021-04-09T18:28:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48a3fff700 1 --2- 172.21.15.79:0/3393175322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9e0b9a0 0x55b9a9e25ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:28:34.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48a37fe700 1 --2- 172.21.15.79:0/3393175322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9df64b0 0x55b9a9df6900 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f48940089c0 tx=0x7f489400d470).ready entity=mon.0 client_cookie=6821e38df13f241b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:34.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48827fc700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2021-04-09T18:28:34.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48827fc700 1 -- 172.21.15.79:0/3393175322 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55b9a9cccc80 con 0x55b9a9df64b0 2021-04-09T18:28:34.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48b9320740 1 -- 172.21.15.79:0/3393175322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b9a9cd7b00 con 0x55b9a9df64b0 2021-04-09T18:28:34.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48827fc700 1 -- 172.21.15.79:0/3393175322 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f489403a3f0 con 0x55b9a9df64b0 2021-04-09T18:28:34.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48827fc700 1 -- 172.21.15.79:0/3393175322 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f489400a6f0 con 0x55b9a9df64b0 2021-04-09T18:28:34.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48b9320740 10 client.5352 fetch_fsmap learned FSMap version 18 2021-04-09T18:28:34.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48b9320740 1 -- 172.21.15.79:0/3393175322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55b9a9cbe700 con 0x55b9a9df64b0 2021-04-09T18:28:34.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48827fc700 1 -- 172.21.15.79:0/3393175322 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489403f020 con 0x55b9a9df64b0 2021-04-09T18:28:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48827fc700 1 -- 172.21.15.79:0/3393175322 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 18) v1 ==== 1247+0+0 (secure 0 0 0) 0x7f4894013020 con 0x55b9a9df64b0 2021-04-09T18:28:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48b9320740 10 client.5352 fetch_fsmap finished waiting for FSMap version 18 2021-04-09T18:28:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48b9320740 10 client.5352 resolve_mds: resolved ID 'a' to GID 5169 2021-04-09T18:28:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48b9320740 20 client.5352 populate_metadata read hostname 'smithi079' 2021-04-09T18:28:34.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48b9320740 1 --2- 172.21.15.79:0/3393175322 >> [v2:172.21.15.79:6832/1928394900,v1:172.21.15.79:6833/1928394900] conn(0x55b9a9e17b40 0x55b9a9e2ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48b9320740 4 client.5352 mds_command: new command op to 5169 tid=0[{"prefix": "get_command_descriptions"}] 2021-04-09T18:28:34.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48b9320740 1 -- 172.21.15.79:0/3393175322 --> [v2:172.21.15.79:6832/1928394900,v1:172.21.15.79:6833/1928394900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b9a9b5dfd0 con 0x55b9a9e17b40 2021-04-09T18:28:34.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.242 7f48a3fff700 1 --2- 172.21.15.79:0/3393175322 >> [v2:172.21.15.79:6832/1928394900,v1:172.21.15.79:6833/1928394900] conn(0x55b9a9e17b40 0x55b9a9e2ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.246 7f48827fc700 10 client.5352 ms_handle_connect on v2:172.21.15.79:6832/1928394900 2021-04-09T18:28:34.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.246 7f48a3fff700 1 --2- 172.21.15.79:0/3393175322 >> [v2:172.21.15.79:6832/1928394900,v1:172.21.15.79:6833/1928394900] conn(0x55b9a9e17b40 0x55b9a9e2ed90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=30eceb5560e97cb3 server_cookie=5b2de5b557d1ab17 in_seq=0 out_seq=0 2021-04-09T18:28:34.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.246 7f48827fc700 1 -- 172.21.15.79:0/3393175322 <== mds.0 v2:172.21.15.79:6832/1928394900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3729 (crc 0 0 0) 0x55b9a9b5dfd0 con 0x55b9a9e17b40 2021-04-09T18:28:34.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.246 7f48827fc700 10 client.5352 handle_command_reply: tid=0 2021-04-09T18:28:34.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.246 7f48b9320740 1 client.5352 shutdown 2021-04-09T18:28:34.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.246 7f48b9320740 1 -- 172.21.15.79:0/3393175322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9df64b0 msgr2=0x55b9a9df6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:34.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.246 7f48b9320740 1 --2- 172.21.15.79:0/3393175322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9df64b0 0x55b9a9df6900 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f48940089c0 tx=0x7f489400d470).stop 2021-04-09T18:28:34.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.246 7f48b9320740 1 -- 172.21.15.79:0/3393175322 shutdown_connections 2021-04-09T18:28:34.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.246 7f48b9320740 1 --2- 172.21.15.79:0/3393175322 >> [v2:172.21.15.79:6832/1928394900,v1:172.21.15.79:6833/1928394900] conn(0x55b9a9e17b40 0x55b9a9e2ed90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.246 7f48b9320740 1 --2- 172.21.15.79:0/3393175322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b9a9df6f30 0x55b9a9e17040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.246 7f48827fc700 0 client.5352 ms_handle_reset on v2:172.21.15.79:6832/1928394900 2021-04-09T18:28:34.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.246 7f48b9320740 1 --2- 172.21.15.79:0/3393175322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9e0b9a0 0x55b9a9e25ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.246 7f48b9320740 1 --2- 172.21.15.79:0/3393175322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9df64b0 0x55b9a9df6900 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.246 7f48b9320740 1 -- 172.21.15.79:0/3393175322 >> 172.21.15.79:0/3393175322 conn(0x55b9a9de1700 msgr2=0x55b9a9e0f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:34.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.246 7f48b9320740 1 -- 172.21.15.79:0/3393175322 shutdown_connections 2021-04-09T18:28:34.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.246 7f48b9320740 1 -- 172.21.15.79:0/3393175322 wait complete. 2021-04-09T18:28:34.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.246 7f48b9320740 20 client.5352 trim_cache size 0 max 16384 2021-04-09T18:28:34.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 Processor -- start 2021-04-09T18:28:34.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 -- start start 2021-04-09T18:28:34.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b9a9e5afb0 0x55b9a9e5b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9e5ba30 0x55b9a9e05e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9e06430 0x55b9a9e06880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9a9df7670 con 0x55b9a9e06430 2021-04-09T18:28:34.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9a9e18530 con 0x55b9a9e5afb0 2021-04-09T18:28:34.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9a9e16d40 con 0x55b9a9e5ba30 2021-04-09T18:28:34.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48a883f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9e06430 0x55b9a9e06880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48a883f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9e06430 0x55b9a9e06880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57830/0 (socket says 172.21.15.79:57830) 2021-04-09T18:28:34.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48a883f700 1 -- 172.21.15.79:0/1629480593 learned_addr learned my addr 172.21.15.79:0/1629480593 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:34.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48a3fff700 1 --2- 172.21.15.79:0/1629480593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b9a9e5afb0 0x55b9a9e5b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48a37fe700 1 --2- 172.21.15.79:0/1629480593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9e5ba30 0x55b9a9e05e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48a883f700 1 -- 172.21.15.79:0/1629480593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9e5ba30 msgr2=0x55b9a9e05e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:34.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48a883f700 1 --2- 172.21.15.79:0/1629480593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9e5ba30 0x55b9a9e05e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48a883f700 1 -- 172.21.15.79:0/1629480593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b9a9e5afb0 msgr2=0x55b9a9e5b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:34.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48a883f700 1 --2- 172.21.15.79:0/1629480593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b9a9e5afb0 0x55b9a9e5b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48a883f700 1 -- 172.21.15.79:0/1629480593 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9a9e13710 con 0x55b9a9e06430 2021-04-09T18:28:34.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48a883f700 1 --2- 172.21.15.79:0/1629480593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9e06430 0x55b9a9e06880 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f4894001c00 tx=0x7f489c0078c0).ready entity=mon.0 client_cookie=db040a03e04e624d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:34.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f4898ff9700 1 -- 172.21.15.79:0/1629480593 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55b9a9e13710 con 0x55b9a9e06430 2021-04-09T18:28:34.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f4898ff9700 1 -- 172.21.15.79:0/1629480593 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c002d40 con 0x55b9a9e06430 2021-04-09T18:28:34.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f4898ff9700 1 -- 172.21.15.79:0/1629480593 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f489c01a030 con 0x55b9a9e06430 2021-04-09T18:28:34.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 -- 172.21.15.79:0/1629480593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9e06430 msgr2=0x55b9a9e06880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:34.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 --2- 172.21.15.79:0/1629480593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9e06430 0x55b9a9e06880 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f4894001c00 tx=0x7f489c0078c0).stop 2021-04-09T18:28:34.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 -- 172.21.15.79:0/1629480593 shutdown_connections 2021-04-09T18:28:34.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 --2- 172.21.15.79:0/1629480593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b9a9e5afb0 0x55b9a9e5b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 --2- 172.21.15.79:0/1629480593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9e06430 0x55b9a9e06880 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 --2- 172.21.15.79:0/1629480593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9e5ba30 0x55b9a9e05e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 -- 172.21.15.79:0/1629480593 >> 172.21.15.79:0/1629480593 conn(0x55b9a9e26fa0 msgr2=0x55b9a9e56140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:34.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 -- 172.21.15.79:0/1629480593 shutdown_connections 2021-04-09T18:28:34.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 -- 172.21.15.79:0/1629480593 wait complete. 2021-04-09T18:28:34.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 -- start start 2021-04-09T18:28:34.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 Processor -- start 2021-04-09T18:28:34.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9e51b00 0x55b9a9e3bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9e62410 0x55b9a9e62860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b9a9e62e90 0x55b9a9e587c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9a9d8cf70 con 0x55b9a9e62410 2021-04-09T18:28:34.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9a9e57220 con 0x55b9a9e62e90 2021-04-09T18:28:34.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9a9e12ef0 con 0x55b9a9e51b00 2021-04-09T18:28:34.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.258 7f48b9320740 10 client.0 ll_register_callbacks cb 0x7f48a41a1cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-04-09T18:28:34.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48a37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9e62410 0x55b9a9e62860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48a37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9e62410 0x55b9a9e62860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57834/0 (socket says 172.21.15.79:57834) 2021-04-09T18:28:34.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48a37fe700 1 -- 172.21.15.79:0/2614567446 learned_addr learned my addr 172.21.15.79:0/2614567446 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:28:34.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48a883f700 1 --2- 172.21.15.79:0/2614567446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b9a9e62e90 0x55b9a9e587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48a3fff700 1 --2- 172.21.15.79:0/2614567446 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9e51b00 0x55b9a9e3bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48a37fe700 1 -- 172.21.15.79:0/2614567446 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9e51b00 msgr2=0x55b9a9e3bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:34.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48a37fe700 1 --2- 172.21.15.79:0/2614567446 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9e51b00 0x55b9a9e3bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48a37fe700 1 -- 172.21.15.79:0/2614567446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b9a9e62e90 msgr2=0x55b9a9e587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:34.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48a37fe700 1 --2- 172.21.15.79:0/2614567446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b9a9e62e90 0x55b9a9e587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:34.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48a37fe700 1 -- 172.21.15.79:0/2614567446 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b9a9dceec0 con 0x55b9a9e62410 2021-04-09T18:28:34.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48a3fff700 1 --2- 172.21.15.79:0/2614567446 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9e51b00 0x55b9a9e3bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:28:34.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48a37fe700 1 --2- 172.21.15.79:0/2614567446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9e62410 0x55b9a9e62860 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f4894001cc0 tx=0x7f489400af10).ready entity=mon.0 client_cookie=8d8c31fba81c81ef server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:34.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48837fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2021-04-09T18:28:34.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48837fe700 1 -- 172.21.15.79:0/2614567446 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55b9a9dceec0 con 0x55b9a9e62410 2021-04-09T18:28:34.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48b9320740 1 -- 172.21.15.79:0/2614567446 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b9a9cccc80 con 0x55b9a9e62410 2021-04-09T18:28:34.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48837fe700 1 -- 172.21.15.79:0/2614567446 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f4894049c20 con 0x55b9a9e62410 2021-04-09T18:28:34.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48837fe700 1 -- 172.21.15.79:0/2614567446 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f489400a6f0 con 0x55b9a9e62410 2021-04-09T18:28:34.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48b9320740 10 client.5358 fetch_fsmap learned FSMap version 18 2021-04-09T18:28:34.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48b9320740 1 -- 172.21.15.79:0/2614567446 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55b9a9e16a10 con 0x55b9a9e62410 2021-04-09T18:28:34.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48837fe700 1 -- 172.21.15.79:0/2614567446 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b9a9cccc80 con 0x55b9a9e62410 2021-04-09T18:28:34.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48837fe700 1 -- 172.21.15.79:0/2614567446 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 18) v1 ==== 1247+0+0 (secure 0 0 0) 0x7f4894013040 con 0x55b9a9e62410 2021-04-09T18:28:34.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48b9320740 10 client.5358 fetch_fsmap finished waiting for FSMap version 18 2021-04-09T18:28:34.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48b9320740 10 client.5358 resolve_mds: resolved ID 'a' to GID 5169 2021-04-09T18:28:34.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48b9320740 20 client.5358 populate_metadata read hostname 'smithi079' 2021-04-09T18:28:34.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48b9320740 1 --2- 172.21.15.79:0/2614567446 >> [v2:172.21.15.79:6832/1928394900,v1:172.21.15.79:6833/1928394900] conn(0x55b9a9e58df0 0x55b9a9e59240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:34.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48b9320740 4 client.5358 mds_command: new command op to 5169 tid=0[{"prefix": "cache drop"}] 2021-04-09T18:28:34.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48b9320740 1 -- 172.21.15.79:0/2614567446 --> [v2:172.21.15.79:6832/1928394900,v1:172.21.15.79:6833/1928394900] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x55b9a9b5dfd0 con 0x55b9a9e58df0 2021-04-09T18:28:34.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48a3fff700 1 --2- 172.21.15.79:0/2614567446 >> [v2:172.21.15.79:6832/1928394900,v1:172.21.15.79:6833/1928394900] conn(0x55b9a9e58df0 0x55b9a9e59240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:34.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48837fe700 10 client.5358 ms_handle_connect on v2:172.21.15.79:6832/1928394900 2021-04-09T18:28:34.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:28:34.262 7f48a3fff700 1 --2- 172.21.15.79:0/2614567446 >> [v2:172.21.15.79:6832/1928394900,v1:172.21.15.79:6833/1928394900] conn(0x55b9a9e58df0 0x55b9a9e59240 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7e3cf6c62fe8b29d server_cookie=2b50c592da740539 in_seq=0 out_seq=0 2021-04-09T18:28:42.559 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:28:42.562 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:28:42.565 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:28:42.568 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:28:42.572 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:29:12.639 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:29:12.643 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:29:12.646 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:29:12.649 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:29:12.651 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:29:36.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.278 7f48837fe700 1 -- 172.21.15.79:0/2614567446 <== mds.0 v2:172.21.15.79:6832/1928394900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+381 (crc 0 0 0) 0x55b9a9b5dfd0 con 0x55b9a9e58df0 2021-04-09T18:29:36.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.278 7f48837fe700 10 client.5358 handle_command_reply: tid=0 2021-04-09T18:29:36.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.278 7f48b9320740 1 client.5358 shutdown 2021-04-09T18:29:36.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.278 7f48b9320740 1 -- 172.21.15.79:0/2614567446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9e62410 msgr2=0x55b9a9e62860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:36.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.278 7f48b9320740 1 --2- 172.21.15.79:0/2614567446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9e62410 0x55b9a9e62860 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f4894001cc0 tx=0x7f489400af10).stop 2021-04-09T18:29:36.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.278 7f48b9320740 1 -- 172.21.15.79:0/2614567446 shutdown_connections 2021-04-09T18:29:36.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.278 7f48b9320740 1 --2- 172.21.15.79:0/2614567446 >> [v2:172.21.15.79:6832/1928394900,v1:172.21.15.79:6833/1928394900] conn(0x55b9a9e58df0 0x55b9a9e59240 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.278 7f48b9320740 1 --2- 172.21.15.79:0/2614567446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b9a9e62e90 0x55b9a9e587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.278 7f48837fe700 0 client.5358 ms_handle_reset on v2:172.21.15.79:6832/1928394900 2021-04-09T18:29:36.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.278 7f48b9320740 1 --2- 172.21.15.79:0/2614567446 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b9a9e51b00 0x55b9a9e3bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.278 7f48b9320740 1 --2- 172.21.15.79:0/2614567446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9a9e62410 0x55b9a9e62860 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.278 7f48b9320740 1 -- 172.21.15.79:0/2614567446 >> 172.21.15.79:0/2614567446 conn(0x55b9a9e53ae0 msgr2=0x55b9a9deec70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:36.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.278 7f48b9320740 1 -- 172.21.15.79:0/2614567446 shutdown_connections 2021-04-09T18:29:36.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.278 7f48b9320740 1 -- 172.21.15.79:0/2614567446 wait complete. 2021-04-09T18:29:36.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.278 7f48b9320740 20 client.5358 trim_cache size 0 max 16384 2021-04-09T18:29:36.288 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:29:36.288 INFO:teuthology.orchestra.run.smithi079.stdout: "client_recall": { 2021-04-09T18:29:36.289 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2021-04-09T18:29:36.289 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "(0) Success", 2021-04-09T18:29:36.289 INFO:teuthology.orchestra.run.smithi079.stdout: "recalled": 220 2021-04-09T18:29:36.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:36.290 INFO:teuthology.orchestra.run.smithi079.stdout: "flush_journal": { 2021-04-09T18:29:36.290 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2021-04-09T18:29:36.290 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "" 2021-04-09T18:29:36.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:36.291 INFO:teuthology.orchestra.run.smithi079.stdout: "trim_cache": { 2021-04-09T18:29:36.291 INFO:teuthology.orchestra.run.smithi079.stdout: "trimmed": 626 2021-04-09T18:29:36.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:36.291 INFO:teuthology.orchestra.run.smithi079.stdout: "cache": { 2021-04-09T18:29:36.292 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": { 2021-04-09T18:29:36.292 INFO:teuthology.orchestra.run.smithi079.stdout: "items": 8585, 2021-04-09T18:29:36.292 INFO:teuthology.orchestra.run.smithi079.stdout: "bytes": 1390472 2021-04-09T18:29:36.292 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:36.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:36.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 62.015295273 2021-04-09T18:29:36.293 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:29:36.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.282 7f48aa29a700 1 -- 172.21.15.79:0/2887947032 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4888029100 msgr2=0x7f488802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:36.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.282 7f48aa29a700 1 --2- 172.21.15.79:0/2887947032 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4888029100 0x7f488802b650 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.282 7f48aa29a700 1 -- 172.21.15.79:0/2887947032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48a40968e0 msgr2=0x7f48a40be2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:36.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.282 7f48aa29a700 1 --2- 172.21.15.79:0/2887947032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48a40968e0 0x7f48a40be2e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f48a40d8210 tx=0x7f489400c040).stop 2021-04-09T18:29:36.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.282 7f48aa29a700 1 -- 172.21.15.79:0/2887947032 shutdown_connections 2021-04-09T18:29:36.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.282 7f48aa29a700 1 --2- 172.21.15.79:0/2887947032 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4888029100 0x7f488802b650 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.282 7f48aa29a700 1 --2- 172.21.15.79:0/2887947032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a40c56e0 0x7f48a40c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.282 7f48aa29a700 1 --2- 172.21.15.79:0/2887947032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48a4099020 0x7f48a40bdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.282 7f48aa29a700 1 --2- 172.21.15.79:0/2887947032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48a40968e0 0x7f48a40be2e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.282 7f48aa29a700 1 -- 172.21.15.79:0/2887947032 >> 172.21.15.79:0/2887947032 conn(0x7f48a409af80 msgr2=0x7f48a409a390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:36.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.282 7f48aa29a700 1 -- 172.21.15.79:0/2887947032 shutdown_connections 2021-04-09T18:29:36.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.282 7f48aa29a700 1 -- 172.21.15.79:0/2887947032 wait complete. 2021-04-09T18:29:36.299 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-04-09T18:29:36.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:36.300 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:29:36.300 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:29:36.307 INFO:teuthology.orchestra.run.smithi090.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-04-09T18:29:36.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:29:36.309 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-04-09T18:29:36.309 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi090.front.sepia.ceph.com... 2021-04-09T18:29:36.310 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:29:36.310 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:29:36.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:36.392 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:29:36.392 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:29:36.440 INFO:teuthology.orchestra.run.smithi090.stdout:ext2/ext3 2021-04-09T18:29:36.442 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:29:36.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:29:36.443 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:29:36.490 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:29:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1eb8f4700 1 Processor -- start 2021-04-09T18:29:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1eb8f4700 1 -- start start 2021-04-09T18:29:36.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1eb8f4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb1e40f5510 0x7fb1e40f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:36.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1eb8f4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb1e40e9ad0 0x7fb1e409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:36.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1eb8f4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e40fbb10 con 0x7fb1e41c2da0 2021-04-09T18:29:36.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1eb8f4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e40e9f20 con 0x7fb1e40f5510 2021-04-09T18:29:36.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1eb8f4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e40e59c0 con 0x7fb1e40e9ad0 2021-04-09T18:29:36.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1e9698700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb1e40f5510 0x7fb1e40f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:36.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1e9698700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb1e40f5510 0x7fb1e40f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57844/0 (socket says 172.21.15.79:57844) 2021-04-09T18:29:36.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1e9698700 1 -- 172.21.15.79:0/2920668233 learned_addr learned my addr 172.21.15.79:0/2920668233 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:36.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1e8e97700 1 --2- 172.21.15.79:0/2920668233 >> v2:172.21.15.89:3300/0 conn(0x7fb1e40e9ad0 0x7fb1e409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:36.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1e9698700 1 -- 172.21.15.79:0/2920668233 >> v2:172.21.15.89:3300/0 conn(0x7fb1e40e9ad0 msgr2=0x7fb1e409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:36.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1e9698700 1 --2- 172.21.15.79:0/2920668233 >> v2:172.21.15.89:3300/0 conn(0x7fb1e40e9ad0 0x7fb1e409f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1e9698700 1 -- 172.21.15.79:0/2920668233 >> v1:172.21.15.89:6789/0 conn(0x7fb1e41c2da0 legacy=0x7fb1e41c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:36.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1e9698700 1 -- 172.21.15.79:0/2920668233 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e40e56c0 con 0x7fb1e40f5510 2021-04-09T18:29:36.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1e8e97700 1 --2- 172.21.15.79:0/2920668233 >> v2:172.21.15.89:3300/0 conn(0x7fb1e40e9ad0 0x7fb1e409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:29:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1e9698700 1 --2- 172.21.15.79:0/2920668233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1e40f5510 0x7fb1e40f64a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fb1e0002f30 tx=0x7fb1e000bd70).ready entity=mon.0 client_cookie=cede7596227d240b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1dbfff700 1 -- 172.21.15.79:0/2920668233 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb1e40e56c0 con 0x7fb1e40f5510 2021-04-09T18:29:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1dbfff700 1 -- 172.21.15.79:0/2920668233 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e0009950 con 0x7fb1e40f5510 2021-04-09T18:29:36.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1dbfff700 1 -- 172.21.15.79:0/2920668233 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb1e0009d20 con 0x7fb1e40f5510 2021-04-09T18:29:36.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1eb8f4700 1 -- 172.21.15.79:0/2920668233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1e40f5510 msgr2=0x7fb1e40f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:36.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1eb8f4700 1 --2- 172.21.15.79:0/2920668233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1e40f5510 0x7fb1e40f64a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fb1e0002f30 tx=0x7fb1e000bd70).stop 2021-04-09T18:29:36.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1eb8f4700 1 -- 172.21.15.79:0/2920668233 shutdown_connections 2021-04-09T18:29:36.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1eb8f4700 1 --2- 172.21.15.79:0/2920668233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1e40f5510 0x7fb1e40f64a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1eb8f4700 1 --2- 172.21.15.79:0/2920668233 >> v2:172.21.15.89:3300/0 conn(0x7fb1e40e9ad0 0x7fb1e409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1eb8f4700 1 -- 172.21.15.79:0/2920668233 >> 172.21.15.79:0/2920668233 conn(0x7fb1e40e5fd0 msgr2=0x7fb1e40e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:36.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1eb8f4700 1 -- 172.21.15.79:0/2920668233 shutdown_connections 2021-04-09T18:29:36.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.582 7fb1eb8f4700 1 -- 172.21.15.79:0/2920668233 wait complete. 2021-04-09T18:29:36.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.586 7fb1eb8f4700 1 Processor -- start 2021-04-09T18:29:36.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.586 7fb1eb8f4700 1 -- start start 2021-04-09T18:29:36.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1eb8f4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1e40b9240 0x7fb1e40d6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:36.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1eb8f4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1e409ab10 0x7fb1e40d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:36.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1eb8f4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1e40b7610 0x7fb1e40cf310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:36.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1eb8f4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40d6470 con 0x7fb1e409ab10 2021-04-09T18:29:36.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1eb8f4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e409af60 con 0x7fb1e40b7610 2021-04-09T18:29:36.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1eb8f4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40d0df0 con 0x7fb1e40b9240 2021-04-09T18:29:36.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1e8e97700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1e409ab10 0x7fb1e40d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:36.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1e8e97700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1e409ab10 0x7fb1e40d07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57850/0 (socket says 172.21.15.79:57850) 2021-04-09T18:29:36.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1e8e97700 1 -- 172.21.15.79:0/425936404 learned_addr learned my addr 172.21.15.79:0/425936404 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:36.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1e9e99700 1 --2- 172.21.15.79:0/425936404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1e40b7610 0x7fb1e40cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:36.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1e9698700 1 --2- 172.21.15.79:0/425936404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1e40b9240 0x7fb1e40d6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:36.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1e8e97700 1 -- 172.21.15.79:0/425936404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1e40b9240 msgr2=0x7fb1e40d6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:36.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1e8e97700 1 --2- 172.21.15.79:0/425936404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1e40b9240 0x7fb1e40d6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1e8e97700 1 -- 172.21.15.79:0/425936404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1e40b7610 msgr2=0x7fb1e40cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1e8e97700 1 --2- 172.21.15.79:0/425936404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1e40b7610 0x7fb1e40cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1e8e97700 1 -- 172.21.15.79:0/425936404 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e40cf940 con 0x7fb1e409ab10 2021-04-09T18:29:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1e9698700 1 --2- 172.21.15.79:0/425936404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1e40b9240 0x7fb1e40d6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:29:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1e8e97700 1 --2- 172.21.15.79:0/425936404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1e409ab10 0x7fb1e40d07c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fb1e40d63f0 tx=0x7fb1d400be90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1d9ffb700 1 -- 172.21.15.79:0/425936404 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb1e40cf940 con 0x7fb1e409ab10 2021-04-09T18:29:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1d9ffb700 1 -- 172.21.15.79:0/425936404 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d40099e0 con 0x7fb1e409ab10 2021-04-09T18:29:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1eb8f4700 1 -- 172.21.15.79:0/425936404 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e40b7a60 con 0x7fb1e409ab10 2021-04-09T18:29:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1d9ffb700 1 -- 172.21.15.79:0/425936404 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb1d400f040 con 0x7fb1e409ab10 2021-04-09T18:29:36.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1eb8f4700 1 -- 172.21.15.79:0/425936404 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e40d5310 con 0x7fb1e409ab10 2021-04-09T18:29:36.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1d9ffb700 1 -- 172.21.15.79:0/425936404 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb1d4013480 con 0x7fb1e409ab10 2021-04-09T18:29:36.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1d9ffb700 1 --2- 172.21.15.79:0/425936404 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb1c4029100 0x7fb1c402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:36.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1d9ffb700 1 -- 172.21.15.79:0/425936404 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6053+0+0 (secure 0 0 0) 0x7fb1d4010070 con 0x7fb1e409ab10 2021-04-09T18:29:36.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.590 7fb1e9698700 1 --2- 172.21.15.79:0/425936404 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb1c4029100 0x7fb1c402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:36.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.594 7fb1e9698700 1 --2- 172.21.15.79:0/425936404 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb1c4029100 0x7fb1c402b650 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:36.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.594 7fb1eb8f4700 1 -- 172.21.15.79:0/425936404 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e40e39d0 con 0x7fb1e409ab10 2021-04-09T18:29:36.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.598 7fb1d9ffb700 1 -- 172.21.15.79:0/425936404 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb1d40095e0 con 0x7fb1e409ab10 2021-04-09T18:29:36.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.754 7fb1eb8f4700 1 -- 172.21.15.79:0/425936404 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1e40a1cb0 con 0x7fb1e409ab10 2021-04-09T18:29:36.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.754 7fb1d9ffb700 1 -- 172.21.15.79:0/425936404 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+14401 (secure 0 0 0) 0x7fb1d4000bf0 con 0x7fb1e409ab10 2021-04-09T18:29:36.758 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:29:36.759 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":41,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:29:35.930639","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:28:13.096102","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2021-04-09 18:28:13.852981","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.90:0/528006622":"2021-04-09 19:29:35.880495","172.21.15.79:6833/3417656822":"2021-04-10 18:28:14.914231","172.21.15.79:6832/3417656822":"2021-04-10 18:28:14.914231"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:29:36.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.758 7fb1eb8f4700 1 -- 172.21.15.79:0/425936404 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb1c4029100 msgr2=0x7fb1c402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:36.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.758 7fb1eb8f4700 1 --2- 172.21.15.79:0/425936404 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb1c4029100 0x7fb1c402b650 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.758 7fb1eb8f4700 1 -- 172.21.15.79:0/425936404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1e409ab10 msgr2=0x7fb1e40d07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:36.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.758 7fb1eb8f4700 1 --2- 172.21.15.79:0/425936404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1e409ab10 0x7fb1e40d07c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fb1e40d63f0 tx=0x7fb1d400be90).stop 2021-04-09T18:29:36.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.758 7fb1eb8f4700 1 -- 172.21.15.79:0/425936404 shutdown_connections 2021-04-09T18:29:36.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.758 7fb1eb8f4700 1 --2- 172.21.15.79:0/425936404 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb1c4029100 0x7fb1c402b650 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.758 7fb1eb8f4700 1 --2- 172.21.15.79:0/425936404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1e40b7610 0x7fb1e40cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.758 7fb1eb8f4700 1 --2- 172.21.15.79:0/425936404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1e40b9240 0x7fb1e40d6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.758 7fb1eb8f4700 1 --2- 172.21.15.79:0/425936404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1e409ab10 0x7fb1e40d07c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.758 7fb1eb8f4700 1 -- 172.21.15.79:0/425936404 >> 172.21.15.79:0/425936404 conn(0x7fb1e40d35b0 msgr2=0x7fb1e408ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:36.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.758 7fb1eb8f4700 1 -- 172.21.15.79:0/425936404 shutdown_connections 2021-04-09T18:29:36.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.758 7fb1eb8f4700 1 -- 172.21.15.79:0/425936404 wait complete. 2021-04-09T18:29:36.771 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:28:13.096102', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:28:13.852981', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:29:36.771 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:29:36.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.862 7f0026a8a700 1 Processor -- start 2021-04-09T18:29:36.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.862 7f0026a8a700 1 -- start start 2021-04-09T18:29:36.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f0026a8a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00200e9b10 0x7f002009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:36.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f0026a8a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f00201c8040 0x7f00201ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:36.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f0026a8a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00200fbb50 con 0x7f00200f5550 2021-04-09T18:29:36.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f0026a8a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00201c3df0 con 0x7f00201c8040 2021-04-09T18:29:36.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f0026a8a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00200e9f60 con 0x7f00200e9b10 2021-04-09T18:29:36.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f002482e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f00200f5550 0x7f00200f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52566/0 (socket says 172.21.15.79:52566) 2021-04-09T18:29:36.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f002482e700 1 -- 172.21.15.79:0/3364090487 learned_addr learned my addr 172.21.15.79:0/3364090487 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:36.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f002502f700 1 --2- 172.21.15.79:0/3364090487 >> v2:172.21.15.79:3300/0 conn(0x7f00201c8040 0x7f00201ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:36.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f001ffff700 1 --2- 172.21.15.79:0/3364090487 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00200e9b10 0x7f002009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:36.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f001f7fe700 1 -- 172.21.15.79:0/3364090487 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4068825249 0 0) 0x7f00100010d0 con 0x7f00200f5550 2021-04-09T18:29:36.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f001f7fe700 1 -- 172.21.15.79:0/3364090487 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0008003240 con 0x7f00200f5550 2021-04-09T18:29:36.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f002502f700 1 -- 172.21.15.79:0/3364090487 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00200e9b10 msgr2=0x7f002009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:36.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f002502f700 1 --2- 172.21.15.79:0/3364090487 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00200e9b10 0x7f002009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f002502f700 1 -- 172.21.15.79:0/3364090487 >> v1:172.21.15.79:6789/0 conn(0x7f00200f5550 legacy=0x7f00200f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:36.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f002502f700 1 -- 172.21.15.79:0/3364090487 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00200e5700 con 0x7f00201c8040 2021-04-09T18:29:36.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f002502f700 1 --2- 172.21.15.79:0/3364090487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00201c8040 0x7f00201ca4a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f0018002f30 tx=0x7f001800bd40).ready entity=mon.0 client_cookie=5c614b48fda78375 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:36.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f001f7fe700 1 -- 172.21.15.79:0/3364090487 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f00200e5700 con 0x7f00201c8040 2021-04-09T18:29:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f001f7fe700 1 -- 172.21.15.79:0/3364090487 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0018009850 con 0x7f00201c8040 2021-04-09T18:29:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f001f7fe700 1 -- 172.21.15.79:0/3364090487 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0018009c20 con 0x7f00201c8040 2021-04-09T18:29:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f0026a8a700 1 -- 172.21.15.79:0/3364090487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00201c8040 msgr2=0x7f00201ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:36.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f0026a8a700 1 --2- 172.21.15.79:0/3364090487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00201c8040 0x7f00201ca4a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f0018002f30 tx=0x7f001800bd40).stop 2021-04-09T18:29:36.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f0026a8a700 1 -- 172.21.15.79:0/3364090487 shutdown_connections 2021-04-09T18:29:36.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f0026a8a700 1 --2- 172.21.15.79:0/3364090487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00201c8040 0x7f00201ca4a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f0026a8a700 1 --2- 172.21.15.79:0/3364090487 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00200e9b10 0x7f002009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f0026a8a700 1 -- 172.21.15.79:0/3364090487 >> 172.21.15.79:0/3364090487 conn(0x7f00200e6010 msgr2=0x7f00200e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:36.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f0026a8a700 1 -- 172.21.15.79:0/3364090487 shutdown_connections 2021-04-09T18:29:36.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.866 7f0026a8a700 1 -- 172.21.15.79:0/3364090487 wait complete. 2021-04-09T18:29:36.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.870 7f0026a8a700 1 Processor -- start 2021-04-09T18:29:36.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.870 7f0026a8a700 1 -- start start 2021-04-09T18:29:36.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.870 7f0026a8a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00200b9620 0x7f00200cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:36.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.870 7f0026a8a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00200d0250 0x7f002009a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:36.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.870 7f0026a8a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f002009a730 0x7f00201a3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:36.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.870 7f0026a8a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002009aed0 con 0x7f00200d0250 2021-04-09T18:29:36.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.870 7f0026a8a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00200b9a70 con 0x7f002009a730 2021-04-09T18:29:36.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.870 7f0026a8a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002009b1d0 con 0x7f00200b9620 2021-04-09T18:29:36.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.870 7f001ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00200d0250 0x7f002009a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:36.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.870 7f001ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00200d0250 0x7f002009a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57864/0 (socket says 172.21.15.79:57864) 2021-04-09T18:29:36.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.870 7f001ffff700 1 -- 172.21.15.79:0/500784790 learned_addr learned my addr 172.21.15.79:0/500784790 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:36.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.870 7f002482e700 1 --2- 172.21.15.79:0/500784790 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00200b9620 0x7f00200cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:36.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.870 7f002502f700 1 --2- 172.21.15.79:0/500784790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f002009a730 0x7f00201a3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:36.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.870 7f001ffff700 1 -- 172.21.15.79:0/500784790 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00200b9620 msgr2=0x7f00200cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:36.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.870 7f001ffff700 1 --2- 172.21.15.79:0/500784790 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00200b9620 0x7f00200cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.870 7f001ffff700 1 -- 172.21.15.79:0/500784790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f002009a730 msgr2=0x7f00201a3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:36.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.870 7f001ffff700 1 --2- 172.21.15.79:0/500784790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f002009a730 0x7f00201a3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:36.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.870 7f001ffff700 1 -- 172.21.15.79:0/500784790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00200a94a0 con 0x7f00200d0250 2021-04-09T18:29:36.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.874 7f001ffff700 1 --2- 172.21.15.79:0/500784790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00200d0250 0x7f002009a100 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f002009b3d0 tx=0x7f001400c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:36.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.874 7f001d7fa700 1 -- 172.21.15.79:0/500784790 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f00200a94a0 con 0x7f00200d0250 2021-04-09T18:29:36.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.874 7f001d7fa700 1 -- 172.21.15.79:0/500784790 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001400cc40 con 0x7f00200d0250 2021-04-09T18:29:36.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.874 7f0026a8a700 1 -- 172.21.15.79:0/500784790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00200a9030 con 0x7f00200d0250 2021-04-09T18:29:36.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.874 7f001d7fa700 1 -- 172.21.15.79:0/500784790 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f001400f040 con 0x7f00200d0250 2021-04-09T18:29:36.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.874 7f0026a8a700 1 -- 172.21.15.79:0/500784790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00201a4750 con 0x7f00200d0250 2021-04-09T18:29:36.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.874 7f001d7fa700 1 -- 172.21.15.79:0/500784790 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0014022060 con 0x7f00200d0250 2021-04-09T18:29:36.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.874 7f001d7fa700 1 --2- 172.21.15.79:0/500784790 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0000029100 0x7f000002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:36.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.874 7f001d7fa700 1 -- 172.21.15.79:0/500784790 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f0014010040 con 0x7f00200d0250 2021-04-09T18:29:36.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.874 7f002482e700 1 --2- 172.21.15.79:0/500784790 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0000029100 0x7f000002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:36.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.874 7f002482e700 1 --2- 172.21.15.79:0/500784790 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0000029100 0x7f000002b650 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:36.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.878 7f0026a8a700 1 -- 172.21.15.79:0/500784790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00200e39f0 con 0x7f00200d0250 2021-04-09T18:29:36.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:36.886 7f001d7fa700 1 -- 172.21.15.79:0/500784790 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f001400ca30 con 0x7f00200d0250 2021-04-09T18:29:37.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.046 7f0026a8a700 1 -- 172.21.15.79:0/500784790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f00200f5b50 con 0x7f00200d0250 2021-04-09T18:29:37.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.046 7f001d7fa700 1 -- 172.21.15.79:0/500784790 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0014000f70 con 0x7f00200d0250 2021-04-09T18:29:37.050 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:29:37.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.050 7f0026a8a700 1 -- 172.21.15.79:0/500784790 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0000029100 msgr2=0x7f000002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.050 7f0026a8a700 1 --2- 172.21.15.79:0/500784790 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0000029100 0x7f000002b650 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.050 7f0026a8a700 1 -- 172.21.15.79:0/500784790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00200d0250 msgr2=0x7f002009a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.050 7f0026a8a700 1 --2- 172.21.15.79:0/500784790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00200d0250 0x7f002009a100 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f002009b3d0 tx=0x7f001400c430).stop 2021-04-09T18:29:37.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.050 7f0026a8a700 1 -- 172.21.15.79:0/500784790 shutdown_connections 2021-04-09T18:29:37.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.050 7f0026a8a700 1 --2- 172.21.15.79:0/500784790 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0000029100 0x7f000002b650 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.050 7f0026a8a700 1 --2- 172.21.15.79:0/500784790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f002009a730 0x7f00201a3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.050 7f0026a8a700 1 --2- 172.21.15.79:0/500784790 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00200b9620 0x7f00200cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.050 7f0026a8a700 1 --2- 172.21.15.79:0/500784790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00200d0250 0x7f002009a100 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.050 7f0026a8a700 1 -- 172.21.15.79:0/500784790 >> 172.21.15.79:0/500784790 conn(0x7f0020093cb0 msgr2=0x7f00200d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.050 7f0026a8a700 1 -- 172.21.15.79:0/500784790 shutdown_connections 2021-04-09T18:29:37.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.050 7f0026a8a700 1 -- 172.21.15.79:0/500784790 wait complete. 2021-04-09T18:29:37.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:29:37.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.154 7f0bb7987700 1 Processor -- start 2021-04-09T18:29:37.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.154 7f0bb7987700 1 -- start start 2021-04-09T18:29:37.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.154 7f0bb7987700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bb00f5550 0x7f0bb00f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.154 7f0bb7987700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb00fbb50 con 0x7f0bb01c8040 2021-04-09T18:29:37.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.154 7f0bb7987700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb009f910 con 0x7f0bb00e9b10 2021-04-09T18:29:37.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.154 7f0bb7987700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb00e9f60 con 0x7f0bb00f5550 2021-04-09T18:29:37.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.154 7f0bb5f2c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0bb01c8040 0x7f0bb01ca4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52584/0 (socket says 172.21.15.79:52584) 2021-04-09T18:29:37.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.154 7f0bb5f2c700 1 -- 172.21.15.79:0/2541023276 learned_addr learned my addr 172.21.15.79:0/2541023276 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:37.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0bb572b700 1 --2- 172.21.15.79:0/2541023276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bb00f5550 0x7f0bb00f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0ba3fff700 1 -- 172.21.15.79:0/2541023276 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949605301 0 0) 0x7f0ba8001450 con 0x7f0bb01c8040 2021-04-09T18:29:37.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0ba3fff700 1 -- 172.21.15.79:0/2541023276 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b9c003240 con 0x7f0bb01c8040 2021-04-09T18:29:37.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0ba3fff700 1 -- 172.21.15.79:0/2541023276 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797276452 0 0) 0x7f0ba40010d0 con 0x7f0bb00e9b10 2021-04-09T18:29:37.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0ba3fff700 1 -- 172.21.15.79:0/2541023276 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b9c003620 con 0x7f0bb00e9b10 2021-04-09T18:29:37.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0ba3fff700 1 -- 172.21.15.79:0/2541023276 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2500741142 0 0) 0x7f0ba80019d0 con 0x7f0bb01c8040 2021-04-09T18:29:37.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0ba3fff700 1 -- 172.21.15.79:0/2541023276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bb00f5550 msgr2=0x7f0bb00f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:37.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0ba3fff700 1 --2- 172.21.15.79:0/2541023276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bb00f5550 0x7f0bb00f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0ba3fff700 1 -- 172.21.15.79:0/2541023276 >> v1:172.21.15.89:6789/0 conn(0x7f0bb00e9b10 legacy=0x7f0bb009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0ba3fff700 1 -- 172.21.15.79:0/2541023276 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb00e5700 con 0x7f0bb01c8040 2021-04-09T18:29:37.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0ba3fff700 1 -- 172.21.15.79:0/2541023276 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f0ba8001f30 con 0x7f0bb01c8040 2021-04-09T18:29:37.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0ba3fff700 1 -- 172.21.15.79:0/2541023276 >> v1:172.21.15.79:6789/0 conn(0x7f0bb01c8040 legacy=0x7f0bb01ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0ba3fff700 1 --2- 172.21.15.79:0/2541023276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b9c003d40 0x7f0b9c0045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0ba3fff700 1 --2- 172.21.15.79:0/2541023276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b9c004bd0 0x7f0b9c0097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0ba3fff700 1 --2- 172.21.15.79:0/2541023276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b9c005020 0x7f0b9c00be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0ba3fff700 1 -- 172.21.15.79:0/2541023276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb00e9f60 con 0x7f0b9c003d40 2021-04-09T18:29:37.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0ba3fff700 1 -- 172.21.15.79:0/2541023276 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c050460 con 0x7f0b9c004bd0 2021-04-09T18:29:37.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0ba3fff700 1 -- 172.21.15.79:0/2541023276 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c050610 con 0x7f0b9c005020 2021-04-09T18:29:37.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0bb572b700 1 --2- 172.21.15.79:0/2541023276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b9c003d40 0x7f0b9c0045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0bb4f2a700 1 --2- 172.21.15.79:0/2541023276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b9c004bd0 0x7f0b9c0097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0bb5f2c700 1 --2- 172.21.15.79:0/2541023276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b9c005020 0x7f0b9c00be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0bb572b700 1 -- 172.21.15.79:0/2541023276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b9c005020 msgr2=0x7f0b9c00be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:37.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0bb572b700 1 --2- 172.21.15.79:0/2541023276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b9c005020 0x7f0b9c00be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0bb572b700 1 -- 172.21.15.79:0/2541023276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b9c004bd0 msgr2=0x7f0b9c0097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:37.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0bb572b700 1 --2- 172.21.15.79:0/2541023276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b9c004bd0 0x7f0b9c0097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0bb572b700 1 -- 172.21.15.79:0/2541023276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c050820 con 0x7f0b9c003d40 2021-04-09T18:29:37.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0bb572b700 1 --2- 172.21.15.79:0/2541023276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b9c003d40 0x7f0b9c0045a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f0bac00c000 tx=0x7f0bac00e1d0).ready entity=mon.0 client_cookie=d1694907e8d19b9b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:37.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0ba3fff700 1 -- 172.21.15.79:0/2541023276 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0b9c050820 con 0x7f0b9c003d40 2021-04-09T18:29:37.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0ba3fff700 1 -- 172.21.15.79:0/2541023276 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bac00ec90 con 0x7f0b9c003d40 2021-04-09T18:29:37.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0ba3fff700 1 -- 172.21.15.79:0/2541023276 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0bac00f040 con 0x7f0b9c003d40 2021-04-09T18:29:37.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0bb7987700 1 -- 172.21.15.79:0/2541023276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b9c003d40 msgr2=0x7f0b9c0045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0bb7987700 1 --2- 172.21.15.79:0/2541023276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b9c003d40 0x7f0b9c0045a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f0bac00c000 tx=0x7f0bac00e1d0).stop 2021-04-09T18:29:37.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0bb5f2c700 1 -- 172.21.15.79:0/2541023276 reap_dead start 2021-04-09T18:29:37.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0bb7987700 1 -- 172.21.15.79:0/2541023276 shutdown_connections 2021-04-09T18:29:37.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0bb7987700 1 -- 172.21.15.79:0/2541023276 >> 172.21.15.79:0/2541023276 conn(0x7f0bb00e6010 msgr2=0x7f0bb00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:37.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0bb7987700 1 -- 172.21.15.79:0/2541023276 shutdown_connections 2021-04-09T18:29:37.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.158 7f0bb7987700 1 -- 172.21.15.79:0/2541023276 wait complete. 2021-04-09T18:29:37.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.162 7f0bb7987700 1 Processor -- start 2021-04-09T18:29:37.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.162 7f0bb7987700 1 -- start start 2021-04-09T18:29:37.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.162 7f0bb7987700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bb00a33d0 0x7f0bb00a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.162 7f0bb7987700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bb00d52e0 0x7f0bb00d5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.162 7f0bb7987700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb01aafc0 0x7f0bb01ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.162 7f0bb7987700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb01c3df0 con 0x7f0bb01aafc0 2021-04-09T18:29:37.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.162 7f0bb7987700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb019be60 con 0x7f0bb00a33d0 2021-04-09T18:29:37.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.162 7f0bb7987700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb019c160 con 0x7f0bb00d52e0 2021-04-09T18:29:37.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.162 7f0bb5f2c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb01aafc0 0x7f0bb01ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.162 7f0bb5f2c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb01aafc0 0x7f0bb01ab410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57886/0 (socket says 172.21.15.79:57886) 2021-04-09T18:29:37.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.162 7f0bb5f2c700 1 -- 172.21.15.79:0/2313642381 learned_addr learned my addr 172.21.15.79:0/2313642381 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:37.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.162 7f0bb572b700 1 --2- 172.21.15.79:0/2313642381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bb00a33d0 0x7f0bb00a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.162 7f0bb4f2a700 1 --2- 172.21.15.79:0/2313642381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bb00d52e0 0x7f0bb00d5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.166 7f0bb5f2c700 1 -- 172.21.15.79:0/2313642381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bb00d52e0 msgr2=0x7f0bb00d5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.166 7f0bb5f2c700 1 --2- 172.21.15.79:0/2313642381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bb00d52e0 0x7f0bb00d5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.166 7f0bb5f2c700 1 -- 172.21.15.79:0/2313642381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bb00a33d0 msgr2=0x7f0bb00a29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.166 7f0bb5f2c700 1 --2- 172.21.15.79:0/2313642381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bb00a33d0 0x7f0bb00a29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.166 7f0bb5f2c700 1 -- 172.21.15.79:0/2313642381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb00997d0 con 0x7f0bb01aafc0 2021-04-09T18:29:37.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.166 7f0bb5f2c700 1 --2- 172.21.15.79:0/2313642381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb01aafc0 0x7f0bb01ab410 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f0bb00a24e0 tx=0x7f0ba80079d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:37.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.166 7f0ba1ffb700 1 -- 172.21.15.79:0/2313642381 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0bb00997d0 con 0x7f0bb01aafc0 2021-04-09T18:29:37.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.166 7f0ba1ffb700 1 -- 172.21.15.79:0/2313642381 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba800ac10 con 0x7f0bb01aafc0 2021-04-09T18:29:37.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.166 7f0bb7987700 1 -- 172.21.15.79:0/2313642381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb00a3000 con 0x7f0bb01aafc0 2021-04-09T18:29:37.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.166 7f0ba1ffb700 1 -- 172.21.15.79:0/2313642381 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ba8010040 con 0x7f0bb01aafc0 2021-04-09T18:29:37.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.166 7f0bb7987700 1 -- 172.21.15.79:0/2313642381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb019ba10 con 0x7f0bb01aafc0 2021-04-09T18:29:37.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.166 7f0ba1ffb700 1 -- 172.21.15.79:0/2313642381 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0ba801b060 con 0x7f0bb01aafc0 2021-04-09T18:29:37.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.166 7f0ba1ffb700 1 --2- 172.21.15.79:0/2313642381 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0b90029100 0x7f0b9002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.166 7f0ba1ffb700 1 -- 172.21.15.79:0/2313642381 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f0ba8011040 con 0x7f0bb01aafc0 2021-04-09T18:29:37.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.166 7f0bb572b700 1 --2- 172.21.15.79:0/2313642381 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0b90029100 0x7f0b9002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.166 7f0bb572b700 1 --2- 172.21.15.79:0/2313642381 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0b90029100 0x7f0b9002b650 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:37.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.170 7f0bb7987700 1 -- 172.21.15.79:0/2313642381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb00e39f0 con 0x7f0bb01aafc0 2021-04-09T18:29:37.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.178 7f0ba1ffb700 1 -- 172.21.15.79:0/2313642381 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0ba800a810 con 0x7f0bb01aafc0 2021-04-09T18:29:37.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.326 7f0bb7987700 1 -- 172.21.15.79:0/2313642381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f0bb00f5b50 con 0x7f0bb01aafc0 2021-04-09T18:29:37.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.326 7f0ba1ffb700 1 -- 172.21.15.79:0/2313642381 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v41) v1 ==== 104+0+10 (secure 0 0 0) 0x7f0bb00f76f0 con 0x7f0bb01aafc0 2021-04-09T18:29:37.331 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:29:37.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.330 7f0bb7987700 1 -- 172.21.15.79:0/2313642381 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0b90029100 msgr2=0x7f0b9002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.330 7f0bb7987700 1 --2- 172.21.15.79:0/2313642381 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0b90029100 0x7f0b9002b650 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.330 7f0bb7987700 1 -- 172.21.15.79:0/2313642381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb01aafc0 msgr2=0x7f0bb01ab410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.330 7f0bb7987700 1 --2- 172.21.15.79:0/2313642381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb01aafc0 0x7f0bb01ab410 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f0bb00a24e0 tx=0x7f0ba80079d0).stop 2021-04-09T18:29:37.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.330 7f0bb7987700 1 -- 172.21.15.79:0/2313642381 shutdown_connections 2021-04-09T18:29:37.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.330 7f0bb7987700 1 --2- 172.21.15.79:0/2313642381 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0b90029100 0x7f0b9002b650 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.330 7f0bb7987700 1 --2- 172.21.15.79:0/2313642381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bb00a33d0 0x7f0bb00a29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.330 7f0bb7987700 1 --2- 172.21.15.79:0/2313642381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb01aafc0 0x7f0bb01ab410 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.330 7f0bb7987700 1 --2- 172.21.15.79:0/2313642381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bb00d52e0 0x7f0bb00d5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.330 7f0bb7987700 1 -- 172.21.15.79:0/2313642381 >> 172.21.15.79:0/2313642381 conn(0x7f0bb00babc0 msgr2=0x7f0bb00c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:37.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.330 7f0bb7987700 1 -- 172.21.15.79:0/2313642381 shutdown_connections 2021-04-09T18:29:37.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.330 7f0bb7987700 1 -- 172.21.15.79:0/2313642381 wait complete. 2021-04-09T18:29:37.349 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:29:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.446 7fdb8524d700 1 Processor -- start 2021-04-09T18:29:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.446 7fdb8524d700 1 -- start start 2021-04-09T18:29:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb8524d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb800e9b10 0x7fdb8009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb8524d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdb801c8040 0x7fdb801ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb8524d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb800fbb50 con 0x7fdb800f5550 2021-04-09T18:29:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb8524d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb801c3df0 con 0x7fdb801c8040 2021-04-09T18:29:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb8524d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800e9f60 con 0x7fdb800e9b10 2021-04-09T18:29:37.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb7f59e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdb801c8040 0x7fdb801ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb7f59e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdb801c8040 0x7fdb801ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57894/0 (socket says 172.21.15.79:57894) 2021-04-09T18:29:37.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb7f59e700 1 -- 172.21.15.79:0/2437152299 learned_addr learned my addr 172.21.15.79:0/2437152299 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:37.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb7e59c700 1 --2- 172.21.15.79:0/2437152299 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb800e9b10 0x7fdb8009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb7f59e700 1 -- 172.21.15.79:0/2437152299 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb800e9b10 msgr2=0x7fdb8009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:37.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb7f59e700 1 --2- 172.21.15.79:0/2437152299 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb800e9b10 0x7fdb8009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb7f59e700 1 -- 172.21.15.79:0/2437152299 >> v1:172.21.15.89:6789/0 conn(0x7fdb800f5550 legacy=0x7fdb800f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:37.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb7f59e700 1 -- 172.21.15.79:0/2437152299 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb800e5700 con 0x7fdb801c8040 2021-04-09T18:29:37.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb7f59e700 1 --2- 172.21.15.79:0/2437152299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb801c8040 0x7fdb801ca4a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fdb780032b0 tx=0x7fdb7800b3c0).ready entity=mon.0 client_cookie=97390cb067fe632e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:37.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb7dd9b700 1 -- 172.21.15.79:0/2437152299 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb800e5700 con 0x7fdb801c8040 2021-04-09T18:29:37.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb7dd9b700 1 -- 172.21.15.79:0/2437152299 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7800bc20 con 0x7fdb801c8040 2021-04-09T18:29:37.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb7dd9b700 1 -- 172.21.15.79:0/2437152299 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb78002020 con 0x7fdb801c8040 2021-04-09T18:29:37.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb8524d700 1 -- 172.21.15.79:0/2437152299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb801c8040 msgr2=0x7fdb801ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb8524d700 1 --2- 172.21.15.79:0/2437152299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb801c8040 0x7fdb801ca4a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fdb780032b0 tx=0x7fdb7800b3c0).stop 2021-04-09T18:29:37.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb8524d700 1 -- 172.21.15.79:0/2437152299 shutdown_connections 2021-04-09T18:29:37.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb8524d700 1 --2- 172.21.15.79:0/2437152299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb801c8040 0x7fdb801ca4a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb8524d700 1 --2- 172.21.15.79:0/2437152299 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb800e9b10 0x7fdb8009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb8524d700 1 -- 172.21.15.79:0/2437152299 >> 172.21.15.79:0/2437152299 conn(0x7fdb800e6010 msgr2=0x7fdb800e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:37.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb8524d700 1 -- 172.21.15.79:0/2437152299 shutdown_connections 2021-04-09T18:29:37.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.450 7fdb8524d700 1 -- 172.21.15.79:0/2437152299 wait complete. 2021-04-09T18:29:37.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.454 7fdb8524d700 1 Processor -- start 2021-04-09T18:29:37.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.454 7fdb8524d700 1 -- start start 2021-04-09T18:29:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.454 7fdb8524d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb800b95d0 0x7fdb800baaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.454 7fdb8524d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb800d4220 0x7fdb800910a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.454 7fdb8524d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb800d4fe0 0x7fdb800ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.454 7fdb8524d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800d5750 con 0x7fdb800d4fe0 2021-04-09T18:29:37.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.454 7fdb8524d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800d4670 con 0x7fdb800d4220 2021-04-09T18:29:37.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.454 7fdb8524d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800d5430 con 0x7fdb800b95d0 2021-04-09T18:29:37.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb7f59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb800d4fe0 0x7fdb800ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb7f59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb800d4fe0 0x7fdb800ce180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57900/0 (socket says 172.21.15.79:57900) 2021-04-09T18:29:37.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb7f59e700 1 -- 172.21.15.79:0/1841349095 learned_addr learned my addr 172.21.15.79:0/1841349095 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:37.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb7e59c700 1 --2- 172.21.15.79:0/1841349095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb800d4220 0x7fdb800910a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb7ed9d700 1 --2- 172.21.15.79:0/1841349095 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb800b95d0 0x7fdb800baaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb7f59e700 1 -- 172.21.15.79:0/1841349095 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb800b95d0 msgr2=0x7fdb800baaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb7f59e700 1 --2- 172.21.15.79:0/1841349095 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb800b95d0 0x7fdb800baaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb7f59e700 1 -- 172.21.15.79:0/1841349095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb800d4220 msgr2=0x7fdb800910a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb7f59e700 1 --2- 172.21.15.79:0/1841349095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb800d4220 0x7fdb800910a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb7f59e700 1 -- 172.21.15.79:0/1841349095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb800bb120 con 0x7fdb800d4fe0 2021-04-09T18:29:37.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb7ed9d700 1 --2- 172.21.15.79:0/1841349095 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb800b95d0 0x7fdb800baaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:29:37.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb7f59e700 1 --2- 172.21.15.79:0/1841349095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb800d4fe0 0x7fdb800ce180 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fdb801a95a0 tx=0x7fdb78006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:37.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb6f7fe700 1 -- 172.21.15.79:0/1841349095 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb78020020 con 0x7fdb800d4fe0 2021-04-09T18:29:37.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb6f7fe700 1 -- 172.21.15.79:0/1841349095 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7801b670 con 0x7fdb800d4fe0 2021-04-09T18:29:37.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb8524d700 1 -- 172.21.15.79:0/1841349095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb800916d0 con 0x7fdb800d4fe0 2021-04-09T18:29:37.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb6f7fe700 1 -- 172.21.15.79:0/1841349095 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb78002020 con 0x7fdb800d4fe0 2021-04-09T18:29:37.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb8524d700 1 -- 172.21.15.79:0/1841349095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb800ce7b0 con 0x7fdb800d4fe0 2021-04-09T18:29:37.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb6f7fe700 1 -- 172.21.15.79:0/1841349095 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fdb78019040 con 0x7fdb800d4fe0 2021-04-09T18:29:37.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb6f7fe700 1 --2- 172.21.15.79:0/1841349095 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb64029100 0x7fdb6402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb6f7fe700 1 -- 172.21.15.79:0/1841349095 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6053+0+0 (secure 0 0 0) 0x7fdb78018040 con 0x7fdb800d4fe0 2021-04-09T18:29:37.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb7ed9d700 1 --2- 172.21.15.79:0/1841349095 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb64029100 0x7fdb6402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.458 7fdb7ed9d700 1 --2- 172.21.15.79:0/1841349095 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb64029100 0x7fdb6402b650 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:37.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.462 7fdb8524d700 1 -- 172.21.15.79:0/1841349095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb800e39f0 con 0x7fdb800d4fe0 2021-04-09T18:29:37.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.470 7fdb6f7fe700 1 -- 172.21.15.79:0/1841349095 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fdb7801b460 con 0x7fdb800d4fe0 2021-04-09T18:29:37.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.634 7fdb8524d700 1 -- 172.21.15.79:0/1841349095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fdb800f5b50 con 0x7fdb800d4fe0 2021-04-09T18:29:37.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.634 7fdb6f7fe700 1 -- 172.21.15.79:0/1841349095 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v41) v1 ==== 100+0+10 (secure 0 0 0) 0x7fdb7800ba10 con 0x7fdb800d4fe0 2021-04-09T18:29:37.640 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:29:37.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.638 7fdb8524d700 1 -- 172.21.15.79:0/1841349095 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb64029100 msgr2=0x7fdb6402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.638 7fdb8524d700 1 --2- 172.21.15.79:0/1841349095 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb64029100 0x7fdb6402b650 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.638 7fdb8524d700 1 -- 172.21.15.79:0/1841349095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb800d4fe0 msgr2=0x7fdb800ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.638 7fdb8524d700 1 --2- 172.21.15.79:0/1841349095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb800d4fe0 0x7fdb800ce180 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fdb801a95a0 tx=0x7fdb78006c10).stop 2021-04-09T18:29:37.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.638 7fdb8524d700 1 -- 172.21.15.79:0/1841349095 shutdown_connections 2021-04-09T18:29:37.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.638 7fdb8524d700 1 --2- 172.21.15.79:0/1841349095 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb64029100 0x7fdb6402b650 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.638 7fdb8524d700 1 --2- 172.21.15.79:0/1841349095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb800d4fe0 0x7fdb800ce180 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.638 7fdb8524d700 1 --2- 172.21.15.79:0/1841349095 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb800b95d0 0x7fdb800baaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.638 7fdb8524d700 1 --2- 172.21.15.79:0/1841349095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb800d4220 0x7fdb800910a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.638 7fdb8524d700 1 -- 172.21.15.79:0/1841349095 >> 172.21.15.79:0/1841349095 conn(0x7fdb800930a0 msgr2=0x7fdb800d6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:37.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.642 7fdb8524d700 1 -- 172.21.15.79:0/1841349095 shutdown_connections 2021-04-09T18:29:37.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.642 7fdb8524d700 1 -- 172.21.15.79:0/1841349095 wait complete. 2021-04-09T18:29:37.653 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:29:37.654 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:29:37.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32aca2b700 1 Processor -- start 2021-04-09T18:29:37.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32aca2b700 1 -- start start 2021-04-09T18:29:37.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32aca2b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f32a81c9010 0x7f32a81cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32aca2b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a80fbb10 con 0x7f32a80e9ad0 2021-04-09T18:29:37.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32aca2b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a809f900 con 0x7f32a80f5510 2021-04-09T18:29:37.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32aca2b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a81c3db0 con 0x7f32a81c9010 2021-04-09T18:29:37.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a5da3700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f32a80e9ad0 0x7f32a809f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52616/0 (socket says 172.21.15.79:52616) 2021-04-09T18:29:37.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a5da3700 1 -- 172.21.15.79:0/1484312543 learned_addr learned my addr 172.21.15.79:0/1484312543 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:37.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a6da5700 1 --2- 172.21.15.79:0/1484312543 >> v2:172.21.15.89:3300/0 conn(0x7f32a81c9010 0x7f32a81cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a55a2700 1 -- 172.21.15.79:0/1484312543 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576746232 0 0) 0x7f32900010d0 con 0x7f32a80e9ad0 2021-04-09T18:29:37.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a55a2700 1 -- 172.21.15.79:0/1484312543 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3294003240 con 0x7f32a80e9ad0 2021-04-09T18:29:37.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a55a2700 1 -- 172.21.15.79:0/1484312543 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536684250 0 0) 0x7f32a0001450 con 0x7f32a80f5510 2021-04-09T18:29:37.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a55a2700 1 -- 172.21.15.79:0/1484312543 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3294003620 con 0x7f32a80f5510 2021-04-09T18:29:37.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a55a2700 1 -- 172.21.15.79:0/1484312543 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2744323657 0 0) 0x7f3290001650 con 0x7f32a80e9ad0 2021-04-09T18:29:37.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a55a2700 1 -- 172.21.15.79:0/1484312543 >> v2:172.21.15.89:3300/0 conn(0x7f32a81c9010 msgr2=0x7f32a81cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:37.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a55a2700 1 --2- 172.21.15.79:0/1484312543 >> v2:172.21.15.89:3300/0 conn(0x7f32a81c9010 0x7f32a81cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a55a2700 1 -- 172.21.15.79:0/1484312543 >> v1:172.21.15.89:6789/0 conn(0x7f32a80f5510 legacy=0x7f32a80f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a55a2700 1 -- 172.21.15.79:0/1484312543 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a80e56c0 con 0x7f32a80e9ad0 2021-04-09T18:29:37.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a55a2700 1 -- 172.21.15.79:0/1484312543 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f3290001bb0 con 0x7f32a80e9ad0 2021-04-09T18:29:37.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a55a2700 1 -- 172.21.15.79:0/1484312543 >> v1:172.21.15.79:6789/0 conn(0x7f32a80e9ad0 legacy=0x7f32a809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a55a2700 1 --2- 172.21.15.79:0/1484312543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3294003d10 0x7f32940045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a55a2700 1 --2- 172.21.15.79:0/1484312543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3294004bd0 0x7f32940097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a55a2700 1 --2- 172.21.15.79:0/1484312543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3294005020 0x7f329400be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a55a2700 1 -- 172.21.15.79:0/1484312543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a81c3db0 con 0x7f3294005020 2021-04-09T18:29:37.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a55a2700 1 -- 172.21.15.79:0/1484312543 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32940505b0 con 0x7f3294003d10 2021-04-09T18:29:37.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a55a2700 1 -- 172.21.15.79:0/1484312543 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32940507b0 con 0x7f3294004bd0 2021-04-09T18:29:37.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a6da5700 1 --2- 172.21.15.79:0/1484312543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3294005020 0x7f329400be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a5da3700 1 --2- 172.21.15.79:0/1484312543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3294004bd0 0x7f32940097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a65a4700 1 --2- 172.21.15.79:0/1484312543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3294003d10 0x7f32940045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a6da5700 1 -- 172.21.15.79:0/1484312543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3294004bd0 msgr2=0x7f32940097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:37.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a6da5700 1 --2- 172.21.15.79:0/1484312543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3294004bd0 0x7f32940097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a6da5700 1 -- 172.21.15.79:0/1484312543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3294003d10 msgr2=0x7f32940045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:37.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a6da5700 1 --2- 172.21.15.79:0/1484312543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3294003d10 0x7f32940045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a6da5700 1 -- 172.21.15.79:0/1484312543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3294050aa0 con 0x7f3294005020 2021-04-09T18:29:37.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a6da5700 1 -- 172.21.15.79:0/1484312543 reap_dead start 2021-04-09T18:29:37.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a6da5700 1 --2- 172.21.15.79:0/1484312543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3294005020 0x7f329400be20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f329800c000 tx=0x7f329800e1d0).ready entity=mon.0 client_cookie=c07ad79e7fdbc53e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:37.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a55a2700 1 -- 172.21.15.79:0/1484312543 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3294050aa0 con 0x7f3294005020 2021-04-09T18:29:37.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a55a2700 1 -- 172.21.15.79:0/1484312543 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329800eaa0 con 0x7f3294005020 2021-04-09T18:29:37.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32a55a2700 1 -- 172.21.15.79:0/1484312543 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f329800f040 con 0x7f3294005020 2021-04-09T18:29:37.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32aca2b700 1 -- 172.21.15.79:0/1484312543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3294005020 msgr2=0x7f329400be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.742 7f32aca2b700 1 --2- 172.21.15.79:0/1484312543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3294005020 0x7f329400be20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f329800c000 tx=0x7f329800e1d0).stop 2021-04-09T18:29:37.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.746 7f32aca2b700 1 -- 172.21.15.79:0/1484312543 shutdown_connections 2021-04-09T18:29:37.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.746 7f32aca2b700 1 --2- 172.21.15.79:0/1484312543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3294005020 0x7f329400be20 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.746 7f32aca2b700 1 -- 172.21.15.79:0/1484312543 >> 172.21.15.79:0/1484312543 conn(0x7f32a80e5fd0 msgr2=0x7f32a80e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:37.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.746 7f32aca2b700 1 -- 172.21.15.79:0/1484312543 shutdown_connections 2021-04-09T18:29:37.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.746 7f32aca2b700 1 -- 172.21.15.79:0/1484312543 wait complete. 2021-04-09T18:29:37.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.746 7f32aca2b700 1 Processor -- start 2021-04-09T18:29:37.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.746 7f32aca2b700 1 -- start start 2021-04-09T18:29:37.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32aca2b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32a81b1680 0x7f32a80b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32aca2b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32a80b83e0 0x7f32a81c0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32aca2b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a81c0650 0x7f32a81a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32aca2b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a80e9f20 con 0x7f32a80b83e0 2021-04-09T18:29:37.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32aca2b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a80b8b30 con 0x7f32a81c0650 2021-04-09T18:29:37.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32aca2b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a80b8830 con 0x7f32a81b1680 2021-04-09T18:29:37.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32a5da3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32a80b83e0 0x7f32a81c0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32a5da3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32a80b83e0 0x7f32a81c0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57916/0 (socket says 172.21.15.79:57916) 2021-04-09T18:29:37.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32a5da3700 1 -- 172.21.15.79:0/3775302407 learned_addr learned my addr 172.21.15.79:0/3775302407 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:37.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32a65a4700 1 --2- 172.21.15.79:0/3775302407 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32a81b1680 0x7f32a80b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32a6da5700 1 --2- 172.21.15.79:0/3775302407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a81c0650 0x7f32a81a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32a5da3700 1 -- 172.21.15.79:0/3775302407 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32a81b1680 msgr2=0x7f32a80b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32a5da3700 1 --2- 172.21.15.79:0/3775302407 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32a81b1680 0x7f32a80b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32a5da3700 1 -- 172.21.15.79:0/3775302407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a81c0650 msgr2=0x7f32a81a0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32a5da3700 1 --2- 172.21.15.79:0/3775302407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a81c0650 0x7f32a81a0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32a5da3700 1 -- 172.21.15.79:0/3775302407 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a81a14f0 con 0x7f32a80b83e0 2021-04-09T18:29:37.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32a5da3700 1 --2- 172.21.15.79:0/3775302407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32a80b83e0 0x7f32a81c0020 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f32a80874c0 tx=0x7f329000f4b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:37.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f329effd700 1 -- 172.21.15.79:0/3775302407 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f32a81a14f0 con 0x7f32a80b83e0 2021-04-09T18:29:37.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f329effd700 1 -- 172.21.15.79:0/3775302407 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329000fe40 con 0x7f32a80b83e0 2021-04-09T18:29:37.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f329effd700 1 -- 172.21.15.79:0/3775302407 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3290010040 con 0x7f32a80b83e0 2021-04-09T18:29:37.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32aca2b700 1 -- 172.21.15.79:0/3775302407 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a81a1810 con 0x7f32a80b83e0 2021-04-09T18:29:37.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32aca2b700 1 -- 172.21.15.79:0/3775302407 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a80ba3d0 con 0x7f32a80b83e0 2021-04-09T18:29:37.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f329effd700 1 -- 172.21.15.79:0/3775302407 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f329001b060 con 0x7f32a80b83e0 2021-04-09T18:29:37.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f329effd700 1 --2- 172.21.15.79:0/3775302407 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f328c029100 0x7f328c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:37.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f329effd700 1 -- 172.21.15.79:0/3775302407 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f3290011040 con 0x7f32a80b83e0 2021-04-09T18:29:37.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32a65a4700 1 --2- 172.21.15.79:0/3775302407 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f328c029100 0x7f328c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:37.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.750 7f32a65a4700 1 --2- 172.21.15.79:0/3775302407 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f328c029100 0x7f328c02b650 crc :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:37.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.754 7f32aca2b700 1 -- 172.21.15.79:0/3775302407 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a80e39d0 con 0x7f32a80b83e0 2021-04-09T18:29:37.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.758 7f329effd700 1 -- 172.21.15.79:0/3775302407 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f329000fa40 con 0x7f32a80b83e0 2021-04-09T18:29:37.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.922 7f32aca2b700 1 -- 172.21.15.79:0/3775302407 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32a80f5b10 con 0x7f32a80b83e0 2021-04-09T18:29:37.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.922 7f329effd700 1 -- 172.21.15.79:0/3775302407 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2099 (secure 0 0 0) 0x7f3290000bf0 con 0x7f32a80b83e0 2021-04-09T18:29:37.927 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 18 2021-04-09T18:29:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:29:37.928 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5233,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/781814443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":781814443},{"type":"v1","addr":"172.21.15.89:6835","nonce":781814443}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:28:14.813896","modified":"2021-04-09 18:28:16.825652","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5169},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5169":{"gid":5169,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/1928394900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1928394900},{"type":"v1","addr":"172.21.15.79:6833","nonce":1928394900}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-04-09T18:29:37.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.926 7f32aca2b700 1 -- 172.21.15.79:0/3775302407 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f328c029100 msgr2=0x7f328c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.926 7f32aca2b700 1 --2- 172.21.15.79:0/3775302407 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f328c029100 0x7f328c02b650 crc :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.926 7f32aca2b700 1 -- 172.21.15.79:0/3775302407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32a80b83e0 msgr2=0x7f32a81c0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:37.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.926 7f32aca2b700 1 --2- 172.21.15.79:0/3775302407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32a80b83e0 0x7f32a81c0020 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f32a80874c0 tx=0x7f329000f4b0).stop 2021-04-09T18:29:37.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.926 7f32aca2b700 1 -- 172.21.15.79:0/3775302407 shutdown_connections 2021-04-09T18:29:37.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.926 7f32aca2b700 1 --2- 172.21.15.79:0/3775302407 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f328c029100 0x7f328c02b650 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.926 7f32aca2b700 1 --2- 172.21.15.79:0/3775302407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a81c0650 0x7f32a81a0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.926 7f32aca2b700 1 --2- 172.21.15.79:0/3775302407 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32a81b1680 0x7f32a80b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.926 7f32aca2b700 1 --2- 172.21.15.79:0/3775302407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32a80b83e0 0x7f32a81c0020 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:37.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.926 7f32aca2b700 1 -- 172.21.15.79:0/3775302407 >> 172.21.15.79:0/3775302407 conn(0x7f32a8099cd0 msgr2=0x7f32a81a34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:37.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.926 7f32aca2b700 1 -- 172.21.15.79:0/3775302407 shutdown_connections 2021-04-09T18:29:37.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:37.926 7f32aca2b700 1 -- 172.21.15.79:0/3775302407 wait complete. 2021-04-09T18:29:38.141 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:28:14.813896', 'modified': '2021-04-09 18:28:16.825652', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 39, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5169}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5169': {'gid': 5169, 'name': 'a', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6833/1928394900', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 1928394900}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 1928394900}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:29:38.142 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:29:38.142 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2021-04-09T18:29:38.243 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:29:38.243 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:29:38.244 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2021-04-09T18:29:38.244 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 5169, 2021-04-09T18:29:38.244 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2021-04-09T18:29:38.244 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2021-04-09T18:29:38.245 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 82.418972281999999, 2021-04-09T18:29:38.245 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 18, 2021-04-09T18:29:38.245 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 41, 2021-04-09T18:29:38.245 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 41, 2021-04-09T18:29:38.245 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 87.370754512999994 2021-04-09T18:29:38.246 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:29:38.250 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 5169, "want_state": "up:active", "state": "up:active", "rank_uptime": 82.418972281999999, "mdsmap_epoch": 18, "osdmap_epoch": 41, "osdmap_epoch_barrier": 41, "uptime": 87.370754512999994 } 2021-04-09T18:29:38.251 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:29:38.252 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-04-09T18:29:38.252 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi090.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-04-09T18:29:38.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:38.254 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:29:38.263 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:29:38.321 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:29:38.322 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:29:38.380 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:29:38.381 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:29:38.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:38.383 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:29:38.432 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:29:38.433 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:29:38.476 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:29:38.491 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:29:38.492 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:29:38.548 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:29:38.549 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:29:38.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:38.550 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:29:38.551 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:2021-04-09 18:29:38.548 7f5037b1c0c0 -1 init, newargv = 0x5590557947c0 newargc=9ceph-fuse[13247]: starting ceph client 2021-04-09T18:29:38.551 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr: 2021-04-09T18:29:38.638 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13247]: starting fuse 2021-04-09T18:29:39.658 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:29:39.674 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:29:39.675 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:29:39.732 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:29:39.733 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:29:39.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:39.735 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:29:39.785 INFO:teuthology.orchestra.run.smithi090.stdout:49 2021-04-09T18:29:39.786 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:29:39.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:39.788 DEBUG:teuthology.orchestra.run.smithi090:> sudo python3 -c ' 2021-04-09T18:29:39.788 DEBUG:teuthology.orchestra.run.smithi090:> import glob 2021-04-09T18:29:39.789 DEBUG:teuthology.orchestra.run.smithi090:> import re 2021-04-09T18:29:39.790 DEBUG:teuthology.orchestra.run.smithi090:> import os 2021-04-09T18:29:39.790 DEBUG:teuthology.orchestra.run.smithi090:> import subprocess 2021-04-09T18:29:39.792 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:29:39.792 DEBUG:teuthology.orchestra.run.smithi090:> def find_socket(client_name): 2021-04-09T18:29:39.793 DEBUG:teuthology.orchestra.run.smithi090:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-04-09T18:29:39.794 DEBUG:teuthology.orchestra.run.smithi090:> files = glob.glob(asok_path) 2021-04-09T18:29:39.795 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:29:39.795 DEBUG:teuthology.orchestra.run.smithi090:> # Given a non-glob path, it better be there 2021-04-09T18:29:39.796 DEBUG:teuthology.orchestra.run.smithi090:> if "*" not in asok_path: 2021-04-09T18:29:39.796 DEBUG:teuthology.orchestra.run.smithi090:> assert(len(files) == 1) 2021-04-09T18:29:39.797 DEBUG:teuthology.orchestra.run.smithi090:> return files[0] 2021-04-09T18:29:39.797 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:29:39.798 DEBUG:teuthology.orchestra.run.smithi090:> for f in files: 2021-04-09T18:29:39.798 DEBUG:teuthology.orchestra.run.smithi090:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:29:39.798 DEBUG:teuthology.orchestra.run.smithi090:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:29:39.799 DEBUG:teuthology.orchestra.run.smithi090:> return f 2021-04-09T18:29:39.799 DEBUG:teuthology.orchestra.run.smithi090:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:29:39.800 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:29:39.800 DEBUG:teuthology.orchestra.run.smithi090:> print(find_socket("client.0")) 2021-04-09T18:29:39.801 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:29:39.877 INFO:teuthology.orchestra.run.smithi090.stdout:/var/run/ceph/ceph-client.0.13247.asok 2021-04-09T18:29:39.882 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13247.asok 2021-04-09T18:29:39.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:39.883 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13247.asok status 2021-04-09T18:29:39.966 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2021-04-09T18:29:39.967 INFO:teuthology.orchestra.run.smithi090.stdout: "metadata": { 2021-04-09T18:29:39.967 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:29:39.967 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:29:39.968 INFO:teuthology.orchestra.run.smithi090.stdout: "entity_id": "0", 2021-04-09T18:29:39.968 INFO:teuthology.orchestra.run.smithi090.stdout: "hostname": "smithi090", 2021-04-09T18:29:39.968 INFO:teuthology.orchestra.run.smithi090.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-04-09T18:29:39.968 INFO:teuthology.orchestra.run.smithi090.stdout: "pid": "13247", 2021-04-09T18:29:39.968 INFO:teuthology.orchestra.run.smithi090.stdout: "root": "/" 2021-04-09T18:29:39.969 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:29:39.969 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_count": 0, 2021-04-09T18:29:39.969 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_pinned_count": 0, 2021-04-09T18:29:39.969 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 5030, 2021-04-09T18:29:39.970 INFO:teuthology.orchestra.run.smithi090.stdout: "inst": { 2021-04-09T18:29:39.970 INFO:teuthology.orchestra.run.smithi090.stdout: "name": { 2021-04-09T18:29:39.970 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "client", 2021-04-09T18:29:39.970 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5030 2021-04-09T18:29:39.970 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:29:39.971 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:29:39.971 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:29:39.971 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:29:39.971 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 919656255 2021-04-09T18:29:39.971 INFO:teuthology.orchestra.run.smithi090.stdout: } 2021-04-09T18:29:39.972 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:29:39.972 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:29:39.972 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:29:39.973 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:29:39.973 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 919656255 2021-04-09T18:29:39.973 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:29:39.973 INFO:teuthology.orchestra.run.smithi090.stdout: "inst_str": "client.5030 172.21.15.90:0/919656255", 2021-04-09T18:29:39.974 INFO:teuthology.orchestra.run.smithi090.stdout: "addr_str": "172.21.15.90:0/919656255", 2021-04-09T18:29:39.974 INFO:teuthology.orchestra.run.smithi090.stdout: "inode_count": 1, 2021-04-09T18:29:39.974 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_epoch": 19, 2021-04-09T18:29:39.974 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch": 41, 2021-04-09T18:29:39.974 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:29:39.975 INFO:teuthology.orchestra.run.smithi090.stdout: "blacklisted": false, 2021-04-09T18:29:39.975 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs" 2021-04-09T18:29:39.975 INFO:teuthology.orchestra.run.smithi090.stdout:} 2021-04-09T18:29:39.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:39.977 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:29:39.977 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:29:39.984 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:29:39.985 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:29:39.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:39.986 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:29:40.044 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:29:40.045 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:29:40.062 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:29:40.080 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:29:40.103 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:29:40.122 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:29:40.141 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:29:40.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:40.142 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:29:40.143 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:29:40.157 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:29:40.158 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:29:40.159 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi090.front.sepia.ceph.com... 2021-04-09T18:29:40.159 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:29:40.159 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:29:40.246 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13247]: fuse finished with error 0 and tester_r 0 2021-04-09T18:29:40.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:40.249 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:29:40.250 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:29:40.257 INFO:teuthology.orchestra.run.smithi090.stdout:ext2/ext3 2021-04-09T18:29:40.258 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:29:40.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:29:40.344 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:29:40.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:40.352 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:29:40.353 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:29:40.359 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-04-09T18:29:40.359 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:29:40.360 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-04-09T18:29:40.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:29:40.361 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:29:40.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:40.407 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:29:40.408 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:29:40.414 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:29:40.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:29:40.416 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:29:40.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:29:40.417 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:29:40.464 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:29:40.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.562 7f8c2db01700 1 Processor -- start 2021-04-09T18:29:40.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.562 7f8c2db01700 1 -- start start 2021-04-09T18:29:40.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.562 7f8c2db01700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8c280f5520 0x7f8c280f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:40.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.562 7f8c2db01700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8c280e9ae0 0x7f8c2809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:40.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.562 7f8c2db01700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c280fbb20 con 0x7f8c281c2db0 2021-04-09T18:29:40.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.562 7f8c2db01700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c280e9f30 con 0x7f8c280e9ae0 2021-04-09T18:29:40.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.562 7f8c2db01700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c280e59d0 con 0x7f8c280f5520 2021-04-09T18:29:40.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.562 7f8c26ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8c280e9ae0 0x7f8c2809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:40.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.562 7f8c26ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8c280e9ae0 0x7f8c2809f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57926/0 (socket says 172.21.15.79:57926) 2021-04-09T18:29:40.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.562 7f8c26ffd700 1 -- 172.21.15.79:0/2093504286 learned_addr learned my addr 172.21.15.79:0/2093504286 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:40.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.562 7f8c277fe700 1 --2- 172.21.15.79:0/2093504286 >> v2:172.21.15.89:3300/0 conn(0x7f8c280f5520 0x7f8c280f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:40.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.562 7f8c26ffd700 1 -- 172.21.15.79:0/2093504286 >> v2:172.21.15.89:3300/0 conn(0x7f8c280f5520 msgr2=0x7f8c280f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:40.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.562 7f8c26ffd700 1 --2- 172.21.15.79:0/2093504286 >> v2:172.21.15.89:3300/0 conn(0x7f8c280f5520 0x7f8c280f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:40.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.562 7f8c26ffd700 1 -- 172.21.15.79:0/2093504286 >> v1:172.21.15.89:6789/0 conn(0x7f8c281c2db0 legacy=0x7f8c281c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:40.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.562 7f8c26ffd700 1 -- 172.21.15.79:0/2093504286 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c280e56d0 con 0x7f8c280e9ae0 2021-04-09T18:29:40.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.562 7f8c26ffd700 1 --2- 172.21.15.79:0/2093504286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c280e9ae0 0x7f8c2809f110 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f8c18002f30 tx=0x7f8c1800bd70).ready entity=mon.0 client_cookie=44bece0702967023 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:40.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.562 7f8c267fc700 1 -- 172.21.15.79:0/2093504286 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8c280e56d0 con 0x7f8c280e9ae0 2021-04-09T18:29:40.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.566 7f8c267fc700 1 -- 172.21.15.79:0/2093504286 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c18009950 con 0x7f8c280e9ae0 2021-04-09T18:29:40.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.566 7f8c267fc700 1 -- 172.21.15.79:0/2093504286 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8c18009d20 con 0x7f8c280e9ae0 2021-04-09T18:29:40.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.566 7f8c2db01700 1 -- 172.21.15.79:0/2093504286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c280e9ae0 msgr2=0x7f8c2809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:40.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.566 7f8c2db01700 1 --2- 172.21.15.79:0/2093504286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c280e9ae0 0x7f8c2809f110 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f8c18002f30 tx=0x7f8c1800bd70).stop 2021-04-09T18:29:40.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.566 7f8c2db01700 1 -- 172.21.15.79:0/2093504286 shutdown_connections 2021-04-09T18:29:40.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.566 7f8c2db01700 1 --2- 172.21.15.79:0/2093504286 >> v2:172.21.15.89:3300/0 conn(0x7f8c280f5520 0x7f8c280f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:40.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.566 7f8c2db01700 1 --2- 172.21.15.79:0/2093504286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c280e9ae0 0x7f8c2809f110 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:40.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.566 7f8c2db01700 1 -- 172.21.15.79:0/2093504286 >> 172.21.15.79:0/2093504286 conn(0x7f8c280e5fe0 msgr2=0x7f8c280e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:40.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.566 7f8c2db01700 1 -- 172.21.15.79:0/2093504286 shutdown_connections 2021-04-09T18:29:40.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.566 7f8c2db01700 1 -- 172.21.15.79:0/2093504286 wait complete. 2021-04-09T18:29:40.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c2db01700 1 Processor -- start 2021-04-09T18:29:40.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c2db01700 1 -- start start 2021-04-09T18:29:40.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c2db01700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c280c2980 0x7f8c2809a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:40.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c2db01700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c280aae10 0x7f8c280ab260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:40.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c2db01700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c281b5950 0x7f8c281b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:40.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c2db01700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280c2440 con 0x7f8c280c2980 2021-04-09T18:29:40.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c2db01700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280c2740 con 0x7f8c280aae10 2021-04-09T18:29:40.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c2db01700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2809af70 con 0x7f8c281b5950 2021-04-09T18:29:40.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c277fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c280c2980 0x7f8c2809a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:40.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c277fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c280c2980 0x7f8c2809a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57934/0 (socket says 172.21.15.79:57934) 2021-04-09T18:29:40.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c277fe700 1 -- 172.21.15.79:0/489743193 learned_addr learned my addr 172.21.15.79:0/489743193 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:40.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c26ffd700 1 --2- 172.21.15.79:0/489743193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c280aae10 0x7f8c280ab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:40.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c27fff700 1 --2- 172.21.15.79:0/489743193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c281b5950 0x7f8c281b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:40.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c277fe700 1 -- 172.21.15.79:0/489743193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c281b5950 msgr2=0x7f8c281b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:40.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c277fe700 1 --2- 172.21.15.79:0/489743193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c281b5950 0x7f8c281b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:40.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c277fe700 1 -- 172.21.15.79:0/489743193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c280aae10 msgr2=0x7f8c280ab260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:40.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c277fe700 1 --2- 172.21.15.79:0/489743193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c280aae10 0x7f8c280ab260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:40.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c277fe700 1 -- 172.21.15.79:0/489743193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c280c1cd0 con 0x7f8c280c2980 2021-04-09T18:29:40.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c26ffd700 1 --2- 172.21.15.79:0/489743193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c280aae10 0x7f8c280ab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:29:40.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c277fe700 1 --2- 172.21.15.79:0/489743193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c280c2980 0x7f8c2809a940 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f8c10006920 tx=0x7f8c1000c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:40.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c1ffff700 1 -- 172.21.15.79:0/489743193 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8c280c1cd0 con 0x7f8c280c2980 2021-04-09T18:29:40.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c1ffff700 1 -- 172.21.15.79:0/489743193 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1000cb50 con 0x7f8c280c2980 2021-04-09T18:29:40.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c2db01700 1 -- 172.21.15.79:0/489743193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c280d8130 con 0x7f8c280c2980 2021-04-09T18:29:40.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c1ffff700 1 -- 172.21.15.79:0/489743193 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8c1000f040 con 0x7f8c280c2980 2021-04-09T18:29:40.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.570 7f8c2db01700 1 -- 172.21.15.79:0/489743193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c280ab890 con 0x7f8c280c2980 2021-04-09T18:29:40.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.574 7f8c1ffff700 1 -- 172.21.15.79:0/489743193 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8c10011070 con 0x7f8c280c2980 2021-04-09T18:29:40.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.574 7f8c1ffff700 1 --2- 172.21.15.79:0/489743193 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8c0c029100 0x7f8c0c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:40.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.574 7f8c1ffff700 1 -- 172.21.15.79:0/489743193 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f8c10010040 con 0x7f8c280c2980 2021-04-09T18:29:40.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.574 7f8c26ffd700 1 --2- 172.21.15.79:0/489743193 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8c0c029100 0x7f8c0c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:40.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.574 7f8c26ffd700 1 --2- 172.21.15.79:0/489743193 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8c0c029100 0x7f8c0c02b650 crc :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:40.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.578 7f8c2db01700 1 -- 172.21.15.79:0/489743193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c280e39e0 con 0x7f8c280c2980 2021-04-09T18:29:40.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.582 7f8c1ffff700 1 -- 172.21.15.79:0/489743193 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8c10000bf0 con 0x7f8c280c2980 2021-04-09T18:29:40.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.746 7f8c2db01700 1 -- 172.21.15.79:0/489743193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8c280f5b20 con 0x7f8c280c2980 2021-04-09T18:29:40.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.750 7f8c1ffff700 1 -- 172.21.15.79:0/489743193 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v41) v1 ==== 81+0+30962 (secure 0 0 0) 0x7f8c1000c750 con 0x7f8c280c2980 2021-04-09T18:29:40.753 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:29:40.754 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:29:40.754 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 41, 2021-04-09T18:29:40.754 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:29:40.754 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:29:40.755 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:29:35.930639", 2021-04-09T18:29:40.755 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:29:40.755 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:29:40.755 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:29:40.756 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:29:40.756 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:29:40.756 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:29:40.756 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:29:40.757 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:29:40.757 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:29:40.757 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:29:40.757 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:29:40.757 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:29:40.758 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:29:40.758 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:29:40.758 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:29:40.758 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 7, 2021-04-09T18:29:40.758 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:29:40.759 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:29:40.759 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:29:40.759 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:29:40.759 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:29:40.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.760 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:29:40.760 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:29:40.760 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:29:40.760 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:29:40.761 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:29:40.761 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:29:40.761 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:29:40.761 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:29:40.762 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:29:40.762 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:29:40.762 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:29:40.762 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:29:40.762 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:29:40.763 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:29:40.763 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:29:40.763 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:29:40.763 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:29:40.764 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:29:40.764 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:29:40.764 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:29:40.764 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:29:40.764 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:29:40.765 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:29:40.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.765 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:29:40.765 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:29:40.766 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:29:40.766 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:29:40.766 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:29:40.766 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:29:40.767 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:29:40.767 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:29:40.767 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:29:40.767 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:29:40.768 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:29:40.768 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:29:40.768 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:29:40.768 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:29:40.768 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:29:40.769 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:29:40.769 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:29:40.769 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:29:40.769 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:29:40.769 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:29:40.770 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:29:40.770 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:29:40.770 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:29:40.770 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:29:40.770 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:29:40.771 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:29:40.771 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:29:40.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.771 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:29:40.772 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:29:40.772 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:29:40.772 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:29:40.772 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:29:40.772 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:29:40.773 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:29:40.773 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:29:40.773 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:29:40.773 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:29:40.773 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:29:40.774 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:29:40.774 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:29:40.774 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:29:40.774 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.775 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 6, 2021-04-09T18:29:40.775 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2021-04-09T18:29:40.775 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:28:13.096102", 2021-04-09T18:29:40.776 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:29:40.776 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:29:40.776 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:29:40.776 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:29:40.776 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:29:40.777 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:29:40.777 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:29:40.777 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:29:40.777 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:29:40.778 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:29:40.778 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:29:40.778 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:29:40.778 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:29:40.779 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:29:40.779 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:29:40.779 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:29:40.780 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:29:40.780 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:29:40.780 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:29:40.780 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:29:40.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.781 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "38", 2021-04-09T18:29:40.781 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:29:40.781 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:29:40.781 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:29:40.781 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:29:40.782 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:29:40.782 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:29:40.782 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:29:40.782 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:29:40.783 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:29:40.783 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:29:40.783 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:29:40.783 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:29:40.784 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:29:40.784 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:29:40.784 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:29:40.784 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:29:40.784 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:29:40.785 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:29:40.785 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:29:40.785 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:29:40.786 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:29:40.786 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:29:40.786 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:29:40.786 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:29:40.786 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:29:40.787 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:29:40.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.787 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:29:40.787 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:29:40.787 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:29:40.788 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:29:40.788 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:29:40.788 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:29:40.788 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:29:40.788 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:29:40.789 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:29:40.789 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:29:40.789 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:29:40.790 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2021-04-09T18:29:40.790 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2021-04-09T18:29:40.790 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2021-04-09T18:29:40.791 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2021-04-09T18:29:40.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.792 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:29:40.792 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:29:40.793 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2021-04-09T18:29:40.793 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.793 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.795 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 7, 2021-04-09T18:29:40.795 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2021-04-09T18:29:40.796 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:28:13.852981", 2021-04-09T18:29:40.796 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:29:40.796 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:29:40.796 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:29:40.797 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:29:40.797 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:29:40.797 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:29:40.797 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:29:40.798 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:29:40.798 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:29:40.798 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:29:40.798 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:29:40.799 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:29:40.799 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:29:40.799 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:29:40.799 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:29:40.799 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:29:40.800 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:29:40.800 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:29:40.800 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:29:40.800 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:29:40.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.801 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "39", 2021-04-09T18:29:40.801 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:29:40.801 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:29:40.802 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:29:40.802 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:29:40.802 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:29:40.802 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:29:40.802 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:29:40.803 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:29:40.803 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:29:40.803 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:29:40.803 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:29:40.804 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:29:40.804 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:29:40.804 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:29:40.804 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:29:40.804 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:29:40.805 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:29:40.805 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:29:40.805 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:29:40.805 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:29:40.806 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:29:40.806 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:29:40.806 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:29:40.806 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:29:40.807 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:29:40.807 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:29:40.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.807 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:29:40.808 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:29:40.808 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:29:40.808 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:29:40.808 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:29:40.809 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:29:40.809 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:29:40.809 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:29:40.809 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:29:40.809 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:29:40.810 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:29:40.810 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:29:40.810 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:29:40.810 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:29:40.810 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2021-04-09T18:29:40.811 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.811 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.811 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.811 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:29:40.811 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:29:40.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.812 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:29:40.812 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:29:40.812 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:29:40.813 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:29:40.813 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:29:40.813 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:29:40.814 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:29:40.814 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:29:40.814 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:29:40.815 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 37, 2021-04-09T18:29:40.815 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:29:40.815 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:29:40.815 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:29:40.816 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.816 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.816 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:29:40.816 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:29:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:29:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:29:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:29:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:29:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:29:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:29:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:29:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.822 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:29:40.822 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.822 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:29:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:29:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.824 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:29:40.824 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:29:40.824 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.824 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:29:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:29:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:29:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:29:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:29:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:29:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:29:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:29:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:29:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:29:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:29:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:29:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:29:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:29:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:29:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:29:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:29:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:29:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:29:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:29:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:29:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 36, 2021-04-09T18:29:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:29:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:29:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:29:40.833 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.833 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.833 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:29:40.833 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:29:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:29:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:29:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.836 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:29:40.836 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.836 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.837 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:29:40.837 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:29:40.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:29:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:29:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:29:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:29:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:29:40.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.841 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.841 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:29:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:29:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:29:40.843 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.843 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.843 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:29:40.844 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:29:40.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.845 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.845 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:29:40.845 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:29:40.845 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.846 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.846 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:29:40.846 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:29:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:29:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:29:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:29:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:29:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:29:40.848 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.848 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:29:40.849 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:29:40.849 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:29:40.849 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:29:40.850 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:29:40.850 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:29:40.850 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:29:40.851 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:29:40.851 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:29:40.852 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 29, 2021-04-09T18:29:40.852 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:29:40.852 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:29:40.852 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:29:40.853 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.853 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.854 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:29:40.854 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:29:40.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.855 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.855 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:29:40.855 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:29:40.855 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.855 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.856 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:29:40.856 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.857 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.857 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:29:40.857 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:29:40.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.858 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.858 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:29:40.858 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:29:40.858 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.859 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.859 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:29:40.859 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.860 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.860 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:29:40.860 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:29:40.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.861 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.861 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:29:40.861 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:29:40.862 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.862 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.862 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:29:40.863 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.863 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.864 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:29:40.864 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:29:40.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.864 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.865 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:29:40.865 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:29:40.865 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.865 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.866 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:29:40.866 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:29:40.866 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:29:40.867 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:29:40.867 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:29:40.867 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:29:40.867 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:29:40.868 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.868 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:29:40.869 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:29:40.869 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:29:40.869 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:29:40.869 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:29:40.869 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:29:40.870 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:29:40.870 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:29:40.870 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:29:40.871 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 37, 2021-04-09T18:29:40.871 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:29:40.871 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:29:40.871 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:29:40.872 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.872 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.872 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:29:40.873 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:29:40.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.873 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.874 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:29:40.874 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:29:40.874 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.874 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.875 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:29:40.875 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.876 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.876 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:29:40.876 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:29:40.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.877 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.877 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:29:40.878 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:29:40.878 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.878 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.879 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:29:40.879 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.880 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.880 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:29:40.880 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:29:40.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.881 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.882 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:29:40.882 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:29:40.883 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.883 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.884 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:29:40.884 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.885 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.886 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:29:40.886 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:29:40.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.887 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.887 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:29:40.887 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:29:40.888 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.888 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.888 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:29:40.889 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:29:40.889 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:29:40.889 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:29:40.890 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:29:40.890 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:29:40.890 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:29:40.890 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.891 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:29:40.891 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:29:40.891 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:29:40.892 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:29:40.892 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:29:40.892 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:29:40.893 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:29:40.893 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:29:40.893 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:29:40.894 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 37, 2021-04-09T18:29:40.894 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:29:40.894 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:29:40.894 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:29:40.895 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.895 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.896 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:29:40.896 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:29:40.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.897 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.898 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:29:40.898 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:29:40.899 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.899 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.900 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:29:40.900 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.900 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.901 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:29:40.901 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:29:40.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.901 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.902 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:29:40.902 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:29:40.903 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.903 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.904 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:29:40.904 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.905 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.905 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:29:40.906 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:29:40.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.907 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.907 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:29:40.908 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:29:40.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.908 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.909 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:29:40.909 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.910 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.911 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:29:40.911 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:29:40.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.912 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.912 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:29:40.913 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:29:40.913 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.913 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.914 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:29:40.915 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:29:40.915 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:29:40.916 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:29:40.916 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:29:40.917 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:29:40.917 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:29:40.917 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.918 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:29:40.919 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:29:40.919 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:29:40.919 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:29:40.919 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:29:40.920 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:29:40.920 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:29:40.920 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:29:40.920 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:29:40.921 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 37, 2021-04-09T18:29:40.921 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:29:40.921 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:29:40.921 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:29:40.922 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.922 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.922 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:29:40.922 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:29:40.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.923 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.923 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:29:40.924 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:29:40.924 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.924 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.925 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:29:40.925 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.925 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.925 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:29:40.926 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:29:40.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.926 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.927 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:29:40.927 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:29:40.927 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.928 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.928 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:29:40.928 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.929 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.929 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:29:40.929 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:29:40.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.930 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.930 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:29:40.930 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:29:40.930 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.931 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.931 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:29:40.931 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.932 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:29:40.932 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:29:40.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.933 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.933 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:29:40.933 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:29:40.934 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.934 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.934 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:29:40.934 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:29:40.935 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:29:40.935 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:29:40.935 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:29:40.935 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:29:40.936 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:29:40.936 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.936 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:29:40.937 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:29:40.937 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:29:40.937 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:29:40.937 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:29:40.937 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:29:40.938 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:29:40.938 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:29:40.938 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:29:40.938 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 37, 2021-04-09T18:29:40.939 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:29:40.939 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:29:40.939 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:29:40.940 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.941 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.941 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:29:40.942 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:29:40.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.943 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.944 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:29:40.944 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:29:40.945 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.945 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.945 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:29:40.946 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.946 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.946 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:29:40.947 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:29:40.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.949 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:29:40.949 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:29:40.950 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.950 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.951 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:29:40.951 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.952 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.953 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:29:40.953 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:29:40.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.954 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:29:40.955 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:29:40.955 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.955 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.956 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:29:40.957 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.958 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.958 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:29:40.959 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:29:40.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.960 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.961 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:29:40.961 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:29:40.962 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.962 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.963 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:29:40.964 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:29:40.964 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:29:40.965 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:29:40.965 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:29:40.966 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:29:40.967 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:29:40.967 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.969 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:29:40.969 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:29:40.970 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:29:40.970 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:29:40.971 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:29:40.972 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:29:40.972 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:29:40.973 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:29:40.974 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:29:40.975 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 37, 2021-04-09T18:29:40.975 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:29:40.976 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:29:40.976 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:29:40.977 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.978 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.978 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:29:40.979 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:29:40.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.981 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.981 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:29:40.982 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:29:40.982 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.983 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.984 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:29:40.984 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.985 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:29:40.986 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:29:40.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.987 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.988 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:29:40.988 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:29:40.988 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.989 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.989 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:29:40.990 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.990 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.991 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:29:40.991 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:29:40.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.992 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.993 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:29:40.993 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:29:40.993 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.994 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.995 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:29:40.995 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:40.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.996 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:40.996 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:29:40.996 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:29:40.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:40.997 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:40.997 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:29:40.997 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:29:40.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:40.998 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:40.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:40.998 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:29:40.999 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:29:40.999 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:29:40.999 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:29:40.999 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:29:41.000 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:29:41.000 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:29:41.000 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:41.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:41.001 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:29:41.001 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:29:41.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:41.001 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:29:41.002 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:29:41.002 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:29:41.002 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:29:41.002 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:29:41.003 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:29:41.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:41.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:41.003 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:29:41.004 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:29:41.004 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:29:41.004 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:29:41.004 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:29:41.005 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:29:41.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:41.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:41.006 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:29:41.006 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:29:41.006 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:29:41.006 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:29:41.006 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:29:41.007 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:29:41.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:41.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:41.007 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:29:41.008 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:29:41.008 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:29:41.008 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:29:41.008 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:29:41.009 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:29:41.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:41.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:41.009 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:29:41.010 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:29:41.010 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:29:41.010 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:29:41.010 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:29:41.010 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:29:41.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:41.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:41.011 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:29:41.011 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:29:41.012 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:29:41.012 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:29:41.012 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:29:41.012 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:29:41.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:41.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:41.013 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:29:41.013 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:29:41.013 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:29:41.014 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:29:41.014 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:29:41.014 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:29:41.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:41.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:41.015 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:29:41.015 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:29:41.015 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:29:41.015 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:29:41.016 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:29:41.016 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:29:41.016 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:41.016 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:29:41.019 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:29:41.020 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:29:41.020 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:29:41.020 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:29:41.020 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": { 2021-04-09T18:29:41.021 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.90:0/528006622": "2021-04-09 19:29:35.880495", 2021-04-09T18:29:41.021 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.79:6833/3417656822": "2021-04-10 18:28:14.914231", 2021-04-09T18:29:41.021 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.79:6832/3417656822": "2021-04-10 18:28:14.914231" 2021-04-09T18:29:41.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:41.022 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:29:41.022 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:29:41.022 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:29:41.022 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:29:41.022 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:29:41.023 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:29:41.023 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:29:41.023 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:29:41.023 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:29:41.024 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:29:41.024 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:29:41.024 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:29:41.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:41.024 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:29:41.025 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:29:41.025 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:29:41.025 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:29:41.025 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:29:41.025 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:29:41.026 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:29:41.026 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:41.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:41.026 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:29:41.026 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:29:41.027 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:29:41.027 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:29:41.027 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:29:41.027 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:29:41.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.754 7f8c2db01700 1 -- 172.21.15.79:0/489743193 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8c0c029100 msgr2=0x7f8c0c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:41.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.754 7f8c2db01700 1 --2- 172.21.15.79:0/489743193 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8c0c029100 0x7f8c0c02b650 crc :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:41.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.754 7f8c2db01700 1 -- 172.21.15.79:0/489743193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c280c2980 msgr2=0x7f8c2809a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:41.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.754 7f8c2db01700 1 --2- 172.21.15.79:0/489743193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c280c2980 0x7f8c2809a940 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f8c10006920 tx=0x7f8c1000c150).stop 2021-04-09T18:29:41.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.754 7f8c2db01700 1 -- 172.21.15.79:0/489743193 shutdown_connections 2021-04-09T18:29:41.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.754 7f8c2db01700 1 --2- 172.21.15.79:0/489743193 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8c0c029100 0x7f8c0c02b650 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:41.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.754 7f8c2db01700 1 --2- 172.21.15.79:0/489743193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c281b5950 0x7f8c281b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:41.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.754 7f8c2db01700 1 --2- 172.21.15.79:0/489743193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c280c2980 0x7f8c2809a940 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:41.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.754 7f8c2db01700 1 --2- 172.21.15.79:0/489743193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c280aae10 0x7f8c280ab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:41.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.754 7f8c2db01700 1 -- 172.21.15.79:0/489743193 >> 172.21.15.79:0/489743193 conn(0x7f8c280971a0 msgr2=0x7f8c28095600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:41.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.754 7f8c2db01700 1 -- 172.21.15.79:0/489743193 shutdown_connections 2021-04-09T18:29:41.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:40.754 7f8c2db01700 1 -- 172.21.15.79:0/489743193 wait complete. 2021-04-09T18:29:41.033 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:29:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.138 7f67a9831700 1 Processor -- start 2021-04-09T18:29:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.138 7f67a9831700 1 -- start start 2021-04-09T18:29:41.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.138 7f67a9831700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f67a40e9ae0 0x7f67a409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:41.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.138 7f67a9831700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a40fbb20 con 0x7f67a41c8010 2021-04-09T18:29:41.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.138 7f67a9831700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a40e56d0 con 0x7f67a40f5520 2021-04-09T18:29:41.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.138 7f67a9831700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67a41c3dc0 con 0x7f67a40e9ae0 2021-04-09T18:29:41.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.138 7f67a3d51700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f67a41c8010 0x7f67a41ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52652/0 (socket says 172.21.15.79:52652) 2021-04-09T18:29:41.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.138 7f67a3d51700 1 -- 172.21.15.79:0/2306385391 learned_addr learned my addr 172.21.15.79:0/2306385391 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:41.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.138 7f67a2d4f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f67a40e9ae0 0x7f67a409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:41.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.138 7f67a2d4f700 1 -- 172.21.15.79:0/2306385391 >> v1:172.21.15.89:6789/0 conn(0x7f67a40f5520 legacy=0x7f67a40f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:41.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.138 7f67a2d4f700 1 -- 172.21.15.79:0/2306385391 >> v1:172.21.15.79:6789/0 conn(0x7f67a41c8010 legacy=0x7f67a41ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:41.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.138 7f67a254e700 1 -- 172.21.15.79:0/2306385391 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4185473842 0 0) 0x7f67940010d0 con 0x7f67a40f5520 2021-04-09T18:29:41.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.138 7f67a2d4f700 1 -- 172.21.15.79:0/2306385391 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a40e4330 con 0x7f67a40e9ae0 2021-04-09T18:29:41.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.142 7f67a2d4f700 1 --2- 172.21.15.79:0/2306385391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67a40e9ae0 0x7f67a409f110 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f679c0016c0 tx=0x7f679c0013c0).ready entity=mon.0 client_cookie=8758c7ea0df8de04 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:41.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.142 7f67a254e700 1 -- 172.21.15.79:0/2306385391 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67a40e4330 con 0x7f67a40e9ae0 2021-04-09T18:29:41.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.142 7f67a254e700 1 -- 172.21.15.79:0/2306385391 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67980096c0 con 0x7f67a40e9ae0 2021-04-09T18:29:41.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.142 7f67a254e700 1 -- 172.21.15.79:0/2306385391 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6798009a90 con 0x7f67a40e9ae0 2021-04-09T18:29:41.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.142 7f67a9831700 1 -- 172.21.15.79:0/2306385391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67a40e9ae0 msgr2=0x7f67a409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:41.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.142 7f67a9831700 1 --2- 172.21.15.79:0/2306385391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67a40e9ae0 0x7f67a409f110 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f679c0016c0 tx=0x7f679c0013c0).stop 2021-04-09T18:29:41.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.142 7f67a9831700 1 -- 172.21.15.79:0/2306385391 shutdown_connections 2021-04-09T18:29:41.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.142 7f67a9831700 1 --2- 172.21.15.79:0/2306385391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67a40e9ae0 0x7f67a409f110 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:41.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.142 7f67a9831700 1 -- 172.21.15.79:0/2306385391 >> 172.21.15.79:0/2306385391 conn(0x7f67a40e5fe0 msgr2=0x7f67a40e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:41.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.142 7f67a9831700 1 -- 172.21.15.79:0/2306385391 shutdown_connections 2021-04-09T18:29:41.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.142 7f67a9831700 1 -- 172.21.15.79:0/2306385391 wait complete. 2021-04-09T18:29:41.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.146 7f67a9831700 1 Processor -- start 2021-04-09T18:29:41.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.146 7f67a9831700 1 -- start start 2021-04-09T18:29:41.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.146 7f67a9831700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67a40a8840 0x7f67a40b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:41.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.146 7f67a9831700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67a40bbaa0 0x7f67a409a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:41.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.146 7f67a9831700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67a409aac0 0x7f67a41d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:41.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.146 7f67a9831700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a40e9f30 con 0x7f67a40bbaa0 2021-04-09T18:29:41.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.146 7f67a9831700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a40b0b00 con 0x7f67a40a8840 2021-04-09T18:29:41.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.146 7f67a9831700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a40b0690 con 0x7f67a409aac0 2021-04-09T18:29:41.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.150 7f67a2d4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67a40bbaa0 0x7f67a409a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:41.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.150 7f67a2d4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67a40bbaa0 0x7f67a409a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57944/0 (socket says 172.21.15.79:57944) 2021-04-09T18:29:41.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.150 7f67a2d4f700 1 -- 172.21.15.79:0/948081978 learned_addr learned my addr 172.21.15.79:0/948081978 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:41.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.150 7f67a3550700 1 --2- 172.21.15.79:0/948081978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67a40a8840 0x7f67a40b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:41.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.150 7f67a3d51700 1 --2- 172.21.15.79:0/948081978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67a409aac0 0x7f67a41d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:41.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.150 7f67a2d4f700 1 -- 172.21.15.79:0/948081978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67a409aac0 msgr2=0x7f67a41d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:41.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.150 7f67a2d4f700 1 --2- 172.21.15.79:0/948081978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67a409aac0 0x7f67a41d0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:41.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.150 7f67a2d4f700 1 -- 172.21.15.79:0/948081978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67a40a8840 msgr2=0x7f67a40b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:41.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.150 7f67a2d4f700 1 --2- 172.21.15.79:0/948081978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67a40a8840 0x7f67a40b0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:41.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.150 7f67a2d4f700 1 -- 172.21.15.79:0/948081978 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a41d1180 con 0x7f67a40bbaa0 2021-04-09T18:29:41.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.150 7f67a2d4f700 1 --2- 172.21.15.79:0/948081978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67a40bbaa0 0x7f67a409a490 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f67a40d7f50 tx=0x7f6798006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:41.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.150 7f678bfff700 1 -- 172.21.15.79:0/948081978 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67a41d1180 con 0x7f67a40bbaa0 2021-04-09T18:29:41.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.150 7f678bfff700 1 -- 172.21.15.79:0/948081978 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6798011c90 con 0x7f67a40bbaa0 2021-04-09T18:29:41.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.150 7f67a9831700 1 -- 172.21.15.79:0/948081978 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a41d13e0 con 0x7f67a40bbaa0 2021-04-09T18:29:41.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.150 7f678bfff700 1 -- 172.21.15.79:0/948081978 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f679801d630 con 0x7f67a40bbaa0 2021-04-09T18:29:41.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.150 7f67a9831700 1 -- 172.21.15.79:0/948081978 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a4096220 con 0x7f67a40bbaa0 2021-04-09T18:29:41.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.150 7f678bfff700 1 -- 172.21.15.79:0/948081978 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f679801d830 con 0x7f67a40bbaa0 2021-04-09T18:29:41.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.150 7f678bfff700 1 --2- 172.21.15.79:0/948081978 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6784029100 0x7f678402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:41.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.150 7f678bfff700 1 -- 172.21.15.79:0/948081978 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f679803b810 con 0x7f67a40bbaa0 2021-04-09T18:29:41.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.150 7f67a3550700 1 --2- 172.21.15.79:0/948081978 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6784029100 0x7f678402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:41.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.154 7f67a3550700 1 --2- 172.21.15.79:0/948081978 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6784029100 0x7f678402b650 crc :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:41.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.166 7f67a9831700 1 -- 172.21.15.79:0/948081978 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a40e39e0 con 0x7f67a40bbaa0 2021-04-09T18:29:41.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.174 7f678bfff700 1 -- 172.21.15.79:0/948081978 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f67980094b0 con 0x7f67a40bbaa0 2021-04-09T18:29:41.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.350 7f67a9831700 1 -- 172.21.15.79:0/948081978 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67a40a1cc0 con 0x7f67a40bbaa0 2021-04-09T18:29:41.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.350 7f678bfff700 1 -- 172.21.15.79:0/948081978 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+2100 (secure 0 0 0) 0x7f6798011a80 con 0x7f67a40bbaa0 2021-04-09T18:29:41.353 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 19 2021-04-09T18:29:41.354 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:29:41.354 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5233,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/781814443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":781814443},{"type":"v1","addr":"172.21.15.89:6835","nonce":781814443}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:28:14.813896","modified":"2021-04-09 18:29:39.955442","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5169},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5169":{"gid":5169,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":24,"addr":"172.21.15.79:6833/1928394900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1928394900},{"type":"v1","addr":"172.21.15.79:6833","nonce":1928394900}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-04-09T18:29:41.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.354 7f67a9831700 1 -- 172.21.15.79:0/948081978 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6784029100 msgr2=0x7f678402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:41.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.354 7f67a9831700 1 --2- 172.21.15.79:0/948081978 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6784029100 0x7f678402b650 crc :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:41.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.354 7f67a9831700 1 -- 172.21.15.79:0/948081978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67a40bbaa0 msgr2=0x7f67a409a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:41.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.354 7f67a9831700 1 --2- 172.21.15.79:0/948081978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67a40bbaa0 0x7f67a409a490 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f67a40d7f50 tx=0x7f6798006890).stop 2021-04-09T18:29:41.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.354 7f67a9831700 1 -- 172.21.15.79:0/948081978 shutdown_connections 2021-04-09T18:29:41.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.354 7f67a9831700 1 --2- 172.21.15.79:0/948081978 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6784029100 0x7f678402b650 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:41.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.354 7f67a9831700 1 --2- 172.21.15.79:0/948081978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67a40a8840 0x7f67a40b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:41.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.354 7f67a9831700 1 --2- 172.21.15.79:0/948081978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67a409aac0 0x7f67a41d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:41.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.354 7f67a9831700 1 --2- 172.21.15.79:0/948081978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67a40bbaa0 0x7f67a409a490 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:41.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.354 7f67a9831700 1 -- 172.21.15.79:0/948081978 >> 172.21.15.79:0/948081978 conn(0x7f67a40975e0 msgr2=0x7f67a40ac8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:41.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.354 7f67a9831700 1 -- 172.21.15.79:0/948081978 shutdown_connections 2021-04-09T18:29:41.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.354 7f67a9831700 1 -- 172.21.15.79:0/948081978 wait complete. 2021-04-09T18:29:41.365 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-04-09T18:29:41.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.458 7f96072ca700 1 Processor -- start 2021-04-09T18:29:41.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.458 7f96072ca700 1 -- start start 2021-04-09T18:29:41.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.458 7f96072ca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96000f5520 0x7f96000f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:41.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.458 7f96072ca700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f96000e9ae0 0x7f960009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:41.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.458 7f96072ca700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96000fbb20 con 0x7f96001c2db0 2021-04-09T18:29:41.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.458 7f96072ca700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96000e9f30 con 0x7f96000e9ae0 2021-04-09T18:29:41.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.458 7f96072ca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96000e59d0 con 0x7f96000f5520 2021-04-09T18:29:41.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.458 7f960486d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f96000e9ae0 0x7f960009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:41.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.458 7f960486d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f96000e9ae0 0x7f960009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57952/0 (socket says 172.21.15.79:57952) 2021-04-09T18:29:41.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.458 7f960486d700 1 -- 172.21.15.79:0/2351030662 learned_addr learned my addr 172.21.15.79:0/2351030662 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:41.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.462 7f960506e700 1 --2- 172.21.15.79:0/2351030662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96000f5520 0x7f96000f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:41.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.462 7f960486d700 1 -- 172.21.15.79:0/2351030662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96000f5520 msgr2=0x7f96000f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:41.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.462 7f960486d700 1 --2- 172.21.15.79:0/2351030662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96000f5520 0x7f96000f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:41.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.462 7f960486d700 1 -- 172.21.15.79:0/2351030662 >> v1:172.21.15.89:6789/0 conn(0x7f96001c2db0 legacy=0x7f96001c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:41.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.462 7f960486d700 1 -- 172.21.15.79:0/2351030662 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96000e56d0 con 0x7f96000e9ae0 2021-04-09T18:29:41.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.462 7f960486d700 1 --2- 172.21.15.79:0/2351030662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96000e9ae0 0x7f960009f110 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f95f0002f30 tx=0x7f95f000bda0).ready entity=mon.0 client_cookie=19426a5b499fec83 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:41.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.462 7f95fffff700 1 -- 172.21.15.79:0/2351030662 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f96000e56d0 con 0x7f96000e9ae0 2021-04-09T18:29:41.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.462 7f95fffff700 1 -- 172.21.15.79:0/2351030662 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f00099d0 con 0x7f96000e9ae0 2021-04-09T18:29:41.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.462 7f95fffff700 1 -- 172.21.15.79:0/2351030662 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f95f0009da0 con 0x7f96000e9ae0 2021-04-09T18:29:41.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.462 7f96072ca700 1 -- 172.21.15.79:0/2351030662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96000e9ae0 msgr2=0x7f960009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:41.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.462 7f96072ca700 1 --2- 172.21.15.79:0/2351030662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96000e9ae0 0x7f960009f110 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f95f0002f30 tx=0x7f95f000bda0).stop 2021-04-09T18:29:41.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.462 7f96072ca700 1 -- 172.21.15.79:0/2351030662 shutdown_connections 2021-04-09T18:29:41.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.462 7f96072ca700 1 --2- 172.21.15.79:0/2351030662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96000f5520 0x7f96000f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:41.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.462 7f96072ca700 1 --2- 172.21.15.79:0/2351030662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96000e9ae0 0x7f960009f110 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:41.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.462 7f96072ca700 1 -- 172.21.15.79:0/2351030662 >> 172.21.15.79:0/2351030662 conn(0x7f96000e5fe0 msgr2=0x7f96000e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:41.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.462 7f96072ca700 1 -- 172.21.15.79:0/2351030662 shutdown_connections 2021-04-09T18:29:41.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.462 7f96072ca700 1 -- 172.21.15.79:0/2351030662 wait complete. 2021-04-09T18:29:41.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f96072ca700 1 Processor -- start 2021-04-09T18:29:41.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f96072ca700 1 -- start start 2021-04-09T18:29:41.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f96072ca700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96000baf30 0x7f96000c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:41.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f96072ca700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96000bfeb0 0x7f96000c3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:41.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f96072ca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96000c0300 0x7f96001b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:41.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f96072ca700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96000c1b70 con 0x7f96000baf30 2021-04-09T18:29:41.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f96072ca700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96000c1e70 con 0x7f96000bfeb0 2021-04-09T18:29:41.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f96072ca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96000bb380 con 0x7f96000c0300 2021-04-09T18:29:41.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f960506e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96000baf30 0x7f96000c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:41.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f960506e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96000baf30 0x7f96000c12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57958/0 (socket says 172.21.15.79:57958) 2021-04-09T18:29:41.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f960506e700 1 -- 172.21.15.79:0/2828837978 learned_addr learned my addr 172.21.15.79:0/2828837978 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:41.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f960486d700 1 --2- 172.21.15.79:0/2828837978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96000bfeb0 0x7f96000c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:41.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f960586f700 1 --2- 172.21.15.79:0/2828837978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96000c0300 0x7f96001b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:41.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f960506e700 1 -- 172.21.15.79:0/2828837978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96000c0300 msgr2=0x7f96001b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:41.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f960506e700 1 --2- 172.21.15.79:0/2828837978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96000c0300 0x7f96001b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:41.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f960506e700 1 -- 172.21.15.79:0/2828837978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96000bfeb0 msgr2=0x7f96000c3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:41.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f960506e700 1 --2- 172.21.15.79:0/2828837978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96000bfeb0 0x7f96000c3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:41.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f960506e700 1 -- 172.21.15.79:0/2828837978 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96000c0ed0 con 0x7f96000baf30 2021-04-09T18:29:41.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f960506e700 1 --2- 172.21.15.79:0/2828837978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96000baf30 0x7f96000c12f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f95e8006920 tx=0x7f95e800c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:41.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f95fdffb700 1 -- 172.21.15.79:0/2828837978 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f96000c0ed0 con 0x7f96000baf30 2021-04-09T18:29:41.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f95fdffb700 1 -- 172.21.15.79:0/2828837978 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e800cbb0 con 0x7f96000baf30 2021-04-09T18:29:41.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f96072ca700 1 -- 172.21.15.79:0/2828837978 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96000c3a40 con 0x7f96000baf30 2021-04-09T18:29:41.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f95fdffb700 1 -- 172.21.15.79:0/2828837978 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f95e800f040 con 0x7f96000baf30 2021-04-09T18:29:41.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f96072ca700 1 -- 172.21.15.79:0/2828837978 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96001b19e0 con 0x7f96000baf30 2021-04-09T18:29:41.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.466 7f95fdffb700 1 -- 172.21.15.79:0/2828837978 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f95e8011070 con 0x7f96000baf30 2021-04-09T18:29:41.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.470 7f95fdffb700 1 --2- 172.21.15.79:0/2828837978 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f95e4029100 0x7f95e402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:41.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.470 7f95fdffb700 1 -- 172.21.15.79:0/2828837978 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f95e8010040 con 0x7f96000baf30 2021-04-09T18:29:41.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.470 7f960486d700 1 --2- 172.21.15.79:0/2828837978 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f95e4029100 0x7f95e402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:41.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.470 7f960486d700 1 --2- 172.21.15.79:0/2828837978 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f95e4029100 0x7f95e402b650 crc :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:41.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.474 7f96072ca700 1 -- 172.21.15.79:0/2828837978 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96000e39e0 con 0x7f96000baf30 2021-04-09T18:29:41.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.482 7f95fdffb700 1 -- 172.21.15.79:0/2828837978 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f95e800c7b0 con 0x7f96000baf30 2021-04-09T18:29:41.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:41.634 7f96072ca700 1 -- 172.21.15.79:0/2828837978 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f96000f5b20 con 0x7f96000baf30 2021-04-09T18:29:42.015 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:29:42.014 7fbcd0516700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:29:42.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.026 7f95fdffb700 1 -- 172.21.15.79:0/2828837978 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7f95e8000bf0 con 0x7f96000baf30 2021-04-09T18:29:42.051 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-04-09T18:29:42.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.054 7f96072ca700 1 -- 172.21.15.79:0/2828837978 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f95e4029100 msgr2=0x7f95e402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:42.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.054 7f96072ca700 1 --2- 172.21.15.79:0/2828837978 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f95e4029100 0x7f95e402b650 crc :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:42.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.054 7f96072ca700 1 -- 172.21.15.79:0/2828837978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96000baf30 msgr2=0x7f96000c12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:42.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.054 7f96072ca700 1 --2- 172.21.15.79:0/2828837978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96000baf30 0x7f96000c12f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f95e8006920 tx=0x7f95e800c150).stop 2021-04-09T18:29:42.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.054 7f96072ca700 1 -- 172.21.15.79:0/2828837978 shutdown_connections 2021-04-09T18:29:42.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.054 7f96072ca700 1 --2- 172.21.15.79:0/2828837978 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f95e4029100 0x7f95e402b650 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:42.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.054 7f96072ca700 1 --2- 172.21.15.79:0/2828837978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96000c0300 0x7f96001b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:42.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.054 7f96072ca700 1 --2- 172.21.15.79:0/2828837978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96000baf30 0x7f96000c12f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:42.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.054 7f96072ca700 1 --2- 172.21.15.79:0/2828837978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96000bfeb0 0x7f96000c3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:42.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.054 7f96072ca700 1 -- 172.21.15.79:0/2828837978 >> 172.21.15.79:0/2828837978 conn(0x7f96000afc60 msgr2=0x7f96000af060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:42.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.054 7f96072ca700 1 -- 172.21.15.79:0/2828837978 shutdown_connections 2021-04-09T18:29:42.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.054 7f96072ca700 1 -- 172.21.15.79:0/2828837978 wait complete. 2021-04-09T18:29:42.069 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:29:42.072 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2021-04-09T18:29:42.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.158 7f3950ac7700 1 Processor -- start 2021-04-09T18:29:42.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.158 7f3950ac7700 1 -- start start 2021-04-09T18:29:42.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.158 7f3950ac7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f394c0f5510 0x7f394c0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:42.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.158 7f3950ac7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f394c0e9ad0 0x7f394c09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:42.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.158 7f3950ac7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394c0fbb10 con 0x7f394c1c2da0 2021-04-09T18:29:42.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.158 7f3950ac7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394c0e9f20 con 0x7f394c0f5510 2021-04-09T18:29:42.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.158 7f3950ac7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394c0e59c0 con 0x7f394c0e9ad0 2021-04-09T18:29:42.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.158 7f394a7e6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f394c0f5510 0x7f394c0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:42.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.158 7f394afe7700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f394c1c2da0 0x7f394c1c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52692/0 (socket says 172.21.15.79:52692) 2021-04-09T18:29:42.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.158 7f394afe7700 1 -- 172.21.15.79:0/442029394 learned_addr learned my addr 172.21.15.79:0/442029394 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:42.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.158 7f3949fe5700 1 --2- 172.21.15.79:0/442029394 >> v2:172.21.15.89:3300/0 conn(0x7f394c0e9ad0 0x7f394c09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:42.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.162 7f394a7e6700 1 -- 172.21.15.79:0/442029394 >> v2:172.21.15.89:3300/0 conn(0x7f394c0e9ad0 msgr2=0x7f394c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:42.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.162 7f394a7e6700 1 --2- 172.21.15.79:0/442029394 >> v2:172.21.15.89:3300/0 conn(0x7f394c0e9ad0 0x7f394c09f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:42.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.162 7f394a7e6700 1 -- 172.21.15.79:0/442029394 >> v1:172.21.15.79:6789/0 conn(0x7f394c1c2da0 legacy=0x7f394c1c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:42.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.162 7f39497e4700 1 -- 172.21.15.79:0/442029394 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2825414325 0 0) 0x7f39440010d0 con 0x7f394c1c2da0 2021-04-09T18:29:42.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.162 7f394a7e6700 1 -- 172.21.15.79:0/442029394 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c0e56c0 con 0x7f394c0f5510 2021-04-09T18:29:42.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.162 7f394a7e6700 1 --2- 172.21.15.79:0/442029394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c0f5510 0x7f394c0f64a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f3934002f30 tx=0x7f393400bd10).ready entity=mon.0 client_cookie=10e3ac2162e53929 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:42.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.162 7f39497e4700 1 -- 172.21.15.79:0/442029394 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f394c0e56c0 con 0x7f394c0f5510 2021-04-09T18:29:42.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.162 7f39497e4700 1 -- 172.21.15.79:0/442029394 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39340098a0 con 0x7f394c0f5510 2021-04-09T18:29:42.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.162 7f39497e4700 1 -- 172.21.15.79:0/442029394 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3934009c70 con 0x7f394c0f5510 2021-04-09T18:29:42.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.162 7f3950ac7700 1 -- 172.21.15.79:0/442029394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c0f5510 msgr2=0x7f394c0f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:42.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.162 7f3950ac7700 1 --2- 172.21.15.79:0/442029394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c0f5510 0x7f394c0f64a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f3934002f30 tx=0x7f393400bd10).stop 2021-04-09T18:29:42.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.162 7f3950ac7700 1 -- 172.21.15.79:0/442029394 shutdown_connections 2021-04-09T18:29:42.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.162 7f3950ac7700 1 --2- 172.21.15.79:0/442029394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c0f5510 0x7f394c0f64a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:42.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.162 7f3950ac7700 1 --2- 172.21.15.79:0/442029394 >> v2:172.21.15.89:3300/0 conn(0x7f394c0e9ad0 0x7f394c09f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:42.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.162 7f3950ac7700 1 -- 172.21.15.79:0/442029394 >> 172.21.15.79:0/442029394 conn(0x7f394c0e5fd0 msgr2=0x7f394c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:42.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.162 7f3950ac7700 1 -- 172.21.15.79:0/442029394 shutdown_connections 2021-04-09T18:29:42.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.162 7f3950ac7700 1 -- 172.21.15.79:0/442029394 wait complete. 2021-04-09T18:29:42.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f3950ac7700 1 Processor -- start 2021-04-09T18:29:42.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f3950ac7700 1 -- start start 2021-04-09T18:29:42.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f3950ac7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c0d0ac0 0x7f394c0d69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:42.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f3950ac7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c099e60 0x7f394c0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:42.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f3950ac7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c09a2b0 0x7f394c0b83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:42.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f3950ac7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0d66f0 con 0x7f394c09a2b0 2021-04-09T18:29:42.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f3950ac7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0d0f10 con 0x7f394c0d0ac0 2021-04-09T18:29:42.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f3950ac7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0d63b0 con 0x7f394c099e60 2021-04-09T18:29:42.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f394afe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c09a2b0 0x7f394c0b83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:42.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f394afe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c09a2b0 0x7f394c0b83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57988/0 (socket says 172.21.15.79:57988) 2021-04-09T18:29:42.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f394afe7700 1 -- 172.21.15.79:0/251238554 learned_addr learned my addr 172.21.15.79:0/251238554 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:42.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f3949fe5700 1 --2- 172.21.15.79:0/251238554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c099e60 0x7f394c0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:42.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f394a7e6700 1 --2- 172.21.15.79:0/251238554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c0d0ac0 0x7f394c0d69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:42.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f394afe7700 1 -- 172.21.15.79:0/251238554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c099e60 msgr2=0x7f394c0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:42.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f394afe7700 1 --2- 172.21.15.79:0/251238554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c099e60 0x7f394c0cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:42.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f394afe7700 1 -- 172.21.15.79:0/251238554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c0d0ac0 msgr2=0x7f394c0d69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:42.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f394afe7700 1 --2- 172.21.15.79:0/251238554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c0d0ac0 0x7f394c0d69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:42.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f394afe7700 1 -- 172.21.15.79:0/251238554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c0d7020 con 0x7f394c09a2b0 2021-04-09T18:29:42.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f394afe7700 1 --2- 172.21.15.79:0/251238554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c09a2b0 0x7f394c0b83d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f394c0d35f0 tx=0x7f394400cb60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:42.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f3942ffd700 1 -- 172.21.15.79:0/251238554 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3944005240 con 0x7f394c09a2b0 2021-04-09T18:29:42.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f3942ffd700 1 -- 172.21.15.79:0/251238554 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39440070d0 con 0x7f394c09a2b0 2021-04-09T18:29:42.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f3942ffd700 1 -- 172.21.15.79:0/251238554 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f39440055f0 con 0x7f394c09a2b0 2021-04-09T18:29:42.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f3950ac7700 1 -- 172.21.15.79:0/251238554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f394c09a900 con 0x7f394c09a2b0 2021-04-09T18:29:42.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.166 7f3950ac7700 1 -- 172.21.15.79:0/251238554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394c0ce660 con 0x7f394c09a2b0 2021-04-09T18:29:42.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.170 7f3942ffd700 1 -- 172.21.15.79:0/251238554 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f39440057f0 con 0x7f394c09a2b0 2021-04-09T18:29:42.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.170 7f3942ffd700 1 --2- 172.21.15.79:0/251238554 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3930029100 0x7f393002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:42.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.170 7f3942ffd700 1 -- 172.21.15.79:0/251238554 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6139+0+0 (secure 0 0 0) 0x7f3944039230 con 0x7f394c09a2b0 2021-04-09T18:29:42.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.170 7f394a7e6700 1 --2- 172.21.15.79:0/251238554 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3930029100 0x7f393002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:42.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.170 7f394a7e6700 1 --2- 172.21.15.79:0/251238554 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3930029100 0x7f393002b650 crc :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:42.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.174 7f3950ac7700 1 -- 172.21.15.79:0/251238554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394c0e39d0 con 0x7f394c09a2b0 2021-04-09T18:29:42.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.182 7f3942ffd700 1 -- 172.21.15.79:0/251238554 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3944005030 con 0x7f394c09a2b0 2021-04-09T18:29:42.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.346 7f3950ac7700 1 -- 172.21.15.79:0/251238554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f394c0f5b10 con 0x7f394c09a2b0 2021-04-09T18:29:42.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.346 7f3942ffd700 1 -- 172.21.15.79:0/251238554 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+1753 (secure 0 0 0) 0x7f3944000bf0 con 0x7f394c09a2b0 2021-04-09T18:29:42.351 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:29:42.352 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5233,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/781814443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":781814443},{"type":"v1","addr":"172.21.15.89:6835","nonce":781814443}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":16}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:28:14.813896","modified":"2021-04-09 18:29:42.017986","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-04-09T18:29:42.352 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 20 2021-04-09T18:29:42.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.350 7f3950ac7700 1 -- 172.21.15.79:0/251238554 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3930029100 msgr2=0x7f393002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:42.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.350 7f3950ac7700 1 --2- 172.21.15.79:0/251238554 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3930029100 0x7f393002b650 crc :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:42.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.350 7f3950ac7700 1 -- 172.21.15.79:0/251238554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c09a2b0 msgr2=0x7f394c0b83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:42.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.350 7f3950ac7700 1 --2- 172.21.15.79:0/251238554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c09a2b0 0x7f394c0b83d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f394c0d35f0 tx=0x7f394400cb60).stop 2021-04-09T18:29:42.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.350 7f3950ac7700 1 -- 172.21.15.79:0/251238554 shutdown_connections 2021-04-09T18:29:42.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.350 7f3950ac7700 1 --2- 172.21.15.79:0/251238554 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3930029100 0x7f393002b650 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:42.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.350 7f3950ac7700 1 --2- 172.21.15.79:0/251238554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c0d0ac0 0x7f394c0d69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:42.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.350 7f3950ac7700 1 --2- 172.21.15.79:0/251238554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c09a2b0 0x7f394c0b83d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:42.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.350 7f3950ac7700 1 --2- 172.21.15.79:0/251238554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c099e60 0x7f394c0cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:42.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.350 7f3950ac7700 1 -- 172.21.15.79:0/251238554 >> 172.21.15.79:0/251238554 conn(0x7f394c0d36f0 msgr2=0x7f394c0d8530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:42.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.350 7f3950ac7700 1 -- 172.21.15.79:0/251238554 shutdown_connections 2021-04-09T18:29:42.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.350 7f3950ac7700 1 -- 172.21.15.79:0/251238554 wait complete. 2021-04-09T18:29:42.364 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-04-09T18:29:42.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.502 7fd3c8b0d700 1 Processor -- start 2021-04-09T18:29:42.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.502 7fd3c8b0d700 1 -- start start 2021-04-09T18:29:42.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.502 7fd3c8b0d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd3c41c9020 0x7fd3c41cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:42.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.502 7fd3c8b0d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c40fbb20 con 0x7fd3c40f5520 2021-04-09T18:29:42.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.502 7fd3c8b0d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c409f910 con 0x7fd3c40e9ae0 2021-04-09T18:29:42.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.502 7fd3c8b0d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c41c3dc0 con 0x7fd3c41c9020 2021-04-09T18:29:42.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.502 7fd3c2fe7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd3c41c9020 0x7fd3c41cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:42.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.502 7fd3c27e6700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd3c40f5520 0x7fd3c40f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52702/0 (socket says 172.21.15.79:52702) 2021-04-09T18:29:42.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.502 7fd3c27e6700 1 -- 172.21.15.79:0/2904932943 learned_addr learned my addr 172.21.15.79:0/2904932943 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:42.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.506 7fd3c2fe7700 1 -- 172.21.15.79:0/2904932943 >> v1:172.21.15.89:6789/0 conn(0x7fd3c40e9ae0 legacy=0x7fd3c409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:42.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.506 7fd3c2fe7700 1 -- 172.21.15.79:0/2904932943 >> v1:172.21.15.79:6789/0 conn(0x7fd3c40f5520 legacy=0x7fd3c40f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:42.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.506 7fd3c17e4700 1 -- 172.21.15.79:0/2904932943 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631605366 0 0) 0x7fd3b40010d0 con 0x7fd3c40f5520 2021-04-09T18:29:42.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.506 7fd3c2fe7700 1 -- 172.21.15.79:0/2904932943 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c40e56d0 con 0x7fd3c41c9020 2021-04-09T18:29:42.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.506 7fd3c2fe7700 1 --2- 172.21.15.79:0/2904932943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3c41c9020 0x7fd3c41cb480 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fd3bc0032b0 tx=0x7fd3bc00b0e0).ready entity=mon.0 client_cookie=f1d64bc490bb3e80 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:42.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.506 7fd3c17e4700 1 -- 172.21.15.79:0/2904932943 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd3c40e56d0 con 0x7fd3c41c9020 2021-04-09T18:29:42.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.506 7fd3c17e4700 1 -- 172.21.15.79:0/2904932943 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc00bab0 con 0x7fd3c41c9020 2021-04-09T18:29:42.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.506 7fd3c17e4700 1 -- 172.21.15.79:0/2904932943 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd3bc002020 con 0x7fd3c41c9020 2021-04-09T18:29:42.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.506 7fd3c8b0d700 1 -- 172.21.15.79:0/2904932943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3c41c9020 msgr2=0x7fd3c41cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:42.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.506 7fd3c8b0d700 1 --2- 172.21.15.79:0/2904932943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3c41c9020 0x7fd3c41cb480 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fd3bc0032b0 tx=0x7fd3bc00b0e0).stop 2021-04-09T18:29:42.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.506 7fd3c8b0d700 1 -- 172.21.15.79:0/2904932943 shutdown_connections 2021-04-09T18:29:42.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.506 7fd3c8b0d700 1 --2- 172.21.15.79:0/2904932943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3c41c9020 0x7fd3c41cb480 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:42.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.506 7fd3c8b0d700 1 -- 172.21.15.79:0/2904932943 >> 172.21.15.79:0/2904932943 conn(0x7fd3c40e5fe0 msgr2=0x7fd3c40e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:42.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.506 7fd3c8b0d700 1 -- 172.21.15.79:0/2904932943 shutdown_connections 2021-04-09T18:29:42.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.506 7fd3c8b0d700 1 -- 172.21.15.79:0/2904932943 wait complete. 2021-04-09T18:29:42.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.510 7fd3c8b0d700 1 Processor -- start 2021-04-09T18:29:42.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.510 7fd3c8b0d700 1 -- start start 2021-04-09T18:29:42.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.510 7fd3c8b0d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3c40ac9e0 0x7fd3c4098b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:42.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.510 7fd3c8b0d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3c40a2f70 0x7fd3c40a25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:42.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.510 7fd3c8b0d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3c40a33c0 0x7fd3c40c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:42.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.510 7fd3c8b0d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40e9f30 con 0x7fd3c40a33c0 2021-04-09T18:29:42.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.510 7fd3c8b0d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c4098800 con 0x7fd3c40a2f70 2021-04-09T18:29:42.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.510 7fd3c8b0d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c4098090 con 0x7fd3c40ac9e0 2021-04-09T18:29:42.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.510 7fd3c2fe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3c40a33c0 0x7fd3c40c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:42.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.510 7fd3c2fe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3c40a33c0 0x7fd3c40c4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58000/0 (socket says 172.21.15.79:58000) 2021-04-09T18:29:42.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.510 7fd3c2fe7700 1 -- 172.21.15.79:0/2182705086 learned_addr learned my addr 172.21.15.79:0/2182705086 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:42.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.510 7fd3c1fe5700 1 --2- 172.21.15.79:0/2182705086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3c40a2f70 0x7fd3c40a25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:42.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.510 7fd3c27e6700 1 --2- 172.21.15.79:0/2182705086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3c40ac9e0 0x7fd3c4098b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:42.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.514 7fd3c2fe7700 1 -- 172.21.15.79:0/2182705086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3c40ac9e0 msgr2=0x7fd3c4098b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:42.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.514 7fd3c2fe7700 1 --2- 172.21.15.79:0/2182705086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3c40ac9e0 0x7fd3c4098b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:42.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.514 7fd3c2fe7700 1 -- 172.21.15.79:0/2182705086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3c40a2f70 msgr2=0x7fd3c40a25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:42.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.514 7fd3c2fe7700 1 --2- 172.21.15.79:0/2182705086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3c40a2f70 0x7fd3c40a25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:42.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.514 7fd3c2fe7700 1 -- 172.21.15.79:0/2182705086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c40a2bf0 con 0x7fd3c40a33c0 2021-04-09T18:29:42.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.514 7fd3c2fe7700 1 --2- 172.21.15.79:0/2182705086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3c40a33c0 0x7fd3c40c4b30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fd3c40874f0 tx=0x7fd3bc006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:42.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.514 7fd3b2ffd700 1 -- 172.21.15.79:0/2182705086 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd3c40a2bf0 con 0x7fd3c40a33c0 2021-04-09T18:29:42.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.514 7fd3b2ffd700 1 -- 172.21.15.79:0/2182705086 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc01f020 con 0x7fd3c40a33c0 2021-04-09T18:29:42.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.514 7fd3c8b0d700 1 -- 172.21.15.79:0/2182705086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c40983b0 con 0x7fd3c40a33c0 2021-04-09T18:29:42.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.514 7fd3b2ffd700 1 -- 172.21.15.79:0/2182705086 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd3bc01b830 con 0x7fd3c40a33c0 2021-04-09T18:29:42.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.514 7fd3c8b0d700 1 -- 172.21.15.79:0/2182705086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c40c52f0 con 0x7fd3c40a33c0 2021-04-09T18:29:42.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.514 7fd3b2ffd700 1 -- 172.21.15.79:0/2182705086 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd3bc009ce0 con 0x7fd3c40a33c0 2021-04-09T18:29:42.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.514 7fd3b2ffd700 1 --2- 172.21.15.79:0/2182705086 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3a8029100 0x7fd3a802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:42.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.514 7fd3b2ffd700 1 -- 172.21.15.79:0/2182705086 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6139+0+0 (secure 0 0 0) 0x7fd3bc03c080 con 0x7fd3c40a33c0 2021-04-09T18:29:42.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.514 7fd3c27e6700 1 --2- 172.21.15.79:0/2182705086 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3a8029100 0x7fd3a802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:42.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.514 7fd3c27e6700 1 --2- 172.21.15.79:0/2182705086 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3a8029100 0x7fd3a802b650 crc :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:42.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.514 7fd3c8b0d700 1 -- 172.21.15.79:0/2182705086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c40e39e0 con 0x7fd3c40a33c0 2021-04-09T18:29:42.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.522 7fd3b2ffd700 1 -- 172.21.15.79:0/2182705086 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd3bc01b430 con 0x7fd3c40a33c0 2021-04-09T18:29:42.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:42.690 7fd3c8b0d700 1 -- 172.21.15.79:0/2182705086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd3c40bb530 con 0x7fd3c40a33c0 2021-04-09T18:29:42.693 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:29:42.696 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:29:42.699 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:29:42.702 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:29:42.705 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:29:43.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.642 7fd3b2ffd700 1 -- 172.21.15.79:0/2182705086 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd3bc00b8a0 con 0x7fd3c40a33c0 2021-04-09T18:29:43.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.658 7fd3c8b0d700 1 -- 172.21.15.79:0/2182705086 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3a8029100 msgr2=0x7fd3a802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:43.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.658 7fd3c8b0d700 1 --2- 172.21.15.79:0/2182705086 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3a8029100 0x7fd3a802b650 crc :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:43.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.658 7fd3c8b0d700 1 -- 172.21.15.79:0/2182705086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3c40a33c0 msgr2=0x7fd3c40c4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:43.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.658 7fd3c8b0d700 1 --2- 172.21.15.79:0/2182705086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3c40a33c0 0x7fd3c40c4b30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fd3c40874f0 tx=0x7fd3bc006c10).stop 2021-04-09T18:29:43.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.658 7fd3c8b0d700 1 -- 172.21.15.79:0/2182705086 shutdown_connections 2021-04-09T18:29:43.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.658 7fd3c8b0d700 1 --2- 172.21.15.79:0/2182705086 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3a8029100 0x7fd3a802b650 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:43.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.658 7fd3c8b0d700 1 --2- 172.21.15.79:0/2182705086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3c40a33c0 0x7fd3c40c4b30 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:43.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.658 7fd3c8b0d700 1 --2- 172.21.15.79:0/2182705086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3c40ac9e0 0x7fd3c4098b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:43.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.658 7fd3c8b0d700 1 --2- 172.21.15.79:0/2182705086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3c40a2f70 0x7fd3c40a25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:43.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.658 7fd3c8b0d700 1 -- 172.21.15.79:0/2182705086 >> 172.21.15.79:0/2182705086 conn(0x7fd3c409b070 msgr2=0x7fd3c409a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:43.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.658 7fd3c8b0d700 1 -- 172.21.15.79:0/2182705086 shutdown_connections 2021-04-09T18:29:43.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.658 7fd3c8b0d700 1 -- 172.21.15.79:0/2182705086 wait complete. 2021-04-09T18:29:43.680 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-04-09T18:29:43.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f5135369700 1 Processor -- start 2021-04-09T18:29:43.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f5135369700 1 -- start start 2021-04-09T18:29:43.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f5135369700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51300f5540 0x7f51300f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:43.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f5135369700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f51301c8030 0x7f51301ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:43.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f5135369700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51300fbb40 con 0x7f51300e9b00 2021-04-09T18:29:43.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f5135369700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51300e9f50 con 0x7f51301c8030 2021-04-09T18:29:43.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f5135369700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51301c3de0 con 0x7f51300f5540 2021-04-09T18:29:43.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f512e804700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f51300e9b00 0x7f513009f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52716/0 (socket says 172.21.15.79:52716) 2021-04-09T18:29:43.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f512e804700 1 -- 172.21.15.79:0/3475882134 learned_addr learned my addr 172.21.15.79:0/3475882134 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:43.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f512f005700 1 --2- 172.21.15.79:0/3475882134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51300f5540 0x7f51300f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:43.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f512f806700 1 --2- 172.21.15.79:0/3475882134 >> v2:172.21.15.89:3300/0 conn(0x7f51301c8030 0x7f51301ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:43.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f512e003700 1 -- 172.21.15.79:0/3475882134 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4254322722 0 0) 0x7f5124001450 con 0x7f51300e9b00 2021-04-09T18:29:43.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f512e003700 1 -- 172.21.15.79:0/3475882134 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5118003240 con 0x7f51300e9b00 2021-04-09T18:29:43.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f512f005700 1 -- 172.21.15.79:0/3475882134 >> v2:172.21.15.89:3300/0 conn(0x7f51301c8030 msgr2=0x7f51301ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:43.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f512f005700 1 --2- 172.21.15.79:0/3475882134 >> v2:172.21.15.89:3300/0 conn(0x7f51301c8030 0x7f51301ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:43.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f512f005700 1 -- 172.21.15.79:0/3475882134 >> v1:172.21.15.79:6789/0 conn(0x7f51300e9b00 legacy=0x7f513009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:43.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f512f005700 1 -- 172.21.15.79:0/3475882134 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513009f900 con 0x7f51300f5540 2021-04-09T18:29:43.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f512f806700 1 --2- 172.21.15.79:0/3475882134 >> v2:172.21.15.89:3300/0 conn(0x7f51301c8030 0x7f51301ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:29:43.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f512f005700 1 --2- 172.21.15.79:0/3475882134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51300f5540 0x7f51300f64d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f5120002f30 tx=0x7f512000bcc0).ready entity=mon.2 client_cookie=a09de8853ba3f763 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:43.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f512e003700 1 -- 172.21.15.79:0/3475882134 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f513009f900 con 0x7f51300f5540 2021-04-09T18:29:43.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f512e003700 1 -- 172.21.15.79:0/3475882134 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5120009800 con 0x7f51300f5540 2021-04-09T18:29:43.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f512e003700 1 -- 172.21.15.79:0/3475882134 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5120009bd0 con 0x7f51300f5540 2021-04-09T18:29:43.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f5135369700 1 -- 172.21.15.79:0/3475882134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51300f5540 msgr2=0x7f51300f64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:43.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f5135369700 1 --2- 172.21.15.79:0/3475882134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51300f5540 0x7f51300f64d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f5120002f30 tx=0x7f512000bcc0).stop 2021-04-09T18:29:43.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f5135369700 1 -- 172.21.15.79:0/3475882134 shutdown_connections 2021-04-09T18:29:43.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f5135369700 1 --2- 172.21.15.79:0/3475882134 >> v2:172.21.15.89:3300/0 conn(0x7f51301c8030 0x7f51301ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:43.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f5135369700 1 --2- 172.21.15.79:0/3475882134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51300f5540 0x7f51300f64d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:43.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.786 7f5135369700 1 -- 172.21.15.79:0/3475882134 >> 172.21.15.79:0/3475882134 conn(0x7f51300e6000 msgr2=0x7f51300e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:43.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.790 7f5135369700 1 -- 172.21.15.79:0/3475882134 shutdown_connections 2021-04-09T18:29:43.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.790 7f5135369700 1 -- 172.21.15.79:0/3475882134 wait complete. 2021-04-09T18:29:43.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.790 7f5135369700 1 Processor -- start 2021-04-09T18:29:43.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.790 7f5135369700 1 -- start start 2021-04-09T18:29:43.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.790 7f5135369700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51300ba950 0x7f513008fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:43.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.790 7f5135369700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51300b9ba0 0x7f51300bba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:43.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.790 7f5135369700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51300d1f60 0x7f513008f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:43.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.790 7f5135369700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5130088570 con 0x7f51300ba950 2021-04-09T18:29:43.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.790 7f5135369700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51300ba2f0 con 0x7f51300b9ba0 2021-04-09T18:29:43.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.790 7f5135369700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51300b9ff0 con 0x7f51300d1f60 2021-04-09T18:29:43.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.790 7f512f005700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51300ba950 0x7f513008fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:43.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.790 7f512f005700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51300ba950 0x7f513008fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58010/0 (socket says 172.21.15.79:58010) 2021-04-09T18:29:43.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.790 7f512f005700 1 -- 172.21.15.79:0/1087085626 learned_addr learned my addr 172.21.15.79:0/1087085626 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:43.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.790 7f512e804700 1 --2- 172.21.15.79:0/1087085626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51300b9ba0 0x7f51300bba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:43.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.790 7f512f806700 1 --2- 172.21.15.79:0/1087085626 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51300d1f60 0x7f513008f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:43.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.794 7f512f005700 1 -- 172.21.15.79:0/1087085626 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51300d1f60 msgr2=0x7f513008f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:43.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.794 7f512f005700 1 --2- 172.21.15.79:0/1087085626 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51300d1f60 0x7f513008f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:43.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.794 7f512f005700 1 -- 172.21.15.79:0/1087085626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51300b9ba0 msgr2=0x7f51300bba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:43.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.794 7f512f005700 1 --2- 172.21.15.79:0/1087085626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51300b9ba0 0x7f51300bba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:43.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.794 7f512f005700 1 -- 172.21.15.79:0/1087085626 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51300ba5f0 con 0x7f51300ba950 2021-04-09T18:29:43.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.794 7f512f005700 1 --2- 172.21.15.79:0/1087085626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51300ba950 0x7f513008fc60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f513008e740 tx=0x7f5120006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:43.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.794 7f5117fff700 1 -- 172.21.15.79:0/1087085626 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f51300ba5f0 con 0x7f51300ba950 2021-04-09T18:29:43.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.794 7f5117fff700 1 -- 172.21.15.79:0/1087085626 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5120011960 con 0x7f51300ba950 2021-04-09T18:29:43.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.794 7f5135369700 1 -- 172.21.15.79:0/1087085626 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f513008f8e0 con 0x7f51300ba950 2021-04-09T18:29:43.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.794 7f5117fff700 1 -- 172.21.15.79:0/1087085626 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5120011d30 con 0x7f51300ba950 2021-04-09T18:29:43.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.794 7f5135369700 1 -- 172.21.15.79:0/1087085626 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51300d2540 con 0x7f51300ba950 2021-04-09T18:29:43.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.794 7f5117fff700 1 -- 172.21.15.79:0/1087085626 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f512001d440 con 0x7f51300ba950 2021-04-09T18:29:43.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.794 7f5117fff700 1 --2- 172.21.15.79:0/1087085626 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5110029100 0x7f511002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:43.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.794 7f5117fff700 1 -- 172.21.15.79:0/1087085626 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6139+0+0 (secure 0 0 0) 0x7f512003b860 con 0x7f51300ba950 2021-04-09T18:29:43.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.794 7f512e804700 1 --2- 172.21.15.79:0/1087085626 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5110029100 0x7f511002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:43.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.794 7f512e804700 1 --2- 172.21.15.79:0/1087085626 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5110029100 0x7f511002b650 crc :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:43.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.798 7f5135369700 1 -- 172.21.15.79:0/1087085626 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51300e39e0 con 0x7f51300ba950 2021-04-09T18:29:43.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.806 7f5117fff700 1 -- 172.21.15.79:0/1087085626 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f51200095f0 con 0x7f51300ba950 2021-04-09T18:29:43.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:43.966 7f5135369700 1 -- 172.21.15.79:0/1087085626 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f51300f5b40 con 0x7f51300ba950 2021-04-09T18:29:44.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.654 7f5117fff700 1 -- 172.21.15.79:0/1087085626 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) v1 ==== 185+0+0 (secure 0 0 0) 0x7f5120011750 con 0x7f51300ba950 2021-04-09T18:29:44.685 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2021-04-09T18:29:44.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.686 7f5135369700 1 -- 172.21.15.79:0/1087085626 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5110029100 msgr2=0x7f511002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:44.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.686 7f5135369700 1 --2- 172.21.15.79:0/1087085626 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5110029100 0x7f511002b650 crc :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:44.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.686 7f5135369700 1 -- 172.21.15.79:0/1087085626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51300ba950 msgr2=0x7f513008fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:44.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.686 7f5135369700 1 --2- 172.21.15.79:0/1087085626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51300ba950 0x7f513008fc60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f513008e740 tx=0x7f5120006890).stop 2021-04-09T18:29:44.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.686 7f5135369700 1 -- 172.21.15.79:0/1087085626 shutdown_connections 2021-04-09T18:29:44.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.686 7f5135369700 1 --2- 172.21.15.79:0/1087085626 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5110029100 0x7f511002b650 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:44.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.686 7f5135369700 1 --2- 172.21.15.79:0/1087085626 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51300d1f60 0x7f513008f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:44.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.686 7f5135369700 1 --2- 172.21.15.79:0/1087085626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51300ba950 0x7f513008fc60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:44.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.686 7f5135369700 1 --2- 172.21.15.79:0/1087085626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51300b9ba0 0x7f51300bba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:44.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.686 7f5135369700 1 -- 172.21.15.79:0/1087085626 >> 172.21.15.79:0/1087085626 conn(0x7f5130094660 msgr2=0x7f5130095d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:44.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.686 7f5135369700 1 -- 172.21.15.79:0/1087085626 shutdown_connections 2021-04-09T18:29:44.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.686 7f5135369700 1 -- 172.21.15.79:0/1087085626 wait complete. 2021-04-09T18:29:44.703 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-04-09T18:29:44.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.802 7f8abed56700 1 Processor -- start 2021-04-09T18:29:44.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.802 7f8abed56700 1 -- start start 2021-04-09T18:29:44.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.802 7f8abed56700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ab80f5550 0x7f8ab80f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:44.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.802 7f8abed56700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8ab80e9b10 0x7f8ab809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:44.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.802 7f8abed56700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab80fbb50 con 0x7f8ab81c2de0 2021-04-09T18:29:44.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.802 7f8abed56700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab80e9f60 con 0x7f8ab80e9b10 2021-04-09T18:29:44.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.802 7f8abed56700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80e5a00 con 0x7f8ab80f5550 2021-04-09T18:29:44.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.802 7f8ab7fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8ab80e9b10 0x7f8ab809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:44.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.802 7f8abcafa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ab80f5550 0x7f8ab80f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:44.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.802 7f8ab7fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8ab80e9b10 0x7f8ab809f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58020/0 (socket says 172.21.15.79:58020) 2021-04-09T18:29:44.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.802 7f8ab7fff700 1 -- 172.21.15.79:0/741363687 learned_addr learned my addr 172.21.15.79:0/741363687 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:44.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.806 7f8ab77fe700 1 -- 172.21.15.79:0/741363687 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405334302 0 0) 0x7f8ab0001450 con 0x7f8ab81c2de0 2021-04-09T18:29:44.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.806 7f8ab77fe700 1 -- 172.21.15.79:0/741363687 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aa0003240 con 0x7f8ab81c2de0 2021-04-09T18:29:44.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.806 7f8ab7fff700 1 -- 172.21.15.79:0/741363687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ab80f5550 msgr2=0x7f8ab80f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:44.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.806 7f8ab7fff700 1 --2- 172.21.15.79:0/741363687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ab80f5550 0x7f8ab80f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:44.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.806 7f8ab7fff700 1 -- 172.21.15.79:0/741363687 >> v1:172.21.15.89:6789/0 conn(0x7f8ab81c2de0 legacy=0x7f8ab81c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:44.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.806 7f8ab7fff700 1 -- 172.21.15.79:0/741363687 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab80e5700 con 0x7f8ab80e9b10 2021-04-09T18:29:44.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.806 7f8abcafa700 1 --2- 172.21.15.79:0/741363687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ab80f5550 0x7f8ab80f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:29:44.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.806 7f8ab7fff700 1 --2- 172.21.15.79:0/741363687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab80e9b10 0x7f8ab809f110 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f8aac002f30 tx=0x7f8aac00bda0).ready entity=mon.0 client_cookie=73a4f875d8d5f2fa server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:44.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.806 7f8ab77fe700 1 -- 172.21.15.79:0/741363687 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8ab80e5700 con 0x7f8ab80e9b10 2021-04-09T18:29:44.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.806 7f8ab77fe700 1 -- 172.21.15.79:0/741363687 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aac0099d0 con 0x7f8ab80e9b10 2021-04-09T18:29:44.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.806 7f8ab77fe700 1 -- 172.21.15.79:0/741363687 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8aac009da0 con 0x7f8ab80e9b10 2021-04-09T18:29:44.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.806 7f8abed56700 1 -- 172.21.15.79:0/741363687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab80e9b10 msgr2=0x7f8ab809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:44.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.806 7f8abed56700 1 --2- 172.21.15.79:0/741363687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab80e9b10 0x7f8ab809f110 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f8aac002f30 tx=0x7f8aac00bda0).stop 2021-04-09T18:29:44.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.806 7f8abed56700 1 -- 172.21.15.79:0/741363687 shutdown_connections 2021-04-09T18:29:44.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.806 7f8abed56700 1 --2- 172.21.15.79:0/741363687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ab80f5550 0x7f8ab80f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:44.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.806 7f8abed56700 1 --2- 172.21.15.79:0/741363687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab80e9b10 0x7f8ab809f110 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:44.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.806 7f8abed56700 1 -- 172.21.15.79:0/741363687 >> 172.21.15.79:0/741363687 conn(0x7f8ab80e6010 msgr2=0x7f8ab80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:44.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.806 7f8abed56700 1 -- 172.21.15.79:0/741363687 shutdown_connections 2021-04-09T18:29:44.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.806 7f8abed56700 1 -- 172.21.15.79:0/741363687 wait complete. 2021-04-09T18:29:44.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8abed56700 1 Processor -- start 2021-04-09T18:29:44.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8abed56700 1 -- start start 2021-04-09T18:29:44.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8abed56700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ab80d5050 0x7f8ab80d54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:44.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8abed56700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ab80b2b10 0x7f8ab80b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:44.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8abed56700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab80ae260 0x7f8ab80ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:44.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8abed56700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80ac9c0 con 0x7f8ab80ae260 2021-04-09T18:29:44.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8abed56700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80b3590 con 0x7f8ab80b2b10 2021-04-09T18:29:44.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8abed56700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80accc0 con 0x7f8ab80d5050 2021-04-09T18:29:44.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8abd2fb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab80ae260 0x7f8ab80ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:44.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8abd2fb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab80ae260 0x7f8ab80ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58026/0 (socket says 172.21.15.79:58026) 2021-04-09T18:29:44.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8abd2fb700 1 -- 172.21.15.79:0/3771976822 learned_addr learned my addr 172.21.15.79:0/3771976822 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:44.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8abcafa700 1 --2- 172.21.15.79:0/3771976822 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ab80d5050 0x7f8ab80d54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:44.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8ab7fff700 1 --2- 172.21.15.79:0/3771976822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ab80b2b10 0x7f8ab80b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:44.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8abd2fb700 1 -- 172.21.15.79:0/3771976822 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ab80d5050 msgr2=0x7f8ab80d54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:44.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8abd2fb700 1 --2- 172.21.15.79:0/3771976822 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ab80d5050 0x7f8ab80d54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:44.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8abd2fb700 1 -- 172.21.15.79:0/3771976822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ab80b2b10 msgr2=0x7f8ab80b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:44.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8abd2fb700 1 --2- 172.21.15.79:0/3771976822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ab80b2b10 0x7f8ab80b2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:44.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8abd2fb700 1 -- 172.21.15.79:0/3771976822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab81a6880 con 0x7f8ab80ae260 2021-04-09T18:29:44.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8ab7fff700 1 --2- 172.21.15.79:0/3771976822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ab80b2b10 0x7f8ab80b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:29:44.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8abd2fb700 1 --2- 172.21.15.79:0/3771976822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab80ae260 0x7f8ab80ae6b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f8ab80d8e20 tx=0x7f8ab0007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:44.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8ab57fa700 1 -- 172.21.15.79:0/3771976822 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8ab81a6880 con 0x7f8ab80ae260 2021-04-09T18:29:44.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8ab57fa700 1 -- 172.21.15.79:0/3771976822 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab0006a80 con 0x7f8ab80ae260 2021-04-09T18:29:44.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8abed56700 1 -- 172.21.15.79:0/3771976822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab80aece0 con 0x7f8ab80ae260 2021-04-09T18:29:44.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.810 7f8ab57fa700 1 -- 172.21.15.79:0/3771976822 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8ab0007030 con 0x7f8ab80ae260 2021-04-09T18:29:44.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.814 7f8abed56700 1 -- 172.21.15.79:0/3771976822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab80af190 con 0x7f8ab80ae260 2021-04-09T18:29:44.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.814 7f8ab57fa700 1 -- 172.21.15.79:0/3771976822 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8ab0007230 con 0x7f8ab80ae260 2021-04-09T18:29:44.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.814 7f8ab57fa700 1 --2- 172.21.15.79:0/3771976822 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8a98029100 0x7f8a9802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:44.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.814 7f8ab57fa700 1 -- 172.21.15.79:0/3771976822 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5701+0+0 (secure 0 0 0) 0x7f8ab0003020 con 0x7f8ab80ae260 2021-04-09T18:29:44.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.814 7f8abcafa700 1 --2- 172.21.15.79:0/3771976822 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8a98029100 0x7f8a9802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:44.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.814 7f8abcafa700 1 --2- 172.21.15.79:0/3771976822 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8a98029100 0x7f8a9802b650 crc :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:44.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.818 7f8abed56700 1 -- 172.21.15.79:0/3771976822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab80e39f0 con 0x7f8ab80ae260 2021-04-09T18:29:44.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.822 7f8ab57fa700 1 -- 172.21.15.79:0/3771976822 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8ab80f76f0 con 0x7f8ab80ae260 2021-04-09T18:29:44.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:44.982 7f8abed56700 1 -- 172.21.15.79:0/3771976822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8ab80f5b50 con 0x7f8ab80ae260 2021-04-09T18:29:45.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.662 7f8ab57fa700 1 -- 172.21.15.79:0/3771976822 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) v1 ==== 173+0+0 (secure 0 0 0) 0x7f8ab0006870 con 0x7f8ab80ae260 2021-04-09T18:29:45.701 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2021-04-09T18:29:45.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.702 7f8abed56700 1 -- 172.21.15.79:0/3771976822 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8a98029100 msgr2=0x7f8a9802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:45.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.702 7f8abed56700 1 --2- 172.21.15.79:0/3771976822 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8a98029100 0x7f8a9802b650 crc :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:45.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.702 7f8abed56700 1 -- 172.21.15.79:0/3771976822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab80ae260 msgr2=0x7f8ab80ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:45.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.702 7f8abed56700 1 --2- 172.21.15.79:0/3771976822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab80ae260 0x7f8ab80ae6b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f8ab80d8e20 tx=0x7f8ab0007f70).stop 2021-04-09T18:29:45.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.702 7f8abed56700 1 -- 172.21.15.79:0/3771976822 shutdown_connections 2021-04-09T18:29:45.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.702 7f8abed56700 1 --2- 172.21.15.79:0/3771976822 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8a98029100 0x7f8a9802b650 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:45.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.702 7f8abed56700 1 --2- 172.21.15.79:0/3771976822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ab80ae260 0x7f8ab80ae6b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:45.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.702 7f8abed56700 1 --2- 172.21.15.79:0/3771976822 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ab80d5050 0x7f8ab80d54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:45.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.702 7f8abed56700 1 --2- 172.21.15.79:0/3771976822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ab80b2b10 0x7f8ab80b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:45.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.702 7f8abed56700 1 -- 172.21.15.79:0/3771976822 >> 172.21.15.79:0/3771976822 conn(0x7f8ab80909b0 msgr2=0x7f8ab80d6410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:45.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.702 7f8abed56700 1 -- 172.21.15.79:0/3771976822 shutdown_connections 2021-04-09T18:29:45.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.702 7f8abed56700 1 -- 172.21.15.79:0/3771976822 wait complete. 2021-04-09T18:29:45.717 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-04-09T18:29:45.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4c660b700 1 Processor -- start 2021-04-09T18:29:45.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4c660b700 1 -- start start 2021-04-09T18:29:45.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4c660b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb4c00f5520 0x7fb4c00f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:45.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4c660b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4c00e9ae0 0x7fb4c009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:45.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4c660b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb4c01c2db0 0x7fb4c01c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:45.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4c660b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c00e9f30 con 0x7fb4c01c2db0 2021-04-09T18:29:45.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4c660b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c00e59d0 con 0x7fb4c00f5520 2021-04-09T18:29:45.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4c660b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c00fbb20 con 0x7fb4c00e9ae0 2021-04-09T18:29:45.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4c4bb0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb4c01c2db0 0x7fb4c01c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:45.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4c4bb0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb4c01c2db0 0x7fb4c01c3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58032/0 (socket says 172.21.15.79:58032) 2021-04-09T18:29:45.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4c4bb0700 1 -- 172.21.15.79:0/1678447298 learned_addr learned my addr 172.21.15.79:0/1678447298 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:45.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4bffff700 1 --2- 172.21.15.79:0/1678447298 >> v2:172.21.15.89:3300/0 conn(0x7fb4c00f5520 0x7fb4c00f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:45.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4bf7fe700 1 --2- 172.21.15.79:0/1678447298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4c00e9ae0 0x7fb4c009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:45.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4c4bb0700 1 -- 172.21.15.79:0/1678447298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4c00e9ae0 msgr2=0x7fb4c009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:45.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4c4bb0700 1 --2- 172.21.15.79:0/1678447298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4c00e9ae0 0x7fb4c009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:45.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4c4bb0700 1 -- 172.21.15.79:0/1678447298 >> v2:172.21.15.89:3300/0 conn(0x7fb4c00f5520 msgr2=0x7fb4c00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:45.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4c4bb0700 1 --2- 172.21.15.79:0/1678447298 >> v2:172.21.15.89:3300/0 conn(0x7fb4c00f5520 0x7fb4c00f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:45.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4c4bb0700 1 -- 172.21.15.79:0/1678447298 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c00e56d0 con 0x7fb4c01c2db0 2021-04-09T18:29:45.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4bffff700 1 --2- 172.21.15.79:0/1678447298 >> v2:172.21.15.89:3300/0 conn(0x7fb4c00f5520 0x7fb4c00f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:29:45.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4c4bb0700 1 --2- 172.21.15.79:0/1678447298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c01c2db0 0x7fb4c01c3200 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fb4a8002f30 tx=0x7fb4a800bd70).ready entity=mon.0 client_cookie=e072ba1d166a5bbf server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:45.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4beffd700 1 -- 172.21.15.79:0/1678447298 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4c00e56d0 con 0x7fb4c01c2db0 2021-04-09T18:29:45.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4beffd700 1 -- 172.21.15.79:0/1678447298 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a80098b0 con 0x7fb4c01c2db0 2021-04-09T18:29:45.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4c660b700 1 -- 172.21.15.79:0/1678447298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c01c2db0 msgr2=0x7fb4c01c3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:45.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4c660b700 1 --2- 172.21.15.79:0/1678447298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c01c2db0 0x7fb4c01c3200 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fb4a8002f30 tx=0x7fb4a800bd70).stop 2021-04-09T18:29:45.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.814 7fb4beffd700 1 -- 172.21.15.79:0/1678447298 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4a8009c80 con 0x7fb4c01c2db0 2021-04-09T18:29:45.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4c660b700 1 -- 172.21.15.79:0/1678447298 shutdown_connections 2021-04-09T18:29:45.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4c660b700 1 --2- 172.21.15.79:0/1678447298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c01c2db0 0x7fb4c01c3200 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:45.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4c660b700 1 --2- 172.21.15.79:0/1678447298 >> v2:172.21.15.89:3300/0 conn(0x7fb4c00f5520 0x7fb4c00f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:45.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4c660b700 1 --2- 172.21.15.79:0/1678447298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4c00e9ae0 0x7fb4c009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:45.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4c660b700 1 -- 172.21.15.79:0/1678447298 >> 172.21.15.79:0/1678447298 conn(0x7fb4c00e5fe0 msgr2=0x7fb4c00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:45.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4c660b700 1 -- 172.21.15.79:0/1678447298 shutdown_connections 2021-04-09T18:29:45.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4c660b700 1 -- 172.21.15.79:0/1678447298 wait complete. 2021-04-09T18:29:45.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4c660b700 1 Processor -- start 2021-04-09T18:29:45.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4c660b700 1 -- start start 2021-04-09T18:29:45.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4c660b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4c00bb010 0x7fb4c00bff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:45.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4c660b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4c00a5970 0x7fb4c01b1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:45.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4c660b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c00a5dc0 0x7fb4c01b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:45.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4c660b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c019bdb0 con 0x7fb4c00a5dc0 2021-04-09T18:29:45.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4c660b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c019c0b0 con 0x7fb4c00a5970 2021-04-09T18:29:45.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4c660b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c0098c90 con 0x7fb4c00bb010 2021-04-09T18:29:45.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4c4bb0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c00a5dc0 0x7fb4c01b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:45.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4c4bb0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c00a5dc0 0x7fb4c01b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58038/0 (socket says 172.21.15.79:58038) 2021-04-09T18:29:45.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4c4bb0700 1 -- 172.21.15.79:0/173977115 learned_addr learned my addr 172.21.15.79:0/173977115 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:45.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4bffff700 1 --2- 172.21.15.79:0/173977115 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4c00bb010 0x7fb4c00bff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:45.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4bf7fe700 1 --2- 172.21.15.79:0/173977115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4c00a5970 0x7fb4c01b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:45.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.818 7fb4c4bb0700 1 -- 172.21.15.79:0/173977115 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4c00bb010 msgr2=0x7fb4c00bff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:45.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.822 7fb4c4bb0700 1 --2- 172.21.15.79:0/173977115 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4c00bb010 0x7fb4c00bff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:45.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.822 7fb4c4bb0700 1 -- 172.21.15.79:0/173977115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4c00a5970 msgr2=0x7fb4c01b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:45.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.822 7fb4c4bb0700 1 --2- 172.21.15.79:0/173977115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4c00a5970 0x7fb4c01b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:45.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.822 7fb4c4bb0700 1 -- 172.21.15.79:0/173977115 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c00bb460 con 0x7fb4c00a5dc0 2021-04-09T18:29:45.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.822 7fb4c4bb0700 1 --2- 172.21.15.79:0/173977115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c00a5dc0 0x7fb4c01b1640 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fb4a8002f30 tx=0x7fb4a8006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:45.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.822 7fb4bcff9700 1 -- 172.21.15.79:0/173977115 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4c00bb460 con 0x7fb4c00a5dc0 2021-04-09T18:29:45.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.822 7fb4bcff9700 1 -- 172.21.15.79:0/173977115 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a8009d10 con 0x7fb4c00a5dc0 2021-04-09T18:29:45.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.822 7fb4bcff9700 1 -- 172.21.15.79:0/173977115 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4a8022070 con 0x7fb4c00a5dc0 2021-04-09T18:29:45.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.822 7fb4c660b700 1 -- 172.21.15.79:0/173977115 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c01c08f0 con 0x7fb4c00a5dc0 2021-04-09T18:29:45.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.822 7fb4c660b700 1 -- 172.21.15.79:0/173977115 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c00c0550 con 0x7fb4c00a5dc0 2021-04-09T18:29:45.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.822 7fb4bcff9700 1 -- 172.21.15.79:0/173977115 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb4a8018770 con 0x7fb4c00a5dc0 2021-04-09T18:29:45.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.822 7fb4bcff9700 1 --2- 172.21.15.79:0/173977115 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb4a4029100 0x7fb4a402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:45.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.822 7fb4bcff9700 1 -- 172.21.15.79:0/173977115 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5319+0+0 (secure 0 0 0) 0x7fb4a803ba50 con 0x7fb4c00a5dc0 2021-04-09T18:29:45.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.822 7fb4bffff700 1 --2- 172.21.15.79:0/173977115 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb4a4029100 0x7fb4a402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:45.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.822 7fb4bffff700 1 --2- 172.21.15.79:0/173977115 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb4a4029100 0x7fb4a402b650 crc :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:45.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.826 7fb4c660b700 1 -- 172.21.15.79:0/173977115 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c00e39e0 con 0x7fb4c00a5dc0 2021-04-09T18:29:45.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:45.834 7fb4bcff9700 1 -- 172.21.15.79:0/173977115 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb4a80096a0 con 0x7fb4c00a5dc0 2021-04-09T18:29:46.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.014 7fb4c660b700 1 -- 172.21.15.79:0/173977115 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb4c00f5b20 con 0x7fb4c00a5dc0 2021-04-09T18:29:46.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.018 7fb4bcff9700 1 -- 172.21.15.79:0/173977115 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb4a8018370 con 0x7fb4c00a5dc0 2021-04-09T18:29:46.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.026 7fb4c660b700 1 -- 172.21.15.79:0/173977115 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb4a4029100 msgr2=0x7fb4a402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:46.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.026 7fb4c660b700 1 --2- 172.21.15.79:0/173977115 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb4a4029100 0x7fb4a402b650 crc :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.026 7fb4c660b700 1 -- 172.21.15.79:0/173977115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c00a5dc0 msgr2=0x7fb4c01b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:46.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.026 7fb4c660b700 1 --2- 172.21.15.79:0/173977115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c00a5dc0 0x7fb4c01b1640 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fb4a8002f30 tx=0x7fb4a8006890).stop 2021-04-09T18:29:46.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.026 7fb4c660b700 1 -- 172.21.15.79:0/173977115 shutdown_connections 2021-04-09T18:29:46.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.026 7fb4c660b700 1 --2- 172.21.15.79:0/173977115 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb4a4029100 0x7fb4a402b650 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.026 7fb4c660b700 1 --2- 172.21.15.79:0/173977115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c00a5dc0 0x7fb4c01b1640 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.026 7fb4c660b700 1 --2- 172.21.15.79:0/173977115 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4c00bb010 0x7fb4c00bff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.026 7fb4c660b700 1 --2- 172.21.15.79:0/173977115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4c00a5970 0x7fb4c01b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.026 7fb4c660b700 1 -- 172.21.15.79:0/173977115 >> 172.21.15.79:0/173977115 conn(0x7fb4c009a6c0 msgr2=0x7fb4c00d7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:46.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.026 7fb4c660b700 1 -- 172.21.15.79:0/173977115 shutdown_connections 2021-04-09T18:29:46.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.026 7fb4c660b700 1 -- 172.21.15.79:0/173977115 wait complete. 2021-04-09T18:29:46.091 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2021-04-09T18:29:46.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.186 7f827c2bb700 1 Processor -- start 2021-04-09T18:29:46.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.186 7f827c2bb700 1 -- start start 2021-04-09T18:29:46.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.186 7f827c2bb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f82740f5520 0x7f82740f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:46.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.186 7f827c2bb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f82741c8010 0x7f82741ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:46.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.186 7f827c2bb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82740fbb20 con 0x7f82740e9ae0 2021-04-09T18:29:46.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.186 7f827c2bb700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82740e9f30 con 0x7f82741c8010 2021-04-09T18:29:46.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.186 7f827c2bb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82741c3dc0 con 0x7f82740f5520 2021-04-09T18:29:46.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.186 7f827a860700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f82741c8010 0x7f82741ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:46.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.186 7f827a860700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f82741c8010 0x7f82741ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58048/0 (socket says 172.21.15.79:58048) 2021-04-09T18:29:46.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.186 7f827a860700 1 -- 172.21.15.79:0/3456837044 learned_addr learned my addr 172.21.15.79:0/3456837044 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:46.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.186 7f827a05f700 1 --2- 172.21.15.79:0/3456837044 >> v2:172.21.15.89:3300/0 conn(0x7f82740f5520 0x7f82740f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:46.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.190 7f827a860700 1 -- 172.21.15.79:0/3456837044 >> v2:172.21.15.89:3300/0 conn(0x7f82740f5520 msgr2=0x7f82740f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:46.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.190 7f827a860700 1 --2- 172.21.15.79:0/3456837044 >> v2:172.21.15.89:3300/0 conn(0x7f82740f5520 0x7f82740f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.190 7f827a860700 1 -- 172.21.15.79:0/3456837044 >> v1:172.21.15.89:6789/0 conn(0x7f82740e9ae0 legacy=0x7f827409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:46.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.190 7f827a860700 1 -- 172.21.15.79:0/3456837044 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827409f910 con 0x7f82741c8010 2021-04-09T18:29:46.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.190 7f827a860700 1 --2- 172.21.15.79:0/3456837044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82741c8010 0x7f82741ca470 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f826c002f30 tx=0x7f826c00bd70).ready entity=mon.0 client_cookie=8ec1ec48fffa0614 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:46.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.190 7f827905d700 1 -- 172.21.15.79:0/3456837044 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f827409f910 con 0x7f82741c8010 2021-04-09T18:29:46.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.190 7f827905d700 1 -- 172.21.15.79:0/3456837044 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c009950 con 0x7f82741c8010 2021-04-09T18:29:46.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.190 7f827905d700 1 -- 172.21.15.79:0/3456837044 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f826c009d20 con 0x7f82741c8010 2021-04-09T18:29:46.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.190 7f827c2bb700 1 -- 172.21.15.79:0/3456837044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82741c8010 msgr2=0x7f82741ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:46.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.190 7f827c2bb700 1 --2- 172.21.15.79:0/3456837044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82741c8010 0x7f82741ca470 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f826c002f30 tx=0x7f826c00bd70).stop 2021-04-09T18:29:46.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.190 7f827c2bb700 1 -- 172.21.15.79:0/3456837044 shutdown_connections 2021-04-09T18:29:46.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.190 7f827c2bb700 1 --2- 172.21.15.79:0/3456837044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82741c8010 0x7f82741ca470 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.190 7f827c2bb700 1 --2- 172.21.15.79:0/3456837044 >> v2:172.21.15.89:3300/0 conn(0x7f82740f5520 0x7f82740f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.190 7f827c2bb700 1 -- 172.21.15.79:0/3456837044 >> 172.21.15.79:0/3456837044 conn(0x7f82740e5fe0 msgr2=0x7f82740e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:46.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.190 7f827c2bb700 1 -- 172.21.15.79:0/3456837044 shutdown_connections 2021-04-09T18:29:46.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.190 7f827c2bb700 1 -- 172.21.15.79:0/3456837044 wait complete. 2021-04-09T18:29:46.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.190 7f827c2bb700 1 Processor -- start 2021-04-09T18:29:46.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827c2bb700 1 -- start start 2021-04-09T18:29:46.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827c2bb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82740b5d20 0x7f8274094710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:46.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827c2bb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82740bd170 0x7f82740a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:46.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827c2bb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82740950f0 0x7f82740cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:46.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827c2bb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82740e8af0 con 0x7f82740950f0 2021-04-09T18:29:46.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827c2bb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82740bbbf0 con 0x7f82740b5d20 2021-04-09T18:29:46.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827c2bb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8274095540 con 0x7f82740bd170 2021-04-09T18:29:46.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827a860700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82740950f0 0x7f82740cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:46.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827a860700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82740950f0 0x7f82740cfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58052/0 (socket says 172.21.15.79:58052) 2021-04-09T18:29:46.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827a860700 1 -- 172.21.15.79:0/2401120801 learned_addr learned my addr 172.21.15.79:0/2401120801 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:46.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827a05f700 1 --2- 172.21.15.79:0/2401120801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82740b5d20 0x7f8274094710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:46.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827985e700 1 --2- 172.21.15.79:0/2401120801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82740bd170 0x7f82740a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:46.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827a860700 1 -- 172.21.15.79:0/2401120801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82740bd170 msgr2=0x7f82740a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:46.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827a860700 1 --2- 172.21.15.79:0/2401120801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82740bd170 0x7f82740a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827a860700 1 -- 172.21.15.79:0/2401120801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82740b5d20 msgr2=0x7f8274094710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:46.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827a860700 1 --2- 172.21.15.79:0/2401120801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82740b5d20 0x7f8274094710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827a860700 1 -- 172.21.15.79:0/2401120801 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82740a51f0 con 0x7f82740950f0 2021-04-09T18:29:46.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827a860700 1 --2- 172.21.15.79:0/2401120801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82740950f0 0x7f82740cfd20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f82740d0960 tx=0x7f826c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:46.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f826affd700 1 -- 172.21.15.79:0/2401120801 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f82740a51f0 con 0x7f82740950f0 2021-04-09T18:29:46.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f826affd700 1 -- 172.21.15.79:0/2401120801 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c0119c0 con 0x7f82740950f0 2021-04-09T18:29:46.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f826affd700 1 -- 172.21.15.79:0/2401120801 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f826c011d90 con 0x7f82740950f0 2021-04-09T18:29:46.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827c2bb700 1 -- 172.21.15.79:0/2401120801 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82740a4d00 con 0x7f82740950f0 2021-04-09T18:29:46.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827c2bb700 1 -- 172.21.15.79:0/2401120801 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82740d0350 con 0x7f82740950f0 2021-04-09T18:29:46.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f826affd700 1 -- 172.21.15.79:0/2401120801 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f826c0263b0 con 0x7f82740950f0 2021-04-09T18:29:46.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f826affd700 1 --2- 172.21.15.79:0/2401120801 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f825c029100 0x7f825c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:46.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f826affd700 1 -- 172.21.15.79:0/2401120801 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5319+0+0 (secure 0 0 0) 0x7f826c03acc0 con 0x7f82740950f0 2021-04-09T18:29:46.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.194 7f827a05f700 1 --2- 172.21.15.79:0/2401120801 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f825c029100 0x7f825c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:46.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.198 7f827a05f700 1 --2- 172.21.15.79:0/2401120801 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f825c029100 0x7f825c02b650 crc :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:46.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.198 7f827c2bb700 1 -- 172.21.15.79:0/2401120801 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82740e39e0 con 0x7f82740950f0 2021-04-09T18:29:46.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.206 7f826affd700 1 -- 172.21.15.79:0/2401120801 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f826c0117b0 con 0x7f82740950f0 2021-04-09T18:29:46.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.366 7f827c2bb700 1 -- 172.21.15.79:0/2401120801 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f82740f5b20 con 0x7f82740950f0 2021-04-09T18:29:46.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.670 7f826affd700 1 -- 172.21.15.79:0/2401120801 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v105) v1 ==== 144+0+0 (secure 0 0 0) 0x7f826c009740 con 0x7f82740950f0 2021-04-09T18:29:46.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.686 7f827c2bb700 1 -- 172.21.15.79:0/2401120801 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f825c029100 msgr2=0x7f825c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:46.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.686 7f827c2bb700 1 --2- 172.21.15.79:0/2401120801 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f825c029100 0x7f825c02b650 crc :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.686 7f827c2bb700 1 -- 172.21.15.79:0/2401120801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82740950f0 msgr2=0x7f82740cfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:46.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.686 7f827c2bb700 1 --2- 172.21.15.79:0/2401120801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82740950f0 0x7f82740cfd20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f82740d0960 tx=0x7f826c006890).stop 2021-04-09T18:29:46.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.686 7f827c2bb700 1 -- 172.21.15.79:0/2401120801 shutdown_connections 2021-04-09T18:29:46.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.686 7f827c2bb700 1 --2- 172.21.15.79:0/2401120801 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f825c029100 0x7f825c02b650 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.686 7f827c2bb700 1 --2- 172.21.15.79:0/2401120801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82740b5d20 0x7f8274094710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.686 7f827c2bb700 1 --2- 172.21.15.79:0/2401120801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82740950f0 0x7f82740cfd20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.686 7f827c2bb700 1 --2- 172.21.15.79:0/2401120801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82740bd170 0x7f82740a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.686 7f827c2bb700 1 -- 172.21.15.79:0/2401120801 >> 172.21.15.79:0/2401120801 conn(0x7f82740935e0 msgr2=0x7f82740d78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:46.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.686 7f827c2bb700 1 -- 172.21.15.79:0/2401120801 shutdown_connections 2021-04-09T18:29:46.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.686 7f827c2bb700 1 -- 172.21.15.79:0/2401120801 wait complete. 2021-04-09T18:29:46.700 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-04-09T18:29:46.701 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2021-04-09T18:29:46.701 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2021-04-09T18:29:46.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.794 7f7c10239700 1 Processor -- start 2021-04-09T18:29:46.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.794 7f7c10239700 1 -- start start 2021-04-09T18:29:46.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c10239700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7c080f5510 0x7f7c080f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:46.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c10239700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c081c8000 0x7f7c081ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:46.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c10239700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c080fbb10 con 0x7f7c080e9ad0 2021-04-09T18:29:46.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c10239700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c080e9f20 con 0x7f7c080f5510 2021-04-09T18:29:46.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c10239700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c081c3db0 con 0x7f7c081c8000 2021-04-09T18:29:46.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c0d7dc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7c080e9ad0 0x7f7c0809f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52770/0 (socket says 172.21.15.79:52770) 2021-04-09T18:29:46.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c0dfdd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7c080f5510 0x7f7c080f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:46.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c0d7dc700 1 -- 172.21.15.79:0/4209308484 learned_addr learned my addr 172.21.15.79:0/4209308484 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:46.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c0e7de700 1 --2- 172.21.15.79:0/4209308484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c081c8000 0x7f7c081ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:46.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c0dfdd700 1 -- 172.21.15.79:0/4209308484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c081c8000 msgr2=0x7f7c081ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:46.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c0dfdd700 1 --2- 172.21.15.79:0/4209308484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c081c8000 0x7f7c081ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c0dfdd700 1 -- 172.21.15.79:0/4209308484 >> v1:172.21.15.79:6789/0 conn(0x7f7c080e9ad0 legacy=0x7f7c0809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:46.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c0dfdd700 1 -- 172.21.15.79:0/4209308484 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0809f900 con 0x7f7c080f5510 2021-04-09T18:29:46.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c0e7de700 1 --2- 172.21.15.79:0/4209308484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c081c8000 0x7f7c081ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:29:46.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c0dfdd700 1 --2- 172.21.15.79:0/4209308484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c080f5510 0x7f7c080f64a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f7c080f6ef0 tx=0x7f7c0400bd70).ready entity=mon.0 client_cookie=db593b4f912844f7 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:46.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c0cfdb700 1 -- 172.21.15.79:0/4209308484 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c0809f900 con 0x7f7c080f5510 2021-04-09T18:29:46.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c0cfdb700 1 -- 172.21.15.79:0/4209308484 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c04009810 con 0x7f7c080f5510 2021-04-09T18:29:46.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c0cfdb700 1 -- 172.21.15.79:0/4209308484 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c04009be0 con 0x7f7c080f5510 2021-04-09T18:29:46.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c10239700 1 -- 172.21.15.79:0/4209308484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c080f5510 msgr2=0x7f7c080f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:46.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c10239700 1 --2- 172.21.15.79:0/4209308484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c080f5510 0x7f7c080f64a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f7c080f6ef0 tx=0x7f7c0400bd70).stop 2021-04-09T18:29:46.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c10239700 1 -- 172.21.15.79:0/4209308484 shutdown_connections 2021-04-09T18:29:46.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c10239700 1 --2- 172.21.15.79:0/4209308484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c080f5510 0x7f7c080f64a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c10239700 1 --2- 172.21.15.79:0/4209308484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c081c8000 0x7f7c081ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c10239700 1 -- 172.21.15.79:0/4209308484 >> 172.21.15.79:0/4209308484 conn(0x7f7c080e5fd0 msgr2=0x7f7c080e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:46.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c10239700 1 -- 172.21.15.79:0/4209308484 shutdown_connections 2021-04-09T18:29:46.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.798 7f7c10239700 1 -- 172.21.15.79:0/4209308484 wait complete. 2021-04-09T18:29:46.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.802 7f7c10239700 1 Processor -- start 2021-04-09T18:29:46.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.802 7f7c10239700 1 -- start start 2021-04-09T18:29:46.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.802 7f7c10239700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c080967b0 0x7f7c080979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:46.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.802 7f7c10239700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c080c0310 0x7f7c080d51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:46.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.802 7f7c10239700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c080c0760 0x7f7c080a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:46.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.802 7f7c10239700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c080b9490 con 0x7f7c080967b0 2021-04-09T18:29:46.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.802 7f7c10239700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c080bac70 con 0x7f7c080c0310 2021-04-09T18:29:46.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.802 7f7c10239700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c080baea0 con 0x7f7c080c0760 2021-04-09T18:29:46.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.802 7f7c0dfdd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c080967b0 0x7f7c080979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:46.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.806 7f7c0dfdd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c080967b0 0x7f7c080979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58066/0 (socket says 172.21.15.79:58066) 2021-04-09T18:29:46.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.806 7f7c0dfdd700 1 -- 172.21.15.79:0/4256032591 learned_addr learned my addr 172.21.15.79:0/4256032591 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:46.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.806 7f7c0d7dc700 1 --2- 172.21.15.79:0/4256032591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c080c0310 0x7f7c080d51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:46.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.806 7f7c0e7de700 1 --2- 172.21.15.79:0/4256032591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c080c0760 0x7f7c080a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:46.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.806 7f7c0dfdd700 1 -- 172.21.15.79:0/4256032591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c080c0760 msgr2=0x7f7c080a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:46.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.806 7f7c0dfdd700 1 --2- 172.21.15.79:0/4256032591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c080c0760 0x7f7c080a9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.806 7f7c0dfdd700 1 -- 172.21.15.79:0/4256032591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c080c0310 msgr2=0x7f7c080d51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:46.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.806 7f7c0dfdd700 1 --2- 172.21.15.79:0/4256032591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c080c0310 0x7f7c080d51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.806 7f7c0dfdd700 1 -- 172.21.15.79:0/4256032591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c080d57d0 con 0x7f7c080967b0 2021-04-09T18:29:46.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.806 7f7c0dfdd700 1 --2- 172.21.15.79:0/4256032591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c080967b0 0x7f7c080979c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f7c080d6830 tx=0x7f7c04006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:46.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.806 7f7bfe7fc700 1 -- 172.21.15.79:0/4256032591 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c080d57d0 con 0x7f7c080967b0 2021-04-09T18:29:46.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.806 7f7bfe7fc700 1 -- 172.21.15.79:0/4256032591 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0401d450 con 0x7f7c080967b0 2021-04-09T18:29:46.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.806 7f7c10239700 1 -- 172.21.15.79:0/4256032591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c080aa3d0 con 0x7f7c080967b0 2021-04-09T18:29:46.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.806 7f7bfe7fc700 1 -- 172.21.15.79:0/4256032591 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c04022020 con 0x7f7c080967b0 2021-04-09T18:29:46.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.806 7f7c10239700 1 -- 172.21.15.79:0/4256032591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c080b8030 con 0x7f7c080967b0 2021-04-09T18:29:46.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.806 7f7bfe7fc700 1 -- 172.21.15.79:0/4256032591 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7c0401d820 con 0x7f7c080967b0 2021-04-09T18:29:46.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.806 7f7bfe7fc700 1 --2- 172.21.15.79:0/4256032591 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7bf0029100 0x7f7bf002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:46.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.806 7f7bfe7fc700 1 -- 172.21.15.79:0/4256032591 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5319+0+0 (secure 0 0 0) 0x7f7c0403c290 con 0x7f7c080967b0 2021-04-09T18:29:46.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.806 7f7c0d7dc700 1 --2- 172.21.15.79:0/4256032591 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7bf0029100 0x7f7bf002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:46.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.810 7f7c0d7dc700 1 --2- 172.21.15.79:0/4256032591 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7bf0029100 0x7f7bf002b650 crc :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:46.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.810 7f7c10239700 1 -- 172.21.15.79:0/4256032591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c080e39d0 con 0x7f7c080967b0 2021-04-09T18:29:46.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.818 7f7bfe7fc700 1 -- 172.21.15.79:0/4256032591 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7c04009600 con 0x7f7c080967b0 2021-04-09T18:29:46.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:46.986 7f7c10239700 1 -- 172.21.15.79:0/4256032591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7f7c080f5b10 con 0x7f7c080967b0 2021-04-09T18:29:47.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.670 7f7bfe7fc700 1 -- 172.21.15.79:0/4256032591 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v106) v1 ==== 155+0+0 (secure 0 0 0) 0x7f7c04011df0 con 0x7f7c080967b0 2021-04-09T18:29:47.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.706 7f7c10239700 1 -- 172.21.15.79:0/4256032591 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7bf0029100 msgr2=0x7f7bf002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:47.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.706 7f7c10239700 1 --2- 172.21.15.79:0/4256032591 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7bf0029100 0x7f7bf002b650 crc :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:47.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.706 7f7c10239700 1 -- 172.21.15.79:0/4256032591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c080967b0 msgr2=0x7f7c080979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:47.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.706 7f7c10239700 1 --2- 172.21.15.79:0/4256032591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c080967b0 0x7f7c080979c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f7c080d6830 tx=0x7f7c04006890).stop 2021-04-09T18:29:47.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.706 7f7c10239700 1 -- 172.21.15.79:0/4256032591 shutdown_connections 2021-04-09T18:29:47.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.706 7f7c10239700 1 --2- 172.21.15.79:0/4256032591 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7bf0029100 0x7f7bf002b650 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:47.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.706 7f7c10239700 1 --2- 172.21.15.79:0/4256032591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c080c0760 0x7f7c080a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:47.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.706 7f7c10239700 1 --2- 172.21.15.79:0/4256032591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c080967b0 0x7f7c080979c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:47.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.706 7f7c10239700 1 --2- 172.21.15.79:0/4256032591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c080c0310 0x7f7c080d51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:47.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.706 7f7c10239700 1 -- 172.21.15.79:0/4256032591 >> 172.21.15.79:0/4256032591 conn(0x7f7c0809ad00 msgr2=0x7f7c0809a110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:47.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.706 7f7c10239700 1 -- 172.21.15.79:0/4256032591 shutdown_connections 2021-04-09T18:29:47.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.706 7f7c10239700 1 -- 172.21.15.79:0/4256032591 wait complete. 2021-04-09T18:29:47.724 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-04-09T18:29:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.818 7f7476b4b700 1 Processor -- start 2021-04-09T18:29:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.818 7f7476b4b700 1 -- start start 2021-04-09T18:29:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f7476b4b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74700f5550 0x7f74700f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f7476b4b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74700fbb50 con 0x7f74700e9b10 2021-04-09T18:29:47.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f7476b4b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747009f910 con 0x7f74701c8040 2021-04-09T18:29:47.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f7476b4b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74700e9f60 con 0x7f74700f5550 2021-04-09T18:29:47.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f746ffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f74700e9b10 0x7f747009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52784/0 (socket says 172.21.15.79:52784) 2021-04-09T18:29:47.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f746ffff700 1 -- 172.21.15.79:0/2102077274 learned_addr learned my addr 172.21.15.79:0/2102077274 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:47.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f74748ef700 1 --2- 172.21.15.79:0/2102077274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74700f5550 0x7f74700f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:47.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f746f7fe700 1 -- 172.21.15.79:0/2102077274 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363684572 0 0) 0x7f74580010d0 con 0x7f74700e9b10 2021-04-09T18:29:47.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f746f7fe700 1 -- 172.21.15.79:0/2102077274 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f745c003240 con 0x7f74700e9b10 2021-04-09T18:29:47.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f746f7fe700 1 -- 172.21.15.79:0/2102077274 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606642185 0 0) 0x7f74680010d0 con 0x7f74701c8040 2021-04-09T18:29:47.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f746f7fe700 1 -- 172.21.15.79:0/2102077274 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f745c004680 con 0x7f74701c8040 2021-04-09T18:29:47.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f74748ef700 1 -- 172.21.15.79:0/2102077274 >> v1:172.21.15.89:6789/0 conn(0x7f74701c8040 legacy=0x7f74701ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:47.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f74748ef700 1 -- 172.21.15.79:0/2102077274 >> v1:172.21.15.79:6789/0 conn(0x7f74700e9b10 legacy=0x7f747009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:47.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f74748ef700 1 -- 172.21.15.79:0/2102077274 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74700e5700 con 0x7f74700f5550 2021-04-09T18:29:47.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f74748ef700 1 --2- 172.21.15.79:0/2102077274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74700f5550 0x7f74700f64e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f74600032b0 tx=0x7f746000b0e0).ready entity=mon.2 client_cookie=bb354a87628daee3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f746f7fe700 1 -- 172.21.15.79:0/2102077274 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f74700e5700 con 0x7f74700f5550 2021-04-09T18:29:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f746f7fe700 1 -- 172.21.15.79:0/2102077274 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746000baf0 con 0x7f74700f5550 2021-04-09T18:29:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f746f7fe700 1 -- 172.21.15.79:0/2102077274 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7460002020 con 0x7f74700f5550 2021-04-09T18:29:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f7476b4b700 1 -- 172.21.15.79:0/2102077274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74700f5550 msgr2=0x7f74700f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f7476b4b700 1 --2- 172.21.15.79:0/2102077274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74700f5550 0x7f74700f64e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f74600032b0 tx=0x7f746000b0e0).stop 2021-04-09T18:29:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f7476b4b700 1 -- 172.21.15.79:0/2102077274 shutdown_connections 2021-04-09T18:29:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f7476b4b700 1 --2- 172.21.15.79:0/2102077274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74700f5550 0x7f74700f64e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f7476b4b700 1 -- 172.21.15.79:0/2102077274 >> 172.21.15.79:0/2102077274 conn(0x7f74700e6010 msgr2=0x7f74700e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f7476b4b700 1 -- 172.21.15.79:0/2102077274 shutdown_connections 2021-04-09T18:29:47.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.822 7f7476b4b700 1 -- 172.21.15.79:0/2102077274 wait complete. 2021-04-09T18:29:47.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f7476b4b700 1 Processor -- start 2021-04-09T18:29:47.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f7476b4b700 1 -- start start 2021-04-09T18:29:47.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f7476b4b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74700cfeb0 0x7f74700ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:47.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f7476b4b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74700ced80 0x7f7470093cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:47.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f7476b4b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74700917f0 0x7f7470099860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:47.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f7476b4b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74701c3df0 con 0x7f74700cfeb0 2021-04-09T18:29:47.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f7476b4b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74700d5080 con 0x7f74700917f0 2021-04-09T18:29:47.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f7476b4b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74700d5380 con 0x7f74700ced80 2021-04-09T18:29:47.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f74748ef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74700cfeb0 0x7f74700ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:47.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f74748ef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74700cfeb0 0x7f74700ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58080/0 (socket says 172.21.15.79:58080) 2021-04-09T18:29:47.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f74748ef700 1 -- 172.21.15.79:0/3506435311 learned_addr learned my addr 172.21.15.79:0/3506435311 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:47.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f746ffff700 1 --2- 172.21.15.79:0/3506435311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74700ced80 0x7f7470093cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:47.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f74750f0700 1 --2- 172.21.15.79:0/3506435311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74700917f0 0x7f7470099860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:47.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f74748ef700 1 -- 172.21.15.79:0/3506435311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74700ced80 msgr2=0x7f7470093cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:47.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f74748ef700 1 --2- 172.21.15.79:0/3506435311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74700ced80 0x7f7470093cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:47.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f74748ef700 1 -- 172.21.15.79:0/3506435311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74700917f0 msgr2=0x7f7470099860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:47.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f74748ef700 1 --2- 172.21.15.79:0/3506435311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74700917f0 0x7f7470099860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:47.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f74748ef700 1 -- 172.21.15.79:0/3506435311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74700d4cb0 con 0x7f74700cfeb0 2021-04-09T18:29:47.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f74748ef700 1 --2- 172.21.15.79:0/3506435311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74700cfeb0 0x7f74700ce750 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f74700d5000 tx=0x7f7460006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:47.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f746d7fa700 1 -- 172.21.15.79:0/3506435311 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f74700d4cb0 con 0x7f74700cfeb0 2021-04-09T18:29:47.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f746d7fa700 1 -- 172.21.15.79:0/3506435311 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746001f020 con 0x7f74700cfeb0 2021-04-09T18:29:47.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f7476b4b700 1 -- 172.21.15.79:0/3506435311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747009a8e0 con 0x7f74700cfeb0 2021-04-09T18:29:47.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.826 7f746d7fa700 1 -- 172.21.15.79:0/3506435311 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f746001b620 con 0x7f74700cfeb0 2021-04-09T18:29:47.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.830 7f7476b4b700 1 -- 172.21.15.79:0/3506435311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7470094a20 con 0x7f74700cfeb0 2021-04-09T18:29:47.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.830 7f746d7fa700 1 -- 172.21.15.79:0/3506435311 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f746001b820 con 0x7f74700cfeb0 2021-04-09T18:29:47.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.830 7f746d7fa700 1 --2- 172.21.15.79:0/3506435311 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7454029100 0x7f745402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:47.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.830 7f746d7fa700 1 -- 172.21.15.79:0/3506435311 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5319+0+0 (secure 0 0 0) 0x7f7460003020 con 0x7f74700cfeb0 2021-04-09T18:29:47.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.830 7f746ffff700 1 --2- 172.21.15.79:0/3506435311 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7454029100 0x7f745402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:47.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.830 7f746ffff700 1 --2- 172.21.15.79:0/3506435311 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7454029100 0x7f745402b650 crc :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:47.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.834 7f7476b4b700 1 -- 172.21.15.79:0/3506435311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74700e39f0 con 0x7f74700cfeb0 2021-04-09T18:29:47.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:47.838 7f746d7fa700 1 -- 172.21.15.79:0/3506435311 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f746000b8e0 con 0x7f74700cfeb0 2021-04-09T18:29:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.026 7f7476b4b700 1 -- 172.21.15.79:0/3506435311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f74700a1c90 con 0x7f74700cfeb0 2021-04-09T18:29:48.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.030 7f746d7fa700 1 -- 172.21.15.79:0/3506435311 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7460011cc0 con 0x7f74700cfeb0 2021-04-09T18:29:48.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.034 7f7476b4b700 1 -- 172.21.15.79:0/3506435311 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7454029100 msgr2=0x7f745402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:48.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.034 7f7476b4b700 1 --2- 172.21.15.79:0/3506435311 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7454029100 0x7f745402b650 crc :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.034 7f7476b4b700 1 -- 172.21.15.79:0/3506435311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74700cfeb0 msgr2=0x7f74700ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:48.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.034 7f7476b4b700 1 --2- 172.21.15.79:0/3506435311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74700cfeb0 0x7f74700ce750 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f74700d5000 tx=0x7f7460006c10).stop 2021-04-09T18:29:48.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.034 7f7476b4b700 1 -- 172.21.15.79:0/3506435311 shutdown_connections 2021-04-09T18:29:48.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.034 7f7476b4b700 1 --2- 172.21.15.79:0/3506435311 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7454029100 0x7f745402b650 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.034 7f7476b4b700 1 --2- 172.21.15.79:0/3506435311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74700917f0 0x7f7470099860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.034 7f7476b4b700 1 --2- 172.21.15.79:0/3506435311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74700cfeb0 0x7f74700ce750 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.034 7f7476b4b700 1 --2- 172.21.15.79:0/3506435311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74700ced80 0x7f7470093cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.034 7f7476b4b700 1 -- 172.21.15.79:0/3506435311 >> 172.21.15.79:0/3506435311 conn(0x7f7470099170 msgr2=0x7f747008e470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:48.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.034 7f7476b4b700 1 -- 172.21.15.79:0/3506435311 shutdown_connections 2021-04-09T18:29:48.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.034 7f7476b4b700 1 -- 172.21.15.79:0/3506435311 wait complete. 2021-04-09T18:29:48.047 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:29:48.047 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:29:48.065 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:29:48.084 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:29:48.103 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:29:48.121 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:29:48.137 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:29:48.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:48.138 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:29:48.139 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:29:48.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:29:48.153 INFO:teuthology.orchestra.run.smithi090.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-04-09T18:29:48.153 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-04-09T18:29:48.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:48.154 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:29:48.155 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:29:48.171 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-04-09T18:29:48.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:29:48.172 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-04-09T18:29:48.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:48.173 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:29:48.174 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:29:48.184 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:29:48.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:29:48.185 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:29:48.186 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:29:48.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.282 7fadd0aea700 1 Processor -- start 2021-04-09T18:29:48.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.282 7fadd0aea700 1 -- start start 2021-04-09T18:29:48.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.282 7fadd0aea700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadcc0e9ae0 0x7fadcc09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:48.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.282 7fadd0aea700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadcc0fbb20 con 0x7fadcc0f5520 2021-04-09T18:29:48.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.282 7fadd0aea700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadcc0e56d0 con 0x7fadcc1c8010 2021-04-09T18:29:48.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.282 7fadd0aea700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc1c3dc0 con 0x7fadcc0e9ae0 2021-04-09T18:29:48.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.282 7fadca7e6700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fadcc0f5520 0x7fadcc0f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52798/0 (socket says 172.21.15.79:52798) 2021-04-09T18:29:48.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.282 7fadca7e6700 1 -- 172.21.15.79:0/961431295 learned_addr learned my addr 172.21.15.79:0/961431295 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:48.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.282 7fadc1fe5700 1 --2- 172.21.15.79:0/961431295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadcc0e9ae0 0x7fadcc09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:48.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.282 7fadc9fe5700 1 -- 172.21.15.79:0/961431295 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2869934594 0 0) 0x7fadbc0010d0 con 0x7fadcc0f5520 2021-04-09T18:29:48.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.282 7fadc9fe5700 1 -- 172.21.15.79:0/961431295 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadb8003240 con 0x7fadcc0f5520 2021-04-09T18:29:48.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.282 7fadc9fe5700 1 -- 172.21.15.79:0/961431295 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389314177 0 0) 0x7fadc4001450 con 0x7fadcc1c8010 2021-04-09T18:29:48.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.282 7fadc9fe5700 1 -- 172.21.15.79:0/961431295 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadb8003620 con 0x7fadcc1c8010 2021-04-09T18:29:48.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.282 7fadc1fe5700 1 -- 172.21.15.79:0/961431295 >> v1:172.21.15.89:6789/0 conn(0x7fadcc1c8010 legacy=0x7fadcc1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:48.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.282 7fadc1fe5700 1 -- 172.21.15.79:0/961431295 >> v1:172.21.15.79:6789/0 conn(0x7fadcc0f5520 legacy=0x7fadcc0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:48.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.282 7fadc1fe5700 1 -- 172.21.15.79:0/961431295 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc0e4330 con 0x7fadcc0e9ae0 2021-04-09T18:29:48.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.282 7fadc1fe5700 1 --2- 172.21.15.79:0/961431295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadcc0e9ae0 0x7fadcc09f110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fadb4002f30 tx=0x7fadb400bcf0).ready entity=mon.2 client_cookie=5f6935376aa63102 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:48.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.286 7fadc9fe5700 1 -- 172.21.15.79:0/961431295 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fadcc0e4330 con 0x7fadcc0e9ae0 2021-04-09T18:29:48.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.286 7fadc9fe5700 1 -- 172.21.15.79:0/961431295 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb4009920 con 0x7fadcc0e9ae0 2021-04-09T18:29:48.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.286 7fadc9fe5700 1 -- 172.21.15.79:0/961431295 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fadb4009cf0 con 0x7fadcc0e9ae0 2021-04-09T18:29:48.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.286 7fadd0aea700 1 -- 172.21.15.79:0/961431295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadcc0e9ae0 msgr2=0x7fadcc09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:48.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.286 7fadd0aea700 1 --2- 172.21.15.79:0/961431295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadcc0e9ae0 0x7fadcc09f110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fadb4002f30 tx=0x7fadb400bcf0).stop 2021-04-09T18:29:48.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.286 7fadd0aea700 1 -- 172.21.15.79:0/961431295 shutdown_connections 2021-04-09T18:29:48.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.286 7fadd0aea700 1 --2- 172.21.15.79:0/961431295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadcc0e9ae0 0x7fadcc09f110 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.286 7fadd0aea700 1 -- 172.21.15.79:0/961431295 >> 172.21.15.79:0/961431295 conn(0x7fadcc0e5fe0 msgr2=0x7fadcc0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:48.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.286 7fadd0aea700 1 -- 172.21.15.79:0/961431295 shutdown_connections 2021-04-09T18:29:48.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.286 7fadd0aea700 1 -- 172.21.15.79:0/961431295 wait complete. 2021-04-09T18:29:48.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.290 7fadd0aea700 1 Processor -- start 2021-04-09T18:29:48.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.290 7fadd0aea700 1 -- start start 2021-04-09T18:29:48.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.290 7fadd0aea700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadcc099860 0x7fadcc091650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:48.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.290 7fadd0aea700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadcc0983f0 0x7fadcc0cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:48.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.290 7fadd0aea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadcc0ce5e0 0x7fadcc0cea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:48.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.290 7fadd0aea700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc0e9f30 con 0x7fadcc0ce5e0 2021-04-09T18:29:48.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.290 7fadd0aea700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc09a7b0 con 0x7fadcc0983f0 2021-04-09T18:29:48.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.290 7fadd0aea700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc099cb0 con 0x7fadcc099860 2021-04-09T18:29:48.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.290 7fadcafe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadcc0ce5e0 0x7fadcc0cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:48.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.290 7fadcafe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadcc0ce5e0 0x7fadcc0cea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58096/0 (socket says 172.21.15.79:58096) 2021-04-09T18:29:48.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.290 7fadcafe7700 1 -- 172.21.15.79:0/295549119 learned_addr learned my addr 172.21.15.79:0/295549119 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:48.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.290 7fadca7e6700 1 --2- 172.21.15.79:0/295549119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadcc099860 0x7fadcc091650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:48.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.290 7fadc1fe5700 1 --2- 172.21.15.79:0/295549119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadcc0983f0 0x7fadcc0cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:48.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.294 7fadcafe7700 1 -- 172.21.15.79:0/295549119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadcc099860 msgr2=0x7fadcc091650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:48.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.294 7fadcafe7700 1 --2- 172.21.15.79:0/295549119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadcc099860 0x7fadcc091650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.294 7fadcafe7700 1 -- 172.21.15.79:0/295549119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadcc0983f0 msgr2=0x7fadcc0cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:48.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.294 7fadcafe7700 1 --2- 172.21.15.79:0/295549119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadcc0983f0 0x7fadcc0cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.294 7fadcafe7700 1 -- 172.21.15.79:0/295549119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc09a040 con 0x7fadcc0ce5e0 2021-04-09T18:29:48.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.294 7fadcafe7700 1 --2- 172.21.15.79:0/295549119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadcc0ce5e0 0x7fadcc0cea30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fadc4001210 tx=0x7fadc400ce30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:48.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.294 7fadc37fe700 1 -- 172.21.15.79:0/295549119 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fadcc09a040 con 0x7fadcc0ce5e0 2021-04-09T18:29:48.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.294 7fadc37fe700 1 -- 172.21.15.79:0/295549119 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc400a690 con 0x7fadcc0ce5e0 2021-04-09T18:29:48.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.294 7fadc37fe700 1 -- 172.21.15.79:0/295549119 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fadc400a870 con 0x7fadcc0ce5e0 2021-04-09T18:29:48.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.294 7fadd0aea700 1 -- 172.21.15.79:0/295549119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadcc0cfd20 con 0x7fadcc0ce5e0 2021-04-09T18:29:48.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.294 7fadd0aea700 1 -- 172.21.15.79:0/295549119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadcc098840 con 0x7fadcc0ce5e0 2021-04-09T18:29:48.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.294 7fadc37fe700 1 -- 172.21.15.79:0/295549119 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fadc4019020 con 0x7fadcc0ce5e0 2021-04-09T18:29:48.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.294 7fadc37fe700 1 --2- 172.21.15.79:0/295549119 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fadb0029100 0x7fadb002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:48.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.294 7fadc37fe700 1 -- 172.21.15.79:0/295549119 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5319+0+0 (secure 0 0 0) 0x7fadc4003020 con 0x7fadcc0ce5e0 2021-04-09T18:29:48.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.294 7fadca7e6700 1 --2- 172.21.15.79:0/295549119 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fadb0029100 0x7fadb002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:48.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.294 7fadca7e6700 1 --2- 172.21.15.79:0/295549119 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fadb0029100 0x7fadb002b650 crc :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:48.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.310 7fadd0aea700 1 -- 172.21.15.79:0/295549119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadcc0e39e0 con 0x7fadcc0ce5e0 2021-04-09T18:29:48.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.318 7fadc37fe700 1 -- 172.21.15.79:0/295549119 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fadc400a480 con 0x7fadcc0ce5e0 2021-04-09T18:29:48.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.478 7fadd0aea700 1 -- 172.21.15.79:0/295549119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fadcc0a1cc0 con 0x7fadcc0ce5e0 2021-04-09T18:29:48.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.478 7fadc37fe700 1 -- 172.21.15.79:0/295549119 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v44) v1 ==== 81+0+26138 (secure 0 0 0) 0x7fadc4000f70 con 0x7fadcc0ce5e0 2021-04-09T18:29:48.483 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:29:48.484 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:29:48.484 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 44, 2021-04-09T18:29:48.484 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:29:48.484 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:29:48.485 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:29:45.653686", 2021-04-09T18:29:48.485 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:29:48.485 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:29:48.485 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:29:48.485 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:29:48.486 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:29:48.486 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:29:48.486 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:29:48.486 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:29:48.487 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:29:48.487 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:29:48.487 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:29:48.487 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:29:48.488 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:29:48.488 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:29:48.488 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:29:48.489 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 7, 2021-04-09T18:29:48.489 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:29:48.489 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:29:48.489 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:29:48.490 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:29:48.490 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:29:48.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.490 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:29:48.490 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:29:48.491 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:29:48.491 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:29:48.491 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:29:48.491 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:29:48.492 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:29:48.492 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:29:48.492 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:29:48.492 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:29:48.492 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:29:48.493 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:29:48.493 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:29:48.493 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:29:48.493 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:29:48.493 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:29:48.494 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:29:48.494 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:29:48.494 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:29:48.494 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:29:48.494 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:29:48.495 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:29:48.495 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:29:48.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.495 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:29:48.495 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:29:48.496 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:29:48.496 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:29:48.496 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:29:48.496 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:29:48.497 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:29:48.497 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:29:48.497 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:29:48.497 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:29:48.497 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:29:48.498 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:29:48.498 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:29:48.498 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:29:48.499 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:29:48.499 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:29:48.499 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:29:48.500 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:29:48.500 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:29:48.501 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:29:48.501 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:29:48.501 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:29:48.501 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:29:48.502 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:29:48.502 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:29:48.502 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:29:48.502 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:29:48.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.503 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:29:48.503 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:29:48.503 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:29:48.504 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:29:48.504 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:29:48.504 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:29:48.504 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:29:48.504 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:29:48.505 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:29:48.505 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:29:48.505 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:29:48.505 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:29:48.505 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:29:48.506 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:29:48.506 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.506 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.506 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:29:48.507 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:29:48.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.507 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:29:48.507 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:29:48.507 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:29:48.508 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:29:48.508 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:29:48.508 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:29:48.508 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:29:48.509 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:29:48.509 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:29:48.509 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 37, 2021-04-09T18:29:48.510 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:29:48.510 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:29:48.510 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:29:48.511 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.511 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.511 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:29:48.511 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:29:48.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.512 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.512 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:29:48.512 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:29:48.513 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.513 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.513 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:29:48.514 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.514 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.514 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:29:48.515 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:29:48.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.516 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.516 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:29:48.516 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:29:48.516 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.516 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.517 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:29:48.517 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.518 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.518 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:29:48.518 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:29:48.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.519 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.520 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:29:48.520 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:29:48.520 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.520 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.521 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:29:48.521 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.522 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.522 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:29:48.522 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:29:48.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.523 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.523 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:29:48.523 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:29:48.523 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.524 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.524 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:29:48.524 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:29:48.524 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:29:48.525 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:29:48.525 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:29:48.525 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:29:48.525 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:29:48.526 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.526 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:29:48.526 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:29:48.527 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:29:48.527 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:29:48.527 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:29:48.527 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:29:48.527 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:29:48.528 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:29:48.528 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:29:48.528 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 36, 2021-04-09T18:29:48.528 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:29:48.529 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:29:48.529 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:29:48.529 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.529 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.530 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:29:48.530 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:29:48.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.531 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.532 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:29:48.532 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:29:48.532 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.532 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.533 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:29:48.533 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.534 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.534 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:29:48.534 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:29:48.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.535 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.535 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:29:48.535 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:29:48.535 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.535 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.536 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:29:48.536 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.537 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.537 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:29:48.537 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:29:48.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.538 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.538 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:29:48.538 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:29:48.538 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.539 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.539 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:29:48.539 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.540 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.540 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:29:48.540 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:29:48.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.541 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.541 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:29:48.542 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:29:48.542 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.542 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.542 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:29:48.543 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:29:48.543 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:29:48.543 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:29:48.543 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:29:48.544 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:29:48.544 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:29:48.544 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.545 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:29:48.546 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:29:48.546 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:29:48.547 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:29:48.547 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:29:48.547 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:29:48.548 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:29:48.548 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:29:48.548 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:29:48.548 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 29, 2021-04-09T18:29:48.549 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:29:48.549 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:29:48.549 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:29:48.549 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.550 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.550 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:29:48.550 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:29:48.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.551 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.551 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:29:48.551 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:29:48.552 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.552 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.553 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:29:48.553 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.554 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.554 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:29:48.555 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:29:48.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.556 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.556 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:29:48.556 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:29:48.557 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.557 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.558 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:29:48.558 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.559 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.559 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:29:48.560 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:29:48.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.561 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.561 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:29:48.561 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:29:48.562 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.562 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.562 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:29:48.563 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.563 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.563 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:29:48.563 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:29:48.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.564 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.564 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:29:48.564 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:29:48.565 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.565 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.565 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:29:48.566 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:29:48.566 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:29:48.566 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:29:48.566 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:29:48.566 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:29:48.567 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:29:48.567 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.567 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:29:48.568 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:29:48.568 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:29:48.568 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:29:48.568 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:29:48.568 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:29:48.569 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:29:48.569 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:29:48.569 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:29:48.569 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 37, 2021-04-09T18:29:48.569 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:29:48.570 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:29:48.570 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:29:48.570 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.570 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.571 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:29:48.571 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:29:48.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.572 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.572 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:29:48.572 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:29:48.572 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.572 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.573 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:29:48.573 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.573 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.574 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:29:48.574 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:29:48.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.575 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.575 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:29:48.575 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:29:48.575 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.575 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.576 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:29:48.576 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.576 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.577 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:29:48.577 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:29:48.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.577 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.578 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:29:48.578 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:29:48.578 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.578 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.579 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:29:48.579 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.579 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.580 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:29:48.580 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:29:48.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.580 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.581 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:29:48.581 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:29:48.581 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.581 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.582 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:29:48.582 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:29:48.582 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:29:48.583 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:29:48.583 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:29:48.583 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:29:48.583 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:29:48.583 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.584 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:29:48.584 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:29:48.584 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:29:48.585 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:29:48.585 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:29:48.585 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:29:48.585 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:29:48.586 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:29:48.586 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:29:48.586 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 37, 2021-04-09T18:29:48.586 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:29:48.586 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:29:48.587 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:29:48.587 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.587 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.587 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:29:48.588 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:29:48.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.588 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.589 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:29:48.589 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:29:48.589 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.589 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.590 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:29:48.590 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.590 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.591 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:29:48.591 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:29:48.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.591 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.592 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:29:48.592 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:29:48.592 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.592 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.593 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:29:48.593 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.593 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.593 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:29:48.594 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:29:48.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.594 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.594 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:29:48.595 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:29:48.595 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.595 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.596 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:29:48.596 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.596 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.596 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:29:48.597 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:29:48.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.597 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.597 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:29:48.598 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:29:48.598 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.598 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.598 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:29:48.599 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:29:48.599 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:29:48.599 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:29:48.599 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:29:48.599 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:29:48.600 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:29:48.600 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.601 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:29:48.601 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:29:48.601 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:29:48.601 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:29:48.601 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:29:48.602 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:29:48.602 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:29:48.602 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:29:48.602 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:29:48.602 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 37, 2021-04-09T18:29:48.603 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:29:48.603 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:29:48.603 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:29:48.603 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.604 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.604 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:29:48.604 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:29:48.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.605 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.605 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:29:48.605 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:29:48.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.605 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.606 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:29:48.606 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.607 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.607 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:29:48.607 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:29:48.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.608 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.608 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:29:48.608 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:29:48.608 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.608 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.609 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:29:48.609 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.610 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.610 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:29:48.610 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:29:48.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.611 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.611 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:29:48.611 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:29:48.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.611 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.612 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:29:48.612 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.612 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.613 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:29:48.613 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:29:48.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.614 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:29:48.614 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:29:48.614 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.614 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.615 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:29:48.615 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:29:48.615 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:29:48.615 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:29:48.615 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:29:48.616 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:29:48.616 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:29:48.616 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.617 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:29:48.617 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:29:48.617 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:29:48.617 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:29:48.618 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:29:48.618 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:29:48.618 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:29:48.618 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:29:48.618 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:29:48.619 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 37, 2021-04-09T18:29:48.619 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:29:48.619 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:29:48.619 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:29:48.619 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.620 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.620 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:29:48.620 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:29:48.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.621 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.621 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:29:48.621 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:29:48.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.622 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.622 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:29:48.622 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.623 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.623 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:29:48.623 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:29:48.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.624 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.624 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:29:48.624 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:29:48.624 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.625 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.625 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:29:48.625 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.626 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.626 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:29:48.626 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:29:48.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.627 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.627 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:29:48.627 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:29:48.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.628 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.628 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:29:48.628 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.629 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.629 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:29:48.629 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:29:48.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.630 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.630 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:29:48.630 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:29:48.630 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.630 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.631 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:29:48.631 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:29:48.631 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:29:48.631 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:29:48.632 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:29:48.632 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:29:48.632 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:29:48.632 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.633 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:29:48.633 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:29:48.633 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:29:48.633 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:29:48.634 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:29:48.634 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:29:48.634 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:29:48.634 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:29:48.635 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:29:48.635 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 37, 2021-04-09T18:29:48.635 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:29:48.635 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:29:48.635 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:29:48.636 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.636 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.636 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:29:48.636 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:29:48.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.637 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.637 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:29:48.637 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:29:48.638 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.638 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.638 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:29:48.639 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.639 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.639 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:29:48.639 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:29:48.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.640 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.640 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:29:48.640 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:29:48.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.641 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.641 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:29:48.641 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.642 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.642 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:29:48.642 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:29:48.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.643 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.643 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:29:48.643 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:29:48.643 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.644 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.644 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:29:48.644 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:29:48.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.645 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:29:48.645 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:29:48.645 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:29:48.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.646 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:29:48.646 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:29:48.646 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:29:48.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.647 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.647 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:29:48.647 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:29:48.647 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:29:48.648 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:29:48.648 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:29:48.648 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:29:48.648 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:29:48.648 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:48.649 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.649 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:29:48.649 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:29:48.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.649 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:29:48.650 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:29:48.650 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:29:48.650 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:29:48.650 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:29:48.650 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:29:48.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.651 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:29:48.651 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:29:48.651 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:29:48.652 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:29:48.652 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:29:48.652 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:29:48.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.653 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:29:48.653 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:29:48.653 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:29:48.653 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:29:48.654 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:29:48.654 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:29:48.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.654 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:29:48.655 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:29:48.655 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:29:48.655 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:29:48.655 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:29:48.655 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:29:48.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.656 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:29:48.656 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:29:48.656 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:29:48.657 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:29:48.657 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:29:48.657 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:29:48.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.658 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:29:48.658 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:29:48.658 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:29:48.658 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:29:48.659 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:29:48.659 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:29:48.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.659 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:29:48.660 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:29:48.660 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:29:48.660 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:29:48.660 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:29:48.660 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:29:48.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:48.661 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:29:48.661 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:29:48.662 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:29:48.662 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:29:48.662 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:29:48.662 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:29:48.662 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.663 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:29:48.663 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:29:48.663 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:29:48.663 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:29:48.663 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:29:48.664 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": { 2021-04-09T18:29:48.664 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.79:6832/1928394900": "2021-04-10 18:29:41.639997", 2021-04-09T18:29:48.664 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.79:6833/1928394900": "2021-04-10 18:29:41.639997", 2021-04-09T18:29:48.664 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.79:6832/3417656822": "2021-04-10 18:28:14.914231", 2021-04-09T18:29:48.664 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.79:6833/3417656822": "2021-04-10 18:28:14.914231", 2021-04-09T18:29:48.665 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.90:0/528006622": "2021-04-09 19:29:35.880495" 2021-04-09T18:29:48.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.665 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:29:48.665 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:29:48.665 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:29:48.666 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:29:48.666 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:29:48.666 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:29:48.666 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:29:48.666 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:29:48.667 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:29:48.667 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:29:48.667 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:29:48.667 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:29:48.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.668 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:29:48.668 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:29:48.668 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:29:48.668 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:29:48.669 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:29:48.669 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:29:48.669 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:29:48.669 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:48.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:48.670 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:29:48.670 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:29:48.670 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:29:48.670 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:29:48.670 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:29:48.671 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:29:48.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.482 7fadd0aea700 1 -- 172.21.15.79:0/295549119 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fadb0029100 msgr2=0x7fadb002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:48.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.482 7fadd0aea700 1 --2- 172.21.15.79:0/295549119 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fadb0029100 0x7fadb002b650 crc :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.482 7fadd0aea700 1 -- 172.21.15.79:0/295549119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadcc0ce5e0 msgr2=0x7fadcc0cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:48.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.482 7fadd0aea700 1 --2- 172.21.15.79:0/295549119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadcc0ce5e0 0x7fadcc0cea30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fadc4001210 tx=0x7fadc400ce30).stop 2021-04-09T18:29:48.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.482 7fadd0aea700 1 -- 172.21.15.79:0/295549119 shutdown_connections 2021-04-09T18:29:48.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.482 7fadd0aea700 1 --2- 172.21.15.79:0/295549119 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fadb0029100 0x7fadb002b650 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.482 7fadd0aea700 1 --2- 172.21.15.79:0/295549119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadcc0ce5e0 0x7fadcc0cea30 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.482 7fadd0aea700 1 --2- 172.21.15.79:0/295549119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadcc099860 0x7fadcc091650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.482 7fadd0aea700 1 --2- 172.21.15.79:0/295549119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadcc0983f0 0x7fadcc0cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.482 7fadd0aea700 1 -- 172.21.15.79:0/295549119 >> 172.21.15.79:0/295549119 conn(0x7fadcc08e4d0 msgr2=0x7fadcc0d29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:48.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.482 7fadd0aea700 1 -- 172.21.15.79:0/295549119 shutdown_connections 2021-04-09T18:29:48.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.482 7fadd0aea700 1 -- 172.21.15.79:0/295549119 wait complete. 2021-04-09T18:29:48.676 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:29:48.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.762 7f6bfc16a700 1 Processor -- start 2021-04-09T18:29:48.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.762 7f6bfc16a700 1 -- start start 2021-04-09T18:29:48.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.762 7f6bfc16a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6bf41c9020 0x7f6bf41cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:48.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.762 7f6bfc16a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf40fbb20 con 0x7f6bf40e9ae0 2021-04-09T18:29:48.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.762 7f6bfc16a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf409f910 con 0x7f6bf40f5520 2021-04-09T18:29:48.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.762 7f6bfc16a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf41c3dc0 con 0x7f6bf41c9020 2021-04-09T18:29:48.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.762 7f6bf970d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6bf40e9ae0 0x7f6bf409f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52814/0 (socket says 172.21.15.79:52814) 2021-04-09T18:29:48.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.762 7f6bf970d700 1 -- 172.21.15.79:0/2965125389 learned_addr learned my addr 172.21.15.79:0/2965125389 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:48.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bfa70f700 1 --2- 172.21.15.79:0/2965125389 >> v2:172.21.15.89:3300/0 conn(0x7f6bf41c9020 0x7f6bf41cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:48.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf8f0c700 1 -- 172.21.15.79:0/2965125389 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2297573926 0 0) 0x7f6be40010d0 con 0x7f6bf40e9ae0 2021-04-09T18:29:48.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf8f0c700 1 -- 172.21.15.79:0/2965125389 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6be0003240 con 0x7f6bf40e9ae0 2021-04-09T18:29:48.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf8f0c700 1 -- 172.21.15.79:0/2965125389 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111005366 0 0) 0x7f6bf00010d0 con 0x7f6bf40f5520 2021-04-09T18:29:48.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf8f0c700 1 -- 172.21.15.79:0/2965125389 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6be0003620 con 0x7f6bf40f5520 2021-04-09T18:29:48.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf8f0c700 1 -- 172.21.15.79:0/2965125389 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3751513689 0 0) 0x7f6be4001650 con 0x7f6bf40e9ae0 2021-04-09T18:29:48.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf8f0c700 1 -- 172.21.15.79:0/2965125389 >> v2:172.21.15.89:3300/0 conn(0x7f6bf41c9020 msgr2=0x7f6bf41cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:48.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf8f0c700 1 --2- 172.21.15.79:0/2965125389 >> v2:172.21.15.89:3300/0 conn(0x7f6bf41c9020 0x7f6bf41cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf8f0c700 1 -- 172.21.15.79:0/2965125389 >> v1:172.21.15.89:6789/0 conn(0x7f6bf40f5520 legacy=0x7f6bf40f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:48.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf8f0c700 1 -- 172.21.15.79:0/2965125389 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf40e56d0 con 0x7f6bf40e9ae0 2021-04-09T18:29:48.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf8f0c700 1 -- 172.21.15.79:0/2965125389 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f6be4001bb0 con 0x7f6bf40e9ae0 2021-04-09T18:29:48.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf8f0c700 1 -- 172.21.15.79:0/2965125389 >> v1:172.21.15.79:6789/0 conn(0x7f6bf40e9ae0 legacy=0x7f6bf409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:48.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf8f0c700 1 --2- 172.21.15.79:0/2965125389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be0003d10 0x7f6be00045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:48.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf8f0c700 1 --2- 172.21.15.79:0/2965125389 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be0004bd0 0x7f6be00097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:48.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf8f0c700 1 --2- 172.21.15.79:0/2965125389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be0005020 0x7f6be000be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:48.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf8f0c700 1 -- 172.21.15.79:0/2965125389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf41c3dc0 con 0x7f6be0003d10 2021-04-09T18:29:48.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf8f0c700 1 -- 172.21.15.79:0/2965125389 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be00505b0 con 0x7f6be0005020 2021-04-09T18:29:48.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf8f0c700 1 -- 172.21.15.79:0/2965125389 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be00507b0 con 0x7f6be0004bd0 2021-04-09T18:29:48.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf9f0e700 1 --2- 172.21.15.79:0/2965125389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be0003d10 0x7f6be00045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:48.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf970d700 1 --2- 172.21.15.79:0/2965125389 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be0004bd0 0x7f6be00097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:48.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bfa70f700 1 --2- 172.21.15.79:0/2965125389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be0005020 0x7f6be000be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:48.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf9f0e700 1 -- 172.21.15.79:0/2965125389 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be0004bd0 msgr2=0x7f6be00097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:48.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf9f0e700 1 --2- 172.21.15.79:0/2965125389 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be0004bd0 0x7f6be00097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf9f0e700 1 -- 172.21.15.79:0/2965125389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be0005020 msgr2=0x7f6be000be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:48.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf9f0e700 1 --2- 172.21.15.79:0/2965125389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be0005020 0x7f6be000be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bfa70f700 1 -- 172.21.15.79:0/2965125389 reap_dead start 2021-04-09T18:29:48.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf9f0e700 1 -- 172.21.15.79:0/2965125389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0050aa0 con 0x7f6be0003d10 2021-04-09T18:29:48.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf9f0e700 1 --2- 172.21.15.79:0/2965125389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be0003d10 0x7f6be00045a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f6bf0000fe0 tx=0x7f6bf000c0e0).ready entity=mon.0 client_cookie=e136b489183603c0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:48.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf8f0c700 1 -- 172.21.15.79:0/2965125389 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6be0050aa0 con 0x7f6be0003d10 2021-04-09T18:29:48.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf8f0c700 1 -- 172.21.15.79:0/2965125389 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf000ca30 con 0x7f6be0003d10 2021-04-09T18:29:48.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bf8f0c700 1 -- 172.21.15.79:0/2965125389 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6bf000ce00 con 0x7f6be0003d10 2021-04-09T18:29:48.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bfc16a700 1 -- 172.21.15.79:0/2965125389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be0003d10 msgr2=0x7f6be00045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:48.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bfc16a700 1 --2- 172.21.15.79:0/2965125389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be0003d10 0x7f6be00045a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f6bf0000fe0 tx=0x7f6bf000c0e0).stop 2021-04-09T18:29:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bfc16a700 1 -- 172.21.15.79:0/2965125389 shutdown_connections 2021-04-09T18:29:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bfc16a700 1 --2- 172.21.15.79:0/2965125389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be0003d10 0x7f6be00045a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.766 7f6bfc16a700 1 -- 172.21.15.79:0/2965125389 >> 172.21.15.79:0/2965125389 conn(0x7f6bf40e5fe0 msgr2=0x7f6bf40e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.770 7f6bfc16a700 1 -- 172.21.15.79:0/2965125389 shutdown_connections 2021-04-09T18:29:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.770 7f6bfc16a700 1 -- 172.21.15.79:0/2965125389 wait complete. 2021-04-09T18:29:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.770 7f6bfc16a700 1 Processor -- start 2021-04-09T18:29:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bfc16a700 1 -- start start 2021-04-09T18:29:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bfc16a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bf40be5a0 0x7f6bf419b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bfc16a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bf419f2d0 0x7f6bf41c0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bfc16a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bf419f720 0x7f6bf41b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:48.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bfc16a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf40e9f30 con 0x7f6bf419f720 2021-04-09T18:29:48.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bfc16a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf419ccd0 con 0x7f6bf40be5a0 2021-04-09T18:29:48.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bfc16a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf419cfd0 con 0x7f6bf419f2d0 2021-04-09T18:29:48.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bfa70f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bf419f720 0x7f6bf41b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bfa70f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bf419f720 0x7f6bf41b1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58118/0 (socket says 172.21.15.79:58118) 2021-04-09T18:29:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bfa70f700 1 -- 172.21.15.79:0/843547872 learned_addr learned my addr 172.21.15.79:0/843547872 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bf9f0e700 1 --2- 172.21.15.79:0/843547872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bf40be5a0 0x7f6bf419b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bf970d700 1 --2- 172.21.15.79:0/843547872 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bf419f2d0 0x7f6bf41c0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bfa70f700 1 -- 172.21.15.79:0/843547872 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bf419f2d0 msgr2=0x7f6bf41c0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:48.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bfa70f700 1 --2- 172.21.15.79:0/843547872 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bf419f2d0 0x7f6bf41c0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bfa70f700 1 -- 172.21.15.79:0/843547872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bf40be5a0 msgr2=0x7f6bf419b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:48.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bfa70f700 1 --2- 172.21.15.79:0/843547872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bf40be5a0 0x7f6bf419b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bfa70f700 1 -- 172.21.15.79:0/843547872 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf419c010 con 0x7f6bf419f720 2021-04-09T18:29:48.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bfa70f700 1 --2- 172.21.15.79:0/843547872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bf419f720 0x7f6bf41b1650 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f6bf40ad400 tx=0x7f6bec00a040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:48.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bea7fc700 1 -- 172.21.15.79:0/843547872 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6bf419c010 con 0x7f6bf419f720 2021-04-09T18:29:48.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bea7fc700 1 -- 172.21.15.79:0/843547872 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bec00fb40 con 0x7f6bf419f720 2021-04-09T18:29:48.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bfc16a700 1 -- 172.21.15.79:0/843547872 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf419c560 con 0x7f6bf419f720 2021-04-09T18:29:48.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bea7fc700 1 -- 172.21.15.79:0/843547872 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6bec00f040 con 0x7f6bf419f720 2021-04-09T18:29:48.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bfc16a700 1 -- 172.21.15.79:0/843547872 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf41ae060 con 0x7f6bf419f720 2021-04-09T18:29:48.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.774 7f6bea7fc700 1 -- 172.21.15.79:0/843547872 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6bec014440 con 0x7f6bf419f720 2021-04-09T18:29:48.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.778 7f6bea7fc700 1 --2- 172.21.15.79:0/843547872 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6bdc029100 0x7f6bdc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:48.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.778 7f6bea7fc700 1 -- 172.21.15.79:0/843547872 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5319+0+0 (secure 0 0 0) 0x7f6bec010040 con 0x7f6bf419f720 2021-04-09T18:29:48.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.778 7f6bf9f0e700 1 --2- 172.21.15.79:0/843547872 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6bdc029100 0x7f6bdc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:48.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.778 7f6bf9f0e700 1 --2- 172.21.15.79:0/843547872 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6bdc029100 0x7f6bdc02b650 crc :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:48.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.794 7f6bfc16a700 1 -- 172.21.15.79:0/843547872 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf40e39e0 con 0x7f6bf419f720 2021-04-09T18:29:48.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.798 7f6bea7fc700 1 -- 172.21.15.79:0/843547872 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6bec00f930 con 0x7f6bf419f720 2021-04-09T18:29:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.970 7f6bfc16a700 1 -- 172.21.15.79:0/843547872 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bf40a1cc0 con 0x7f6bf419f720 2021-04-09T18:29:48.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.974 7f6bea7fc700 1 -- 172.21.15.79:0/843547872 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+1171 (secure 0 0 0) 0x7f6bf40f76c0 con 0x7f6bf419f720 2021-04-09T18:29:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 22 2021-04-09T18:29:48.976 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:29:48.976 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5233,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/781814443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":781814443},{"type":"v1","addr":"172.21.15.89:6835","nonce":781814443}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":16},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/781193665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":781193665},{"type":"v1","addr":"172.21.15.79:6833","nonce":781193665}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":22}],"filesystems":[]} 2021-04-09T18:29:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.974 7f6bfc16a700 1 -- 172.21.15.79:0/843547872 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6bdc029100 msgr2=0x7f6bdc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.974 7f6bfc16a700 1 --2- 172.21.15.79:0/843547872 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6bdc029100 0x7f6bdc02b650 crc :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.974 7f6bfc16a700 1 -- 172.21.15.79:0/843547872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bf419f720 msgr2=0x7f6bf41b1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.974 7f6bfc16a700 1 --2- 172.21.15.79:0/843547872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bf419f720 0x7f6bf41b1650 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f6bf40ad400 tx=0x7f6bec00a040).stop 2021-04-09T18:29:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.974 7f6bfc16a700 1 -- 172.21.15.79:0/843547872 shutdown_connections 2021-04-09T18:29:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.974 7f6bfc16a700 1 --2- 172.21.15.79:0/843547872 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6bdc029100 0x7f6bdc02b650 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.974 7f6bfc16a700 1 --2- 172.21.15.79:0/843547872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bf40be5a0 0x7f6bf419b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.974 7f6bfc16a700 1 --2- 172.21.15.79:0/843547872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bf419f720 0x7f6bf41b1650 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.974 7f6bfc16a700 1 --2- 172.21.15.79:0/843547872 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bf419f2d0 0x7f6bf41c0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:48.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.974 7f6bfc16a700 1 -- 172.21.15.79:0/843547872 >> 172.21.15.79:0/843547872 conn(0x7f6bf40a2e40 msgr2=0x7f6bf40a24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:48.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.974 7f6bfc16a700 1 -- 172.21.15.79:0/843547872 shutdown_connections 2021-04-09T18:29:48.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:48.974 7f6bfc16a700 1 -- 172.21.15.79:0/843547872 wait complete. 2021-04-09T18:29:48.988 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:29:49.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d6e927700 1 Processor -- start 2021-04-09T18:29:49.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d6e927700 1 -- start start 2021-04-09T18:29:49.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d6e927700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d680e9ad0 0x7f2d6809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d6e927700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d680fbb10 con 0x7f2d680f5510 2021-04-09T18:29:49.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d6e927700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d680e56c0 con 0x7f2d681c8000 2021-04-09T18:29:49.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d6e927700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d681c3db0 con 0x7f2d680e9ad0 2021-04-09T18:29:49.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d67fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2d680f5510 0x7f2d680f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52834/0 (socket says 172.21.15.79:52834) 2021-04-09T18:29:49.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d67fff700 1 -- 172.21.15.79:0/2752340077 learned_addr learned my addr 172.21.15.79:0/2752340077 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:49.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d677fe700 1 --2- 172.21.15.79:0/2752340077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d680e9ad0 0x7f2d6809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d66ffd700 1 -- 172.21.15.79:0/2752340077 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4062076727 0 0) 0x7f2d500010d0 con 0x7f2d680f5510 2021-04-09T18:29:49.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d66ffd700 1 -- 172.21.15.79:0/2752340077 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d54003240 con 0x7f2d680f5510 2021-04-09T18:29:49.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d66ffd700 1 -- 172.21.15.79:0/2752340077 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554406612 0 0) 0x7f2d60001450 con 0x7f2d681c8000 2021-04-09T18:29:49.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d66ffd700 1 -- 172.21.15.79:0/2752340077 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d54003620 con 0x7f2d681c8000 2021-04-09T18:29:49.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d66ffd700 1 -- 172.21.15.79:0/2752340077 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1529475885 0 0) 0x7f2d50001650 con 0x7f2d680f5510 2021-04-09T18:29:49.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d66ffd700 1 -- 172.21.15.79:0/2752340077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d680e9ad0 msgr2=0x7f2d6809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:49.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d66ffd700 1 --2- 172.21.15.79:0/2752340077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d680e9ad0 0x7f2d6809f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d66ffd700 1 -- 172.21.15.79:0/2752340077 >> v1:172.21.15.89:6789/0 conn(0x7f2d681c8000 legacy=0x7f2d681ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d66ffd700 1 -- 172.21.15.79:0/2752340077 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d680e4320 con 0x7f2d680f5510 2021-04-09T18:29:49.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d66ffd700 1 -- 172.21.15.79:0/2752340077 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f2d50001bb0 con 0x7f2d680f5510 2021-04-09T18:29:49.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d66ffd700 1 -- 172.21.15.79:0/2752340077 >> v1:172.21.15.79:6789/0 conn(0x7f2d680f5510 legacy=0x7f2d680f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d66ffd700 1 --2- 172.21.15.79:0/2752340077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d54003d40 0x7f2d540045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d66ffd700 1 --2- 172.21.15.79:0/2752340077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d54004bd0 0x7f2d540097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d66ffd700 1 --2- 172.21.15.79:0/2752340077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d54005020 0x7f2d5400be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d66ffd700 1 -- 172.21.15.79:0/2752340077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d681c3db0 con 0x7f2d54005020 2021-04-09T18:29:49.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d6cecc700 1 --2- 172.21.15.79:0/2752340077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d54005020 0x7f2d5400be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d66ffd700 1 -- 172.21.15.79:0/2752340077 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d54050460 con 0x7f2d54003d40 2021-04-09T18:29:49.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d66ffd700 1 -- 172.21.15.79:0/2752340077 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d54050610 con 0x7f2d54004bd0 2021-04-09T18:29:49.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d677fe700 1 --2- 172.21.15.79:0/2752340077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d54004bd0 0x7f2d540097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d67fff700 1 --2- 172.21.15.79:0/2752340077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d54003d40 0x7f2d540045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d6cecc700 1 -- 172.21.15.79:0/2752340077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d54004bd0 msgr2=0x7f2d540097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:49.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d6cecc700 1 --2- 172.21.15.79:0/2752340077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d54004bd0 0x7f2d540097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d6cecc700 1 -- 172.21.15.79:0/2752340077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d54003d40 msgr2=0x7f2d540045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:49.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d6cecc700 1 --2- 172.21.15.79:0/2752340077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d54003d40 0x7f2d540045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d6cecc700 1 -- 172.21.15.79:0/2752340077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d540508d0 con 0x7f2d54005020 2021-04-09T18:29:49.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d67fff700 1 --2- 172.21.15.79:0/2752340077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d54003d40 0x7f2d540045a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:29:49.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d6cecc700 1 --2- 172.21.15.79:0/2752340077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d54005020 0x7f2d5400be20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f2d60001340 tx=0x7f2d6000c470).ready entity=mon.0 client_cookie=5b83621e2f315cc9 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:49.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d66ffd700 1 -- 172.21.15.79:0/2752340077 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2d540508d0 con 0x7f2d54005020 2021-04-09T18:29:49.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d66ffd700 1 -- 172.21.15.79:0/2752340077 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6000ce00 con 0x7f2d54005020 2021-04-09T18:29:49.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d66ffd700 1 -- 172.21.15.79:0/2752340077 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2d600125f0 con 0x7f2d54005020 2021-04-09T18:29:49.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d6e927700 1 -- 172.21.15.79:0/2752340077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d54005020 msgr2=0x7f2d5400be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d6e927700 1 --2- 172.21.15.79:0/2752340077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d54005020 0x7f2d5400be20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f2d60001340 tx=0x7f2d6000c470).stop 2021-04-09T18:29:49.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.078 7f2d6cecc700 1 -- 172.21.15.79:0/2752340077 reap_dead start 2021-04-09T18:29:49.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.082 7f2d6e927700 1 -- 172.21.15.79:0/2752340077 shutdown_connections 2021-04-09T18:29:49.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.082 7f2d6e927700 1 -- 172.21.15.79:0/2752340077 >> 172.21.15.79:0/2752340077 conn(0x7f2d680e5fd0 msgr2=0x7f2d680e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:49.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.082 7f2d6e927700 1 -- 172.21.15.79:0/2752340077 shutdown_connections 2021-04-09T18:29:49.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.082 7f2d6e927700 1 -- 172.21.15.79:0/2752340077 wait complete. 2021-04-09T18:29:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.082 7f2d6e927700 1 Processor -- start 2021-04-09T18:29:49.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.082 7f2d6e927700 1 -- start start 2021-04-09T18:29:49.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d6e927700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d680abe10 0x7f2d6819dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d6e927700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d681abd50 0x7f2d681ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d6e927700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d680c59f0 0x7f2d680c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d6e927700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d680e9f20 con 0x7f2d681abd50 2021-04-09T18:29:49.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d6e927700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6819c7b0 con 0x7f2d680c59f0 2021-04-09T18:29:49.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d6e927700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6819bd40 con 0x7f2d680abe10 2021-04-09T18:29:49.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d677fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d681abd50 0x7f2d681ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d677fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d681abd50 0x7f2d681ac1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58136/0 (socket says 172.21.15.79:58136) 2021-04-09T18:29:49.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d677fe700 1 -- 172.21.15.79:0/2396236013 learned_addr learned my addr 172.21.15.79:0/2396236013 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:49.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d67fff700 1 --2- 172.21.15.79:0/2396236013 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d680abe10 0x7f2d6819dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d6cecc700 1 --2- 172.21.15.79:0/2396236013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d680c59f0 0x7f2d680c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d677fe700 1 -- 172.21.15.79:0/2396236013 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d680abe10 msgr2=0x7f2d6819dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d677fe700 1 --2- 172.21.15.79:0/2396236013 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d680abe10 0x7f2d6819dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d677fe700 1 -- 172.21.15.79:0/2396236013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d680c59f0 msgr2=0x7f2d680c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d677fe700 1 --2- 172.21.15.79:0/2396236013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d680c59f0 0x7f2d680c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d677fe700 1 -- 172.21.15.79:0/2396236013 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d680ac260 con 0x7f2d681abd50 2021-04-09T18:29:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d6cecc700 1 --2- 172.21.15.79:0/2396236013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d680c59f0 0x7f2d680c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:29:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d677fe700 1 --2- 172.21.15.79:0/2396236013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d681abd50 0x7f2d681ac1a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f2d68087760 tx=0x7f2d5800e4b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d64ff9700 1 -- 172.21.15.79:0/2396236013 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2d680ac260 con 0x7f2d681abd50 2021-04-09T18:29:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d64ff9700 1 -- 172.21.15.79:0/2396236013 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5800ea40 con 0x7f2d681abd50 2021-04-09T18:29:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d6e927700 1 -- 172.21.15.79:0/2396236013 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6819e7d0 con 0x7f2d681abd50 2021-04-09T18:29:49.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d64ff9700 1 -- 172.21.15.79:0/2396236013 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2d5800f040 con 0x7f2d681abd50 2021-04-09T18:29:49.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d6e927700 1 -- 172.21.15.79:0/2396236013 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6819bf80 con 0x7f2d681abd50 2021-04-09T18:29:49.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d64ff9700 1 -- 172.21.15.79:0/2396236013 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2d58014470 con 0x7f2d681abd50 2021-04-09T18:29:49.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d64ff9700 1 --2- 172.21.15.79:0/2396236013 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2d4c029100 0x7f2d4c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d64ff9700 1 -- 172.21.15.79:0/2396236013 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5319+0+0 (secure 0 0 0) 0x7f2d58039820 con 0x7f2d681abd50 2021-04-09T18:29:49.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.086 7f2d67fff700 1 --2- 172.21.15.79:0/2396236013 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2d4c029100 0x7f2d4c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.090 7f2d67fff700 1 --2- 172.21.15.79:0/2396236013 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2d4c029100 0x7f2d4c02b650 crc :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.090 7f2d6e927700 1 -- 172.21.15.79:0/2396236013 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d680e39d0 con 0x7f2d681abd50 2021-04-09T18:29:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.094 7f2d64ff9700 1 -- 172.21.15.79:0/2396236013 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2d58010d70 con 0x7f2d681abd50 2021-04-09T18:29:49.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.258 7f2d6e927700 1 -- 172.21.15.79:0/2396236013 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d680f5b10 con 0x7f2d681abd50 2021-04-09T18:29:49.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.258 7f2d64ff9700 1 -- 172.21.15.79:0/2396236013 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+1171 (secure 0 0 0) 0x7f2d58000bf0 con 0x7f2d681abd50 2021-04-09T18:29:49.263 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:29:49.263 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5233,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/781814443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":781814443},{"type":"v1","addr":"172.21.15.89:6835","nonce":781814443}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":16},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/781193665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":781193665},{"type":"v1","addr":"172.21.15.79:6833","nonce":781193665}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":22}],"filesystems":[]} 2021-04-09T18:29:49.263 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 22 2021-04-09T18:29:49.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.262 7f2d6e927700 1 -- 172.21.15.79:0/2396236013 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2d4c029100 msgr2=0x7f2d4c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.262 7f2d6e927700 1 --2- 172.21.15.79:0/2396236013 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2d4c029100 0x7f2d4c02b650 crc :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.262 7f2d6e927700 1 -- 172.21.15.79:0/2396236013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d681abd50 msgr2=0x7f2d681ac1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.262 7f2d6e927700 1 --2- 172.21.15.79:0/2396236013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d681abd50 0x7f2d681ac1a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f2d68087760 tx=0x7f2d5800e4b0).stop 2021-04-09T18:29:49.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.262 7f2d6e927700 1 -- 172.21.15.79:0/2396236013 shutdown_connections 2021-04-09T18:29:49.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.262 7f2d6e927700 1 --2- 172.21.15.79:0/2396236013 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2d4c029100 0x7f2d4c02b650 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.262 7f2d6e927700 1 --2- 172.21.15.79:0/2396236013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d680c59f0 0x7f2d680c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.262 7f2d6e927700 1 --2- 172.21.15.79:0/2396236013 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d680abe10 0x7f2d6819dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.262 7f2d6e927700 1 --2- 172.21.15.79:0/2396236013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d681abd50 0x7f2d681ac1a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.262 7f2d6e927700 1 -- 172.21.15.79:0/2396236013 >> 172.21.15.79:0/2396236013 conn(0x7f2d680d8590 msgr2=0x7f2d680c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:49.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.262 7f2d6e927700 1 -- 172.21.15.79:0/2396236013 shutdown_connections 2021-04-09T18:29:49.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.262 7f2d6e927700 1 -- 172.21.15.79:0/2396236013 wait complete. 2021-04-09T18:29:49.279 INFO:tasks.ceph.mds.a:Restarting daemon 2021-04-09T18:29:49.279 INFO:tasks.ceph.mds.a:Stopping old one... 2021-04-09T18:29:49.280 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-04-09T18:29:49.280 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:29:49.280 INFO:tasks.ceph.mds.b:Restarting daemon 2021-04-09T18:29:49.281 INFO:tasks.ceph.mds.b:Stopping old one... 2021-04-09T18:29:49.281 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-04-09T18:29:49.281 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:29:49.291 INFO:tasks.ceph.mds.a:Stopped 2021-04-09T18:29:49.291 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-04-09T18:29:49.295 INFO:tasks.ceph.mds.b:Stopped 2021-04-09T18:29:49.296 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-04-09T18:29:49.340 INFO:tasks.ceph.mds.a:Started 2021-04-09T18:29:49.340 DEBUG:teuthology.parallel:result is None 2021-04-09T18:29:49.342 INFO:tasks.ceph.mds.b:Started 2021-04-09T18:29:49.343 DEBUG:teuthology.parallel:result is None 2021-04-09T18:29:49.343 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-04-09T18:29:49.412 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2021-04-09T18:29:49.419 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2021-04-09T18:29:49.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f42410eb700 1 Processor -- start 2021-04-09T18:29:49.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f42410eb700 1 -- start start 2021-04-09T18:29:49.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f42410eb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f423c1c9020 0x7f423c1cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f42410eb700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423c0fbb20 con 0x7f423c0e9ae0 2021-04-09T18:29:49.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f42410eb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423c09f910 con 0x7f423c0f5520 2021-04-09T18:29:49.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f42410eb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c1c3dc0 con 0x7f423c1c9020 2021-04-09T18:29:49.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423259c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f423c0e9ae0 0x7f423c09f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52864/0 (socket says 172.21.15.79:52864) 2021-04-09T18:29:49.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423259c700 1 -- 172.21.15.79:0/1151560744 learned_addr learned my addr 172.21.15.79:0/1151560744 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:49.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423b59e700 1 --2- 172.21.15.79:0/1151560744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f423c1c9020 0x7f423c1cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423a59c700 1 -- 172.21.15.79:0/1151560744 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522930668 0 0) 0x7f42240010d0 con 0x7f423c0e9ae0 2021-04-09T18:29:49.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423a59c700 1 -- 172.21.15.79:0/1151560744 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4228003240 con 0x7f423c0e9ae0 2021-04-09T18:29:49.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423a59c700 1 -- 172.21.15.79:0/1151560744 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 994191448 0 0) 0x7f4224001650 con 0x7f423c0e9ae0 2021-04-09T18:29:49.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423a59c700 1 -- 172.21.15.79:0/1151560744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f423c1c9020 msgr2=0x7f423c1cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:49.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423a59c700 1 --2- 172.21.15.79:0/1151560744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f423c1c9020 0x7f423c1cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423a59c700 1 -- 172.21.15.79:0/1151560744 >> v1:172.21.15.89:6789/0 conn(0x7f423c0f5520 legacy=0x7f423c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423a59c700 1 -- 172.21.15.79:0/1151560744 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c0e56d0 con 0x7f423c0e9ae0 2021-04-09T18:29:49.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423a59c700 1 -- 172.21.15.79:0/1151560744 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f4224001bb0 con 0x7f423c0e9ae0 2021-04-09T18:29:49.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423a59c700 1 -- 172.21.15.79:0/1151560744 >> v1:172.21.15.79:6789/0 conn(0x7f423c0e9ae0 legacy=0x7f423c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423a59c700 1 --2- 172.21.15.79:0/1151560744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42280038f0 0x7f4228003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423a59c700 1 --2- 172.21.15.79:0/1151560744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42280045a0 0x7f42280049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423a59c700 1 --2- 172.21.15.79:0/1151560744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42280097e0 0x7f422800bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423a59c700 1 -- 172.21.15.79:0/1151560744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c1c3dc0 con 0x7f42280045a0 2021-04-09T18:29:49.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423a59c700 1 -- 172.21.15.79:0/1151560744 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42280051d0 con 0x7f42280038f0 2021-04-09T18:29:49.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423a59c700 1 -- 172.21.15.79:0/1151560744 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42280053d0 con 0x7f42280097e0 2021-04-09T18:29:49.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423259c700 1 --2- 172.21.15.79:0/1151560744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42280045a0 0x7f42280049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423ad9d700 1 --2- 172.21.15.79:0/1151560744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42280038f0 0x7f4228003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423b59e700 1 --2- 172.21.15.79:0/1151560744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42280097e0 0x7f422800bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423259c700 1 -- 172.21.15.79:0/1151560744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42280097e0 msgr2=0x7f422800bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:49.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423259c700 1 --2- 172.21.15.79:0/1151560744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42280097e0 0x7f422800bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423259c700 1 -- 172.21.15.79:0/1151560744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42280038f0 msgr2=0x7f4228003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:49.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423259c700 1 --2- 172.21.15.79:0/1151560744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42280038f0 0x7f4228003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423259c700 1 -- 172.21.15.79:0/1151560744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4228050390 con 0x7f42280045a0 2021-04-09T18:29:49.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423b59e700 1 --2- 172.21.15.79:0/1151560744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42280097e0 0x7f422800bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:29:49.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423259c700 1 --2- 172.21.15.79:0/1151560744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42280045a0 0x7f42280049f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f42240018c0 tx=0x7f4224005230).ready entity=mon.0 client_cookie=b1ed194d427ebc9a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:49.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423a59c700 1 -- 172.21.15.79:0/1151560744 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4228050390 con 0x7f42280045a0 2021-04-09T18:29:49.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423a59c700 1 -- 172.21.15.79:0/1151560744 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4224008120 con 0x7f42280045a0 2021-04-09T18:29:49.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423a59c700 1 -- 172.21.15.79:0/1151560744 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f423c0e56d0 con 0x7f42280045a0 2021-04-09T18:29:49.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f42410eb700 1 -- 172.21.15.79:0/1151560744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42280045a0 msgr2=0x7f42280049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f42410eb700 1 --2- 172.21.15.79:0/1151560744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42280045a0 0x7f42280049f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f42240018c0 tx=0x7f4224005230).stop 2021-04-09T18:29:49.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.442 7f423b59e700 1 -- 172.21.15.79:0/1151560744 reap_dead start 2021-04-09T18:29:49.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.446 7f42410eb700 1 -- 172.21.15.79:0/1151560744 shutdown_connections 2021-04-09T18:29:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.446 7f42410eb700 1 -- 172.21.15.79:0/1151560744 >> 172.21.15.79:0/1151560744 conn(0x7f423c0e5fe0 msgr2=0x7f423c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.446 7f42410eb700 1 -- 172.21.15.79:0/1151560744 shutdown_connections 2021-04-09T18:29:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.446 7f42410eb700 1 -- 172.21.15.79:0/1151560744 wait complete. 2021-04-09T18:29:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.446 7f42410eb700 1 Processor -- start 2021-04-09T18:29:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.446 7f42410eb700 1 -- start start 2021-04-09T18:29:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f42410eb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f423c19bf70 0x7f423c097060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f42410eb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f423c097690 0x7f423c0b99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f42410eb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f423c0ba000 0x7f423c0afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f42410eb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0e9f30 con 0x7f423c097690 2021-04-09T18:29:49.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f42410eb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c19c6c0 con 0x7f423c0ba000 2021-04-09T18:29:49.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f42410eb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c19c3c0 con 0x7f423c19bf70 2021-04-09T18:29:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f423259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f423c097690 0x7f423c0b99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f423259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f423c097690 0x7f423c0b99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58170/0 (socket says 172.21.15.79:58170) 2021-04-09T18:29:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f423b59e700 1 --2- 172.21.15.79:0/2618309929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f423c0ba000 0x7f423c0afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f423259c700 1 -- 172.21.15.79:0/2618309929 learned_addr learned my addr 172.21.15.79:0/2618309929 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f423ad9d700 1 --2- 172.21.15.79:0/2618309929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f423c19bf70 0x7f423c097060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f423259c700 1 -- 172.21.15.79:0/2618309929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f423c19bf70 msgr2=0x7f423c097060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f423259c700 1 --2- 172.21.15.79:0/2618309929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f423c19bf70 0x7f423c097060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f423259c700 1 -- 172.21.15.79:0/2618309929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f423c0ba000 msgr2=0x7f423c0afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f423259c700 1 --2- 172.21.15.79:0/2618309929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f423c0ba000 0x7f423c0afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f423259c700 1 -- 172.21.15.79:0/2618309929 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c0ba450 con 0x7f423c097690 2021-04-09T18:29:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f423259c700 1 --2- 172.21.15.79:0/2618309929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f423c097690 0x7f423c0b99d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f423c0b0d60 tx=0x7f422400c040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f4233fff700 1 -- 172.21.15.79:0/2618309929 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f423c0ba450 con 0x7f423c097690 2021-04-09T18:29:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f4233fff700 1 -- 172.21.15.79:0/2618309929 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4224001c60 con 0x7f423c097690 2021-04-09T18:29:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f4233fff700 1 -- 172.21.15.79:0/2618309929 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4224005770 con 0x7f423c097690 2021-04-09T18:29:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f42410eb700 1 -- 172.21.15.79:0/2618309929 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423c19b9e0 con 0x7f423c097690 2021-04-09T18:29:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f42410eb700 1 -- 172.21.15.79:0/2618309929 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f423c0b03b0 con 0x7f423c097690 2021-04-09T18:29:49.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f4233fff700 1 -- 172.21.15.79:0/2618309929 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f422401e030 con 0x7f423c097690 2021-04-09T18:29:49.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f4233fff700 1 --2- 172.21.15.79:0/2618309929 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4220029100 0x7f422002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.450 7f4233fff700 1 -- 172.21.15.79:0/2618309929 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5319+0+0 (secure 0 0 0) 0x7f422403a8f0 con 0x7f423c097690 2021-04-09T18:29:49.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.454 7f423ad9d700 1 --2- 172.21.15.79:0/2618309929 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4220029100 0x7f422002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.454 7f423ad9d700 1 --2- 172.21.15.79:0/2618309929 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4220029100 0x7f422002b650 crc :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.454 7f42410eb700 1 -- 172.21.15.79:0/2618309929 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423c0e39e0 con 0x7f423c097690 2021-04-09T18:29:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.462 7f4233fff700 1 -- 172.21.15.79:0/2618309929 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4224001a50 con 0x7f423c097690 2021-04-09T18:29:49.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.642 7f42410eb700 1 -- 172.21.15.79:0/2618309929 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f423c0a1cc0 con 0x7f423c097690 2021-04-09T18:29:49.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.682 7f4233fff700 1 -- 172.21.15.79:0/2618309929 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v45) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4224000bf0 con 0x7f423c097690 2021-04-09T18:29:49.710 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blacklist entries 2021-04-09T18:29:49.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.710 7f42410eb700 1 -- 172.21.15.79:0/2618309929 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4220029100 msgr2=0x7f422002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.710 7f42410eb700 1 --2- 172.21.15.79:0/2618309929 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4220029100 0x7f422002b650 crc :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.710 7f42410eb700 1 -- 172.21.15.79:0/2618309929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f423c097690 msgr2=0x7f423c0b99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.710 7f42410eb700 1 --2- 172.21.15.79:0/2618309929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f423c097690 0x7f423c0b99d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f423c0b0d60 tx=0x7f422400c040).stop 2021-04-09T18:29:49.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.710 7f42410eb700 1 -- 172.21.15.79:0/2618309929 shutdown_connections 2021-04-09T18:29:49.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.710 7f42410eb700 1 --2- 172.21.15.79:0/2618309929 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4220029100 0x7f422002b650 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.710 7f42410eb700 1 --2- 172.21.15.79:0/2618309929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f423c0ba000 0x7f423c0afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.710 7f42410eb700 1 --2- 172.21.15.79:0/2618309929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f423c19bf70 0x7f423c097060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.710 7f42410eb700 1 --2- 172.21.15.79:0/2618309929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f423c097690 0x7f423c0b99d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.710 7f42410eb700 1 -- 172.21.15.79:0/2618309929 >> 172.21.15.79:0/2618309929 conn(0x7f423c0baa20 msgr2=0x7f423c0d8540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:49.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.710 7f42410eb700 1 -- 172.21.15.79:0/2618309929 shutdown_connections 2021-04-09T18:29:49.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.710 7f42410eb700 1 -- 172.21.15.79:0/2618309929 wait complete. 2021-04-09T18:29:49.726 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-04-09T18:29:49.727 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-04-09T18:29:49.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.814 7f8d70ec9700 1 Processor -- start 2021-04-09T18:29:49.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.814 7f8d70ec9700 1 -- start start 2021-04-09T18:29:49.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d70ec9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d6c0e9ae0 0x7f8d6c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d70ec9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8d6c1c8010 0x7f8d6c1ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d70ec9700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d6c0fbb20 con 0x7f8d6c0f5520 2021-04-09T18:29:49.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d70ec9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6c1c3dc0 con 0x7f8d6c1c8010 2021-04-09T18:29:49.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d70ec9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c0e9f30 con 0x7f8d6c0e9ae0 2021-04-09T18:29:49.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d6aaef700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8d6c0f5520 0x7f8d6c0f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52884/0 (socket says 172.21.15.79:52884) 2021-04-09T18:29:49.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d6aaef700 1 -- 172.21.15.79:0/728589283 learned_addr learned my addr 172.21.15.79:0/728589283 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:49.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d6b2f0700 1 --2- 172.21.15.79:0/728589283 >> v2:172.21.15.89:3300/0 conn(0x7f8d6c1c8010 0x7f8d6c1ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d6a2ee700 1 --2- 172.21.15.79:0/728589283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d6c0e9ae0 0x7f8d6c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d69aed700 1 -- 172.21.15.79:0/728589283 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313993397 0 0) 0x7f8d5c0010d0 con 0x7f8d6c0f5520 2021-04-09T18:29:49.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d69aed700 1 -- 172.21.15.79:0/728589283 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d50003240 con 0x7f8d6c0f5520 2021-04-09T18:29:49.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d6b2f0700 1 -- 172.21.15.79:0/728589283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d6c0e9ae0 msgr2=0x7f8d6c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:49.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d6b2f0700 1 --2- 172.21.15.79:0/728589283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d6c0e9ae0 0x7f8d6c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d6b2f0700 1 -- 172.21.15.79:0/728589283 >> v1:172.21.15.79:6789/0 conn(0x7f8d6c0f5520 legacy=0x7f8d6c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d6b2f0700 1 -- 172.21.15.79:0/728589283 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c0e56d0 con 0x7f8d6c1c8010 2021-04-09T18:29:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d6a2ee700 1 --2- 172.21.15.79:0/728589283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d6c0e9ae0 0x7f8d6c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:29:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d6b2f0700 1 --2- 172.21.15.79:0/728589283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d6c1c8010 0x7f8d6c1ca470 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f8d640032b0 tx=0x7f8d6400b3c0).ready entity=mon.1 client_cookie=bcb3e5299a478ae5 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d69aed700 1 -- 172.21.15.79:0/728589283 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d6c0e56d0 con 0x7f8d6c1c8010 2021-04-09T18:29:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d69aed700 1 -- 172.21.15.79:0/728589283 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6400bc20 con 0x7f8d6c1c8010 2021-04-09T18:29:49.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d69aed700 1 -- 172.21.15.79:0/728589283 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d64002020 con 0x7f8d6c1c8010 2021-04-09T18:29:49.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d70ec9700 1 -- 172.21.15.79:0/728589283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d6c1c8010 msgr2=0x7f8d6c1ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d70ec9700 1 --2- 172.21.15.79:0/728589283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d6c1c8010 0x7f8d6c1ca470 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f8d640032b0 tx=0x7f8d6400b3c0).stop 2021-04-09T18:29:49.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d70ec9700 1 -- 172.21.15.79:0/728589283 shutdown_connections 2021-04-09T18:29:49.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d70ec9700 1 --2- 172.21.15.79:0/728589283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d6c1c8010 0x7f8d6c1ca470 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d70ec9700 1 --2- 172.21.15.79:0/728589283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d6c0e9ae0 0x7f8d6c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.818 7f8d70ec9700 1 -- 172.21.15.79:0/728589283 >> 172.21.15.79:0/728589283 conn(0x7f8d6c0e5fe0 msgr2=0x7f8d6c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:49.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.822 7f8d70ec9700 1 -- 172.21.15.79:0/728589283 shutdown_connections 2021-04-09T18:29:49.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.822 7f8d70ec9700 1 -- 172.21.15.79:0/728589283 wait complete. 2021-04-09T18:29:49.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.822 7f8d70ec9700 1 Processor -- start 2021-04-09T18:29:49.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d70ec9700 1 -- start start 2021-04-09T18:29:49.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d70ec9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d6c0bb260 0x7f8d6c19b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d70ec9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d6c19c280 0x7f8d6c19eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d70ec9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d6c19ce80 0x7f8d6c19d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d70ec9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c19cb80 con 0x7f8d6c0bb260 2021-04-09T18:29:49.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d70ec9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c19f110 con 0x7f8d6c19ce80 2021-04-09T18:29:49.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d70ec9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c19c6d0 con 0x7f8d6c19c280 2021-04-09T18:29:49.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d6aaef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d6c0bb260 0x7f8d6c19b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d6aaef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d6c0bb260 0x7f8d6c19b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58182/0 (socket says 172.21.15.79:58182) 2021-04-09T18:29:49.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d6aaef700 1 -- 172.21.15.79:0/3044815277 learned_addr learned my addr 172.21.15.79:0/3044815277 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:49.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d6a2ee700 1 --2- 172.21.15.79:0/3044815277 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d6c19c280 0x7f8d6c19eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d6b2f0700 1 --2- 172.21.15.79:0/3044815277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d6c19ce80 0x7f8d6c19d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d6aaef700 1 -- 172.21.15.79:0/3044815277 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d6c19c280 msgr2=0x7f8d6c19eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d6aaef700 1 --2- 172.21.15.79:0/3044815277 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d6c19c280 0x7f8d6c19eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d6aaef700 1 -- 172.21.15.79:0/3044815277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d6c19ce80 msgr2=0x7f8d6c19d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d6aaef700 1 --2- 172.21.15.79:0/3044815277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d6c19ce80 0x7f8d6c19d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d6aaef700 1 -- 172.21.15.79:0/3044815277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c1acff0 con 0x7f8d6c0bb260 2021-04-09T18:29:49.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d6aaef700 1 --2- 172.21.15.79:0/3044815277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d6c0bb260 0x7f8d6c19b9e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f8d6c097160 tx=0x7f8d5c00cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:49.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d637fe700 1 -- 172.21.15.79:0/3044815277 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d6c1acff0 con 0x7f8d6c0bb260 2021-04-09T18:29:49.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d637fe700 1 -- 172.21.15.79:0/3044815277 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c007320 con 0x7f8d6c0bb260 2021-04-09T18:29:49.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d637fe700 1 -- 172.21.15.79:0/3044815277 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d5c0057e0 con 0x7f8d6c0bb260 2021-04-09T18:29:49.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d70ec9700 1 -- 172.21.15.79:0/3044815277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d6c1ad310 con 0x7f8d6c0bb260 2021-04-09T18:29:49.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d70ec9700 1 -- 172.21.15.79:0/3044815277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6c1ad820 con 0x7f8d6c0bb260 2021-04-09T18:29:49.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.826 7f8d637fe700 1 -- 172.21.15.79:0/3044815277 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8d5c01a060 con 0x7f8d6c0bb260 2021-04-09T18:29:49.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.830 7f8d637fe700 1 --2- 172.21.15.79:0/3044815277 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8d48029100 0x7f8d4802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.830 7f8d637fe700 1 -- 172.21.15.79:0/3044815277 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f8d5c038920 con 0x7f8d6c0bb260 2021-04-09T18:29:49.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.830 7f8d6a2ee700 1 --2- 172.21.15.79:0/3044815277 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8d48029100 0x7f8d4802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.830 7f8d6a2ee700 1 --2- 172.21.15.79:0/3044815277 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8d48029100 0x7f8d4802b650 crc :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:49.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.830 7f8d70ec9700 1 -- 172.21.15.79:0/3044815277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d6c0e39e0 con 0x7f8d6c0bb260 2021-04-09T18:29:49.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:49.838 7f8d637fe700 1 -- 172.21.15.79:0/3044815277 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8d5c007110 con 0x7f8d6c0bb260 2021-04-09T18:29:50.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.010 7f8d70ec9700 1 -- 172.21.15.79:0/3044815277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8d6c0f5b20 con 0x7f8d6c0bb260 2021-04-09T18:29:50.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.010 7f8d637fe700 1 -- 172.21.15.79:0/3044815277 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f8d6c107f50 con 0x7f8d6c0bb260 2021-04-09T18:29:50.013 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:29:50.014 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:29:50.014 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2021-04-09T18:29:50.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:50.014 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2021-04-09T18:29:50.015 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgovEoMhAAbDfArG3lSFAdk80rS/4iEQ==", 2021-04-09T18:29:50.015 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:29:50.015 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:29:50.015 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:29:50.016 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:29:50.016 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:29:50.016 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:50.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:50.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:50.017 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2021-04-09T18:29:50.017 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgN4sfOBAAPjvDX11uLM+vgdFpdP49Kw==", 2021-04-09T18:29:50.017 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:29:50.017 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:29:50.018 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:29:50.018 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:29:50.018 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:29:50.018 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:50.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:50.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:50.019 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2021-04-09T18:29:50.020 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQALnHBgro0COxAAgbe5jxAZH9bD7zDLbtdkhQ==", 2021-04-09T18:29:50.020 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:29:50.020 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:29:50.020 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:29:50.021 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:29:50.021 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:50.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:50.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:50.022 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2021-04-09T18:29:50.022 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAPnHBghZ/oARAAhkN+fnZJiskmHnvvs+G8NA==", 2021-04-09T18:29:50.022 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:29:50.022 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:29:50.023 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:29:50.023 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:29:50.023 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:50.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:50.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:50.024 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2021-04-09T18:29:50.024 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQASnHBgWT2FBxAACrSTbwbF18k9aPeYNohelw==", 2021-04-09T18:29:50.024 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:29:50.025 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:29:50.025 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:29:50.025 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:29:50.026 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:50.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:50.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:50.027 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2021-04-09T18:29:50.027 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAVnHBgPHy6CxAAFq+yki4AZe5ybodgTO/4/Q==", 2021-04-09T18:29:50.028 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:29:50.028 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:29:50.029 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:29:50.029 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:29:50.029 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:50.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:50.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:50.031 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2021-04-09T18:29:50.031 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAanHBgfbs4NhAAQzxM9dDML4RgQP8yamkuVw==", 2021-04-09T18:29:50.031 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:29:50.031 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:29:50.032 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:29:50.032 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:29:50.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:50.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:50.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:50.033 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2021-04-09T18:29:50.033 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAdnHBgi0WLOhAA4OBguOCjtmzqulUjTJ+GhQ==", 2021-04-09T18:29:50.033 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:29:50.033 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:29:50.034 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:29:50.034 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:29:50.034 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:50.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:50.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:50.035 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2021-04-09T18:29:50.035 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAhnHBgCs+PAxAAOm0wSMe/1Bu9vfTrpmrLkg==", 2021-04-09T18:29:50.035 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:29:50.035 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:29:50.035 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:29:50.036 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:29:50.036 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:50.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:50.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:50.037 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2021-04-09T18:29:50.037 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAknHBgH1S3CBAAUcdUIW7O6wH482l1yZBKBw==", 2021-04-09T18:29:50.037 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:29:50.037 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:29:50.037 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:29:50.038 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:29:50.038 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:50.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:50.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:50.039 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2021-04-09T18:29:50.039 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgxEq9BxAAap2nrjhcrf2aHzygtMclVw==", 2021-04-09T18:29:50.039 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:29:50.040 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:29:50.040 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:29:50.040 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:29:50.040 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:50.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:50.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:50.041 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2021-04-09T18:29:50.041 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBguJFeDRAAWL4NV4tsYRAqcwJ26kjm2Q==", 2021-04-09T18:29:50.041 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:29:50.041 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:29:50.042 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:29:50.042 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:29:50.042 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:50.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:50.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:50.043 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2021-04-09T18:29:50.043 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgN9X5EhAA3DBPdlRHVBHXJNH9nRFW0A==", 2021-04-09T18:29:50.043 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:29:50.043 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:29:50.044 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:29:50.044 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:29:50.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:50.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:50.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:50.045 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2021-04-09T18:29:50.045 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgHOSVDBAAMMqd8paqBSTQRgR7n4EXGQ==", 2021-04-09T18:29:50.045 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:29:50.045 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:29:50.045 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:29:50.046 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:29:50.046 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:29:50.046 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:50.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:50.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:50.047 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2021-04-09T18:29:50.047 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgmHJhLxAAyhBrx08J7ZFKu34MYC2Wyg==", 2021-04-09T18:29:50.047 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:29:50.047 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:29:50.047 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:29:50.048 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:29:50.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:50.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:29:50.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:50.049 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2021-04-09T18:29:50.049 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgNCCXKhAA/bKOzzjVHldj6RpMGu0c8g==", 2021-04-09T18:29:50.049 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:29:50.049 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:29:50.049 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:29:50.050 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:29:50.050 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:50.050 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:50.050 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:29:50.050 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:29:50.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.014 7f8d70ec9700 1 -- 172.21.15.79:0/3044815277 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8d48029100 msgr2=0x7f8d4802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.014 7f8d70ec9700 1 --2- 172.21.15.79:0/3044815277 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8d48029100 0x7f8d4802b650 crc :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.014 7f8d70ec9700 1 -- 172.21.15.79:0/3044815277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d6c0bb260 msgr2=0x7f8d6c19b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.014 7f8d70ec9700 1 --2- 172.21.15.79:0/3044815277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d6c0bb260 0x7f8d6c19b9e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f8d6c097160 tx=0x7f8d5c00cae0).stop 2021-04-09T18:29:50.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.014 7f8d70ec9700 1 -- 172.21.15.79:0/3044815277 shutdown_connections 2021-04-09T18:29:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.014 7f8d70ec9700 1 --2- 172.21.15.79:0/3044815277 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8d48029100 0x7f8d4802b650 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.014 7f8d70ec9700 1 --2- 172.21.15.79:0/3044815277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d6c19ce80 0x7f8d6c19d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.014 7f8d70ec9700 1 --2- 172.21.15.79:0/3044815277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d6c0bb260 0x7f8d6c19b9e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.014 7f8d70ec9700 1 --2- 172.21.15.79:0/3044815277 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d6c19c280 0x7f8d6c19eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.014 7f8d70ec9700 1 -- 172.21.15.79:0/3044815277 >> 172.21.15.79:0/3044815277 conn(0x7f8d6c0a7150 msgr2=0x7f8d6c0d8100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.014 7f8d70ec9700 1 -- 172.21.15.79:0/3044815277 shutdown_connections 2021-04-09T18:29:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.014 7f8d70ec9700 1 -- 172.21.15.79:0/3044815277 wait complete. 2021-04-09T18:29:50.056 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:29:50.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.146 7f8d89838700 1 Processor -- start 2021-04-09T18:29:50.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.146 7f8d89838700 1 -- start start 2021-04-09T18:29:50.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.146 7f8d89838700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8d840e9ad0 0x7f8d8409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.146 7f8d89838700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d840fbb10 con 0x7f8d841c8000 2021-04-09T18:29:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.146 7f8d89838700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d840e56c0 con 0x7f8d840f5510 2021-04-09T18:29:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.146 7f8d89838700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d841c3db0 con 0x7f8d840e9ad0 2021-04-09T18:29:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.146 7f8d82d4f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8d840e9ad0 0x7f8d8409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.146 7f8d83d51700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8d841c8000 0x7f8d841ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52902/0 (socket says 172.21.15.79:52902) 2021-04-09T18:29:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.146 7f8d83d51700 1 -- 172.21.15.79:0/4027354782 learned_addr learned my addr 172.21.15.79:0/4027354782 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:50.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.150 7f8d82d4f700 1 -- 172.21.15.79:0/4027354782 >> v1:172.21.15.89:6789/0 conn(0x7f8d840f5510 legacy=0x7f8d840f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.150 7f8d82d4f700 1 -- 172.21.15.79:0/4027354782 >> v1:172.21.15.79:6789/0 conn(0x7f8d841c8000 legacy=0x7f8d841ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.150 7f8d8254e700 1 -- 172.21.15.79:0/4027354782 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014981354 0 0) 0x7f8d7c001450 con 0x7f8d841c8000 2021-04-09T18:29:50.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.150 7f8d82d4f700 1 -- 172.21.15.79:0/4027354782 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d840e4320 con 0x7f8d840e9ad0 2021-04-09T18:29:50.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.150 7f8d82d4f700 1 --2- 172.21.15.79:0/4027354782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d840e9ad0 0x7f8d8409f100 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f8d78002f30 tx=0x7f8d7800bcc0).ready entity=mon.0 client_cookie=64f3e0237a32a48f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:50.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.150 7f8d8254e700 1 -- 172.21.15.79:0/4027354782 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d840e4320 con 0x7f8d840e9ad0 2021-04-09T18:29:50.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.150 7f8d8254e700 1 -- 172.21.15.79:0/4027354782 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d78009800 con 0x7f8d840e9ad0 2021-04-09T18:29:50.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.150 7f8d8254e700 1 -- 172.21.15.79:0/4027354782 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d78009bd0 con 0x7f8d840e9ad0 2021-04-09T18:29:50.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.150 7f8d89838700 1 -- 172.21.15.79:0/4027354782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d840e9ad0 msgr2=0x7f8d8409f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.150 7f8d89838700 1 --2- 172.21.15.79:0/4027354782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d840e9ad0 0x7f8d8409f100 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f8d78002f30 tx=0x7f8d7800bcc0).stop 2021-04-09T18:29:50.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.150 7f8d89838700 1 -- 172.21.15.79:0/4027354782 shutdown_connections 2021-04-09T18:29:50.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.150 7f8d89838700 1 --2- 172.21.15.79:0/4027354782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d840e9ad0 0x7f8d8409f100 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.150 7f8d89838700 1 -- 172.21.15.79:0/4027354782 >> 172.21.15.79:0/4027354782 conn(0x7f8d840e5fd0 msgr2=0x7f8d840e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:50.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.150 7f8d89838700 1 -- 172.21.15.79:0/4027354782 shutdown_connections 2021-04-09T18:29:50.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.150 7f8d89838700 1 -- 172.21.15.79:0/4027354782 wait complete. 2021-04-09T18:29:50.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.154 7f8d89838700 1 Processor -- start 2021-04-09T18:29:50.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.154 7f8d89838700 1 -- start start 2021-04-09T18:29:50.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.154 7f8d89838700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d840ac800 0x7f8d840af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:50.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.154 7f8d89838700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d84098800 0x7f8d84098c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:50.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.154 7f8d89838700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d840d4bf0 0x7f8d840d5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:50.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.154 7f8d89838700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d840e9f20 con 0x7f8d84098800 2021-04-09T18:29:50.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.154 7f8d89838700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d840c4910 con 0x7f8d840ac800 2021-04-09T18:29:50.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.154 7f8d89838700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d840acc50 con 0x7f8d840d4bf0 2021-04-09T18:29:50.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.154 7f8d82d4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d84098800 0x7f8d84098c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:50.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.154 7f8d82d4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d84098800 0x7f8d84098c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58198/0 (socket says 172.21.15.79:58198) 2021-04-09T18:29:50.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.154 7f8d82d4f700 1 -- 172.21.15.79:0/48728806 learned_addr learned my addr 172.21.15.79:0/48728806 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:50.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.158 7f8d83550700 1 --2- 172.21.15.79:0/48728806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d840ac800 0x7f8d840af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:50.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.158 7f8d83d51700 1 --2- 172.21.15.79:0/48728806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d840d4bf0 0x7f8d840d5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:50.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.158 7f8d82d4f700 1 -- 172.21.15.79:0/48728806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d840d4bf0 msgr2=0x7f8d840d5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.158 7f8d82d4f700 1 --2- 172.21.15.79:0/48728806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d840d4bf0 0x7f8d840d5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.158 7f8d82d4f700 1 -- 172.21.15.79:0/48728806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d840ac800 msgr2=0x7f8d840af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.158 7f8d82d4f700 1 --2- 172.21.15.79:0/48728806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d840ac800 0x7f8d840af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.158 7f8d82d4f700 1 -- 172.21.15.79:0/48728806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d840af6f0 con 0x7f8d84098800 2021-04-09T18:29:50.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.158 7f8d83550700 1 --2- 172.21.15.79:0/48728806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d840ac800 0x7f8d840af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:29:50.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.158 7f8d82d4f700 1 --2- 172.21.15.79:0/48728806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d84098800 0x7f8d84098c50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f8d78002f30 tx=0x7f8d78006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:50.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.158 7f8d6bfff700 1 -- 172.21.15.79:0/48728806 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d840af6f0 con 0x7f8d84098800 2021-04-09T18:29:50.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.158 7f8d89838700 1 -- 172.21.15.79:0/48728806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d84099450 con 0x7f8d84098800 2021-04-09T18:29:50.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.158 7f8d6bfff700 1 -- 172.21.15.79:0/48728806 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d78011d90 con 0x7f8d84098800 2021-04-09T18:29:50.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.158 7f8d6bfff700 1 -- 172.21.15.79:0/48728806 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d7801d670 con 0x7f8d84098800 2021-04-09T18:29:50.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.158 7f8d89838700 1 -- 172.21.15.79:0/48728806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d841af660 con 0x7f8d84098800 2021-04-09T18:29:50.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.158 7f8d6bfff700 1 -- 172.21.15.79:0/48728806 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8d7801c3e0 con 0x7f8d84098800 2021-04-09T18:29:50.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.158 7f8d6bfff700 1 --2- 172.21.15.79:0/48728806 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8d64029100 0x7f8d6402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:50.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.158 7f8d6bfff700 1 -- 172.21.15.79:0/48728806 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f8d7803ac30 con 0x7f8d84098800 2021-04-09T18:29:50.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.158 7f8d83550700 1 --2- 172.21.15.79:0/48728806 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8d64029100 0x7f8d6402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:50.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.158 7f8d89838700 1 -- 172.21.15.79:0/48728806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d840e39d0 con 0x7f8d84098800 2021-04-09T18:29:50.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.158 7f8d83550700 1 --2- 172.21.15.79:0/48728806 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8d64029100 0x7f8d6402b650 crc :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:50.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.162 7f8d6bfff700 1 -- 172.21.15.79:0/48728806 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8d780095f0 con 0x7f8d84098800 2021-04-09T18:29:50.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.330 7f8d89838700 1 -- 172.21.15.79:0/48728806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d840a1cb0 con 0x7f8d84098800 2021-04-09T18:29:50.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.330 7f8d6bfff700 1 -- 172.21.15.79:0/48728806 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+11377 (secure 0 0 0) 0x7f8d78011b80 con 0x7f8d84098800 2021-04-09T18:29:50.335 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:29:50.335 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":45,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:29:49.681414","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:29:50.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.334 7f8d89838700 1 -- 172.21.15.79:0/48728806 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8d64029100 msgr2=0x7f8d6402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.334 7f8d89838700 1 --2- 172.21.15.79:0/48728806 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8d64029100 0x7f8d6402b650 crc :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.334 7f8d89838700 1 -- 172.21.15.79:0/48728806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d84098800 msgr2=0x7f8d84098c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.334 7f8d89838700 1 --2- 172.21.15.79:0/48728806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d84098800 0x7f8d84098c50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f8d78002f30 tx=0x7f8d78006890).stop 2021-04-09T18:29:50.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.334 7f8d89838700 1 -- 172.21.15.79:0/48728806 shutdown_connections 2021-04-09T18:29:50.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.334 7f8d89838700 1 --2- 172.21.15.79:0/48728806 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8d64029100 0x7f8d6402b650 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.334 7f8d89838700 1 --2- 172.21.15.79:0/48728806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d840ac800 0x7f8d840af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.334 7f8d89838700 1 --2- 172.21.15.79:0/48728806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d840d4bf0 0x7f8d840d5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.334 7f8d89838700 1 --2- 172.21.15.79:0/48728806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d84098800 0x7f8d84098c50 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.334 7f8d89838700 1 -- 172.21.15.79:0/48728806 >> 172.21.15.79:0/48728806 conn(0x7f8d8409b020 msgr2=0x7f8d840ba6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:50.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.334 7f8d89838700 1 -- 172.21.15.79:0/48728806 shutdown_connections 2021-04-09T18:29:50.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.334 7f8d89838700 1 -- 172.21.15.79:0/48728806 wait complete. 2021-04-09T18:29:50.348 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-04-09T18:29:50.348 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:29:50.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.438 7f8b40140700 1 Processor -- start 2021-04-09T18:29:50.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.438 7f8b40140700 1 -- start start 2021-04-09T18:29:50.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.438 7f8b40140700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8b381c9040 0x7f8b381cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:50.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.438 7f8b40140700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b380fbb40 con 0x7f8b380f5540 2021-04-09T18:29:50.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.438 7f8b40140700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b3809f900 con 0x7f8b380e9b00 2021-04-09T18:29:50.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.438 7f8b40140700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b381c3de0 con 0x7f8b381c9040 2021-04-09T18:29:50.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.438 7f8b3e6e5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8b381c9040 0x7f8b381cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:50.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.438 7f8b3dee4700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8b380f5540 0x7f8b380f64d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52912/0 (socket says 172.21.15.79:52912) 2021-04-09T18:29:50.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.442 7f8b3dee4700 1 -- 172.21.15.79:0/3439888659 learned_addr learned my addr 172.21.15.79:0/3439888659 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:50.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.442 7f8b3e6e5700 1 -- 172.21.15.79:0/3439888659 >> v1:172.21.15.89:6789/0 conn(0x7f8b380e9b00 legacy=0x7f8b3809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.442 7f8b3e6e5700 1 -- 172.21.15.79:0/3439888659 >> v1:172.21.15.79:6789/0 conn(0x7f8b380f5540 legacy=0x7f8b380f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.442 7f8b3cee2700 1 -- 172.21.15.79:0/3439888659 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 12296720 0 0) 0x7f8b2c0010d0 con 0x7f8b380f5540 2021-04-09T18:29:50.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.442 7f8b3e6e5700 1 -- 172.21.15.79:0/3439888659 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b380e56f0 con 0x7f8b381c9040 2021-04-09T18:29:50.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.442 7f8b3e6e5700 1 --2- 172.21.15.79:0/3439888659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b381c9040 0x7f8b381cb4a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f8b300032b0 tx=0x7f8b3000b0e0).ready entity=mon.0 client_cookie=e85cbf58a0bd5990 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:50.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.442 7f8b3cee2700 1 -- 172.21.15.79:0/3439888659 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b380e56f0 con 0x7f8b381c9040 2021-04-09T18:29:50.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.442 7f8b3cee2700 1 -- 172.21.15.79:0/3439888659 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3000bab0 con 0x7f8b381c9040 2021-04-09T18:29:50.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.442 7f8b3cee2700 1 -- 172.21.15.79:0/3439888659 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b30002020 con 0x7f8b381c9040 2021-04-09T18:29:50.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.442 7f8b40140700 1 -- 172.21.15.79:0/3439888659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b381c9040 msgr2=0x7f8b381cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.442 7f8b40140700 1 --2- 172.21.15.79:0/3439888659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b381c9040 0x7f8b381cb4a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f8b300032b0 tx=0x7f8b3000b0e0).stop 2021-04-09T18:29:50.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.442 7f8b40140700 1 -- 172.21.15.79:0/3439888659 shutdown_connections 2021-04-09T18:29:50.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.442 7f8b40140700 1 --2- 172.21.15.79:0/3439888659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b381c9040 0x7f8b381cb4a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.442 7f8b40140700 1 -- 172.21.15.79:0/3439888659 >> 172.21.15.79:0/3439888659 conn(0x7f8b380e6000 msgr2=0x7f8b380e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:50.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.442 7f8b40140700 1 -- 172.21.15.79:0/3439888659 shutdown_connections 2021-04-09T18:29:50.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.442 7f8b40140700 1 -- 172.21.15.79:0/3439888659 wait complete. 2021-04-09T18:29:50.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b40140700 1 Processor -- start 2021-04-09T18:29:50.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b40140700 1 -- start start 2021-04-09T18:29:50.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b40140700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b380adc20 0x7f8b380c0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:50.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b40140700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b380ae070 0x7f8b380a8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:50.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b40140700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b380a8f40 0x7f8b381d2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:50.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b40140700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b380e9f50 con 0x7f8b380a8f40 2021-04-09T18:29:50.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b40140700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b380c0b40 con 0x7f8b380adc20 2021-04-09T18:29:50.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b40140700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b38096550 con 0x7f8b380ae070 2021-04-09T18:29:50.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b3e6e5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b380a8f40 0x7f8b381d2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:50.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b3dee4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b380adc20 0x7f8b380c0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:50.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b3e6e5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b380a8f40 0x7f8b381d2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58212/0 (socket says 172.21.15.79:58212) 2021-04-09T18:29:50.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b3e6e5700 1 -- 172.21.15.79:0/138648353 learned_addr learned my addr 172.21.15.79:0/138648353 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:50.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b3d6e3700 1 --2- 172.21.15.79:0/138648353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b380ae070 0x7f8b380a8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:50.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b3e6e5700 1 -- 172.21.15.79:0/138648353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b380ae070 msgr2=0x7f8b380a8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b3e6e5700 1 --2- 172.21.15.79:0/138648353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b380ae070 0x7f8b380a8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b3e6e5700 1 -- 172.21.15.79:0/138648353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b380adc20 msgr2=0x7f8b380c0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b3e6e5700 1 --2- 172.21.15.79:0/138648353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b380adc20 0x7f8b380c0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b3e6e5700 1 -- 172.21.15.79:0/138648353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b380c0310 con 0x7f8b380a8f40 2021-04-09T18:29:50.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b3d6e3700 1 --2- 172.21.15.79:0/138648353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b380ae070 0x7f8b380a8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:29:50.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b3e6e5700 1 --2- 172.21.15.79:0/138648353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b380a8f40 0x7f8b381d2bf0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f8b380bb1b0 tx=0x7f8b30006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:50.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b2a7fc700 1 -- 172.21.15.79:0/138648353 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b380c0310 con 0x7f8b380a8f40 2021-04-09T18:29:50.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b2a7fc700 1 -- 172.21.15.79:0/138648353 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3001f020 con 0x7f8b380a8f40 2021-04-09T18:29:50.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b2a7fc700 1 -- 172.21.15.79:0/138648353 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b3001b830 con 0x7f8b380a8f40 2021-04-09T18:29:50.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b40140700 1 -- 172.21.15.79:0/138648353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b380c06d0 con 0x7f8b380a8f40 2021-04-09T18:29:50.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.446 7f8b40140700 1 -- 172.21.15.79:0/138648353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b380c1470 con 0x7f8b380a8f40 2021-04-09T18:29:50.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.450 7f8b2a7fc700 1 -- 172.21.15.79:0/138648353 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8b30009ce0 con 0x7f8b380a8f40 2021-04-09T18:29:50.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.450 7f8b2a7fc700 1 --2- 172.21.15.79:0/138648353 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b20029100 0x7f8b2002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:50.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.450 7f8b2a7fc700 1 -- 172.21.15.79:0/138648353 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f8b3003bad0 con 0x7f8b380a8f40 2021-04-09T18:29:50.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.450 7f8b3dee4700 1 --2- 172.21.15.79:0/138648353 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b20029100 0x7f8b2002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:50.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.450 7f8b3dee4700 1 --2- 172.21.15.79:0/138648353 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b20029100 0x7f8b2002b650 crc :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:50.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.454 7f8b40140700 1 -- 172.21.15.79:0/138648353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b380e39e0 con 0x7f8b380a8f40 2021-04-09T18:29:50.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.462 7f8b2a7fc700 1 -- 172.21.15.79:0/138648353 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8b3000b8a0 con 0x7f8b380a8f40 2021-04-09T18:29:50.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.622 7f8b40140700 1 -- 172.21.15.79:0/138648353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f8b380a1c80 con 0x7f8b380a8f40 2021-04-09T18:29:50.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.622 7f8b2a7fc700 1 -- 172.21.15.79:0/138648353 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v45) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8b3001b430 con 0x7f8b380a8f40 2021-04-09T18:29:50.626 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:29:50.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.626 7f8b40140700 1 -- 172.21.15.79:0/138648353 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b20029100 msgr2=0x7f8b2002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.626 7f8b40140700 1 --2- 172.21.15.79:0/138648353 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b20029100 0x7f8b2002b650 crc :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.626 7f8b40140700 1 -- 172.21.15.79:0/138648353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b380a8f40 msgr2=0x7f8b381d2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.626 7f8b40140700 1 --2- 172.21.15.79:0/138648353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b380a8f40 0x7f8b381d2bf0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f8b380bb1b0 tx=0x7f8b30006c10).stop 2021-04-09T18:29:50.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.626 7f8b40140700 1 -- 172.21.15.79:0/138648353 shutdown_connections 2021-04-09T18:29:50.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.626 7f8b40140700 1 --2- 172.21.15.79:0/138648353 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b20029100 0x7f8b2002b650 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.626 7f8b40140700 1 --2- 172.21.15.79:0/138648353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b380adc20 0x7f8b380c0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.626 7f8b40140700 1 --2- 172.21.15.79:0/138648353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b380a8f40 0x7f8b381d2bf0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.626 7f8b40140700 1 --2- 172.21.15.79:0/138648353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b380ae070 0x7f8b380a8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.626 7f8b40140700 1 -- 172.21.15.79:0/138648353 >> 172.21.15.79:0/138648353 conn(0x7f8b38098090 msgr2=0x7f8b38097530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:50.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.626 7f8b40140700 1 -- 172.21.15.79:0/138648353 shutdown_connections 2021-04-09T18:29:50.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.626 7f8b40140700 1 -- 172.21.15.79:0/138648353 wait complete. 2021-04-09T18:29:50.638 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-04-09T18:29:50.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.718 7fd24b680700 1 Processor -- start 2021-04-09T18:29:50.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.718 7fd24b680700 1 -- start start 2021-04-09T18:29:50.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.718 7fd24b680700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd2440e9ad0 0x7fd24409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:50.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.718 7fd24b680700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2440fbb10 con 0x7fd2440f5510 2021-04-09T18:29:50.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.718 7fd24b680700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2440e56c0 con 0x7fd2441c8000 2021-04-09T18:29:50.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.718 7fd24b680700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2441c3db0 con 0x7fd2440e9ad0 2021-04-09T18:29:50.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.722 7fd249424700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd2440f5510 0x7fd2440f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52926/0 (socket says 172.21.15.79:52926) 2021-04-09T18:29:50.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.722 7fd249424700 1 -- 172.21.15.79:0/2503598606 learned_addr learned my addr 172.21.15.79:0/2503598606 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:50.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.722 7fd248c23700 1 --2- 172.21.15.79:0/2503598606 >> v2:172.21.15.79:3300/0 conn(0x7fd2440e9ad0 0x7fd24409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:50.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.722 7fd243fff700 1 -- 172.21.15.79:0/2503598606 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418463223 0 0) 0x7fd234001450 con 0x7fd2440f5510 2021-04-09T18:29:50.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.722 7fd243fff700 1 -- 172.21.15.79:0/2503598606 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd22c003240 con 0x7fd2440f5510 2021-04-09T18:29:50.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.722 7fd248c23700 1 -- 172.21.15.79:0/2503598606 >> v1:172.21.15.89:6789/0 conn(0x7fd2441c8000 legacy=0x7fd2441ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.722 7fd243fff700 1 -- 172.21.15.79:0/2503598606 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992237504 0 0) 0x7fd23c0010d0 con 0x7fd2441c8000 2021-04-09T18:29:50.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.722 7fd248c23700 1 -- 172.21.15.79:0/2503598606 >> v1:172.21.15.79:6789/0 conn(0x7fd2440f5510 legacy=0x7fd2440f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.722 7fd248c23700 1 -- 172.21.15.79:0/2503598606 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2440e4320 con 0x7fd2440e9ad0 2021-04-09T18:29:50.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.722 7fd248c23700 1 --2- 172.21.15.79:0/2503598606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2440e9ad0 0x7fd24409f100 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fd238002f30 tx=0x7fd23800bcc0).ready entity=mon.0 client_cookie=15ca485ccf82223 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:50.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.722 7fd243fff700 1 -- 172.21.15.79:0/2503598606 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd2440e4320 con 0x7fd2440e9ad0 2021-04-09T18:29:50.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.722 7fd243fff700 1 -- 172.21.15.79:0/2503598606 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd238009800 con 0x7fd2440e9ad0 2021-04-09T18:29:50.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.722 7fd243fff700 1 -- 172.21.15.79:0/2503598606 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd238009bd0 con 0x7fd2440e9ad0 2021-04-09T18:29:50.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.722 7fd24b680700 1 -- 172.21.15.79:0/2503598606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2440e9ad0 msgr2=0x7fd24409f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.722 7fd24b680700 1 --2- 172.21.15.79:0/2503598606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2440e9ad0 0x7fd24409f100 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fd238002f30 tx=0x7fd23800bcc0).stop 2021-04-09T18:29:50.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.722 7fd24b680700 1 -- 172.21.15.79:0/2503598606 shutdown_connections 2021-04-09T18:29:50.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.722 7fd24b680700 1 --2- 172.21.15.79:0/2503598606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2440e9ad0 0x7fd24409f100 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.722 7fd24b680700 1 -- 172.21.15.79:0/2503598606 >> 172.21.15.79:0/2503598606 conn(0x7fd2440e5fd0 msgr2=0x7fd2440e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:50.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.722 7fd24b680700 1 -- 172.21.15.79:0/2503598606 shutdown_connections 2021-04-09T18:29:50.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.722 7fd24b680700 1 -- 172.21.15.79:0/2503598606 wait complete. 2021-04-09T18:29:50.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd24b680700 1 Processor -- start 2021-04-09T18:29:50.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd24b680700 1 -- start start 2021-04-09T18:29:50.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd24b680700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2440992f0 0x7fd2440c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:50.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd24b680700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24419d700 0x7fd2440a30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:50.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd24b680700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2440a2740 0x7fd2440d4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:50.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd24b680700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440e9f20 con 0x7fd2440992f0 2021-04-09T18:29:50.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd24b680700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24419bc40 con 0x7fd2440a2740 2021-04-09T18:29:50.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd24b680700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24419bf40 con 0x7fd24419d700 2021-04-09T18:29:50.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd249424700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2440992f0 0x7fd2440c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:50.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd249424700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2440992f0 0x7fd2440c3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58222/0 (socket says 172.21.15.79:58222) 2021-04-09T18:29:50.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd249424700 1 -- 172.21.15.79:0/1766209543 learned_addr learned my addr 172.21.15.79:0/1766209543 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:50.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd248c23700 1 --2- 172.21.15.79:0/1766209543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24419d700 0x7fd2440a30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:50.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd249c25700 1 --2- 172.21.15.79:0/1766209543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2440a2740 0x7fd2440d4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:50.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd249424700 1 -- 172.21.15.79:0/1766209543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24419d700 msgr2=0x7fd2440a30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd249424700 1 --2- 172.21.15.79:0/1766209543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24419d700 0x7fd2440a30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd249424700 1 -- 172.21.15.79:0/1766209543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2440a2740 msgr2=0x7fd2440d4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd249424700 1 --2- 172.21.15.79:0/1766209543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2440a2740 0x7fd2440d4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd249424700 1 -- 172.21.15.79:0/1766209543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2440a2b90 con 0x7fd2440992f0 2021-04-09T18:29:50.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd248c23700 1 --2- 172.21.15.79:0/1766209543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24419d700 0x7fd2440a30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:29:50.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd249424700 1 --2- 172.21.15.79:0/1766209543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2440992f0 0x7fd2440c3fb0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fd24419bbc0 tx=0x7fd23400cec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:50.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.726 7fd241ffb700 1 -- 172.21.15.79:0/1766209543 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd2440a2b90 con 0x7fd2440992f0 2021-04-09T18:29:50.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.730 7fd241ffb700 1 -- 172.21.15.79:0/1766209543 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd234005b80 con 0x7fd2440992f0 2021-04-09T18:29:50.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.730 7fd241ffb700 1 -- 172.21.15.79:0/1766209543 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd234007110 con 0x7fd2440992f0 2021-04-09T18:29:50.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.730 7fd24b680700 1 -- 172.21.15.79:0/1766209543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2440d5380 con 0x7fd2440992f0 2021-04-09T18:29:50.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.730 7fd24b680700 1 -- 172.21.15.79:0/1766209543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2440d58f0 con 0x7fd2440992f0 2021-04-09T18:29:50.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.730 7fd241ffb700 1 -- 172.21.15.79:0/1766209543 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd23401a060 con 0x7fd2440992f0 2021-04-09T18:29:50.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.730 7fd241ffb700 1 --2- 172.21.15.79:0/1766209543 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd224029100 0x7fd22402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:50.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.730 7fd241ffb700 1 -- 172.21.15.79:0/1766209543 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fd234038ca0 con 0x7fd2440992f0 2021-04-09T18:29:50.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.730 7fd248c23700 1 --2- 172.21.15.79:0/1766209543 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd224029100 0x7fd22402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:50.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.730 7fd248c23700 1 --2- 172.21.15.79:0/1766209543 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd224029100 0x7fd22402b650 crc :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:50.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.734 7fd24b680700 1 -- 172.21.15.79:0/1766209543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2440e39d0 con 0x7fd2440992f0 2021-04-09T18:29:50.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.738 7fd241ffb700 1 -- 172.21.15.79:0/1766209543 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd244107f40 con 0x7fd2440992f0 2021-04-09T18:29:50.898 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.894 7fd24b680700 1 -- 172.21.15.79:0/1766209543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd2440a1cb0 con 0x7fd2440992f0 2021-04-09T18:29:50.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.898 7fd241ffb700 1 -- 172.21.15.79:0/1766209543 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v45) v1 ==== 84+0+64 (secure 0 0 0) 0x7fd234005970 con 0x7fd2440992f0 2021-04-09T18:29:50.899 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:29:50.899 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2021-04-09T18:29:50.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:29:50.900 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2021-04-09T18:29:50.900 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": "rbd" 2021-04-09T18:29:50.900 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:29:50.901 INFO:teuthology.orchestra.run.smithi079.stdout:] 2021-04-09T18:29:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.898 7fd24b680700 1 -- 172.21.15.79:0/1766209543 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd224029100 msgr2=0x7fd22402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.898 7fd24b680700 1 --2- 172.21.15.79:0/1766209543 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd224029100 0x7fd22402b650 crc :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.898 7fd24b680700 1 -- 172.21.15.79:0/1766209543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2440992f0 msgr2=0x7fd2440c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.898 7fd24b680700 1 --2- 172.21.15.79:0/1766209543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2440992f0 0x7fd2440c3fb0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fd24419bbc0 tx=0x7fd23400cec0).stop 2021-04-09T18:29:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.898 7fd24b680700 1 -- 172.21.15.79:0/1766209543 shutdown_connections 2021-04-09T18:29:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.898 7fd24b680700 1 --2- 172.21.15.79:0/1766209543 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd224029100 0x7fd22402b650 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.898 7fd24b680700 1 --2- 172.21.15.79:0/1766209543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2440a2740 0x7fd2440d4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.898 7fd24b680700 1 --2- 172.21.15.79:0/1766209543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2440992f0 0x7fd2440c3fb0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.898 7fd24b680700 1 --2- 172.21.15.79:0/1766209543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24419d700 0x7fd2440a30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:50.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.898 7fd24b680700 1 -- 172.21.15.79:0/1766209543 >> 172.21.15.79:0/1766209543 conn(0x7fd24409b0a0 msgr2=0x7fd24409a600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:50.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.898 7fd24b680700 1 -- 172.21.15.79:0/1766209543 shutdown_connections 2021-04-09T18:29:50.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:50.898 7fd24b680700 1 -- 172.21.15.79:0/1766209543 wait complete. 2021-04-09T18:29:50.911 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-04-09T18:29:50.912 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-04-09T18:29:51.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.002 7fd5c4d1c700 1 Processor -- start 2021-04-09T18:29:51.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.002 7fd5c4d1c700 1 -- start start 2021-04-09T18:29:51.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.002 7fd5c4d1c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd5c00e9b10 0x7fd5c009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:51.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.002 7fd5c4d1c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5c01c8040 0x7fd5c01ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:51.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.002 7fd5c4d1c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c00fbb50 con 0x7fd5c00f5550 2021-04-09T18:29:51.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5c4d1c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c01c3df0 con 0x7fd5c00e9b10 2021-04-09T18:29:51.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5c4d1c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c00e9f60 con 0x7fd5c01c8040 2021-04-09T18:29:51.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5bea94700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd5c00f5550 0x7fd5c00f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52940/0 (socket says 172.21.15.79:52940) 2021-04-09T18:29:51.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5bea94700 1 -- 172.21.15.79:0/2382169260 learned_addr learned my addr 172.21.15.79:0/2382169260 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:51.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5bf295700 1 --2- 172.21.15.79:0/2382169260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5c01c8040 0x7fd5c01ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:51.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5be293700 1 --2- 172.21.15.79:0/2382169260 >> v2:172.21.15.89:3300/0 conn(0x7fd5c00e9b10 0x7fd5c009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:51.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5bda92700 1 -- 172.21.15.79:0/2382169260 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018309594 0 0) 0x7fd5b00010d0 con 0x7fd5c00f5550 2021-04-09T18:29:51.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5bda92700 1 -- 172.21.15.79:0/2382169260 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5a8003240 con 0x7fd5c00f5550 2021-04-09T18:29:51.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5bf295700 1 -- 172.21.15.79:0/2382169260 >> v2:172.21.15.89:3300/0 conn(0x7fd5c00e9b10 msgr2=0x7fd5c009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:51.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5bf295700 1 --2- 172.21.15.79:0/2382169260 >> v2:172.21.15.89:3300/0 conn(0x7fd5c00e9b10 0x7fd5c009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:51.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5bf295700 1 -- 172.21.15.79:0/2382169260 >> v1:172.21.15.79:6789/0 conn(0x7fd5c00f5550 legacy=0x7fd5c00f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:51.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5bf295700 1 -- 172.21.15.79:0/2382169260 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c00e5700 con 0x7fd5c01c8040 2021-04-09T18:29:51.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5bf295700 1 --2- 172.21.15.79:0/2382169260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5c01c8040 0x7fd5c01ca4a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fd5b80032b0 tx=0x7fd5b800b0e0).ready entity=mon.2 client_cookie=34064f7ac47fa338 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:51.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5bda92700 1 -- 172.21.15.79:0/2382169260 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd5c00e5700 con 0x7fd5c01c8040 2021-04-09T18:29:51.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5bda92700 1 -- 172.21.15.79:0/2382169260 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b800bab0 con 0x7fd5c01c8040 2021-04-09T18:29:51.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5bda92700 1 -- 172.21.15.79:0/2382169260 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd5b8002020 con 0x7fd5c01c8040 2021-04-09T18:29:51.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5c4d1c700 1 -- 172.21.15.79:0/2382169260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5c01c8040 msgr2=0x7fd5c01ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:51.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5c4d1c700 1 --2- 172.21.15.79:0/2382169260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5c01c8040 0x7fd5c01ca4a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fd5b80032b0 tx=0x7fd5b800b0e0).stop 2021-04-09T18:29:51.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5c4d1c700 1 -- 172.21.15.79:0/2382169260 shutdown_connections 2021-04-09T18:29:51.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5c4d1c700 1 --2- 172.21.15.79:0/2382169260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5c01c8040 0x7fd5c01ca4a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:51.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5c4d1c700 1 --2- 172.21.15.79:0/2382169260 >> v2:172.21.15.89:3300/0 conn(0x7fd5c00e9b10 0x7fd5c009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:51.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5c4d1c700 1 -- 172.21.15.79:0/2382169260 >> 172.21.15.79:0/2382169260 conn(0x7fd5c00e6010 msgr2=0x7fd5c00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:51.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5c4d1c700 1 -- 172.21.15.79:0/2382169260 shutdown_connections 2021-04-09T18:29:51.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.006 7fd5c4d1c700 1 -- 172.21.15.79:0/2382169260 wait complete. 2021-04-09T18:29:51.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.010 7fd5c4d1c700 1 Processor -- start 2021-04-09T18:29:51.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.010 7fd5c4d1c700 1 -- start start 2021-04-09T18:29:51.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.010 7fd5c4d1c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5c00c6d90 0x7fd5c00a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:51.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.010 7fd5c4d1c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5c00c4b60 0x7fd5c00c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:51.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.010 7fd5c4d1c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5c00c3050 0x7fd5c00d4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:51.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.010 7fd5c4d1c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c00c52b0 con 0x7fd5c00c6d90 2021-04-09T18:29:51.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.010 7fd5c4d1c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c00c4fb0 con 0x7fd5c00c3050 2021-04-09T18:29:51.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.010 7fd5c4d1c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c00c55b0 con 0x7fd5c00c4b60 2021-04-09T18:29:51.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.010 7fd5bea94700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5c00c6d90 0x7fd5c00a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.014 7fd5bea94700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5c00c6d90 0x7fd5c00a9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58236/0 (socket says 172.21.15.79:58236) 2021-04-09T18:29:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.014 7fd5bea94700 1 -- 172.21.15.79:0/165690472 learned_addr learned my addr 172.21.15.79:0/165690472 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.014 7fd5be293700 1 --2- 172.21.15.79:0/165690472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5c00c4b60 0x7fd5c00c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.014 7fd5bf295700 1 --2- 172.21.15.79:0/165690472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5c00c3050 0x7fd5c00d4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.014 7fd5bea94700 1 -- 172.21.15.79:0/165690472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5c00c4b60 msgr2=0x7fd5c00c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.014 7fd5bea94700 1 --2- 172.21.15.79:0/165690472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5c00c4b60 0x7fd5c00c40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.014 7fd5bea94700 1 -- 172.21.15.79:0/165690472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5c00c3050 msgr2=0x7fd5c00d4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.014 7fd5bea94700 1 --2- 172.21.15.79:0/165690472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5c00c3050 0x7fd5c00d4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.014 7fd5bea94700 1 -- 172.21.15.79:0/165690472 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c00c46d0 con 0x7fd5c00c6d90 2021-04-09T18:29:51.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.014 7fd5bea94700 1 --2- 172.21.15.79:0/165690472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5c00c6d90 0x7fd5c00a9b40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fd5c00d7fd0 tx=0x7fd5b000cb10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:51.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.014 7fd5af7fe700 1 -- 172.21.15.79:0/165690472 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd5c00c46d0 con 0x7fd5c00c6d90 2021-04-09T18:29:51.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.014 7fd5af7fe700 1 -- 172.21.15.79:0/165690472 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b00072e0 con 0x7fd5c00c6d90 2021-04-09T18:29:51.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.014 7fd5c4d1c700 1 -- 172.21.15.79:0/165690472 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c00c34a0 con 0x7fd5c00c6d90 2021-04-09T18:29:51.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.014 7fd5af7fe700 1 -- 172.21.15.79:0/165690472 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd5b00057e0 con 0x7fd5c00c6d90 2021-04-09T18:29:51.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.014 7fd5c4d1c700 1 -- 172.21.15.79:0/165690472 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c00d52d0 con 0x7fd5c00c6d90 2021-04-09T18:29:51.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.014 7fd5af7fe700 1 -- 172.21.15.79:0/165690472 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd5b00059e0 con 0x7fd5c00c6d90 2021-04-09T18:29:51.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.014 7fd5af7fe700 1 --2- 172.21.15.79:0/165690472 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd5a4029100 0x7fd5a402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:51.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.014 7fd5af7fe700 1 -- 172.21.15.79:0/165690472 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fd5b0038b30 con 0x7fd5c00c6d90 2021-04-09T18:29:51.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.014 7fd5be293700 1 --2- 172.21.15.79:0/165690472 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd5a4029100 0x7fd5a402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:51.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.014 7fd5be293700 1 --2- 172.21.15.79:0/165690472 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd5a4029100 0x7fd5a402b650 crc :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:51.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.018 7fd5c4d1c700 1 -- 172.21.15.79:0/165690472 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c00e39f0 con 0x7fd5c00c6d90 2021-04-09T18:29:51.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.018 7fd5af7fe700 1 -- 172.21.15.79:0/165690472 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd5b00070d0 con 0x7fd5c00c6d90 2021-04-09T18:29:51.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.178 7fd5c4d1c700 1 -- 172.21.15.79:0/165690472 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7fd5c00f5b50 con 0x7fd5c00c6d90 2021-04-09T18:29:51.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.702 7fd5af7fe700 1 -- 172.21.15.79:0/165690472 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v46) v1 ==== 133+0+0 (secure 0 0 0) 0x7fd5c0107f80 con 0x7fd5c00c6d90 2021-04-09T18:29:51.746 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2021-04-09T18:29:51.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.746 7fd5c4d1c700 1 -- 172.21.15.79:0/165690472 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd5a4029100 msgr2=0x7fd5a402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:51.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.746 7fd5c4d1c700 1 --2- 172.21.15.79:0/165690472 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd5a4029100 0x7fd5a402b650 crc :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:51.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.746 7fd5c4d1c700 1 -- 172.21.15.79:0/165690472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5c00c6d90 msgr2=0x7fd5c00a9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:51.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.746 7fd5c4d1c700 1 --2- 172.21.15.79:0/165690472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5c00c6d90 0x7fd5c00a9b40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fd5c00d7fd0 tx=0x7fd5b000cb10).stop 2021-04-09T18:29:51.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.746 7fd5c4d1c700 1 -- 172.21.15.79:0/165690472 shutdown_connections 2021-04-09T18:29:51.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.750 7fd5c4d1c700 1 --2- 172.21.15.79:0/165690472 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd5a4029100 0x7fd5a402b650 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:51.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.750 7fd5c4d1c700 1 --2- 172.21.15.79:0/165690472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5c00c3050 0x7fd5c00d4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:51.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.750 7fd5c4d1c700 1 --2- 172.21.15.79:0/165690472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5c00c6d90 0x7fd5c00a9b40 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:51.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.750 7fd5c4d1c700 1 --2- 172.21.15.79:0/165690472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5c00c4b60 0x7fd5c00c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:51.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.750 7fd5c4d1c700 1 -- 172.21.15.79:0/165690472 >> 172.21.15.79:0/165690472 conn(0x7fd5c009b1e0 msgr2=0x7fd5c00d80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:51.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.750 7fd5c4d1c700 1 -- 172.21.15.79:0/165690472 shutdown_connections 2021-04-09T18:29:51.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.750 7fd5c4d1c700 1 -- 172.21.15.79:0/165690472 wait complete. 2021-04-09T18:29:51.769 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-04-09T18:29:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.870 7f0d5930e700 1 Processor -- start 2021-04-09T18:29:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.870 7f0d5930e700 1 -- start start 2021-04-09T18:29:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d5930e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0d540e9b10 0x7f0d5409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d5930e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d541c8040 0x7f0d541ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d5930e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d540fbb50 con 0x7f0d540f5550 2021-04-09T18:29:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d5930e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d541c3df0 con 0x7f0d540e9b10 2021-04-09T18:29:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d5930e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d540e9f60 con 0x7f0d541c8040 2021-04-09T18:29:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d52804700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0d540e9b10 0x7f0d5409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d52804700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0d540e9b10 0x7f0d5409f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58246/0 (socket says 172.21.15.79:58246) 2021-04-09T18:29:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d52804700 1 -- 172.21.15.79:0/791995698 learned_addr learned my addr 172.21.15.79:0/791995698 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d53806700 1 --2- 172.21.15.79:0/791995698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d541c8040 0x7f0d541ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d52804700 1 -- 172.21.15.79:0/791995698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d541c8040 msgr2=0x7f0d541ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d52804700 1 --2- 172.21.15.79:0/791995698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d541c8040 0x7f0d541ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d52804700 1 -- 172.21.15.79:0/791995698 >> v1:172.21.15.89:6789/0 conn(0x7f0d540f5550 legacy=0x7f0d540f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d52804700 1 -- 172.21.15.79:0/791995698 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d540e5700 con 0x7f0d540e9b10 2021-04-09T18:29:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d52804700 1 --2- 172.21.15.79:0/791995698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d540e9b10 0x7f0d5409f110 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f0d540f6f30 tx=0x7f0d4800bdd0).ready entity=mon.0 client_cookie=dc4d3dd634fc15f8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d52003700 1 -- 172.21.15.79:0/791995698 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d540e5700 con 0x7f0d540e9b10 2021-04-09T18:29:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d52003700 1 -- 172.21.15.79:0/791995698 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d48009990 con 0x7f0d540e9b10 2021-04-09T18:29:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d52003700 1 -- 172.21.15.79:0/791995698 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d48009d60 con 0x7f0d540e9b10 2021-04-09T18:29:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d5930e700 1 -- 172.21.15.79:0/791995698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d540e9b10 msgr2=0x7f0d5409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d5930e700 1 --2- 172.21.15.79:0/791995698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d540e9b10 0x7f0d5409f110 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f0d540f6f30 tx=0x7f0d4800bdd0).stop 2021-04-09T18:29:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d5930e700 1 -- 172.21.15.79:0/791995698 shutdown_connections 2021-04-09T18:29:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d5930e700 1 --2- 172.21.15.79:0/791995698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d541c8040 0x7f0d541ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d5930e700 1 --2- 172.21.15.79:0/791995698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d540e9b10 0x7f0d5409f110 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d5930e700 1 -- 172.21.15.79:0/791995698 >> 172.21.15.79:0/791995698 conn(0x7f0d540e6010 msgr2=0x7f0d540e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d5930e700 1 -- 172.21.15.79:0/791995698 shutdown_connections 2021-04-09T18:29:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.874 7f0d5930e700 1 -- 172.21.15.79:0/791995698 wait complete. 2021-04-09T18:29:51.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.878 7f0d5930e700 1 Processor -- start 2021-04-09T18:29:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.878 7f0d5930e700 1 -- start start 2021-04-09T18:29:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.878 7f0d5930e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d540be630 0x7f0d5409ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.878 7f0d5930e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d540bdc80 0x7f0d540d51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.878 7f0d5930e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d540be0d0 0x7f0d540977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.878 7f0d5930e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d540e5700 con 0x7f0d540be630 2021-04-09T18:29:51.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.878 7f0d5930e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d540c06a0 con 0x7f0d540be0d0 2021-04-09T18:29:51.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.878 7f0d5930e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d540c09a0 con 0x7f0d540bdc80 2021-04-09T18:29:51.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.878 7f0d53005700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d540be630 0x7f0d5409ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:51.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.878 7f0d53005700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d540be630 0x7f0d5409ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58250/0 (socket says 172.21.15.79:58250) 2021-04-09T18:29:51.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.878 7f0d53005700 1 -- 172.21.15.79:0/2148016669 learned_addr learned my addr 172.21.15.79:0/2148016669 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:51.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.878 7f0d52804700 1 --2- 172.21.15.79:0/2148016669 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d540bdc80 0x7f0d540d51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:51.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.878 7f0d53806700 1 --2- 172.21.15.79:0/2148016669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d540be0d0 0x7f0d540977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:51.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.878 7f0d53005700 1 -- 172.21.15.79:0/2148016669 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d540bdc80 msgr2=0x7f0d540d51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:51.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.878 7f0d53005700 1 --2- 172.21.15.79:0/2148016669 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d540bdc80 0x7f0d540d51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:51.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.878 7f0d53005700 1 -- 172.21.15.79:0/2148016669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d540be0d0 msgr2=0x7f0d540977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:51.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.878 7f0d53005700 1 --2- 172.21.15.79:0/2148016669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d540be0d0 0x7f0d540977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:51.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.878 7f0d53005700 1 -- 172.21.15.79:0/2148016669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d540c0170 con 0x7f0d540be630 2021-04-09T18:29:51.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.882 7f0d53005700 1 --2- 172.21.15.79:0/2148016669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d540be630 0x7f0d5409ad80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f0d540c0620 tx=0x7f0d4400cec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:51.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.882 7f0d3bfff700 1 -- 172.21.15.79:0/2148016669 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d540c0170 con 0x7f0d540be630 2021-04-09T18:29:51.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.882 7f0d5930e700 1 -- 172.21.15.79:0/2148016669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d540d5810 con 0x7f0d540be630 2021-04-09T18:29:51.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.882 7f0d3bfff700 1 -- 172.21.15.79:0/2148016669 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4400a7f0 con 0x7f0d540be630 2021-04-09T18:29:51.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.882 7f0d3bfff700 1 -- 172.21.15.79:0/2148016669 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d44003030 con 0x7f0d540be630 2021-04-09T18:29:51.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.882 7f0d5930e700 1 -- 172.21.15.79:0/2148016669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d54097de0 con 0x7f0d540be630 2021-04-09T18:29:51.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.882 7f0d3bfff700 1 -- 172.21.15.79:0/2148016669 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0d4400abc0 con 0x7f0d540be630 2021-04-09T18:29:51.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.882 7f0d3bfff700 1 --2- 172.21.15.79:0/2148016669 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0d34029100 0x7f0d3402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:51.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.882 7f0d3bfff700 1 -- 172.21.15.79:0/2148016669 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5458+0+0 (secure 0 0 0) 0x7f0d44038ee0 con 0x7f0d540be630 2021-04-09T18:29:51.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.882 7f0d52804700 1 --2- 172.21.15.79:0/2148016669 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0d34029100 0x7f0d3402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:51.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.882 7f0d52804700 1 --2- 172.21.15.79:0/2148016669 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0d34029100 0x7f0d3402b650 crc :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:51.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.886 7f0d5930e700 1 -- 172.21.15.79:0/2148016669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d540e39f0 con 0x7f0d540be630 2021-04-09T18:29:51.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:51.894 7f0d3bfff700 1 -- 172.21.15.79:0/2148016669 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0d54107f80 con 0x7f0d540be630 2021-04-09T18:29:52.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.058 7f0d5930e700 1 -- 172.21.15.79:0/2148016669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f0d540a1c90 con 0x7f0d540be630 2021-04-09T18:29:52.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.706 7f0d3bfff700 1 -- 172.21.15.79:0/2148016669 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7f0d4400a5e0 con 0x7f0d540be630 2021-04-09T18:29:52.723 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2021-04-09T18:29:52.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.722 7f0d5930e700 1 -- 172.21.15.79:0/2148016669 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0d34029100 msgr2=0x7f0d3402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:52.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.722 7f0d5930e700 1 --2- 172.21.15.79:0/2148016669 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0d34029100 0x7f0d3402b650 crc :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:52.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.722 7f0d5930e700 1 -- 172.21.15.79:0/2148016669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d540be630 msgr2=0x7f0d5409ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:52.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.722 7f0d5930e700 1 --2- 172.21.15.79:0/2148016669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d540be630 0x7f0d5409ad80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f0d540c0620 tx=0x7f0d4400cec0).stop 2021-04-09T18:29:52.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.722 7f0d5930e700 1 -- 172.21.15.79:0/2148016669 shutdown_connections 2021-04-09T18:29:52.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.722 7f0d5930e700 1 --2- 172.21.15.79:0/2148016669 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0d34029100 0x7f0d3402b650 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:52.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.722 7f0d5930e700 1 --2- 172.21.15.79:0/2148016669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d540be0d0 0x7f0d540977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:52.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.722 7f0d5930e700 1 --2- 172.21.15.79:0/2148016669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d540be630 0x7f0d5409ad80 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:52.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.722 7f0d5930e700 1 --2- 172.21.15.79:0/2148016669 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d540bdc80 0x7f0d540d51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:52.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.722 7f0d5930e700 1 -- 172.21.15.79:0/2148016669 >> 172.21.15.79:0/2148016669 conn(0x7f0d540a2540 msgr2=0x7f0d540d84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:52.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.726 7f0d5930e700 1 -- 172.21.15.79:0/2148016669 shutdown_connections 2021-04-09T18:29:52.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.726 7f0d5930e700 1 -- 172.21.15.79:0/2148016669 wait complete. 2021-04-09T18:29:52.737 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-04-09T18:29:52.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.830 7f211db04700 1 Processor -- start 2021-04-09T18:29:52.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.830 7f211db04700 1 -- start start 2021-04-09T18:29:52.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f211db04700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f21180f5550 0x7f21180f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:52.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f211db04700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21181c8040 0x7f21181ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:52.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f211db04700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21180fbb50 con 0x7f21180e9b10 2021-04-09T18:29:52.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f211db04700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21180e9f60 con 0x7f21181c8040 2021-04-09T18:29:52.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f211db04700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21181c3df0 con 0x7f21180f5550 2021-04-09T18:29:52.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f2117fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21181c8040 0x7f21181ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:52.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f2116ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f21180e9b10 0x7f211809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52972/0 (socket says 172.21.15.79:52972) 2021-04-09T18:29:52.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f2116ffd700 1 -- 172.21.15.79:0/4260554749 learned_addr learned my addr 172.21.15.79:0/4260554749 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:52.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f21177fe700 1 --2- 172.21.15.79:0/4260554749 >> v2:172.21.15.89:3300/0 conn(0x7f21180f5550 0x7f21180f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:52.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f21167fc700 1 -- 172.21.15.79:0/4260554749 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235554008 0 0) 0x7f210c0010d0 con 0x7f21180e9b10 2021-04-09T18:29:52.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f21167fc700 1 -- 172.21.15.79:0/4260554749 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2100003240 con 0x7f21180e9b10 2021-04-09T18:29:52.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f2117fff700 1 -- 172.21.15.79:0/4260554749 >> v2:172.21.15.89:3300/0 conn(0x7f21180f5550 msgr2=0x7f21180f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:52.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f2117fff700 1 --2- 172.21.15.79:0/4260554749 >> v2:172.21.15.89:3300/0 conn(0x7f21180f5550 0x7f21180f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:52.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f21167fc700 1 -- 172.21.15.79:0/4260554749 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4066035576 0 0) 0x7f210c001650 con 0x7f21180e9b10 2021-04-09T18:29:52.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f2117fff700 1 -- 172.21.15.79:0/4260554749 >> v1:172.21.15.79:6789/0 conn(0x7f21180e9b10 legacy=0x7f211809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:52.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f2117fff700 1 -- 172.21.15.79:0/4260554749 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211809f910 con 0x7f21181c8040 2021-04-09T18:29:52.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f2117fff700 1 --2- 172.21.15.79:0/4260554749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21181c8040 0x7f21181ca4a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f210c001df0 tx=0x7f211000b3c0).ready entity=mon.0 client_cookie=c049e95ce7cb1ff7 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:52.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f21167fc700 1 -- 172.21.15.79:0/4260554749 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f211809f910 con 0x7f21181c8040 2021-04-09T18:29:52.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f21167fc700 1 -- 172.21.15.79:0/4260554749 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211000bae0 con 0x7f21181c8040 2021-04-09T18:29:52.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f21167fc700 1 -- 172.21.15.79:0/4260554749 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2110002020 con 0x7f21181c8040 2021-04-09T18:29:52.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f211db04700 1 -- 172.21.15.79:0/4260554749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21181c8040 msgr2=0x7f21181ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:52.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f211db04700 1 --2- 172.21.15.79:0/4260554749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21181c8040 0x7f21181ca4a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f210c001df0 tx=0x7f211000b3c0).stop 2021-04-09T18:29:52.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f211db04700 1 -- 172.21.15.79:0/4260554749 shutdown_connections 2021-04-09T18:29:52.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f211db04700 1 --2- 172.21.15.79:0/4260554749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21181c8040 0x7f21181ca4a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:52.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f211db04700 1 --2- 172.21.15.79:0/4260554749 >> v2:172.21.15.89:3300/0 conn(0x7f21180f5550 0x7f21180f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:52.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f211db04700 1 -- 172.21.15.79:0/4260554749 >> 172.21.15.79:0/4260554749 conn(0x7f21180e6010 msgr2=0x7f21180e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:52.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f211db04700 1 -- 172.21.15.79:0/4260554749 shutdown_connections 2021-04-09T18:29:52.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.834 7f211db04700 1 -- 172.21.15.79:0/4260554749 wait complete. 2021-04-09T18:29:52.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.838 7f211db04700 1 Processor -- start 2021-04-09T18:29:52.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.838 7f211db04700 1 -- start start 2021-04-09T18:29:52.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f211db04700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21181c06f0 0x7f21180bae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:52.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f211db04700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21180ac3c0 0x7f21180af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:52.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f211db04700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21180ae3d0 0x7f21181add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:52.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f211db04700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2118047500 con 0x7f21181c06f0 2021-04-09T18:29:52.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f211db04700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21180acb30 con 0x7f21180ae3d0 2021-04-09T18:29:52.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f211db04700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21180ace30 con 0x7f21180ac3c0 2021-04-09T18:29:52.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f21177fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21181c06f0 0x7f21180bae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:52.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f21177fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21181c06f0 0x7f21180bae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58264/0 (socket says 172.21.15.79:58264) 2021-04-09T18:29:52.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f21177fe700 1 -- 172.21.15.79:0/1724174560 learned_addr learned my addr 172.21.15.79:0/1724174560 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:52.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f2116ffd700 1 --2- 172.21.15.79:0/1724174560 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21180ac3c0 0x7f21180af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:52.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f2117fff700 1 --2- 172.21.15.79:0/1724174560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21180ae3d0 0x7f21181add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:52.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f21177fe700 1 -- 172.21.15.79:0/1724174560 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21180ac3c0 msgr2=0x7f21180af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:52.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f21177fe700 1 --2- 172.21.15.79:0/1724174560 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21180ac3c0 0x7f21180af060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:52.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f21177fe700 1 -- 172.21.15.79:0/1724174560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21180ae3d0 msgr2=0x7f21181add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:52.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f21177fe700 1 --2- 172.21.15.79:0/1724174560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21180ae3d0 0x7f21181add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:52.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f21177fe700 1 -- 172.21.15.79:0/1724174560 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21180af690 con 0x7f21181c06f0 2021-04-09T18:29:52.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f2117fff700 1 --2- 172.21.15.79:0/1724174560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21180ae3d0 0x7f21181add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:29:52.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f21177fe700 1 --2- 172.21.15.79:0/1724174560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21181c06f0 0x7f21180bae70 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f21180d7db0 tx=0x7f210800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:52.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f20fffff700 1 -- 172.21.15.79:0/1724174560 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f210800f040 con 0x7f21181c06f0 2021-04-09T18:29:52.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f20fffff700 1 -- 172.21.15.79:0/1724174560 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210800cd60 con 0x7f21181c06f0 2021-04-09T18:29:52.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f211db04700 1 -- 172.21.15.79:0/1724174560 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21180abea0 con 0x7f21181c06f0 2021-04-09T18:29:52.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f20fffff700 1 -- 172.21.15.79:0/1724174560 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f21080125e0 con 0x7f21181c06f0 2021-04-09T18:29:52.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f211db04700 1 -- 172.21.15.79:0/1724174560 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21180ae820 con 0x7f21181c06f0 2021-04-09T18:29:52.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f20fffff700 1 -- 172.21.15.79:0/1724174560 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2108011070 con 0x7f21181c06f0 2021-04-09T18:29:52.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f20fffff700 1 --2- 172.21.15.79:0/1724174560 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f20f8029100 0x7f20f802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:52.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f20fffff700 1 -- 172.21.15.79:0/1724174560 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f2108010040 con 0x7f21181c06f0 2021-04-09T18:29:52.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.842 7f2116ffd700 1 --2- 172.21.15.79:0/1724174560 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f20f8029100 0x7f20f802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:52.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.846 7f2116ffd700 1 --2- 172.21.15.79:0/1724174560 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f20f8029100 0x7f20f802b650 crc :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:52.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.846 7f211db04700 1 -- 172.21.15.79:0/1724174560 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21180e39f0 con 0x7f21181c06f0 2021-04-09T18:29:52.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:52.854 7f20fffff700 1 -- 172.21.15.79:0/1724174560 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2108000bf0 con 0x7f21181c06f0 2021-04-09T18:29:53.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.014 7f211db04700 1 -- 172.21.15.79:0/1724174560 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f21180f5b50 con 0x7f21181c06f0 2021-04-09T18:29:53.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.022 7f20fffff700 1 -- 172.21.15.79:0/1724174560 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 8 and data pool 9 v23) v1 ==== 187+0+0 (secure 0 0 0) 0x7f210800c960 con 0x7f21181c06f0 2021-04-09T18:29:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 8 and data pool 9 2021-04-09T18:29:53.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.034 7f211db04700 1 -- 172.21.15.79:0/1724174560 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f20f8029100 msgr2=0x7f20f802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:53.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.034 7f211db04700 1 --2- 172.21.15.79:0/1724174560 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f20f8029100 0x7f20f802b650 crc :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.034 7f211db04700 1 -- 172.21.15.79:0/1724174560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21181c06f0 msgr2=0x7f21180bae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:53.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.034 7f211db04700 1 --2- 172.21.15.79:0/1724174560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21181c06f0 0x7f21180bae70 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f21180d7db0 tx=0x7f210800c430).stop 2021-04-09T18:29:53.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.034 7f211db04700 1 -- 172.21.15.79:0/1724174560 shutdown_connections 2021-04-09T18:29:53.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.034 7f211db04700 1 --2- 172.21.15.79:0/1724174560 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f20f8029100 0x7f20f802b650 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.034 7f211db04700 1 --2- 172.21.15.79:0/1724174560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21180ae3d0 0x7f21181add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.034 7f211db04700 1 --2- 172.21.15.79:0/1724174560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21181c06f0 0x7f21180bae70 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.034 7f211db04700 1 --2- 172.21.15.79:0/1724174560 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21180ac3c0 0x7f21180af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.034 7f211db04700 1 -- 172.21.15.79:0/1724174560 >> 172.21.15.79:0/1724174560 conn(0x7f211809a9a0 msgr2=0x7f2118097290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:53.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.034 7f211db04700 1 -- 172.21.15.79:0/1724174560 shutdown_connections 2021-04-09T18:29:53.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.034 7f211db04700 1 -- 172.21.15.79:0/1724174560 wait complete. 2021-04-09T18:29:53.047 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:29:53.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f2354ca6700 1 Processor -- start 2021-04-09T18:29:53.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f2354ca6700 1 -- start start 2021-04-09T18:29:53.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f2354ca6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23500e9ad0 0x7f235009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:53.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f2354ca6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f23501c8000 0x7f23501ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:53.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f2354ca6700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23500fbb10 con 0x7f23500f5510 2021-04-09T18:29:53.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f2354ca6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23501c3db0 con 0x7f23500e9ad0 2021-04-09T18:29:53.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f2354ca6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23500e9f20 con 0x7f23501c8000 2021-04-09T18:29:53.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f234dfe5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23500e9ad0 0x7f235009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:53.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f234e7e6700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f23500f5510 0x7f23500f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52982/0 (socket says 172.21.15.79:52982) 2021-04-09T18:29:53.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f234e7e6700 1 -- 172.21.15.79:0/1973700170 learned_addr learned my addr 172.21.15.79:0/1973700170 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:53.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f234efe7700 1 --2- 172.21.15.79:0/1973700170 >> v2:172.21.15.89:3300/0 conn(0x7f23501c8000 0x7f23501ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:53.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f234dfe5700 1 -- 172.21.15.79:0/1973700170 >> v2:172.21.15.89:3300/0 conn(0x7f23501c8000 msgr2=0x7f23501ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:53.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f234dfe5700 1 --2- 172.21.15.79:0/1973700170 >> v2:172.21.15.89:3300/0 conn(0x7f23501c8000 0x7f23501ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f234dfe5700 1 -- 172.21.15.79:0/1973700170 >> v1:172.21.15.79:6789/0 conn(0x7f23500f5510 legacy=0x7f23500f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:53.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f234d7e4700 1 -- 172.21.15.79:0/1973700170 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000734856 0 0) 0x7f2338001450 con 0x7f23500f5510 2021-04-09T18:29:53.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f234dfe5700 1 -- 172.21.15.79:0/1973700170 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23500e56c0 con 0x7f23500e9ad0 2021-04-09T18:29:53.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f234dfe5700 1 --2- 172.21.15.79:0/1973700170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23500e9ad0 0x7f235009f100 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f2340002f30 tx=0x7f234000bd10).ready entity=mon.0 client_cookie=d44acfefa60cdf9 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:53.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f234d7e4700 1 -- 172.21.15.79:0/1973700170 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f23500e56c0 con 0x7f23500e9ad0 2021-04-09T18:29:53.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f234d7e4700 1 -- 172.21.15.79:0/1973700170 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23400098a0 con 0x7f23500e9ad0 2021-04-09T18:29:53.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f234d7e4700 1 -- 172.21.15.79:0/1973700170 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2340009c70 con 0x7f23500e9ad0 2021-04-09T18:29:53.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f2354ca6700 1 -- 172.21.15.79:0/1973700170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23500e9ad0 msgr2=0x7f235009f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:53.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.134 7f2354ca6700 1 --2- 172.21.15.79:0/1973700170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23500e9ad0 0x7f235009f100 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f2340002f30 tx=0x7f234000bd10).stop 2021-04-09T18:29:53.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.138 7f2354ca6700 1 -- 172.21.15.79:0/1973700170 shutdown_connections 2021-04-09T18:29:53.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.138 7f2354ca6700 1 --2- 172.21.15.79:0/1973700170 >> v2:172.21.15.89:3300/0 conn(0x7f23501c8000 0x7f23501ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.138 7f2354ca6700 1 --2- 172.21.15.79:0/1973700170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23500e9ad0 0x7f235009f100 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.138 7f2354ca6700 1 -- 172.21.15.79:0/1973700170 >> 172.21.15.79:0/1973700170 conn(0x7f23500e5fd0 msgr2=0x7f23500e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:53.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.138 7f2354ca6700 1 -- 172.21.15.79:0/1973700170 shutdown_connections 2021-04-09T18:29:53.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.138 7f2354ca6700 1 -- 172.21.15.79:0/1973700170 wait complete. 2021-04-09T18:29:53.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.138 7f2354ca6700 1 Processor -- start 2021-04-09T18:29:53.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.138 7f2354ca6700 1 -- start start 2021-04-09T18:29:53.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f2354ca6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2350091ed0 0x7f23500a8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:53.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f2354ca6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23500b8b70 0x7f23500949d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:53.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f2354ca6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23500b8fc0 0x7f2350095000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:53.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f2354ca6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23501a80a0 con 0x7f23500b8fc0 2021-04-09T18:29:53.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f2354ca6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23500d6ea0 con 0x7f2350091ed0 2021-04-09T18:29:53.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f2354ca6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23500a9130 con 0x7f23500b8b70 2021-04-09T18:29:53.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f234efe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23500b8fc0 0x7f2350095000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:53.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f234efe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23500b8fc0 0x7f2350095000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58282/0 (socket says 172.21.15.79:58282) 2021-04-09T18:29:53.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f234efe7700 1 -- 172.21.15.79:0/3393034044 learned_addr learned my addr 172.21.15.79:0/3393034044 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:53.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f234dfe5700 1 --2- 172.21.15.79:0/3393034044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23500b8b70 0x7f23500949d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:53.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f234e7e6700 1 --2- 172.21.15.79:0/3393034044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2350091ed0 0x7f23500a8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:53.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f234efe7700 1 -- 172.21.15.79:0/3393034044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23500b8b70 msgr2=0x7f23500949d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:53.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f234efe7700 1 --2- 172.21.15.79:0/3393034044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23500b8b70 0x7f23500949d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f234efe7700 1 -- 172.21.15.79:0/3393034044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2350091ed0 msgr2=0x7f23500a8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:53.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f234efe7700 1 --2- 172.21.15.79:0/3393034044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2350091ed0 0x7f23500a8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f234efe7700 1 -- 172.21.15.79:0/3393034044 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23500d6a40 con 0x7f23500b8fc0 2021-04-09T18:29:53.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f234e7e6700 1 --2- 172.21.15.79:0/3393034044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2350091ed0 0x7f23500a8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:29:53.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f234efe7700 1 --2- 172.21.15.79:0/3393034044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23500b8fc0 0x7f2350095000 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f234800b140 tx=0x7f234800bf60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:53.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f2346ffd700 1 -- 172.21.15.79:0/3393034044 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f23500d6a40 con 0x7f23500b8fc0 2021-04-09T18:29:53.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f2346ffd700 1 -- 172.21.15.79:0/3393034044 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234800cb20 con 0x7f23500b8fc0 2021-04-09T18:29:53.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f2346ffd700 1 -- 172.21.15.79:0/3393034044 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f234800f040 con 0x7f23500b8fc0 2021-04-09T18:29:53.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f2354ca6700 1 -- 172.21.15.79:0/3393034044 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23500d6c40 con 0x7f23500b8fc0 2021-04-09T18:29:53.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f2354ca6700 1 -- 172.21.15.79:0/3393034044 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23501aa570 con 0x7f23500b8fc0 2021-04-09T18:29:53.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f2346ffd700 1 -- 172.21.15.79:0/3393034044 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2348011070 con 0x7f23500b8fc0 2021-04-09T18:29:53.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f2346ffd700 1 --2- 172.21.15.79:0/3393034044 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2334029100 0x7f233402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:53.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f2346ffd700 1 -- 172.21.15.79:0/3393034044 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f2348010040 con 0x7f23500b8fc0 2021-04-09T18:29:53.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f234e7e6700 1 --2- 172.21.15.79:0/3393034044 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2334029100 0x7f233402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:53.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.142 7f234e7e6700 1 --2- 172.21.15.79:0/3393034044 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2334029100 0x7f233402b650 crc :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:53.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.150 7f2354ca6700 1 -- 172.21.15.79:0/3393034044 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23500e39d0 con 0x7f23500b8fc0 2021-04-09T18:29:53.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.154 7f2346ffd700 1 -- 172.21.15.79:0/3393034044 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f234800c720 con 0x7f23500b8fc0 2021-04-09T18:29:53.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.314 7f2354ca6700 1 -- 172.21.15.79:0/3393034044 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23500f5b10 con 0x7f23500b8fc0 2021-04-09T18:29:53.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.318 7f2346ffd700 1 -- 172.21.15.79:0/3393034044 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+14239 (secure 0 0 0) 0x7f23500f76b0 con 0x7f23500b8fc0 2021-04-09T18:29:53.320 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:29:53.321 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":48,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:29:53.021991","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:29:51.239559","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2021-04-09 18:29:52.114936","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:29:53.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.322 7f2354ca6700 1 -- 172.21.15.79:0/3393034044 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2334029100 msgr2=0x7f233402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:53.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.322 7f2354ca6700 1 --2- 172.21.15.79:0/3393034044 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2334029100 0x7f233402b650 crc :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.322 7f2354ca6700 1 -- 172.21.15.79:0/3393034044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23500b8fc0 msgr2=0x7f2350095000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:53.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.322 7f2354ca6700 1 --2- 172.21.15.79:0/3393034044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23500b8fc0 0x7f2350095000 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f234800b140 tx=0x7f234800bf60).stop 2021-04-09T18:29:53.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.322 7f2354ca6700 1 -- 172.21.15.79:0/3393034044 shutdown_connections 2021-04-09T18:29:53.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.322 7f2354ca6700 1 --2- 172.21.15.79:0/3393034044 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2334029100 0x7f233402b650 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.322 7f2354ca6700 1 --2- 172.21.15.79:0/3393034044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2350091ed0 0x7f23500a8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.322 7f2354ca6700 1 --2- 172.21.15.79:0/3393034044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23500b8fc0 0x7f2350095000 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.322 7f2354ca6700 1 --2- 172.21.15.79:0/3393034044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23500b8b70 0x7f23500949d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.322 7f2354ca6700 1 -- 172.21.15.79:0/3393034044 >> 172.21.15.79:0/3393034044 conn(0x7f23500babe0 msgr2=0x7f235008eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:53.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.322 7f2354ca6700 1 -- 172.21.15.79:0/3393034044 shutdown_connections 2021-04-09T18:29:53.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.322 7f2354ca6700 1 -- 172.21.15.79:0/3393034044 wait complete. 2021-04-09T18:29:53.334 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:29:53.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.422 7f893df63700 1 Processor -- start 2021-04-09T18:29:53.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.422 7f893df63700 1 -- start start 2021-04-09T18:29:53.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.422 7f893df63700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f89380f5510 0x7f89380f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:53.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.422 7f893df63700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89380fbb10 con 0x7f89380e9ad0 2021-04-09T18:29:53.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.422 7f893df63700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893809f900 con 0x7f89381c8000 2021-04-09T18:29:53.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.422 7f893df63700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89380e9f20 con 0x7f89380f5510 2021-04-09T18:29:53.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.422 7f8936ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f89380e9ad0 0x7f893809f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52998/0 (socket says 172.21.15.79:52998) 2021-04-09T18:29:53.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.422 7f8936ffd700 1 -- 172.21.15.79:0/2588742085 learned_addr learned my addr 172.21.15.79:0/2588742085 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:53.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.422 7f89377fe700 1 --2- 172.21.15.79:0/2588742085 >> v2:172.21.15.89:3300/0 conn(0x7f89380f5510 0x7f89380f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.422 7f89367fc700 1 -- 172.21.15.79:0/2588742085 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429640261 0 0) 0x7f892c0010d0 con 0x7f89380e9ad0 2021-04-09T18:29:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.422 7f89367fc700 1 -- 172.21.15.79:0/2588742085 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8920003240 con 0x7f89380e9ad0 2021-04-09T18:29:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.426 7f89367fc700 1 -- 172.21.15.79:0/2588742085 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312394535 0 0) 0x7f8930001450 con 0x7f89381c8000 2021-04-09T18:29:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.426 7f89367fc700 1 -- 172.21.15.79:0/2588742085 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8920003620 con 0x7f89381c8000 2021-04-09T18:29:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.426 7f89367fc700 1 -- 172.21.15.79:0/2588742085 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3323517962 0 0) 0x7f892c001650 con 0x7f89380e9ad0 2021-04-09T18:29:53.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.426 7f89377fe700 1 -- 172.21.15.79:0/2588742085 >> v1:172.21.15.89:6789/0 conn(0x7f89381c8000 legacy=0x7f89381ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:53.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.426 7f89377fe700 1 -- 172.21.15.79:0/2588742085 >> v1:172.21.15.79:6789/0 conn(0x7f89380e9ad0 legacy=0x7f893809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:53.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.426 7f89377fe700 1 -- 172.21.15.79:0/2588742085 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89380e56c0 con 0x7f89380f5510 2021-04-09T18:29:53.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.426 7f89377fe700 1 --2- 172.21.15.79:0/2588742085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89380f5510 0x7f89380f64a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f892c001980 tx=0x7f892800bcc0).ready entity=mon.1 client_cookie=19eae833b2ba1745 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:53.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.426 7f89367fc700 1 -- 172.21.15.79:0/2588742085 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f89380e56c0 con 0x7f89380f5510 2021-04-09T18:29:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.426 7f89367fc700 1 -- 172.21.15.79:0/2588742085 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89280096c0 con 0x7f89380f5510 2021-04-09T18:29:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.426 7f89367fc700 1 -- 172.21.15.79:0/2588742085 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f892c001bb0 con 0x7f89380f5510 2021-04-09T18:29:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.426 7f893df63700 1 -- 172.21.15.79:0/2588742085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89380f5510 msgr2=0x7f89380f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.426 7f893df63700 1 --2- 172.21.15.79:0/2588742085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89380f5510 0x7f89380f64a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f892c001980 tx=0x7f892800bcc0).stop 2021-04-09T18:29:53.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.426 7f893df63700 1 -- 172.21.15.79:0/2588742085 shutdown_connections 2021-04-09T18:29:53.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.426 7f893df63700 1 --2- 172.21.15.79:0/2588742085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89380f5510 0x7f89380f64a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.426 7f893df63700 1 -- 172.21.15.79:0/2588742085 >> 172.21.15.79:0/2588742085 conn(0x7f89380e5fd0 msgr2=0x7f89380e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:53.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.426 7f893df63700 1 -- 172.21.15.79:0/2588742085 shutdown_connections 2021-04-09T18:29:53.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.426 7f893df63700 1 -- 172.21.15.79:0/2588742085 wait complete. 2021-04-09T18:29:53.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.430 7f893df63700 1 Processor -- start 2021-04-09T18:29:53.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.430 7f893df63700 1 -- start start 2021-04-09T18:29:53.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.430 7f893df63700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89380c20c0 0x7f89380ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:53.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.430 7f893df63700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89380c3500 0x7f89380af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:53.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.430 7f893df63700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89380c3950 0x7f89380af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:53.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.430 7f893df63700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89381c3db0 con 0x7f89380c3950 2021-04-09T18:29:53.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.430 7f893df63700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89380c3200 con 0x7f89380c20c0 2021-04-09T18:29:53.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.430 7f893df63700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89380c2510 con 0x7f89380c3500 2021-04-09T18:29:53.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.430 7f8937fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89380c3950 0x7f89380af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:53.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.430 7f8937fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89380c3950 0x7f89380af680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58296/0 (socket says 172.21.15.79:58296) 2021-04-09T18:29:53.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.430 7f8937fff700 1 -- 172.21.15.79:0/2419316300 learned_addr learned my addr 172.21.15.79:0/2419316300 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:53.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.430 7f8936ffd700 1 --2- 172.21.15.79:0/2419316300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89380c3500 0x7f89380af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:53.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.430 7f89377fe700 1 --2- 172.21.15.79:0/2419316300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89380c20c0 0x7f89380ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:53.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.434 7f8937fff700 1 -- 172.21.15.79:0/2419316300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89380c3500 msgr2=0x7f89380af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:53.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.434 7f8937fff700 1 --2- 172.21.15.79:0/2419316300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89380c3500 0x7f89380af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.434 7f8937fff700 1 -- 172.21.15.79:0/2419316300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89380c20c0 msgr2=0x7f89380ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:53.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.434 7f8937fff700 1 --2- 172.21.15.79:0/2419316300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89380c20c0 0x7f89380ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.434 7f8937fff700 1 -- 172.21.15.79:0/2419316300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89381ad3b0 con 0x7f89380c3950 2021-04-09T18:29:53.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.434 7f8937fff700 1 --2- 172.21.15.79:0/2419316300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89380c3950 0x7f89380af680 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f89380d8440 tx=0x7f893000ce90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:53.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.434 7f891ffff700 1 -- 172.21.15.79:0/2419316300 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f89381ad3b0 con 0x7f89380c3950 2021-04-09T18:29:53.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.434 7f891ffff700 1 -- 172.21.15.79:0/2419316300 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893000a790 con 0x7f89380c3950 2021-04-09T18:29:53.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.434 7f893df63700 1 -- 172.21.15.79:0/2419316300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89380ae880 con 0x7f89380c3950 2021-04-09T18:29:53.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.434 7f891ffff700 1 -- 172.21.15.79:0/2419316300 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f893000a970 con 0x7f89380c3950 2021-04-09T18:29:53.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.434 7f893df63700 1 -- 172.21.15.79:0/2419316300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89380c2900 con 0x7f89380c3950 2021-04-09T18:29:53.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.434 7f891ffff700 1 -- 172.21.15.79:0/2419316300 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8930019020 con 0x7f89380c3950 2021-04-09T18:29:53.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.434 7f891ffff700 1 --2- 172.21.15.79:0/2419316300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8918029100 0x7f891802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:53.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.434 7f891ffff700 1 -- 172.21.15.79:0/2419316300 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f8930039120 con 0x7f89380c3950 2021-04-09T18:29:53.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.434 7f89377fe700 1 --2- 172.21.15.79:0/2419316300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8918029100 0x7f891802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:53.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.434 7f893df63700 1 -- 172.21.15.79:0/2419316300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89380e39d0 con 0x7f89380c3950 2021-04-09T18:29:53.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.434 7f89377fe700 1 --2- 172.21.15.79:0/2419316300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8918029100 0x7f891802b650 crc :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:53.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.442 7f891ffff700 1 -- 172.21.15.79:0/2419316300 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8930000f70 con 0x7f89380c3950 2021-04-09T18:29:53.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.606 7f893df63700 1 -- 172.21.15.79:0/2419316300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89380a1cb0 con 0x7f89380c3950 2021-04-09T18:29:53.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.610 7f891ffff700 1 -- 172.21.15.79:0/2419316300 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+14343 (secure 0 0 0) 0x7f893000a580 con 0x7f89380c3950 2021-04-09T18:29:53.613 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:29:53.614 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":50,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:29:53.473860","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:29:51.239559","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2021-04-09 18:29:52.114936","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6835/781814443":"2021-04-10 18:29:53.473795","172.21.15.89:6834/781814443":"2021-04-10 18:29:53.473795"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:29:53.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.614 7f893df63700 1 -- 172.21.15.79:0/2419316300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8918029100 msgr2=0x7f891802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:53.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.614 7f893df63700 1 --2- 172.21.15.79:0/2419316300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8918029100 0x7f891802b650 crc :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.614 7f893df63700 1 -- 172.21.15.79:0/2419316300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89380c3950 msgr2=0x7f89380af680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:53.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.614 7f893df63700 1 --2- 172.21.15.79:0/2419316300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89380c3950 0x7f89380af680 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f89380d8440 tx=0x7f893000ce90).stop 2021-04-09T18:29:53.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.614 7f893df63700 1 -- 172.21.15.79:0/2419316300 shutdown_connections 2021-04-09T18:29:53.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.614 7f893df63700 1 --2- 172.21.15.79:0/2419316300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8918029100 0x7f891802b650 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.614 7f893df63700 1 --2- 172.21.15.79:0/2419316300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89380c20c0 0x7f89380ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.614 7f893df63700 1 --2- 172.21.15.79:0/2419316300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89380c3950 0x7f89380af680 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.614 7f893df63700 1 --2- 172.21.15.79:0/2419316300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89380c3500 0x7f89380af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.614 7f893df63700 1 -- 172.21.15.79:0/2419316300 >> 172.21.15.79:0/2419316300 conn(0x7f89380984d0 msgr2=0x7f893809a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:53.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.614 7f893df63700 1 -- 172.21.15.79:0/2419316300 shutdown_connections 2021-04-09T18:29:53.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.614 7f893df63700 1 -- 172.21.15.79:0/2419316300 wait complete. 2021-04-09T18:29:53.626 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-04-09T18:29:53.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.718 7f829b1dc700 1 Processor -- start 2021-04-09T18:29:53.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.718 7f829b1dc700 1 -- start start 2021-04-09T18:29:53.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.718 7f829b1dc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f82940f5550 0x7f82940f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:53.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.718 7f829b1dc700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82940fbb50 con 0x7f82941c8040 2021-04-09T18:29:53.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.718 7f829b1dc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829409f910 con 0x7f82940e9b10 2021-04-09T18:29:53.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.718 7f829b1dc700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82940e9f60 con 0x7f82940f5550 2021-04-09T18:29:53.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.718 7f8298f80700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f82940f5550 0x7f82940f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:53.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.718 7f8299781700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f82941c8040 0x7f82941ca4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53014/0 (socket says 172.21.15.79:53014) 2021-04-09T18:29:53.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.718 7f8299781700 1 -- 172.21.15.79:0/961822825 learned_addr learned my addr 172.21.15.79:0/961822825 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:53.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.718 7f8298f80700 1 -- 172.21.15.79:0/961822825 >> v1:172.21.15.89:6789/0 conn(0x7f82940e9b10 legacy=0x7f829409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:53.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.718 7f8298f80700 1 -- 172.21.15.79:0/961822825 >> v1:172.21.15.79:6789/0 conn(0x7f82941c8040 legacy=0x7f82941ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:53.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.718 7f82937fe700 1 -- 172.21.15.79:0/961822825 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231001535 0 0) 0x7f828c001450 con 0x7f82941c8040 2021-04-09T18:29:53.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.718 7f8298f80700 1 -- 172.21.15.79:0/961822825 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82940e5700 con 0x7f82940f5550 2021-04-09T18:29:53.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.718 7f8298f80700 1 --2- 172.21.15.79:0/961822825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82940f5550 0x7f82940f64e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f8284002f30 tx=0x7f828400bcc0).ready entity=mon.0 client_cookie=818a91fedac5bf7c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:53.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.718 7f82937fe700 1 -- 172.21.15.79:0/961822825 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f82940e5700 con 0x7f82940f5550 2021-04-09T18:29:53.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.718 7f82937fe700 1 -- 172.21.15.79:0/961822825 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8284009800 con 0x7f82940f5550 2021-04-09T18:29:53.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.718 7f82937fe700 1 -- 172.21.15.79:0/961822825 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8284009bd0 con 0x7f82940f5550 2021-04-09T18:29:53.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.718 7f829b1dc700 1 -- 172.21.15.79:0/961822825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82940f5550 msgr2=0x7f82940f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:53.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.718 7f829b1dc700 1 --2- 172.21.15.79:0/961822825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82940f5550 0x7f82940f64e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f8284002f30 tx=0x7f828400bcc0).stop 2021-04-09T18:29:53.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.718 7f829b1dc700 1 -- 172.21.15.79:0/961822825 shutdown_connections 2021-04-09T18:29:53.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f829b1dc700 1 --2- 172.21.15.79:0/961822825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82940f5550 0x7f82940f64e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f829b1dc700 1 -- 172.21.15.79:0/961822825 >> 172.21.15.79:0/961822825 conn(0x7f82940e6010 msgr2=0x7f82940e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:53.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f829b1dc700 1 -- 172.21.15.79:0/961822825 shutdown_connections 2021-04-09T18:29:53.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f829b1dc700 1 -- 172.21.15.79:0/961822825 wait complete. 2021-04-09T18:29:53.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f829b1dc700 1 Processor -- start 2021-04-09T18:29:53.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f829b1dc700 1 -- start start 2021-04-09T18:29:53.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f829b1dc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8294099290 0x7f82940a8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:53.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f829b1dc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82941d6d70 0x7f82941d71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:53.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f829b1dc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82941d77f0 0x7f82941d2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:53.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f829b1dc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82941c3df0 con 0x7f82941d77f0 2021-04-09T18:29:53.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f829b1dc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82940a9e80 con 0x7f82941d6d70 2021-04-09T18:29:53.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f829b1dc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82940aa180 con 0x7f8294099290 2021-04-09T18:29:53.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f8299781700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82941d77f0 0x7f82941d2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:53.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f8299781700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82941d77f0 0x7f82941d2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58308/0 (socket says 172.21.15.79:58308) 2021-04-09T18:29:53.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f8299781700 1 -- 172.21.15.79:0/3866835191 learned_addr learned my addr 172.21.15.79:0/3866835191 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:53.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f8293fff700 1 --2- 172.21.15.79:0/3866835191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82941d6d70 0x7f82941d71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:53.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f8298f80700 1 --2- 172.21.15.79:0/3866835191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8294099290 0x7f82940a8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:53.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f8299781700 1 -- 172.21.15.79:0/3866835191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8294099290 msgr2=0x7f82940a8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:53.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f8299781700 1 --2- 172.21.15.79:0/3866835191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8294099290 0x7f82940a8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f8299781700 1 -- 172.21.15.79:0/3866835191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82941d6d70 msgr2=0x7f82941d71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:53.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f8299781700 1 --2- 172.21.15.79:0/3866835191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82941d6d70 0x7f82941d71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:53.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f8299781700 1 -- 172.21.15.79:0/3866835191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82941d7c40 con 0x7f82941d77f0 2021-04-09T18:29:53.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f8293fff700 1 --2- 172.21.15.79:0/3866835191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82941d6d70 0x7f82941d71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:29:53.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.722 7f8299781700 1 --2- 172.21.15.79:0/3866835191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82941d77f0 0x7f82941d2e50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f82940d7c70 tx=0x7f828c00cee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:53.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.726 7f82917fa700 1 -- 172.21.15.79:0/3866835191 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f82941d7c40 con 0x7f82941d77f0 2021-04-09T18:29:53.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.726 7f82917fa700 1 -- 172.21.15.79:0/3866835191 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c005b80 con 0x7f82941d77f0 2021-04-09T18:29:53.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.726 7f829b1dc700 1 -- 172.21.15.79:0/3866835191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82940996e0 con 0x7f82941d77f0 2021-04-09T18:29:53.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.726 7f82917fa700 1 -- 172.21.15.79:0/3866835191 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f828c007110 con 0x7f82941d77f0 2021-04-09T18:29:53.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.726 7f829b1dc700 1 -- 172.21.15.79:0/3866835191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82940a9110 con 0x7f82941d77f0 2021-04-09T18:29:53.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.726 7f82917fa700 1 -- 172.21.15.79:0/3866835191 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f828c01a020 con 0x7f82941d77f0 2021-04-09T18:29:53.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.726 7f82917fa700 1 --2- 172.21.15.79:0/3866835191 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8274029100 0x7f827402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:53.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.726 7f82917fa700 1 -- 172.21.15.79:0/3866835191 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f828c039510 con 0x7f82941d77f0 2021-04-09T18:29:53.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.726 7f8298f80700 1 --2- 172.21.15.79:0/3866835191 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8274029100 0x7f827402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:53.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.726 7f8298f80700 1 --2- 172.21.15.79:0/3866835191 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8274029100 0x7f827402b650 crc :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:53.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.730 7f829b1dc700 1 -- 172.21.15.79:0/3866835191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82940e39f0 con 0x7f82941d77f0 2021-04-09T18:29:53.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.738 7f82917fa700 1 -- 172.21.15.79:0/3866835191 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f828c005970 con 0x7f82941d77f0 2021-04-09T18:29:53.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:53.910 7f829b1dc700 1 -- 172.21.15.79:0/3866835191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f82940a1c90 con 0x7f82941d77f0 2021-04-09T18:29:54.022 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:29:54.018 7fbcd0516700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:29:54.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.026 7f82917fa700 1 -- 172.21.15.79:0/3866835191 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7f828c000f70 con 0x7f82941d77f0 2021-04-09T18:29:54.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.030 7f829b1dc700 1 -- 172.21.15.79:0/3866835191 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8274029100 msgr2=0x7f827402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.030 7f829b1dc700 1 --2- 172.21.15.79:0/3866835191 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8274029100 0x7f827402b650 crc :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.030 7f829b1dc700 1 -- 172.21.15.79:0/3866835191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82941d77f0 msgr2=0x7f82941d2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.030 7f829b1dc700 1 --2- 172.21.15.79:0/3866835191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82941d77f0 0x7f82941d2e50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f82940d7c70 tx=0x7f828c00cee0).stop 2021-04-09T18:29:54.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.030 7f829b1dc700 1 -- 172.21.15.79:0/3866835191 shutdown_connections 2021-04-09T18:29:54.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.030 7f829b1dc700 1 --2- 172.21.15.79:0/3866835191 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8274029100 0x7f827402b650 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.030 7f829b1dc700 1 --2- 172.21.15.79:0/3866835191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82941d77f0 0x7f82941d2e50 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.030 7f829b1dc700 1 --2- 172.21.15.79:0/3866835191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8294099290 0x7f82940a8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.030 7f829b1dc700 1 --2- 172.21.15.79:0/3866835191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82941d6d70 0x7f82941d71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.030 7f829b1dc700 1 -- 172.21.15.79:0/3866835191 >> 172.21.15.79:0/3866835191 conn(0x7f82940ba780 msgr2=0x7f82940abf50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:54.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.030 7f829b1dc700 1 -- 172.21.15.79:0/3866835191 shutdown_connections 2021-04-09T18:29:54.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.030 7f829b1dc700 1 -- 172.21.15.79:0/3866835191 wait complete. 2021-04-09T18:29:54.045 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:29:54.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14ae354700 1 Processor -- start 2021-04-09T18:29:54.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14ae354700 1 -- start start 2021-04-09T18:29:54.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14ae354700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14a80f5510 0x7f14a80f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14ae354700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a80fbb10 con 0x7f14a81c8000 2021-04-09T18:29:54.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14ae354700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a809f900 con 0x7f14a80e9ad0 2021-04-09T18:29:54.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14ae354700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a80e9f20 con 0x7f14a80f5510 2021-04-09T18:29:54.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14ac8f9700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f14a81c8000 0x7f14a81ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53026/0 (socket says 172.21.15.79:53026) 2021-04-09T18:29:54.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14ac8f9700 1 -- 172.21.15.79:0/3664599457 learned_addr learned my addr 172.21.15.79:0/3664599457 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:54.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14a7fff700 1 --2- 172.21.15.79:0/3664599457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14a80f5510 0x7f14a80f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14a6ffd700 1 -- 172.21.15.79:0/3664599457 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171548943 0 0) 0x7f14a00010d0 con 0x7f14a81c8000 2021-04-09T18:29:54.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14a6ffd700 1 -- 172.21.15.79:0/3664599457 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1494003240 con 0x7f14a81c8000 2021-04-09T18:29:54.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14a6ffd700 1 -- 172.21.15.79:0/3664599457 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3043850635 0 0) 0x7f14a0001650 con 0x7f14a81c8000 2021-04-09T18:29:54.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14a7fff700 1 -- 172.21.15.79:0/3664599457 >> v1:172.21.15.89:6789/0 conn(0x7f14a80e9ad0 legacy=0x7f14a809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14a7fff700 1 -- 172.21.15.79:0/3664599457 >> v1:172.21.15.79:6789/0 conn(0x7f14a81c8000 legacy=0x7f14a81ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14a7fff700 1 -- 172.21.15.79:0/3664599457 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a80e56c0 con 0x7f14a80f5510 2021-04-09T18:29:54.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14a7fff700 1 --2- 172.21.15.79:0/3664599457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14a80f5510 0x7f14a80f64a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f14a0001db0 tx=0x7f14900013c0).ready entity=mon.2 client_cookie=5c49f6610676404d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:54.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14a6ffd700 1 -- 172.21.15.79:0/3664599457 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f14a80e56c0 con 0x7f14a80f5510 2021-04-09T18:29:54.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14a6ffd700 1 -- 172.21.15.79:0/3664599457 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14980096c0 con 0x7f14a80f5510 2021-04-09T18:29:54.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14a6ffd700 1 -- 172.21.15.79:0/3664599457 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f14a0001bb0 con 0x7f14a80f5510 2021-04-09T18:29:54.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14ae354700 1 -- 172.21.15.79:0/3664599457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14a80f5510 msgr2=0x7f14a80f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.134 7f14ae354700 1 --2- 172.21.15.79:0/3664599457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14a80f5510 0x7f14a80f64a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f14a0001db0 tx=0x7f14900013c0).stop 2021-04-09T18:29:54.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.138 7f14ae354700 1 -- 172.21.15.79:0/3664599457 shutdown_connections 2021-04-09T18:29:54.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.138 7f14ae354700 1 --2- 172.21.15.79:0/3664599457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14a80f5510 0x7f14a80f64a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.138 7f14ae354700 1 -- 172.21.15.79:0/3664599457 >> 172.21.15.79:0/3664599457 conn(0x7f14a80e5fd0 msgr2=0x7f14a80e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:54.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.138 7f14ae354700 1 -- 172.21.15.79:0/3664599457 shutdown_connections 2021-04-09T18:29:54.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.138 7f14ae354700 1 -- 172.21.15.79:0/3664599457 wait complete. 2021-04-09T18:29:54.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14ae354700 1 Processor -- start 2021-04-09T18:29:54.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14ae354700 1 -- start start 2021-04-09T18:29:54.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14ae354700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14a80967a0 0x7f14a808f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14ae354700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14a8099830 0x7f14a80d86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14ae354700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14a8099c80 0x7f14a80d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14ae354700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a81c3db0 con 0x7f14a8099830 2021-04-09T18:29:54.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14ae354700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a8096ef0 con 0x7f14a80967a0 2021-04-09T18:29:54.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14ae354700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a8096bf0 con 0x7f14a8099c80 2021-04-09T18:29:54.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14a77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14a8099830 0x7f14a80d86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14a77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14a8099830 0x7f14a80d86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58322/0 (socket says 172.21.15.79:58322) 2021-04-09T18:29:54.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14a77fe700 1 -- 172.21.15.79:0/762281432 learned_addr learned my addr 172.21.15.79:0/762281432 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:54.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14ac8f9700 1 --2- 172.21.15.79:0/762281432 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14a8099c80 0x7f14a80d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14a7fff700 1 --2- 172.21.15.79:0/762281432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14a80967a0 0x7f14a808f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14a77fe700 1 -- 172.21.15.79:0/762281432 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14a8099c80 msgr2=0x7f14a80d0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14a77fe700 1 --2- 172.21.15.79:0/762281432 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14a8099c80 0x7f14a80d0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14a77fe700 1 -- 172.21.15.79:0/762281432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14a80967a0 msgr2=0x7f14a808f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14a77fe700 1 --2- 172.21.15.79:0/762281432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14a80967a0 0x7f14a808f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14a77fe700 1 -- 172.21.15.79:0/762281432 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a80d8ce0 con 0x7f14a8099830 2021-04-09T18:29:54.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14a77fe700 1 --2- 172.21.15.79:0/762281432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14a8099830 0x7f14a80d86b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f14a8096710 tx=0x7f149000a340).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:54.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14a4ff9700 1 -- 172.21.15.79:0/762281432 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f14a80d8ce0 con 0x7f14a8099830 2021-04-09T18:29:54.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14a4ff9700 1 -- 172.21.15.79:0/762281432 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149000aae0 con 0x7f14a8099830 2021-04-09T18:29:54.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14a4ff9700 1 -- 172.21.15.79:0/762281432 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1490012400 con 0x7f14a8099830 2021-04-09T18:29:54.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14ae354700 1 -- 172.21.15.79:0/762281432 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a8096210 con 0x7f14a8099830 2021-04-09T18:29:54.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.142 7f14ae354700 1 -- 172.21.15.79:0/762281432 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a80d13b0 con 0x7f14a8099830 2021-04-09T18:29:54.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.146 7f14a4ff9700 1 -- 172.21.15.79:0/762281432 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f149001b3b0 con 0x7f14a8099830 2021-04-09T18:29:54.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.146 7f14a4ff9700 1 --2- 172.21.15.79:0/762281432 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f148c029100 0x7f148c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.146 7f14a4ff9700 1 -- 172.21.15.79:0/762281432 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f14900396c0 con 0x7f14a8099830 2021-04-09T18:29:54.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.146 7f14a7fff700 1 --2- 172.21.15.79:0/762281432 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f148c029100 0x7f148c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.146 7f14a7fff700 1 --2- 172.21.15.79:0/762281432 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f148c029100 0x7f148c02b650 crc :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:54.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.146 7f14ae354700 1 -- 172.21.15.79:0/762281432 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a80e39d0 con 0x7f14a8099830 2021-04-09T18:29:54.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.154 7f14a4ff9700 1 -- 172.21.15.79:0/762281432 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1490000f70 con 0x7f14a8099830 2021-04-09T18:29:54.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.318 7f14ae354700 1 -- 172.21.15.79:0/762281432 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14a80a1cb0 con 0x7f14a8099830 2021-04-09T18:29:54.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.318 7f14a4ff9700 1 -- 172.21.15.79:0/762281432 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2104 (secure 0 0 0) 0x7f149000a8d0 con 0x7f14a8099830 2021-04-09T18:29:54.324 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 25 2021-04-09T18:29:54.325 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:29:54.326 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3328659942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3328659942},{"type":"v1","addr":"172.21.15.79:6833","nonce":3328659942}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:29:53.022273","modified":"2021-04-09 18:29:54.030121","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":50,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5111":{"gid":5111,"name":"b","rank":0,"incarnation":25,"state":"up:creating","state_seq":2,"addr":"172.21.15.89:6835/1280399112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1280399112},{"type":"v1","addr":"172.21.15.89:6835","nonce":1280399112}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-04-09T18:29:54.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.326 7f14ae354700 1 -- 172.21.15.79:0/762281432 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f148c029100 msgr2=0x7f148c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.326 7f14ae354700 1 --2- 172.21.15.79:0/762281432 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f148c029100 0x7f148c02b650 crc :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.326 7f14ae354700 1 -- 172.21.15.79:0/762281432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14a8099830 msgr2=0x7f14a80d86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.326 7f14ae354700 1 --2- 172.21.15.79:0/762281432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14a8099830 0x7f14a80d86b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f14a8096710 tx=0x7f149000a340).stop 2021-04-09T18:29:54.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.326 7f14ae354700 1 -- 172.21.15.79:0/762281432 shutdown_connections 2021-04-09T18:29:54.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.326 7f14ae354700 1 --2- 172.21.15.79:0/762281432 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f148c029100 0x7f148c02b650 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.326 7f14ae354700 1 --2- 172.21.15.79:0/762281432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14a80967a0 0x7f14a808f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.326 7f14ae354700 1 --2- 172.21.15.79:0/762281432 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14a8099c80 0x7f14a80d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.326 7f14ae354700 1 --2- 172.21.15.79:0/762281432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14a8099830 0x7f14a80d86b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.326 7f14ae354700 1 -- 172.21.15.79:0/762281432 >> 172.21.15.79:0/762281432 conn(0x7f14a80baeb0 msgr2=0x7f14a80d3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:54.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.326 7f14ae354700 1 -- 172.21.15.79:0/762281432 shutdown_connections 2021-04-09T18:29:54.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.326 7f14ae354700 1 -- 172.21.15.79:0/762281432 wait complete. 2021-04-09T18:29:54.338 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:29:54.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc696374700 1 Processor -- start 2021-04-09T18:29:54.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc696374700 1 -- start start 2021-04-09T18:29:54.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc696374700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6900e9ae0 0x7fc69009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc696374700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc6901c8010 0x7fc6901ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc696374700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6900fbb20 con 0x7fc6900f5520 2021-04-09T18:29:54.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc696374700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6901c3dc0 con 0x7fc6901c8010 2021-04-09T18:29:54.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc696374700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900e9f30 con 0x7fc6900e9ae0 2021-04-09T18:29:54.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68ffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc6900f5520 0x7fc6900f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53040/0 (socket says 172.21.15.79:53040) 2021-04-09T18:29:54.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68ffff700 1 -- 172.21.15.79:0/3168207082 learned_addr learned my addr 172.21.15.79:0/3168207082 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:54.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc694919700 1 --2- 172.21.15.79:0/3168207082 >> v2:172.21.15.89:3300/0 conn(0x7fc6901c8010 0x7fc6901ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68f7fe700 1 --2- 172.21.15.79:0/3168207082 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6900e9ae0 0x7fc69009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68effd700 1 -- 172.21.15.79:0/3168207082 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553925461 0 0) 0x7fc6800010d0 con 0x7fc6900f5520 2021-04-09T18:29:54.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68effd700 1 -- 172.21.15.79:0/3168207082 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc678003240 con 0x7fc6900f5520 2021-04-09T18:29:54.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68effd700 1 -- 172.21.15.79:0/3168207082 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 514725201 0 0) 0x7fc680001650 con 0x7fc6900f5520 2021-04-09T18:29:54.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68effd700 1 -- 172.21.15.79:0/3168207082 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6900e9ae0 msgr2=0x7fc69009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:54.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68effd700 1 --2- 172.21.15.79:0/3168207082 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6900e9ae0 0x7fc69009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68effd700 1 -- 172.21.15.79:0/3168207082 >> v2:172.21.15.89:3300/0 conn(0x7fc6901c8010 msgr2=0x7fc6901ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:54.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68effd700 1 --2- 172.21.15.79:0/3168207082 >> v2:172.21.15.89:3300/0 conn(0x7fc6901c8010 0x7fc6901ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68effd700 1 -- 172.21.15.79:0/3168207082 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6900e56d0 con 0x7fc6900f5520 2021-04-09T18:29:54.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68effd700 1 -- 172.21.15.79:0/3168207082 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7fc680001bb0 con 0x7fc6900f5520 2021-04-09T18:29:54.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68effd700 1 -- 172.21.15.79:0/3168207082 >> v1:172.21.15.79:6789/0 conn(0x7fc6900f5520 legacy=0x7fc6900f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68effd700 1 --2- 172.21.15.79:0/3168207082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6780038c0 0x7fc678003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68effd700 1 --2- 172.21.15.79:0/3168207082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6780045a0 0x7fc6780049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68effd700 1 --2- 172.21.15.79:0/3168207082 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc67804d7f0 0x7fc67804fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68ffff700 1 --2- 172.21.15.79:0/3168207082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6780038c0 0x7fc678003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68effd700 1 -- 172.21.15.79:0/3168207082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6901c3dc0 con 0x7fc6780038c0 2021-04-09T18:29:54.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68effd700 1 -- 172.21.15.79:0/3168207082 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900e9f30 con 0x7fc6780045a0 2021-04-09T18:29:54.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68effd700 1 -- 172.21.15.79:0/3168207082 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6780052a0 con 0x7fc67804d7f0 2021-04-09T18:29:54.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc694919700 1 --2- 172.21.15.79:0/3168207082 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc67804d7f0 0x7fc67804fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68ffff700 1 -- 172.21.15.79:0/3168207082 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc67804d7f0 msgr2=0x7fc67804fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:54.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68f7fe700 1 --2- 172.21.15.79:0/3168207082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6780045a0 0x7fc6780049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68ffff700 1 --2- 172.21.15.79:0/3168207082 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc67804d7f0 0x7fc67804fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68ffff700 1 -- 172.21.15.79:0/3168207082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6780045a0 msgr2=0x7fc6780049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:54.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68ffff700 1 --2- 172.21.15.79:0/3168207082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6780045a0 0x7fc6780049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68ffff700 1 -- 172.21.15.79:0/3168207082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc678050280 con 0x7fc6780038c0 2021-04-09T18:29:54.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc694919700 1 --2- 172.21.15.79:0/3168207082 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc67804d7f0 0x7fc67804fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:29:54.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68f7fe700 1 --2- 172.21.15.79:0/3168207082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6780045a0 0x7fc6780049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:29:54.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68ffff700 1 --2- 172.21.15.79:0/3168207082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6780038c0 0x7fc678003d90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fc680004640 tx=0x7fc680005290).ready entity=mon.0 client_cookie=91e6be54c01ae4c6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:54.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68effd700 1 -- 172.21.15.79:0/3168207082 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc678050280 con 0x7fc6780038c0 2021-04-09T18:29:54.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68effd700 1 -- 172.21.15.79:0/3168207082 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6800053d0 con 0x7fc6780038c0 2021-04-09T18:29:54.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc68effd700 1 -- 172.21.15.79:0/3168207082 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc6900e56d0 con 0x7fc6780038c0 2021-04-09T18:29:54.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc696374700 1 -- 172.21.15.79:0/3168207082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6780038c0 msgr2=0x7fc678003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc696374700 1 --2- 172.21.15.79:0/3168207082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6780038c0 0x7fc678003d90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fc680004640 tx=0x7fc680005290).stop 2021-04-09T18:29:54.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.430 7fc694919700 1 -- 172.21.15.79:0/3168207082 reap_dead start 2021-04-09T18:29:54.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.434 7fc696374700 1 -- 172.21.15.79:0/3168207082 shutdown_connections 2021-04-09T18:29:54.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.434 7fc696374700 1 -- 172.21.15.79:0/3168207082 >> 172.21.15.79:0/3168207082 conn(0x7fc6900e5fe0 msgr2=0x7fc6900e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:54.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.434 7fc696374700 1 -- 172.21.15.79:0/3168207082 shutdown_connections 2021-04-09T18:29:54.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.434 7fc696374700 1 -- 172.21.15.79:0/3168207082 wait complete. 2021-04-09T18:29:54.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.434 7fc696374700 1 Processor -- start 2021-04-09T18:29:54.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.434 7fc696374700 1 -- start start 2021-04-09T18:29:54.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc696374700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6900c1a30 0x7fc6900c2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc696374700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc69019b9e0 0x7fc6900c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc696374700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc690098350 0x7fc6900c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc696374700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc690047500 con 0x7fc69019b9e0 2021-04-09T18:29:54.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc696374700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900c2180 con 0x7fc6900c1a30 2021-04-09T18:29:54.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc696374700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900987a0 con 0x7fc690098350 2021-04-09T18:29:54.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc68f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc69019b9e0 0x7fc6900c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc68f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc69019b9e0 0x7fc6900c2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58344/0 (socket says 172.21.15.79:58344) 2021-04-09T18:29:54.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc694919700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc690098350 0x7fc6900c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc68f7fe700 1 -- 172.21.15.79:0/4049103840 learned_addr learned my addr 172.21.15.79:0/4049103840 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:54.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc68ffff700 1 --2- 172.21.15.79:0/4049103840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6900c1a30 0x7fc6900c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc68f7fe700 1 -- 172.21.15.79:0/4049103840 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc690098350 msgr2=0x7fc6900c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc68f7fe700 1 --2- 172.21.15.79:0/4049103840 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc690098350 0x7fc6900c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc68f7fe700 1 -- 172.21.15.79:0/4049103840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6900c1a30 msgr2=0x7fc6900c2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc68f7fe700 1 --2- 172.21.15.79:0/4049103840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6900c1a30 0x7fc6900c2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc68f7fe700 1 -- 172.21.15.79:0/4049103840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69019e930 con 0x7fc69019b9e0 2021-04-09T18:29:54.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc68ffff700 1 --2- 172.21.15.79:0/4049103840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6900c1a30 0x7fc6900c2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:29:54.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc694919700 1 --2- 172.21.15.79:0/4049103840 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc690098350 0x7fc6900c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:29:54.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc68f7fe700 1 --2- 172.21.15.79:0/4049103840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc69019b9e0 0x7fc6900c2ab0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fc6900b06e0 tx=0x7fc68400bf70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:54.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc68cff9700 1 -- 172.21.15.79:0/4049103840 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc69019e930 con 0x7fc69019b9e0 2021-04-09T18:29:54.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc68cff9700 1 -- 172.21.15.79:0/4049103840 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc684013800 con 0x7fc69019b9e0 2021-04-09T18:29:54.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc696374700 1 -- 172.21.15.79:0/4049103840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6900c1150 con 0x7fc69019b9e0 2021-04-09T18:29:54.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc68cff9700 1 -- 172.21.15.79:0/4049103840 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc684018070 con 0x7fc69019b9e0 2021-04-09T18:29:54.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc696374700 1 -- 172.21.15.79:0/4049103840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6900c7f60 con 0x7fc69019b9e0 2021-04-09T18:29:54.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.438 7fc68cff9700 1 -- 172.21.15.79:0/4049103840 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc684013bd0 con 0x7fc69019b9e0 2021-04-09T18:29:54.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.442 7fc68cff9700 1 --2- 172.21.15.79:0/4049103840 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc670029100 0x7fc67002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.442 7fc68cff9700 1 -- 172.21.15.79:0/4049103840 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fc684039720 con 0x7fc69019b9e0 2021-04-09T18:29:54.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.442 7fc68ffff700 1 --2- 172.21.15.79:0/4049103840 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc670029100 0x7fc67002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.442 7fc68ffff700 1 --2- 172.21.15.79:0/4049103840 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc670029100 0x7fc67002b650 crc :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:54.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.442 7fc696374700 1 -- 172.21.15.79:0/4049103840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6900e39e0 con 0x7fc69019b9e0 2021-04-09T18:29:54.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.450 7fc68cff9700 1 -- 172.21.15.79:0/4049103840 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc684000bf0 con 0x7fc69019b9e0 2021-04-09T18:29:54.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.610 7fc696374700 1 -- 172.21.15.79:0/4049103840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6900f5b20 con 0x7fc69019b9e0 2021-04-09T18:29:54.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.610 7fc68cff9700 1 -- 172.21.15.79:0/4049103840 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+14343 (secure 0 0 0) 0x7fc684013400 con 0x7fc69019b9e0 2021-04-09T18:29:54.614 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:29:54.614 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":50,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:29:53.473860","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:29:51.239559","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2021-04-09 18:29:52.114936","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6835/781814443":"2021-04-10 18:29:53.473795","172.21.15.89:6834/781814443":"2021-04-10 18:29:53.473795"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:29:54.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.614 7fc696374700 1 -- 172.21.15.79:0/4049103840 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc670029100 msgr2=0x7fc67002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.614 7fc696374700 1 --2- 172.21.15.79:0/4049103840 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc670029100 0x7fc67002b650 crc :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.614 7fc696374700 1 -- 172.21.15.79:0/4049103840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc69019b9e0 msgr2=0x7fc6900c2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.614 7fc696374700 1 --2- 172.21.15.79:0/4049103840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc69019b9e0 0x7fc6900c2ab0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fc6900b06e0 tx=0x7fc68400bf70).stop 2021-04-09T18:29:54.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.614 7fc696374700 1 -- 172.21.15.79:0/4049103840 shutdown_connections 2021-04-09T18:29:54.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.614 7fc696374700 1 --2- 172.21.15.79:0/4049103840 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc670029100 0x7fc67002b650 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.614 7fc696374700 1 --2- 172.21.15.79:0/4049103840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6900c1a30 0x7fc6900c2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.614 7fc696374700 1 --2- 172.21.15.79:0/4049103840 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc690098350 0x7fc6900c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.614 7fc696374700 1 --2- 172.21.15.79:0/4049103840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc69019b9e0 0x7fc6900c2ab0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.614 7fc696374700 1 -- 172.21.15.79:0/4049103840 >> 172.21.15.79:0/4049103840 conn(0x7fc6900d8530 msgr2=0x7fc690098c30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:54.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.614 7fc696374700 1 -- 172.21.15.79:0/4049103840 shutdown_connections 2021-04-09T18:29:54.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.614 7fc696374700 1 -- 172.21.15.79:0/4049103840 wait complete. 2021-04-09T18:29:54.627 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:29:54.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.722 7f2ca5c55700 1 Processor -- start 2021-04-09T18:29:54.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.722 7f2ca5c55700 1 -- start start 2021-04-09T18:29:54.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2ca5c55700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2ca00f5580 0x7f2ca00f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2ca5c55700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ca00e9b40 0x7f2ca009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2ca5c55700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca00fbb80 con 0x7f2ca01c6e30 2021-04-09T18:29:54.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2ca5c55700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca00e9f90 con 0x7f2ca00f5580 2021-04-09T18:29:54.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2ca5c55700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca00e59b0 con 0x7f2ca00e9b40 2021-04-09T18:29:54.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2c9f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2ca00f5580 0x7f2ca00f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2c9f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2ca00f5580 0x7f2ca00f6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58348/0 (socket says 172.21.15.79:58348) 2021-04-09T18:29:54.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2c9f7fe700 1 -- 172.21.15.79:0/1791087336 learned_addr learned my addr 172.21.15.79:0/1791087336 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:54.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2c9effd700 1 --2- 172.21.15.79:0/1791087336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ca00e9b40 0x7f2ca009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2c9f7fe700 1 -- 172.21.15.79:0/1791087336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ca00e9b40 msgr2=0x7f2ca009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:54.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2c9f7fe700 1 --2- 172.21.15.79:0/1791087336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ca00e9b40 0x7f2ca009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2c9f7fe700 1 -- 172.21.15.79:0/1791087336 >> v1:172.21.15.89:6789/0 conn(0x7f2ca01c6e30 legacy=0x7f2ca01c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2c9f7fe700 1 -- 172.21.15.79:0/1791087336 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca00e56b0 con 0x7f2ca00f5580 2021-04-09T18:29:54.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2c9f7fe700 1 --2- 172.21.15.79:0/1791087336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ca00f5580 0x7f2ca00f6510 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f2c94002f30 tx=0x7f2c9400bda0).ready entity=mon.0 client_cookie=7d05943e7e7a9e0d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:54.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2c9e7fc700 1 -- 172.21.15.79:0/1791087336 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2ca00e56b0 con 0x7f2ca00f5580 2021-04-09T18:29:54.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2c9e7fc700 1 -- 172.21.15.79:0/1791087336 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c940099d0 con 0x7f2ca00f5580 2021-04-09T18:29:54.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2c9e7fc700 1 -- 172.21.15.79:0/1791087336 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c94009da0 con 0x7f2ca00f5580 2021-04-09T18:29:54.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2ca5c55700 1 -- 172.21.15.79:0/1791087336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ca00f5580 msgr2=0x7f2ca00f6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2ca5c55700 1 --2- 172.21.15.79:0/1791087336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ca00f5580 0x7f2ca00f6510 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f2c94002f30 tx=0x7f2c9400bda0).stop 2021-04-09T18:29:54.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2ca5c55700 1 -- 172.21.15.79:0/1791087336 shutdown_connections 2021-04-09T18:29:54.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2ca5c55700 1 --2- 172.21.15.79:0/1791087336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ca00f5580 0x7f2ca00f6510 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2ca5c55700 1 --2- 172.21.15.79:0/1791087336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ca00e9b40 0x7f2ca009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2ca5c55700 1 -- 172.21.15.79:0/1791087336 >> 172.21.15.79:0/1791087336 conn(0x7f2ca00e6040 msgr2=0x7f2ca00e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:54.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2ca5c55700 1 -- 172.21.15.79:0/1791087336 shutdown_connections 2021-04-09T18:29:54.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.726 7f2ca5c55700 1 -- 172.21.15.79:0/1791087336 wait complete. 2021-04-09T18:29:54.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.730 7f2ca5c55700 1 Processor -- start 2021-04-09T18:29:54.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.730 7f2ca5c55700 1 -- start start 2021-04-09T18:29:54.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.730 7f2ca5c55700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ca00c43c0 0x7f2ca00d5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.730 7f2ca5c55700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ca00c3650 0x7f2ca00c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.730 7f2ca5c55700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ca01b14f0 0x7f2ca01b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.730 7f2ca5c55700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca00c60e0 con 0x7f2ca00c43c0 2021-04-09T18:29:54.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.730 7f2ca5c55700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca00c55b0 con 0x7f2ca01b14f0 2021-04-09T18:29:54.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.730 7f2ca5c55700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca00c5970 con 0x7f2ca00c3650 2021-04-09T18:29:54.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.730 7f2c9f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ca00c43c0 0x7f2ca00d5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.730 7f2c9f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ca00c43c0 0x7f2ca00d5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58354/0 (socket says 172.21.15.79:58354) 2021-04-09T18:29:54.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.734 7f2c9f7fe700 1 -- 172.21.15.79:0/803422752 learned_addr learned my addr 172.21.15.79:0/803422752 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:54.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.734 7f2c9effd700 1 --2- 172.21.15.79:0/803422752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ca00c3650 0x7f2ca00c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.734 7f2c9ffff700 1 --2- 172.21.15.79:0/803422752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ca01b14f0 0x7f2ca01b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.734 7f2c9f7fe700 1 -- 172.21.15.79:0/803422752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ca00c3650 msgr2=0x7f2ca00c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.734 7f2c9f7fe700 1 --2- 172.21.15.79:0/803422752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ca00c3650 0x7f2ca00c3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.734 7f2c9f7fe700 1 -- 172.21.15.79:0/803422752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ca01b14f0 msgr2=0x7f2ca01b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.734 7f2c9f7fe700 1 --2- 172.21.15.79:0/803422752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ca01b14f0 0x7f2ca01b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.734 7f2c9f7fe700 1 -- 172.21.15.79:0/803422752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca00d58c0 con 0x7f2ca00c43c0 2021-04-09T18:29:54.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.734 7f2c9f7fe700 1 --2- 172.21.15.79:0/803422752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ca00c43c0 0x7f2ca00d5290 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f2c94002f30 tx=0x7f2c94006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:54.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.734 7f2c87fff700 1 -- 172.21.15.79:0/803422752 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2ca00d58c0 con 0x7f2ca00c43c0 2021-04-09T18:29:54.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.734 7f2c87fff700 1 -- 172.21.15.79:0/803422752 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c94011e10 con 0x7f2ca00c43c0 2021-04-09T18:29:54.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.734 7f2ca5c55700 1 -- 172.21.15.79:0/803422752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca01b1f70 con 0x7f2ca00c43c0 2021-04-09T18:29:54.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.734 7f2c87fff700 1 -- 172.21.15.79:0/803422752 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c94018770 con 0x7f2ca00c43c0 2021-04-09T18:29:54.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.734 7f2ca5c55700 1 -- 172.21.15.79:0/803422752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca00af660 con 0x7f2ca00c43c0 2021-04-09T18:29:54.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.734 7f2c87fff700 1 -- 172.21.15.79:0/803422752 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2c94018970 con 0x7f2ca00c43c0 2021-04-09T18:29:54.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.734 7f2c87fff700 1 --2- 172.21.15.79:0/803422752 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2c80029100 0x7f2c8002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.734 7f2c87fff700 1 -- 172.21.15.79:0/803422752 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f2c9403c6a0 con 0x7f2ca00c43c0 2021-04-09T18:29:54.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.734 7f2c9effd700 1 --2- 172.21.15.79:0/803422752 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2c80029100 0x7f2c8002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.734 7f2c9effd700 1 --2- 172.21.15.79:0/803422752 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2c80029100 0x7f2c8002b650 crc :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:54.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.738 7f2ca5c55700 1 -- 172.21.15.79:0/803422752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca0088d30 con 0x7f2ca00c43c0 2021-04-09T18:29:54.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.746 7f2c87fff700 1 -- 172.21.15.79:0/803422752 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2c940097c0 con 0x7f2ca00c43c0 2021-04-09T18:29:54.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.914 7f2ca5c55700 1 -- 172.21.15.79:0/803422752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f2ca00e39a0 con 0x7f2ca00c43c0 2021-04-09T18:29:54.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.918 7f2c87fff700 1 -- 172.21.15.79:0/803422752 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v15) v1 ==== 184+0+0 (secure 0 0 0) 0x7f2c94018370 con 0x7f2ca00c43c0 2021-04-09T18:29:54.922 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2021-04-09T18:29:54.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.922 7f2ca5c55700 1 -- 172.21.15.79:0/803422752 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2c80029100 msgr2=0x7f2c8002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.922 7f2ca5c55700 1 --2- 172.21.15.79:0/803422752 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2c80029100 0x7f2c8002b650 crc :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.922 7f2ca5c55700 1 -- 172.21.15.79:0/803422752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ca00c43c0 msgr2=0x7f2ca00d5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.922 7f2ca5c55700 1 --2- 172.21.15.79:0/803422752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ca00c43c0 0x7f2ca00d5290 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f2c94002f30 tx=0x7f2c94006890).stop 2021-04-09T18:29:54.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.922 7f2ca5c55700 1 -- 172.21.15.79:0/803422752 shutdown_connections 2021-04-09T18:29:54.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.922 7f2ca5c55700 1 --2- 172.21.15.79:0/803422752 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2c80029100 0x7f2c8002b650 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.922 7f2ca5c55700 1 --2- 172.21.15.79:0/803422752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ca01b14f0 0x7f2ca01b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.922 7f2ca5c55700 1 --2- 172.21.15.79:0/803422752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ca00c43c0 0x7f2ca00d5290 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.922 7f2ca5c55700 1 --2- 172.21.15.79:0/803422752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ca00c3650 0x7f2ca00c3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.922 7f2ca5c55700 1 -- 172.21.15.79:0/803422752 >> 172.21.15.79:0/803422752 conn(0x7f2ca009abd0 msgr2=0x7f2ca00d8440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:54.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.922 7f2ca5c55700 1 -- 172.21.15.79:0/803422752 shutdown_connections 2021-04-09T18:29:54.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:54.922 7f2ca5c55700 1 -- 172.21.15.79:0/803422752 wait complete. 2021-04-09T18:29:54.936 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:29:55.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.038 7f16e40c5700 1 Processor -- start 2021-04-09T18:29:55.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.038 7f16e40c5700 1 -- start start 2021-04-09T18:29:55.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.038 7f16e40c5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16dc0f5580 0x7f16dc0f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:55.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.038 7f16e40c5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f16dc1c7e40 0x7f16dc1ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:55.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.038 7f16e40c5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16dc0fbb80 con 0x7f16dc0e9b40 2021-04-09T18:29:55.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.038 7f16e40c5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16dc0e9f90 con 0x7f16dc1c7e40 2021-04-09T18:29:55.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.038 7f16e40c5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0e59b0 con 0x7f16dc0f5580 2021-04-09T18:29:55.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.038 7f16e266a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f16dc1c7e40 0x7f16dc1ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:55.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.038 7f16e266a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f16dc1c7e40 0x7f16dc1ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58366/0 (socket says 172.21.15.79:58366) 2021-04-09T18:29:55.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.038 7f16e266a700 1 -- 172.21.15.79:0/1747768278 learned_addr learned my addr 172.21.15.79:0/1747768278 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:55.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.038 7f16e1e69700 1 --2- 172.21.15.79:0/1747768278 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16dc0f5580 0x7f16dc0f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:55.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.038 7f16e266a700 1 -- 172.21.15.79:0/1747768278 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16dc0f5580 msgr2=0x7f16dc0f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:55.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.038 7f16e266a700 1 --2- 172.21.15.79:0/1747768278 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16dc0f5580 0x7f16dc0f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.038 7f16e266a700 1 -- 172.21.15.79:0/1747768278 >> v1:172.21.15.89:6789/0 conn(0x7f16dc0e9b40 legacy=0x7f16dc09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:55.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.038 7f16e266a700 1 -- 172.21.15.79:0/1747768278 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc09f910 con 0x7f16dc1c7e40 2021-04-09T18:29:55.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.038 7f16e266a700 1 --2- 172.21.15.79:0/1747768278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16dc1c7e40 0x7f16dc1ca2a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f16d40032b0 tx=0x7f16d400b3c0).ready entity=mon.0 client_cookie=6acdf945c61a5463 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:55.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.042 7f16e0e67700 1 -- 172.21.15.79:0/1747768278 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f16dc09f910 con 0x7f16dc1c7e40 2021-04-09T18:29:55.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.042 7f16e0e67700 1 -- 172.21.15.79:0/1747768278 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d400bc20 con 0x7f16dc1c7e40 2021-04-09T18:29:55.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.042 7f16e0e67700 1 -- 172.21.15.79:0/1747768278 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f16d4002020 con 0x7f16dc1c7e40 2021-04-09T18:29:55.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.042 7f16e40c5700 1 -- 172.21.15.79:0/1747768278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16dc1c7e40 msgr2=0x7f16dc1ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:55.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.042 7f16e40c5700 1 --2- 172.21.15.79:0/1747768278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16dc1c7e40 0x7f16dc1ca2a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f16d40032b0 tx=0x7f16d400b3c0).stop 2021-04-09T18:29:55.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.042 7f16e40c5700 1 -- 172.21.15.79:0/1747768278 shutdown_connections 2021-04-09T18:29:55.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.042 7f16e40c5700 1 --2- 172.21.15.79:0/1747768278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16dc1c7e40 0x7f16dc1ca2a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.042 7f16e40c5700 1 --2- 172.21.15.79:0/1747768278 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16dc0f5580 0x7f16dc0f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.042 7f16e40c5700 1 -- 172.21.15.79:0/1747768278 >> 172.21.15.79:0/1747768278 conn(0x7f16dc0e6040 msgr2=0x7f16dc0e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:55.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.042 7f16e40c5700 1 -- 172.21.15.79:0/1747768278 shutdown_connections 2021-04-09T18:29:55.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.042 7f16e40c5700 1 -- 172.21.15.79:0/1747768278 wait complete. 2021-04-09T18:29:55.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.046 7f16e40c5700 1 Processor -- start 2021-04-09T18:29:55.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.046 7f16e40c5700 1 -- start start 2021-04-09T18:29:55.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.046 7f16e40c5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16dc1b1110 0x7f16dc0a5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:55.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.046 7f16e40c5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16dc1b1560 0x7f16dc0a6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:55.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.046 7f16e40c5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16dc09a120 0x7f16dc09a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:55.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.046 7f16e40c5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0a9040 con 0x7f16dc09a120 2021-04-09T18:29:55.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.046 7f16e40c5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0a8510 con 0x7f16dc1b1560 2021-04-09T18:29:55.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.046 7f16e40c5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc09b400 con 0x7f16dc1b1110 2021-04-09T18:29:55.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.046 7f16e266a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16dc09a120 0x7f16dc09a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:55.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.046 7f16e266a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16dc09a120 0x7f16dc09a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58372/0 (socket says 172.21.15.79:58372) 2021-04-09T18:29:55.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.046 7f16e266a700 1 -- 172.21.15.79:0/3191952210 learned_addr learned my addr 172.21.15.79:0/3191952210 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:55.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.046 7f16e1e69700 1 --2- 172.21.15.79:0/3191952210 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16dc1b1110 0x7f16dc0a5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:55.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.046 7f16e1668700 1 --2- 172.21.15.79:0/3191952210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16dc1b1560 0x7f16dc0a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:55.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.046 7f16e266a700 1 -- 172.21.15.79:0/3191952210 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16dc1b1110 msgr2=0x7f16dc0a5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:55.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.046 7f16e266a700 1 --2- 172.21.15.79:0/3191952210 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16dc1b1110 0x7f16dc0a5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.046 7f16e266a700 1 -- 172.21.15.79:0/3191952210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16dc1b1560 msgr2=0x7f16dc0a6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:55.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.046 7f16e266a700 1 --2- 172.21.15.79:0/3191952210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16dc1b1560 0x7f16dc0a6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.046 7f16e266a700 1 -- 172.21.15.79:0/3191952210 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc1c0800 con 0x7f16dc09a120 2021-04-09T18:29:55.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.050 7f16e266a700 1 --2- 172.21.15.79:0/3191952210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16dc09a120 0x7f16dc09a570 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f16dc0d8460 tx=0x7f16d4006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:55.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.050 7f16da7fc700 1 -- 172.21.15.79:0/3191952210 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f16dc1c0800 con 0x7f16dc09a120 2021-04-09T18:29:55.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.050 7f16da7fc700 1 -- 172.21.15.79:0/3191952210 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d401b670 con 0x7f16dc09a120 2021-04-09T18:29:55.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.050 7f16da7fc700 1 -- 172.21.15.79:0/3191952210 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f16d4020020 con 0x7f16dc09a120 2021-04-09T18:29:55.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.050 7f16e40c5700 1 -- 172.21.15.79:0/3191952210 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16dc0a6860 con 0x7f16dc09a120 2021-04-09T18:29:55.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.050 7f16e40c5700 1 -- 172.21.15.79:0/3191952210 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc09aba0 con 0x7f16dc09a120 2021-04-09T18:29:55.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.050 7f16da7fc700 1 -- 172.21.15.79:0/3191952210 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f16d4019040 con 0x7f16dc09a120 2021-04-09T18:29:55.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.050 7f16da7fc700 1 --2- 172.21.15.79:0/3191952210 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f16bc029100 0x7f16bc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:55.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.050 7f16da7fc700 1 -- 172.21.15.79:0/3191952210 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f16d4018040 con 0x7f16dc09a120 2021-04-09T18:29:55.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.050 7f16e1e69700 1 --2- 172.21.15.79:0/3191952210 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f16bc029100 0x7f16bc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:55.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.050 7f16e1e69700 1 --2- 172.21.15.79:0/3191952210 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f16bc029100 0x7f16bc02b650 crc :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:55.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.054 7f16e40c5700 1 -- 172.21.15.79:0/3191952210 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16dc088d30 con 0x7f16dc09a120 2021-04-09T18:29:55.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.062 7f16da7fc700 1 -- 172.21.15.79:0/3191952210 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f16d401b460 con 0x7f16dc09a120 2021-04-09T18:29:55.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.222 7f16e40c5700 1 -- 172.21.15.79:0/3191952210 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f16dc0e39a0 con 0x7f16dc09a120 2021-04-09T18:29:55.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.226 7f16da7fc700 1 -- 172.21.15.79:0/3191952210 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7f16dc0f7720 con 0x7f16dc09a120 2021-04-09T18:29:55.230 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.1 2021-04-09T18:29:55.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.230 7f16e40c5700 1 -- 172.21.15.79:0/3191952210 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f16bc029100 msgr2=0x7f16bc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:55.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.230 7f16e40c5700 1 --2- 172.21.15.79:0/3191952210 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f16bc029100 0x7f16bc02b650 crc :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.230 7f16e40c5700 1 -- 172.21.15.79:0/3191952210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16dc09a120 msgr2=0x7f16dc09a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:55.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.230 7f16e40c5700 1 --2- 172.21.15.79:0/3191952210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16dc09a120 0x7f16dc09a570 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f16dc0d8460 tx=0x7f16d4006c10).stop 2021-04-09T18:29:55.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.230 7f16e40c5700 1 -- 172.21.15.79:0/3191952210 shutdown_connections 2021-04-09T18:29:55.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.230 7f16e40c5700 1 --2- 172.21.15.79:0/3191952210 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f16bc029100 0x7f16bc02b650 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.230 7f16e40c5700 1 --2- 172.21.15.79:0/3191952210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16dc09a120 0x7f16dc09a570 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.230 7f16e40c5700 1 --2- 172.21.15.79:0/3191952210 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16dc1b1110 0x7f16dc0a5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.230 7f16e40c5700 1 --2- 172.21.15.79:0/3191952210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16dc1b1560 0x7f16dc0a6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.230 7f16e40c5700 1 -- 172.21.15.79:0/3191952210 >> 172.21.15.79:0/3191952210 conn(0x7f16dc0a2470 msgr2=0x7f16dc0d86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:55.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.230 7f16e40c5700 1 -- 172.21.15.79:0/3191952210 shutdown_connections 2021-04-09T18:29:55.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.230 7f16e40c5700 1 -- 172.21.15.79:0/3191952210 wait complete. 2021-04-09T18:29:55.248 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:29:55.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.350 7f4415eeb700 1 Processor -- start 2021-04-09T18:29:55.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.350 7f4415eeb700 1 -- start start 2021-04-09T18:29:55.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.350 7f4415eeb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f44100e9b40 0x7f441009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:55.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.350 7f4415eeb700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44100fbb80 con 0x7f44100f5580 2021-04-09T18:29:55.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.350 7f4415eeb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44100e56b0 con 0x7f44101c7e40 2021-04-09T18:29:55.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.350 7f4415eeb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44100e9f90 con 0x7f44100e9b40 2021-04-09T18:29:55.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.354 7f440f7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f44100f5580 0x7f44100f6510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53086/0 (socket says 172.21.15.79:53086) 2021-04-09T18:29:55.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.354 7f440f7fe700 1 -- 172.21.15.79:0/2068702758 learned_addr learned my addr 172.21.15.79:0/2068702758 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:55.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.354 7f440effd700 1 --2- 172.21.15.79:0/2068702758 >> v2:172.21.15.89:3300/0 conn(0x7f44100e9b40 0x7f441009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:55.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.354 7f440e7fc700 1 -- 172.21.15.79:0/2068702758 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1464377733 0 0) 0x7f43f80010d0 con 0x7f44100f5580 2021-04-09T18:29:55.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.354 7f440e7fc700 1 -- 172.21.15.79:0/2068702758 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43fc003240 con 0x7f44100f5580 2021-04-09T18:29:55.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.354 7f440effd700 1 -- 172.21.15.79:0/2068702758 >> v1:172.21.15.89:6789/0 conn(0x7f44101c7e40 legacy=0x7f44101ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:55.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.354 7f440e7fc700 1 -- 172.21.15.79:0/2068702758 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1077303503 0 0) 0x7f43f8001650 con 0x7f44100f5580 2021-04-09T18:29:55.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.354 7f440effd700 1 -- 172.21.15.79:0/2068702758 >> v1:172.21.15.79:6789/0 conn(0x7f44100f5580 legacy=0x7f44100f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:55.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.354 7f440effd700 1 -- 172.21.15.79:0/2068702758 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44100e4310 con 0x7f44100e9b40 2021-04-09T18:29:55.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.354 7f440effd700 1 --2- 172.21.15.79:0/2068702758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44100e9b40 0x7f441009f110 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f43f8001db0 tx=0x7f440000b0e0).ready entity=mon.1 client_cookie=eadabb93d13a762c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:55.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.354 7f440e7fc700 1 -- 172.21.15.79:0/2068702758 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f44100e4310 con 0x7f44100e9b40 2021-04-09T18:29:55.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.354 7f440e7fc700 1 -- 172.21.15.79:0/2068702758 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440000b9b0 con 0x7f44100e9b40 2021-04-09T18:29:55.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.354 7f440e7fc700 1 -- 172.21.15.79:0/2068702758 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4400002020 con 0x7f44100e9b40 2021-04-09T18:29:55.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.354 7f4415eeb700 1 -- 172.21.15.79:0/2068702758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44100e9b40 msgr2=0x7f441009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:55.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.354 7f4415eeb700 1 --2- 172.21.15.79:0/2068702758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44100e9b40 0x7f441009f110 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f43f8001db0 tx=0x7f440000b0e0).stop 2021-04-09T18:29:55.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.354 7f4415eeb700 1 -- 172.21.15.79:0/2068702758 shutdown_connections 2021-04-09T18:29:55.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.354 7f4415eeb700 1 --2- 172.21.15.79:0/2068702758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44100e9b40 0x7f441009f110 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.354 7f4415eeb700 1 -- 172.21.15.79:0/2068702758 >> 172.21.15.79:0/2068702758 conn(0x7f44100e6040 msgr2=0x7f44100e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:55.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.354 7f4415eeb700 1 -- 172.21.15.79:0/2068702758 shutdown_connections 2021-04-09T18:29:55.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.354 7f4415eeb700 1 -- 172.21.15.79:0/2068702758 wait complete. 2021-04-09T18:29:55.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.358 7f4415eeb700 1 Processor -- start 2021-04-09T18:29:55.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.358 7f4415eeb700 1 -- start start 2021-04-09T18:29:55.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f4415eeb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44100ba560 0x7f44100cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:55.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f4415eeb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44100ba9b0 0x7f441008fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:55.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f4415eeb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44100ce240 0x7f4410090110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:55.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f4415eeb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44100d4ef0 con 0x7f44100ba9b0 2021-04-09T18:29:55.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f4415eeb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44101a2db0 con 0x7f44100ba560 2021-04-09T18:29:55.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f4415eeb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44100d6490 con 0x7f44100ce240 2021-04-09T18:29:55.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f440effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44100ba9b0 0x7f441008fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:55.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f440effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44100ba9b0 0x7f441008fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58384/0 (socket says 172.21.15.79:58384) 2021-04-09T18:29:55.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f440effd700 1 -- 172.21.15.79:0/1492730057 learned_addr learned my addr 172.21.15.79:0/1492730057 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:55.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f440f7fe700 1 --2- 172.21.15.79:0/1492730057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44100ba560 0x7f44100cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:55.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f440ffff700 1 --2- 172.21.15.79:0/1492730057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44100ce240 0x7f4410090110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:55.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f440effd700 1 -- 172.21.15.79:0/1492730057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44100ce240 msgr2=0x7f4410090110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:55.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f440effd700 1 --2- 172.21.15.79:0/1492730057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44100ce240 0x7f4410090110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f440effd700 1 -- 172.21.15.79:0/1492730057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44100ba560 msgr2=0x7f44100cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:55.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f440effd700 1 --2- 172.21.15.79:0/1492730057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44100ba560 0x7f44100cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f440effd700 1 -- 172.21.15.79:0/1492730057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4410090af0 con 0x7f44100ba9b0 2021-04-09T18:29:55.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f440effd700 1 --2- 172.21.15.79:0/1492730057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44100ba9b0 0x7f441008fae0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f44101a2fb0 tx=0x7f4400006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:55.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f4407fff700 1 -- 172.21.15.79:0/1492730057 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4410090af0 con 0x7f44100ba9b0 2021-04-09T18:29:55.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f4407fff700 1 -- 172.21.15.79:0/1492730057 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4400011e00 con 0x7f44100ba9b0 2021-04-09T18:29:55.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f4415eeb700 1 -- 172.21.15.79:0/1492730057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44100b8a00 con 0x7f44100ba9b0 2021-04-09T18:29:55.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f4407fff700 1 -- 172.21.15.79:0/1492730057 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f43f8001bb0 con 0x7f44100ba9b0 2021-04-09T18:29:55.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f4415eeb700 1 -- 172.21.15.79:0/1492730057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44100d48a0 con 0x7f44100ba9b0 2021-04-09T18:29:55.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f4407fff700 1 -- 172.21.15.79:0/1492730057 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f440001d840 con 0x7f44100ba9b0 2021-04-09T18:29:55.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f4407fff700 1 --2- 172.21.15.79:0/1492730057 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f43f4029100 0x7f43f402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:55.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f4407fff700 1 -- 172.21.15.79:0/1492730057 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f440003bce0 con 0x7f44100ba9b0 2021-04-09T18:29:55.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.362 7f440f7fe700 1 --2- 172.21.15.79:0/1492730057 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f43f4029100 0x7f43f402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:55.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.366 7f440f7fe700 1 --2- 172.21.15.79:0/1492730057 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f43f4029100 0x7f43f402b650 crc :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:55.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.366 7f4415eeb700 1 -- 172.21.15.79:0/1492730057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4410088d30 con 0x7f44100ba9b0 2021-04-09T18:29:55.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.374 7f4407fff700 1 -- 172.21.15.79:0/1492730057 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f440001d440 con 0x7f44100ba9b0 2021-04-09T18:29:55.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.542 7f4415eeb700 1 -- 172.21.15.79:0/1492730057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f44100e39a0 con 0x7f44100ba9b0 2021-04-09T18:29:55.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.550 7f4407fff700 1 -- 172.21.15.79:0/1492730057 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v17) v1 ==== 184+0+0 (secure 0 0 0) 0x7f440000b7a0 con 0x7f44100ba9b0 2021-04-09T18:29:55.551 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.2 2021-04-09T18:29:55.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.550 7f4415eeb700 1 -- 172.21.15.79:0/1492730057 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f43f4029100 msgr2=0x7f43f402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:55.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.550 7f4415eeb700 1 --2- 172.21.15.79:0/1492730057 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f43f4029100 0x7f43f402b650 crc :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.550 7f4415eeb700 1 -- 172.21.15.79:0/1492730057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44100ba9b0 msgr2=0x7f441008fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:55.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.550 7f4415eeb700 1 --2- 172.21.15.79:0/1492730057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44100ba9b0 0x7f441008fae0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f44101a2fb0 tx=0x7f4400006c10).stop 2021-04-09T18:29:55.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.550 7f4415eeb700 1 -- 172.21.15.79:0/1492730057 shutdown_connections 2021-04-09T18:29:55.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.550 7f4415eeb700 1 --2- 172.21.15.79:0/1492730057 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f43f4029100 0x7f43f402b650 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.550 7f4415eeb700 1 --2- 172.21.15.79:0/1492730057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44100ba560 0x7f44100cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.550 7f4415eeb700 1 --2- 172.21.15.79:0/1492730057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44100ce240 0x7f4410090110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.550 7f4415eeb700 1 --2- 172.21.15.79:0/1492730057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44100ba9b0 0x7f441008fae0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.550 7f4415eeb700 1 -- 172.21.15.79:0/1492730057 >> 172.21.15.79:0/1492730057 conn(0x7f441008dde0 msgr2=0x7f44100d3350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:55.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.554 7f4415eeb700 1 -- 172.21.15.79:0/1492730057 shutdown_connections 2021-04-09T18:29:55.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.554 7f4415eeb700 1 -- 172.21.15.79:0/1492730057 wait complete. 2021-04-09T18:29:55.566 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:29:55.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.658 7fc11fb97700 1 Processor -- start 2021-04-09T18:29:55.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.658 7fc11fb97700 1 -- start start 2021-04-09T18:29:55.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.658 7fc11fb97700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1180f5510 0x7fc1180f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:55.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.658 7fc11fb97700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc1180e9ad0 0x7fc11809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.658 7fc11fb97700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1180fbb10 con 0x7fc1181c2da0 2021-04-09T18:29:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.658 7fc11fb97700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1180e9f20 con 0x7fc1180e9ad0 2021-04-09T18:29:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.658 7fc11fb97700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1180e59c0 con 0x7fc1180f5510 2021-04-09T18:29:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.658 7fc11e13c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc1181c2da0 0x7fc1181c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53104/0 (socket says 172.21.15.79:53104) 2021-04-09T18:29:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.658 7fc11e13c700 1 -- 172.21.15.79:0/2247018383 learned_addr learned my addr 172.21.15.79:0/2247018383 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:55.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.658 7fc11d93b700 1 --2- 172.21.15.79:0/2247018383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1180f5510 0x7fc1180f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:55.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.658 7fc11d13a700 1 --2- 172.21.15.79:0/2247018383 >> v2:172.21.15.89:3300/0 conn(0x7fc1180e9ad0 0x7fc11809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:55.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.658 7fc11c939700 1 -- 172.21.15.79:0/2247018383 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396405132 0 0) 0x7fc1100010d0 con 0x7fc1181c2da0 2021-04-09T18:29:55.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.662 7fc11c939700 1 -- 172.21.15.79:0/2247018383 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc100003240 con 0x7fc1181c2da0 2021-04-09T18:29:55.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.662 7fc11d93b700 1 -- 172.21.15.79:0/2247018383 >> v2:172.21.15.89:3300/0 conn(0x7fc1180e9ad0 msgr2=0x7fc11809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:55.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.662 7fc11d93b700 1 --2- 172.21.15.79:0/2247018383 >> v2:172.21.15.89:3300/0 conn(0x7fc1180e9ad0 0x7fc11809f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.662 7fc11d93b700 1 -- 172.21.15.79:0/2247018383 >> v1:172.21.15.79:6789/0 conn(0x7fc1181c2da0 legacy=0x7fc1181c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:55.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.662 7fc11d93b700 1 -- 172.21.15.79:0/2247018383 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1180e56c0 con 0x7fc1180f5510 2021-04-09T18:29:55.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.662 7fc11d13a700 1 --2- 172.21.15.79:0/2247018383 >> v2:172.21.15.89:3300/0 conn(0x7fc1180e9ad0 0x7fc11809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:29:55.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.662 7fc11d93b700 1 --2- 172.21.15.79:0/2247018383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1180f5510 0x7fc1180f64a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fc1080032b0 tx=0x7fc10800b0e0).ready entity=mon.2 client_cookie=c1c8dc4b4ccd65f1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:55.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.662 7fc11c939700 1 -- 172.21.15.79:0/2247018383 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc1180e56c0 con 0x7fc1180f5510 2021-04-09T18:29:55.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.662 7fc11c939700 1 -- 172.21.15.79:0/2247018383 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10800bab0 con 0x7fc1180f5510 2021-04-09T18:29:55.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.662 7fc11c939700 1 -- 172.21.15.79:0/2247018383 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc108002020 con 0x7fc1180f5510 2021-04-09T18:29:55.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.662 7fc11fb97700 1 -- 172.21.15.79:0/2247018383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1180f5510 msgr2=0x7fc1180f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:55.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.662 7fc11fb97700 1 --2- 172.21.15.79:0/2247018383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1180f5510 0x7fc1180f64a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fc1080032b0 tx=0x7fc10800b0e0).stop 2021-04-09T18:29:55.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.662 7fc11fb97700 1 -- 172.21.15.79:0/2247018383 shutdown_connections 2021-04-09T18:29:55.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.662 7fc11fb97700 1 --2- 172.21.15.79:0/2247018383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1180f5510 0x7fc1180f64a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.662 7fc11fb97700 1 --2- 172.21.15.79:0/2247018383 >> v2:172.21.15.89:3300/0 conn(0x7fc1180e9ad0 0x7fc11809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.662 7fc11fb97700 1 -- 172.21.15.79:0/2247018383 >> 172.21.15.79:0/2247018383 conn(0x7fc1180e5fd0 msgr2=0x7fc1180e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.662 7fc11fb97700 1 -- 172.21.15.79:0/2247018383 shutdown_connections 2021-04-09T18:29:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.662 7fc11fb97700 1 -- 172.21.15.79:0/2247018383 wait complete. 2021-04-09T18:29:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11fb97700 1 Processor -- start 2021-04-09T18:29:55.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11fb97700 1 -- start start 2021-04-09T18:29:55.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11fb97700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1180ab940 0x7fc1180d7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11fb97700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1180ad2a0 0x7fc11809a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11fb97700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc11809a880 0x7fc1180cff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11fb97700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1180ad6f0 con 0x7fc1180ad2a0 2021-04-09T18:29:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11fb97700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc118099bc0 con 0x7fc1180ab940 2021-04-09T18:29:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11fb97700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1180d4980 con 0x7fc11809a880 2021-04-09T18:29:55.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11d13a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1180ad2a0 0x7fc11809a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:55.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11d93b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1180ab940 0x7fc1180d7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:55.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11d13a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1180ad2a0 0x7fc11809a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58400/0 (socket says 172.21.15.79:58400) 2021-04-09T18:29:55.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11d13a700 1 -- 172.21.15.79:0/1570338068 learned_addr learned my addr 172.21.15.79:0/1570338068 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:55.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11e13c700 1 --2- 172.21.15.79:0/1570338068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc11809a880 0x7fc1180cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:55.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11d13a700 1 -- 172.21.15.79:0/1570338068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc11809a880 msgr2=0x7fc1180cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:55.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11d13a700 1 --2- 172.21.15.79:0/1570338068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc11809a880 0x7fc1180cff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11d13a700 1 -- 172.21.15.79:0/1570338068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1180ab940 msgr2=0x7fc1180d7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:55.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11d13a700 1 --2- 172.21.15.79:0/1570338068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1180ab940 0x7fc1180d7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11d13a700 1 -- 172.21.15.79:0/1570338068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1180917c0 con 0x7fc1180ad2a0 2021-04-09T18:29:55.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11d93b700 1 --2- 172.21.15.79:0/1570338068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1180ab940 0x7fc1180d7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:29:55.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11d13a700 1 --2- 172.21.15.79:0/1570338068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1180ad2a0 0x7fc11809a250 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fc10c00efc0 tx=0x7fc10c00c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:55.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc1167fc700 1 -- 172.21.15.79:0/1570338068 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc1180917c0 con 0x7fc1180ad2a0 2021-04-09T18:29:55.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc1167fc700 1 -- 172.21.15.79:0/1570338068 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c0123f0 con 0x7fc1180ad2a0 2021-04-09T18:29:55.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11fb97700 1 -- 172.21.15.79:0/1570338068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1180d0570 con 0x7fc1180ad2a0 2021-04-09T18:29:55.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc1167fc700 1 -- 172.21.15.79:0/1570338068 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc10c00f040 con 0x7fc1180ad2a0 2021-04-09T18:29:55.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.666 7fc11fb97700 1 -- 172.21.15.79:0/1570338068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc118094180 con 0x7fc1180ad2a0 2021-04-09T18:29:55.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.670 7fc1167fc700 1 -- 172.21.15.79:0/1570338068 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc10c011070 con 0x7fc1180ad2a0 2021-04-09T18:29:55.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.670 7fc1167fc700 1 --2- 172.21.15.79:0/1570338068 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc0f8029100 0x7fc0f802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:55.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.670 7fc1167fc700 1 -- 172.21.15.79:0/1570338068 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fc10c010040 con 0x7fc1180ad2a0 2021-04-09T18:29:55.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.670 7fc11d93b700 1 --2- 172.21.15.79:0/1570338068 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc0f8029100 0x7fc0f802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:55.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.670 7fc11d93b700 1 --2- 172.21.15.79:0/1570338068 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc0f8029100 0x7fc0f802b650 crc :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:55.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.674 7fc11fb97700 1 -- 172.21.15.79:0/1570338068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1180e39d0 con 0x7fc1180ad2a0 2021-04-09T18:29:55.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.678 7fc1167fc700 1 -- 172.21.15.79:0/1570338068 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc10c000bf0 con 0x7fc1180ad2a0 2021-04-09T18:29:55.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.842 7fc11fb97700 1 -- 172.21.15.79:0/1570338068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1180f5b10 con 0x7fc1180ad2a0 2021-04-09T18:29:55.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.842 7fc1167fc700 1 -- 172.21.15.79:0/1570338068 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2102 (secure 0 0 0) 0x7fc10c00ca90 con 0x7fc1180ad2a0 2021-04-09T18:29:55.845 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 26 2021-04-09T18:29:55.845 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:29:55.846 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3328659942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3328659942},{"type":"v1","addr":"172.21.15.79:6833","nonce":3328659942}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:29:53.022273","modified":"2021-04-09 18:29:55.034774","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":50,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5111":{"gid":5111,"name":"b","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/1280399112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1280399112},{"type":"v1","addr":"172.21.15.89:6835","nonce":1280399112}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-04-09T18:29:55.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.842 7fc11fb97700 1 -- 172.21.15.79:0/1570338068 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc0f8029100 msgr2=0x7fc0f802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:55.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.842 7fc11fb97700 1 --2- 172.21.15.79:0/1570338068 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc0f8029100 0x7fc0f802b650 crc :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.842 7fc11fb97700 1 -- 172.21.15.79:0/1570338068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1180ad2a0 msgr2=0x7fc11809a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:55.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.842 7fc11fb97700 1 --2- 172.21.15.79:0/1570338068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1180ad2a0 0x7fc11809a250 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fc10c00efc0 tx=0x7fc10c00c430).stop 2021-04-09T18:29:55.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.846 7fc11fb97700 1 -- 172.21.15.79:0/1570338068 shutdown_connections 2021-04-09T18:29:55.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.846 7fc11fb97700 1 --2- 172.21.15.79:0/1570338068 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc0f8029100 0x7fc0f802b650 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.846 7fc11fb97700 1 --2- 172.21.15.79:0/1570338068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1180ab940 0x7fc1180d7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.846 7fc11fb97700 1 --2- 172.21.15.79:0/1570338068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc11809a880 0x7fc1180cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.846 7fc11fb97700 1 --2- 172.21.15.79:0/1570338068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1180ad2a0 0x7fc11809a250 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:55.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.846 7fc11fb97700 1 -- 172.21.15.79:0/1570338068 >> 172.21.15.79:0/1570338068 conn(0x7fc1180bb030 msgr2=0x7fc1180d3230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:55.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.846 7fc11fb97700 1 -- 172.21.15.79:0/1570338068 shutdown_connections 2021-04-09T18:29:55.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:55.846 7fc11fb97700 1 -- 172.21.15.79:0/1570338068 wait complete. 2021-04-09T18:29:56.057 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:29:53.022273', 'modified': '2021-04-09 18:29:55.034774', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 50, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5111}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5111': {'gid': 5111, 'name': 'b', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6835/1280399112', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 1280399112}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 1280399112}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:29:56.058 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:29:56.058 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2021-04-09T18:29:56.150 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:29:56.150 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:29:56.150 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2021-04-09T18:29:56.150 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 5111, 2021-04-09T18:29:56.151 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2021-04-09T18:29:56.151 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2021-04-09T18:29:56.151 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 2.112617476, 2021-04-09T18:29:56.151 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 26, 2021-04-09T18:29:56.152 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 50, 2021-04-09T18:29:56.152 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 50, 2021-04-09T18:29:56.152 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 6.7282147749999996 2021-04-09T18:29:56.152 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:29:56.156 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 5111, "want_state": "up:active", "state": "up:active", "rank_uptime": 2.112617476, "mdsmap_epoch": 26, "osdmap_epoch": 50, "osdmap_epoch_barrier": 50, "uptime": 6.7282147749999996 } 2021-04-09T18:29:56.157 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:29:56.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.254 7f7607174700 1 Processor -- start 2021-04-09T18:29:56.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.254 7f7607174700 1 -- start start 2021-04-09T18:29:56.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f7607174700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76000f5520 0x7f76000f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f7607174700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f76001c8010 0x7f76001ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f7607174700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76000fbb20 con 0x7f76000e9ae0 2021-04-09T18:29:56.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f7607174700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76000e9f30 con 0x7f76001c8010 2021-04-09T18:29:56.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f7607174700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76001c3dc0 con 0x7f76000f5520 2021-04-09T18:29:56.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f75fffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f76000e9ae0 0x7f760009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53114/0 (socket says 172.21.15.79:53114) 2021-04-09T18:29:56.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f75fffff700 1 -- 172.21.15.79:0/256002628 learned_addr learned my addr 172.21.15.79:0/256002628 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:56.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f7605719700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f76001c8010 0x7f76001ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f7604f18700 1 --2- 172.21.15.79:0/256002628 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76000f5520 0x7f76000f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f75ff7fe700 1 -- 172.21.15.79:0/256002628 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010135424 0 0) 0x7f75f40010d0 con 0x7f76000e9ae0 2021-04-09T18:29:56.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f75ff7fe700 1 -- 172.21.15.79:0/256002628 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e8003240 con 0x7f76000e9ae0 2021-04-09T18:29:56.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f7605719700 1 -- 172.21.15.79:0/256002628 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76000f5520 msgr2=0x7f76000f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:56.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f7605719700 1 --2- 172.21.15.79:0/256002628 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76000f5520 0x7f76000f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f7605719700 1 -- 172.21.15.79:0/256002628 >> v1:172.21.15.79:6789/0 conn(0x7f76000e9ae0 legacy=0x7f760009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:56.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f7605719700 1 -- 172.21.15.79:0/256002628 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760009f910 con 0x7f76001c8010 2021-04-09T18:29:56.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f7605719700 1 --2- 172.21.15.79:0/256002628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76001c8010 0x7f76001ca470 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f75f80032b0 tx=0x7f75f800b3c0).ready entity=mon.0 client_cookie=ddf9a423692b10f1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:56.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f75ff7fe700 1 -- 172.21.15.79:0/256002628 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f760009f910 con 0x7f76001c8010 2021-04-09T18:29:56.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f75ff7fe700 1 -- 172.21.15.79:0/256002628 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f800bc20 con 0x7f76001c8010 2021-04-09T18:29:56.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f75ff7fe700 1 -- 172.21.15.79:0/256002628 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f75f8002020 con 0x7f76001c8010 2021-04-09T18:29:56.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f7607174700 1 -- 172.21.15.79:0/256002628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76001c8010 msgr2=0x7f76001ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:56.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f7607174700 1 --2- 172.21.15.79:0/256002628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76001c8010 0x7f76001ca470 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f75f80032b0 tx=0x7f75f800b3c0).stop 2021-04-09T18:29:56.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f7607174700 1 -- 172.21.15.79:0/256002628 shutdown_connections 2021-04-09T18:29:56.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f7607174700 1 --2- 172.21.15.79:0/256002628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76001c8010 0x7f76001ca470 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f7607174700 1 --2- 172.21.15.79:0/256002628 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76000f5520 0x7f76000f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f7607174700 1 -- 172.21.15.79:0/256002628 >> 172.21.15.79:0/256002628 conn(0x7f76000e5fe0 msgr2=0x7f76000e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:56.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f7607174700 1 -- 172.21.15.79:0/256002628 shutdown_connections 2021-04-09T18:29:56.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.258 7f7607174700 1 -- 172.21.15.79:0/256002628 wait complete. 2021-04-09T18:29:56.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.262 7f7607174700 1 Processor -- start 2021-04-09T18:29:56.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.262 7f7607174700 1 -- start start 2021-04-09T18:29:56.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.262 7f7607174700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f760008f830 0x7f76000d6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f7607174700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76000a5010 0x7f76000a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f7607174700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7600090b30 0x7f7600090f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f7607174700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7600090630 con 0x7f7600090b30 2021-04-09T18:29:56.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f7607174700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760009a460 con 0x7f760008f830 2021-04-09T18:29:56.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f7607174700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760009a160 con 0x7f76000a5010 2021-04-09T18:29:56.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f7605719700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7600090b30 0x7f7600090f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f7605719700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7600090b30 0x7f7600090f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58414/0 (socket says 172.21.15.79:58414) 2021-04-09T18:29:56.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f7605719700 1 -- 172.21.15.79:0/981636068 learned_addr learned my addr 172.21.15.79:0/981636068 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:56.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f75fffff700 1 --2- 172.21.15.79:0/981636068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76000a5010 0x7f76000a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f7604f18700 1 --2- 172.21.15.79:0/981636068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f760008f830 0x7f76000d6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f75fffff700 1 -- 172.21.15.79:0/981636068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f760008f830 msgr2=0x7f76000d6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:56.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f75fffff700 1 --2- 172.21.15.79:0/981636068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f760008f830 0x7f76000d6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f75fffff700 1 -- 172.21.15.79:0/981636068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7600090b30 msgr2=0x7f7600090f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:56.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f75fffff700 1 --2- 172.21.15.79:0/981636068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7600090b30 0x7f7600090f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f75fffff700 1 -- 172.21.15.79:0/981636068 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760008fec0 con 0x7f76000a5010 2021-04-09T18:29:56.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f7605719700 1 --2- 172.21.15.79:0/981636068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7600090b30 0x7f7600090f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:29:56.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f75fffff700 1 --2- 172.21.15.79:0/981636068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76000a5010 0x7f76000a46d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f76000874d0 tx=0x7f75f400ca30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:56.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f75fd7fa700 1 -- 172.21.15.79:0/981636068 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f760008fec0 con 0x7f76000a5010 2021-04-09T18:29:56.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f75fd7fa700 1 -- 172.21.15.79:0/981636068 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f40072e0 con 0x7f76000a5010 2021-04-09T18:29:56.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f75fd7fa700 1 -- 172.21.15.79:0/981636068 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f75f40057e0 con 0x7f76000a5010 2021-04-09T18:29:56.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f7607174700 1 -- 172.21.15.79:0/981636068 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76000d7130 con 0x7f76000a5010 2021-04-09T18:29:56.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f7607174700 1 -- 172.21.15.79:0/981636068 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76000915b0 con 0x7f76000a5010 2021-04-09T18:29:56.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f75fd7fa700 1 -- 172.21.15.79:0/981636068 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f75f40059e0 con 0x7f76000a5010 2021-04-09T18:29:56.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f75fd7fa700 1 --2- 172.21.15.79:0/981636068 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f75e0029100 0x7f75e002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f75fd7fa700 1 -- 172.21.15.79:0/981636068 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f75f4038e30 con 0x7f76000a5010 2021-04-09T18:29:56.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.266 7f7604f18700 1 --2- 172.21.15.79:0/981636068 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f75e0029100 0x7f75e002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.270 7f7604f18700 1 --2- 172.21.15.79:0/981636068 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f75e0029100 0x7f75e002b650 crc :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:56.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.270 7f7607174700 1 -- 172.21.15.79:0/981636068 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76000e39e0 con 0x7f76000a5010 2021-04-09T18:29:56.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.278 7f75fd7fa700 1 -- 172.21.15.79:0/981636068 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f75f40070d0 con 0x7f76000a5010 2021-04-09T18:29:56.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.450 7f7607174700 1 -- 172.21.15.79:0/981636068 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76000f5b20 con 0x7f76000a5010 2021-04-09T18:29:56.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.454 7f75fd7fa700 1 -- 172.21.15.79:0/981636068 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+14343 (secure 0 0 0) 0x7f76000e5ca0 con 0x7f76000a5010 2021-04-09T18:29:56.460 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:29:56.460 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":50,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:29:53.473860","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:29:51.239559","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2021-04-09 18:29:52.114936","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6835/781814443":"2021-04-10 18:29:53.473795","172.21.15.89:6834/781814443":"2021-04-10 18:29:53.473795"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:29:56.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.458 7f7607174700 1 -- 172.21.15.79:0/981636068 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f75e0029100 msgr2=0x7f75e002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:56.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.458 7f7607174700 1 --2- 172.21.15.79:0/981636068 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f75e0029100 0x7f75e002b650 crc :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.458 7f7607174700 1 -- 172.21.15.79:0/981636068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76000a5010 msgr2=0x7f76000a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:56.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.458 7f7607174700 1 --2- 172.21.15.79:0/981636068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76000a5010 0x7f76000a46d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f76000874d0 tx=0x7f75f400ca30).stop 2021-04-09T18:29:56.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.458 7f7607174700 1 -- 172.21.15.79:0/981636068 shutdown_connections 2021-04-09T18:29:56.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.458 7f7607174700 1 --2- 172.21.15.79:0/981636068 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f75e0029100 0x7f75e002b650 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.458 7f7607174700 1 --2- 172.21.15.79:0/981636068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f760008f830 0x7f76000d6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.458 7f7607174700 1 --2- 172.21.15.79:0/981636068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7600090b30 0x7f7600090f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.458 7f7607174700 1 --2- 172.21.15.79:0/981636068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76000a5010 0x7f76000a46d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.458 7f7607174700 1 -- 172.21.15.79:0/981636068 >> 172.21.15.79:0/981636068 conn(0x7f7600093e70 msgr2=0x7f76000d8820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:56.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.458 7f7607174700 1 -- 172.21.15.79:0/981636068 shutdown_connections 2021-04-09T18:29:56.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.458 7f7607174700 1 -- 172.21.15.79:0/981636068 wait complete. 2021-04-09T18:29:56.471 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:29:51.239559', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:29:52.114936', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:29:56.473 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:29:56.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a9502700 1 Processor -- start 2021-04-09T18:29:56.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a9502700 1 -- start start 2021-04-09T18:29:56.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a9502700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc8a40f5550 0x7fc8a40f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a9502700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc8a40e9b10 0x7fc8a409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a9502700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8a41c2de0 0x7fc8a41c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a9502700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a40e9f60 con 0x7fc8a40f5550 2021-04-09T18:29:56.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a9502700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a40e5a00 con 0x7fc8a40e9b10 2021-04-09T18:29:56.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a9502700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a40fbb50 con 0x7fc8a41c2de0 2021-04-09T18:29:56.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a3247700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc8a40f5550 0x7fc8a40f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a3247700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc8a40f5550 0x7fc8a40f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58420/0 (socket says 172.21.15.79:58420) 2021-04-09T18:29:56.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a3247700 1 -- 172.21.15.79:0/3811310141 learned_addr learned my addr 172.21.15.79:0/3811310141 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:56.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a3a48700 1 --2- 172.21.15.79:0/3811310141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8a41c2de0 0x7fc8a41c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a2a46700 1 --2- 172.21.15.79:0/3811310141 >> v2:172.21.15.89:3300/0 conn(0x7fc8a40e9b10 0x7fc8a409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a3247700 1 -- 172.21.15.79:0/3811310141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8a41c2de0 msgr2=0x7fc8a41c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:56.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a3247700 1 --2- 172.21.15.79:0/3811310141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8a41c2de0 0x7fc8a41c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a3247700 1 -- 172.21.15.79:0/3811310141 >> v2:172.21.15.89:3300/0 conn(0x7fc8a40e9b10 msgr2=0x7fc8a409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:56.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a3247700 1 --2- 172.21.15.79:0/3811310141 >> v2:172.21.15.89:3300/0 conn(0x7fc8a40e9b10 0x7fc8a409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a3247700 1 -- 172.21.15.79:0/3811310141 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a40e5700 con 0x7fc8a40f5550 2021-04-09T18:29:56.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a3247700 1 --2- 172.21.15.79:0/3811310141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8a40f5550 0x7fc8a40f64e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fc8a4125470 tx=0x7fc88c00bda0).ready entity=mon.0 client_cookie=e68266bf5c492eca server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:56.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a2245700 1 -- 172.21.15.79:0/3811310141 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc8a40e5700 con 0x7fc8a40f5550 2021-04-09T18:29:56.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a2245700 1 -- 172.21.15.79:0/3811310141 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88c009940 con 0x7fc8a40f5550 2021-04-09T18:29:56.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a2245700 1 -- 172.21.15.79:0/3811310141 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc88c009d10 con 0x7fc8a40f5550 2021-04-09T18:29:56.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a9502700 1 -- 172.21.15.79:0/3811310141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8a40f5550 msgr2=0x7fc8a40f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:56.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a9502700 1 --2- 172.21.15.79:0/3811310141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8a40f5550 0x7fc8a40f64e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fc8a4125470 tx=0x7fc88c00bda0).stop 2021-04-09T18:29:56.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a9502700 1 -- 172.21.15.79:0/3811310141 shutdown_connections 2021-04-09T18:29:56.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a9502700 1 --2- 172.21.15.79:0/3811310141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8a41c2de0 0x7fc8a41c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a9502700 1 --2- 172.21.15.79:0/3811310141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8a40f5550 0x7fc8a40f64e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a9502700 1 --2- 172.21.15.79:0/3811310141 >> v2:172.21.15.89:3300/0 conn(0x7fc8a40e9b10 0x7fc8a409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a9502700 1 -- 172.21.15.79:0/3811310141 >> 172.21.15.79:0/3811310141 conn(0x7fc8a40e6010 msgr2=0x7fc8a40e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:56.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a9502700 1 -- 172.21.15.79:0/3811310141 shutdown_connections 2021-04-09T18:29:56.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.570 7fc8a9502700 1 -- 172.21.15.79:0/3811310141 wait complete. 2021-04-09T18:29:56.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a9502700 1 Processor -- start 2021-04-09T18:29:56.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a9502700 1 -- start start 2021-04-09T18:29:56.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a9502700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8a40ad7f0 0x7fc8a4090b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a9502700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8a40b96c0 0x7fc8a40901c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a9502700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8a40b9b10 0x7fc8a40d39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a9502700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a40997d0 con 0x7fc8a40b96c0 2021-04-09T18:29:56.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a9502700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a40907f0 con 0x7fc8a40ad7f0 2021-04-09T18:29:56.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a9502700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a4099360 con 0x7fc8a40b9b10 2021-04-09T18:29:56.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a2a46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8a40b96c0 0x7fc8a40901c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a2a46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8a40b96c0 0x7fc8a40901c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58428/0 (socket says 172.21.15.79:58428) 2021-04-09T18:29:56.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a2a46700 1 -- 172.21.15.79:0/3835975445 learned_addr learned my addr 172.21.15.79:0/3835975445 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:56.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a3a48700 1 --2- 172.21.15.79:0/3835975445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8a40b9b10 0x7fc8a40d39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a3247700 1 --2- 172.21.15.79:0/3835975445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8a40ad7f0 0x7fc8a4090b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a2a46700 1 -- 172.21.15.79:0/3835975445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8a40b9b10 msgr2=0x7fc8a40d39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:56.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a2a46700 1 --2- 172.21.15.79:0/3835975445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8a40b9b10 0x7fc8a40d39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a2a46700 1 -- 172.21.15.79:0/3835975445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8a40ad7f0 msgr2=0x7fc8a4090b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:56.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a2a46700 1 --2- 172.21.15.79:0/3835975445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8a40ad7f0 0x7fc8a4090b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a2a46700 1 -- 172.21.15.79:0/3835975445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a4099ad0 con 0x7fc8a40b96c0 2021-04-09T18:29:56.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a2a46700 1 --2- 172.21.15.79:0/3835975445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8a40b96c0 0x7fc8a40901c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fc89c00a000 tx=0x7fc89c00b0e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:56.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc89bfff700 1 -- 172.21.15.79:0/3835975445 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc8a4099ad0 con 0x7fc8a40b96c0 2021-04-09T18:29:56.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc89bfff700 1 -- 172.21.15.79:0/3835975445 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89c00bbe0 con 0x7fc8a40b96c0 2021-04-09T18:29:56.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a9502700 1 -- 172.21.15.79:0/3835975445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a40d4020 con 0x7fc8a40b96c0 2021-04-09T18:29:56.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc89bfff700 1 -- 172.21.15.79:0/3835975445 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc89c00f040 con 0x7fc8a40b96c0 2021-04-09T18:29:56.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.574 7fc8a9502700 1 -- 172.21.15.79:0/3835975445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a40d4530 con 0x7fc8a40b96c0 2021-04-09T18:29:56.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.578 7fc89bfff700 1 -- 172.21.15.79:0/3835975445 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc89c012420 con 0x7fc8a40b96c0 2021-04-09T18:29:56.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.578 7fc89bfff700 1 --2- 172.21.15.79:0/3835975445 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc888029100 0x7fc88802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.578 7fc89bfff700 1 -- 172.21.15.79:0/3835975445 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fc89c010070 con 0x7fc8a40b96c0 2021-04-09T18:29:56.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.578 7fc8a3247700 1 --2- 172.21.15.79:0/3835975445 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc888029100 0x7fc88802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.578 7fc8a3247700 1 --2- 172.21.15.79:0/3835975445 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc888029100 0x7fc88802b650 crc :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:56.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.582 7fc8a9502700 1 -- 172.21.15.79:0/3835975445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a40e39f0 con 0x7fc8a40b96c0 2021-04-09T18:29:56.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.590 7fc89bfff700 1 -- 172.21.15.79:0/3835975445 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc89c000f70 con 0x7fc8a40b96c0 2021-04-09T18:29:56.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.754 7fc8a9502700 1 -- 172.21.15.79:0/3835975445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fc8a40f5b50 con 0x7fc8a40b96c0 2021-04-09T18:29:56.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.754 7fc89bfff700 1 -- 172.21.15.79:0/3835975445 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v50) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc89c00b7e0 con 0x7fc8a40b96c0 2021-04-09T18:29:56.757 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:29:56.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.754 7fc8a9502700 1 -- 172.21.15.79:0/3835975445 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc888029100 msgr2=0x7fc88802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:56.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.754 7fc8a9502700 1 --2- 172.21.15.79:0/3835975445 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc888029100 0x7fc88802b650 crc :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.754 7fc8a9502700 1 -- 172.21.15.79:0/3835975445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8a40b96c0 msgr2=0x7fc8a40901c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:56.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.754 7fc8a9502700 1 --2- 172.21.15.79:0/3835975445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8a40b96c0 0x7fc8a40901c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fc89c00a000 tx=0x7fc89c00b0e0).stop 2021-04-09T18:29:56.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.758 7fc8a9502700 1 -- 172.21.15.79:0/3835975445 shutdown_connections 2021-04-09T18:29:56.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.758 7fc8a9502700 1 --2- 172.21.15.79:0/3835975445 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc888029100 0x7fc88802b650 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.758 7fc8a9502700 1 --2- 172.21.15.79:0/3835975445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8a40ad7f0 0x7fc8a4090b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.758 7fc8a9502700 1 --2- 172.21.15.79:0/3835975445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8a40b9b10 0x7fc8a40d39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.758 7fc8a9502700 1 --2- 172.21.15.79:0/3835975445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8a40b96c0 0x7fc8a40901c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.758 7fc8a9502700 1 -- 172.21.15.79:0/3835975445 >> 172.21.15.79:0/3835975445 conn(0x7fc8a40bb2a0 msgr2=0x7fc8a40ba230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:56.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.758 7fc8a9502700 1 -- 172.21.15.79:0/3835975445 shutdown_connections 2021-04-09T18:29:56.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.758 7fc8a9502700 1 -- 172.21.15.79:0/3835975445 wait complete. 2021-04-09T18:29:56.772 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:29:56.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.870 7fa6128aa700 1 Processor -- start 2021-04-09T18:29:56.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.870 7fa6128aa700 1 -- start start 2021-04-09T18:29:56.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.870 7fa6128aa700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa60c0e9b10 0x7fa60c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.870 7fa6128aa700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa60c1c8040 0x7fa60c1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.870 7fa6128aa700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60c0fbb50 con 0x7fa60c0f5550 2021-04-09T18:29:56.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.870 7fa6128aa700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60c1c3df0 con 0x7fa60c0e9b10 2021-04-09T18:29:56.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.870 7fa6128aa700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60c0e9f60 con 0x7fa60c1c8040 2021-04-09T18:29:56.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.874 7fa60b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa60c0e9b10 0x7fa60c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.874 7fa60b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa60c0e9b10 0x7fa60c09f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58434/0 (socket says 172.21.15.79:58434) 2021-04-09T18:29:56.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.874 7fa60b7fe700 1 -- 172.21.15.79:0/3431532878 learned_addr learned my addr 172.21.15.79:0/3431532878 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:56.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.874 7fa610e4f700 1 --2- 172.21.15.79:0/3431532878 >> v2:172.21.15.89:3300/0 conn(0x7fa60c1c8040 0x7fa60c1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.874 7fa60b7fe700 1 -- 172.21.15.79:0/3431532878 >> v2:172.21.15.89:3300/0 conn(0x7fa60c1c8040 msgr2=0x7fa60c1ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:56.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.874 7fa60b7fe700 1 --2- 172.21.15.79:0/3431532878 >> v2:172.21.15.89:3300/0 conn(0x7fa60c1c8040 0x7fa60c1ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.874 7fa60b7fe700 1 -- 172.21.15.79:0/3431532878 >> v1:172.21.15.89:6789/0 conn(0x7fa60c0f5550 legacy=0x7fa60c0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:56.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.874 7fa60b7fe700 1 -- 172.21.15.79:0/3431532878 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c0e5700 con 0x7fa60c0e9b10 2021-04-09T18:29:56.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.874 7fa60b7fe700 1 --2- 172.21.15.79:0/3431532878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c0e9b10 0x7fa60c09f110 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fa600002f30 tx=0x7fa60000bd70).ready entity=mon.0 client_cookie=87a11f82a7b539e3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:56.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.874 7fa60affd700 1 -- 172.21.15.79:0/3431532878 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa60c0e5700 con 0x7fa60c0e9b10 2021-04-09T18:29:56.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.874 7fa60affd700 1 -- 172.21.15.79:0/3431532878 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa600009950 con 0x7fa60c0e9b10 2021-04-09T18:29:56.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.874 7fa60affd700 1 -- 172.21.15.79:0/3431532878 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa600009d20 con 0x7fa60c0e9b10 2021-04-09T18:29:56.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.874 7fa6128aa700 1 -- 172.21.15.79:0/3431532878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c0e9b10 msgr2=0x7fa60c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:56.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.874 7fa6128aa700 1 --2- 172.21.15.79:0/3431532878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c0e9b10 0x7fa60c09f110 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fa600002f30 tx=0x7fa60000bd70).stop 2021-04-09T18:29:56.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.874 7fa6128aa700 1 -- 172.21.15.79:0/3431532878 shutdown_connections 2021-04-09T18:29:56.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.874 7fa6128aa700 1 --2- 172.21.15.79:0/3431532878 >> v2:172.21.15.89:3300/0 conn(0x7fa60c1c8040 0x7fa60c1ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.874 7fa6128aa700 1 --2- 172.21.15.79:0/3431532878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c0e9b10 0x7fa60c09f110 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.874 7fa6128aa700 1 -- 172.21.15.79:0/3431532878 >> 172.21.15.79:0/3431532878 conn(0x7fa60c0e6010 msgr2=0x7fa60c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:56.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.874 7fa6128aa700 1 -- 172.21.15.79:0/3431532878 shutdown_connections 2021-04-09T18:29:56.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.874 7fa6128aa700 1 -- 172.21.15.79:0/3431532878 wait complete. 2021-04-09T18:29:56.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.878 7fa6128aa700 1 Processor -- start 2021-04-09T18:29:56.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.878 7fa6128aa700 1 -- start start 2021-04-09T18:29:56.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.878 7fa6128aa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa60c09ae50 0x7fa60c0d54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.878 7fa6128aa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c0d08a0 0x7fa60c0d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.878 7fa6128aa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa60c0d6530 0x7fa60c0d6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.878 7fa6128aa700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c09ab50 con 0x7fa60c0d08a0 2021-04-09T18:29:56.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.878 7fa6128aa700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c1a50b0 con 0x7fa60c0d6530 2021-04-09T18:29:56.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.878 7fa6128aa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c09a6e0 con 0x7fa60c09ae50 2021-04-09T18:29:56.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.878 7fa60b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c0d08a0 0x7fa60c0d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.878 7fa60b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c0d08a0 0x7fa60c0d0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58440/0 (socket says 172.21.15.79:58440) 2021-04-09T18:29:56.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.878 7fa60b7fe700 1 -- 172.21.15.79:0/3467761734 learned_addr learned my addr 172.21.15.79:0/3467761734 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:56.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.878 7fa610e4f700 1 --2- 172.21.15.79:0/3467761734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa60c0d6530 0x7fa60c0d6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.878 7fa60bfff700 1 --2- 172.21.15.79:0/3467761734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa60c09ae50 0x7fa60c0d54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.878 7fa60b7fe700 1 -- 172.21.15.79:0/3467761734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa60c09ae50 msgr2=0x7fa60c0d54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:56.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.878 7fa60b7fe700 1 --2- 172.21.15.79:0/3467761734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa60c09ae50 0x7fa60c0d54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.878 7fa60b7fe700 1 -- 172.21.15.79:0/3467761734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa60c0d6530 msgr2=0x7fa60c0d6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:56.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.878 7fa60b7fe700 1 --2- 172.21.15.79:0/3467761734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa60c0d6530 0x7fa60c0d6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.878 7fa60b7fe700 1 -- 172.21.15.79:0/3467761734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c0d5b10 con 0x7fa60c0d08a0 2021-04-09T18:29:56.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.878 7fa60bfff700 1 --2- 172.21.15.79:0/3467761734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa60c09ae50 0x7fa60c0d54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:29:56.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.882 7fa60b7fe700 1 --2- 172.21.15.79:0/3467761734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c0d08a0 0x7fa60c0d0cf0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fa600002f30 tx=0x7fa600006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.882 7fa608ff9700 1 -- 172.21.15.79:0/3467761734 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa60c0d5b10 con 0x7fa60c0d08a0 2021-04-09T18:29:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.882 7fa608ff9700 1 -- 172.21.15.79:0/3467761734 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60001d480 con 0x7fa60c0d08a0 2021-04-09T18:29:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.882 7fa6128aa700 1 -- 172.21.15.79:0/3467761734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60c0d6fb0 con 0x7fa60c0d08a0 2021-04-09T18:29:56.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.882 7fa608ff9700 1 -- 172.21.15.79:0/3467761734 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa60001d850 con 0x7fa60c0d08a0 2021-04-09T18:29:56.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.882 7fa6128aa700 1 -- 172.21.15.79:0/3467761734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60c094480 con 0x7fa60c0d08a0 2021-04-09T18:29:56.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.882 7fa608ff9700 1 -- 172.21.15.79:0/3467761734 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa6000263b0 con 0x7fa60c0d08a0 2021-04-09T18:29:56.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.882 7fa608ff9700 1 --2- 172.21.15.79:0/3467761734 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa5ec029100 0x7fa5ec02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.882 7fa608ff9700 1 -- 172.21.15.79:0/3467761734 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fa60003bc50 con 0x7fa60c0d08a0 2021-04-09T18:29:56.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.882 7fa60bfff700 1 --2- 172.21.15.79:0/3467761734 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa5ec029100 0x7fa5ec02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.882 7fa60bfff700 1 --2- 172.21.15.79:0/3467761734 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa5ec029100 0x7fa5ec02b650 crc :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:56.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.882 7fa6128aa700 1 -- 172.21.15.79:0/3467761734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60c0e39f0 con 0x7fa60c0d08a0 2021-04-09T18:29:56.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:56.890 7fa608ff9700 1 -- 172.21.15.79:0/3467761734 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa600009740 con 0x7fa60c0d08a0 2021-04-09T18:29:57.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.042 7fa6128aa700 1 -- 172.21.15.79:0/3467761734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fa60c0f5b50 con 0x7fa60c0d08a0 2021-04-09T18:29:57.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.042 7fa608ff9700 1 -- 172.21.15.79:0/3467761734 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v50) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa600011c90 con 0x7fa60c0d08a0 2021-04-09T18:29:57.046 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:29:57.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.046 7fa6128aa700 1 -- 172.21.15.79:0/3467761734 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa5ec029100 msgr2=0x7fa5ec02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:57.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.046 7fa6128aa700 1 --2- 172.21.15.79:0/3467761734 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa5ec029100 0x7fa5ec02b650 crc :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.046 7fa6128aa700 1 -- 172.21.15.79:0/3467761734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c0d08a0 msgr2=0x7fa60c0d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:57.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.046 7fa6128aa700 1 --2- 172.21.15.79:0/3467761734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c0d08a0 0x7fa60c0d0cf0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fa600002f30 tx=0x7fa600006890).stop 2021-04-09T18:29:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.046 7fa6128aa700 1 -- 172.21.15.79:0/3467761734 shutdown_connections 2021-04-09T18:29:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.046 7fa6128aa700 1 --2- 172.21.15.79:0/3467761734 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa5ec029100 0x7fa5ec02b650 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.046 7fa6128aa700 1 --2- 172.21.15.79:0/3467761734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa60c0d6530 0x7fa60c0d6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.046 7fa6128aa700 1 --2- 172.21.15.79:0/3467761734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa60c09ae50 0x7fa60c0d54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.046 7fa6128aa700 1 --2- 172.21.15.79:0/3467761734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c0d08a0 0x7fa60c0d0cf0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.046 7fa6128aa700 1 -- 172.21.15.79:0/3467761734 >> 172.21.15.79:0/3467761734 conn(0x7fa60c0d39a0 msgr2=0x7fa60c08eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:57.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.046 7fa6128aa700 1 -- 172.21.15.79:0/3467761734 shutdown_connections 2021-04-09T18:29:57.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.046 7fa6128aa700 1 -- 172.21.15.79:0/3467761734 wait complete. 2021-04-09T18:29:57.058 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:29:57.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.146 7f1156c8e700 1 Processor -- start 2021-04-09T18:29:57.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.146 7f1156c8e700 1 -- start start 2021-04-09T18:29:57.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f1156c8e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11500e9b10 0x7f115009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:57.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f1156c8e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f11501c8040 0x7f11501ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:57.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f1156c8e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11500fbb50 con 0x7f11500f5550 2021-04-09T18:29:57.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f1156c8e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11501c3df0 con 0x7f11501c8040 2021-04-09T18:29:57.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f1156c8e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11500e9f60 con 0x7f11500e9b10 2021-04-09T18:29:57.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f114ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11500e9b10 0x7f115009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:57.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f1155233700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f11501c8040 0x7f11501ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:57.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f114ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11500e9b10 0x7f115009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:55446/0 (socket says 172.21.15.79:55446) 2021-04-09T18:29:57.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f114ffff700 1 -- 172.21.15.79:0/3638741940 learned_addr learned my addr 172.21.15.79:0/3638741940 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:57.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f1155233700 1 -- 172.21.15.79:0/3638741940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11500e9b10 msgr2=0x7f115009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:57.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f1155233700 1 --2- 172.21.15.79:0/3638741940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11500e9b10 0x7f115009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f1155233700 1 -- 172.21.15.79:0/3638741940 >> v1:172.21.15.89:6789/0 conn(0x7f11500f5550 legacy=0x7f11500f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:57.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f114f7fe700 1 -- 172.21.15.79:0/3638741940 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421617352 0 0) 0x7f11400010d0 con 0x7f11500f5550 2021-04-09T18:29:57.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f1155233700 1 -- 172.21.15.79:0/3638741940 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11500e5700 con 0x7f11501c8040 2021-04-09T18:29:57.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f114ffff700 1 --2- 172.21.15.79:0/3638741940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11500e9b10 0x7f115009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:29:57.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f1155233700 1 --2- 172.21.15.79:0/3638741940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11501c8040 0x7f11501ca4a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f11480032b0 tx=0x7f114800b3c0).ready entity=mon.1 client_cookie=7ae81a024c68928a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:57.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f114f7fe700 1 -- 172.21.15.79:0/3638741940 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11500e5700 con 0x7f11501c8040 2021-04-09T18:29:57.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f114f7fe700 1 -- 172.21.15.79:0/3638741940 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114800bc20 con 0x7f11501c8040 2021-04-09T18:29:57.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f114f7fe700 1 -- 172.21.15.79:0/3638741940 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1148002020 con 0x7f11501c8040 2021-04-09T18:29:57.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f1156c8e700 1 -- 172.21.15.79:0/3638741940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11501c8040 msgr2=0x7f11501ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:57.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f1156c8e700 1 --2- 172.21.15.79:0/3638741940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11501c8040 0x7f11501ca4a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f11480032b0 tx=0x7f114800b3c0).stop 2021-04-09T18:29:57.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f1156c8e700 1 -- 172.21.15.79:0/3638741940 shutdown_connections 2021-04-09T18:29:57.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f1156c8e700 1 --2- 172.21.15.79:0/3638741940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11501c8040 0x7f11501ca4a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f1156c8e700 1 --2- 172.21.15.79:0/3638741940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11500e9b10 0x7f115009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f1156c8e700 1 -- 172.21.15.79:0/3638741940 >> 172.21.15.79:0/3638741940 conn(0x7f11500e6010 msgr2=0x7f11500e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:57.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f1156c8e700 1 -- 172.21.15.79:0/3638741940 shutdown_connections 2021-04-09T18:29:57.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.150 7f1156c8e700 1 -- 172.21.15.79:0/3638741940 wait complete. 2021-04-09T18:29:57.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f1156c8e700 1 Processor -- start 2021-04-09T18:29:57.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f1156c8e700 1 -- start start 2021-04-09T18:29:57.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f1156c8e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11501a15e0 0x7f1150098540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:57.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f1156c8e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1150098b70 0x7f115019fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:57.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f1156c8e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11501a0450 0x7f11501acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:57.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f1156c8e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1150096cc0 con 0x7f1150098b70 2021-04-09T18:29:57.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f1156c8e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1150096fc0 con 0x7f11501a15e0 2021-04-09T18:29:57.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f1156c8e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1150096190 con 0x7f11501a0450 2021-04-09T18:29:57.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f114ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1150098b70 0x7f115019fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:57.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f114ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1150098b70 0x7f115019fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58452/0 (socket says 172.21.15.79:58452) 2021-04-09T18:29:57.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f114ffff700 1 -- 172.21.15.79:0/3073683690 learned_addr learned my addr 172.21.15.79:0/3073683690 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:57.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f1155233700 1 --2- 172.21.15.79:0/3073683690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11501a0450 0x7f11501acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:57.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f1154a32700 1 --2- 172.21.15.79:0/3073683690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11501a15e0 0x7f1150098540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:57.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f114ffff700 1 -- 172.21.15.79:0/3073683690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11501a0450 msgr2=0x7f11501acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:57.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f114ffff700 1 --2- 172.21.15.79:0/3073683690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11501a0450 0x7f11501acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f114ffff700 1 -- 172.21.15.79:0/3073683690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11501a15e0 msgr2=0x7f1150098540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:57.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f114ffff700 1 --2- 172.21.15.79:0/3073683690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11501a15e0 0x7f1150098540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f114ffff700 1 -- 172.21.15.79:0/3073683690 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11501ad3e0 con 0x7f1150098b70 2021-04-09T18:29:57.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f114ffff700 1 --2- 172.21.15.79:0/3073683690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1150098b70 0x7f115019fe20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f11500d7c80 tx=0x7f113800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:57.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f114d7fa700 1 -- 172.21.15.79:0/3073683690 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11501ad3e0 con 0x7f1150098b70 2021-04-09T18:29:57.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f114d7fa700 1 -- 172.21.15.79:0/3073683690 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113800cbd0 con 0x7f1150098b70 2021-04-09T18:29:57.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f114d7fa700 1 -- 172.21.15.79:0/3073683690 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f113800f040 con 0x7f1150098b70 2021-04-09T18:29:57.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f1156c8e700 1 -- 172.21.15.79:0/3073683690 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11501ad700 con 0x7f1150098b70 2021-04-09T18:29:57.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.154 7f1156c8e700 1 -- 172.21.15.79:0/3073683690 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11501b0f50 con 0x7f1150098b70 2021-04-09T18:29:57.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.158 7f114d7fa700 1 -- 172.21.15.79:0/3073683690 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1138011070 con 0x7f1150098b70 2021-04-09T18:29:57.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.158 7f114d7fa700 1 --2- 172.21.15.79:0/3073683690 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1134029100 0x7f113402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:57.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.158 7f114d7fa700 1 -- 172.21.15.79:0/3073683690 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f1138010040 con 0x7f1150098b70 2021-04-09T18:29:57.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.158 7f1154a32700 1 --2- 172.21.15.79:0/3073683690 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1134029100 0x7f113402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:57.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.158 7f1154a32700 1 --2- 172.21.15.79:0/3073683690 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1134029100 0x7f113402b650 crc :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:57.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.162 7f1156c8e700 1 -- 172.21.15.79:0/3073683690 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11500e39f0 con 0x7f1150098b70 2021-04-09T18:29:57.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.170 7f114d7fa700 1 -- 172.21.15.79:0/3073683690 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1138000bf0 con 0x7f1150098b70 2021-04-09T18:29:57.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.326 7f1156c8e700 1 -- 172.21.15.79:0/3073683690 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f11500f5b50 con 0x7f1150098b70 2021-04-09T18:29:57.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.326 7f114d7fa700 1 -- 172.21.15.79:0/3073683690 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v50) v1 ==== 100+0+10 (secure 0 0 0) 0x7f113800c9c0 con 0x7f1150098b70 2021-04-09T18:29:57.330 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:29:57.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.330 7f1156c8e700 1 -- 172.21.15.79:0/3073683690 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1134029100 msgr2=0x7f113402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:57.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.330 7f1156c8e700 1 --2- 172.21.15.79:0/3073683690 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1134029100 0x7f113402b650 crc :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.330 7f1156c8e700 1 -- 172.21.15.79:0/3073683690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1150098b70 msgr2=0x7f115019fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:57.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.330 7f1156c8e700 1 --2- 172.21.15.79:0/3073683690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1150098b70 0x7f115019fe20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f11500d7c80 tx=0x7f113800c430).stop 2021-04-09T18:29:57.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.330 7f1156c8e700 1 -- 172.21.15.79:0/3073683690 shutdown_connections 2021-04-09T18:29:57.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.330 7f1156c8e700 1 --2- 172.21.15.79:0/3073683690 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1134029100 0x7f113402b650 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.330 7f1156c8e700 1 --2- 172.21.15.79:0/3073683690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11501a15e0 0x7f1150098540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.330 7f1156c8e700 1 --2- 172.21.15.79:0/3073683690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11501a0450 0x7f11501acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.330 7f1156c8e700 1 --2- 172.21.15.79:0/3073683690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1150098b70 0x7f115019fe20 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.330 7f1156c8e700 1 -- 172.21.15.79:0/3073683690 >> 172.21.15.79:0/3073683690 conn(0x7f11500afc20 msgr2=0x7f11500a6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:57.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.330 7f1156c8e700 1 -- 172.21.15.79:0/3073683690 shutdown_connections 2021-04-09T18:29:57.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.330 7f1156c8e700 1 -- 172.21.15.79:0/3073683690 wait complete. 2021-04-09T18:29:57.342 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:29:57.343 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:29:57.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.430 7fd524141700 1 Processor -- start 2021-04-09T18:29:57.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.430 7fd524141700 1 -- start start 2021-04-09T18:29:57.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.430 7fd524141700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd51c1c9010 0x7fd51c1cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:57.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.430 7fd524141700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51c0fbb10 con 0x7fd51c0e9ad0 2021-04-09T18:29:57.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.430 7fd524141700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51c09f900 con 0x7fd51c0f5510 2021-04-09T18:29:57.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.430 7fd524141700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51c1c3db0 con 0x7fd51c1c9010 2021-04-09T18:29:57.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.434 7fd5216e4700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd51c0e9ad0 0x7fd51c09f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53172/0 (socket says 172.21.15.79:53172) 2021-04-09T18:29:57.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.434 7fd5216e4700 1 -- 172.21.15.79:0/3588406411 learned_addr learned my addr 172.21.15.79:0/3588406411 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:29:57.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.434 7fd5226e6700 1 --2- 172.21.15.79:0/3588406411 >> v2:172.21.15.89:3300/0 conn(0x7fd51c1c9010 0x7fd51c1cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:57.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.434 7fd520ee3700 1 -- 172.21.15.79:0/3588406411 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254327927 0 0) 0x7fd50c0010d0 con 0x7fd51c0e9ad0 2021-04-09T18:29:57.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.434 7fd520ee3700 1 -- 172.21.15.79:0/3588406411 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd508003240 con 0x7fd51c0e9ad0 2021-04-09T18:29:57.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.434 7fd5226e6700 1 -- 172.21.15.79:0/3588406411 >> v1:172.21.15.89:6789/0 conn(0x7fd51c0f5510 legacy=0x7fd51c0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:57.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.434 7fd5226e6700 1 -- 172.21.15.79:0/3588406411 >> v1:172.21.15.79:6789/0 conn(0x7fd51c0e9ad0 legacy=0x7fd51c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:57.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.434 7fd5226e6700 1 -- 172.21.15.79:0/3588406411 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c0e56c0 con 0x7fd51c1c9010 2021-04-09T18:29:57.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.434 7fd5226e6700 1 --2- 172.21.15.79:0/3588406411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd51c1c9010 0x7fd51c1cb470 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fd5140032b0 tx=0x7fd51400b0e0).ready entity=mon.1 client_cookie=918c442dd971a023 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:57.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.434 7fd520ee3700 1 -- 172.21.15.79:0/3588406411 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd51c0e56c0 con 0x7fd51c1c9010 2021-04-09T18:29:57.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.434 7fd520ee3700 1 -- 172.21.15.79:0/3588406411 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51400bab0 con 0x7fd51c1c9010 2021-04-09T18:29:57.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.434 7fd520ee3700 1 -- 172.21.15.79:0/3588406411 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd514002020 con 0x7fd51c1c9010 2021-04-09T18:29:57.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.434 7fd524141700 1 -- 172.21.15.79:0/3588406411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd51c1c9010 msgr2=0x7fd51c1cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:57.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.434 7fd524141700 1 --2- 172.21.15.79:0/3588406411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd51c1c9010 0x7fd51c1cb470 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fd5140032b0 tx=0x7fd51400b0e0).stop 2021-04-09T18:29:57.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.434 7fd524141700 1 -- 172.21.15.79:0/3588406411 shutdown_connections 2021-04-09T18:29:57.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.434 7fd524141700 1 --2- 172.21.15.79:0/3588406411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd51c1c9010 0x7fd51c1cb470 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.434 7fd524141700 1 -- 172.21.15.79:0/3588406411 >> 172.21.15.79:0/3588406411 conn(0x7fd51c0e5fd0 msgr2=0x7fd51c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:57.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.434 7fd524141700 1 -- 172.21.15.79:0/3588406411 shutdown_connections 2021-04-09T18:29:57.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.434 7fd524141700 1 -- 172.21.15.79:0/3588406411 wait complete. 2021-04-09T18:29:57.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.438 7fd524141700 1 Processor -- start 2021-04-09T18:29:57.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.438 7fd524141700 1 -- start start 2021-04-09T18:29:57.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.438 7fd524141700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd51c096270 0x7fd51c0ae020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:57.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.438 7fd524141700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd51c0c3310 0x7fd51c0c3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:57.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.438 7fd524141700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd51c0d4ae0 0x7fd51c0d4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:57.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.438 7fd524141700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0e9f20 con 0x7fd51c0d4ae0 2021-04-09T18:29:57.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.438 7fd524141700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0c3010 con 0x7fd51c0c3310 2021-04-09T18:29:57.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.438 7fd524141700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c19b9d0 con 0x7fd51c096270 2021-04-09T18:29:57.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.438 7fd5226e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd51c0d4ae0 0x7fd51c0d4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:57.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.438 7fd5226e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd51c0d4ae0 0x7fd51c0d4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58468/0 (socket says 172.21.15.79:58468) 2021-04-09T18:29:57.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.438 7fd5226e6700 1 -- 172.21.15.79:0/34999680 learned_addr learned my addr 172.21.15.79:0/34999680 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:29:57.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.442 7fd521ee5700 1 --2- 172.21.15.79:0/34999680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd51c096270 0x7fd51c0ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:57.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.442 7fd5216e4700 1 --2- 172.21.15.79:0/34999680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd51c0c3310 0x7fd51c0c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:57.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.442 7fd5226e6700 1 -- 172.21.15.79:0/34999680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd51c096270 msgr2=0x7fd51c0ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:57.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.442 7fd5226e6700 1 --2- 172.21.15.79:0/34999680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd51c096270 0x7fd51c0ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.442 7fd5226e6700 1 -- 172.21.15.79:0/34999680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd51c0c3310 msgr2=0x7fd51c0c3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:57.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.442 7fd5226e6700 1 --2- 172.21.15.79:0/34999680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd51c0c3310 0x7fd51c0c3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.442 7fd5226e6700 1 -- 172.21.15.79:0/34999680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c0ae650 con 0x7fd51c0d4ae0 2021-04-09T18:29:57.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.442 7fd5226e6700 1 --2- 172.21.15.79:0/34999680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd51c0d4ae0 0x7fd51c0d4f30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7fd5140032b0 tx=0x7fd514006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:57.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.442 7fd5127fc700 1 -- 172.21.15.79:0/34999680 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd51c0ae650 con 0x7fd51c0d4ae0 2021-04-09T18:29:57.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.442 7fd5127fc700 1 -- 172.21.15.79:0/34999680 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51401f030 con 0x7fd51c0d4ae0 2021-04-09T18:29:57.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.442 7fd524141700 1 -- 172.21.15.79:0/34999680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51c0aeb30 con 0x7fd51c0d4ae0 2021-04-09T18:29:57.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.442 7fd5127fc700 1 -- 172.21.15.79:0/34999680 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd514002020 con 0x7fd51c0d4ae0 2021-04-09T18:29:57.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.442 7fd524141700 1 -- 172.21.15.79:0/34999680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51c0c18b0 con 0x7fd51c0d4ae0 2021-04-09T18:29:57.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.442 7fd5127fc700 1 -- 172.21.15.79:0/34999680 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd51402a060 con 0x7fd51c0d4ae0 2021-04-09T18:29:57.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.442 7fd5127fc700 1 --2- 172.21.15.79:0/34999680 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd504029100 0x7fd50402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:57.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.442 7fd5127fc700 1 -- 172.21.15.79:0/34999680 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fd51403b620 con 0x7fd51c0d4ae0 2021-04-09T18:29:57.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.442 7fd521ee5700 1 --2- 172.21.15.79:0/34999680 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd504029100 0x7fd50402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:57.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.442 7fd521ee5700 1 --2- 172.21.15.79:0/34999680 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd504029100 0x7fd50402b650 crc :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:57.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.442 7fd524141700 1 -- 172.21.15.79:0/34999680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51c0e39d0 con 0x7fd51c0d4ae0 2021-04-09T18:29:57.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.450 7fd5127fc700 1 -- 172.21.15.79:0/34999680 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd51400b8a0 con 0x7fd51c0d4ae0 2021-04-09T18:29:57.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.610 7fd524141700 1 -- 172.21.15.79:0/34999680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd51c0a1cb0 con 0x7fd51c0d4ae0 2021-04-09T18:29:57.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.610 7fd5127fc700 1 -- 172.21.15.79:0/34999680 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2102 (secure 0 0 0) 0x7fd51401b430 con 0x7fd51c0d4ae0 2021-04-09T18:29:57.615 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:29:57.615 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3328659942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3328659942},{"type":"v1","addr":"172.21.15.79:6833","nonce":3328659942}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:29:53.022273","modified":"2021-04-09 18:29:55.034774","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":50,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5111":{"gid":5111,"name":"b","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/1280399112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1280399112},{"type":"v1","addr":"172.21.15.89:6835","nonce":1280399112}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-04-09T18:29:57.615 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 26 2021-04-09T18:29:57.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.614 7fd524141700 1 -- 172.21.15.79:0/34999680 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd504029100 msgr2=0x7fd50402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:57.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.614 7fd524141700 1 --2- 172.21.15.79:0/34999680 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd504029100 0x7fd50402b650 crc :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.614 7fd524141700 1 -- 172.21.15.79:0/34999680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd51c0d4ae0 msgr2=0x7fd51c0d4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:57.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.614 7fd524141700 1 --2- 172.21.15.79:0/34999680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd51c0d4ae0 0x7fd51c0d4f30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7fd5140032b0 tx=0x7fd514006c10).stop 2021-04-09T18:29:57.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.614 7fd524141700 1 -- 172.21.15.79:0/34999680 shutdown_connections 2021-04-09T18:29:57.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.614 7fd524141700 1 --2- 172.21.15.79:0/34999680 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd504029100 0x7fd50402b650 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.614 7fd524141700 1 --2- 172.21.15.79:0/34999680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd51c0d4ae0 0x7fd51c0d4f30 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.614 7fd524141700 1 --2- 172.21.15.79:0/34999680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd51c096270 0x7fd51c0ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.614 7fd524141700 1 --2- 172.21.15.79:0/34999680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd51c0c3310 0x7fd51c0c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.614 7fd524141700 1 -- 172.21.15.79:0/34999680 >> 172.21.15.79:0/34999680 conn(0x7fd51c09b190 msgr2=0x7fd51c0d7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:57.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.614 7fd524141700 1 -- 172.21.15.79:0/34999680 shutdown_connections 2021-04-09T18:29:57.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:29:57.614 7fd524141700 1 -- 172.21.15.79:0/34999680 wait complete. 2021-04-09T18:29:57.828 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:29:53.022273', 'modified': '2021-04-09 18:29:55.034774', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 50, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5111}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5111': {'gid': 5111, 'name': 'b', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6835/1280399112', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 1280399112}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 1280399112}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:29:57.828 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:29:57.829 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2021-04-09T18:29:57.919 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:29:57.920 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:29:57.920 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2021-04-09T18:29:57.920 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 5111, 2021-04-09T18:29:57.921 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2021-04-09T18:29:57.921 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2021-04-09T18:29:57.921 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 3.882392254, 2021-04-09T18:29:57.921 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 26, 2021-04-09T18:29:57.922 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 50, 2021-04-09T18:29:57.922 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 50, 2021-04-09T18:29:57.922 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 8.4979964619999997 2021-04-09T18:29:57.923 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:29:57.926 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 5111, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.882392254, "mdsmap_epoch": 26, "osdmap_epoch": 50, "osdmap_epoch_barrier": 50, "uptime": 8.4979964619999997 } 2021-04-09T18:29:57.927 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:29:57.927 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-04-09T18:29:57.928 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi090.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-04-09T18:29:57.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:57.928 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:29:57.936 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:29:57.993 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:29:57.993 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:29:58.048 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:29:58.049 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:29:58.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:58.050 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:29:58.100 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:29:58.100 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:29:58.143 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:29:58.158 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:29:58.159 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:29:58.214 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:29:58.216 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:29:58.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:58.217 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:29:58.218 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:2021-04-09 18:29:58.220 7f6994dbb0c0 -1 init, newargv = 0x556df64bebf0 newargc=9ceph-fuse[13333]: starting ceph client 2021-04-09T18:29:58.218 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr: 2021-04-09T18:29:58.226 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13333]: starting fuse 2021-04-09T18:29:59.324 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:29:59.341 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:29:59.342 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:29:59.396 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:29:59.397 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:29:59.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:59.398 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:29:59.448 INFO:teuthology.orchestra.run.smithi090.stdout:49 2021-04-09T18:29:59.448 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:29:59.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:59.449 DEBUG:teuthology.orchestra.run.smithi090:> sudo python3 -c ' 2021-04-09T18:29:59.449 DEBUG:teuthology.orchestra.run.smithi090:> import glob 2021-04-09T18:29:59.450 DEBUG:teuthology.orchestra.run.smithi090:> import re 2021-04-09T18:29:59.450 DEBUG:teuthology.orchestra.run.smithi090:> import os 2021-04-09T18:29:59.451 DEBUG:teuthology.orchestra.run.smithi090:> import subprocess 2021-04-09T18:29:59.451 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:29:59.452 DEBUG:teuthology.orchestra.run.smithi090:> def find_socket(client_name): 2021-04-09T18:29:59.452 DEBUG:teuthology.orchestra.run.smithi090:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-04-09T18:29:59.452 DEBUG:teuthology.orchestra.run.smithi090:> files = glob.glob(asok_path) 2021-04-09T18:29:59.453 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:29:59.453 DEBUG:teuthology.orchestra.run.smithi090:> # Given a non-glob path, it better be there 2021-04-09T18:29:59.454 DEBUG:teuthology.orchestra.run.smithi090:> if "*" not in asok_path: 2021-04-09T18:29:59.454 DEBUG:teuthology.orchestra.run.smithi090:> assert(len(files) == 1) 2021-04-09T18:29:59.455 DEBUG:teuthology.orchestra.run.smithi090:> return files[0] 2021-04-09T18:29:59.455 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:29:59.455 DEBUG:teuthology.orchestra.run.smithi090:> for f in files: 2021-04-09T18:29:59.456 DEBUG:teuthology.orchestra.run.smithi090:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:29:59.456 DEBUG:teuthology.orchestra.run.smithi090:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:29:59.457 DEBUG:teuthology.orchestra.run.smithi090:> return f 2021-04-09T18:29:59.457 DEBUG:teuthology.orchestra.run.smithi090:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:29:59.458 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:29:59.458 DEBUG:teuthology.orchestra.run.smithi090:> print(find_socket("client.0")) 2021-04-09T18:29:59.458 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:29:59.535 INFO:teuthology.orchestra.run.smithi090.stdout:/var/run/ceph/ceph-client.0.13333.asok 2021-04-09T18:29:59.540 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13333.asok 2021-04-09T18:29:59.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:59.541 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13333.asok status 2021-04-09T18:29:59.619 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2021-04-09T18:29:59.619 INFO:teuthology.orchestra.run.smithi090.stdout: "metadata": { 2021-04-09T18:29:59.620 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:29:59.620 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:29:59.620 INFO:teuthology.orchestra.run.smithi090.stdout: "entity_id": "0", 2021-04-09T18:29:59.620 INFO:teuthology.orchestra.run.smithi090.stdout: "hostname": "smithi090", 2021-04-09T18:29:59.620 INFO:teuthology.orchestra.run.smithi090.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-04-09T18:29:59.621 INFO:teuthology.orchestra.run.smithi090.stdout: "pid": "13333", 2021-04-09T18:29:59.621 INFO:teuthology.orchestra.run.smithi090.stdout: "root": "/" 2021-04-09T18:29:59.621 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:29:59.621 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_count": 0, 2021-04-09T18:29:59.621 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_pinned_count": 0, 2021-04-09T18:29:59.622 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 5725, 2021-04-09T18:29:59.622 INFO:teuthology.orchestra.run.smithi090.stdout: "inst": { 2021-04-09T18:29:59.622 INFO:teuthology.orchestra.run.smithi090.stdout: "name": { 2021-04-09T18:29:59.622 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "client", 2021-04-09T18:29:59.623 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5725 2021-04-09T18:29:59.623 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:29:59.623 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:29:59.623 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:29:59.623 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:29:59.624 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 2690155541 2021-04-09T18:29:59.624 INFO:teuthology.orchestra.run.smithi090.stdout: } 2021-04-09T18:29:59.624 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:29:59.624 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:29:59.624 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:29:59.625 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:29:59.625 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 2690155541 2021-04-09T18:29:59.625 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:29:59.625 INFO:teuthology.orchestra.run.smithi090.stdout: "inst_str": "client.5725 172.21.15.90:0/2690155541", 2021-04-09T18:29:59.625 INFO:teuthology.orchestra.run.smithi090.stdout: "addr_str": "172.21.15.90:0/2690155541", 2021-04-09T18:29:59.626 INFO:teuthology.orchestra.run.smithi090.stdout: "inode_count": 1, 2021-04-09T18:29:59.626 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_epoch": 26, 2021-04-09T18:29:59.626 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch": 50, 2021-04-09T18:29:59.626 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:29:59.626 INFO:teuthology.orchestra.run.smithi090.stdout: "blacklisted": false, 2021-04-09T18:29:59.627 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs" 2021-04-09T18:29:59.627 INFO:teuthology.orchestra.run.smithi090.stdout:} 2021-04-09T18:29:59.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:59.629 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:29:59.629 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:29:59.636 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:29:59.637 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:29:59.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:59.637 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:29:59.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:29:59.695 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:29:59.696 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:29:59.744 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:29:59.746 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:29:59.746 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-04-09T18:29:59.747 DEBUG:teuthology.orchestra.run.smithi090:> import sys 2021-04-09T18:29:59.747 DEBUG:teuthology.orchestra.run.smithi090:> import time 2021-04-09T18:29:59.747 DEBUG:teuthology.orchestra.run.smithi090:> import os 2021-04-09T18:29:59.748 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:29:59.748 DEBUG:teuthology.orchestra.run.smithi090:> n = 1000 2021-04-09T18:29:59.748 DEBUG:teuthology.orchestra.run.smithi090:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-04-09T18:29:59.749 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:29:59.749 DEBUG:teuthology.orchestra.run.smithi090:> if not os.path.exists(os.path.dirname(abs_path)): 2021-04-09T18:29:59.750 DEBUG:teuthology.orchestra.run.smithi090:> os.makedirs(os.path.dirname(abs_path)) 2021-04-09T18:29:59.750 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:29:59.750 DEBUG:teuthology.orchestra.run.smithi090:> for i in range(0, n): 2021-04-09T18:29:59.751 DEBUG:teuthology.orchestra.run.smithi090:> fname = "{0}_{1}".format(abs_path, i) 2021-04-09T18:29:59.751 DEBUG:teuthology.orchestra.run.smithi090:> with open(fname, '"'"'w'"'"') as f: 2021-04-09T18:29:59.751 DEBUG:teuthology.orchestra.run.smithi090:> f.write('"'"'content'"'"') 2021-04-09T18:29:59.752 DEBUG:teuthology.orchestra.run.smithi090:> if True: 2021-04-09T18:29:59.752 DEBUG:teuthology.orchestra.run.smithi090:> f.flush() 2021-04-09T18:29:59.753 DEBUG:teuthology.orchestra.run.smithi090:> os.fsync(f.fileno()) 2021-04-09T18:29:59.753 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:30:11.872 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:30:11.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.966 7f9c593ff700 1 Processor -- start 2021-04-09T18:30:11.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.966 7f9c593ff700 1 -- start start 2021-04-09T18:30:11.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.966 7f9c593ff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c540e9ae0 0x7f9c5409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:11.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.966 7f9c593ff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9c541c8010 0x7f9c541ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:11.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.966 7f9c593ff700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c540fbb20 con 0x7f9c540f5520 2021-04-09T18:30:11.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.966 7f9c593ff700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c541c3dc0 con 0x7f9c541c8010 2021-04-09T18:30:11.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.966 7f9c593ff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540e9f30 con 0x7f9c540e9ae0 2021-04-09T18:30:11.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.966 7f9c53806700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9c541c8010 0x7f9c541ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:11.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.966 7f9c53806700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9c541c8010 0x7f9c541ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58474/0 (socket says 172.21.15.79:58474) 2021-04-09T18:30:11.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.966 7f9c53806700 1 -- 172.21.15.79:0/4231288098 learned_addr learned my addr 172.21.15.79:0/4231288098 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:30:11.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.966 7f9c52804700 1 --2- 172.21.15.79:0/4231288098 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c540e9ae0 0x7f9c5409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:11.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.966 7f9c53806700 1 -- 172.21.15.79:0/4231288098 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c540e9ae0 msgr2=0x7f9c5409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:11.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.966 7f9c53806700 1 --2- 172.21.15.79:0/4231288098 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c540e9ae0 0x7f9c5409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:11.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.966 7f9c53806700 1 -- 172.21.15.79:0/4231288098 >> v1:172.21.15.89:6789/0 conn(0x7f9c540f5520 legacy=0x7f9c540f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:11.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.966 7f9c53806700 1 -- 172.21.15.79:0/4231288098 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c540e56d0 con 0x7f9c541c8010 2021-04-09T18:30:11.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.966 7f9c53806700 1 --2- 172.21.15.79:0/4231288098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c541c8010 0x7f9c541ca470 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f9c4c0032b0 tx=0x7f9c4c00b3c0).ready entity=mon.0 client_cookie=a01875a64b48a564 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:11.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.970 7f9c52003700 1 -- 172.21.15.79:0/4231288098 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9c540e56d0 con 0x7f9c541c8010 2021-04-09T18:30:11.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.970 7f9c52003700 1 -- 172.21.15.79:0/4231288098 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4c00bc20 con 0x7f9c541c8010 2021-04-09T18:30:11.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.970 7f9c52003700 1 -- 172.21.15.79:0/4231288098 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9c4c002020 con 0x7f9c541c8010 2021-04-09T18:30:11.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.970 7f9c593ff700 1 -- 172.21.15.79:0/4231288098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c541c8010 msgr2=0x7f9c541ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:11.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.970 7f9c593ff700 1 --2- 172.21.15.79:0/4231288098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c541c8010 0x7f9c541ca470 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f9c4c0032b0 tx=0x7f9c4c00b3c0).stop 2021-04-09T18:30:11.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.970 7f9c593ff700 1 -- 172.21.15.79:0/4231288098 shutdown_connections 2021-04-09T18:30:11.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.970 7f9c593ff700 1 --2- 172.21.15.79:0/4231288098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c541c8010 0x7f9c541ca470 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:11.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.970 7f9c593ff700 1 --2- 172.21.15.79:0/4231288098 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c540e9ae0 0x7f9c5409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:11.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.970 7f9c593ff700 1 -- 172.21.15.79:0/4231288098 >> 172.21.15.79:0/4231288098 conn(0x7f9c540e5fe0 msgr2=0x7f9c540e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:11.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.970 7f9c593ff700 1 -- 172.21.15.79:0/4231288098 shutdown_connections 2021-04-09T18:30:11.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.970 7f9c593ff700 1 -- 172.21.15.79:0/4231288098 wait complete. 2021-04-09T18:30:11.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c593ff700 1 Processor -- start 2021-04-09T18:30:11.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c593ff700 1 -- start start 2021-04-09T18:30:11.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c593ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54096460 0x7f9c5408fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:11.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c593ff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c540d1bc0 0x7f9c540d2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:11.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c593ff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c541a5000 0x7f9c541a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:11.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c593ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540bda00 con 0x7f9c54096460 2021-04-09T18:30:11.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c593ff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540b8520 con 0x7f9c541a5000 2021-04-09T18:30:11.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c593ff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540aed00 con 0x7f9c540d1bc0 2021-04-09T18:30:11.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c53005700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54096460 0x7f9c5408fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:11.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c53005700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54096460 0x7f9c5408fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58480/0 (socket says 172.21.15.79:58480) 2021-04-09T18:30:11.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c53005700 1 -- 172.21.15.79:0/596229046 learned_addr learned my addr 172.21.15.79:0/596229046 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:30:11.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c52804700 1 --2- 172.21.15.79:0/596229046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c540d1bc0 0x7f9c540d2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:11.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c53806700 1 --2- 172.21.15.79:0/596229046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c541a5000 0x7f9c541a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:11.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c53005700 1 -- 172.21.15.79:0/596229046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c540d1bc0 msgr2=0x7f9c540d2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:11.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c53005700 1 --2- 172.21.15.79:0/596229046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c540d1bc0 0x7f9c540d2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:11.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c53005700 1 -- 172.21.15.79:0/596229046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c541a5000 msgr2=0x7f9c541a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:11.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c53005700 1 --2- 172.21.15.79:0/596229046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c541a5000 0x7f9c541a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:11.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c53005700 1 -- 172.21.15.79:0/596229046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c540bd290 con 0x7f9c54096460 2021-04-09T18:30:11.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c53005700 1 --2- 172.21.15.79:0/596229046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54096460 0x7f9c5408fb70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f9c540bb140 tx=0x7f9c4400cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:11.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c3bfff700 1 -- 172.21.15.79:0/596229046 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9c540bd290 con 0x7f9c54096460 2021-04-09T18:30:11.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c3bfff700 1 -- 172.21.15.79:0/596229046 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c44010510 con 0x7f9c54096460 2021-04-09T18:30:11.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c593ff700 1 -- 172.21.15.79:0/596229046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c540bab20 con 0x7f9c54096460 2021-04-09T18:30:11.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c3bfff700 1 -- 172.21.15.79:0/596229046 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9c440106f0 con 0x7f9c54096460 2021-04-09T18:30:11.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.974 7f9c593ff700 1 -- 172.21.15.79:0/596229046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c541a5a80 con 0x7f9c54096460 2021-04-09T18:30:11.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.978 7f9c3bfff700 1 -- 172.21.15.79:0/596229046 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9c44019020 con 0x7f9c54096460 2021-04-09T18:30:11.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.978 7f9c3bfff700 1 --2- 172.21.15.79:0/596229046 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9c34029100 0x7f9c3402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:11.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.978 7f9c3bfff700 1 -- 172.21.15.79:0/596229046 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f9c44038e30 con 0x7f9c54096460 2021-04-09T18:30:11.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.978 7f9c52804700 1 --2- 172.21.15.79:0/596229046 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9c34029100 0x7f9c3402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:11.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.978 7f9c52804700 1 --2- 172.21.15.79:0/596229046 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9c34029100 0x7f9c3402b650 crc :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:11.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.982 7f9c593ff700 1 -- 172.21.15.79:0/596229046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c540e39e0 con 0x7f9c54096460 2021-04-09T18:30:11.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:11.986 7f9c3bfff700 1 -- 172.21.15.79:0/596229046 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9c44010300 con 0x7f9c54096460 2021-04-09T18:30:12.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.154 7f9c593ff700 1 -- 172.21.15.79:0/596229046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c540f5b20 con 0x7f9c54096460 2021-04-09T18:30:12.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.154 7f9c3bfff700 1 -- 172.21.15.79:0/596229046 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2102 (secure 0 0 0) 0x7f9c44000bf0 con 0x7f9c54096460 2021-04-09T18:30:12.158 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 26 2021-04-09T18:30:12.158 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:30:12.158 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3328659942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3328659942},{"type":"v1","addr":"172.21.15.79:6833","nonce":3328659942}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:29:53.022273","modified":"2021-04-09 18:29:55.034774","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":50,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5111":{"gid":5111,"name":"b","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/1280399112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1280399112},{"type":"v1","addr":"172.21.15.89:6835","nonce":1280399112}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-04-09T18:30:12.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.158 7f9c593ff700 1 -- 172.21.15.79:0/596229046 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9c34029100 msgr2=0x7f9c3402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.158 7f9c593ff700 1 --2- 172.21.15.79:0/596229046 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9c34029100 0x7f9c3402b650 crc :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.158 7f9c593ff700 1 -- 172.21.15.79:0/596229046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54096460 msgr2=0x7f9c5408fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.158 7f9c593ff700 1 --2- 172.21.15.79:0/596229046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54096460 0x7f9c5408fb70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f9c540bb140 tx=0x7f9c4400cae0).stop 2021-04-09T18:30:12.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.158 7f9c593ff700 1 -- 172.21.15.79:0/596229046 shutdown_connections 2021-04-09T18:30:12.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.158 7f9c593ff700 1 --2- 172.21.15.79:0/596229046 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9c34029100 0x7f9c3402b650 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.158 7f9c593ff700 1 --2- 172.21.15.79:0/596229046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c541a5000 0x7f9c541a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.158 7f9c593ff700 1 --2- 172.21.15.79:0/596229046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54096460 0x7f9c5408fb70 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.158 7f9c593ff700 1 --2- 172.21.15.79:0/596229046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c540d1bc0 0x7f9c540d2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.158 7f9c593ff700 1 -- 172.21.15.79:0/596229046 >> 172.21.15.79:0/596229046 conn(0x7f9c540bded0 msgr2=0x7f9c540d3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:12.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.158 7f9c593ff700 1 -- 172.21.15.79:0/596229046 shutdown_connections 2021-04-09T18:30:12.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.158 7f9c593ff700 1 -- 172.21.15.79:0/596229046 wait complete. 2021-04-09T18:30:12.170 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok config set mds_recall_max_caps 20 2021-04-09T18:30:12.254 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:30:12.254 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " 2021-04-09T18:30:12.255 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:30:12.260 INFO:tasks.cephfs.filesystem:_json_asok output: { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-04-09T18:30:12.261 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:30:12.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.354 7f68b6e9d700 1 Processor -- start 2021-04-09T18:30:12.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.354 7f68b6e9d700 1 -- start start 2021-04-09T18:30:12.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.354 7f68b6e9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f68b00e9ae0 0x7f68b009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:12.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.354 7f68b6e9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b01c8010 0x7f68b01ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:12.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.354 7f68b6e9d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b00fbb20 con 0x7f68b00f5520 2021-04-09T18:30:12.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.354 7f68b6e9d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b01c3dc0 con 0x7f68b00e9ae0 2021-04-09T18:30:12.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.354 7f68b6e9d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b00e9f30 con 0x7f68b01c8010 2021-04-09T18:30:12.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.354 7f68b4c41700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f68b00f5520 0x7f68b00f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:53668/0 (socket says 172.21.15.79:53668) 2021-04-09T18:30:12.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.354 7f68b4c41700 1 -- 172.21.15.79:0/1347360354 learned_addr learned my addr 172.21.15.79:0/1347360354 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:30:12.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.354 7f68affff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f68b00e9ae0 0x7f68b009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:12.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.354 7f68b5442700 1 --2- 172.21.15.79:0/1347360354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b01c8010 0x7f68b01ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:12.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.354 7f68b5442700 1 -- 172.21.15.79:0/1347360354 >> v2:172.21.15.89:3300/0 conn(0x7f68b00e9ae0 msgr2=0x7f68b009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:12.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.354 7f68b5442700 1 --2- 172.21.15.79:0/1347360354 >> v2:172.21.15.89:3300/0 conn(0x7f68b00e9ae0 0x7f68b009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.354 7f68b5442700 1 -- 172.21.15.79:0/1347360354 >> v1:172.21.15.89:6789/0 conn(0x7f68b00f5520 legacy=0x7f68b00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.354 7f68b5442700 1 -- 172.21.15.79:0/1347360354 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b00e56d0 con 0x7f68b01c8010 2021-04-09T18:30:12.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.354 7f68affff700 1 --2- 172.21.15.79:0/1347360354 >> v2:172.21.15.89:3300/0 conn(0x7f68b00e9ae0 0x7f68b009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:30:12.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.354 7f68b5442700 1 --2- 172.21.15.79:0/1347360354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b01c8010 0x7f68b01ca470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f68a80032b0 tx=0x7f68a800b0e0).ready entity=mon.2 client_cookie=c6f7994d370813d6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:12.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.358 7f68af7fe700 1 -- 172.21.15.79:0/1347360354 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f68b00e56d0 con 0x7f68b01c8010 2021-04-09T18:30:12.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.358 7f68af7fe700 1 -- 172.21.15.79:0/1347360354 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a800bab0 con 0x7f68b01c8010 2021-04-09T18:30:12.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.358 7f68af7fe700 1 -- 172.21.15.79:0/1347360354 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f68a8002020 con 0x7f68b01c8010 2021-04-09T18:30:12.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.358 7f68b6e9d700 1 -- 172.21.15.79:0/1347360354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b01c8010 msgr2=0x7f68b01ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.358 7f68b6e9d700 1 --2- 172.21.15.79:0/1347360354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b01c8010 0x7f68b01ca470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f68a80032b0 tx=0x7f68a800b0e0).stop 2021-04-09T18:30:12.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.358 7f68b6e9d700 1 -- 172.21.15.79:0/1347360354 shutdown_connections 2021-04-09T18:30:12.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.358 7f68b6e9d700 1 --2- 172.21.15.79:0/1347360354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b01c8010 0x7f68b01ca470 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.358 7f68b6e9d700 1 --2- 172.21.15.79:0/1347360354 >> v2:172.21.15.89:3300/0 conn(0x7f68b00e9ae0 0x7f68b009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.358 7f68b6e9d700 1 -- 172.21.15.79:0/1347360354 >> 172.21.15.79:0/1347360354 conn(0x7f68b00e5fe0 msgr2=0x7f68b00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:12.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.358 7f68b6e9d700 1 -- 172.21.15.79:0/1347360354 shutdown_connections 2021-04-09T18:30:12.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.358 7f68b6e9d700 1 -- 172.21.15.79:0/1347360354 wait complete. 2021-04-09T18:30:12.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b6e9d700 1 Processor -- start 2021-04-09T18:30:12.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b6e9d700 1 -- start start 2021-04-09T18:30:12.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b6e9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68b00d71f0 0x7f68b0094bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:12.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b6e9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68b00b9290 0x7f68b00b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:12.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b6e9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b01a7000 0x7f68b01a7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:12.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b6e9d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b00d5c50 con 0x7f68b00d71f0 2021-04-09T18:30:12.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b6e9d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b00bd7b0 con 0x7f68b00b9290 2021-04-09T18:30:12.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b6e9d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b00bd490 con 0x7f68b01a7000 2021-04-09T18:30:12.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b4c41700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68b00d71f0 0x7f68b0094bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:12.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b4c41700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68b00d71f0 0x7f68b0094bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58494/0 (socket says 172.21.15.79:58494) 2021-04-09T18:30:12.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b4c41700 1 -- 172.21.15.79:0/2330718735 learned_addr learned my addr 172.21.15.79:0/2330718735 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:30:12.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b5442700 1 --2- 172.21.15.79:0/2330718735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b01a7000 0x7f68b01a7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:12.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68affff700 1 --2- 172.21.15.79:0/2330718735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68b00b9290 0x7f68b00b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:12.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b4c41700 1 -- 172.21.15.79:0/2330718735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b01a7000 msgr2=0x7f68b01a7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b4c41700 1 --2- 172.21.15.79:0/2330718735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b01a7000 0x7f68b01a7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b4c41700 1 -- 172.21.15.79:0/2330718735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68b00b9290 msgr2=0x7f68b00b96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b4c41700 1 --2- 172.21.15.79:0/2330718735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68b00b9290 0x7f68b00b96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b4c41700 1 -- 172.21.15.79:0/2330718735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b00951f0 con 0x7f68b00d71f0 2021-04-09T18:30:12.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b5442700 1 --2- 172.21.15.79:0/2330718735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b01a7000 0x7f68b01a7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:30:12.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b4c41700 1 --2- 172.21.15.79:0/2330718735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68b00d71f0 0x7f68b0094bc0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f68a0000b80 tx=0x7f68a000cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:12.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68ad7fa700 1 -- 172.21.15.79:0/2330718735 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f68b00951f0 con 0x7f68b00d71f0 2021-04-09T18:30:12.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68ad7fa700 1 -- 172.21.15.79:0/2330718735 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a0007320 con 0x7f68b00d71f0 2021-04-09T18:30:12.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b6e9d700 1 -- 172.21.15.79:0/2330718735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b01a7a80 con 0x7f68b00d71f0 2021-04-09T18:30:12.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68ad7fa700 1 -- 172.21.15.79:0/2330718735 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f68a00057e0 con 0x7f68b00d71f0 2021-04-09T18:30:12.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68b6e9d700 1 -- 172.21.15.79:0/2330718735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b01aa5c0 con 0x7f68b00d71f0 2021-04-09T18:30:12.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68ad7fa700 1 -- 172.21.15.79:0/2330718735 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f68a001a060 con 0x7f68b00d71f0 2021-04-09T18:30:12.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68ad7fa700 1 --2- 172.21.15.79:0/2330718735 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6890029100 0x7f689002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:12.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.362 7f68ad7fa700 1 -- 172.21.15.79:0/2330718735 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f68a0038d20 con 0x7f68b00d71f0 2021-04-09T18:30:12.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.366 7f68affff700 1 --2- 172.21.15.79:0/2330718735 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6890029100 0x7f689002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:12.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.366 7f68affff700 1 --2- 172.21.15.79:0/2330718735 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6890029100 0x7f689002b650 crc :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:12.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.370 7f68b6e9d700 1 -- 172.21.15.79:0/2330718735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b00e39e0 con 0x7f68b00d71f0 2021-04-09T18:30:12.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.374 7f68ad7fa700 1 -- 172.21.15.79:0/2330718735 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f68a0007110 con 0x7f68b00d71f0 2021-04-09T18:30:12.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.542 7f68b6e9d700 1 -- 172.21.15.79:0/2330718735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68b00f5b20 con 0x7f68b00d71f0 2021-04-09T18:30:12.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.542 7f68ad7fa700 1 -- 172.21.15.79:0/2330718735 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2102 (secure 0 0 0) 0x7f68a0000bf0 con 0x7f68b00d71f0 2021-04-09T18:30:12.548 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:30:12.548 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3328659942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3328659942},{"type":"v1","addr":"172.21.15.79:6833","nonce":3328659942}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:29:53.022273","modified":"2021-04-09 18:29:55.034774","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":50,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5111":{"gid":5111,"name":"b","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/1280399112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1280399112},{"type":"v1","addr":"172.21.15.89:6835","nonce":1280399112}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-04-09T18:30:12.548 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 26 2021-04-09T18:30:12.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.550 7f68b6e9d700 1 -- 172.21.15.79:0/2330718735 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6890029100 msgr2=0x7f689002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.550 7f68b6e9d700 1 --2- 172.21.15.79:0/2330718735 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6890029100 0x7f689002b650 crc :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.550 7f68b6e9d700 1 -- 172.21.15.79:0/2330718735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68b00d71f0 msgr2=0x7f68b0094bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.550 7f68b6e9d700 1 --2- 172.21.15.79:0/2330718735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68b00d71f0 0x7f68b0094bc0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f68a0000b80 tx=0x7f68a000cab0).stop 2021-04-09T18:30:12.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.550 7f68b6e9d700 1 -- 172.21.15.79:0/2330718735 shutdown_connections 2021-04-09T18:30:12.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.550 7f68b6e9d700 1 --2- 172.21.15.79:0/2330718735 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6890029100 0x7f689002b650 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.550 7f68b6e9d700 1 --2- 172.21.15.79:0/2330718735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b01a7000 0x7f68b01a7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.550 7f68b6e9d700 1 --2- 172.21.15.79:0/2330718735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68b00d71f0 0x7f68b0094bc0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.550 7f68b6e9d700 1 --2- 172.21.15.79:0/2330718735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68b00b9290 0x7f68b00b96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.550 7f68b6e9d700 1 -- 172.21.15.79:0/2330718735 >> 172.21.15.79:0/2330718735 conn(0x7f68b00bab00 msgr2=0x7f68b008eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:12.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.550 7f68b6e9d700 1 -- 172.21.15.79:0/2330718735 shutdown_connections 2021-04-09T18:30:12.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.550 7f68b6e9d700 1 -- 172.21.15.79:0/2330718735 wait complete. 2021-04-09T18:30:12.562 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok config set mds_recall_max_decay_threshold 400 2021-04-09T18:30:12.651 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:30:12.651 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " 2021-04-09T18:30:12.652 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:30:12.658 INFO:tasks.cephfs.filesystem:_json_asok output: { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-04-09T18:30:12.658 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi090.front.sepia.ceph.com... 2021-04-09T18:30:12.676 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:30:12.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.774 7f99c9bb2700 1 Processor -- start 2021-04-09T18:30:12.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.774 7f99c9bb2700 1 -- start start 2021-04-09T18:30:12.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c9bb2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99c40f5510 0x7f99c40f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:12.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c9bb2700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c40fbb10 con 0x7f99c41c8000 2021-04-09T18:30:12.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c9bb2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c409f900 con 0x7f99c40e9ad0 2021-04-09T18:30:12.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c9bb2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c40e9f20 con 0x7f99c40f5510 2021-04-09T18:30:12.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c3fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f99c41c8000 0x7f99c41ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53216/0 (socket says 172.21.15.79:53216) 2021-04-09T18:30:12.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c3fff700 1 -- 172.21.15.79:0/3491282527 learned_addr learned my addr 172.21.15.79:0/3491282527 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:30:12.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c37fe700 1 --2- 172.21.15.79:0/3491282527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99c40f5510 0x7f99c40f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:12.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c27fc700 1 -- 172.21.15.79:0/3491282527 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585497401 0 0) 0x7f99bc001450 con 0x7f99c41c8000 2021-04-09T18:30:12.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c27fc700 1 -- 172.21.15.79:0/3491282527 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99ac003240 con 0x7f99c41c8000 2021-04-09T18:30:12.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c27fc700 1 -- 172.21.15.79:0/3491282527 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948053944 0 0) 0x7f99b80010d0 con 0x7f99c40e9ad0 2021-04-09T18:30:12.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c27fc700 1 -- 172.21.15.79:0/3491282527 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99ac003620 con 0x7f99c40e9ad0 2021-04-09T18:30:12.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c27fc700 1 -- 172.21.15.79:0/3491282527 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1128071216 0 0) 0x7f99bc0019d0 con 0x7f99c41c8000 2021-04-09T18:30:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c27fc700 1 -- 172.21.15.79:0/3491282527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99c40f5510 msgr2=0x7f99c40f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c27fc700 1 --2- 172.21.15.79:0/3491282527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99c40f5510 0x7f99c40f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c27fc700 1 -- 172.21.15.79:0/3491282527 >> v1:172.21.15.89:6789/0 conn(0x7f99c40e9ad0 legacy=0x7f99c409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c27fc700 1 -- 172.21.15.79:0/3491282527 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c40e56c0 con 0x7f99c41c8000 2021-04-09T18:30:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c27fc700 1 -- 172.21.15.79:0/3491282527 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f99bc001f30 con 0x7f99c41c8000 2021-04-09T18:30:12.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c27fc700 1 -- 172.21.15.79:0/3491282527 >> v1:172.21.15.79:6789/0 conn(0x7f99c41c8000 legacy=0x7f99c41ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c27fc700 1 --2- 172.21.15.79:0/3491282527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99ac003d40 0x7f99ac0045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:12.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c27fc700 1 --2- 172.21.15.79:0/3491282527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99ac004bd0 0x7f99ac0097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:12.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c27fc700 1 --2- 172.21.15.79:0/3491282527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99ac005020 0x7f99ac00be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:12.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c27fc700 1 -- 172.21.15.79:0/3491282527 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c40e9f20 con 0x7f99ac004bd0 2021-04-09T18:30:12.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c27fc700 1 -- 172.21.15.79:0/3491282527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0504b0 con 0x7f99ac003d40 2021-04-09T18:30:12.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c27fc700 1 -- 172.21.15.79:0/3491282527 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0506e0 con 0x7f99ac005020 2021-04-09T18:30:12.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c2ffd700 1 --2- 172.21.15.79:0/3491282527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99ac004bd0 0x7f99ac0097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:12.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c37fe700 1 --2- 172.21.15.79:0/3491282527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99c40f5510 0x7f99c40f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:30:12.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c3fff700 1 --2- 172.21.15.79:0/3491282527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99ac005020 0x7f99ac00be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:12.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c2ffd700 1 -- 172.21.15.79:0/3491282527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99ac005020 msgr2=0x7f99ac00be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:12.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c2ffd700 1 --2- 172.21.15.79:0/3491282527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99ac005020 0x7f99ac00be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c2ffd700 1 -- 172.21.15.79:0/3491282527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99ac003d40 msgr2=0x7f99ac0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:12.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c37fe700 1 --2- 172.21.15.79:0/3491282527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99ac003d40 0x7f99ac0045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:12.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c2ffd700 1 --2- 172.21.15.79:0/3491282527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99ac003d40 0x7f99ac0045a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c2ffd700 1 -- 172.21.15.79:0/3491282527 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac0509d0 con 0x7f99ac004bd0 2021-04-09T18:30:12.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c2ffd700 1 --2- 172.21.15.79:0/3491282527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99ac004bd0 0x7f99ac0097e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f99b8001440 tx=0x7f99b800c0e0).ready entity=mon.0 client_cookie=cf55bf78cfc7a924 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:12.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c27fc700 1 -- 172.21.15.79:0/3491282527 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f99ac0509d0 con 0x7f99ac004bd0 2021-04-09T18:30:12.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c27fc700 1 -- 172.21.15.79:0/3491282527 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b800ca70 con 0x7f99ac004bd0 2021-04-09T18:30:12.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c27fc700 1 -- 172.21.15.79:0/3491282527 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f99b8012400 con 0x7f99ac004bd0 2021-04-09T18:30:12.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c9bb2700 1 -- 172.21.15.79:0/3491282527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99ac004bd0 msgr2=0x7f99ac0097e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c9bb2700 1 --2- 172.21.15.79:0/3491282527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99ac004bd0 0x7f99ac0097e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f99b8001440 tx=0x7f99b800c0e0).stop 2021-04-09T18:30:12.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.778 7f99c3fff700 1 -- 172.21.15.79:0/3491282527 reap_dead start 2021-04-09T18:30:12.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.782 7f99c9bb2700 1 -- 172.21.15.79:0/3491282527 shutdown_connections 2021-04-09T18:30:12.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.782 7f99c9bb2700 1 -- 172.21.15.79:0/3491282527 >> 172.21.15.79:0/3491282527 conn(0x7f99c40e5fd0 msgr2=0x7f99c40e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:12.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.782 7f99c9bb2700 1 -- 172.21.15.79:0/3491282527 shutdown_connections 2021-04-09T18:30:12.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.782 7f99c9bb2700 1 -- 172.21.15.79:0/3491282527 wait complete. 2021-04-09T18:30:12.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c9bb2700 1 Processor -- start 2021-04-09T18:30:12.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c9bb2700 1 -- start start 2021-04-09T18:30:12.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c9bb2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c419c530 0x7f99c419b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:12.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c9bb2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99c40b14e0 0x7f99c40c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c9bb2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99c40b1930 0x7f99c41c0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c9bb2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c41c3db0 con 0x7f99c419c530 2021-04-09T18:30:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c9bb2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c419cd60 con 0x7f99c40b1930 2021-04-09T18:30:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c9bb2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c419d060 con 0x7f99c40b14e0 2021-04-09T18:30:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c419c530 0x7f99c419b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c419c530 0x7f99c419b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58518/0 (socket says 172.21.15.79:58518) 2021-04-09T18:30:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c37fe700 1 -- 172.21.15.79:0/2683804777 learned_addr learned my addr 172.21.15.79:0/2683804777 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:30:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c3fff700 1 --2- 172.21.15.79:0/2683804777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99c40b1930 0x7f99c41c0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c2ffd700 1 --2- 172.21.15.79:0/2683804777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99c40b14e0 0x7f99c40c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c37fe700 1 -- 172.21.15.79:0/2683804777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99c40b14e0 msgr2=0x7f99c40c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c37fe700 1 --2- 172.21.15.79:0/2683804777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99c40b14e0 0x7f99c40c5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c37fe700 1 -- 172.21.15.79:0/2683804777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99c40b1930 msgr2=0x7f99c41c0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c37fe700 1 --2- 172.21.15.79:0/2683804777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99c40b1930 0x7f99c41c0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c37fe700 1 -- 172.21.15.79:0/2683804777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c419c980 con 0x7f99c419c530 2021-04-09T18:30:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c37fe700 1 --2- 172.21.15.79:0/2683804777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c419c530 0x7f99c419b9d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f99b400b000 tx=0x7f99b400fc80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99abfff700 1 -- 172.21.15.79:0/2683804777 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f99c419c980 con 0x7f99c419c530 2021-04-09T18:30:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99abfff700 1 -- 172.21.15.79:0/2683804777 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b400d950 con 0x7f99c419c530 2021-04-09T18:30:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c9bb2700 1 -- 172.21.15.79:0/2683804777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c419e7b0 con 0x7f99c419c530 2021-04-09T18:30:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99abfff700 1 -- 172.21.15.79:0/2683804777 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f99b4018070 con 0x7f99c419c530 2021-04-09T18:30:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99c9bb2700 1 -- 172.21.15.79:0/2683804777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c41c0640 con 0x7f99c419c530 2021-04-09T18:30:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.786 7f99abfff700 1 -- 172.21.15.79:0/2683804777 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f99b4013400 con 0x7f99c419c530 2021-04-09T18:30:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.790 7f99abfff700 1 --2- 172.21.15.79:0/2683804777 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f99a4029100 0x7f99a402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.790 7f99abfff700 1 -- 172.21.15.79:0/2683804777 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f99b4039860 con 0x7f99c419c530 2021-04-09T18:30:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.790 7f99c2ffd700 1 --2- 172.21.15.79:0/2683804777 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f99a4029100 0x7f99a402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.790 7f99c2ffd700 1 --2- 172.21.15.79:0/2683804777 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f99a4029100 0x7f99a402b650 crc :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.806 7f99c9bb2700 1 -- 172.21.15.79:0/2683804777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c40e39d0 con 0x7f99c419c530 2021-04-09T18:30:12.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.814 7f99abfff700 1 -- 172.21.15.79:0/2683804777 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f99b400d550 con 0x7f99c419c530 2021-04-09T18:30:12.891 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:30:12.894 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:30:12.897 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:30:12.901 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:30:12.904 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:30:12.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.986 7f99c9bb2700 1 -- 172.21.15.79:0/2683804777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99c4087540 con 0x7f99c419c530 2021-04-09T18:30:12.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.986 7f99abfff700 1 -- 172.21.15.79:0/2683804777 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2102 (secure 0 0 0) 0x7f99c4107f40 con 0x7f99c419c530 2021-04-09T18:30:12.989 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 26 2021-04-09T18:30:12.990 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:30:12.990 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3328659942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3328659942},{"type":"v1","addr":"172.21.15.79:6833","nonce":3328659942}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:29:53.022273","modified":"2021-04-09 18:29:55.034774","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":50,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5111":{"gid":5111,"name":"b","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/1280399112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1280399112},{"type":"v1","addr":"172.21.15.89:6835","nonce":1280399112}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-04-09T18:30:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.990 7f99c9bb2700 1 -- 172.21.15.79:0/2683804777 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f99a4029100 msgr2=0x7f99a402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.990 7f99c9bb2700 1 --2- 172.21.15.79:0/2683804777 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f99a4029100 0x7f99a402b650 crc :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.990 7f99c9bb2700 1 -- 172.21.15.79:0/2683804777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c419c530 msgr2=0x7f99c419b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.990 7f99c9bb2700 1 --2- 172.21.15.79:0/2683804777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c419c530 0x7f99c419b9d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f99b400b000 tx=0x7f99b400fc80).stop 2021-04-09T18:30:12.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.990 7f99c9bb2700 1 -- 172.21.15.79:0/2683804777 shutdown_connections 2021-04-09T18:30:12.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.990 7f99c9bb2700 1 --2- 172.21.15.79:0/2683804777 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f99a4029100 0x7f99a402b650 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.990 7f99c9bb2700 1 --2- 172.21.15.79:0/2683804777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99c40b1930 0x7f99c41c0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.990 7f99c9bb2700 1 --2- 172.21.15.79:0/2683804777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c419c530 0x7f99c419b9d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.990 7f99c9bb2700 1 --2- 172.21.15.79:0/2683804777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99c40b14e0 0x7f99c40c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.990 7f99c9bb2700 1 -- 172.21.15.79:0/2683804777 >> 172.21.15.79:0/2683804777 conn(0x7f99c40baab0 msgr2=0x7f99c40d8530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:12.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.990 7f99c9bb2700 1 -- 172.21.15.79:0/2683804777 shutdown_connections 2021-04-09T18:30:12.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:12.990 7f99c9bb2700 1 -- 172.21.15.79:0/2683804777 wait complete. 2021-04-09T18:30:13.002 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b cache drop 5 2021-04-09T18:30:13.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f2615cb3700 1 Processor -- start 2021-04-09T18:30:13.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f2615cb3700 1 -- start start 2021-04-09T18:30:13.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f2615cb3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26100f5550 0x7f26100f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f2615cb3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f26101c8040 0x7f26101ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f2615cb3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26100fbb50 con 0x7f26100e9b10 2021-04-09T18:30:13.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f2615cb3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26100e9f60 con 0x7f26101c8040 2021-04-09T18:30:13.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f2615cb3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26101c3df0 con 0x7f26100f5550 2021-04-09T18:30:13.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260effd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f26100e9b10 0x7f261009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53236/0 (socket says 172.21.15.79:53236) 2021-04-09T18:30:13.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260effd700 1 -- 172.21.15.79:0/1353101870 learned_addr learned my addr 172.21.15.79:0/1353101870 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:30:13.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260ffff700 1 --2- 172.21.15.79:0/1353101870 >> v2:172.21.15.89:3300/0 conn(0x7f26101c8040 0x7f26101ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260f7fe700 1 --2- 172.21.15.79:0/1353101870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26100f5550 0x7f26100f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260e7fc700 1 -- 172.21.15.79:0/1353101870 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240308462 0 0) 0x7f25f80010d0 con 0x7f26100e9b10 2021-04-09T18:30:13.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260e7fc700 1 -- 172.21.15.79:0/1353101870 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25fc003240 con 0x7f26100e9b10 2021-04-09T18:30:13.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260e7fc700 1 -- 172.21.15.79:0/1353101870 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1560274701 0 0) 0x7f25f8001650 con 0x7f26100e9b10 2021-04-09T18:30:13.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260e7fc700 1 -- 172.21.15.79:0/1353101870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26100f5550 msgr2=0x7f26100f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:13.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260e7fc700 1 --2- 172.21.15.79:0/1353101870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26100f5550 0x7f26100f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260e7fc700 1 -- 172.21.15.79:0/1353101870 >> v2:172.21.15.89:3300/0 conn(0x7f26101c8040 msgr2=0x7f26101ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:13.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260e7fc700 1 --2- 172.21.15.79:0/1353101870 >> v2:172.21.15.89:3300/0 conn(0x7f26101c8040 0x7f26101ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260e7fc700 1 -- 172.21.15.79:0/1353101870 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261009f910 con 0x7f26100e9b10 2021-04-09T18:30:13.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260e7fc700 1 -- 172.21.15.79:0/1353101870 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f25f8001bb0 con 0x7f26100e9b10 2021-04-09T18:30:13.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260e7fc700 1 -- 172.21.15.79:0/1353101870 >> v1:172.21.15.79:6789/0 conn(0x7f26100e9b10 legacy=0x7f261009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:13.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260e7fc700 1 --2- 172.21.15.79:0/1353101870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25fc0038c0 0x7f25fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260e7fc700 1 --2- 172.21.15.79:0/1353101870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25fc0045a0 0x7f25fc0049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260e7fc700 1 --2- 172.21.15.79:0/1353101870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25fc04d7f0 0x7f25fc04fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260e7fc700 1 -- 172.21.15.79:0/1353101870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26100e9f60 con 0x7f25fc0045a0 2021-04-09T18:30:13.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260e7fc700 1 -- 172.21.15.79:0/1353101870 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26101c3df0 con 0x7f25fc0038c0 2021-04-09T18:30:13.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260e7fc700 1 -- 172.21.15.79:0/1353101870 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc0052a0 con 0x7f25fc04d7f0 2021-04-09T18:30:13.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260effd700 1 --2- 172.21.15.79:0/1353101870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25fc0045a0 0x7f25fc0049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260ffff700 1 --2- 172.21.15.79:0/1353101870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25fc04d7f0 0x7f25fc04fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.094 7f260f7fe700 1 --2- 172.21.15.79:0/1353101870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25fc0038c0 0x7f25fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.098 7f260effd700 1 -- 172.21.15.79:0/1353101870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25fc04d7f0 msgr2=0x7f25fc04fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:13.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.098 7f260effd700 1 --2- 172.21.15.79:0/1353101870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25fc04d7f0 0x7f25fc04fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.098 7f260effd700 1 -- 172.21.15.79:0/1353101870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25fc0038c0 msgr2=0x7f25fc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:13.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.098 7f260effd700 1 --2- 172.21.15.79:0/1353101870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25fc0038c0 0x7f25fc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.098 7f260effd700 1 -- 172.21.15.79:0/1353101870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25fc050280 con 0x7f25fc0045a0 2021-04-09T18:30:13.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.098 7f260effd700 1 --2- 172.21.15.79:0/1353101870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25fc0045a0 0x7f25fc0049f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f25f8001000 tx=0x7f25f8005080).ready entity=mon.0 client_cookie=b64aa48663c72a8e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:13.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.098 7f260e7fc700 1 -- 172.21.15.79:0/1353101870 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f25fc050280 con 0x7f25fc0045a0 2021-04-09T18:30:13.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.098 7f260e7fc700 1 -- 172.21.15.79:0/1353101870 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f8008170 con 0x7f25fc0045a0 2021-04-09T18:30:13.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.098 7f260e7fc700 1 -- 172.21.15.79:0/1353101870 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f261009f910 con 0x7f25fc0045a0 2021-04-09T18:30:13.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.098 7f2615cb3700 1 -- 172.21.15.79:0/1353101870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25fc0045a0 msgr2=0x7f25fc0049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:13.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.098 7f2615cb3700 1 --2- 172.21.15.79:0/1353101870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25fc0045a0 0x7f25fc0049f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f25f8001000 tx=0x7f25f8005080).stop 2021-04-09T18:30:13.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.098 7f260ffff700 1 -- 172.21.15.79:0/1353101870 reap_dead start 2021-04-09T18:30:13.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.098 7f2615cb3700 1 -- 172.21.15.79:0/1353101870 shutdown_connections 2021-04-09T18:30:13.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.098 7f2615cb3700 1 -- 172.21.15.79:0/1353101870 >> 172.21.15.79:0/1353101870 conn(0x7f26100e6010 msgr2=0x7f26100e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:13.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.098 7f2615cb3700 1 -- 172.21.15.79:0/1353101870 shutdown_connections 2021-04-09T18:30:13.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.098 7f2615cb3700 1 -- 172.21.15.79:0/1353101870 wait complete. 2021-04-09T18:30:13.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f2615cb3700 1 Processor -- start 2021-04-09T18:30:13.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f2615cb3700 1 -- start start 2021-04-09T18:30:13.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f2615cb3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26101a1430 0x7f26100af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f2615cb3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26100b09d0 0x7f26100b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f2615cb3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26100d4e40 0x7f26100d5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f2615cb3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26100ade70 con 0x7f26101a1430 2021-04-09T18:30:13.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f2615cb3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26100ae170 con 0x7f26100b09d0 2021-04-09T18:30:13.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f2615cb3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26100d58c0 con 0x7f26100d4e40 2021-04-09T18:30:13.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f260f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26101a1430 0x7f26100af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f260f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26101a1430 0x7f26100af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58534/0 (socket says 172.21.15.79:58534) 2021-04-09T18:30:13.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f260f7fe700 1 -- 172.21.15.79:0/170003972 learned_addr learned my addr 172.21.15.79:0/170003972 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:30:13.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f260effd700 1 --2- 172.21.15.79:0/170003972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26100b09d0 0x7f26100b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f260ffff700 1 --2- 172.21.15.79:0/170003972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26100d4e40 0x7f26100d5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f260f7fe700 1 -- 172.21.15.79:0/170003972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26100d4e40 msgr2=0x7f26100d5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:13.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f260f7fe700 1 --2- 172.21.15.79:0/170003972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26100d4e40 0x7f26100d5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f260f7fe700 1 -- 172.21.15.79:0/170003972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26100b09d0 msgr2=0x7f26100b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:13.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f260f7fe700 1 --2- 172.21.15.79:0/170003972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26100b09d0 0x7f26100b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f260f7fe700 1 -- 172.21.15.79:0/170003972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26100ad700 con 0x7f26101a1430 2021-04-09T18:30:13.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f260effd700 1 --2- 172.21.15.79:0/170003972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26100b09d0 0x7f26100b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:30:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f260f7fe700 1 --2- 172.21.15.79:0/170003972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26101a1430 0x7f26100af710 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f26100d8010 tx=0x7f260000e4b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f2607fff700 1 -- 172.21.15.79:0/170003972 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f26100ad700 con 0x7f26101a1430 2021-04-09T18:30:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f2607fff700 1 -- 172.21.15.79:0/170003972 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2600014430 con 0x7f26101a1430 2021-04-09T18:30:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f2607fff700 1 -- 172.21.15.79:0/170003972 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f260000f040 con 0x7f26101a1430 2021-04-09T18:30:13.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f2615cb3700 1 -- 172.21.15.79:0/170003972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26100ad300 con 0x7f26101a1430 2021-04-09T18:30:13.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.102 7f2615cb3700 1 -- 172.21.15.79:0/170003972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26100afd40 con 0x7f26101a1430 2021-04-09T18:30:13.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.106 7f2607fff700 1 -- 172.21.15.79:0/170003972 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2600014800 con 0x7f26101a1430 2021-04-09T18:30:13.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.106 7f2607fff700 1 --2- 172.21.15.79:0/170003972 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f25f4029100 0x7f25f402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.106 7f2607fff700 1 -- 172.21.15.79:0/170003972 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f260003a2e0 con 0x7f26101a1430 2021-04-09T18:30:13.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.106 7f260effd700 1 --2- 172.21.15.79:0/170003972 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f25f4029100 0x7f25f402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.106 7f260effd700 1 --2- 172.21.15.79:0/170003972 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f25f4029100 0x7f25f402b650 crc :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:13.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.110 7f2624d39740 1 Processor -- start 2021-04-09T18:30:13.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.110 7f2624d39740 1 -- start start 2021-04-09T18:30:13.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.110 7f2624d39740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb4e8de0 0x562adb52b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.110 7f2624d39740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb4e9230 0x562adb52bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.110 7f2624d39740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb522d40 0x562adb523190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.110 7f2624d39740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x562adb49b780 con 0x562adb4e9230 2021-04-09T18:30:13.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.110 7f2624d39740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562adb4b5540 con 0x562adb522d40 2021-04-09T18:30:13.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.110 7f2624d39740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x562adb425d10 con 0x562adb4e8de0 2021-04-09T18:30:13.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.110 7f260effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb4e9230 0x562adb52bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.110 7f260effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb4e9230 0x562adb52bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58546/0 (socket says 172.21.15.79:58546) 2021-04-09T18:30:13.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.110 7f260effd700 1 -- 172.21.15.79:0/2700658554 learned_addr learned my addr 172.21.15.79:0/2700658554 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:30:13.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.110 7f260f7fe700 1 --2- 172.21.15.79:0/2700658554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb4e8de0 0x562adb52b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.110 7f260ffff700 1 --2- 172.21.15.79:0/2700658554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb522d40 0x562adb523190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.110 7f260effd700 1 -- 172.21.15.79:0/2700658554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb4e8de0 msgr2=0x562adb52b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:13.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.110 7f260effd700 1 --2- 172.21.15.79:0/2700658554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb4e8de0 0x562adb52b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.110 7f260effd700 1 -- 172.21.15.79:0/2700658554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb522d40 msgr2=0x562adb523190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:13.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.110 7f260effd700 1 --2- 172.21.15.79:0/2700658554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb522d40 0x562adb523190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.110 7f260effd700 1 -- 172.21.15.79:0/2700658554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562adb4dd270 con 0x562adb4e9230 2021-04-09T18:30:13.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.110 7f260ffff700 1 --2- 172.21.15.79:0/2700658554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb522d40 0x562adb523190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:30:13.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.110 7f260effd700 1 --2- 172.21.15.79:0/2700658554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb4e9230 0x562adb52bc60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x562adb47bfe0 tx=0x7f25f8008bc0).ready entity=mon.0 client_cookie=639794435ab0d2c4 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:13.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2615cb3700 1 -- 172.21.15.79:0/2700658554 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x562adb4dd270 con 0x562adb4e9230 2021-04-09T18:30:13.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2615cb3700 1 -- 172.21.15.79:0/2700658554 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f801e070 con 0x562adb4e9230 2021-04-09T18:30:13.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2615cb3700 1 -- 172.21.15.79:0/2700658554 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f25f8020040 con 0x562adb4e9230 2021-04-09T18:30:13.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2624d39740 1 -- 172.21.15.79:0/2700658554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb4e9230 msgr2=0x562adb52bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:13.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2624d39740 1 --2- 172.21.15.79:0/2700658554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb4e9230 0x562adb52bc60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x562adb47bfe0 tx=0x7f25f8008bc0).stop 2021-04-09T18:30:13.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2624d39740 1 -- 172.21.15.79:0/2700658554 shutdown_connections 2021-04-09T18:30:13.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2624d39740 1 --2- 172.21.15.79:0/2700658554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb522d40 0x562adb523190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2624d39740 1 --2- 172.21.15.79:0/2700658554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb4e8de0 0x562adb52b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2624d39740 1 --2- 172.21.15.79:0/2700658554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb4e9230 0x562adb52bc60 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2624d39740 1 -- 172.21.15.79:0/2700658554 >> 172.21.15.79:0/2700658554 conn(0x562adb4e4560 msgr2=0x562adb4ea3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:13.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2624d39740 1 -- 172.21.15.79:0/2700658554 shutdown_connections 2021-04-09T18:30:13.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2624d39740 1 -- 172.21.15.79:0/2700658554 wait complete. 2021-04-09T18:30:13.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2624d39740 1 -- start start 2021-04-09T18:30:13.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2624d39740 1 Processor -- start 2021-04-09T18:30:13.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2624d39740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb526d40 0x562adb4fbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2624d39740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb518b50 0x562adb518fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2624d39740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb51f6a0 0x562adb51faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2624d39740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x562adb492c20 con 0x562adb51f6a0 2021-04-09T18:30:13.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2624d39740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562adb32c0b0 con 0x562adb518b50 2021-04-09T18:30:13.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2624d39740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x562adb34b620 con 0x562adb526d40 2021-04-09T18:30:13.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f2624d39740 10 client.0 ll_register_callbacks cb 0x562adb4b1db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-04-09T18:30:13.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f260ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb51f6a0 0x562adb51faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f260ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb51f6a0 0x562adb51faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58552/0 (socket says 172.21.15.79:58552) 2021-04-09T18:30:13.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f260ffff700 1 -- 172.21.15.79:0/3269080005 learned_addr learned my addr 172.21.15.79:0/3269080005 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:30:13.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f260effd700 1 --2- 172.21.15.79:0/3269080005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb518b50 0x562adb518fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.114 7f260f7fe700 1 --2- 172.21.15.79:0/3269080005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb526d40 0x562adb4fbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f260ffff700 1 -- 172.21.15.79:0/3269080005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb526d40 msgr2=0x562adb4fbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:13.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f260ffff700 1 --2- 172.21.15.79:0/3269080005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb526d40 0x562adb4fbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f260ffff700 1 -- 172.21.15.79:0/3269080005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb518b50 msgr2=0x562adb518fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:13.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f260ffff700 1 --2- 172.21.15.79:0/3269080005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb518b50 0x562adb518fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f260ffff700 1 -- 172.21.15.79:0/3269080005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562adb3d9490 con 0x562adb51f6a0 2021-04-09T18:30:13.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f260f7fe700 1 --2- 172.21.15.79:0/3269080005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb526d40 0x562adb4fbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:30:13.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f260ffff700 1 --2- 172.21.15.79:0/3269080005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb51f6a0 0x562adb51faf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x562adb523d60 tx=0x7f26080157b0).ready entity=mon.0 client_cookie=eb52b213570b37a8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:13.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f25edffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2021-04-09T18:30:13.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f25edffb700 1 -- 172.21.15.79:0/3269080005 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x562adb3d9490 con 0x562adb51f6a0 2021-04-09T18:30:13.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f2624d39740 1 -- 172.21.15.79:0/3269080005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562adb3e4140 con 0x562adb51f6a0 2021-04-09T18:30:13.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f25edffb700 1 -- 172.21.15.79:0/3269080005 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f2608010040 con 0x562adb51f6a0 2021-04-09T18:30:13.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f25edffb700 1 -- 172.21.15.79:0/3269080005 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2608016640 con 0x562adb51f6a0 2021-04-09T18:30:13.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f2624d39740 10 client.5697 fetch_fsmap learned FSMap version 26 2021-04-09T18:30:13.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f2624d39740 1 -- 172.21.15.79:0/3269080005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x562adb347f10 con 0x562adb51f6a0 2021-04-09T18:30:13.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f25edffb700 1 -- 172.21.15.79:0/3269080005 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562adb3e4140 con 0x562adb51f6a0 2021-04-09T18:30:13.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f25edffb700 1 -- 172.21.15.79:0/3269080005 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 26) v1 ==== 1247+0+0 (secure 0 0 0) 0x7f260801f420 con 0x562adb51f6a0 2021-04-09T18:30:13.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f2624d39740 10 client.5697 fetch_fsmap finished waiting for FSMap version 26 2021-04-09T18:30:13.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f2624d39740 10 client.5697 resolve_mds: resolved ID 'b' to GID 5111 2021-04-09T18:30:13.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f2624d39740 20 client.5697 populate_metadata read hostname 'smithi079' 2021-04-09T18:30:13.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f2624d39740 1 --2- 172.21.15.79:0/3269080005 >> [v2:172.21.15.89:6834/1280399112,v1:172.21.15.89:6835/1280399112] conn(0x562adb533050 0x562adb5334a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f2624d39740 4 client.5697 mds_command: new command op to 5111 tid=0[{"prefix": "get_command_descriptions"}] 2021-04-09T18:30:13.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f2624d39740 1 -- 172.21.15.79:0/3269080005 --> [v2:172.21.15.89:6834/1280399112,v1:172.21.15.89:6835/1280399112] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562adb268fd0 con 0x562adb533050 2021-04-09T18:30:13.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f260f7fe700 1 --2- 172.21.15.79:0/3269080005 >> [v2:172.21.15.89:6834/1280399112,v1:172.21.15.89:6835/1280399112] conn(0x562adb533050 0x562adb5334a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f25edffb700 10 client.5697 ms_handle_connect on v2:172.21.15.89:6834/1280399112 2021-04-09T18:30:13.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f260f7fe700 1 --2- 172.21.15.79:0/3269080005 >> [v2:172.21.15.89:6834/1280399112,v1:172.21.15.89:6835/1280399112] conn(0x562adb533050 0x562adb5334a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ea7c2557cf025473 server_cookie=4c49aa6fbf83a794 in_seq=0 out_seq=0 2021-04-09T18:30:13.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f25edffb700 1 -- 172.21.15.79:0/3269080005 <== mds.0 v2:172.21.15.89:6834/1280399112 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3729 (crc 0 0 0) 0x562adb268fd0 con 0x562adb533050 2021-04-09T18:30:13.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f25edffb700 10 client.5697 handle_command_reply: tid=0 2021-04-09T18:30:13.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.118 7f2624d39740 1 client.5697 shutdown 2021-04-09T18:30:13.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.122 7f2624d39740 1 -- 172.21.15.79:0/3269080005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb51f6a0 msgr2=0x562adb51faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:13.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.122 7f2624d39740 1 --2- 172.21.15.79:0/3269080005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb51f6a0 0x562adb51faf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x562adb523d60 tx=0x7f26080157b0).stop 2021-04-09T18:30:13.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.122 7f2624d39740 1 -- 172.21.15.79:0/3269080005 shutdown_connections 2021-04-09T18:30:13.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.122 7f2624d39740 1 --2- 172.21.15.79:0/3269080005 >> [v2:172.21.15.89:6834/1280399112,v1:172.21.15.89:6835/1280399112] conn(0x562adb533050 0x562adb5334a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.122 7f2624d39740 1 --2- 172.21.15.79:0/3269080005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb51f6a0 0x562adb51faf0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.122 7f2624d39740 1 --2- 172.21.15.79:0/3269080005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb526d40 0x562adb4fbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.122 7f2624d39740 1 --2- 172.21.15.79:0/3269080005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb518b50 0x562adb518fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.122 7f25edffb700 0 client.5697 ms_handle_reset on v2:172.21.15.89:6834/1280399112 2021-04-09T18:30:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.122 7f2624d39740 1 -- 172.21.15.79:0/3269080005 >> 172.21.15.79:0/3269080005 conn(0x562adb522160 msgr2=0x562adb4e4560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.122 7f2624d39740 1 -- 172.21.15.79:0/3269080005 shutdown_connections 2021-04-09T18:30:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.122 7f2624d39740 1 -- 172.21.15.79:0/3269080005 wait complete. 2021-04-09T18:30:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.122 7f2624d39740 20 client.5697 trim_cache size 0 max 16384 2021-04-09T18:30:13.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f2624d39740 1 Processor -- start 2021-04-09T18:30:13.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f2624d39740 1 -- start start 2021-04-09T18:30:13.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f2624d39740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb4e9530 0x562adb552fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f2624d39740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb4e9980 0x562adb5535d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f2624d39740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb55ba90 0x562adb55bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f2624d39740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x562adb4e4ef0 con 0x562adb4e9980 2021-04-09T18:30:13.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f2624d39740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562adb4ef0c0 con 0x562adb55ba90 2021-04-09T18:30:13.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f2624d39740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x562adb523e20 con 0x562adb4e9530 2021-04-09T18:30:13.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f260effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb4e9980 0x562adb5535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f260effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb4e9980 0x562adb5535d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58558/0 (socket says 172.21.15.79:58558) 2021-04-09T18:30:13.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f260effd700 1 -- 172.21.15.79:0/2416533294 learned_addr learned my addr 172.21.15.79:0/2416533294 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:30:13.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f260f7fe700 1 --2- 172.21.15.79:0/2416533294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb4e9530 0x562adb552fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f260ffff700 1 --2- 172.21.15.79:0/2416533294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb55ba90 0x562adb55bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f260f7fe700 1 -- 172.21.15.79:0/2416533294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb55ba90 msgr2=0x562adb55bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:13.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f260f7fe700 1 --2- 172.21.15.79:0/2416533294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb55ba90 0x562adb55bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f260f7fe700 1 -- 172.21.15.79:0/2416533294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb4e9980 msgr2=0x562adb5535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:13.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f260f7fe700 1 --2- 172.21.15.79:0/2416533294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb4e9980 0x562adb5535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f260f7fe700 1 -- 172.21.15.79:0/2416533294 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2608012e30 con 0x562adb4e9530 2021-04-09T18:30:13.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f260effd700 1 --2- 172.21.15.79:0/2416533294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb4e9980 0x562adb5535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:30:13.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f260f7fe700 1 --2- 172.21.15.79:0/2416533294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb4e9530 0x562adb552fa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f2600028000 tx=0x7f2600006b80).ready entity=mon.2 client_cookie=e85419693153d3cc server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:13.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f25effff700 1 -- 172.21.15.79:0/2416533294 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2608012e30 con 0x562adb4e9530 2021-04-09T18:30:13.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f25effff700 1 -- 172.21.15.79:0/2416533294 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2600030040 con 0x562adb4e9530 2021-04-09T18:30:13.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f25effff700 1 -- 172.21.15.79:0/2416533294 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f26100afd40 con 0x562adb4e9530 2021-04-09T18:30:13.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f2624d39740 1 -- 172.21.15.79:0/2416533294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb4e9530 msgr2=0x562adb552fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:13.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.130 7f2624d39740 1 --2- 172.21.15.79:0/2416533294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb4e9530 0x562adb552fa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f2600028000 tx=0x7f2600006b80).stop 2021-04-09T18:30:13.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f2624d39740 1 -- 172.21.15.79:0/2416533294 shutdown_connections 2021-04-09T18:30:13.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f2624d39740 1 --2- 172.21.15.79:0/2416533294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb55ba90 0x562adb55bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f2624d39740 1 --2- 172.21.15.79:0/2416533294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb4e9530 0x562adb552fa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f2624d39740 1 --2- 172.21.15.79:0/2416533294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb4e9980 0x562adb5535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f2624d39740 1 -- 172.21.15.79:0/2416533294 >> 172.21.15.79:0/2416533294 conn(0x562adb5569d0 msgr2=0x562adb556e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:13.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f2624d39740 1 -- 172.21.15.79:0/2416533294 shutdown_connections 2021-04-09T18:30:13.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f2624d39740 1 -- 172.21.15.79:0/2416533294 wait complete. 2021-04-09T18:30:13.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f2624d39740 1 -- start start 2021-04-09T18:30:13.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f2624d39740 1 Processor -- start 2021-04-09T18:30:13.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f2624d39740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb5518e0 0x562adb5538d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f2624d39740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb551d30 0x562adb5635c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f2624d39740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb563bf0 0x562adb4f6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f2624d39740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x562adb4e51e0 con 0x562adb563bf0 2021-04-09T18:30:13.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f2624d39740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562adb2db390 con 0x562adb5518e0 2021-04-09T18:30:13.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f2624d39740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x562adb5544c0 con 0x562adb551d30 2021-04-09T18:30:13.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f2624d39740 10 client.0 ll_register_callbacks cb 0x7f2610100f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-04-09T18:30:13.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f260ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb563bf0 0x562adb4f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f260ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb563bf0 0x562adb4f6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58566/0 (socket says 172.21.15.79:58566) 2021-04-09T18:30:13.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f260ffff700 1 -- 172.21.15.79:0/3932551416 learned_addr learned my addr 172.21.15.79:0/3932551416 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:30:13.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f260f7fe700 1 --2- 172.21.15.79:0/3932551416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb5518e0 0x562adb5538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f260effd700 1 --2- 172.21.15.79:0/3932551416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb551d30 0x562adb5635c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f260ffff700 1 -- 172.21.15.79:0/3932551416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb551d30 msgr2=0x562adb5635c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:13.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f260ffff700 1 --2- 172.21.15.79:0/3932551416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb551d30 0x562adb5635c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f260ffff700 1 -- 172.21.15.79:0/3932551416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb5518e0 msgr2=0x562adb5538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:13.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f260ffff700 1 --2- 172.21.15.79:0/3932551416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb5518e0 0x562adb5538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:13.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f260ffff700 1 -- 172.21.15.79:0/3932551416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260801ee20 con 0x562adb563bf0 2021-04-09T18:30:13.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f260ffff700 1 --2- 172.21.15.79:0/3932551416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb563bf0 0x562adb4f6750 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x562adb5242b0 tx=0x7f2608006d70).ready entity=mon.0 client_cookie=843dc9c2581ceb44 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:13.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f25eeffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2021-04-09T18:30:13.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f25eeffd700 1 -- 172.21.15.79:0/3932551416 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f260801ee20 con 0x562adb563bf0 2021-04-09T18:30:13.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f25eeffd700 1 -- 172.21.15.79:0/3932551416 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f2608010070 con 0x562adb563bf0 2021-04-09T18:30:13.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f2624d39740 1 -- 172.21.15.79:0/3932551416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562adb268fd0 con 0x562adb563bf0 2021-04-09T18:30:13.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f25eeffd700 1 -- 172.21.15.79:0/3932551416 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f260801fe30 con 0x562adb563bf0 2021-04-09T18:30:13.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f2624d39740 10 client.5703 fetch_fsmap learned FSMap version 26 2021-04-09T18:30:13.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f2624d39740 1 -- 172.21.15.79:0/3932551416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x562adb53b550 con 0x562adb563bf0 2021-04-09T18:30:13.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f25eeffd700 1 -- 172.21.15.79:0/3932551416 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562adb268fd0 con 0x562adb563bf0 2021-04-09T18:30:13.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f25eeffd700 1 -- 172.21.15.79:0/3932551416 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 26) v1 ==== 1247+0+0 (secure 0 0 0) 0x7f2608011c50 con 0x562adb563bf0 2021-04-09T18:30:13.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.134 7f2624d39740 10 client.5703 fetch_fsmap finished waiting for FSMap version 26 2021-04-09T18:30:13.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.138 7f2624d39740 10 client.5703 resolve_mds: resolved ID 'b' to GID 5111 2021-04-09T18:30:13.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.138 7f2624d39740 20 client.5703 populate_metadata read hostname 'smithi079' 2021-04-09T18:30:13.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.138 7f2624d39740 1 --2- 172.21.15.79:0/3932551416 >> [v2:172.21.15.89:6834/1280399112,v1:172.21.15.89:6835/1280399112] conn(0x562adb4f6d80 0x562adb4f71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:13.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.138 7f2624d39740 4 client.5703 mds_command: new command op to 5111 tid=0[{"prefix": "cache drop", "timeout": 5}] 2021-04-09T18:30:13.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.138 7f2624d39740 1 -- 172.21.15.79:0/3932551416 --> [v2:172.21.15.89:6834/1280399112,v1:172.21.15.89:6835/1280399112] -- command(tid 0: {"prefix": "cache drop", "timeout": 5}) v1 -- 0x562adb50ad70 con 0x562adb4f6d80 2021-04-09T18:30:13.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.138 7f260f7fe700 1 --2- 172.21.15.79:0/3932551416 >> [v2:172.21.15.89:6834/1280399112,v1:172.21.15.89:6835/1280399112] conn(0x562adb4f6d80 0x562adb4f71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:13.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.138 7f25eeffd700 10 client.5703 ms_handle_connect on v2:172.21.15.89:6834/1280399112 2021-04-09T18:30:13.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:30:13.138 7f260f7fe700 1 --2- 172.21.15.79:0/3932551416 >> [v2:172.21.15.89:6834/1280399112,v1:172.21.15.89:6835/1280399112] conn(0x562adb4f6d80 0x562adb4f71d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=40d1cded9907583d server_cookie=89bcf45c81ac5111 in_seq=0 out_seq=0 2021-04-09T18:30:43.293 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:30:43.296 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:30:43.298 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:30:43.301 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:30:43.304 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:31:13.354 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:31:13.356 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:31:13.359 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:31:13.362 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:31:13.365 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:31:15.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.418 7f25eeffd700 1 -- 172.21.15.79:0/3932551416 <== mds.0 v2:172.21.15.89:6834/1280399112 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+405 (crc 0 0 0) 0x7f2600042070 con 0x562adb4f6d80 2021-04-09T18:31:15.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.418 7f25eeffd700 10 client.5703 handle_command_reply: tid=0 2021-04-09T18:31:15.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.418 7f2624d39740 1 client.5703 shutdown 2021-04-09T18:31:15.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.418 7f2624d39740 1 -- 172.21.15.79:0/3932551416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb563bf0 msgr2=0x562adb4f6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:15.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.418 7f2624d39740 1 --2- 172.21.15.79:0/3932551416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb563bf0 0x562adb4f6750 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x562adb5242b0 tx=0x7f2608006d70).stop 2021-04-09T18:31:15.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.418 7f2624d39740 1 -- 172.21.15.79:0/3932551416 shutdown_connections 2021-04-09T18:31:15.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.418 7f2624d39740 1 --2- 172.21.15.79:0/3932551416 >> [v2:172.21.15.89:6834/1280399112,v1:172.21.15.89:6835/1280399112] conn(0x562adb4f6d80 0x562adb4f71d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.418 7f2624d39740 1 --2- 172.21.15.79:0/3932551416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562adb5518e0 0x562adb5538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.418 7f25eeffd700 0 client.5703 ms_handle_reset on v2:172.21.15.89:6834/1280399112 2021-04-09T18:31:15.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.418 7f2624d39740 1 --2- 172.21.15.79:0/3932551416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562adb563bf0 0x562adb4f6750 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.418 7f2624d39740 1 --2- 172.21.15.79:0/3932551416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562adb551d30 0x562adb5635c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.418 7f2624d39740 1 -- 172.21.15.79:0/3932551416 >> 172.21.15.79:0/3932551416 conn(0x562adb5525a0 msgr2=0x562adb556930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:15.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.418 7f2624d39740 1 -- 172.21.15.79:0/3932551416 shutdown_connections 2021-04-09T18:31:15.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.418 7f2624d39740 1 -- 172.21.15.79:0/3932551416 wait complete. 2021-04-09T18:31:15.429 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.418 7f2624d39740 20 client.5703 trim_cache size 0 max 16384 2021-04-09T18:31:15.429 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:31:15.430 INFO:teuthology.orchestra.run.smithi079.stdout: "client_recall": { 2021-04-09T18:31:15.430 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": -110, 2021-04-09T18:31:15.431 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "(110) Connection timed out", 2021-04-09T18:31:15.431 INFO:teuthology.orchestra.run.smithi079.stdout: "recalled": 120 2021-04-09T18:31:15.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:15.432 INFO:teuthology.orchestra.run.smithi079.stdout: "flush_journal": { 2021-04-09T18:31:15.432 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2021-04-09T18:31:15.432 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "" 2021-04-09T18:31:15.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:15.433 INFO:teuthology.orchestra.run.smithi079.stdout: "trim_cache": { 2021-04-09T18:31:15.433 INFO:teuthology.orchestra.run.smithi079.stdout: "trimmed": 648 2021-04-09T18:31:15.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:15.434 INFO:teuthology.orchestra.run.smithi079.stdout: "cache": { 2021-04-09T18:31:15.434 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": { 2021-04-09T18:31:15.435 INFO:teuthology.orchestra.run.smithi079.stdout: "items": 8104, 2021-04-09T18:31:15.435 INFO:teuthology.orchestra.run.smithi079.stdout: "bytes": 1309160 2021-04-09T18:31:15.435 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:15.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:15.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 62.281167713999999 2021-04-09T18:31:15.437 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:31:15.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.422 7f2615cb3700 1 -- 172.21.15.79:0/170003972 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f25f4029100 msgr2=0x7f25f402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:15.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.422 7f2615cb3700 1 --2- 172.21.15.79:0/170003972 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f25f4029100 0x7f25f402b650 crc :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.422 7f2615cb3700 1 -- 172.21.15.79:0/170003972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26101a1430 msgr2=0x7f26100af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:15.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.422 7f2615cb3700 1 --2- 172.21.15.79:0/170003972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26101a1430 0x7f26100af710 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f26100d8010 tx=0x7f260000e4b0).stop 2021-04-09T18:31:15.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.422 7f2615cb3700 1 -- 172.21.15.79:0/170003972 shutdown_connections 2021-04-09T18:31:15.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.422 7f2615cb3700 1 --2- 172.21.15.79:0/170003972 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f25f4029100 0x7f25f402b650 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.422 7f2615cb3700 1 --2- 172.21.15.79:0/170003972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26100d4e40 0x7f26100d5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.422 7f2615cb3700 1 --2- 172.21.15.79:0/170003972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26101a1430 0x7f26100af710 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.422 7f2615cb3700 1 --2- 172.21.15.79:0/170003972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26100b09d0 0x7f26100b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.422 7f2615cb3700 1 -- 172.21.15.79:0/170003972 >> 172.21.15.79:0/170003972 conn(0x7f26101a1d30 msgr2=0x7f26100d8250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:15.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.422 7f2615cb3700 1 -- 172.21.15.79:0/170003972 shutdown_connections 2021-04-09T18:31:15.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.422 7f2615cb3700 1 -- 172.21.15.79:0/170003972 wait complete. 2021-04-09T18:31:15.443 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-04-09T18:31:15.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:15.444 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:31:15.445 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:31:15.452 INFO:teuthology.orchestra.run.smithi090.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-04-09T18:31:15.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:31:15.456 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-04-09T18:31:15.457 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi090.front.sepia.ceph.com... 2021-04-09T18:31:15.458 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:31:15.459 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:31:15.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:15.542 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:31:15.543 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:31:15.550 INFO:teuthology.orchestra.run.smithi090.stdout:ext2/ext3 2021-04-09T18:31:15.551 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:31:15.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:31:15.552 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:31:15.600 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:31:15.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f217519f700 1 Processor -- start 2021-04-09T18:31:15.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f217519f700 1 -- start start 2021-04-09T18:31:15.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f217519f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21700f5510 0x7f21700f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:15.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f217519f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21700e9ad0 0x7f217009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:15.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f217519f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f21701c2da0 0x7f21701c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:15.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f217519f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21700e9f20 con 0x7f21700f5510 2021-04-09T18:31:15.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f217519f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21700e59c0 con 0x7f21701c2da0 2021-04-09T18:31:15.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f217519f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21700fbb10 con 0x7f21700e9ad0 2021-04-09T18:31:15.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f216ed9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21700f5510 0x7f21700f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:15.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f216ed9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21700f5510 0x7f21700f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58572/0 (socket says 172.21.15.79:58572) 2021-04-09T18:31:15.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f216ed9d700 1 -- 172.21.15.79:0/86859506 learned_addr learned my addr 172.21.15.79:0/86859506 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:15.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f216e59c700 1 --2- 172.21.15.79:0/86859506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21700e9ad0 0x7f217009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:15.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f216f59e700 1 --2- 172.21.15.79:0/86859506 >> v2:172.21.15.89:3300/0 conn(0x7f21701c2da0 0x7f21701c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:15.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f216ed9d700 1 -- 172.21.15.79:0/86859506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21700e9ad0 msgr2=0x7f217009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:15.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f216ed9d700 1 --2- 172.21.15.79:0/86859506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21700e9ad0 0x7f217009f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f216ed9d700 1 -- 172.21.15.79:0/86859506 >> v2:172.21.15.89:3300/0 conn(0x7f21701c2da0 msgr2=0x7f21701c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:15.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f216ed9d700 1 --2- 172.21.15.79:0/86859506 >> v2:172.21.15.89:3300/0 conn(0x7f21701c2da0 0x7f21701c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f216ed9d700 1 -- 172.21.15.79:0/86859506 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21700e56c0 con 0x7f21700f5510 2021-04-09T18:31:15.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f216ed9d700 1 --2- 172.21.15.79:0/86859506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21700f5510 0x7f21700f64a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f2160002f30 tx=0x7f216000bd70).ready entity=mon.0 client_cookie=9f105493d6029d7c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:15.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f216dd9b700 1 -- 172.21.15.79:0/86859506 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f21700e56c0 con 0x7f21700f5510 2021-04-09T18:31:15.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f216dd9b700 1 -- 172.21.15.79:0/86859506 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21600098b0 con 0x7f21700f5510 2021-04-09T18:31:15.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f216dd9b700 1 -- 172.21.15.79:0/86859506 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2160009c80 con 0x7f21700f5510 2021-04-09T18:31:15.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f217519f700 1 -- 172.21.15.79:0/86859506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21700f5510 msgr2=0x7f21700f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:15.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.702 7f217519f700 1 --2- 172.21.15.79:0/86859506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21700f5510 0x7f21700f64a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f2160002f30 tx=0x7f216000bd70).stop 2021-04-09T18:31:15.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.706 7f217519f700 1 -- 172.21.15.79:0/86859506 shutdown_connections 2021-04-09T18:31:15.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.706 7f217519f700 1 --2- 172.21.15.79:0/86859506 >> v2:172.21.15.89:3300/0 conn(0x7f21701c2da0 0x7f21701c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.706 7f217519f700 1 --2- 172.21.15.79:0/86859506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21700f5510 0x7f21700f64a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.706 7f217519f700 1 --2- 172.21.15.79:0/86859506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21700e9ad0 0x7f217009f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.706 7f217519f700 1 -- 172.21.15.79:0/86859506 >> 172.21.15.79:0/86859506 conn(0x7f21700e5fd0 msgr2=0x7f21700e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:15.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.706 7f217519f700 1 -- 172.21.15.79:0/86859506 shutdown_connections 2021-04-09T18:31:15.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.706 7f217519f700 1 -- 172.21.15.79:0/86859506 wait complete. 2021-04-09T18:31:15.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.706 7f217519f700 1 Processor -- start 2021-04-09T18:31:15.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.706 7f217519f700 1 -- start start 2021-04-09T18:31:15.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.706 7f217519f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21700960d0 0x7f21700956d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:15.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.706 7f217519f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2170096520 0x7f21700ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:15.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.706 7f217519f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21701a6d40 0x7f21701a7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:15.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.706 7f217519f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21700b7330 con 0x7f2170096520 2021-04-09T18:31:15.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.706 7f217519f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21700992e0 con 0x7f21701a6d40 2021-04-09T18:31:15.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.706 7f217519f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21700b7630 con 0x7f21700960d0 2021-04-09T18:31:15.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.710 7f216e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2170096520 0x7f21700ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:15.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.710 7f216e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2170096520 0x7f21700ac4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58576/0 (socket says 172.21.15.79:58576) 2021-04-09T18:31:15.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.710 7f216e59c700 1 -- 172.21.15.79:0/1085812365 learned_addr learned my addr 172.21.15.79:0/1085812365 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:15.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.710 7f216ed9d700 1 --2- 172.21.15.79:0/1085812365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21700960d0 0x7f21700956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:15.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.710 7f216f59e700 1 --2- 172.21.15.79:0/1085812365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21701a6d40 0x7f21701a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:15.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.710 7f216e59c700 1 -- 172.21.15.79:0/1085812365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21700960d0 msgr2=0x7f21700956d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:15.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.710 7f216e59c700 1 --2- 172.21.15.79:0/1085812365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21700960d0 0x7f21700956d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.710 7f216e59c700 1 -- 172.21.15.79:0/1085812365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21701a6d40 msgr2=0x7f21701a7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:15.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.710 7f216e59c700 1 --2- 172.21.15.79:0/1085812365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21701a6d40 0x7f21701a7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.710 7f216e59c700 1 -- 172.21.15.79:0/1085812365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2170095d00 con 0x7f2170096520 2021-04-09T18:31:15.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.710 7f216e59c700 1 --2- 172.21.15.79:0/1085812365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2170096520 0x7f21700ac4b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f21700b7830 tx=0x7f216400c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:15.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.710 7f215f7fe700 1 -- 172.21.15.79:0/1085812365 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2170095d00 con 0x7f2170096520 2021-04-09T18:31:15.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.710 7f215f7fe700 1 -- 172.21.15.79:0/1085812365 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216400cb30 con 0x7f2170096520 2021-04-09T18:31:15.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.710 7f217519f700 1 -- 172.21.15.79:0/1085812365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21700acae0 con 0x7f2170096520 2021-04-09T18:31:15.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.710 7f215f7fe700 1 -- 172.21.15.79:0/1085812365 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f216400f040 con 0x7f2170096520 2021-04-09T18:31:15.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.710 7f217519f700 1 -- 172.21.15.79:0/1085812365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21701a7950 con 0x7f2170096520 2021-04-09T18:31:15.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.710 7f215f7fe700 1 -- 172.21.15.79:0/1085812365 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2164011070 con 0x7f2170096520 2021-04-09T18:31:15.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.710 7f215f7fe700 1 --2- 172.21.15.79:0/1085812365 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2154029100 0x7f215402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:15.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.710 7f215f7fe700 1 -- 172.21.15.79:0/1085812365 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f2164010040 con 0x7f2170096520 2021-04-09T18:31:15.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.710 7f216ed9d700 1 --2- 172.21.15.79:0/1085812365 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2154029100 0x7f215402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:15.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.714 7f216ed9d700 1 --2- 172.21.15.79:0/1085812365 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2154029100 0x7f215402b650 crc :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:15.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.714 7f217519f700 1 -- 172.21.15.79:0/1085812365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21700e39d0 con 0x7f2170096520 2021-04-09T18:31:15.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.722 7f215f7fe700 1 -- 172.21.15.79:0/1085812365 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f216400c730 con 0x7f2170096520 2021-04-09T18:31:15.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.882 7f217519f700 1 -- 172.21.15.79:0/1085812365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21700f5b10 con 0x7f2170096520 2021-04-09T18:31:15.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.886 7f215f7fe700 1 -- 172.21.15.79:0/1085812365 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+14400 (secure 0 0 0) 0x7f2164000bf0 con 0x7f2170096520 2021-04-09T18:31:15.887 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:15.887 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":51,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:31:15.092542","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:29:51.239559","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2021-04-09 18:29:52.114936","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.90:0/2690155541":"2021-04-09 19:31:14.431527","172.21.15.89:6835/781814443":"2021-04-10 18:29:53.473795","172.21.15.89:6834/781814443":"2021-04-10 18:29:53.473795"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:31:15.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.886 7f217519f700 1 -- 172.21.15.79:0/1085812365 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2154029100 msgr2=0x7f215402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:15.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.886 7f217519f700 1 --2- 172.21.15.79:0/1085812365 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2154029100 0x7f215402b650 crc :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.886 7f217519f700 1 -- 172.21.15.79:0/1085812365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2170096520 msgr2=0x7f21700ac4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:15.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.886 7f217519f700 1 --2- 172.21.15.79:0/1085812365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2170096520 0x7f21700ac4b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f21700b7830 tx=0x7f216400c150).stop 2021-04-09T18:31:15.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.886 7f217519f700 1 -- 172.21.15.79:0/1085812365 shutdown_connections 2021-04-09T18:31:15.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.886 7f217519f700 1 --2- 172.21.15.79:0/1085812365 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2154029100 0x7f215402b650 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.886 7f217519f700 1 --2- 172.21.15.79:0/1085812365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21701a6d40 0x7f21701a7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.886 7f217519f700 1 --2- 172.21.15.79:0/1085812365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21700960d0 0x7f21700956d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.886 7f217519f700 1 --2- 172.21.15.79:0/1085812365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2170096520 0x7f21700ac4b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:15.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.890 7f217519f700 1 -- 172.21.15.79:0/1085812365 >> 172.21.15.79:0/1085812365 conn(0x7f217009a080 msgr2=0x7f2170099500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:15.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.890 7f217519f700 1 -- 172.21.15.79:0/1085812365 shutdown_connections 2021-04-09T18:31:15.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.890 7f217519f700 1 -- 172.21.15.79:0/1085812365 wait complete. 2021-04-09T18:31:15.899 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:29:51.239559', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:29:52.114936', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:31:15.900 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:31:16.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.994 7f0957b59700 1 Processor -- start 2021-04-09T18:31:16.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.994 7f0957b59700 1 -- start start 2021-04-09T18:31:16.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.994 7f0957b59700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f09500e9b10 0x7f095009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.994 7f0957b59700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f09501c8040 0x7f09501ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.994 7f0957b59700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09500fbb50 con 0x7f09500f5550 2021-04-09T18:31:16.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.994 7f0957b59700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09501c3df0 con 0x7f09501c8040 2021-04-09T18:31:16.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.994 7f0957b59700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09500e9f60 con 0x7f09500e9b10 2021-04-09T18:31:16.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.994 7f09560fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f09501c8040 0x7f09501ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.994 7f09558fd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f09500f5550 0x7f09500f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53294/0 (socket says 172.21.15.79:53294) 2021-04-09T18:31:16.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.994 7f09558fd700 1 -- 172.21.15.79:0/2387740070 learned_addr learned my addr 172.21.15.79:0/2387740070 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:16.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.994 7f09550fc700 1 --2- 172.21.15.79:0/2387740070 >> v2:172.21.15.89:3300/0 conn(0x7f09500e9b10 0x7f095009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.998 7f09560fe700 1 -- 172.21.15.79:0/2387740070 >> v2:172.21.15.89:3300/0 conn(0x7f09500e9b10 msgr2=0x7f095009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:16.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.998 7f09560fe700 1 --2- 172.21.15.79:0/2387740070 >> v2:172.21.15.89:3300/0 conn(0x7f09500e9b10 0x7f095009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.998 7f09560fe700 1 -- 172.21.15.79:0/2387740070 >> v1:172.21.15.79:6789/0 conn(0x7f09500f5550 legacy=0x7f09500f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.998 7f09548fb700 1 -- 172.21.15.79:0/2387740070 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665252909 0 0) 0x7f09440010d0 con 0x7f09500f5550 2021-04-09T18:31:16.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.998 7f09560fe700 1 -- 172.21.15.79:0/2387740070 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09500e5700 con 0x7f09501c8040 2021-04-09T18:31:16.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.998 7f09560fe700 1 --2- 172.21.15.79:0/2387740070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09501c8040 0x7f09501ca4a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f09480032b0 tx=0x7f094800b3c0).ready entity=mon.0 client_cookie=ef3675b903ff79fc server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:16.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.998 7f09548fb700 1 -- 172.21.15.79:0/2387740070 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f09500e5700 con 0x7f09501c8040 2021-04-09T18:31:16.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.998 7f09548fb700 1 -- 172.21.15.79:0/2387740070 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094800bc20 con 0x7f09501c8040 2021-04-09T18:31:16.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.998 7f09548fb700 1 -- 172.21.15.79:0/2387740070 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0948002020 con 0x7f09501c8040 2021-04-09T18:31:16.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.998 7f0957b59700 1 -- 172.21.15.79:0/2387740070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09501c8040 msgr2=0x7f09501ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.998 7f0957b59700 1 --2- 172.21.15.79:0/2387740070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09501c8040 0x7f09501ca4a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f09480032b0 tx=0x7f094800b3c0).stop 2021-04-09T18:31:16.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.998 7f0957b59700 1 -- 172.21.15.79:0/2387740070 shutdown_connections 2021-04-09T18:31:16.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.998 7f0957b59700 1 --2- 172.21.15.79:0/2387740070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09501c8040 0x7f09501ca4a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.998 7f0957b59700 1 --2- 172.21.15.79:0/2387740070 >> v2:172.21.15.89:3300/0 conn(0x7f09500e9b10 0x7f095009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.998 7f0957b59700 1 -- 172.21.15.79:0/2387740070 >> 172.21.15.79:0/2387740070 conn(0x7f09500e6010 msgr2=0x7f09500e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:16.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.998 7f0957b59700 1 -- 172.21.15.79:0/2387740070 shutdown_connections 2021-04-09T18:31:16.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:15.998 7f0957b59700 1 -- 172.21.15.79:0/2387740070 wait complete. 2021-04-09T18:31:16.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f0957b59700 1 Processor -- start 2021-04-09T18:31:16.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f0957b59700 1 -- start start 2021-04-09T18:31:16.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f0957b59700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09500bcbb0 0x7f09500bd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f0957b59700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0950090f40 0x7f09500d0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f0957b59700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09500d0db0 0x7f0950093c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f0957b59700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0950091fb0 con 0x7f09500d0db0 2021-04-09T18:31:16.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f0957b59700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0950091390 con 0x7f09500bcbb0 2021-04-09T18:31:16.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f0957b59700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09500922b0 con 0x7f0950090f40 2021-04-09T18:31:16.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f09560fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09500d0db0 0x7f0950093c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f09560fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09500d0db0 0x7f0950093c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58594/0 (socket says 172.21.15.79:58594) 2021-04-09T18:31:16.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f09560fe700 1 -- 172.21.15.79:0/1285661196 learned_addr learned my addr 172.21.15.79:0/1285661196 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:16.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f09550fc700 1 --2- 172.21.15.79:0/1285661196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0950090f40 0x7f09500d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f09558fd700 1 --2- 172.21.15.79:0/1285661196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09500bcbb0 0x7f09500bd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f09560fe700 1 -- 172.21.15.79:0/1285661196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0950090f40 msgr2=0x7f09500d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f09560fe700 1 --2- 172.21.15.79:0/1285661196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0950090f40 0x7f09500d0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f09560fe700 1 -- 172.21.15.79:0/1285661196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09500bcbb0 msgr2=0x7f09500bd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f09560fe700 1 --2- 172.21.15.79:0/1285661196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09500bcbb0 0x7f09500bd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f09560fe700 1 -- 172.21.15.79:0/1285661196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0950091b40 con 0x7f09500d0db0 2021-04-09T18:31:16.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f09560fe700 1 --2- 172.21.15.79:0/1285661196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09500d0db0 0x7f0950093c70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f095008fcb0 tx=0x7f0948006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:16.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f09427fc700 1 -- 172.21.15.79:0/1285661196 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0950091b40 con 0x7f09500d0db0 2021-04-09T18:31:16.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f09427fc700 1 -- 172.21.15.79:0/1285661196 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0948020020 con 0x7f09500d0db0 2021-04-09T18:31:16.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f0957b59700 1 -- 172.21.15.79:0/1285661196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09500942a0 con 0x7f09500d0db0 2021-04-09T18:31:16.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f09427fc700 1 -- 172.21.15.79:0/1285661196 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f094801b720 con 0x7f09500d0db0 2021-04-09T18:31:16.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.002 7f0957b59700 1 -- 172.21.15.79:0/1285661196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0950094750 con 0x7f09500d0db0 2021-04-09T18:31:16.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.006 7f09427fc700 1 -- 172.21.15.79:0/1285661196 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f094800b0e0 con 0x7f09500d0db0 2021-04-09T18:31:16.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.006 7f09427fc700 1 --2- 172.21.15.79:0/1285661196 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0938029100 0x7f093802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.006 7f09427fc700 1 -- 172.21.15.79:0/1285661196 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f094803d510 con 0x7f09500d0db0 2021-04-09T18:31:16.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.006 7f09558fd700 1 --2- 172.21.15.79:0/1285661196 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0938029100 0x7f093802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.006 7f09558fd700 1 --2- 172.21.15.79:0/1285661196 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0938029100 0x7f093802b650 crc :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:16.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.010 7f0957b59700 1 -- 172.21.15.79:0/1285661196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09500e39f0 con 0x7f09500d0db0 2021-04-09T18:31:16.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.018 7f09427fc700 1 -- 172.21.15.79:0/1285661196 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f094800ba10 con 0x7f09500d0db0 2021-04-09T18:31:16.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.166 7f0957b59700 1 -- 172.21.15.79:0/1285661196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f09500a1c90 con 0x7f09500d0db0 2021-04-09T18:31:16.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.170 7f09427fc700 1 -- 172.21.15.79:0/1285661196 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v51) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0948011dc0 con 0x7f09500d0db0 2021-04-09T18:31:16.170 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:31:16.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.170 7f0957b59700 1 -- 172.21.15.79:0/1285661196 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0938029100 msgr2=0x7f093802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.170 7f0957b59700 1 --2- 172.21.15.79:0/1285661196 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0938029100 0x7f093802b650 crc :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.170 7f0957b59700 1 -- 172.21.15.79:0/1285661196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09500d0db0 msgr2=0x7f0950093c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.170 7f0957b59700 1 --2- 172.21.15.79:0/1285661196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09500d0db0 0x7f0950093c70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f095008fcb0 tx=0x7f0948006c10).stop 2021-04-09T18:31:16.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.170 7f0957b59700 1 -- 172.21.15.79:0/1285661196 shutdown_connections 2021-04-09T18:31:16.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.170 7f0957b59700 1 --2- 172.21.15.79:0/1285661196 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0938029100 0x7f093802b650 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.170 7f0957b59700 1 --2- 172.21.15.79:0/1285661196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09500bcbb0 0x7f09500bd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.170 7f0957b59700 1 --2- 172.21.15.79:0/1285661196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09500d0db0 0x7f0950093c70 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.170 7f0957b59700 1 --2- 172.21.15.79:0/1285661196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0950090f40 0x7f09500d0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.170 7f0957b59700 1 -- 172.21.15.79:0/1285661196 >> 172.21.15.79:0/1285661196 conn(0x7f095009b170 msgr2=0x7f09500d3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:16.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.170 7f0957b59700 1 -- 172.21.15.79:0/1285661196 shutdown_connections 2021-04-09T18:31:16.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.170 7f0957b59700 1 -- 172.21.15.79:0/1285661196 wait complete. 2021-04-09T18:31:16.183 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:31:16.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.282 7f752605f700 1 Processor -- start 2021-04-09T18:31:16.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.282 7f752605f700 1 -- start start 2021-04-09T18:31:16.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.282 7f752605f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75200e9b10 0x7f752009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.282 7f752605f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f75201c8040 0x7f75201ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.282 7f752605f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75200fbb50 con 0x7f75200f5550 2021-04-09T18:31:16.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.282 7f752605f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75201c3df0 con 0x7f75201c8040 2021-04-09T18:31:16.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.282 7f752605f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75200e9f60 con 0x7f75200e9b10 2021-04-09T18:31:16.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.282 7f751ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f75201c8040 0x7f75201ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.282 7f751ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f75201c8040 0x7f75201ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58602/0 (socket says 172.21.15.79:58602) 2021-04-09T18:31:16.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.282 7f751ffff700 1 -- 172.21.15.79:0/3646327501 learned_addr learned my addr 172.21.15.79:0/3646327501 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:16.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.282 7f751effd700 1 --2- 172.21.15.79:0/3646327501 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75200e9b10 0x7f752009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.282 7f751ffff700 1 -- 172.21.15.79:0/3646327501 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75200e9b10 msgr2=0x7f752009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:16.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.282 7f751ffff700 1 --2- 172.21.15.79:0/3646327501 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75200e9b10 0x7f752009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.282 7f751ffff700 1 -- 172.21.15.79:0/3646327501 >> v1:172.21.15.89:6789/0 conn(0x7f75200f5550 legacy=0x7f75200f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.282 7f751ffff700 1 -- 172.21.15.79:0/3646327501 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75200e5700 con 0x7f75201c8040 2021-04-09T18:31:16.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.282 7f751ffff700 1 --2- 172.21.15.79:0/3646327501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75201c8040 0x7f75201ca4a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f75180032b0 tx=0x7f751800b3c0).ready entity=mon.0 client_cookie=319ca9d7823314fb server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:16.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f751e7fc700 1 -- 172.21.15.79:0/3646327501 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f75200e5700 con 0x7f75201c8040 2021-04-09T18:31:16.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f751e7fc700 1 -- 172.21.15.79:0/3646327501 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751800bc20 con 0x7f75201c8040 2021-04-09T18:31:16.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f751e7fc700 1 -- 172.21.15.79:0/3646327501 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7518002020 con 0x7f75201c8040 2021-04-09T18:31:16.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f752605f700 1 -- 172.21.15.79:0/3646327501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75201c8040 msgr2=0x7f75201ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f752605f700 1 --2- 172.21.15.79:0/3646327501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75201c8040 0x7f75201ca4a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f75180032b0 tx=0x7f751800b3c0).stop 2021-04-09T18:31:16.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f752605f700 1 -- 172.21.15.79:0/3646327501 shutdown_connections 2021-04-09T18:31:16.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f752605f700 1 --2- 172.21.15.79:0/3646327501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75201c8040 0x7f75201ca4a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f752605f700 1 --2- 172.21.15.79:0/3646327501 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75200e9b10 0x7f752009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f752605f700 1 -- 172.21.15.79:0/3646327501 >> 172.21.15.79:0/3646327501 conn(0x7f75200e6010 msgr2=0x7f75200e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:16.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f752605f700 1 -- 172.21.15.79:0/3646327501 shutdown_connections 2021-04-09T18:31:16.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f752605f700 1 -- 172.21.15.79:0/3646327501 wait complete. 2021-04-09T18:31:16.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f752605f700 1 Processor -- start 2021-04-09T18:31:16.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f752605f700 1 -- start start 2021-04-09T18:31:16.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f752605f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75200a3890 0x7f75200c1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f752605f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75200a3ce0 0x7f75200af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f752605f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75200d4cc0 0x7f75200d5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f752605f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7520088590 con 0x7f75200a3890 2021-04-09T18:31:16.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f752605f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75200ad960 con 0x7f75200a3ce0 2021-04-09T18:31:16.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f752605f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75200adc60 con 0x7f75200d4cc0 2021-04-09T18:31:16.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f751f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75200a3890 0x7f75200c1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f751f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75200a3890 0x7f75200c1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58606/0 (socket says 172.21.15.79:58606) 2021-04-09T18:31:16.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f751f7fe700 1 -- 172.21.15.79:0/3041438451 learned_addr learned my addr 172.21.15.79:0/3041438451 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:16.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f751effd700 1 --2- 172.21.15.79:0/3041438451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75200a3ce0 0x7f75200af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.286 7f751ffff700 1 --2- 172.21.15.79:0/3041438451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75200d4cc0 0x7f75200d5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.290 7f751f7fe700 1 -- 172.21.15.79:0/3041438451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75200d4cc0 msgr2=0x7f75200d5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.290 7f751f7fe700 1 --2- 172.21.15.79:0/3041438451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75200d4cc0 0x7f75200d5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.290 7f751f7fe700 1 -- 172.21.15.79:0/3041438451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75200a3ce0 msgr2=0x7f75200af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.290 7f751f7fe700 1 --2- 172.21.15.79:0/3041438451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75200a3ce0 0x7f75200af200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.290 7f751f7fe700 1 -- 172.21.15.79:0/3041438451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75200c1a70 con 0x7f75200a3890 2021-04-09T18:31:16.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.290 7f751f7fe700 1 --2- 172.21.15.79:0/3041438451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75200a3890 0x7f75200c1440 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f7510000e90 tx=0x7f751000cb00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:16.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.290 7f7517fff700 1 -- 172.21.15.79:0/3041438451 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f75200c1a70 con 0x7f75200a3890 2021-04-09T18:31:16.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.290 7f752605f700 1 -- 172.21.15.79:0/3041438451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75200af830 con 0x7f75200a3890 2021-04-09T18:31:16.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.290 7f7517fff700 1 -- 172.21.15.79:0/3041438451 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751000e4a0 con 0x7f75200a3890 2021-04-09T18:31:16.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.290 7f752605f700 1 -- 172.21.15.79:0/3041438451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75201af000 con 0x7f75200a3890 2021-04-09T18:31:16.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.290 7f7517fff700 1 -- 172.21.15.79:0/3041438451 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f751000e870 con 0x7f75200a3890 2021-04-09T18:31:16.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.290 7f7517fff700 1 -- 172.21.15.79:0/3041438451 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f751000ea70 con 0x7f75200a3890 2021-04-09T18:31:16.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.290 7f7517fff700 1 --2- 172.21.15.79:0/3041438451 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7504029100 0x7f750402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.290 7f7517fff700 1 -- 172.21.15.79:0/3041438451 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f7510038fc0 con 0x7f75200a3890 2021-04-09T18:31:16.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.290 7f751effd700 1 --2- 172.21.15.79:0/3041438451 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7504029100 0x7f750402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.290 7f751effd700 1 --2- 172.21.15.79:0/3041438451 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7504029100 0x7f750402b650 crc :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:16.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.298 7f752605f700 1 -- 172.21.15.79:0/3041438451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75200e39f0 con 0x7f75200a3890 2021-04-09T18:31:16.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.302 7f7517fff700 1 -- 172.21.15.79:0/3041438451 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7520107f80 con 0x7f75200a3890 2021-04-09T18:31:16.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.458 7f752605f700 1 -- 172.21.15.79:0/3041438451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f75200f5b50 con 0x7f75200a3890 2021-04-09T18:31:16.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.458 7f7517fff700 1 -- 172.21.15.79:0/3041438451 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v51) v1 ==== 104+0+10 (secure 0 0 0) 0x7f751000e290 con 0x7f75200a3890 2021-04-09T18:31:16.459 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:31:16.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.462 7f752605f700 1 -- 172.21.15.79:0/3041438451 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7504029100 msgr2=0x7f750402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.462 7f752605f700 1 --2- 172.21.15.79:0/3041438451 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7504029100 0x7f750402b650 crc :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.462 7f752605f700 1 -- 172.21.15.79:0/3041438451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75200a3890 msgr2=0x7f75200c1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.462 7f752605f700 1 --2- 172.21.15.79:0/3041438451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75200a3890 0x7f75200c1440 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f7510000e90 tx=0x7f751000cb00).stop 2021-04-09T18:31:16.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.462 7f752605f700 1 -- 172.21.15.79:0/3041438451 shutdown_connections 2021-04-09T18:31:16.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.462 7f752605f700 1 --2- 172.21.15.79:0/3041438451 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7504029100 0x7f750402b650 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.462 7f752605f700 1 --2- 172.21.15.79:0/3041438451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75200d4cc0 0x7f75200d5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.462 7f752605f700 1 --2- 172.21.15.79:0/3041438451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75200a3890 0x7f75200c1440 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.462 7f752605f700 1 --2- 172.21.15.79:0/3041438451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75200a3ce0 0x7f75200af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.462 7f752605f700 1 -- 172.21.15.79:0/3041438451 >> 172.21.15.79:0/3041438451 conn(0x7f75200997d0 msgr2=0x7f75200d8020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:16.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.462 7f752605f700 1 -- 172.21.15.79:0/3041438451 shutdown_connections 2021-04-09T18:31:16.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.462 7f752605f700 1 -- 172.21.15.79:0/3041438451 wait complete. 2021-04-09T18:31:16.477 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:31:16.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.566 7fc7761dc700 1 Processor -- start 2021-04-09T18:31:16.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.566 7fc7761dc700 1 -- start start 2021-04-09T18:31:16.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc7761dc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc7701c9050 0x7fc7701cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc7761dc700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7700fbb50 con 0x7fc7700e9b10 2021-04-09T18:31:16.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc7761dc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77009f910 con 0x7fc7700f5550 2021-04-09T18:31:16.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc7761dc700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7701c3df0 con 0x7fc7701c9050 2021-04-09T18:31:16.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc76ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc7701c9050 0x7fc7701cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc76effd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc7700e9b10 0x7fc77009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53324/0 (socket says 172.21.15.79:53324) 2021-04-09T18:31:16.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc76effd700 1 -- 172.21.15.79:0/45894396 learned_addr learned my addr 172.21.15.79:0/45894396 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:16.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc76ffff700 1 -- 172.21.15.79:0/45894396 >> v1:172.21.15.89:6789/0 conn(0x7fc7700f5550 legacy=0x7fc7700f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc76ffff700 1 -- 172.21.15.79:0/45894396 >> v1:172.21.15.79:6789/0 conn(0x7fc7700e9b10 legacy=0x7fc77009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc76ffff700 1 -- 172.21.15.79:0/45894396 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7700e5700 con 0x7fc7701c9050 2021-04-09T18:31:16.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc76e7fc700 1 -- 172.21.15.79:0/45894396 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117905931 0 0) 0x7fc760001450 con 0x7fc7700e9b10 2021-04-09T18:31:16.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc76ffff700 1 --2- 172.21.15.79:0/45894396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7701c9050 0x7fc7701cb4b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fc768002f30 tx=0x7fc76800bcc0).ready entity=mon.0 client_cookie=8b453ee1b133ec15 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:16.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc76e7fc700 1 -- 172.21.15.79:0/45894396 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc7700e5700 con 0x7fc7701c9050 2021-04-09T18:31:16.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc76e7fc700 1 -- 172.21.15.79:0/45894396 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc768009800 con 0x7fc7701c9050 2021-04-09T18:31:16.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc76e7fc700 1 -- 172.21.15.79:0/45894396 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc768009bd0 con 0x7fc7701c9050 2021-04-09T18:31:16.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc7761dc700 1 -- 172.21.15.79:0/45894396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7701c9050 msgr2=0x7fc7701cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc7761dc700 1 --2- 172.21.15.79:0/45894396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7701c9050 0x7fc7701cb4b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fc768002f30 tx=0x7fc76800bcc0).stop 2021-04-09T18:31:16.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc7761dc700 1 -- 172.21.15.79:0/45894396 shutdown_connections 2021-04-09T18:31:16.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc7761dc700 1 --2- 172.21.15.79:0/45894396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7701c9050 0x7fc7701cb4b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc7761dc700 1 -- 172.21.15.79:0/45894396 >> 172.21.15.79:0/45894396 conn(0x7fc7700e6010 msgr2=0x7fc7700e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:16.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc7761dc700 1 -- 172.21.15.79:0/45894396 shutdown_connections 2021-04-09T18:31:16.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.570 7fc7761dc700 1 -- 172.21.15.79:0/45894396 wait complete. 2021-04-09T18:31:16.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.574 7fc7761dc700 1 Processor -- start 2021-04-09T18:31:16.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.574 7fc7761dc700 1 -- start start 2021-04-09T18:31:16.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.574 7fc7761dc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7700a9990 0x7fc7700a86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.574 7fc7761dc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7701d2a90 0x7fc7701d2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.574 7fc7761dc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7700c0cf0 0x7fc7700c1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.574 7fc7761dc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7700e9f60 con 0x7fc7701d2a90 2021-04-09T18:31:16.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.574 7fc7761dc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7700c09f0 con 0x7fc7700a9990 2021-04-09T18:31:16.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.574 7fc7761dc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7700bfe80 con 0x7fc7700c0cf0 2021-04-09T18:31:16.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.574 7fc76effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7701d2a90 0x7fc7701d2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.574 7fc76effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7701d2a90 0x7fc7701d2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58618/0 (socket says 172.21.15.79:58618) 2021-04-09T18:31:16.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.574 7fc76effd700 1 -- 172.21.15.79:0/2931993360 learned_addr learned my addr 172.21.15.79:0/2931993360 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:16.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.574 7fc76ffff700 1 --2- 172.21.15.79:0/2931993360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7700c0cf0 0x7fc7700c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.574 7fc76f7fe700 1 --2- 172.21.15.79:0/2931993360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7700a9990 0x7fc7700a86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.574 7fc76effd700 1 -- 172.21.15.79:0/2931993360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7700c0cf0 msgr2=0x7fc7700c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.574 7fc76effd700 1 --2- 172.21.15.79:0/2931993360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7700c0cf0 0x7fc7700c1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.574 7fc76effd700 1 -- 172.21.15.79:0/2931993360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7700a9990 msgr2=0x7fc7700a86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.574 7fc76effd700 1 --2- 172.21.15.79:0/2931993360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7700a9990 0x7fc7700a86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.574 7fc76effd700 1 -- 172.21.15.79:0/2931993360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7700a9ec0 con 0x7fc7701d2a90 2021-04-09T18:31:16.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.574 7fc76effd700 1 --2- 172.21.15.79:0/2931993360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7701d2a90 0x7fc7701d2ee0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fc770092740 tx=0x7fc76000cee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:16.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.578 7fc767fff700 1 -- 172.21.15.79:0/2931993360 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc7700a9ec0 con 0x7fc7701d2a90 2021-04-09T18:31:16.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.578 7fc767fff700 1 -- 172.21.15.79:0/2931993360 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc760005b80 con 0x7fc7701d2a90 2021-04-09T18:31:16.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.578 7fc767fff700 1 -- 172.21.15.79:0/2931993360 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc760007110 con 0x7fc7701d2a90 2021-04-09T18:31:16.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.578 7fc7761dc700 1 -- 172.21.15.79:0/2931993360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7700c1770 con 0x7fc7701d2a90 2021-04-09T18:31:16.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.578 7fc7761dc700 1 -- 172.21.15.79:0/2931993360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7700c0580 con 0x7fc7701d2a90 2021-04-09T18:31:16.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.578 7fc767fff700 1 -- 172.21.15.79:0/2931993360 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc76001a020 con 0x7fc7701d2a90 2021-04-09T18:31:16.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.578 7fc767fff700 1 --2- 172.21.15.79:0/2931993360 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc754029100 0x7fc75402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.578 7fc767fff700 1 -- 172.21.15.79:0/2931993360 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6053+0+0 (secure 0 0 0) 0x7fc7600395b0 con 0x7fc7701d2a90 2021-04-09T18:31:16.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.578 7fc76f7fe700 1 --2- 172.21.15.79:0/2931993360 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc754029100 0x7fc75402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.578 7fc76f7fe700 1 --2- 172.21.15.79:0/2931993360 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc754029100 0x7fc75402b650 crc :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:16.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.582 7fc7761dc700 1 -- 172.21.15.79:0/2931993360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7700e39f0 con 0x7fc7701d2a90 2021-04-09T18:31:16.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.590 7fc767fff700 1 -- 172.21.15.79:0/2931993360 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc760005970 con 0x7fc7701d2a90 2021-04-09T18:31:16.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.746 7fc7761dc700 1 -- 172.21.15.79:0/2931993360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fc7700a1c90 con 0x7fc7701d2a90 2021-04-09T18:31:16.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.746 7fc767fff700 1 -- 172.21.15.79:0/2931993360 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v51) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc760000f70 con 0x7fc7701d2a90 2021-04-09T18:31:16.748 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:31:16.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.750 7fc7761dc700 1 -- 172.21.15.79:0/2931993360 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc754029100 msgr2=0x7fc75402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.750 7fc7761dc700 1 --2- 172.21.15.79:0/2931993360 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc754029100 0x7fc75402b650 crc :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.750 7fc7761dc700 1 -- 172.21.15.79:0/2931993360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7701d2a90 msgr2=0x7fc7701d2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.750 7fc7761dc700 1 --2- 172.21.15.79:0/2931993360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7701d2a90 0x7fc7701d2ee0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fc770092740 tx=0x7fc76000cee0).stop 2021-04-09T18:31:16.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.750 7fc7761dc700 1 -- 172.21.15.79:0/2931993360 shutdown_connections 2021-04-09T18:31:16.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.750 7fc7761dc700 1 --2- 172.21.15.79:0/2931993360 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc754029100 0x7fc75402b650 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.750 7fc7761dc700 1 --2- 172.21.15.79:0/2931993360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7700a9990 0x7fc7700a86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.750 7fc7761dc700 1 --2- 172.21.15.79:0/2931993360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7700c0cf0 0x7fc7700c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.750 7fc7761dc700 1 --2- 172.21.15.79:0/2931993360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7701d2a90 0x7fc7701d2ee0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.750 7fc7761dc700 1 -- 172.21.15.79:0/2931993360 >> 172.21.15.79:0/2931993360 conn(0x7fc7700d8b80 msgr2=0x7fc7700973f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:16.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.750 7fc7761dc700 1 -- 172.21.15.79:0/2931993360 shutdown_connections 2021-04-09T18:31:16.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.750 7fc7761dc700 1 -- 172.21.15.79:0/2931993360 wait complete. 2021-04-09T18:31:16.760 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:31:16.762 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:16.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.850 7ffa1b741700 1 Processor -- start 2021-04-09T18:31:16.922 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.850 7ffa1b741700 1 -- start start 2021-04-09T18:31:16.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.850 7ffa1b741700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa140e9ad0 0x7ffa1409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa1b741700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa140fbb10 con 0x7ffa141c8000 2021-04-09T18:31:16.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa1b741700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa140e56c0 con 0x7ffa140f5510 2021-04-09T18:31:16.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa1b741700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa141c3db0 con 0x7ffa140e9ad0 2021-04-09T18:31:16.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa19ce6700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ffa141c8000 0x7ffa141ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53340/0 (socket says 172.21.15.79:53340) 2021-04-09T18:31:16.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa19ce6700 1 -- 172.21.15.79:0/2389929697 learned_addr learned my addr 172.21.15.79:0/2389929697 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:16.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa18ce4700 1 --2- 172.21.15.79:0/2389929697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa140e9ad0 0x7ffa1409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa0bfff700 1 -- 172.21.15.79:0/2389929697 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443169428 0 0) 0x7ffa0c001450 con 0x7ffa141c8000 2021-04-09T18:31:16.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa0bfff700 1 -- 172.21.15.79:0/2389929697 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa00003240 con 0x7ffa141c8000 2021-04-09T18:31:16.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa0bfff700 1 -- 172.21.15.79:0/2389929697 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474773849 0 0) 0x7ffa100010d0 con 0x7ffa140f5510 2021-04-09T18:31:16.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa18ce4700 1 -- 172.21.15.79:0/2389929697 >> v1:172.21.15.89:6789/0 conn(0x7ffa140f5510 legacy=0x7ffa140f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa18ce4700 1 -- 172.21.15.79:0/2389929697 >> v1:172.21.15.79:6789/0 conn(0x7ffa141c8000 legacy=0x7ffa141ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa18ce4700 1 -- 172.21.15.79:0/2389929697 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa140e4320 con 0x7ffa140e9ad0 2021-04-09T18:31:16.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa18ce4700 1 --2- 172.21.15.79:0/2389929697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa140e9ad0 0x7ffa1409f100 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ffa0c002170 tx=0x7ffa0400bcf0).ready entity=mon.2 client_cookie=3392e5af93ffeb6e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:16.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa0bfff700 1 -- 172.21.15.79:0/2389929697 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffa140e4320 con 0x7ffa140e9ad0 2021-04-09T18:31:16.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa0bfff700 1 -- 172.21.15.79:0/2389929697 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa040096c0 con 0x7ffa140e9ad0 2021-04-09T18:31:16.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa0bfff700 1 -- 172.21.15.79:0/2389929697 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffa0c001f30 con 0x7ffa140e9ad0 2021-04-09T18:31:16.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa1b741700 1 -- 172.21.15.79:0/2389929697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa140e9ad0 msgr2=0x7ffa1409f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa1b741700 1 --2- 172.21.15.79:0/2389929697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa140e9ad0 0x7ffa1409f100 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ffa0c002170 tx=0x7ffa0400bcf0).stop 2021-04-09T18:31:16.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa1b741700 1 -- 172.21.15.79:0/2389929697 shutdown_connections 2021-04-09T18:31:16.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa1b741700 1 --2- 172.21.15.79:0/2389929697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa140e9ad0 0x7ffa1409f100 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa1b741700 1 -- 172.21.15.79:0/2389929697 >> 172.21.15.79:0/2389929697 conn(0x7ffa140e5fd0 msgr2=0x7ffa140e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:16.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa1b741700 1 -- 172.21.15.79:0/2389929697 shutdown_connections 2021-04-09T18:31:16.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.854 7ffa1b741700 1 -- 172.21.15.79:0/2389929697 wait complete. 2021-04-09T18:31:16.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.858 7ffa1b741700 1 Processor -- start 2021-04-09T18:31:16.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.858 7ffa1b741700 1 -- start start 2021-04-09T18:31:16.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.858 7ffa1b741700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa1409a320 0x7ffa14099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.858 7ffa1b741700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa141aa030 0x7ffa140d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.858 7ffa1b741700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa141aa480 0x7ffa140cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.858 7ffa1b741700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa140e9f20 con 0x7ffa141aa030 2021-04-09T18:31:16.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.858 7ffa1b741700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1409aa70 con 0x7ffa1409a320 2021-04-09T18:31:16.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.858 7ffa1b741700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa140b9450 con 0x7ffa141aa480 2021-04-09T18:31:16.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.858 7ffa18ce4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa141aa030 0x7ffa140d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.858 7ffa18ce4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa141aa030 0x7ffa140d0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58634/0 (socket says 172.21.15.79:58634) 2021-04-09T18:31:16.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.858 7ffa18ce4700 1 -- 172.21.15.79:0/411310127 learned_addr learned my addr 172.21.15.79:0/411310127 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:16.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.858 7ffa19ce6700 1 --2- 172.21.15.79:0/411310127 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa141aa480 0x7ffa140cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.858 7ffa194e5700 1 --2- 172.21.15.79:0/411310127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa1409a320 0x7ffa14099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.858 7ffa18ce4700 1 -- 172.21.15.79:0/411310127 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa141aa480 msgr2=0x7ffa140cffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.858 7ffa18ce4700 1 --2- 172.21.15.79:0/411310127 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa141aa480 0x7ffa140cffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.858 7ffa18ce4700 1 -- 172.21.15.79:0/411310127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa1409a320 msgr2=0x7ffa14099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:16.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.858 7ffa18ce4700 1 --2- 172.21.15.79:0/411310127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa1409a320 0x7ffa14099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:16.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.858 7ffa18ce4700 1 -- 172.21.15.79:0/411310127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa140d14c0 con 0x7ffa141aa030 2021-04-09T18:31:16.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.862 7ffa18ce4700 1 --2- 172.21.15.79:0/411310127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa141aa030 0x7ffa140d0e90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7ffa1409a290 tx=0x7ffa04006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:16.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.862 7ffa09ffb700 1 -- 172.21.15.79:0/411310127 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffa140d14c0 con 0x7ffa141aa030 2021-04-09T18:31:16.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.862 7ffa09ffb700 1 -- 172.21.15.79:0/411310127 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0401e400 con 0x7ffa141aa030 2021-04-09T18:31:16.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.862 7ffa1b741700 1 -- 172.21.15.79:0/411310127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa140d18d0 con 0x7ffa141aa030 2021-04-09T18:31:16.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.862 7ffa09ffb700 1 -- 172.21.15.79:0/411310127 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffa0401e7d0 con 0x7ffa141aa030 2021-04-09T18:31:16.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.862 7ffa1b741700 1 -- 172.21.15.79:0/411310127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa140d0800 con 0x7ffa141aa030 2021-04-09T18:31:16.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.862 7ffa09ffb700 1 -- 172.21.15.79:0/411310127 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ffa040113c0 con 0x7ffa141aa030 2021-04-09T18:31:16.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.862 7ffa09ffb700 1 --2- 172.21.15.79:0/411310127 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff9f4029100 0x7ff9f402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:16.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.862 7ffa09ffb700 1 -- 172.21.15.79:0/411310127 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6053+0+0 (secure 0 0 0) 0x7ffa0403b420 con 0x7ffa141aa030 2021-04-09T18:31:16.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.862 7ffa194e5700 1 --2- 172.21.15.79:0/411310127 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff9f4029100 0x7ff9f402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:16.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.862 7ffa194e5700 1 --2- 172.21.15.79:0/411310127 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff9f4029100 0x7ff9f402b650 crc :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:16.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.866 7ffa1b741700 1 -- 172.21.15.79:0/411310127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa140e39d0 con 0x7ffa141aa030 2021-04-09T18:31:16.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:16.870 7ffa09ffb700 1 -- 172.21.15.79:0/411310127 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ffa04013c50 con 0x7ffa141aa030 2021-04-09T18:31:17.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:17.038 7ffa1b741700 1 -- 172.21.15.79:0/411310127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa140a1cb0 con 0x7ffa141aa030 2021-04-09T18:31:17.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:17.038 7ffa09ffb700 1 -- 172.21.15.79:0/411310127 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2102 (secure 0 0 0) 0x7ffa040094b0 con 0x7ffa141aa030 2021-04-09T18:31:17.040 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 26 2021-04-09T18:31:17.040 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:17.041 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3328659942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3328659942},{"type":"v1","addr":"172.21.15.79:6833","nonce":3328659942}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:29:53.022273","modified":"2021-04-09 18:29:55.034774","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":50,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5111":{"gid":5111,"name":"b","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/1280399112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1280399112},{"type":"v1","addr":"172.21.15.89:6835","nonce":1280399112}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-04-09T18:31:17.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:17.038 7ffa1b741700 1 -- 172.21.15.79:0/411310127 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff9f4029100 msgr2=0x7ff9f402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:17.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:17.038 7ffa1b741700 1 --2- 172.21.15.79:0/411310127 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff9f4029100 0x7ff9f402b650 crc :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:17.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:17.038 7ffa1b741700 1 -- 172.21.15.79:0/411310127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa141aa030 msgr2=0x7ffa140d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:17.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:17.038 7ffa1b741700 1 --2- 172.21.15.79:0/411310127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa141aa030 0x7ffa140d0e90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7ffa1409a290 tx=0x7ffa04006890).stop 2021-04-09T18:31:17.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:17.038 7ffa1b741700 1 -- 172.21.15.79:0/411310127 shutdown_connections 2021-04-09T18:31:17.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:17.038 7ffa1b741700 1 --2- 172.21.15.79:0/411310127 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff9f4029100 0x7ff9f402b650 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:17.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:17.038 7ffa1b741700 1 --2- 172.21.15.79:0/411310127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa1409a320 0x7ffa14099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:17.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:17.038 7ffa1b741700 1 --2- 172.21.15.79:0/411310127 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa141aa480 0x7ffa140cffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:17.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:17.038 7ffa1b741700 1 --2- 172.21.15.79:0/411310127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa141aa030 0x7ffa140d0e90 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:17.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:17.038 7ffa1b741700 1 -- 172.21.15.79:0/411310127 >> 172.21.15.79:0/411310127 conn(0x7ffa14093930 msgr2=0x7ffa14092dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:17.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:17.038 7ffa1b741700 1 -- 172.21.15.79:0/411310127 shutdown_connections 2021-04-09T18:31:17.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:17.038 7ffa1b741700 1 -- 172.21.15.79:0/411310127 wait complete. 2021-04-09T18:31:17.259 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:29:53.022273', 'modified': '2021-04-09 18:29:55.034774', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 50, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5111}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5111': {'gid': 5111, 'name': 'b', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6835/1280399112', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 1280399112}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 1280399112}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:31:17.260 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:31:17.261 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2021-04-09T18:31:17.356 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:31:17.357 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:31:17.357 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2021-04-09T18:31:17.357 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 5111, 2021-04-09T18:31:17.357 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2021-04-09T18:31:17.358 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2021-04-09T18:31:17.358 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 83.320893420999994, 2021-04-09T18:31:17.358 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 26, 2021-04-09T18:31:17.358 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 51, 2021-04-09T18:31:17.358 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 51, 2021-04-09T18:31:17.359 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 87.936492204000004 2021-04-09T18:31:17.359 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:31:17.362 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 5111, "want_state": "up:active", "state": "up:active", "rank_uptime": 83.320893420999994, "mdsmap_epoch": 26, "osdmap_epoch": 51, "osdmap_epoch_barrier": 51, "uptime": 87.936492204000004 } 2021-04-09T18:31:17.363 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:31:17.363 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-04-09T18:31:17.364 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi090.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-04-09T18:31:17.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:17.365 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:31:17.374 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:31:17.435 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:31:17.436 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:31:17.495 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:31:17.496 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:31:17.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:17.499 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:31:17.546 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:31:17.547 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:31:17.590 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:31:17.606 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:31:17.607 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:31:17.661 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:31:17.662 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:31:17.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:17.663 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:31:17.665 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:2021-04-09 18:31:17.668 7f588fac00c0 -1 init, newargv = 0x55968e7189c0 newargc=9ceph-fuse[13434]: starting ceph client 2021-04-09T18:31:17.666 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr: 2021-04-09T18:31:17.747 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13434]: starting fuse 2021-04-09T18:31:18.772 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:31:18.787 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:31:18.788 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:31:18.847 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:31:18.847 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:31:18.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:18.849 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:31:18.899 INFO:teuthology.orchestra.run.smithi090.stdout:49 2021-04-09T18:31:18.899 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:31:18.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:18.900 DEBUG:teuthology.orchestra.run.smithi090:> sudo python3 -c ' 2021-04-09T18:31:18.901 DEBUG:teuthology.orchestra.run.smithi090:> import glob 2021-04-09T18:31:18.901 DEBUG:teuthology.orchestra.run.smithi090:> import re 2021-04-09T18:31:18.901 DEBUG:teuthology.orchestra.run.smithi090:> import os 2021-04-09T18:31:18.902 DEBUG:teuthology.orchestra.run.smithi090:> import subprocess 2021-04-09T18:31:18.902 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:31:18.903 DEBUG:teuthology.orchestra.run.smithi090:> def find_socket(client_name): 2021-04-09T18:31:18.903 DEBUG:teuthology.orchestra.run.smithi090:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-04-09T18:31:18.904 DEBUG:teuthology.orchestra.run.smithi090:> files = glob.glob(asok_path) 2021-04-09T18:31:18.904 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:31:18.904 DEBUG:teuthology.orchestra.run.smithi090:> # Given a non-glob path, it better be there 2021-04-09T18:31:18.905 DEBUG:teuthology.orchestra.run.smithi090:> if "*" not in asok_path: 2021-04-09T18:31:18.905 DEBUG:teuthology.orchestra.run.smithi090:> assert(len(files) == 1) 2021-04-09T18:31:18.906 DEBUG:teuthology.orchestra.run.smithi090:> return files[0] 2021-04-09T18:31:18.906 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:31:18.906 DEBUG:teuthology.orchestra.run.smithi090:> for f in files: 2021-04-09T18:31:18.907 DEBUG:teuthology.orchestra.run.smithi090:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:31:18.907 DEBUG:teuthology.orchestra.run.smithi090:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:31:18.908 DEBUG:teuthology.orchestra.run.smithi090:> return f 2021-04-09T18:31:18.908 DEBUG:teuthology.orchestra.run.smithi090:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:31:18.908 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:31:18.909 DEBUG:teuthology.orchestra.run.smithi090:> print(find_socket("client.0")) 2021-04-09T18:31:18.909 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:31:18.988 INFO:teuthology.orchestra.run.smithi090.stdout:/var/run/ceph/ceph-client.0.13434.asok 2021-04-09T18:31:18.992 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13434.asok 2021-04-09T18:31:18.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:18.993 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13434.asok status 2021-04-09T18:31:19.065 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2021-04-09T18:31:19.066 INFO:teuthology.orchestra.run.smithi090.stdout: "metadata": { 2021-04-09T18:31:19.066 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:31:19.066 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:31:19.067 INFO:teuthology.orchestra.run.smithi090.stdout: "entity_id": "0", 2021-04-09T18:31:19.067 INFO:teuthology.orchestra.run.smithi090.stdout: "hostname": "smithi090", 2021-04-09T18:31:19.067 INFO:teuthology.orchestra.run.smithi090.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-04-09T18:31:19.067 INFO:teuthology.orchestra.run.smithi090.stdout: "pid": "13434", 2021-04-09T18:31:19.068 INFO:teuthology.orchestra.run.smithi090.stdout: "root": "/" 2021-04-09T18:31:19.068 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:31:19.068 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_count": 0, 2021-04-09T18:31:19.068 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_pinned_count": 0, 2021-04-09T18:31:19.069 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 5748, 2021-04-09T18:31:19.069 INFO:teuthology.orchestra.run.smithi090.stdout: "inst": { 2021-04-09T18:31:19.069 INFO:teuthology.orchestra.run.smithi090.stdout: "name": { 2021-04-09T18:31:19.069 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "client", 2021-04-09T18:31:19.069 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5748 2021-04-09T18:31:19.070 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:31:19.070 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:31:19.070 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:31:19.070 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:31:19.071 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 1237493734 2021-04-09T18:31:19.071 INFO:teuthology.orchestra.run.smithi090.stdout: } 2021-04-09T18:31:19.071 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:31:19.071 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:31:19.072 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:31:19.072 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:31:19.072 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 1237493734 2021-04-09T18:31:19.072 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:31:19.073 INFO:teuthology.orchestra.run.smithi090.stdout: "inst_str": "client.5748 172.21.15.90:0/1237493734", 2021-04-09T18:31:19.073 INFO:teuthology.orchestra.run.smithi090.stdout: "addr_str": "172.21.15.90:0/1237493734", 2021-04-09T18:31:19.073 INFO:teuthology.orchestra.run.smithi090.stdout: "inode_count": 1, 2021-04-09T18:31:19.074 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_epoch": 27, 2021-04-09T18:31:19.074 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch": 51, 2021-04-09T18:31:19.074 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:31:19.074 INFO:teuthology.orchestra.run.smithi090.stdout: "blacklisted": false, 2021-04-09T18:31:19.075 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs" 2021-04-09T18:31:19.075 INFO:teuthology.orchestra.run.smithi090.stdout:} 2021-04-09T18:31:19.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:19.077 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:31:19.077 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:31:19.084 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:31:19.085 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:31:19.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:19.086 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:31:19.146 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:31:19.147 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:31:19.166 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:31:19.187 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:31:19.205 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:31:19.224 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:31:19.244 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:31:19.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:19.245 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:31:19.245 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:31:19.255 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:31:19.256 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:31:19.257 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi090.front.sepia.ceph.com... 2021-04-09T18:31:19.257 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:31:19.258 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:31:19.333 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13434]: fuse finished with error 0 and tester_r 0 2021-04-09T18:31:19.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:19.335 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:31:19.336 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:31:19.382 INFO:teuthology.orchestra.run.smithi090.stdout:ext2/ext3 2021-04-09T18:31:19.384 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:31:19.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:31:19.460 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:31:19.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:19.467 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:31:19.468 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:31:19.475 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-04-09T18:31:19.475 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:31:19.476 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-04-09T18:31:19.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:31:19.477 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:31:19.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:19.526 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:31:19.526 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:31:19.533 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:31:19.534 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:31:19.535 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:31:19.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:31:19.536 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:31:19.583 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:31:19.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bfd3fd700 1 Processor -- start 2021-04-09T18:31:19.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bfd3fd700 1 -- start start 2021-04-09T18:31:19.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bfd3fd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bf81c9020 0x7f8bf81cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:19.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bfd3fd700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf80fbb20 con 0x7f8bf80e9ae0 2021-04-09T18:31:19.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bfd3fd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf809f910 con 0x7f8bf80f5520 2021-04-09T18:31:19.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bfd3fd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf81c3dc0 con 0x7f8bf81c9020 2021-04-09T18:31:19.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6804700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8bf80e9ae0 0x7f8bf809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53350/0 (socket says 172.21.15.79:53350) 2021-04-09T18:31:19.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6804700 1 -- 172.21.15.79:0/3716399430 learned_addr learned my addr 172.21.15.79:0/3716399430 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:19.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf7806700 1 --2- 172.21.15.79:0/3716399430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bf81c9020 0x7f8bf81cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:19.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6003700 1 -- 172.21.15.79:0/3716399430 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833677780 0 0) 0x7f8be00010d0 con 0x7f8bf80e9ae0 2021-04-09T18:31:19.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6003700 1 -- 172.21.15.79:0/3716399430 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8be4003240 con 0x7f8bf80e9ae0 2021-04-09T18:31:19.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6003700 1 -- 172.21.15.79:0/3716399430 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1405290624 0 0) 0x7f8be0001650 con 0x7f8bf80e9ae0 2021-04-09T18:31:19.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6003700 1 -- 172.21.15.79:0/3716399430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bf81c9020 msgr2=0x7f8bf81cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:19.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6003700 1 --2- 172.21.15.79:0/3716399430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bf81c9020 0x7f8bf81cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:19.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6003700 1 -- 172.21.15.79:0/3716399430 >> v1:172.21.15.89:6789/0 conn(0x7f8bf80f5520 legacy=0x7f8bf80f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:19.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6003700 1 -- 172.21.15.79:0/3716399430 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf80e56d0 con 0x7f8bf80e9ae0 2021-04-09T18:31:19.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6003700 1 -- 172.21.15.79:0/3716399430 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f8be0001bb0 con 0x7f8bf80e9ae0 2021-04-09T18:31:19.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6003700 1 -- 172.21.15.79:0/3716399430 >> v1:172.21.15.79:6789/0 conn(0x7f8bf80e9ae0 legacy=0x7f8bf809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:19.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6003700 1 --2- 172.21.15.79:0/3716399430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8be40038f0 0x7f8be4003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:19.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6003700 1 --2- 172.21.15.79:0/3716399430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8be40045a0 0x7f8be40049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:19.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6003700 1 --2- 172.21.15.79:0/3716399430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8be40097e0 0x7f8be400bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:19.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6003700 1 -- 172.21.15.79:0/3716399430 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf81c3dc0 con 0x7f8be40045a0 2021-04-09T18:31:19.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6003700 1 -- 172.21.15.79:0/3716399430 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be40051d0 con 0x7f8be40038f0 2021-04-09T18:31:19.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6804700 1 --2- 172.21.15.79:0/3716399430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8be40045a0 0x7f8be40049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:19.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6003700 1 -- 172.21.15.79:0/3716399430 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be40053d0 con 0x7f8be40097e0 2021-04-09T18:31:19.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf7806700 1 --2- 172.21.15.79:0/3716399430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8be40097e0 0x7f8be400bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:19.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf7005700 1 --2- 172.21.15.79:0/3716399430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8be40038f0 0x7f8be4003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:19.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6804700 1 -- 172.21.15.79:0/3716399430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8be40097e0 msgr2=0x7f8be400bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:19.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6804700 1 --2- 172.21.15.79:0/3716399430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8be40097e0 0x7f8be400bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:19.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6804700 1 -- 172.21.15.79:0/3716399430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8be40038f0 msgr2=0x7f8be4003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:19.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6804700 1 --2- 172.21.15.79:0/3716399430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8be40038f0 0x7f8be4003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:19.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6804700 1 -- 172.21.15.79:0/3716399430 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be4050390 con 0x7f8be40045a0 2021-04-09T18:31:19.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.685 7f8bf6804700 1 --2- 172.21.15.79:0/3716399430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8be40045a0 0x7f8be40049f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f8be0001000 tx=0x7f8be000cc70).ready entity=mon.0 client_cookie=a86caaa74abf8339 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:19.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.689 7f8bf6003700 1 -- 172.21.15.79:0/3716399430 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8be4050390 con 0x7f8be40045a0 2021-04-09T18:31:19.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.689 7f8bf6003700 1 -- 172.21.15.79:0/3716399430 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be0007110 con 0x7f8be40045a0 2021-04-09T18:31:19.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.689 7f8bf6003700 1 -- 172.21.15.79:0/3716399430 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8bf80e56d0 con 0x7f8be40045a0 2021-04-09T18:31:19.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.689 7f8bfd3fd700 1 -- 172.21.15.79:0/3716399430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8be40045a0 msgr2=0x7f8be40049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:19.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.689 7f8bfd3fd700 1 --2- 172.21.15.79:0/3716399430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8be40045a0 0x7f8be40049f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f8be0001000 tx=0x7f8be000cc70).stop 2021-04-09T18:31:19.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.689 7f8bf7806700 1 -- 172.21.15.79:0/3716399430 reap_dead start 2021-04-09T18:31:19.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.689 7f8bfd3fd700 1 -- 172.21.15.79:0/3716399430 shutdown_connections 2021-04-09T18:31:19.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.689 7f8bfd3fd700 1 -- 172.21.15.79:0/3716399430 >> 172.21.15.79:0/3716399430 conn(0x7f8bf80e5fe0 msgr2=0x7f8bf80e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:19.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.689 7f8bfd3fd700 1 -- 172.21.15.79:0/3716399430 shutdown_connections 2021-04-09T18:31:19.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.689 7f8bfd3fd700 1 -- 172.21.15.79:0/3716399430 wait complete. 2021-04-09T18:31:19.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bfd3fd700 1 Processor -- start 2021-04-09T18:31:19.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bfd3fd700 1 -- start start 2021-04-09T18:31:19.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bfd3fd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bf80c3750 0x7f8bf819d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:19.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bfd3fd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bf80afdc0 0x7f8bf80b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:19.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bfd3fd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bf80c5a20 0x7f8bf80c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:19.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bfd3fd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf80e9f30 con 0x7f8bf80c3750 2021-04-09T18:31:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bfd3fd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf819bec0 con 0x7f8bf80afdc0 2021-04-09T18:31:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bfd3fd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf80c3ba0 con 0x7f8bf80c5a20 2021-04-09T18:31:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bf7005700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bf80c3750 0x7f8bf819d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bf7005700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bf80c3750 0x7f8bf819d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58652/0 (socket says 172.21.15.79:58652) 2021-04-09T18:31:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bf6804700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bf80afdc0 0x7f8bf80b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:19.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bf7005700 1 -- 172.21.15.79:0/856694136 learned_addr learned my addr 172.21.15.79:0/856694136 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:19.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bf7806700 1 --2- 172.21.15.79:0/856694136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bf80c5a20 0x7f8bf80c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:19.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bf7005700 1 -- 172.21.15.79:0/856694136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bf80c5a20 msgr2=0x7f8bf80c5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:19.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bf7005700 1 --2- 172.21.15.79:0/856694136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bf80c5a20 0x7f8bf80c5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:19.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bf7005700 1 -- 172.21.15.79:0/856694136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bf80afdc0 msgr2=0x7f8bf80b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:19.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bf7005700 1 --2- 172.21.15.79:0/856694136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bf80afdc0 0x7f8bf80b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:19.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bf7005700 1 -- 172.21.15.79:0/856694136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf80c4370 con 0x7f8bf80c3750 2021-04-09T18:31:19.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bf6804700 1 --2- 172.21.15.79:0/856694136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bf80afdc0 0x7f8bf80b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:19.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bf7806700 1 --2- 172.21.15.79:0/856694136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bf80c5a20 0x7f8bf80c5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:19.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bf7005700 1 --2- 172.21.15.79:0/856694136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bf80c3750 0x7f8bf819d440 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f8bf80a7f00 tx=0x7f8be800c3c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:19.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8beffff700 1 -- 172.21.15.79:0/856694136 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8bf80c4370 con 0x7f8bf80c3750 2021-04-09T18:31:19.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8beffff700 1 -- 172.21.15.79:0/856694136 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be800cd50 con 0x7f8bf80c3750 2021-04-09T18:31:19.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8beffff700 1 -- 172.21.15.79:0/856694136 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8be8010040 con 0x7f8bf80c3750 2021-04-09T18:31:19.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bfd3fd700 1 -- 172.21.15.79:0/856694136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf80b0840 con 0x7f8bf80c3750 2021-04-09T18:31:19.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.693 7f8bfd3fd700 1 -- 172.21.15.79:0/856694136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf80bb1e0 con 0x7f8bf80c3750 2021-04-09T18:31:19.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.697 7f8beffff700 1 -- 172.21.15.79:0/856694136 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8be8013610 con 0x7f8bf80c3750 2021-04-09T18:31:19.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.697 7f8beffff700 1 --2- 172.21.15.79:0/856694136 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8bdc029100 0x7f8bdc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:19.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.697 7f8beffff700 1 -- 172.21.15.79:0/856694136 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f8be8011070 con 0x7f8bf80c3750 2021-04-09T18:31:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.697 7f8bf6804700 1 --2- 172.21.15.79:0/856694136 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8bdc029100 0x7f8bdc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.697 7f8bf6804700 1 --2- 172.21.15.79:0/856694136 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8bdc029100 0x7f8bdc02b650 crc :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.697 7f8bfd3fd700 1 -- 172.21.15.79:0/856694136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf80e39e0 con 0x7f8bf80c3750 2021-04-09T18:31:19.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.709 7f8beffff700 1 -- 172.21.15.79:0/856694136 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8bf8107f50 con 0x7f8bf80c3750 2021-04-09T18:31:19.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.877 7f8bfd3fd700 1 -- 172.21.15.79:0/856694136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8bf80a1cc0 con 0x7f8bf80c3750 2021-04-09T18:31:19.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.881 7f8beffff700 1 -- 172.21.15.79:0/856694136 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v51) v1 ==== 81+0+30961 (secure 0 0 0) 0x7f8be800c950 con 0x7f8bf80c3750 2021-04-09T18:31:19.880 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:19.881 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:31:19.881 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 51, 2021-04-09T18:31:19.882 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:31:19.882 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:31:19.883 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:31:15.092542", 2021-04-09T18:31:19.883 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:31:19.883 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:31:19.884 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:31:19.884 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:31:19.885 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:31:19.885 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:31:19.886 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:31:19.886 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:31:19.886 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:31:19.887 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:31:19.887 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:31:19.888 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:31:19.888 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:31:19.889 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:31:19.889 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:31:19.889 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 9, 2021-04-09T18:31:19.890 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:31:19.890 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:31:19.891 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:31:19.891 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:31:19.892 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:31:19.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.892 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:31:19.893 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:31:19.893 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:31:19.894 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:31:19.894 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:31:19.895 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:31:19.895 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:31:19.895 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:31:19.896 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:31:19.896 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:31:19.897 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:31:19.897 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:31:19.897 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:31:19.898 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:31:19.898 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:31:19.899 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:31:19.899 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:31:19.900 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:31:19.900 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:31:19.901 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:31:19.901 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:31:19.901 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:31:19.902 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:31:19.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.903 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:31:19.903 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:31:19.903 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:31:19.904 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:31:19.904 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:31:19.905 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:31:19.905 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:31:19.905 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:31:19.905 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:31:19.906 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:31:19.906 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:31:19.906 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:31:19.907 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:31:19.907 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:31:19.907 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:31:19.907 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:31:19.908 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:31:19.908 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:31:19.908 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:31:19.908 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:31:19.908 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:31:19.909 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:31:19.909 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:31:19.909 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:31:19.909 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:31:19.910 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:31:19.910 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:31:19.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.910 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:31:19.910 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:31:19.911 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:31:19.911 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:31:19.911 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:31:19.911 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:31:19.911 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:31:19.912 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:31:19.912 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:31:19.912 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:31:19.912 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:31:19.913 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:31:19.913 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:31:19.913 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:31:19.913 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:19.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.914 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 8, 2021-04-09T18:31:19.914 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2021-04-09T18:31:19.914 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:29:51.239559", 2021-04-09T18:31:19.915 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:31:19.915 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:31:19.915 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:31:19.915 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:31:19.916 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:31:19.916 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:31:19.916 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:31:19.916 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:31:19.916 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:31:19.917 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:31:19.917 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:31:19.917 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:31:19.918 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:31:19.918 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:31:19.918 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:31:19.918 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:31:19.919 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:31:19.919 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:31:19.919 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:31:19.920 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:31:19.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.920 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "48", 2021-04-09T18:31:19.920 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:31:19.920 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:31:19.921 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:31:19.921 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:31:19.921 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:31:19.921 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:31:19.922 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:31:19.922 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:31:19.922 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:31:19.922 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:31:19.922 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:31:19.923 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:31:19.923 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:31:19.923 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:31:19.923 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:31:19.923 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:31:19.924 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:31:19.924 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:31:19.924 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:31:19.924 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:31:19.925 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:31:19.925 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:31:19.925 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:31:19.925 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:31:19.925 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:31:19.926 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:31:19.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.926 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:31:19.926 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:31:19.926 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:31:19.927 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:31:19.927 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:31:19.927 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:31:19.927 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:31:19.928 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:31:19.928 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:31:19.928 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:31:19.928 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:31:19.929 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2021-04-09T18:31:19.929 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2021-04-09T18:31:19.929 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2021-04-09T18:31:19.929 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2021-04-09T18:31:19.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.930 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:31:19.930 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:31:19.930 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2021-04-09T18:31:19.930 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:19.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:19.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.931 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 9, 2021-04-09T18:31:19.932 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2021-04-09T18:31:19.932 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:29:52.114936", 2021-04-09T18:31:19.932 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:31:19.932 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:31:19.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:31:19.933 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:31:19.933 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:31:19.933 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:31:19.933 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:31:19.934 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:31:19.934 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:31:19.934 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:31:19.934 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:31:19.935 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:31:19.935 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:31:19.935 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:31:19.935 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:31:19.936 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:31:19.936 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:31:19.936 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:31:19.936 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:31:19.936 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:31:19.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.937 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "49", 2021-04-09T18:31:19.937 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:31:19.937 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:31:19.937 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:31:19.938 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:31:19.938 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:31:19.938 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:31:19.939 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:31:19.939 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:31:19.939 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:31:19.939 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:31:19.940 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:31:19.940 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:31:19.941 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:31:19.941 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:31:19.941 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:31:19.942 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:31:19.942 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:31:19.943 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:31:19.943 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:31:19.943 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:31:19.944 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:31:19.944 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:31:19.945 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:31:19.945 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:31:19.945 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:31:19.946 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:31:19.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.947 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:31:19.947 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:31:19.947 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:31:19.948 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:31:19.948 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:31:19.949 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:31:19.949 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:31:19.949 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:31:19.950 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:31:19.950 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:31:19.951 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:31:19.951 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:31:19.952 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:31:19.952 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:31:19.952 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2021-04-09T18:31:19.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:19.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:19.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:19.954 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:31:19.954 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:31:19.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.955 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:31:19.956 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:31:19.956 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:31:19.956 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:31:19.957 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:31:19.957 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:31:19.958 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:31:19.958 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:31:19.959 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:31:19.959 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 47, 2021-04-09T18:31:19.959 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:31:19.960 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:31:19.960 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:31:19.961 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:19.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.961 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:19.962 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:31:19.962 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:31:19.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.963 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:19.963 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:31:19.964 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:31:19.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:19.964 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:31:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:19.966 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:31:19.966 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:31:19.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.967 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:19.967 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:31:19.967 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:31:19.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:19.967 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:19.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.968 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:31:19.968 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:19.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.968 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:31:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:31:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:19.970 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:31:19.970 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:31:19.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:19.970 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:19.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.971 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:31:19.971 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:19.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.971 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:31:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:31:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:31:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:31:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.974 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:31:19.974 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:31:19.974 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:31:19.974 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:31:19.974 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:31:19.975 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:31:19.975 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:31:19.975 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:19.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.976 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:31:19.976 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:31:19.976 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:31:19.976 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:31:19.977 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:31:19.977 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:31:19.977 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:31:19.977 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:31:19.977 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:31:19.978 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 47, 2021-04-09T18:31:19.978 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:31:19.978 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:31:19.978 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:31:19.978 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:19.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.979 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:19.979 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:31:19.979 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:31:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:31:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:31:19.981 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:19.981 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:19.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.981 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:31:19.981 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:19.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.982 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:19.982 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:31:19.982 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:31:19.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.983 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:19.983 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:31:19.983 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:31:19.983 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:19.984 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:19.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.984 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:31:19.984 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:31:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:31:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.986 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:19.986 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:31:19.986 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:31:19.986 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:31:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.988 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:19.988 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:31:19.988 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:31:19.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.989 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:19.989 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:31:19.989 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:31:19.989 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:19.990 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:19.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.990 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:31:19.990 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:31:19.990 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:31:19.991 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:31:19.991 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:31:19.991 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:31:19.991 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:31:19.991 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:19.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.992 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:31:19.992 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:31:19.992 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:31:19.993 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:31:19.993 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:31:19.993 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:31:19.993 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:31:19.994 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:31:19.994 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:31:19.994 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 29, 2021-04-09T18:31:19.994 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:31:19.994 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:31:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:31:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:31:19.996 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:31:19.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.996 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:19.996 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:31:19.997 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:31:19.997 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:19.997 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:19.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.997 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:31:19.998 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:19.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.998 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:19.998 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:31:19.999 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:31:19.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:19.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:19.999 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:19.999 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:31:20.000 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:31:20.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.000 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.000 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:31:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:31:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:31:20.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.002 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.002 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:31:20.002 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:31:20.003 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.003 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.003 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:31:20.004 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.004 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.004 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:31:20.004 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:31:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:31:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:31:20.006 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.006 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.006 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:31:20.006 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:31:20.007 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:31:20.007 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:31:20.007 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:31:20.007 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:31:20.007 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:31:20.008 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.008 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:31:20.009 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:31:20.009 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:31:20.009 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:31:20.009 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:31:20.009 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:31:20.010 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:31:20.010 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:31:20.010 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:31:20.010 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 47, 2021-04-09T18:31:20.010 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:31:20.011 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:31:20.011 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:31:20.011 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.011 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.012 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:31:20.012 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:31:20.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.013 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.013 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:31:20.013 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:31:20.013 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.013 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.014 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:31:20.014 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.014 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.015 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:31:20.015 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:31:20.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.016 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.016 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:31:20.016 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:31:20.016 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.016 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.017 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:31:20.017 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.017 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.018 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:31:20.018 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:31:20.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.018 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:31:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:31:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.020 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:31:20.020 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.020 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.021 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:31:20.021 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:31:20.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.021 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.022 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:31:20.022 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:31:20.022 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.022 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.023 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:31:20.023 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:31:20.023 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:31:20.023 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:31:20.023 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:31:20.024 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:31:20.024 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:31:20.024 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.025 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:31:20.025 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:31:20.025 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:31:20.025 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:31:20.026 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:31:20.026 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:31:20.026 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:31:20.026 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:31:20.026 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:31:20.027 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 46, 2021-04-09T18:31:20.027 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:31:20.027 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:31:20.027 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:31:20.027 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.028 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.028 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:31:20.028 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:31:20.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:31:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:31:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.030 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.030 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:31:20.030 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.031 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.031 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:31:20.031 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:31:20.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.032 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.032 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:31:20.032 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:31:20.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.033 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.033 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:31:20.033 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.034 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.034 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:31:20.034 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:31:20.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.035 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.035 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:31:20.035 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:31:20.035 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.036 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.036 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:31:20.036 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.037 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.037 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:31:20.037 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:31:20.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.038 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.038 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:31:20.038 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:31:20.038 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.038 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.039 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:31:20.039 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:31:20.039 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:31:20.040 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:31:20.040 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:31:20.040 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:31:20.040 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:31:20.040 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.041 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:31:20.041 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:31:20.041 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:31:20.042 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:31:20.042 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:31:20.042 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:31:20.042 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:31:20.043 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:31:20.043 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:31:20.043 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 47, 2021-04-09T18:31:20.043 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:31:20.043 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:31:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:31:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:31:20.045 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:31:20.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.045 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.045 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:31:20.046 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:31:20.046 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.046 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:31:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:31:20.048 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:31:20.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.048 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.048 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:31:20.049 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:31:20.049 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.049 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.049 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:31:20.050 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.050 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.050 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:31:20.050 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:31:20.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.051 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.051 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:31:20.052 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:31:20.052 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.052 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.052 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:31:20.053 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.053 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.053 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:31:20.053 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:31:20.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.054 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.054 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:31:20.054 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:31:20.055 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.055 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.055 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:31:20.056 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:31:20.056 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:31:20.056 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:31:20.056 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:31:20.056 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:31:20.057 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:31:20.057 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.057 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:31:20.058 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:31:20.058 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:31:20.058 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:31:20.058 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:31:20.058 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:31:20.059 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:31:20.059 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:31:20.059 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:31:20.059 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 46, 2021-04-09T18:31:20.059 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:31:20.060 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:31:20.060 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:31:20.060 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.061 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.061 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:31:20.061 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:31:20.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.062 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.062 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:31:20.062 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:31:20.062 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.062 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.063 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:31:20.063 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.064 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:31:20.064 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:31:20.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.064 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.065 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:31:20.065 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:31:20.065 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.065 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.066 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:31:20.066 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.066 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.067 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:31:20.067 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:31:20.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.067 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.068 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:31:20.068 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:31:20.068 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.068 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.069 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:31:20.069 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.069 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:31:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:31:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.071 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:31:20.071 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:31:20.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.071 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:31:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:31:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:31:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:31:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:31:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:31:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:31:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.074 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:31:20.074 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:31:20.074 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:31:20.074 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:31:20.075 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:31:20.075 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:31:20.075 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:31:20.075 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:31:20.075 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:31:20.076 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 47, 2021-04-09T18:31:20.076 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:31:20.076 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:31:20.076 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:31:20.076 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.077 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.077 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:31:20.077 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:31:20.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.078 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.078 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:31:20.078 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:31:20.079 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.079 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.079 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:31:20.079 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.080 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.080 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:31:20.080 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:31:20.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.081 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.081 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:31:20.081 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:31:20.081 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.082 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.082 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:31:20.082 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.083 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.083 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:31:20.083 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:31:20.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:31:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:31:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.085 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.085 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:31:20.085 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:20.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.086 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:20.086 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:31:20.086 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:31:20.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.087 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:20.087 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:31:20.087 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:31:20.087 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.088 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.088 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:31:20.088 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:31:20.088 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:31:20.089 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:31:20.089 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:31:20.089 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:31:20.089 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:31:20.089 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:20.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.090 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:31:20.090 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:31:20.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.091 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:31:20.091 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:31:20.091 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:31:20.091 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:31:20.091 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:31:20.092 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:31:20.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.092 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:31:20.092 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:31:20.093 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:31:20.093 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:31:20.093 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:31:20.093 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:31:20.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.094 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:31:20.094 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:31:20.094 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:31:20.095 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:31:20.095 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:31:20.095 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:31:20.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.096 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:31:20.096 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:31:20.096 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:31:20.096 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:31:20.096 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:31:20.097 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:31:20.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.097 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:31:20.097 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:31:20.098 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:31:20.098 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:31:20.098 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:31:20.098 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:31:20.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.099 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:31:20.099 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:31:20.099 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:31:20.100 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:31:20.100 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:31:20.100 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:31:20.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.101 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:31:20.101 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:31:20.101 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:31:20.101 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:31:20.101 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:31:20.102 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:31:20.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:20.102 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:31:20.102 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:31:20.103 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:31:20.103 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:31:20.103 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:31:20.103 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:31:20.104 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.104 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:31:20.104 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:31:20.104 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:31:20.104 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:31:20.105 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:31:20.105 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": { 2021-04-09T18:31:20.105 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.90:0/2690155541": "2021-04-09 19:31:14.431527", 2021-04-09T18:31:20.105 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6835/781814443": "2021-04-10 18:29:53.473795", 2021-04-09T18:31:20.105 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6834/781814443": "2021-04-10 18:29:53.473795" 2021-04-09T18:31:20.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.106 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:31:20.106 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:31:20.106 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:31:20.106 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:31:20.107 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:31:20.107 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:31:20.107 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:31:20.107 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:31:20.107 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:31:20.108 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:31:20.108 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:31:20.108 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:31:20.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.108 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:31:20.109 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:31:20.109 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:31:20.109 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:31:20.109 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:31:20.109 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:31:20.110 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:31:20.110 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:20.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:20.110 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:31:20.111 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:31:20.111 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:31:20.111 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:31:20.111 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:31:20.111 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:31:20.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.885 7f8bfd3fd700 1 -- 172.21.15.79:0/856694136 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8bdc029100 msgr2=0x7f8bdc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:20.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.885 7f8bfd3fd700 1 --2- 172.21.15.79:0/856694136 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8bdc029100 0x7f8bdc02b650 crc :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.885 7f8bfd3fd700 1 -- 172.21.15.79:0/856694136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bf80c3750 msgr2=0x7f8bf819d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:20.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.885 7f8bfd3fd700 1 --2- 172.21.15.79:0/856694136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bf80c3750 0x7f8bf819d440 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f8bf80a7f00 tx=0x7f8be800c3c0).stop 2021-04-09T18:31:20.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.885 7f8bfd3fd700 1 -- 172.21.15.79:0/856694136 shutdown_connections 2021-04-09T18:31:20.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.885 7f8bfd3fd700 1 --2- 172.21.15.79:0/856694136 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8bdc029100 0x7f8bdc02b650 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.885 7f8bfd3fd700 1 --2- 172.21.15.79:0/856694136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bf80c5a20 0x7f8bf80c5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.885 7f8bfd3fd700 1 --2- 172.21.15.79:0/856694136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bf80c3750 0x7f8bf819d440 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.885 7f8bfd3fd700 1 --2- 172.21.15.79:0/856694136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bf80afdc0 0x7f8bf80b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.885 7f8bfd3fd700 1 -- 172.21.15.79:0/856694136 >> 172.21.15.79:0/856694136 conn(0x7f8bf80d8700 msgr2=0x7f8bf809a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.885 7f8bfd3fd700 1 -- 172.21.15.79:0/856694136 shutdown_connections 2021-04-09T18:31:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:19.885 7f8bfd3fd700 1 -- 172.21.15.79:0/856694136 wait complete. 2021-04-09T18:31:20.117 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:20.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f7795812700 1 Processor -- start 2021-04-09T18:31:20.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f7795812700 1 -- start start 2021-04-09T18:31:20.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f7795812700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f77900f5510 0x7f77900f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:20.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f7795812700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77900e9ad0 0x7f779009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:20.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f7795812700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f77901c2da0 0x7f77901c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:20.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f7795812700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77900e9f20 con 0x7f77900f5510 2021-04-09T18:31:20.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f7795812700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77900e59c0 con 0x7f77901c2da0 2021-04-09T18:31:20.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f7795812700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77900fbb10 con 0x7f77900e9ad0 2021-04-09T18:31:20.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f778f550700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f77900f5510 0x7f77900f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:20.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f778f550700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f77900f5510 0x7f77900f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58660/0 (socket says 172.21.15.79:58660) 2021-04-09T18:31:20.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f778f550700 1 -- 172.21.15.79:0/9764442 learned_addr learned my addr 172.21.15.79:0/9764442 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:20.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f778fd51700 1 --2- 172.21.15.79:0/9764442 >> v2:172.21.15.89:3300/0 conn(0x7f77901c2da0 0x7f77901c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:20.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f778ed4f700 1 --2- 172.21.15.79:0/9764442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77900e9ad0 0x7f779009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:20.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f778f550700 1 -- 172.21.15.79:0/9764442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77900e9ad0 msgr2=0x7f779009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:20.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f778f550700 1 --2- 172.21.15.79:0/9764442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77900e9ad0 0x7f779009f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f778f550700 1 -- 172.21.15.79:0/9764442 >> v2:172.21.15.89:3300/0 conn(0x7f77901c2da0 msgr2=0x7f77901c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:20.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f778f550700 1 --2- 172.21.15.79:0/9764442 >> v2:172.21.15.89:3300/0 conn(0x7f77901c2da0 0x7f77901c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f778f550700 1 -- 172.21.15.79:0/9764442 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77900e56c0 con 0x7f77900f5510 2021-04-09T18:31:20.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f778f550700 1 --2- 172.21.15.79:0/9764442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77900f5510 0x7f77900f64a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f7780002f30 tx=0x7f778000bd70).ready entity=mon.0 client_cookie=6901bf6b3f76c9e2 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:20.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f778e54e700 1 -- 172.21.15.79:0/9764442 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f77900e56c0 con 0x7f77900f5510 2021-04-09T18:31:20.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f778e54e700 1 -- 172.21.15.79:0/9764442 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77800098b0 con 0x7f77900f5510 2021-04-09T18:31:20.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f778e54e700 1 -- 172.21.15.79:0/9764442 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7780009c80 con 0x7f77900f5510 2021-04-09T18:31:20.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f7795812700 1 -- 172.21.15.79:0/9764442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77900f5510 msgr2=0x7f77900f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:20.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.221 7f7795812700 1 --2- 172.21.15.79:0/9764442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77900f5510 0x7f77900f64a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f7780002f30 tx=0x7f778000bd70).stop 2021-04-09T18:31:20.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.225 7f7795812700 1 -- 172.21.15.79:0/9764442 shutdown_connections 2021-04-09T18:31:20.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.225 7f7795812700 1 --2- 172.21.15.79:0/9764442 >> v2:172.21.15.89:3300/0 conn(0x7f77901c2da0 0x7f77901c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.225 7f7795812700 1 --2- 172.21.15.79:0/9764442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77900f5510 0x7f77900f64a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.225 7f7795812700 1 --2- 172.21.15.79:0/9764442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77900e9ad0 0x7f779009f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.225 7f7795812700 1 -- 172.21.15.79:0/9764442 >> 172.21.15.79:0/9764442 conn(0x7f77900e5fd0 msgr2=0x7f77900e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:20.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.225 7f7795812700 1 -- 172.21.15.79:0/9764442 shutdown_connections 2021-04-09T18:31:20.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.225 7f7795812700 1 -- 172.21.15.79:0/9764442 wait complete. 2021-04-09T18:31:20.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.229 7f7795812700 1 Processor -- start 2021-04-09T18:31:20.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.229 7f7795812700 1 -- start start 2021-04-09T18:31:20.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.229 7f7795812700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77900ab670 0x7f77900ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:20.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.229 7f7795812700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77900bae50 0x7f77900ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:20.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.229 7f7795812700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7790096050 0x7f77900964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:20.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.229 7f7795812700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77900a8520 con 0x7f7790096050 2021-04-09T18:31:20.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.229 7f7795812700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77900bb2a0 con 0x7f77900ab670 2021-04-09T18:31:20.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.229 7f7795812700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77900a8820 con 0x7f77900bae50 2021-04-09T18:31:20.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.229 7f778fd51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7790096050 0x7f77900964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:20.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.229 7f778fd51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7790096050 0x7f77900964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58670/0 (socket says 172.21.15.79:58670) 2021-04-09T18:31:20.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.229 7f778fd51700 1 -- 172.21.15.79:0/3838436966 learned_addr learned my addr 172.21.15.79:0/3838436966 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:20.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.229 7f778f550700 1 --2- 172.21.15.79:0/3838436966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77900ab670 0x7f77900ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:20.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.229 7f778ed4f700 1 --2- 172.21.15.79:0/3838436966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77900bae50 0x7f77900ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:20.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.229 7f778fd51700 1 -- 172.21.15.79:0/3838436966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77900bae50 msgr2=0x7f77900ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:20.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.229 7f778fd51700 1 --2- 172.21.15.79:0/3838436966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77900bae50 0x7f77900ae630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.229 7f778fd51700 1 -- 172.21.15.79:0/3838436966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77900ab670 msgr2=0x7f77900ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:20.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.229 7f778fd51700 1 --2- 172.21.15.79:0/3838436966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77900ab670 0x7f77900ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.229 7f778fd51700 1 -- 172.21.15.79:0/3838436966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77901c0850 con 0x7f7790096050 2021-04-09T18:31:20.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.229 7f778fd51700 1 --2- 172.21.15.79:0/3838436966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7790096050 0x7f77900964a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f77900a84a0 tx=0x7f778800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:20.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.233 7f7777fff700 1 -- 172.21.15.79:0/3838436966 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f77901c0850 con 0x7f7790096050 2021-04-09T18:31:20.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.233 7f7777fff700 1 -- 172.21.15.79:0/3838436966 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778800cbd0 con 0x7f7790096050 2021-04-09T18:31:20.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.233 7f7795812700 1 -- 172.21.15.79:0/3838436966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77900aec60 con 0x7f7790096050 2021-04-09T18:31:20.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.233 7f7777fff700 1 -- 172.21.15.79:0/3838436966 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f778800f040 con 0x7f7790096050 2021-04-09T18:31:20.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.233 7f7795812700 1 -- 172.21.15.79:0/3838436966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77900a80b0 con 0x7f7790096050 2021-04-09T18:31:20.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.233 7f7777fff700 1 -- 172.21.15.79:0/3838436966 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7788022060 con 0x7f7790096050 2021-04-09T18:31:20.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.233 7f7777fff700 1 --2- 172.21.15.79:0/3838436966 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7770029100 0x7f777002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:20.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.233 7f7777fff700 1 -- 172.21.15.79:0/3838436966 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f7788010040 con 0x7f7790096050 2021-04-09T18:31:20.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.233 7f778f550700 1 --2- 172.21.15.79:0/3838436966 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7770029100 0x7f777002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:20.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.233 7f778f550700 1 --2- 172.21.15.79:0/3838436966 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7770029100 0x7f777002b650 crc :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:20.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.249 7f7795812700 1 -- 172.21.15.79:0/3838436966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77900e39d0 con 0x7f7790096050 2021-04-09T18:31:20.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.257 7f7777fff700 1 -- 172.21.15.79:0/3838436966 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f778800c9c0 con 0x7f7790096050 2021-04-09T18:31:20.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.417 7f7795812700 1 -- 172.21.15.79:0/3838436966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77900f5b10 con 0x7f7790096050 2021-04-09T18:31:20.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.421 7f7777fff700 1 -- 172.21.15.79:0/3838436966 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2103 (secure 0 0 0) 0x7f77900f76b0 con 0x7f7790096050 2021-04-09T18:31:20.420 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 27 2021-04-09T18:31:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:20.421 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3328659942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3328659942},{"type":"v1","addr":"172.21.15.79:6833","nonce":3328659942}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:29:53.022273","modified":"2021-04-09 18:31:18.116298","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":50,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5111":{"gid":5111,"name":"b","rank":0,"incarnation":25,"state":"up:active","state_seq":24,"addr":"172.21.15.89:6835/1280399112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1280399112},{"type":"v1","addr":"172.21.15.89:6835","nonce":1280399112}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-04-09T18:31:20.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.425 7f7795812700 1 -- 172.21.15.79:0/3838436966 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7770029100 msgr2=0x7f777002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:20.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.425 7f7795812700 1 --2- 172.21.15.79:0/3838436966 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7770029100 0x7f777002b650 crc :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.425 7f7795812700 1 -- 172.21.15.79:0/3838436966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7790096050 msgr2=0x7f77900964a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:20.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.425 7f7795812700 1 --2- 172.21.15.79:0/3838436966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7790096050 0x7f77900964a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f77900a84a0 tx=0x7f778800c430).stop 2021-04-09T18:31:20.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.425 7f7795812700 1 -- 172.21.15.79:0/3838436966 shutdown_connections 2021-04-09T18:31:20.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.425 7f7795812700 1 --2- 172.21.15.79:0/3838436966 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7770029100 0x7f777002b650 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.425 7f7795812700 1 --2- 172.21.15.79:0/3838436966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77900ab670 0x7f77900ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.425 7f7795812700 1 --2- 172.21.15.79:0/3838436966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7790096050 0x7f77900964a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.425 7f7795812700 1 --2- 172.21.15.79:0/3838436966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77900bae50 0x7f77900ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.425 7f7795812700 1 -- 172.21.15.79:0/3838436966 >> 172.21.15.79:0/3838436966 conn(0x7f779009b1d0 msgr2=0x7f77900af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:20.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.425 7f7795812700 1 -- 172.21.15.79:0/3838436966 shutdown_connections 2021-04-09T18:31:20.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.425 7f7795812700 1 -- 172.21.15.79:0/3838436966 wait complete. 2021-04-09T18:31:20.438 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-04-09T18:31:20.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.533 7fece6b1e700 1 Processor -- start 2021-04-09T18:31:20.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.533 7fece6b1e700 1 -- start start 2021-04-09T18:31:20.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.533 7fece6b1e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece00f5520 0x7fece00f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:20.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.533 7fece6b1e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fece00e9ae0 0x7fece009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:20.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.533 7fece6b1e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece00fbb20 con 0x7fece01c2db0 2021-04-09T18:31:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.533 7fece6b1e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece00e9f30 con 0x7fece00e9ae0 2021-04-09T18:31:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.533 7fece6b1e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece00e59d0 con 0x7fece00f5520 2021-04-09T18:31:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.533 7fecdffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fece00e9ae0 0x7fece009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.533 7fece50c3700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fece01c2db0 0x7fece01c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53386/0 (socket says 172.21.15.79:53386) 2021-04-09T18:31:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.533 7fecdffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fece00e9ae0 0x7fece009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58674/0 (socket says 172.21.15.79:58674) 2021-04-09T18:31:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.533 7fece50c3700 1 -- 172.21.15.79:0/3135522941 learned_addr learned my addr 172.21.15.79:0/3135522941 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.537 7fece48c2700 1 --2- 172.21.15.79:0/3135522941 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece00f5520 0x7fece00f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.537 7fecdffff700 1 -- 172.21.15.79:0/3135522941 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece00f5520 msgr2=0x7fece00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.537 7fecdffff700 1 --2- 172.21.15.79:0/3135522941 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece00f5520 0x7fece00f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.537 7fecdffff700 1 -- 172.21.15.79:0/3135522941 >> v1:172.21.15.79:6789/0 conn(0x7fece01c2db0 legacy=0x7fece01c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:20.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.537 7fecdf7fe700 1 -- 172.21.15.79:0/3135522941 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997223954 0 0) 0x7fecd00010d0 con 0x7fece01c2db0 2021-04-09T18:31:20.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.537 7fecdffff700 1 -- 172.21.15.79:0/3135522941 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece00e56d0 con 0x7fece00e9ae0 2021-04-09T18:31:20.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.537 7fecdffff700 1 --2- 172.21.15.79:0/3135522941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece00e9ae0 0x7fece009f110 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fecd40032b0 tx=0x7fecd400b3c0).ready entity=mon.0 client_cookie=d0352c10e4eed5f9 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:20.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.537 7fecdf7fe700 1 -- 172.21.15.79:0/3135522941 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fece00e56d0 con 0x7fece00e9ae0 2021-04-09T18:31:20.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.537 7fecdf7fe700 1 -- 172.21.15.79:0/3135522941 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd400bc20 con 0x7fece00e9ae0 2021-04-09T18:31:20.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.537 7fecdf7fe700 1 -- 172.21.15.79:0/3135522941 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fecd4002020 con 0x7fece00e9ae0 2021-04-09T18:31:20.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.537 7fece6b1e700 1 -- 172.21.15.79:0/3135522941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece00e9ae0 msgr2=0x7fece009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:20.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.537 7fece6b1e700 1 --2- 172.21.15.79:0/3135522941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece00e9ae0 0x7fece009f110 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fecd40032b0 tx=0x7fecd400b3c0).stop 2021-04-09T18:31:20.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.537 7fece6b1e700 1 -- 172.21.15.79:0/3135522941 shutdown_connections 2021-04-09T18:31:20.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.537 7fece6b1e700 1 --2- 172.21.15.79:0/3135522941 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece00f5520 0x7fece00f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.537 7fece6b1e700 1 --2- 172.21.15.79:0/3135522941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece00e9ae0 0x7fece009f110 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.537 7fece6b1e700 1 -- 172.21.15.79:0/3135522941 >> 172.21.15.79:0/3135522941 conn(0x7fece00e5fe0 msgr2=0x7fece00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:20.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.537 7fece6b1e700 1 -- 172.21.15.79:0/3135522941 shutdown_connections 2021-04-09T18:31:20.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.537 7fece6b1e700 1 -- 172.21.15.79:0/3135522941 wait complete. 2021-04-09T18:31:20.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.541 7fece6b1e700 1 Processor -- start 2021-04-09T18:31:20.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.541 7fece6b1e700 1 -- start start 2021-04-09T18:31:20.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.541 7fece6b1e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece00aac40 0x7fece00ab450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:20.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.541 7fece6b1e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece00a7a40 0x7fece00d4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:20.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.541 7fece6b1e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fece00d5030 0x7fece00ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:20.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.541 7fece6b1e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece00a8340 con 0x7fece00aac40 2021-04-09T18:31:20.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.541 7fece6b1e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece00a8640 con 0x7fece00d5030 2021-04-09T18:31:20.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.541 7fece6b1e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece00ab090 con 0x7fece00a7a40 2021-04-09T18:31:20.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.541 7fece48c2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece00aac40 0x7fece00ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:20.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.541 7fece48c2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece00aac40 0x7fece00ab450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58680/0 (socket says 172.21.15.79:58680) 2021-04-09T18:31:20.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.541 7fece48c2700 1 -- 172.21.15.79:0/1707219236 learned_addr learned my addr 172.21.15.79:0/1707219236 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:20.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.545 7fecdffff700 1 --2- 172.21.15.79:0/1707219236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece00a7a40 0x7fece00d4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:20.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.545 7fece50c3700 1 --2- 172.21.15.79:0/1707219236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fece00d5030 0x7fece00ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:20.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.545 7fece48c2700 1 -- 172.21.15.79:0/1707219236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece00a7a40 msgr2=0x7fece00d4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:20.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.545 7fece48c2700 1 --2- 172.21.15.79:0/1707219236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece00a7a40 0x7fece00d4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.545 7fece48c2700 1 -- 172.21.15.79:0/1707219236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fece00d5030 msgr2=0x7fece00ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:20.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.545 7fece48c2700 1 --2- 172.21.15.79:0/1707219236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fece00d5030 0x7fece00ae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.545 7fece48c2700 1 -- 172.21.15.79:0/1707219236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece00a7e90 con 0x7fece00aac40 2021-04-09T18:31:20.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.545 7fece48c2700 1 --2- 172.21.15.79:0/1707219236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece00aac40 0x7fece00ab450 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fece00af9f0 tx=0x7fecd800df60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:20.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.545 7fecdd7fa700 1 -- 172.21.15.79:0/1707219236 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fece00a7e90 con 0x7fece00aac40 2021-04-09T18:31:20.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.545 7fecdd7fa700 1 -- 172.21.15.79:0/1707219236 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd80099e0 con 0x7fece00aac40 2021-04-09T18:31:20.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.545 7fece6b1e700 1 -- 172.21.15.79:0/1707219236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece00ae640 con 0x7fece00aac40 2021-04-09T18:31:20.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.545 7fecdd7fa700 1 -- 172.21.15.79:0/1707219236 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fecd800f040 con 0x7fece00aac40 2021-04-09T18:31:20.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.545 7fece6b1e700 1 -- 172.21.15.79:0/1707219236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece00aeb20 con 0x7fece00aac40 2021-04-09T18:31:20.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.545 7fecdd7fa700 1 -- 172.21.15.79:0/1707219236 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fecd8013480 con 0x7fece00aac40 2021-04-09T18:31:20.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.545 7fecdd7fa700 1 --2- 172.21.15.79:0/1707219236 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fecc0029100 0x7fecc002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:20.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.545 7fecdd7fa700 1 -- 172.21.15.79:0/1707219236 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6053+0+0 (secure 0 0 0) 0x7fecd8010070 con 0x7fece00aac40 2021-04-09T18:31:20.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.545 7fecdffff700 1 --2- 172.21.15.79:0/1707219236 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fecc0029100 0x7fecc002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:20.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.545 7fecdffff700 1 --2- 172.21.15.79:0/1707219236 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fecc0029100 0x7fecc002b650 crc :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:20.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.549 7fece6b1e700 1 -- 172.21.15.79:0/1707219236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece00e39e0 con 0x7fece00aac40 2021-04-09T18:31:20.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.557 7fecdd7fa700 1 -- 172.21.15.79:0/1707219236 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fecd80095e0 con 0x7fece00aac40 2021-04-09T18:31:20.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.717 7fece6b1e700 1 -- 172.21.15.79:0/1707219236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fece00f5b20 con 0x7fece00aac40 2021-04-09T18:31:20.932 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:31:20.933 7fbcd0516700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:31:20.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.945 7fecdd7fa700 1 -- 172.21.15.79:0/1707219236 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) v1 ==== 161+0+0 (secure 0 0 0) 0x7fecd8000bf0 con 0x7fece00aac40 2021-04-09T18:31:20.981 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-04-09T18:31:20.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.985 7fece6b1e700 1 -- 172.21.15.79:0/1707219236 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fecc0029100 msgr2=0x7fecc002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:20.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.985 7fece6b1e700 1 --2- 172.21.15.79:0/1707219236 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fecc0029100 0x7fecc002b650 crc :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.985 7fece6b1e700 1 -- 172.21.15.79:0/1707219236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece00aac40 msgr2=0x7fece00ab450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:20.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.985 7fece6b1e700 1 --2- 172.21.15.79:0/1707219236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece00aac40 0x7fece00ab450 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fece00af9f0 tx=0x7fecd800df60).stop 2021-04-09T18:31:20.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.985 7fece6b1e700 1 -- 172.21.15.79:0/1707219236 shutdown_connections 2021-04-09T18:31:20.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.985 7fece6b1e700 1 --2- 172.21.15.79:0/1707219236 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fecc0029100 0x7fecc002b650 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.985 7fece6b1e700 1 --2- 172.21.15.79:0/1707219236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fece00d5030 0x7fece00ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.985 7fece6b1e700 1 --2- 172.21.15.79:0/1707219236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece00aac40 0x7fece00ab450 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.985 7fece6b1e700 1 --2- 172.21.15.79:0/1707219236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece00a7a40 0x7fece00d4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:20.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.985 7fece6b1e700 1 -- 172.21.15.79:0/1707219236 >> 172.21.15.79:0/1707219236 conn(0x7fece009b240 msgr2=0x7fece00aef90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:20.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.985 7fece6b1e700 1 -- 172.21.15.79:0/1707219236 shutdown_connections 2021-04-09T18:31:20.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:20.985 7fece6b1e700 1 -- 172.21.15.79:0/1707219236 wait complete. 2021-04-09T18:31:20.990 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2021-04-09T18:31:21.005 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:21.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.101 7fe112658700 1 Processor -- start 2021-04-09T18:31:21.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.101 7fe112658700 1 -- start start 2021-04-09T18:31:21.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.101 7fe112658700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe10c0e9ae0 0x7fe10c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:21.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.101 7fe112658700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe10c1c8010 0x7fe10c1ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:21.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe112658700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10c0fbb20 con 0x7fe10c0f5520 2021-04-09T18:31:21.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe112658700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe10c1c3dc0 con 0x7fe10c1c8010 2021-04-09T18:31:21.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe112658700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c0e9f30 con 0x7fe10c0e9ae0 2021-04-09T18:31:21.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe10b7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe10c0e9ae0 0x7fe10c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:21.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe10b7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe10c0e9ae0 0x7fe10c09f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:55686/0 (socket says 172.21.15.79:55686) 2021-04-09T18:31:21.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe10b7fe700 1 -- 172.21.15.79:0/3662794272 learned_addr learned my addr 172.21.15.79:0/3662794272 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:21.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe110bfd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe10c1c8010 0x7fe10c1ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:21.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe10b7fe700 1 -- 172.21.15.79:0/3662794272 >> v2:172.21.15.89:3300/0 conn(0x7fe10c1c8010 msgr2=0x7fe10c1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:21.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe10b7fe700 1 --2- 172.21.15.79:0/3662794272 >> v2:172.21.15.89:3300/0 conn(0x7fe10c1c8010 0x7fe10c1ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:21.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe10b7fe700 1 -- 172.21.15.79:0/3662794272 >> v1:172.21.15.89:6789/0 conn(0x7fe10c0f5520 legacy=0x7fe10c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:21.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe10b7fe700 1 -- 172.21.15.79:0/3662794272 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c0e56d0 con 0x7fe10c0e9ae0 2021-04-09T18:31:21.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe110bfd700 1 --2- 172.21.15.79:0/3662794272 >> v2:172.21.15.89:3300/0 conn(0x7fe10c1c8010 0x7fe10c1ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:21.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe10b7fe700 1 --2- 172.21.15.79:0/3662794272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe10c0e9ae0 0x7fe10c09f110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fe0fc001340 tx=0x7fe0fc001040).ready entity=mon.2 client_cookie=ad10552ce25164b8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:21.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe10affd700 1 -- 172.21.15.79:0/3662794272 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe10c0e56d0 con 0x7fe10c0e9ae0 2021-04-09T18:31:21.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe10affd700 1 -- 172.21.15.79:0/3662794272 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe100009720 con 0x7fe10c0e9ae0 2021-04-09T18:31:21.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe10affd700 1 -- 172.21.15.79:0/3662794272 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe100009b30 con 0x7fe10c0e9ae0 2021-04-09T18:31:21.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe112658700 1 -- 172.21.15.79:0/3662794272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe10c0e9ae0 msgr2=0x7fe10c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:21.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe112658700 1 --2- 172.21.15.79:0/3662794272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe10c0e9ae0 0x7fe10c09f110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fe0fc001340 tx=0x7fe0fc001040).stop 2021-04-09T18:31:21.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe112658700 1 -- 172.21.15.79:0/3662794272 shutdown_connections 2021-04-09T18:31:21.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe112658700 1 --2- 172.21.15.79:0/3662794272 >> v2:172.21.15.89:3300/0 conn(0x7fe10c1c8010 0x7fe10c1ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:21.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe112658700 1 --2- 172.21.15.79:0/3662794272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe10c0e9ae0 0x7fe10c09f110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:21.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe112658700 1 -- 172.21.15.79:0/3662794272 >> 172.21.15.79:0/3662794272 conn(0x7fe10c0e5fe0 msgr2=0x7fe10c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:21.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe112658700 1 -- 172.21.15.79:0/3662794272 shutdown_connections 2021-04-09T18:31:21.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.105 7fe112658700 1 -- 172.21.15.79:0/3662794272 wait complete. 2021-04-09T18:31:21.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.109 7fe112658700 1 Processor -- start 2021-04-09T18:31:21.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.109 7fe112658700 1 -- start start 2021-04-09T18:31:21.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.109 7fe112658700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe10c0d4f90 0x7fe10c0af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:21.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.109 7fe112658700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe10c0afa00 0x7fe10c1ae090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:21.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.109 7fe112658700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe10c0d53e0 0x7fe10c1ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:21.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.109 7fe112658700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c0bbc80 con 0x7fe10c0d53e0 2021-04-09T18:31:21.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.109 7fe112658700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c0aff70 con 0x7fe10c0afa00 2021-04-09T18:31:21.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.109 7fe112658700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c0b01a0 con 0x7fe10c0d4f90 2021-04-09T18:31:21.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.113 7fe110bfd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe10c0d53e0 0x7fe10c1ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:21.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.113 7fe110bfd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe10c0d53e0 0x7fe10c1ae6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58698/0 (socket says 172.21.15.79:58698) 2021-04-09T18:31:21.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.113 7fe110bfd700 1 -- 172.21.15.79:0/3639130825 learned_addr learned my addr 172.21.15.79:0/3639130825 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:21.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.113 7fe10bfff700 1 --2- 172.21.15.79:0/3639130825 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe10c0d4f90 0x7fe10c0af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:21.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.113 7fe10b7fe700 1 --2- 172.21.15.79:0/3639130825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe10c0afa00 0x7fe10c1ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:21.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.113 7fe110bfd700 1 -- 172.21.15.79:0/3639130825 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe10c0d4f90 msgr2=0x7fe10c0af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:21.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.113 7fe110bfd700 1 --2- 172.21.15.79:0/3639130825 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe10c0d4f90 0x7fe10c0af3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:21.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.113 7fe110bfd700 1 -- 172.21.15.79:0/3639130825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe10c0afa00 msgr2=0x7fe10c1ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:21.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.113 7fe110bfd700 1 --2- 172.21.15.79:0/3639130825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe10c0afa00 0x7fe10c1ae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:21.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.113 7fe110bfd700 1 -- 172.21.15.79:0/3639130825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c0bd200 con 0x7fe10c0d53e0 2021-04-09T18:31:21.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.113 7fe110bfd700 1 --2- 172.21.15.79:0/3639130825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe10c0d53e0 0x7fe10c1ae6c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fe10c09b4f0 tx=0x7fe10400eae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:21.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.113 7fe108ff9700 1 -- 172.21.15.79:0/3639130825 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe10c0bd200 con 0x7fe10c0d53e0 2021-04-09T18:31:21.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.113 7fe108ff9700 1 -- 172.21.15.79:0/3639130825 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe104011920 con 0x7fe10c0d53e0 2021-04-09T18:31:21.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.113 7fe112658700 1 -- 172.21.15.79:0/3639130825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe10c096750 con 0x7fe10c0d53e0 2021-04-09T18:31:21.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.113 7fe108ff9700 1 -- 172.21.15.79:0/3639130825 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe104011cf0 con 0x7fe10c0d53e0 2021-04-09T18:31:21.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.113 7fe112658700 1 -- 172.21.15.79:0/3639130825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe10c096c60 con 0x7fe10c0d53e0 2021-04-09T18:31:21.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.113 7fe108ff9700 1 -- 172.21.15.79:0/3639130825 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe1040243f0 con 0x7fe10c0d53e0 2021-04-09T18:31:21.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.113 7fe108ff9700 1 --2- 172.21.15.79:0/3639130825 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe0ec029100 0x7fe0ec02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:21.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.113 7fe108ff9700 1 -- 172.21.15.79:0/3639130825 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6139+0+0 (secure 0 0 0) 0x7fe10403c650 con 0x7fe10c0d53e0 2021-04-09T18:31:21.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.113 7fe10bfff700 1 --2- 172.21.15.79:0/3639130825 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe0ec029100 0x7fe0ec02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:21.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.117 7fe112658700 1 -- 172.21.15.79:0/3639130825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe10c0e39e0 con 0x7fe10c0d53e0 2021-04-09T18:31:21.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.117 7fe10bfff700 1 --2- 172.21.15.79:0/3639130825 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe0ec029100 0x7fe0ec02b650 crc :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:21.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.121 7fe108ff9700 1 -- 172.21.15.79:0/3639130825 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe10c0f76c0 con 0x7fe10c0d53e0 2021-04-09T18:31:21.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.285 7fe112658700 1 -- 172.21.15.79:0/3639130825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe10c0a1cc0 con 0x7fe10c0d53e0 2021-04-09T18:31:21.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.289 7fe108ff9700 1 -- 172.21.15.79:0/3639130825 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+1756 (secure 0 0 0) 0x7fe104011520 con 0x7fe10c0d53e0 2021-04-09T18:31:21.289 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:21.289 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3328659942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3328659942},{"type":"v1","addr":"172.21.15.79:6833","nonce":3328659942}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:29:53.022273","modified":"2021-04-09 18:31:20.935966","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-04-09T18:31:21.289 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 28 2021-04-09T18:31:21.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.293 7fe112658700 1 -- 172.21.15.79:0/3639130825 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe0ec029100 msgr2=0x7fe0ec02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:21.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.293 7fe112658700 1 --2- 172.21.15.79:0/3639130825 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe0ec029100 0x7fe0ec02b650 crc :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:21.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.293 7fe112658700 1 -- 172.21.15.79:0/3639130825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe10c0d53e0 msgr2=0x7fe10c1ae6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:21.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.293 7fe112658700 1 --2- 172.21.15.79:0/3639130825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe10c0d53e0 0x7fe10c1ae6c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fe10c09b4f0 tx=0x7fe10400eae0).stop 2021-04-09T18:31:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.293 7fe112658700 1 -- 172.21.15.79:0/3639130825 shutdown_connections 2021-04-09T18:31:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.293 7fe112658700 1 --2- 172.21.15.79:0/3639130825 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe0ec029100 0x7fe0ec02b650 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.293 7fe112658700 1 --2- 172.21.15.79:0/3639130825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe10c0d53e0 0x7fe10c1ae6c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.293 7fe112658700 1 --2- 172.21.15.79:0/3639130825 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe10c0d4f90 0x7fe10c0af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.293 7fe112658700 1 --2- 172.21.15.79:0/3639130825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe10c0afa00 0x7fe10c1ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:21.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.293 7fe112658700 1 -- 172.21.15.79:0/3639130825 >> 172.21.15.79:0/3639130825 conn(0x7fe10c09aca0 msgr2=0x7fe10c09a200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:21.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.293 7fe112658700 1 -- 172.21.15.79:0/3639130825 shutdown_connections 2021-04-09T18:31:21.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.293 7fe112658700 1 -- 172.21.15.79:0/3639130825 wait complete. 2021-04-09T18:31:21.302 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-04-09T18:31:21.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.397 7f8f632be700 1 Processor -- start 2021-04-09T18:31:21.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.397 7f8f632be700 1 -- start start 2021-04-09T18:31:21.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.397 7f8f632be700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8f5c0f5520 0x7f8f5c0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:21.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.397 7f8f632be700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8f5c0e9ae0 0x7f8f5c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:21.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.397 7f8f632be700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5c0fbb20 con 0x7f8f5c1c2db0 2021-04-09T18:31:21.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.397 7f8f632be700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f5c0e9f30 con 0x7f8f5c0e9ae0 2021-04-09T18:31:21.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.397 7f8f632be700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f5c0e59d0 con 0x7f8f5c0f5520 2021-04-09T18:31:21.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f61863700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8f5c1c2db0 0x7f8f5c1c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53416/0 (socket says 172.21.15.79:53416) 2021-04-09T18:31:21.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f61863700 1 -- 172.21.15.79:0/1385010121 learned_addr learned my addr 172.21.15.79:0/1385010121 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:21.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f60861700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8f5c0e9ae0 0x7f8f5c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:21.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f61062700 1 --2- 172.21.15.79:0/1385010121 >> v2:172.21.15.89:3300/0 conn(0x7f8f5c0f5520 0x7f8f5c0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:21.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f60861700 1 -- 172.21.15.79:0/1385010121 >> v2:172.21.15.89:3300/0 conn(0x7f8f5c0f5520 msgr2=0x7f8f5c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:21.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f60861700 1 --2- 172.21.15.79:0/1385010121 >> v2:172.21.15.89:3300/0 conn(0x7f8f5c0f5520 0x7f8f5c0f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:21.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f60861700 1 -- 172.21.15.79:0/1385010121 >> v1:172.21.15.79:6789/0 conn(0x7f8f5c1c2db0 legacy=0x7f8f5c1c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:21.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f4ffff700 1 -- 172.21.15.79:0/1385010121 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044582336 0 0) 0x7f8f54001450 con 0x7f8f5c1c2db0 2021-04-09T18:31:21.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f60861700 1 -- 172.21.15.79:0/1385010121 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c0e56d0 con 0x7f8f5c0e9ae0 2021-04-09T18:31:21.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f60861700 1 --2- 172.21.15.79:0/1385010121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f5c0e9ae0 0x7f8f5c09f110 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f8f50002f30 tx=0x7f8f5000bd10).ready entity=mon.0 client_cookie=7035d96efdd6626e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f4ffff700 1 -- 172.21.15.79:0/1385010121 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8f5c0e56d0 con 0x7f8f5c0e9ae0 2021-04-09T18:31:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f4ffff700 1 -- 172.21.15.79:0/1385010121 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f500098a0 con 0x7f8f5c0e9ae0 2021-04-09T18:31:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f4ffff700 1 -- 172.21.15.79:0/1385010121 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8f50009c70 con 0x7f8f5c0e9ae0 2021-04-09T18:31:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f632be700 1 -- 172.21.15.79:0/1385010121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f5c0e9ae0 msgr2=0x7f8f5c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:21.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f632be700 1 --2- 172.21.15.79:0/1385010121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f5c0e9ae0 0x7f8f5c09f110 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f8f50002f30 tx=0x7f8f5000bd10).stop 2021-04-09T18:31:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f632be700 1 -- 172.21.15.79:0/1385010121 shutdown_connections 2021-04-09T18:31:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f632be700 1 --2- 172.21.15.79:0/1385010121 >> v2:172.21.15.89:3300/0 conn(0x7f8f5c0f5520 0x7f8f5c0f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f632be700 1 --2- 172.21.15.79:0/1385010121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f5c0e9ae0 0x7f8f5c09f110 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:21.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f632be700 1 -- 172.21.15.79:0/1385010121 >> 172.21.15.79:0/1385010121 conn(0x7f8f5c0e5fe0 msgr2=0x7f8f5c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:21.410 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f632be700 1 -- 172.21.15.79:0/1385010121 shutdown_connections 2021-04-09T18:31:21.410 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.401 7f8f632be700 1 -- 172.21.15.79:0/1385010121 wait complete. 2021-04-09T18:31:21.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.405 7f8f632be700 1 Processor -- start 2021-04-09T18:31:21.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.405 7f8f632be700 1 -- start start 2021-04-09T18:31:21.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.405 7f8f632be700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f5c0b91a0 0x7f8f5c0d4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:21.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.405 7f8f632be700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f5c0902b0 0x7f8f5c090c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:21.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.405 7f8f632be700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f5c0ce400 0x7f8f5c0ce850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:21.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.405 7f8f632be700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c090980 con 0x7f8f5c0b91a0 2021-04-09T18:31:21.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.405 7f8f632be700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c0d55d0 con 0x7f8f5c0ce400 2021-04-09T18:31:21.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.405 7f8f632be700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c0912b0 con 0x7f8f5c0902b0 2021-04-09T18:31:21.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.405 7f8f61062700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f5c0b91a0 0x7f8f5c0d4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:21.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.405 7f8f61062700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f5c0b91a0 0x7f8f5c0d4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58708/0 (socket says 172.21.15.79:58708) 2021-04-09T18:31:21.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.405 7f8f61062700 1 -- 172.21.15.79:0/2820411176 learned_addr learned my addr 172.21.15.79:0/2820411176 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:21.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.405 7f8f61863700 1 --2- 172.21.15.79:0/2820411176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f5c0ce400 0x7f8f5c0ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:21.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.405 7f8f60861700 1 --2- 172.21.15.79:0/2820411176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f5c0902b0 0x7f8f5c090c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:21.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.409 7f8f61062700 1 -- 172.21.15.79:0/2820411176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f5c0902b0 msgr2=0x7f8f5c090c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:21.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.409 7f8f61062700 1 --2- 172.21.15.79:0/2820411176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f5c0902b0 0x7f8f5c090c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:21.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.409 7f8f61062700 1 -- 172.21.15.79:0/2820411176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f5c0ce400 msgr2=0x7f8f5c0ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:21.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.409 7f8f61062700 1 --2- 172.21.15.79:0/2820411176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f5c0ce400 0x7f8f5c0ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:21.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.409 7f8f61062700 1 -- 172.21.15.79:0/2820411176 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c0cee80 con 0x7f8f5c0b91a0 2021-04-09T18:31:21.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.409 7f8f61062700 1 --2- 172.21.15.79:0/2820411176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f5c0b91a0 0x7f8f5c0d4fa0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f8f58006920 tx=0x7f8f5800c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:21.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.409 7f8f4dffb700 1 -- 172.21.15.79:0/2820411176 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8f5c0cee80 con 0x7f8f5c0b91a0 2021-04-09T18:31:21.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.409 7f8f4dffb700 1 -- 172.21.15.79:0/2820411176 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5800cbb0 con 0x7f8f5c0b91a0 2021-04-09T18:31:21.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.409 7f8f4dffb700 1 -- 172.21.15.79:0/2820411176 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8f5800f040 con 0x7f8f5c0b91a0 2021-04-09T18:31:21.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.409 7f8f632be700 1 -- 172.21.15.79:0/2820411176 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f5c0cf1a0 con 0x7f8f5c0b91a0 2021-04-09T18:31:21.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.409 7f8f632be700 1 -- 172.21.15.79:0/2820411176 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5c0d5980 con 0x7f8f5c0b91a0 2021-04-09T18:31:21.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.409 7f8f4dffb700 1 -- 172.21.15.79:0/2820411176 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8f58011070 con 0x7f8f5c0b91a0 2021-04-09T18:31:21.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.409 7f8f4dffb700 1 --2- 172.21.15.79:0/2820411176 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8f3c029100 0x7f8f3c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:21.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.409 7f8f4dffb700 1 -- 172.21.15.79:0/2820411176 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6139+0+0 (secure 0 0 0) 0x7f8f58010040 con 0x7f8f5c0b91a0 2021-04-09T18:31:21.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.409 7f8f60861700 1 --2- 172.21.15.79:0/2820411176 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8f3c029100 0x7f8f3c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:21.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.409 7f8f60861700 1 --2- 172.21.15.79:0/2820411176 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8f3c029100 0x7f8f3c02b650 crc :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:21.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.413 7f8f632be700 1 -- 172.21.15.79:0/2820411176 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5c0e39e0 con 0x7f8f5c0b91a0 2021-04-09T18:31:21.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.421 7f8f4dffb700 1 -- 172.21.15.79:0/2820411176 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8f5800c7b0 con 0x7f8f5c0b91a0 2021-04-09T18:31:21.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.585 7f8f632be700 1 -- 172.21.15.79:0/2820411176 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8f5c0f5b20 con 0x7f8f5c0b91a0 2021-04-09T18:31:21.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:21.953 7f8f4dffb700 1 -- 172.21.15.79:0/2820411176 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8f58000bf0 con 0x7f8f5c0b91a0 2021-04-09T18:31:22.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.001 7f8f632be700 1 -- 172.21.15.79:0/2820411176 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8f3c029100 msgr2=0x7f8f3c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:22.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.001 7f8f632be700 1 --2- 172.21.15.79:0/2820411176 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8f3c029100 0x7f8f3c02b650 crc :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:22.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.001 7f8f632be700 1 -- 172.21.15.79:0/2820411176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f5c0b91a0 msgr2=0x7f8f5c0d4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:22.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.001 7f8f632be700 1 --2- 172.21.15.79:0/2820411176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f5c0b91a0 0x7f8f5c0d4fa0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f8f58006920 tx=0x7f8f5800c150).stop 2021-04-09T18:31:22.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.001 7f8f632be700 1 -- 172.21.15.79:0/2820411176 shutdown_connections 2021-04-09T18:31:22.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.001 7f8f632be700 1 --2- 172.21.15.79:0/2820411176 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8f3c029100 0x7f8f3c02b650 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:22.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.001 7f8f632be700 1 --2- 172.21.15.79:0/2820411176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f5c0ce400 0x7f8f5c0ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:22.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.001 7f8f632be700 1 --2- 172.21.15.79:0/2820411176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f5c0b91a0 0x7f8f5c0d4fa0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:22.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.001 7f8f632be700 1 --2- 172.21.15.79:0/2820411176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f5c0902b0 0x7f8f5c090c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:22.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.001 7f8f632be700 1 -- 172.21.15.79:0/2820411176 >> 172.21.15.79:0/2820411176 conn(0x7f8f5c093630 msgr2=0x7f8f5c0d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:22.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.001 7f8f632be700 1 -- 172.21.15.79:0/2820411176 shutdown_connections 2021-04-09T18:31:22.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.001 7f8f632be700 1 -- 172.21.15.79:0/2820411176 wait complete. 2021-04-09T18:31:22.020 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-04-09T18:31:22.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7dfac44700 1 Processor -- start 2021-04-09T18:31:22.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7dfac44700 1 -- start start 2021-04-09T18:31:22.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7dfac44700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7df40f5550 0x7f7df40f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:22.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7dfac44700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7df40e9b10 0x7f7df409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:22.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7dfac44700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df40fbb50 con 0x7f7df41c2de0 2021-04-09T18:31:22.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7dfac44700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df40e9f60 con 0x7f7df40f5550 2021-04-09T18:31:22.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7dfac44700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df40e5a00 con 0x7f7df40e9b10 2021-04-09T18:31:22.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7df89e8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7df40f5550 0x7f7df40f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:22.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7df89e8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7df40f5550 0x7f7df40f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58716/0 (socket says 172.21.15.79:58716) 2021-04-09T18:31:22.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7df89e8700 1 -- 172.21.15.79:0/806018444 learned_addr learned my addr 172.21.15.79:0/806018444 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:22.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7df3fff700 1 --2- 172.21.15.79:0/806018444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7df40e9b10 0x7f7df409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:22.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7df89e8700 1 -- 172.21.15.79:0/806018444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7df40e9b10 msgr2=0x7f7df409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:22.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7df89e8700 1 --2- 172.21.15.79:0/806018444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7df40e9b10 0x7f7df409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:22.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7df89e8700 1 -- 172.21.15.79:0/806018444 >> v1:172.21.15.89:6789/0 conn(0x7f7df41c2de0 legacy=0x7f7df41c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:22.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7df89e8700 1 -- 172.21.15.79:0/806018444 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df40e5700 con 0x7f7df40f5550 2021-04-09T18:31:22.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7df89e8700 1 --2- 172.21.15.79:0/806018444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7df40f5550 0x7f7df40f64e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f7de40032b0 tx=0x7f7de400b3c0).ready entity=mon.0 client_cookie=efb0af1eb2b30250 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:22.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7df37fe700 1 -- 172.21.15.79:0/806018444 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7df40e5700 con 0x7f7df40f5550 2021-04-09T18:31:22.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7df37fe700 1 -- 172.21.15.79:0/806018444 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de400bc20 con 0x7f7df40f5550 2021-04-09T18:31:22.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7df37fe700 1 -- 172.21.15.79:0/806018444 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7de4002020 con 0x7f7df40f5550 2021-04-09T18:31:22.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7dfac44700 1 -- 172.21.15.79:0/806018444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7df40f5550 msgr2=0x7f7df40f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:22.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.125 7f7dfac44700 1 --2- 172.21.15.79:0/806018444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7df40f5550 0x7f7df40f64e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f7de40032b0 tx=0x7f7de400b3c0).stop 2021-04-09T18:31:22.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.129 7f7dfac44700 1 -- 172.21.15.79:0/806018444 shutdown_connections 2021-04-09T18:31:22.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.129 7f7dfac44700 1 --2- 172.21.15.79:0/806018444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7df40f5550 0x7f7df40f64e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:22.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.129 7f7dfac44700 1 --2- 172.21.15.79:0/806018444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7df40e9b10 0x7f7df409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:22.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.129 7f7dfac44700 1 -- 172.21.15.79:0/806018444 >> 172.21.15.79:0/806018444 conn(0x7f7df40e6010 msgr2=0x7f7df40e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:22.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.129 7f7dfac44700 1 -- 172.21.15.79:0/806018444 shutdown_connections 2021-04-09T18:31:22.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.129 7f7dfac44700 1 -- 172.21.15.79:0/806018444 wait complete. 2021-04-09T18:31:22.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.129 7f7dfac44700 1 Processor -- start 2021-04-09T18:31:22.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.129 7f7dfac44700 1 -- start start 2021-04-09T18:31:22.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7dfac44700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7df40b5b50 0x7f7df41b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:22.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7dfac44700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7df40af420 0x7f7df40d4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:22.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7dfac44700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df40d5200 0x7f7df40a3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:22.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7dfac44700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df40b6150 con 0x7f7df40b5b50 2021-04-09T18:31:22.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7dfac44700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df40b6450 con 0x7f7df40d5200 2021-04-09T18:31:22.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7dfac44700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df40b79f0 con 0x7f7df40af420 2021-04-09T18:31:22.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7df89e8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7df40b5b50 0x7f7df41b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:22.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7df89e8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7df40b5b50 0x7f7df41b1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58722/0 (socket says 172.21.15.79:58722) 2021-04-09T18:31:22.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7df89e8700 1 -- 172.21.15.79:0/3355547792 learned_addr learned my addr 172.21.15.79:0/3355547792 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:22.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7df3fff700 1 --2- 172.21.15.79:0/3355547792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7df40af420 0x7f7df40d4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:22.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7df91e9700 1 --2- 172.21.15.79:0/3355547792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df40d5200 0x7f7df40a3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:22.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7df89e8700 1 -- 172.21.15.79:0/3355547792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7df40af420 msgr2=0x7f7df40d4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:22.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7df89e8700 1 --2- 172.21.15.79:0/3355547792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7df40af420 0x7f7df40d4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:22.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7df89e8700 1 -- 172.21.15.79:0/3355547792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df40d5200 msgr2=0x7f7df40a3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:22.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7df89e8700 1 --2- 172.21.15.79:0/3355547792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df40d5200 0x7f7df40a3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:22.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7df89e8700 1 -- 172.21.15.79:0/3355547792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df40af870 con 0x7f7df40b5b50 2021-04-09T18:31:22.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7df3fff700 1 --2- 172.21.15.79:0/3355547792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7df40af420 0x7f7df40d4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:22.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7df89e8700 1 --2- 172.21.15.79:0/3355547792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7df40b5b50 0x7f7df41b1020 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f7df40d7e00 tx=0x7f7de4006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:22.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7df17fa700 1 -- 172.21.15.79:0/3355547792 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7df40af870 con 0x7f7df40b5b50 2021-04-09T18:31:22.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7df17fa700 1 -- 172.21.15.79:0/3355547792 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de401b670 con 0x7f7df40b5b50 2021-04-09T18:31:22.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7dfac44700 1 -- 172.21.15.79:0/3355547792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df40afb30 con 0x7f7df40b5b50 2021-04-09T18:31:22.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7df17fa700 1 -- 172.21.15.79:0/3355547792 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7de4020020 con 0x7f7df40b5b50 2021-04-09T18:31:22.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7dfac44700 1 -- 172.21.15.79:0/3355547792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df40a3b10 con 0x7f7df40b5b50 2021-04-09T18:31:22.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7df17fa700 1 -- 172.21.15.79:0/3355547792 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7de4019040 con 0x7f7df40b5b50 2021-04-09T18:31:22.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7df17fa700 1 --2- 172.21.15.79:0/3355547792 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7dcc029100 0x7f7dcc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:22.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7df17fa700 1 -- 172.21.15.79:0/3355547792 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6139+0+0 (secure 0 0 0) 0x7f7de4003020 con 0x7f7df40b5b50 2021-04-09T18:31:22.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.133 7f7df3fff700 1 --2- 172.21.15.79:0/3355547792 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7dcc029100 0x7f7dcc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:22.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.137 7f7df3fff700 1 --2- 172.21.15.79:0/3355547792 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7dcc029100 0x7f7dcc02b650 crc :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:22.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.141 7f7dfac44700 1 -- 172.21.15.79:0/3355547792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df40e39f0 con 0x7f7df40b5b50 2021-04-09T18:31:22.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.149 7f7df17fa700 1 -- 172.21.15.79:0/3355547792 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7de400ba10 con 0x7f7df40b5b50 2021-04-09T18:31:22.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.321 7f7dfac44700 1 -- 172.21.15.79:0/3355547792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7df40f5b50 con 0x7f7df40b5b50 2021-04-09T18:31:22.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.960 7f7df17fa700 1 -- 172.21.15.79:0/3355547792 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) v1 ==== 185+0+0 (secure 0 0 0) 0x7f7de401b460 con 0x7f7df40b5b50 2021-04-09T18:31:22.983 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2021-04-09T18:31:22.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.988 7f7dfac44700 1 -- 172.21.15.79:0/3355547792 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7dcc029100 msgr2=0x7f7dcc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:22.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.988 7f7dfac44700 1 --2- 172.21.15.79:0/3355547792 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7dcc029100 0x7f7dcc02b650 crc :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:22.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.988 7f7dfac44700 1 -- 172.21.15.79:0/3355547792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7df40b5b50 msgr2=0x7f7df41b1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:22.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.988 7f7dfac44700 1 --2- 172.21.15.79:0/3355547792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7df40b5b50 0x7f7df41b1020 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f7df40d7e00 tx=0x7f7de4006c10).stop 2021-04-09T18:31:22.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.988 7f7dfac44700 1 -- 172.21.15.79:0/3355547792 shutdown_connections 2021-04-09T18:31:22.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.988 7f7dfac44700 1 --2- 172.21.15.79:0/3355547792 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7dcc029100 0x7f7dcc02b650 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:22.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.988 7f7dfac44700 1 --2- 172.21.15.79:0/3355547792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df40d5200 0x7f7df40a3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:22.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.988 7f7dfac44700 1 --2- 172.21.15.79:0/3355547792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7df40b5b50 0x7f7df41b1020 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:22.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.988 7f7dfac44700 1 --2- 172.21.15.79:0/3355547792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7df40af420 0x7f7df40d4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:22.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.988 7f7dfac44700 1 -- 172.21.15.79:0/3355547792 >> 172.21.15.79:0/3355547792 conn(0x7f7df409ae80 msgr2=0x7f7df40ba370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:22.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.988 7f7dfac44700 1 -- 172.21.15.79:0/3355547792 shutdown_connections 2021-04-09T18:31:22.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:22.988 7f7dfac44700 1 -- 172.21.15.79:0/3355547792 wait complete. 2021-04-09T18:31:23.000 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-04-09T18:31:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.104 7f3a34da5700 1 Processor -- start 2021-04-09T18:31:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.104 7f3a34da5700 1 -- start start 2021-04-09T18:31:23.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.104 7f3a34da5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3a300f5550 0x7f3a300f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:23.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.104 7f3a34da5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a300e9b10 0x7f3a3009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:23.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.104 7f3a34da5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a300fbb50 con 0x7f3a301c2de0 2021-04-09T18:31:23.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.104 7f3a34da5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a300e9f60 con 0x7f3a300e9b10 2021-04-09T18:31:23.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.104 7f3a34da5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a300e5a00 con 0x7f3a300f5550 2021-04-09T18:31:23.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.104 7f3a2e2ee700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a300e9b10 0x7f3a3009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:23.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.104 7f3a2e2ee700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a300e9b10 0x7f3a3009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58732/0 (socket says 172.21.15.79:58732) 2021-04-09T18:31:23.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.104 7f3a2e2ee700 1 -- 172.21.15.79:0/1152960498 learned_addr learned my addr 172.21.15.79:0/1152960498 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:23.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.104 7f3a2eaef700 1 --2- 172.21.15.79:0/1152960498 >> v2:172.21.15.89:3300/0 conn(0x7f3a300f5550 0x7f3a300f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:23.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.104 7f3a2e2ee700 1 -- 172.21.15.79:0/1152960498 >> v2:172.21.15.89:3300/0 conn(0x7f3a300f5550 msgr2=0x7f3a300f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:23.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.104 7f3a2e2ee700 1 --2- 172.21.15.79:0/1152960498 >> v2:172.21.15.89:3300/0 conn(0x7f3a300f5550 0x7f3a300f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:23.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.104 7f3a2e2ee700 1 -- 172.21.15.79:0/1152960498 >> v1:172.21.15.89:6789/0 conn(0x7f3a301c2de0 legacy=0x7f3a301c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:23.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.104 7f3a2e2ee700 1 -- 172.21.15.79:0/1152960498 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a300e5700 con 0x7f3a300e9b10 2021-04-09T18:31:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.104 7f3a2e2ee700 1 --2- 172.21.15.79:0/1152960498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300e9b10 0x7f3a3009f110 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f3a24002f30 tx=0x7f3a2400bd70).ready entity=mon.0 client_cookie=189e49659d5082be server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.104 7f3a2daed700 1 -- 172.21.15.79:0/1152960498 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a300e5700 con 0x7f3a300e9b10 2021-04-09T18:31:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.104 7f3a2daed700 1 -- 172.21.15.79:0/1152960498 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a24009950 con 0x7f3a300e9b10 2021-04-09T18:31:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.108 7f3a2daed700 1 -- 172.21.15.79:0/1152960498 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a24009d20 con 0x7f3a300e9b10 2021-04-09T18:31:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.108 7f3a34da5700 1 -- 172.21.15.79:0/1152960498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300e9b10 msgr2=0x7f3a3009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:23.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.108 7f3a34da5700 1 --2- 172.21.15.79:0/1152960498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300e9b10 0x7f3a3009f110 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f3a24002f30 tx=0x7f3a2400bd70).stop 2021-04-09T18:31:23.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.108 7f3a34da5700 1 -- 172.21.15.79:0/1152960498 shutdown_connections 2021-04-09T18:31:23.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.108 7f3a34da5700 1 --2- 172.21.15.79:0/1152960498 >> v2:172.21.15.89:3300/0 conn(0x7f3a300f5550 0x7f3a300f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:23.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.108 7f3a34da5700 1 --2- 172.21.15.79:0/1152960498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300e9b10 0x7f3a3009f110 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:23.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.108 7f3a34da5700 1 -- 172.21.15.79:0/1152960498 >> 172.21.15.79:0/1152960498 conn(0x7f3a300e6010 msgr2=0x7f3a300e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:23.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.108 7f3a34da5700 1 -- 172.21.15.79:0/1152960498 shutdown_connections 2021-04-09T18:31:23.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.108 7f3a34da5700 1 -- 172.21.15.79:0/1152960498 wait complete. 2021-04-09T18:31:23.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.108 7f3a34da5700 1 Processor -- start 2021-04-09T18:31:23.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.108 7f3a34da5700 1 -- start start 2021-04-09T18:31:23.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a34da5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300a7cf0 0x7f3a300badc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:23.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a34da5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a300aad60 0x7f3a300a9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:23.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a34da5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a300aa2f0 0x7f3a301aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:23.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a34da5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a300a8440 con 0x7f3a300a7cf0 2021-04-09T18:31:23.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a34da5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a300a8140 con 0x7f3a300aa2f0 2021-04-09T18:31:23.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a34da5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a300a8740 con 0x7f3a300aad60 2021-04-09T18:31:23.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a2eaef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300a7cf0 0x7f3a300badc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:23.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a2eaef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300a7cf0 0x7f3a300badc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58736/0 (socket says 172.21.15.79:58736) 2021-04-09T18:31:23.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a2eaef700 1 -- 172.21.15.79:0/2797355151 learned_addr learned my addr 172.21.15.79:0/2797355151 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:23.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a2e2ee700 1 --2- 172.21.15.79:0/2797355151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a300aad60 0x7f3a300a9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:23.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a2f2f0700 1 --2- 172.21.15.79:0/2797355151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a300aa2f0 0x7f3a301aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:23.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a2eaef700 1 -- 172.21.15.79:0/2797355151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a300aad60 msgr2=0x7f3a300a9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:23.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a2eaef700 1 --2- 172.21.15.79:0/2797355151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a300aad60 0x7f3a300a9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:23.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a2eaef700 1 -- 172.21.15.79:0/2797355151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a300aa2f0 msgr2=0x7f3a301aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:23.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a2eaef700 1 --2- 172.21.15.79:0/2797355151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a300aa2f0 0x7f3a301aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:23.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a2eaef700 1 -- 172.21.15.79:0/2797355151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a300aa740 con 0x7f3a300a7cf0 2021-04-09T18:31:23.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a2eaef700 1 --2- 172.21.15.79:0/2797355151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300a7cf0 0x7f3a300badc0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f3a30094f00 tx=0x7f3a2000c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:23.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a1f7fe700 1 -- 172.21.15.79:0/2797355151 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a300aa740 con 0x7f3a300a7cf0 2021-04-09T18:31:23.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a1f7fe700 1 -- 172.21.15.79:0/2797355151 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2000cd00 con 0x7f3a300a7cf0 2021-04-09T18:31:23.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a34da5700 1 -- 172.21.15.79:0/2797355151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a301c07e0 con 0x7f3a300a7cf0 2021-04-09T18:31:23.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a1f7fe700 1 -- 172.21.15.79:0/2797355151 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a2000f040 con 0x7f3a300a7cf0 2021-04-09T18:31:23.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a34da5700 1 -- 172.21.15.79:0/2797355151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a300ab1b0 con 0x7f3a300a7cf0 2021-04-09T18:31:23.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a1f7fe700 1 -- 172.21.15.79:0/2797355151 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3a20022060 con 0x7f3a300a7cf0 2021-04-09T18:31:23.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a1f7fe700 1 --2- 172.21.15.79:0/2797355151 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a14029100 0x7f3a1402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:23.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a1f7fe700 1 -- 172.21.15.79:0/2797355151 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5701+0+0 (secure 0 0 0) 0x7f3a20010040 con 0x7f3a300a7cf0 2021-04-09T18:31:23.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.112 7f3a2e2ee700 1 --2- 172.21.15.79:0/2797355151 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a14029100 0x7f3a1402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:23.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.116 7f3a2e2ee700 1 --2- 172.21.15.79:0/2797355151 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a14029100 0x7f3a1402b650 crc :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:23.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.120 7f3a34da5700 1 -- 172.21.15.79:0/2797355151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a300e39f0 con 0x7f3a300a7cf0 2021-04-09T18:31:23.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.128 7f3a1f7fe700 1 -- 172.21.15.79:0/2797355151 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3a2000caf0 con 0x7f3a300a7cf0 2021-04-09T18:31:23.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.292 7f3a34da5700 1 -- 172.21.15.79:0/2797355151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3a300f5b50 con 0x7f3a300a7cf0 2021-04-09T18:31:23.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:23.964 7f3a1f7fe700 1 -- 172.21.15.79:0/2797355151 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3a30107f80 con 0x7f3a300a7cf0 2021-04-09T18:31:24.007 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2021-04-09T18:31:24.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.012 7f3a34da5700 1 -- 172.21.15.79:0/2797355151 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a14029100 msgr2=0x7f3a1402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:24.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.012 7f3a34da5700 1 --2- 172.21.15.79:0/2797355151 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a14029100 0x7f3a1402b650 crc :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.012 7f3a34da5700 1 -- 172.21.15.79:0/2797355151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300a7cf0 msgr2=0x7f3a300badc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:24.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.012 7f3a34da5700 1 --2- 172.21.15.79:0/2797355151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300a7cf0 0x7f3a300badc0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f3a30094f00 tx=0x7f3a2000c430).stop 2021-04-09T18:31:24.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.012 7f3a34da5700 1 -- 172.21.15.79:0/2797355151 shutdown_connections 2021-04-09T18:31:24.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.012 7f3a34da5700 1 --2- 172.21.15.79:0/2797355151 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a14029100 0x7f3a1402b650 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.012 7f3a34da5700 1 --2- 172.21.15.79:0/2797355151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a300aa2f0 0x7f3a301aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.012 7f3a34da5700 1 --2- 172.21.15.79:0/2797355151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300a7cf0 0x7f3a300badc0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.012 7f3a34da5700 1 --2- 172.21.15.79:0/2797355151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a300aad60 0x7f3a300a9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.012 7f3a34da5700 1 -- 172.21.15.79:0/2797355151 >> 172.21.15.79:0/2797355151 conn(0x7f3a301a1350 msgr2=0x7f3a300d7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:24.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.012 7f3a34da5700 1 -- 172.21.15.79:0/2797355151 shutdown_connections 2021-04-09T18:31:24.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.012 7f3a34da5700 1 -- 172.21.15.79:0/2797355151 wait complete. 2021-04-09T18:31:24.023 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-04-09T18:31:24.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f90a5f7d700 1 Processor -- start 2021-04-09T18:31:24.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f90a5f7d700 1 -- start start 2021-04-09T18:31:24.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f90a5f7d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f90a00f5520 0x7f90a00f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:24.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f90a5f7d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f90a00e9ae0 0x7f90a009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:24.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f90a5f7d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90a01c2db0 0x7f90a01c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:24.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f90a5f7d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a00e9f30 con 0x7f90a00f5520 2021-04-09T18:31:24.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f90a5f7d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a00e59d0 con 0x7f90a00e9ae0 2021-04-09T18:31:24.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f90a5f7d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a00fbb20 con 0x7f90a01c2db0 2021-04-09T18:31:24.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f909f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f90a00f5520 0x7f90a00f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:24.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f909f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f90a00f5520 0x7f90a00f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58744/0 (socket says 172.21.15.79:58744) 2021-04-09T18:31:24.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f909f7fe700 1 -- 172.21.15.79:0/2869189911 learned_addr learned my addr 172.21.15.79:0/2869189911 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:24.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f909ffff700 1 --2- 172.21.15.79:0/2869189911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90a01c2db0 0x7f90a01c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:24.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f909effd700 1 --2- 172.21.15.79:0/2869189911 >> v2:172.21.15.89:3300/0 conn(0x7f90a00e9ae0 0x7f90a009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:24.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f909f7fe700 1 -- 172.21.15.79:0/2869189911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90a01c2db0 msgr2=0x7f90a01c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:24.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f909f7fe700 1 --2- 172.21.15.79:0/2869189911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90a01c2db0 0x7f90a01c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f909f7fe700 1 -- 172.21.15.79:0/2869189911 >> v2:172.21.15.89:3300/0 conn(0x7f90a00e9ae0 msgr2=0x7f90a009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:24.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f909f7fe700 1 --2- 172.21.15.79:0/2869189911 >> v2:172.21.15.89:3300/0 conn(0x7f90a00e9ae0 0x7f90a009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f909f7fe700 1 -- 172.21.15.79:0/2869189911 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a00e56d0 con 0x7f90a00f5520 2021-04-09T18:31:24.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f909f7fe700 1 --2- 172.21.15.79:0/2869189911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a00f5520 0x7f90a00f64b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f90a0125440 tx=0x7f908800bda0).ready entity=mon.0 client_cookie=2cef35cbe5ada25c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:24.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f909e7fc700 1 -- 172.21.15.79:0/2869189911 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90a00e56d0 con 0x7f90a00f5520 2021-04-09T18:31:24.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f909e7fc700 1 -- 172.21.15.79:0/2869189911 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9088009940 con 0x7f90a00f5520 2021-04-09T18:31:24.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f909e7fc700 1 -- 172.21.15.79:0/2869189911 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9088009d10 con 0x7f90a00f5520 2021-04-09T18:31:24.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f90a5f7d700 1 -- 172.21.15.79:0/2869189911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a00f5520 msgr2=0x7f90a00f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:24.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f90a5f7d700 1 --2- 172.21.15.79:0/2869189911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a00f5520 0x7f90a00f64b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f90a0125440 tx=0x7f908800bda0).stop 2021-04-09T18:31:24.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f90a5f7d700 1 -- 172.21.15.79:0/2869189911 shutdown_connections 2021-04-09T18:31:24.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f90a5f7d700 1 --2- 172.21.15.79:0/2869189911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90a01c2db0 0x7f90a01c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f90a5f7d700 1 --2- 172.21.15.79:0/2869189911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a00f5520 0x7f90a00f64b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f90a5f7d700 1 --2- 172.21.15.79:0/2869189911 >> v2:172.21.15.89:3300/0 conn(0x7f90a00e9ae0 0x7f90a009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f90a5f7d700 1 -- 172.21.15.79:0/2869189911 >> 172.21.15.79:0/2869189911 conn(0x7f90a00e5fe0 msgr2=0x7f90a00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:24.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f90a5f7d700 1 -- 172.21.15.79:0/2869189911 shutdown_connections 2021-04-09T18:31:24.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.124 7f90a5f7d700 1 -- 172.21.15.79:0/2869189911 wait complete. 2021-04-09T18:31:24.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.128 7f90a5f7d700 1 Processor -- start 2021-04-09T18:31:24.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.128 7f90a5f7d700 1 -- start start 2021-04-09T18:31:24.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.128 7f90a5f7d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a00b7230 0x7f90a00b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:24.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.128 7f90a5f7d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90a00b0240 0x7f90a00d4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:24.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.128 7f90a5f7d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a00b0690 0x7f90a00c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:24.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.128 7f90a5f7d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a00b7980 con 0x7f90a00b7230 2021-04-09T18:31:24.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.128 7f90a5f7d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a00b7680 con 0x7f90a00b0690 2021-04-09T18:31:24.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.128 7f90a5f7d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a00b1210 con 0x7f90a00b0240 2021-04-09T18:31:24.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.128 7f909f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a00b7230 0x7f90a00b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:24.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.128 7f909f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a00b7230 0x7f90a00b0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58752/0 (socket says 172.21.15.79:58752) 2021-04-09T18:31:24.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.128 7f909f7fe700 1 -- 172.21.15.79:0/357911026 learned_addr learned my addr 172.21.15.79:0/357911026 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:24.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.128 7f909ffff700 1 --2- 172.21.15.79:0/357911026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a00b0690 0x7f90a00c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:24.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.128 7f909effd700 1 --2- 172.21.15.79:0/357911026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90a00b0240 0x7f90a00d4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:24.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.128 7f909f7fe700 1 -- 172.21.15.79:0/357911026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90a00b0240 msgr2=0x7f90a00d4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:24.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.128 7f909f7fe700 1 --2- 172.21.15.79:0/357911026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90a00b0240 0x7f90a00d4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.128 7f909f7fe700 1 -- 172.21.15.79:0/357911026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a00b0690 msgr2=0x7f90a00c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:24.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.128 7f909f7fe700 1 --2- 172.21.15.79:0/357911026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a00b0690 0x7f90a00c3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.128 7f909f7fe700 1 -- 172.21.15.79:0/357911026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a00c18b0 con 0x7f90a00b7230 2021-04-09T18:31:24.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.128 7f909f7fe700 1 --2- 172.21.15.79:0/357911026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a00b7230 0x7f90a00b0be0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f90a009b500 tx=0x7f9088006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.132 7f9097fff700 1 -- 172.21.15.79:0/357911026 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90a00c18b0 con 0x7f90a00b7230 2021-04-09T18:31:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.132 7f9097fff700 1 -- 172.21.15.79:0/357911026 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9088011ce0 con 0x7f90a00b7230 2021-04-09T18:31:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.132 7f90a5f7d700 1 -- 172.21.15.79:0/357911026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a00d5580 con 0x7f90a00b7230 2021-04-09T18:31:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.132 7f9097fff700 1 -- 172.21.15.79:0/357911026 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f908801d640 con 0x7f90a00b7230 2021-04-09T18:31:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.132 7f90a5f7d700 1 -- 172.21.15.79:0/357911026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a00c3b70 con 0x7f90a00b7230 2021-04-09T18:31:24.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.132 7f9097fff700 1 -- 172.21.15.79:0/357911026 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9088028060 con 0x7f90a00b7230 2021-04-09T18:31:24.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.132 7f9097fff700 1 --2- 172.21.15.79:0/357911026 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9078029100 0x7f907802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:24.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.132 7f9097fff700 1 -- 172.21.15.79:0/357911026 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5319+0+0 (secure 0 0 0) 0x7f908803ba20 con 0x7f90a00b7230 2021-04-09T18:31:24.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.132 7f909effd700 1 --2- 172.21.15.79:0/357911026 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9078029100 0x7f907802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:24.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.132 7f909effd700 1 --2- 172.21.15.79:0/357911026 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9078029100 0x7f907802b650 crc :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:24.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.136 7f90a5f7d700 1 -- 172.21.15.79:0/357911026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a00e39e0 con 0x7f90a00b7230 2021-04-09T18:31:24.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.144 7f9097fff700 1 -- 172.21.15.79:0/357911026 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9088011ad0 con 0x7f90a00b7230 2021-04-09T18:31:24.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.336 7f90a5f7d700 1 -- 172.21.15.79:0/357911026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f90a00f5b20 con 0x7f90a00b7230 2021-04-09T18:31:24.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.340 7f9097fff700 1 -- 172.21.15.79:0/357911026 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9088009730 con 0x7f90a00b7230 2021-04-09T18:31:24.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.348 7f90a5f7d700 1 -- 172.21.15.79:0/357911026 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9078029100 msgr2=0x7f907802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:24.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.348 7f90a5f7d700 1 --2- 172.21.15.79:0/357911026 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9078029100 0x7f907802b650 crc :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.348 7f90a5f7d700 1 -- 172.21.15.79:0/357911026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a00b7230 msgr2=0x7f90a00b0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:24.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.348 7f90a5f7d700 1 --2- 172.21.15.79:0/357911026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a00b7230 0x7f90a00b0be0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f90a009b500 tx=0x7f9088006890).stop 2021-04-09T18:31:24.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.348 7f90a5f7d700 1 -- 172.21.15.79:0/357911026 shutdown_connections 2021-04-09T18:31:24.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.348 7f90a5f7d700 1 --2- 172.21.15.79:0/357911026 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9078029100 0x7f907802b650 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.348 7f90a5f7d700 1 --2- 172.21.15.79:0/357911026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a00b0690 0x7f90a00c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.348 7f90a5f7d700 1 --2- 172.21.15.79:0/357911026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a00b7230 0x7f90a00b0be0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.348 7f90a5f7d700 1 --2- 172.21.15.79:0/357911026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90a00b0240 0x7f90a00d4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.348 7f90a5f7d700 1 -- 172.21.15.79:0/357911026 >> 172.21.15.79:0/357911026 conn(0x7f90a00a24c0 msgr2=0x7f90a00d82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:24.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.348 7f90a5f7d700 1 -- 172.21.15.79:0/357911026 shutdown_connections 2021-04-09T18:31:24.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.348 7f90a5f7d700 1 -- 172.21.15.79:0/357911026 wait complete. 2021-04-09T18:31:24.359 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2021-04-09T18:31:24.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9b5757700 1 Processor -- start 2021-04-09T18:31:24.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9b5757700 1 -- start start 2021-04-09T18:31:24.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9b5757700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa9b00f5520 0x7fa9b00f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:24.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9b5757700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b00e9ae0 0x7fa9b009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:24.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9b5757700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b00fbb20 con 0x7fa9b01c2db0 2021-04-09T18:31:24.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9b5757700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b00e9f30 con 0x7fa9b00f5520 2021-04-09T18:31:24.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9b5757700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b00e59d0 con 0x7fa9b00e9ae0 2021-04-09T18:31:24.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9af4f5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa9b00f5520 0x7fa9b00f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:24.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9afcf6700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa9b01c2db0 0x7fa9b01c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53472/0 (socket says 172.21.15.79:53472) 2021-04-09T18:31:24.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9afcf6700 1 -- 172.21.15.79:0/2253293599 learned_addr learned my addr 172.21.15.79:0/2253293599 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:24.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9aecf4700 1 --2- 172.21.15.79:0/2253293599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b00e9ae0 0x7fa9b009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:24.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9af4f5700 1 -- 172.21.15.79:0/2253293599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b00e9ae0 msgr2=0x7fa9b009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:24.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9af4f5700 1 --2- 172.21.15.79:0/2253293599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b00e9ae0 0x7fa9b009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9af4f5700 1 -- 172.21.15.79:0/2253293599 >> v1:172.21.15.79:6789/0 conn(0x7fa9b01c2db0 legacy=0x7fa9b01c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:24.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9ae4f3700 1 -- 172.21.15.79:0/2253293599 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522415778 0 0) 0x7fa9a8001450 con 0x7fa9b01c2db0 2021-04-09T18:31:24.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9af4f5700 1 -- 172.21.15.79:0/2253293599 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b00e56d0 con 0x7fa9b00f5520 2021-04-09T18:31:24.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9af4f5700 1 --2- 172.21.15.79:0/2253293599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b00f5520 0x7fa9b00f64b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fa9a0002f30 tx=0x7fa9a000bd40).ready entity=mon.0 client_cookie=48691bbd37950c81 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:24.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9ae4f3700 1 -- 172.21.15.79:0/2253293599 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa9b00e56d0 con 0x7fa9b00f5520 2021-04-09T18:31:24.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9ae4f3700 1 -- 172.21.15.79:0/2253293599 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a0009850 con 0x7fa9b00f5520 2021-04-09T18:31:24.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9b5757700 1 -- 172.21.15.79:0/2253293599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b00f5520 msgr2=0x7fa9b00f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:24.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9ae4f3700 1 -- 172.21.15.79:0/2253293599 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa9a0009c20 con 0x7fa9b00f5520 2021-04-09T18:31:24.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.452 7fa9b5757700 1 --2- 172.21.15.79:0/2253293599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b00f5520 0x7fa9b00f64b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fa9a0002f30 tx=0x7fa9a000bd40).stop 2021-04-09T18:31:24.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.456 7fa9b5757700 1 -- 172.21.15.79:0/2253293599 shutdown_connections 2021-04-09T18:31:24.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.456 7fa9b5757700 1 --2- 172.21.15.79:0/2253293599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b00f5520 0x7fa9b00f64b0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.456 7fa9b5757700 1 --2- 172.21.15.79:0/2253293599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b00e9ae0 0x7fa9b009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.456 7fa9b5757700 1 -- 172.21.15.79:0/2253293599 >> 172.21.15.79:0/2253293599 conn(0x7fa9b00e5fe0 msgr2=0x7fa9b00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:24.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.456 7fa9b5757700 1 -- 172.21.15.79:0/2253293599 shutdown_connections 2021-04-09T18:31:24.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.456 7fa9b5757700 1 -- 172.21.15.79:0/2253293599 wait complete. 2021-04-09T18:31:24.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.456 7fa9b5757700 1 Processor -- start 2021-04-09T18:31:24.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.456 7fa9b5757700 1 -- start start 2021-04-09T18:31:24.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.456 7fa9b5757700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9b01adc50 0x7fa9b00bad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:24.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.456 7fa9b5757700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b00d49f0 0x7fa9b00d4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:24.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.456 7fa9b5757700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b00ad3e0 0x7fa9b00ad830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:24.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.456 7fa9b5757700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b0098ca0 con 0x7fa9b00d49f0 2021-04-09T18:31:24.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.456 7fa9b5757700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b00c3c70 con 0x7fa9b01adc50 2021-04-09T18:31:24.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.456 7fa9b5757700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b0098830 con 0x7fa9b00ad3e0 2021-04-09T18:31:24.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.456 7fa9aecf4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b00d49f0 0x7fa9b00d4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.456 7fa9aecf4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b00d49f0 0x7fa9b00d4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58766/0 (socket says 172.21.15.79:58766) 2021-04-09T18:31:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.456 7fa9aecf4700 1 -- 172.21.15.79:0/1252334620 learned_addr learned my addr 172.21.15.79:0/1252334620 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.456 7fa9afcf6700 1 --2- 172.21.15.79:0/1252334620 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b00ad3e0 0x7fa9b00ad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.456 7fa9af4f5700 1 --2- 172.21.15.79:0/1252334620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9b01adc50 0x7fa9b00bad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.460 7fa9aecf4700 1 -- 172.21.15.79:0/1252334620 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b00ad3e0 msgr2=0x7fa9b00ad830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:24.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.460 7fa9aecf4700 1 --2- 172.21.15.79:0/1252334620 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b00ad3e0 0x7fa9b00ad830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.460 7fa9aecf4700 1 -- 172.21.15.79:0/1252334620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9b01adc50 msgr2=0x7fa9b00bad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:24.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.460 7fa9aecf4700 1 --2- 172.21.15.79:0/1252334620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9b01adc50 0x7fa9b00bad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.460 7fa9aecf4700 1 -- 172.21.15.79:0/1252334620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b00bb380 con 0x7fa9b00d49f0 2021-04-09T18:31:24.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.460 7fa9af4f5700 1 --2- 172.21.15.79:0/1252334620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9b01adc50 0x7fa9b00bad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.460 7fa9aecf4700 1 --2- 172.21.15.79:0/1252334620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b00d49f0 0x7fa9b00d4e40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fa9a400c000 tx=0x7fa9a400ef70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.460 7fa997fff700 1 -- 172.21.15.79:0/1252334620 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa9b00bb380 con 0x7fa9b00d49f0 2021-04-09T18:31:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.460 7fa997fff700 1 -- 172.21.15.79:0/1252334620 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a400cb80 con 0x7fa9b00d49f0 2021-04-09T18:31:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.460 7fa9b5757700 1 -- 172.21.15.79:0/1252334620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b0096280 con 0x7fa9b00d49f0 2021-04-09T18:31:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.460 7fa997fff700 1 -- 172.21.15.79:0/1252334620 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa9a400f040 con 0x7fa9b00d49f0 2021-04-09T18:31:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.460 7fa9b5757700 1 -- 172.21.15.79:0/1252334620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b00967b0 con 0x7fa9b00d49f0 2021-04-09T18:31:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.460 7fa997fff700 1 -- 172.21.15.79:0/1252334620 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa9a4011450 con 0x7fa9b00d49f0 2021-04-09T18:31:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.460 7fa997fff700 1 --2- 172.21.15.79:0/1252334620 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa990029100 0x7fa99002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.460 7fa997fff700 1 -- 172.21.15.79:0/1252334620 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5319+0+0 (secure 0 0 0) 0x7fa9a403b350 con 0x7fa9b00d49f0 2021-04-09T18:31:24.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.460 7fa9af4f5700 1 --2- 172.21.15.79:0/1252334620 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa990029100 0x7fa99002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:24.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.460 7fa9af4f5700 1 --2- 172.21.15.79:0/1252334620 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa990029100 0x7fa99002b650 crc :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:24.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.464 7fa9b5757700 1 -- 172.21.15.79:0/1252334620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b00e39e0 con 0x7fa9b00d49f0 2021-04-09T18:31:24.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.472 7fa997fff700 1 -- 172.21.15.79:0/1252334620 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa9a4000bf0 con 0x7fa9b00d49f0 2021-04-09T18:31:24.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.628 7fa9b5757700 1 -- 172.21.15.79:0/1252334620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7fa9b00f5b20 con 0x7fa9b00d49f0 2021-04-09T18:31:24.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.976 7fa997fff700 1 -- 172.21.15.79:0/1252334620 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v135) v1 ==== 152+0+0 (secure 0 0 0) 0x7fa9a400c780 con 0x7fa9b00d49f0 2021-04-09T18:31:24.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.996 7fa9b5757700 1 -- 172.21.15.79:0/1252334620 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa990029100 msgr2=0x7fa99002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:24.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.996 7fa9b5757700 1 --2- 172.21.15.79:0/1252334620 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa990029100 0x7fa99002b650 crc :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.996 7fa9b5757700 1 -- 172.21.15.79:0/1252334620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b00d49f0 msgr2=0x7fa9b00d4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.996 7fa9b5757700 1 --2- 172.21.15.79:0/1252334620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b00d49f0 0x7fa9b00d4e40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fa9a400c000 tx=0x7fa9a400ef70).stop 2021-04-09T18:31:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.996 7fa9b5757700 1 -- 172.21.15.79:0/1252334620 shutdown_connections 2021-04-09T18:31:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.996 7fa9b5757700 1 --2- 172.21.15.79:0/1252334620 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa990029100 0x7fa99002b650 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.996 7fa9b5757700 1 --2- 172.21.15.79:0/1252334620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9b01adc50 0x7fa9b00bad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.996 7fa9b5757700 1 --2- 172.21.15.79:0/1252334620 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b00ad3e0 0x7fa9b00ad830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.996 7fa9b5757700 1 --2- 172.21.15.79:0/1252334620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b00d49f0 0x7fa9b00d4e40 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.996 7fa9b5757700 1 -- 172.21.15.79:0/1252334620 >> 172.21.15.79:0/1252334620 conn(0x7fa9b00afec0 msgr2=0x7fa9b00a6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.996 7fa9b5757700 1 -- 172.21.15.79:0/1252334620 shutdown_connections 2021-04-09T18:31:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:24.996 7fa9b5757700 1 -- 172.21.15.79:0/1252334620 wait complete. 2021-04-09T18:31:25.016 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-04-09T18:31:25.017 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2021-04-09T18:31:25.017 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2021-04-09T18:31:25.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.116 7fc9d6cbc700 1 Processor -- start 2021-04-09T18:31:25.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.116 7fc9d6cbc700 1 -- start start 2021-04-09T18:31:25.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.116 7fc9d6cbc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc9d00f5520 0x7fc9d00f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:25.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.116 7fc9d6cbc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9d00e9ae0 0x7fc9d009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:25.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.116 7fc9d6cbc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d00fbb20 con 0x7fc9d01c2db0 2021-04-09T18:31:25.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.116 7fc9d6cbc700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d00e9f30 con 0x7fc9d00f5520 2021-04-09T18:31:25.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.116 7fc9d6cbc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00e59d0 con 0x7fc9d00e9ae0 2021-04-09T18:31:25.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.116 7fc9d4a60700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc9d00f5520 0x7fc9d00f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:25.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.116 7fc9cffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9d00e9ae0 0x7fc9d009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:25.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.116 7fc9cffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9d00e9ae0 0x7fc9d009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:55770/0 (socket says 172.21.15.79:55770) 2021-04-09T18:31:25.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.116 7fc9d4a60700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc9d00f5520 0x7fc9d00f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:47114/0 (socket says 172.21.15.79:47114) 2021-04-09T18:31:25.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.116 7fc9cffff700 1 -- 172.21.15.79:0/414296775 learned_addr learned my addr 172.21.15.79:0/414296775 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:25.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.120 7fc9d4a60700 1 -- 172.21.15.79:0/414296775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9d00e9ae0 msgr2=0x7fc9d009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:25.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.120 7fc9d4a60700 1 --2- 172.21.15.79:0/414296775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9d00e9ae0 0x7fc9d009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:25.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.120 7fc9d4a60700 1 -- 172.21.15.79:0/414296775 >> v1:172.21.15.89:6789/0 conn(0x7fc9d01c2db0 legacy=0x7fc9d01c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:25.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.120 7fc9d4a60700 1 -- 172.21.15.79:0/414296775 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d00e56d0 con 0x7fc9d00f5520 2021-04-09T18:31:25.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.120 7fc9d4a60700 1 --2- 172.21.15.79:0/414296775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9d00f5520 0x7fc9d00f64b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fc9c0002f30 tx=0x7fc9c000bd40).ready entity=mon.1 client_cookie=7a2d8c6120023e41 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:25.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.120 7fc9cf7fe700 1 -- 172.21.15.79:0/414296775 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc9d00e56d0 con 0x7fc9d00f5520 2021-04-09T18:31:25.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.120 7fc9cf7fe700 1 -- 172.21.15.79:0/414296775 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c0009850 con 0x7fc9d00f5520 2021-04-09T18:31:25.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.120 7fc9cf7fe700 1 -- 172.21.15.79:0/414296775 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc9c0009c60 con 0x7fc9d00f5520 2021-04-09T18:31:25.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.120 7fc9d6cbc700 1 -- 172.21.15.79:0/414296775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9d00f5520 msgr2=0x7fc9d00f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:25.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.120 7fc9d6cbc700 1 --2- 172.21.15.79:0/414296775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9d00f5520 0x7fc9d00f64b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fc9c0002f30 tx=0x7fc9c000bd40).stop 2021-04-09T18:31:25.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.120 7fc9d6cbc700 1 -- 172.21.15.79:0/414296775 shutdown_connections 2021-04-09T18:31:25.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.120 7fc9d6cbc700 1 --2- 172.21.15.79:0/414296775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9d00f5520 0x7fc9d00f64b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:25.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.120 7fc9d6cbc700 1 --2- 172.21.15.79:0/414296775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9d00e9ae0 0x7fc9d009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:25.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.120 7fc9d6cbc700 1 -- 172.21.15.79:0/414296775 >> 172.21.15.79:0/414296775 conn(0x7fc9d00e5fe0 msgr2=0x7fc9d00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:25.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.120 7fc9d6cbc700 1 -- 172.21.15.79:0/414296775 shutdown_connections 2021-04-09T18:31:25.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.120 7fc9d6cbc700 1 -- 172.21.15.79:0/414296775 wait complete. 2021-04-09T18:31:25.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9d6cbc700 1 Processor -- start 2021-04-09T18:31:25.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9d6cbc700 1 -- start start 2021-04-09T18:31:25.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9d6cbc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9d00b7120 0x7fc9d00d5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:25.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9d6cbc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9d00d56b0 0x7fc9d01af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:25.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9d6cbc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9d01af710 0x7fc9d01afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:25.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9d6cbc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00b7870 con 0x7fc9d00b7120 2021-04-09T18:31:25.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9d6cbc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00b0240 con 0x7fc9d00d56b0 2021-04-09T18:31:25.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9d6cbc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00c3460 con 0x7fc9d01af710 2021-04-09T18:31:25.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9d4a60700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9d00b7120 0x7fc9d00d5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:25.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9d4a60700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9d00b7120 0x7fc9d00d5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58778/0 (socket says 172.21.15.79:58778) 2021-04-09T18:31:25.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9d4a60700 1 -- 172.21.15.79:0/1914314652 learned_addr learned my addr 172.21.15.79:0/1914314652 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:25.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9cffff700 1 --2- 172.21.15.79:0/1914314652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9d00d56b0 0x7fc9d01af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:25.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9d5261700 1 --2- 172.21.15.79:0/1914314652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9d01af710 0x7fc9d01afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:25.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9d4a60700 1 -- 172.21.15.79:0/1914314652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9d01af710 msgr2=0x7fc9d01afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:25.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9d4a60700 1 --2- 172.21.15.79:0/1914314652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9d01af710 0x7fc9d01afb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:25.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9d4a60700 1 -- 172.21.15.79:0/1914314652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9d00d56b0 msgr2=0x7fc9d01af0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:25.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9d4a60700 1 --2- 172.21.15.79:0/1914314652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9d00d56b0 0x7fc9d01af0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:25.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9d4a60700 1 -- 172.21.15.79:0/1914314652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d00c3690 con 0x7fc9d00b7120 2021-04-09T18:31:25.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9d4a60700 1 --2- 172.21.15.79:0/1914314652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9d00b7120 0x7fc9d00d5080 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fc9d00b7090 tx=0x7fc9c0006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:25.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9cd7fa700 1 -- 172.21.15.79:0/1914314652 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc9d00c3690 con 0x7fc9d00b7120 2021-04-09T18:31:25.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9cd7fa700 1 -- 172.21.15.79:0/1914314652 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c0011c50 con 0x7fc9d00b7120 2021-04-09T18:31:25.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9d6cbc700 1 -- 172.21.15.79:0/1914314652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d00c3950 con 0x7fc9d00b7120 2021-04-09T18:31:25.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9cd7fa700 1 -- 172.21.15.79:0/1914314652 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc9c001d630 con 0x7fc9d00b7120 2021-04-09T18:31:25.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.124 7fc9d6cbc700 1 -- 172.21.15.79:0/1914314652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d00c3da0 con 0x7fc9d00b7120 2021-04-09T18:31:25.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.128 7fc9cd7fa700 1 -- 172.21.15.79:0/1914314652 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc9c0026450 con 0x7fc9d00b7120 2021-04-09T18:31:25.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.128 7fc9cd7fa700 1 --2- 172.21.15.79:0/1914314652 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc9b4029100 0x7fc9b402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:25.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.128 7fc9cd7fa700 1 -- 172.21.15.79:0/1914314652 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5319+0+0 (secure 0 0 0) 0x7fc9c003ac80 con 0x7fc9d00b7120 2021-04-09T18:31:25.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.128 7fc9cffff700 1 --2- 172.21.15.79:0/1914314652 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc9b4029100 0x7fc9b402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:25.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.128 7fc9cffff700 1 --2- 172.21.15.79:0/1914314652 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc9b4029100 0x7fc9b402b650 crc :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:25.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.132 7fc9d6cbc700 1 -- 172.21.15.79:0/1914314652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d00e39e0 con 0x7fc9d00b7120 2021-04-09T18:31:25.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.140 7fc9cd7fa700 1 -- 172.21.15.79:0/1914314652 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc9c0011a40 con 0x7fc9d00b7120 2021-04-09T18:31:25.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.308 7fc9d6cbc700 1 -- 172.21.15.79:0/1914314652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7fc9d00f5b20 con 0x7fc9d00b7120 2021-04-09T18:31:25.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:25.980 7fc9cd7fa700 1 -- 172.21.15.79:0/1914314652 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v136) v1 ==== 150+0+0 (secure 0 0 0) 0x7fc9c0009640 con 0x7fc9d00b7120 2021-04-09T18:31:26.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.028 7fc9d6cbc700 1 -- 172.21.15.79:0/1914314652 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc9b4029100 msgr2=0x7fc9b402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:26.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.028 7fc9d6cbc700 1 --2- 172.21.15.79:0/1914314652 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc9b4029100 0x7fc9b402b650 crc :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.028 7fc9d6cbc700 1 -- 172.21.15.79:0/1914314652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9d00b7120 msgr2=0x7fc9d00d5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:26.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.028 7fc9d6cbc700 1 --2- 172.21.15.79:0/1914314652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9d00b7120 0x7fc9d00d5080 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fc9d00b7090 tx=0x7fc9c0006890).stop 2021-04-09T18:31:26.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.028 7fc9d6cbc700 1 -- 172.21.15.79:0/1914314652 shutdown_connections 2021-04-09T18:31:26.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.028 7fc9d6cbc700 1 --2- 172.21.15.79:0/1914314652 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc9b4029100 0x7fc9b402b650 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.028 7fc9d6cbc700 1 --2- 172.21.15.79:0/1914314652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9d01af710 0x7fc9d01afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.028 7fc9d6cbc700 1 --2- 172.21.15.79:0/1914314652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9d00b7120 0x7fc9d00d5080 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.028 7fc9d6cbc700 1 --2- 172.21.15.79:0/1914314652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9d00d56b0 0x7fc9d01af0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.028 7fc9d6cbc700 1 -- 172.21.15.79:0/1914314652 >> 172.21.15.79:0/1914314652 conn(0x7fc9d00a24c0 msgr2=0x7fc9d00d82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:26.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.028 7fc9d6cbc700 1 -- 172.21.15.79:0/1914314652 shutdown_connections 2021-04-09T18:31:26.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.028 7fc9d6cbc700 1 -- 172.21.15.79:0/1914314652 wait complete. 2021-04-09T18:31:26.044 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-04-09T18:31:26.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.140 7f7838f1c700 1 Processor -- start 2021-04-09T18:31:26.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.140 7f7838f1c700 1 -- start start 2021-04-09T18:31:26.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f7838f1c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f78340f5550 0x7f78340f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:26.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f7838f1c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78341c8040 0x7f78341ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:26.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f7838f1c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78340fbb50 con 0x7f78340e9b10 2021-04-09T18:31:26.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f7838f1c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78340e9f60 con 0x7f78340f5550 2021-04-09T18:31:26.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f7838f1c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78341c3df0 con 0x7f78341c8040 2021-04-09T18:31:26.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f78332f0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78341c8040 0x7f78341ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:26.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f7832aef700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f78340f5550 0x7f78340f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:26.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f78332f0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78341c8040 0x7f78341ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:55786/0 (socket says 172.21.15.79:55786) 2021-04-09T18:31:26.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f78332f0700 1 -- 172.21.15.79:0/4228140242 learned_addr learned my addr 172.21.15.79:0/4228140242 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:26.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f78322ee700 1 --1- 172.21.15.79:0/4228140242 >> v1:172.21.15.89:6789/0 conn(0x7f78340e9b10 0x7f783409f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:53968/0 (socket says 172.21.15.79:53968) 2021-04-09T18:31:26.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f7832aef700 1 -- 172.21.15.79:0/4228140242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78341c8040 msgr2=0x7f78341ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:26.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f7832aef700 1 --2- 172.21.15.79:0/4228140242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78341c8040 0x7f78341ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f7832aef700 1 -- 172.21.15.79:0/4228140242 >> v1:172.21.15.89:6789/0 conn(0x7f78340e9b10 legacy=0x7f783409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:26.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f7831aed700 1 -- 172.21.15.79:0/4228140242 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684864442 0 0) 0x7f78280010d0 con 0x7f78340e9b10 2021-04-09T18:31:26.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f7832aef700 1 -- 172.21.15.79:0/4228140242 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783409f910 con 0x7f78340f5550 2021-04-09T18:31:26.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f78332f0700 1 --2- 172.21.15.79:0/4228140242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78341c8040 0x7f78341ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:26.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f7832aef700 1 --2- 172.21.15.79:0/4228140242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78340f5550 0x7f78340f64e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f78340f6f30 tx=0x7f782400b3c0).ready entity=mon.1 client_cookie=2e8256a22402a3d5 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:26.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f7831aed700 1 -- 172.21.15.79:0/4228140242 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f783409f910 con 0x7f78340f5550 2021-04-09T18:31:26.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f7831aed700 1 -- 172.21.15.79:0/4228140242 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782400bbe0 con 0x7f78340f5550 2021-04-09T18:31:26.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f7831aed700 1 -- 172.21.15.79:0/4228140242 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7824002020 con 0x7f78340f5550 2021-04-09T18:31:26.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f7838f1c700 1 -- 172.21.15.79:0/4228140242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78340f5550 msgr2=0x7f78340f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:26.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.144 7f7838f1c700 1 --2- 172.21.15.79:0/4228140242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78340f5550 0x7f78340f64e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f78340f6f30 tx=0x7f782400b3c0).stop 2021-04-09T18:31:26.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.148 7f7838f1c700 1 -- 172.21.15.79:0/4228140242 shutdown_connections 2021-04-09T18:31:26.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.148 7f7838f1c700 1 --2- 172.21.15.79:0/4228140242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78341c8040 0x7f78341ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.148 7f7838f1c700 1 --2- 172.21.15.79:0/4228140242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78340f5550 0x7f78340f64e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.148 7f7838f1c700 1 -- 172.21.15.79:0/4228140242 >> 172.21.15.79:0/4228140242 conn(0x7f78340e6010 msgr2=0x7f78340e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:26.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.148 7f7838f1c700 1 -- 172.21.15.79:0/4228140242 shutdown_connections 2021-04-09T18:31:26.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.148 7f7838f1c700 1 -- 172.21.15.79:0/4228140242 wait complete. 2021-04-09T18:31:26.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.148 7f7838f1c700 1 Processor -- start 2021-04-09T18:31:26.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f7838f1c700 1 -- start start 2021-04-09T18:31:26.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f7838f1c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78340c4ad0 0x7f78340b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:26.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f7838f1c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78340c11d0 0x7f7834095870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:26.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f7838f1c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78340d4cb0 0x7f78340d5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:26.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f7838f1c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78340b7460 con 0x7f78340c4ad0 2021-04-09T18:31:26.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f7838f1c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78340b7760 con 0x7f78340d4cb0 2021-04-09T18:31:26.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f7838f1c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78340c1620 con 0x7f78340c11d0 2021-04-09T18:31:26.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f7832aef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78340c4ad0 0x7f78340b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:26.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f7832aef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78340c4ad0 0x7f78340b6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58792/0 (socket says 172.21.15.79:58792) 2021-04-09T18:31:26.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f7832aef700 1 -- 172.21.15.79:0/2426768328 learned_addr learned my addr 172.21.15.79:0/2426768328 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:26.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f78322ee700 1 --2- 172.21.15.79:0/2426768328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78340c11d0 0x7f7834095870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:26.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f78332f0700 1 --2- 172.21.15.79:0/2426768328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78340d4cb0 0x7f78340d5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:26.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f7832aef700 1 -- 172.21.15.79:0/2426768328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78340c11d0 msgr2=0x7f7834095870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:26.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f7832aef700 1 --2- 172.21.15.79:0/2426768328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78340c11d0 0x7f7834095870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f7832aef700 1 -- 172.21.15.79:0/2426768328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78340d4cb0 msgr2=0x7f78340d5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:26.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f7832aef700 1 --2- 172.21.15.79:0/2426768328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78340d4cb0 0x7f78340d5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f7832aef700 1 -- 172.21.15.79:0/2426768328 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7834095ea0 con 0x7f78340c4ad0 2021-04-09T18:31:26.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f7832aef700 1 --2- 172.21.15.79:0/2426768328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78340c4ad0 0x7f78340b6ca0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f78340b73e0 tx=0x7f7824006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:26.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f78237fe700 1 -- 172.21.15.79:0/2426768328 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7834095ea0 con 0x7f78340c4ad0 2021-04-09T18:31:26.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f78237fe700 1 -- 172.21.15.79:0/2426768328 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782401f020 con 0x7f78340c4ad0 2021-04-09T18:31:26.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f7838f1c700 1 -- 172.21.15.79:0/2426768328 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78340c2f90 con 0x7f78340c4ad0 2021-04-09T18:31:26.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f78237fe700 1 -- 172.21.15.79:0/2426768328 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f782401b830 con 0x7f78340c4ad0 2021-04-09T18:31:26.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f7838f1c700 1 -- 172.21.15.79:0/2426768328 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78340c3440 con 0x7f78340c4ad0 2021-04-09T18:31:26.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f78237fe700 1 -- 172.21.15.79:0/2426768328 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f782400b0e0 con 0x7f78340c4ad0 2021-04-09T18:31:26.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f78237fe700 1 --2- 172.21.15.79:0/2426768328 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7818029100 0x7f781802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:26.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f78237fe700 1 -- 172.21.15.79:0/2426768328 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5319+0+0 (secure 0 0 0) 0x7f782403b6d0 con 0x7f78340c4ad0 2021-04-09T18:31:26.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.152 7f78322ee700 1 --2- 172.21.15.79:0/2426768328 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7818029100 0x7f781802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:26.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.156 7f78322ee700 1 --2- 172.21.15.79:0/2426768328 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7818029100 0x7f781802b650 crc :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:26.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.156 7f7838f1c700 1 -- 172.21.15.79:0/2426768328 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78340e39f0 con 0x7f78340c4ad0 2021-04-09T18:31:26.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.160 7f78237fe700 1 -- 172.21.15.79:0/2426768328 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f782400b9d0 con 0x7f78340c4ad0 2021-04-09T18:31:26.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.344 7f7838f1c700 1 -- 172.21.15.79:0/2426768328 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f78340f5b50 con 0x7f78340c4ad0 2021-04-09T18:31:26.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.348 7f78237fe700 1 -- 172.21.15.79:0/2426768328 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f782401b430 con 0x7f78340c4ad0 2021-04-09T18:31:26.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.352 7f7838f1c700 1 -- 172.21.15.79:0/2426768328 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7818029100 msgr2=0x7f781802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:26.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.352 7f7838f1c700 1 --2- 172.21.15.79:0/2426768328 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7818029100 0x7f781802b650 crc :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.352 7f7838f1c700 1 -- 172.21.15.79:0/2426768328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78340c4ad0 msgr2=0x7f78340b6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:26.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.352 7f7838f1c700 1 --2- 172.21.15.79:0/2426768328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78340c4ad0 0x7f78340b6ca0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f78340b73e0 tx=0x7f7824006c10).stop 2021-04-09T18:31:26.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.352 7f7838f1c700 1 -- 172.21.15.79:0/2426768328 shutdown_connections 2021-04-09T18:31:26.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.352 7f7838f1c700 1 --2- 172.21.15.79:0/2426768328 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7818029100 0x7f781802b650 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.352 7f7838f1c700 1 --2- 172.21.15.79:0/2426768328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78340d4cb0 0x7f78340d5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.352 7f7838f1c700 1 --2- 172.21.15.79:0/2426768328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78340c4ad0 0x7f78340b6ca0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.352 7f7838f1c700 1 --2- 172.21.15.79:0/2426768328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78340c11d0 0x7f7834095870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.352 7f7838f1c700 1 -- 172.21.15.79:0/2426768328 >> 172.21.15.79:0/2426768328 conn(0x7f7834099f90 msgr2=0x7f7834099490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:26.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.352 7f7838f1c700 1 -- 172.21.15.79:0/2426768328 shutdown_connections 2021-04-09T18:31:26.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.352 7f7838f1c700 1 -- 172.21.15.79:0/2426768328 wait complete. 2021-04-09T18:31:26.364 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:31:26.364 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:31:26.383 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:31:26.402 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:31:26.421 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:31:26.439 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:31:26.458 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:31:26.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:26.459 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:31:26.459 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:31:26.470 INFO:teuthology.orchestra.run.smithi090.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-04-09T18:31:26.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:31:26.471 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-04-09T18:31:26.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:26.472 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:31:26.473 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:31:26.492 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-04-09T18:31:26.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:31:26.494 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-04-09T18:31:26.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:26.495 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:31:26.495 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:31:26.506 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:31:26.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:31:26.507 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:31:26.508 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:31:26.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.604 7f855a09e700 1 Processor -- start 2021-04-09T18:31:26.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.604 7f855a09e700 1 -- start start 2021-04-09T18:31:26.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.604 7f855a09e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85540f5510 0x7f85540f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:26.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.604 7f855a09e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f85540e9ad0 0x7f855409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:26.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.604 7f855a09e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f85541c2da0 0x7f85541c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:26.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.604 7f855a09e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85540e9f20 con 0x7f85541c2da0 2021-04-09T18:31:26.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.604 7f855a09e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85540e59c0 con 0x7f85540e9ad0 2021-04-09T18:31:26.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.604 7f855a09e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85540fbb10 con 0x7f85540f5510 2021-04-09T18:31:26.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.604 7f8553fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f85541c2da0 0x7f85541c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:26.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.604 7f8553fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f85541c2da0 0x7f85541c31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58804/0 (socket says 172.21.15.79:58804) 2021-04-09T18:31:26.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.604 7f8553fff700 1 -- 172.21.15.79:0/2928383311 learned_addr learned my addr 172.21.15.79:0/2928383311 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:26.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.604 7f85537fe700 1 --2- 172.21.15.79:0/2928383311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85540f5510 0x7f85540f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:26.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.604 7f8552ffd700 1 --2- 172.21.15.79:0/2928383311 >> v2:172.21.15.89:3300/0 conn(0x7f85540e9ad0 0x7f855409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:26.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.608 7f8553fff700 1 -- 172.21.15.79:0/2928383311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85540f5510 msgr2=0x7f85540f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:26.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.608 7f8553fff700 1 --2- 172.21.15.79:0/2928383311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85540f5510 0x7f85540f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.608 7f8553fff700 1 -- 172.21.15.79:0/2928383311 >> v2:172.21.15.89:3300/0 conn(0x7f85540e9ad0 msgr2=0x7f855409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:26.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.608 7f8553fff700 1 --2- 172.21.15.79:0/2928383311 >> v2:172.21.15.89:3300/0 conn(0x7f85540e9ad0 0x7f855409f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.608 7f8553fff700 1 -- 172.21.15.79:0/2928383311 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85540e56c0 con 0x7f85541c2da0 2021-04-09T18:31:26.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.608 7f8553fff700 1 --2- 172.21.15.79:0/2928383311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85541c2da0 0x7f85541c31f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f854c0032b0 tx=0x7f854c00b3c0).ready entity=mon.0 client_cookie=79504965a6c62e2b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:26.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.608 7f85527fc700 1 -- 172.21.15.79:0/2928383311 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f85540e56c0 con 0x7f85541c2da0 2021-04-09T18:31:26.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.608 7f85527fc700 1 -- 172.21.15.79:0/2928383311 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c00bc20 con 0x7f85541c2da0 2021-04-09T18:31:26.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.608 7f85527fc700 1 -- 172.21.15.79:0/2928383311 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f854c002020 con 0x7f85541c2da0 2021-04-09T18:31:26.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.608 7f855a09e700 1 -- 172.21.15.79:0/2928383311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85541c2da0 msgr2=0x7f85541c31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:26.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.608 7f855a09e700 1 --2- 172.21.15.79:0/2928383311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85541c2da0 0x7f85541c31f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f854c0032b0 tx=0x7f854c00b3c0).stop 2021-04-09T18:31:26.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.608 7f855a09e700 1 -- 172.21.15.79:0/2928383311 shutdown_connections 2021-04-09T18:31:26.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.608 7f855a09e700 1 --2- 172.21.15.79:0/2928383311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85540f5510 0x7f85540f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.608 7f855a09e700 1 --2- 172.21.15.79:0/2928383311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85541c2da0 0x7f85541c31f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.608 7f855a09e700 1 --2- 172.21.15.79:0/2928383311 >> v2:172.21.15.89:3300/0 conn(0x7f85540e9ad0 0x7f855409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.608 7f855a09e700 1 -- 172.21.15.79:0/2928383311 >> 172.21.15.79:0/2928383311 conn(0x7f85540e5fd0 msgr2=0x7f85540e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:26.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.608 7f855a09e700 1 -- 172.21.15.79:0/2928383311 shutdown_connections 2021-04-09T18:31:26.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.608 7f855a09e700 1 -- 172.21.15.79:0/2928383311 wait complete. 2021-04-09T18:31:26.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.612 7f855a09e700 1 Processor -- start 2021-04-09T18:31:26.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.612 7f855a09e700 1 -- start start 2021-04-09T18:31:26.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.612 7f855a09e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85541c0600 0x7f85540bad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:26.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.612 7f855a09e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85540ad360 0x7f85540ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:26.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.612 7f855a09e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85540adde0 0x7f85540ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:26.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.612 7f855a09e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85540885b0 con 0x7f85540ad360 2021-04-09T18:31:26.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.612 7f855a09e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85540c08a0 con 0x7f85541c0600 2021-04-09T18:31:26.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.612 7f855a09e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8554098e70 con 0x7f85540adde0 2021-04-09T18:31:26.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f8552ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85540ad360 0x7f85540ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:26.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f8553fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85540adde0 0x7f85540ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:26.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f8552ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85540ad360 0x7f85540ad7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58806/0 (socket says 172.21.15.79:58806) 2021-04-09T18:31:26.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f8552ffd700 1 -- 172.21.15.79:0/1899735677 learned_addr learned my addr 172.21.15.79:0/1899735677 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:26.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f85537fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85541c0600 0x7f85540bad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:26.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f8553fff700 1 -- 172.21.15.79:0/1899735677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85541c0600 msgr2=0x7f85540bad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:26.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f8553fff700 1 --2- 172.21.15.79:0/1899735677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85541c0600 0x7f85540bad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f8553fff700 1 -- 172.21.15.79:0/1899735677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85540ad360 msgr2=0x7f85540ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:26.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f8553fff700 1 --2- 172.21.15.79:0/1899735677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85540ad360 0x7f85540ad7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f8553fff700 1 -- 172.21.15.79:0/1899735677 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85540bb370 con 0x7f85540adde0 2021-04-09T18:31:26.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f8552ffd700 1 --2- 172.21.15.79:0/1899735677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85540ad360 0x7f85540ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:26.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f8553fff700 1 --2- 172.21.15.79:0/1899735677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85540adde0 0x7f85540ae230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f85540c0e30 tx=0x7f854c006c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:26.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f853bfff700 1 -- 172.21.15.79:0/1899735677 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f85540bb370 con 0x7f85540adde0 2021-04-09T18:31:26.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f853bfff700 1 -- 172.21.15.79:0/1899735677 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c01a5d0 con 0x7f85540adde0 2021-04-09T18:31:26.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f855a09e700 1 -- 172.21.15.79:0/1899735677 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85540afdb0 con 0x7f85540adde0 2021-04-09T18:31:26.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f853bfff700 1 -- 172.21.15.79:0/1899735677 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f854c01a9a0 con 0x7f85540adde0 2021-04-09T18:31:26.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f855a09e700 1 -- 172.21.15.79:0/1899735677 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8554098640 con 0x7f85540adde0 2021-04-09T18:31:26.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f853bfff700 1 -- 172.21.15.79:0/1899735677 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f854c019040 con 0x7f85540adde0 2021-04-09T18:31:26.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f853bfff700 1 --2- 172.21.15.79:0/1899735677 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8534029100 0x7f853402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:26.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f853bfff700 1 -- 172.21.15.79:0/1899735677 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5319+0+0 (secure 0 0 0) 0x7f854c018040 con 0x7f85540adde0 2021-04-09T18:31:26.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.616 7f85537fe700 1 --2- 172.21.15.79:0/1899735677 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8534029100 0x7f853402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:26.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.620 7f85537fe700 1 --2- 172.21.15.79:0/1899735677 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8534029100 0x7f853402b650 crc :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:26.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.636 7f855a09e700 1 -- 172.21.15.79:0/1899735677 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85540e39d0 con 0x7f85540adde0 2021-04-09T18:31:26.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.644 7f853bfff700 1 -- 172.21.15.79:0/1899735677 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f854c00ba10 con 0x7f85540adde0 2021-04-09T18:31:26.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.812 7f855a09e700 1 -- 172.21.15.79:0/1899735677 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f85540f5b10 con 0x7f85540adde0 2021-04-09T18:31:26.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.816 7f853bfff700 1 -- 172.21.15.79:0/1899735677 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v54) v1 ==== 81+0+26137 (secure 0 0 0) 0x7f854c01a3c0 con 0x7f85540adde0 2021-04-09T18:31:26.817 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:26.818 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:31:26.818 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 54, 2021-04-09T18:31:26.818 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:31:26.818 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:31:26.818 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:31:23.958421", 2021-04-09T18:31:26.819 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:31:26.819 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:31:26.819 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:31:26.819 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:31:26.820 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:31:26.820 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:31:26.820 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:31:26.820 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:31:26.820 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:31:26.821 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:31:26.821 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:31:26.821 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:31:26.821 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:31:26.821 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:31:26.822 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:31:26.822 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 9, 2021-04-09T18:31:26.822 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:31:26.822 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:31:26.822 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:31:26.823 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:31:26.823 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:31:26.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.823 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:31:26.823 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:31:26.824 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:31:26.824 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:31:26.824 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:31:26.824 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:31:26.825 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:31:26.825 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:31:26.825 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:31:26.825 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:31:26.825 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:31:26.826 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:31:26.826 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:31:26.826 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:31:26.826 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:31:26.827 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:31:26.827 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:31:26.827 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:31:26.827 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:31:26.827 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:31:26.828 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:31:26.828 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:31:26.828 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:31:26.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.828 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:31:26.829 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:31:26.829 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:31:26.829 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:31:26.829 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:31:26.829 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:31:26.830 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:31:26.830 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:31:26.830 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:31:26.830 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:31:26.831 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:31:26.831 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:31:26.831 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:31:26.831 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:31:26.831 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:31:26.832 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:31:26.832 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:31:26.832 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:31:26.832 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:31:26.832 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:31:26.833 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:31:26.833 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:31:26.833 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:31:26.833 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:31:26.833 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:31:26.834 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:31:26.834 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:31:26.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.834 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:31:26.834 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:31:26.835 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:31:26.835 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:31:26.835 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:31:26.835 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:31:26.836 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:31:26.836 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:31:26.836 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:31:26.836 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:31:26.836 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:31:26.837 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:31:26.837 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:31:26.837 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:31:26.837 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.837 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.838 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:31:26.838 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:31:26.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.838 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:31:26.839 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:31:26.839 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:31:26.839 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:31:26.839 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:31:26.839 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:31:26.840 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:31:26.840 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:31:26.840 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:31:26.840 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 47, 2021-04-09T18:31:26.840 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:31:26.841 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:31:26.841 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:31:26.841 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.841 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.842 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:31:26.842 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:31:26.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.843 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.843 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:31:26.843 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:31:26.843 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.843 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.844 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:31:26.844 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.844 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.845 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:31:26.845 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:31:26.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.846 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.846 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:31:26.846 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:31:26.846 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.846 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.847 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:31:26.847 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.847 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.848 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:31:26.848 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:31:26.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.848 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.849 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:31:26.849 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:31:26.849 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.850 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.850 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:31:26.850 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.851 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.851 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:31:26.851 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:31:26.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.852 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.852 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:31:26.852 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:31:26.853 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.853 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.853 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:31:26.854 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:31:26.854 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:31:26.854 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:31:26.854 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:31:26.855 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:31:26.855 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:31:26.855 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.856 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:31:26.856 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:31:26.856 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:31:26.856 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:31:26.857 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:31:26.857 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:31:26.857 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:31:26.857 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:31:26.858 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:31:26.858 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 47, 2021-04-09T18:31:26.858 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:31:26.858 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:31:26.858 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:31:26.859 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.859 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.860 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:31:26.860 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:31:26.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.861 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.861 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:31:26.861 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:31:26.861 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.861 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.862 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:31:26.862 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.862 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.863 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:31:26.863 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:31:26.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.863 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.864 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:31:26.864 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:31:26.864 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.864 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.865 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:31:26.865 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.865 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.865 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:31:26.866 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:31:26.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.866 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.866 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:31:26.867 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:31:26.867 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.867 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.868 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:31:26.868 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.868 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.868 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:31:26.869 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:31:26.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.869 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.869 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:31:26.870 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:31:26.870 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.870 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.870 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:31:26.871 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:31:26.871 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:31:26.871 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:31:26.871 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:31:26.871 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:31:26.872 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:31:26.872 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.872 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:31:26.873 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:31:26.873 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:31:26.873 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:31:26.873 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:31:26.874 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:31:26.874 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:31:26.874 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:31:26.874 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:31:26.874 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 29, 2021-04-09T18:31:26.875 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:31:26.875 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:31:26.875 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:31:26.875 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.876 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.876 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:31:26.876 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:31:26.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.877 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.877 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:31:26.877 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:31:26.877 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.878 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.878 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:31:26.878 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.879 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.879 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:31:26.879 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:31:26.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.880 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.880 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:31:26.880 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:31:26.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.880 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.881 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:31:26.881 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.882 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.882 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:31:26.882 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:31:26.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.883 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.883 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:31:26.883 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:31:26.883 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.883 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.884 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:31:26.884 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.884 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.885 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:31:26.885 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:31:26.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.885 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.886 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:31:26.886 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:31:26.886 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.886 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.887 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:31:26.887 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:31:26.887 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:31:26.887 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:31:26.888 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:31:26.888 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:31:26.888 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:31:26.888 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.889 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:31:26.889 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:31:26.889 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:31:26.889 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:31:26.890 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:31:26.890 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:31:26.890 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:31:26.890 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:31:26.890 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:31:26.891 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 47, 2021-04-09T18:31:26.891 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:31:26.891 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:31:26.891 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:31:26.892 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.892 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.892 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:31:26.893 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:31:26.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.893 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.893 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:31:26.894 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:31:26.894 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.894 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.894 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:31:26.895 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.895 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.895 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:31:26.895 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:31:26.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.896 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.896 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:31:26.897 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:31:26.897 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.897 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.897 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:31:26.898 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.898 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.898 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:31:26.898 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:31:26.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.899 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.899 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:31:26.899 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:31:26.900 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.900 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.900 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:31:26.901 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.901 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.901 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:31:26.902 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:31:26.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.902 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.902 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:31:26.903 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:31:26.903 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.903 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.903 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:31:26.904 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:31:26.904 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:31:26.904 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:31:26.904 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:31:26.904 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:31:26.905 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:31:26.905 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.905 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:31:26.906 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:31:26.906 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:31:26.906 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:31:26.906 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:31:26.907 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:31:26.907 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:31:26.907 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:31:26.907 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:31:26.907 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 46, 2021-04-09T18:31:26.908 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:31:26.908 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:31:26.908 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:31:26.908 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.909 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.909 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:31:26.909 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:31:26.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.910 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.910 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:31:26.910 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:31:26.910 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.910 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.911 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:31:26.911 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.911 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.912 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:31:26.912 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:31:26.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.913 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.913 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:31:26.913 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:31:26.913 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.913 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.914 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:31:26.914 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.914 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.915 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:31:26.915 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:31:26.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.915 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.916 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:31:26.916 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:31:26.916 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.916 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.917 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:31:26.917 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.917 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.918 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:31:26.918 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:31:26.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.918 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.919 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:31:26.919 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:31:26.919 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.919 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.920 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:31:26.920 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:31:26.920 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:31:26.920 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:31:26.921 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:31:26.921 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:31:26.921 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:31:26.921 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.922 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:31:26.922 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:31:26.922 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:31:26.922 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:31:26.923 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:31:26.923 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:31:26.923 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:31:26.923 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:31:26.923 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:31:26.924 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 47, 2021-04-09T18:31:26.924 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:31:26.924 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:31:26.924 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:31:26.924 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.925 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.925 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:31:26.925 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:31:26.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.926 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.926 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:31:26.926 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:31:26.927 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.927 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.927 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:31:26.927 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.928 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.928 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:31:26.928 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:31:26.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.929 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.929 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:31:26.929 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:31:26.930 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.930 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.930 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:31:26.930 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.931 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.931 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:31:26.931 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:31:26.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.932 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:31:26.932 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:31:26.933 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.933 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.933 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:31:26.933 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.934 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.934 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:31:26.934 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:31:26.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.935 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.935 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:31:26.935 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:31:26.935 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.936 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.936 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:31:26.936 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:31:26.936 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:31:26.937 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:31:26.937 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:31:26.937 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:31:26.937 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:31:26.937 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.938 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:31:26.938 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:31:26.938 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:31:26.939 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:31:26.939 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:31:26.939 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:31:26.939 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:31:26.940 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:31:26.940 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:31:26.940 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 46, 2021-04-09T18:31:26.940 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:31:26.940 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:31:26.941 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:31:26.941 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.941 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.941 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:31:26.942 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:31:26.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.942 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.942 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:31:26.943 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:31:26.943 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.943 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.943 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:31:26.944 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.944 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.944 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:31:26.944 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:31:26.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.945 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.945 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:31:26.945 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:31:26.946 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.946 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.946 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:31:26.946 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.947 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.947 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:31:26.947 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:31:26.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.948 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:31:26.948 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:31:26.949 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.949 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.949 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:31:26.949 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.950 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.950 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:31:26.950 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:31:26.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.951 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.951 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:31:26.951 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:31:26.951 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.952 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.952 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:31:26.952 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:31:26.952 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:31:26.953 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:31:26.953 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:31:26.953 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:31:26.953 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:31:26.954 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.954 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:31:26.954 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:31:26.955 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:31:26.955 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:31:26.955 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:31:26.955 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:31:26.955 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:31:26.956 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:31:26.956 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:31:26.956 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 47, 2021-04-09T18:31:26.956 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:31:26.956 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:31:26.957 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:31:26.957 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.957 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.957 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:31:26.958 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:31:26.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.958 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.958 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:31:26.959 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:31:26.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.959 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.960 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:31:26.960 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.960 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.960 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:31:26.961 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:31:26.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.961 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.961 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:31:26.962 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:31:26.962 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.962 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.962 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:31:26.963 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.963 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.963 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:31:26.964 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:31:26.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.964 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.964 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:31:26.965 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:31:26.965 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.965 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.965 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:31:26.966 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:31:26.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.966 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:31:26.966 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:31:26.966 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:31:26.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.967 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:31:26.967 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:31:26.967 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:31:26.968 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.968 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.968 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:31:26.968 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:31:26.969 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:31:26.969 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:31:26.969 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:31:26.969 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:31:26.969 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:31:26.970 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:26.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.970 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:31:26.970 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:31:26.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.971 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:31:26.971 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:31:26.971 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:31:26.971 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:31:26.972 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:31:26.972 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:31:26.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.972 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:31:26.973 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:31:26.973 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:31:26.973 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:31:26.973 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:31:26.973 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:31:26.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.974 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:31:26.974 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:31:26.974 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:31:26.975 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:31:26.975 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:31:26.975 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:31:26.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.976 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:31:26.976 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:31:26.976 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:31:26.976 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:31:26.976 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:31:26.977 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:31:26.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.977 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:31:26.977 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:31:26.978 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:31:26.978 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:31:26.978 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:31:26.978 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:31:26.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.979 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:31:26.979 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:31:26.979 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:31:26.980 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:31:26.980 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:31:26.980 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:31:26.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.981 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:31:26.981 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:31:26.981 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:31:26.981 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:31:26.981 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:31:26.982 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:31:26.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:26.982 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:31:26.982 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:31:26.983 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:31:26.983 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:31:26.983 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:31:26.983 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:31:26.983 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.984 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:31:26.984 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:31:26.984 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:31:26.984 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:31:26.984 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:31:26.985 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": { 2021-04-09T18:31:26.985 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6834/1280399112": "2021-04-10 18:31:20.720870", 2021-04-09T18:31:26.985 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6835/1280399112": "2021-04-10 18:31:20.720870", 2021-04-09T18:31:26.985 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.90:0/2690155541": "2021-04-09 19:31:14.431527", 2021-04-09T18:31:26.985 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6835/781814443": "2021-04-10 18:29:53.473795", 2021-04-09T18:31:26.986 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6834/781814443": "2021-04-10 18:29:53.473795" 2021-04-09T18:31:26.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.986 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:31:26.986 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:31:26.987 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:31:26.987 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:31:26.987 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:31:26.987 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:31:26.987 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:31:26.988 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:31:26.988 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:31:26.988 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:31:26.988 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:31:26.988 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:31:26.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.989 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:31:26.989 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:31:26.989 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:31:26.989 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:31:26.990 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:31:26.990 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:31:26.990 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:31:26.990 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:26.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:26.991 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:31:26.991 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:31:26.991 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:31:26.991 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:31:26.991 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:31:26.992 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:31:26.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.820 7f855a09e700 1 -- 172.21.15.79:0/1899735677 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8534029100 msgr2=0x7f853402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:26.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.820 7f855a09e700 1 --2- 172.21.15.79:0/1899735677 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8534029100 0x7f853402b650 crc :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.820 7f855a09e700 1 -- 172.21.15.79:0/1899735677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85540adde0 msgr2=0x7f85540ae230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:26.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.820 7f855a09e700 1 --2- 172.21.15.79:0/1899735677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85540adde0 0x7f85540ae230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f85540c0e30 tx=0x7f854c006c10).stop 2021-04-09T18:31:26.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.820 7f855a09e700 1 -- 172.21.15.79:0/1899735677 shutdown_connections 2021-04-09T18:31:26.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.820 7f855a09e700 1 --2- 172.21.15.79:0/1899735677 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8534029100 0x7f853402b650 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.820 7f855a09e700 1 --2- 172.21.15.79:0/1899735677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85541c0600 0x7f85540bad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.820 7f855a09e700 1 --2- 172.21.15.79:0/1899735677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85540adde0 0x7f85540ae230 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.820 7f855a09e700 1 --2- 172.21.15.79:0/1899735677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85540ad360 0x7f85540ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:26.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.820 7f855a09e700 1 -- 172.21.15.79:0/1899735677 >> 172.21.15.79:0/1899735677 conn(0x7f855409a970 msgr2=0x7f85540a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:26.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.820 7f855a09e700 1 -- 172.21.15.79:0/1899735677 shutdown_connections 2021-04-09T18:31:26.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:26.820 7f855a09e700 1 -- 172.21.15.79:0/1899735677 wait complete. 2021-04-09T18:31:26.997 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:27.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fd49a3700 1 Processor -- start 2021-04-09T18:31:27.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fd49a3700 1 -- start start 2021-04-09T18:31:27.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fd49a3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1fd00e9ad0 0x7f1fd009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:27.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fd49a3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1fd01c8000 0x7f1fd01ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:27.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fd49a3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd00fbb10 con 0x7f1fd00f5510 2021-04-09T18:31:27.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fd49a3700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd01c3db0 con 0x7f1fd00e9ad0 2021-04-09T18:31:27.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fd49a3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd00e9f20 con 0x7f1fd01c8000 2021-04-09T18:31:27.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fcdda3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1fd00e9ad0 0x7f1fd009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:27.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fce5a4700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1fd00f5510 0x7f1fd00f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53524/0 (socket says 172.21.15.79:53524) 2021-04-09T18:31:27.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fce5a4700 1 -- 172.21.15.79:0/1076809851 learned_addr learned my addr 172.21.15.79:0/1076809851 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:27.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fceda5700 1 --2- 172.21.15.79:0/1076809851 >> v2:172.21.15.89:3300/0 conn(0x7f1fd01c8000 0x7f1fd01ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:27.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fcdda3700 1 -- 172.21.15.79:0/1076809851 >> v2:172.21.15.89:3300/0 conn(0x7f1fd01c8000 msgr2=0x7f1fd01ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:27.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fcdda3700 1 --2- 172.21.15.79:0/1076809851 >> v2:172.21.15.89:3300/0 conn(0x7f1fd01c8000 0x7f1fd01ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fcdda3700 1 -- 172.21.15.79:0/1076809851 >> v1:172.21.15.79:6789/0 conn(0x7f1fd00f5510 legacy=0x7f1fd00f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:27.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fcd5a2700 1 -- 172.21.15.79:0/1076809851 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521320625 0 0) 0x7f1fc00010d0 con 0x7f1fd00f5510 2021-04-09T18:31:27.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fcdda3700 1 -- 172.21.15.79:0/1076809851 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd00e56c0 con 0x7f1fd00e9ad0 2021-04-09T18:31:27.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fcdda3700 1 --2- 172.21.15.79:0/1076809851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fd00e9ad0 0x7f1fd009f100 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f1fbc002f30 tx=0x7f1fbc00bd10).ready entity=mon.0 client_cookie=73bd9b8efb6ae34d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:27.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fcd5a2700 1 -- 172.21.15.79:0/1076809851 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1fd00e56c0 con 0x7f1fd00e9ad0 2021-04-09T18:31:27.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fcd5a2700 1 -- 172.21.15.79:0/1076809851 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fbc0098a0 con 0x7f1fd00e9ad0 2021-04-09T18:31:27.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fcd5a2700 1 -- 172.21.15.79:0/1076809851 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1fbc009c70 con 0x7f1fd00e9ad0 2021-04-09T18:31:27.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.092 7f1fd49a3700 1 -- 172.21.15.79:0/1076809851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fd00e9ad0 msgr2=0x7f1fd009f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:27.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.096 7f1fd49a3700 1 --2- 172.21.15.79:0/1076809851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fd00e9ad0 0x7f1fd009f100 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f1fbc002f30 tx=0x7f1fbc00bd10).stop 2021-04-09T18:31:27.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.096 7f1fd49a3700 1 -- 172.21.15.79:0/1076809851 shutdown_connections 2021-04-09T18:31:27.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.096 7f1fd49a3700 1 --2- 172.21.15.79:0/1076809851 >> v2:172.21.15.89:3300/0 conn(0x7f1fd01c8000 0x7f1fd01ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.096 7f1fd49a3700 1 --2- 172.21.15.79:0/1076809851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fd00e9ad0 0x7f1fd009f100 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.096 7f1fd49a3700 1 -- 172.21.15.79:0/1076809851 >> 172.21.15.79:0/1076809851 conn(0x7f1fd00e5fd0 msgr2=0x7f1fd00e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:27.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.096 7f1fd49a3700 1 -- 172.21.15.79:0/1076809851 shutdown_connections 2021-04-09T18:31:27.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.096 7f1fd49a3700 1 -- 172.21.15.79:0/1076809851 wait complete. 2021-04-09T18:31:27.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fd49a3700 1 Processor -- start 2021-04-09T18:31:27.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fd49a3700 1 -- start start 2021-04-09T18:31:27.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fd49a3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fd009b050 0x7f1fd01a6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:27.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fd49a3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fd00b8390 0x7f1fd00b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:27.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fd49a3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fd00d3670 0x7f1fd00d3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:27.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fd49a3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd0099ad0 con 0x7f1fd00b8390 2021-04-09T18:31:27.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fd49a3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00d2ae0 con 0x7f1fd00d3670 2021-04-09T18:31:27.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fd49a3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00d40f0 con 0x7f1fd009b050 2021-04-09T18:31:27.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fcdda3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fd00b8390 0x7f1fd00b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:27.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fcdda3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fd00b8390 0x7f1fd00b87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58822/0 (socket says 172.21.15.79:58822) 2021-04-09T18:31:27.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fcdda3700 1 -- 172.21.15.79:0/727730975 learned_addr learned my addr 172.21.15.79:0/727730975 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:27.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fce5a4700 1 --2- 172.21.15.79:0/727730975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fd009b050 0x7f1fd01a6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:27.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fceda5700 1 --2- 172.21.15.79:0/727730975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fd00d3670 0x7f1fd00d3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:27.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fcdda3700 1 -- 172.21.15.79:0/727730975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fd009b050 msgr2=0x7f1fd01a6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:27.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fcdda3700 1 --2- 172.21.15.79:0/727730975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fd009b050 0x7f1fd01a6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fcdda3700 1 -- 172.21.15.79:0/727730975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fd00d3670 msgr2=0x7f1fd00d3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:27.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fcdda3700 1 --2- 172.21.15.79:0/727730975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fd00d3670 0x7f1fd00d3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fcdda3700 1 -- 172.21.15.79:0/727730975 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd00d4320 con 0x7f1fd00b8390 2021-04-09T18:31:27.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fceda5700 1 --2- 172.21.15.79:0/727730975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fd00d3670 0x7f1fd00d3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:27.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fce5a4700 1 --2- 172.21.15.79:0/727730975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fd009b050 0x7f1fd01a6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:27.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fcdda3700 1 --2- 172.21.15.79:0/727730975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fd00b8390 0x7f1fd00b87e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f1fbc002f30 tx=0x7f1fbc006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:27.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fc6ffd700 1 -- 172.21.15.79:0/727730975 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1fd00d4320 con 0x7f1fd00b8390 2021-04-09T18:31:27.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fc6ffd700 1 -- 172.21.15.79:0/727730975 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fbc011d00 con 0x7f1fd00b8390 2021-04-09T18:31:27.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fc6ffd700 1 -- 172.21.15.79:0/727730975 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1fbc01d630 con 0x7f1fd00b8390 2021-04-09T18:31:27.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fd49a3700 1 -- 172.21.15.79:0/727730975 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd01aa490 con 0x7f1fd00b8390 2021-04-09T18:31:27.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.100 7f1fd49a3700 1 -- 172.21.15.79:0/727730975 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd01aa750 con 0x7f1fd00b8390 2021-04-09T18:31:27.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.104 7f1fc6ffd700 1 -- 172.21.15.79:0/727730975 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1fbc01d830 con 0x7f1fd00b8390 2021-04-09T18:31:27.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.104 7f1fc6ffd700 1 --2- 172.21.15.79:0/727730975 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1fac029100 0x7f1fac02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:27.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.104 7f1fc6ffd700 1 -- 172.21.15.79:0/727730975 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5319+0+0 (secure 0 0 0) 0x7f1fbc03b1e0 con 0x7f1fd00b8390 2021-04-09T18:31:27.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.104 7f1fce5a4700 1 --2- 172.21.15.79:0/727730975 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1fac029100 0x7f1fac02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:27.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.104 7f1fce5a4700 1 --2- 172.21.15.79:0/727730975 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1fac029100 0x7f1fac02b650 crc :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:27.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.104 7f1fd49a3700 1 -- 172.21.15.79:0/727730975 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd00e39d0 con 0x7f1fd00b8390 2021-04-09T18:31:27.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.112 7f1fc6ffd700 1 -- 172.21.15.79:0/727730975 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1fbc011af0 con 0x7f1fd00b8390 2021-04-09T18:31:27.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.276 7f1fd49a3700 1 -- 172.21.15.79:0/727730975 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1fd00f5b10 con 0x7f1fd00b8390 2021-04-09T18:31:27.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.276 7f1fc6ffd700 1 -- 172.21.15.79:0/727730975 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+1177 (secure 0 0 0) 0x7f1fbc009690 con 0x7f1fd00b8390 2021-04-09T18:31:27.279 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 30 2021-04-09T18:31:27.279 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:27.280 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5306,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/3190188639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3190188639},{"type":"v1","addr":"172.21.15.89:6835","nonce":3190188639}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":30},{"gid":5508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3328659942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3328659942},{"type":"v1","addr":"172.21.15.79:6833","nonce":3328659942}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":24}],"filesystems":[]} 2021-04-09T18:31:27.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.280 7f1fd49a3700 1 -- 172.21.15.79:0/727730975 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1fac029100 msgr2=0x7f1fac02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:27.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.280 7f1fd49a3700 1 --2- 172.21.15.79:0/727730975 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1fac029100 0x7f1fac02b650 crc :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.280 7f1fd49a3700 1 -- 172.21.15.79:0/727730975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fd00b8390 msgr2=0x7f1fd00b87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:27.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.280 7f1fd49a3700 1 --2- 172.21.15.79:0/727730975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fd00b8390 0x7f1fd00b87e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f1fbc002f30 tx=0x7f1fbc006890).stop 2021-04-09T18:31:27.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.280 7f1fd49a3700 1 -- 172.21.15.79:0/727730975 shutdown_connections 2021-04-09T18:31:27.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.280 7f1fd49a3700 1 --2- 172.21.15.79:0/727730975 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1fac029100 0x7f1fac02b650 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.280 7f1fd49a3700 1 --2- 172.21.15.79:0/727730975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fd00d3670 0x7f1fd00d3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.280 7f1fd49a3700 1 --2- 172.21.15.79:0/727730975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fd009b050 0x7f1fd01a6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.280 7f1fd49a3700 1 --2- 172.21.15.79:0/727730975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fd00b8390 0x7f1fd00b87e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.280 7f1fd49a3700 1 -- 172.21.15.79:0/727730975 >> 172.21.15.79:0/727730975 conn(0x7f1fd00d77a0 msgr2=0x7f1fd00d6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:27.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.280 7f1fd49a3700 1 -- 172.21.15.79:0/727730975 shutdown_connections 2021-04-09T18:31:27.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.280 7f1fd49a3700 1 -- 172.21.15.79:0/727730975 wait complete. 2021-04-09T18:31:27.291 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:27.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.384 7fd964772700 1 Processor -- start 2021-04-09T18:31:27.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.384 7fd964772700 1 -- start start 2021-04-09T18:31:27.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.384 7fd964772700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd95c0f5520 0x7fd95c0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:27.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.384 7fd964772700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd95c1c8010 0x7fd95c1ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:27.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.384 7fd964772700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95c0fbb20 con 0x7fd95c0e9ae0 2021-04-09T18:31:27.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.384 7fd964772700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95c0e9f30 con 0x7fd95c0f5520 2021-04-09T18:31:27.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.384 7fd964772700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95c1c3dc0 con 0x7fd95c1c8010 2021-04-09T18:31:27.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.384 7fd962516700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd95c0f5520 0x7fd95c0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:27.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.384 7fd961d15700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd95c0e9ae0 0x7fd95c09f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53538/0 (socket says 172.21.15.79:53538) 2021-04-09T18:31:27.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.384 7fd961d15700 1 -- 172.21.15.79:0/272355539 learned_addr learned my addr 172.21.15.79:0/272355539 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:27.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.384 7fd962d17700 1 --2- 172.21.15.79:0/272355539 >> v2:172.21.15.89:3300/0 conn(0x7fd95c1c8010 0x7fd95c1ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:27.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.384 7fd962516700 1 -- 172.21.15.79:0/272355539 >> v2:172.21.15.89:3300/0 conn(0x7fd95c1c8010 msgr2=0x7fd95c1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:27.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.384 7fd962516700 1 --2- 172.21.15.79:0/272355539 >> v2:172.21.15.89:3300/0 conn(0x7fd95c1c8010 0x7fd95c1ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.384 7fd962516700 1 -- 172.21.15.79:0/272355539 >> v1:172.21.15.79:6789/0 conn(0x7fd95c0e9ae0 legacy=0x7fd95c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:27.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.384 7fd961514700 1 -- 172.21.15.79:0/272355539 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2099815751 0 0) 0x7fd9580010d0 con 0x7fd95c0e9ae0 2021-04-09T18:31:27.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.388 7fd962516700 1 -- 172.21.15.79:0/272355539 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c09f910 con 0x7fd95c0f5520 2021-04-09T18:31:27.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.388 7fd962516700 1 --2- 172.21.15.79:0/272355539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd95c0f5520 0x7fd95c0f64b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fd950002f30 tx=0x7fd95000bd10).ready entity=mon.0 client_cookie=4bf6bd91b8559513 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:27.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.388 7fd961514700 1 -- 172.21.15.79:0/272355539 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd95c09f910 con 0x7fd95c0f5520 2021-04-09T18:31:27.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.388 7fd961514700 1 -- 172.21.15.79:0/272355539 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9500098a0 con 0x7fd95c0f5520 2021-04-09T18:31:27.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.388 7fd961514700 1 -- 172.21.15.79:0/272355539 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd950009c70 con 0x7fd95c0f5520 2021-04-09T18:31:27.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.388 7fd964772700 1 -- 172.21.15.79:0/272355539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd95c0f5520 msgr2=0x7fd95c0f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:27.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.388 7fd964772700 1 --2- 172.21.15.79:0/272355539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd95c0f5520 0x7fd95c0f64b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fd950002f30 tx=0x7fd95000bd10).stop 2021-04-09T18:31:27.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.388 7fd964772700 1 -- 172.21.15.79:0/272355539 shutdown_connections 2021-04-09T18:31:27.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.388 7fd964772700 1 --2- 172.21.15.79:0/272355539 >> v2:172.21.15.89:3300/0 conn(0x7fd95c1c8010 0x7fd95c1ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.388 7fd964772700 1 --2- 172.21.15.79:0/272355539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd95c0f5520 0x7fd95c0f64b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.388 7fd964772700 1 -- 172.21.15.79:0/272355539 >> 172.21.15.79:0/272355539 conn(0x7fd95c0e5fe0 msgr2=0x7fd95c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:27.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.388 7fd964772700 1 -- 172.21.15.79:0/272355539 shutdown_connections 2021-04-09T18:31:27.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.388 7fd964772700 1 -- 172.21.15.79:0/272355539 wait complete. 2021-04-09T18:31:27.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd964772700 1 Processor -- start 2021-04-09T18:31:27.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd964772700 1 -- start start 2021-04-09T18:31:27.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd964772700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd95c0bac80 0x7fd95c0903f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:27.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd964772700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd95c1aaa30 0x7fd95c1aae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:27.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd964772700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd95c1ab4b0 0x7fd95c1a69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:27.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd964772700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0b8d30 con 0x7fd95c0bac80 2021-04-09T18:31:27.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd964772700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0b9330 con 0x7fd95c1ab4b0 2021-04-09T18:31:27.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd964772700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0b9030 con 0x7fd95c1aaa30 2021-04-09T18:31:27.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd962516700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd95c0bac80 0x7fd95c0903f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:27.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd962516700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd95c0bac80 0x7fd95c0903f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58838/0 (socket says 172.21.15.79:58838) 2021-04-09T18:31:27.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd962516700 1 -- 172.21.15.79:0/2714558932 learned_addr learned my addr 172.21.15.79:0/2714558932 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:27.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd961d15700 1 --2- 172.21.15.79:0/2714558932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd95c1aaa30 0x7fd95c1aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:27.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd962d17700 1 --2- 172.21.15.79:0/2714558932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd95c1ab4b0 0x7fd95c1a69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:27.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd962516700 1 -- 172.21.15.79:0/2714558932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd95c1aaa30 msgr2=0x7fd95c1aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:27.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd962516700 1 --2- 172.21.15.79:0/2714558932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd95c1aaa30 0x7fd95c1aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd962516700 1 -- 172.21.15.79:0/2714558932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd95c1ab4b0 msgr2=0x7fd95c1a69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:27.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd962516700 1 --2- 172.21.15.79:0/2714558932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd95c1ab4b0 0x7fd95c1a69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd962516700 1 -- 172.21.15.79:0/2714558932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c1ab900 con 0x7fd95c0bac80 2021-04-09T18:31:27.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd962d17700 1 --2- 172.21.15.79:0/2714558932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd95c1ab4b0 0x7fd95c1a69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:27.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd962516700 1 --2- 172.21.15.79:0/2714558932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd95c0bac80 0x7fd95c0903f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fd95c0d9000 tx=0x7fd950006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:27.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd94effd700 1 -- 172.21.15.79:0/2714558932 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd95c1ab900 con 0x7fd95c0bac80 2021-04-09T18:31:27.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd94effd700 1 -- 172.21.15.79:0/2714558932 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd950011a90 con 0x7fd95c0bac80 2021-04-09T18:31:27.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd964772700 1 -- 172.21.15.79:0/2714558932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd95c090a20 con 0x7fd95c0bac80 2021-04-09T18:31:27.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd94effd700 1 -- 172.21.15.79:0/2714558932 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd95001d440 con 0x7fd95c0bac80 2021-04-09T18:31:27.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.392 7fd964772700 1 -- 172.21.15.79:0/2714558932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95c1a71f0 con 0x7fd95c0bac80 2021-04-09T18:31:27.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.396 7fd94effd700 1 -- 172.21.15.79:0/2714558932 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd95001d640 con 0x7fd95c0bac80 2021-04-09T18:31:27.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.396 7fd94effd700 1 --2- 172.21.15.79:0/2714558932 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd944029100 0x7fd94402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:27.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.396 7fd94effd700 1 -- 172.21.15.79:0/2714558932 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5319+0+0 (secure 0 0 0) 0x7fd95003b530 con 0x7fd95c0bac80 2021-04-09T18:31:27.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.396 7fd961d15700 1 --2- 172.21.15.79:0/2714558932 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd944029100 0x7fd94402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:27.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.396 7fd961d15700 1 --2- 172.21.15.79:0/2714558932 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd944029100 0x7fd94402b650 crc :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:27.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.396 7fd964772700 1 -- 172.21.15.79:0/2714558932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95c0e39e0 con 0x7fd95c0bac80 2021-04-09T18:31:27.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.404 7fd94effd700 1 -- 172.21.15.79:0/2714558932 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd950009690 con 0x7fd95c0bac80 2021-04-09T18:31:27.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.568 7fd964772700 1 -- 172.21.15.79:0/2714558932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd95c0a1cc0 con 0x7fd95c0bac80 2021-04-09T18:31:27.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.568 7fd94effd700 1 -- 172.21.15.79:0/2714558932 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+1177 (secure 0 0 0) 0x7fd950011880 con 0x7fd95c0bac80 2021-04-09T18:31:27.570 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 30 2021-04-09T18:31:27.570 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:27.571 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5306,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/3190188639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3190188639},{"type":"v1","addr":"172.21.15.89:6835","nonce":3190188639}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":30},{"gid":5508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/3328659942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3328659942},{"type":"v1","addr":"172.21.15.79:6833","nonce":3328659942}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":24}],"filesystems":[]} 2021-04-09T18:31:27.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.572 7fd964772700 1 -- 172.21.15.79:0/2714558932 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd944029100 msgr2=0x7fd94402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:27.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.572 7fd964772700 1 --2- 172.21.15.79:0/2714558932 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd944029100 0x7fd94402b650 crc :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.572 7fd964772700 1 -- 172.21.15.79:0/2714558932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd95c0bac80 msgr2=0x7fd95c0903f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:27.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.572 7fd964772700 1 --2- 172.21.15.79:0/2714558932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd95c0bac80 0x7fd95c0903f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fd95c0d9000 tx=0x7fd950006890).stop 2021-04-09T18:31:27.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.572 7fd964772700 1 -- 172.21.15.79:0/2714558932 shutdown_connections 2021-04-09T18:31:27.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.572 7fd964772700 1 --2- 172.21.15.79:0/2714558932 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd944029100 0x7fd94402b650 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.572 7fd964772700 1 --2- 172.21.15.79:0/2714558932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd95c1ab4b0 0x7fd95c1a69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.572 7fd964772700 1 --2- 172.21.15.79:0/2714558932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd95c0bac80 0x7fd95c0903f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.572 7fd964772700 1 --2- 172.21.15.79:0/2714558932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd95c1aaa30 0x7fd95c1aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.572 7fd964772700 1 -- 172.21.15.79:0/2714558932 >> 172.21.15.79:0/2714558932 conn(0x7fd95c0d48c0 msgr2=0x7fd95c0d4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:27.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.572 7fd964772700 1 -- 172.21.15.79:0/2714558932 shutdown_connections 2021-04-09T18:31:27.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.572 7fd964772700 1 -- 172.21.15.79:0/2714558932 wait complete. 2021-04-09T18:31:27.582 INFO:tasks.ceph.mds.a:Restarting daemon 2021-04-09T18:31:27.582 INFO:tasks.ceph.mds.a:Stopping old one... 2021-04-09T18:31:27.583 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-04-09T18:31:27.583 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:31:27.583 INFO:tasks.ceph.mds.b:Restarting daemon 2021-04-09T18:31:27.584 INFO:tasks.ceph.mds.b:Stopping old one... 2021-04-09T18:31:27.584 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-04-09T18:31:27.584 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:31:27.596 INFO:tasks.ceph.mds.a:Stopped 2021-04-09T18:31:27.597 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-04-09T18:31:27.600 INFO:tasks.ceph.mds.b:Stopped 2021-04-09T18:31:27.600 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-04-09T18:31:27.640 INFO:tasks.ceph.mds.a:Started 2021-04-09T18:31:27.641 DEBUG:teuthology.parallel:result is None 2021-04-09T18:31:27.645 INFO:tasks.ceph.mds.b:Started 2021-04-09T18:31:27.646 DEBUG:teuthology.parallel:result is None 2021-04-09T18:31:27.646 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-04-09T18:31:27.712 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2021-04-09T18:31:27.725 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2021-04-09T18:31:27.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f8469d2b700 1 Processor -- start 2021-04-09T18:31:27.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f8469d2b700 1 -- start start 2021-04-09T18:31:27.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f8469d2b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f84641c9020 0x7f84641cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:27.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f8469d2b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84640fbb20 con 0x7f84640f5520 2021-04-09T18:31:27.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f8469d2b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846409f910 con 0x7f84640e9ae0 2021-04-09T18:31:27.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f8469d2b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84641c3dc0 con 0x7f84641c9020 2021-04-09T18:31:27.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f84637fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f84640f5520 0x7f84640f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53564/0 (socket says 172.21.15.79:53564) 2021-04-09T18:31:27.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f84637fe700 1 -- 172.21.15.79:0/1866044163 learned_addr learned my addr 172.21.15.79:0/1866044163 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:27.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f8463fff700 1 --2- 172.21.15.79:0/1866044163 >> v2:172.21.15.89:3300/0 conn(0x7f84641c9020 0x7f84641cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:27.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f84627fc700 1 -- 172.21.15.79:0/1866044163 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523879300 0 0) 0x7f84540010d0 con 0x7f84640f5520 2021-04-09T18:31:27.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f84627fc700 1 -- 172.21.15.79:0/1866044163 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f844c003240 con 0x7f84640f5520 2021-04-09T18:31:27.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f84627fc700 1 -- 172.21.15.79:0/1866044163 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005552479 0 0) 0x7f84580010d0 con 0x7f84640e9ae0 2021-04-09T18:31:27.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f84627fc700 1 -- 172.21.15.79:0/1866044163 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f844c004680 con 0x7f84640e9ae0 2021-04-09T18:31:27.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f8463fff700 1 -- 172.21.15.79:0/1866044163 >> v1:172.21.15.89:6789/0 conn(0x7f84640e9ae0 legacy=0x7f846409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:27.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f8463fff700 1 -- 172.21.15.79:0/1866044163 >> v1:172.21.15.79:6789/0 conn(0x7f84640f5520 legacy=0x7f84640f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:27.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f8463fff700 1 -- 172.21.15.79:0/1866044163 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84640e56d0 con 0x7f84641c9020 2021-04-09T18:31:27.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f8463fff700 1 --2- 172.21.15.79:0/1866044163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84641c9020 0x7f84641cb480 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f845c0032b0 tx=0x7f845c00b0e0).ready entity=mon.1 client_cookie=84af31cc01221c9d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:27.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f84627fc700 1 -- 172.21.15.79:0/1866044163 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f84640e56d0 con 0x7f84641c9020 2021-04-09T18:31:27.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f84627fc700 1 -- 172.21.15.79:0/1866044163 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845c00bab0 con 0x7f84641c9020 2021-04-09T18:31:27.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f84627fc700 1 -- 172.21.15.79:0/1866044163 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f845c002020 con 0x7f84641c9020 2021-04-09T18:31:27.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f8469d2b700 1 -- 172.21.15.79:0/1866044163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84641c9020 msgr2=0x7f84641cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:27.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f8469d2b700 1 --2- 172.21.15.79:0/1866044163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84641c9020 0x7f84641cb480 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f845c0032b0 tx=0x7f845c00b0e0).stop 2021-04-09T18:31:27.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f8469d2b700 1 -- 172.21.15.79:0/1866044163 shutdown_connections 2021-04-09T18:31:27.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f8469d2b700 1 --2- 172.21.15.79:0/1866044163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84641c9020 0x7f84641cb480 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f8469d2b700 1 -- 172.21.15.79:0/1866044163 >> 172.21.15.79:0/1866044163 conn(0x7f84640e5fe0 msgr2=0x7f84640e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:27.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f8469d2b700 1 -- 172.21.15.79:0/1866044163 shutdown_connections 2021-04-09T18:31:27.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.732 7f8469d2b700 1 -- 172.21.15.79:0/1866044163 wait complete. 2021-04-09T18:31:27.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.736 7f8469d2b700 1 Processor -- start 2021-04-09T18:31:27.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.736 7f8469d2b700 1 -- start start 2021-04-09T18:31:27.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.736 7f8469d2b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8464099780 0x7f84640915a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:27.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.736 7f8469d2b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8464093c10 0x7f84640d8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:27.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.736 7f8469d2b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84640ce630 0x7f84640cea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:27.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.736 7f8469d2b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84640e9f30 con 0x7f8464093c10 2021-04-09T18:31:27.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.736 7f8469d2b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846409a6d0 con 0x7f8464099780 2021-04-09T18:31:27.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.736 7f8469d2b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8464094060 con 0x7f84640ce630 2021-04-09T18:31:27.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.736 7f8462ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8464093c10 0x7f84640d8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:27.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.736 7f8462ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8464093c10 0x7f84640d8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58860/0 (socket says 172.21.15.79:58860) 2021-04-09T18:31:27.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.736 7f8462ffd700 1 -- 172.21.15.79:0/2173923225 learned_addr learned my addr 172.21.15.79:0/2173923225 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:27.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.740 7f8463fff700 1 --2- 172.21.15.79:0/2173923225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84640ce630 0x7f84640cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:27.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.740 7f84637fe700 1 --2- 172.21.15.79:0/2173923225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8464099780 0x7f84640915a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:27.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.740 7f8462ffd700 1 -- 172.21.15.79:0/2173923225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84640ce630 msgr2=0x7f84640cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:27.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.740 7f8462ffd700 1 --2- 172.21.15.79:0/2173923225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84640ce630 0x7f84640cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.740 7f8462ffd700 1 -- 172.21.15.79:0/2173923225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8464099780 msgr2=0x7f84640915a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:27.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.740 7f8462ffd700 1 --2- 172.21.15.79:0/2173923225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8464099780 0x7f84640915a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:27.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.740 7f8462ffd700 1 -- 172.21.15.79:0/2173923225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84640d89c0 con 0x7f8464093c10 2021-04-09T18:31:27.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.740 7f84637fe700 1 --2- 172.21.15.79:0/2173923225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8464099780 0x7f84640915a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:27.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.740 7f8462ffd700 1 --2- 172.21.15.79:0/2173923225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8464093c10 0x7f84640d8390 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f84640d2630 tx=0x7f8458007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:27.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.740 7f844bfff700 1 -- 172.21.15.79:0/2173923225 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f84640d89c0 con 0x7f8464093c10 2021-04-09T18:31:27.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.740 7f844bfff700 1 -- 172.21.15.79:0/2173923225 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845800e4a0 con 0x7f8464093c10 2021-04-09T18:31:27.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.740 7f844bfff700 1 -- 172.21.15.79:0/2173923225 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f845800e870 con 0x7f8464093c10 2021-04-09T18:31:27.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.740 7f8469d2b700 1 -- 172.21.15.79:0/2173923225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f846409a260 con 0x7f8464093c10 2021-04-09T18:31:27.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.740 7f8469d2b700 1 -- 172.21.15.79:0/2173923225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84640d8d10 con 0x7f8464093c10 2021-04-09T18:31:27.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.740 7f844bfff700 1 -- 172.21.15.79:0/2173923225 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f845800ea70 con 0x7f8464093c10 2021-04-09T18:31:27.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.740 7f844bfff700 1 --2- 172.21.15.79:0/2173923225 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8444029100 0x7f844402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:27.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.740 7f844bfff700 1 -- 172.21.15.79:0/2173923225 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5319+0+0 (secure 0 0 0) 0x7f8458038a70 con 0x7f8464093c10 2021-04-09T18:31:27.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.740 7f84637fe700 1 --2- 172.21.15.79:0/2173923225 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8444029100 0x7f844402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:27.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.740 7f84637fe700 1 --2- 172.21.15.79:0/2173923225 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8444029100 0x7f844402b650 crc :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:27.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.744 7f8469d2b700 1 -- 172.21.15.79:0/2173923225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84640e39e0 con 0x7f8464093c10 2021-04-09T18:31:27.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.748 7f844bfff700 1 -- 172.21.15.79:0/2173923225 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f845800e290 con 0x7f8464093c10 2021-04-09T18:31:27.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.924 7f8469d2b700 1 -- 172.21.15.79:0/2173923225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f84640a1cc0 con 0x7f8464093c10 2021-04-09T18:31:27.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:27.996 7f844bfff700 1 -- 172.21.15.79:0/2173923225 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v55) v1 ==== 97+0+0 (secure 0 0 0) 0x7f84640e5ca0 con 0x7f8464093c10 2021-04-09T18:31:28.038 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blacklist entries 2021-04-09T18:31:28.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.040 7f8469d2b700 1 -- 172.21.15.79:0/2173923225 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8444029100 msgr2=0x7f844402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:28.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.040 7f8469d2b700 1 --2- 172.21.15.79:0/2173923225 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8444029100 0x7f844402b650 crc :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.040 7f8469d2b700 1 -- 172.21.15.79:0/2173923225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8464093c10 msgr2=0x7f84640d8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:28.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.040 7f8469d2b700 1 --2- 172.21.15.79:0/2173923225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8464093c10 0x7f84640d8390 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f84640d2630 tx=0x7f8458007f70).stop 2021-04-09T18:31:28.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.040 7f8469d2b700 1 -- 172.21.15.79:0/2173923225 shutdown_connections 2021-04-09T18:31:28.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.040 7f8469d2b700 1 --2- 172.21.15.79:0/2173923225 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8444029100 0x7f844402b650 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.040 7f8469d2b700 1 --2- 172.21.15.79:0/2173923225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8464099780 0x7f84640915a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.040 7f8469d2b700 1 --2- 172.21.15.79:0/2173923225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84640ce630 0x7f84640cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.040 7f8469d2b700 1 --2- 172.21.15.79:0/2173923225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8464093c10 0x7f84640d8390 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.040 7f8469d2b700 1 -- 172.21.15.79:0/2173923225 >> 172.21.15.79:0/2173923225 conn(0x7f846408e3b0 msgr2=0x7f84640d2870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:28.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.044 7f8469d2b700 1 -- 172.21.15.79:0/2173923225 shutdown_connections 2021-04-09T18:31:28.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.044 7f8469d2b700 1 -- 172.21.15.79:0/2173923225 wait complete. 2021-04-09T18:31:28.056 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-04-09T18:31:28.056 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-04-09T18:31:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb6268c700 1 Processor -- start 2021-04-09T18:31:28.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb6268c700 1 -- start start 2021-04-09T18:31:28.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb6268c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb5c0e9ad0 0x7fdb5c09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:28.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb6268c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdb5c1c8000 0x7fdb5c1ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:28.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb6268c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb5c0fbb10 con 0x7fdb5c0f5510 2021-04-09T18:31:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb6268c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb5c1c3db0 con 0x7fdb5c1c8000 2021-04-09T18:31:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb6268c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c0e9f20 con 0x7fdb5c0e9ad0 2021-04-09T18:31:28.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb60c31700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdb5c1c8000 0x7fdb5c1ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:28.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb60c31700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdb5c1c8000 0x7fdb5c1ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58870/0 (socket says 172.21.15.79:58870) 2021-04-09T18:31:28.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb60c31700 1 -- 172.21.15.79:0/3326893754 learned_addr learned my addr 172.21.15.79:0/3326893754 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb5b7fe700 1 --2- 172.21.15.79:0/3326893754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb5c0e9ad0 0x7fdb5c09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb60c31700 1 -- 172.21.15.79:0/3326893754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb5c0e9ad0 msgr2=0x7fdb5c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb60c31700 1 --2- 172.21.15.79:0/3326893754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb5c0e9ad0 0x7fdb5c09f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb60c31700 1 -- 172.21.15.79:0/3326893754 >> v1:172.21.15.89:6789/0 conn(0x7fdb5c0f5510 legacy=0x7fdb5c0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb60c31700 1 -- 172.21.15.79:0/3326893754 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c0e56c0 con 0x7fdb5c1c8000 2021-04-09T18:31:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb60c31700 1 --2- 172.21.15.79:0/3326893754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c1c8000 0x7fdb5c1ca460 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fdb540032b0 tx=0x7fdb5400b3c0).ready entity=mon.0 client_cookie=b21da969aa46b8e3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb5affd700 1 -- 172.21.15.79:0/3326893754 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb5c0e56c0 con 0x7fdb5c1c8000 2021-04-09T18:31:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb5affd700 1 -- 172.21.15.79:0/3326893754 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5400bc20 con 0x7fdb5c1c8000 2021-04-09T18:31:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb5affd700 1 -- 172.21.15.79:0/3326893754 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb54002020 con 0x7fdb5c1c8000 2021-04-09T18:31:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb6268c700 1 -- 172.21.15.79:0/3326893754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c1c8000 msgr2=0x7fdb5c1ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.152 7fdb6268c700 1 --2- 172.21.15.79:0/3326893754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c1c8000 0x7fdb5c1ca460 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fdb540032b0 tx=0x7fdb5400b3c0).stop 2021-04-09T18:31:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.156 7fdb6268c700 1 -- 172.21.15.79:0/3326893754 shutdown_connections 2021-04-09T18:31:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.156 7fdb6268c700 1 --2- 172.21.15.79:0/3326893754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c1c8000 0x7fdb5c1ca460 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.156 7fdb6268c700 1 --2- 172.21.15.79:0/3326893754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb5c0e9ad0 0x7fdb5c09f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.156 7fdb6268c700 1 -- 172.21.15.79:0/3326893754 >> 172.21.15.79:0/3326893754 conn(0x7fdb5c0e5fd0 msgr2=0x7fdb5c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:28.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.156 7fdb6268c700 1 -- 172.21.15.79:0/3326893754 shutdown_connections 2021-04-09T18:31:28.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.156 7fdb6268c700 1 -- 172.21.15.79:0/3326893754 wait complete. 2021-04-09T18:31:28.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.160 7fdb6268c700 1 Processor -- start 2021-04-09T18:31:28.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.160 7fdb6268c700 1 -- start start 2021-04-09T18:31:28.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.160 7fdb6268c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb5c0a9050 0x7fdb5c1a4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:28.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.160 7fdb6268c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb5c09a0f0 0x7fdb5c0cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:28.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.160 7fdb6268c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c0d01d0 0x7fdb5c1a7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:28.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.160 7fdb6268c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c09b130 con 0x7fdb5c0d01d0 2021-04-09T18:31:28.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.160 7fdb6268c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c0b82d0 con 0x7fdb5c0a9050 2021-04-09T18:31:28.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.160 7fdb6268c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c0a94a0 con 0x7fdb5c09a0f0 2021-04-09T18:31:28.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.160 7fdb60c31700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c0d01d0 0x7fdb5c1a7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:28.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.160 7fdb5b7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb5c09a0f0 0x7fdb5c0cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:28.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.160 7fdb60c31700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c0d01d0 0x7fdb5c1a7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58878/0 (socket says 172.21.15.79:58878) 2021-04-09T18:31:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.160 7fdb60c31700 1 -- 172.21.15.79:0/1739737619 learned_addr learned my addr 172.21.15.79:0/1739737619 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.160 7fdb5bfff700 1 --2- 172.21.15.79:0/1739737619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb5c0a9050 0x7fdb5c1a4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:28.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.160 7fdb60c31700 1 -- 172.21.15.79:0/1739737619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb5c09a0f0 msgr2=0x7fdb5c0cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:28.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.160 7fdb60c31700 1 --2- 172.21.15.79:0/1739737619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb5c09a0f0 0x7fdb5c0cfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.160 7fdb60c31700 1 -- 172.21.15.79:0/1739737619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb5c0a9050 msgr2=0x7fdb5c1a4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:28.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.160 7fdb60c31700 1 --2- 172.21.15.79:0/1739737619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb5c0a9050 0x7fdb5c1a4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.160 7fdb60c31700 1 -- 172.21.15.79:0/1739737619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c099ce0 con 0x7fdb5c0d01d0 2021-04-09T18:31:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.160 7fdb60c31700 1 --2- 172.21.15.79:0/1739737619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c0d01d0 0x7fdb5c1a7670 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fdb5c0d3dd0 tx=0x7fdb54006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.164 7fdb58ff9700 1 -- 172.21.15.79:0/1739737619 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb5c099ce0 con 0x7fdb5c0d01d0 2021-04-09T18:31:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.164 7fdb58ff9700 1 -- 172.21.15.79:0/1739737619 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5401b670 con 0x7fdb5c0d01d0 2021-04-09T18:31:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.164 7fdb58ff9700 1 -- 172.21.15.79:0/1739737619 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb5401ba40 con 0x7fdb5c0d01d0 2021-04-09T18:31:28.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.164 7fdb6268c700 1 -- 172.21.15.79:0/1739737619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb5c09acc0 con 0x7fdb5c0d01d0 2021-04-09T18:31:28.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.164 7fdb6268c700 1 -- 172.21.15.79:0/1739737619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5c0b7df0 con 0x7fdb5c0d01d0 2021-04-09T18:31:28.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.164 7fdb58ff9700 1 -- 172.21.15.79:0/1739737619 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fdb54019040 con 0x7fdb5c0d01d0 2021-04-09T18:31:28.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.164 7fdb58ff9700 1 --2- 172.21.15.79:0/1739737619 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb3c029100 0x7fdb3c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.164 7fdb58ff9700 1 -- 172.21.15.79:0/1739737619 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fdb54018040 con 0x7fdb5c0d01d0 2021-04-09T18:31:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.164 7fdb5bfff700 1 --2- 172.21.15.79:0/1739737619 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb3c029100 0x7fdb3c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.164 7fdb5bfff700 1 --2- 172.21.15.79:0/1739737619 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb3c029100 0x7fdb3c02b650 crc :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.164 7fdb6268c700 1 -- 172.21.15.79:0/1739737619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5c0e39d0 con 0x7fdb5c0d01d0 2021-04-09T18:31:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.172 7fdb58ff9700 1 -- 172.21.15.79:0/1739737619 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fdb5401b460 con 0x7fdb5c0d01d0 2021-04-09T18:31:28.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.332 7fdb6268c700 1 -- 172.21.15.79:0/1739737619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdb5c0f5b10 con 0x7fdb5c0d01d0 2021-04-09T18:31:28.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.332 7fdb58ff9700 1 -- 172.21.15.79:0/1739737619 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fdb5c0f76b0 con 0x7fdb5c0d01d0 2021-04-09T18:31:28.335 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:28.337 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:31:28.338 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2021-04-09T18:31:28.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:28.338 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2021-04-09T18:31:28.338 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgovEoMhAAbDfArG3lSFAdk80rS/4iEQ==", 2021-04-09T18:31:28.338 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:31:28.339 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:31:28.339 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:31:28.339 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:31:28.339 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:31:28.340 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:28.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:28.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:28.340 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2021-04-09T18:31:28.340 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgN4sfOBAAPjvDX11uLM+vgdFpdP49Kw==", 2021-04-09T18:31:28.341 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:31:28.341 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:31:28.341 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:31:28.341 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:31:28.342 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:31:28.342 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:28.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:28.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:28.343 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2021-04-09T18:31:28.343 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQALnHBgro0COxAAgbe5jxAZH9bD7zDLbtdkhQ==", 2021-04-09T18:31:28.343 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:31:28.343 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:31:28.343 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:31:28.344 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:31:28.344 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:28.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:28.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:28.345 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2021-04-09T18:31:28.345 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAPnHBghZ/oARAAhkN+fnZJiskmHnvvs+G8NA==", 2021-04-09T18:31:28.346 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:31:28.346 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:31:28.346 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:31:28.346 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:31:28.346 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:28.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:28.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:28.347 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2021-04-09T18:31:28.347 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQASnHBgWT2FBxAACrSTbwbF18k9aPeYNohelw==", 2021-04-09T18:31:28.348 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:31:28.348 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:31:28.348 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:31:28.349 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:31:28.349 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:28.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:28.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:28.350 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2021-04-09T18:31:28.350 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAVnHBgPHy6CxAAFq+yki4AZe5ybodgTO/4/Q==", 2021-04-09T18:31:28.350 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:31:28.350 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:31:28.351 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:31:28.351 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:31:28.351 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:28.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:28.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:28.352 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2021-04-09T18:31:28.352 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAanHBgfbs4NhAAQzxM9dDML4RgQP8yamkuVw==", 2021-04-09T18:31:28.352 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:31:28.352 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:31:28.352 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:31:28.353 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:31:28.353 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:28.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:28.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:28.354 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2021-04-09T18:31:28.354 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAdnHBgi0WLOhAA4OBguOCjtmzqulUjTJ+GhQ==", 2021-04-09T18:31:28.354 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:31:28.354 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:31:28.354 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:31:28.355 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:31:28.355 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:28.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:28.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:28.356 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2021-04-09T18:31:28.356 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAhnHBgCs+PAxAAOm0wSMe/1Bu9vfTrpmrLkg==", 2021-04-09T18:31:28.356 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:31:28.356 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:31:28.357 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:31:28.357 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:31:28.357 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:28.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:28.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:28.359 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2021-04-09T18:31:28.359 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAknHBgH1S3CBAAUcdUIW7O6wH482l1yZBKBw==", 2021-04-09T18:31:28.360 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:31:28.360 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:31:28.361 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:31:28.361 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:31:28.361 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:28.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:28.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:28.362 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2021-04-09T18:31:28.363 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgxEq9BxAAap2nrjhcrf2aHzygtMclVw==", 2021-04-09T18:31:28.363 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:31:28.364 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:31:28.364 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:31:28.365 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:31:28.365 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:28.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:28.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:28.366 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2021-04-09T18:31:28.367 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBguJFeDRAAWL4NV4tsYRAqcwJ26kjm2Q==", 2021-04-09T18:31:28.367 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:31:28.367 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:31:28.368 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:31:28.368 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:31:28.368 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:28.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:28.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:28.369 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2021-04-09T18:31:28.369 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgN9X5EhAA3DBPdlRHVBHXJNH9nRFW0A==", 2021-04-09T18:31:28.369 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:31:28.370 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:31:28.370 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:31:28.370 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:31:28.370 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:28.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:28.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:28.371 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2021-04-09T18:31:28.371 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgHOSVDBAAMMqd8paqBSTQRgR7n4EXGQ==", 2021-04-09T18:31:28.371 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:31:28.372 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:31:28.372 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:31:28.372 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:31:28.372 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:31:28.373 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:28.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:28.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:28.373 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2021-04-09T18:31:28.373 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgmHJhLxAAyhBrx08J7ZFKu34MYC2Wyg==", 2021-04-09T18:31:28.374 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:31:28.374 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:31:28.374 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:31:28.374 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:31:28.374 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:28.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:31:28.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:28.375 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2021-04-09T18:31:28.375 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgNCCXKhAA/bKOzzjVHldj6RpMGu0c8g==", 2021-04-09T18:31:28.376 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:31:28.376 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:31:28.376 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:31:28.376 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:31:28.376 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:28.377 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:28.377 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:31:28.377 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:31:28.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.336 7fdb6268c700 1 -- 172.21.15.79:0/1739737619 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb3c029100 msgr2=0x7fdb3c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:28.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.336 7fdb6268c700 1 --2- 172.21.15.79:0/1739737619 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb3c029100 0x7fdb3c02b650 crc :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.336 7fdb6268c700 1 -- 172.21.15.79:0/1739737619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c0d01d0 msgr2=0x7fdb5c1a7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:28.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.336 7fdb6268c700 1 --2- 172.21.15.79:0/1739737619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c0d01d0 0x7fdb5c1a7670 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fdb5c0d3dd0 tx=0x7fdb54006c10).stop 2021-04-09T18:31:28.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.336 7fdb6268c700 1 -- 172.21.15.79:0/1739737619 shutdown_connections 2021-04-09T18:31:28.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.336 7fdb6268c700 1 --2- 172.21.15.79:0/1739737619 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb3c029100 0x7fdb3c02b650 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.336 7fdb6268c700 1 --2- 172.21.15.79:0/1739737619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb5c0a9050 0x7fdb5c1a4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.336 7fdb6268c700 1 --2- 172.21.15.79:0/1739737619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c0d01d0 0x7fdb5c1a7670 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.336 7fdb6268c700 1 --2- 172.21.15.79:0/1739737619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb5c09a0f0 0x7fdb5c0cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.336 7fdb6268c700 1 -- 172.21.15.79:0/1739737619 >> 172.21.15.79:0/1739737619 conn(0x7fdb5c093d40 msgr2=0x7fdb5c0d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:28.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.336 7fdb6268c700 1 -- 172.21.15.79:0/1739737619 shutdown_connections 2021-04-09T18:31:28.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.336 7fdb6268c700 1 -- 172.21.15.79:0/1739737619 wait complete. 2021-04-09T18:31:28.382 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:31:28.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.476 7fe8817bb700 1 Processor -- start 2021-04-09T18:31:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.476 7fe8817bb700 1 -- start start 2021-04-09T18:31:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe8817bb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c1c9010 0x7fe87c1cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe8817bb700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe87c0fbb10 con 0x7fe87c0f5510 2021-04-09T18:31:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe8817bb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe87c09f900 con 0x7fe87c0e9ad0 2021-04-09T18:31:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe8817bb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c1c3db0 con 0x7fe87c1c9010 2021-04-09T18:31:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe87b550700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe87c0f5510 0x7fe87c0f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53592/0 (socket says 172.21.15.79:53592) 2021-04-09T18:31:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe87b550700 1 -- 172.21.15.79:0/3276680420 learned_addr learned my addr 172.21.15.79:0/3276680420 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:28.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe87bd51700 1 --2- 172.21.15.79:0/3276680420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c1c9010 0x7fe87c1cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:28.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe87a54e700 1 -- 172.21.15.79:0/3276680420 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886805404 0 0) 0x7fe86c001450 con 0x7fe87c0f5510 2021-04-09T18:31:28.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe87a54e700 1 -- 172.21.15.79:0/3276680420 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe864003240 con 0x7fe87c0f5510 2021-04-09T18:31:28.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe87a54e700 1 -- 172.21.15.79:0/3276680420 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1897119428 0 0) 0x7fe8700010d0 con 0x7fe87c0e9ad0 2021-04-09T18:31:28.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe87a54e700 1 -- 172.21.15.79:0/3276680420 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe864003620 con 0x7fe87c0e9ad0 2021-04-09T18:31:28.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe87bd51700 1 -- 172.21.15.79:0/3276680420 >> v1:172.21.15.89:6789/0 conn(0x7fe87c0e9ad0 legacy=0x7fe87c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:28.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe87bd51700 1 -- 172.21.15.79:0/3276680420 >> v1:172.21.15.79:6789/0 conn(0x7fe87c0f5510 legacy=0x7fe87c0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:28.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe87bd51700 1 -- 172.21.15.79:0/3276680420 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87c0e56c0 con 0x7fe87c1c9010 2021-04-09T18:31:28.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe87bd51700 1 --2- 172.21.15.79:0/3276680420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c1c9010 0x7fe87c1cb470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fe874002f30 tx=0x7fe87400bcf0).ready entity=mon.2 client_cookie=c37c4b7f9c936a5d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:28.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe87a54e700 1 -- 172.21.15.79:0/3276680420 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe87c0e56c0 con 0x7fe87c1c9010 2021-04-09T18:31:28.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe87a54e700 1 -- 172.21.15.79:0/3276680420 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe874009920 con 0x7fe87c1c9010 2021-04-09T18:31:28.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe87a54e700 1 -- 172.21.15.79:0/3276680420 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe874009cf0 con 0x7fe87c1c9010 2021-04-09T18:31:28.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe8817bb700 1 -- 172.21.15.79:0/3276680420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c1c9010 msgr2=0x7fe87c1cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:28.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe8817bb700 1 --2- 172.21.15.79:0/3276680420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c1c9010 0x7fe87c1cb470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fe874002f30 tx=0x7fe87400bcf0).stop 2021-04-09T18:31:28.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe8817bb700 1 -- 172.21.15.79:0/3276680420 shutdown_connections 2021-04-09T18:31:28.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe8817bb700 1 --2- 172.21.15.79:0/3276680420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c1c9010 0x7fe87c1cb470 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe8817bb700 1 -- 172.21.15.79:0/3276680420 >> 172.21.15.79:0/3276680420 conn(0x7fe87c0e5fd0 msgr2=0x7fe87c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:28.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.480 7fe8817bb700 1 -- 172.21.15.79:0/3276680420 shutdown_connections 2021-04-09T18:31:28.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.484 7fe8817bb700 1 -- 172.21.15.79:0/3276680420 wait complete. 2021-04-09T18:31:28.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe8817bb700 1 Processor -- start 2021-04-09T18:31:28.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe8817bb700 1 -- start start 2021-04-09T18:31:28.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe8817bb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c0bf360 0x7fe87c1a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:28.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe8817bb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe87c0d50a0 0x7fe87c0d54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:28.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe8817bb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe87c0b4f20 0x7fe87c0b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:28.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe8817bb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c0e9f20 con 0x7fe87c0d50a0 2021-04-09T18:31:28.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe8817bb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c0bfab0 con 0x7fe87c0b4f20 2021-04-09T18:31:28.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe8817bb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c0bf7b0 con 0x7fe87c0bf360 2021-04-09T18:31:28.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe87ad4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe87c0d50a0 0x7fe87c0d54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:28.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe87ad4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe87c0d50a0 0x7fe87c0d54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58892/0 (socket says 172.21.15.79:58892) 2021-04-09T18:31:28.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe87ad4f700 1 -- 172.21.15.79:0/2614434290 learned_addr learned my addr 172.21.15.79:0/2614434290 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:28.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe87bd51700 1 --2- 172.21.15.79:0/2614434290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe87c0b4f20 0x7fe87c0b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:28.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe87b550700 1 --2- 172.21.15.79:0/2614434290 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c0bf360 0x7fe87c1a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:28.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe87ad4f700 1 -- 172.21.15.79:0/2614434290 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c0bf360 msgr2=0x7fe87c1a0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:28.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe87ad4f700 1 --2- 172.21.15.79:0/2614434290 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c0bf360 0x7fe87c1a0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe87ad4f700 1 -- 172.21.15.79:0/2614434290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe87c0b4f20 msgr2=0x7fe87c0b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:28.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe87ad4f700 1 --2- 172.21.15.79:0/2614434290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe87c0b4f20 0x7fe87c0b5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe87ad4f700 1 -- 172.21.15.79:0/2614434290 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87c1a1530 con 0x7fe87c0d50a0 2021-04-09T18:31:28.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe87ad4f700 1 --2- 172.21.15.79:0/2614434290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe87c0d50a0 0x7fe87c0d54f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fe87c0a3230 tx=0x7fe87000ca90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:28.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe863fff700 1 -- 172.21.15.79:0/2614434290 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe870010510 con 0x7fe87c0d50a0 2021-04-09T18:31:28.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe863fff700 1 -- 172.21.15.79:0/2614434290 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe870010710 con 0x7fe87c0d50a0 2021-04-09T18:31:28.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe8817bb700 1 -- 172.21.15.79:0/2614434290 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe87c19b9d0 con 0x7fe87c0d50a0 2021-04-09T18:31:28.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe863fff700 1 -- 172.21.15.79:0/2614434290 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe8700108f0 con 0x7fe87c0d50a0 2021-04-09T18:31:28.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe8817bb700 1 -- 172.21.15.79:0/2614434290 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87c0b5b30 con 0x7fe87c0d50a0 2021-04-09T18:31:28.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.488 7fe863fff700 1 -- 172.21.15.79:0/2614434290 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe870019020 con 0x7fe87c0d50a0 2021-04-09T18:31:28.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.492 7fe863fff700 1 --2- 172.21.15.79:0/2614434290 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe85c029100 0x7fe85c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:28.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.492 7fe863fff700 1 -- 172.21.15.79:0/2614434290 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fe870038c70 con 0x7fe87c0d50a0 2021-04-09T18:31:28.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.492 7fe87b550700 1 --2- 172.21.15.79:0/2614434290 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe85c029100 0x7fe85c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:28.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.492 7fe87b550700 1 --2- 172.21.15.79:0/2614434290 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe85c029100 0x7fe85c02b650 crc :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:28.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.492 7fe8817bb700 1 -- 172.21.15.79:0/2614434290 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe87c0e39d0 con 0x7fe87c0d50a0 2021-04-09T18:31:28.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.496 7fe863fff700 1 -- 172.21.15.79:0/2614434290 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe870010300 con 0x7fe87c0d50a0 2021-04-09T18:31:28.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.656 7fe8817bb700 1 -- 172.21.15.79:0/2614434290 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe87c0f5b10 con 0x7fe87c0d50a0 2021-04-09T18:31:28.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.660 7fe863fff700 1 -- 172.21.15.79:0/2614434290 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+11377 (secure 0 0 0) 0x7fe87c0e5c90 con 0x7fe87c0d50a0 2021-04-09T18:31:28.662 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:28.662 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":55,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:31:27.989985","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:31:28.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.664 7fe8817bb700 1 -- 172.21.15.79:0/2614434290 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe85c029100 msgr2=0x7fe85c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:28.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.664 7fe8817bb700 1 --2- 172.21.15.79:0/2614434290 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe85c029100 0x7fe85c02b650 crc :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.664 7fe8817bb700 1 -- 172.21.15.79:0/2614434290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe87c0d50a0 msgr2=0x7fe87c0d54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:28.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.664 7fe8817bb700 1 --2- 172.21.15.79:0/2614434290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe87c0d50a0 0x7fe87c0d54f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fe87c0a3230 tx=0x7fe87000ca90).stop 2021-04-09T18:31:28.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.664 7fe8817bb700 1 -- 172.21.15.79:0/2614434290 shutdown_connections 2021-04-09T18:31:28.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.664 7fe8817bb700 1 --2- 172.21.15.79:0/2614434290 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe85c029100 0x7fe85c02b650 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.664 7fe8817bb700 1 --2- 172.21.15.79:0/2614434290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe87c0b4f20 0x7fe87c0b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.664 7fe8817bb700 1 --2- 172.21.15.79:0/2614434290 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c0bf360 0x7fe87c1a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.664 7fe8817bb700 1 --2- 172.21.15.79:0/2614434290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe87c0d50a0 0x7fe87c0d54f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.664 7fe8817bb700 1 -- 172.21.15.79:0/2614434290 >> 172.21.15.79:0/2614434290 conn(0x7fe87c09acb0 msgr2=0x7fe87c0d8430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:28.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.664 7fe8817bb700 1 -- 172.21.15.79:0/2614434290 shutdown_connections 2021-04-09T18:31:28.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.664 7fe8817bb700 1 -- 172.21.15.79:0/2614434290 wait complete. 2021-04-09T18:31:28.675 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-04-09T18:31:28.676 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:31:28.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.768 7f69b5267700 1 Processor -- start 2021-04-09T18:31:28.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.768 7f69b5267700 1 -- start start 2021-04-09T18:31:28.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.768 7f69b5267700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f69b00f5540 0x7f69b00f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:28.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.768 7f69b5267700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69b00e9b00 0x7f69b009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:28.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.768 7f69b5267700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b00fbb40 con 0x7f69b01c2dd0 2021-04-09T18:31:28.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.768 7f69b5267700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b00e9f50 con 0x7f69b00f5540 2021-04-09T18:31:28.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.768 7f69b5267700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b00e59f0 con 0x7f69b00e9b00 2021-04-09T18:31:28.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.768 7f69af005700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f69b00f5540 0x7f69b00f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:28.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.772 7f69af005700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f69b00f5540 0x7f69b00f64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58896/0 (socket says 172.21.15.79:58896) 2021-04-09T18:31:28.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.772 7f69af005700 1 -- 172.21.15.79:0/348388814 learned_addr learned my addr 172.21.15.79:0/348388814 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:28.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.772 7f69a6804700 1 --2- 172.21.15.79:0/348388814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69b00e9b00 0x7f69b009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:28.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.772 7f69af005700 1 -- 172.21.15.79:0/348388814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69b00e9b00 msgr2=0x7f69b009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:28.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.772 7f69af005700 1 --2- 172.21.15.79:0/348388814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69b00e9b00 0x7f69b009f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.772 7f69af005700 1 -- 172.21.15.79:0/348388814 >> v1:172.21.15.89:6789/0 conn(0x7f69b01c2dd0 legacy=0x7f69b01c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:28.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.772 7f69af005700 1 -- 172.21.15.79:0/348388814 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b00e56f0 con 0x7f69b00f5540 2021-04-09T18:31:28.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.772 7f69af005700 1 --2- 172.21.15.79:0/348388814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b00f5540 0x7f69b00f64d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f69a0002f30 tx=0x7f69a000bda0).ready entity=mon.0 client_cookie=1a64ab01249b8fa9 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:28.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.772 7f69ae804700 1 -- 172.21.15.79:0/348388814 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f69b00e56f0 con 0x7f69b00f5540 2021-04-09T18:31:28.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.772 7f69ae804700 1 -- 172.21.15.79:0/348388814 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a00099d0 con 0x7f69b00f5540 2021-04-09T18:31:28.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.772 7f69ae804700 1 -- 172.21.15.79:0/348388814 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f69a0009da0 con 0x7f69b00f5540 2021-04-09T18:31:28.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.772 7f69b5267700 1 -- 172.21.15.79:0/348388814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b00f5540 msgr2=0x7f69b00f64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:28.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.772 7f69b5267700 1 --2- 172.21.15.79:0/348388814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b00f5540 0x7f69b00f64d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f69a0002f30 tx=0x7f69a000bda0).stop 2021-04-09T18:31:28.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.772 7f69b5267700 1 -- 172.21.15.79:0/348388814 shutdown_connections 2021-04-09T18:31:28.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.772 7f69b5267700 1 --2- 172.21.15.79:0/348388814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b00f5540 0x7f69b00f64d0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.772 7f69b5267700 1 --2- 172.21.15.79:0/348388814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69b00e9b00 0x7f69b009f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.772 7f69b5267700 1 -- 172.21.15.79:0/348388814 >> 172.21.15.79:0/348388814 conn(0x7f69b00e6000 msgr2=0x7f69b00e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:28.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.772 7f69b5267700 1 -- 172.21.15.79:0/348388814 shutdown_connections 2021-04-09T18:31:28.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.772 7f69b5267700 1 -- 172.21.15.79:0/348388814 wait complete. 2021-04-09T18:31:28.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69b5267700 1 Processor -- start 2021-04-09T18:31:28.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69b5267700 1 -- start start 2021-04-09T18:31:28.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69b5267700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b00c3520 0x7f69b00b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:28.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69b5267700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69b00d5010 0x7f69b00d5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:28.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69b5267700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69b00af1e0 0x7f69b00af630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:28.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69b5267700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b00c5c50 con 0x7f69b00c3520 2021-04-09T18:31:28.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69b5267700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b00b20d0 con 0x7f69b00d5010 2021-04-09T18:31:28.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69b5267700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b00b0020 con 0x7f69b00af1e0 2021-04-09T18:31:28.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69af005700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b00c3520 0x7f69b00b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:28.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69af005700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b00c3520 0x7f69b00b1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58904/0 (socket says 172.21.15.79:58904) 2021-04-09T18:31:28.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69af005700 1 -- 172.21.15.79:0/539378333 learned_addr learned my addr 172.21.15.79:0/539378333 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:28.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69a6804700 1 --2- 172.21.15.79:0/539378333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69b00d5010 0x7f69b00d5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:28.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69af806700 1 --2- 172.21.15.79:0/539378333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69b00af1e0 0x7f69b00af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:28.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69af806700 1 -- 172.21.15.79:0/539378333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69b00d5010 msgr2=0x7f69b00d5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:28.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69af806700 1 --2- 172.21.15.79:0/539378333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69b00d5010 0x7f69b00d5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69af806700 1 -- 172.21.15.79:0/539378333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b00c3520 msgr2=0x7f69b00b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:28.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69af806700 1 --2- 172.21.15.79:0/539378333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b00c3520 0x7f69b00b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69af806700 1 -- 172.21.15.79:0/539378333 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b00c3970 con 0x7f69b00af1e0 2021-04-09T18:31:28.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69af005700 1 --2- 172.21.15.79:0/539378333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b00c3520 0x7f69b00b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:28.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69af806700 1 --2- 172.21.15.79:0/539378333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69b00af1e0 0x7f69b00af630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f69b009b010 tx=0x7f69a800cdb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:28.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69ac800700 1 -- 172.21.15.79:0/539378333 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f69b00c3970 con 0x7f69b00af1e0 2021-04-09T18:31:28.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69ac800700 1 -- 172.21.15.79:0/539378333 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a8006a80 con 0x7f69b00af1e0 2021-04-09T18:31:28.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69b5267700 1 -- 172.21.15.79:0/539378333 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b01b1050 con 0x7f69b00af1e0 2021-04-09T18:31:28.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69ac800700 1 -- 172.21.15.79:0/539378333 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f69a8006c60 con 0x7f69b00af1e0 2021-04-09T18:31:28.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.776 7f69b5267700 1 -- 172.21.15.79:0/539378333 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b01b1580 con 0x7f69b00af1e0 2021-04-09T18:31:28.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.780 7f69ac800700 1 -- 172.21.15.79:0/539378333 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f69a8007030 con 0x7f69b00af1e0 2021-04-09T18:31:28.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.780 7f69ac800700 1 --2- 172.21.15.79:0/539378333 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6994029100 0x7f699402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:28.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.780 7f69ac800700 1 -- 172.21.15.79:0/539378333 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f69a8038c60 con 0x7f69b00af1e0 2021-04-09T18:31:28.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.780 7f69af005700 1 --2- 172.21.15.79:0/539378333 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6994029100 0x7f699402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:28.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.780 7f69af005700 1 --2- 172.21.15.79:0/539378333 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6994029100 0x7f699402b650 crc :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:28.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.784 7f69b5267700 1 -- 172.21.15.79:0/539378333 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b00e39e0 con 0x7f69b00af1e0 2021-04-09T18:31:28.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.792 7f69ac800700 1 -- 172.21.15.79:0/539378333 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f69a8006870 con 0x7f69b00af1e0 2021-04-09T18:31:28.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.952 7f69b5267700 1 -- 172.21.15.79:0/539378333 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f69b00f5b40 con 0x7f69b00af1e0 2021-04-09T18:31:28.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.952 7f69ac800700 1 -- 172.21.15.79:0/539378333 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v55) v1 ==== 92+0+10 (secure 0 0 0) 0x7f69b00f76e0 con 0x7f69b00af1e0 2021-04-09T18:31:28.957 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:31:28.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.960 7f69b5267700 1 -- 172.21.15.79:0/539378333 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6994029100 msgr2=0x7f699402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:28.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.960 7f69b5267700 1 --2- 172.21.15.79:0/539378333 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6994029100 0x7f699402b650 crc :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.960 7f69b5267700 1 -- 172.21.15.79:0/539378333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69b00af1e0 msgr2=0x7f69b00af630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:28.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.960 7f69b5267700 1 --2- 172.21.15.79:0/539378333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69b00af1e0 0x7f69b00af630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f69b009b010 tx=0x7f69a800cdb0).stop 2021-04-09T18:31:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.960 7f69b5267700 1 -- 172.21.15.79:0/539378333 shutdown_connections 2021-04-09T18:31:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.960 7f69b5267700 1 --2- 172.21.15.79:0/539378333 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6994029100 0x7f699402b650 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.960 7f69b5267700 1 --2- 172.21.15.79:0/539378333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69b00af1e0 0x7f69b00af630 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.960 7f69b5267700 1 --2- 172.21.15.79:0/539378333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b00c3520 0x7f69b00b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.960 7f69b5267700 1 --2- 172.21.15.79:0/539378333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69b00d5010 0x7f69b00d5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.960 7f69b5267700 1 -- 172.21.15.79:0/539378333 >> 172.21.15.79:0/539378333 conn(0x7f69b00d8260 msgr2=0x7f69b00d6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.960 7f69b5267700 1 -- 172.21.15.79:0/539378333 shutdown_connections 2021-04-09T18:31:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:28.960 7f69b5267700 1 -- 172.21.15.79:0/539378333 wait complete. 2021-04-09T18:31:28.970 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-04-09T18:31:29.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.060 7f8fcb143700 1 Processor -- start 2021-04-09T18:31:29.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.060 7f8fcb143700 1 -- start start 2021-04-09T18:31:29.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.060 7f8fcb143700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fc40f5520 0x7f8fc40f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:29.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.060 7f8fcb143700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8fc41c8010 0x7f8fc41ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:29.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.060 7f8fcb143700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc40fbb20 con 0x7f8fc40e9ae0 2021-04-09T18:31:29.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.060 7f8fcb143700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc40e9f30 con 0x7f8fc41c8010 2021-04-09T18:31:29.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.060 7f8fcb143700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc41c3dc0 con 0x7f8fc40f5520 2021-04-09T18:31:29.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.060 7f8fc3fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8fc40e9ae0 0x7f8fc409f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53622/0 (socket says 172.21.15.79:53622) 2021-04-09T18:31:29.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.060 7f8fc3fff700 1 -- 172.21.15.79:0/959987138 learned_addr learned my addr 172.21.15.79:0/959987138 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:29.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.060 7f8fc96e8700 1 --2- 172.21.15.79:0/959987138 >> v2:172.21.15.89:3300/0 conn(0x7f8fc41c8010 0x7f8fc41ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:29.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.060 7f8fc8ee7700 1 --2- 172.21.15.79:0/959987138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fc40f5520 0x7f8fc40f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:29.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc37fe700 1 -- 172.21.15.79:0/959987138 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746366772 0 0) 0x7f8fb80010d0 con 0x7f8fc40e9ae0 2021-04-09T18:31:29.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc37fe700 1 -- 172.21.15.79:0/959987138 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fac003240 con 0x7f8fc40e9ae0 2021-04-09T18:31:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc37fe700 1 -- 172.21.15.79:0/959987138 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1601902679 0 0) 0x7f8fb8001650 con 0x7f8fc40e9ae0 2021-04-09T18:31:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc37fe700 1 -- 172.21.15.79:0/959987138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fc40f5520 msgr2=0x7f8fc40f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc37fe700 1 --2- 172.21.15.79:0/959987138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fc40f5520 0x7f8fc40f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:29.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc37fe700 1 -- 172.21.15.79:0/959987138 >> v2:172.21.15.89:3300/0 conn(0x7f8fc41c8010 msgr2=0x7f8fc41ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:29.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc37fe700 1 --2- 172.21.15.79:0/959987138 >> v2:172.21.15.89:3300/0 conn(0x7f8fc41c8010 0x7f8fc41ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:29.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc37fe700 1 -- 172.21.15.79:0/959987138 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc409f910 con 0x7f8fc40e9ae0 2021-04-09T18:31:29.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc37fe700 1 -- 172.21.15.79:0/959987138 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f8fb8001bb0 con 0x7f8fc40e9ae0 2021-04-09T18:31:29.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc37fe700 1 -- 172.21.15.79:0/959987138 >> v1:172.21.15.79:6789/0 conn(0x7f8fc40e9ae0 legacy=0x7f8fc409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:29.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc37fe700 1 --2- 172.21.15.79:0/959987138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fac0038c0 0x7f8fac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:29.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc37fe700 1 --2- 172.21.15.79:0/959987138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fac0045a0 0x7f8fac0049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:29.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc37fe700 1 --2- 172.21.15.79:0/959987138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fac04d7f0 0x7f8fac04fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:29.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc37fe700 1 -- 172.21.15.79:0/959987138 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40e9f30 con 0x7f8fac0038c0 2021-04-09T18:31:29.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc37fe700 1 -- 172.21.15.79:0/959987138 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc41c3dc0 con 0x7f8fac0045a0 2021-04-09T18:31:29.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc37fe700 1 -- 172.21.15.79:0/959987138 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac0052a0 con 0x7f8fac04d7f0 2021-04-09T18:31:29.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc8ee7700 1 --2- 172.21.15.79:0/959987138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fac0038c0 0x7f8fac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:29.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc96e8700 1 --2- 172.21.15.79:0/959987138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fac04d7f0 0x7f8fac04fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:29.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc3fff700 1 --2- 172.21.15.79:0/959987138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fac0045a0 0x7f8fac0049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:29.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc8ee7700 1 -- 172.21.15.79:0/959987138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fac04d7f0 msgr2=0x7f8fac04fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:29.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc8ee7700 1 --2- 172.21.15.79:0/959987138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fac04d7f0 0x7f8fac04fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:29.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc8ee7700 1 -- 172.21.15.79:0/959987138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fac0045a0 msgr2=0x7f8fac0049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:29.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc8ee7700 1 --2- 172.21.15.79:0/959987138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fac0045a0 0x7f8fac0049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:29.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc8ee7700 1 -- 172.21.15.79:0/959987138 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac050280 con 0x7f8fac0038c0 2021-04-09T18:31:29.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc8ee7700 1 --2- 172.21.15.79:0/959987138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fac0038c0 0x7f8fac003d90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f8fb400c000 tx=0x7f8fb400e1d0).ready entity=mon.0 client_cookie=114f7f90af45bbd server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:29.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc37fe700 1 -- 172.21.15.79:0/959987138 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8fac050280 con 0x7f8fac0038c0 2021-04-09T18:31:29.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc37fe700 1 -- 172.21.15.79:0/959987138 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb400ec90 con 0x7f8fac0038c0 2021-04-09T18:31:29.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc37fe700 1 -- 172.21.15.79:0/959987138 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8fb400f040 con 0x7f8fac0038c0 2021-04-09T18:31:29.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fcb143700 1 -- 172.21.15.79:0/959987138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fac0038c0 msgr2=0x7f8fac003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:29.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fcb143700 1 --2- 172.21.15.79:0/959987138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fac0038c0 0x7f8fac003d90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f8fb400c000 tx=0x7f8fb400e1d0).stop 2021-04-09T18:31:29.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fc96e8700 1 -- 172.21.15.79:0/959987138 reap_dead start 2021-04-09T18:31:29.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fcb143700 1 -- 172.21.15.79:0/959987138 shutdown_connections 2021-04-09T18:31:29.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fcb143700 1 -- 172.21.15.79:0/959987138 >> 172.21.15.79:0/959987138 conn(0x7f8fc40e5fe0 msgr2=0x7f8fc40e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:29.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fcb143700 1 -- 172.21.15.79:0/959987138 shutdown_connections 2021-04-09T18:31:29.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.064 7f8fcb143700 1 -- 172.21.15.79:0/959987138 wait complete. 2021-04-09T18:31:29.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.068 7f8fcb143700 1 Processor -- start 2021-04-09T18:31:29.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.068 7f8fcb143700 1 -- start start 2021-04-09T18:31:29.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.068 7f8fcb143700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fc41aee70 0x7f8fc41aac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:29.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.068 7f8fcb143700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fc40b5a00 0x7f8fc41ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:29.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.068 7f8fcb143700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fc40d5270 0x7f8fc40bfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:29.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.068 7f8fcb143700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40e8af0 con 0x7f8fc40d5270 2021-04-09T18:31:29.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.068 7f8fcb143700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40bf280 con 0x7f8fc41aee70 2021-04-09T18:31:29.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.068 7f8fcb143700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40bf570 con 0x7f8fc40b5a00 2021-04-09T18:31:29.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.068 7f8fc96e8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fc40d5270 0x7f8fc40bfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:29.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.068 7f8fc8ee7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fc41aee70 0x7f8fc41aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:29.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.068 7f8fc3fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fc40b5a00 0x7f8fc41ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:29.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.068 7f8fc8ee7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fc41aee70 0x7f8fc41aac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:47264/0 (socket says 172.21.15.79:47264) 2021-04-09T18:31:29.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.068 7f8fc96e8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fc40d5270 0x7f8fc40bfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58926/0 (socket says 172.21.15.79:58926) 2021-04-09T18:31:29.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.068 7f8fc8ee7700 1 -- 172.21.15.79:0/3054453122 learned_addr learned my addr 172.21.15.79:0/3054453122 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:29.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.068 7f8fc96e8700 1 -- 172.21.15.79:0/3054453122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fc40b5a00 msgr2=0x7f8fc41ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:29.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.068 7f8fc96e8700 1 --2- 172.21.15.79:0/3054453122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fc40b5a00 0x7f8fc41ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:29.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.068 7f8fc96e8700 1 -- 172.21.15.79:0/3054453122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fc41aee70 msgr2=0x7f8fc41aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:29.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.068 7f8fc96e8700 1 --2- 172.21.15.79:0/3054453122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fc41aee70 0x7f8fc41aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:29.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.068 7f8fc96e8700 1 -- 172.21.15.79:0/3054453122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc41ae810 con 0x7f8fc40d5270 2021-04-09T18:31:29.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.072 7f8fc96e8700 1 --2- 172.21.15.79:0/3054453122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fc40d5270 0x7f8fc40bfcf0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f8fc40bf970 tx=0x7f8fbc006b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:29.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.072 7f8fc17fa700 1 -- 172.21.15.79:0/3054453122 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8fc41ae810 con 0x7f8fc40d5270 2021-04-09T18:31:29.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.072 7f8fc17fa700 1 -- 172.21.15.79:0/3054453122 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc00ebc0 con 0x7f8fc40d5270 2021-04-09T18:31:29.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.072 7f8fcb143700 1 -- 172.21.15.79:0/3054453122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc40b5e50 con 0x7f8fc40d5270 2021-04-09T18:31:29.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.072 7f8fc17fa700 1 -- 172.21.15.79:0/3054453122 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8fbc019070 con 0x7f8fc40d5270 2021-04-09T18:31:29.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.072 7f8fcb143700 1 -- 172.21.15.79:0/3054453122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc40d5850 con 0x7f8fc40d5270 2021-04-09T18:31:29.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.072 7f8fc17fa700 1 -- 172.21.15.79:0/3054453122 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8fbc014470 con 0x7f8fc40d5270 2021-04-09T18:31:29.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.072 7f8fc17fa700 1 --2- 172.21.15.79:0/3054453122 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8fa4029100 0x7f8fa402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:29.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.072 7f8fc17fa700 1 -- 172.21.15.79:0/3054453122 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f8fbc003020 con 0x7f8fc40d5270 2021-04-09T18:31:29.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.072 7f8fc8ee7700 1 --2- 172.21.15.79:0/3054453122 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8fa4029100 0x7f8fa402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:29.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.072 7f8fc8ee7700 1 --2- 172.21.15.79:0/3054453122 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8fa4029100 0x7f8fa402b650 crc :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:29.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.076 7f8fcb143700 1 -- 172.21.15.79:0/3054453122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc40e39e0 con 0x7f8fc40d5270 2021-04-09T18:31:29.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.080 7f8fc17fa700 1 -- 172.21.15.79:0/3054453122 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8fbc000f70 con 0x7f8fc40d5270 2021-04-09T18:31:29.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.240 7f8fcb143700 1 -- 172.21.15.79:0/3054453122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8fc40f5b20 con 0x7f8fc40d5270 2021-04-09T18:31:29.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.240 7f8fc17fa700 1 -- 172.21.15.79:0/3054453122 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v55) v1 ==== 84+0+64 (secure 0 0 0) 0x7f8fbc00e7c0 con 0x7f8fc40d5270 2021-04-09T18:31:29.241 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:29.241 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2021-04-09T18:31:29.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:31:29.242 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2021-04-09T18:31:29.242 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": "rbd" 2021-04-09T18:31:29.242 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:31:29.242 INFO:teuthology.orchestra.run.smithi079.stdout:] 2021-04-09T18:31:29.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.240 7f8fcb143700 1 -- 172.21.15.79:0/3054453122 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8fa4029100 msgr2=0x7f8fa402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:29.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.240 7f8fcb143700 1 --2- 172.21.15.79:0/3054453122 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8fa4029100 0x7f8fa402b650 crc :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:29.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.240 7f8fcb143700 1 -- 172.21.15.79:0/3054453122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fc40d5270 msgr2=0x7f8fc40bfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:29.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.240 7f8fcb143700 1 --2- 172.21.15.79:0/3054453122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fc40d5270 0x7f8fc40bfcf0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f8fc40bf970 tx=0x7f8fbc006b80).stop 2021-04-09T18:31:29.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.244 7f8fcb143700 1 -- 172.21.15.79:0/3054453122 shutdown_connections 2021-04-09T18:31:29.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.244 7f8fcb143700 1 --2- 172.21.15.79:0/3054453122 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8fa4029100 0x7f8fa402b650 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:29.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.244 7f8fcb143700 1 --2- 172.21.15.79:0/3054453122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fc41aee70 0x7f8fc41aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:29.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.244 7f8fcb143700 1 --2- 172.21.15.79:0/3054453122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fc40d5270 0x7f8fc40bfcf0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:29.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.244 7f8fcb143700 1 --2- 172.21.15.79:0/3054453122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fc40b5a00 0x7f8fc41ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:29.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.244 7f8fcb143700 1 -- 172.21.15.79:0/3054453122 >> 172.21.15.79:0/3054453122 conn(0x7f8fc409af20 msgr2=0x7f8fc40d8440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:29.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.244 7f8fcb143700 1 -- 172.21.15.79:0/3054453122 shutdown_connections 2021-04-09T18:31:29.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.244 7f8fcb143700 1 -- 172.21.15.79:0/3054453122 wait complete. 2021-04-09T18:31:29.253 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-04-09T18:31:29.254 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-04-09T18:31:29.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb6bad700 1 Processor -- start 2021-04-09T18:31:29.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb6bad700 1 -- start start 2021-04-09T18:31:29.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb6bad700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcfb00f5550 0x7fcfb00f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:29.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb6bad700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcfb01c8040 0x7fcfb01ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:29.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb6bad700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb00fbb50 con 0x7fcfb00e9b10 2021-04-09T18:31:29.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb6bad700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb00e9f60 con 0x7fcfb00f5550 2021-04-09T18:31:29.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb6bad700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb01c3df0 con 0x7fcfb01c8040 2021-04-09T18:31:29.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb4951700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcfb00f5550 0x7fcfb00f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:29.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb4951700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcfb00f5550 0x7fcfb00f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58932/0 (socket says 172.21.15.79:58932) 2021-04-09T18:31:29.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb4951700 1 -- 172.21.15.79:0/464878 learned_addr learned my addr 172.21.15.79:0/464878 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:29.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb5152700 1 --2- 172.21.15.79:0/464878 >> v2:172.21.15.89:3300/0 conn(0x7fcfb01c8040 0x7fcfb01ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:29.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb4951700 1 -- 172.21.15.79:0/464878 >> v2:172.21.15.89:3300/0 conn(0x7fcfb01c8040 msgr2=0x7fcfb01ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:29.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb4951700 1 --2- 172.21.15.79:0/464878 >> v2:172.21.15.89:3300/0 conn(0x7fcfb01c8040 0x7fcfb01ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:29.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb4951700 1 -- 172.21.15.79:0/464878 >> v1:172.21.15.89:6789/0 conn(0x7fcfb00e9b10 legacy=0x7fcfb009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:29.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb4951700 1 -- 172.21.15.79:0/464878 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb009f910 con 0x7fcfb00f5550 2021-04-09T18:31:29.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb4951700 1 --2- 172.21.15.79:0/464878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfb00f5550 0x7fcfb00f64e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7fcfa0002f30 tx=0x7fcfa000bd70).ready entity=mon.0 client_cookie=31b4b39d56263a50 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:29.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfaf7fe700 1 -- 172.21.15.79:0/464878 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcfb009f910 con 0x7fcfb00f5550 2021-04-09T18:31:29.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfaf7fe700 1 -- 172.21.15.79:0/464878 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa0009950 con 0x7fcfb00f5550 2021-04-09T18:31:29.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfaf7fe700 1 -- 172.21.15.79:0/464878 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcfa0009d20 con 0x7fcfb00f5550 2021-04-09T18:31:29.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb6bad700 1 -- 172.21.15.79:0/464878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfb00f5550 msgr2=0x7fcfb00f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:29.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb6bad700 1 --2- 172.21.15.79:0/464878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfb00f5550 0x7fcfb00f64e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7fcfa0002f30 tx=0x7fcfa000bd70).stop 2021-04-09T18:31:29.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb6bad700 1 -- 172.21.15.79:0/464878 shutdown_connections 2021-04-09T18:31:29.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb6bad700 1 --2- 172.21.15.79:0/464878 >> v2:172.21.15.89:3300/0 conn(0x7fcfb01c8040 0x7fcfb01ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:29.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb6bad700 1 --2- 172.21.15.79:0/464878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfb00f5550 0x7fcfb00f64e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:29.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb6bad700 1 -- 172.21.15.79:0/464878 >> 172.21.15.79:0/464878 conn(0x7fcfb00e6010 msgr2=0x7fcfb00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:29.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb6bad700 1 -- 172.21.15.79:0/464878 shutdown_connections 2021-04-09T18:31:29.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.348 7fcfb6bad700 1 -- 172.21.15.79:0/464878 wait complete. 2021-04-09T18:31:29.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.352 7fcfb6bad700 1 Processor -- start 2021-04-09T18:31:29.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.352 7fcfb6bad700 1 -- start start 2021-04-09T18:31:29.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.352 7fcfb6bad700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfb00bba70 0x7fcfb00bc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:29.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.352 7fcfb6bad700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfb01ad320 0x7fcfb01ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:29.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.352 7fcfb6bad700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfb00c0280 0x7fcfb00c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:29.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.352 7fcfb6bad700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00bff80 con 0x7fcfb00c0280 2021-04-09T18:31:29.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.352 7fcfb6bad700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00c0d00 con 0x7fcfb01ad320 2021-04-09T18:31:29.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.352 7fcfb6bad700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00afc80 con 0x7fcfb00bba70 2021-04-09T18:31:29.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.352 7fcfb5152700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfb00c0280 0x7fcfb00c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:29.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.352 7fcfb5152700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfb00c0280 0x7fcfb00c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58940/0 (socket says 172.21.15.79:58940) 2021-04-09T18:31:29.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.352 7fcfb5152700 1 -- 172.21.15.79:0/3249024172 learned_addr learned my addr 172.21.15.79:0/3249024172 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:29.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.352 7fcfb4951700 1 --2- 172.21.15.79:0/3249024172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfb00bba70 0x7fcfb00bc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:29.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.352 7fcfaffff700 1 --2- 172.21.15.79:0/3249024172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfb01ad320 0x7fcfb01ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:29.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.352 7fcfb5152700 1 -- 172.21.15.79:0/3249024172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfb00bba70 msgr2=0x7fcfb00bc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:29.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.352 7fcfb5152700 1 --2- 172.21.15.79:0/3249024172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfb00bba70 0x7fcfb00bc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:29.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.352 7fcfb5152700 1 -- 172.21.15.79:0/3249024172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfb01ad320 msgr2=0x7fcfb01ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:29.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.352 7fcfb5152700 1 --2- 172.21.15.79:0/3249024172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfb01ad320 0x7fcfb01ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:29.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.352 7fcfb5152700 1 -- 172.21.15.79:0/3249024172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb00bc940 con 0x7fcfb00c0280 2021-04-09T18:31:29.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.352 7fcfb5152700 1 --2- 172.21.15.79:0/3249024172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfb00c0280 0x7fcfb00c06d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7fcfa800b140 tx=0x7fcfa800bf60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:29.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.352 7fcfad7fa700 1 -- 172.21.15.79:0/3249024172 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcfb00bc940 con 0x7fcfb00c0280 2021-04-09T18:31:29.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.356 7fcfad7fa700 1 -- 172.21.15.79:0/3249024172 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa800cb20 con 0x7fcfb00c0280 2021-04-09T18:31:29.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.356 7fcfad7fa700 1 -- 172.21.15.79:0/3249024172 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcfa800f040 con 0x7fcfb00c0280 2021-04-09T18:31:29.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.356 7fcfb6bad700 1 -- 172.21.15.79:0/3249024172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb00aff40 con 0x7fcfb00c0280 2021-04-09T18:31:29.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.356 7fcfb6bad700 1 -- 172.21.15.79:0/3249024172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb00bc050 con 0x7fcfb00c0280 2021-04-09T18:31:29.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.356 7fcfad7fa700 1 -- 172.21.15.79:0/3249024172 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fcfa8011070 con 0x7fcfb00c0280 2021-04-09T18:31:29.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.356 7fcfad7fa700 1 --2- 172.21.15.79:0/3249024172 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcf94029100 0x7fcf9402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:29.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.356 7fcfad7fa700 1 -- 172.21.15.79:0/3249024172 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fcfa8010040 con 0x7fcfb00c0280 2021-04-09T18:31:29.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.356 7fcfb4951700 1 --2- 172.21.15.79:0/3249024172 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcf94029100 0x7fcf9402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:29.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.356 7fcfb4951700 1 --2- 172.21.15.79:0/3249024172 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcf94029100 0x7fcf9402b650 crc :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:29.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.360 7fcfb6bad700 1 -- 172.21.15.79:0/3249024172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb00e39f0 con 0x7fcfb00c0280 2021-04-09T18:31:29.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.368 7fcfad7fa700 1 -- 172.21.15.79:0/3249024172 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fcfa800c720 con 0x7fcfb00c0280 2021-04-09T18:31:29.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:29.524 7fcfb6bad700 1 -- 172.21.15.79:0/3249024172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7fcfb00a1c90 con 0x7fcfb00c0280 2021-04-09T18:31:30.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.007 7fcfad7fa700 1 -- 172.21.15.79:0/3249024172 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v56) v1 ==== 133+0+0 (secure 0 0 0) 0x7fcfb00f76f0 con 0x7fcfb00c0280 2021-04-09T18:31:30.038 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2021-04-09T18:31:30.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.039 7fcfb6bad700 1 -- 172.21.15.79:0/3249024172 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcf94029100 msgr2=0x7fcf9402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:30.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.039 7fcfb6bad700 1 --2- 172.21.15.79:0/3249024172 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcf94029100 0x7fcf9402b650 crc :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.039 7fcfb6bad700 1 -- 172.21.15.79:0/3249024172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfb00c0280 msgr2=0x7fcfb00c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:30.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.039 7fcfb6bad700 1 --2- 172.21.15.79:0/3249024172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfb00c0280 0x7fcfb00c06d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7fcfa800b140 tx=0x7fcfa800bf60).stop 2021-04-09T18:31:30.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.039 7fcfb6bad700 1 -- 172.21.15.79:0/3249024172 shutdown_connections 2021-04-09T18:31:30.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.039 7fcfb6bad700 1 --2- 172.21.15.79:0/3249024172 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcf94029100 0x7fcf9402b650 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.039 7fcfb6bad700 1 --2- 172.21.15.79:0/3249024172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfb00c0280 0x7fcfb00c06d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.039 7fcfb6bad700 1 --2- 172.21.15.79:0/3249024172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfb00bba70 0x7fcfb00bc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.039 7fcfb6bad700 1 --2- 172.21.15.79:0/3249024172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfb01ad320 0x7fcfb01ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.039 7fcfb6bad700 1 -- 172.21.15.79:0/3249024172 >> 172.21.15.79:0/3249024172 conn(0x7fcfb009abe0 msgr2=0x7fcfb009a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:30.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.039 7fcfb6bad700 1 -- 172.21.15.79:0/3249024172 shutdown_connections 2021-04-09T18:31:30.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.039 7fcfb6bad700 1 -- 172.21.15.79:0/3249024172 wait complete. 2021-04-09T18:31:30.055 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-04-09T18:31:30.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.159 7f64d3c3b700 1 Processor -- start 2021-04-09T18:31:30.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.159 7f64d3c3b700 1 -- start start 2021-04-09T18:31:30.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d3c3b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f64cc0f5550 0x7f64cc0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:30.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d3c3b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64cc1c8040 0x7f64cc1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:30.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d3c3b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64cc0fbb50 con 0x7f64cc0e9b10 2021-04-09T18:31:30.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d3c3b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64cc0e9f60 con 0x7f64cc0f5550 2021-04-09T18:31:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d3c3b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc1c3df0 con 0x7f64cc1c8040 2021-04-09T18:31:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d19df700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f64cc0f5550 0x7f64cc0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d11de700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f64cc0e9b10 0x7f64cc09f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53658/0 (socket says 172.21.15.79:53658) 2021-04-09T18:31:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d11de700 1 -- 172.21.15.79:0/3054231027 learned_addr learned my addr 172.21.15.79:0/3054231027 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:30.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d21e0700 1 --2- 172.21.15.79:0/3054231027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64cc1c8040 0x7f64cc1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:30.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d19df700 1 -- 172.21.15.79:0/3054231027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64cc1c8040 msgr2=0x7f64cc1ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:30.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d19df700 1 --2- 172.21.15.79:0/3054231027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64cc1c8040 0x7f64cc1ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d19df700 1 -- 172.21.15.79:0/3054231027 >> v1:172.21.15.79:6789/0 conn(0x7f64cc0e9b10 legacy=0x7f64cc09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:30.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d09dd700 1 -- 172.21.15.79:0/3054231027 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353678641 0 0) 0x7f64bc0010d0 con 0x7f64cc0e9b10 2021-04-09T18:31:30.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d19df700 1 -- 172.21.15.79:0/3054231027 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc09f910 con 0x7f64cc0f5550 2021-04-09T18:31:30.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d19df700 1 --2- 172.21.15.79:0/3054231027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64cc0f5550 0x7f64cc0f64e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f64cc0f6f30 tx=0x7f64c800bd70).ready entity=mon.0 client_cookie=d73d44a691da78e6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:30.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d09dd700 1 -- 172.21.15.79:0/3054231027 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f64cc09f910 con 0x7f64cc0f5550 2021-04-09T18:31:30.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d09dd700 1 -- 172.21.15.79:0/3054231027 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c8009810 con 0x7f64cc0f5550 2021-04-09T18:31:30.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d09dd700 1 -- 172.21.15.79:0/3054231027 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f64c8009be0 con 0x7f64cc0f5550 2021-04-09T18:31:30.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d3c3b700 1 -- 172.21.15.79:0/3054231027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64cc0f5550 msgr2=0x7f64cc0f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:30.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d3c3b700 1 --2- 172.21.15.79:0/3054231027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64cc0f5550 0x7f64cc0f64e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f64cc0f6f30 tx=0x7f64c800bd70).stop 2021-04-09T18:31:30.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d3c3b700 1 -- 172.21.15.79:0/3054231027 shutdown_connections 2021-04-09T18:31:30.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d3c3b700 1 --2- 172.21.15.79:0/3054231027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64cc0f5550 0x7f64cc0f64e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d3c3b700 1 --2- 172.21.15.79:0/3054231027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64cc1c8040 0x7f64cc1ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d3c3b700 1 -- 172.21.15.79:0/3054231027 >> 172.21.15.79:0/3054231027 conn(0x7f64cc0e6010 msgr2=0x7f64cc0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:30.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d3c3b700 1 -- 172.21.15.79:0/3054231027 shutdown_connections 2021-04-09T18:31:30.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.163 7f64d3c3b700 1 -- 172.21.15.79:0/3054231027 wait complete. 2021-04-09T18:31:30.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.167 7f64d3c3b700 1 Processor -- start 2021-04-09T18:31:30.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.167 7f64d3c3b700 1 -- start start 2021-04-09T18:31:30.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.167 7f64d3c3b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64cc0bac90 0x7f64cc0d60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:30.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.167 7f64d3c3b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64cc1aac30 0x7f64cc1ab080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:30.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.167 7f64d3c3b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64cc1ab6b0 0x7f64cc1a6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:30.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.167 7f64d3c3b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc0e1ac0 con 0x7f64cc0bac90 2021-04-09T18:31:30.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.167 7f64d3c3b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc0b91d0 con 0x7f64cc1aac30 2021-04-09T18:31:30.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.167 7f64d3c3b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc0b94d0 con 0x7f64cc1ab6b0 2021-04-09T18:31:30.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.167 7f64d19df700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64cc0bac90 0x7f64cc0d60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:30.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.167 7f64d19df700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64cc0bac90 0x7f64cc0d60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58950/0 (socket says 172.21.15.79:58950) 2021-04-09T18:31:30.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.167 7f64d19df700 1 -- 172.21.15.79:0/4037961606 learned_addr learned my addr 172.21.15.79:0/4037961606 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:30.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.167 7f64d11de700 1 --2- 172.21.15.79:0/4037961606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64cc1aac30 0x7f64cc1ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:30.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.167 7f64d21e0700 1 --2- 172.21.15.79:0/4037961606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64cc1ab6b0 0x7f64cc1a6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:30.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.171 7f64d19df700 1 -- 172.21.15.79:0/4037961606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64cc1ab6b0 msgr2=0x7f64cc1a6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:30.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.171 7f64d19df700 1 --2- 172.21.15.79:0/4037961606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64cc1ab6b0 0x7f64cc1a6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.171 7f64d19df700 1 -- 172.21.15.79:0/4037961606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64cc1aac30 msgr2=0x7f64cc1ab080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:30.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.171 7f64d19df700 1 --2- 172.21.15.79:0/4037961606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64cc1aac30 0x7f64cc1ab080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.171 7f64d19df700 1 -- 172.21.15.79:0/4037961606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc092f40 con 0x7f64cc0bac90 2021-04-09T18:31:30.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.171 7f64d21e0700 1 --2- 172.21.15.79:0/4037961606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64cc1ab6b0 0x7f64cc1a6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:30.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.171 7f64d19df700 1 --2- 172.21.15.79:0/4037961606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64cc0bac90 0x7f64cc0d60e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f64cc095650 tx=0x7f64c8006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:30.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.171 7f64c27fc700 1 -- 172.21.15.79:0/4037961606 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f64cc092f40 con 0x7f64cc0bac90 2021-04-09T18:31:30.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.171 7f64c27fc700 1 -- 172.21.15.79:0/4037961606 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c8009c70 con 0x7f64cc0bac90 2021-04-09T18:31:30.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.171 7f64d3c3b700 1 -- 172.21.15.79:0/4037961606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64cc1abb00 con 0x7f64cc0bac90 2021-04-09T18:31:30.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.171 7f64c27fc700 1 -- 172.21.15.79:0/4037961606 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f64c8011e00 con 0x7f64cc0bac90 2021-04-09T18:31:30.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.171 7f64d3c3b700 1 -- 172.21.15.79:0/4037961606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64cc0bb0e0 con 0x7f64cc0bac90 2021-04-09T18:31:30.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.171 7f64c27fc700 1 -- 172.21.15.79:0/4037961606 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f64c8018580 con 0x7f64cc0bac90 2021-04-09T18:31:30.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.171 7f64c27fc700 1 --2- 172.21.15.79:0/4037961606 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f64b4029100 0x7f64b402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:30.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.171 7f64c27fc700 1 -- 172.21.15.79:0/4037961606 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5458+0+0 (secure 0 0 0) 0x7f64c803a2c0 con 0x7f64cc0bac90 2021-04-09T18:31:30.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.171 7f64d11de700 1 --2- 172.21.15.79:0/4037961606 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f64b4029100 0x7f64b402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.175 7f64d11de700 1 --2- 172.21.15.79:0/4037961606 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f64b4029100 0x7f64b402b650 crc :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.175 7f64d3c3b700 1 -- 172.21.15.79:0/4037961606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64cc0e39f0 con 0x7f64cc0bac90 2021-04-09T18:31:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.179 7f64c27fc700 1 -- 172.21.15.79:0/4037961606 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f64c8009600 con 0x7f64cc0bac90 2021-04-09T18:31:30.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:30.339 7f64d3c3b700 1 -- 172.21.15.79:0/4037961606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f64cc0a1c90 con 0x7f64cc0bac90 2021-04-09T18:31:31.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.011 7f64c27fc700 1 -- 172.21.15.79:0/4037961606 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v57) v1 ==== 125+0+0 (secure 0 0 0) 0x7f64c8018370 con 0x7f64cc0bac90 2021-04-09T18:31:31.055 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2021-04-09T18:31:31.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.055 7f64d3c3b700 1 -- 172.21.15.79:0/4037961606 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f64b4029100 msgr2=0x7f64b402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.055 7f64d3c3b700 1 --2- 172.21.15.79:0/4037961606 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f64b4029100 0x7f64b402b650 crc :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.055 7f64d3c3b700 1 -- 172.21.15.79:0/4037961606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64cc0bac90 msgr2=0x7f64cc0d60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.055 7f64d3c3b700 1 --2- 172.21.15.79:0/4037961606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64cc0bac90 0x7f64cc0d60e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f64cc095650 tx=0x7f64c8006890).stop 2021-04-09T18:31:31.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.055 7f64d3c3b700 1 -- 172.21.15.79:0/4037961606 shutdown_connections 2021-04-09T18:31:31.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.055 7f64d3c3b700 1 --2- 172.21.15.79:0/4037961606 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f64b4029100 0x7f64b402b650 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.055 7f64d3c3b700 1 --2- 172.21.15.79:0/4037961606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64cc1ab6b0 0x7f64cc1a6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.055 7f64d3c3b700 1 --2- 172.21.15.79:0/4037961606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64cc0bac90 0x7f64cc0d60e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.055 7f64d3c3b700 1 --2- 172.21.15.79:0/4037961606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64cc1aac30 0x7f64cc1ab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.055 7f64d3c3b700 1 -- 172.21.15.79:0/4037961606 >> 172.21.15.79:0/4037961606 conn(0x7f64cc094a10 msgr2=0x7f64cc0d4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:31.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.055 7f64d3c3b700 1 -- 172.21.15.79:0/4037961606 shutdown_connections 2021-04-09T18:31:31.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.055 7f64d3c3b700 1 -- 172.21.15.79:0/4037961606 wait complete. 2021-04-09T18:31:31.072 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-04-09T18:31:31.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.171 7fb79d4aa700 1 Processor -- start 2021-04-09T18:31:31.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.171 7fb79d4aa700 1 -- start start 2021-04-09T18:31:31.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.171 7fb79d4aa700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb7980f5550 0x7fb7980f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:31.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.171 7fb79d4aa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7980e9b10 0x7fb79809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:31.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.171 7fb79d4aa700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7980fbb50 con 0x7fb7981c2de0 2021-04-09T18:31:31.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.171 7fb79d4aa700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7980e9f60 con 0x7fb7980f5550 2021-04-09T18:31:31.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.171 7fb79d4aa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7980e5a00 con 0x7fb7980e9b10 2021-04-09T18:31:31.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.171 7fb797a48700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb7981c2de0 0x7fb7981c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53672/0 (socket says 172.21.15.79:53672) 2021-04-09T18:31:31.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.171 7fb797a48700 1 -- 172.21.15.79:0/3793911268 learned_addr learned my addr 172.21.15.79:0/3793911268 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:31.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.171 7fb796a46700 1 --2- 172.21.15.79:0/3793911268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7980e9b10 0x7fb79809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:31.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.171 7fb797247700 1 --2- 172.21.15.79:0/3793911268 >> v2:172.21.15.89:3300/0 conn(0x7fb7980f5550 0x7fb7980f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:31.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.171 7fb796245700 1 -- 172.21.15.79:0/3793911268 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823840731 0 0) 0x7fb7900010d0 con 0x7fb7981c2de0 2021-04-09T18:31:31.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.171 7fb796245700 1 -- 172.21.15.79:0/3793911268 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb784003240 con 0x7fb7981c2de0 2021-04-09T18:31:31.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.171 7fb796a46700 1 -- 172.21.15.79:0/3793911268 >> v2:172.21.15.89:3300/0 conn(0x7fb7980f5550 msgr2=0x7fb7980f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:31.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.175 7fb796a46700 1 --2- 172.21.15.79:0/3793911268 >> v2:172.21.15.89:3300/0 conn(0x7fb7980f5550 0x7fb7980f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.175 7fb796a46700 1 -- 172.21.15.79:0/3793911268 >> v1:172.21.15.79:6789/0 conn(0x7fb7981c2de0 legacy=0x7fb7981c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.175 7fb796a46700 1 -- 172.21.15.79:0/3793911268 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7980e5700 con 0x7fb7980e9b10 2021-04-09T18:31:31.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.175 7fb796a46700 1 --2- 172.21.15.79:0/3793911268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7980e9b10 0x7fb79809f110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fb780002f30 tx=0x7fb78000bcc0).ready entity=mon.2 client_cookie=68fed94dc2df2cd8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:31.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.175 7fb796245700 1 -- 172.21.15.79:0/3793911268 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb7980e5700 con 0x7fb7980e9b10 2021-04-09T18:31:31.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.175 7fb796245700 1 -- 172.21.15.79:0/3793911268 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb780009800 con 0x7fb7980e9b10 2021-04-09T18:31:31.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.175 7fb796245700 1 -- 172.21.15.79:0/3793911268 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb780009bd0 con 0x7fb7980e9b10 2021-04-09T18:31:31.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.175 7fb79d4aa700 1 -- 172.21.15.79:0/3793911268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7980e9b10 msgr2=0x7fb79809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.175 7fb79d4aa700 1 --2- 172.21.15.79:0/3793911268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7980e9b10 0x7fb79809f110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fb780002f30 tx=0x7fb78000bcc0).stop 2021-04-09T18:31:31.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.175 7fb79d4aa700 1 -- 172.21.15.79:0/3793911268 shutdown_connections 2021-04-09T18:31:31.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.175 7fb79d4aa700 1 --2- 172.21.15.79:0/3793911268 >> v2:172.21.15.89:3300/0 conn(0x7fb7980f5550 0x7fb7980f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.175 7fb79d4aa700 1 --2- 172.21.15.79:0/3793911268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7980e9b10 0x7fb79809f110 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.175 7fb79d4aa700 1 -- 172.21.15.79:0/3793911268 >> 172.21.15.79:0/3793911268 conn(0x7fb7980e6010 msgr2=0x7fb7980e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:31.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.175 7fb79d4aa700 1 -- 172.21.15.79:0/3793911268 shutdown_connections 2021-04-09T18:31:31.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.175 7fb79d4aa700 1 -- 172.21.15.79:0/3793911268 wait complete. 2021-04-09T18:31:31.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.179 7fb79d4aa700 1 Processor -- start 2021-04-09T18:31:31.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.179 7fb79d4aa700 1 -- start start 2021-04-09T18:31:31.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.179 7fb79d4aa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7981a8200 0x7fb7980aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:31.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.179 7fb79d4aa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7980ad690 0x7fb7980d51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:31.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.179 7fb79d4aa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7980d0f10 0x7fb7980d1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:31.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.179 7fb79d4aa700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7980abdf0 con 0x7fb7980d0f10 2021-04-09T18:31:31.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.179 7fb79d4aa700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7980ac0f0 con 0x7fb7981a8200 2021-04-09T18:31:31.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.179 7fb79d4aa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7981a8650 con 0x7fb7980ad690 2021-04-09T18:31:31.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.179 7fb797a48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7980d0f10 0x7fb7980d1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:31.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.179 7fb797a48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7980d0f10 0x7fb7980d1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58968/0 (socket says 172.21.15.79:58968) 2021-04-09T18:31:31.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.179 7fb797a48700 1 -- 172.21.15.79:0/3655934630 learned_addr learned my addr 172.21.15.79:0/3655934630 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:31.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.179 7fb797247700 1 --2- 172.21.15.79:0/3655934630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7981a8200 0x7fb7980aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:31.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.179 7fb796a46700 1 --2- 172.21.15.79:0/3655934630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7980ad690 0x7fb7980d51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:31.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.179 7fb797a48700 1 -- 172.21.15.79:0/3655934630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7980ad690 msgr2=0x7fb7980d51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.179 7fb797a48700 1 --2- 172.21.15.79:0/3655934630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7980ad690 0x7fb7980d51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.179 7fb797a48700 1 -- 172.21.15.79:0/3655934630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7981a8200 msgr2=0x7fb7980aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.179 7fb797a48700 1 --2- 172.21.15.79:0/3655934630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7981a8200 0x7fb7980aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.179 7fb797a48700 1 -- 172.21.15.79:0/3655934630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb798096130 con 0x7fb7980d0f10 2021-04-09T18:31:31.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.179 7fb796a46700 1 --2- 172.21.15.79:0/3655934630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7980ad690 0x7fb7980d51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:31.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.179 7fb797a48700 1 --2- 172.21.15.79:0/3655934630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7980d0f10 0x7fb7980d1360 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fb790000b80 tx=0x7fb79000cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:31.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.183 7fb78ffff700 1 -- 172.21.15.79:0/3655934630 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb7900072e0 con 0x7fb7980d0f10 2021-04-09T18:31:31.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.183 7fb78ffff700 1 -- 172.21.15.79:0/3655934630 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7900055f0 con 0x7fb7980d0f10 2021-04-09T18:31:31.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.183 7fb79d4aa700 1 -- 172.21.15.79:0/3655934630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7980d57e0 con 0x7fb7980d0f10 2021-04-09T18:31:31.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.183 7fb78ffff700 1 -- 172.21.15.79:0/3655934630 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb7900059c0 con 0x7fb7980d0f10 2021-04-09T18:31:31.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.183 7fb79d4aa700 1 -- 172.21.15.79:0/3655934630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7980ab980 con 0x7fb7980d0f10 2021-04-09T18:31:31.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.183 7fb78ffff700 1 -- 172.21.15.79:0/3655934630 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb790005bc0 con 0x7fb7980d0f10 2021-04-09T18:31:31.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.183 7fb78ffff700 1 --2- 172.21.15.79:0/3655934630 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb77c029100 0x7fb77c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:31.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.183 7fb78ffff700 1 -- 172.21.15.79:0/3655934630 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb790038ff0 con 0x7fb7980d0f10 2021-04-09T18:31:31.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.183 7fb797247700 1 --2- 172.21.15.79:0/3655934630 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb77c029100 0x7fb77c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:31.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.183 7fb797247700 1 --2- 172.21.15.79:0/3655934630 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb77c029100 0x7fb77c02b650 crc :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:31.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.187 7fb79d4aa700 1 -- 172.21.15.79:0/3655934630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7980e39f0 con 0x7fb7980d0f10 2021-04-09T18:31:31.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.195 7fb78ffff700 1 -- 172.21.15.79:0/3655934630 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb7900070d0 con 0x7fb7980d0f10 2021-04-09T18:31:31.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.359 7fb79d4aa700 1 -- 172.21.15.79:0/3655934630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7fb7980f5b50 con 0x7fb7980d0f10 2021-04-09T18:31:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.367 7fb78ffff700 1 -- 172.21.15.79:0/3655934630 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 10 and data pool 11 v31) v1 ==== 189+0+0 (secure 0 0 0) 0x7fb7980f76f0 con 0x7fb7980d0f10 2021-04-09T18:31:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 10 and data pool 11 2021-04-09T18:31:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.371 7fb79d4aa700 1 -- 172.21.15.79:0/3655934630 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb77c029100 msgr2=0x7fb77c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.371 7fb79d4aa700 1 --2- 172.21.15.79:0/3655934630 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb77c029100 0x7fb77c02b650 crc :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.371 7fb79d4aa700 1 -- 172.21.15.79:0/3655934630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7980d0f10 msgr2=0x7fb7980d1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.371 7fb79d4aa700 1 --2- 172.21.15.79:0/3655934630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7980d0f10 0x7fb7980d1360 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fb790000b80 tx=0x7fb79000cab0).stop 2021-04-09T18:31:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.371 7fb79d4aa700 1 -- 172.21.15.79:0/3655934630 shutdown_connections 2021-04-09T18:31:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.371 7fb79d4aa700 1 --2- 172.21.15.79:0/3655934630 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb77c029100 0x7fb77c02b650 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.371 7fb79d4aa700 1 --2- 172.21.15.79:0/3655934630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7981a8200 0x7fb7980aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.371 7fb79d4aa700 1 --2- 172.21.15.79:0/3655934630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7980d0f10 0x7fb7980d1360 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.371 7fb79d4aa700 1 --2- 172.21.15.79:0/3655934630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7980ad690 0x7fb7980d51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.371 7fb79d4aa700 1 -- 172.21.15.79:0/3655934630 >> 172.21.15.79:0/3655934630 conn(0x7fb7980ae1c0 msgr2=0x7fb79808f610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.371 7fb79d4aa700 1 -- 172.21.15.79:0/3655934630 shutdown_connections 2021-04-09T18:31:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.371 7fb79d4aa700 1 -- 172.21.15.79:0/3655934630 wait complete. 2021-04-09T18:31:31.384 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:31:31.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.467 7ff32a3cd700 1 Processor -- start 2021-04-09T18:31:31.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.467 7ff32a3cd700 1 -- start start 2021-04-09T18:31:31.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff32a3cd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff3241c9010 0x7ff3241cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:31.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff32a3cd700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3240fbb10 con 0x7ff3240e9ad0 2021-04-09T18:31:31.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff32a3cd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff32409f900 con 0x7ff3240f5510 2021-04-09T18:31:31.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff32a3cd700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3241c3db0 con 0x7ff3241c9010 2021-04-09T18:31:31.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff328972700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff3241c9010 0x7ff3241cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:31.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff328972700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff3241c9010 0x7ff3241cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58976/0 (socket says 172.21.15.79:58976) 2021-04-09T18:31:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff328972700 1 -- 172.21.15.79:0/3362985435 learned_addr learned my addr 172.21.15.79:0/3362985435 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff328972700 1 -- 172.21.15.79:0/3362985435 >> v1:172.21.15.89:6789/0 conn(0x7ff3240f5510 legacy=0x7ff3240f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff328972700 1 -- 172.21.15.79:0/3362985435 >> v1:172.21.15.79:6789/0 conn(0x7ff3240e9ad0 legacy=0x7ff32409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff328972700 1 -- 172.21.15.79:0/3362985435 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3240e56c0 con 0x7ff3241c9010 2021-04-09T18:31:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff328972700 1 --2- 172.21.15.79:0/3362985435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3241c9010 0x7ff3241cb470 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7ff31c0032b0 tx=0x7ff31c00b3c0).ready entity=mon.0 client_cookie=6df6247ebdd5011a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff322ffd700 1 -- 172.21.15.79:0/3362985435 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff3240e56c0 con 0x7ff3241c9010 2021-04-09T18:31:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff322ffd700 1 -- 172.21.15.79:0/3362985435 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31c00bca0 con 0x7ff3241c9010 2021-04-09T18:31:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff32a3cd700 1 -- 172.21.15.79:0/3362985435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3241c9010 msgr2=0x7ff3241cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff32a3cd700 1 --2- 172.21.15.79:0/3362985435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3241c9010 0x7ff3241cb470 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7ff31c0032b0 tx=0x7ff31c00b3c0).stop 2021-04-09T18:31:31.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff322ffd700 1 -- 172.21.15.79:0/3362985435 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff31c002020 con 0x7ff3241c9010 2021-04-09T18:31:31.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff32a3cd700 1 -- 172.21.15.79:0/3362985435 shutdown_connections 2021-04-09T18:31:31.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff32a3cd700 1 --2- 172.21.15.79:0/3362985435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3241c9010 0x7ff3241cb470 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff32a3cd700 1 -- 172.21.15.79:0/3362985435 >> 172.21.15.79:0/3362985435 conn(0x7ff3240e5fd0 msgr2=0x7ff3240e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:31.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff32a3cd700 1 -- 172.21.15.79:0/3362985435 shutdown_connections 2021-04-09T18:31:31.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.471 7ff32a3cd700 1 -- 172.21.15.79:0/3362985435 wait complete. 2021-04-09T18:31:31.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff32a3cd700 1 Processor -- start 2021-04-09T18:31:31.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff32a3cd700 1 -- start start 2021-04-09T18:31:31.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff32a3cd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff324098dc0 0x7ff3240b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff32a3cd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3240b1270 0x7ff3240939f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff32a3cd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff324094020 0x7ff3241d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff32a3cd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3240e9f20 con 0x7ff324098dc0 2021-04-09T18:31:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff32a3cd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3240abf40 con 0x7ff324094020 2021-04-09T18:31:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff32a3cd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3240b1890 con 0x7ff3240b1270 2021-04-09T18:31:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff323fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff324098dc0 0x7ff3240b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff323fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff324098dc0 0x7ff3240b0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58978/0 (socket says 172.21.15.79:58978) 2021-04-09T18:31:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff323fff700 1 -- 172.21.15.79:0/1849287770 learned_addr learned my addr 172.21.15.79:0/1849287770 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff328972700 1 --2- 172.21.15.79:0/1849287770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff324094020 0x7ff3241d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:31.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff3237fe700 1 --2- 172.21.15.79:0/1849287770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3240b1270 0x7ff3240939f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:31.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff323fff700 1 -- 172.21.15.79:0/1849287770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3240b1270 msgr2=0x7ff3240939f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff323fff700 1 --2- 172.21.15.79:0/1849287770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3240b1270 0x7ff3240939f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff323fff700 1 -- 172.21.15.79:0/1849287770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff324094020 msgr2=0x7ff3241d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff323fff700 1 --2- 172.21.15.79:0/1849287770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff324094020 0x7ff3241d09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff323fff700 1 -- 172.21.15.79:0/1849287770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3240ad4a0 con 0x7ff324098dc0 2021-04-09T18:31:31.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff3237fe700 1 --2- 172.21.15.79:0/1849287770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3240b1270 0x7ff3240939f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:31.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff323fff700 1 --2- 172.21.15.79:0/1849287770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff324098dc0 0x7ff3240b0c40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7ff3240d77c0 tx=0x7ff31400cb90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:31.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff320ff9700 1 -- 172.21.15.79:0/1849287770 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff3240ad4a0 con 0x7ff324098dc0 2021-04-09T18:31:31.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff320ff9700 1 -- 172.21.15.79:0/1849287770 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31400e4a0 con 0x7ff324098dc0 2021-04-09T18:31:31.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff32a3cd700 1 -- 172.21.15.79:0/1849287770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff324099210 con 0x7ff324098dc0 2021-04-09T18:31:31.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff320ff9700 1 -- 172.21.15.79:0/1849287770 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff31400e870 con 0x7ff324098dc0 2021-04-09T18:31:31.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.475 7ff32a3cd700 1 -- 172.21.15.79:0/1849287770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3241d1000 con 0x7ff324098dc0 2021-04-09T18:31:31.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.479 7ff320ff9700 1 -- 172.21.15.79:0/1849287770 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff31401a060 con 0x7ff324098dc0 2021-04-09T18:31:31.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.479 7ff320ff9700 1 --2- 172.21.15.79:0/1849287770 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff304029100 0x7ff30402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:31.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.479 7ff320ff9700 1 -- 172.21.15.79:0/1849287770 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5924+0+0 (secure 0 0 0) 0x7ff314038e30 con 0x7ff324098dc0 2021-04-09T18:31:31.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.479 7ff3237fe700 1 --2- 172.21.15.79:0/1849287770 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff304029100 0x7ff30402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:31.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.479 7ff3237fe700 1 --2- 172.21.15.79:0/1849287770 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff304029100 0x7ff30402b650 crc :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:31.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.483 7ff32a3cd700 1 -- 172.21.15.79:0/1849287770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3240e39d0 con 0x7ff324098dc0 2021-04-09T18:31:31.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.487 7ff320ff9700 1 -- 172.21.15.79:0/1849287770 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff31400e290 con 0x7ff324098dc0 2021-04-09T18:31:31.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.651 7ff32a3cd700 1 -- 172.21.15.79:0/1849287770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3240a1cb0 con 0x7ff324098dc0 2021-04-09T18:31:31.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.655 7ff320ff9700 1 -- 172.21.15.79:0/1849287770 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+14242 (secure 0 0 0) 0x7ff324107f40 con 0x7ff324098dc0 2021-04-09T18:31:31.658 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:31.658 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":58,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:31:31.364509","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:31:29.577618","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2021-04-09 18:31:30.395684","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:31:31.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.659 7ff32a3cd700 1 -- 172.21.15.79:0/1849287770 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff304029100 msgr2=0x7ff30402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.659 7ff32a3cd700 1 --2- 172.21.15.79:0/1849287770 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff304029100 0x7ff30402b650 crc :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.659 7ff32a3cd700 1 -- 172.21.15.79:0/1849287770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff324098dc0 msgr2=0x7ff3240b0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.659 7ff32a3cd700 1 --2- 172.21.15.79:0/1849287770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff324098dc0 0x7ff3240b0c40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7ff3240d77c0 tx=0x7ff31400cb90).stop 2021-04-09T18:31:31.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.659 7ff32a3cd700 1 -- 172.21.15.79:0/1849287770 shutdown_connections 2021-04-09T18:31:31.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.659 7ff32a3cd700 1 --2- 172.21.15.79:0/1849287770 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff304029100 0x7ff30402b650 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.659 7ff32a3cd700 1 --2- 172.21.15.79:0/1849287770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff324094020 0x7ff3241d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.659 7ff32a3cd700 1 --2- 172.21.15.79:0/1849287770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff324098dc0 0x7ff3240b0c40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.659 7ff32a3cd700 1 --2- 172.21.15.79:0/1849287770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3240b1270 0x7ff3240939f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.659 7ff32a3cd700 1 -- 172.21.15.79:0/1849287770 >> 172.21.15.79:0/1849287770 conn(0x7ff3240d8c80 msgr2=0x7ff3240974a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:31.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.659 7ff32a3cd700 1 -- 172.21.15.79:0/1849287770 shutdown_connections 2021-04-09T18:31:31.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.659 7ff32a3cd700 1 -- 172.21.15.79:0/1849287770 wait complete. 2021-04-09T18:31:31.671 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:31:31.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.767 7f5e3dd84700 1 Processor -- start 2021-04-09T18:31:31.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.767 7f5e3dd84700 1 -- start start 2021-04-09T18:31:31.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.767 7f5e3dd84700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5e381c9020 0x7f5e381cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:31.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.767 7f5e3dd84700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e380fbb20 con 0x7f5e380f5520 2021-04-09T18:31:31.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.767 7f5e3dd84700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3809f910 con 0x7f5e380e9ae0 2021-04-09T18:31:31.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.767 7f5e3dd84700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e381c3dc0 con 0x7f5e381c9020 2021-04-09T18:31:31.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.767 7f5e377fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5e380f5520 0x7f5e380f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53696/0 (socket says 172.21.15.79:53696) 2021-04-09T18:31:31.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.767 7f5e377fe700 1 -- 172.21.15.79:0/789399921 learned_addr learned my addr 172.21.15.79:0/789399921 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:31.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e37fff700 1 --2- 172.21.15.79:0/789399921 >> v2:172.21.15.89:3300/0 conn(0x7f5e381c9020 0x7f5e381cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:31.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e367fc700 1 -- 172.21.15.79:0/789399921 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437284384 0 0) 0x7f5e28001450 con 0x7f5e380f5520 2021-04-09T18:31:31.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e367fc700 1 -- 172.21.15.79:0/789399921 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e20003240 con 0x7f5e380f5520 2021-04-09T18:31:31.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e367fc700 1 -- 172.21.15.79:0/789399921 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285638656 0 0) 0x7f5e2c0010d0 con 0x7f5e380e9ae0 2021-04-09T18:31:31.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e367fc700 1 -- 172.21.15.79:0/789399921 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e20003620 con 0x7f5e380e9ae0 2021-04-09T18:31:31.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e367fc700 1 -- 172.21.15.79:0/789399921 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 278519594 0 0) 0x7f5e280019d0 con 0x7f5e380f5520 2021-04-09T18:31:31.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e367fc700 1 -- 172.21.15.79:0/789399921 >> v2:172.21.15.89:3300/0 conn(0x7f5e381c9020 msgr2=0x7f5e381cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:31.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e367fc700 1 --2- 172.21.15.79:0/789399921 >> v2:172.21.15.89:3300/0 conn(0x7f5e381c9020 0x7f5e381cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e367fc700 1 -- 172.21.15.79:0/789399921 >> v1:172.21.15.89:6789/0 conn(0x7f5e380e9ae0 legacy=0x7f5e3809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e367fc700 1 -- 172.21.15.79:0/789399921 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e380e56d0 con 0x7f5e380f5520 2021-04-09T18:31:31.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e367fc700 1 -- 172.21.15.79:0/789399921 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f5e28001f30 con 0x7f5e380f5520 2021-04-09T18:31:31.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e367fc700 1 -- 172.21.15.79:0/789399921 >> v1:172.21.15.79:6789/0 conn(0x7f5e380f5520 legacy=0x7f5e380f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e367fc700 1 --2- 172.21.15.79:0/789399921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e20003d10 0x7f5e200045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:31.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e367fc700 1 --2- 172.21.15.79:0/789399921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e20004bd0 0x7f5e200097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:31.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e367fc700 1 --2- 172.21.15.79:0/789399921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e20005020 0x7f5e2000be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:31.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e367fc700 1 -- 172.21.15.79:0/789399921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e381c3dc0 con 0x7f5e20005020 2021-04-09T18:31:31.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e367fc700 1 -- 172.21.15.79:0/789399921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200505b0 con 0x7f5e20004bd0 2021-04-09T18:31:31.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e367fc700 1 -- 172.21.15.79:0/789399921 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200507b0 con 0x7f5e20003d10 2021-04-09T18:31:31.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e37fff700 1 --2- 172.21.15.79:0/789399921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e20005020 0x7f5e2000be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:31.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e36ffd700 1 --2- 172.21.15.79:0/789399921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e20004bd0 0x7f5e200097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:31.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e377fe700 1 --2- 172.21.15.79:0/789399921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e20003d10 0x7f5e200045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:31.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e37fff700 1 -- 172.21.15.79:0/789399921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e20003d10 msgr2=0x7f5e200045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:31.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e37fff700 1 --2- 172.21.15.79:0/789399921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e20003d10 0x7f5e200045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e37fff700 1 -- 172.21.15.79:0/789399921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e20004bd0 msgr2=0x7f5e200097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:31.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e37fff700 1 --2- 172.21.15.79:0/789399921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e20004bd0 0x7f5e200097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e37fff700 1 -- 172.21.15.79:0/789399921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e20050aa0 con 0x7f5e20005020 2021-04-09T18:31:31.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e36ffd700 1 --2- 172.21.15.79:0/789399921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e20004bd0 0x7f5e200097e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:31.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e37fff700 1 -- 172.21.15.79:0/789399921 reap_dead start 2021-04-09T18:31:31.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e37fff700 1 --2- 172.21.15.79:0/789399921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e20005020 0x7f5e2000be20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f5e3000c000 tx=0x7f5e3000e1d0).ready entity=mon.0 client_cookie=6d7ce90291595ac6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:31.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e367fc700 1 -- 172.21.15.79:0/789399921 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5e20050aa0 con 0x7f5e20005020 2021-04-09T18:31:31.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e367fc700 1 -- 172.21.15.79:0/789399921 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3000eaa0 con 0x7f5e20005020 2021-04-09T18:31:31.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e367fc700 1 -- 172.21.15.79:0/789399921 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5e3000f040 con 0x7f5e20005020 2021-04-09T18:31:31.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e3dd84700 1 -- 172.21.15.79:0/789399921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e20005020 msgr2=0x7f5e2000be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e3dd84700 1 --2- 172.21.15.79:0/789399921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e20005020 0x7f5e2000be20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f5e3000c000 tx=0x7f5e3000e1d0).stop 2021-04-09T18:31:31.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e3dd84700 1 -- 172.21.15.79:0/789399921 shutdown_connections 2021-04-09T18:31:31.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e3dd84700 1 --2- 172.21.15.79:0/789399921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e20005020 0x7f5e2000be20 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e3dd84700 1 -- 172.21.15.79:0/789399921 >> 172.21.15.79:0/789399921 conn(0x7f5e380e5fe0 msgr2=0x7f5e380e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:31.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e3dd84700 1 -- 172.21.15.79:0/789399921 shutdown_connections 2021-04-09T18:31:31.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.771 7f5e3dd84700 1 -- 172.21.15.79:0/789399921 wait complete. 2021-04-09T18:31:31.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.775 7f5e3dd84700 1 Processor -- start 2021-04-09T18:31:31.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.775 7f5e3dd84700 1 -- start start 2021-04-09T18:31:31.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.775 7f5e3dd84700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e38096990 0x7f5e380c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:31.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.775 7f5e3dd84700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e380bb2a0 0x7f5e380c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:31.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.775 7f5e3dd84700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e38097200 0x7f5e380c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:31.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.775 7f5e3dd84700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380e9f30 con 0x7f5e380bb2a0 2021-04-09T18:31:31.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.775 7f5e3dd84700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e38097970 con 0x7f5e38097200 2021-04-09T18:31:31.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.775 7f5e3dd84700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380bb6f0 con 0x7f5e38096990 2021-04-09T18:31:31.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.775 7f5e36ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e380bb2a0 0x7f5e380c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:31.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.775 7f5e36ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e380bb2a0 0x7f5e380c3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59000/0 (socket says 172.21.15.79:59000) 2021-04-09T18:31:31.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.775 7f5e36ffd700 1 -- 172.21.15.79:0/1819972800 learned_addr learned my addr 172.21.15.79:0/1819972800 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:31.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.775 7f5e37fff700 1 --2- 172.21.15.79:0/1819972800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e38097200 0x7f5e380c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:31.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.775 7f5e377fe700 1 --2- 172.21.15.79:0/1819972800 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e38096990 0x7f5e380c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:31.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.779 7f5e36ffd700 1 -- 172.21.15.79:0/1819972800 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e38096990 msgr2=0x7f5e380c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.779 7f5e36ffd700 1 --2- 172.21.15.79:0/1819972800 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e38096990 0x7f5e380c34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.779 7f5e36ffd700 1 -- 172.21.15.79:0/1819972800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e38097200 msgr2=0x7f5e380c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.779 7f5e36ffd700 1 --2- 172.21.15.79:0/1819972800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e38097200 0x7f5e380c56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.779 7f5e36ffd700 1 -- 172.21.15.79:0/1819972800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e38099210 con 0x7f5e380bb2a0 2021-04-09T18:31:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.779 7f5e36ffd700 1 --2- 172.21.15.79:0/1819972800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e380bb2a0 0x7f5e380c3b10 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f5e380d80f0 tx=0x7f5e2c00d430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.779 7f5e1ffff700 1 -- 172.21.15.79:0/1819972800 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5e38099210 con 0x7f5e380bb2a0 2021-04-09T18:31:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.779 7f5e1ffff700 1 -- 172.21.15.79:0/1819972800 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c00dbb0 con 0x7f5e380bb2a0 2021-04-09T18:31:31.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.779 7f5e1ffff700 1 -- 172.21.15.79:0/1819972800 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5e2c010040 con 0x7f5e380bb2a0 2021-04-09T18:31:31.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.779 7f5e3dd84700 1 -- 172.21.15.79:0/1819972800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e380c5d10 con 0x7f5e380bb2a0 2021-04-09T18:31:31.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.779 7f5e3dd84700 1 -- 172.21.15.79:0/1819972800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e380c6280 con 0x7f5e380bb2a0 2021-04-09T18:31:31.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.779 7f5e1ffff700 1 -- 172.21.15.79:0/1819972800 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5e2c012070 con 0x7f5e380bb2a0 2021-04-09T18:31:31.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.779 7f5e1ffff700 1 --2- 172.21.15.79:0/1819972800 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5e18029100 0x7f5e1802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:31.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.779 7f5e1ffff700 1 -- 172.21.15.79:0/1819972800 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f5e2c011040 con 0x7f5e380bb2a0 2021-04-09T18:31:31.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.779 7f5e377fe700 1 --2- 172.21.15.79:0/1819972800 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5e18029100 0x7f5e1802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:31.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.783 7f5e377fe700 1 --2- 172.21.15.79:0/1819972800 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5e18029100 0x7f5e1802b650 crc :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:31.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.783 7f5e3dd84700 1 -- 172.21.15.79:0/1819972800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e380e39e0 con 0x7f5e380bb2a0 2021-04-09T18:31:31.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.787 7f5e1ffff700 1 -- 172.21.15.79:0/1819972800 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5e380e5ca0 con 0x7f5e380bb2a0 2021-04-09T18:31:31.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.951 7f5e3dd84700 1 -- 172.21.15.79:0/1819972800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e380f5b20 con 0x7f5e380bb2a0 2021-04-09T18:31:31.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.951 7f5e1ffff700 1 -- 172.21.15.79:0/1819972800 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+14348 (secure 0 0 0) 0x7f5e2c00fe10 con 0x7f5e380bb2a0 2021-04-09T18:31:31.956 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:31.956 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":60,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:31:31.735141","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:31:29.577618","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2021-04-09 18:31:30.395684","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6835/3190188639":"2021-04-10 18:31:31.735114","172.21.15.89:6834/3190188639":"2021-04-10 18:31:31.735114"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:31:31.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.955 7f5e3dd84700 1 -- 172.21.15.79:0/1819972800 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5e18029100 msgr2=0x7f5e1802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.955 7f5e3dd84700 1 --2- 172.21.15.79:0/1819972800 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5e18029100 0x7f5e1802b650 crc :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.955 7f5e3dd84700 1 -- 172.21.15.79:0/1819972800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e380bb2a0 msgr2=0x7f5e380c3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:31.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.955 7f5e3dd84700 1 --2- 172.21.15.79:0/1819972800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e380bb2a0 0x7f5e380c3b10 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f5e380d80f0 tx=0x7f5e2c00d430).stop 2021-04-09T18:31:31.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.955 7f5e3dd84700 1 -- 172.21.15.79:0/1819972800 shutdown_connections 2021-04-09T18:31:31.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.955 7f5e3dd84700 1 --2- 172.21.15.79:0/1819972800 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5e18029100 0x7f5e1802b650 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.955 7f5e3dd84700 1 --2- 172.21.15.79:0/1819972800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e38097200 0x7f5e380c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.955 7f5e3dd84700 1 --2- 172.21.15.79:0/1819972800 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e38096990 0x7f5e380c34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.955 7f5e3dd84700 1 --2- 172.21.15.79:0/1819972800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e380bb2a0 0x7f5e380c3b10 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:31.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.955 7f5e3dd84700 1 -- 172.21.15.79:0/1819972800 >> 172.21.15.79:0/1819972800 conn(0x7f5e380c0460 msgr2=0x7f5e38095da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:31.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.955 7f5e3dd84700 1 -- 172.21.15.79:0/1819972800 shutdown_connections 2021-04-09T18:31:31.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:31.955 7f5e3dd84700 1 -- 172.21.15.79:0/1819972800 wait complete. 2021-04-09T18:31:31.968 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-04-09T18:31:32.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.071 7f35737fb700 1 Processor -- start 2021-04-09T18:31:32.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.071 7f35737fb700 1 -- start start 2021-04-09T18:31:32.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.071 7f35737fb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f356c1c9050 0x7f356c1cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:32.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.071 7f35737fb700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356c0fbb50 con 0x7f356c0e9b10 2021-04-09T18:31:32.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.071 7f35737fb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356c09f910 con 0x7f356c0f5550 2021-04-09T18:31:32.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.071 7f35737fb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356c1c3df0 con 0x7f356c1c9050 2021-04-09T18:31:32.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.071 7f3570d9e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f356c0e9b10 0x7f356c09f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53718/0 (socket says 172.21.15.79:53718) 2021-04-09T18:31:32.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.071 7f3570d9e700 1 -- 172.21.15.79:0/2002618023 learned_addr learned my addr 172.21.15.79:0/2002618023 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:32.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.071 7f3571da0700 1 --2- 172.21.15.79:0/2002618023 >> v2:172.21.15.89:3300/0 conn(0x7f356c1c9050 0x7f356c1cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:32.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.071 7f3563fff700 1 -- 172.21.15.79:0/2002618023 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512178403 0 0) 0x7f355c0010d0 con 0x7f356c0e9b10 2021-04-09T18:31:32.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.071 7f3563fff700 1 -- 172.21.15.79:0/2002618023 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3558003240 con 0x7f356c0e9b10 2021-04-09T18:31:32.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.071 7f3571da0700 1 -- 172.21.15.79:0/2002618023 >> v1:172.21.15.89:6789/0 conn(0x7f356c0f5550 legacy=0x7f356c0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:32.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.071 7f3571da0700 1 -- 172.21.15.79:0/2002618023 >> v1:172.21.15.79:6789/0 conn(0x7f356c0e9b10 legacy=0x7f356c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:32.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.071 7f3571da0700 1 -- 172.21.15.79:0/2002618023 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c0e5700 con 0x7f356c1c9050 2021-04-09T18:31:32.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.071 7f3571da0700 1 --2- 172.21.15.79:0/2002618023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f356c1c9050 0x7f356c1cb4b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f35640032b0 tx=0x7f356400b0e0).ready entity=mon.1 client_cookie=50b56ca12b0922ec server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:32.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.071 7f3563fff700 1 -- 172.21.15.79:0/2002618023 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f356c0e5700 con 0x7f356c1c9050 2021-04-09T18:31:32.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.071 7f3563fff700 1 -- 172.21.15.79:0/2002618023 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356400bab0 con 0x7f356c1c9050 2021-04-09T18:31:32.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.071 7f3563fff700 1 -- 172.21.15.79:0/2002618023 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3564002020 con 0x7f356c1c9050 2021-04-09T18:31:32.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.071 7f35737fb700 1 -- 172.21.15.79:0/2002618023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f356c1c9050 msgr2=0x7f356c1cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:32.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.071 7f35737fb700 1 --2- 172.21.15.79:0/2002618023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f356c1c9050 0x7f356c1cb4b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f35640032b0 tx=0x7f356400b0e0).stop 2021-04-09T18:31:32.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.075 7f35737fb700 1 -- 172.21.15.79:0/2002618023 shutdown_connections 2021-04-09T18:31:32.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.075 7f35737fb700 1 --2- 172.21.15.79:0/2002618023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f356c1c9050 0x7f356c1cb4b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.075 7f35737fb700 1 -- 172.21.15.79:0/2002618023 >> 172.21.15.79:0/2002618023 conn(0x7f356c0e6010 msgr2=0x7f356c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:32.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.075 7f35737fb700 1 -- 172.21.15.79:0/2002618023 shutdown_connections 2021-04-09T18:31:32.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.075 7f35737fb700 1 -- 172.21.15.79:0/2002618023 wait complete. 2021-04-09T18:31:32.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.075 7f35737fb700 1 Processor -- start 2021-04-09T18:31:32.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f35737fb700 1 -- start start 2021-04-09T18:31:32.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f35737fb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f356c19d630 0x7f356c1ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:32.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f35737fb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f356c0d4bb0 0x7f356c0d5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:32.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f35737fb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f356c0d5630 0x7f356c1ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:32.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f35737fb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c0e9f60 con 0x7f356c0d4bb0 2021-04-09T18:31:32.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f35737fb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c19bae0 con 0x7f356c0d5630 2021-04-09T18:31:32.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f35737fb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356c19bde0 con 0x7f356c19d630 2021-04-09T18:31:32.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f3570d9e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f356c0d4bb0 0x7f356c0d5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:32.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f3570d9e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f356c0d4bb0 0x7f356c0d5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59014/0 (socket says 172.21.15.79:59014) 2021-04-09T18:31:32.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f3571da0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f356c0d5630 0x7f356c1ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:32.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f3570d9e700 1 -- 172.21.15.79:0/2509153466 learned_addr learned my addr 172.21.15.79:0/2509153466 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:32.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f357159f700 1 --2- 172.21.15.79:0/2509153466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f356c19d630 0x7f356c1ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:32.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f357159f700 1 -- 172.21.15.79:0/2509153466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f356c0d5630 msgr2=0x7f356c1ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:32.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f357159f700 1 --2- 172.21.15.79:0/2509153466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f356c0d5630 0x7f356c1ae810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f357159f700 1 -- 172.21.15.79:0/2509153466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f356c0d4bb0 msgr2=0x7f356c0d5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:32.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f357159f700 1 --2- 172.21.15.79:0/2509153466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f356c0d4bb0 0x7f356c0d5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f357159f700 1 -- 172.21.15.79:0/2509153466 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c1aee40 con 0x7f356c19d630 2021-04-09T18:31:32.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f3570d9e700 1 --2- 172.21.15.79:0/2509153466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f356c0d4bb0 0x7f356c0d5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:32.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f3571da0700 1 --2- 172.21.15.79:0/2509153466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f356c0d5630 0x7f356c1ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:32.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f357159f700 1 --2- 172.21.15.79:0/2509153466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f356c19d630 0x7f356c1ab250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f356c0d8200 tx=0x7f356800ca00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:32.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f3561ffb700 1 -- 172.21.15.79:0/2509153466 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f356c1aee40 con 0x7f356c19d630 2021-04-09T18:31:32.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f3561ffb700 1 -- 172.21.15.79:0/2509153466 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356800e4a0 con 0x7f356c19d630 2021-04-09T18:31:32.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f35737fb700 1 -- 172.21.15.79:0/2509153466 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356c1af100 con 0x7f356c19d630 2021-04-09T18:31:32.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f3561ffb700 1 -- 172.21.15.79:0/2509153466 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f356800e870 con 0x7f356c19d630 2021-04-09T18:31:32.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.079 7f35737fb700 1 -- 172.21.15.79:0/2509153466 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356c1af600 con 0x7f356c19d630 2021-04-09T18:31:32.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.083 7f3561ffb700 1 -- 172.21.15.79:0/2509153466 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f356800ea70 con 0x7f356c19d630 2021-04-09T18:31:32.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.083 7f3561ffb700 1 --2- 172.21.15.79:0/2509153466 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f354c029100 0x7f354c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:32.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.083 7f3561ffb700 1 -- 172.21.15.79:0/2509153466 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f3568038dc0 con 0x7f356c19d630 2021-04-09T18:31:32.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.083 7f3570d9e700 1 --2- 172.21.15.79:0/2509153466 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f354c029100 0x7f354c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:32.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.083 7f3570d9e700 1 --2- 172.21.15.79:0/2509153466 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f354c029100 0x7f354c02b650 crc :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:32.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.083 7f35737fb700 1 -- 172.21.15.79:0/2509153466 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356c0e39f0 con 0x7f356c19d630 2021-04-09T18:31:32.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.095 7f3561ffb700 1 -- 172.21.15.79:0/2509153466 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f356800e290 con 0x7f356c19d630 2021-04-09T18:31:32.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.263 7f35737fb700 1 -- 172.21.15.79:0/2509153466 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f356c0bb500 con 0x7f356c19d630 2021-04-09T18:31:32.365 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:31:32.363 7fbcd0516700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:31:32.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.371 7f3561ffb700 1 -- 172.21.15.79:0/2509153466 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v32) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3568000bf0 con 0x7f356c19d630 2021-04-09T18:31:32.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.383 7f35737fb700 1 -- 172.21.15.79:0/2509153466 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f354c029100 msgr2=0x7f354c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:32.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.383 7f35737fb700 1 --2- 172.21.15.79:0/2509153466 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f354c029100 0x7f354c02b650 crc :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.383 7f35737fb700 1 -- 172.21.15.79:0/2509153466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f356c19d630 msgr2=0x7f356c1ab250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:32.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.383 7f35737fb700 1 --2- 172.21.15.79:0/2509153466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f356c19d630 0x7f356c1ab250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f356c0d8200 tx=0x7f356800ca00).stop 2021-04-09T18:31:32.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.387 7f35737fb700 1 -- 172.21.15.79:0/2509153466 shutdown_connections 2021-04-09T18:31:32.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.387 7f35737fb700 1 --2- 172.21.15.79:0/2509153466 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f354c029100 0x7f354c02b650 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.387 7f35737fb700 1 --2- 172.21.15.79:0/2509153466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f356c0d5630 0x7f356c1ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.387 7f35737fb700 1 --2- 172.21.15.79:0/2509153466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f356c19d630 0x7f356c1ab250 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.387 7f35737fb700 1 --2- 172.21.15.79:0/2509153466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f356c0d4bb0 0x7f356c0d5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.387 7f35737fb700 1 -- 172.21.15.79:0/2509153466 >> 172.21.15.79:0/2509153466 conn(0x7f356c09b020 msgr2=0x7f356c09a580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:32.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.387 7f35737fb700 1 -- 172.21.15.79:0/2509153466 shutdown_connections 2021-04-09T18:31:32.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.387 7f35737fb700 1 -- 172.21.15.79:0/2509153466 wait complete. 2021-04-09T18:31:32.400 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:32.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.499 7f9471e15700 1 Processor -- start 2021-04-09T18:31:32.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.499 7f9471e15700 1 -- start start 2021-04-09T18:31:32.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f9471e15700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f946c0f5510 0x7f946c0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:32.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f9471e15700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f946c1c8000 0x7f946c1ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:32.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f9471e15700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f946c0fbb10 con 0x7f946c0e9ad0 2021-04-09T18:31:32.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f9471e15700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946c0e9f20 con 0x7f946c0f5510 2021-04-09T18:31:32.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f9471e15700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946c1c3db0 con 0x7f946c1c8000 2021-04-09T18:31:32.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f946b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f946c0f5510 0x7f946c0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:32.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f946affd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f946c0e9ad0 0x7f946c09f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53744/0 (socket says 172.21.15.79:53744) 2021-04-09T18:31:32.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f946affd700 1 -- 172.21.15.79:0/3804500638 learned_addr learned my addr 172.21.15.79:0/3804500638 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:32.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f946bfff700 1 --2- 172.21.15.79:0/3804500638 >> v2:172.21.15.89:3300/0 conn(0x7f946c1c8000 0x7f946c1ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:32.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f946b7fe700 1 -- 172.21.15.79:0/3804500638 >> v2:172.21.15.89:3300/0 conn(0x7f946c1c8000 msgr2=0x7f946c1ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:32.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f946b7fe700 1 --2- 172.21.15.79:0/3804500638 >> v2:172.21.15.89:3300/0 conn(0x7f946c1c8000 0x7f946c1ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f946b7fe700 1 -- 172.21.15.79:0/3804500638 >> v1:172.21.15.79:6789/0 conn(0x7f946c0e9ad0 legacy=0x7f946c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:32.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f946a7fc700 1 -- 172.21.15.79:0/3804500638 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600000785 0 0) 0x7f94600010d0 con 0x7f946c0e9ad0 2021-04-09T18:31:32.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f946b7fe700 1 -- 172.21.15.79:0/3804500638 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c09f900 con 0x7f946c0f5510 2021-04-09T18:31:32.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f946b7fe700 1 --2- 172.21.15.79:0/3804500638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f946c0f5510 0x7f946c0f64a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f945c002f30 tx=0x7f945c00bd10).ready entity=mon.0 client_cookie=9b33add1cee51f72 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:32.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f946a7fc700 1 -- 172.21.15.79:0/3804500638 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f946c09f900 con 0x7f946c0f5510 2021-04-09T18:31:32.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f946a7fc700 1 -- 172.21.15.79:0/3804500638 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945c0098a0 con 0x7f946c0f5510 2021-04-09T18:31:32.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f946a7fc700 1 -- 172.21.15.79:0/3804500638 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f945c009c70 con 0x7f946c0f5510 2021-04-09T18:31:32.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f9471e15700 1 -- 172.21.15.79:0/3804500638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f946c0f5510 msgr2=0x7f946c0f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:32.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f9471e15700 1 --2- 172.21.15.79:0/3804500638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f946c0f5510 0x7f946c0f64a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f945c002f30 tx=0x7f945c00bd10).stop 2021-04-09T18:31:32.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f9471e15700 1 -- 172.21.15.79:0/3804500638 shutdown_connections 2021-04-09T18:31:32.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f9471e15700 1 --2- 172.21.15.79:0/3804500638 >> v2:172.21.15.89:3300/0 conn(0x7f946c1c8000 0x7f946c1ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f9471e15700 1 --2- 172.21.15.79:0/3804500638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f946c0f5510 0x7f946c0f64a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f9471e15700 1 -- 172.21.15.79:0/3804500638 >> 172.21.15.79:0/3804500638 conn(0x7f946c0e5fd0 msgr2=0x7f946c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:32.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f9471e15700 1 -- 172.21.15.79:0/3804500638 shutdown_connections 2021-04-09T18:31:32.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.503 7f9471e15700 1 -- 172.21.15.79:0/3804500638 wait complete. 2021-04-09T18:31:32.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.507 7f9471e15700 1 Processor -- start 2021-04-09T18:31:32.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.507 7f9471e15700 1 -- start start 2021-04-09T18:31:32.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.507 7f9471e15700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f946c0d25b0 0x7f946c0d2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:32.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.507 7f9471e15700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f946c0d4a00 0x7f946c0d4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:32.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.507 7f9471e15700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f946c0bcd10 0x7f946c0bd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:32.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.507 7f9471e15700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c095a30 con 0x7f946c0bcd10 2021-04-09T18:31:32.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.507 7f9471e15700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c1a86e0 con 0x7f946c0d4a00 2021-04-09T18:31:32.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.507 7f9471e15700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946c0952c0 con 0x7f946c0d25b0 2021-04-09T18:31:32.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.507 7f946bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f946c0bcd10 0x7f946c0bd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:32.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.507 7f946bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f946c0bcd10 0x7f946c0bd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59040/0 (socket says 172.21.15.79:59040) 2021-04-09T18:31:32.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.507 7f946bfff700 1 -- 172.21.15.79:0/688739906 learned_addr learned my addr 172.21.15.79:0/688739906 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:32.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.507 7f946b7fe700 1 --2- 172.21.15.79:0/688739906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f946c0d25b0 0x7f946c0d2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:32.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.507 7f946affd700 1 --2- 172.21.15.79:0/688739906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f946c0d4a00 0x7f946c0d4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:32.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.511 7f946bfff700 1 -- 172.21.15.79:0/688739906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f946c0d25b0 msgr2=0x7f946c0d2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:32.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.511 7f946bfff700 1 --2- 172.21.15.79:0/688739906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f946c0d25b0 0x7f946c0d2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.511 7f946bfff700 1 -- 172.21.15.79:0/688739906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f946c0d4a00 msgr2=0x7f946c0d4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:32.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.511 7f946bfff700 1 --2- 172.21.15.79:0/688739906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f946c0d4a00 0x7f946c0d4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.511 7f946bfff700 1 -- 172.21.15.79:0/688739906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c0bd790 con 0x7f946c0bcd10 2021-04-09T18:31:32.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.511 7f946bfff700 1 --2- 172.21.15.79:0/688739906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f946c0bcd10 0x7f946c0bd160 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f946400efc0 tx=0x7f946400c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:32.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.511 7f9453fff700 1 -- 172.21.15.79:0/688739906 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f946c0bd790 con 0x7f946c0bcd10 2021-04-09T18:31:32.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.511 7f9453fff700 1 -- 172.21.15.79:0/688739906 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946400cca0 con 0x7f946c0bcd10 2021-04-09T18:31:32.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.511 7f9471e15700 1 -- 172.21.15.79:0/688739906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f946c0949e0 con 0x7f946c0bcd10 2021-04-09T18:31:32.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.511 7f9453fff700 1 -- 172.21.15.79:0/688739906 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f946400f040 con 0x7f946c0bcd10 2021-04-09T18:31:32.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.511 7f9471e15700 1 -- 172.21.15.79:0/688739906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f946c1aac10 con 0x7f946c0bcd10 2021-04-09T18:31:32.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.511 7f9453fff700 1 -- 172.21.15.79:0/688739906 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9464022060 con 0x7f946c0bcd10 2021-04-09T18:31:32.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.511 7f9453fff700 1 --2- 172.21.15.79:0/688739906 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f944c029100 0x7f944c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:32.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.511 7f9453fff700 1 -- 172.21.15.79:0/688739906 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f9464010040 con 0x7f946c0bcd10 2021-04-09T18:31:32.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.511 7f946b7fe700 1 --2- 172.21.15.79:0/688739906 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f944c029100 0x7f944c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:32.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.515 7f946b7fe700 1 --2- 172.21.15.79:0/688739906 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f944c029100 0x7f944c02b650 crc :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:32.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.515 7f9471e15700 1 -- 172.21.15.79:0/688739906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946c0e39d0 con 0x7f946c0bcd10 2021-04-09T18:31:32.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.519 7f9453fff700 1 -- 172.21.15.79:0/688739906 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f946c0f76b0 con 0x7f946c0bcd10 2021-04-09T18:31:32.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.683 7f9471e15700 1 -- 172.21.15.79:0/688739906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f946c0a1cb0 con 0x7f946c0bcd10 2021-04-09T18:31:32.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.683 7f9453fff700 1 -- 172.21.15.79:0/688739906 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2106 (secure 0 0 0) 0x7f946400ca90 con 0x7f946c0bcd10 2021-04-09T18:31:32.689 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 33 2021-04-09T18:31:32.690 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:32.690 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5369,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/2729581928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2729581928},{"type":"v1","addr":"172.21.15.89:6835","nonce":2729581928}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:31:31.364796","modified":"2021-04-09 18:31:32.371994","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5366},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5366":{"gid":5366,"name":"a","rank":0,"incarnation":33,"state":"up:creating","state_seq":2,"addr":"172.21.15.79:6833/4166243574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4166243574},{"type":"v1","addr":"172.21.15.79:6833","nonce":4166243574}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-04-09T18:31:32.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.687 7f9471e15700 1 -- 172.21.15.79:0/688739906 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f944c029100 msgr2=0x7f944c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:32.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.687 7f9471e15700 1 --2- 172.21.15.79:0/688739906 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f944c029100 0x7f944c02b650 crc :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.687 7f9471e15700 1 -- 172.21.15.79:0/688739906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f946c0bcd10 msgr2=0x7f946c0bd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:32.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.687 7f9471e15700 1 --2- 172.21.15.79:0/688739906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f946c0bcd10 0x7f946c0bd160 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f946400efc0 tx=0x7f946400c430).stop 2021-04-09T18:31:32.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.687 7f9471e15700 1 -- 172.21.15.79:0/688739906 shutdown_connections 2021-04-09T18:31:32.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.687 7f9471e15700 1 --2- 172.21.15.79:0/688739906 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f944c029100 0x7f944c02b650 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.687 7f9471e15700 1 --2- 172.21.15.79:0/688739906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f946c0bcd10 0x7f946c0bd160 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.687 7f9471e15700 1 --2- 172.21.15.79:0/688739906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f946c0d25b0 0x7f946c0d2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.687 7f9471e15700 1 --2- 172.21.15.79:0/688739906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f946c0d4a00 0x7f946c0d4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.687 7f9471e15700 1 -- 172.21.15.79:0/688739906 >> 172.21.15.79:0/688739906 conn(0x7f946c0bae80 msgr2=0x7f946c0938a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:32.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.687 7f9471e15700 1 -- 172.21.15.79:0/688739906 shutdown_connections 2021-04-09T18:31:32.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.687 7f9471e15700 1 -- 172.21.15.79:0/688739906 wait complete. 2021-04-09T18:31:32.700 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:31:32.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8537a60700 1 Processor -- start 2021-04-09T18:31:32.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8537a60700 1 -- start start 2021-04-09T18:31:32.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8537a60700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f85300f5510 0x7f85300f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:32.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8537a60700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f85300e9ad0 0x7f853009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:32.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8537a60700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85300fbb10 con 0x7f85301c2da0 2021-04-09T18:31:32.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8537a60700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85300e9f20 con 0x7f85300e9ad0 2021-04-09T18:31:32.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8537a60700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85300e59c0 con 0x7f85300f5510 2021-04-09T18:31:32.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8536005700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f85301c2da0 0x7f85301c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53760/0 (socket says 172.21.15.79:53760) 2021-04-09T18:31:32.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8535003700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f85300e9ad0 0x7f853009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:32.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8536005700 1 -- 172.21.15.79:0/3181657924 learned_addr learned my addr 172.21.15.79:0/3181657924 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:32.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8535804700 1 --2- 172.21.15.79:0/3181657924 >> v2:172.21.15.89:3300/0 conn(0x7f85300f5510 0x7f85300f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:32.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8534802700 1 -- 172.21.15.79:0/3181657924 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818286697 0 0) 0x7f8528001450 con 0x7f85301c2da0 2021-04-09T18:31:32.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8534802700 1 -- 172.21.15.79:0/3181657924 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f851c003240 con 0x7f85301c2da0 2021-04-09T18:31:32.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8535003700 1 -- 172.21.15.79:0/3181657924 >> v2:172.21.15.89:3300/0 conn(0x7f85300f5510 msgr2=0x7f85300f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:32.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8535003700 1 --2- 172.21.15.79:0/3181657924 >> v2:172.21.15.89:3300/0 conn(0x7f85300f5510 0x7f85300f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8535003700 1 -- 172.21.15.79:0/3181657924 >> v1:172.21.15.79:6789/0 conn(0x7f85301c2da0 legacy=0x7f85301c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:32.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8535003700 1 -- 172.21.15.79:0/3181657924 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85300e56c0 con 0x7f85300e9ad0 2021-04-09T18:31:32.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8535804700 1 --2- 172.21.15.79:0/3181657924 >> v2:172.21.15.89:3300/0 conn(0x7f85300f5510 0x7f85300f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:32.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8535003700 1 --2- 172.21.15.79:0/3181657924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85300e9ad0 0x7f853009f100 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f8520002f30 tx=0x7f852000bd10).ready entity=mon.0 client_cookie=c6d6bee85dc74382 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:32.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8534802700 1 -- 172.21.15.79:0/3181657924 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f85300e56c0 con 0x7f85300e9ad0 2021-04-09T18:31:32.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8534802700 1 -- 172.21.15.79:0/3181657924 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85200098a0 con 0x7f85300e9ad0 2021-04-09T18:31:32.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8534802700 1 -- 172.21.15.79:0/3181657924 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8520009c70 con 0x7f85300e9ad0 2021-04-09T18:31:32.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8537a60700 1 -- 172.21.15.79:0/3181657924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85300e9ad0 msgr2=0x7f853009f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:32.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.803 7f8537a60700 1 --2- 172.21.15.79:0/3181657924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85300e9ad0 0x7f853009f100 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f8520002f30 tx=0x7f852000bd10).stop 2021-04-09T18:31:32.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.807 7f8537a60700 1 -- 172.21.15.79:0/3181657924 shutdown_connections 2021-04-09T18:31:32.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.807 7f8537a60700 1 --2- 172.21.15.79:0/3181657924 >> v2:172.21.15.89:3300/0 conn(0x7f85300f5510 0x7f85300f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.807 7f8537a60700 1 --2- 172.21.15.79:0/3181657924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85300e9ad0 0x7f853009f100 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.807 7f8537a60700 1 -- 172.21.15.79:0/3181657924 >> 172.21.15.79:0/3181657924 conn(0x7f85300e5fd0 msgr2=0x7f85300e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:32.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.807 7f8537a60700 1 -- 172.21.15.79:0/3181657924 shutdown_connections 2021-04-09T18:31:32.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.807 7f8537a60700 1 -- 172.21.15.79:0/3181657924 wait complete. 2021-04-09T18:31:32.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8537a60700 1 Processor -- start 2021-04-09T18:31:32.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8537a60700 1 -- start start 2021-04-09T18:31:32.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8537a60700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85300d01f0 0x7f85300d6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:32.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8537a60700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85300d67b0 0x7f85300b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:32.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8537a60700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85300cec60 0x7f85301a7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:32.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8537a60700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85300885b0 con 0x7f85300d67b0 2021-04-09T18:31:32.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8537a60700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853009a700 con 0x7f85300cec60 2021-04-09T18:31:32.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8537a60700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85300b6690 con 0x7f85300d01f0 2021-04-09T18:31:32.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8535003700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85300d67b0 0x7f85300b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:32.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8535003700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85300d67b0 0x7f85300b8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59054/0 (socket says 172.21.15.79:59054) 2021-04-09T18:31:32.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8535003700 1 -- 172.21.15.79:0/3626488687 learned_addr learned my addr 172.21.15.79:0/3626488687 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:32.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8536005700 1 --2- 172.21.15.79:0/3626488687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85300cec60 0x7f85301a7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:32.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8535804700 1 --2- 172.21.15.79:0/3626488687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85300d01f0 0x7f85300d6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:32.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8535003700 1 -- 172.21.15.79:0/3626488687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85300d01f0 msgr2=0x7f85300d6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:32.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8535003700 1 --2- 172.21.15.79:0/3626488687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85300d01f0 0x7f85300d6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8535003700 1 -- 172.21.15.79:0/3626488687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85300cec60 msgr2=0x7f85301a7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:32.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8535003700 1 --2- 172.21.15.79:0/3626488687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85300cec60 0x7f85301a7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8535003700 1 -- 172.21.15.79:0/3626488687 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85300d6c00 con 0x7f85300d67b0 2021-04-09T18:31:32.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8535003700 1 --2- 172.21.15.79:0/3626488687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85300d67b0 0x7f85300b8c10 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f85300b9980 tx=0x7f8520006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:32.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f85267fc700 1 -- 172.21.15.79:0/3626488687 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f85300d6c00 con 0x7f85300d67b0 2021-04-09T18:31:32.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f85267fc700 1 -- 172.21.15.79:0/3626488687 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8520011c50 con 0x7f85300d67b0 2021-04-09T18:31:32.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8537a60700 1 -- 172.21.15.79:0/3626488687 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85300b9240 con 0x7f85300d67b0 2021-04-09T18:31:32.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f85267fc700 1 -- 172.21.15.79:0/3626488687 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f852001d630 con 0x7f85300d67b0 2021-04-09T18:31:32.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.811 7f8537a60700 1 -- 172.21.15.79:0/3626488687 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853009a290 con 0x7f85300d67b0 2021-04-09T18:31:32.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.815 7f85267fc700 1 -- 172.21.15.79:0/3626488687 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8520026450 con 0x7f85300d67b0 2021-04-09T18:31:32.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.815 7f85267fc700 1 --2- 172.21.15.79:0/3626488687 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8518029100 0x7f851802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:32.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.815 7f85267fc700 1 -- 172.21.15.79:0/3626488687 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f852003af30 con 0x7f85300d67b0 2021-04-09T18:31:32.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.815 7f8535804700 1 --2- 172.21.15.79:0/3626488687 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8518029100 0x7f851802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:32.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.815 7f8535804700 1 --2- 172.21.15.79:0/3626488687 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8518029100 0x7f851802b650 crc :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:32.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.819 7f8537a60700 1 -- 172.21.15.79:0/3626488687 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85300e39d0 con 0x7f85300d67b0 2021-04-09T18:31:32.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.823 7f85267fc700 1 -- 172.21.15.79:0/3626488687 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8520011a40 con 0x7f85300d67b0 2021-04-09T18:31:32.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.987 7f8537a60700 1 -- 172.21.15.79:0/3626488687 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85300f5b10 con 0x7f85300d67b0 2021-04-09T18:31:32.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.987 7f85267fc700 1 -- 172.21.15.79:0/3626488687 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+14348 (secure 0 0 0) 0x7f8520009690 con 0x7f85300d67b0 2021-04-09T18:31:32.991 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:32.992 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":60,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:31:31.735141","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:31:29.577618","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2021-04-09 18:31:30.395684","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6835/3190188639":"2021-04-10 18:31:31.735114","172.21.15.89:6834/3190188639":"2021-04-10 18:31:31.735114"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:31:32.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.991 7f8537a60700 1 -- 172.21.15.79:0/3626488687 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8518029100 msgr2=0x7f851802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:32.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.991 7f8537a60700 1 --2- 172.21.15.79:0/3626488687 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8518029100 0x7f851802b650 crc :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.991 7f8537a60700 1 -- 172.21.15.79:0/3626488687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85300d67b0 msgr2=0x7f85300b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:32.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.991 7f8537a60700 1 --2- 172.21.15.79:0/3626488687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85300d67b0 0x7f85300b8c10 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f85300b9980 tx=0x7f8520006890).stop 2021-04-09T18:31:32.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.991 7f8537a60700 1 -- 172.21.15.79:0/3626488687 shutdown_connections 2021-04-09T18:31:32.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.991 7f8537a60700 1 --2- 172.21.15.79:0/3626488687 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8518029100 0x7f851802b650 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.991 7f8537a60700 1 --2- 172.21.15.79:0/3626488687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85300cec60 0x7f85301a7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.991 7f8537a60700 1 --2- 172.21.15.79:0/3626488687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85300d01f0 0x7f85300d6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.991 7f8537a60700 1 --2- 172.21.15.79:0/3626488687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85300d67b0 0x7f85300b8c10 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:32.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.991 7f8537a60700 1 -- 172.21.15.79:0/3626488687 >> 172.21.15.79:0/3626488687 conn(0x7f8530092d60 msgr2=0x7f85300baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:32.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.991 7f8537a60700 1 -- 172.21.15.79:0/3626488687 shutdown_connections 2021-04-09T18:31:32.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:32.991 7f8537a60700 1 -- 172.21.15.79:0/3626488687 wait complete. 2021-04-09T18:31:33.005 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:31:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.111 7fc076fe1700 1 Processor -- start 2021-04-09T18:31:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.111 7fc076fe1700 1 -- start start 2021-04-09T18:31:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.111 7fc076fe1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc0700e9b40 0x7fc07009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.111 7fc076fe1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0700fbb80 con 0x7fc0700f5580 2021-04-09T18:31:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.111 7fc076fe1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0700e56b0 con 0x7fc0701c7e40 2021-04-09T18:31:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.111 7fc076fe1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0700e9f90 con 0x7fc0700e9b40 2021-04-09T18:31:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.111 7fc06ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc0700e9b40 0x7fc07009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.111 7fc074d85700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc0700f5580 0x7fc0700f6510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53770/0 (socket says 172.21.15.79:53770) 2021-04-09T18:31:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.111 7fc074d85700 1 -- 172.21.15.79:0/740488240 learned_addr learned my addr 172.21.15.79:0/740488240 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.115 7fc06ffff700 1 -- 172.21.15.79:0/740488240 >> v1:172.21.15.89:6789/0 conn(0x7fc0701c7e40 legacy=0x7fc0701ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.115 7fc06ffff700 1 -- 172.21.15.79:0/740488240 >> v1:172.21.15.79:6789/0 conn(0x7fc0700f5580 legacy=0x7fc0700f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.115 7fc06ffff700 1 -- 172.21.15.79:0/740488240 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0700e4310 con 0x7fc0700e9b40 2021-04-09T18:31:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.115 7fc06f7fe700 1 -- 172.21.15.79:0/740488240 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38484644 0 0) 0x7fc0640010d0 con 0x7fc0700f5580 2021-04-09T18:31:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.115 7fc06ffff700 1 --2- 172.21.15.79:0/740488240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0700e9b40 0x7fc07009f110 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fc05c002f30 tx=0x7fc05c00bcc0).ready entity=mon.0 client_cookie=11b4981008047870 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.115 7fc06f7fe700 1 -- 172.21.15.79:0/740488240 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc0700e4310 con 0x7fc0700e9b40 2021-04-09T18:31:33.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.115 7fc06f7fe700 1 -- 172.21.15.79:0/740488240 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c009800 con 0x7fc0700e9b40 2021-04-09T18:31:33.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.115 7fc06f7fe700 1 -- 172.21.15.79:0/740488240 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc05c009bd0 con 0x7fc0700e9b40 2021-04-09T18:31:33.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.115 7fc076fe1700 1 -- 172.21.15.79:0/740488240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0700e9b40 msgr2=0x7fc07009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.115 7fc076fe1700 1 --2- 172.21.15.79:0/740488240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0700e9b40 0x7fc07009f110 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fc05c002f30 tx=0x7fc05c00bcc0).stop 2021-04-09T18:31:33.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.115 7fc076fe1700 1 -- 172.21.15.79:0/740488240 shutdown_connections 2021-04-09T18:31:33.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.115 7fc076fe1700 1 --2- 172.21.15.79:0/740488240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0700e9b40 0x7fc07009f110 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.115 7fc076fe1700 1 -- 172.21.15.79:0/740488240 >> 172.21.15.79:0/740488240 conn(0x7fc0700e6040 msgr2=0x7fc0700e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:33.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.115 7fc076fe1700 1 -- 172.21.15.79:0/740488240 shutdown_connections 2021-04-09T18:31:33.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.115 7fc076fe1700 1 -- 172.21.15.79:0/740488240 wait complete. 2021-04-09T18:31:33.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc076fe1700 1 Processor -- start 2021-04-09T18:31:33.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc076fe1700 1 -- start start 2021-04-09T18:31:33.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc076fe1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0700d6290 0x7fc0700979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc076fe1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0700d66e0 0x7fc0700bfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc076fe1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0700c04f0 0x7fc0701d2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc076fe1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc070088820 con 0x7fc0700d6290 2021-04-09T18:31:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc076fe1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc070098e60 con 0x7fc0700c04f0 2021-04-09T18:31:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc076fe1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc070099160 con 0x7fc0700d66e0 2021-04-09T18:31:33.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc074d85700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0700d6290 0x7fc0700979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc074d85700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0700d6290 0x7fc0700979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59068/0 (socket says 172.21.15.79:59068) 2021-04-09T18:31:33.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc074d85700 1 -- 172.21.15.79:0/3410974083 learned_addr learned my addr 172.21.15.79:0/3410974083 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:33.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc06ffff700 1 --2- 172.21.15.79:0/3410974083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0700d66e0 0x7fc0700bfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc075586700 1 --2- 172.21.15.79:0/3410974083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0700c04f0 0x7fc0701d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc074d85700 1 -- 172.21.15.79:0/3410974083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0700d66e0 msgr2=0x7fc0700bfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc074d85700 1 --2- 172.21.15.79:0/3410974083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0700d66e0 0x7fc0700bfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc074d85700 1 -- 172.21.15.79:0/3410974083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0700c04f0 msgr2=0x7fc0701d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc074d85700 1 --2- 172.21.15.79:0/3410974083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0700c04f0 0x7fc0701d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc074d85700 1 -- 172.21.15.79:0/3410974083 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0700989f0 con 0x7fc0700d6290 2021-04-09T18:31:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc075586700 1 --2- 172.21.15.79:0/3410974083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0700c04f0 0x7fc0701d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc06ffff700 1 --2- 172.21.15.79:0/3410974083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0700d66e0 0x7fc0700bfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc074d85700 1 --2- 172.21.15.79:0/3410974083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0700d6290 0x7fc0700979c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fc0700d5a10 tx=0x7fc06400cb40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:33.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc06d7fa700 1 -- 172.21.15.79:0/3410974083 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc0700989f0 con 0x7fc0700d6290 2021-04-09T18:31:33.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc06d7fa700 1 -- 172.21.15.79:0/3410974083 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc064007320 con 0x7fc0700d6290 2021-04-09T18:31:33.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc076fe1700 1 -- 172.21.15.79:0/3410974083 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc070097ff0 con 0x7fc0700d6290 2021-04-09T18:31:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc06d7fa700 1 -- 172.21.15.79:0/3410974083 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc0640057e0 con 0x7fc0700d6290 2021-04-09T18:31:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.119 7fc076fe1700 1 -- 172.21.15.79:0/3410974083 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0701d2f00 con 0x7fc0700d6290 2021-04-09T18:31:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.123 7fc06d7fa700 1 -- 172.21.15.79:0/3410974083 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc06401a060 con 0x7fc0700d6290 2021-04-09T18:31:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.123 7fc06d7fa700 1 --2- 172.21.15.79:0/3410974083 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc050029100 0x7fc05002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.123 7fc06d7fa700 1 -- 172.21.15.79:0/3410974083 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fc064038d40 con 0x7fc0700d6290 2021-04-09T18:31:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.123 7fc06ffff700 1 --2- 172.21.15.79:0/3410974083 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc050029100 0x7fc05002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.123 7fc06ffff700 1 --2- 172.21.15.79:0/3410974083 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc050029100 0x7fc05002b650 crc :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:33.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.127 7fc076fe1700 1 -- 172.21.15.79:0/3410974083 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc070088d30 con 0x7fc0700d6290 2021-04-09T18:31:33.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.131 7fc06d7fa700 1 -- 172.21.15.79:0/3410974083 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc064000bf0 con 0x7fc0700d6290 2021-04-09T18:31:33.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.291 7fc076fe1700 1 -- 172.21.15.79:0/3410974083 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fc0700e39a0 con 0x7fc0700d6290 2021-04-09T18:31:33.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.295 7fc06d7fa700 1 -- 172.21.15.79:0/3410974083 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v18) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc064007110 con 0x7fc0700d6290 2021-04-09T18:31:33.301 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2021-04-09T18:31:33.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.303 7fc076fe1700 1 -- 172.21.15.79:0/3410974083 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc050029100 msgr2=0x7fc05002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.303 7fc076fe1700 1 --2- 172.21.15.79:0/3410974083 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc050029100 0x7fc05002b650 crc :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.303 7fc076fe1700 1 -- 172.21.15.79:0/3410974083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0700d6290 msgr2=0x7fc0700979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.303 7fc076fe1700 1 --2- 172.21.15.79:0/3410974083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0700d6290 0x7fc0700979c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fc0700d5a10 tx=0x7fc06400cb40).stop 2021-04-09T18:31:33.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.303 7fc076fe1700 1 -- 172.21.15.79:0/3410974083 shutdown_connections 2021-04-09T18:31:33.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.303 7fc076fe1700 1 --2- 172.21.15.79:0/3410974083 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc050029100 0x7fc05002b650 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.303 7fc076fe1700 1 --2- 172.21.15.79:0/3410974083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0700c04f0 0x7fc0701d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.303 7fc076fe1700 1 --2- 172.21.15.79:0/3410974083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0700d6290 0x7fc0700979c0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.303 7fc076fe1700 1 --2- 172.21.15.79:0/3410974083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0700d66e0 0x7fc0700bfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.303 7fc076fe1700 1 -- 172.21.15.79:0/3410974083 >> 172.21.15.79:0/3410974083 conn(0x7fc070095b50 msgr2=0x7fc0700d8200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:33.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.303 7fc076fe1700 1 -- 172.21.15.79:0/3410974083 shutdown_connections 2021-04-09T18:31:33.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.303 7fc076fe1700 1 -- 172.21.15.79:0/3410974083 wait complete. 2021-04-09T18:31:33.316 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:31:33.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.419 7f6c7f9f9700 1 Processor -- start 2021-04-09T18:31:33.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.419 7f6c7f9f9700 1 -- start start 2021-04-09T18:31:33.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.419 7f6c7f9f9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c780f5580 0x7f6c780f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.419 7f6c7f9f9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6c781c7e40 0x7f6c781ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.419 7f6c7f9f9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c780fbb80 con 0x7f6c780e9b40 2021-04-09T18:31:33.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.419 7f6c7f9f9700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c780e9f90 con 0x7f6c780f5580 2021-04-09T18:31:33.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.419 7f6c7f9f9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c780e59b0 con 0x7f6c781c7e40 2021-04-09T18:31:33.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.419 7f6c7d79d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c780f5580 0x7f6c780f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.419 7f6c7d79d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c780f5580 0x7f6c780f6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59076/0 (socket says 172.21.15.79:59076) 2021-04-09T18:31:33.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.419 7f6c7d79d700 1 -- 172.21.15.79:0/1360304749 learned_addr learned my addr 172.21.15.79:0/1360304749 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:33.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.423 7f6c7df9e700 1 --2- 172.21.15.79:0/1360304749 >> v2:172.21.15.89:3300/0 conn(0x7f6c781c7e40 0x7f6c781ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.423 7f6c7d79d700 1 -- 172.21.15.79:0/1360304749 >> v2:172.21.15.89:3300/0 conn(0x7f6c781c7e40 msgr2=0x7f6c781ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:33.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.423 7f6c7d79d700 1 --2- 172.21.15.79:0/1360304749 >> v2:172.21.15.89:3300/0 conn(0x7f6c781c7e40 0x7f6c781ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.423 7f6c7d79d700 1 -- 172.21.15.79:0/1360304749 >> v1:172.21.15.89:6789/0 conn(0x7f6c780e9b40 legacy=0x7f6c7809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.423 7f6c7d79d700 1 -- 172.21.15.79:0/1360304749 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7809f910 con 0x7f6c780f5580 2021-04-09T18:31:33.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.423 7f6c7df9e700 1 --2- 172.21.15.79:0/1360304749 >> v2:172.21.15.89:3300/0 conn(0x7f6c781c7e40 0x7f6c781ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:33.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.423 7f6c7d79d700 1 --2- 172.21.15.79:0/1360304749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c780f5580 0x7f6c780f6510 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f6c700016c0 tx=0x7f6c700013c0).ready entity=mon.0 client_cookie=57a3f3ddbb3078ab server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:33.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.423 7f6c6ffff700 1 -- 172.21.15.79:0/1360304749 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c7809f910 con 0x7f6c780f5580 2021-04-09T18:31:33.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.423 7f6c6ffff700 1 -- 172.21.15.79:0/1360304749 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c680097c0 con 0x7f6c780f5580 2021-04-09T18:31:33.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.423 7f6c6ffff700 1 -- 172.21.15.79:0/1360304749 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c68009b90 con 0x7f6c780f5580 2021-04-09T18:31:33.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.423 7f6c7f9f9700 1 -- 172.21.15.79:0/1360304749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c780f5580 msgr2=0x7f6c780f6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.423 7f6c7f9f9700 1 --2- 172.21.15.79:0/1360304749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c780f5580 0x7f6c780f6510 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f6c700016c0 tx=0x7f6c700013c0).stop 2021-04-09T18:31:33.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.423 7f6c7f9f9700 1 -- 172.21.15.79:0/1360304749 shutdown_connections 2021-04-09T18:31:33.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.423 7f6c7f9f9700 1 --2- 172.21.15.79:0/1360304749 >> v2:172.21.15.89:3300/0 conn(0x7f6c781c7e40 0x7f6c781ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.423 7f6c7f9f9700 1 --2- 172.21.15.79:0/1360304749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c780f5580 0x7f6c780f6510 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.423 7f6c7f9f9700 1 -- 172.21.15.79:0/1360304749 >> 172.21.15.79:0/1360304749 conn(0x7f6c780e6040 msgr2=0x7f6c780e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:33.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.423 7f6c7f9f9700 1 -- 172.21.15.79:0/1360304749 shutdown_connections 2021-04-09T18:31:33.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.423 7f6c7f9f9700 1 -- 172.21.15.79:0/1360304749 wait complete. 2021-04-09T18:31:33.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7f9f9700 1 Processor -- start 2021-04-09T18:31:33.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7f9f9700 1 -- start start 2021-04-09T18:31:33.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7f9f9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c780902d0 0x7f6c780bab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7f9f9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c780a58d0 0x7f6c781a6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7f9f9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c780a5d20 0x7f6c781a7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7f9f9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c780b92d0 con 0x7f6c780a5d20 2021-04-09T18:31:33.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7f9f9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c780b95d0 con 0x7f6c780902d0 2021-04-09T18:31:33.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7f9f9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c780bb180 con 0x7f6c780a58d0 2021-04-09T18:31:33.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7df9e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c780a5d20 0x7f6c781a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7df9e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c780a5d20 0x7f6c781a7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59084/0 (socket says 172.21.15.79:59084) 2021-04-09T18:31:33.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7df9e700 1 -- 172.21.15.79:0/3522663807 learned_addr learned my addr 172.21.15.79:0/3522663807 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:33.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7cf9c700 1 --2- 172.21.15.79:0/3522663807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c780a58d0 0x7f6c781a6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7d79d700 1 --2- 172.21.15.79:0/3522663807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c780902d0 0x7f6c780bab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7df9e700 1 -- 172.21.15.79:0/3522663807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c780a58d0 msgr2=0x7f6c781a6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7df9e700 1 --2- 172.21.15.79:0/3522663807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c780a58d0 0x7f6c781a6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7df9e700 1 -- 172.21.15.79:0/3522663807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c780902d0 msgr2=0x7f6c780bab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7df9e700 1 --2- 172.21.15.79:0/3522663807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c780902d0 0x7f6c780bab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7df9e700 1 -- 172.21.15.79:0/3522663807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c780a6520 con 0x7f6c780a5d20 2021-04-09T18:31:33.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7df9e700 1 --2- 172.21.15.79:0/3522663807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c780a5d20 0x7f6c781a7290 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f6c780b9250 tx=0x7f6c7400c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:33.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c6dffb700 1 -- 172.21.15.79:0/3522663807 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c780a6520 con 0x7f6c780a5d20 2021-04-09T18:31:33.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c6dffb700 1 -- 172.21.15.79:0/3522663807 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7400cdc0 con 0x7f6c780a5d20 2021-04-09T18:31:33.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7f9f9700 1 -- 172.21.15.79:0/3522663807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c780b8e80 con 0x7f6c780a5d20 2021-04-09T18:31:33.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c6dffb700 1 -- 172.21.15.79:0/3522663807 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c7400f040 con 0x7f6c780a5d20 2021-04-09T18:31:33.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.427 7f6c7f9f9700 1 -- 172.21.15.79:0/3522663807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c78090720 con 0x7f6c780a5d20 2021-04-09T18:31:33.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.431 7f6c6dffb700 1 -- 172.21.15.79:0/3522663807 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6c74011070 con 0x7f6c780a5d20 2021-04-09T18:31:33.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.431 7f6c6dffb700 1 --2- 172.21.15.79:0/3522663807 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6c58029100 0x7f6c5802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.431 7f6c6dffb700 1 -- 172.21.15.79:0/3522663807 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f6c74010040 con 0x7f6c780a5d20 2021-04-09T18:31:33.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.431 7f6c7d79d700 1 --2- 172.21.15.79:0/3522663807 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6c58029100 0x7f6c5802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.431 7f6c7d79d700 1 --2- 172.21.15.79:0/3522663807 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6c58029100 0x7f6c5802b650 crc :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:33.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.435 7f6c7f9f9700 1 -- 172.21.15.79:0/3522663807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c78088d30 con 0x7f6c780a5d20 2021-04-09T18:31:33.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.443 7f6c6dffb700 1 -- 172.21.15.79:0/3522663807 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6c780f7720 con 0x7f6c780a5d20 2021-04-09T18:31:33.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.607 7f6c7f9f9700 1 -- 172.21.15.79:0/3522663807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f6c780e39a0 con 0x7f6c780a5d20 2021-04-09T18:31:33.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.611 7f6c6dffb700 1 -- 172.21.15.79:0/3522663807 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v19) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6c7400c9c0 con 0x7f6c780a5d20 2021-04-09T18:31:33.615 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.1 2021-04-09T18:31:33.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.615 7f6c7f9f9700 1 -- 172.21.15.79:0/3522663807 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6c58029100 msgr2=0x7f6c5802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.615 7f6c7f9f9700 1 --2- 172.21.15.79:0/3522663807 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6c58029100 0x7f6c5802b650 crc :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.615 7f6c7f9f9700 1 -- 172.21.15.79:0/3522663807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c780a5d20 msgr2=0x7f6c781a7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.615 7f6c7f9f9700 1 --2- 172.21.15.79:0/3522663807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c780a5d20 0x7f6c781a7290 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f6c780b9250 tx=0x7f6c7400c430).stop 2021-04-09T18:31:33.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.615 7f6c7f9f9700 1 -- 172.21.15.79:0/3522663807 shutdown_connections 2021-04-09T18:31:33.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.615 7f6c7f9f9700 1 --2- 172.21.15.79:0/3522663807 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6c58029100 0x7f6c5802b650 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.615 7f6c7f9f9700 1 --2- 172.21.15.79:0/3522663807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c780902d0 0x7f6c780bab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.615 7f6c7f9f9700 1 --2- 172.21.15.79:0/3522663807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c780a5d20 0x7f6c781a7290 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.615 7f6c7f9f9700 1 --2- 172.21.15.79:0/3522663807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c780a58d0 0x7f6c781a6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.615 7f6c7f9f9700 1 -- 172.21.15.79:0/3522663807 >> 172.21.15.79:0/3522663807 conn(0x7f6c78090b40 msgr2=0x7f6c78094ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:33.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.615 7f6c7f9f9700 1 -- 172.21.15.79:0/3522663807 shutdown_connections 2021-04-09T18:31:33.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.615 7f6c7f9f9700 1 -- 172.21.15.79:0/3522663807 wait complete. 2021-04-09T18:31:33.629 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:31:33.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f914e086700 1 Processor -- start 2021-04-09T18:31:33.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f914e086700 1 -- start start 2021-04-09T18:31:33.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f914e086700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f91481c8e50 0x7f91481cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f914e086700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91480fbb80 con 0x7f91480f5580 2021-04-09T18:31:33.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f914e086700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f914809f910 con 0x7f91480e9b40 2021-04-09T18:31:33.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f914e086700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91480e9f90 con 0x7f91481c8e50 2021-04-09T18:31:33.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f9147fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f91481c8e50 0x7f91481cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f91477fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f91480f5580 0x7f91480f6510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53800/0 (socket says 172.21.15.79:53800) 2021-04-09T18:31:33.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f91477fe700 1 -- 172.21.15.79:0/3214707292 learned_addr learned my addr 172.21.15.79:0/3214707292 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:33.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f9147fff700 1 -- 172.21.15.79:0/3214707292 >> v1:172.21.15.89:6789/0 conn(0x7f91480e9b40 legacy=0x7f914809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f9147fff700 1 -- 172.21.15.79:0/3214707292 >> v1:172.21.15.79:6789/0 conn(0x7f91480f5580 legacy=0x7f91480f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f91467fc700 1 -- 172.21.15.79:0/3214707292 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3595978723 0 0) 0x7f91300010d0 con 0x7f91480f5580 2021-04-09T18:31:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f9147fff700 1 -- 172.21.15.79:0/3214707292 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91480e56b0 con 0x7f91481c8e50 2021-04-09T18:31:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f9147fff700 1 --2- 172.21.15.79:0/3214707292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91481c8e50 0x7f91481cb2b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f9140002f30 tx=0x7f914000bcc0).ready entity=mon.0 client_cookie=537681e344ba5279 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:33.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f91467fc700 1 -- 172.21.15.79:0/3214707292 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f91480e56b0 con 0x7f91481c8e50 2021-04-09T18:31:33.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f91467fc700 1 -- 172.21.15.79:0/3214707292 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9140009800 con 0x7f91481c8e50 2021-04-09T18:31:33.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f91467fc700 1 -- 172.21.15.79:0/3214707292 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9140009bd0 con 0x7f91481c8e50 2021-04-09T18:31:33.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f914e086700 1 -- 172.21.15.79:0/3214707292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91481c8e50 msgr2=0x7f91481cb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f914e086700 1 --2- 172.21.15.79:0/3214707292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91481c8e50 0x7f91481cb2b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f9140002f30 tx=0x7f914000bcc0).stop 2021-04-09T18:31:33.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f914e086700 1 -- 172.21.15.79:0/3214707292 shutdown_connections 2021-04-09T18:31:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f914e086700 1 --2- 172.21.15.79:0/3214707292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91481c8e50 0x7f91481cb2b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f914e086700 1 -- 172.21.15.79:0/3214707292 >> 172.21.15.79:0/3214707292 conn(0x7f91480e6040 msgr2=0x7f91480e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f914e086700 1 -- 172.21.15.79:0/3214707292 shutdown_connections 2021-04-09T18:31:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.731 7f914e086700 1 -- 172.21.15.79:0/3214707292 wait complete. 2021-04-09T18:31:33.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f914e086700 1 Processor -- start 2021-04-09T18:31:33.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f914e086700 1 -- start start 2021-04-09T18:31:33.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f914e086700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91481c3900 0x7f91481c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f914e086700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91480d5350 0x7f91481d6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f914e086700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91480d57a0 0x7f91481d7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f914e086700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91481c3180 con 0x7f91480d5350 2021-04-09T18:31:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f914e086700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91481c3480 con 0x7f91480d57a0 2021-04-09T18:31:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f914e086700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91481c2a10 con 0x7f91481c3900 2021-04-09T18:31:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f9146ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91480d5350 0x7f91481d6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f9146ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91480d5350 0x7f91481d6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59096/0 (socket says 172.21.15.79:59096) 2021-04-09T18:31:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f9146ffd700 1 -- 172.21.15.79:0/3437586229 learned_addr learned my addr 172.21.15.79:0/3437586229 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f91477fe700 1 --2- 172.21.15.79:0/3437586229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91481c3900 0x7f91481c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f9147fff700 1 --2- 172.21.15.79:0/3437586229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91480d57a0 0x7f91481d7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f9146ffd700 1 -- 172.21.15.79:0/3437586229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91481c3900 msgr2=0x7f91481c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f9146ffd700 1 --2- 172.21.15.79:0/3437586229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91481c3900 0x7f91481c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f9146ffd700 1 -- 172.21.15.79:0/3437586229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91480d57a0 msgr2=0x7f91481d7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f9146ffd700 1 --2- 172.21.15.79:0/3437586229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91480d57a0 0x7f91481d7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f9146ffd700 1 -- 172.21.15.79:0/3437586229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91481c3d50 con 0x7f91480d5350 2021-04-09T18:31:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f9147fff700 1 --2- 172.21.15.79:0/3437586229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91480d57a0 0x7f91481d7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:31:33.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f91477fe700 1 --2- 172.21.15.79:0/3437586229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91481c3900 0x7f91481c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:31:33.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f9146ffd700 1 --2- 172.21.15.79:0/3437586229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91480d5350 0x7f91481d6a20 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f91481c3680 tx=0x7f913800ce90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:33.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f913ffff700 1 -- 172.21.15.79:0/3437586229 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f91481c3d50 con 0x7f91480d5350 2021-04-09T18:31:33.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f913ffff700 1 -- 172.21.15.79:0/3437586229 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913800a7d0 con 0x7f91480d5350 2021-04-09T18:31:33.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f914e086700 1 -- 172.21.15.79:0/3437586229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91481c8120 con 0x7f91480d5350 2021-04-09T18:31:33.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f913ffff700 1 -- 172.21.15.79:0/3437586229 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f913800aba0 con 0x7f91480d5350 2021-04-09T18:31:33.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.735 7f914e086700 1 -- 172.21.15.79:0/3437586229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91480c5e90 con 0x7f91480d5350 2021-04-09T18:31:33.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.739 7f913ffff700 1 -- 172.21.15.79:0/3437586229 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f913801b3b0 con 0x7f91480d5350 2021-04-09T18:31:33.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.739 7f913ffff700 1 --2- 172.21.15.79:0/3437586229 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f912c029100 0x7f912c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.739 7f913ffff700 1 -- 172.21.15.79:0/3437586229 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f9138039300 con 0x7f91480d5350 2021-04-09T18:31:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.739 7f91477fe700 1 --2- 172.21.15.79:0/3437586229 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f912c029100 0x7f912c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.739 7f91477fe700 1 --2- 172.21.15.79:0/3437586229 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f912c029100 0x7f912c02b650 crc :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.743 7f914e086700 1 -- 172.21.15.79:0/3437586229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9148088d30 con 0x7f91480d5350 2021-04-09T18:31:33.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.751 7f913ffff700 1 -- 172.21.15.79:0/3437586229 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9138000f70 con 0x7f91480d5350 2021-04-09T18:31:33.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.907 7f914e086700 1 -- 172.21.15.79:0/3437586229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f91480e39a0 con 0x7f91480d5350 2021-04-09T18:31:33.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.915 7f913ffff700 1 -- 172.21.15.79:0/3437586229 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v20) v1 ==== 184+0+0 (secure 0 0 0) 0x7f913800a5c0 con 0x7f91480d5350 2021-04-09T18:31:33.918 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.2 2021-04-09T18:31:33.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.919 7f914e086700 1 -- 172.21.15.79:0/3437586229 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f912c029100 msgr2=0x7f912c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.919 7f914e086700 1 --2- 172.21.15.79:0/3437586229 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f912c029100 0x7f912c02b650 crc :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.919 7f914e086700 1 -- 172.21.15.79:0/3437586229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91480d5350 msgr2=0x7f91481d6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.922 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.919 7f914e086700 1 --2- 172.21.15.79:0/3437586229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91480d5350 0x7f91481d6a20 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f91481c3680 tx=0x7f913800ce90).stop 2021-04-09T18:31:33.922 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.919 7f914e086700 1 -- 172.21.15.79:0/3437586229 shutdown_connections 2021-04-09T18:31:33.922 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.919 7f914e086700 1 --2- 172.21.15.79:0/3437586229 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f912c029100 0x7f912c02b650 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.922 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.919 7f914e086700 1 --2- 172.21.15.79:0/3437586229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91480d57a0 0x7f91481d7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.922 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.919 7f914e086700 1 --2- 172.21.15.79:0/3437586229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91481c3900 0x7f91481c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.919 7f914e086700 1 --2- 172.21.15.79:0/3437586229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91480d5350 0x7f91481d6a20 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.919 7f914e086700 1 -- 172.21.15.79:0/3437586229 >> 172.21.15.79:0/3437586229 conn(0x7f91480a2620 msgr2=0x7f91480ba760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:33.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.919 7f914e086700 1 -- 172.21.15.79:0/3437586229 shutdown_connections 2021-04-09T18:31:33.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:33.919 7f914e086700 1 -- 172.21.15.79:0/3437586229 wait complete. 2021-04-09T18:31:33.932 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:34.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d750a5700 1 Processor -- start 2021-04-09T18:31:34.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d750a5700 1 -- start start 2021-04-09T18:31:34.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d750a5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d700f5520 0x7f4d700f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:34.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d750a5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4d700e9ae0 0x7f4d7009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:34.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d750a5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d700fbb20 con 0x7f4d701c2db0 2021-04-09T18:31:34.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d750a5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d700e9f30 con 0x7f4d700f5520 2021-04-09T18:31:34.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d750a5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d700e59d0 con 0x7f4d700e9ae0 2021-04-09T18:31:34.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d6ed9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d700f5520 0x7f4d700f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:34.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d6f59e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4d701c2db0 0x7f4d701c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53814/0 (socket says 172.21.15.79:53814) 2021-04-09T18:31:34.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d6f59e700 1 -- 172.21.15.79:0/1128145410 learned_addr learned my addr 172.21.15.79:0/1128145410 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:34.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d6e59c700 1 --2- 172.21.15.79:0/1128145410 >> v2:172.21.15.89:3300/0 conn(0x7f4d700e9ae0 0x7f4d7009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:34.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d6ed9d700 1 -- 172.21.15.79:0/1128145410 >> v2:172.21.15.89:3300/0 conn(0x7f4d700e9ae0 msgr2=0x7f4d7009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:34.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d6ed9d700 1 --2- 172.21.15.79:0/1128145410 >> v2:172.21.15.89:3300/0 conn(0x7f4d700e9ae0 0x7f4d7009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d6ed9d700 1 -- 172.21.15.79:0/1128145410 >> v1:172.21.15.79:6789/0 conn(0x7f4d701c2db0 legacy=0x7f4d701c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:34.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d6ed9d700 1 -- 172.21.15.79:0/1128145410 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d700e56d0 con 0x7f4d700f5520 2021-04-09T18:31:34.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d6dd9b700 1 -- 172.21.15.79:0/1128145410 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486598258 0 0) 0x7f4d68001450 con 0x7f4d701c2db0 2021-04-09T18:31:34.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d6e59c700 1 --2- 172.21.15.79:0/1128145410 >> v2:172.21.15.89:3300/0 conn(0x7f4d700e9ae0 0x7f4d7009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:34.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d6ed9d700 1 --2- 172.21.15.79:0/1128145410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d700f5520 0x7f4d700f64b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f4d60002f30 tx=0x7f4d6000bd10).ready entity=mon.0 client_cookie=af880ac45ad86b8b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:34.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d6dd9b700 1 -- 172.21.15.79:0/1128145410 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d700e56d0 con 0x7f4d700f5520 2021-04-09T18:31:34.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d6dd9b700 1 -- 172.21.15.79:0/1128145410 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d600098a0 con 0x7f4d700f5520 2021-04-09T18:31:34.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d6dd9b700 1 -- 172.21.15.79:0/1128145410 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d60009c70 con 0x7f4d700f5520 2021-04-09T18:31:34.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d750a5700 1 -- 172.21.15.79:0/1128145410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d700f5520 msgr2=0x7f4d700f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:34.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d750a5700 1 --2- 172.21.15.79:0/1128145410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d700f5520 0x7f4d700f64b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f4d60002f30 tx=0x7f4d6000bd10).stop 2021-04-09T18:31:34.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d750a5700 1 -- 172.21.15.79:0/1128145410 shutdown_connections 2021-04-09T18:31:34.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d750a5700 1 --2- 172.21.15.79:0/1128145410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d700f5520 0x7f4d700f64b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d750a5700 1 --2- 172.21.15.79:0/1128145410 >> v2:172.21.15.89:3300/0 conn(0x7f4d700e9ae0 0x7f4d7009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d750a5700 1 -- 172.21.15.79:0/1128145410 >> 172.21.15.79:0/1128145410 conn(0x7f4d700e5fe0 msgr2=0x7f4d700e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:34.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d750a5700 1 -- 172.21.15.79:0/1128145410 shutdown_connections 2021-04-09T18:31:34.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.019 7f4d750a5700 1 -- 172.21.15.79:0/1128145410 wait complete. 2021-04-09T18:31:34.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.023 7f4d750a5700 1 Processor -- start 2021-04-09T18:31:34.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.023 7f4d750a5700 1 -- start start 2021-04-09T18:31:34.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d750a5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d700d1e50 0x7f4d700d3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:34.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d750a5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d700d3dc0 0x7f4d700badd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:34.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d750a5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d700d86b0 0x7f4d700cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:34.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d750a5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700b97c0 con 0x7f4d700d3dc0 2021-04-09T18:31:34.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d750a5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700d4210 con 0x7f4d700d1e50 2021-04-09T18:31:34.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d750a5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700d8b00 con 0x7f4d700d86b0 2021-04-09T18:31:34.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d6e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d700d3dc0 0x7f4d700badd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:34.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d6e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d700d3dc0 0x7f4d700badd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59110/0 (socket says 172.21.15.79:59110) 2021-04-09T18:31:34.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d6e59c700 1 -- 172.21.15.79:0/3347808682 learned_addr learned my addr 172.21.15.79:0/3347808682 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:34.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d6f59e700 1 --2- 172.21.15.79:0/3347808682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d700d86b0 0x7f4d700cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:34.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d6ed9d700 1 --2- 172.21.15.79:0/3347808682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d700d1e50 0x7f4d700d3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:34.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d6e59c700 1 -- 172.21.15.79:0/3347808682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d700d86b0 msgr2=0x7f4d700cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:34.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d6e59c700 1 --2- 172.21.15.79:0/3347808682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d700d86b0 0x7f4d700cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d6e59c700 1 -- 172.21.15.79:0/3347808682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d700d1e50 msgr2=0x7f4d700d3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:34.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d6e59c700 1 --2- 172.21.15.79:0/3347808682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d700d1e50 0x7f4d700d3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d6e59c700 1 -- 172.21.15.79:0/3347808682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d700d8d30 con 0x7f4d700d3dc0 2021-04-09T18:31:34.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d6e59c700 1 --2- 172.21.15.79:0/3347808682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d700d3dc0 0x7f4d700badd0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f4d6400a000 tx=0x7f4d6400df30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:34.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d5f7fe700 1 -- 172.21.15.79:0/3347808682 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d700d8d30 con 0x7f4d700d3dc0 2021-04-09T18:31:34.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d5f7fe700 1 -- 172.21.15.79:0/3347808682 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d640099e0 con 0x7f4d700d3dc0 2021-04-09T18:31:34.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d5f7fe700 1 -- 172.21.15.79:0/3347808682 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d6400f040 con 0x7f4d700d3dc0 2021-04-09T18:31:34.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d750a5700 1 -- 172.21.15.79:0/3347808682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d700cf4b0 con 0x7f4d700d3dc0 2021-04-09T18:31:34.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.027 7f4d750a5700 1 -- 172.21.15.79:0/3347808682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d701a8260 con 0x7f4d700d3dc0 2021-04-09T18:31:34.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.031 7f4d5f7fe700 1 -- 172.21.15.79:0/3347808682 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4d64013480 con 0x7f4d700d3dc0 2021-04-09T18:31:34.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.031 7f4d5f7fe700 1 --2- 172.21.15.79:0/3347808682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d54029100 0x7f4d5402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:34.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.031 7f4d5f7fe700 1 -- 172.21.15.79:0/3347808682 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f4d64010070 con 0x7f4d700d3dc0 2021-04-09T18:31:34.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.031 7f4d6ed9d700 1 --2- 172.21.15.79:0/3347808682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d54029100 0x7f4d5402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:34.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.031 7f4d6ed9d700 1 --2- 172.21.15.79:0/3347808682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d54029100 0x7f4d5402b650 crc :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:34.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.031 7f4d750a5700 1 -- 172.21.15.79:0/3347808682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d700e39e0 con 0x7f4d700d3dc0 2021-04-09T18:31:34.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.035 7f4d5f7fe700 1 -- 172.21.15.79:0/3347808682 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4d64000bf0 con 0x7f4d700d3dc0 2021-04-09T18:31:34.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.199 7f4d750a5700 1 -- 172.21.15.79:0/3347808682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d700a1cc0 con 0x7f4d700d3dc0 2021-04-09T18:31:34.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.199 7f4d5f7fe700 1 -- 172.21.15.79:0/3347808682 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2104 (secure 0 0 0) 0x7f4d640095e0 con 0x7f4d700d3dc0 2021-04-09T18:31:34.203 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 34 2021-04-09T18:31:34.204 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:34.204 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5369,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/2729581928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2729581928},{"type":"v1","addr":"172.21.15.89:6835","nonce":2729581928}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:31:31.364796","modified":"2021-04-09 18:31:33.376191","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5366},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5366":{"gid":5366,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/4166243574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4166243574},{"type":"v1","addr":"172.21.15.79:6833","nonce":4166243574}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-04-09T18:31:34.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.203 7f4d750a5700 1 -- 172.21.15.79:0/3347808682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d54029100 msgr2=0x7f4d5402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:34.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.203 7f4d750a5700 1 --2- 172.21.15.79:0/3347808682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d54029100 0x7f4d5402b650 crc :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.203 7f4d750a5700 1 -- 172.21.15.79:0/3347808682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d700d3dc0 msgr2=0x7f4d700badd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:34.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.203 7f4d750a5700 1 --2- 172.21.15.79:0/3347808682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d700d3dc0 0x7f4d700badd0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f4d6400a000 tx=0x7f4d6400df30).stop 2021-04-09T18:31:34.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.203 7f4d750a5700 1 -- 172.21.15.79:0/3347808682 shutdown_connections 2021-04-09T18:31:34.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.203 7f4d750a5700 1 --2- 172.21.15.79:0/3347808682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d54029100 0x7f4d5402b650 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.203 7f4d750a5700 1 --2- 172.21.15.79:0/3347808682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d700d1e50 0x7f4d700d3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.203 7f4d750a5700 1 --2- 172.21.15.79:0/3347808682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d700d86b0 0x7f4d700cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.203 7f4d750a5700 1 --2- 172.21.15.79:0/3347808682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d700d3dc0 0x7f4d700badd0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.203 7f4d750a5700 1 -- 172.21.15.79:0/3347808682 >> 172.21.15.79:0/3347808682 conn(0x7f4d700d3170 msgr2=0x7f4d700bbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:34.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.203 7f4d750a5700 1 -- 172.21.15.79:0/3347808682 shutdown_connections 2021-04-09T18:31:34.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.203 7f4d750a5700 1 -- 172.21.15.79:0/3347808682 wait complete. 2021-04-09T18:31:34.417 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:31:31.364796', 'modified': '2021-04-09 18:31:33.376191', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 60, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5366}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5366': {'gid': 5366, 'name': 'a', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6833/4166243574', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 4166243574}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 4166243574}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:31:34.418 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:31:34.418 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2021-04-09T18:31:34.510 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:31:34.511 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:31:34.511 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2021-04-09T18:31:34.511 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 5366, 2021-04-09T18:31:34.511 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2021-04-09T18:31:34.511 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2021-04-09T18:31:34.512 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 2.1322720980000001, 2021-04-09T18:31:34.512 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 34, 2021-04-09T18:31:34.512 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 60, 2021-04-09T18:31:34.512 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 60, 2021-04-09T18:31:34.513 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 6.7957945410000002 2021-04-09T18:31:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:31:34.517 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 5366, "want_state": "up:active", "state": "up:active", "rank_uptime": 2.1322720980000001, "mdsmap_epoch": 34, "osdmap_epoch": 60, "osdmap_epoch_barrier": 60, "uptime": 6.7957945410000002 } 2021-04-09T18:31:34.517 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:31:34.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.607 7fa683c51700 1 Processor -- start 2021-04-09T18:31:34.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.607 7fa683c51700 1 -- start start 2021-04-09T18:31:34.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa683c51700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa67c0f5520 0x7fa67c0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:34.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa683c51700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa67c0e9ae0 0x7fa67c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:34.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa683c51700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa67c1c2db0 0x7fa67c1c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:34.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa683c51700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa67c0e9f30 con 0x7fa67c0f5520 2021-04-09T18:31:34.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa683c51700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa67c0e59d0 con 0x7fa67c1c2db0 2021-04-09T18:31:34.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa683c51700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c0fbb20 con 0x7fa67c0e9ae0 2021-04-09T18:31:34.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa6819f5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa67c0f5520 0x7fa67c0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:34.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa6819f5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa67c0f5520 0x7fa67c0f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59116/0 (socket says 172.21.15.79:59116) 2021-04-09T18:31:34.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa6819f5700 1 -- 172.21.15.79:0/3213447403 learned_addr learned my addr 172.21.15.79:0/3213447403 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:34.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa6821f6700 1 --2- 172.21.15.79:0/3213447403 >> v2:172.21.15.89:3300/0 conn(0x7fa67c1c2db0 0x7fa67c1c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:34.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa6811f4700 1 --2- 172.21.15.79:0/3213447403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa67c0e9ae0 0x7fa67c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:34.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa6819f5700 1 -- 172.21.15.79:0/3213447403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa67c0e9ae0 msgr2=0x7fa67c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:34.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa6819f5700 1 --2- 172.21.15.79:0/3213447403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa67c0e9ae0 0x7fa67c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa6819f5700 1 -- 172.21.15.79:0/3213447403 >> v2:172.21.15.89:3300/0 conn(0x7fa67c1c2db0 msgr2=0x7fa67c1c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:34.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa6819f5700 1 --2- 172.21.15.79:0/3213447403 >> v2:172.21.15.89:3300/0 conn(0x7fa67c1c2db0 0x7fa67c1c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa6819f5700 1 -- 172.21.15.79:0/3213447403 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c0e56d0 con 0x7fa67c0f5520 2021-04-09T18:31:34.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa6821f6700 1 --2- 172.21.15.79:0/3213447403 >> v2:172.21.15.89:3300/0 conn(0x7fa67c1c2db0 0x7fa67c1c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:34.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa6819f5700 1 --2- 172.21.15.79:0/3213447403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c0f5520 0x7fa67c0f64b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fa678002f30 tx=0x7fa67800bd70).ready entity=mon.0 client_cookie=a2e0537fdf95159d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:34.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa6809f3700 1 -- 172.21.15.79:0/3213447403 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa67c0e56d0 con 0x7fa67c0f5520 2021-04-09T18:31:34.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa6809f3700 1 -- 172.21.15.79:0/3213447403 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6780098b0 con 0x7fa67c0f5520 2021-04-09T18:31:34.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa6809f3700 1 -- 172.21.15.79:0/3213447403 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa678009c80 con 0x7fa67c0f5520 2021-04-09T18:31:34.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa683c51700 1 -- 172.21.15.79:0/3213447403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c0f5520 msgr2=0x7fa67c0f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:34.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa683c51700 1 --2- 172.21.15.79:0/3213447403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c0f5520 0x7fa67c0f64b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fa678002f30 tx=0x7fa67800bd70).stop 2021-04-09T18:31:34.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa683c51700 1 -- 172.21.15.79:0/3213447403 shutdown_connections 2021-04-09T18:31:34.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa683c51700 1 --2- 172.21.15.79:0/3213447403 >> v2:172.21.15.89:3300/0 conn(0x7fa67c1c2db0 0x7fa67c1c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa683c51700 1 --2- 172.21.15.79:0/3213447403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c0f5520 0x7fa67c0f64b0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa683c51700 1 --2- 172.21.15.79:0/3213447403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa67c0e9ae0 0x7fa67c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa683c51700 1 -- 172.21.15.79:0/3213447403 >> 172.21.15.79:0/3213447403 conn(0x7fa67c0e5fe0 msgr2=0x7fa67c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:34.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa683c51700 1 -- 172.21.15.79:0/3213447403 shutdown_connections 2021-04-09T18:31:34.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.611 7fa683c51700 1 -- 172.21.15.79:0/3213447403 wait complete. 2021-04-09T18:31:34.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.615 7fa683c51700 1 Processor -- start 2021-04-09T18:31:34.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa683c51700 1 -- start start 2021-04-09T18:31:34.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa683c51700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa67c0b1c40 0x7fa67c096770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:34.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa683c51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c0d5070 0x7fa67c0d54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:34.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa683c51700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa67c097170 0x7fa67c0975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:34.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa683c51700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c0c5bf0 con 0x7fa67c0d5070 2021-04-09T18:31:34.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa683c51700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c097bf0 con 0x7fa67c097170 2021-04-09T18:31:34.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa683c51700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c0c5160 con 0x7fa67c0b1c40 2021-04-09T18:31:34.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa6811f4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c0d5070 0x7fa67c0d54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:34.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa6811f4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c0d5070 0x7fa67c0d54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59122/0 (socket says 172.21.15.79:59122) 2021-04-09T18:31:34.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa6811f4700 1 -- 172.21.15.79:0/597400954 learned_addr learned my addr 172.21.15.79:0/597400954 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:34.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa6821f6700 1 --2- 172.21.15.79:0/597400954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa67c097170 0x7fa67c0975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:34.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa6819f5700 1 --2- 172.21.15.79:0/597400954 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa67c0b1c40 0x7fa67c096770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:34.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa6811f4700 1 -- 172.21.15.79:0/597400954 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa67c0b1c40 msgr2=0x7fa67c096770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:34.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa6811f4700 1 --2- 172.21.15.79:0/597400954 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa67c0b1c40 0x7fa67c096770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa6811f4700 1 -- 172.21.15.79:0/597400954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa67c097170 msgr2=0x7fa67c0975c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:34.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa6811f4700 1 --2- 172.21.15.79:0/597400954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa67c097170 0x7fa67c0975c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa6811f4700 1 -- 172.21.15.79:0/597400954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c0c53c0 con 0x7fa67c0d5070 2021-04-09T18:31:34.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa6821f6700 1 --2- 172.21.15.79:0/597400954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa67c097170 0x7fa67c0975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:34.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa6811f4700 1 --2- 172.21.15.79:0/597400954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c0d5070 0x7fa67c0d54c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fa66c00c000 tx=0x7fa66c00ef50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:34.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa6727fc700 1 -- 172.21.15.79:0/597400954 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa67c0c53c0 con 0x7fa67c0d5070 2021-04-09T18:31:34.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa6727fc700 1 -- 172.21.15.79:0/597400954 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c00cac0 con 0x7fa67c0d5070 2021-04-09T18:31:34.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa683c51700 1 -- 172.21.15.79:0/597400954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67c096da0 con 0x7fa67c0d5070 2021-04-09T18:31:34.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa6727fc700 1 -- 172.21.15.79:0/597400954 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa66c00f040 con 0x7fa67c0d5070 2021-04-09T18:31:34.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa683c51700 1 -- 172.21.15.79:0/597400954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67c1b1010 con 0x7fa67c0d5070 2021-04-09T18:31:34.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.619 7fa6727fc700 1 -- 172.21.15.79:0/597400954 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa66c011070 con 0x7fa67c0d5070 2021-04-09T18:31:34.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.623 7fa6727fc700 1 --2- 172.21.15.79:0/597400954 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa664029100 0x7fa66402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:34.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.623 7fa6727fc700 1 -- 172.21.15.79:0/597400954 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fa66c010040 con 0x7fa67c0d5070 2021-04-09T18:31:34.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.623 7fa6819f5700 1 --2- 172.21.15.79:0/597400954 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa664029100 0x7fa66402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:34.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.623 7fa6819f5700 1 --2- 172.21.15.79:0/597400954 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa664029100 0x7fa66402b650 crc :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:34.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.623 7fa683c51700 1 -- 172.21.15.79:0/597400954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa67c0e39e0 con 0x7fa67c0d5070 2021-04-09T18:31:34.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.627 7fa6727fc700 1 -- 172.21.15.79:0/597400954 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa66c000bf0 con 0x7fa67c0d5070 2021-04-09T18:31:34.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.795 7fa683c51700 1 -- 172.21.15.79:0/597400954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa67c0f5b20 con 0x7fa67c0d5070 2021-04-09T18:31:34.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.795 7fa6727fc700 1 -- 172.21.15.79:0/597400954 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+14348 (secure 0 0 0) 0x7fa66c00c6c0 con 0x7fa67c0d5070 2021-04-09T18:31:34.799 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:34.800 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":60,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:31:31.735141","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:31:29.577618","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2021-04-09 18:31:30.395684","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6835/3190188639":"2021-04-10 18:31:31.735114","172.21.15.89:6834/3190188639":"2021-04-10 18:31:31.735114"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:31:34.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.799 7fa683c51700 1 -- 172.21.15.79:0/597400954 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa664029100 msgr2=0x7fa66402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:34.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.799 7fa683c51700 1 --2- 172.21.15.79:0/597400954 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa664029100 0x7fa66402b650 crc :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.799 7fa683c51700 1 -- 172.21.15.79:0/597400954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c0d5070 msgr2=0x7fa67c0d54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:34.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.799 7fa683c51700 1 --2- 172.21.15.79:0/597400954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c0d5070 0x7fa67c0d54c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fa66c00c000 tx=0x7fa66c00ef50).stop 2021-04-09T18:31:34.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.799 7fa683c51700 1 -- 172.21.15.79:0/597400954 shutdown_connections 2021-04-09T18:31:34.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.799 7fa683c51700 1 --2- 172.21.15.79:0/597400954 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa664029100 0x7fa66402b650 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.799 7fa683c51700 1 --2- 172.21.15.79:0/597400954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa67c097170 0x7fa67c0975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.799 7fa683c51700 1 --2- 172.21.15.79:0/597400954 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa67c0b1c40 0x7fa67c096770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.799 7fa683c51700 1 --2- 172.21.15.79:0/597400954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c0d5070 0x7fa67c0d54c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.799 7fa683c51700 1 -- 172.21.15.79:0/597400954 >> 172.21.15.79:0/597400954 conn(0x7fa67c0bb0c0 msgr2=0x7fa67c0d82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:34.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.799 7fa683c51700 1 -- 172.21.15.79:0/597400954 shutdown_connections 2021-04-09T18:31:34.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.799 7fa683c51700 1 -- 172.21.15.79:0/597400954 wait complete. 2021-04-09T18:31:34.813 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:31:29.577618', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:31:30.395684', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:31:34.814 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:31:34.912 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.903 7fcadbd5b700 1 Processor -- start 2021-04-09T18:31:34.913 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.903 7fcadbd5b700 1 -- start start 2021-04-09T18:31:34.913 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.903 7fcadbd5b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcad40e9b10 0x7fcad409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:34.913 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.903 7fcadbd5b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcad41c8040 0x7fcad41ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:34.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.903 7fcadbd5b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad40fbb50 con 0x7fcad40f5550 2021-04-09T18:31:34.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.903 7fcadbd5b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad41c3df0 con 0x7fcad41c8040 2021-04-09T18:31:34.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.903 7fcadbd5b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad40e9f60 con 0x7fcad40e9b10 2021-04-09T18:31:34.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcad92fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcad40e9b10 0x7fcad409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:34.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcad92fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcad40e9b10 0x7fcad409f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:56128/0 (socket says 172.21.15.79:56128) 2021-04-09T18:31:34.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcada300700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcad41c8040 0x7fcad41ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:34.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcad92fe700 1 -- 172.21.15.79:0/1878287918 learned_addr learned my addr 172.21.15.79:0/1878287918 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:34.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcad9aff700 1 --1- 172.21.15.79:0/1878287918 >> v1:172.21.15.89:6789/0 conn(0x7fcad40f5550 0x7fcad40f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:54310/0 (socket says 172.21.15.79:54310) 2021-04-09T18:31:34.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcada300700 1 -- 172.21.15.79:0/1878287918 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcad40e9b10 msgr2=0x7fcad409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:34.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcada300700 1 --2- 172.21.15.79:0/1878287918 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcad40e9b10 0x7fcad409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcada300700 1 -- 172.21.15.79:0/1878287918 >> v1:172.21.15.89:6789/0 conn(0x7fcad40f5550 legacy=0x7fcad40f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:34.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcada300700 1 -- 172.21.15.79:0/1878287918 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad40e5700 con 0x7fcad41c8040 2021-04-09T18:31:34.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcad92fe700 1 --2- 172.21.15.79:0/1878287918 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcad40e9b10 0x7fcad409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:34.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcada300700 1 --2- 172.21.15.79:0/1878287918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad41c8040 0x7fcad41ca4a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fcacc002f30 tx=0x7fcacc00bd40).ready entity=mon.1 client_cookie=184422b9e177924f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:34.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcad8afd700 1 -- 172.21.15.79:0/1878287918 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcad40e5700 con 0x7fcad41c8040 2021-04-09T18:31:34.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcad8afd700 1 -- 172.21.15.79:0/1878287918 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc009850 con 0x7fcad41c8040 2021-04-09T18:31:34.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcad8afd700 1 -- 172.21.15.79:0/1878287918 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcacc009c60 con 0x7fcad41c8040 2021-04-09T18:31:34.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcadbd5b700 1 -- 172.21.15.79:0/1878287918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad41c8040 msgr2=0x7fcad41ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:34.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcadbd5b700 1 --2- 172.21.15.79:0/1878287918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad41c8040 0x7fcad41ca4a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fcacc002f30 tx=0x7fcacc00bd40).stop 2021-04-09T18:31:34.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcadbd5b700 1 -- 172.21.15.79:0/1878287918 shutdown_connections 2021-04-09T18:31:34.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcadbd5b700 1 --2- 172.21.15.79:0/1878287918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad41c8040 0x7fcad41ca4a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcadbd5b700 1 --2- 172.21.15.79:0/1878287918 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcad40e9b10 0x7fcad409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcadbd5b700 1 -- 172.21.15.79:0/1878287918 >> 172.21.15.79:0/1878287918 conn(0x7fcad40e6010 msgr2=0x7fcad40e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:34.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcadbd5b700 1 -- 172.21.15.79:0/1878287918 shutdown_connections 2021-04-09T18:31:34.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.907 7fcadbd5b700 1 -- 172.21.15.79:0/1878287918 wait complete. 2021-04-09T18:31:34.922 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.911 7fcadbd5b700 1 Processor -- start 2021-04-09T18:31:34.922 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.911 7fcadbd5b700 1 -- start start 2021-04-09T18:31:34.922 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.911 7fcadbd5b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad40a4fa0 0x7fcad40d7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:34.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.911 7fcadbd5b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcad40cfdd0 0x7fcad409a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:34.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.911 7fcadbd5b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcad40d0220 0x7fcad409a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:34.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.911 7fcadbd5b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad4088590 con 0x7fcad40cfdd0 2021-04-09T18:31:34.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.911 7fcadbd5b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad40a4ca0 con 0x7fcad40a4fa0 2021-04-09T18:31:34.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.911 7fcadbd5b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad40d8330 con 0x7fcad40d0220 2021-04-09T18:31:34.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.911 7fcad92fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcad40cfdd0 0x7fcad409a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:34.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.911 7fcad92fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcad40cfdd0 0x7fcad409a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59136/0 (socket says 172.21.15.79:59136) 2021-04-09T18:31:34.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.911 7fcad92fe700 1 -- 172.21.15.79:0/2552525241 learned_addr learned my addr 172.21.15.79:0/2552525241 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:34.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.911 7fcada300700 1 --2- 172.21.15.79:0/2552525241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcad40d0220 0x7fcad409a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:34.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.911 7fcad9aff700 1 --2- 172.21.15.79:0/2552525241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad40a4fa0 0x7fcad40d7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:34.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.911 7fcad92fe700 1 -- 172.21.15.79:0/2552525241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcad40d0220 msgr2=0x7fcad409a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:34.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.911 7fcad92fe700 1 --2- 172.21.15.79:0/2552525241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcad40d0220 0x7fcad409a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.911 7fcad92fe700 1 -- 172.21.15.79:0/2552525241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad40a4fa0 msgr2=0x7fcad40d7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:34.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.911 7fcad92fe700 1 --2- 172.21.15.79:0/2552525241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad40a4fa0 0x7fcad40d7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:34.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.911 7fcad92fe700 1 -- 172.21.15.79:0/2552525241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad40a4830 con 0x7fcad40cfdd0 2021-04-09T18:31:34.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.911 7fcad92fe700 1 --2- 172.21.15.79:0/2552525241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcad40cfdd0 0x7fcad409a200 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fcad40bb2c0 tx=0x7fcac800c650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:34.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.911 7fcad27fc700 1 -- 172.21.15.79:0/2552525241 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcad40a4830 con 0x7fcad40cfdd0 2021-04-09T18:31:34.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.915 7fcad27fc700 1 -- 172.21.15.79:0/2552525241 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac80123f0 con 0x7fcad40cfdd0 2021-04-09T18:31:34.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.915 7fcad27fc700 1 -- 172.21.15.79:0/2552525241 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcac800f040 con 0x7fcad40cfdd0 2021-04-09T18:31:34.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.915 7fcadbd5b700 1 -- 172.21.15.79:0/2552525241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad40bc700 con 0x7fcad40cfdd0 2021-04-09T18:31:34.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.915 7fcadbd5b700 1 -- 172.21.15.79:0/2552525241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad40baba0 con 0x7fcad40cfdd0 2021-04-09T18:31:34.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.915 7fcad27fc700 1 -- 172.21.15.79:0/2552525241 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fcac8022060 con 0x7fcad40cfdd0 2021-04-09T18:31:34.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.915 7fcad27fc700 1 --2- 172.21.15.79:0/2552525241 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcab4029100 0x7fcab402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:34.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.915 7fcad27fc700 1 -- 172.21.15.79:0/2552525241 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fcac8010040 con 0x7fcad40cfdd0 2021-04-09T18:31:34.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.915 7fcad9aff700 1 --2- 172.21.15.79:0/2552525241 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcab4029100 0x7fcab402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:34.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.915 7fcad9aff700 1 --2- 172.21.15.79:0/2552525241 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcab4029100 0x7fcab402b650 crc :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:34.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.919 7fcadbd5b700 1 -- 172.21.15.79:0/2552525241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad40e39f0 con 0x7fcad40cfdd0 2021-04-09T18:31:34.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:34.927 7fcad27fc700 1 -- 172.21.15.79:0/2552525241 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fcac800cca0 con 0x7fcad40cfdd0 2021-04-09T18:31:35.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.079 7fcadbd5b700 1 -- 172.21.15.79:0/2552525241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fcad40f5b50 con 0x7fcad40cfdd0 2021-04-09T18:31:35.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.079 7fcad27fc700 1 -- 172.21.15.79:0/2552525241 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v60) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcac8000f70 con 0x7fcad40cfdd0 2021-04-09T18:31:35.084 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:31:35.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.083 7fcadbd5b700 1 -- 172.21.15.79:0/2552525241 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcab4029100 msgr2=0x7fcab402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.083 7fcadbd5b700 1 --2- 172.21.15.79:0/2552525241 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcab4029100 0x7fcab402b650 crc :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.083 7fcadbd5b700 1 -- 172.21.15.79:0/2552525241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcad40cfdd0 msgr2=0x7fcad409a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.083 7fcadbd5b700 1 --2- 172.21.15.79:0/2552525241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcad40cfdd0 0x7fcad409a200 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fcad40bb2c0 tx=0x7fcac800c650).stop 2021-04-09T18:31:35.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.083 7fcadbd5b700 1 -- 172.21.15.79:0/2552525241 shutdown_connections 2021-04-09T18:31:35.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.083 7fcadbd5b700 1 --2- 172.21.15.79:0/2552525241 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcab4029100 0x7fcab402b650 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.083 7fcadbd5b700 1 --2- 172.21.15.79:0/2552525241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad40a4fa0 0x7fcad40d7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.083 7fcadbd5b700 1 --2- 172.21.15.79:0/2552525241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcad40d0220 0x7fcad409a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.083 7fcadbd5b700 1 --2- 172.21.15.79:0/2552525241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcad40cfdd0 0x7fcad409a200 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.083 7fcadbd5b700 1 -- 172.21.15.79:0/2552525241 >> 172.21.15.79:0/2552525241 conn(0x7fcad408edf0 msgr2=0x7fcad40bcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:35.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.083 7fcadbd5b700 1 -- 172.21.15.79:0/2552525241 shutdown_connections 2021-04-09T18:31:35.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.083 7fcadbd5b700 1 -- 172.21.15.79:0/2552525241 wait complete. 2021-04-09T18:31:35.096 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:31:35.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.187 7f78479a4700 1 Processor -- start 2021-04-09T18:31:35.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.187 7f78479a4700 1 -- start start 2021-04-09T18:31:35.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.187 7f78479a4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78400e9b10 0x7f784009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.187 7f78479a4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f78401c8040 0x7f78401ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.187 7f78479a4700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78400fbb50 con 0x7f78400f5550 2021-04-09T18:31:35.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.187 7f78479a4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78401c3df0 con 0x7f78401c8040 2021-04-09T18:31:35.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.187 7f78479a4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78400e9f60 con 0x7f78400e9b10 2021-04-09T18:31:35.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.187 7f7845748700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f78400f5550 0x7f78400f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53852/0 (socket says 172.21.15.79:53852) 2021-04-09T18:31:35.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.187 7f7845748700 1 -- 172.21.15.79:0/1525411680 learned_addr learned my addr 172.21.15.79:0/1525411680 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:35.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.187 7f7845f49700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f78401c8040 0x7f78401ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.191 7f7844f47700 1 --2- 172.21.15.79:0/1525411680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78400e9b10 0x7f784009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.191 7f7845f49700 1 -- 172.21.15.79:0/1525411680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78400e9b10 msgr2=0x7f784009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:35.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.191 7f7845f49700 1 --2- 172.21.15.79:0/1525411680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78400e9b10 0x7f784009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.191 7f7845f49700 1 -- 172.21.15.79:0/1525411680 >> v1:172.21.15.79:6789/0 conn(0x7f78400f5550 legacy=0x7f78400f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.191 7f783ffff700 1 -- 172.21.15.79:0/1525411680 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967322122 0 0) 0x7f78300010d0 con 0x7f78400f5550 2021-04-09T18:31:35.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.191 7f7845f49700 1 -- 172.21.15.79:0/1525411680 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78400e5700 con 0x7f78401c8040 2021-04-09T18:31:35.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.191 7f7845f49700 1 --2- 172.21.15.79:0/1525411680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78401c8040 0x7f78401ca4a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f78380032b0 tx=0x7f783800b3c0).ready entity=mon.0 client_cookie=f34d78e67946b1d5 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:35.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.191 7f783ffff700 1 -- 172.21.15.79:0/1525411680 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f78400e5700 con 0x7f78401c8040 2021-04-09T18:31:35.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.191 7f783ffff700 1 -- 172.21.15.79:0/1525411680 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783800bc20 con 0x7f78401c8040 2021-04-09T18:31:35.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.191 7f783ffff700 1 -- 172.21.15.79:0/1525411680 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7838002020 con 0x7f78401c8040 2021-04-09T18:31:35.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.191 7f78479a4700 1 -- 172.21.15.79:0/1525411680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78401c8040 msgr2=0x7f78401ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.191 7f78479a4700 1 --2- 172.21.15.79:0/1525411680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78401c8040 0x7f78401ca4a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f78380032b0 tx=0x7f783800b3c0).stop 2021-04-09T18:31:35.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.191 7f78479a4700 1 -- 172.21.15.79:0/1525411680 shutdown_connections 2021-04-09T18:31:35.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.191 7f78479a4700 1 --2- 172.21.15.79:0/1525411680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78401c8040 0x7f78401ca4a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.191 7f78479a4700 1 --2- 172.21.15.79:0/1525411680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78400e9b10 0x7f784009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.191 7f78479a4700 1 -- 172.21.15.79:0/1525411680 >> 172.21.15.79:0/1525411680 conn(0x7f78400e6010 msgr2=0x7f78400e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:35.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.191 7f78479a4700 1 -- 172.21.15.79:0/1525411680 shutdown_connections 2021-04-09T18:31:35.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.191 7f78479a4700 1 -- 172.21.15.79:0/1525411680 wait complete. 2021-04-09T18:31:35.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f78479a4700 1 Processor -- start 2021-04-09T18:31:35.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f78479a4700 1 -- start start 2021-04-09T18:31:35.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f78479a4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78400bd5e0 0x7f78400d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f78479a4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78400b7c90 0x7f78400bba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f78479a4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78400bc0a0 0x7f7840091fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f78479a4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7840091cb0 con 0x7f78400bc0a0 2021-04-09T18:31:35.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f78479a4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78400d24d0 con 0x7f78400bd5e0 2021-04-09T18:31:35.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f78479a4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784008fe30 con 0x7f78400b7c90 2021-04-09T18:31:35.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f7845f49700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78400bc0a0 0x7f7840091fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f7845f49700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78400bc0a0 0x7f7840091fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59148/0 (socket says 172.21.15.79:59148) 2021-04-09T18:31:35.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f7845f49700 1 -- 172.21.15.79:0/886556402 learned_addr learned my addr 172.21.15.79:0/886556402 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:35.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f7844f47700 1 --2- 172.21.15.79:0/886556402 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78400b7c90 0x7f78400bba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f7845748700 1 --2- 172.21.15.79:0/886556402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78400bd5e0 0x7f78400d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f7845f49700 1 -- 172.21.15.79:0/886556402 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78400b7c90 msgr2=0x7f78400bba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f7845f49700 1 --2- 172.21.15.79:0/886556402 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78400b7c90 0x7f78400bba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f7845f49700 1 -- 172.21.15.79:0/886556402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78400bd5e0 msgr2=0x7f78400d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f7845f49700 1 --2- 172.21.15.79:0/886556402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78400bd5e0 0x7f78400d1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f7845f49700 1 -- 172.21.15.79:0/886556402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78400925e0 con 0x7f78400bc0a0 2021-04-09T18:31:35.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f7845f49700 1 --2- 172.21.15.79:0/886556402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78400bc0a0 0x7f7840091fb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f78400874d0 tx=0x7f7838006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:35.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f783dffb700 1 -- 172.21.15.79:0/886556402 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f78400925e0 con 0x7f78400bc0a0 2021-04-09T18:31:35.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f783dffb700 1 -- 172.21.15.79:0/886556402 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783801f020 con 0x7f78400bc0a0 2021-04-09T18:31:35.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f78479a4700 1 -- 172.21.15.79:0/886556402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7840090850 con 0x7f78400bc0a0 2021-04-09T18:31:35.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f783dffb700 1 -- 172.21.15.79:0/886556402 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f783801b830 con 0x7f78400bc0a0 2021-04-09T18:31:35.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f78479a4700 1 -- 172.21.15.79:0/886556402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7840090d00 con 0x7f78400bc0a0 2021-04-09T18:31:35.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f783dffb700 1 -- 172.21.15.79:0/886556402 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f783800b0e0 con 0x7f78400bc0a0 2021-04-09T18:31:35.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.195 7f783dffb700 1 --2- 172.21.15.79:0/886556402 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7820029100 0x7f782002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.199 7f783dffb700 1 -- 172.21.15.79:0/886556402 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f783803b7b0 con 0x7f78400bc0a0 2021-04-09T18:31:35.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.199 7f7845748700 1 --2- 172.21.15.79:0/886556402 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7820029100 0x7f782002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.199 7f7845748700 1 --2- 172.21.15.79:0/886556402 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7820029100 0x7f782002b650 crc :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:35.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.203 7f78479a4700 1 -- 172.21.15.79:0/886556402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78400e39f0 con 0x7f78400bc0a0 2021-04-09T18:31:35.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.211 7f783dffb700 1 -- 172.21.15.79:0/886556402 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f783801b430 con 0x7f78400bc0a0 2021-04-09T18:31:35.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.375 7f78479a4700 1 -- 172.21.15.79:0/886556402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f78400f5b50 con 0x7f78400bc0a0 2021-04-09T18:31:35.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.375 7f783dffb700 1 -- 172.21.15.79:0/886556402 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v60) v1 ==== 104+0+10 (secure 0 0 0) 0x7f783800ba10 con 0x7f78400bc0a0 2021-04-09T18:31:35.379 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:31:35.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.379 7f78479a4700 1 -- 172.21.15.79:0/886556402 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7820029100 msgr2=0x7f782002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.379 7f78479a4700 1 --2- 172.21.15.79:0/886556402 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7820029100 0x7f782002b650 crc :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.379 7f78479a4700 1 -- 172.21.15.79:0/886556402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78400bc0a0 msgr2=0x7f7840091fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.379 7f78479a4700 1 --2- 172.21.15.79:0/886556402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78400bc0a0 0x7f7840091fb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f78400874d0 tx=0x7f7838006c10).stop 2021-04-09T18:31:35.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.379 7f78479a4700 1 -- 172.21.15.79:0/886556402 shutdown_connections 2021-04-09T18:31:35.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.379 7f78479a4700 1 --2- 172.21.15.79:0/886556402 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7820029100 0x7f782002b650 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.379 7f78479a4700 1 --2- 172.21.15.79:0/886556402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78400bd5e0 0x7f78400d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.379 7f78479a4700 1 --2- 172.21.15.79:0/886556402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78400bc0a0 0x7f7840091fb0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.379 7f78479a4700 1 --2- 172.21.15.79:0/886556402 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78400b7c90 0x7f78400bba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.379 7f78479a4700 1 -- 172.21.15.79:0/886556402 >> 172.21.15.79:0/886556402 conn(0x7f7840094eb0 msgr2=0x7f78400d3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:35.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.379 7f78479a4700 1 -- 172.21.15.79:0/886556402 shutdown_connections 2021-04-09T18:31:35.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.379 7f78479a4700 1 -- 172.21.15.79:0/886556402 wait complete. 2021-04-09T18:31:35.390 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:31:35.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.483 7f6d5ef56700 1 Processor -- start 2021-04-09T18:31:35.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.483 7f6d5ef56700 1 -- start start 2021-04-09T18:31:35.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d5ef56700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6d580e9b10 0x7f6d5809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d5ef56700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d581c8040 0x7f6d581ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d5ef56700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d580fbb50 con 0x7f6d580f5550 2021-04-09T18:31:35.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d5ef56700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d581c3df0 con 0x7f6d580e9b10 2021-04-09T18:31:35.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d5ef56700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d580e9f60 con 0x7f6d581c8040 2021-04-09T18:31:35.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d5ccfa700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6d580f5550 0x7f6d580f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53866/0 (socket says 172.21.15.79:53866) 2021-04-09T18:31:35.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d5ccfa700 1 -- 172.21.15.79:0/1378505679 learned_addr learned my addr 172.21.15.79:0/1378505679 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:35.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d57fff700 1 --2- 172.21.15.79:0/1378505679 >> v2:172.21.15.89:3300/0 conn(0x7f6d580e9b10 0x7f6d5809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d5d4fb700 1 --2- 172.21.15.79:0/1378505679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d581c8040 0x7f6d581ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d577fe700 1 -- 172.21.15.79:0/1378505679 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422897119 0 0) 0x7f6d480010d0 con 0x7f6d580f5550 2021-04-09T18:31:35.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d577fe700 1 -- 172.21.15.79:0/1378505679 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d40003240 con 0x7f6d580f5550 2021-04-09T18:31:35.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d5d4fb700 1 -- 172.21.15.79:0/1378505679 >> v2:172.21.15.89:3300/0 conn(0x7f6d580e9b10 msgr2=0x7f6d5809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:35.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d5d4fb700 1 --2- 172.21.15.79:0/1378505679 >> v2:172.21.15.89:3300/0 conn(0x7f6d580e9b10 0x7f6d5809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d577fe700 1 -- 172.21.15.79:0/1378505679 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 200708814 0 0) 0x7f6d48001650 con 0x7f6d580f5550 2021-04-09T18:31:35.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d5d4fb700 1 -- 172.21.15.79:0/1378505679 >> v1:172.21.15.79:6789/0 conn(0x7f6d580f5550 legacy=0x7f6d580f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d5d4fb700 1 -- 172.21.15.79:0/1378505679 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d580e5700 con 0x7f6d581c8040 2021-04-09T18:31:35.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d57fff700 1 --2- 172.21.15.79:0/1378505679 >> v2:172.21.15.89:3300/0 conn(0x7f6d580e9b10 0x7f6d5809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:35.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d5d4fb700 1 --2- 172.21.15.79:0/1378505679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d581c8040 0x7f6d581ca4a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f6d48001df0 tx=0x7f6d5000b0e0).ready entity=mon.2 client_cookie=496274a39826b3a2 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:35.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d577fe700 1 -- 172.21.15.79:0/1378505679 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6d580e5700 con 0x7f6d581c8040 2021-04-09T18:31:35.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d577fe700 1 -- 172.21.15.79:0/1378505679 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5000b9b0 con 0x7f6d581c8040 2021-04-09T18:31:35.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d577fe700 1 -- 172.21.15.79:0/1378505679 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6d50002020 con 0x7f6d581c8040 2021-04-09T18:31:35.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d5ef56700 1 -- 172.21.15.79:0/1378505679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d581c8040 msgr2=0x7f6d581ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d5ef56700 1 --2- 172.21.15.79:0/1378505679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d581c8040 0x7f6d581ca4a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f6d48001df0 tx=0x7f6d5000b0e0).stop 2021-04-09T18:31:35.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.487 7f6d5ef56700 1 -- 172.21.15.79:0/1378505679 shutdown_connections 2021-04-09T18:31:35.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.491 7f6d5ef56700 1 --2- 172.21.15.79:0/1378505679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d581c8040 0x7f6d581ca4a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.491 7f6d5ef56700 1 --2- 172.21.15.79:0/1378505679 >> v2:172.21.15.89:3300/0 conn(0x7f6d580e9b10 0x7f6d5809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.491 7f6d5ef56700 1 -- 172.21.15.79:0/1378505679 >> 172.21.15.79:0/1378505679 conn(0x7f6d580e6010 msgr2=0x7f6d580e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.491 7f6d5ef56700 1 -- 172.21.15.79:0/1378505679 shutdown_connections 2021-04-09T18:31:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.491 7f6d5ef56700 1 -- 172.21.15.79:0/1378505679 wait complete. 2021-04-09T18:31:35.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d5ef56700 1 Processor -- start 2021-04-09T18:31:35.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d5ef56700 1 -- start start 2021-04-09T18:31:35.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d5ef56700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d580bfe80 0x7f6d580985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d5ef56700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d5819ba10 0x7f6d5819be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d5ef56700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d580c6490 0x7f6d580c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d5ef56700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d580982b0 con 0x7f6d580c6490 2021-04-09T18:31:35.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d5ef56700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d58097b40 con 0x7f6d5819ba10 2021-04-09T18:31:35.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d5ef56700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d580c02d0 con 0x7f6d580bfe80 2021-04-09T18:31:35.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d5d4fb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d580c6490 0x7f6d580c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d5d4fb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d580c6490 0x7f6d580c68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59164/0 (socket says 172.21.15.79:59164) 2021-04-09T18:31:35.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d5d4fb700 1 -- 172.21.15.79:0/4140413221 learned_addr learned my addr 172.21.15.79:0/4140413221 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:35.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d57fff700 1 --2- 172.21.15.79:0/4140413221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d5819ba10 0x7f6d5819be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d5ccfa700 1 --2- 172.21.15.79:0/4140413221 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d580bfe80 0x7f6d580985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d5d4fb700 1 -- 172.21.15.79:0/4140413221 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d580bfe80 msgr2=0x7f6d580985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d5d4fb700 1 --2- 172.21.15.79:0/4140413221 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d580bfe80 0x7f6d580985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d5d4fb700 1 -- 172.21.15.79:0/4140413221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d5819ba10 msgr2=0x7f6d5819be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d5d4fb700 1 --2- 172.21.15.79:0/4140413221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d5819ba10 0x7f6d5819be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d5d4fb700 1 -- 172.21.15.79:0/4140413221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d580bb3f0 con 0x7f6d580c6490 2021-04-09T18:31:35.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d5d4fb700 1 --2- 172.21.15.79:0/4140413221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d580c6490 0x7f6d580c68e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f6d58095230 tx=0x7f6d50006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:35.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d557fa700 1 -- 172.21.15.79:0/4140413221 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6d580bb3f0 con 0x7f6d580c6490 2021-04-09T18:31:35.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d557fa700 1 -- 172.21.15.79:0/4140413221 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5001f030 con 0x7f6d580c6490 2021-04-09T18:31:35.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d5ef56700 1 -- 172.21.15.79:0/4140413221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d58097e60 con 0x7f6d580c6490 2021-04-09T18:31:35.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d557fa700 1 -- 172.21.15.79:0/4140413221 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6d48001bb0 con 0x7f6d580c6490 2021-04-09T18:31:35.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d5ef56700 1 -- 172.21.15.79:0/4140413221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d580c6f10 con 0x7f6d580c6490 2021-04-09T18:31:35.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.495 7f6d557fa700 1 -- 172.21.15.79:0/4140413221 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6d5002a060 con 0x7f6d580c6490 2021-04-09T18:31:35.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.499 7f6d557fa700 1 --2- 172.21.15.79:0/4140413221 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6d38029100 0x7f6d3802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.499 7f6d557fa700 1 -- 172.21.15.79:0/4140413221 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f6d50003020 con 0x7f6d580c6490 2021-04-09T18:31:35.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.499 7f6d5ccfa700 1 --2- 172.21.15.79:0/4140413221 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6d38029100 0x7f6d3802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.499 7f6d5ccfa700 1 --2- 172.21.15.79:0/4140413221 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6d38029100 0x7f6d3802b650 crc :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:35.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.499 7f6d5ef56700 1 -- 172.21.15.79:0/4140413221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d580a5570 con 0x7f6d580c6490 2021-04-09T18:31:35.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.507 7f6d557fa700 1 -- 172.21.15.79:0/4140413221 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6d5000b7a0 con 0x7f6d580c6490 2021-04-09T18:31:35.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.663 7f6d5ef56700 1 -- 172.21.15.79:0/4140413221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f6d580e39f0 con 0x7f6d580c6490 2021-04-09T18:31:35.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.663 7f6d557fa700 1 -- 172.21.15.79:0/4140413221 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v60) v1 ==== 100+0+10 (secure 0 0 0) 0x7f6d5001b430 con 0x7f6d580c6490 2021-04-09T18:31:35.669 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:31:35.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.667 7f6d5ef56700 1 -- 172.21.15.79:0/4140413221 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6d38029100 msgr2=0x7f6d3802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.667 7f6d5ef56700 1 --2- 172.21.15.79:0/4140413221 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6d38029100 0x7f6d3802b650 crc :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.667 7f6d5ef56700 1 -- 172.21.15.79:0/4140413221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d580c6490 msgr2=0x7f6d580c68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.667 7f6d5ef56700 1 --2- 172.21.15.79:0/4140413221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d580c6490 0x7f6d580c68e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f6d58095230 tx=0x7f6d50006c10).stop 2021-04-09T18:31:35.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.671 7f6d5ef56700 1 -- 172.21.15.79:0/4140413221 shutdown_connections 2021-04-09T18:31:35.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.671 7f6d5ef56700 1 --2- 172.21.15.79:0/4140413221 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6d38029100 0x7f6d3802b650 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.671 7f6d5ef56700 1 --2- 172.21.15.79:0/4140413221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d580c6490 0x7f6d580c68e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.671 7f6d5ef56700 1 --2- 172.21.15.79:0/4140413221 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d580bfe80 0x7f6d580985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.671 7f6d5ef56700 1 --2- 172.21.15.79:0/4140413221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d5819ba10 0x7f6d5819be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.671 7f6d5ef56700 1 -- 172.21.15.79:0/4140413221 >> 172.21.15.79:0/4140413221 conn(0x7f6d5809aad0 msgr2=0x7f6d580d8200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:35.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.671 7f6d5ef56700 1 -- 172.21.15.79:0/4140413221 shutdown_connections 2021-04-09T18:31:35.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.671 7f6d5ef56700 1 -- 172.21.15.79:0/4140413221 wait complete. 2021-04-09T18:31:35.681 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:31:35.682 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:35.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5ae4c0700 1 Processor -- start 2021-04-09T18:31:35.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5ae4c0700 1 -- start start 2021-04-09T18:31:35.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5ae4c0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5a80e9ae0 0x7fa5a809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5ae4c0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa5a81c8010 0x7fa5a81ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5ae4c0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a80fbb20 con 0x7fa5a80f5520 2021-04-09T18:31:35.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5ae4c0700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a81c3dc0 con 0x7fa5a81c8010 2021-04-09T18:31:35.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5ae4c0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a80e9f30 con 0x7fa5a80e9ae0 2021-04-09T18:31:35.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5aca65700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa5a81c8010 0x7fa5a81ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5aca65700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa5a81c8010 0x7fa5a81ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59174/0 (socket says 172.21.15.79:59174) 2021-04-09T18:31:35.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5aca65700 1 -- 172.21.15.79:0/1312967948 learned_addr learned my addr 172.21.15.79:0/1312967948 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:35.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5a77fe700 1 --2- 172.21.15.79:0/1312967948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5a80e9ae0 0x7fa5a809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5aca65700 1 -- 172.21.15.79:0/1312967948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5a80e9ae0 msgr2=0x7fa5a809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:35.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5aca65700 1 --2- 172.21.15.79:0/1312967948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5a80e9ae0 0x7fa5a809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5aca65700 1 -- 172.21.15.79:0/1312967948 >> v1:172.21.15.89:6789/0 conn(0x7fa5a80f5520 legacy=0x7fa5a80f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5aca65700 1 -- 172.21.15.79:0/1312967948 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a80e56d0 con 0x7fa5a81c8010 2021-04-09T18:31:35.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5a77fe700 1 --2- 172.21.15.79:0/1312967948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5a80e9ae0 0x7fa5a809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:31:35.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5aca65700 1 --2- 172.21.15.79:0/1312967948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5a81c8010 0x7fa5a81ca470 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fa5a00032b0 tx=0x7fa5a000b3c0).ready entity=mon.0 client_cookie=6fe5c8276dd9ccf1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:35.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5a6ffd700 1 -- 172.21.15.79:0/1312967948 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa5a80e56d0 con 0x7fa5a81c8010 2021-04-09T18:31:35.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5a6ffd700 1 -- 172.21.15.79:0/1312967948 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a000bc20 con 0x7fa5a81c8010 2021-04-09T18:31:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5a6ffd700 1 -- 172.21.15.79:0/1312967948 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa5a0002020 con 0x7fa5a81c8010 2021-04-09T18:31:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5ae4c0700 1 -- 172.21.15.79:0/1312967948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5a81c8010 msgr2=0x7fa5a81ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.771 7fa5ae4c0700 1 --2- 172.21.15.79:0/1312967948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5a81c8010 0x7fa5a81ca470 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fa5a00032b0 tx=0x7fa5a000b3c0).stop 2021-04-09T18:31:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.775 7fa5ae4c0700 1 -- 172.21.15.79:0/1312967948 shutdown_connections 2021-04-09T18:31:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.775 7fa5ae4c0700 1 --2- 172.21.15.79:0/1312967948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5a81c8010 0x7fa5a81ca470 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.775 7fa5ae4c0700 1 --2- 172.21.15.79:0/1312967948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5a80e9ae0 0x7fa5a809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.775 7fa5ae4c0700 1 -- 172.21.15.79:0/1312967948 >> 172.21.15.79:0/1312967948 conn(0x7fa5a80e5fe0 msgr2=0x7fa5a80e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:35.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.775 7fa5ae4c0700 1 -- 172.21.15.79:0/1312967948 shutdown_connections 2021-04-09T18:31:35.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.775 7fa5ae4c0700 1 -- 172.21.15.79:0/1312967948 wait complete. 2021-04-09T18:31:35.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5ae4c0700 1 Processor -- start 2021-04-09T18:31:35.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5ae4c0700 1 -- start start 2021-04-09T18:31:35.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5ae4c0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5a80d10f0 0x7fa5a809abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5ae4c0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5a80b9330 0x7fa5a80cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5ae4c0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5a809a120 0x7fa5a80b82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5ae4c0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a80d1540 con 0x7fa5a809a120 2021-04-09T18:31:35.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5ae4c0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a8095640 con 0x7fa5a80b9330 2021-04-09T18:31:35.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5ae4c0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a80d03e0 con 0x7fa5a80d10f0 2021-04-09T18:31:35.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5aca65700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5a809a120 0x7fa5a80b82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5aca65700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5a809a120 0x7fa5a80b82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59180/0 (socket says 172.21.15.79:59180) 2021-04-09T18:31:35.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5aca65700 1 -- 172.21.15.79:0/1721889162 learned_addr learned my addr 172.21.15.79:0/1721889162 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:35.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5a77fe700 1 --2- 172.21.15.79:0/1721889162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5a80b9330 0x7fa5a80cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5a7fff700 1 --2- 172.21.15.79:0/1721889162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5a80d10f0 0x7fa5a809abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5aca65700 1 -- 172.21.15.79:0/1721889162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5a80d10f0 msgr2=0x7fa5a809abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5aca65700 1 --2- 172.21.15.79:0/1721889162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5a80d10f0 0x7fa5a809abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5aca65700 1 -- 172.21.15.79:0/1721889162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5a80b9330 msgr2=0x7fa5a80cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5aca65700 1 --2- 172.21.15.79:0/1721889162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5a80b9330 0x7fa5a80cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5aca65700 1 -- 172.21.15.79:0/1721889162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a80b9780 con 0x7fa5a809a120 2021-04-09T18:31:35.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5aca65700 1 --2- 172.21.15.79:0/1721889162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5a809a120 0x7fa5a80b82e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fa5a00032b0 tx=0x7fa5a0006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:35.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5a4ff9700 1 -- 172.21.15.79:0/1721889162 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa5a80b9780 con 0x7fa5a809a120 2021-04-09T18:31:35.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5ae4c0700 1 -- 172.21.15.79:0/1721889162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a80abc90 con 0x7fa5a809a120 2021-04-09T18:31:35.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5a4ff9700 1 -- 172.21.15.79:0/1721889162 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a001b740 con 0x7fa5a809a120 2021-04-09T18:31:35.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.779 7fa5a4ff9700 1 -- 172.21.15.79:0/1721889162 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa5a0020020 con 0x7fa5a809a120 2021-04-09T18:31:35.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.783 7fa5ae4c0700 1 -- 172.21.15.79:0/1721889162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a809a700 con 0x7fa5a809a120 2021-04-09T18:31:35.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.783 7fa5a4ff9700 1 -- 172.21.15.79:0/1721889162 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa5a0019040 con 0x7fa5a809a120 2021-04-09T18:31:35.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.783 7fa5a4ff9700 1 --2- 172.21.15.79:0/1721889162 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa588029100 0x7fa58802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.783 7fa5a4ff9700 1 -- 172.21.15.79:0/1721889162 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fa5a0003020 con 0x7fa5a809a120 2021-04-09T18:31:35.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.783 7fa5a7fff700 1 --2- 172.21.15.79:0/1721889162 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa588029100 0x7fa58802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.783 7fa5a7fff700 1 --2- 172.21.15.79:0/1721889162 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa588029100 0x7fa58802b650 crc :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:35.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.783 7fa5ae4c0700 1 -- 172.21.15.79:0/1721889162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a80e39e0 con 0x7fa5a809a120 2021-04-09T18:31:35.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.791 7fa5a4ff9700 1 -- 172.21.15.79:0/1721889162 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa5a80f76c0 con 0x7fa5a809a120 2021-04-09T18:31:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.959 7fa5ae4c0700 1 -- 172.21.15.79:0/1721889162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5a80f5b20 con 0x7fa5a809a120 2021-04-09T18:31:35.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.959 7fa5a4ff9700 1 -- 172.21.15.79:0/1721889162 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2104 (secure 0 0 0) 0x7fa5a001b530 con 0x7fa5a809a120 2021-04-09T18:31:35.964 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:35.964 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5369,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/2729581928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2729581928},{"type":"v1","addr":"172.21.15.89:6835","nonce":2729581928}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:31:31.364796","modified":"2021-04-09 18:31:33.376191","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5366},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5366":{"gid":5366,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/4166243574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4166243574},{"type":"v1","addr":"172.21.15.79:6833","nonce":4166243574}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-04-09T18:31:35.964 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 34 2021-04-09T18:31:35.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.963 7fa5ae4c0700 1 -- 172.21.15.79:0/1721889162 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa588029100 msgr2=0x7fa58802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.963 7fa5ae4c0700 1 --2- 172.21.15.79:0/1721889162 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa588029100 0x7fa58802b650 crc :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.963 7fa5ae4c0700 1 -- 172.21.15.79:0/1721889162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5a809a120 msgr2=0x7fa5a80b82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.963 7fa5ae4c0700 1 --2- 172.21.15.79:0/1721889162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5a809a120 0x7fa5a80b82e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fa5a00032b0 tx=0x7fa5a0006c10).stop 2021-04-09T18:31:35.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.963 7fa5ae4c0700 1 -- 172.21.15.79:0/1721889162 shutdown_connections 2021-04-09T18:31:35.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.963 7fa5ae4c0700 1 --2- 172.21.15.79:0/1721889162 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa588029100 0x7fa58802b650 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.963 7fa5ae4c0700 1 --2- 172.21.15.79:0/1721889162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5a809a120 0x7fa5a80b82e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.963 7fa5ae4c0700 1 --2- 172.21.15.79:0/1721889162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5a80d10f0 0x7fa5a809abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.963 7fa5ae4c0700 1 --2- 172.21.15.79:0/1721889162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5a80b9330 0x7fa5a80cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.963 7fa5ae4c0700 1 -- 172.21.15.79:0/1721889162 >> 172.21.15.79:0/1721889162 conn(0x7fa5a8093db0 msgr2=0x7fa5a80d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:35.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.963 7fa5ae4c0700 1 -- 172.21.15.79:0/1721889162 shutdown_connections 2021-04-09T18:31:35.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:35.963 7fa5ae4c0700 1 -- 172.21.15.79:0/1721889162 wait complete. 2021-04-09T18:31:36.182 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:31:31.364796', 'modified': '2021-04-09 18:31:33.376191', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 60, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5366}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5366': {'gid': 5366, 'name': 'a', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6833/4166243574', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 4166243574}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 4166243574}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:31:36.183 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:31:36.183 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2021-04-09T18:31:36.283 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:31:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:31:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2021-04-09T18:31:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 5366, 2021-04-09T18:31:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2021-04-09T18:31:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2021-04-09T18:31:36.285 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 3.9051376929999999, 2021-04-09T18:31:36.285 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 34, 2021-04-09T18:31:36.285 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 60, 2021-04-09T18:31:36.285 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 60, 2021-04-09T18:31:36.286 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 8.5686807740000006 2021-04-09T18:31:36.286 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:31:36.290 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 5366, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.9051376929999999, "mdsmap_epoch": 34, "osdmap_epoch": 60, "osdmap_epoch_barrier": 60, "uptime": 8.5686807740000006 } 2021-04-09T18:31:36.290 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:31:36.290 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-04-09T18:31:36.291 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi090.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-04-09T18:31:36.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:36.292 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:31:36.300 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:31:36.356 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:31:36.357 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:31:36.412 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:31:36.413 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:31:36.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:36.414 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:31:36.463 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:31:36.464 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:31:36.507 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:31:36.523 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:31:36.523 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:31:36.580 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:31:36.581 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:31:36.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:36.582 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:31:36.584 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:2021-04-09 18:31:36.582 7f13a18f10c0 -1 init, newargv = 0x555fb7f78890 newargc=9 2021-04-09T18:31:36.584 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13519]: starting ceph client 2021-04-09T18:31:36.593 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13519]: starting fuse 2021-04-09T18:31:37.690 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:31:37.708 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:31:37.708 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:31:37.764 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:31:37.765 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:31:37.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:37.766 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:31:37.816 INFO:teuthology.orchestra.run.smithi090.stdout:49 2021-04-09T18:31:37.816 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:31:37.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:37.817 DEBUG:teuthology.orchestra.run.smithi090:> sudo python3 -c ' 2021-04-09T18:31:37.817 DEBUG:teuthology.orchestra.run.smithi090:> import glob 2021-04-09T18:31:37.818 DEBUG:teuthology.orchestra.run.smithi090:> import re 2021-04-09T18:31:37.818 DEBUG:teuthology.orchestra.run.smithi090:> import os 2021-04-09T18:31:37.819 DEBUG:teuthology.orchestra.run.smithi090:> import subprocess 2021-04-09T18:31:37.819 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:31:37.819 DEBUG:teuthology.orchestra.run.smithi090:> def find_socket(client_name): 2021-04-09T18:31:37.820 DEBUG:teuthology.orchestra.run.smithi090:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-04-09T18:31:37.820 DEBUG:teuthology.orchestra.run.smithi090:> files = glob.glob(asok_path) 2021-04-09T18:31:37.821 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:31:37.821 DEBUG:teuthology.orchestra.run.smithi090:> # Given a non-glob path, it better be there 2021-04-09T18:31:37.822 DEBUG:teuthology.orchestra.run.smithi090:> if "*" not in asok_path: 2021-04-09T18:31:37.822 DEBUG:teuthology.orchestra.run.smithi090:> assert(len(files) == 1) 2021-04-09T18:31:37.822 DEBUG:teuthology.orchestra.run.smithi090:> return files[0] 2021-04-09T18:31:37.823 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:31:37.823 DEBUG:teuthology.orchestra.run.smithi090:> for f in files: 2021-04-09T18:31:37.824 DEBUG:teuthology.orchestra.run.smithi090:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:31:37.824 DEBUG:teuthology.orchestra.run.smithi090:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:31:37.825 DEBUG:teuthology.orchestra.run.smithi090:> return f 2021-04-09T18:31:37.825 DEBUG:teuthology.orchestra.run.smithi090:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:31:37.825 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:31:37.826 DEBUG:teuthology.orchestra.run.smithi090:> print(find_socket("client.0")) 2021-04-09T18:31:37.826 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:31:37.905 INFO:teuthology.orchestra.run.smithi090.stdout:/var/run/ceph/ceph-client.0.13519.asok 2021-04-09T18:31:37.910 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13519.asok 2021-04-09T18:31:37.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:37.911 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13519.asok status 2021-04-09T18:31:38.036 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2021-04-09T18:31:38.037 INFO:teuthology.orchestra.run.smithi090.stdout: "metadata": { 2021-04-09T18:31:38.037 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:31:38.037 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:31:38.037 INFO:teuthology.orchestra.run.smithi090.stdout: "entity_id": "0", 2021-04-09T18:31:38.037 INFO:teuthology.orchestra.run.smithi090.stdout: "hostname": "smithi090", 2021-04-09T18:31:38.038 INFO:teuthology.orchestra.run.smithi090.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-04-09T18:31:38.038 INFO:teuthology.orchestra.run.smithi090.stdout: "pid": "13519", 2021-04-09T18:31:38.038 INFO:teuthology.orchestra.run.smithi090.stdout: "root": "/" 2021-04-09T18:31:38.038 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:31:38.039 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_count": 0, 2021-04-09T18:31:38.039 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_pinned_count": 0, 2021-04-09T18:31:38.039 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 6018, 2021-04-09T18:31:38.039 INFO:teuthology.orchestra.run.smithi090.stdout: "inst": { 2021-04-09T18:31:38.039 INFO:teuthology.orchestra.run.smithi090.stdout: "name": { 2021-04-09T18:31:38.040 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "client", 2021-04-09T18:31:38.040 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6018 2021-04-09T18:31:38.040 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:31:38.040 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:31:38.041 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:31:38.041 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:31:38.042 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 1598669163 2021-04-09T18:31:38.042 INFO:teuthology.orchestra.run.smithi090.stdout: } 2021-04-09T18:31:38.042 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:31:38.043 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:31:38.043 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:31:38.043 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:31:38.043 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 1598669163 2021-04-09T18:31:38.044 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:31:38.044 INFO:teuthology.orchestra.run.smithi090.stdout: "inst_str": "client.6018 172.21.15.90:0/1598669163", 2021-04-09T18:31:38.044 INFO:teuthology.orchestra.run.smithi090.stdout: "addr_str": "172.21.15.90:0/1598669163", 2021-04-09T18:31:38.044 INFO:teuthology.orchestra.run.smithi090.stdout: "inode_count": 1, 2021-04-09T18:31:38.044 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_epoch": 34, 2021-04-09T18:31:38.045 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch": 60, 2021-04-09T18:31:38.045 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:31:38.045 INFO:teuthology.orchestra.run.smithi090.stdout: "blacklisted": false, 2021-04-09T18:31:38.045 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs" 2021-04-09T18:31:38.046 INFO:teuthology.orchestra.run.smithi090.stdout:} 2021-04-09T18:31:38.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:38.047 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:31:38.048 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:31:38.054 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:31:38.055 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:31:38.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:38.056 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:31:38.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:31:38.116 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:31:38.117 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:31:38.164 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:31:38.166 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:31:38.166 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-04-09T18:31:38.167 DEBUG:teuthology.orchestra.run.smithi090:> import sys 2021-04-09T18:31:38.167 DEBUG:teuthology.orchestra.run.smithi090:> import time 2021-04-09T18:31:38.168 DEBUG:teuthology.orchestra.run.smithi090:> import os 2021-04-09T18:31:38.168 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:31:38.168 DEBUG:teuthology.orchestra.run.smithi090:> n = 1000 2021-04-09T18:31:38.169 DEBUG:teuthology.orchestra.run.smithi090:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-04-09T18:31:38.169 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:31:38.169 DEBUG:teuthology.orchestra.run.smithi090:> if not os.path.exists(os.path.dirname(abs_path)): 2021-04-09T18:31:38.170 DEBUG:teuthology.orchestra.run.smithi090:> os.makedirs(os.path.dirname(abs_path)) 2021-04-09T18:31:38.170 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:31:38.171 DEBUG:teuthology.orchestra.run.smithi090:> for i in range(0, n): 2021-04-09T18:31:38.171 DEBUG:teuthology.orchestra.run.smithi090:> fname = "{0}_{1}".format(abs_path, i) 2021-04-09T18:31:38.171 DEBUG:teuthology.orchestra.run.smithi090:> with open(fname, '"'"'w'"'"') as f: 2021-04-09T18:31:38.172 DEBUG:teuthology.orchestra.run.smithi090:> f.write('"'"'content'"'"') 2021-04-09T18:31:38.172 DEBUG:teuthology.orchestra.run.smithi090:> if True: 2021-04-09T18:31:38.173 DEBUG:teuthology.orchestra.run.smithi090:> f.flush() 2021-04-09T18:31:38.173 DEBUG:teuthology.orchestra.run.smithi090:> os.fsync(f.fileno()) 2021-04-09T18:31:38.173 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:31:43.677 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:31:43.679 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:31:43.682 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:31:43.684 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:31:43.687 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:31:50.894 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:51.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.989 7f215322b700 1 Processor -- start 2021-04-09T18:31:51.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.989 7f215322b700 1 -- start start 2021-04-09T18:31:51.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.989 7f215322b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f214c0f5510 0x7f214c0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:51.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.989 7f215322b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c0fbb10 con 0x7f214c0e9ad0 2021-04-09T18:31:51.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.989 7f215322b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c09f900 con 0x7f214c1c8000 2021-04-09T18:31:51.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.989 7f215322b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214c0e9f20 con 0x7f214c0f5510 2021-04-09T18:31:51.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.993 7f214bfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f214c0e9ad0 0x7f214c09f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53896/0 (socket says 172.21.15.79:53896) 2021-04-09T18:31:51.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.993 7f214bfff700 1 -- 172.21.15.79:0/1397231958 learned_addr learned my addr 172.21.15.79:0/1397231958 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:31:51.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.993 7f2150fcf700 1 --2- 172.21.15.79:0/1397231958 >> v2:172.21.15.89:3300/0 conn(0x7f214c0f5510 0x7f214c0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:51.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.993 7f214b7fe700 1 -- 172.21.15.79:0/1397231958 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281338622 0 0) 0x7f21340010d0 con 0x7f214c0e9ad0 2021-04-09T18:31:51.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.993 7f214b7fe700 1 -- 172.21.15.79:0/1397231958 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2138003240 con 0x7f214c0e9ad0 2021-04-09T18:31:51.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.993 7f2150fcf700 1 -- 172.21.15.79:0/1397231958 >> v1:172.21.15.89:6789/0 conn(0x7f214c1c8000 legacy=0x7f214c1ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:51.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.993 7f2150fcf700 1 -- 172.21.15.79:0/1397231958 >> v1:172.21.15.79:6789/0 conn(0x7f214c0e9ad0 legacy=0x7f214c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:51.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.993 7f2150fcf700 1 -- 172.21.15.79:0/1397231958 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c0e56c0 con 0x7f214c0f5510 2021-04-09T18:31:51.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.993 7f2150fcf700 1 --2- 172.21.15.79:0/1397231958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f214c0f5510 0x7f214c0f64a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f213c002f30 tx=0x7f213c00bcc0).ready entity=mon.1 client_cookie=1c9ebb6c7fcb11df server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:51.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.993 7f214b7fe700 1 -- 172.21.15.79:0/1397231958 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f214c0e56c0 con 0x7f214c0f5510 2021-04-09T18:31:51.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.993 7f214b7fe700 1 -- 172.21.15.79:0/1397231958 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c009800 con 0x7f214c0f5510 2021-04-09T18:31:51.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.993 7f214b7fe700 1 -- 172.21.15.79:0/1397231958 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f213c009bd0 con 0x7f214c0f5510 2021-04-09T18:31:51.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.993 7f215322b700 1 -- 172.21.15.79:0/1397231958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f214c0f5510 msgr2=0x7f214c0f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:51.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.993 7f215322b700 1 --2- 172.21.15.79:0/1397231958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f214c0f5510 0x7f214c0f64a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f213c002f30 tx=0x7f213c00bcc0).stop 2021-04-09T18:31:51.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.993 7f215322b700 1 -- 172.21.15.79:0/1397231958 shutdown_connections 2021-04-09T18:31:51.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.993 7f215322b700 1 --2- 172.21.15.79:0/1397231958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f214c0f5510 0x7f214c0f64a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.993 7f215322b700 1 -- 172.21.15.79:0/1397231958 >> 172.21.15.79:0/1397231958 conn(0x7f214c0e5fd0 msgr2=0x7f214c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:51.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.993 7f215322b700 1 -- 172.21.15.79:0/1397231958 shutdown_connections 2021-04-09T18:31:51.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.993 7f215322b700 1 -- 172.21.15.79:0/1397231958 wait complete. 2021-04-09T18:31:51.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.997 7f215322b700 1 Processor -- start 2021-04-09T18:31:51.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.997 7f215322b700 1 -- start start 2021-04-09T18:31:51.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.997 7f215322b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f214c19d730 0x7f214c0c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:51.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.997 7f215322b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f214c0c45e0 0x7f214c0d5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:51.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.997 7f215322b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f214c0d5880 0x7f214c0af980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:51.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.997 7f215322b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c1c3db0 con 0x7f214c19d730 2021-04-09T18:31:51.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.997 7f215322b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c19b9d0 con 0x7f214c0c45e0 2021-04-09T18:31:51.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:50.997 7f215322b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214c19bec0 con 0x7f214c0d5880 2021-04-09T18:31:51.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.001 7f2150fcf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f214c19d730 0x7f214c0c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:51.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.001 7f2150fcf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f214c19d730 0x7f214c0c3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59192/0 (socket says 172.21.15.79:59192) 2021-04-09T18:31:51.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.001 7f2150fcf700 1 -- 172.21.15.79:0/1780080836 learned_addr learned my addr 172.21.15.79:0/1780080836 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:51.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.001 7f214bfff700 1 --2- 172.21.15.79:0/1780080836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f214c0c45e0 0x7f214c0d5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:51.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.001 7f21517d0700 1 --2- 172.21.15.79:0/1780080836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f214c0d5880 0x7f214c0af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:51.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.001 7f2150fcf700 1 -- 172.21.15.79:0/1780080836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f214c0d5880 msgr2=0x7f214c0af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:51.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.001 7f2150fcf700 1 --2- 172.21.15.79:0/1780080836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f214c0d5880 0x7f214c0af980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.001 7f2150fcf700 1 -- 172.21.15.79:0/1780080836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f214c0c45e0 msgr2=0x7f214c0d5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:51.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.001 7f2150fcf700 1 --2- 172.21.15.79:0/1780080836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f214c0c45e0 0x7f214c0d5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.001 7f2150fcf700 1 -- 172.21.15.79:0/1780080836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c0994b0 con 0x7f214c19d730 2021-04-09T18:31:51.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.001 7f2150fcf700 1 --2- 172.21.15.79:0/1780080836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f214c19d730 0x7f214c0c3fb0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f214c0bb300 tx=0x7f213c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:51.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.001 7f21497fa700 1 -- 172.21.15.79:0/1780080836 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f214c0994b0 con 0x7f214c19d730 2021-04-09T18:31:51.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.001 7f21497fa700 1 -- 172.21.15.79:0/1780080836 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c01d450 con 0x7f214c19d730 2021-04-09T18:31:51.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.001 7f215322b700 1 -- 172.21.15.79:0/1780080836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214c0990f0 con 0x7f214c19d730 2021-04-09T18:31:51.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.001 7f21497fa700 1 -- 172.21.15.79:0/1780080836 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f213c022020 con 0x7f214c19d730 2021-04-09T18:31:51.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.001 7f215322b700 1 -- 172.21.15.79:0/1780080836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c0b0140 con 0x7f214c19d730 2021-04-09T18:31:51.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.001 7f21497fa700 1 -- 172.21.15.79:0/1780080836 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f213c01d820 con 0x7f214c19d730 2021-04-09T18:31:51.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.001 7f21497fa700 1 --2- 172.21.15.79:0/1780080836 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2130029100 0x7f213002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:51.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.001 7f21497fa700 1 -- 172.21.15.79:0/1780080836 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f213c03c6e0 con 0x7f214c19d730 2021-04-09T18:31:51.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.005 7f214bfff700 1 --2- 172.21.15.79:0/1780080836 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2130029100 0x7f213002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:51.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.005 7f215322b700 1 -- 172.21.15.79:0/1780080836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214c0e39d0 con 0x7f214c19d730 2021-04-09T18:31:51.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.005 7f214bfff700 1 --2- 172.21.15.79:0/1780080836 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2130029100 0x7f213002b650 crc :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:51.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.009 7f21497fa700 1 -- 172.21.15.79:0/1780080836 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f213c011db0 con 0x7f214c19d730 2021-04-09T18:31:51.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.177 7f215322b700 1 -- 172.21.15.79:0/1780080836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f214c0a1cb0 con 0x7f214c19d730 2021-04-09T18:31:51.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.177 7f21497fa700 1 -- 172.21.15.79:0/1780080836 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2104 (secure 0 0 0) 0x7f213c035850 con 0x7f214c19d730 2021-04-09T18:31:51.185 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:51.185 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5369,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/2729581928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2729581928},{"type":"v1","addr":"172.21.15.89:6835","nonce":2729581928}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:31:31.364796","modified":"2021-04-09 18:31:33.376191","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5366},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5366":{"gid":5366,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/4166243574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4166243574},{"type":"v1","addr":"172.21.15.79:6833","nonce":4166243574}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-04-09T18:31:51.185 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 34 2021-04-09T18:31:51.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.181 7f215322b700 1 -- 172.21.15.79:0/1780080836 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2130029100 msgr2=0x7f213002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:51.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.181 7f215322b700 1 --2- 172.21.15.79:0/1780080836 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2130029100 0x7f213002b650 crc :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.181 7f215322b700 1 -- 172.21.15.79:0/1780080836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f214c19d730 msgr2=0x7f214c0c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:51.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.181 7f215322b700 1 --2- 172.21.15.79:0/1780080836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f214c19d730 0x7f214c0c3fb0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f214c0bb300 tx=0x7f213c006890).stop 2021-04-09T18:31:51.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.181 7f215322b700 1 -- 172.21.15.79:0/1780080836 shutdown_connections 2021-04-09T18:31:51.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.181 7f215322b700 1 --2- 172.21.15.79:0/1780080836 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2130029100 0x7f213002b650 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.181 7f215322b700 1 --2- 172.21.15.79:0/1780080836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f214c0d5880 0x7f214c0af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.181 7f215322b700 1 --2- 172.21.15.79:0/1780080836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f214c19d730 0x7f214c0c3fb0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.181 7f215322b700 1 --2- 172.21.15.79:0/1780080836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f214c0c45e0 0x7f214c0d5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.181 7f215322b700 1 -- 172.21.15.79:0/1780080836 >> 172.21.15.79:0/1780080836 conn(0x7f214c0ba8f0 msgr2=0x7f214c0d85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:51.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.181 7f215322b700 1 -- 172.21.15.79:0/1780080836 shutdown_connections 2021-04-09T18:31:51.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.181 7f215322b700 1 -- 172.21.15.79:0/1780080836 wait complete. 2021-04-09T18:31:51.197 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config set mds_recall_max_caps 20 2021-04-09T18:31:51.285 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:31:51.285 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " 2021-04-09T18:31:51.285 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:31:51.291 INFO:tasks.cephfs.filesystem:_json_asok output: { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-04-09T18:31:51.291 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:51.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.373 7fb54314e700 1 Processor -- start 2021-04-09T18:31:51.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.373 7fb54314e700 1 -- start start 2021-04-09T18:31:51.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.373 7fb54314e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb53c0e9ad0 0x7fb53c09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:51.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.373 7fb54314e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb53c1c8000 0x7fb53c1ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:51.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.373 7fb54314e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53c0fbb10 con 0x7fb53c0f5510 2021-04-09T18:31:51.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.373 7fb54314e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb53c1c3db0 con 0x7fb53c1c8000 2021-04-09T18:31:51.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.373 7fb54314e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb53c0e9f20 con 0x7fb53c0e9ad0 2021-04-09T18:31:51.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.373 7fb5416f3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb53c1c8000 0x7fb53c1ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:51.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.373 7fb5416f3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb53c1c8000 0x7fb53c1ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59204/0 (socket says 172.21.15.79:59204) 2021-04-09T18:31:51.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.373 7fb5416f3700 1 -- 172.21.15.79:0/971061314 learned_addr learned my addr 172.21.15.79:0/971061314 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:51.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.373 7fb540ef2700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb53c0f5510 0x7fb53c0f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53910/0 (socket says 172.21.15.79:53910) 2021-04-09T18:31:51.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.373 7fb53bfff700 1 --2- 172.21.15.79:0/971061314 >> v2:172.21.15.89:3300/0 conn(0x7fb53c0e9ad0 0x7fb53c09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:51.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.373 7fb5416f3700 1 -- 172.21.15.79:0/971061314 >> v2:172.21.15.89:3300/0 conn(0x7fb53c0e9ad0 msgr2=0x7fb53c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:51.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.373 7fb5416f3700 1 --2- 172.21.15.79:0/971061314 >> v2:172.21.15.89:3300/0 conn(0x7fb53c0e9ad0 0x7fb53c09f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.377 7fb5416f3700 1 -- 172.21.15.79:0/971061314 >> v1:172.21.15.79:6789/0 conn(0x7fb53c0f5510 legacy=0x7fb53c0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:51.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.377 7fb53b7fe700 1 -- 172.21.15.79:0/971061314 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894504088 0 0) 0x7fb52c0010d0 con 0x7fb53c0f5510 2021-04-09T18:31:51.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.377 7fb5416f3700 1 -- 172.21.15.79:0/971061314 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c0e56c0 con 0x7fb53c1c8000 2021-04-09T18:31:51.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.377 7fb5416f3700 1 --2- 172.21.15.79:0/971061314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb53c1c8000 0x7fb53c1ca460 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fb5340032b0 tx=0x7fb53400b3c0).ready entity=mon.0 client_cookie=2ceba73112ad188a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:51.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.377 7fb53b7fe700 1 -- 172.21.15.79:0/971061314 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb53c0e56c0 con 0x7fb53c1c8000 2021-04-09T18:31:51.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.377 7fb53b7fe700 1 -- 172.21.15.79:0/971061314 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53400bc20 con 0x7fb53c1c8000 2021-04-09T18:31:51.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.377 7fb53b7fe700 1 -- 172.21.15.79:0/971061314 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb534002020 con 0x7fb53c1c8000 2021-04-09T18:31:51.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.377 7fb54314e700 1 -- 172.21.15.79:0/971061314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb53c1c8000 msgr2=0x7fb53c1ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:51.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.377 7fb54314e700 1 --2- 172.21.15.79:0/971061314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb53c1c8000 0x7fb53c1ca460 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fb5340032b0 tx=0x7fb53400b3c0).stop 2021-04-09T18:31:51.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.377 7fb54314e700 1 -- 172.21.15.79:0/971061314 shutdown_connections 2021-04-09T18:31:51.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.377 7fb54314e700 1 --2- 172.21.15.79:0/971061314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb53c1c8000 0x7fb53c1ca460 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.377 7fb54314e700 1 --2- 172.21.15.79:0/971061314 >> v2:172.21.15.89:3300/0 conn(0x7fb53c0e9ad0 0x7fb53c09f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.377 7fb54314e700 1 -- 172.21.15.79:0/971061314 >> 172.21.15.79:0/971061314 conn(0x7fb53c0e5fd0 msgr2=0x7fb53c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:51.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.377 7fb54314e700 1 -- 172.21.15.79:0/971061314 shutdown_connections 2021-04-09T18:31:51.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.377 7fb54314e700 1 -- 172.21.15.79:0/971061314 wait complete. 2021-04-09T18:31:51.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb54314e700 1 Processor -- start 2021-04-09T18:31:51.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb54314e700 1 -- start start 2021-04-09T18:31:51.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb54314e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb53c0a94b0 0x7fb53c0bd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:51.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb54314e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb53c09a340 0x7fb53c09a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:51.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb54314e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb53c0cfe10 0x7fb53c0d0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:51.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb54314e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0bba90 con 0x7fb53c0cfe10 2021-04-09T18:31:51.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb54314e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0bbd90 con 0x7fb53c0a94b0 2021-04-09T18:31:51.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb54314e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c1a75a0 con 0x7fb53c09a340 2021-04-09T18:31:51.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb5416f3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb53c0cfe10 0x7fb53c0d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:51.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb5416f3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb53c0cfe10 0x7fb53c0d0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59210/0 (socket says 172.21.15.79:59210) 2021-04-09T18:31:51.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb5416f3700 1 -- 172.21.15.79:0/2749846399 learned_addr learned my addr 172.21.15.79:0/2749846399 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:51.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb540ef2700 1 --2- 172.21.15.79:0/2749846399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb53c0a94b0 0x7fb53c0bd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:51.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb53bfff700 1 --2- 172.21.15.79:0/2749846399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb53c09a340 0x7fb53c09a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:51.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb5416f3700 1 -- 172.21.15.79:0/2749846399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb53c09a340 msgr2=0x7fb53c09a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:51.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb5416f3700 1 --2- 172.21.15.79:0/2749846399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb53c09a340 0x7fb53c09a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb5416f3700 1 -- 172.21.15.79:0/2749846399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb53c0a94b0 msgr2=0x7fb53c0bd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:51.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb5416f3700 1 --2- 172.21.15.79:0/2749846399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb53c0a94b0 0x7fb53c0bd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb5416f3700 1 -- 172.21.15.79:0/2749846399 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c0b6160 con 0x7fb53c0cfe10 2021-04-09T18:31:51.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb540ef2700 1 --2- 172.21.15.79:0/2749846399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb53c0a94b0 0x7fb53c0bd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:51.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb5416f3700 1 --2- 172.21.15.79:0/2749846399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb53c0cfe10 0x7fb53c0d0260 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fb53c0874c0 tx=0x7fb534006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:51.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb5397fa700 1 -- 172.21.15.79:0/2749846399 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb53c0b6160 con 0x7fb53c0cfe10 2021-04-09T18:31:51.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb5397fa700 1 -- 172.21.15.79:0/2749846399 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53401a5d0 con 0x7fb53c0cfe10 2021-04-09T18:31:51.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb5397fa700 1 -- 172.21.15.79:0/2749846399 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb534020020 con 0x7fb53c0cfe10 2021-04-09T18:31:51.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb54314e700 1 -- 172.21.15.79:0/2749846399 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53c09afa0 con 0x7fb53c0cfe10 2021-04-09T18:31:51.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.381 7fb54314e700 1 -- 172.21.15.79:0/2749846399 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53c091fc0 con 0x7fb53c0cfe10 2021-04-09T18:31:51.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.385 7fb5397fa700 1 -- 172.21.15.79:0/2749846399 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb534019040 con 0x7fb53c0cfe10 2021-04-09T18:31:51.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.385 7fb5397fa700 1 --2- 172.21.15.79:0/2749846399 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb51c029100 0x7fb51c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:51.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.385 7fb5397fa700 1 -- 172.21.15.79:0/2749846399 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fb534018040 con 0x7fb53c0cfe10 2021-04-09T18:31:51.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.385 7fb540ef2700 1 --2- 172.21.15.79:0/2749846399 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb51c029100 0x7fb51c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:51.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.385 7fb540ef2700 1 --2- 172.21.15.79:0/2749846399 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb51c029100 0x7fb51c02b650 crc :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:51.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.389 7fb54314e700 1 -- 172.21.15.79:0/2749846399 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53c0d0890 con 0x7fb53c0cfe10 2021-04-09T18:31:51.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.393 7fb5397fa700 1 -- 172.21.15.79:0/2749846399 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb53401a3c0 con 0x7fb53c0cfe10 2021-04-09T18:31:51.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.557 7fb54314e700 1 -- 172.21.15.79:0/2749846399 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb53c0e39d0 con 0x7fb53c0cfe10 2021-04-09T18:31:51.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.561 7fb5397fa700 1 -- 172.21.15.79:0/2749846399 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2104 (secure 0 0 0) 0x7fb53400ba10 con 0x7fb53c0cfe10 2021-04-09T18:31:51.565 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 34 2021-04-09T18:31:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:51.566 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5369,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/2729581928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2729581928},{"type":"v1","addr":"172.21.15.89:6835","nonce":2729581928}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:31:31.364796","modified":"2021-04-09 18:31:33.376191","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5366},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5366":{"gid":5366,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/4166243574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4166243574},{"type":"v1","addr":"172.21.15.79:6833","nonce":4166243574}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-04-09T18:31:51.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.561 7fb54314e700 1 -- 172.21.15.79:0/2749846399 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb51c029100 msgr2=0x7fb51c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:51.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.561 7fb54314e700 1 --2- 172.21.15.79:0/2749846399 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb51c029100 0x7fb51c02b650 crc :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.561 7fb54314e700 1 -- 172.21.15.79:0/2749846399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb53c0cfe10 msgr2=0x7fb53c0d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:51.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.561 7fb54314e700 1 --2- 172.21.15.79:0/2749846399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb53c0cfe10 0x7fb53c0d0260 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fb53c0874c0 tx=0x7fb534006c10).stop 2021-04-09T18:31:51.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.561 7fb54314e700 1 -- 172.21.15.79:0/2749846399 shutdown_connections 2021-04-09T18:31:51.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.561 7fb54314e700 1 --2- 172.21.15.79:0/2749846399 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb51c029100 0x7fb51c02b650 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.561 7fb54314e700 1 --2- 172.21.15.79:0/2749846399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb53c0a94b0 0x7fb53c0bd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.561 7fb54314e700 1 --2- 172.21.15.79:0/2749846399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb53c0cfe10 0x7fb53c0d0260 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.561 7fb54314e700 1 --2- 172.21.15.79:0/2749846399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb53c09a340 0x7fb53c09a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.561 7fb54314e700 1 -- 172.21.15.79:0/2749846399 >> 172.21.15.79:0/2749846399 conn(0x7fb53c0942a0 msgr2=0x7fb53c0936b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:51.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.561 7fb54314e700 1 -- 172.21.15.79:0/2749846399 shutdown_connections 2021-04-09T18:31:51.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.561 7fb54314e700 1 -- 172.21.15.79:0/2749846399 wait complete. 2021-04-09T18:31:51.577 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config set mds_recall_max_decay_threshold 400 2021-04-09T18:31:51.661 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:31:51.661 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " 2021-04-09T18:31:51.661 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:31:51.667 INFO:tasks.cephfs.filesystem:_json_asok output: { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-04-09T18:31:51.667 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:51.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f2150c8e700 1 Processor -- start 2021-04-09T18:31:51.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f2150c8e700 1 -- start start 2021-04-09T18:31:51.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f2150c8e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f214c0f5510 0x7f214c0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:51.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f2150c8e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f214c1c8000 0x7f214c1ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:51.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f2150c8e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c0fbb10 con 0x7f214c0e9ad0 2021-04-09T18:31:51.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f2150c8e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214c0e9f20 con 0x7f214c1c8000 2021-04-09T18:31:51.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f2150c8e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214c1c3db0 con 0x7f214c0f5510 2021-04-09T18:31:51.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f214a7e6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f214c0f5510 0x7f214c0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:51.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f214afe7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f214c1c8000 0x7f214c1ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:51.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f214a7e6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f214c0f5510 0x7f214c0f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:56214/0 (socket says 172.21.15.79:56214) 2021-04-09T18:31:51.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f214a7e6700 1 -- 172.21.15.79:0/3676859353 learned_addr learned my addr 172.21.15.79:0/3676859353 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:51.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f214a7e6700 1 -- 172.21.15.79:0/3676859353 >> v2:172.21.15.89:3300/0 conn(0x7f214c1c8000 msgr2=0x7f214c1ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:51.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f214a7e6700 1 --2- 172.21.15.79:0/3676859353 >> v2:172.21.15.89:3300/0 conn(0x7f214c1c8000 0x7f214c1ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f214a7e6700 1 -- 172.21.15.79:0/3676859353 >> v1:172.21.15.89:6789/0 conn(0x7f214c0e9ad0 legacy=0x7f214c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:51.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f214a7e6700 1 -- 172.21.15.79:0/3676859353 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c09f900 con 0x7f214c0f5510 2021-04-09T18:31:51.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f214afe7700 1 --2- 172.21.15.79:0/3676859353 >> v2:172.21.15.89:3300/0 conn(0x7f214c1c8000 0x7f214c1ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:51.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f214a7e6700 1 --2- 172.21.15.79:0/3676859353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f214c0f5510 0x7f214c0f64a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f2144002f30 tx=0x7f214400bd20).ready entity=mon.2 client_cookie=a529de2c2acd736 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:51.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f21497e4700 1 -- 172.21.15.79:0/3676859353 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f214c09f900 con 0x7f214c0f5510 2021-04-09T18:31:51.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f21497e4700 1 -- 172.21.15.79:0/3676859353 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2144009980 con 0x7f214c0f5510 2021-04-09T18:31:51.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f21497e4700 1 -- 172.21.15.79:0/3676859353 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2144009d50 con 0x7f214c0f5510 2021-04-09T18:31:51.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f2150c8e700 1 -- 172.21.15.79:0/3676859353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f214c0f5510 msgr2=0x7f214c0f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:51.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.741 7f2150c8e700 1 --2- 172.21.15.79:0/3676859353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f214c0f5510 0x7f214c0f64a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f2144002f30 tx=0x7f214400bd20).stop 2021-04-09T18:31:51.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.745 7f2150c8e700 1 -- 172.21.15.79:0/3676859353 shutdown_connections 2021-04-09T18:31:51.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.745 7f2150c8e700 1 --2- 172.21.15.79:0/3676859353 >> v2:172.21.15.89:3300/0 conn(0x7f214c1c8000 0x7f214c1ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.745 7f2150c8e700 1 --2- 172.21.15.79:0/3676859353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f214c0f5510 0x7f214c0f64a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.745 7f2150c8e700 1 -- 172.21.15.79:0/3676859353 >> 172.21.15.79:0/3676859353 conn(0x7f214c0e5fd0 msgr2=0x7f214c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:51.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.745 7f2150c8e700 1 -- 172.21.15.79:0/3676859353 shutdown_connections 2021-04-09T18:31:51.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.745 7f2150c8e700 1 -- 172.21.15.79:0/3676859353 wait complete. 2021-04-09T18:31:51.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.745 7f2150c8e700 1 Processor -- start 2021-04-09T18:31:51.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.745 7f2150c8e700 1 -- start start 2021-04-09T18:31:51.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.745 7f2150c8e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f214c0b8630 0x7f214c0bd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:51.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.745 7f2150c8e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f214c0bdda0 0x7f214c0d1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:51.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.745 7f2150c8e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f214c0b8a80 0x7f214c0b9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:51.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.745 7f2150c8e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c0bd470 con 0x7f214c0b8630 2021-04-09T18:31:51.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.745 7f2150c8e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c0bd000 con 0x7f214c0b8a80 2021-04-09T18:31:51.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.745 7f2150c8e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214c0d24c0 con 0x7f214c0bdda0 2021-04-09T18:31:51.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.745 7f214a7e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f214c0b8630 0x7f214c0bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:51.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.745 7f214a7e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f214c0b8630 0x7f214c0bd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59222/0 (socket says 172.21.15.79:59222) 2021-04-09T18:31:51.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.745 7f214a7e6700 1 -- 172.21.15.79:0/3769492177 learned_addr learned my addr 172.21.15.79:0/3769492177 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:51.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.745 7f214afe7700 1 --2- 172.21.15.79:0/3769492177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f214c0b8a80 0x7f214c0b9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:51.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.745 7f2149fe5700 1 --2- 172.21.15.79:0/3769492177 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f214c0bdda0 0x7f214c0d1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:51.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.749 7f214a7e6700 1 -- 172.21.15.79:0/3769492177 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f214c0bdda0 msgr2=0x7f214c0d1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:51.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.749 7f214a7e6700 1 --2- 172.21.15.79:0/3769492177 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f214c0bdda0 0x7f214c0d1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.749 7f214a7e6700 1 -- 172.21.15.79:0/3769492177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f214c0b8a80 msgr2=0x7f214c0b9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:51.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.749 7f214a7e6700 1 --2- 172.21.15.79:0/3769492177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f214c0b8a80 0x7f214c0b9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.749 7f214a7e6700 1 -- 172.21.15.79:0/3769492177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c0d26f0 con 0x7f214c0b8630 2021-04-09T18:31:51.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.749 7f214a7e6700 1 --2- 172.21.15.79:0/3769492177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f214c0b8630 0x7f214c0bd770 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f2144002f30 tx=0x7f2144006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:51.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.749 7f2142ffd700 1 -- 172.21.15.79:0/3769492177 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f214c0d26f0 con 0x7f214c0b8630 2021-04-09T18:31:51.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.749 7f2142ffd700 1 -- 172.21.15.79:0/3769492177 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2144011b50 con 0x7f214c0b8630 2021-04-09T18:31:51.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.749 7f2150c8e700 1 -- 172.21.15.79:0/3769492177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214c0b9630 con 0x7f214c0b8630 2021-04-09T18:31:51.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.749 7f2142ffd700 1 -- 172.21.15.79:0/3769492177 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f214401d440 con 0x7f214c0b8630 2021-04-09T18:31:51.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.749 7f2150c8e700 1 -- 172.21.15.79:0/3769492177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c0b9a80 con 0x7f214c0b8630 2021-04-09T18:31:51.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.749 7f2142ffd700 1 -- 172.21.15.79:0/3769492177 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2144026450 con 0x7f214c0b8630 2021-04-09T18:31:51.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.749 7f2142ffd700 1 --2- 172.21.15.79:0/3769492177 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2130029100 0x7f213002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:51.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.749 7f2142ffd700 1 -- 172.21.15.79:0/3769492177 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f214403af30 con 0x7f214c0b8630 2021-04-09T18:31:51.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.749 7f2149fe5700 1 --2- 172.21.15.79:0/3769492177 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2130029100 0x7f213002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:51.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.749 7f2149fe5700 1 --2- 172.21.15.79:0/3769492177 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2130029100 0x7f213002b650 crc :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:51.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.757 7f2150c8e700 1 -- 172.21.15.79:0/3769492177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214c0e39d0 con 0x7f214c0b8630 2021-04-09T18:31:51.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.765 7f2142ffd700 1 -- 172.21.15.79:0/3769492177 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2144011940 con 0x7f214c0b8630 2021-04-09T18:31:51.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.941 7f2150c8e700 1 -- 172.21.15.79:0/3769492177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f214c0f5b10 con 0x7f214c0b8630 2021-04-09T18:31:51.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.941 7f2142ffd700 1 -- 172.21.15.79:0/3769492177 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2104 (secure 0 0 0) 0x7f2144009770 con 0x7f214c0b8630 2021-04-09T18:31:51.949 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 34 2021-04-09T18:31:51.950 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:31:51.950 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5369,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/2729581928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2729581928},{"type":"v1","addr":"172.21.15.89:6835","nonce":2729581928}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:31:31.364796","modified":"2021-04-09 18:31:33.376191","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5366},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5366":{"gid":5366,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/4166243574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4166243574},{"type":"v1","addr":"172.21.15.79:6833","nonce":4166243574}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-04-09T18:31:51.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.945 7f2150c8e700 1 -- 172.21.15.79:0/3769492177 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2130029100 msgr2=0x7f213002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:51.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.945 7f2150c8e700 1 --2- 172.21.15.79:0/3769492177 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2130029100 0x7f213002b650 crc :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.945 7f2150c8e700 1 -- 172.21.15.79:0/3769492177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f214c0b8630 msgr2=0x7f214c0bd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:51.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.945 7f2150c8e700 1 --2- 172.21.15.79:0/3769492177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f214c0b8630 0x7f214c0bd770 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f2144002f30 tx=0x7f2144006890).stop 2021-04-09T18:31:51.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.945 7f2150c8e700 1 -- 172.21.15.79:0/3769492177 shutdown_connections 2021-04-09T18:31:51.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.945 7f2150c8e700 1 --2- 172.21.15.79:0/3769492177 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2130029100 0x7f213002b650 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.945 7f2150c8e700 1 --2- 172.21.15.79:0/3769492177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f214c0b8a80 0x7f214c0b9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.945 7f2150c8e700 1 --2- 172.21.15.79:0/3769492177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f214c0b8630 0x7f214c0bd770 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.945 7f2150c8e700 1 --2- 172.21.15.79:0/3769492177 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f214c0bdda0 0x7f214c0d1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:51.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.945 7f2150c8e700 1 -- 172.21.15.79:0/3769492177 >> 172.21.15.79:0/3769492177 conn(0x7f214c092c00 msgr2=0x7f214c0d3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:51.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.945 7f2150c8e700 1 -- 172.21.15.79:0/3769492177 shutdown_connections 2021-04-09T18:31:51.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:51.945 7f2150c8e700 1 -- 172.21.15.79:0/3769492177 wait complete. 2021-04-09T18:31:51.962 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 10 2021-04-09T18:31:52.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.045 7fba6e6b4700 1 Processor -- start 2021-04-09T18:31:52.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.045 7fba6e6b4700 1 -- start start 2021-04-09T18:31:52.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.045 7fba6e6b4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fba680f5550 0x7fba680f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.045 7fba6e6b4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fba681c8040 0x7fba681ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.045 7fba6e6b4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba680fbb50 con 0x7fba680e9b10 2021-04-09T18:31:52.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.045 7fba6e6b4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba680e9f60 con 0x7fba681c8040 2021-04-09T18:31:52.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.045 7fba6e6b4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba681c3df0 con 0x7fba680f5550 2021-04-09T18:31:52.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.045 7fba6cc59700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fba681c8040 0x7fba681ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.045 7fba6cc59700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fba681c8040 0x7fba681ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59228/0 (socket says 172.21.15.79:59228) 2021-04-09T18:31:52.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.045 7fba6cc59700 1 -- 172.21.15.79:0/4026581495 learned_addr learned my addr 172.21.15.79:0/4026581495 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:52.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.045 7fba67fff700 1 --2- 172.21.15.79:0/4026581495 >> v2:172.21.15.89:3300/0 conn(0x7fba680f5550 0x7fba680f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.045 7fba6cc59700 1 -- 172.21.15.79:0/4026581495 >> v2:172.21.15.89:3300/0 conn(0x7fba680f5550 msgr2=0x7fba680f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:52.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.045 7fba6cc59700 1 --2- 172.21.15.79:0/4026581495 >> v2:172.21.15.89:3300/0 conn(0x7fba680f5550 0x7fba680f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.045 7fba6cc59700 1 -- 172.21.15.79:0/4026581495 >> v1:172.21.15.89:6789/0 conn(0x7fba680e9b10 legacy=0x7fba6809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:52.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.045 7fba6cc59700 1 -- 172.21.15.79:0/4026581495 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6809f910 con 0x7fba681c8040 2021-04-09T18:31:52.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.045 7fba6cc59700 1 --2- 172.21.15.79:0/4026581495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba681c8040 0x7fba681ca4a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fba60002f30 tx=0x7fba6000bd70).ready entity=mon.0 client_cookie=3ab3203d214789ca server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:52.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba66ffd700 1 -- 172.21.15.79:0/4026581495 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba6809f910 con 0x7fba681c8040 2021-04-09T18:31:52.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba66ffd700 1 -- 172.21.15.79:0/4026581495 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba60009950 con 0x7fba681c8040 2021-04-09T18:31:52.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba66ffd700 1 -- 172.21.15.79:0/4026581495 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba60009d20 con 0x7fba681c8040 2021-04-09T18:31:52.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba6e6b4700 1 -- 172.21.15.79:0/4026581495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba681c8040 msgr2=0x7fba681ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:52.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba6e6b4700 1 --2- 172.21.15.79:0/4026581495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba681c8040 0x7fba681ca4a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fba60002f30 tx=0x7fba6000bd70).stop 2021-04-09T18:31:52.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba6e6b4700 1 -- 172.21.15.79:0/4026581495 shutdown_connections 2021-04-09T18:31:52.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba6e6b4700 1 --2- 172.21.15.79:0/4026581495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba681c8040 0x7fba681ca4a0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba6e6b4700 1 --2- 172.21.15.79:0/4026581495 >> v2:172.21.15.89:3300/0 conn(0x7fba680f5550 0x7fba680f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba6e6b4700 1 -- 172.21.15.79:0/4026581495 >> 172.21.15.79:0/4026581495 conn(0x7fba680e6010 msgr2=0x7fba680e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:52.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba6e6b4700 1 -- 172.21.15.79:0/4026581495 shutdown_connections 2021-04-09T18:31:52.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba6e6b4700 1 -- 172.21.15.79:0/4026581495 wait complete. 2021-04-09T18:31:52.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba6e6b4700 1 Processor -- start 2021-04-09T18:31:52.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba6e6b4700 1 -- start start 2021-04-09T18:31:52.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba6e6b4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba680b87f0 0x7fba680b7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba6e6b4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba680d1970 0x7fba680d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba6e6b4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba681a85f0 0x7fba681a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba6e6b4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba68047500 con 0x7fba680d1970 2021-04-09T18:31:52.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba6e6b4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba680a7ed0 con 0x7fba681a85f0 2021-04-09T18:31:52.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba6e6b4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba680a81d0 con 0x7fba680b87f0 2021-04-09T18:31:52.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba677fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba680d1970 0x7fba680d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba677fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba680d1970 0x7fba680d1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59234/0 (socket says 172.21.15.79:59234) 2021-04-09T18:31:52.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba677fe700 1 -- 172.21.15.79:0/1828823457 learned_addr learned my addr 172.21.15.79:0/1828823457 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:52.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.049 7fba6cc59700 1 --2- 172.21.15.79:0/1828823457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba681a85f0 0x7fba681a8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.053 7fba67fff700 1 --2- 172.21.15.79:0/1828823457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba680b87f0 0x7fba680b7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.053 7fba677fe700 1 -- 172.21.15.79:0/1828823457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba680b87f0 msgr2=0x7fba680b7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:52.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.053 7fba677fe700 1 --2- 172.21.15.79:0/1828823457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba680b87f0 0x7fba680b7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.053 7fba677fe700 1 -- 172.21.15.79:0/1828823457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba681a85f0 msgr2=0x7fba681a8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:52.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.053 7fba677fe700 1 --2- 172.21.15.79:0/1828823457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba681a85f0 0x7fba681a8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.053 7fba677fe700 1 -- 172.21.15.79:0/1828823457 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba680b82b0 con 0x7fba680d1970 2021-04-09T18:31:52.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.053 7fba67fff700 1 --2- 172.21.15.79:0/1828823457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba680b87f0 0x7fba680b7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:52.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.053 7fba677fe700 1 --2- 172.21.15.79:0/1828823457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba680d1970 0x7fba680d1dc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fba680d4a50 tx=0x7fba5000cb10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:52.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.053 7fba64ff9700 1 -- 172.21.15.79:0/1828823457 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba680b82b0 con 0x7fba680d1970 2021-04-09T18:31:52.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.053 7fba64ff9700 1 -- 172.21.15.79:0/1828823457 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba50010510 con 0x7fba680d1970 2021-04-09T18:31:52.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.053 7fba64ff9700 1 -- 172.21.15.79:0/1828823457 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba500106f0 con 0x7fba680d1970 2021-04-09T18:31:52.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.053 7fba6e6b4700 1 -- 172.21.15.79:0/1828823457 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba680a79a0 con 0x7fba680d1970 2021-04-09T18:31:52.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.053 7fba6e6b4700 1 -- 172.21.15.79:0/1828823457 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba681a9200 con 0x7fba680d1970 2021-04-09T18:31:52.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.053 7fba64ff9700 1 -- 172.21.15.79:0/1828823457 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fba50019020 con 0x7fba680d1970 2021-04-09T18:31:52.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.053 7fba64ff9700 1 --2- 172.21.15.79:0/1828823457 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fba4c029100 0x7fba4c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.053 7fba64ff9700 1 -- 172.21.15.79:0/1828823457 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fba50038e30 con 0x7fba680d1970 2021-04-09T18:31:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.053 7fba67fff700 1 --2- 172.21.15.79:0/1828823457 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fba4c029100 0x7fba4c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.053 7fba67fff700 1 --2- 172.21.15.79:0/1828823457 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fba4c029100 0x7fba4c02b650 crc :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.061 7fba7d73a740 1 Processor -- start 2021-04-09T18:31:52.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.061 7fba7d73a740 1 -- start start 2021-04-09T18:31:52.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.061 7fba7d73a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564921176cb0 0x564921159280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.061 7fba7d73a740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x564921177100 0x5649211598b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.061 7fba7d73a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56492117b790 0x56492117bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.061 7fba7d73a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564920f7c0a0 con 0x564921176cb0 2021-04-09T18:31:52.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.061 7fba7d73a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649210fec40 con 0x56492117b790 2021-04-09T18:31:52.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.061 7fba7d73a740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x564920f9c140 con 0x564921177100 2021-04-09T18:31:52.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.061 7fba67fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564921176cb0 0x564921159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.061 7fba67fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564921176cb0 0x564921159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59242/0 (socket says 172.21.15.79:59242) 2021-04-09T18:31:52.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.061 7fba67fff700 1 -- 172.21.15.79:0/1786707636 learned_addr learned my addr 172.21.15.79:0/1786707636 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:52.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba677fe700 1 --2- 172.21.15.79:0/1786707636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x564921177100 0x5649211598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba6cc59700 1 --2- 172.21.15.79:0/1786707636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56492117b790 0x56492117bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba67fff700 1 -- 172.21.15.79:0/1786707636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x564921177100 msgr2=0x5649211598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:52.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba67fff700 1 --2- 172.21.15.79:0/1786707636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x564921177100 0x5649211598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba67fff700 1 -- 172.21.15.79:0/1786707636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56492117b790 msgr2=0x56492117bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:52.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba67fff700 1 --2- 172.21.15.79:0/1786707636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56492117b790 0x56492117bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba67fff700 1 -- 172.21.15.79:0/1786707636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56492112d3d0 con 0x564921176cb0 2021-04-09T18:31:52.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba6cc59700 1 --2- 172.21.15.79:0/1786707636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56492117b790 0x56492117bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:52.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba677fe700 1 --2- 172.21.15.79:0/1786707636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x564921177100 0x5649211598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:52.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba67fff700 1 --2- 172.21.15.79:0/1786707636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564921176cb0 0x564921159280 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x5649210fc020 tx=0x7fba58016d20).ready entity=mon.0 client_cookie=cd27ee613c89edf7 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:52.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba6e6b4700 1 -- 172.21.15.79:0/1786707636 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x56492112d3d0 con 0x564921176cb0 2021-04-09T18:31:52.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba6e6b4700 1 -- 172.21.15.79:0/1786707636 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba58014b60 con 0x564921176cb0 2021-04-09T18:31:52.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba6e6b4700 1 -- 172.21.15.79:0/1786707636 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba58017440 con 0x564921176cb0 2021-04-09T18:31:52.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba7d73a740 1 -- 172.21.15.79:0/1786707636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564921176cb0 msgr2=0x564921159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:52.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba7d73a740 1 --2- 172.21.15.79:0/1786707636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564921176cb0 0x564921159280 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x5649210fc020 tx=0x7fba58016d20).stop 2021-04-09T18:31:52.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba7d73a740 1 -- 172.21.15.79:0/1786707636 shutdown_connections 2021-04-09T18:31:52.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba7d73a740 1 --2- 172.21.15.79:0/1786707636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56492117b790 0x56492117bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba7d73a740 1 --2- 172.21.15.79:0/1786707636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564921176cb0 0x564921159280 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba7d73a740 1 --2- 172.21.15.79:0/1786707636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x564921177100 0x5649211598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba7d73a740 1 -- 172.21.15.79:0/1786707636 >> 172.21.15.79:0/1786707636 conn(0x564921134380 msgr2=0x5649211764b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:52.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba7d73a740 1 -- 172.21.15.79:0/1786707636 shutdown_connections 2021-04-09T18:31:52.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba7d73a740 1 -- 172.21.15.79:0/1786707636 wait complete. 2021-04-09T18:31:52.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba7d73a740 1 -- start start 2021-04-09T18:31:52.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba7d73a740 1 Processor -- start 2021-04-09T18:31:52.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba7d73a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564921157b40 0x5649211761a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba7d73a740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x564921157f90 0x564921168c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba7d73a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564921169280 0x564921170a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba7d73a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564920f57680 con 0x564921169280 2021-04-09T18:31:52.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba7d73a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x564920f49270 con 0x564921157b40 2021-04-09T18:31:52.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba7d73a740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x564920f2c390 con 0x564921157f90 2021-04-09T18:31:52.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba7d73a740 10 client.0 ll_register_callbacks cb 0x5649210f82e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-04-09T18:31:52.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba6cc59700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564921169280 0x564921170a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba6cc59700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564921169280 0x564921170a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59250/0 (socket says 172.21.15.79:59250) 2021-04-09T18:31:52.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.065 7fba6cc59700 1 -- 172.21.15.79:0/2984211228 learned_addr learned my addr 172.21.15.79:0/2984211228 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:52.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba677fe700 1 --2- 172.21.15.79:0/2984211228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x564921157f90 0x564921168c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba67fff700 1 --2- 172.21.15.79:0/2984211228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564921157b40 0x5649211761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba6cc59700 1 -- 172.21.15.79:0/2984211228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x564921157f90 msgr2=0x564921168c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:52.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba6cc59700 1 --2- 172.21.15.79:0/2984211228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x564921157f90 0x564921168c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba6cc59700 1 -- 172.21.15.79:0/2984211228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564921157b40 msgr2=0x5649211761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:52.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba6cc59700 1 --2- 172.21.15.79:0/2984211228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564921157b40 0x5649211761a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba6cc59700 1 -- 172.21.15.79:0/2984211228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564921029550 con 0x564921169280 2021-04-09T18:31:52.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba6cc59700 1 --2- 172.21.15.79:0/2984211228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564921169280 0x564921170a90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x56492116f490 tx=0x7fba600116b0).ready entity=mon.0 client_cookie=7ab58c855f64b534 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:52.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba467fc700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2021-04-09T18:31:52.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba467fc700 1 -- 172.21.15.79:0/2984211228 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x564921029550 con 0x564921169280 2021-04-09T18:31:52.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 1 -- 172.21.15.79:0/2984211228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564921034200 con 0x564921169280 2021-04-09T18:31:52.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba467fc700 1 -- 172.21.15.79:0/2984211228 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fba60011a60 con 0x564921169280 2021-04-09T18:31:52.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba467fc700 1 -- 172.21.15.79:0/2984211228 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba60011cd0 con 0x564921169280 2021-04-09T18:31:52.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 10 client.6048 fetch_fsmap learned FSMap version 34 2021-04-09T18:31:52.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 1 -- 172.21.15.79:0/2984211228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x564920f7a430 con 0x564921169280 2021-04-09T18:31:52.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba467fc700 1 -- 172.21.15.79:0/2984211228 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564921034200 con 0x564921169280 2021-04-09T18:31:52.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba467fc700 1 -- 172.21.15.79:0/2984211228 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 34) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fba60011070 con 0x564921169280 2021-04-09T18:31:52.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 10 client.6048 fetch_fsmap finished waiting for FSMap version 34 2021-04-09T18:31:52.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 10 client.6048 resolve_mds: resolved ID 'a' to GID 5366 2021-04-09T18:31:52.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 20 client.6048 populate_metadata read hostname 'smithi079' 2021-04-09T18:31:52.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 1 --2- 172.21.15.79:0/2984211228 >> [v2:172.21.15.79:6832/4166243574,v1:172.21.15.79:6833/4166243574] conn(0x564921171590 0x5649211719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 4 client.6048 mds_command: new command op to 5366 tid=0[{"prefix": "get_command_descriptions"}] 2021-04-09T18:31:52.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 1 -- 172.21.15.79:0/2984211228 --> [v2:172.21.15.79:6832/4166243574,v1:172.21.15.79:6833/4166243574] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564920eb9fd0 con 0x564921171590 2021-04-09T18:31:52.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba67fff700 1 --2- 172.21.15.79:0/2984211228 >> [v2:172.21.15.79:6832/4166243574,v1:172.21.15.79:6833/4166243574] conn(0x564921171590 0x5649211719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba467fc700 10 client.6048 ms_handle_connect on v2:172.21.15.79:6832/4166243574 2021-04-09T18:31:52.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba67fff700 1 --2- 172.21.15.79:0/2984211228 >> [v2:172.21.15.79:6832/4166243574,v1:172.21.15.79:6833/4166243574] conn(0x564921171590 0x5649211719e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b384d458dd11b20f server_cookie=2b45ae6c2a665ee7 in_seq=0 out_seq=0 2021-04-09T18:31:52.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba467fc700 1 -- 172.21.15.79:0/2984211228 <== mds.0 v2:172.21.15.79:6832/4166243574 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3729 (crc 0 0 0) 0x564920eb9fd0 con 0x564921171590 2021-04-09T18:31:52.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba467fc700 10 client.6048 handle_command_reply: tid=0 2021-04-09T18:31:52.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 1 client.6048 shutdown 2021-04-09T18:31:52.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 1 -- 172.21.15.79:0/2984211228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564921169280 msgr2=0x564921170a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:52.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 1 --2- 172.21.15.79:0/2984211228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564921169280 0x564921170a90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x56492116f490 tx=0x7fba600116b0).stop 2021-04-09T18:31:52.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 1 -- 172.21.15.79:0/2984211228 shutdown_connections 2021-04-09T18:31:52.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 1 --2- 172.21.15.79:0/2984211228 >> [v2:172.21.15.79:6832/4166243574,v1:172.21.15.79:6833/4166243574] conn(0x564921171590 0x5649211719e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 1 --2- 172.21.15.79:0/2984211228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564921157b40 0x5649211761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba467fc700 0 client.6048 ms_handle_reset on v2:172.21.15.79:6832/4166243574 2021-04-09T18:31:52.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 1 --2- 172.21.15.79:0/2984211228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564921169280 0x564921170a90 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 1 --2- 172.21.15.79:0/2984211228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x564921157f90 0x564921168c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 1 -- 172.21.15.79:0/2984211228 >> 172.21.15.79:0/2984211228 conn(0x564921137c70 msgr2=0x56492116ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:52.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 1 -- 172.21.15.79:0/2984211228 shutdown_connections 2021-04-09T18:31:52.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 1 -- 172.21.15.79:0/2984211228 wait complete. 2021-04-09T18:31:52.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.069 7fba7d73a740 20 client.6048 trim_cache size 0 max 16384 2021-04-09T18:31:52.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba7d73a740 1 Processor -- start 2021-04-09T18:31:52.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba7d73a740 1 -- start start 2021-04-09T18:31:52.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba7d73a740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649211a9050 0x56492118ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba7d73a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649211a94a0 0x56492118b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba7d73a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649211b18b0 0x5649211b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba7d73a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56492116db30 con 0x5649211a94a0 2021-04-09T18:31:52.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba7d73a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x564921180f70 con 0x5649211b18b0 2021-04-09T18:31:52.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba7d73a740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x564921121c70 con 0x5649211a9050 2021-04-09T18:31:52.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba677fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649211a94a0 0x56492118b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba677fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649211a94a0 0x56492118b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59256/0 (socket says 172.21.15.79:59256) 2021-04-09T18:31:52.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba677fe700 1 -- 172.21.15.79:0/256231788 learned_addr learned my addr 172.21.15.79:0/256231788 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:52.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba6cc59700 1 --2- 172.21.15.79:0/256231788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649211b18b0 0x5649211b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba67fff700 1 --2- 172.21.15.79:0/256231788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649211a9050 0x56492118ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba677fe700 1 -- 172.21.15.79:0/256231788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649211a9050 msgr2=0x56492118ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:52.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba677fe700 1 --2- 172.21.15.79:0/256231788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649211a9050 0x56492118ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba677fe700 1 -- 172.21.15.79:0/256231788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649211b18b0 msgr2=0x5649211b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:52.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba677fe700 1 --2- 172.21.15.79:0/256231788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649211b18b0 0x5649211b1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba677fe700 1 -- 172.21.15.79:0/256231788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56492118b870 con 0x5649211a94a0 2021-04-09T18:31:52.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba6cc59700 1 --2- 172.21.15.79:0/256231788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649211b18b0 0x5649211b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:52.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba677fe700 1 --2- 172.21.15.79:0/256231788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649211a94a0 0x56492118b240 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fba5002a000 tx=0x7fba50002570).ready entity=mon.0 client_cookie=89f6985991402f6e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:52.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba5cff9700 1 -- 172.21.15.79:0/256231788 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x56492118b870 con 0x5649211a94a0 2021-04-09T18:31:52.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba5cff9700 1 -- 172.21.15.79:0/256231788 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba50030040 con 0x5649211a94a0 2021-04-09T18:31:52.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba5cff9700 1 -- 172.21.15.79:0/256231788 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba681a9200 con 0x5649211a94a0 2021-04-09T18:31:52.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba7d73a740 1 -- 172.21.15.79:0/256231788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649211a94a0 msgr2=0x56492118b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:52.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba7d73a740 1 --2- 172.21.15.79:0/256231788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649211a94a0 0x56492118b240 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fba5002a000 tx=0x7fba50002570).stop 2021-04-09T18:31:52.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba7d73a740 1 -- 172.21.15.79:0/256231788 shutdown_connections 2021-04-09T18:31:52.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba7d73a740 1 --2- 172.21.15.79:0/256231788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649211b18b0 0x5649211b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba7d73a740 1 --2- 172.21.15.79:0/256231788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649211a9050 0x56492118ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba7d73a740 1 --2- 172.21.15.79:0/256231788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649211a94a0 0x56492118b240 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba7d73a740 1 -- 172.21.15.79:0/256231788 >> 172.21.15.79:0/256231788 conn(0x564921185e70 msgr2=0x564921184de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:52.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba7d73a740 1 -- 172.21.15.79:0/256231788 shutdown_connections 2021-04-09T18:31:52.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.085 7fba7d73a740 1 -- 172.21.15.79:0/256231788 wait complete. 2021-04-09T18:31:52.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba7d73a740 1 -- start start 2021-04-09T18:31:52.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba7d73a740 1 Processor -- start 2021-04-09T18:31:52.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba7d73a740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56492114d020 0x5649211649a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba7d73a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56492118cac0 0x5649211566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba7d73a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56492118cf10 0x5649211b9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba7d73a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649210cba00 con 0x56492118cf10 2021-04-09T18:31:52.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba7d73a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56492114e510 con 0x56492118cac0 2021-04-09T18:31:52.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba7d73a740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x56492113ea40 con 0x56492114d020 2021-04-09T18:31:52.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba7d73a740 10 client.0 ll_register_callbacks cb 0x7fba680c4db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-04-09T18:31:52.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba6cc59700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56492118cf10 0x5649211b9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba6cc59700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56492118cf10 0x5649211b9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59266/0 (socket says 172.21.15.79:59266) 2021-04-09T18:31:52.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba67fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56492114d020 0x5649211649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba6cc59700 1 -- 172.21.15.79:0/1944504053 learned_addr learned my addr 172.21.15.79:0/1944504053 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:31:52.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba677fe700 1 --2- 172.21.15.79:0/1944504053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56492118cac0 0x5649211566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba6cc59700 1 -- 172.21.15.79:0/1944504053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56492114d020 msgr2=0x5649211649a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:52.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba6cc59700 1 --2- 172.21.15.79:0/1944504053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56492114d020 0x5649211649a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba6cc59700 1 -- 172.21.15.79:0/1944504053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56492118cac0 msgr2=0x5649211566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:52.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba6cc59700 1 --2- 172.21.15.79:0/1944504053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56492118cac0 0x5649211566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba6cc59700 1 -- 172.21.15.79:0/1944504053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56492114d470 con 0x56492118cf10 2021-04-09T18:31:52.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba67fff700 1 --2- 172.21.15.79:0/1944504053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56492114d020 0x5649211649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:52.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba6cc59700 1 --2- 172.21.15.79:0/1944504053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56492118cf10 0x5649211b9190 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x564921125060 tx=0x7fba6000bf40).ready entity=mon.0 client_cookie=bd8fe337ece025d2 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:52.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba477fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2021-04-09T18:31:52.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba477fe700 1 -- 172.21.15.79:0/1944504053 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x56492114d470 con 0x56492118cf10 2021-04-09T18:31:52.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba477fe700 1 -- 172.21.15.79:0/1944504053 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fba60030040 con 0x56492118cf10 2021-04-09T18:31:52.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba7d73a740 1 -- 172.21.15.79:0/1944504053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564920eb9fd0 con 0x56492118cf10 2021-04-09T18:31:52.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba477fe700 1 -- 172.21.15.79:0/1944504053 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba6001f650 con 0x56492118cf10 2021-04-09T18:31:52.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba7d73a740 10 client.6054 fetch_fsmap learned FSMap version 34 2021-04-09T18:31:52.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba7d73a740 1 -- 172.21.15.79:0/1944504053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x564920fb84a0 con 0x56492118cf10 2021-04-09T18:31:52.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba477fe700 1 -- 172.21.15.79:0/1944504053 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564920eb9fd0 con 0x56492118cf10 2021-04-09T18:31:52.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba477fe700 1 -- 172.21.15.79:0/1944504053 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 34) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fba60033450 con 0x56492118cf10 2021-04-09T18:31:52.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba7d73a740 10 client.6054 fetch_fsmap finished waiting for FSMap version 34 2021-04-09T18:31:52.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba7d73a740 10 client.6054 resolve_mds: resolved ID 'a' to GID 5366 2021-04-09T18:31:52.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba7d73a740 20 client.6054 populate_metadata read hostname 'smithi079' 2021-04-09T18:31:52.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba7d73a740 1 --2- 172.21.15.79:0/1944504053 >> [v2:172.21.15.79:6832/4166243574,v1:172.21.15.79:6833/4166243574] conn(0x5649211b97c0 0x5649211b9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba7d73a740 4 client.6054 mds_command: new command op to 5366 tid=0[{"prefix": "cache drop", "timeout": 10}] 2021-04-09T18:31:52.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba7d73a740 1 -- 172.21.15.79:0/1944504053 --> [v2:172.21.15.79:6832/4166243574,v1:172.21.15.79:6833/4166243574] -- command(tid 0: {"prefix": "cache drop", "timeout": 10}) v1 -- 0x564920e7b2e0 con 0x5649211b97c0 2021-04-09T18:31:52.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba67fff700 1 --2- 172.21.15.79:0/1944504053 >> [v2:172.21.15.79:6832/4166243574,v1:172.21.15.79:6833/4166243574] conn(0x5649211b97c0 0x5649211b9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba477fe700 10 client.6054 ms_handle_connect on v2:172.21.15.79:6832/4166243574 2021-04-09T18:31:52.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:31:52.089 7fba67fff700 1 --2- 172.21.15.79:0/1944504053 >> [v2:172.21.15.79:6832/4166243574,v1:172.21.15.79:6833/4166243574] conn(0x5649211b97c0 0x5649211b9c10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6a19c629dbdc7b38 server_cookie=efdf713e2d8d3e1b in_seq=0 out_seq=0 2021-04-09T18:32:02.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba477fe700 1 -- 172.21.15.79:0/1944504053 <== mds.0 v2:172.21.15.79:6832/4166243574 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+406 (crc 0 0 0) 0x564920e7b2e0 con 0x5649211b97c0 2021-04-09T18:32:02.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba477fe700 10 client.6054 handle_command_reply: tid=0 2021-04-09T18:32:02.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba7d73a740 1 client.6054 shutdown 2021-04-09T18:32:02.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba7d73a740 1 -- 172.21.15.79:0/1944504053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56492118cf10 msgr2=0x5649211b9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:02.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba7d73a740 1 --2- 172.21.15.79:0/1944504053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56492118cf10 0x5649211b9190 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x564921125060 tx=0x7fba6000bf40).stop 2021-04-09T18:32:02.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba7d73a740 1 -- 172.21.15.79:0/1944504053 shutdown_connections 2021-04-09T18:32:02.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba7d73a740 1 --2- 172.21.15.79:0/1944504053 >> [v2:172.21.15.79:6832/4166243574,v1:172.21.15.79:6833/4166243574] conn(0x5649211b97c0 0x5649211b9c10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba7d73a740 1 --2- 172.21.15.79:0/1944504053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56492118cf10 0x5649211b9190 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba7d73a740 1 --2- 172.21.15.79:0/1944504053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56492114d020 0x5649211649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba7d73a740 1 --2- 172.21.15.79:0/1944504053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56492118cac0 0x5649211566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba477fe700 0 client.6054 ms_handle_reset on v2:172.21.15.79:6832/4166243574 2021-04-09T18:32:02.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba7d73a740 1 -- 172.21.15.79:0/1944504053 >> 172.21.15.79:0/1944504053 conn(0x56492116ed60 msgr2=0x5649211a7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:02.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba7d73a740 1 -- 172.21.15.79:0/1944504053 shutdown_connections 2021-04-09T18:32:02.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba7d73a740 1 -- 172.21.15.79:0/1944504053 wait complete. 2021-04-09T18:32:02.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba7d73a740 20 client.6054 trim_cache size 0 max 16384 2021-04-09T18:32:02.325 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:32:02.325 INFO:teuthology.orchestra.run.smithi079.stdout: "client_recall": { 2021-04-09T18:32:02.325 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": -110, 2021-04-09T18:32:02.325 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "(110) Connection timed out", 2021-04-09T18:32:02.325 INFO:teuthology.orchestra.run.smithi079.stdout: "recalled": 240 2021-04-09T18:32:02.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:02.326 INFO:teuthology.orchestra.run.smithi079.stdout: "flush_journal": { 2021-04-09T18:32:02.326 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2021-04-09T18:32:02.326 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "" 2021-04-09T18:32:02.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:02.327 INFO:teuthology.orchestra.run.smithi079.stdout: "trim_cache": { 2021-04-09T18:32:02.327 INFO:teuthology.orchestra.run.smithi079.stdout: "trimmed": 220 2021-04-09T18:32:02.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:02.327 INFO:teuthology.orchestra.run.smithi079.stdout: "cache": { 2021-04-09T18:32:02.328 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": { 2021-04-09T18:32:02.328 INFO:teuthology.orchestra.run.smithi079.stdout: "items": 15418, 2021-04-09T18:32:02.328 INFO:teuthology.orchestra.run.smithi079.stdout: "bytes": 2304928 2021-04-09T18:32:02.328 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:02.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:02.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 10.223055480999999 2021-04-09T18:32:02.329 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:32:02.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba6e6b4700 1 -- 172.21.15.79:0/1828823457 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fba4c029100 msgr2=0x7fba4c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:02.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba6e6b4700 1 --2- 172.21.15.79:0/1828823457 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fba4c029100 0x7fba4c02b650 crc :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba6e6b4700 1 -- 172.21.15.79:0/1828823457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba680d1970 msgr2=0x7fba680d1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:02.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba6e6b4700 1 --2- 172.21.15.79:0/1828823457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba680d1970 0x7fba680d1dc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fba680d4a50 tx=0x7fba5000cb10).stop 2021-04-09T18:32:02.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba6e6b4700 1 -- 172.21.15.79:0/1828823457 shutdown_connections 2021-04-09T18:32:02.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba6e6b4700 1 --2- 172.21.15.79:0/1828823457 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fba4c029100 0x7fba4c02b650 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba6e6b4700 1 --2- 172.21.15.79:0/1828823457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba681a85f0 0x7fba681a8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba6e6b4700 1 --2- 172.21.15.79:0/1828823457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba680b87f0 0x7fba680b7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba6e6b4700 1 --2- 172.21.15.79:0/1828823457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba680d1970 0x7fba680d1dc0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.317 7fba6e6b4700 1 -- 172.21.15.79:0/1828823457 >> 172.21.15.79:0/1828823457 conn(0x7fba6809b240 msgr2=0x7fba680d39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:02.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.321 7fba6e6b4700 1 -- 172.21.15.79:0/1828823457 shutdown_connections 2021-04-09T18:32:02.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.321 7fba6e6b4700 1 -- 172.21.15.79:0/1828823457 wait complete. 2021-04-09T18:32:02.334 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:32:02.334 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:32:02.345 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:32:02.363 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:32:02.381 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:32:02.400 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:32:02.419 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:32:02.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:02.420 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:32:02.420 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:32:02.430 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:32:02.432 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:32:02.432 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi090.front.sepia.ceph.com... 2021-04-09T18:32:02.433 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:32:02.433 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:32:02.508 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13519]: fuse finished with error 0 and tester_r 0 2021-04-09T18:32:02.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:02.510 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:32:02.511 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:32:02.557 INFO:teuthology.orchestra.run.smithi090.stdout:ext2/ext3 2021-04-09T18:32:02.559 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:32:02.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:32:02.608 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:32:02.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:02.615 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:32:02.615 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:32:02.622 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-04-09T18:32:02.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:32:02.624 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-04-09T18:32:02.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:32:02.625 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:32:02.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:02.673 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:32:02.673 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:32:02.680 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:32:02.681 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:32:02.682 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:32:02.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:32:02.683 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:32:02.729 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:32:02.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b1426f700 1 Processor -- start 2021-04-09T18:32:02.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b1426f700 1 -- start start 2021-04-09T18:32:02.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b1426f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5b0c0f5510 0x7f5b0c0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:02.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b1426f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5b0c1c8000 0x7f5b0c1ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:02.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b1426f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0c0fbb10 con 0x7f5b0c0e9ad0 2021-04-09T18:32:02.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b1426f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0c0e9f20 con 0x7f5b0c1c8000 2021-04-09T18:32:02.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b1426f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0c1c3db0 con 0x7f5b0c0f5510 2021-04-09T18:32:02.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b12814700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5b0c1c8000 0x7f5b0c1ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:02.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b11812700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5b0c0e9ad0 0x7f5b0c09f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53984/0 (socket says 172.21.15.79:53984) 2021-04-09T18:32:02.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b11812700 1 -- 172.21.15.79:0/1647984116 learned_addr learned my addr 172.21.15.79:0/1647984116 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:02.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b12013700 1 --2- 172.21.15.79:0/1647984116 >> v2:172.21.15.89:3300/0 conn(0x7f5b0c0f5510 0x7f5b0c0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:02.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b12814700 1 -- 172.21.15.79:0/1647984116 >> v2:172.21.15.89:3300/0 conn(0x7f5b0c0f5510 msgr2=0x7f5b0c0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:02.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b12814700 1 --2- 172.21.15.79:0/1647984116 >> v2:172.21.15.89:3300/0 conn(0x7f5b0c0f5510 0x7f5b0c0f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b12814700 1 -- 172.21.15.79:0/1647984116 >> v1:172.21.15.79:6789/0 conn(0x7f5b0c0e9ad0 legacy=0x7f5b0c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:02.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b11011700 1 -- 172.21.15.79:0/1647984116 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191626832 0 0) 0x7f5afc0010d0 con 0x7f5b0c0e9ad0 2021-04-09T18:32:02.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b12814700 1 -- 172.21.15.79:0/1647984116 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c09f900 con 0x7f5b0c1c8000 2021-04-09T18:32:02.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b12814700 1 --2- 172.21.15.79:0/1647984116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c1c8000 0x7f5b0c1ca460 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f5b040032b0 tx=0x7f5b0400b3c0).ready entity=mon.0 client_cookie=81caeb205afba7ed server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:02.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b11011700 1 -- 172.21.15.79:0/1647984116 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b0c09f900 con 0x7f5b0c1c8000 2021-04-09T18:32:02.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b11011700 1 -- 172.21.15.79:0/1647984116 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0400bc20 con 0x7f5b0c1c8000 2021-04-09T18:32:02.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b11011700 1 -- 172.21.15.79:0/1647984116 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b04002020 con 0x7f5b0c1c8000 2021-04-09T18:32:02.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b1426f700 1 -- 172.21.15.79:0/1647984116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c1c8000 msgr2=0x7f5b0c1ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:02.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.833 7f5b1426f700 1 --2- 172.21.15.79:0/1647984116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c1c8000 0x7f5b0c1ca460 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f5b040032b0 tx=0x7f5b0400b3c0).stop 2021-04-09T18:32:02.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.837 7f5b1426f700 1 -- 172.21.15.79:0/1647984116 shutdown_connections 2021-04-09T18:32:02.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.837 7f5b1426f700 1 --2- 172.21.15.79:0/1647984116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c1c8000 0x7f5b0c1ca460 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.837 7f5b1426f700 1 --2- 172.21.15.79:0/1647984116 >> v2:172.21.15.89:3300/0 conn(0x7f5b0c0f5510 0x7f5b0c0f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.837 7f5b1426f700 1 -- 172.21.15.79:0/1647984116 >> 172.21.15.79:0/1647984116 conn(0x7f5b0c0e5fd0 msgr2=0x7f5b0c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:02.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.837 7f5b1426f700 1 -- 172.21.15.79:0/1647984116 shutdown_connections 2021-04-09T18:32:02.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.837 7f5b1426f700 1 -- 172.21.15.79:0/1647984116 wait complete. 2021-04-09T18:32:02.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.837 7f5b1426f700 1 Processor -- start 2021-04-09T18:32:02.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.837 7f5b1426f700 1 -- start start 2021-04-09T18:32:02.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.837 7f5b1426f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c094780 0x7f5b0c094bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:02.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.837 7f5b1426f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b0c0b8fa0 0x7f5b0c0b93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:02.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.837 7f5b1426f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b0c0d6770 0x7f5b0c0d6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:02.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.837 7f5b1426f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c09ae80 con 0x7f5b0c094780 2021-04-09T18:32:02.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.837 7f5b1426f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0b9a20 con 0x7f5b0c0d6770 2021-04-09T18:32:02.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.837 7f5b1426f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c09aa10 con 0x7f5b0c0b8fa0 2021-04-09T18:32:02.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b12013700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c094780 0x7f5b0c094bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:02.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b12013700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c094780 0x7f5b0c094bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59278/0 (socket says 172.21.15.79:59278) 2021-04-09T18:32:02.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b12013700 1 -- 172.21.15.79:0/926137483 learned_addr learned my addr 172.21.15.79:0/926137483 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:02.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b12814700 1 --2- 172.21.15.79:0/926137483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b0c0d6770 0x7f5b0c0d6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:02.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b11812700 1 --2- 172.21.15.79:0/926137483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b0c0b8fa0 0x7f5b0c0b93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:02.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b12814700 1 -- 172.21.15.79:0/926137483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b0c0b8fa0 msgr2=0x7f5b0c0b93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:02.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b12814700 1 --2- 172.21.15.79:0/926137483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b0c0b8fa0 0x7f5b0c0b93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b12814700 1 -- 172.21.15.79:0/926137483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c094780 msgr2=0x7f5b0c094bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:02.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b12814700 1 --2- 172.21.15.79:0/926137483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c094780 0x7f5b0c094bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b12814700 1 -- 172.21.15.79:0/926137483 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c09b180 con 0x7f5b0c0d6770 2021-04-09T18:32:02.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b12013700 1 --2- 172.21.15.79:0/926137483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c094780 0x7f5b0c094bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:32:02.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b12814700 1 --2- 172.21.15.79:0/926137483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b0c0d6770 0x7f5b0c0d6bc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f5b040032b0 tx=0x7f5b04006c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:02.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b02ffd700 1 -- 172.21.15.79:0/926137483 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b0c09b180 con 0x7f5b0c0d6770 2021-04-09T18:32:02.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b02ffd700 1 -- 172.21.15.79:0/926137483 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0401f020 con 0x7f5b0c0d6770 2021-04-09T18:32:02.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b1426f700 1 -- 172.21.15.79:0/926137483 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0c0d71f0 con 0x7f5b0c0d6770 2021-04-09T18:32:02.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b02ffd700 1 -- 172.21.15.79:0/926137483 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b0401b830 con 0x7f5b0c0d6770 2021-04-09T18:32:02.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b1426f700 1 -- 172.21.15.79:0/926137483 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0c09a2b0 con 0x7f5b0c0d6770 2021-04-09T18:32:02.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b02ffd700 1 -- 172.21.15.79:0/926137483 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5b0400b0e0 con 0x7f5b0c0d6770 2021-04-09T18:32:02.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b02ffd700 1 --2- 172.21.15.79:0/926137483 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5af4029100 0x7f5af402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:02.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b02ffd700 1 -- 172.21.15.79:0/926137483 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f5b04003020 con 0x7f5b0c0d6770 2021-04-09T18:32:02.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.841 7f5b12013700 1 --2- 172.21.15.79:0/926137483 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5af4029100 0x7f5af402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:02.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.845 7f5b12013700 1 --2- 172.21.15.79:0/926137483 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5af4029100 0x7f5af402b650 crc :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:02.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.845 7f5b1426f700 1 -- 172.21.15.79:0/926137483 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0c0e39d0 con 0x7f5b0c0d6770 2021-04-09T18:32:02.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:02.853 7f5b02ffd700 1 -- 172.21.15.79:0/926137483 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5b0400ba10 con 0x7f5b0c0d6770 2021-04-09T18:32:03.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.021 7f5b1426f700 1 -- 172.21.15.79:0/926137483 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5b0c0f5b10 con 0x7f5b0c0d6770 2021-04-09T18:32:03.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.025 7f5b02ffd700 1 -- 172.21.15.79:0/926137483 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v60) v1 ==== 81+0+30899 (secure 0 0 0) 0x7f5b040388d0 con 0x7f5b0c0d6770 2021-04-09T18:32:03.028 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:32:03.029 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:32:03.029 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 60, 2021-04-09T18:32:03.030 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:32:03.030 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:32:03.030 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:31:31.735141", 2021-04-09T18:32:03.031 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:32:03.031 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:32:03.032 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:32:03.032 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:32:03.033 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:32:03.033 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:32:03.033 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:32:03.034 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:32:03.034 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:32:03.035 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:32:03.035 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:32:03.035 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:32:03.036 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:32:03.036 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:32:03.037 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:32:03.037 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 11, 2021-04-09T18:32:03.038 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:32:03.038 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:32:03.038 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:32:03.039 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:32:03.039 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:32:03.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.040 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:32:03.040 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:32:03.041 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:32:03.041 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:32:03.042 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:32:03.042 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:32:03.042 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:32:03.043 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:32:03.043 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:32:03.044 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:32:03.044 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:32:03.045 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:32:03.045 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:32:03.045 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:32:03.046 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:32:03.046 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:32:03.047 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:32:03.047 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:32:03.047 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:32:03.048 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:32:03.048 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:32:03.049 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:32:03.049 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:32:03.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.050 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:32:03.050 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:32:03.051 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:32:03.051 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:32:03.052 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:32:03.052 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:32:03.052 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:32:03.053 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:32:03.053 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:32:03.054 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:32:03.054 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:32:03.054 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:32:03.055 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:32:03.055 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:32:03.056 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:32:03.056 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:32:03.056 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:32:03.056 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:32:03.057 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:32:03.057 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:32:03.057 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:32:03.057 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:32:03.057 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:32:03.058 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:32:03.058 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:32:03.058 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:32:03.058 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:32:03.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.059 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:32:03.059 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:32:03.059 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:32:03.059 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:32:03.060 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:32:03.060 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:32:03.060 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:32:03.060 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:32:03.060 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:32:03.061 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:32:03.061 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:32:03.061 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:32:03.061 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:32:03.061 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:32:03.062 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.062 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 10, 2021-04-09T18:32:03.062 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2021-04-09T18:32:03.063 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:31:29.577618", 2021-04-09T18:32:03.063 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:32:03.063 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:32:03.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:32:03.064 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:32:03.064 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:32:03.064 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:32:03.064 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:32:03.064 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:32:03.065 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:32:03.065 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:32:03.065 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:32:03.065 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:32:03.065 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:32:03.066 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:32:03.066 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:32:03.066 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:32:03.066 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:32:03.066 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:32:03.067 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:32:03.067 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:32:03.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.067 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "58", 2021-04-09T18:32:03.067 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:32:03.068 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:32:03.068 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:32:03.068 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:32:03.068 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:32:03.069 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:32:03.069 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:32:03.069 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:32:03.069 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:32:03.069 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:32:03.070 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:32:03.070 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:32:03.070 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:32:03.070 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:32:03.070 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:32:03.071 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:32:03.071 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:32:03.071 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:32:03.071 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:32:03.071 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:32:03.072 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:32:03.072 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:32:03.072 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:32:03.072 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:32:03.072 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:32:03.073 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:32:03.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.073 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:32:03.073 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:32:03.074 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:32:03.074 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:32:03.074 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:32:03.074 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:32:03.074 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:32:03.075 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:32:03.075 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:32:03.075 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:32:03.075 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:32:03.075 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2021-04-09T18:32:03.076 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2021-04-09T18:32:03.076 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2021-04-09T18:32:03.076 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2021-04-09T18:32:03.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.076 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:32:03.077 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:32:03.077 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2021-04-09T18:32:03.077 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.077 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.078 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 11, 2021-04-09T18:32:03.078 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2021-04-09T18:32:03.078 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:31:30.395684", 2021-04-09T18:32:03.079 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:32:03.079 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:32:03.079 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:32:03.079 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:32:03.079 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:32:03.080 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:32:03.080 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:32:03.080 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:32:03.080 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:32:03.080 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:32:03.081 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:32:03.081 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:32:03.081 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:32:03.081 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:32:03.081 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:32:03.082 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:32:03.082 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:32:03.082 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:32:03.082 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:32:03.082 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:32:03.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.083 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "59", 2021-04-09T18:32:03.083 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:32:03.083 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:32:03.084 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:32:03.084 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:32:03.084 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:32:03.084 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:32:03.084 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:32:03.085 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:32:03.085 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:32:03.085 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:32:03.085 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:32:03.085 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:32:03.086 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:32:03.086 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:32:03.086 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:32:03.086 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:32:03.086 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:32:03.087 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:32:03.087 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:32:03.087 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:32:03.087 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:32:03.087 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:32:03.088 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:32:03.088 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:32:03.088 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:32:03.088 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:32:03.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.089 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:32:03.089 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:32:03.089 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:32:03.089 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:32:03.090 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:32:03.090 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:32:03.090 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:32:03.090 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:32:03.090 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:32:03.091 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:32:03.091 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:32:03.091 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:32:03.091 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:32:03.091 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:32:03.092 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2021-04-09T18:32:03.092 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.092 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.092 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.093 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:32:03.093 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:32:03.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.093 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:32:03.093 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:32:03.094 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:32:03.094 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:32:03.094 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:32:03.094 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:32:03.094 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:32:03.095 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:32:03.095 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:32:03.095 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 57, 2021-04-09T18:32:03.095 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:32:03.096 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:32:03.096 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:32:03.096 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.096 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.097 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:32:03.097 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:32:03.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.097 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.098 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:32:03.098 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:32:03.098 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.098 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.099 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:32:03.099 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.099 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.099 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:32:03.100 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:32:03.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.100 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.100 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:32:03.101 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:32:03.101 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.101 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.101 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:32:03.102 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.102 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.102 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:32:03.103 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:32:03.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.103 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.103 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:32:03.104 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:32:03.104 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.104 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.104 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:32:03.105 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.105 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.105 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:32:03.105 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:32:03.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.106 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.106 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:32:03.106 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:32:03.107 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.107 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.107 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:32:03.108 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:32:03.108 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:32:03.108 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:32:03.108 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:32:03.108 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:32:03.109 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:32:03.109 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.109 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:32:03.110 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:32:03.110 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:32:03.110 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:32:03.110 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:32:03.111 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:32:03.111 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:32:03.111 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:32:03.111 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:32:03.111 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 57, 2021-04-09T18:32:03.112 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:32:03.112 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:32:03.112 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:32:03.112 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.113 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.113 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:32:03.113 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:32:03.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.114 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.114 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:32:03.114 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:32:03.114 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.114 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.115 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:32:03.115 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.116 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.116 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:32:03.116 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:32:03.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.117 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.117 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:32:03.117 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:32:03.117 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.117 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.118 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:32:03.118 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.118 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.119 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:32:03.119 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:32:03.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.119 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.120 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:32:03.120 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:32:03.120 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.120 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.121 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:32:03.121 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.121 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.121 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:32:03.122 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:32:03.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.122 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.122 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:32:03.123 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:32:03.123 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.123 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.124 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:32:03.124 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:32:03.124 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:32:03.124 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:32:03.124 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:32:03.125 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:32:03.125 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:32:03.125 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.126 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:32:03.126 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:32:03.126 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:32:03.126 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:32:03.126 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:32:03.127 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:32:03.127 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:32:03.127 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:32:03.127 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:32:03.127 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 57, 2021-04-09T18:32:03.128 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:32:03.128 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:32:03.128 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:32:03.128 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.129 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.129 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:32:03.129 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:32:03.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.130 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.130 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:32:03.130 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:32:03.130 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.130 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.131 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:32:03.131 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.132 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.132 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:32:03.132 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:32:03.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.133 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:32:03.133 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:32:03.133 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.133 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.134 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:32:03.134 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.134 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.135 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:32:03.135 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:32:03.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.135 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.136 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:32:03.136 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:32:03.136 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.136 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.137 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:32:03.137 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.137 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.137 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:32:03.138 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:32:03.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.138 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.138 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:32:03.139 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:32:03.139 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.139 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.140 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:32:03.140 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:32:03.140 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:32:03.140 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:32:03.140 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:32:03.141 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:32:03.141 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:32:03.141 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.142 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:32:03.142 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:32:03.142 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:32:03.142 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:32:03.142 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:32:03.143 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:32:03.143 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:32:03.143 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:32:03.143 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:32:03.143 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 47, 2021-04-09T18:32:03.144 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:32:03.144 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:32:03.144 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:32:03.144 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.145 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.145 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:32:03.145 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:32:03.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.146 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.146 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:32:03.146 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:32:03.146 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.146 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.147 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:32:03.147 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.147 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.148 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:32:03.148 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:32:03.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.148 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.149 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:32:03.149 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:32:03.149 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.149 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.150 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:32:03.150 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.150 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.150 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:32:03.151 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:32:03.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.151 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.152 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:32:03.152 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:32:03.152 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.152 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.153 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:32:03.153 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.153 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.153 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:32:03.154 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:32:03.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.154 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.154 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:32:03.155 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:32:03.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.155 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.155 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:32:03.156 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:32:03.156 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:32:03.156 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:32:03.156 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:32:03.156 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:32:03.157 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:32:03.157 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.157 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:32:03.158 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:32:03.158 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:32:03.158 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:32:03.158 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:32:03.158 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:32:03.159 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:32:03.159 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:32:03.159 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:32:03.159 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 56, 2021-04-09T18:32:03.160 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:32:03.160 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:32:03.160 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:32:03.160 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.161 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.161 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:32:03.161 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:32:03.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.162 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.162 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:32:03.162 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:32:03.162 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.162 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.163 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:32:03.163 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.164 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.164 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:32:03.164 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:32:03.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.166 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.166 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:32:03.166 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:32:03.167 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.167 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.168 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:32:03.168 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.169 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.169 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:32:03.170 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:32:03.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.171 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.171 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:32:03.172 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:32:03.172 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.172 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.173 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:32:03.173 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.174 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.174 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:32:03.174 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:32:03.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.175 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.175 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:32:03.175 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:32:03.176 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.176 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.176 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:32:03.176 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:32:03.177 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:32:03.177 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:32:03.177 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:32:03.177 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:32:03.177 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:32:03.178 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.178 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:32:03.178 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:32:03.179 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:32:03.179 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:32:03.179 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:32:03.179 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:32:03.180 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:32:03.180 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:32:03.180 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:32:03.180 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 57, 2021-04-09T18:32:03.181 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:32:03.181 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:32:03.181 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:32:03.181 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.182 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.182 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:32:03.183 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:32:03.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.183 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.184 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:32:03.184 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:32:03.184 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.184 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.185 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:32:03.185 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.185 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.185 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:32:03.186 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:32:03.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.186 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.186 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:32:03.187 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:32:03.187 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.187 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.188 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:32:03.188 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.188 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.189 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:32:03.189 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:32:03.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.190 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.191 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:32:03.191 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:32:03.191 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.191 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.192 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:32:03.192 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.193 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.193 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:32:03.193 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:32:03.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.194 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.194 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:32:03.194 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:32:03.194 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.194 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.195 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:32:03.195 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:32:03.195 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:32:03.195 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:32:03.196 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:32:03.196 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:32:03.196 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:32:03.196 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.197 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:32:03.197 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:32:03.197 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:32:03.198 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:32:03.198 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:32:03.198 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:32:03.198 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:32:03.198 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:32:03.199 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:32:03.199 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 57, 2021-04-09T18:32:03.199 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:32:03.200 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:32:03.200 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:32:03.200 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.200 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.201 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:32:03.201 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:32:03.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.202 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.202 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:32:03.202 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:32:03.203 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.203 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.203 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:32:03.203 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.204 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.204 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:32:03.204 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:32:03.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.205 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.205 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:32:03.205 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:32:03.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.206 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.206 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:32:03.206 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.207 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.207 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:32:03.207 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:32:03.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.208 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.208 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:32:03.208 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:32:03.209 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.209 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.209 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:32:03.210 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.210 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.210 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:32:03.210 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:32:03.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.211 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.211 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:32:03.211 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:32:03.212 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.212 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.212 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:32:03.212 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:32:03.213 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:32:03.213 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:32:03.213 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:32:03.213 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:32:03.213 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:32:03.214 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.214 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:32:03.214 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:32:03.215 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:32:03.215 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:32:03.215 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:32:03.215 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:32:03.215 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:32:03.216 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:32:03.216 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:32:03.216 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 57, 2021-04-09T18:32:03.216 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:32:03.217 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:32:03.217 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:32:03.217 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.217 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.218 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:32:03.218 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:32:03.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.219 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.219 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:32:03.219 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:32:03.219 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.219 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.220 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:32:03.220 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.220 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.221 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:32:03.221 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:32:03.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.221 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.222 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:32:03.222 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:32:03.222 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.222 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.223 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:32:03.223 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.223 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.224 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:32:03.224 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:32:03.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.224 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.225 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:32:03.225 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:32:03.225 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.225 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.226 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:32:03.226 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:03.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.226 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:03.226 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:32:03.227 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:32:03.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.227 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:03.227 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:32:03.228 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:32:03.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.228 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.228 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:32:03.229 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:32:03.229 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:32:03.229 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:32:03.229 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:32:03.229 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:32:03.230 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:32:03.230 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:03.230 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.230 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:32:03.230 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:32:03.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.231 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:32:03.231 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:32:03.231 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:32:03.232 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:32:03.232 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:32:03.232 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:32:03.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.233 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:32:03.233 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:32:03.233 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:32:03.233 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:32:03.233 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:32:03.234 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:32:03.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.234 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:32:03.234 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:32:03.235 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:32:03.235 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:32:03.235 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:32:03.235 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:32:03.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.236 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:32:03.236 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:32:03.236 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:32:03.236 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:32:03.237 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:32:03.237 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:32:03.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.237 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:32:03.238 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:32:03.238 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:32:03.238 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:32:03.238 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:32:03.238 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:32:03.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.239 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:32:03.239 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:32:03.239 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:32:03.240 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:32:03.240 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:32:03.240 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:32:03.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.241 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:32:03.241 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:32:03.241 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:32:03.241 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:32:03.241 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:32:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:32:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:32:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:32:03.243 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:32:03.243 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:32:03.243 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:32:03.243 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:32:03.243 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.244 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:32:03.244 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:32:03.244 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:32:03.244 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:32:03.244 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:32:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": { 2021-04-09T18:32:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6835/3190188639": "2021-04-10 18:31:31.735114", 2021-04-09T18:32:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6834/3190188639": "2021-04-10 18:31:31.735114" 2021-04-09T18:32:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:32:03.246 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:32:03.246 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:32:03.246 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:32:03.246 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:32:03.247 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:32:03.247 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:32:03.247 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:32:03.247 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:32:03.247 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:32:03.248 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:32:03.248 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:32:03.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.248 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:32:03.248 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:32:03.249 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:32:03.249 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:32:03.249 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:32:03.249 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:32:03.249 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:32:03.250 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:03.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:03.250 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:32:03.250 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:32:03.250 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:32:03.251 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:32:03.251 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:32:03.251 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:32:03.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.029 7f5b1426f700 1 -- 172.21.15.79:0/926137483 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5af4029100 msgr2=0x7f5af402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:03.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.029 7f5b1426f700 1 --2- 172.21.15.79:0/926137483 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5af4029100 0x7f5af402b650 crc :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.029 7f5b1426f700 1 -- 172.21.15.79:0/926137483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b0c0d6770 msgr2=0x7f5b0c0d6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:03.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.029 7f5b1426f700 1 --2- 172.21.15.79:0/926137483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b0c0d6770 0x7f5b0c0d6bc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f5b040032b0 tx=0x7f5b04006c10).stop 2021-04-09T18:32:03.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.029 7f5b1426f700 1 -- 172.21.15.79:0/926137483 shutdown_connections 2021-04-09T18:32:03.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.029 7f5b1426f700 1 --2- 172.21.15.79:0/926137483 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5af4029100 0x7f5af402b650 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.029 7f5b1426f700 1 --2- 172.21.15.79:0/926137483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b0c0d6770 0x7f5b0c0d6bc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.029 7f5b1426f700 1 --2- 172.21.15.79:0/926137483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c094780 0x7f5b0c094bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.029 7f5b1426f700 1 --2- 172.21.15.79:0/926137483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b0c0b8fa0 0x7f5b0c0b93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.029 7f5b1426f700 1 -- 172.21.15.79:0/926137483 >> 172.21.15.79:0/926137483 conn(0x7f5b0c0d3bf0 msgr2=0x7f5b0c0d76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.029 7f5b1426f700 1 -- 172.21.15.79:0/926137483 shutdown_connections 2021-04-09T18:32:03.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.029 7f5b1426f700 1 -- 172.21.15.79:0/926137483 wait complete. 2021-04-09T18:32:03.257 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:32:03.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.361 7fafa0355700 1 Processor -- start 2021-04-09T18:32:03.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.361 7fafa0355700 1 -- start start 2021-04-09T18:32:03.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.361 7fafa0355700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf981c9010 0x7faf981cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:03.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.361 7fafa0355700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf980fbb10 con 0x7faf980e9ad0 2021-04-09T18:32:03.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.361 7fafa0355700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf9809f900 con 0x7faf980f5510 2021-04-09T18:32:03.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.361 7fafa0355700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf981c3db0 con 0x7faf981c9010 2021-04-09T18:32:03.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.361 7faf9d8f8700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7faf980e9ad0 0x7faf9809f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53996/0 (socket says 172.21.15.79:53996) 2021-04-09T18:32:03.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.361 7faf9d8f8700 1 -- 172.21.15.79:0/662826856 learned_addr learned my addr 172.21.15.79:0/662826856 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:03.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.361 7faf9e8fa700 1 --2- 172.21.15.79:0/662826856 >> v2:172.21.15.89:3300/0 conn(0x7faf981c9010 0x7faf981cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:03.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.361 7faf9d0f7700 1 -- 172.21.15.79:0/662826856 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810833648 0 0) 0x7faf8c001450 con 0x7faf980e9ad0 2021-04-09T18:32:03.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.361 7faf9d0f7700 1 -- 172.21.15.79:0/662826856 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf84003240 con 0x7faf980e9ad0 2021-04-09T18:32:03.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9d0f7700 1 -- 172.21.15.79:0/662826856 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501533681 0 0) 0x7faf940010d0 con 0x7faf980f5510 2021-04-09T18:32:03.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9d0f7700 1 -- 172.21.15.79:0/662826856 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf84003620 con 0x7faf980f5510 2021-04-09T18:32:03.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9d0f7700 1 -- 172.21.15.79:0/662826856 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3693438175 0 0) 0x7faf8c0019d0 con 0x7faf980e9ad0 2021-04-09T18:32:03.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9d0f7700 1 -- 172.21.15.79:0/662826856 >> v2:172.21.15.89:3300/0 conn(0x7faf981c9010 msgr2=0x7faf981cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:03.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9d0f7700 1 --2- 172.21.15.79:0/662826856 >> v2:172.21.15.89:3300/0 conn(0x7faf981c9010 0x7faf981cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9d0f7700 1 -- 172.21.15.79:0/662826856 >> v1:172.21.15.89:6789/0 conn(0x7faf980f5510 legacy=0x7faf980f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:03.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9d0f7700 1 -- 172.21.15.79:0/662826856 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf980e56c0 con 0x7faf980e9ad0 2021-04-09T18:32:03.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9d0f7700 1 -- 172.21.15.79:0/662826856 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7faf8c001f30 con 0x7faf980e9ad0 2021-04-09T18:32:03.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9d0f7700 1 -- 172.21.15.79:0/662826856 >> v1:172.21.15.79:6789/0 conn(0x7faf980e9ad0 legacy=0x7faf9809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:03.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9d0f7700 1 --2- 172.21.15.79:0/662826856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf84003d10 0x7faf840045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:03.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9d0f7700 1 --2- 172.21.15.79:0/662826856 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf84004bd0 0x7faf840097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:03.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9d0f7700 1 --2- 172.21.15.79:0/662826856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf84005020 0x7faf8400be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:03.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9e0f9700 1 --2- 172.21.15.79:0/662826856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf84003d10 0x7faf840045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:03.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9d0f7700 1 -- 172.21.15.79:0/662826856 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf981c3db0 con 0x7faf84003d10 2021-04-09T18:32:03.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9d0f7700 1 -- 172.21.15.79:0/662826856 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf840505b0 con 0x7faf84005020 2021-04-09T18:32:03.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9d0f7700 1 -- 172.21.15.79:0/662826856 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf840507b0 con 0x7faf84004bd0 2021-04-09T18:32:03.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9d8f8700 1 --2- 172.21.15.79:0/662826856 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf84004bd0 0x7faf840097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:03.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9e8fa700 1 --2- 172.21.15.79:0/662826856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf84005020 0x7faf8400be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:03.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9e0f9700 1 -- 172.21.15.79:0/662826856 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf84004bd0 msgr2=0x7faf840097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:03.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9e0f9700 1 --2- 172.21.15.79:0/662826856 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf84004bd0 0x7faf840097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9e0f9700 1 -- 172.21.15.79:0/662826856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf84005020 msgr2=0x7faf8400be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:03.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9e0f9700 1 --2- 172.21.15.79:0/662826856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf84005020 0x7faf8400be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9e8fa700 1 -- 172.21.15.79:0/662826856 reap_dead start 2021-04-09T18:32:03.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9e0f9700 1 -- 172.21.15.79:0/662826856 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf84050aa0 con 0x7faf84003d10 2021-04-09T18:32:03.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9e0f9700 1 --2- 172.21.15.79:0/662826856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf84003d10 0x7faf840045a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7faf94000fe0 tx=0x7faf9400c0e0).ready entity=mon.0 client_cookie=c7e52d6c0e803f8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:03.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9d0f7700 1 -- 172.21.15.79:0/662826856 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf84050aa0 con 0x7faf84003d10 2021-04-09T18:32:03.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9d0f7700 1 -- 172.21.15.79:0/662826856 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9400c9f0 con 0x7faf84003d10 2021-04-09T18:32:03.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7faf9d0f7700 1 -- 172.21.15.79:0/662826856 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf9400cdc0 con 0x7faf84003d10 2021-04-09T18:32:03.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7fafa0355700 1 -- 172.21.15.79:0/662826856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf84003d10 msgr2=0x7faf840045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:03.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7fafa0355700 1 --2- 172.21.15.79:0/662826856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf84003d10 0x7faf840045a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7faf94000fe0 tx=0x7faf9400c0e0).stop 2021-04-09T18:32:03.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7fafa0355700 1 -- 172.21.15.79:0/662826856 shutdown_connections 2021-04-09T18:32:03.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7fafa0355700 1 --2- 172.21.15.79:0/662826856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf84003d10 0x7faf840045a0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7fafa0355700 1 -- 172.21.15.79:0/662826856 >> 172.21.15.79:0/662826856 conn(0x7faf980e5fd0 msgr2=0x7faf980e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:03.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7fafa0355700 1 -- 172.21.15.79:0/662826856 shutdown_connections 2021-04-09T18:32:03.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.365 7fafa0355700 1 -- 172.21.15.79:0/662826856 wait complete. 2021-04-09T18:32:03.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7fafa0355700 1 Processor -- start 2021-04-09T18:32:03.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7fafa0355700 1 -- start start 2021-04-09T18:32:03.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7fafa0355700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf980a4360 0x7faf980bacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:03.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7fafa0355700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf980ad770 0x7faf980a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:03.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7fafa0355700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf980d52b0 0x7faf980d5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:03.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7fafa0355700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf980e9f20 con 0x7faf980a4360 2021-04-09T18:32:03.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7fafa0355700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf980c44a0 con 0x7faf980d52b0 2021-04-09T18:32:03.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7fafa0355700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf980c47a0 con 0x7faf980ad770 2021-04-09T18:32:03.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7faf9e0f9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf980a4360 0x7faf980bacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:03.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7faf9e0f9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf980a4360 0x7faf980bacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59298/0 (socket says 172.21.15.79:59298) 2021-04-09T18:32:03.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7faf9e0f9700 1 -- 172.21.15.79:0/3384842791 learned_addr learned my addr 172.21.15.79:0/3384842791 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:03.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7faf9e8fa700 1 --2- 172.21.15.79:0/3384842791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf980d52b0 0x7faf980d5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:03.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7faf9d8f8700 1 --2- 172.21.15.79:0/3384842791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf980ad770 0x7faf980a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:03.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7faf9e0f9700 1 -- 172.21.15.79:0/3384842791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf980ad770 msgr2=0x7faf980a3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:03.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7faf9e0f9700 1 --2- 172.21.15.79:0/3384842791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf980ad770 0x7faf980a3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7faf9e0f9700 1 -- 172.21.15.79:0/3384842791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf980d52b0 msgr2=0x7faf980d5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:03.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7faf9e0f9700 1 --2- 172.21.15.79:0/3384842791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf980d52b0 0x7faf980d5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7faf9e0f9700 1 -- 172.21.15.79:0/3384842791 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf980c3d30 con 0x7faf980a4360 2021-04-09T18:32:03.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7faf9e0f9700 1 --2- 172.21.15.79:0/3384842791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf980a4360 0x7faf980bacb0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7faf98096ed0 tx=0x7faf94001640).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:03.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7faf8affd700 1 -- 172.21.15.79:0/3384842791 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf980c3d30 con 0x7faf980a4360 2021-04-09T18:32:03.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7faf8affd700 1 -- 172.21.15.79:0/3384842791 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9401c410 con 0x7faf980a4360 2021-04-09T18:32:03.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7fafa0355700 1 -- 172.21.15.79:0/3384842791 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf980a4030 con 0x7faf980a4360 2021-04-09T18:32:03.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7faf8affd700 1 -- 172.21.15.79:0/3384842791 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf9401c7e0 con 0x7faf980a4360 2021-04-09T18:32:03.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.369 7fafa0355700 1 -- 172.21.15.79:0/3384842791 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf980adbc0 con 0x7faf980a4360 2021-04-09T18:32:03.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.373 7faf8affd700 1 -- 172.21.15.79:0/3384842791 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7faf940253b0 con 0x7faf980a4360 2021-04-09T18:32:03.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.373 7faf8affd700 1 --2- 172.21.15.79:0/3384842791 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf80029100 0x7faf8002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:03.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.373 7faf8affd700 1 -- 172.21.15.79:0/3384842791 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7faf9403ac50 con 0x7faf980a4360 2021-04-09T18:32:03.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.373 7faf9d8f8700 1 --2- 172.21.15.79:0/3384842791 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf80029100 0x7faf8002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:03.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.373 7faf9d8f8700 1 --2- 172.21.15.79:0/3384842791 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf80029100 0x7faf8002b650 crc :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:03.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.377 7fafa0355700 1 -- 172.21.15.79:0/3384842791 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf980bb2e0 con 0x7faf980a4360 2021-04-09T18:32:03.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.385 7faf8affd700 1 -- 172.21.15.79:0/3384842791 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7faf94012aa0 con 0x7faf980a4360 2021-04-09T18:32:03.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.557 7fafa0355700 1 -- 172.21.15.79:0/3384842791 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf980e39d0 con 0x7faf980a4360 2021-04-09T18:32:03.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.557 7faf8affd700 1 -- 172.21.15.79:0/3384842791 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2104 (secure 0 0 0) 0x7faf9400c7e0 con 0x7faf980a4360 2021-04-09T18:32:03.561 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 34 2021-04-09T18:32:03.562 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:32:03.562 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5369,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/2729581928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2729581928},{"type":"v1","addr":"172.21.15.89:6835","nonce":2729581928}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:31:31.364796","modified":"2021-04-09 18:31:33.376191","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5366},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5366":{"gid":5366,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/4166243574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4166243574},{"type":"v1","addr":"172.21.15.79:6833","nonce":4166243574}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-04-09T18:32:03.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.561 7fafa0355700 1 -- 172.21.15.79:0/3384842791 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf80029100 msgr2=0x7faf8002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:03.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.561 7fafa0355700 1 --2- 172.21.15.79:0/3384842791 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf80029100 0x7faf8002b650 crc :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.561 7fafa0355700 1 -- 172.21.15.79:0/3384842791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf980a4360 msgr2=0x7faf980bacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:03.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.561 7fafa0355700 1 --2- 172.21.15.79:0/3384842791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf980a4360 0x7faf980bacb0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7faf98096ed0 tx=0x7faf94001640).stop 2021-04-09T18:32:03.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.561 7fafa0355700 1 -- 172.21.15.79:0/3384842791 shutdown_connections 2021-04-09T18:32:03.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.561 7fafa0355700 1 --2- 172.21.15.79:0/3384842791 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf80029100 0x7faf8002b650 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.561 7fafa0355700 1 --2- 172.21.15.79:0/3384842791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf980d52b0 0x7faf980d5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.561 7fafa0355700 1 --2- 172.21.15.79:0/3384842791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf980a4360 0x7faf980bacb0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.561 7fafa0355700 1 --2- 172.21.15.79:0/3384842791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf980ad770 0x7faf980a3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.561 7fafa0355700 1 -- 172.21.15.79:0/3384842791 >> 172.21.15.79:0/3384842791 conn(0x7faf98096f30 msgr2=0x7faf980a24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:03.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.561 7fafa0355700 1 -- 172.21.15.79:0/3384842791 shutdown_connections 2021-04-09T18:32:03.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.561 7fafa0355700 1 -- 172.21.15.79:0/3384842791 wait complete. 2021-04-09T18:32:03.573 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-04-09T18:32:03.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.664 7f996b7a5700 1 Processor -- start 2021-04-09T18:32:03.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.664 7f996b7a5700 1 -- start start 2021-04-09T18:32:03.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.664 7f996b7a5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99640e9ae0 0x7f996409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:03.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.664 7f996b7a5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f99641c8010 0x7f99641ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:03.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.664 7f996b7a5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99640fbb20 con 0x7f99640f5520 2021-04-09T18:32:03.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.664 7f996b7a5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99641c3dc0 con 0x7f99641c8010 2021-04-09T18:32:03.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.664 7f996b7a5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99640e9f30 con 0x7f99640e9ae0 2021-04-09T18:32:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.664 7f9969d4a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f99641c8010 0x7f99641ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.664 7f9969549700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f99640f5520 0x7f99640f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:54488/0 (socket says 172.21.15.79:54488) 2021-04-09T18:32:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.664 7f9969549700 1 -- 172.21.15.79:0/1438691039 learned_addr learned my addr 172.21.15.79:0/1438691039 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.664 7f9968d48700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99640e9ae0 0x7f996409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.664 7f9969d4a700 1 -- 172.21.15.79:0/1438691039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99640e9ae0 msgr2=0x7f996409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.664 7f9969d4a700 1 --2- 172.21.15.79:0/1438691039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99640e9ae0 0x7f996409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.664 7f9969d4a700 1 -- 172.21.15.79:0/1438691039 >> v1:172.21.15.89:6789/0 conn(0x7f99640f5520 legacy=0x7f99640f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.664 7f9957fff700 1 -- 172.21.15.79:0/1438691039 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032943290 0 0) 0x7f99600010d0 con 0x7f99640f5520 2021-04-09T18:32:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.664 7f9969d4a700 1 -- 172.21.15.79:0/1438691039 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99640e56d0 con 0x7f99641c8010 2021-04-09T18:32:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.664 7f9969d4a700 1 --2- 172.21.15.79:0/1438691039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99641c8010 0x7f99641ca470 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f995c002f30 tx=0x7f995c00bd40).ready entity=mon.1 client_cookie=f05e376b319b8e9f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.668 7f9957fff700 1 -- 172.21.15.79:0/1438691039 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f99640e56d0 con 0x7f99641c8010 2021-04-09T18:32:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.668 7f9957fff700 1 -- 172.21.15.79:0/1438691039 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995c009850 con 0x7f99641c8010 2021-04-09T18:32:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.668 7f9957fff700 1 -- 172.21.15.79:0/1438691039 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f995c009c20 con 0x7f99641c8010 2021-04-09T18:32:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.668 7f996b7a5700 1 -- 172.21.15.79:0/1438691039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99641c8010 msgr2=0x7f99641ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:03.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.668 7f996b7a5700 1 --2- 172.21.15.79:0/1438691039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99641c8010 0x7f99641ca470 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f995c002f30 tx=0x7f995c00bd40).stop 2021-04-09T18:32:03.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.668 7f996b7a5700 1 -- 172.21.15.79:0/1438691039 shutdown_connections 2021-04-09T18:32:03.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.668 7f996b7a5700 1 --2- 172.21.15.79:0/1438691039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99641c8010 0x7f99641ca470 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.668 7f996b7a5700 1 --2- 172.21.15.79:0/1438691039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99640e9ae0 0x7f996409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.668 7f996b7a5700 1 -- 172.21.15.79:0/1438691039 >> 172.21.15.79:0/1438691039 conn(0x7f99640e5fe0 msgr2=0x7f99640e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:03.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.668 7f996b7a5700 1 -- 172.21.15.79:0/1438691039 shutdown_connections 2021-04-09T18:32:03.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.668 7f996b7a5700 1 -- 172.21.15.79:0/1438691039 wait complete. 2021-04-09T18:32:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f996b7a5700 1 Processor -- start 2021-04-09T18:32:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f996b7a5700 1 -- start start 2021-04-09T18:32:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f996b7a5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99640a4e90 0x7f99640a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f996b7a5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99640d6ce0 0x7f9964094b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f996b7a5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99640d5600 0x7f99640cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f996b7a5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99640e8af0 con 0x7f99640d5600 2021-04-09T18:32:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f996b7a5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996409a300 con 0x7f99640a4e90 2021-04-09T18:32:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f996b7a5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996409a600 con 0x7f99640d6ce0 2021-04-09T18:32:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f9969d4a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99640d5600 0x7f99640cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:03.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f9969549700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99640a4e90 0x7f99640a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:03.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f9968d48700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99640d6ce0 0x7f9964094b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:03.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f9969d4a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99640d5600 0x7f99640cf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59316/0 (socket says 172.21.15.79:59316) 2021-04-09T18:32:03.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f9969d4a700 1 -- 172.21.15.79:0/1564704444 learned_addr learned my addr 172.21.15.79:0/1564704444 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:03.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f9969d4a700 1 -- 172.21.15.79:0/1564704444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99640d6ce0 msgr2=0x7f9964094b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:03.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f9969d4a700 1 --2- 172.21.15.79:0/1564704444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99640d6ce0 0x7f9964094b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f9969d4a700 1 -- 172.21.15.79:0/1564704444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99640a4e90 msgr2=0x7f99640a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:03.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f9969d4a700 1 --2- 172.21.15.79:0/1564704444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99640a4e90 0x7f99640a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f9969d4a700 1 -- 172.21.15.79:0/1564704444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99640adbb0 con 0x7f99640d5600 2021-04-09T18:32:03.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f9969d4a700 1 --2- 172.21.15.79:0/1564704444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99640d5600 0x7f99640cf9e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f9964093d10 tx=0x7f995c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:03.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f9955ffb700 1 -- 172.21.15.79:0/1564704444 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f99640adbb0 con 0x7f99640d5600 2021-04-09T18:32:03.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f9955ffb700 1 -- 172.21.15.79:0/1564704444 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995c011c10 con 0x7f99640d5600 2021-04-09T18:32:03.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f996b7a5700 1 -- 172.21.15.79:0/1564704444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9964095190 con 0x7f99640d5600 2021-04-09T18:32:03.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f9955ffb700 1 -- 172.21.15.79:0/1564704444 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f995c01d440 con 0x7f99640d5600 2021-04-09T18:32:03.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.672 7f996b7a5700 1 -- 172.21.15.79:0/1564704444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99640d0010 con 0x7f99640d5600 2021-04-09T18:32:03.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.676 7f9955ffb700 1 -- 172.21.15.79:0/1564704444 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f995c01d640 con 0x7f99640d5600 2021-04-09T18:32:03.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.676 7f9955ffb700 1 --2- 172.21.15.79:0/1564704444 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9944029100 0x7f994402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:03.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.676 7f9955ffb700 1 -- 172.21.15.79:0/1564704444 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f995c03b7e0 con 0x7f99640d5600 2021-04-09T18:32:03.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.676 7f9969549700 1 --2- 172.21.15.79:0/1564704444 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9944029100 0x7f994402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:03.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.676 7f9969549700 1 --2- 172.21.15.79:0/1564704444 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9944029100 0x7f994402b650 crc :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:03.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.680 7f996b7a5700 1 -- 172.21.15.79:0/1564704444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99640e39e0 con 0x7f99640d5600 2021-04-09T18:32:03.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.684 7f9955ffb700 1 -- 172.21.15.79:0/1564704444 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f995c011a00 con 0x7f99640d5600 2021-04-09T18:32:03.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:03.840 7f996b7a5700 1 -- 172.21.15.79:0/1564704444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f99640f5b20 con 0x7f99640d5600 2021-04-09T18:32:04.111 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:32:04.108 7fbcd0516700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:32:04.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.120 7f9955ffb700 1 -- 172.21.15.79:0/1564704444 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) v1 ==== 161+0+0 (secure 0 0 0) 0x7f995c009640 con 0x7f99640d5600 2021-04-09T18:32:04.158 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-04-09T18:32:04.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.156 7f996b7a5700 1 -- 172.21.15.79:0/1564704444 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9944029100 msgr2=0x7f994402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:04.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.156 7f996b7a5700 1 --2- 172.21.15.79:0/1564704444 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9944029100 0x7f994402b650 crc :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:04.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.156 7f996b7a5700 1 -- 172.21.15.79:0/1564704444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99640d5600 msgr2=0x7f99640cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:04.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.156 7f996b7a5700 1 --2- 172.21.15.79:0/1564704444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99640d5600 0x7f99640cf9e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f9964093d10 tx=0x7f995c006890).stop 2021-04-09T18:32:04.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.160 7f996b7a5700 1 -- 172.21.15.79:0/1564704444 shutdown_connections 2021-04-09T18:32:04.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.160 7f996b7a5700 1 --2- 172.21.15.79:0/1564704444 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9944029100 0x7f994402b650 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:04.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.160 7f996b7a5700 1 --2- 172.21.15.79:0/1564704444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99640a4e90 0x7f99640a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:04.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.160 7f996b7a5700 1 --2- 172.21.15.79:0/1564704444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99640d5600 0x7f99640cf9e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:04.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.160 7f996b7a5700 1 --2- 172.21.15.79:0/1564704444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99640d6ce0 0x7f9964094b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:04.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.160 7f996b7a5700 1 -- 172.21.15.79:0/1564704444 >> 172.21.15.79:0/1564704444 conn(0x7f9964093d50 msgr2=0x7f99640d76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:04.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.160 7f996b7a5700 1 -- 172.21.15.79:0/1564704444 shutdown_connections 2021-04-09T18:32:04.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.160 7f996b7a5700 1 -- 172.21.15.79:0/1564704444 wait complete. 2021-04-09T18:32:04.173 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:32:04.175 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2021-04-09T18:32:04.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.260 7f1f5f179700 1 Processor -- start 2021-04-09T18:32:04.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.260 7f1f5f179700 1 -- start start 2021-04-09T18:32:04.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.260 7f1f5f179700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1f581c9020 0x7f1f581cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:04.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.260 7f1f5f179700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f580fbb20 con 0x7f1f580e9ae0 2021-04-09T18:32:04.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.260 7f1f5f179700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5809f910 con 0x7f1f580f5520 2021-04-09T18:32:04.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.260 7f1f5f179700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f581c3dc0 con 0x7f1f581c9020 2021-04-09T18:32:04.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.260 7f1f57fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1f580e9ae0 0x7f1f5809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54046/0 (socket says 172.21.15.79:54046) 2021-04-09T18:32:04.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.260 7f1f57fff700 1 -- 172.21.15.79:0/2139265397 learned_addr learned my addr 172.21.15.79:0/2139265397 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:04.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.260 7f1f5d71e700 1 --2- 172.21.15.79:0/2139265397 >> v2:172.21.15.89:3300/0 conn(0x7f1f581c9020 0x7f1f581cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:04.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.260 7f1f577fe700 1 -- 172.21.15.79:0/2139265397 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920204344 0 0) 0x7f1f480010d0 con 0x7f1f580e9ae0 2021-04-09T18:32:04.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.260 7f1f577fe700 1 -- 172.21.15.79:0/2139265397 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f44003240 con 0x7f1f580e9ae0 2021-04-09T18:32:04.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.264 7f1f5d71e700 1 -- 172.21.15.79:0/2139265397 >> v1:172.21.15.89:6789/0 conn(0x7f1f580f5520 legacy=0x7f1f580f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:04.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.264 7f1f5d71e700 1 -- 172.21.15.79:0/2139265397 >> v1:172.21.15.79:6789/0 conn(0x7f1f580e9ae0 legacy=0x7f1f5809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:04.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.264 7f1f5d71e700 1 -- 172.21.15.79:0/2139265397 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f580e56d0 con 0x7f1f581c9020 2021-04-09T18:32:04.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.264 7f1f5d71e700 1 --2- 172.21.15.79:0/2139265397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f581c9020 0x7f1f581cb480 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f1f500032b0 tx=0x7f1f5000b0e0).ready entity=mon.1 client_cookie=1b1db1b70886615d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:04.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.264 7f1f577fe700 1 -- 172.21.15.79:0/2139265397 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1f580e56d0 con 0x7f1f581c9020 2021-04-09T18:32:04.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.264 7f1f577fe700 1 -- 172.21.15.79:0/2139265397 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5000bb00 con 0x7f1f581c9020 2021-04-09T18:32:04.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.264 7f1f577fe700 1 -- 172.21.15.79:0/2139265397 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1f50002020 con 0x7f1f581c9020 2021-04-09T18:32:04.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.264 7f1f5f179700 1 -- 172.21.15.79:0/2139265397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f581c9020 msgr2=0x7f1f581cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:04.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.264 7f1f5f179700 1 --2- 172.21.15.79:0/2139265397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f581c9020 0x7f1f581cb480 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f1f500032b0 tx=0x7f1f5000b0e0).stop 2021-04-09T18:32:04.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.264 7f1f5f179700 1 -- 172.21.15.79:0/2139265397 shutdown_connections 2021-04-09T18:32:04.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.264 7f1f5f179700 1 --2- 172.21.15.79:0/2139265397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f581c9020 0x7f1f581cb480 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:04.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.264 7f1f5f179700 1 -- 172.21.15.79:0/2139265397 >> 172.21.15.79:0/2139265397 conn(0x7f1f580e5fe0 msgr2=0x7f1f580e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:04.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.264 7f1f5f179700 1 -- 172.21.15.79:0/2139265397 shutdown_connections 2021-04-09T18:32:04.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.264 7f1f5f179700 1 -- 172.21.15.79:0/2139265397 wait complete. 2021-04-09T18:32:04.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f5f179700 1 Processor -- start 2021-04-09T18:32:04.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f5f179700 1 -- start start 2021-04-09T18:32:04.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f5f179700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5819bb00 0x7f1f580bee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:04.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f5f179700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f5819cd50 0x7f1f5819d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:04.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f5f179700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f581ad4a0 0x7f1f581ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:04.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f5f179700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f580e9f30 con 0x7f1f5819bb00 2021-04-09T18:32:04.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f5f179700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5819ca50 con 0x7f1f581ad4a0 2021-04-09T18:32:04.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f5f179700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f581adf20 con 0x7f1f5819cd50 2021-04-09T18:32:04.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f5cf1d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5819bb00 0x7f1f580bee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:04.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f5cf1d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5819bb00 0x7f1f580bee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59338/0 (socket says 172.21.15.79:59338) 2021-04-09T18:32:04.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f5cf1d700 1 -- 172.21.15.79:0/2778961322 learned_addr learned my addr 172.21.15.79:0/2778961322 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:04.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f5d71e700 1 --2- 172.21.15.79:0/2778961322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f581ad4a0 0x7f1f581ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:04.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f57fff700 1 --2- 172.21.15.79:0/2778961322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f5819cd50 0x7f1f5819d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:04.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f5cf1d700 1 -- 172.21.15.79:0/2778961322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f5819cd50 msgr2=0x7f1f5819d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:04.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f5cf1d700 1 --2- 172.21.15.79:0/2778961322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f5819cd50 0x7f1f5819d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:04.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f5cf1d700 1 -- 172.21.15.79:0/2778961322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f581ad4a0 msgr2=0x7f1f581ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:04.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f5cf1d700 1 --2- 172.21.15.79:0/2778961322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f581ad4a0 0x7f1f581ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:04.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f5cf1d700 1 -- 172.21.15.79:0/2778961322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f580bf6f0 con 0x7f1f5819bb00 2021-04-09T18:32:04.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f5cf1d700 1 --2- 172.21.15.79:0/2778961322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5819bb00 0x7f1f580bee50 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f1f5819c9d0 tx=0x7f1f4000cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:04.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f557fa700 1 -- 172.21.15.79:0/2778961322 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1f580bf6f0 con 0x7f1f5819bb00 2021-04-09T18:32:04.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f557fa700 1 -- 172.21.15.79:0/2778961322 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4000e4a0 con 0x7f1f5819bb00 2021-04-09T18:32:04.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f5f179700 1 -- 172.21.15.79:0/2778961322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f580bfa10 con 0x7f1f5819bb00 2021-04-09T18:32:04.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f557fa700 1 -- 172.21.15.79:0/2778961322 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1f4000e870 con 0x7f1f5819bb00 2021-04-09T18:32:04.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.268 7f1f5f179700 1 -- 172.21.15.79:0/2778961322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f580bff70 con 0x7f1f5819bb00 2021-04-09T18:32:04.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.272 7f1f557fa700 1 -- 172.21.15.79:0/2778961322 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1f4001a020 con 0x7f1f5819bb00 2021-04-09T18:32:04.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.272 7f1f557fa700 1 --2- 172.21.15.79:0/2778961322 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1f3c029100 0x7f1f3c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:04.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.272 7f1f557fa700 1 -- 172.21.15.79:0/2778961322 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6096+0+0 (secure 0 0 0) 0x7f1f40039310 con 0x7f1f5819bb00 2021-04-09T18:32:04.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.272 7f1f57fff700 1 --2- 172.21.15.79:0/2778961322 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1f3c029100 0x7f1f3c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:04.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.272 7f1f57fff700 1 --2- 172.21.15.79:0/2778961322 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1f3c029100 0x7f1f3c02b650 crc :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:04.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.276 7f1f5f179700 1 -- 172.21.15.79:0/2778961322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f580e39e0 con 0x7f1f5819bb00 2021-04-09T18:32:04.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.284 7f1f557fa700 1 -- 172.21.15.79:0/2778961322 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1f4000e290 con 0x7f1f5819bb00 2021-04-09T18:32:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.452 7f1f5f179700 1 -- 172.21.15.79:0/2778961322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f580a1cc0 con 0x7f1f5819bb00 2021-04-09T18:32:04.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.456 7f1f557fa700 1 -- 172.21.15.79:0/2778961322 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+1758 (secure 0 0 0) 0x7f1f40000bf0 con 0x7f1f5819bb00 2021-04-09T18:32:04.460 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 35 2021-04-09T18:32:04.460 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:32:04.461 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5369,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/2729581928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2729581928},{"type":"v1","addr":"172.21.15.89:6835","nonce":2729581928}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:31:31.364796","modified":"2021-04-09 18:32:04.110687","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-04-09T18:32:04.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.460 7f1f5f179700 1 -- 172.21.15.79:0/2778961322 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1f3c029100 msgr2=0x7f1f3c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:04.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.460 7f1f5f179700 1 --2- 172.21.15.79:0/2778961322 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1f3c029100 0x7f1f3c02b650 crc :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.460 7f1f5f179700 1 -- 172.21.15.79:0/2778961322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5819bb00 msgr2=0x7f1f580bee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.460 7f1f5f179700 1 --2- 172.21.15.79:0/2778961322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5819bb00 0x7f1f580bee50 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f1f5819c9d0 tx=0x7f1f4000cae0).stop 2021-04-09T18:32:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.460 7f1f5f179700 1 -- 172.21.15.79:0/2778961322 shutdown_connections 2021-04-09T18:32:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.460 7f1f5f179700 1 --2- 172.21.15.79:0/2778961322 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1f3c029100 0x7f1f3c02b650 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.460 7f1f5f179700 1 --2- 172.21.15.79:0/2778961322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f581ad4a0 0x7f1f581ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.460 7f1f5f179700 1 --2- 172.21.15.79:0/2778961322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5819bb00 0x7f1f580bee50 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.460 7f1f5f179700 1 --2- 172.21.15.79:0/2778961322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f5819cd50 0x7f1f5819d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.460 7f1f5f179700 1 -- 172.21.15.79:0/2778961322 >> 172.21.15.79:0/2778961322 conn(0x7f1f58099200 msgr2=0x7f1f58095df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.460 7f1f5f179700 1 -- 172.21.15.79:0/2778961322 shutdown_connections 2021-04-09T18:32:04.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.460 7f1f5f179700 1 -- 172.21.15.79:0/2778961322 wait complete. 2021-04-09T18:32:04.478 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-04-09T18:32:04.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.564 7f0d3b655700 1 Processor -- start 2021-04-09T18:32:04.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.564 7f0d3b655700 1 -- start start 2021-04-09T18:32:04.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.564 7f0d3b655700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0d340f5520 0x7f0d340f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:04.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.564 7f0d3b655700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d340fbb20 con 0x7f0d341c8010 2021-04-09T18:32:04.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.564 7f0d3b655700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d3409f910 con 0x7f0d340e9ae0 2021-04-09T18:32:04.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.564 7f0d3b655700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d340e9f30 con 0x7f0d340f5520 2021-04-09T18:32:04.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.564 7f0d393f9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0d340f5520 0x7f0d340f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:04.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.564 7f0d39bfa700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0d341c8010 0x7f0d341ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54060/0 (socket says 172.21.15.79:54060) 2021-04-09T18:32:04.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.568 7f0d39bfa700 1 -- 172.21.15.79:0/2921499510 learned_addr learned my addr 172.21.15.79:0/2921499510 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:04.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.568 7f0d27fff700 1 -- 172.21.15.79:0/2921499510 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028412751 0 0) 0x7f0d2c001450 con 0x7f0d341c8010 2021-04-09T18:32:04.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.568 7f0d27fff700 1 -- 172.21.15.79:0/2921499510 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d20003240 con 0x7f0d341c8010 2021-04-09T18:32:04.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.568 7f0d27fff700 1 -- 172.21.15.79:0/2921499510 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1461518840 0 0) 0x7f0d2c0019d0 con 0x7f0d341c8010 2021-04-09T18:32:04.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.568 7f0d393f9700 1 -- 172.21.15.79:0/2921499510 >> v1:172.21.15.89:6789/0 conn(0x7f0d340e9ae0 legacy=0x7f0d3409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:04.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.568 7f0d393f9700 1 -- 172.21.15.79:0/2921499510 >> v1:172.21.15.79:6789/0 conn(0x7f0d341c8010 legacy=0x7f0d341ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:04.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.568 7f0d393f9700 1 -- 172.21.15.79:0/2921499510 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d340e56d0 con 0x7f0d340f5520 2021-04-09T18:32:04.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.568 7f0d393f9700 1 --2- 172.21.15.79:0/2921499510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d340f5520 0x7f0d340f64b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f0d2c002130 tx=0x7f0d3000bcc0).ready entity=mon.0 client_cookie=af3fd6c853613c0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:04.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.568 7f0d27fff700 1 -- 172.21.15.79:0/2921499510 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d340e56d0 con 0x7f0d340f5520 2021-04-09T18:32:04.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.568 7f0d27fff700 1 -- 172.21.15.79:0/2921499510 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d300096c0 con 0x7f0d340f5520 2021-04-09T18:32:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.568 7f0d27fff700 1 -- 172.21.15.79:0/2921499510 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d2c001f30 con 0x7f0d340f5520 2021-04-09T18:32:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.568 7f0d3b655700 1 -- 172.21.15.79:0/2921499510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d340f5520 msgr2=0x7f0d340f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.568 7f0d3b655700 1 --2- 172.21.15.79:0/2921499510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d340f5520 0x7f0d340f64b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f0d2c002130 tx=0x7f0d3000bcc0).stop 2021-04-09T18:32:04.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.568 7f0d3b655700 1 -- 172.21.15.79:0/2921499510 shutdown_connections 2021-04-09T18:32:04.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.568 7f0d3b655700 1 --2- 172.21.15.79:0/2921499510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d340f5520 0x7f0d340f64b0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:04.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.568 7f0d3b655700 1 -- 172.21.15.79:0/2921499510 >> 172.21.15.79:0/2921499510 conn(0x7f0d340e5fe0 msgr2=0x7f0d340e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:04.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.568 7f0d3b655700 1 -- 172.21.15.79:0/2921499510 shutdown_connections 2021-04-09T18:32:04.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.568 7f0d3b655700 1 -- 172.21.15.79:0/2921499510 wait complete. 2021-04-09T18:32:04.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.572 7f0d3b655700 1 Processor -- start 2021-04-09T18:32:04.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.572 7f0d3b655700 1 -- start start 2021-04-09T18:32:04.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.572 7f0d3b655700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d3419e550 0x7f0d340ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:04.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.572 7f0d3b655700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d3419dbf0 0x7f0d340c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:04.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.572 7f0d3b655700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3419e040 0x7f0d340c5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:04.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.572 7f0d3b655700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d341c3dc0 con 0x7f0d3419e040 2021-04-09T18:32:04.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.572 7f0d3b655700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340982a0 con 0x7f0d3419dbf0 2021-04-09T18:32:04.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.572 7f0d3b655700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340985a0 con 0x7f0d3419e550 2021-04-09T18:32:04.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.572 7f0d39bfa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3419e040 0x7f0d340c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:04.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.572 7f0d393f9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d3419e550 0x7f0d340ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:04.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.572 7f0d39bfa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3419e040 0x7f0d340c5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59356/0 (socket says 172.21.15.79:59356) 2021-04-09T18:32:04.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.572 7f0d39bfa700 1 -- 172.21.15.79:0/2174434071 learned_addr learned my addr 172.21.15.79:0/2174434071 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:04.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.572 7f0d38bf8700 1 --2- 172.21.15.79:0/2174434071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d3419dbf0 0x7f0d340c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:04.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.572 7f0d39bfa700 1 -- 172.21.15.79:0/2174434071 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d3419e550 msgr2=0x7f0d340ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:04.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.572 7f0d39bfa700 1 --2- 172.21.15.79:0/2174434071 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d3419e550 0x7f0d340ac670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:04.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.572 7f0d39bfa700 1 -- 172.21.15.79:0/2174434071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d3419dbf0 msgr2=0x7f0d340c4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:04.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.572 7f0d39bfa700 1 --2- 172.21.15.79:0/2174434071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d3419dbf0 0x7f0d340c4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:04.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.572 7f0d39bfa700 1 -- 172.21.15.79:0/2174434071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d34097e50 con 0x7f0d3419e040 2021-04-09T18:32:04.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.572 7f0d39bfa700 1 --2- 172.21.15.79:0/2174434071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3419e040 0x7f0d340c5160 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f0d34099f70 tx=0x7f0d2c00cec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.576 7f0d25ffb700 1 -- 172.21.15.79:0/2174434071 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d34097e50 con 0x7f0d3419e040 2021-04-09T18:32:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.576 7f0d25ffb700 1 -- 172.21.15.79:0/2174434071 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2c004be0 con 0x7f0d3419e040 2021-04-09T18:32:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.576 7f0d3b655700 1 -- 172.21.15.79:0/2174434071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d340c5790 con 0x7f0d3419e040 2021-04-09T18:32:04.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.576 7f0d25ffb700 1 -- 172.21.15.79:0/2174434071 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d2c007170 con 0x7f0d3419e040 2021-04-09T18:32:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.576 7f0d3b655700 1 -- 172.21.15.79:0/2174434071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d340c4090 con 0x7f0d3419e040 2021-04-09T18:32:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.576 7f0d25ffb700 1 -- 172.21.15.79:0/2174434071 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0d2c007370 con 0x7f0d3419e040 2021-04-09T18:32:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.576 7f0d25ffb700 1 --2- 172.21.15.79:0/2174434071 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0d14029100 0x7f0d1402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.576 7f0d25ffb700 1 -- 172.21.15.79:0/2174434071 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6096+0+0 (secure 0 0 0) 0x7f0d2c039650 con 0x7f0d3419e040 2021-04-09T18:32:04.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.576 7f0d393f9700 1 --2- 172.21.15.79:0/2174434071 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0d14029100 0x7f0d1402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:04.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.576 7f0d393f9700 1 --2- 172.21.15.79:0/2174434071 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0d14029100 0x7f0d1402b650 crc :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:04.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.580 7f0d3b655700 1 -- 172.21.15.79:0/2174434071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d340e39e0 con 0x7f0d3419e040 2021-04-09T18:32:04.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.584 7f0d25ffb700 1 -- 172.21.15.79:0/2174434071 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0d2c000f70 con 0x7f0d3419e040 2021-04-09T18:32:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:04.752 7f0d3b655700 1 -- 172.21.15.79:0/2174434071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0d340a1cc0 con 0x7f0d3419e040 2021-04-09T18:32:05.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.120 7f0d25ffb700 1 -- 172.21.15.79:0/2174434071 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0d2c0049d0 con 0x7f0d3419e040 2021-04-09T18:32:05.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.172 7f0d3b655700 1 -- 172.21.15.79:0/2174434071 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0d14029100 msgr2=0x7f0d1402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:05.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.172 7f0d3b655700 1 --2- 172.21.15.79:0/2174434071 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0d14029100 0x7f0d1402b650 crc :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:05.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.172 7f0d3b655700 1 -- 172.21.15.79:0/2174434071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3419e040 msgr2=0x7f0d340c5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:05.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.172 7f0d3b655700 1 --2- 172.21.15.79:0/2174434071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3419e040 0x7f0d340c5160 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f0d34099f70 tx=0x7f0d2c00cec0).stop 2021-04-09T18:32:05.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.172 7f0d3b655700 1 -- 172.21.15.79:0/2174434071 shutdown_connections 2021-04-09T18:32:05.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.172 7f0d3b655700 1 --2- 172.21.15.79:0/2174434071 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0d14029100 0x7f0d1402b650 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:05.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.172 7f0d3b655700 1 --2- 172.21.15.79:0/2174434071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3419e040 0x7f0d340c5160 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:05.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.172 7f0d3b655700 1 --2- 172.21.15.79:0/2174434071 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d3419e550 0x7f0d340ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:05.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.172 7f0d3b655700 1 --2- 172.21.15.79:0/2174434071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d3419dbf0 0x7f0d340c4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:05.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.172 7f0d3b655700 1 -- 172.21.15.79:0/2174434071 >> 172.21.15.79:0/2174434071 conn(0x7f0d3409b0c0 msgr2=0x7f0d340ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:05.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.172 7f0d3b655700 1 -- 172.21.15.79:0/2174434071 shutdown_connections 2021-04-09T18:32:05.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.172 7f0d3b655700 1 -- 172.21.15.79:0/2174434071 wait complete. 2021-04-09T18:32:05.194 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-04-09T18:32:05.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.292 7f382ac94700 1 Processor -- start 2021-04-09T18:32:05.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.292 7f382ac94700 1 -- start start 2021-04-09T18:32:05.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.292 7f382ac94700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38240e9b10 0x7f382409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:05.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.292 7f382ac94700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38240fbb50 con 0x7f38241c8040 2021-04-09T18:32:05.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.292 7f382ac94700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38240e5700 con 0x7f38240f5550 2021-04-09T18:32:05.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.292 7f382ac94700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38241c3df0 con 0x7f38240e9b10 2021-04-09T18:32:05.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.292 7f3829239700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f38241c8040 0x7f38241ca4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54074/0 (socket says 172.21.15.79:54074) 2021-04-09T18:32:05.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.292 7f3829239700 1 -- 172.21.15.79:0/3613510695 learned_addr learned my addr 172.21.15.79:0/3613510695 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:05.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.292 7f3823fff700 1 --2- 172.21.15.79:0/3613510695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38240e9b10 0x7f382409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:05.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.292 7f38237fe700 1 -- 172.21.15.79:0/3613510695 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24395747 0 0) 0x7f381c001450 con 0x7f38241c8040 2021-04-09T18:32:05.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.292 7f38237fe700 1 -- 172.21.15.79:0/3613510695 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f380c003240 con 0x7f38241c8040 2021-04-09T18:32:05.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.296 7f38237fe700 1 -- 172.21.15.79:0/3613510695 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65172089 0 0) 0x7f38140010d0 con 0x7f38240f5550 2021-04-09T18:32:05.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.296 7f38237fe700 1 -- 172.21.15.79:0/3613510695 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f380c003620 con 0x7f38240f5550 2021-04-09T18:32:05.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.296 7f38237fe700 1 -- 172.21.15.79:0/3613510695 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2114676026 0 0) 0x7f381c0019d0 con 0x7f38241c8040 2021-04-09T18:32:05.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.296 7f3823fff700 1 -- 172.21.15.79:0/3613510695 >> v1:172.21.15.89:6789/0 conn(0x7f38240f5550 legacy=0x7f38240f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:05.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.296 7f3823fff700 1 -- 172.21.15.79:0/3613510695 >> v1:172.21.15.79:6789/0 conn(0x7f38241c8040 legacy=0x7f38241ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:05.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.296 7f3823fff700 1 -- 172.21.15.79:0/3613510695 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38240e4360 con 0x7f38240e9b10 2021-04-09T18:32:05.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.296 7f3823fff700 1 --2- 172.21.15.79:0/3613510695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38240e9b10 0x7f382409f110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f381c001d00 tx=0x7f381800bcf0).ready entity=mon.2 client_cookie=92c0687f6119d56e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:05.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.296 7f38237fe700 1 -- 172.21.15.79:0/3613510695 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f38240e4360 con 0x7f38240e9b10 2021-04-09T18:32:05.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.296 7f38237fe700 1 -- 172.21.15.79:0/3613510695 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3818009790 con 0x7f38240e9b10 2021-04-09T18:32:05.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.296 7f38237fe700 1 -- 172.21.15.79:0/3613510695 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f381c001f30 con 0x7f38240e9b10 2021-04-09T18:32:05.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.296 7f382ac94700 1 -- 172.21.15.79:0/3613510695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38240e9b10 msgr2=0x7f382409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:05.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.296 7f382ac94700 1 --2- 172.21.15.79:0/3613510695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38240e9b10 0x7f382409f110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f381c001d00 tx=0x7f381800bcf0).stop 2021-04-09T18:32:05.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.296 7f382ac94700 1 -- 172.21.15.79:0/3613510695 shutdown_connections 2021-04-09T18:32:05.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.296 7f382ac94700 1 --2- 172.21.15.79:0/3613510695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38240e9b10 0x7f382409f110 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:05.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.296 7f382ac94700 1 -- 172.21.15.79:0/3613510695 >> 172.21.15.79:0/3613510695 conn(0x7f38240e6010 msgr2=0x7f38240e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:05.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.296 7f382ac94700 1 -- 172.21.15.79:0/3613510695 shutdown_connections 2021-04-09T18:32:05.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.296 7f382ac94700 1 -- 172.21.15.79:0/3613510695 wait complete. 2021-04-09T18:32:05.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.300 7f382ac94700 1 Processor -- start 2021-04-09T18:32:05.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.300 7f382ac94700 1 -- start start 2021-04-09T18:32:05.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f382ac94700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38240b0f20 0x7f38240af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:05.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f382ac94700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38240abdd0 0x7f38240b97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:05.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f382ac94700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38240c5dc0 0x7f38240c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:05.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f382ac94700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38240e9f60 con 0x7f38240abdd0 2021-04-09T18:32:05.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f382ac94700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38240abad0 con 0x7f38240b0f20 2021-04-09T18:32:05.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f382ac94700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38240ab360 con 0x7f38240c5dc0 2021-04-09T18:32:05.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f3823fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38240abdd0 0x7f38240b97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:05.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f3823fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38240abdd0 0x7f38240b97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59368/0 (socket says 172.21.15.79:59368) 2021-04-09T18:32:05.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f3823fff700 1 -- 172.21.15.79:0/3567907045 learned_addr learned my addr 172.21.15.79:0/3567907045 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:05.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f3829239700 1 --2- 172.21.15.79:0/3567907045 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38240c5dc0 0x7f38240c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:05.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f3828a38700 1 --2- 172.21.15.79:0/3567907045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38240b0f20 0x7f38240af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:05.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f3823fff700 1 -- 172.21.15.79:0/3567907045 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38240c5dc0 msgr2=0x7f38240c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:05.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f3823fff700 1 --2- 172.21.15.79:0/3567907045 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38240c5dc0 0x7f38240c6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:05.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f3823fff700 1 -- 172.21.15.79:0/3567907045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38240b0f20 msgr2=0x7f38240af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:05.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f3823fff700 1 --2- 172.21.15.79:0/3567907045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38240b0f20 0x7f38240af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:05.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f3823fff700 1 -- 172.21.15.79:0/3567907045 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38240ac220 con 0x7f38240abdd0 2021-04-09T18:32:05.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f3828a38700 1 --2- 172.21.15.79:0/3567907045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38240b0f20 0x7f38240af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:32:05.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f3823fff700 1 --2- 172.21.15.79:0/3567907045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38240abdd0 0x7f38240b97a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f38240d82d0 tx=0x7f3818006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:05.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f38217fa700 1 -- 172.21.15.79:0/3567907045 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f38240ac220 con 0x7f38240abdd0 2021-04-09T18:32:05.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f38217fa700 1 -- 172.21.15.79:0/3567907045 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3818018470 con 0x7f38240abdd0 2021-04-09T18:32:05.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f382ac94700 1 -- 172.21.15.79:0/3567907045 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38240b9dd0 con 0x7f38240abdd0 2021-04-09T18:32:05.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f38217fa700 1 -- 172.21.15.79:0/3567907045 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f381801f070 con 0x7f38240abdd0 2021-04-09T18:32:05.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f382ac94700 1 -- 172.21.15.79:0/3567907045 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38240ba140 con 0x7f38240abdd0 2021-04-09T18:32:05.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f38217fa700 1 -- 172.21.15.79:0/3567907045 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3818023460 con 0x7f38240abdd0 2021-04-09T18:32:05.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f38217fa700 1 --2- 172.21.15.79:0/3567907045 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3804029100 0x7f380402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:05.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f38217fa700 1 -- 172.21.15.79:0/3567907045 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6096+0+0 (secure 0 0 0) 0x7f381803c140 con 0x7f38240abdd0 2021-04-09T18:32:05.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.304 7f3828a38700 1 --2- 172.21.15.79:0/3567907045 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3804029100 0x7f380402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:05.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.308 7f3828a38700 1 --2- 172.21.15.79:0/3567907045 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3804029100 0x7f380402b650 crc :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:05.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.320 7f382ac94700 1 -- 172.21.15.79:0/3567907045 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38240e39f0 con 0x7f38240abdd0 2021-04-09T18:32:05.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.328 7f38217fa700 1 -- 172.21.15.79:0/3567907045 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3818009580 con 0x7f38240abdd0 2021-04-09T18:32:05.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:05.488 7f382ac94700 1 -- 172.21.15.79:0/3567907045 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f38240a1c90 con 0x7f38240abdd0 2021-04-09T18:32:06.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.132 7f38217fa700 1 -- 172.21.15.79:0/3567907045 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v62) v1 ==== 185+0+0 (secure 0 0 0) 0x7f3818011b40 con 0x7f38240abdd0 2021-04-09T18:32:06.157 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2021-04-09T18:32:06.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.156 7f382ac94700 1 -- 172.21.15.79:0/3567907045 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3804029100 msgr2=0x7f380402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:06.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.156 7f382ac94700 1 --2- 172.21.15.79:0/3567907045 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3804029100 0x7f380402b650 crc :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:06.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.156 7f382ac94700 1 -- 172.21.15.79:0/3567907045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38240abdd0 msgr2=0x7f38240b97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:06.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.156 7f382ac94700 1 --2- 172.21.15.79:0/3567907045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38240abdd0 0x7f38240b97a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f38240d82d0 tx=0x7f3818006890).stop 2021-04-09T18:32:06.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.156 7f382ac94700 1 -- 172.21.15.79:0/3567907045 shutdown_connections 2021-04-09T18:32:06.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.156 7f382ac94700 1 --2- 172.21.15.79:0/3567907045 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3804029100 0x7f380402b650 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:06.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.156 7f382ac94700 1 --2- 172.21.15.79:0/3567907045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38240b0f20 0x7f38240af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:06.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.156 7f382ac94700 1 --2- 172.21.15.79:0/3567907045 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38240c5dc0 0x7f38240c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:06.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.156 7f382ac94700 1 --2- 172.21.15.79:0/3567907045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38240abdd0 0x7f38240b97a0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:06.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.156 7f382ac94700 1 -- 172.21.15.79:0/3567907045 >> 172.21.15.79:0/3567907045 conn(0x7f38240a2eb0 msgr2=0x7f38240ba730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:06.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.156 7f382ac94700 1 -- 172.21.15.79:0/3567907045 shutdown_connections 2021-04-09T18:32:06.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.156 7f382ac94700 1 -- 172.21.15.79:0/3567907045 wait complete. 2021-04-09T18:32:06.173 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-04-09T18:32:06.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.276 7f6737ea8700 1 Processor -- start 2021-04-09T18:32:06.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.276 7f6737ea8700 1 -- start start 2021-04-09T18:32:06.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.276 7f6737ea8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f67300f5550 0x7f67300f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:06.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.276 7f6737ea8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67301c8040 0x7f67301ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:06.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.276 7f6737ea8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67300fbb50 con 0x7f67300e9b10 2021-04-09T18:32:06.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.276 7f6737ea8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67300e9f60 con 0x7f67300f5550 2021-04-09T18:32:06.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.276 7f6737ea8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67301c3df0 con 0x7f67301c8040 2021-04-09T18:32:06.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.276 7f6735c4c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f67300f5550 0x7f67300f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:06.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.276 7f673644d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67301c8040 0x7f67301ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:06.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.276 7f673544b700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f67300e9b10 0x7f673009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:54558/0 (socket says 172.21.15.79:54558) 2021-04-09T18:32:06.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.276 7f673544b700 1 -- 172.21.15.79:0/1703850936 learned_addr learned my addr 172.21.15.79:0/1703850936 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:06.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.276 7f6734c4a700 1 -- 172.21.15.79:0/1703850936 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970430776 0 0) 0x7f67200010d0 con 0x7f67300e9b10 2021-04-09T18:32:06.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.276 7f6734c4a700 1 -- 172.21.15.79:0/1703850936 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f671c003240 con 0x7f67300e9b10 2021-04-09T18:32:06.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.276 7f6735c4c700 1 -- 172.21.15.79:0/1703850936 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67301c8040 msgr2=0x7f67301ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:06.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.276 7f6735c4c700 1 --2- 172.21.15.79:0/1703850936 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67301c8040 0x7f67301ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:06.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.276 7f6735c4c700 1 -- 172.21.15.79:0/1703850936 >> v1:172.21.15.89:6789/0 conn(0x7f67300e9b10 legacy=0x7f673009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:06.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.276 7f6735c4c700 1 -- 172.21.15.79:0/1703850936 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673009f910 con 0x7f67300f5550 2021-04-09T18:32:06.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.276 7f673644d700 1 --2- 172.21.15.79:0/1703850936 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67301c8040 0x7f67301ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:32:06.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.280 7f6735c4c700 1 --2- 172.21.15.79:0/1703850936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67300f5550 0x7f67300f64e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f67300f6f30 tx=0x7f672c00bd70).ready entity=mon.1 client_cookie=c4f341d66904e45e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:06.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.280 7f6734c4a700 1 -- 172.21.15.79:0/1703850936 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f673009f910 con 0x7f67300f5550 2021-04-09T18:32:06.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.280 7f6734c4a700 1 -- 172.21.15.79:0/1703850936 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c009810 con 0x7f67300f5550 2021-04-09T18:32:06.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.280 7f6734c4a700 1 -- 172.21.15.79:0/1703850936 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f672c009be0 con 0x7f67300f5550 2021-04-09T18:32:06.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.280 7f6737ea8700 1 -- 172.21.15.79:0/1703850936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67300f5550 msgr2=0x7f67300f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:06.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.280 7f6737ea8700 1 --2- 172.21.15.79:0/1703850936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67300f5550 0x7f67300f64e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f67300f6f30 tx=0x7f672c00bd70).stop 2021-04-09T18:32:06.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.280 7f6737ea8700 1 -- 172.21.15.79:0/1703850936 shutdown_connections 2021-04-09T18:32:06.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.280 7f6737ea8700 1 --2- 172.21.15.79:0/1703850936 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67301c8040 0x7f67301ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:06.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.280 7f6737ea8700 1 --2- 172.21.15.79:0/1703850936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67300f5550 0x7f67300f64e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:06.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.280 7f6737ea8700 1 -- 172.21.15.79:0/1703850936 >> 172.21.15.79:0/1703850936 conn(0x7f67300e6010 msgr2=0x7f67300e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:06.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.280 7f6737ea8700 1 -- 172.21.15.79:0/1703850936 shutdown_connections 2021-04-09T18:32:06.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.280 7f6737ea8700 1 -- 172.21.15.79:0/1703850936 wait complete. 2021-04-09T18:32:06.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f6737ea8700 1 Processor -- start 2021-04-09T18:32:06.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f6737ea8700 1 -- start start 2021-04-09T18:32:06.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f6737ea8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67300bd530 0x7f6730090e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:06.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f6737ea8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67300a69a0 0x7f67300d4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:06.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f6737ea8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67300d4dc0 0x7f67300921f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:06.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f6737ea8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6730091ef0 con 0x7f67300bd530 2021-04-09T18:32:06.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f6737ea8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67300a6df0 con 0x7f67300a69a0 2021-04-09T18:32:06.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f6737ea8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6730092e40 con 0x7f67300d4dc0 2021-04-09T18:32:06.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f6735c4c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67300bd530 0x7f6730090e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:06.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f6735c4c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67300bd530 0x7f6730090e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59384/0 (socket says 172.21.15.79:59384) 2021-04-09T18:32:06.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f6735c4c700 1 -- 172.21.15.79:0/3599434766 learned_addr learned my addr 172.21.15.79:0/3599434766 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:06.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f673644d700 1 --2- 172.21.15.79:0/3599434766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67300d4dc0 0x7f67300921f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:06.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f673544b700 1 --2- 172.21.15.79:0/3599434766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67300a69a0 0x7f67300d4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:06.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f673644d700 1 -- 172.21.15.79:0/3599434766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67300a69a0 msgr2=0x7f67300d4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:06.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f673644d700 1 --2- 172.21.15.79:0/3599434766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67300a69a0 0x7f67300d4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:06.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f673644d700 1 -- 172.21.15.79:0/3599434766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67300bd530 msgr2=0x7f6730090e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:06.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f673644d700 1 --2- 172.21.15.79:0/3599434766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67300bd530 0x7f6730090e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:06.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f673644d700 1 -- 172.21.15.79:0/3599434766 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67300ba4d0 con 0x7f67300d4dc0 2021-04-09T18:32:06.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f673544b700 1 --2- 172.21.15.79:0/3599434766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67300a69a0 0x7f67300d4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:32:06.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f6735c4c700 1 --2- 172.21.15.79:0/3599434766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67300bd530 0x7f6730090e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:32:06.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f673644d700 1 --2- 172.21.15.79:0/3599434766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67300d4dc0 0x7f67300921f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f672800efc0 tx=0x7f672800c4e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:06.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f67267fc700 1 -- 172.21.15.79:0/3599434766 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67300ba4d0 con 0x7f67300d4dc0 2021-04-09T18:32:06.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f67267fc700 1 -- 172.21.15.79:0/3599434766 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672800cdd0 con 0x7f67300d4dc0 2021-04-09T18:32:06.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f6737ea8700 1 -- 172.21.15.79:0/3599434766 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6730091a80 con 0x7f67300d4dc0 2021-04-09T18:32:06.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f67267fc700 1 -- 172.21.15.79:0/3599434766 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f672800f040 con 0x7f67300d4dc0 2021-04-09T18:32:06.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.284 7f6737ea8700 1 -- 172.21.15.79:0/3599434766 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67300929b0 con 0x7f67300d4dc0 2021-04-09T18:32:06.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.288 7f67267fc700 1 -- 172.21.15.79:0/3599434766 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6728022060 con 0x7f67300d4dc0 2021-04-09T18:32:06.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.288 7f67267fc700 1 --2- 172.21.15.79:0/3599434766 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6718029100 0x7f671802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:06.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.288 7f67267fc700 1 -- 172.21.15.79:0/3599434766 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5658+0+0 (secure 0 0 0) 0x7f6728010040 con 0x7f67300d4dc0 2021-04-09T18:32:06.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.288 7f6735c4c700 1 --2- 172.21.15.79:0/3599434766 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6718029100 0x7f671802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:06.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.288 7f6735c4c700 1 --2- 172.21.15.79:0/3599434766 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6718029100 0x7f671802b650 crc :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:06.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.292 7f6737ea8700 1 -- 172.21.15.79:0/3599434766 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67300e39f0 con 0x7f67300d4dc0 2021-04-09T18:32:06.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.300 7f67267fc700 1 -- 172.21.15.79:0/3599434766 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f67300f76f0 con 0x7f67300d4dc0 2021-04-09T18:32:06.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:06.468 7f6737ea8700 1 -- 172.21.15.79:0/3599434766 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f67300a1c90 con 0x7f67300d4dc0 2021-04-09T18:32:07.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.140 7f67267fc700 1 -- 172.21.15.79:0/3599434766 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v63) v1 ==== 173+0+0 (secure 0 0 0) 0x7f672800cbc0 con 0x7f67300d4dc0 2021-04-09T18:32:07.186 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2021-04-09T18:32:07.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.184 7f6737ea8700 1 -- 172.21.15.79:0/3599434766 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6718029100 msgr2=0x7f671802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:07.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.184 7f6737ea8700 1 --2- 172.21.15.79:0/3599434766 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6718029100 0x7f671802b650 crc :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:07.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.184 7f6737ea8700 1 -- 172.21.15.79:0/3599434766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67300d4dc0 msgr2=0x7f67300921f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:07.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.184 7f6737ea8700 1 --2- 172.21.15.79:0/3599434766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67300d4dc0 0x7f67300921f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f672800efc0 tx=0x7f672800c4e0).stop 2021-04-09T18:32:07.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.188 7f6737ea8700 1 -- 172.21.15.79:0/3599434766 shutdown_connections 2021-04-09T18:32:07.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.188 7f6737ea8700 1 --2- 172.21.15.79:0/3599434766 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6718029100 0x7f671802b650 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:07.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.188 7f6737ea8700 1 --2- 172.21.15.79:0/3599434766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67300d4dc0 0x7f67300921f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:07.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.188 7f6737ea8700 1 --2- 172.21.15.79:0/3599434766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67300bd530 0x7f6730090e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:07.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.188 7f6737ea8700 1 --2- 172.21.15.79:0/3599434766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67300a69a0 0x7f67300d4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:07.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.188 7f6737ea8700 1 -- 172.21.15.79:0/3599434766 >> 172.21.15.79:0/3599434766 conn(0x7f67300baa50 msgr2=0x7f67300948c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:07.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.188 7f6737ea8700 1 -- 172.21.15.79:0/3599434766 shutdown_connections 2021-04-09T18:32:07.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.188 7f6737ea8700 1 -- 172.21.15.79:0/3599434766 wait complete. 2021-04-09T18:32:07.202 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-04-09T18:32:07.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.296 7f608ce8b700 1 Processor -- start 2021-04-09T18:32:07.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.296 7f608ce8b700 1 -- start start 2021-04-09T18:32:07.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f608ce8b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f60880e9ae0 0x7f608809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:07.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f608ce8b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60881c8010 0x7f60881ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:07.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f608ce8b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60880fbb20 con 0x7f60880f5520 2021-04-09T18:32:07.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f608ce8b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60881c3dc0 con 0x7f60881c8010 2021-04-09T18:32:07.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f608ce8b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60880e9f30 con 0x7f60880e9ae0 2021-04-09T18:32:07.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f60872f0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60881c8010 0x7f60881ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:07.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f60872f0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60881c8010 0x7f60881ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59394/0 (socket says 172.21.15.79:59394) 2021-04-09T18:32:07.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f60872f0700 1 -- 172.21.15.79:0/3963282998 learned_addr learned my addr 172.21.15.79:0/3963282998 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:07.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f60862ee700 1 --2- 172.21.15.79:0/3963282998 >> v2:172.21.15.89:3300/0 conn(0x7f60880e9ae0 0x7f608809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:07.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f60872f0700 1 -- 172.21.15.79:0/3963282998 >> v2:172.21.15.89:3300/0 conn(0x7f60880e9ae0 msgr2=0x7f608809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:07.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f60872f0700 1 --2- 172.21.15.79:0/3963282998 >> v2:172.21.15.89:3300/0 conn(0x7f60880e9ae0 0x7f608809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:07.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f60872f0700 1 -- 172.21.15.79:0/3963282998 >> v1:172.21.15.89:6789/0 conn(0x7f60880f5520 legacy=0x7f60880f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:07.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f60872f0700 1 -- 172.21.15.79:0/3963282998 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60880e56d0 con 0x7f60881c8010 2021-04-09T18:32:07.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f60872f0700 1 --2- 172.21.15.79:0/3963282998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60881c8010 0x7f60881ca470 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f60800032b0 tx=0x7f608000b3c0).ready entity=mon.0 client_cookie=ac1cf30590bccdd3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:07.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f6085aed700 1 -- 172.21.15.79:0/3963282998 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f60880e56d0 con 0x7f60881c8010 2021-04-09T18:32:07.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f6085aed700 1 -- 172.21.15.79:0/3963282998 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608000bc20 con 0x7f60881c8010 2021-04-09T18:32:07.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f6085aed700 1 -- 172.21.15.79:0/3963282998 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6080002020 con 0x7f60881c8010 2021-04-09T18:32:07.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f608ce8b700 1 -- 172.21.15.79:0/3963282998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60881c8010 msgr2=0x7f60881ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:07.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f608ce8b700 1 --2- 172.21.15.79:0/3963282998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60881c8010 0x7f60881ca470 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f60800032b0 tx=0x7f608000b3c0).stop 2021-04-09T18:32:07.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f608ce8b700 1 -- 172.21.15.79:0/3963282998 shutdown_connections 2021-04-09T18:32:07.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f608ce8b700 1 --2- 172.21.15.79:0/3963282998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60881c8010 0x7f60881ca470 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:07.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f608ce8b700 1 --2- 172.21.15.79:0/3963282998 >> v2:172.21.15.89:3300/0 conn(0x7f60880e9ae0 0x7f608809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:07.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f608ce8b700 1 -- 172.21.15.79:0/3963282998 >> 172.21.15.79:0/3963282998 conn(0x7f60880e5fe0 msgr2=0x7f60880e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:07.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f608ce8b700 1 -- 172.21.15.79:0/3963282998 shutdown_connections 2021-04-09T18:32:07.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.300 7f608ce8b700 1 -- 172.21.15.79:0/3963282998 wait complete. 2021-04-09T18:32:07.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f608ce8b700 1 Processor -- start 2021-04-09T18:32:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f608ce8b700 1 -- start start 2021-04-09T18:32:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f608ce8b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60880a8430 0x7f60881ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f608ce8b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60880b2400 0x7f6088095f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f608ce8b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60880adf20 0x7f60880d73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f608ce8b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60880b2d00 con 0x7f60880b2400 2021-04-09T18:32:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f608ce8b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60880b3000 con 0x7f60880adf20 2021-04-09T18:32:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f608ce8b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60880965c0 con 0x7f60880a8430 2021-04-09T18:32:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f60862ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60880b2400 0x7f6088095f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f60862ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60880b2400 0x7f6088095f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59398/0 (socket says 172.21.15.79:59398) 2021-04-09T18:32:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f60862ee700 1 -- 172.21.15.79:0/706045548 learned_addr learned my addr 172.21.15.79:0/706045548 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f6086aef700 1 --2- 172.21.15.79:0/706045548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60880a8430 0x7f60881ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f60872f0700 1 --2- 172.21.15.79:0/706045548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60880adf20 0x7f60880d73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f60862ee700 1 -- 172.21.15.79:0/706045548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60880a8430 msgr2=0x7f60881ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f60862ee700 1 --2- 172.21.15.79:0/706045548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60880a8430 0x7f60881ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f60862ee700 1 -- 172.21.15.79:0/706045548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60880adf20 msgr2=0x7f60880d73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f60862ee700 1 --2- 172.21.15.79:0/706045548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60880adf20 0x7f60880d73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f60862ee700 1 -- 172.21.15.79:0/706045548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60880b2850 con 0x7f60880b2400 2021-04-09T18:32:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f60862ee700 1 --2- 172.21.15.79:0/706045548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60880b2400 0x7f6088095f90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f60880d85c0 tx=0x7f607c00c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f60777fe700 1 -- 172.21.15.79:0/706045548 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f60880b2850 con 0x7f60880b2400 2021-04-09T18:32:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f60777fe700 1 -- 172.21.15.79:0/706045548 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607c00cc10 con 0x7f60880b2400 2021-04-09T18:32:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f608ce8b700 1 -- 172.21.15.79:0/706045548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60880ae370 con 0x7f60880b2400 2021-04-09T18:32:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f60777fe700 1 -- 172.21.15.79:0/706045548 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f607c00f040 con 0x7f60880b2400 2021-04-09T18:32:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.308 7f608ce8b700 1 -- 172.21.15.79:0/706045548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60880d7b90 con 0x7f60880b2400 2021-04-09T18:32:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.312 7f60777fe700 1 -- 172.21.15.79:0/706045548 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f607c011070 con 0x7f60880b2400 2021-04-09T18:32:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.312 7f60777fe700 1 --2- 172.21.15.79:0/706045548 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f606c029100 0x7f606c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.312 7f60777fe700 1 -- 172.21.15.79:0/706045548 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f607c010040 con 0x7f60880b2400 2021-04-09T18:32:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.312 7f6086aef700 1 --2- 172.21.15.79:0/706045548 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f606c029100 0x7f606c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:07.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.312 7f6086aef700 1 --2- 172.21.15.79:0/706045548 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f606c029100 0x7f606c02b650 crc :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:07.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.328 7f608ce8b700 1 -- 172.21.15.79:0/706045548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60880e39e0 con 0x7f60880b2400 2021-04-09T18:32:07.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.336 7f60777fe700 1 -- 172.21.15.79:0/706045548 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f607c00c810 con 0x7f60880b2400 2021-04-09T18:32:07.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.516 7f608ce8b700 1 -- 172.21.15.79:0/706045548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f60880a1cc0 con 0x7f60880b2400 2021-04-09T18:32:07.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.524 7f60777fe700 1 -- 172.21.15.79:0/706045548 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f607c000bf0 con 0x7f60880b2400 2021-04-09T18:32:07.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.524 7f608ce8b700 1 -- 172.21.15.79:0/706045548 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f606c029100 msgr2=0x7f606c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:07.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.524 7f608ce8b700 1 --2- 172.21.15.79:0/706045548 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f606c029100 0x7f606c02b650 crc :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:07.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.524 7f608ce8b700 1 -- 172.21.15.79:0/706045548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60880b2400 msgr2=0x7f6088095f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:07.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.524 7f608ce8b700 1 --2- 172.21.15.79:0/706045548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60880b2400 0x7f6088095f90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f60880d85c0 tx=0x7f607c00c150).stop 2021-04-09T18:32:07.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.524 7f608ce8b700 1 -- 172.21.15.79:0/706045548 shutdown_connections 2021-04-09T18:32:07.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.524 7f608ce8b700 1 --2- 172.21.15.79:0/706045548 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f606c029100 0x7f606c02b650 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:07.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.524 7f608ce8b700 1 --2- 172.21.15.79:0/706045548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60880adf20 0x7f60880d73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:07.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.524 7f608ce8b700 1 --2- 172.21.15.79:0/706045548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60880a8430 0x7f60881ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:07.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.524 7f608ce8b700 1 --2- 172.21.15.79:0/706045548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60880b2400 0x7f6088095f90 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:07.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.524 7f608ce8b700 1 -- 172.21.15.79:0/706045548 >> 172.21.15.79:0/706045548 conn(0x7f60880ab240 msgr2=0x7f6088098340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:07.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.524 7f608ce8b700 1 -- 172.21.15.79:0/706045548 shutdown_connections 2021-04-09T18:32:07.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.528 7f608ce8b700 1 -- 172.21.15.79:0/706045548 wait complete. 2021-04-09T18:32:07.540 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2021-04-09T18:32:07.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.628 7f19c5fb5700 1 Processor -- start 2021-04-09T18:32:07.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.628 7f19c5fb5700 1 -- start start 2021-04-09T18:32:07.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.628 7f19c5fb5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c01c9020 0x7f19c01cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:07.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.628 7f19c5fb5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c00fbb20 con 0x7f19c00e9ae0 2021-04-09T18:32:07.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19c5fb5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c009f910 con 0x7f19c00f5520 2021-04-09T18:32:07.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19c5fb5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c01c3dc0 con 0x7f19c01c9020 2021-04-09T18:32:07.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19b6ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f19c00e9ae0 0x7f19c009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54116/0 (socket says 172.21.15.79:54116) 2021-04-09T18:32:07.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19b6ffd700 1 -- 172.21.15.79:0/450524427 learned_addr learned my addr 172.21.15.79:0/450524427 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:07.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19bffff700 1 --2- 172.21.15.79:0/450524427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c01c9020 0x7f19c01cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:07.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19beffd700 1 -- 172.21.15.79:0/450524427 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886776482 0 0) 0x7f19a80010d0 con 0x7f19c00e9ae0 2021-04-09T18:32:07.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19beffd700 1 -- 172.21.15.79:0/450524427 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19ac003240 con 0x7f19c00e9ae0 2021-04-09T18:32:07.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19beffd700 1 -- 172.21.15.79:0/450524427 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034390098 0 0) 0x7f19b00010d0 con 0x7f19c00f5520 2021-04-09T18:32:07.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19beffd700 1 -- 172.21.15.79:0/450524427 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19ac003620 con 0x7f19c00f5520 2021-04-09T18:32:07.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19bffff700 1 -- 172.21.15.79:0/450524427 >> v1:172.21.15.89:6789/0 conn(0x7f19c00f5520 legacy=0x7f19c00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:07.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19bffff700 1 -- 172.21.15.79:0/450524427 >> v1:172.21.15.79:6789/0 conn(0x7f19c00e9ae0 legacy=0x7f19c009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:07.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19bffff700 1 -- 172.21.15.79:0/450524427 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c00e56d0 con 0x7f19c01c9020 2021-04-09T18:32:07.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19bffff700 1 --2- 172.21.15.79:0/450524427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c01c9020 0x7f19c01cb480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f19b80032b0 tx=0x7f19b800b0e0).ready entity=mon.2 client_cookie=56eed7e2d984f063 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:07.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19beffd700 1 -- 172.21.15.79:0/450524427 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f19c00e56d0 con 0x7f19c01c9020 2021-04-09T18:32:07.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19beffd700 1 -- 172.21.15.79:0/450524427 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b800baf0 con 0x7f19c01c9020 2021-04-09T18:32:07.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19beffd700 1 -- 172.21.15.79:0/450524427 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f19b8002020 con 0x7f19c01c9020 2021-04-09T18:32:07.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19c5fb5700 1 -- 172.21.15.79:0/450524427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c01c9020 msgr2=0x7f19c01cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:07.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19c5fb5700 1 --2- 172.21.15.79:0/450524427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c01c9020 0x7f19c01cb480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f19b80032b0 tx=0x7f19b800b0e0).stop 2021-04-09T18:32:07.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19c5fb5700 1 -- 172.21.15.79:0/450524427 shutdown_connections 2021-04-09T18:32:07.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19c5fb5700 1 --2- 172.21.15.79:0/450524427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c01c9020 0x7f19c01cb480 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:07.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19c5fb5700 1 -- 172.21.15.79:0/450524427 >> 172.21.15.79:0/450524427 conn(0x7f19c00e5fe0 msgr2=0x7f19c00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:07.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19c5fb5700 1 -- 172.21.15.79:0/450524427 shutdown_connections 2021-04-09T18:32:07.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.632 7f19c5fb5700 1 -- 172.21.15.79:0/450524427 wait complete. 2021-04-09T18:32:07.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.636 7f19c5fb5700 1 Processor -- start 2021-04-09T18:32:07.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.636 7f19c5fb5700 1 -- start start 2021-04-09T18:32:07.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.636 7f19c5fb5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c00d66c0 0x7f19c00d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:07.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.636 7f19c5fb5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19c00d5f60 0x7f19c00d7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:07.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.636 7f19c5fb5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19c00d83b0 0x7f19c00cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:07.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.636 7f19c5fb5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00e9f30 con 0x7f19c00d5f60 2021-04-09T18:32:07.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.636 7f19c5fb5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00d8be0 con 0x7f19c00d83b0 2021-04-09T18:32:07.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.636 7f19c5fb5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c01a3210 con 0x7f19c00d66c0 2021-04-09T18:32:07.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19b6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19c00d5f60 0x7f19c00d7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:07.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19b6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19c00d5f60 0x7f19c00d7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59410/0 (socket says 172.21.15.79:59410) 2021-04-09T18:32:07.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19b6ffd700 1 -- 172.21.15.79:0/42133272 learned_addr learned my addr 172.21.15.79:0/42133272 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:07.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19bffff700 1 --2- 172.21.15.79:0/42133272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19c00d83b0 0x7f19c00cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:07.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19bf7fe700 1 --2- 172.21.15.79:0/42133272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c00d66c0 0x7f19c00d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:07.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19b6ffd700 1 -- 172.21.15.79:0/42133272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c00d66c0 msgr2=0x7f19c00d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:07.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19b6ffd700 1 --2- 172.21.15.79:0/42133272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c00d66c0 0x7f19c00d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:07.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19b6ffd700 1 -- 172.21.15.79:0/42133272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19c00d83b0 msgr2=0x7f19c00cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:07.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19b6ffd700 1 --2- 172.21.15.79:0/42133272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19c00d83b0 0x7f19c00cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:07.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19b6ffd700 1 -- 172.21.15.79:0/42133272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c00d8800 con 0x7f19c00d5f60 2021-04-09T18:32:07.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19b6ffd700 1 --2- 172.21.15.79:0/42133272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19c00d5f60 0x7f19c00d7d80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f19c008dab0 tx=0x7f19a800cb10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:07.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19bcff9700 1 -- 172.21.15.79:0/42133272 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f19c00d8800 con 0x7f19c00d5f60 2021-04-09T18:32:07.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19bcff9700 1 -- 172.21.15.79:0/42133272 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a8007320 con 0x7f19c00d5f60 2021-04-09T18:32:07.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19c5fb5700 1 -- 172.21.15.79:0/42133272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c00d63b0 con 0x7f19c00d5f60 2021-04-09T18:32:07.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19bcff9700 1 -- 172.21.15.79:0/42133272 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f19a80057e0 con 0x7f19c00d5f60 2021-04-09T18:32:07.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19c5fb5700 1 -- 172.21.15.79:0/42133272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c0091250 con 0x7f19c00d5f60 2021-04-09T18:32:07.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19bcff9700 1 -- 172.21.15.79:0/42133272 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f19a801a060 con 0x7f19c00d5f60 2021-04-09T18:32:07.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19bcff9700 1 --2- 172.21.15.79:0/42133272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f19a4029100 0x7f19a402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:07.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19bcff9700 1 -- 172.21.15.79:0/42133272 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f19a8038ad0 con 0x7f19c00d5f60 2021-04-09T18:32:07.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19bf7fe700 1 --2- 172.21.15.79:0/42133272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f19a4029100 0x7f19a402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:07.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.640 7f19bf7fe700 1 --2- 172.21.15.79:0/42133272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f19a4029100 0x7f19a402b650 crc :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:07.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.644 7f19c5fb5700 1 -- 172.21.15.79:0/42133272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c00e39e0 con 0x7f19c00d5f60 2021-04-09T18:32:07.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.652 7f19bcff9700 1 -- 172.21.15.79:0/42133272 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f19c00e5ca0 con 0x7f19c00d5f60 2021-04-09T18:32:07.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:07.816 7f19c5fb5700 1 -- 172.21.15.79:0/42133272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7f19c00f5b20 con 0x7f19c00d5f60 2021-04-09T18:32:08.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.148 7f19bcff9700 1 -- 172.21.15.79:0/42133272 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v157) v1 ==== 147+0+0 (secure 0 0 0) 0x7f19a8007110 con 0x7f19c00d5f60 2021-04-09T18:32:08.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.184 7f19c5fb5700 1 -- 172.21.15.79:0/42133272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f19a4029100 msgr2=0x7f19a402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:08.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.184 7f19c5fb5700 1 --2- 172.21.15.79:0/42133272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f19a4029100 0x7f19a402b650 crc :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:08.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.184 7f19c5fb5700 1 -- 172.21.15.79:0/42133272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19c00d5f60 msgr2=0x7f19c00d7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:08.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.184 7f19c5fb5700 1 --2- 172.21.15.79:0/42133272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19c00d5f60 0x7f19c00d7d80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f19c008dab0 tx=0x7f19a800cb10).stop 2021-04-09T18:32:08.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.184 7f19c5fb5700 1 -- 172.21.15.79:0/42133272 shutdown_connections 2021-04-09T18:32:08.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.184 7f19c5fb5700 1 --2- 172.21.15.79:0/42133272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f19a4029100 0x7f19a402b650 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:08.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.184 7f19c5fb5700 1 --2- 172.21.15.79:0/42133272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19c00d83b0 0x7f19c00cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:08.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.184 7f19c5fb5700 1 --2- 172.21.15.79:0/42133272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c00d66c0 0x7f19c00d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:08.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.184 7f19c5fb5700 1 --2- 172.21.15.79:0/42133272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19c00d5f60 0x7f19c00d7d80 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:08.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.184 7f19c5fb5700 1 -- 172.21.15.79:0/42133272 >> 172.21.15.79:0/42133272 conn(0x7f19c008e020 msgr2=0x7f19c00d3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:08.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.184 7f19c5fb5700 1 -- 172.21.15.79:0/42133272 shutdown_connections 2021-04-09T18:32:08.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.184 7f19c5fb5700 1 -- 172.21.15.79:0/42133272 wait complete. 2021-04-09T18:32:08.202 INFO:tasks.cephfs_test_runner:test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-04-09T18:32:08.202 INFO:tasks.cephfs_test_runner:Starting test: test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) 2021-04-09T18:32:08.203 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2021-04-09T18:32:08.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe61b958700 1 Processor -- start 2021-04-09T18:32:08.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe61b958700 1 -- start start 2021-04-09T18:32:08.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe61b958700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6140f5520 0x7fe6140f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:08.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe61b958700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe6140e9ae0 0x7fe61409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:08.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe61b958700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe6141c2db0 0x7fe6141c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:08.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe61b958700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6140e9f30 con 0x7fe6141c2db0 2021-04-09T18:32:08.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe61b958700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6140e59d0 con 0x7fe6140e9ae0 2021-04-09T18:32:08.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe61b958700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6140fbb20 con 0x7fe6140f5520 2021-04-09T18:32:08.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe619efd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe6141c2db0 0x7fe6141c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:08.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe619efd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe6141c2db0 0x7fe6141c3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59422/0 (socket says 172.21.15.79:59422) 2021-04-09T18:32:08.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe619efd700 1 -- 172.21.15.79:0/696043655 learned_addr learned my addr 172.21.15.79:0/696043655 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:08.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe618efb700 1 --2- 172.21.15.79:0/696043655 >> v2:172.21.15.89:3300/0 conn(0x7fe6140e9ae0 0x7fe61409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:08.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe6196fc700 1 --2- 172.21.15.79:0/696043655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6140f5520 0x7fe6140f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:08.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe619efd700 1 -- 172.21.15.79:0/696043655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6140f5520 msgr2=0x7fe6140f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:08.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe619efd700 1 --2- 172.21.15.79:0/696043655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6140f5520 0x7fe6140f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:08.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe619efd700 1 -- 172.21.15.79:0/696043655 >> v2:172.21.15.89:3300/0 conn(0x7fe6140e9ae0 msgr2=0x7fe61409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:08.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe619efd700 1 --2- 172.21.15.79:0/696043655 >> v2:172.21.15.89:3300/0 conn(0x7fe6140e9ae0 0x7fe61409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:08.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe619efd700 1 -- 172.21.15.79:0/696043655 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6140e56d0 con 0x7fe6141c2db0 2021-04-09T18:32:08.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe619efd700 1 --2- 172.21.15.79:0/696043655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6141c2db0 0x7fe6141c3200 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fe60c002f30 tx=0x7fe60c00bd70).ready entity=mon.0 client_cookie=57cb21c0d2fee571 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:08.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe613fff700 1 -- 172.21.15.79:0/696043655 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe6140e56d0 con 0x7fe6141c2db0 2021-04-09T18:32:08.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe613fff700 1 -- 172.21.15.79:0/696043655 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c0098b0 con 0x7fe6141c2db0 2021-04-09T18:32:08.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe613fff700 1 -- 172.21.15.79:0/696043655 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe60c009c80 con 0x7fe6141c2db0 2021-04-09T18:32:08.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe61b958700 1 -- 172.21.15.79:0/696043655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6141c2db0 msgr2=0x7fe6141c3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:08.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe61b958700 1 --2- 172.21.15.79:0/696043655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6141c2db0 0x7fe6141c3200 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fe60c002f30 tx=0x7fe60c00bd70).stop 2021-04-09T18:32:08.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe61b958700 1 -- 172.21.15.79:0/696043655 shutdown_connections 2021-04-09T18:32:08.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe61b958700 1 --2- 172.21.15.79:0/696043655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6140f5520 0x7fe6140f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:08.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe61b958700 1 --2- 172.21.15.79:0/696043655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6141c2db0 0x7fe6141c3200 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:08.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe61b958700 1 --2- 172.21.15.79:0/696043655 >> v2:172.21.15.89:3300/0 conn(0x7fe6140e9ae0 0x7fe61409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:08.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe61b958700 1 -- 172.21.15.79:0/696043655 >> 172.21.15.79:0/696043655 conn(0x7fe6140e5fe0 msgr2=0x7fe6140e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:08.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe61b958700 1 -- 172.21.15.79:0/696043655 shutdown_connections 2021-04-09T18:32:08.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.296 7fe61b958700 1 -- 172.21.15.79:0/696043655 wait complete. 2021-04-09T18:32:08.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.300 7fe61b958700 1 Processor -- start 2021-04-09T18:32:08.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.300 7fe61b958700 1 -- start start 2021-04-09T18:32:08.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.300 7fe61b958700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe614098200 0x7fe6140d5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:08.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.300 7fe61b958700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6140d6130 0x7fe6140ae190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:08.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.300 7fe61b958700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe614098650 0x7fe6140ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:08.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.300 7fe61b958700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6140885c0 con 0x7fe614098200 2021-04-09T18:32:08.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.300 7fe61b958700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe614096980 con 0x7fe614098650 2021-04-09T18:32:08.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.300 7fe61b958700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe614096c80 con 0x7fe6140d6130 2021-04-09T18:32:08.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.300 7fe6196fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe614098200 0x7fe6140d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:08.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.300 7fe6196fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe614098200 0x7fe6140d5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59424/0 (socket says 172.21.15.79:59424) 2021-04-09T18:32:08.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.300 7fe6196fc700 1 -- 172.21.15.79:0/1857458753 learned_addr learned my addr 172.21.15.79:0/1857458753 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:08.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.300 7fe618efb700 1 --2- 172.21.15.79:0/1857458753 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6140d6130 0x7fe6140ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:08.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.300 7fe619efd700 1 --2- 172.21.15.79:0/1857458753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe614098650 0x7fe6140ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:08.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.304 7fe6196fc700 1 -- 172.21.15.79:0/1857458753 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6140d6130 msgr2=0x7fe6140ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:08.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.304 7fe6196fc700 1 --2- 172.21.15.79:0/1857458753 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6140d6130 0x7fe6140ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:08.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.304 7fe6196fc700 1 -- 172.21.15.79:0/1857458753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe614098650 msgr2=0x7fe6140ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:08.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.304 7fe6196fc700 1 --2- 172.21.15.79:0/1857458753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe614098650 0x7fe6140ae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:08.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.304 7fe6196fc700 1 -- 172.21.15.79:0/1857458753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe614096510 con 0x7fe614098200 2021-04-09T18:32:08.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.304 7fe6196fc700 1 --2- 172.21.15.79:0/1857458753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe614098200 0x7fe6140d5b00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fe61409b550 tx=0x7fe5fc00bf60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:08.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.304 7fe611ffb700 1 -- 172.21.15.79:0/1857458753 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe614096510 con 0x7fe614098200 2021-04-09T18:32:08.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.304 7fe611ffb700 1 -- 172.21.15.79:0/1857458753 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc00cb80 con 0x7fe614098200 2021-04-09T18:32:08.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.304 7fe611ffb700 1 -- 172.21.15.79:0/1857458753 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe5fc00f040 con 0x7fe614098200 2021-04-09T18:32:08.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.304 7fe61b958700 1 -- 172.21.15.79:0/1857458753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6141a13d0 con 0x7fe614098200 2021-04-09T18:32:08.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.304 7fe61b958700 1 -- 172.21.15.79:0/1857458753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6140c4520 con 0x7fe614098200 2021-04-09T18:32:08.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.304 7fe611ffb700 1 -- 172.21.15.79:0/1857458753 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe5fc011070 con 0x7fe614098200 2021-04-09T18:32:08.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.304 7fe611ffb700 1 --2- 172.21.15.79:0/1857458753 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe5f8029100 0x7fe5f802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:08.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.304 7fe611ffb700 1 -- 172.21.15.79:0/1857458753 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5276+0+0 (secure 0 0 0) 0x7fe5fc010040 con 0x7fe614098200 2021-04-09T18:32:08.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.304 7fe618efb700 1 --2- 172.21.15.79:0/1857458753 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe5f8029100 0x7fe5f802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:08.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.304 7fe618efb700 1 --2- 172.21.15.79:0/1857458753 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe5f8029100 0x7fe5f802b650 crc :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:08.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.308 7fe61b958700 1 -- 172.21.15.79:0/1857458753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6140e39e0 con 0x7fe614098200 2021-04-09T18:32:08.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.312 7fe611ffb700 1 -- 172.21.15.79:0/1857458753 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe614107f50 con 0x7fe614098200 2021-04-09T18:32:08.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:08.480 7fe61b958700 1 -- 172.21.15.79:0/1857458753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7fe6140f5b20 con 0x7fe614098200 2021-04-09T18:32:09.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.148 7fe611ffb700 1 -- 172.21.15.79:0/1857458753 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v158) v1 ==== 142+0+0 (secure 0 0 0) 0x7fe5fc00c780 con 0x7fe614098200 2021-04-09T18:32:09.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.200 7fe61b958700 1 -- 172.21.15.79:0/1857458753 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe5f8029100 msgr2=0x7fe5f802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:09.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.200 7fe61b958700 1 --2- 172.21.15.79:0/1857458753 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe5f8029100 0x7fe5f802b650 crc :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:09.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.200 7fe61b958700 1 -- 172.21.15.79:0/1857458753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe614098200 msgr2=0x7fe6140d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:09.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.200 7fe61b958700 1 --2- 172.21.15.79:0/1857458753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe614098200 0x7fe6140d5b00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fe61409b550 tx=0x7fe5fc00bf60).stop 2021-04-09T18:32:09.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.200 7fe61b958700 1 -- 172.21.15.79:0/1857458753 shutdown_connections 2021-04-09T18:32:09.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.200 7fe61b958700 1 --2- 172.21.15.79:0/1857458753 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe5f8029100 0x7fe5f802b650 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:09.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.200 7fe61b958700 1 --2- 172.21.15.79:0/1857458753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe614098650 0x7fe6140ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:09.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.200 7fe61b958700 1 --2- 172.21.15.79:0/1857458753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe614098200 0x7fe6140d5b00 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:09.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.200 7fe61b958700 1 --2- 172.21.15.79:0/1857458753 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6140d6130 0x7fe6140ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:09.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.200 7fe61b958700 1 -- 172.21.15.79:0/1857458753 >> 172.21.15.79:0/1857458753 conn(0x7fe61409aa40 msgr2=0x7fe6140a6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:09.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.200 7fe61b958700 1 -- 172.21.15.79:0/1857458753 shutdown_connections 2021-04-09T18:32:09.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.200 7fe61b958700 1 -- 172.21.15.79:0/1857458753 wait complete. 2021-04-09T18:32:09.222 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-04-09T18:32:09.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.328 7f36b0b11700 1 Processor -- start 2021-04-09T18:32:09.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.328 7f36b0b11700 1 -- start start 2021-04-09T18:32:09.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.328 7f36b0b11700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36ac0f5550 0x7f36ac0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:09.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.328 7f36b0b11700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f36ac1c8040 0x7f36ac1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:09.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.328 7f36b0b11700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ac0fbb50 con 0x7f36ac0e9b10 2021-04-09T18:32:09.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.328 7f36b0b11700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac0e9f60 con 0x7f36ac1c8040 2021-04-09T18:32:09.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.328 7f36b0b11700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac1c3df0 con 0x7f36ac0f5550 2021-04-09T18:32:09.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.328 7f36a9fe5700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f36ac0e9b10 0x7f36ac09f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54142/0 (socket says 172.21.15.79:54142) 2021-04-09T18:32:09.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.328 7f36a9fe5700 1 -- 172.21.15.79:0/3458584428 learned_addr learned my addr 172.21.15.79:0/3458584428 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:09.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.328 7f36aa7e6700 1 --2- 172.21.15.79:0/3458584428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36ac0f5550 0x7f36ac0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:09.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.328 7f36aafe7700 1 --2- 172.21.15.79:0/3458584428 >> v2:172.21.15.89:3300/0 conn(0x7f36ac1c8040 0x7f36ac1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:09.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.328 7f36a97e4700 1 -- 172.21.15.79:0/3458584428 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765738172 0 0) 0x7f36a0001450 con 0x7f36ac0e9b10 2021-04-09T18:32:09.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.328 7f36a97e4700 1 -- 172.21.15.79:0/3458584428 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3694003240 con 0x7f36ac0e9b10 2021-04-09T18:32:09.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.332 7f36aafe7700 1 -- 172.21.15.79:0/3458584428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36ac0f5550 msgr2=0x7f36ac0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:09.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.332 7f36aafe7700 1 --2- 172.21.15.79:0/3458584428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36ac0f5550 0x7f36ac0f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:09.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.332 7f36aafe7700 1 -- 172.21.15.79:0/3458584428 >> v1:172.21.15.79:6789/0 conn(0x7f36ac0e9b10 legacy=0x7f36ac09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:09.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.332 7f36a97e4700 1 -- 172.21.15.79:0/3458584428 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 615152600 0 0) 0x7f36a00019d0 con 0x7f36ac0e9b10 2021-04-09T18:32:09.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.332 7f36aafe7700 1 -- 172.21.15.79:0/3458584428 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac09f910 con 0x7f36ac1c8040 2021-04-09T18:32:09.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.332 7f36aa7e6700 1 --2- 172.21.15.79:0/3458584428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36ac0f5550 0x7f36ac0f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:32:09.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.332 7f36aafe7700 1 --2- 172.21.15.79:0/3458584428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36ac1c8040 0x7f36ac1ca4a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f36a0002170 tx=0x7f36a400bd40).ready entity=mon.1 client_cookie=1161a3067ca5c6dc server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:09.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.332 7f36a97e4700 1 -- 172.21.15.79:0/3458584428 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f36ac09f910 con 0x7f36ac1c8040 2021-04-09T18:32:09.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.332 7f36a97e4700 1 -- 172.21.15.79:0/3458584428 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a4009710 con 0x7f36ac1c8040 2021-04-09T18:32:09.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.332 7f36a97e4700 1 -- 172.21.15.79:0/3458584428 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f36a0001f30 con 0x7f36ac1c8040 2021-04-09T18:32:09.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.332 7f36b0b11700 1 -- 172.21.15.79:0/3458584428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36ac1c8040 msgr2=0x7f36ac1ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:09.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.332 7f36b0b11700 1 --2- 172.21.15.79:0/3458584428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36ac1c8040 0x7f36ac1ca4a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f36a0002170 tx=0x7f36a400bd40).stop 2021-04-09T18:32:09.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.332 7f36b0b11700 1 -- 172.21.15.79:0/3458584428 shutdown_connections 2021-04-09T18:32:09.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.332 7f36b0b11700 1 --2- 172.21.15.79:0/3458584428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36ac1c8040 0x7f36ac1ca4a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:09.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.332 7f36b0b11700 1 --2- 172.21.15.79:0/3458584428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36ac0f5550 0x7f36ac0f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:09.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.332 7f36b0b11700 1 -- 172.21.15.79:0/3458584428 >> 172.21.15.79:0/3458584428 conn(0x7f36ac0e6010 msgr2=0x7f36ac0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:09.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.332 7f36b0b11700 1 -- 172.21.15.79:0/3458584428 shutdown_connections 2021-04-09T18:32:09.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.332 7f36b0b11700 1 -- 172.21.15.79:0/3458584428 wait complete. 2021-04-09T18:32:09.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36b0b11700 1 Processor -- start 2021-04-09T18:32:09.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36b0b11700 1 -- start start 2021-04-09T18:32:09.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36b0b11700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36ac19e4e0 0x7f36ac19d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:09.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36b0b11700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36ac098b40 0x7f36ac0d4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:09.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36b0b11700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36ac0d5120 0x7f36ac0c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:09.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36b0b11700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac088590 con 0x7f36ac19e4e0 2021-04-09T18:32:09.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36b0b11700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac19e1e0 con 0x7f36ac0d5120 2021-04-09T18:32:09.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36b0b11700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac1ae0a0 con 0x7f36ac098b40 2021-04-09T18:32:09.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36aa7e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36ac19e4e0 0x7f36ac19d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:09.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36aa7e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36ac19e4e0 0x7f36ac19d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59442/0 (socket says 172.21.15.79:59442) 2021-04-09T18:32:09.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36aa7e6700 1 -- 172.21.15.79:0/2223168300 learned_addr learned my addr 172.21.15.79:0/2223168300 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:09.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36aafe7700 1 --2- 172.21.15.79:0/2223168300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36ac0d5120 0x7f36ac0c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:09.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36a9fe5700 1 --2- 172.21.15.79:0/2223168300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36ac098b40 0x7f36ac0d4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:09.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36aa7e6700 1 -- 172.21.15.79:0/2223168300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36ac098b40 msgr2=0x7f36ac0d4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:09.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36aa7e6700 1 --2- 172.21.15.79:0/2223168300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36ac098b40 0x7f36ac0d4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:09.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36aa7e6700 1 -- 172.21.15.79:0/2223168300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36ac0d5120 msgr2=0x7f36ac0c1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:09.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36aa7e6700 1 --2- 172.21.15.79:0/2223168300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36ac0d5120 0x7f36ac0c1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:09.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36aa7e6700 1 -- 172.21.15.79:0/2223168300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac0bb3d0 con 0x7f36ac19e4e0 2021-04-09T18:32:09.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36aafe7700 1 --2- 172.21.15.79:0/2223168300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36ac0d5120 0x7f36ac0c1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:32:09.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36aa7e6700 1 --2- 172.21.15.79:0/2223168300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36ac19e4e0 0x7f36ac19d8e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f369c00efc0 tx=0x7f369c00c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:09.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f369affd700 1 -- 172.21.15.79:0/2223168300 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f36ac0bb3d0 con 0x7f36ac19e4e0 2021-04-09T18:32:09.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f369affd700 1 -- 172.21.15.79:0/2223168300 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c0123f0 con 0x7f36ac19e4e0 2021-04-09T18:32:09.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f369affd700 1 -- 172.21.15.79:0/2223168300 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f369c00f040 con 0x7f36ac19e4e0 2021-04-09T18:32:09.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.336 7f36b0b11700 1 -- 172.21.15.79:0/2223168300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ac0d5570 con 0x7f36ac19e4e0 2021-04-09T18:32:09.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.340 7f36b0b11700 1 -- 172.21.15.79:0/2223168300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ac0c2610 con 0x7f36ac19e4e0 2021-04-09T18:32:09.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.340 7f369affd700 1 -- 172.21.15.79:0/2223168300 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f369c011070 con 0x7f36ac19e4e0 2021-04-09T18:32:09.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.340 7f369affd700 1 --2- 172.21.15.79:0/2223168300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3690029100 0x7f369002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:09.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.340 7f369affd700 1 -- 172.21.15.79:0/2223168300 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f369c010040 con 0x7f36ac19e4e0 2021-04-09T18:32:09.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.340 7f36a9fe5700 1 --2- 172.21.15.79:0/2223168300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3690029100 0x7f369002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:09.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.340 7f36a9fe5700 1 --2- 172.21.15.79:0/2223168300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3690029100 0x7f369002b650 crc :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:09.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.344 7f36b0b11700 1 -- 172.21.15.79:0/2223168300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ac0e39f0 con 0x7f36ac19e4e0 2021-04-09T18:32:09.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.348 7f369affd700 1 -- 172.21.15.79:0/2223168300 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f369c000bf0 con 0x7f36ac19e4e0 2021-04-09T18:32:09.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.536 7f36b0b11700 1 -- 172.21.15.79:0/2223168300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f36ac0f5b50 con 0x7f36ac19e4e0 2021-04-09T18:32:09.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.544 7f369affd700 1 -- 172.21.15.79:0/2223168300 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f369c00ca90 con 0x7f36ac19e4e0 2021-04-09T18:32:09.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.548 7f36b0b11700 1 -- 172.21.15.79:0/2223168300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3690029100 msgr2=0x7f369002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:09.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.548 7f36b0b11700 1 --2- 172.21.15.79:0/2223168300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3690029100 0x7f369002b650 crc :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:09.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.548 7f36b0b11700 1 -- 172.21.15.79:0/2223168300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36ac19e4e0 msgr2=0x7f36ac19d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:09.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.548 7f36b0b11700 1 --2- 172.21.15.79:0/2223168300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36ac19e4e0 0x7f36ac19d8e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f369c00efc0 tx=0x7f369c00c430).stop 2021-04-09T18:32:09.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.548 7f36b0b11700 1 -- 172.21.15.79:0/2223168300 shutdown_connections 2021-04-09T18:32:09.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.548 7f36b0b11700 1 --2- 172.21.15.79:0/2223168300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3690029100 0x7f369002b650 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:09.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.548 7f36b0b11700 1 --2- 172.21.15.79:0/2223168300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36ac0d5120 0x7f36ac0c1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:09.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.548 7f36b0b11700 1 --2- 172.21.15.79:0/2223168300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36ac19e4e0 0x7f36ac19d8e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:09.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.548 7f36b0b11700 1 --2- 172.21.15.79:0/2223168300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36ac098b40 0x7f36ac0d4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:09.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.548 7f36b0b11700 1 -- 172.21.15.79:0/2223168300 >> 172.21.15.79:0/2223168300 conn(0x7f36ac0c0680 msgr2=0x7f36ac0d82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:09.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.548 7f36b0b11700 1 -- 172.21.15.79:0/2223168300 shutdown_connections 2021-04-09T18:32:09.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.548 7f36b0b11700 1 -- 172.21.15.79:0/2223168300 wait complete. 2021-04-09T18:32:09.561 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:32:09.562 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:32:09.581 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:32:09.598 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:32:09.618 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:32:09.637 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:32:09.656 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:32:09.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:09.657 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:32:09.658 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:32:09.666 INFO:teuthology.orchestra.run.smithi090.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-04-09T18:32:09.666 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:32:09.667 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-04-09T18:32:09.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:09.668 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:32:09.669 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:32:09.684 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-04-09T18:32:09.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:32:09.686 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-04-09T18:32:09.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:09.687 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:32:09.687 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:32:09.705 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:32:09.706 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:32:09.706 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:32:09.707 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:32:09.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.800 7f71b338f700 1 Processor -- start 2021-04-09T18:32:09.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.800 7f71b338f700 1 -- start start 2021-04-09T18:32:09.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.800 7f71b338f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f71ac0f5520 0x7f71ac0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:09.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.800 7f71b338f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f71ac1c8010 0x7f71ac1ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:09.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.800 7f71b338f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ac0fbb20 con 0x7f71ac0e9ae0 2021-04-09T18:32:09.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.800 7f71b338f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ac0e9f30 con 0x7f71ac0f5520 2021-04-09T18:32:09.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.800 7f71b338f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ac1c3dc0 con 0x7f71ac1c8010 2021-04-09T18:32:09.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.800 7f71b1133700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f71ac0f5520 0x7f71ac0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:09.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.800 7f71b1133700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f71ac0f5520 0x7f71ac0f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59448/0 (socket says 172.21.15.79:59448) 2021-04-09T18:32:09.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.800 7f71b1133700 1 -- 172.21.15.79:0/1591081107 learned_addr learned my addr 172.21.15.79:0/1591081107 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:09.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.800 7f71b1934700 1 --2- 172.21.15.79:0/1591081107 >> v2:172.21.15.89:3300/0 conn(0x7f71ac1c8010 0x7f71ac1ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:09.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.800 7f71b1133700 1 -- 172.21.15.79:0/1591081107 >> v2:172.21.15.89:3300/0 conn(0x7f71ac1c8010 msgr2=0x7f71ac1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:09.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.800 7f71b1133700 1 --2- 172.21.15.79:0/1591081107 >> v2:172.21.15.89:3300/0 conn(0x7f71ac1c8010 0x7f71ac1ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:09.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.800 7f71b1133700 1 -- 172.21.15.79:0/1591081107 >> v1:172.21.15.89:6789/0 conn(0x7f71ac0e9ae0 legacy=0x7f71ac09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:09.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.800 7f71b1133700 1 -- 172.21.15.79:0/1591081107 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac09f910 con 0x7f71ac0f5520 2021-04-09T18:32:09.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.800 7f71b1133700 1 --2- 172.21.15.79:0/1591081107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ac0f5520 0x7f71ac0f64b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f71a8002f30 tx=0x7f71a800bd70).ready entity=mon.0 client_cookie=52f790d72aaf3ed9 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:09.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.804 7f71a3fff700 1 -- 172.21.15.79:0/1591081107 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71ac09f910 con 0x7f71ac0f5520 2021-04-09T18:32:09.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.804 7f71a3fff700 1 -- 172.21.15.79:0/1591081107 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a8009950 con 0x7f71ac0f5520 2021-04-09T18:32:09.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.804 7f71a3fff700 1 -- 172.21.15.79:0/1591081107 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71a8009d20 con 0x7f71ac0f5520 2021-04-09T18:32:09.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.804 7f71b338f700 1 -- 172.21.15.79:0/1591081107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ac0f5520 msgr2=0x7f71ac0f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.804 7f71b338f700 1 --2- 172.21.15.79:0/1591081107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ac0f5520 0x7f71ac0f64b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f71a8002f30 tx=0x7f71a800bd70).stop 2021-04-09T18:32:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.804 7f71b338f700 1 -- 172.21.15.79:0/1591081107 shutdown_connections 2021-04-09T18:32:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.804 7f71b338f700 1 --2- 172.21.15.79:0/1591081107 >> v2:172.21.15.89:3300/0 conn(0x7f71ac1c8010 0x7f71ac1ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.804 7f71b338f700 1 --2- 172.21.15.79:0/1591081107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ac0f5520 0x7f71ac0f64b0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:09.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.804 7f71b338f700 1 -- 172.21.15.79:0/1591081107 >> 172.21.15.79:0/1591081107 conn(0x7f71ac0e5fe0 msgr2=0x7f71ac0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:09.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.804 7f71b338f700 1 -- 172.21.15.79:0/1591081107 shutdown_connections 2021-04-09T18:32:09.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.804 7f71b338f700 1 -- 172.21.15.79:0/1591081107 wait complete. 2021-04-09T18:32:09.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b338f700 1 Processor -- start 2021-04-09T18:32:09.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b338f700 1 -- start start 2021-04-09T18:32:09.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b338f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71ac0b0050 0x7f71ac0986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:09.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b338f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71ac098ce0 0x7f71ac1b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:09.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b338f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ac1b1b20 0x7f71ac1b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b338f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac097110 con 0x7f71ac1b1b20 2021-04-09T18:32:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b338f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac0c0e40 con 0x7f71ac0b0050 2021-04-09T18:32:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b338f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac0b04a0 con 0x7f71ac098ce0 2021-04-09T18:32:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b1934700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ac1b1b20 0x7f71ac1b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b1934700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ac1b1b20 0x7f71ac1b1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59456/0 (socket says 172.21.15.79:59456) 2021-04-09T18:32:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b1934700 1 -- 172.21.15.79:0/4111766816 learned_addr learned my addr 172.21.15.79:0/4111766816 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b1133700 1 --2- 172.21.15.79:0/4111766816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71ac0b0050 0x7f71ac0986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b0932700 1 --2- 172.21.15.79:0/4111766816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71ac098ce0 0x7f71ac1b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b1934700 1 -- 172.21.15.79:0/4111766816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71ac098ce0 msgr2=0x7f71ac1b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b1934700 1 --2- 172.21.15.79:0/4111766816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71ac098ce0 0x7f71ac1b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b1934700 1 -- 172.21.15.79:0/4111766816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71ac0b0050 msgr2=0x7f71ac0986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b1934700 1 --2- 172.21.15.79:0/4111766816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71ac0b0050 0x7f71ac0986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b1934700 1 -- 172.21.15.79:0/4111766816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac0968a0 con 0x7f71ac1b1b20 2021-04-09T18:32:09.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b1934700 1 --2- 172.21.15.79:0/4111766816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ac1b1b20 0x7f71ac1b1f70 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f71a4006de0 tx=0x7f71a400c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:09.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71a1ffb700 1 -- 172.21.15.79:0/4111766816 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71ac0968a0 con 0x7f71ac1b1b20 2021-04-09T18:32:09.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71a1ffb700 1 -- 172.21.15.79:0/4111766816 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a400cca0 con 0x7f71ac1b1b20 2021-04-09T18:32:09.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b338f700 1 -- 172.21.15.79:0/4111766816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ac1ad560 con 0x7f71ac1b1b20 2021-04-09T18:32:09.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71a1ffb700 1 -- 172.21.15.79:0/4111766816 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71a400f040 con 0x7f71ac1b1b20 2021-04-09T18:32:09.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.808 7f71b338f700 1 -- 172.21.15.79:0/4111766816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ac1ada90 con 0x7f71ac1b1b20 2021-04-09T18:32:09.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.812 7f71a1ffb700 1 -- 172.21.15.79:0/4111766816 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f71a4022060 con 0x7f71ac1b1b20 2021-04-09T18:32:09.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.812 7f71a1ffb700 1 --2- 172.21.15.79:0/4111766816 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f718c029100 0x7f718c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:09.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.812 7f71a1ffb700 1 -- 172.21.15.79:0/4111766816 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f71a4010040 con 0x7f71ac1b1b20 2021-04-09T18:32:09.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.812 7f71b1133700 1 --2- 172.21.15.79:0/4111766816 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f718c029100 0x7f718c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:09.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.812 7f71b1133700 1 --2- 172.21.15.79:0/4111766816 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f718c029100 0x7f718c02b650 crc :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:09.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.816 7f71b338f700 1 -- 172.21.15.79:0/4111766816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71ac0e39e0 con 0x7f71ac1b1b20 2021-04-09T18:32:09.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.820 7f71a1ffb700 1 -- 172.21.15.79:0/4111766816 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f71a400ca90 con 0x7f71ac1b1b20 2021-04-09T18:32:09.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.984 7f71b338f700 1 -- 172.21.15.79:0/4111766816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f71ac0bb4f0 con 0x7f71ac1b1b20 2021-04-09T18:32:09.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.984 7f71a1ffb700 1 -- 172.21.15.79:0/4111766816 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v63) v1 ==== 81+0+26073 (secure 0 0 0) 0x7f71a4000f70 con 0x7f71ac1b1b20 2021-04-09T18:32:09.989 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:32:09.989 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:32:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 63, 2021-04-09T18:32:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:32:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:32:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:32:07.130932", 2021-04-09T18:32:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:32:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:32:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:32:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:32:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:32:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:32:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:32:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:32:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:32:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:32:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:32:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:32:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:32:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:32:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:32:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 11, 2021-04-09T18:32:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:32:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:32:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:32:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:32:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:32:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:32:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:32:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:32:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:32:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:32:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:32:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:32:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:32:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:32:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:32:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:32:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:32:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:32:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:32:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:32:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:32:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:32:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:32:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:32:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:32:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:32:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:32:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:32:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:32:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:32:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:32:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:32:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:32:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:32:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:32:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:32:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:32:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:32:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:32:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:32:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:32:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:32:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:32:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:32:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:32:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:32:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:32:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:32:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:32:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:32:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:32:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:32:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:32:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:32:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:32:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:32:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:32:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:32:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:32:10.008 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:32:10.008 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:32:10.008 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:32:10.008 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:32:10.008 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:32:10.009 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:32:10.009 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:32:10.009 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:32:10.009 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:32:10.009 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:32:10.010 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.010 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.010 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:32:10.010 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:32:10.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.011 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:32:10.011 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:32:10.011 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:32:10.011 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:32:10.012 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:32:10.012 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:32:10.012 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:32:10.012 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:32:10.012 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:32:10.013 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 57, 2021-04-09T18:32:10.013 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:32:10.013 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:32:10.013 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:32:10.013 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.014 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.014 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:32:10.014 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:32:10.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.015 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.015 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:32:10.015 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:32:10.016 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.016 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.016 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:32:10.016 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.017 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.017 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:32:10.017 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:32:10.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.018 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.018 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:32:10.018 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:32:10.019 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.019 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.019 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:32:10.019 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.020 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.020 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:32:10.020 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:32:10.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.021 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.021 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:32:10.021 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:32:10.022 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.022 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.022 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:32:10.022 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.023 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.023 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:32:10.023 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:32:10.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.024 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.024 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:32:10.024 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:32:10.024 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.025 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.025 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:32:10.025 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:32:10.026 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:32:10.026 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:32:10.026 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:32:10.026 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:32:10.027 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:32:10.027 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.027 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:32:10.028 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:32:10.028 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:32:10.028 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:32:10.028 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:32:10.028 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:32:10.029 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:32:10.029 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:32:10.029 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:32:10.029 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 57, 2021-04-09T18:32:10.030 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:32:10.030 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:32:10.030 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:32:10.030 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.031 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.031 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:32:10.031 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:32:10.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.032 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.032 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:32:10.032 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:32:10.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.033 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.033 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:32:10.033 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.034 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.034 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:32:10.034 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:32:10.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.035 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.035 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:32:10.035 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:32:10.035 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.035 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.036 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:32:10.036 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.037 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.037 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:32:10.037 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:32:10.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.038 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.038 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:32:10.038 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:32:10.038 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.038 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.039 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:32:10.039 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.039 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.040 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:32:10.040 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:32:10.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.041 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.041 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:32:10.041 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:32:10.041 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.041 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.042 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:32:10.042 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:32:10.042 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:32:10.042 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:32:10.043 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:32:10.043 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:32:10.043 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:32:10.043 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.044 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:32:10.044 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:32:10.044 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:32:10.045 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:32:10.045 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:32:10.045 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:32:10.045 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:32:10.045 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:32:10.046 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:32:10.046 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 57, 2021-04-09T18:32:10.046 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:32:10.046 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:32:10.046 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:32:10.047 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.047 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.047 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:32:10.047 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:32:10.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.048 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.048 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:32:10.049 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:32:10.049 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.049 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.049 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:32:10.050 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.050 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.050 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:32:10.050 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:32:10.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.051 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.051 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:32:10.051 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:32:10.052 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.052 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.052 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:32:10.053 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.053 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.053 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:32:10.053 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:32:10.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.054 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.054 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:32:10.054 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:32:10.055 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.055 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.055 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:32:10.055 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.056 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.056 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:32:10.056 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:32:10.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.057 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.057 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:32:10.057 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:32:10.058 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.058 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.058 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:32:10.058 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:32:10.059 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:32:10.059 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:32:10.059 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:32:10.059 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:32:10.059 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:32:10.060 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.060 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:32:10.060 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:32:10.061 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:32:10.061 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:32:10.061 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:32:10.061 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:32:10.061 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:32:10.062 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:32:10.062 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:32:10.062 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 47, 2021-04-09T18:32:10.062 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:32:10.063 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:32:10.063 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:32:10.063 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.064 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:32:10.064 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:32:10.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.064 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.065 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:32:10.065 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:32:10.065 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.065 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.066 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:32:10.066 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.066 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.067 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:32:10.067 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:32:10.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.067 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.068 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:32:10.068 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:32:10.068 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.068 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.069 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:32:10.069 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.069 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.069 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:32:10.070 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:32:10.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.070 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.071 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:32:10.071 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:32:10.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.071 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.072 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:32:10.072 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.072 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.072 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:32:10.073 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:32:10.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.073 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.073 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:32:10.074 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:32:10.074 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.074 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.074 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:32:10.075 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:32:10.075 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:32:10.075 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:32:10.075 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:32:10.075 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:32:10.076 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:32:10.076 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.077 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:32:10.077 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:32:10.077 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:32:10.077 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:32:10.077 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:32:10.078 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:32:10.078 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:32:10.078 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:32:10.078 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:32:10.078 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 56, 2021-04-09T18:32:10.079 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:32:10.079 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:32:10.079 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:32:10.079 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.080 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.080 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:32:10.080 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:32:10.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.081 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.081 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:32:10.081 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:32:10.081 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.082 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.082 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:32:10.082 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.083 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.083 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:32:10.083 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:32:10.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.084 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.084 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:32:10.084 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:32:10.084 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.085 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.085 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:32:10.085 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.086 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.086 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:32:10.086 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:32:10.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.087 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.087 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:32:10.087 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:32:10.087 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.088 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.088 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:32:10.088 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.089 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.089 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:32:10.089 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:32:10.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.090 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.090 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:32:10.090 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:32:10.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.091 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.091 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:32:10.091 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:32:10.091 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:32:10.092 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:32:10.092 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:32:10.092 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:32:10.092 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:32:10.092 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.093 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:32:10.093 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:32:10.093 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:32:10.094 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:32:10.094 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:32:10.094 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:32:10.094 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:32:10.095 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:32:10.095 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:32:10.095 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 57, 2021-04-09T18:32:10.095 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:32:10.095 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:32:10.096 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:32:10.096 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.096 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.096 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:32:10.097 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:32:10.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.097 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.097 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:32:10.098 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:32:10.098 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.098 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.098 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:32:10.099 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.099 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.099 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:32:10.100 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:32:10.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.100 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.100 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:32:10.101 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:32:10.101 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.101 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.101 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:32:10.102 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.102 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.102 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:32:10.102 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:32:10.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.103 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.103 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:32:10.103 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:32:10.104 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.104 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.104 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:32:10.105 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.105 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.105 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:32:10.105 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:32:10.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.106 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.106 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:32:10.106 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:32:10.107 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.107 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.107 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:32:10.107 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:32:10.108 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:32:10.108 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:32:10.108 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:32:10.108 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:32:10.109 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:32:10.109 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.109 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:32:10.110 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:32:10.110 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:32:10.110 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:32:10.110 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:32:10.110 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:32:10.111 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:32:10.111 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:32:10.111 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:32:10.111 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 57, 2021-04-09T18:32:10.111 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:32:10.112 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:32:10.112 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:32:10.112 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.112 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.113 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:32:10.113 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:32:10.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.113 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.114 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:32:10.114 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:32:10.114 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.114 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.115 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:32:10.115 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.115 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.116 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:32:10.116 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:32:10.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.116 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.117 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:32:10.117 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:32:10.117 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.117 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.118 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:32:10.118 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.118 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.118 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:32:10.119 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:32:10.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.119 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.119 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:32:10.120 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:32:10.120 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.120 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.121 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:32:10.121 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.121 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.121 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:32:10.122 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:32:10.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.122 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.122 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:32:10.123 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:32:10.123 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.123 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.123 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:32:10.124 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:32:10.124 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:32:10.124 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:32:10.124 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:32:10.125 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:32:10.125 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:32:10.125 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.126 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:32:10.126 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:32:10.126 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:32:10.126 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:32:10.126 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:32:10.127 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:32:10.127 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:32:10.127 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:32:10.127 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:32:10.127 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 57, 2021-04-09T18:32:10.128 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:32:10.128 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:32:10.128 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:32:10.128 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.129 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.129 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:32:10.129 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:32:10.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.130 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.130 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:32:10.130 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:32:10.130 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.131 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.131 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:32:10.131 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.132 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.132 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:32:10.132 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:32:10.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.133 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:32:10.133 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:32:10.133 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.133 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.134 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:32:10.134 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.134 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.135 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:32:10.135 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:32:10.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.136 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.136 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:32:10.136 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:32:10.136 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.136 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.137 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:32:10.137 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:32:10.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.137 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:32:10.138 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:32:10.138 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:32:10.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.138 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:32:10.139 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:32:10.139 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:32:10.139 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.139 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.140 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:32:10.140 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:32:10.140 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:32:10.140 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:32:10.141 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:32:10.141 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:32:10.141 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:32:10.141 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:10.141 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.142 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:32:10.142 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:32:10.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.142 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:32:10.142 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:32:10.143 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:32:10.143 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:32:10.143 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:32:10.143 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:32:10.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.144 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:32:10.144 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:32:10.144 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:32:10.144 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:32:10.145 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:32:10.145 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:32:10.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.145 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:32:10.146 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:32:10.146 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:32:10.146 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:32:10.146 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:32:10.146 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:32:10.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.147 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:32:10.147 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:32:10.148 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:32:10.148 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:32:10.148 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:32:10.148 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:32:10.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.149 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:32:10.149 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:32:10.149 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:32:10.149 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:32:10.150 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:32:10.150 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:32:10.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.150 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:32:10.151 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:32:10.151 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:32:10.151 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:32:10.151 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:32:10.151 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:32:10.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.152 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:32:10.152 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:32:10.152 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:32:10.153 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:32:10.153 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:32:10.153 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:32:10.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:10.154 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:32:10.154 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:32:10.154 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:32:10.154 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:32:10.155 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:32:10.155 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:32:10.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.155 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:32:10.155 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:32:10.156 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:32:10.156 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:32:10.156 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:32:10.156 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": { 2021-04-09T18:32:10.157 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.79:6833/4166243574": "2021-04-10 18:32:03.844614", 2021-04-09T18:32:10.157 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6835/3190188639": "2021-04-10 18:31:31.735114", 2021-04-09T18:32:10.157 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.79:6832/4166243574": "2021-04-10 18:32:03.844614", 2021-04-09T18:32:10.157 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6834/3190188639": "2021-04-10 18:31:31.735114" 2021-04-09T18:32:10.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.158 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:32:10.158 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:32:10.158 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:32:10.158 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:32:10.158 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:32:10.159 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:32:10.159 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:32:10.159 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:32:10.159 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:32:10.159 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:32:10.160 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:32:10.160 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:32:10.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.160 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:32:10.160 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:32:10.161 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:32:10.161 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:32:10.161 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:32:10.161 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:32:10.161 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:32:10.162 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:10.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:10.162 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:32:10.162 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:32:10.162 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:32:10.163 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:32:10.163 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:32:10.163 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:32:10.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.988 7f71b338f700 1 -- 172.21.15.79:0/4111766816 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f718c029100 msgr2=0x7f718c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:10.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.988 7f71b338f700 1 --2- 172.21.15.79:0/4111766816 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f718c029100 0x7f718c02b650 crc :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.988 7f71b338f700 1 -- 172.21.15.79:0/4111766816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ac1b1b20 msgr2=0x7f71ac1b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:10.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.988 7f71b338f700 1 --2- 172.21.15.79:0/4111766816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ac1b1b20 0x7f71ac1b1f70 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f71a4006de0 tx=0x7f71a400c430).stop 2021-04-09T18:32:10.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.988 7f71b338f700 1 -- 172.21.15.79:0/4111766816 shutdown_connections 2021-04-09T18:32:10.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.988 7f71b338f700 1 --2- 172.21.15.79:0/4111766816 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f718c029100 0x7f718c02b650 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.988 7f71b338f700 1 --2- 172.21.15.79:0/4111766816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71ac0b0050 0x7f71ac0986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.988 7f71b338f700 1 --2- 172.21.15.79:0/4111766816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ac1b1b20 0x7f71ac1b1f70 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.988 7f71b338f700 1 --2- 172.21.15.79:0/4111766816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71ac098ce0 0x7f71ac1b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.988 7f71b338f700 1 -- 172.21.15.79:0/4111766816 >> 172.21.15.79:0/4111766816 conn(0x7f71ac09a350 msgr2=0x7f71ac0d84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:10.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.988 7f71b338f700 1 -- 172.21.15.79:0/4111766816 shutdown_connections 2021-04-09T18:32:10.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:09.988 7f71b338f700 1 -- 172.21.15.79:0/4111766816 wait complete. 2021-04-09T18:32:10.168 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:32:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.264 7ff33cfc7700 1 Processor -- start 2021-04-09T18:32:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.264 7ff33cfc7700 1 -- start start 2021-04-09T18:32:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.264 7ff33cfc7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3380e9ad0 0x7ff33809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.264 7ff33cfc7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3380fbb10 con 0x7ff3381c8000 2021-04-09T18:32:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.264 7ff33cfc7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3380e56c0 con 0x7ff3380f5510 2021-04-09T18:32:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.264 7ff33cfc7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3381c3db0 con 0x7ff3380e9ad0 2021-04-09T18:32:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.264 7ff3372f0700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff3381c8000 0x7ff3381ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54174/0 (socket says 172.21.15.79:54174) 2021-04-09T18:32:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.268 7ff3372f0700 1 -- 172.21.15.79:0/2220927155 learned_addr learned my addr 172.21.15.79:0/2220927155 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:10.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.268 7ff3362ee700 1 --2- 172.21.15.79:0/2220927155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3380e9ad0 0x7ff33809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:10.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.268 7ff335aed700 1 -- 172.21.15.79:0/2220927155 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160047950 0 0) 0x7ff330001450 con 0x7ff3381c8000 2021-04-09T18:32:10.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.268 7ff335aed700 1 -- 172.21.15.79:0/2220927155 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff320003240 con 0x7ff3381c8000 2021-04-09T18:32:10.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.268 7ff335aed700 1 -- 172.21.15.79:0/2220927155 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999635820 0 0) 0x7ff3280010d0 con 0x7ff3380f5510 2021-04-09T18:32:10.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.268 7ff335aed700 1 -- 172.21.15.79:0/2220927155 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff320003620 con 0x7ff3380f5510 2021-04-09T18:32:10.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.268 7ff3362ee700 1 -- 172.21.15.79:0/2220927155 >> v1:172.21.15.89:6789/0 conn(0x7ff3380f5510 legacy=0x7ff3380f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:10.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.268 7ff3362ee700 1 -- 172.21.15.79:0/2220927155 >> v1:172.21.15.79:6789/0 conn(0x7ff3381c8000 legacy=0x7ff3381ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:10.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.268 7ff3362ee700 1 -- 172.21.15.79:0/2220927155 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3380e4320 con 0x7ff3380e9ad0 2021-04-09T18:32:10.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.268 7ff3362ee700 1 --2- 172.21.15.79:0/2220927155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3380e9ad0 0x7ff33809f100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ff32c002f30 tx=0x7ff32c00bcf0).ready entity=mon.2 client_cookie=bdfafac7d8e3a5e0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:10.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.268 7ff335aed700 1 -- 172.21.15.79:0/2220927155 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff3380e4320 con 0x7ff3380e9ad0 2021-04-09T18:32:10.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.268 7ff335aed700 1 -- 172.21.15.79:0/2220927155 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c009920 con 0x7ff3380e9ad0 2021-04-09T18:32:10.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.268 7ff335aed700 1 -- 172.21.15.79:0/2220927155 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff32c009cf0 con 0x7ff3380e9ad0 2021-04-09T18:32:10.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.268 7ff33cfc7700 1 -- 172.21.15.79:0/2220927155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3380e9ad0 msgr2=0x7ff33809f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.268 7ff33cfc7700 1 --2- 172.21.15.79:0/2220927155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3380e9ad0 0x7ff33809f100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ff32c002f30 tx=0x7ff32c00bcf0).stop 2021-04-09T18:32:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.268 7ff33cfc7700 1 -- 172.21.15.79:0/2220927155 shutdown_connections 2021-04-09T18:32:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.268 7ff33cfc7700 1 --2- 172.21.15.79:0/2220927155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3380e9ad0 0x7ff33809f100 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.268 7ff33cfc7700 1 -- 172.21.15.79:0/2220927155 >> 172.21.15.79:0/2220927155 conn(0x7ff3380e5fd0 msgr2=0x7ff3380e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.268 7ff33cfc7700 1 -- 172.21.15.79:0/2220927155 shutdown_connections 2021-04-09T18:32:10.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.268 7ff33cfc7700 1 -- 172.21.15.79:0/2220927155 wait complete. 2021-04-09T18:32:10.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.272 7ff33cfc7700 1 Processor -- start 2021-04-09T18:32:10.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.272 7ff33cfc7700 1 -- start start 2021-04-09T18:32:10.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff33cfc7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3380d4f00 0x7ff3380d6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:10.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff33cfc7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff338091140 0x7ff338091590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:10.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff33cfc7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3380ce6d0 0x7ff3380ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:10.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff33cfc7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3380e9f20 con 0x7ff3380ce6d0 2021-04-09T18:32:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff33cfc7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff338090e40 con 0x7ff3380d4f00 2021-04-09T18:32:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff33cfc7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3380d6d40 con 0x7ff338091140 2021-04-09T18:32:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff3372f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3380ce6d0 0x7ff3380ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff3372f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3380ce6d0 0x7ff3380ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59470/0 (socket says 172.21.15.79:59470) 2021-04-09T18:32:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff3362ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff338091140 0x7ff338091590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff3372f0700 1 -- 172.21.15.79:0/2081814198 learned_addr learned my addr 172.21.15.79:0/2081814198 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff336aef700 1 --2- 172.21.15.79:0/2081814198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3380d4f00 0x7ff3380d6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff3372f0700 1 -- 172.21.15.79:0/2081814198 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff338091140 msgr2=0x7ff338091590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff3372f0700 1 --2- 172.21.15.79:0/2081814198 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff338091140 0x7ff338091590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff3372f0700 1 -- 172.21.15.79:0/2081814198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3380d4f00 msgr2=0x7ff3380d6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:10.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff3372f0700 1 --2- 172.21.15.79:0/2081814198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3380d4f00 0x7ff3380d6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff3372f0700 1 -- 172.21.15.79:0/2081814198 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3380cf150 con 0x7ff3380ce6d0 2021-04-09T18:32:10.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff3372f0700 1 --2- 172.21.15.79:0/2081814198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3380ce6d0 0x7ff3380ceb20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7ff330000f00 tx=0x7ff33000ce30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:10.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff3277fe700 1 -- 172.21.15.79:0/2081814198 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff3380cf150 con 0x7ff3380ce6d0 2021-04-09T18:32:10.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff3277fe700 1 -- 172.21.15.79:0/2081814198 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff330005b80 con 0x7ff3380ce6d0 2021-04-09T18:32:10.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff33cfc7700 1 -- 172.21.15.79:0/2081814198 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff338091c70 con 0x7ff3380ce6d0 2021-04-09T18:32:10.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff3277fe700 1 -- 172.21.15.79:0/2081814198 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff330007110 con 0x7ff3380ce6d0 2021-04-09T18:32:10.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff33cfc7700 1 -- 172.21.15.79:0/2081814198 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3380909d0 con 0x7ff3380ce6d0 2021-04-09T18:32:10.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff3277fe700 1 -- 172.21.15.79:0/2081814198 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff33001a060 con 0x7ff3380ce6d0 2021-04-09T18:32:10.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff3277fe700 1 --2- 172.21.15.79:0/2081814198 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff31c029100 0x7ff31c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:10.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff3277fe700 1 -- 172.21.15.79:0/2081814198 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5276+0+0 (secure 0 0 0) 0x7ff330038ce0 con 0x7ff3380ce6d0 2021-04-09T18:32:10.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.276 7ff336aef700 1 --2- 172.21.15.79:0/2081814198 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff31c029100 0x7ff31c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:10.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.280 7ff33cfc7700 1 -- 172.21.15.79:0/2081814198 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3380e39d0 con 0x7ff3380ce6d0 2021-04-09T18:32:10.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.280 7ff336aef700 1 --2- 172.21.15.79:0/2081814198 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff31c029100 0x7ff31c02b650 crc :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:10.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.284 7ff3277fe700 1 -- 172.21.15.79:0/2081814198 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff3380f76b0 con 0x7ff3380ce6d0 2021-04-09T18:32:10.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.452 7ff33cfc7700 1 -- 172.21.15.79:0/2081814198 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3380a1cb0 con 0x7ff3380ce6d0 2021-04-09T18:32:10.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.452 7ff3277fe700 1 -- 172.21.15.79:0/2081814198 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+1177 (secure 0 0 0) 0x7ff330005970 con 0x7ff3380ce6d0 2021-04-09T18:32:10.455 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 36 2021-04-09T18:32:10.456 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:32:10.456 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":36,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5369,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/2729581928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2729581928},{"type":"v1","addr":"172.21.15.89:6835","nonce":2729581928}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":32},{"gid":6078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/2298507264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2298507264},{"type":"v1","addr":"172.21.15.79:6833","nonce":2298507264}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":36}],"filesystems":[]} 2021-04-09T18:32:10.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.452 7ff33cfc7700 1 -- 172.21.15.79:0/2081814198 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff31c029100 msgr2=0x7ff31c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:10.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.452 7ff33cfc7700 1 --2- 172.21.15.79:0/2081814198 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff31c029100 0x7ff31c02b650 crc :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.452 7ff33cfc7700 1 -- 172.21.15.79:0/2081814198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3380ce6d0 msgr2=0x7ff3380ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:10.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.452 7ff33cfc7700 1 --2- 172.21.15.79:0/2081814198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3380ce6d0 0x7ff3380ceb20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7ff330000f00 tx=0x7ff33000ce30).stop 2021-04-09T18:32:10.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.452 7ff33cfc7700 1 -- 172.21.15.79:0/2081814198 shutdown_connections 2021-04-09T18:32:10.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.452 7ff33cfc7700 1 --2- 172.21.15.79:0/2081814198 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff31c029100 0x7ff31c02b650 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.452 7ff33cfc7700 1 --2- 172.21.15.79:0/2081814198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3380d4f00 0x7ff3380d6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.452 7ff33cfc7700 1 --2- 172.21.15.79:0/2081814198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3380ce6d0 0x7ff3380ceb20 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.452 7ff33cfc7700 1 --2- 172.21.15.79:0/2081814198 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff338091140 0x7ff338091590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.452 7ff33cfc7700 1 -- 172.21.15.79:0/2081814198 >> 172.21.15.79:0/2081814198 conn(0x7ff3380d8300 msgr2=0x7ff338092d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:10.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.456 7ff33cfc7700 1 -- 172.21.15.79:0/2081814198 shutdown_connections 2021-04-09T18:32:10.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.456 7ff33cfc7700 1 -- 172.21.15.79:0/2081814198 wait complete. 2021-04-09T18:32:10.467 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:32:10.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bfb43700 1 Processor -- start 2021-04-09T18:32:10.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bfb43700 1 -- start start 2021-04-09T18:32:10.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bfb43700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd3b80f5510 0x7fd3b80f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:10.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bfb43700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80e9ad0 0x7fd3b809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:10.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bfb43700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b80fbb10 con 0x7fd3b81c2da0 2021-04-09T18:32:10.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bfb43700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b80e9f20 con 0x7fd3b80f5510 2021-04-09T18:32:10.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bfb43700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80e59c0 con 0x7fd3b80e9ad0 2021-04-09T18:32:10.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3be0e8700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd3b81c2da0 0x7fd3b81c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54188/0 (socket says 172.21.15.79:54188) 2021-04-09T18:32:10.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3be0e8700 1 -- 172.21.15.79:0/3465012834 learned_addr learned my addr 172.21.15.79:0/3465012834 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:10.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bd8e7700 1 --2- 172.21.15.79:0/3465012834 >> v2:172.21.15.89:3300/0 conn(0x7fd3b80f5510 0x7fd3b80f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:10.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bd0e6700 1 --2- 172.21.15.79:0/3465012834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80e9ad0 0x7fd3b809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:10.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bc8e5700 1 -- 172.21.15.79:0/3465012834 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088273266 0 0) 0x7fd3b00010d0 con 0x7fd3b81c2da0 2021-04-09T18:32:10.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bc8e5700 1 -- 172.21.15.79:0/3465012834 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3a4003240 con 0x7fd3b81c2da0 2021-04-09T18:32:10.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bd8e7700 1 -- 172.21.15.79:0/3465012834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80e9ad0 msgr2=0x7fd3b809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:10.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bd8e7700 1 --2- 172.21.15.79:0/3465012834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80e9ad0 0x7fd3b809f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bd8e7700 1 -- 172.21.15.79:0/3465012834 >> v1:172.21.15.79:6789/0 conn(0x7fd3b81c2da0 legacy=0x7fd3b81c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:10.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bc8e5700 1 -- 172.21.15.79:0/3465012834 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3066904467 0 0) 0x7fd3b0001650 con 0x7fd3b81c2da0 2021-04-09T18:32:10.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bd8e7700 1 -- 172.21.15.79:0/3465012834 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b80e56c0 con 0x7fd3b80f5510 2021-04-09T18:32:10.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bd8e7700 1 --2- 172.21.15.79:0/3465012834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b80f5510 0x7fd3b80f64a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fd3b4002f30 tx=0x7fd3b400bd40).ready entity=mon.1 client_cookie=6b7c6d3ebde04610 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:10.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bc8e5700 1 -- 172.21.15.79:0/3465012834 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd3b80e56c0 con 0x7fd3b80f5510 2021-04-09T18:32:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bc8e5700 1 -- 172.21.15.79:0/3465012834 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b4009850 con 0x7fd3b80f5510 2021-04-09T18:32:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bc8e5700 1 -- 172.21.15.79:0/3465012834 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd3b4009c20 con 0x7fd3b80f5510 2021-04-09T18:32:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bfb43700 1 -- 172.21.15.79:0/3465012834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b80f5510 msgr2=0x7fd3b80f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.560 7fd3bfb43700 1 --2- 172.21.15.79:0/3465012834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b80f5510 0x7fd3b80f64a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fd3b4002f30 tx=0x7fd3b400bd40).stop 2021-04-09T18:32:10.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.564 7fd3bfb43700 1 -- 172.21.15.79:0/3465012834 shutdown_connections 2021-04-09T18:32:10.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.564 7fd3bfb43700 1 --2- 172.21.15.79:0/3465012834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b80f5510 0x7fd3b80f64a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.564 7fd3bfb43700 1 --2- 172.21.15.79:0/3465012834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80e9ad0 0x7fd3b809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.564 7fd3bfb43700 1 -- 172.21.15.79:0/3465012834 >> 172.21.15.79:0/3465012834 conn(0x7fd3b80e5fd0 msgr2=0x7fd3b80e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:10.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.564 7fd3bfb43700 1 -- 172.21.15.79:0/3465012834 shutdown_connections 2021-04-09T18:32:10.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.564 7fd3bfb43700 1 -- 172.21.15.79:0/3465012834 wait complete. 2021-04-09T18:32:10.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.564 7fd3bfb43700 1 Processor -- start 2021-04-09T18:32:10.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.564 7fd3bfb43700 1 -- start start 2021-04-09T18:32:10.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3bfb43700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b8097890 0x7fd3b80a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:10.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3bfb43700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b8098000 0x7fd3b80c3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:10.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3bfb43700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b80c3750 0x7fd3b80961d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:10.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3bfb43700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b8098900 con 0x7fd3b8098000 2021-04-09T18:32:10.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3bfb43700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b8098c00 con 0x7fd3b80c3750 2021-04-09T18:32:10.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3bfb43700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80abb40 con 0x7fd3b8097890 2021-04-09T18:32:10.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3bd0e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b8098000 0x7fd3b80c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:10.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3bd0e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b8098000 0x7fd3b80c3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59482/0 (socket says 172.21.15.79:59482) 2021-04-09T18:32:10.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3bd0e6700 1 -- 172.21.15.79:0/4092574269 learned_addr learned my addr 172.21.15.79:0/4092574269 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:10.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3be0e8700 1 --2- 172.21.15.79:0/4092574269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b80c3750 0x7fd3b80961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:10.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3bd8e7700 1 --2- 172.21.15.79:0/4092574269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b8097890 0x7fd3b80a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:10.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3bd0e6700 1 -- 172.21.15.79:0/4092574269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b8097890 msgr2=0x7fd3b80a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:10.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3bd0e6700 1 --2- 172.21.15.79:0/4092574269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b8097890 0x7fd3b80a4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3bd0e6700 1 -- 172.21.15.79:0/4092574269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b80c3750 msgr2=0x7fd3b80961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:10.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3bd0e6700 1 --2- 172.21.15.79:0/4092574269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b80c3750 0x7fd3b80961d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3bd0e6700 1 -- 172.21.15.79:0/4092574269 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b80c3ba0 con 0x7fd3b8098000 2021-04-09T18:32:10.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3bd0e6700 1 --2- 172.21.15.79:0/4092574269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b8098000 0x7fd3b80c3120 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7fd3ac00efc0 tx=0x7fd3ac00c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:10.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3aa7fc700 1 -- 172.21.15.79:0/4092574269 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd3b80c3ba0 con 0x7fd3b8098000 2021-04-09T18:32:10.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3aa7fc700 1 -- 172.21.15.79:0/4092574269 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac00cca0 con 0x7fd3b8098000 2021-04-09T18:32:10.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3bfb43700 1 -- 172.21.15.79:0/4092574269 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b81c0800 con 0x7fd3b8098000 2021-04-09T18:32:10.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3aa7fc700 1 -- 172.21.15.79:0/4092574269 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd3ac00f040 con 0x7fd3b8098000 2021-04-09T18:32:10.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3bfb43700 1 -- 172.21.15.79:0/4092574269 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b8096800 con 0x7fd3b8098000 2021-04-09T18:32:10.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3aa7fc700 1 -- 172.21.15.79:0/4092574269 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd3ac011070 con 0x7fd3b8098000 2021-04-09T18:32:10.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3aa7fc700 1 --2- 172.21.15.79:0/4092574269 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3a0029100 0x7fd3a002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:10.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3aa7fc700 1 -- 172.21.15.79:0/4092574269 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5276+0+0 (secure 0 0 0) 0x7fd3ac010040 con 0x7fd3b8098000 2021-04-09T18:32:10.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.568 7fd3bd8e7700 1 --2- 172.21.15.79:0/4092574269 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3a0029100 0x7fd3a002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:10.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.572 7fd3bd8e7700 1 --2- 172.21.15.79:0/4092574269 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3a0029100 0x7fd3a002b650 crc :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:10.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.572 7fd3bfb43700 1 -- 172.21.15.79:0/4092574269 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b80e39d0 con 0x7fd3b8098000 2021-04-09T18:32:10.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.580 7fd3aa7fc700 1 -- 172.21.15.79:0/4092574269 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd3ac000f70 con 0x7fd3b8098000 2021-04-09T18:32:10.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.744 7fd3bfb43700 1 -- 172.21.15.79:0/4092574269 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3b81b00d0 con 0x7fd3b8098000 2021-04-09T18:32:10.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.744 7fd3aa7fc700 1 -- 172.21.15.79:0/4092574269 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+1177 (secure 0 0 0) 0x7fd3ac00ca90 con 0x7fd3b8098000 2021-04-09T18:32:10.749 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 36 2021-04-09T18:32:10.749 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:32:10.750 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":36,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5369,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/2729581928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2729581928},{"type":"v1","addr":"172.21.15.89:6835","nonce":2729581928}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":32},{"gid":6078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/2298507264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2298507264},{"type":"v1","addr":"172.21.15.79:6833","nonce":2298507264}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":36}],"filesystems":[]} 2021-04-09T18:32:10.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.748 7fd3bfb43700 1 -- 172.21.15.79:0/4092574269 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3a0029100 msgr2=0x7fd3a002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:10.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.748 7fd3bfb43700 1 --2- 172.21.15.79:0/4092574269 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3a0029100 0x7fd3a002b650 crc :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.748 7fd3bfb43700 1 -- 172.21.15.79:0/4092574269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b8098000 msgr2=0x7fd3b80c3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:10.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.748 7fd3bfb43700 1 --2- 172.21.15.79:0/4092574269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b8098000 0x7fd3b80c3120 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7fd3ac00efc0 tx=0x7fd3ac00c430).stop 2021-04-09T18:32:10.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.748 7fd3bfb43700 1 -- 172.21.15.79:0/4092574269 shutdown_connections 2021-04-09T18:32:10.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.748 7fd3bfb43700 1 --2- 172.21.15.79:0/4092574269 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3a0029100 0x7fd3a002b650 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.748 7fd3bfb43700 1 --2- 172.21.15.79:0/4092574269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b80c3750 0x7fd3b80961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.748 7fd3bfb43700 1 --2- 172.21.15.79:0/4092574269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b8097890 0x7fd3b80a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.748 7fd3bfb43700 1 --2- 172.21.15.79:0/4092574269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b8098000 0x7fd3b80c3120 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.748 7fd3bfb43700 1 -- 172.21.15.79:0/4092574269 >> 172.21.15.79:0/4092574269 conn(0x7fd3b80afd60 msgr2=0x7fd3b80a6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:10.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.748 7fd3bfb43700 1 -- 172.21.15.79:0/4092574269 shutdown_connections 2021-04-09T18:32:10.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.748 7fd3bfb43700 1 -- 172.21.15.79:0/4092574269 wait complete. 2021-04-09T18:32:10.764 INFO:tasks.ceph.mds.a:Restarting daemon 2021-04-09T18:32:10.764 INFO:tasks.ceph.mds.a:Stopping old one... 2021-04-09T18:32:10.765 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-04-09T18:32:10.765 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:32:10.766 INFO:tasks.ceph.mds.b:Restarting daemon 2021-04-09T18:32:10.766 INFO:tasks.ceph.mds.b:Stopping old one... 2021-04-09T18:32:10.767 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-04-09T18:32:10.767 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:32:10.778 INFO:tasks.ceph.mds.a:Stopped 2021-04-09T18:32:10.778 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-04-09T18:32:10.781 INFO:tasks.ceph.mds.b:Stopped 2021-04-09T18:32:10.782 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-04-09T18:32:10.823 INFO:tasks.ceph.mds.a:Started 2021-04-09T18:32:10.824 DEBUG:teuthology.parallel:result is None 2021-04-09T18:32:10.827 INFO:tasks.ceph.mds.b:Started 2021-04-09T18:32:10.827 DEBUG:teuthology.parallel:result is None 2021-04-09T18:32:10.828 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-04-09T18:32:10.898 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2021-04-09T18:32:10.904 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2021-04-09T18:32:10.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.920 7f900727c700 1 Processor -- start 2021-04-09T18:32:10.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.920 7f900727c700 1 -- start start 2021-04-09T18:32:10.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.920 7f900727c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f90000f5520 0x7f90000f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:10.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.920 7f900727c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90000e9ae0 0x7f900009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:10.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.920 7f900727c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90000fbb20 con 0x7f90001c2db0 2021-04-09T18:32:10.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.920 7f900727c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90000e9f30 con 0x7f90000f5520 2021-04-09T18:32:10.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.920 7f900727c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90000e59d0 con 0x7f90000e9ae0 2021-04-09T18:32:10.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.920 7f9005821700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f90001c2db0 0x7f90001c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54214/0 (socket says 172.21.15.79:54214) 2021-04-09T18:32:10.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.920 7f9005821700 1 -- 172.21.15.79:0/2130092517 learned_addr learned my addr 172.21.15.79:0/2130092517 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:10.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.920 7f900481f700 1 --2- 172.21.15.79:0/2130092517 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90000e9ae0 0x7f900009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:10.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.920 7f9005020700 1 --2- 172.21.15.79:0/2130092517 >> v2:172.21.15.89:3300/0 conn(0x7f90000f5520 0x7f90000f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:10.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.920 7f8ff7fff700 1 -- 172.21.15.79:0/2130092517 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252769108 0 0) 0x7f8ff8001450 con 0x7f90001c2db0 2021-04-09T18:32:10.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.920 7f8ff7fff700 1 -- 172.21.15.79:0/2130092517 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fec003240 con 0x7f90001c2db0 2021-04-09T18:32:10.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f8ff7fff700 1 -- 172.21.15.79:0/2130092517 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3132273947 0 0) 0x7f8ff80019d0 con 0x7f90001c2db0 2021-04-09T18:32:10.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f8ff7fff700 1 -- 172.21.15.79:0/2130092517 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90000e9ae0 msgr2=0x7f900009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:10.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f8ff7fff700 1 --2- 172.21.15.79:0/2130092517 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90000e9ae0 0x7f900009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f8ff7fff700 1 -- 172.21.15.79:0/2130092517 >> v2:172.21.15.89:3300/0 conn(0x7f90000f5520 msgr2=0x7f90000f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:10.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f8ff7fff700 1 --2- 172.21.15.79:0/2130092517 >> v2:172.21.15.89:3300/0 conn(0x7f90000f5520 0x7f90000f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f8ff7fff700 1 -- 172.21.15.79:0/2130092517 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90000e56d0 con 0x7f90001c2db0 2021-04-09T18:32:10.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f8ff7fff700 1 -- 172.21.15.79:0/2130092517 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f8ff8001f30 con 0x7f90001c2db0 2021-04-09T18:32:10.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f8ff7fff700 1 -- 172.21.15.79:0/2130092517 >> v1:172.21.15.79:6789/0 conn(0x7f90001c2db0 legacy=0x7f90001c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:10.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f8ff7fff700 1 --2- 172.21.15.79:0/2130092517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fec0038c0 0x7f8fec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:10.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f8ff7fff700 1 --2- 172.21.15.79:0/2130092517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fec0045a0 0x7f8fec0049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:10.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f8ff7fff700 1 --2- 172.21.15.79:0/2130092517 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fec04d7f0 0x7f8fec04fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:10.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f8ff7fff700 1 -- 172.21.15.79:0/2130092517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90000e9f30 con 0x7f8fec0045a0 2021-04-09T18:32:10.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f8ff7fff700 1 -- 172.21.15.79:0/2130092517 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90000e59d0 con 0x7f8fec0038c0 2021-04-09T18:32:10.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f8ff7fff700 1 -- 172.21.15.79:0/2130092517 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0052a0 con 0x7f8fec04d7f0 2021-04-09T18:32:10.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f900481f700 1 --2- 172.21.15.79:0/2130092517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fec0045a0 0x7f8fec0049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:10.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f9005020700 1 --2- 172.21.15.79:0/2130092517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fec0038c0 0x7f8fec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:10.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f9005821700 1 --2- 172.21.15.79:0/2130092517 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fec04d7f0 0x7f8fec04fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:10.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f900481f700 1 -- 172.21.15.79:0/2130092517 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fec04d7f0 msgr2=0x7f8fec04fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:10.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f900481f700 1 --2- 172.21.15.79:0/2130092517 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fec04d7f0 0x7f8fec04fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f900481f700 1 -- 172.21.15.79:0/2130092517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fec0038c0 msgr2=0x7f8fec003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:10.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f900481f700 1 --2- 172.21.15.79:0/2130092517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fec0038c0 0x7f8fec003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f900481f700 1 -- 172.21.15.79:0/2130092517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec050280 con 0x7f8fec0045a0 2021-04-09T18:32:10.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f9005020700 1 --2- 172.21.15.79:0/2130092517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fec0038c0 0x7f8fec003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:32:10.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f900481f700 1 --2- 172.21.15.79:0/2130092517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fec0045a0 0x7f8fec0049f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f8ff000c000 tx=0x7f8ff000e1d0).ready entity=mon.0 client_cookie=868264ce1b48e310 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:10.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f8ff7fff700 1 -- 172.21.15.79:0/2130092517 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8fec050280 con 0x7f8fec0045a0 2021-04-09T18:32:10.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f8ff7fff700 1 -- 172.21.15.79:0/2130092517 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff000ec90 con 0x7f8fec0045a0 2021-04-09T18:32:10.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f8ff7fff700 1 -- 172.21.15.79:0/2130092517 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8ff000f040 con 0x7f8fec0045a0 2021-04-09T18:32:10.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f900727c700 1 -- 172.21.15.79:0/2130092517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fec0045a0 msgr2=0x7f8fec0049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:10.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f900727c700 1 --2- 172.21.15.79:0/2130092517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fec0045a0 0x7f8fec0049f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f8ff000c000 tx=0x7f8ff000e1d0).stop 2021-04-09T18:32:10.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f9005821700 1 -- 172.21.15.79:0/2130092517 reap_dead start 2021-04-09T18:32:10.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f900727c700 1 -- 172.21.15.79:0/2130092517 shutdown_connections 2021-04-09T18:32:10.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f900727c700 1 -- 172.21.15.79:0/2130092517 >> 172.21.15.79:0/2130092517 conn(0x7f90000e5fe0 msgr2=0x7f90000e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:10.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f900727c700 1 -- 172.21.15.79:0/2130092517 shutdown_connections 2021-04-09T18:32:10.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.924 7f900727c700 1 -- 172.21.15.79:0/2130092517 wait complete. 2021-04-09T18:32:10.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.928 7f900727c700 1 Processor -- start 2021-04-09T18:32:10.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.928 7f900727c700 1 -- start start 2021-04-09T18:32:10.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.928 7f900727c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90000c3a20 0x7f90001b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:10.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.928 7f900727c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90000a5f80 0x7f9000099850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:10.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.928 7f900727c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90000b27a0 0x7f90000b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:10.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.928 7f900727c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90001a04c0 con 0x7f90000c3a20 2021-04-09T18:32:10.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.928 7f900727c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90001a07c0 con 0x7f90000b27a0 2021-04-09T18:32:10.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.928 7f900727c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9000099e80 con 0x7f90000a5f80 2021-04-09T18:32:10.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.928 7f9005020700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90000c3a20 0x7f90001b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:10.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.928 7f9005020700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90000c3a20 0x7f90001b4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59512/0 (socket says 172.21.15.79:59512) 2021-04-09T18:32:10.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.928 7f9005020700 1 -- 172.21.15.79:0/1552449308 learned_addr learned my addr 172.21.15.79:0/1552449308 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:10.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.928 7f9005821700 1 --2- 172.21.15.79:0/1552449308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90000b27a0 0x7f90000b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:10.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.928 7f900481f700 1 --2- 172.21.15.79:0/1552449308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90000a5f80 0x7f9000099850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:10.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.932 7f9005020700 1 -- 172.21.15.79:0/1552449308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90000a5f80 msgr2=0x7f9000099850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.932 7f9005020700 1 --2- 172.21.15.79:0/1552449308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90000a5f80 0x7f9000099850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.932 7f9005020700 1 -- 172.21.15.79:0/1552449308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90000b27a0 msgr2=0x7f90000b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.932 7f9005020700 1 --2- 172.21.15.79:0/1552449308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90000b27a0 0x7f90000b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.932 7f9005020700 1 -- 172.21.15.79:0/1552449308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90001a0070 con 0x7f90000c3a20 2021-04-09T18:32:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.932 7f9005020700 1 --2- 172.21.15.79:0/1552449308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90000c3a20 0x7f90001b4540 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f9000087770 tx=0x7f8ffc00e4b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:10.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.932 7f8ff5ffb700 1 -- 172.21.15.79:0/1552449308 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90001a0070 con 0x7f90000c3a20 2021-04-09T18:32:10.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.932 7f8ff5ffb700 1 -- 172.21.15.79:0/1552449308 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ffc00ea40 con 0x7f90000c3a20 2021-04-09T18:32:10.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.932 7f900727c700 1 -- 172.21.15.79:0/1552449308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900009a1d0 con 0x7f90000c3a20 2021-04-09T18:32:10.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.932 7f8ff5ffb700 1 -- 172.21.15.79:0/1552449308 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8ffc00f040 con 0x7f90000c3a20 2021-04-09T18:32:10.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.932 7f900727c700 1 -- 172.21.15.79:0/1552449308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90000b33b0 con 0x7f90000c3a20 2021-04-09T18:32:10.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.932 7f8ff5ffb700 1 -- 172.21.15.79:0/1552449308 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8ffc024060 con 0x7f90000c3a20 2021-04-09T18:32:10.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.932 7f8ff5ffb700 1 --2- 172.21.15.79:0/1552449308 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8fe0029100 0x7f8fe002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.932 7f8ff5ffb700 1 -- 172.21.15.79:0/1552449308 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f8ffc039380 con 0x7f90000c3a20 2021-04-09T18:32:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.932 7f900481f700 1 --2- 172.21.15.79:0/1552449308 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8fe0029100 0x7f8fe002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.932 7f900481f700 1 --2- 172.21.15.79:0/1552449308 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8fe0029100 0x7f8fe002b650 crc :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.936 7f900727c700 1 -- 172.21.15.79:0/1552449308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90000e39e0 con 0x7f90000c3a20 2021-04-09T18:32:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:10.940 7f8ff5ffb700 1 -- 172.21.15.79:0/1552449308 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8ffc010e10 con 0x7f90000c3a20 2021-04-09T18:32:11.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.108 7f900727c700 1 -- 172.21.15.79:0/1552449308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f90000f5b20 con 0x7f90000c3a20 2021-04-09T18:32:11.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.548 7f8ff5ffb700 1 -- 172.21.15.79:0/1552449308 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v64) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8ffc000bf0 con 0x7f90000c3a20 2021-04-09T18:32:11.578 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blacklist entries 2021-04-09T18:32:11.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.580 7f900727c700 1 -- 172.21.15.79:0/1552449308 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8fe0029100 msgr2=0x7f8fe002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:11.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.580 7f900727c700 1 --2- 172.21.15.79:0/1552449308 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8fe0029100 0x7f8fe002b650 crc :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:11.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.580 7f900727c700 1 -- 172.21.15.79:0/1552449308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90000c3a20 msgr2=0x7f90001b4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:11.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.580 7f900727c700 1 --2- 172.21.15.79:0/1552449308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90000c3a20 0x7f90001b4540 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f9000087770 tx=0x7f8ffc00e4b0).stop 2021-04-09T18:32:11.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.580 7f900727c700 1 -- 172.21.15.79:0/1552449308 shutdown_connections 2021-04-09T18:32:11.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.580 7f900727c700 1 --2- 172.21.15.79:0/1552449308 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8fe0029100 0x7f8fe002b650 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:11.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.580 7f900727c700 1 --2- 172.21.15.79:0/1552449308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90000b27a0 0x7f90000b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:11.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.580 7f900727c700 1 --2- 172.21.15.79:0/1552449308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90000c3a20 0x7f90001b4540 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:11.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.580 7f900727c700 1 --2- 172.21.15.79:0/1552449308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90000a5f80 0x7f9000099850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:11.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.580 7f900727c700 1 -- 172.21.15.79:0/1552449308 >> 172.21.15.79:0/1552449308 conn(0x7f90000a4e80 msgr2=0x7f90000d83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:11.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.580 7f900727c700 1 -- 172.21.15.79:0/1552449308 shutdown_connections 2021-04-09T18:32:11.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.580 7f900727c700 1 -- 172.21.15.79:0/1552449308 wait complete. 2021-04-09T18:32:11.600 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-04-09T18:32:11.600 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-04-09T18:32:11.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb8a2e5700 1 Processor -- start 2021-04-09T18:32:11.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb8a2e5700 1 -- start start 2021-04-09T18:32:11.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb8a2e5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feb840f5520 0x7feb840f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:11.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb8a2e5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feb841c8010 0x7feb841ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:11.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb8a2e5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb840fbb20 con 0x7feb840e9ae0 2021-04-09T18:32:11.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb8a2e5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb840e9f30 con 0x7feb840f5520 2021-04-09T18:32:11.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb8a2e5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb841c3dc0 con 0x7feb841c8010 2021-04-09T18:32:11.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb83fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feb840f5520 0x7feb840f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:11.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb837fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7feb840e9ae0 0x7feb8409f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54232/0 (socket says 172.21.15.79:54232) 2021-04-09T18:32:11.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb837fe700 1 -- 172.21.15.79:0/1338902728 learned_addr learned my addr 172.21.15.79:0/1338902728 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:11.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb8888a700 1 --2- 172.21.15.79:0/1338902728 >> v2:172.21.15.89:3300/0 conn(0x7feb841c8010 0x7feb841ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:11.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb82ffd700 1 -- 172.21.15.79:0/1338902728 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120601004 0 0) 0x7feb6c0010d0 con 0x7feb840e9ae0 2021-04-09T18:32:11.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb82ffd700 1 -- 172.21.15.79:0/1338902728 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb70003240 con 0x7feb840e9ae0 2021-04-09T18:32:11.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb83fff700 1 -- 172.21.15.79:0/1338902728 >> v2:172.21.15.89:3300/0 conn(0x7feb841c8010 msgr2=0x7feb841ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:11.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb83fff700 1 --2- 172.21.15.79:0/1338902728 >> v2:172.21.15.89:3300/0 conn(0x7feb841c8010 0x7feb841ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:11.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb82ffd700 1 -- 172.21.15.79:0/1338902728 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2315322253 0 0) 0x7feb6c001650 con 0x7feb840e9ae0 2021-04-09T18:32:11.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb83fff700 1 -- 172.21.15.79:0/1338902728 >> v1:172.21.15.79:6789/0 conn(0x7feb840e9ae0 legacy=0x7feb8409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:11.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb83fff700 1 -- 172.21.15.79:0/1338902728 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8409f910 con 0x7feb840f5520 2021-04-09T18:32:11.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb83fff700 1 --2- 172.21.15.79:0/1338902728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb840f5520 0x7feb840f64b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7feb74002f30 tx=0x7feb7400bd10).ready entity=mon.0 client_cookie=eaa9e25643f131b3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:11.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb82ffd700 1 -- 172.21.15.79:0/1338902728 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feb8409f910 con 0x7feb840f5520 2021-04-09T18:32:11.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb82ffd700 1 -- 172.21.15.79:0/1338902728 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb740098a0 con 0x7feb840f5520 2021-04-09T18:32:11.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb82ffd700 1 -- 172.21.15.79:0/1338902728 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feb74009c70 con 0x7feb840f5520 2021-04-09T18:32:11.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb8a2e5700 1 -- 172.21.15.79:0/1338902728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb840f5520 msgr2=0x7feb840f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:11.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.696 7feb8a2e5700 1 --2- 172.21.15.79:0/1338902728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb840f5520 0x7feb840f64b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7feb74002f30 tx=0x7feb7400bd10).stop 2021-04-09T18:32:11.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.700 7feb8a2e5700 1 -- 172.21.15.79:0/1338902728 shutdown_connections 2021-04-09T18:32:11.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.700 7feb8a2e5700 1 --2- 172.21.15.79:0/1338902728 >> v2:172.21.15.89:3300/0 conn(0x7feb841c8010 0x7feb841ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:11.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.700 7feb8a2e5700 1 --2- 172.21.15.79:0/1338902728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb840f5520 0x7feb840f64b0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:11.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.700 7feb8a2e5700 1 -- 172.21.15.79:0/1338902728 >> 172.21.15.79:0/1338902728 conn(0x7feb840e5fe0 msgr2=0x7feb840e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:11.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.700 7feb8a2e5700 1 -- 172.21.15.79:0/1338902728 shutdown_connections 2021-04-09T18:32:11.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.700 7feb8a2e5700 1 -- 172.21.15.79:0/1338902728 wait complete. 2021-04-09T18:32:11.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb8a2e5700 1 Processor -- start 2021-04-09T18:32:11.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb8a2e5700 1 -- start start 2021-04-09T18:32:11.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb8a2e5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb840d61e0 0x7feb840d52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:11.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb8a2e5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb840d6630 0x7feb841ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:11.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb8a2e5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb841ae760 0x7feb840bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:11.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb8a2e5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb840bf9f0 con 0x7feb840d6630 2021-04-09T18:32:11.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb8a2e5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb840bfcf0 con 0x7feb840d61e0 2021-04-09T18:32:11.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb8a2e5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb840bee70 con 0x7feb841ae760 2021-04-09T18:32:11.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb837fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb840d6630 0x7feb841ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:11.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb837fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb840d6630 0x7feb841ae130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59528/0 (socket says 172.21.15.79:59528) 2021-04-09T18:32:11.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb837fe700 1 -- 172.21.15.79:0/1812839359 learned_addr learned my addr 172.21.15.79:0/1812839359 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:11.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb8888a700 1 --2- 172.21.15.79:0/1812839359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb841ae760 0x7feb840bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:11.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb83fff700 1 --2- 172.21.15.79:0/1812839359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb840d61e0 0x7feb840d52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:11.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb837fe700 1 -- 172.21.15.79:0/1812839359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb841ae760 msgr2=0x7feb840bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:11.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb837fe700 1 --2- 172.21.15.79:0/1812839359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb841ae760 0x7feb840bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:11.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb837fe700 1 -- 172.21.15.79:0/1812839359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb840d61e0 msgr2=0x7feb840d52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:11.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb837fe700 1 --2- 172.21.15.79:0/1812839359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb840d61e0 0x7feb840d52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:11.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb837fe700 1 -- 172.21.15.79:0/1812839359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb840bbaa0 con 0x7feb840d6630 2021-04-09T18:32:11.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb837fe700 1 --2- 172.21.15.79:0/1812839359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb840d6630 0x7feb841ae130 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7feb840bf970 tx=0x7feb6c00cb30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:11.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb80ff9700 1 -- 172.21.15.79:0/1812839359 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feb840bbaa0 con 0x7feb840d6630 2021-04-09T18:32:11.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb80ff9700 1 -- 172.21.15.79:0/1812839359 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6c007320 con 0x7feb840d6630 2021-04-09T18:32:11.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb80ff9700 1 -- 172.21.15.79:0/1812839359 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feb6c0057e0 con 0x7feb840d6630 2021-04-09T18:32:11.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb8a2e5700 1 -- 172.21.15.79:0/1812839359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb840bf580 con 0x7feb840d6630 2021-04-09T18:32:11.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.704 7feb8a2e5700 1 -- 172.21.15.79:0/1812839359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb840d5a60 con 0x7feb840d6630 2021-04-09T18:32:11.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.708 7feb80ff9700 1 -- 172.21.15.79:0/1812839359 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7feb6c01a060 con 0x7feb840d6630 2021-04-09T18:32:11.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.708 7feb80ff9700 1 --2- 172.21.15.79:0/1812839359 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7feb68029100 0x7feb6802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:11.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.708 7feb80ff9700 1 -- 172.21.15.79:0/1812839359 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5104+0+0 (secure 0 0 0) 0x7feb6c0389f0 con 0x7feb840d6630 2021-04-09T18:32:11.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.708 7feb83fff700 1 --2- 172.21.15.79:0/1812839359 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7feb68029100 0x7feb6802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:11.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.708 7feb8a2e5700 1 -- 172.21.15.79:0/1812839359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb840e39e0 con 0x7feb840d6630 2021-04-09T18:32:11.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.708 7feb83fff700 1 --2- 172.21.15.79:0/1812839359 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7feb68029100 0x7feb6802b650 crc :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:11.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.712 7feb80ff9700 1 -- 172.21.15.79:0/1812839359 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7feb840e5ca0 con 0x7feb840d6630 2021-04-09T18:32:11.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.872 7feb8a2e5700 1 -- 172.21.15.79:0/1812839359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7feb840be8a0 con 0x7feb840d6630 2021-04-09T18:32:11.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.872 7feb80ff9700 1 -- 172.21.15.79:0/1812839359 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+4242 (secure 0 0 0) 0x7feb6c007110 con 0x7feb840d6630 2021-04-09T18:32:11.877 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:32:11.877 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:32:11.878 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2021-04-09T18:32:11.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:11.878 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2021-04-09T18:32:11.878 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgovEoMhAAbDfArG3lSFAdk80rS/4iEQ==", 2021-04-09T18:32:11.879 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:32:11.879 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:32:11.879 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:32:11.879 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:32:11.879 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:32:11.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:11.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:11.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:11.880 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2021-04-09T18:32:11.881 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgN4sfOBAAPjvDX11uLM+vgdFpdP49Kw==", 2021-04-09T18:32:11.881 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:32:11.881 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:32:11.881 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:32:11.881 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:32:11.882 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:32:11.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:11.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:11.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:11.882 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2021-04-09T18:32:11.883 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQALnHBgro0COxAAgbe5jxAZH9bD7zDLbtdkhQ==", 2021-04-09T18:32:11.883 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:32:11.883 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:32:11.884 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:32:11.884 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:32:11.884 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:11.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:11.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:11.885 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2021-04-09T18:32:11.885 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAPnHBghZ/oARAAhkN+fnZJiskmHnvvs+G8NA==", 2021-04-09T18:32:11.885 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:32:11.885 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:32:11.886 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:32:11.886 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:32:11.886 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:11.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:11.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:11.887 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2021-04-09T18:32:11.887 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQASnHBgWT2FBxAACrSTbwbF18k9aPeYNohelw==", 2021-04-09T18:32:11.887 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:32:11.888 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:32:11.888 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:32:11.889 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:32:11.889 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:11.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:11.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:11.889 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2021-04-09T18:32:11.890 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAVnHBgPHy6CxAAFq+yki4AZe5ybodgTO/4/Q==", 2021-04-09T18:32:11.890 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:32:11.890 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:32:11.890 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:32:11.891 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:32:11.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:11.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:11.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:11.892 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2021-04-09T18:32:11.892 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAanHBgfbs4NhAAQzxM9dDML4RgQP8yamkuVw==", 2021-04-09T18:32:11.892 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:32:11.892 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:32:11.892 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:32:11.893 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:32:11.893 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:11.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:11.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:11.893 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2021-04-09T18:32:11.894 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAdnHBgi0WLOhAA4OBguOCjtmzqulUjTJ+GhQ==", 2021-04-09T18:32:11.894 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:32:11.894 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:32:11.894 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:32:11.895 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:32:11.895 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:11.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:11.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:11.896 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2021-04-09T18:32:11.896 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAhnHBgCs+PAxAAOm0wSMe/1Bu9vfTrpmrLkg==", 2021-04-09T18:32:11.896 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:32:11.896 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:32:11.896 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:32:11.897 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:32:11.897 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:11.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:11.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:11.898 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2021-04-09T18:32:11.898 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAknHBgH1S3CBAAUcdUIW7O6wH482l1yZBKBw==", 2021-04-09T18:32:11.898 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:32:11.898 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:32:11.898 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:32:11.899 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:32:11.899 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:11.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:11.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:11.900 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2021-04-09T18:32:11.900 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgxEq9BxAAap2nrjhcrf2aHzygtMclVw==", 2021-04-09T18:32:11.900 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:32:11.900 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:32:11.900 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:32:11.901 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:32:11.901 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:11.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:11.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:11.901 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2021-04-09T18:32:11.902 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBguJFeDRAAWL4NV4tsYRAqcwJ26kjm2Q==", 2021-04-09T18:32:11.902 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:32:11.902 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:32:11.902 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:32:11.903 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:32:11.903 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:11.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:11.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:11.903 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2021-04-09T18:32:11.904 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgN9X5EhAA3DBPdlRHVBHXJNH9nRFW0A==", 2021-04-09T18:32:11.904 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:32:11.904 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:32:11.904 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:32:11.905 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:32:11.905 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:11.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:11.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:11.905 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2021-04-09T18:32:11.906 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgHOSVDBAAMMqd8paqBSTQRgR7n4EXGQ==", 2021-04-09T18:32:11.906 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:32:11.906 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:32:11.906 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:32:11.907 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:32:11.907 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:32:11.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:11.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:11.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:11.908 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2021-04-09T18:32:11.908 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgmHJhLxAAyhBrx08J7ZFKu34MYC2Wyg==", 2021-04-09T18:32:11.908 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:32:11.908 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:32:11.908 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:32:11.909 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:32:11.909 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:11.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:32:11.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:11.910 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2021-04-09T18:32:11.910 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgNCCXKhAA/bKOzzjVHldj6RpMGu0c8g==", 2021-04-09T18:32:11.910 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:32:11.910 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:32:11.911 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:32:11.911 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:32:11.911 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:11.911 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:11.912 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:32:11.912 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:32:11.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.876 7feb8a2e5700 1 -- 172.21.15.79:0/1812839359 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7feb68029100 msgr2=0x7feb6802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:11.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.876 7feb8a2e5700 1 --2- 172.21.15.79:0/1812839359 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7feb68029100 0x7feb6802b650 crc :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:11.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.876 7feb8a2e5700 1 -- 172.21.15.79:0/1812839359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb840d6630 msgr2=0x7feb841ae130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:11.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.876 7feb8a2e5700 1 --2- 172.21.15.79:0/1812839359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb840d6630 0x7feb841ae130 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7feb840bf970 tx=0x7feb6c00cb30).stop 2021-04-09T18:32:11.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.876 7feb8a2e5700 1 -- 172.21.15.79:0/1812839359 shutdown_connections 2021-04-09T18:32:11.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.876 7feb8a2e5700 1 --2- 172.21.15.79:0/1812839359 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7feb68029100 0x7feb6802b650 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:11.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.876 7feb8a2e5700 1 --2- 172.21.15.79:0/1812839359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb840d61e0 0x7feb840d52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:11.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.876 7feb8a2e5700 1 --2- 172.21.15.79:0/1812839359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb841ae760 0x7feb840bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:11.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.876 7feb8a2e5700 1 --2- 172.21.15.79:0/1812839359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb840d6630 0x7feb841ae130 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:11.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.876 7feb8a2e5700 1 -- 172.21.15.79:0/1812839359 >> 172.21.15.79:0/1812839359 conn(0x7feb84098ff0 msgr2=0x7feb8409a280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:11.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.876 7feb8a2e5700 1 -- 172.21.15.79:0/1812839359 shutdown_connections 2021-04-09T18:32:11.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:11.876 7feb8a2e5700 1 -- 172.21.15.79:0/1812839359 wait complete. 2021-04-09T18:32:11.917 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:32:12.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.012 7fdb3ef62700 1 Processor -- start 2021-04-09T18:32:12.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.012 7fdb3ef62700 1 -- start start 2021-04-09T18:32:12.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.012 7fdb3ef62700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdb380f5510 0x7fdb380f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.012 7fdb3ef62700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb380e9ad0 0x7fdb3809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.012 7fdb3ef62700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb380fbb10 con 0x7fdb381c2da0 2021-04-09T18:32:12.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.012 7fdb3ef62700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb380e9f20 con 0x7fdb380f5510 2021-04-09T18:32:12.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.012 7fdb3ef62700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb380e59c0 con 0x7fdb380e9ad0 2021-04-09T18:32:12.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.012 7fdb3cd06700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdb380f5510 0x7fdb380f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.012 7fdb3cd06700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdb380f5510 0x7fdb380f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59534/0 (socket says 172.21.15.79:59534) 2021-04-09T18:32:12.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.012 7fdb3cd06700 1 -- 172.21.15.79:0/824684231 learned_addr learned my addr 172.21.15.79:0/824684231 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:12.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.012 7fdb37fff700 1 --2- 172.21.15.79:0/824684231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb380e9ad0 0x7fdb3809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.012 7fdb3cd06700 1 -- 172.21.15.79:0/824684231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb380e9ad0 msgr2=0x7fdb3809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:12.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.012 7fdb3cd06700 1 --2- 172.21.15.79:0/824684231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb380e9ad0 0x7fdb3809f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.012 7fdb3cd06700 1 -- 172.21.15.79:0/824684231 >> v1:172.21.15.89:6789/0 conn(0x7fdb381c2da0 legacy=0x7fdb381c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.012 7fdb3cd06700 1 -- 172.21.15.79:0/824684231 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb380e56c0 con 0x7fdb380f5510 2021-04-09T18:32:12.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.016 7fdb3cd06700 1 --2- 172.21.15.79:0/824684231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb380f5510 0x7fdb380f64a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fdb28002f30 tx=0x7fdb2800bda0).ready entity=mon.0 client_cookie=d769ed51f912fd27 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:12.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.016 7fdb377fe700 1 -- 172.21.15.79:0/824684231 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb380e56c0 con 0x7fdb380f5510 2021-04-09T18:32:12.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.016 7fdb377fe700 1 -- 172.21.15.79:0/824684231 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb280099d0 con 0x7fdb380f5510 2021-04-09T18:32:12.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.016 7fdb377fe700 1 -- 172.21.15.79:0/824684231 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb28009da0 con 0x7fdb380f5510 2021-04-09T18:32:12.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.016 7fdb3ef62700 1 -- 172.21.15.79:0/824684231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb380f5510 msgr2=0x7fdb380f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.016 7fdb3ef62700 1 --2- 172.21.15.79:0/824684231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb380f5510 0x7fdb380f64a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fdb28002f30 tx=0x7fdb2800bda0).stop 2021-04-09T18:32:12.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.016 7fdb3ef62700 1 -- 172.21.15.79:0/824684231 shutdown_connections 2021-04-09T18:32:12.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.016 7fdb3ef62700 1 --2- 172.21.15.79:0/824684231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb380f5510 0x7fdb380f64a0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.016 7fdb3ef62700 1 --2- 172.21.15.79:0/824684231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb380e9ad0 0x7fdb3809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.016 7fdb3ef62700 1 -- 172.21.15.79:0/824684231 >> 172.21.15.79:0/824684231 conn(0x7fdb380e5fd0 msgr2=0x7fdb380e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:12.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.016 7fdb3ef62700 1 -- 172.21.15.79:0/824684231 shutdown_connections 2021-04-09T18:32:12.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.016 7fdb3ef62700 1 -- 172.21.15.79:0/824684231 wait complete. 2021-04-09T18:32:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.020 7fdb3ef62700 1 Processor -- start 2021-04-09T18:32:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.020 7fdb3ef62700 1 -- start start 2021-04-09T18:32:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb3ef62700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb381a7df0 0x7fdb380cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb3ef62700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb380cf3e0 0x7fdb380cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb3ef62700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb380d03a0 0x7fdb38099b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb3ef62700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb380d54b0 con 0x7fdb380cf3e0 2021-04-09T18:32:12.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb3ef62700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb380d57b0 con 0x7fdb381a7df0 2021-04-09T18:32:12.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb3ef62700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb380b9030 con 0x7fdb380d03a0 2021-04-09T18:32:12.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb37fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb380cf3e0 0x7fdb380cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb37fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb380cf3e0 0x7fdb380cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59542/0 (socket says 172.21.15.79:59542) 2021-04-09T18:32:12.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb37fff700 1 -- 172.21.15.79:0/635422382 learned_addr learned my addr 172.21.15.79:0/635422382 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:12.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb3cd06700 1 --2- 172.21.15.79:0/635422382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb381a7df0 0x7fdb380cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb3d507700 1 --2- 172.21.15.79:0/635422382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb380d03a0 0x7fdb38099b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb37fff700 1 -- 172.21.15.79:0/635422382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb380d03a0 msgr2=0x7fdb38099b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb37fff700 1 --2- 172.21.15.79:0/635422382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb380d03a0 0x7fdb38099b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb37fff700 1 -- 172.21.15.79:0/635422382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb381a7df0 msgr2=0x7fdb380cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb37fff700 1 --2- 172.21.15.79:0/635422382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb381a7df0 0x7fdb380cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb37fff700 1 -- 172.21.15.79:0/635422382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb380d07f0 con 0x7fdb380cf3e0 2021-04-09T18:32:12.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb3d507700 1 --2- 172.21.15.79:0/635422382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb380d03a0 0x7fdb38099b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:32:12.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb37fff700 1 --2- 172.21.15.79:0/635422382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb380cf3e0 0x7fdb380cfd70 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fdb380baba0 tx=0x7fdb2c00dd80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:12.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb357fa700 1 -- 172.21.15.79:0/635422382 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb2c00f040 con 0x7fdb380cf3e0 2021-04-09T18:32:12.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb357fa700 1 -- 172.21.15.79:0/635422382 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c0099e0 con 0x7fdb380cf3e0 2021-04-09T18:32:12.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb3ef62700 1 -- 172.21.15.79:0/635422382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb3809ac60 con 0x7fdb380cf3e0 2021-04-09T18:32:12.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb357fa700 1 -- 172.21.15.79:0/635422382 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb2c009db0 con 0x7fdb380cf3e0 2021-04-09T18:32:12.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb3ef62700 1 -- 172.21.15.79:0/635422382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb380d5060 con 0x7fdb380cf3e0 2021-04-09T18:32:12.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb357fa700 1 -- 172.21.15.79:0/635422382 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fdb2c013480 con 0x7fdb380cf3e0 2021-04-09T18:32:12.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb357fa700 1 --2- 172.21.15.79:0/635422382 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb18029100 0x7fdb1802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb357fa700 1 -- 172.21.15.79:0/635422382 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fdb2c010070 con 0x7fdb380cf3e0 2021-04-09T18:32:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb3cd06700 1 --2- 172.21.15.79:0/635422382 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb18029100 0x7fdb1802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.024 7fdb3cd06700 1 --2- 172.21.15.79:0/635422382 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb18029100 0x7fdb1802b650 crc :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:12.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.040 7fdb3ef62700 1 -- 172.21.15.79:0/635422382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb380e39d0 con 0x7fdb380cf3e0 2021-04-09T18:32:12.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.044 7fdb357fa700 1 -- 172.21.15.79:0/635422382 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fdb2c000bf0 con 0x7fdb380cf3e0 2021-04-09T18:32:12.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.216 7fdb3ef62700 1 -- 172.21.15.79:0/635422382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb380f5b10 con 0x7fdb380cf3e0 2021-04-09T18:32:12.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.216 7fdb357fa700 1 -- 172.21.15.79:0/635422382 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+11378 (secure 0 0 0) 0x7fdb2c0095e0 con 0x7fdb380cf3e0 2021-04-09T18:32:12.222 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:32:12.222 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":64,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:32:11.545102","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:32:12.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.220 7fdb3ef62700 1 -- 172.21.15.79:0/635422382 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb18029100 msgr2=0x7fdb1802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.220 7fdb3ef62700 1 --2- 172.21.15.79:0/635422382 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb18029100 0x7fdb1802b650 crc :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.220 7fdb3ef62700 1 -- 172.21.15.79:0/635422382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb380cf3e0 msgr2=0x7fdb380cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.220 7fdb3ef62700 1 --2- 172.21.15.79:0/635422382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb380cf3e0 0x7fdb380cfd70 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fdb380baba0 tx=0x7fdb2c00dd80).stop 2021-04-09T18:32:12.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.220 7fdb3ef62700 1 -- 172.21.15.79:0/635422382 shutdown_connections 2021-04-09T18:32:12.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.220 7fdb3ef62700 1 --2- 172.21.15.79:0/635422382 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb18029100 0x7fdb1802b650 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.220 7fdb3ef62700 1 --2- 172.21.15.79:0/635422382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb381a7df0 0x7fdb380cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.220 7fdb3ef62700 1 --2- 172.21.15.79:0/635422382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb380d03a0 0x7fdb38099b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.220 7fdb3ef62700 1 --2- 172.21.15.79:0/635422382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb380cf3e0 0x7fdb380cfd70 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.220 7fdb3ef62700 1 -- 172.21.15.79:0/635422382 >> 172.21.15.79:0/635422382 conn(0x7fdb380d3020 msgr2=0x7fdb3808e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:12.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.220 7fdb3ef62700 1 -- 172.21.15.79:0/635422382 shutdown_connections 2021-04-09T18:32:12.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.220 7fdb3ef62700 1 -- 172.21.15.79:0/635422382 wait complete. 2021-04-09T18:32:12.239 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-04-09T18:32:12.240 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:32:12.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.332 7ff1a8d2d700 1 Processor -- start 2021-04-09T18:32:12.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a8d2d700 1 -- start start 2021-04-09T18:32:12.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a8d2d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff1a40f5550 0x7ff1a40f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a8d2d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff1a40e9b10 0x7ff1a409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a8d2d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1a41c2de0 0x7ff1a41c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a8d2d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a40e9f60 con 0x7ff1a40e9b10 2021-04-09T18:32:12.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a8d2d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a40e5a00 con 0x7ff1a40f5550 2021-04-09T18:32:12.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a8d2d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a40fbb50 con 0x7ff1a41c2de0 2021-04-09T18:32:12.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a2293700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff1a40e9b10 0x7ff1a409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a2293700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff1a40e9b10 0x7ff1a409f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59550/0 (socket says 172.21.15.79:59550) 2021-04-09T18:32:12.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a2293700 1 -- 172.21.15.79:0/2849773236 learned_addr learned my addr 172.21.15.79:0/2849773236 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:12.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a2a94700 1 --2- 172.21.15.79:0/2849773236 >> v2:172.21.15.89:3300/0 conn(0x7ff1a40f5550 0x7ff1a40f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a3295700 1 --2- 172.21.15.79:0/2849773236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1a41c2de0 0x7ff1a41c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a2293700 1 -- 172.21.15.79:0/2849773236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1a41c2de0 msgr2=0x7ff1a41c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:12.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a2293700 1 --2- 172.21.15.79:0/2849773236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1a41c2de0 0x7ff1a41c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a2293700 1 -- 172.21.15.79:0/2849773236 >> v2:172.21.15.89:3300/0 conn(0x7ff1a40f5550 msgr2=0x7ff1a40f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:12.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a2293700 1 --2- 172.21.15.79:0/2849773236 >> v2:172.21.15.89:3300/0 conn(0x7ff1a40f5550 0x7ff1a40f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a2293700 1 -- 172.21.15.79:0/2849773236 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a40e5700 con 0x7ff1a40e9b10 2021-04-09T18:32:12.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a2a94700 1 --2- 172.21.15.79:0/2849773236 >> v2:172.21.15.89:3300/0 conn(0x7ff1a40f5550 0x7ff1a40f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:32:12.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a3295700 1 --2- 172.21.15.79:0/2849773236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1a41c2de0 0x7ff1a41c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:32:12.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a2293700 1 --2- 172.21.15.79:0/2849773236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1a40e9b10 0x7ff1a409f110 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7ff1a4125470 tx=0x7ff19400bda0).ready entity=mon.0 client_cookie=1113344f435220a6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:12.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a1a92700 1 -- 172.21.15.79:0/2849773236 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff1a40e5700 con 0x7ff1a40e9b10 2021-04-09T18:32:12.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a1a92700 1 -- 172.21.15.79:0/2849773236 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff194009940 con 0x7ff1a40e9b10 2021-04-09T18:32:12.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a1a92700 1 -- 172.21.15.79:0/2849773236 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff194009d10 con 0x7ff1a40e9b10 2021-04-09T18:32:12.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a8d2d700 1 -- 172.21.15.79:0/2849773236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1a40e9b10 msgr2=0x7ff1a409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a8d2d700 1 --2- 172.21.15.79:0/2849773236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1a40e9b10 0x7ff1a409f110 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7ff1a4125470 tx=0x7ff19400bda0).stop 2021-04-09T18:32:12.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a8d2d700 1 -- 172.21.15.79:0/2849773236 shutdown_connections 2021-04-09T18:32:12.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a8d2d700 1 --2- 172.21.15.79:0/2849773236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1a41c2de0 0x7ff1a41c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a8d2d700 1 --2- 172.21.15.79:0/2849773236 >> v2:172.21.15.89:3300/0 conn(0x7ff1a40f5550 0x7ff1a40f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a8d2d700 1 --2- 172.21.15.79:0/2849773236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1a40e9b10 0x7ff1a409f110 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a8d2d700 1 -- 172.21.15.79:0/2849773236 >> 172.21.15.79:0/2849773236 conn(0x7ff1a40e6010 msgr2=0x7ff1a40e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:12.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a8d2d700 1 -- 172.21.15.79:0/2849773236 shutdown_connections 2021-04-09T18:32:12.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.336 7ff1a8d2d700 1 -- 172.21.15.79:0/2849773236 wait complete. 2021-04-09T18:32:12.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a8d2d700 1 Processor -- start 2021-04-09T18:32:12.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a8d2d700 1 -- start start 2021-04-09T18:32:12.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a8d2d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1a41af890 0x7ff1a40b8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a8d2d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1a4098f00 0x7ff1a4099350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a8d2d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1a4099980 0x7ff1a4099dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a8d2d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a4097960 con 0x7ff1a4098f00 2021-04-09T18:32:12.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a8d2d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a409a9c0 con 0x7ff1a41af890 2021-04-09T18:32:12.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a8d2d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a40b8c70 con 0x7ff1a4099980 2021-04-09T18:32:12.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a2293700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1a4098f00 0x7ff1a4099350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a2293700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1a4098f00 0x7ff1a4099350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59554/0 (socket says 172.21.15.79:59554) 2021-04-09T18:32:12.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a2293700 1 -- 172.21.15.79:0/3943816419 learned_addr learned my addr 172.21.15.79:0/3943816419 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:12.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a2a94700 1 --2- 172.21.15.79:0/3943816419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1a41af890 0x7ff1a40b8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a3295700 1 --2- 172.21.15.79:0/3943816419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1a4099980 0x7ff1a4099dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a2293700 1 -- 172.21.15.79:0/3943816419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1a4099980 msgr2=0x7ff1a4099dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a2293700 1 --2- 172.21.15.79:0/3943816419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1a4099980 0x7ff1a4099dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a2293700 1 -- 172.21.15.79:0/3943816419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1a41af890 msgr2=0x7ff1a40b8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a2293700 1 --2- 172.21.15.79:0/3943816419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1a41af890 0x7ff1a40b8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a2293700 1 -- 172.21.15.79:0/3943816419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a4093490 con 0x7ff1a4098f00 2021-04-09T18:32:12.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a2293700 1 --2- 172.21.15.79:0/3943816419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1a4098f00 0x7ff1a4099350 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7ff1a4125470 tx=0x7ff194006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:12.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff19b7fe700 1 -- 172.21.15.79:0/3943816419 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff1a4093490 con 0x7ff1a4098f00 2021-04-09T18:32:12.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff19b7fe700 1 -- 172.21.15.79:0/3943816419 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19401d450 con 0x7ff1a4098f00 2021-04-09T18:32:12.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a8d2d700 1 -- 172.21.15.79:0/3943816419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a41afce0 con 0x7ff1a4098f00 2021-04-09T18:32:12.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff19b7fe700 1 -- 172.21.15.79:0/3943816419 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff194022070 con 0x7ff1a4098f00 2021-04-09T18:32:12.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.340 7ff1a8d2d700 1 -- 172.21.15.79:0/3943816419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a4093170 con 0x7ff1a4098f00 2021-04-09T18:32:12.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.344 7ff19b7fe700 1 -- 172.21.15.79:0/3943816419 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff194026410 con 0x7ff1a4098f00 2021-04-09T18:32:12.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.344 7ff19b7fe700 1 --2- 172.21.15.79:0/3943816419 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff188029100 0x7ff18802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.344 7ff19b7fe700 1 -- 172.21.15.79:0/3943816419 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5104+0+0 (secure 0 0 0) 0x7ff19403b970 con 0x7ff1a4098f00 2021-04-09T18:32:12.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.344 7ff1a2a94700 1 --2- 172.21.15.79:0/3943816419 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff188029100 0x7ff18802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.344 7ff1a2a94700 1 --2- 172.21.15.79:0/3943816419 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff188029100 0x7ff18802b650 crc :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:12.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.348 7ff1a8d2d700 1 -- 172.21.15.79:0/3943816419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a40e39f0 con 0x7ff1a4098f00 2021-04-09T18:32:12.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.356 7ff19b7fe700 1 -- 172.21.15.79:0/3943816419 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff194011d60 con 0x7ff1a4098f00 2021-04-09T18:32:12.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.504 7ff1a8d2d700 1 -- 172.21.15.79:0/3943816419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7ff1a40f5b50 con 0x7ff1a4098f00 2021-04-09T18:32:12.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.508 7ff19b7fe700 1 -- 172.21.15.79:0/3943816419 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v64) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff194009730 con 0x7ff1a4098f00 2021-04-09T18:32:12.510 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:32:12.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.508 7ff1a8d2d700 1 -- 172.21.15.79:0/3943816419 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff188029100 msgr2=0x7ff18802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.508 7ff1a8d2d700 1 --2- 172.21.15.79:0/3943816419 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff188029100 0x7ff18802b650 crc :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.508 7ff1a8d2d700 1 -- 172.21.15.79:0/3943816419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1a4098f00 msgr2=0x7ff1a4099350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.508 7ff1a8d2d700 1 --2- 172.21.15.79:0/3943816419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1a4098f00 0x7ff1a4099350 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7ff1a4125470 tx=0x7ff194006890).stop 2021-04-09T18:32:12.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.508 7ff1a8d2d700 1 -- 172.21.15.79:0/3943816419 shutdown_connections 2021-04-09T18:32:12.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.508 7ff1a8d2d700 1 --2- 172.21.15.79:0/3943816419 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff188029100 0x7ff18802b650 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.508 7ff1a8d2d700 1 --2- 172.21.15.79:0/3943816419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1a41af890 0x7ff1a40b8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.508 7ff1a8d2d700 1 --2- 172.21.15.79:0/3943816419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1a4099980 0x7ff1a4099dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.508 7ff1a8d2d700 1 --2- 172.21.15.79:0/3943816419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1a4098f00 0x7ff1a4099350 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.508 7ff1a8d2d700 1 -- 172.21.15.79:0/3943816419 >> 172.21.15.79:0/3943816419 conn(0x7ff1a40d59c0 msgr2=0x7ff1a4090e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:12.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.508 7ff1a8d2d700 1 -- 172.21.15.79:0/3943816419 shutdown_connections 2021-04-09T18:32:12.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.508 7ff1a8d2d700 1 -- 172.21.15.79:0/3943816419 wait complete. 2021-04-09T18:32:12.526 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-04-09T18:32:12.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea2e3c7700 1 Processor -- start 2021-04-09T18:32:12.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea2e3c7700 1 -- start start 2021-04-09T18:32:12.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea2e3c7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fea280f5510 0x7fea280f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea2e3c7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fea280e9ad0 0x7fea2809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea2e3c7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea280fbb10 con 0x7fea281c2da0 2021-04-09T18:32:12.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea2e3c7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea280e9f20 con 0x7fea280e9ad0 2021-04-09T18:32:12.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea2e3c7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea280e59c0 con 0x7fea280f5510 2021-04-09T18:32:12.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea277fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fea280e9ad0 0x7fea2809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea2c96c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fea281c2da0 0x7fea281c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54276/0 (socket says 172.21.15.79:54276) 2021-04-09T18:32:12.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea2c96c700 1 -- 172.21.15.79:0/1540965680 learned_addr learned my addr 172.21.15.79:0/1540965680 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:12.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea277fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fea280e9ad0 0x7fea2809f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59564/0 (socket says 172.21.15.79:59564) 2021-04-09T18:32:12.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea27fff700 1 --2- 172.21.15.79:0/1540965680 >> v2:172.21.15.89:3300/0 conn(0x7fea280f5510 0x7fea280f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea277fe700 1 -- 172.21.15.79:0/1540965680 >> v2:172.21.15.89:3300/0 conn(0x7fea280f5510 msgr2=0x7fea280f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:12.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea277fe700 1 --2- 172.21.15.79:0/1540965680 >> v2:172.21.15.89:3300/0 conn(0x7fea280f5510 0x7fea280f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea277fe700 1 -- 172.21.15.79:0/1540965680 >> v1:172.21.15.79:6789/0 conn(0x7fea281c2da0 legacy=0x7fea281c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea26ffd700 1 -- 172.21.15.79:0/1540965680 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041950634 0 0) 0x7fea200010d0 con 0x7fea281c2da0 2021-04-09T18:32:12.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea277fe700 1 -- 172.21.15.79:0/1540965680 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea280e56c0 con 0x7fea280e9ad0 2021-04-09T18:32:12.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea277fe700 1 --2- 172.21.15.79:0/1540965680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea280e9ad0 0x7fea2809f100 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fea100032b0 tx=0x7fea1000b3c0).ready entity=mon.0 client_cookie=1df3490026aebc05 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:12.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea26ffd700 1 -- 172.21.15.79:0/1540965680 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fea280e56c0 con 0x7fea280e9ad0 2021-04-09T18:32:12.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea26ffd700 1 -- 172.21.15.79:0/1540965680 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1000bc20 con 0x7fea280e9ad0 2021-04-09T18:32:12.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea26ffd700 1 -- 172.21.15.79:0/1540965680 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fea10002020 con 0x7fea280e9ad0 2021-04-09T18:32:12.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea2e3c7700 1 -- 172.21.15.79:0/1540965680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea280e9ad0 msgr2=0x7fea2809f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.616 7fea2e3c7700 1 --2- 172.21.15.79:0/1540965680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea280e9ad0 0x7fea2809f100 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fea100032b0 tx=0x7fea1000b3c0).stop 2021-04-09T18:32:12.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.620 7fea2e3c7700 1 -- 172.21.15.79:0/1540965680 shutdown_connections 2021-04-09T18:32:12.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.620 7fea2e3c7700 1 --2- 172.21.15.79:0/1540965680 >> v2:172.21.15.89:3300/0 conn(0x7fea280f5510 0x7fea280f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.620 7fea2e3c7700 1 --2- 172.21.15.79:0/1540965680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea280e9ad0 0x7fea2809f100 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.620 7fea2e3c7700 1 -- 172.21.15.79:0/1540965680 >> 172.21.15.79:0/1540965680 conn(0x7fea280e5fd0 msgr2=0x7fea280e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.620 7fea2e3c7700 1 -- 172.21.15.79:0/1540965680 shutdown_connections 2021-04-09T18:32:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.620 7fea2e3c7700 1 -- 172.21.15.79:0/1540965680 wait complete. 2021-04-09T18:32:12.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.620 7fea2e3c7700 1 Processor -- start 2021-04-09T18:32:12.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.620 7fea2e3c7700 1 -- start start 2021-04-09T18:32:12.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea2e3c7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea280c2720 0x7fea2819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea2e3c7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea28096ad0 0x7fea28097520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea2e3c7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea28097b50 0x7fea280ae400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea2e3c7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea28097220 con 0x7fea28096ad0 2021-04-09T18:32:12.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea2e3c7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea28096f20 con 0x7fea280c2720 2021-04-09T18:32:12.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea2e3c7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea28098240 con 0x7fea28097b50 2021-04-09T18:32:12.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea277fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea28096ad0 0x7fea28097520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea277fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea28096ad0 0x7fea28097520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59572/0 (socket says 172.21.15.79:59572) 2021-04-09T18:32:12.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea277fe700 1 -- 172.21.15.79:0/3375490505 learned_addr learned my addr 172.21.15.79:0/3375490505 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:12.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea2c96c700 1 --2- 172.21.15.79:0/3375490505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea28097b50 0x7fea280ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea27fff700 1 --2- 172.21.15.79:0/3375490505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea280c2720 0x7fea2819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea277fe700 1 -- 172.21.15.79:0/3375490505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea28097b50 msgr2=0x7fea280ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea277fe700 1 --2- 172.21.15.79:0/3375490505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea28097b50 0x7fea280ae400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea277fe700 1 -- 172.21.15.79:0/3375490505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea280c2720 msgr2=0x7fea2819cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea277fe700 1 --2- 172.21.15.79:0/3375490505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea280c2720 0x7fea2819cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea277fe700 1 -- 172.21.15.79:0/3375490505 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea280aea30 con 0x7fea28096ad0 2021-04-09T18:32:12.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea277fe700 1 --2- 172.21.15.79:0/3375490505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea28096ad0 0x7fea28097520 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fea280874c0 tx=0x7fea10006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:12.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea24ff9700 1 -- 172.21.15.79:0/3375490505 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fea280aea30 con 0x7fea28096ad0 2021-04-09T18:32:12.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea24ff9700 1 -- 172.21.15.79:0/3375490505 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1001f020 con 0x7fea28096ad0 2021-04-09T18:32:12.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea2e3c7700 1 -- 172.21.15.79:0/3375490505 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea280aecf0 con 0x7fea28096ad0 2021-04-09T18:32:12.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea24ff9700 1 -- 172.21.15.79:0/3375490505 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fea10010b60 con 0x7fea28096ad0 2021-04-09T18:32:12.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea2e3c7700 1 -- 172.21.15.79:0/3375490505 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea280bcd90 con 0x7fea28096ad0 2021-04-09T18:32:12.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea24ff9700 1 -- 172.21.15.79:0/3375490505 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fea1002a060 con 0x7fea28096ad0 2021-04-09T18:32:12.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea24ff9700 1 --2- 172.21.15.79:0/3375490505 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fea0c029100 0x7fea0c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea24ff9700 1 -- 172.21.15.79:0/3375490505 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fea10003020 con 0x7fea28096ad0 2021-04-09T18:32:12.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.624 7fea27fff700 1 --2- 172.21.15.79:0/3375490505 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fea0c029100 0x7fea0c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.628 7fea27fff700 1 --2- 172.21.15.79:0/3375490505 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fea0c029100 0x7fea0c02b650 crc :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:12.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.632 7fea2e3c7700 1 -- 172.21.15.79:0/3375490505 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea280e39d0 con 0x7fea28096ad0 2021-04-09T18:32:12.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.636 7fea24ff9700 1 -- 172.21.15.79:0/3375490505 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fea10010760 con 0x7fea28096ad0 2021-04-09T18:32:12.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.796 7fea2e3c7700 1 -- 172.21.15.79:0/3375490505 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fea280f5b10 con 0x7fea28096ad0 2021-04-09T18:32:12.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.796 7fea24ff9700 1 -- 172.21.15.79:0/3375490505 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) v1 ==== 84+0+64 (secure 0 0 0) 0x7fea10030050 con 0x7fea28096ad0 2021-04-09T18:32:12.801 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:32:12.802 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2021-04-09T18:32:12.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:32:12.802 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2021-04-09T18:32:12.802 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": "rbd" 2021-04-09T18:32:12.803 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:32:12.803 INFO:teuthology.orchestra.run.smithi079.stdout:] 2021-04-09T18:32:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.800 7fea2e3c7700 1 -- 172.21.15.79:0/3375490505 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fea0c029100 msgr2=0x7fea0c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.800 7fea2e3c7700 1 --2- 172.21.15.79:0/3375490505 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fea0c029100 0x7fea0c02b650 crc :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.800 7fea2e3c7700 1 -- 172.21.15.79:0/3375490505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea28096ad0 msgr2=0x7fea28097520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.800 7fea2e3c7700 1 --2- 172.21.15.79:0/3375490505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea28096ad0 0x7fea28097520 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fea280874c0 tx=0x7fea10006c10).stop 2021-04-09T18:32:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.800 7fea2e3c7700 1 -- 172.21.15.79:0/3375490505 shutdown_connections 2021-04-09T18:32:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.800 7fea2e3c7700 1 --2- 172.21.15.79:0/3375490505 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fea0c029100 0x7fea0c02b650 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.800 7fea2e3c7700 1 --2- 172.21.15.79:0/3375490505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea280c2720 0x7fea2819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.800 7fea2e3c7700 1 --2- 172.21.15.79:0/3375490505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea28097b50 0x7fea280ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.800 7fea2e3c7700 1 --2- 172.21.15.79:0/3375490505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea28096ad0 0x7fea28097520 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.800 7fea2e3c7700 1 -- 172.21.15.79:0/3375490505 >> 172.21.15.79:0/3375490505 conn(0x7fea2809a880 msgr2=0x7fea280d8500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.800 7fea2e3c7700 1 -- 172.21.15.79:0/3375490505 shutdown_connections 2021-04-09T18:32:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.800 7fea2e3c7700 1 -- 172.21.15.79:0/3375490505 wait complete. 2021-04-09T18:32:12.814 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-04-09T18:32:12.814 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-04-09T18:32:12.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.904 7f41ad60d700 1 Processor -- start 2021-04-09T18:32:12.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.904 7f41ad60d700 1 -- start start 2021-04-09T18:32:12.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.904 7f41ad60d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f41a80f5550 0x7f41a80f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.904 7f41ad60d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41a80e9b10 0x7f41a809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.904 7f41ad60d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a80fbb50 con 0x7f41a81c2de0 2021-04-09T18:32:12.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.904 7f41ad60d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a80e9f60 con 0x7f41a80f5550 2021-04-09T18:32:12.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.904 7f41ad60d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a80e5a00 con 0x7f41a80e9b10 2021-04-09T18:32:12.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.904 7f41a7247700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f41a80f5550 0x7f41a80f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.904 7f41a7247700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f41a80f5550 0x7f41a80f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59578/0 (socket says 172.21.15.79:59578) 2021-04-09T18:32:12.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.904 7f41a7247700 1 -- 172.21.15.79:0/678497428 learned_addr learned my addr 172.21.15.79:0/678497428 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:12.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.908 7f41a6a46700 1 --2- 172.21.15.79:0/678497428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41a80e9b10 0x7f41a809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.908 7f41a7247700 1 -- 172.21.15.79:0/678497428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41a80e9b10 msgr2=0x7f41a809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:12.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.908 7f41a7247700 1 --2- 172.21.15.79:0/678497428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41a80e9b10 0x7f41a809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.908 7f41a7247700 1 -- 172.21.15.79:0/678497428 >> v1:172.21.15.89:6789/0 conn(0x7f41a81c2de0 legacy=0x7f41a81c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.908 7f41a7247700 1 -- 172.21.15.79:0/678497428 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a80e5700 con 0x7f41a80f5550 2021-04-09T18:32:12.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.908 7f41a7247700 1 --2- 172.21.15.79:0/678497428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41a80f5550 0x7f41a80f64e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f4198002f30 tx=0x7f419800bda0).ready entity=mon.0 client_cookie=6a9657f6be7a4654 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:12.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.908 7f41a6245700 1 -- 172.21.15.79:0/678497428 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f41a80e5700 con 0x7f41a80f5550 2021-04-09T18:32:12.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.908 7f41a6245700 1 -- 172.21.15.79:0/678497428 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41980099d0 con 0x7f41a80f5550 2021-04-09T18:32:12.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.908 7f41a6245700 1 -- 172.21.15.79:0/678497428 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4198009da0 con 0x7f41a80f5550 2021-04-09T18:32:12.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.908 7f41ad60d700 1 -- 172.21.15.79:0/678497428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41a80f5550 msgr2=0x7f41a80f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.908 7f41ad60d700 1 --2- 172.21.15.79:0/678497428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41a80f5550 0x7f41a80f64e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f4198002f30 tx=0x7f419800bda0).stop 2021-04-09T18:32:12.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.908 7f41ad60d700 1 -- 172.21.15.79:0/678497428 shutdown_connections 2021-04-09T18:32:12.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.908 7f41ad60d700 1 --2- 172.21.15.79:0/678497428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41a80f5550 0x7f41a80f64e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.908 7f41ad60d700 1 --2- 172.21.15.79:0/678497428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41a80e9b10 0x7f41a809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.908 7f41ad60d700 1 -- 172.21.15.79:0/678497428 >> 172.21.15.79:0/678497428 conn(0x7f41a80e6010 msgr2=0x7f41a80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:12.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.908 7f41ad60d700 1 -- 172.21.15.79:0/678497428 shutdown_connections 2021-04-09T18:32:12.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.908 7f41ad60d700 1 -- 172.21.15.79:0/678497428 wait complete. 2021-04-09T18:32:12.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.912 7f41ad60d700 1 Processor -- start 2021-04-09T18:32:12.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.912 7f41ad60d700 1 -- start start 2021-04-09T18:32:12.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.912 7f41ad60d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41a80ceba0 0x7f41a80ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.912 7f41ad60d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41a81aa070 0x7f41a81aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.912 7f41ad60d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41a80cfd50 0x7f41a80d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.912 7f41ad60d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a80d5aa0 con 0x7f41a81aa070 2021-04-09T18:32:12.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.912 7f41ad60d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a80d5da0 con 0x7f41a80cfd50 2021-04-09T18:32:12.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.912 7f41ad60d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a80d5330 con 0x7f41a80ceba0 2021-04-09T18:32:12.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.912 7f41a6a46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41a81aa070 0x7f41a81aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.912 7f41a6a46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41a81aa070 0x7f41a81aa4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59586/0 (socket says 172.21.15.79:59586) 2021-04-09T18:32:12.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.912 7f41a6a46700 1 -- 172.21.15.79:0/2917059179 learned_addr learned my addr 172.21.15.79:0/2917059179 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:12.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.912 7f41a7a48700 1 --2- 172.21.15.79:0/2917059179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41a80cfd50 0x7f41a80d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.912 7f41a7247700 1 --2- 172.21.15.79:0/2917059179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41a80ceba0 0x7f41a80ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.916 7f41a6a46700 1 -- 172.21.15.79:0/2917059179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41a80ceba0 msgr2=0x7f41a80ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.916 7f41a6a46700 1 --2- 172.21.15.79:0/2917059179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41a80ceba0 0x7f41a80ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.916 7f41a6a46700 1 -- 172.21.15.79:0/2917059179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41a80cfd50 msgr2=0x7f41a80d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.916 7f41a6a46700 1 --2- 172.21.15.79:0/2917059179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41a80cfd50 0x7f41a80d01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.916 7f41a6a46700 1 -- 172.21.15.79:0/2917059179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a80d07d0 con 0x7f41a81aa070 2021-04-09T18:32:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.916 7f41a6a46700 1 --2- 172.21.15.79:0/2917059179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41a81aa070 0x7f41a81aa4c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f41a80ad7c0 tx=0x7f419c00c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.916 7f418ffff700 1 -- 172.21.15.79:0/2917059179 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f419c00f040 con 0x7f41a81aa070 2021-04-09T18:32:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.916 7f418ffff700 1 -- 172.21.15.79:0/2917059179 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c00cbb0 con 0x7f41a81aa070 2021-04-09T18:32:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.916 7f418ffff700 1 -- 172.21.15.79:0/2917059179 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f419c0123f0 con 0x7f41a81aa070 2021-04-09T18:32:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.916 7f41ad60d700 1 -- 172.21.15.79:0/2917059179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a80d5650 con 0x7f41a81aa070 2021-04-09T18:32:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.916 7f41ad60d700 1 -- 172.21.15.79:0/2917059179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a808f480 con 0x7f41a81aa070 2021-04-09T18:32:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.916 7f418ffff700 1 -- 172.21.15.79:0/2917059179 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f419c011070 con 0x7f41a81aa070 2021-04-09T18:32:12.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.916 7f418ffff700 1 --2- 172.21.15.79:0/2917059179 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4188029100 0x7f418802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:12.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.916 7f418ffff700 1 -- 172.21.15.79:0/2917059179 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f419c010040 con 0x7f41a81aa070 2021-04-09T18:32:12.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.916 7f41a7247700 1 --2- 172.21.15.79:0/2917059179 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4188029100 0x7f418802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:12.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.916 7f41a7247700 1 --2- 172.21.15.79:0/2917059179 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4188029100 0x7f418802b650 crc :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:12.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.916 7f41ad60d700 1 -- 172.21.15.79:0/2917059179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a80e39f0 con 0x7f41a81aa070 2021-04-09T18:32:12.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:12.924 7f418ffff700 1 -- 172.21.15.79:0/2917059179 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f419c00c7b0 con 0x7f41a81aa070 2021-04-09T18:32:13.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.080 7f41ad60d700 1 -- 172.21.15.79:0/2917059179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f41a80f5b50 con 0x7f41a81aa070 2021-04-09T18:32:13.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.568 7f418ffff700 1 -- 172.21.15.79:0/2917059179 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v65) v1 ==== 133+0+0 (secure 0 0 0) 0x7f419c000bf0 con 0x7f41a81aa070 2021-04-09T18:32:13.598 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2021-04-09T18:32:13.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.600 7f41ad60d700 1 -- 172.21.15.79:0/2917059179 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4188029100 msgr2=0x7f418802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:13.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.600 7f41ad60d700 1 --2- 172.21.15.79:0/2917059179 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4188029100 0x7f418802b650 crc :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:13.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.600 7f41ad60d700 1 -- 172.21.15.79:0/2917059179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41a81aa070 msgr2=0x7f41a81aa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:13.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.600 7f41ad60d700 1 --2- 172.21.15.79:0/2917059179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41a81aa070 0x7f41a81aa4c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f41a80ad7c0 tx=0x7f419c00c150).stop 2021-04-09T18:32:13.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.600 7f41ad60d700 1 -- 172.21.15.79:0/2917059179 shutdown_connections 2021-04-09T18:32:13.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.600 7f41ad60d700 1 --2- 172.21.15.79:0/2917059179 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4188029100 0x7f418802b650 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:13.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.600 7f41ad60d700 1 --2- 172.21.15.79:0/2917059179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41a80cfd50 0x7f41a80d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:13.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.600 7f41ad60d700 1 --2- 172.21.15.79:0/2917059179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41a80ceba0 0x7f41a80ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:13.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.600 7f41ad60d700 1 --2- 172.21.15.79:0/2917059179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41a81aa070 0x7f41a81aa4c0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:13.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.600 7f41ad60d700 1 -- 172.21.15.79:0/2917059179 >> 172.21.15.79:0/2917059179 conn(0x7f41a80d3000 msgr2=0x7f41a808e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:13.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.600 7f41ad60d700 1 -- 172.21.15.79:0/2917059179 shutdown_connections 2021-04-09T18:32:13.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.600 7f41ad60d700 1 -- 172.21.15.79:0/2917059179 wait complete. 2021-04-09T18:32:13.616 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-04-09T18:32:13.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fd6dca700 1 Processor -- start 2021-04-09T18:32:13.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fd6dca700 1 -- start start 2021-04-09T18:32:13.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fd6dca700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0fd00f5550 0x7f0fd00f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:13.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fd6dca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fd00e9b10 0x7f0fd009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:13.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fd6dca700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd00fbb50 con 0x7f0fd01c2de0 2021-04-09T18:32:13.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fd6dca700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd00e9f60 con 0x7f0fd00f5550 2021-04-09T18:32:13.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fd6dca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd00e5a00 con 0x7f0fd00e9b10 2021-04-09T18:32:13.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fd536f700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0fd01c2de0 0x7f0fd01c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54304/0 (socket says 172.21.15.79:54304) 2021-04-09T18:32:13.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fd536f700 1 -- 172.21.15.79:0/2746097270 learned_addr learned my addr 172.21.15.79:0/2746097270 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:13.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fcffff700 1 --2- 172.21.15.79:0/2746097270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fd00e9b10 0x7f0fd009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:13.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fd4b6e700 1 --2- 172.21.15.79:0/2746097270 >> v2:172.21.15.89:3300/0 conn(0x7f0fd00f5550 0x7f0fd00f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:13.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fcf7fe700 1 -- 172.21.15.79:0/2746097270 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051785648 0 0) 0x7f0fc0001450 con 0x7f0fd01c2de0 2021-04-09T18:32:13.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fcf7fe700 1 -- 172.21.15.79:0/2746097270 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fbc003240 con 0x7f0fd01c2de0 2021-04-09T18:32:13.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fcffff700 1 -- 172.21.15.79:0/2746097270 >> v2:172.21.15.89:3300/0 conn(0x7f0fd00f5550 msgr2=0x7f0fd00f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:13.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fcffff700 1 --2- 172.21.15.79:0/2746097270 >> v2:172.21.15.89:3300/0 conn(0x7f0fd00f5550 0x7f0fd00f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:13.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fcffff700 1 -- 172.21.15.79:0/2746097270 >> v1:172.21.15.79:6789/0 conn(0x7f0fd01c2de0 legacy=0x7f0fd01c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:13.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fcffff700 1 -- 172.21.15.79:0/2746097270 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd00e5700 con 0x7f0fd00e9b10 2021-04-09T18:32:13.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fcffff700 1 --2- 172.21.15.79:0/2746097270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fd00e9b10 0x7f0fd009f110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f0fc8002f30 tx=0x7f0fc800bcc0).ready entity=mon.2 client_cookie=2c38859bb4b5e21b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:13.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fcf7fe700 1 -- 172.21.15.79:0/2746097270 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0fd00e5700 con 0x7f0fd00e9b10 2021-04-09T18:32:13.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fcf7fe700 1 -- 172.21.15.79:0/2746097270 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc8009800 con 0x7f0fd00e9b10 2021-04-09T18:32:13.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fcf7fe700 1 -- 172.21.15.79:0/2746097270 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0fc8009bd0 con 0x7f0fd00e9b10 2021-04-09T18:32:13.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fd6dca700 1 -- 172.21.15.79:0/2746097270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fd00e9b10 msgr2=0x7f0fd009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:13.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.708 7f0fd6dca700 1 --2- 172.21.15.79:0/2746097270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fd00e9b10 0x7f0fd009f110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f0fc8002f30 tx=0x7f0fc800bcc0).stop 2021-04-09T18:32:13.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.712 7f0fd6dca700 1 -- 172.21.15.79:0/2746097270 shutdown_connections 2021-04-09T18:32:13.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.712 7f0fd6dca700 1 --2- 172.21.15.79:0/2746097270 >> v2:172.21.15.89:3300/0 conn(0x7f0fd00f5550 0x7f0fd00f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:13.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.712 7f0fd6dca700 1 --2- 172.21.15.79:0/2746097270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fd00e9b10 0x7f0fd009f110 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:13.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.712 7f0fd6dca700 1 -- 172.21.15.79:0/2746097270 >> 172.21.15.79:0/2746097270 conn(0x7f0fd00e6010 msgr2=0x7f0fd00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:13.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.712 7f0fd6dca700 1 -- 172.21.15.79:0/2746097270 shutdown_connections 2021-04-09T18:32:13.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.712 7f0fd6dca700 1 -- 172.21.15.79:0/2746097270 wait complete. 2021-04-09T18:32:13.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.712 7f0fd6dca700 1 Processor -- start 2021-04-09T18:32:13.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.712 7f0fd6dca700 1 -- start start 2021-04-09T18:32:13.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.712 7f0fd6dca700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fd00aa720 0x7f0fd01a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:13.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.712 7f0fd6dca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fd0099dc0 0x7f0fd00d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:13.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.712 7f0fd6dca700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fd00d14e0 0x7f0fd00d1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:13.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.712 7f0fd6dca700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd00aadf0 con 0x7f0fd00aa720 2021-04-09T18:32:13.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.712 7f0fd6dca700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd00ab0f0 con 0x7f0fd00d14e0 2021-04-09T18:32:13.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.712 7f0fd6dca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd01a8460 con 0x7f0fd0099dc0 2021-04-09T18:32:13.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.712 7f0fd4b6e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fd00aa720 0x7f0fd01a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:13.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.712 7f0fd4b6e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fd00aa720 0x7f0fd01a7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59596/0 (socket says 172.21.15.79:59596) 2021-04-09T18:32:13.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.712 7f0fd4b6e700 1 -- 172.21.15.79:0/1879751265 learned_addr learned my addr 172.21.15.79:0/1879751265 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:13.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.712 7f0fd536f700 1 --2- 172.21.15.79:0/1879751265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fd00d14e0 0x7f0fd00d1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:13.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.712 7f0fcffff700 1 --2- 172.21.15.79:0/1879751265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fd0099dc0 0x7f0fd00d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:13.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.716 7f0fd4b6e700 1 -- 172.21.15.79:0/1879751265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fd0099dc0 msgr2=0x7f0fd00d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:13.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.716 7f0fd4b6e700 1 --2- 172.21.15.79:0/1879751265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fd0099dc0 0x7f0fd00d0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:13.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.716 7f0fd4b6e700 1 -- 172.21.15.79:0/1879751265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fd00d14e0 msgr2=0x7f0fd00d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:13.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.716 7f0fd4b6e700 1 --2- 172.21.15.79:0/1879751265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fd00d14e0 0x7f0fd00d1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:13.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.716 7f0fd4b6e700 1 -- 172.21.15.79:0/1879751265 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd009a210 con 0x7f0fd00aa720 2021-04-09T18:32:13.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.716 7f0fcffff700 1 --2- 172.21.15.79:0/1879751265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fd0099dc0 0x7f0fd00d0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:32:13.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.716 7f0fd4b6e700 1 --2- 172.21.15.79:0/1879751265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fd00aa720 0x7f0fd01a7e30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f0fb8006920 tx=0x7f0fb800c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:13.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.716 7f0fcd7fa700 1 -- 172.21.15.79:0/1879751265 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0fd009a210 con 0x7f0fd00aa720 2021-04-09T18:32:13.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.716 7f0fcd7fa700 1 -- 172.21.15.79:0/1879751265 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb800cb50 con 0x7f0fd00aa720 2021-04-09T18:32:13.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.716 7f0fd6dca700 1 -- 172.21.15.79:0/1879751265 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd009a530 con 0x7f0fd00aa720 2021-04-09T18:32:13.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.716 7f0fcd7fa700 1 -- 172.21.15.79:0/1879751265 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0fb800f040 con 0x7f0fd00aa720 2021-04-09T18:32:13.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.716 7f0fd6dca700 1 -- 172.21.15.79:0/1879751265 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd00d2720 con 0x7f0fd00aa720 2021-04-09T18:32:13.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.716 7f0fcd7fa700 1 -- 172.21.15.79:0/1879751265 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0fb8011070 con 0x7f0fd00aa720 2021-04-09T18:32:13.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.716 7f0fcd7fa700 1 --2- 172.21.15.79:0/1879751265 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0fb4029100 0x7f0fb402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:13.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.716 7f0fcd7fa700 1 -- 172.21.15.79:0/1879751265 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5458+0+0 (secure 0 0 0) 0x7f0fb8010040 con 0x7f0fd00aa720 2021-04-09T18:32:13.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.716 7f0fcffff700 1 --2- 172.21.15.79:0/1879751265 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0fb4029100 0x7f0fb402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:13.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.716 7f0fcffff700 1 --2- 172.21.15.79:0/1879751265 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0fb4029100 0x7f0fb402b650 crc :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:13.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.720 7f0fd6dca700 1 -- 172.21.15.79:0/1879751265 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd00e39f0 con 0x7f0fd00aa720 2021-04-09T18:32:13.736 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:32:13.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.728 7f0fcd7fa700 1 -- 172.21.15.79:0/1879751265 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0fb8000bf0 con 0x7f0fd00aa720 2021-04-09T18:32:13.739 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:32:13.741 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:32:13.744 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:32:13.746 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:32:13.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:13.888 7f0fd6dca700 1 -- 172.21.15.79:0/1879751265 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f0fd00f5b50 con 0x7f0fd00aa720 2021-04-09T18:32:14.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.576 7f0fcd7fa700 1 -- 172.21.15.79:0/1879751265 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v66) v1 ==== 125+0+0 (secure 0 0 0) 0x7f0fb800c750 con 0x7f0fd00aa720 2021-04-09T18:32:14.605 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2021-04-09T18:32:14.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.604 7f0fd6dca700 1 -- 172.21.15.79:0/1879751265 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0fb4029100 msgr2=0x7f0fb402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:14.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.604 7f0fd6dca700 1 --2- 172.21.15.79:0/1879751265 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0fb4029100 0x7f0fb402b650 crc :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:14.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.604 7f0fd6dca700 1 -- 172.21.15.79:0/1879751265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fd00aa720 msgr2=0x7f0fd01a7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:14.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.604 7f0fd6dca700 1 --2- 172.21.15.79:0/1879751265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fd00aa720 0x7f0fd01a7e30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f0fb8006920 tx=0x7f0fb800c150).stop 2021-04-09T18:32:14.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.604 7f0fd6dca700 1 -- 172.21.15.79:0/1879751265 shutdown_connections 2021-04-09T18:32:14.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.604 7f0fd6dca700 1 --2- 172.21.15.79:0/1879751265 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0fb4029100 0x7f0fb402b650 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:14.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.604 7f0fd6dca700 1 --2- 172.21.15.79:0/1879751265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fd00d14e0 0x7f0fd00d1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:14.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.604 7f0fd6dca700 1 --2- 172.21.15.79:0/1879751265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fd00aa720 0x7f0fd01a7e30 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:14.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.604 7f0fd6dca700 1 --2- 172.21.15.79:0/1879751265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fd0099dc0 0x7f0fd00d0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:14.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.604 7f0fd6dca700 1 -- 172.21.15.79:0/1879751265 >> 172.21.15.79:0/1879751265 conn(0x7f0fd00bb0c0 msgr2=0x7f0fd00b9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:14.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.604 7f0fd6dca700 1 -- 172.21.15.79:0/1879751265 shutdown_connections 2021-04-09T18:32:14.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.604 7f0fd6dca700 1 -- 172.21.15.79:0/1879751265 wait complete. 2021-04-09T18:32:14.622 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-04-09T18:32:14.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.712 7fda33772700 1 Processor -- start 2021-04-09T18:32:14.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.712 7fda33772700 1 -- start start 2021-04-09T18:32:14.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.712 7fda33772700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fda2c0f5550 0x7fda2c0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:14.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.712 7fda33772700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda2c1c8040 0x7fda2c1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:14.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.712 7fda33772700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2c0fbb50 con 0x7fda2c0e9b10 2021-04-09T18:32:14.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.712 7fda33772700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2c0e9f60 con 0x7fda2c0f5550 2021-04-09T18:32:14.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.712 7fda33772700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c1c3df0 con 0x7fda2c1c8040 2021-04-09T18:32:14.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.712 7fda31d17700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda2c1c8040 0x7fda2c1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:14.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.712 7fda31516700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fda2c0f5550 0x7fda2c0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:14.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.712 7fda31d17700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda2c1c8040 0x7fda2c1ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:56604/0 (socket says 172.21.15.79:56604) 2021-04-09T18:32:14.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.712 7fda31d17700 1 -- 172.21.15.79:0/786941424 learned_addr learned my addr 172.21.15.79:0/786941424 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:14.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.716 7fda31516700 1 -- 172.21.15.79:0/786941424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda2c1c8040 msgr2=0x7fda2c1ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:14.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.716 7fda31516700 1 --2- 172.21.15.79:0/786941424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda2c1c8040 0x7fda2c1ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:14.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.716 7fda31516700 1 -- 172.21.15.79:0/786941424 >> v1:172.21.15.89:6789/0 conn(0x7fda2c0e9b10 legacy=0x7fda2c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:14.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.716 7fda31516700 1 -- 172.21.15.79:0/786941424 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c09f910 con 0x7fda2c0f5550 2021-04-09T18:32:14.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.716 7fda2bfff700 1 -- 172.21.15.79:0/786941424 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760152804 0 0) 0x7fda140010d0 con 0x7fda2c0e9b10 2021-04-09T18:32:14.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.716 7fda31d17700 1 --2- 172.21.15.79:0/786941424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda2c1c8040 0x7fda2c1ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:32:14.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.716 7fda31516700 1 --2- 172.21.15.79:0/786941424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda2c0f5550 0x7fda2c0f64e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fda2c0f6f30 tx=0x7fda2400bd70).ready entity=mon.1 client_cookie=cde7b4f416968e3a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:14.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.716 7fda2bfff700 1 -- 172.21.15.79:0/786941424 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fda2c09f910 con 0x7fda2c0f5550 2021-04-09T18:32:14.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.716 7fda2bfff700 1 -- 172.21.15.79:0/786941424 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda24009810 con 0x7fda2c0f5550 2021-04-09T18:32:14.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.716 7fda2bfff700 1 -- 172.21.15.79:0/786941424 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fda24009be0 con 0x7fda2c0f5550 2021-04-09T18:32:14.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.716 7fda33772700 1 -- 172.21.15.79:0/786941424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda2c0f5550 msgr2=0x7fda2c0f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:14.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.716 7fda33772700 1 --2- 172.21.15.79:0/786941424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda2c0f5550 0x7fda2c0f64e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fda2c0f6f30 tx=0x7fda2400bd70).stop 2021-04-09T18:32:14.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.716 7fda33772700 1 -- 172.21.15.79:0/786941424 shutdown_connections 2021-04-09T18:32:14.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.716 7fda33772700 1 --2- 172.21.15.79:0/786941424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda2c1c8040 0x7fda2c1ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:14.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.716 7fda33772700 1 --2- 172.21.15.79:0/786941424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda2c0f5550 0x7fda2c0f64e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:14.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.716 7fda33772700 1 -- 172.21.15.79:0/786941424 >> 172.21.15.79:0/786941424 conn(0x7fda2c0e6010 msgr2=0x7fda2c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:14.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.716 7fda33772700 1 -- 172.21.15.79:0/786941424 shutdown_connections 2021-04-09T18:32:14.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.716 7fda33772700 1 -- 172.21.15.79:0/786941424 wait complete. 2021-04-09T18:32:14.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda33772700 1 Processor -- start 2021-04-09T18:32:14.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda33772700 1 -- start start 2021-04-09T18:32:14.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda33772700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda2c0c3d30 0x7fda2c0c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:14.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda33772700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda2c0aeb70 0x7fda2c0aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:14.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda33772700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda2c0af5f0 0x7fda2c1b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:14.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda33772700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c0ad2d0 con 0x7fda2c0aeb70 2021-04-09T18:32:14.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda33772700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c0ad5d0 con 0x7fda2c0af5f0 2021-04-09T18:32:14.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda33772700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c1adc60 con 0x7fda2c0c3d30 2021-04-09T18:32:14.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda30d15700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda2c0aeb70 0x7fda2c0aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:14.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda30d15700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda2c0aeb70 0x7fda2c0aefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59614/0 (socket says 172.21.15.79:59614) 2021-04-09T18:32:14.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda30d15700 1 -- 172.21.15.79:0/3118386017 learned_addr learned my addr 172.21.15.79:0/3118386017 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:14.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda31516700 1 --2- 172.21.15.79:0/3118386017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda2c0c3d30 0x7fda2c0c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:14.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda31d17700 1 --2- 172.21.15.79:0/3118386017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda2c0af5f0 0x7fda2c1b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:14.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda30d15700 1 -- 172.21.15.79:0/3118386017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda2c0c3d30 msgr2=0x7fda2c0c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:14.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda30d15700 1 --2- 172.21.15.79:0/3118386017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda2c0c3d30 0x7fda2c0c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:14.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda30d15700 1 -- 172.21.15.79:0/3118386017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda2c0af5f0 msgr2=0x7fda2c1b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:14.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda30d15700 1 --2- 172.21.15.79:0/3118386017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda2c0af5f0 0x7fda2c1b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:14.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda30d15700 1 -- 172.21.15.79:0/3118386017 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c0afa40 con 0x7fda2c0aeb70 2021-04-09T18:32:14.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda30d15700 1 --2- 172.21.15.79:0/3118386017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda2c0aeb70 0x7fda2c0aefc0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fda2c1a4fc0 tx=0x7fda1400cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:14.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda29ffb700 1 -- 172.21.15.79:0/3118386017 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fda2c0afa40 con 0x7fda2c0aeb70 2021-04-09T18:32:14.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda29ffb700 1 -- 172.21.15.79:0/3118386017 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda14010510 con 0x7fda2c0aeb70 2021-04-09T18:32:14.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda33772700 1 -- 172.21.15.79:0/3118386017 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2c0acf00 con 0x7fda2c0aeb70 2021-04-09T18:32:14.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda29ffb700 1 -- 172.21.15.79:0/3118386017 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fda140106f0 con 0x7fda2c0aeb70 2021-04-09T18:32:14.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.720 7fda33772700 1 -- 172.21.15.79:0/3118386017 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2c0c4c40 con 0x7fda2c0aeb70 2021-04-09T18:32:14.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.724 7fda29ffb700 1 -- 172.21.15.79:0/3118386017 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fda14019020 con 0x7fda2c0aeb70 2021-04-09T18:32:14.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.724 7fda29ffb700 1 --2- 172.21.15.79:0/3118386017 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fda10029100 0x7fda1002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:14.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.724 7fda29ffb700 1 -- 172.21.15.79:0/3118386017 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fda14038d30 con 0x7fda2c0aeb70 2021-04-09T18:32:14.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.724 7fda31516700 1 --2- 172.21.15.79:0/3118386017 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fda10029100 0x7fda1002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:14.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.724 7fda31516700 1 --2- 172.21.15.79:0/3118386017 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fda10029100 0x7fda1002b650 crc :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:14.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.728 7fda33772700 1 -- 172.21.15.79:0/3118386017 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2c0e39f0 con 0x7fda2c0aeb70 2021-04-09T18:32:14.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.736 7fda29ffb700 1 -- 172.21.15.79:0/3118386017 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fda2c0e5cd0 con 0x7fda2c0aeb70 2021-04-09T18:32:14.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.900 7fda33772700 1 -- 172.21.15.79:0/3118386017 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7fda2c0f5b50 con 0x7fda2c0aeb70 2021-04-09T18:32:14.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.908 7fda29ffb700 1 -- 172.21.15.79:0/3118386017 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 12 and data pool 13 v37) v1 ==== 189+0+0 (secure 0 0 0) 0x7fda14010300 con 0x7fda2c0aeb70 2021-04-09T18:32:14.918 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 12 and data pool 13 2021-04-09T18:32:14.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.920 7fda33772700 1 -- 172.21.15.79:0/3118386017 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fda10029100 msgr2=0x7fda1002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:14.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.920 7fda33772700 1 --2- 172.21.15.79:0/3118386017 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fda10029100 0x7fda1002b650 crc :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:14.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.920 7fda33772700 1 -- 172.21.15.79:0/3118386017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda2c0aeb70 msgr2=0x7fda2c0aefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:14.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.920 7fda33772700 1 --2- 172.21.15.79:0/3118386017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda2c0aeb70 0x7fda2c0aefc0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fda2c1a4fc0 tx=0x7fda1400cae0).stop 2021-04-09T18:32:14.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.920 7fda33772700 1 -- 172.21.15.79:0/3118386017 shutdown_connections 2021-04-09T18:32:14.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.920 7fda33772700 1 --2- 172.21.15.79:0/3118386017 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fda10029100 0x7fda1002b650 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:14.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.920 7fda33772700 1 --2- 172.21.15.79:0/3118386017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda2c0af5f0 0x7fda2c1b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:14.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.920 7fda33772700 1 --2- 172.21.15.79:0/3118386017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda2c0c3d30 0x7fda2c0c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:14.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.920 7fda33772700 1 --2- 172.21.15.79:0/3118386017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda2c0aeb70 0x7fda2c0aefc0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:14.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.920 7fda33772700 1 -- 172.21.15.79:0/3118386017 >> 172.21.15.79:0/3118386017 conn(0x7fda2c095500 msgr2=0x7fda2c0a3050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:14.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.920 7fda33772700 1 -- 172.21.15.79:0/3118386017 shutdown_connections 2021-04-09T18:32:14.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:14.920 7fda33772700 1 -- 172.21.15.79:0/3118386017 wait complete. 2021-04-09T18:32:14.934 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:32:15.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.024 7fd513429700 1 Processor -- start 2021-04-09T18:32:15.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.024 7fd513429700 1 -- start start 2021-04-09T18:32:15.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.024 7fd513429700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd50c1c9010 0x7fd50c1cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:15.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.024 7fd513429700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50c0fbb10 con 0x7fd50c0e9ad0 2021-04-09T18:32:15.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.024 7fd513429700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50c09f900 con 0x7fd50c0f5510 2021-04-09T18:32:15.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.024 7fd513429700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c1c3db0 con 0x7fd50c1c9010 2021-04-09T18:32:15.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.024 7fd5109cc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd50c0e9ad0 0x7fd50c09f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54330/0 (socket says 172.21.15.79:54330) 2021-04-09T18:32:15.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.024 7fd5109cc700 1 -- 172.21.15.79:0/3817474523 learned_addr learned my addr 172.21.15.79:0/3817474523 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:15.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.024 7fd5119ce700 1 --2- 172.21.15.79:0/3817474523 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd50c1c9010 0x7fd50c1cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:15.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.024 7fd50bfff700 1 -- 172.21.15.79:0/3817474523 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014090695 0 0) 0x7fd5000010d0 con 0x7fd50c0e9ad0 2021-04-09T18:32:15.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.024 7fd50bfff700 1 -- 172.21.15.79:0/3817474523 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4f4003240 con 0x7fd50c0e9ad0 2021-04-09T18:32:15.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.028 7fd50bfff700 1 -- 172.21.15.79:0/3817474523 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766075680 0 0) 0x7fd4fc001450 con 0x7fd50c0f5510 2021-04-09T18:32:15.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.028 7fd50bfff700 1 -- 172.21.15.79:0/3817474523 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4f4003620 con 0x7fd50c0f5510 2021-04-09T18:32:15.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.028 7fd5119ce700 1 -- 172.21.15.79:0/3817474523 >> v1:172.21.15.89:6789/0 conn(0x7fd50c0f5510 legacy=0x7fd50c0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:15.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.028 7fd5119ce700 1 -- 172.21.15.79:0/3817474523 >> v1:172.21.15.79:6789/0 conn(0x7fd50c0e9ad0 legacy=0x7fd50c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:15.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.028 7fd5119ce700 1 -- 172.21.15.79:0/3817474523 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c0e56c0 con 0x7fd50c1c9010 2021-04-09T18:32:15.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.028 7fd5119ce700 1 --2- 172.21.15.79:0/3817474523 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd50c1c9010 0x7fd50c1cb470 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fd504002f30 tx=0x7fd50400bcf0).ready entity=mon.2 client_cookie=edc2d55a6d82c1ae server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:15.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.028 7fd50bfff700 1 -- 172.21.15.79:0/3817474523 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd50c0e56c0 con 0x7fd50c1c9010 2021-04-09T18:32:15.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.028 7fd50bfff700 1 -- 172.21.15.79:0/3817474523 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd504009920 con 0x7fd50c1c9010 2021-04-09T18:32:15.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.028 7fd50bfff700 1 -- 172.21.15.79:0/3817474523 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd504009cf0 con 0x7fd50c1c9010 2021-04-09T18:32:15.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.028 7fd513429700 1 -- 172.21.15.79:0/3817474523 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd50c1c9010 msgr2=0x7fd50c1cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:15.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.028 7fd513429700 1 --2- 172.21.15.79:0/3817474523 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd50c1c9010 0x7fd50c1cb470 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fd504002f30 tx=0x7fd50400bcf0).stop 2021-04-09T18:32:15.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.028 7fd513429700 1 -- 172.21.15.79:0/3817474523 shutdown_connections 2021-04-09T18:32:15.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.028 7fd513429700 1 --2- 172.21.15.79:0/3817474523 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd50c1c9010 0x7fd50c1cb470 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.028 7fd513429700 1 -- 172.21.15.79:0/3817474523 >> 172.21.15.79:0/3817474523 conn(0x7fd50c0e5fd0 msgr2=0x7fd50c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:15.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.028 7fd513429700 1 -- 172.21.15.79:0/3817474523 shutdown_connections 2021-04-09T18:32:15.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.028 7fd513429700 1 -- 172.21.15.79:0/3817474523 wait complete. 2021-04-09T18:32:15.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.028 7fd513429700 1 Processor -- start 2021-04-09T18:32:15.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd513429700 1 -- start start 2021-04-09T18:32:15.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd513429700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd50c0d5b90 0x7fd50c0d2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:15.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd513429700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd50c0d2c60 0x7fd50c08e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:15.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd513429700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd50c08ee50 0x7fd50c0d62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:15.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd513429700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c0e9f20 con 0x7fd50c08ee50 2021-04-09T18:32:15.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd513429700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c08e520 con 0x7fd50c0d2c60 2021-04-09T18:32:15.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd513429700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c095b10 con 0x7fd50c0d5b90 2021-04-09T18:32:15.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd5119ce700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd50c08ee50 0x7fd50c0d62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:15.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd5119ce700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd50c08ee50 0x7fd50c0d62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59628/0 (socket says 172.21.15.79:59628) 2021-04-09T18:32:15.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd5119ce700 1 -- 172.21.15.79:0/3936467735 learned_addr learned my addr 172.21.15.79:0/3936467735 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:15.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd5109cc700 1 --2- 172.21.15.79:0/3936467735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd50c0d2c60 0x7fd50c08e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:15.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd5111cd700 1 --2- 172.21.15.79:0/3936467735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd50c0d5b90 0x7fd50c0d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:15.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd5119ce700 1 -- 172.21.15.79:0/3936467735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd50c0d5b90 msgr2=0x7fd50c0d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:15.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd5119ce700 1 --2- 172.21.15.79:0/3936467735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd50c0d5b90 0x7fd50c0d2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd5119ce700 1 -- 172.21.15.79:0/3936467735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd50c0d2c60 msgr2=0x7fd50c08e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:15.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd5119ce700 1 --2- 172.21.15.79:0/3936467735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd50c0d2c60 0x7fd50c08e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd5119ce700 1 -- 172.21.15.79:0/3936467735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c0d5fe0 con 0x7fd50c08ee50 2021-04-09T18:32:15.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd5119ce700 1 --2- 172.21.15.79:0/3936467735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd50c08ee50 0x7fd50c0d62b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fd50c0945d0 tx=0x7fd504006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:15.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd509ffb700 1 -- 172.21.15.79:0/3936467735 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd50c0d5fe0 con 0x7fd50c08ee50 2021-04-09T18:32:15.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd509ffb700 1 -- 172.21.15.79:0/3936467735 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50401d450 con 0x7fd50c08ee50 2021-04-09T18:32:15.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd513429700 1 -- 172.21.15.79:0/3936467735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd50c08dfb0 con 0x7fd50c08ee50 2021-04-09T18:32:15.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd509ffb700 1 -- 172.21.15.79:0/3936467735 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd504022020 con 0x7fd50c08ee50 2021-04-09T18:32:15.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd513429700 1 -- 172.21.15.79:0/3936467735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50c08f490 con 0x7fd50c08ee50 2021-04-09T18:32:15.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd509ffb700 1 -- 172.21.15.79:0/3936467735 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd504006960 con 0x7fd50c08ee50 2021-04-09T18:32:15.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd509ffb700 1 --2- 172.21.15.79:0/3936467735 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd4ec029100 0x7fd4ec02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:15.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd509ffb700 1 -- 172.21.15.79:0/3936467735 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fd50403c540 con 0x7fd50c08ee50 2021-04-09T18:32:15.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.032 7fd5111cd700 1 --2- 172.21.15.79:0/3936467735 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd4ec029100 0x7fd4ec02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:15.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.036 7fd5111cd700 1 --2- 172.21.15.79:0/3936467735 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd4ec029100 0x7fd4ec02b650 crc :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:15.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.036 7fd513429700 1 -- 172.21.15.79:0/3936467735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd50c0e39d0 con 0x7fd50c08ee50 2021-04-09T18:32:15.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.044 7fd509ffb700 1 -- 172.21.15.79:0/3936467735 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd504009710 con 0x7fd50c08ee50 2021-04-09T18:32:15.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.204 7fd513429700 1 -- 172.21.15.79:0/3936467735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd50c0f5b10 con 0x7fd50c08ee50 2021-04-09T18:32:15.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.204 7fd509ffb700 1 -- 172.21.15.79:0/3936467735 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+14348 (secure 0 0 0) 0x7fd504011db0 con 0x7fd50c08ee50 2021-04-09T18:32:15.211 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:32:15.211 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":69,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:32:14.953152","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:32:13.133609","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2021-04-09 18:32:13.943877","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6835/2729581928":"2021-04-10 18:32:14.953106","172.21.15.89:6834/2729581928":"2021-04-10 18:32:14.953106"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:32:15.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.208 7fd513429700 1 -- 172.21.15.79:0/3936467735 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd4ec029100 msgr2=0x7fd4ec02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:15.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.208 7fd513429700 1 --2- 172.21.15.79:0/3936467735 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd4ec029100 0x7fd4ec02b650 crc :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.208 7fd513429700 1 -- 172.21.15.79:0/3936467735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd50c08ee50 msgr2=0x7fd50c0d62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:15.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.208 7fd513429700 1 --2- 172.21.15.79:0/3936467735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd50c08ee50 0x7fd50c0d62b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fd50c0945d0 tx=0x7fd504006890).stop 2021-04-09T18:32:15.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.208 7fd513429700 1 -- 172.21.15.79:0/3936467735 shutdown_connections 2021-04-09T18:32:15.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.208 7fd513429700 1 --2- 172.21.15.79:0/3936467735 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd4ec029100 0x7fd4ec02b650 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.208 7fd513429700 1 --2- 172.21.15.79:0/3936467735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd50c08ee50 0x7fd50c0d62b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.208 7fd513429700 1 --2- 172.21.15.79:0/3936467735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd50c0d5b90 0x7fd50c0d2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.208 7fd513429700 1 --2- 172.21.15.79:0/3936467735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd50c0d2c60 0x7fd50c08e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.208 7fd513429700 1 -- 172.21.15.79:0/3936467735 >> 172.21.15.79:0/3936467735 conn(0x7fd50c0bafb0 msgr2=0x7fd50c09a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:15.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.208 7fd513429700 1 -- 172.21.15.79:0/3936467735 shutdown_connections 2021-04-09T18:32:15.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.208 7fd513429700 1 -- 172.21.15.79:0/3936467735 wait complete. 2021-04-09T18:32:15.223 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:32:15.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.308 7f666421f700 1 Processor -- start 2021-04-09T18:32:15.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.308 7f666421f700 1 -- start start 2021-04-09T18:32:15.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f666421f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f665c0f5520 0x7f665c0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:15.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f666421f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665c0fbb20 con 0x7f665c0e9ae0 2021-04-09T18:32:15.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f666421f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665c09f910 con 0x7f665c1c8010 2021-04-09T18:32:15.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f666421f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665c0e9f30 con 0x7f665c0f5520 2021-04-09T18:32:15.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f66617c2700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f665c0e9ae0 0x7f665c09f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54346/0 (socket says 172.21.15.79:54346) 2021-04-09T18:32:15.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f66617c2700 1 -- 172.21.15.79:0/4197725890 learned_addr learned my addr 172.21.15.79:0/4197725890 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:15.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6661fc3700 1 --2- 172.21.15.79:0/4197725890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f665c0f5520 0x7f665c0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:15.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6660fc1700 1 -- 172.21.15.79:0/4197725890 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341737520 0 0) 0x7f664c0010d0 con 0x7f665c0e9ae0 2021-04-09T18:32:15.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6660fc1700 1 -- 172.21.15.79:0/4197725890 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6648003240 con 0x7f665c0e9ae0 2021-04-09T18:32:15.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6660fc1700 1 -- 172.21.15.79:0/4197725890 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1414128720 0 0) 0x7f664c001650 con 0x7f665c0e9ae0 2021-04-09T18:32:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6660fc1700 1 -- 172.21.15.79:0/4197725890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f665c0f5520 msgr2=0x7f665c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6660fc1700 1 --2- 172.21.15.79:0/4197725890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f665c0f5520 0x7f665c0f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6660fc1700 1 -- 172.21.15.79:0/4197725890 >> v1:172.21.15.89:6789/0 conn(0x7f665c1c8010 legacy=0x7f665c1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6660fc1700 1 -- 172.21.15.79:0/4197725890 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665c0e56d0 con 0x7f665c0e9ae0 2021-04-09T18:32:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6660fc1700 1 -- 172.21.15.79:0/4197725890 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f664c001bb0 con 0x7f665c0e9ae0 2021-04-09T18:32:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6660fc1700 1 -- 172.21.15.79:0/4197725890 >> v1:172.21.15.79:6789/0 conn(0x7f665c0e9ae0 legacy=0x7f665c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6660fc1700 1 --2- 172.21.15.79:0/4197725890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66480038f0 0x7f6648003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6660fc1700 1 --2- 172.21.15.79:0/4197725890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66480045a0 0x7f66480049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:15.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6660fc1700 1 --2- 172.21.15.79:0/4197725890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66480097e0 0x7f664800bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:15.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6660fc1700 1 -- 172.21.15.79:0/4197725890 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c0e9f30 con 0x7f66480038f0 2021-04-09T18:32:15.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6660fc1700 1 -- 172.21.15.79:0/4197725890 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66480051d0 con 0x7f66480045a0 2021-04-09T18:32:15.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6660fc1700 1 -- 172.21.15.79:0/4197725890 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66480053d0 con 0x7f66480097e0 2021-04-09T18:32:15.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6661fc3700 1 --2- 172.21.15.79:0/4197725890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66480038f0 0x7f6648003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:15.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f66617c2700 1 --2- 172.21.15.79:0/4197725890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66480045a0 0x7f66480049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:15.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f66627c4700 1 --2- 172.21.15.79:0/4197725890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66480097e0 0x7f664800bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:15.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6661fc3700 1 -- 172.21.15.79:0/4197725890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66480097e0 msgr2=0x7f664800bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:15.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6661fc3700 1 --2- 172.21.15.79:0/4197725890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66480097e0 0x7f664800bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6661fc3700 1 -- 172.21.15.79:0/4197725890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66480045a0 msgr2=0x7f66480049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:15.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6661fc3700 1 --2- 172.21.15.79:0/4197725890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66480045a0 0x7f66480049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6661fc3700 1 -- 172.21.15.79:0/4197725890 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6648050390 con 0x7f66480038f0 2021-04-09T18:32:15.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6661fc3700 1 --2- 172.21.15.79:0/4197725890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66480038f0 0x7f6648003d60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f665800c000 tx=0x7f665800e1d0).ready entity=mon.0 client_cookie=b1c89d808c990c32 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:15.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6660fc1700 1 -- 172.21.15.79:0/4197725890 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6648050390 con 0x7f66480038f0 2021-04-09T18:32:15.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6660fc1700 1 -- 172.21.15.79:0/4197725890 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665800ec90 con 0x7f66480038f0 2021-04-09T18:32:15.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f6660fc1700 1 -- 172.21.15.79:0/4197725890 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f665800f040 con 0x7f66480038f0 2021-04-09T18:32:15.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f666421f700 1 -- 172.21.15.79:0/4197725890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66480038f0 msgr2=0x7f6648003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:15.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f666421f700 1 --2- 172.21.15.79:0/4197725890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66480038f0 0x7f6648003d60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f665800c000 tx=0x7f665800e1d0).stop 2021-04-09T18:32:15.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.312 7f66627c4700 1 -- 172.21.15.79:0/4197725890 reap_dead start 2021-04-09T18:32:15.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.316 7f666421f700 1 -- 172.21.15.79:0/4197725890 shutdown_connections 2021-04-09T18:32:15.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.316 7f666421f700 1 -- 172.21.15.79:0/4197725890 >> 172.21.15.79:0/4197725890 conn(0x7f665c0e5fe0 msgr2=0x7f665c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:15.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.316 7f666421f700 1 -- 172.21.15.79:0/4197725890 shutdown_connections 2021-04-09T18:32:15.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.316 7f666421f700 1 -- 172.21.15.79:0/4197725890 wait complete. 2021-04-09T18:32:15.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f666421f700 1 Processor -- start 2021-04-09T18:32:15.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f666421f700 1 -- start start 2021-04-09T18:32:15.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f666421f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f665c0af680 0x7f665c1af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:15.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f666421f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f665c0acb60 0x7f665c098ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:15.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f666421f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665c0994f0 0x7f665c0d52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:15.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f666421f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c1c3dc0 con 0x7f665c0994f0 2021-04-09T18:32:15.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f666421f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c098bc0 con 0x7f665c0af680 2021-04-09T18:32:15.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f666421f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665c098300 con 0x7f665c0acb60 2021-04-09T18:32:15.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f66627c4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665c0994f0 0x7f665c0d52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:15.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f66627c4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665c0994f0 0x7f665c0d52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59648/0 (socket says 172.21.15.79:59648) 2021-04-09T18:32:15.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f66627c4700 1 -- 172.21.15.79:0/2862738827 learned_addr learned my addr 172.21.15.79:0/2862738827 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:15.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f6661fc3700 1 --2- 172.21.15.79:0/2862738827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f665c0af680 0x7f665c1af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:15.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f66617c2700 1 --2- 172.21.15.79:0/2862738827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f665c0acb60 0x7f665c098ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:15.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f66627c4700 1 -- 172.21.15.79:0/2862738827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f665c0acb60 msgr2=0x7f665c098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:15.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f66627c4700 1 --2- 172.21.15.79:0/2862738827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f665c0acb60 0x7f665c098ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f66627c4700 1 -- 172.21.15.79:0/2862738827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f665c0af680 msgr2=0x7f665c1af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:15.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f66627c4700 1 --2- 172.21.15.79:0/2862738827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f665c0af680 0x7f665c1af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f66627c4700 1 -- 172.21.15.79:0/2862738827 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665c0acfb0 con 0x7f665c0994f0 2021-04-09T18:32:15.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f66627c4700 1 --2- 172.21.15.79:0/2862738827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665c0994f0 0x7f665c0d52d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f665c098b40 tx=0x7f6654007920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:15.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f66527fc700 1 -- 172.21.15.79:0/2862738827 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f665c0acfb0 con 0x7f665c0994f0 2021-04-09T18:32:15.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f66527fc700 1 -- 172.21.15.79:0/2862738827 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665400db40 con 0x7f665c0994f0 2021-04-09T18:32:15.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f666421f700 1 -- 172.21.15.79:0/2862738827 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f665c0d5900 con 0x7f665c0994f0 2021-04-09T18:32:15.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f66527fc700 1 -- 172.21.15.79:0/2862738827 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6654010040 con 0x7f665c0994f0 2021-04-09T18:32:15.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.320 7f666421f700 1 -- 172.21.15.79:0/2862738827 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665c0ad330 con 0x7f665c0994f0 2021-04-09T18:32:15.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.324 7f66527fc700 1 -- 172.21.15.79:0/2862738827 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6654012070 con 0x7f665c0994f0 2021-04-09T18:32:15.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.324 7f66527fc700 1 --2- 172.21.15.79:0/2862738827 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6644029100 0x7f664402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:15.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.324 7f66527fc700 1 -- 172.21.15.79:0/2862738827 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f6654011040 con 0x7f665c0994f0 2021-04-09T18:32:15.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.324 7f6661fc3700 1 --2- 172.21.15.79:0/2862738827 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6644029100 0x7f664402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:15.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.324 7f6661fc3700 1 --2- 172.21.15.79:0/2862738827 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6644029100 0x7f664402b650 crc :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:15.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.340 7f666421f700 1 -- 172.21.15.79:0/2862738827 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665c0e39e0 con 0x7f665c0994f0 2021-04-09T18:32:15.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.348 7f66527fc700 1 -- 172.21.15.79:0/2862738827 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f665400d740 con 0x7f665c0994f0 2021-04-09T18:32:15.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.516 7f666421f700 1 -- 172.21.15.79:0/2862738827 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f665c087550 con 0x7f665c0994f0 2021-04-09T18:32:15.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.516 7f66527fc700 1 -- 172.21.15.79:0/2862738827 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+14348 (secure 0 0 0) 0x7f6654000f70 con 0x7f665c0994f0 2021-04-09T18:32:15.521 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:32:15.522 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":69,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:32:14.953152","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:32:13.133609","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2021-04-09 18:32:13.943877","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6835/2729581928":"2021-04-10 18:32:14.953106","172.21.15.89:6834/2729581928":"2021-04-10 18:32:14.953106"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:32:15.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.520 7f666421f700 1 -- 172.21.15.79:0/2862738827 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6644029100 msgr2=0x7f664402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:15.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.520 7f666421f700 1 --2- 172.21.15.79:0/2862738827 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6644029100 0x7f664402b650 crc :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.520 7f666421f700 1 -- 172.21.15.79:0/2862738827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665c0994f0 msgr2=0x7f665c0d52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:15.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.520 7f666421f700 1 --2- 172.21.15.79:0/2862738827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665c0994f0 0x7f665c0d52d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f665c098b40 tx=0x7f6654007920).stop 2021-04-09T18:32:15.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.520 7f666421f700 1 -- 172.21.15.79:0/2862738827 shutdown_connections 2021-04-09T18:32:15.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.520 7f666421f700 1 --2- 172.21.15.79:0/2862738827 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6644029100 0x7f664402b650 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.520 7f666421f700 1 --2- 172.21.15.79:0/2862738827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f665c0af680 0x7f665c1af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.520 7f666421f700 1 --2- 172.21.15.79:0/2862738827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665c0994f0 0x7f665c0d52d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.520 7f666421f700 1 --2- 172.21.15.79:0/2862738827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f665c0acb60 0x7f665c098ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.520 7f666421f700 1 -- 172.21.15.79:0/2862738827 >> 172.21.15.79:0/2862738827 conn(0x7f665c0bac80 msgr2=0x7f665c0d8680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:15.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.520 7f666421f700 1 -- 172.21.15.79:0/2862738827 shutdown_connections 2021-04-09T18:32:15.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.520 7f666421f700 1 -- 172.21.15.79:0/2862738827 wait complete. 2021-04-09T18:32:15.534 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-04-09T18:32:15.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.624 7fdc4b9f5700 1 Processor -- start 2021-04-09T18:32:15.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.624 7fdc4b9f5700 1 -- start start 2021-04-09T18:32:15.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.624 7fdc4b9f5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdc440f5550 0x7fdc440f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:15.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.624 7fdc4b9f5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdc441c8040 0x7fdc441ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:15.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.624 7fdc4b9f5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc440fbb50 con 0x7fdc440e9b10 2021-04-09T18:32:15.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.624 7fdc4b9f5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc440e9f60 con 0x7fdc441c8040 2021-04-09T18:32:15.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.624 7fdc4b9f5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc441c3df0 con 0x7fdc440f5550 2021-04-09T18:32:15.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.624 7fdc49f9a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdc441c8040 0x7fdc441ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:15.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.624 7fdc49f9a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdc441c8040 0x7fdc441ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59656/0 (socket says 172.21.15.79:59656) 2021-04-09T18:32:15.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.624 7fdc49f9a700 1 -- 172.21.15.79:0/1158977588 learned_addr learned my addr 172.21.15.79:0/1158977588 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:15.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.628 7fdc49799700 1 --2- 172.21.15.79:0/1158977588 >> v2:172.21.15.89:3300/0 conn(0x7fdc440f5550 0x7fdc440f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:15.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.628 7fdc49f9a700 1 -- 172.21.15.79:0/1158977588 >> v2:172.21.15.89:3300/0 conn(0x7fdc440f5550 msgr2=0x7fdc440f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:15.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.628 7fdc49f9a700 1 --2- 172.21.15.79:0/1158977588 >> v2:172.21.15.89:3300/0 conn(0x7fdc440f5550 0x7fdc440f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.628 7fdc49f9a700 1 -- 172.21.15.79:0/1158977588 >> v1:172.21.15.79:6789/0 conn(0x7fdc440e9b10 legacy=0x7fdc4409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:15.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.628 7fdc49f9a700 1 -- 172.21.15.79:0/1158977588 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4409f910 con 0x7fdc441c8040 2021-04-09T18:32:15.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.628 7fdc49f9a700 1 --2- 172.21.15.79:0/1158977588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc441c8040 0x7fdc441ca4a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7fdc3c0032b0 tx=0x7fdc3c00b3c0).ready entity=mon.0 client_cookie=956e922f46c6f50e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:15.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.628 7fdc3bfff700 1 -- 172.21.15.79:0/1158977588 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdc4409f910 con 0x7fdc441c8040 2021-04-09T18:32:15.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.628 7fdc3bfff700 1 -- 172.21.15.79:0/1158977588 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c00bc20 con 0x7fdc441c8040 2021-04-09T18:32:15.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.628 7fdc3bfff700 1 -- 172.21.15.79:0/1158977588 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdc3c002020 con 0x7fdc441c8040 2021-04-09T18:32:15.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.628 7fdc4b9f5700 1 -- 172.21.15.79:0/1158977588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc441c8040 msgr2=0x7fdc441ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:15.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.628 7fdc4b9f5700 1 --2- 172.21.15.79:0/1158977588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc441c8040 0x7fdc441ca4a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7fdc3c0032b0 tx=0x7fdc3c00b3c0).stop 2021-04-09T18:32:15.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.628 7fdc4b9f5700 1 -- 172.21.15.79:0/1158977588 shutdown_connections 2021-04-09T18:32:15.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.628 7fdc4b9f5700 1 --2- 172.21.15.79:0/1158977588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc441c8040 0x7fdc441ca4a0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.628 7fdc4b9f5700 1 --2- 172.21.15.79:0/1158977588 >> v2:172.21.15.89:3300/0 conn(0x7fdc440f5550 0x7fdc440f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.628 7fdc4b9f5700 1 -- 172.21.15.79:0/1158977588 >> 172.21.15.79:0/1158977588 conn(0x7fdc440e6010 msgr2=0x7fdc440e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:15.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.628 7fdc4b9f5700 1 -- 172.21.15.79:0/1158977588 shutdown_connections 2021-04-09T18:32:15.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.628 7fdc4b9f5700 1 -- 172.21.15.79:0/1158977588 wait complete. 2021-04-09T18:32:15.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc4b9f5700 1 Processor -- start 2021-04-09T18:32:15.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc4b9f5700 1 -- start start 2021-04-09T18:32:15.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc4b9f5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc440d55d0 0x7fdc441a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:15.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc4b9f5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc440d7080 0x7fdc4408f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:15.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc4b9f5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc440d6600 0x7fdc4408fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:15.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc4b9f5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc441a6f80 con 0x7fdc440d55d0 2021-04-09T18:32:15.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc4b9f5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc440d14b0 con 0x7fdc440d7080 2021-04-09T18:32:15.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc4b9f5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc440adbb0 con 0x7fdc440d6600 2021-04-09T18:32:15.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc49799700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc440d55d0 0x7fdc441a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:15.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc49799700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc440d55d0 0x7fdc441a6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59660/0 (socket says 172.21.15.79:59660) 2021-04-09T18:32:15.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc49799700 1 -- 172.21.15.79:0/4240621556 learned_addr learned my addr 172.21.15.79:0/4240621556 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:15.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc49f9a700 1 --2- 172.21.15.79:0/4240621556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc440d6600 0x7fdc4408fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:15.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc48f98700 1 --2- 172.21.15.79:0/4240621556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc440d7080 0x7fdc4408f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:15.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc49799700 1 -- 172.21.15.79:0/4240621556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc440d6600 msgr2=0x7fdc4408fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:15.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc49799700 1 --2- 172.21.15.79:0/4240621556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc440d6600 0x7fdc4408fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc49799700 1 -- 172.21.15.79:0/4240621556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc440d7080 msgr2=0x7fdc4408f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:15.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc49799700 1 --2- 172.21.15.79:0/4240621556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc440d7080 0x7fdc4408f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc49799700 1 -- 172.21.15.79:0/4240621556 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc440903f0 con 0x7fdc440d55d0 2021-04-09T18:32:15.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc49799700 1 --2- 172.21.15.79:0/4240621556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc440d55d0 0x7fdc441a6950 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7fdc40003070 tx=0x7fdc4000df00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:15.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc39ffb700 1 -- 172.21.15.79:0/4240621556 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdc440903f0 con 0x7fdc440d55d0 2021-04-09T18:32:15.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc39ffb700 1 -- 172.21.15.79:0/4240621556 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc400099e0 con 0x7fdc440d55d0 2021-04-09T18:32:15.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc4b9f5700 1 -- 172.21.15.79:0/4240621556 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc440907d0 con 0x7fdc440d55d0 2021-04-09T18:32:15.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc39ffb700 1 -- 172.21.15.79:0/4240621556 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdc4000f040 con 0x7fdc440d55d0 2021-04-09T18:32:15.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.632 7fdc4b9f5700 1 -- 172.21.15.79:0/4240621556 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc44090d30 con 0x7fdc440d55d0 2021-04-09T18:32:15.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.636 7fdc39ffb700 1 -- 172.21.15.79:0/4240621556 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fdc40013480 con 0x7fdc440d55d0 2021-04-09T18:32:15.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.636 7fdc39ffb700 1 --2- 172.21.15.79:0/4240621556 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdc24029100 0x7fdc2402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:15.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.636 7fdc39ffb700 1 -- 172.21.15.79:0/4240621556 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fdc40010070 con 0x7fdc440d55d0 2021-04-09T18:32:15.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.636 7fdc48f98700 1 --2- 172.21.15.79:0/4240621556 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdc24029100 0x7fdc2402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:15.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.636 7fdc48f98700 1 --2- 172.21.15.79:0/4240621556 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdc24029100 0x7fdc2402b650 crc :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:15.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.636 7fdc4b9f5700 1 -- 172.21.15.79:0/4240621556 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc440e39f0 con 0x7fdc440d55d0 2021-04-09T18:32:15.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.644 7fdc39ffb700 1 -- 172.21.15.79:0/4240621556 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fdc40000bf0 con 0x7fdc440d55d0 2021-04-09T18:32:15.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.808 7fdc4b9f5700 1 -- 172.21.15.79:0/4240621556 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7fdc440f5b50 con 0x7fdc440d55d0 2021-04-09T18:32:15.906 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:32:15.904 7fbcd0516700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:32:15.912 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.908 7fdc39ffb700 1 -- 172.21.15.79:0/4240621556 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v38) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdc400095e0 con 0x7fdc440d55d0 2021-04-09T18:32:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.928 7fdc4b9f5700 1 -- 172.21.15.79:0/4240621556 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdc24029100 msgr2=0x7fdc2402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:15.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.928 7fdc4b9f5700 1 --2- 172.21.15.79:0/4240621556 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdc24029100 0x7fdc2402b650 crc :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.928 7fdc4b9f5700 1 -- 172.21.15.79:0/4240621556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc440d55d0 msgr2=0x7fdc441a6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:15.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.928 7fdc4b9f5700 1 --2- 172.21.15.79:0/4240621556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc440d55d0 0x7fdc441a6950 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7fdc40003070 tx=0x7fdc4000df00).stop 2021-04-09T18:32:15.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.928 7fdc4b9f5700 1 -- 172.21.15.79:0/4240621556 shutdown_connections 2021-04-09T18:32:15.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.928 7fdc4b9f5700 1 --2- 172.21.15.79:0/4240621556 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdc24029100 0x7fdc2402b650 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.928 7fdc4b9f5700 1 --2- 172.21.15.79:0/4240621556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc440d6600 0x7fdc4408fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.928 7fdc4b9f5700 1 --2- 172.21.15.79:0/4240621556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc440d55d0 0x7fdc441a6950 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.928 7fdc4b9f5700 1 --2- 172.21.15.79:0/4240621556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc440d7080 0x7fdc4408f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:15.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.928 7fdc4b9f5700 1 -- 172.21.15.79:0/4240621556 >> 172.21.15.79:0/4240621556 conn(0x7fdc44093dd0 msgr2=0x7fdc440d87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:15.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.928 7fdc4b9f5700 1 -- 172.21.15.79:0/4240621556 shutdown_connections 2021-04-09T18:32:15.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:15.928 7fdc4b9f5700 1 -- 172.21.15.79:0/4240621556 wait complete. 2021-04-09T18:32:15.940 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:32:16.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.024 7ffadfb3f700 1 Processor -- start 2021-04-09T18:32:16.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.024 7ffadfb3f700 1 -- start start 2021-04-09T18:32:16.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.024 7ffadfb3f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffad80e9ad0 0x7ffad809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.024 7ffadfb3f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffad81c8000 0x7ffad81ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.024 7ffadfb3f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad80fbb10 con 0x7ffad80f5510 2021-04-09T18:32:16.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.024 7ffadfb3f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad81c3db0 con 0x7ffad80e9ad0 2021-04-09T18:32:16.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.024 7ffadfb3f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad80e9f20 con 0x7ffad81c8000 2021-04-09T18:32:16.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.024 7ffadd0e2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffad80e9ad0 0x7ffad809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.024 7ffadd0e2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffad80e9ad0 0x7ffad809f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59678/0 (socket says 172.21.15.79:59678) 2021-04-09T18:32:16.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.024 7ffadd0e2700 1 -- 172.21.15.79:0/822663495 learned_addr learned my addr 172.21.15.79:0/822663495 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:16.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.024 7ffade0e4700 1 --2- 172.21.15.79:0/822663495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffad81c8000 0x7ffad81ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.024 7ffadd0e2700 1 -- 172.21.15.79:0/822663495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffad81c8000 msgr2=0x7ffad81ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:16.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.024 7ffadd0e2700 1 --2- 172.21.15.79:0/822663495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffad81c8000 0x7ffad81ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.024 7ffadd0e2700 1 -- 172.21.15.79:0/822663495 >> v1:172.21.15.89:6789/0 conn(0x7ffad80f5510 legacy=0x7ffad80f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.024 7ffadd0e2700 1 -- 172.21.15.79:0/822663495 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad80e56c0 con 0x7ffad80e9ad0 2021-04-09T18:32:16.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.024 7ffadd0e2700 1 --2- 172.21.15.79:0/822663495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffad80e9ad0 0x7ffad809f100 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7ffad80f6ef0 tx=0x7ffad400bdd0).ready entity=mon.0 client_cookie=140c31ac88f1f794 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:16.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.024 7ffadc8e1700 1 -- 172.21.15.79:0/822663495 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffad80e56c0 con 0x7ffad80e9ad0 2021-04-09T18:32:16.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.024 7ffadc8e1700 1 -- 172.21.15.79:0/822663495 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad4009990 con 0x7ffad80e9ad0 2021-04-09T18:32:16.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.024 7ffadc8e1700 1 -- 172.21.15.79:0/822663495 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffad4009d60 con 0x7ffad80e9ad0 2021-04-09T18:32:16.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.028 7ffadfb3f700 1 -- 172.21.15.79:0/822663495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffad80e9ad0 msgr2=0x7ffad809f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.028 7ffadfb3f700 1 --2- 172.21.15.79:0/822663495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffad80e9ad0 0x7ffad809f100 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7ffad80f6ef0 tx=0x7ffad400bdd0).stop 2021-04-09T18:32:16.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.028 7ffadfb3f700 1 -- 172.21.15.79:0/822663495 shutdown_connections 2021-04-09T18:32:16.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.028 7ffadfb3f700 1 --2- 172.21.15.79:0/822663495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffad81c8000 0x7ffad81ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.028 7ffadfb3f700 1 --2- 172.21.15.79:0/822663495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffad80e9ad0 0x7ffad809f100 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.028 7ffadfb3f700 1 -- 172.21.15.79:0/822663495 >> 172.21.15.79:0/822663495 conn(0x7ffad80e5fd0 msgr2=0x7ffad80e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:16.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.028 7ffadfb3f700 1 -- 172.21.15.79:0/822663495 shutdown_connections 2021-04-09T18:32:16.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.028 7ffadfb3f700 1 -- 172.21.15.79:0/822663495 wait complete. 2021-04-09T18:32:16.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.028 7ffadfb3f700 1 Processor -- start 2021-04-09T18:32:16.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.028 7ffadfb3f700 1 -- start start 2021-04-09T18:32:16.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7ffadfb3f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffad8096240 0x7ffad80a68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7ffadfb3f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad80b9890 0x7ffad81ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7ffadfb3f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffad81aecc0 0x7ffad81b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7ffadfb3f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad80a9990 con 0x7ffad81aecc0 2021-04-09T18:32:16.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7ffadfb3f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad80a9c90 con 0x7ffad80b9890 2021-04-09T18:32:16.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7ffadfb3f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad80a9220 con 0x7ffad8096240 2021-04-09T18:32:16.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7ffade0e4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffad81aecc0 0x7ffad81b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7ffade0e4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffad81aecc0 0x7ffad81b14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59686/0 (socket says 172.21.15.79:59686) 2021-04-09T18:32:16.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7ffade0e4700 1 -- 172.21.15.79:0/949105709 learned_addr learned my addr 172.21.15.79:0/949105709 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:16.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7ffadd8e3700 1 --2- 172.21.15.79:0/949105709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffad8096240 0x7ffad80a68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7ffadd0e2700 1 --2- 172.21.15.79:0/949105709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad80b9890 0x7ffad81ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7ffade0e4700 1 -- 172.21.15.79:0/949105709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffad8096240 msgr2=0x7ffad80a68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7ffade0e4700 1 --2- 172.21.15.79:0/949105709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffad8096240 0x7ffad80a68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7ffade0e4700 1 -- 172.21.15.79:0/949105709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad80b9890 msgr2=0x7ffad81ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7ffade0e4700 1 --2- 172.21.15.79:0/949105709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad80b9890 0x7ffad81ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7ffade0e4700 1 -- 172.21.15.79:0/949105709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad8096690 con 0x7ffad81aecc0 2021-04-09T18:32:16.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7ffade0e4700 1 --2- 172.21.15.79:0/949105709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffad81aecc0 0x7ffad81b14c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7ffad8095db0 tx=0x7ffad000c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:16.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7fface7fc700 1 -- 172.21.15.79:0/949105709 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffad8096690 con 0x7ffad81aecc0 2021-04-09T18:32:16.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7fface7fc700 1 -- 172.21.15.79:0/949105709 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad000cca0 con 0x7ffad81aecc0 2021-04-09T18:32:16.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7fface7fc700 1 -- 172.21.15.79:0/949105709 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffad000f040 con 0x7ffad81aecc0 2021-04-09T18:32:16.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7ffadfb3f700 1 -- 172.21.15.79:0/949105709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad80a6ef0 con 0x7ffad81aecc0 2021-04-09T18:32:16.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7ffadfb3f700 1 -- 172.21.15.79:0/949105709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad80ab5b0 con 0x7ffad81aecc0 2021-04-09T18:32:16.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7fface7fc700 1 -- 172.21.15.79:0/949105709 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ffad0022060 con 0x7ffad81aecc0 2021-04-09T18:32:16.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7fface7fc700 1 --2- 172.21.15.79:0/949105709 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffab8029100 0x7ffab802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.032 7fface7fc700 1 -- 172.21.15.79:0/949105709 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7ffad0010040 con 0x7ffad81aecc0 2021-04-09T18:32:16.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.036 7ffadd8e3700 1 --2- 172.21.15.79:0/949105709 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffab8029100 0x7ffab802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.036 7ffadd8e3700 1 --2- 172.21.15.79:0/949105709 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffab8029100 0x7ffab802b650 crc :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:16.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.040 7ffadfb3f700 1 -- 172.21.15.79:0/949105709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad80e39d0 con 0x7ffad81aecc0 2021-04-09T18:32:16.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.048 7fface7fc700 1 -- 172.21.15.79:0/949105709 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ffad000ca90 con 0x7ffad81aecc0 2021-04-09T18:32:16.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.212 7ffadfb3f700 1 -- 172.21.15.79:0/949105709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffad80a1cb0 con 0x7ffad81aecc0 2021-04-09T18:32:16.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.212 7fface7fc700 1 -- 172.21.15.79:0/949105709 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+2106 (secure 0 0 0) 0x7ffad80f76b0 con 0x7ffad81aecc0 2021-04-09T18:32:16.217 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 39 2021-04-09T18:32:16.217 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:32:16.218 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":39,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6153,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1203679879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1203679879},{"type":"v1","addr":"172.21.15.89:6835","nonce":1203679879}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":38}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:32:14.903910","modified":"2021-04-09 18:32:15.911829","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":39,"state":"up:creating","state_seq":2,"addr":"172.21.15.79:6833/1131782053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1131782053},{"type":"v1","addr":"172.21.15.79:6833","nonce":1131782053}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-04-09T18:32:16.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.216 7ffadfb3f700 1 -- 172.21.15.79:0/949105709 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffab8029100 msgr2=0x7ffab802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.216 7ffadfb3f700 1 --2- 172.21.15.79:0/949105709 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffab8029100 0x7ffab802b650 crc :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.216 7ffadfb3f700 1 -- 172.21.15.79:0/949105709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffad81aecc0 msgr2=0x7ffad81b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.216 7ffadfb3f700 1 --2- 172.21.15.79:0/949105709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffad81aecc0 0x7ffad81b14c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7ffad8095db0 tx=0x7ffad000c430).stop 2021-04-09T18:32:16.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.216 7ffadfb3f700 1 -- 172.21.15.79:0/949105709 shutdown_connections 2021-04-09T18:32:16.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.216 7ffadfb3f700 1 --2- 172.21.15.79:0/949105709 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffab8029100 0x7ffab802b650 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.216 7ffadfb3f700 1 --2- 172.21.15.79:0/949105709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffad81aecc0 0x7ffad81b14c0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.216 7ffadfb3f700 1 --2- 172.21.15.79:0/949105709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffad8096240 0x7ffad80a68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.216 7ffadfb3f700 1 --2- 172.21.15.79:0/949105709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad80b9890 0x7ffad81ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.216 7ffadfb3f700 1 -- 172.21.15.79:0/949105709 >> 172.21.15.79:0/949105709 conn(0x7ffad809a680 msgr2=0x7ffad80aed10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:16.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.216 7ffadfb3f700 1 -- 172.21.15.79:0/949105709 shutdown_connections 2021-04-09T18:32:16.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.216 7ffadfb3f700 1 -- 172.21.15.79:0/949105709 wait complete. 2021-04-09T18:32:16.230 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:32:16.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07da6dc700 1 Processor -- start 2021-04-09T18:32:16.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07da6dc700 1 -- start start 2021-04-09T18:32:16.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07da6dc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f07d40f5510 0x7f07d40f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07da6dc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f07d40e9ad0 0x7f07d409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07da6dc700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d40fbb10 con 0x7f07d41c2da0 2021-04-09T18:32:16.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07da6dc700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d40e9f20 con 0x7f07d40f5510 2021-04-09T18:32:16.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07da6dc700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d40e59c0 con 0x7f07d40e9ad0 2021-04-09T18:32:16.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07d3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f07d40f5510 0x7f07d40f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07d3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f07d40f5510 0x7f07d40f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59690/0 (socket says 172.21.15.79:59690) 2021-04-09T18:32:16.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07d3fff700 1 -- 172.21.15.79:0/368095008 learned_addr learned my addr 172.21.15.79:0/368095008 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:16.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07d8c81700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f07d41c2da0 0x7f07d41c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54404/0 (socket says 172.21.15.79:54404) 2021-04-09T18:32:16.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07d37fe700 1 --2- 172.21.15.79:0/368095008 >> v2:172.21.15.89:3300/0 conn(0x7f07d40e9ad0 0x7f07d409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07d3fff700 1 -- 172.21.15.79:0/368095008 >> v2:172.21.15.89:3300/0 conn(0x7f07d40e9ad0 msgr2=0x7f07d409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:16.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07d3fff700 1 --2- 172.21.15.79:0/368095008 >> v2:172.21.15.89:3300/0 conn(0x7f07d40e9ad0 0x7f07d409f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07d3fff700 1 -- 172.21.15.79:0/368095008 >> v1:172.21.15.79:6789/0 conn(0x7f07d41c2da0 legacy=0x7f07d41c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07d2ffd700 1 -- 172.21.15.79:0/368095008 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415834039 0 0) 0x7f07cc0010d0 con 0x7f07d41c2da0 2021-04-09T18:32:16.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07d3fff700 1 -- 172.21.15.79:0/368095008 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d40e56c0 con 0x7f07d40f5510 2021-04-09T18:32:16.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07d37fe700 1 --2- 172.21.15.79:0/368095008 >> v2:172.21.15.89:3300/0 conn(0x7f07d40e9ad0 0x7f07d409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:32:16.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07d3fff700 1 --2- 172.21.15.79:0/368095008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d40f5510 0x7f07d40f64a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f07c40032b0 tx=0x7f07c400b3c0).ready entity=mon.0 client_cookie=c746504b956d3538 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:16.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07d2ffd700 1 -- 172.21.15.79:0/368095008 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f07d40e56c0 con 0x7f07d40f5510 2021-04-09T18:32:16.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07d2ffd700 1 -- 172.21.15.79:0/368095008 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c400bc20 con 0x7f07d40f5510 2021-04-09T18:32:16.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.320 7f07d2ffd700 1 -- 172.21.15.79:0/368095008 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f07c4002020 con 0x7f07d40f5510 2021-04-09T18:32:16.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07da6dc700 1 -- 172.21.15.79:0/368095008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d40f5510 msgr2=0x7f07d40f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07da6dc700 1 --2- 172.21.15.79:0/368095008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d40f5510 0x7f07d40f64a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f07c40032b0 tx=0x7f07c400b3c0).stop 2021-04-09T18:32:16.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07da6dc700 1 -- 172.21.15.79:0/368095008 shutdown_connections 2021-04-09T18:32:16.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07da6dc700 1 --2- 172.21.15.79:0/368095008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d40f5510 0x7f07d40f64a0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07da6dc700 1 --2- 172.21.15.79:0/368095008 >> v2:172.21.15.89:3300/0 conn(0x7f07d40e9ad0 0x7f07d409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07da6dc700 1 -- 172.21.15.79:0/368095008 >> 172.21.15.79:0/368095008 conn(0x7f07d40e5fd0 msgr2=0x7f07d40e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:16.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07da6dc700 1 -- 172.21.15.79:0/368095008 shutdown_connections 2021-04-09T18:32:16.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07da6dc700 1 -- 172.21.15.79:0/368095008 wait complete. 2021-04-09T18:32:16.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07da6dc700 1 Processor -- start 2021-04-09T18:32:16.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07da6dc700 1 -- start start 2021-04-09T18:32:16.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07da6dc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07d40c11e0 0x7f07d40c3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07da6dc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07d40c3e30 0x7f07d40d60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07da6dc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d40d66f0 0x7f07d40af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07da6dc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d40c1f80 con 0x7f07d40d66f0 2021-04-09T18:32:16.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07da6dc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d40c2280 con 0x7f07d40c11e0 2021-04-09T18:32:16.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07da6dc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d41af290 con 0x7f07d40c3e30 2021-04-09T18:32:16.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07d8c81700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d40d66f0 0x7f07d40af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07d8c81700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d40d66f0 0x7f07d40af840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59700/0 (socket says 172.21.15.79:59700) 2021-04-09T18:32:16.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07d8c81700 1 -- 172.21.15.79:0/2926199908 learned_addr learned my addr 172.21.15.79:0/2926199908 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:16.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07d37fe700 1 --2- 172.21.15.79:0/2926199908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07d40c3e30 0x7f07d40d60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.324 7f07d3fff700 1 --2- 172.21.15.79:0/2926199908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07d40c11e0 0x7f07d40c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.328 7f07d8c81700 1 -- 172.21.15.79:0/2926199908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07d40c3e30 msgr2=0x7f07d40d60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.328 7f07d8c81700 1 --2- 172.21.15.79:0/2926199908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07d40c3e30 0x7f07d40d60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.328 7f07d8c81700 1 -- 172.21.15.79:0/2926199908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07d40c11e0 msgr2=0x7f07d40c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.328 7f07d8c81700 1 --2- 172.21.15.79:0/2926199908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07d40c11e0 0x7f07d40c3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.328 7f07d8c81700 1 -- 172.21.15.79:0/2926199908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d40c1b10 con 0x7f07d40d66f0 2021-04-09T18:32:16.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.328 7f07d8c81700 1 --2- 172.21.15.79:0/2926199908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d40d66f0 0x7f07d40af840 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f07d40af550 tx=0x7f07cc00cb60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:16.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.328 7f07d0ff9700 1 -- 172.21.15.79:0/2926199908 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f07d40c1b10 con 0x7f07d40d66f0 2021-04-09T18:32:16.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.328 7f07d0ff9700 1 -- 172.21.15.79:0/2926199908 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07cc007320 con 0x7f07d40d66f0 2021-04-09T18:32:16.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.328 7f07da6dc700 1 -- 172.21.15.79:0/2926199908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d40afe70 con 0x7f07d40d66f0 2021-04-09T18:32:16.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.328 7f07d0ff9700 1 -- 172.21.15.79:0/2926199908 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f07cc005720 con 0x7f07d40d66f0 2021-04-09T18:32:16.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.328 7f07da6dc700 1 -- 172.21.15.79:0/2926199908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d40b03d0 con 0x7f07d40d66f0 2021-04-09T18:32:16.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.328 7f07d0ff9700 1 -- 172.21.15.79:0/2926199908 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f07cc01a020 con 0x7f07d40d66f0 2021-04-09T18:32:16.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.328 7f07d0ff9700 1 --2- 172.21.15.79:0/2926199908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f07b8029100 0x7f07b802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.328 7f07d0ff9700 1 -- 172.21.15.79:0/2926199908 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f07cc039230 con 0x7f07d40d66f0 2021-04-09T18:32:16.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.328 7f07d3fff700 1 --2- 172.21.15.79:0/2926199908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f07b8029100 0x7f07b802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.328 7f07d3fff700 1 --2- 172.21.15.79:0/2926199908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f07b8029100 0x7f07b802b650 crc :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:16.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.336 7f07da6dc700 1 -- 172.21.15.79:0/2926199908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d40e39d0 con 0x7f07d40d66f0 2021-04-09T18:32:16.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.344 7f07d0ff9700 1 -- 172.21.15.79:0/2926199908 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f07cc007110 con 0x7f07d40d66f0 2021-04-09T18:32:16.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.512 7f07da6dc700 1 -- 172.21.15.79:0/2926199908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07d40a1cb0 con 0x7f07d40d66f0 2021-04-09T18:32:16.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.512 7f07d0ff9700 1 -- 172.21.15.79:0/2926199908 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+14348 (secure 0 0 0) 0x7f07cc000bf0 con 0x7f07d40d66f0 2021-04-09T18:32:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:32:16.518 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":69,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:32:14.953152","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:32:13.133609","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2021-04-09 18:32:13.943877","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6835/2729581928":"2021-04-10 18:32:14.953106","172.21.15.89:6834/2729581928":"2021-04-10 18:32:14.953106"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:32:16.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.516 7f07da6dc700 1 -- 172.21.15.79:0/2926199908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f07b8029100 msgr2=0x7f07b802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.516 7f07da6dc700 1 --2- 172.21.15.79:0/2926199908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f07b8029100 0x7f07b802b650 crc :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.516 7f07da6dc700 1 -- 172.21.15.79:0/2926199908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d40d66f0 msgr2=0x7f07d40af840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.516 7f07da6dc700 1 --2- 172.21.15.79:0/2926199908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d40d66f0 0x7f07d40af840 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f07d40af550 tx=0x7f07cc00cb60).stop 2021-04-09T18:32:16.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.516 7f07da6dc700 1 -- 172.21.15.79:0/2926199908 shutdown_connections 2021-04-09T18:32:16.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.516 7f07da6dc700 1 --2- 172.21.15.79:0/2926199908 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f07b8029100 0x7f07b802b650 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.516 7f07da6dc700 1 --2- 172.21.15.79:0/2926199908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07d40c11e0 0x7f07d40c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.516 7f07da6dc700 1 --2- 172.21.15.79:0/2926199908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d40d66f0 0x7f07d40af840 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.516 7f07da6dc700 1 --2- 172.21.15.79:0/2926199908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07d40c3e30 0x7f07d40d60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.516 7f07da6dc700 1 -- 172.21.15.79:0/2926199908 >> 172.21.15.79:0/2926199908 conn(0x7f07d419e560 msgr2=0x7f07d419dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:16.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.516 7f07da6dc700 1 -- 172.21.15.79:0/2926199908 shutdown_connections 2021-04-09T18:32:16.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.516 7f07da6dc700 1 -- 172.21.15.79:0/2926199908 wait complete. 2021-04-09T18:32:16.531 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:32:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a6e051700 1 Processor -- start 2021-04-09T18:32:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a6e051700 1 -- start start 2021-04-09T18:32:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a6e051700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4a680f5580 0x7f4a680f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a6e051700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4a680e9b40 0x7f4a6809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a6e051700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a680fbb80 con 0x7f4a681c6e30 2021-04-09T18:32:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a6e051700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a680e9f90 con 0x7f4a680e9b40 2021-04-09T18:32:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a6e051700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a680e59b0 con 0x7f4a680f5580 2021-04-09T18:32:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a5effd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4a680e9b40 0x7f4a6809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a67fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4a681c6e30 0x7f4a681c9290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54418/0 (socket says 172.21.15.79:54418) 2021-04-09T18:32:16.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a67fff700 1 -- 172.21.15.79:0/1867618069 learned_addr learned my addr 172.21.15.79:0/1867618069 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:16.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a677fe700 1 --2- 172.21.15.79:0/1867618069 >> v2:172.21.15.89:3300/0 conn(0x7f4a680f5580 0x7f4a680f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a5effd700 1 -- 172.21.15.79:0/1867618069 >> v2:172.21.15.89:3300/0 conn(0x7f4a680f5580 msgr2=0x7f4a680f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:16.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a5effd700 1 --2- 172.21.15.79:0/1867618069 >> v2:172.21.15.89:3300/0 conn(0x7f4a680f5580 0x7f4a680f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a5effd700 1 -- 172.21.15.79:0/1867618069 >> v1:172.21.15.79:6789/0 conn(0x7f4a681c6e30 legacy=0x7f4a681c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a66ffd700 1 -- 172.21.15.79:0/1867618069 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155421786 0 0) 0x7f4a600010d0 con 0x7f4a681c6e30 2021-04-09T18:32:16.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a5effd700 1 -- 172.21.15.79:0/1867618069 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a680e56b0 con 0x7f4a680e9b40 2021-04-09T18:32:16.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a677fe700 1 --2- 172.21.15.79:0/1867618069 >> v2:172.21.15.89:3300/0 conn(0x7f4a680f5580 0x7f4a680f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:32:16.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a5effd700 1 --2- 172.21.15.79:0/1867618069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a680e9b40 0x7f4a6809f110 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f4a50002f30 tx=0x7f4a5000bd10).ready entity=mon.0 client_cookie=938f80be965f1578 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:16.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a66ffd700 1 -- 172.21.15.79:0/1867618069 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a680e56b0 con 0x7f4a680e9b40 2021-04-09T18:32:16.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a66ffd700 1 -- 172.21.15.79:0/1867618069 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a500098a0 con 0x7f4a680e9b40 2021-04-09T18:32:16.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a66ffd700 1 -- 172.21.15.79:0/1867618069 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a50009c70 con 0x7f4a680e9b40 2021-04-09T18:32:16.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a6e051700 1 -- 172.21.15.79:0/1867618069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a680e9b40 msgr2=0x7f4a6809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.628 7f4a6e051700 1 --2- 172.21.15.79:0/1867618069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a680e9b40 0x7f4a6809f110 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f4a50002f30 tx=0x7f4a5000bd10).stop 2021-04-09T18:32:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.632 7f4a6e051700 1 -- 172.21.15.79:0/1867618069 shutdown_connections 2021-04-09T18:32:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.632 7f4a6e051700 1 --2- 172.21.15.79:0/1867618069 >> v2:172.21.15.89:3300/0 conn(0x7f4a680f5580 0x7f4a680f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.632 7f4a6e051700 1 --2- 172.21.15.79:0/1867618069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a680e9b40 0x7f4a6809f110 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.632 7f4a6e051700 1 -- 172.21.15.79:0/1867618069 >> 172.21.15.79:0/1867618069 conn(0x7f4a680e6040 msgr2=0x7f4a680e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:16.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.632 7f4a6e051700 1 -- 172.21.15.79:0/1867618069 shutdown_connections 2021-04-09T18:32:16.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.632 7f4a6e051700 1 -- 172.21.15.79:0/1867618069 wait complete. 2021-04-09T18:32:16.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.632 7f4a6e051700 1 Processor -- start 2021-04-09T18:32:16.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.632 7f4a6e051700 1 -- start start 2021-04-09T18:32:16.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.632 7f4a6e051700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a680c3670 0x7f4a681a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.632 7f4a6e051700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a680c6a60 0x7f4a680994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.632 7f4a6e051700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a680c9410 0x7f4a680c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.632 7f4a6e051700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a681a2240 con 0x7f4a680c9410 2021-04-09T18:32:16.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.632 7f4a6e051700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a681a2540 con 0x7f4a680c6a60 2021-04-09T18:32:16.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.632 7f4a6e051700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a681a1b70 con 0x7f4a680c3670 2021-04-09T18:32:16.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.632 7f4a67fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a680c9410 0x7f4a680c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.636 7f4a67fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a680c9410 0x7f4a680c9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59712/0 (socket says 172.21.15.79:59712) 2021-04-09T18:32:16.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.636 7f4a67fff700 1 -- 172.21.15.79:0/3658106783 learned_addr learned my addr 172.21.15.79:0/3658106783 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:16.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.636 7f4a677fe700 1 --2- 172.21.15.79:0/3658106783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a680c3670 0x7f4a681a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.636 7f4a5effd700 1 --2- 172.21.15.79:0/3658106783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a680c6a60 0x7f4a680994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.636 7f4a67fff700 1 -- 172.21.15.79:0/3658106783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a680c3670 msgr2=0x7f4a681a3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.636 7f4a67fff700 1 --2- 172.21.15.79:0/3658106783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a680c3670 0x7f4a681a3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.636 7f4a67fff700 1 -- 172.21.15.79:0/3658106783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a680c6a60 msgr2=0x7f4a680994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.636 7f4a67fff700 1 --2- 172.21.15.79:0/3658106783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a680c6a60 0x7f4a680994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.636 7f4a67fff700 1 -- 172.21.15.79:0/3658106783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a68099ad0 con 0x7f4a680c9410 2021-04-09T18:32:16.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.636 7f4a677fe700 1 --2- 172.21.15.79:0/3658106783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a680c3670 0x7f4a681a3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:32:16.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.636 7f4a67fff700 1 --2- 172.21.15.79:0/3658106783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a680c9410 0x7f4a680c9860 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f4a681a1d20 tx=0x7f4a6000cb30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:16.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.636 7f4a64ff9700 1 -- 172.21.15.79:0/3658106783 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a68099ad0 con 0x7f4a680c9410 2021-04-09T18:32:16.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.636 7f4a64ff9700 1 -- 172.21.15.79:0/3658106783 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a60007320 con 0x7f4a680c9410 2021-04-09T18:32:16.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.636 7f4a6e051700 1 -- 172.21.15.79:0/3658106783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a68099f40 con 0x7f4a680c9410 2021-04-09T18:32:16.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.636 7f4a64ff9700 1 -- 172.21.15.79:0/3658106783 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a600057e0 con 0x7f4a680c9410 2021-04-09T18:32:16.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.636 7f4a6e051700 1 -- 172.21.15.79:0/3658106783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a680c9e90 con 0x7f4a680c9410 2021-04-09T18:32:16.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.636 7f4a64ff9700 1 -- 172.21.15.79:0/3658106783 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4a6001a020 con 0x7f4a680c9410 2021-04-09T18:32:16.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.636 7f4a64ff9700 1 --2- 172.21.15.79:0/3658106783 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a4c029100 0x7f4a4c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.636 7f4a64ff9700 1 -- 172.21.15.79:0/3658106783 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f4a60039180 con 0x7f4a680c9410 2021-04-09T18:32:16.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.636 7f4a677fe700 1 --2- 172.21.15.79:0/3658106783 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a4c029100 0x7f4a4c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.640 7f4a677fe700 1 --2- 172.21.15.79:0/3658106783 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a4c029100 0x7f4a4c02b650 crc :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:16.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.640 7f4a6e051700 1 -- 172.21.15.79:0/3658106783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a68088d30 con 0x7f4a680c9410 2021-04-09T18:32:16.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.648 7f4a64ff9700 1 -- 172.21.15.79:0/3658106783 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4a60000bf0 con 0x7f4a680c9410 2021-04-09T18:32:16.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.808 7f4a6e051700 1 -- 172.21.15.79:0/3658106783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4a680e39a0 con 0x7f4a680c9410 2021-04-09T18:32:16.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.812 7f4a64ff9700 1 -- 172.21.15.79:0/3658106783 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v21) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4a60007110 con 0x7f4a680c9410 2021-04-09T18:32:16.817 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2021-04-09T18:32:16.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.816 7f4a6e051700 1 -- 172.21.15.79:0/3658106783 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a4c029100 msgr2=0x7f4a4c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.816 7f4a6e051700 1 --2- 172.21.15.79:0/3658106783 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a4c029100 0x7f4a4c02b650 crc :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.816 7f4a6e051700 1 -- 172.21.15.79:0/3658106783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a680c9410 msgr2=0x7f4a680c9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.816 7f4a6e051700 1 --2- 172.21.15.79:0/3658106783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a680c9410 0x7f4a680c9860 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f4a681a1d20 tx=0x7f4a6000cb30).stop 2021-04-09T18:32:16.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.816 7f4a6e051700 1 -- 172.21.15.79:0/3658106783 shutdown_connections 2021-04-09T18:32:16.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.816 7f4a6e051700 1 --2- 172.21.15.79:0/3658106783 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a4c029100 0x7f4a4c02b650 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.816 7f4a6e051700 1 --2- 172.21.15.79:0/3658106783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a680c9410 0x7f4a680c9860 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.816 7f4a6e051700 1 --2- 172.21.15.79:0/3658106783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a680c3670 0x7f4a681a3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.816 7f4a6e051700 1 --2- 172.21.15.79:0/3658106783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a680c6a60 0x7f4a680994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.816 7f4a6e051700 1 -- 172.21.15.79:0/3658106783 >> 172.21.15.79:0/3658106783 conn(0x7f4a680d80b0 msgr2=0x7f4a680a2470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:16.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.816 7f4a6e051700 1 -- 172.21.15.79:0/3658106783 shutdown_connections 2021-04-09T18:32:16.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.816 7f4a6e051700 1 -- 172.21.15.79:0/3658106783 wait complete. 2021-04-09T18:32:16.832 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:32:16.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.928 7fb9d9029700 1 Processor -- start 2021-04-09T18:32:16.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.928 7fb9d9029700 1 -- start start 2021-04-09T18:32:16.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d9029700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb9d40f5580 0x7fb9d40f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d9029700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d41c7e40 0x7fb9d41ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d9029700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d40fbb80 con 0x7fb9d40e9b40 2021-04-09T18:32:16.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d9029700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d40e9f90 con 0x7fb9d40f5580 2021-04-09T18:32:16.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d9029700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d40e59b0 con 0x7fb9d41c7e40 2021-04-09T18:32:16.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d259c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb9d40e9b40 0x7fb9d409f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54428/0 (socket says 172.21.15.79:54428) 2021-04-09T18:32:16.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d259c700 1 -- 172.21.15.79:0/1912455900 learned_addr learned my addr 172.21.15.79:0/1912455900 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:16.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d359e700 1 --2- 172.21.15.79:0/1912455900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d41c7e40 0x7fb9d41ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d2d9d700 1 --2- 172.21.15.79:0/1912455900 >> v2:172.21.15.89:3300/0 conn(0x7fb9d40f5580 0x7fb9d40f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d1d9b700 1 -- 172.21.15.79:0/1912455900 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310339199 0 0) 0x7fb9c80010d0 con 0x7fb9d40e9b40 2021-04-09T18:32:16.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d1d9b700 1 -- 172.21.15.79:0/1912455900 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9bc003240 con 0x7fb9d40e9b40 2021-04-09T18:32:16.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d359e700 1 -- 172.21.15.79:0/1912455900 >> v2:172.21.15.89:3300/0 conn(0x7fb9d40f5580 msgr2=0x7fb9d40f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:16.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d359e700 1 --2- 172.21.15.79:0/1912455900 >> v2:172.21.15.89:3300/0 conn(0x7fb9d40f5580 0x7fb9d40f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d359e700 1 -- 172.21.15.79:0/1912455900 >> v1:172.21.15.79:6789/0 conn(0x7fb9d40e9b40 legacy=0x7fb9d409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d359e700 1 -- 172.21.15.79:0/1912455900 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d409f910 con 0x7fb9d41c7e40 2021-04-09T18:32:16.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d359e700 1 --2- 172.21.15.79:0/1912455900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d41c7e40 0x7fb9d41ca2a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fb9cc0032b0 tx=0x7fb9cc00b0e0).ready entity=mon.2 client_cookie=54db30fb316e38d7 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:16.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d1d9b700 1 -- 172.21.15.79:0/1912455900 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb9d409f910 con 0x7fb9d41c7e40 2021-04-09T18:32:16.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d1d9b700 1 -- 172.21.15.79:0/1912455900 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc00bab0 con 0x7fb9d41c7e40 2021-04-09T18:32:16.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d1d9b700 1 -- 172.21.15.79:0/1912455900 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb9cc002020 con 0x7fb9d41c7e40 2021-04-09T18:32:16.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d9029700 1 -- 172.21.15.79:0/1912455900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d41c7e40 msgr2=0x7fb9d41ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d9029700 1 --2- 172.21.15.79:0/1912455900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d41c7e40 0x7fb9d41ca2a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fb9cc0032b0 tx=0x7fb9cc00b0e0).stop 2021-04-09T18:32:16.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d9029700 1 -- 172.21.15.79:0/1912455900 shutdown_connections 2021-04-09T18:32:16.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d9029700 1 --2- 172.21.15.79:0/1912455900 >> v2:172.21.15.89:3300/0 conn(0x7fb9d40f5580 0x7fb9d40f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d9029700 1 --2- 172.21.15.79:0/1912455900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d41c7e40 0x7fb9d41ca2a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d9029700 1 -- 172.21.15.79:0/1912455900 >> 172.21.15.79:0/1912455900 conn(0x7fb9d40e6040 msgr2=0x7fb9d40e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:16.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d9029700 1 -- 172.21.15.79:0/1912455900 shutdown_connections 2021-04-09T18:32:16.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.932 7fb9d9029700 1 -- 172.21.15.79:0/1912455900 wait complete. 2021-04-09T18:32:16.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.936 7fb9d9029700 1 Processor -- start 2021-04-09T18:32:16.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.936 7fb9d9029700 1 -- start start 2021-04-09T18:32:16.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.936 7fb9d9029700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9d40900d0 0x7fb9d40ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.936 7fb9d9029700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d4094c90 0x7fb9d40950e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.936 7fb9d9029700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9d4095710 0x7fb9d40d0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.936 7fb9d9029700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d4098d30 con 0x7fb9d40900d0 2021-04-09T18:32:16.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.936 7fb9d9029700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d4090520 con 0x7fb9d4095710 2021-04-09T18:32:16.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.936 7fb9d9029700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d40981c0 con 0x7fb9d4094c90 2021-04-09T18:32:16.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.936 7fb9d2d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9d40900d0 0x7fb9d40ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.936 7fb9d2d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9d40900d0 0x7fb9d40ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59724/0 (socket says 172.21.15.79:59724) 2021-04-09T18:32:16.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.936 7fb9d359e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9d4095710 0x7fb9d40d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.936 7fb9d2d9d700 1 -- 172.21.15.79:0/2130479030 learned_addr learned my addr 172.21.15.79:0/2130479030 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:16.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.936 7fb9d259c700 1 --2- 172.21.15.79:0/2130479030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d4094c90 0x7fb9d40950e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.936 7fb9d2d9d700 1 -- 172.21.15.79:0/2130479030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d4094c90 msgr2=0x7fb9d40950e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.936 7fb9d2d9d700 1 --2- 172.21.15.79:0/2130479030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d4094c90 0x7fb9d40950e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.936 7fb9d2d9d700 1 -- 172.21.15.79:0/2130479030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9d4095710 msgr2=0x7fb9d40d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:16.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.936 7fb9d2d9d700 1 --2- 172.21.15.79:0/2130479030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9d4095710 0x7fb9d40d0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:16.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.936 7fb9d2d9d700 1 -- 172.21.15.79:0/2130479030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d40d09a0 con 0x7fb9d40900d0 2021-04-09T18:32:16.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.940 7fb9d2d9d700 1 --2- 172.21.15.79:0/2130479030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9d40900d0 0x7fb9d40ace20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fb9d40989b0 tx=0x7fb9c400c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:16.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.940 7fb9c37fe700 1 -- 172.21.15.79:0/2130479030 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb9d40d09a0 con 0x7fb9d40900d0 2021-04-09T18:32:16.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.940 7fb9c37fe700 1 -- 172.21.15.79:0/2130479030 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c400cd60 con 0x7fb9d40900d0 2021-04-09T18:32:16.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.940 7fb9c37fe700 1 -- 172.21.15.79:0/2130479030 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb9c400f040 con 0x7fb9d40900d0 2021-04-09T18:32:16.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.940 7fb9d9029700 1 -- 172.21.15.79:0/2130479030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d40d0cc0 con 0x7fb9d40900d0 2021-04-09T18:32:16.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.940 7fb9d9029700 1 -- 172.21.15.79:0/2130479030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d40d1040 con 0x7fb9d40900d0 2021-04-09T18:32:16.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.940 7fb9c37fe700 1 -- 172.21.15.79:0/2130479030 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb9c4011070 con 0x7fb9d40900d0 2021-04-09T18:32:16.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.940 7fb9c37fe700 1 --2- 172.21.15.79:0/2130479030 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb9b8029100 0x7fb9b802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:16.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.940 7fb9c37fe700 1 -- 172.21.15.79:0/2130479030 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fb9c4010040 con 0x7fb9d40900d0 2021-04-09T18:32:16.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.940 7fb9d259c700 1 --2- 172.21.15.79:0/2130479030 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb9b8029100 0x7fb9b802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:16.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.940 7fb9d259c700 1 --2- 172.21.15.79:0/2130479030 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb9b8029100 0x7fb9b802b650 crc :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:16.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.944 7fb9d9029700 1 -- 172.21.15.79:0/2130479030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d4088d30 con 0x7fb9d40900d0 2021-04-09T18:32:16.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:16.948 7fb9c37fe700 1 -- 172.21.15.79:0/2130479030 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb9c4000bf0 con 0x7fb9d40900d0 2021-04-09T18:32:17.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.108 7fb9d9029700 1 -- 172.21.15.79:0/2130479030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fb9d40e39a0 con 0x7fb9d40900d0 2021-04-09T18:32:17.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.116 7fb9c37fe700 1 -- 172.21.15.79:0/2130479030 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v22) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb9c400c960 con 0x7fb9d40900d0 2021-04-09T18:32:17.125 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.1 2021-04-09T18:32:17.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.120 7fb9d9029700 1 -- 172.21.15.79:0/2130479030 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb9b8029100 msgr2=0x7fb9b802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:17.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.120 7fb9d9029700 1 --2- 172.21.15.79:0/2130479030 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb9b8029100 0x7fb9b802b650 crc :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.120 7fb9d9029700 1 -- 172.21.15.79:0/2130479030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9d40900d0 msgr2=0x7fb9d40ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:17.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.120 7fb9d9029700 1 --2- 172.21.15.79:0/2130479030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9d40900d0 0x7fb9d40ace20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fb9d40989b0 tx=0x7fb9c400c430).stop 2021-04-09T18:32:17.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.120 7fb9d9029700 1 -- 172.21.15.79:0/2130479030 shutdown_connections 2021-04-09T18:32:17.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.120 7fb9d9029700 1 --2- 172.21.15.79:0/2130479030 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb9b8029100 0x7fb9b802b650 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.120 7fb9d9029700 1 --2- 172.21.15.79:0/2130479030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9d4095710 0x7fb9d40d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.120 7fb9d9029700 1 --2- 172.21.15.79:0/2130479030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9d40900d0 0x7fb9d40ace20 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.120 7fb9d9029700 1 --2- 172.21.15.79:0/2130479030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d4094c90 0x7fb9d40950e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.120 7fb9d9029700 1 -- 172.21.15.79:0/2130479030 >> 172.21.15.79:0/2130479030 conn(0x7fb9d409b260 msgr2=0x7fb9d4092460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:17.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.120 7fb9d9029700 1 -- 172.21.15.79:0/2130479030 shutdown_connections 2021-04-09T18:32:17.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.120 7fb9d9029700 1 -- 172.21.15.79:0/2130479030 wait complete. 2021-04-09T18:32:17.135 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:32:17.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.236 7fcb0cdba700 1 Processor -- start 2021-04-09T18:32:17.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.236 7fcb0cdba700 1 -- start start 2021-04-09T18:32:17.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.236 7fcb0cdba700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb080f5580 0x7fcb080f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:17.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.236 7fcb0cdba700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcb080e9b40 0x7fcb0809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:17.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.236 7fcb0cdba700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb080fbb80 con 0x7fcb081c6e30 2021-04-09T18:32:17.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.236 7fcb0cdba700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb080e9f90 con 0x7fcb080f5580 2021-04-09T18:32:17.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.236 7fcb0cdba700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb080e59b0 con 0x7fcb080e9b40 2021-04-09T18:32:17.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.236 7fcb06aef700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb080f5580 0x7fcb080f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:17.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.236 7fcb072f0700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcb081c6e30 0x7fcb081c9290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54446/0 (socket says 172.21.15.79:54446) 2021-04-09T18:32:17.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.236 7fcb072f0700 1 -- 172.21.15.79:0/1930764962 learned_addr learned my addr 172.21.15.79:0/1930764962 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:17.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.236 7fcb062ee700 1 --2- 172.21.15.79:0/1930764962 >> v2:172.21.15.89:3300/0 conn(0x7fcb080e9b40 0x7fcb0809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:17.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.236 7fcb06aef700 1 -- 172.21.15.79:0/1930764962 >> v2:172.21.15.89:3300/0 conn(0x7fcb080e9b40 msgr2=0x7fcb0809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:17.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.236 7fcb06aef700 1 --2- 172.21.15.79:0/1930764962 >> v2:172.21.15.89:3300/0 conn(0x7fcb080e9b40 0x7fcb0809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.236 7fcb06aef700 1 -- 172.21.15.79:0/1930764962 >> v1:172.21.15.79:6789/0 conn(0x7fcb081c6e30 legacy=0x7fcb081c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:17.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.236 7fcb05aed700 1 -- 172.21.15.79:0/1930764962 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444305766 0 0) 0x7fcb00001450 con 0x7fcb081c6e30 2021-04-09T18:32:17.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.236 7fcb06aef700 1 -- 172.21.15.79:0/1930764962 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb080e56b0 con 0x7fcb080f5580 2021-04-09T18:32:17.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.236 7fcb06aef700 1 --2- 172.21.15.79:0/1930764962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb080f5580 0x7fcb080f6510 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fcaf8002f30 tx=0x7fcaf800bd10).ready entity=mon.0 client_cookie=277dbb91415416b8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:17.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.240 7fcb05aed700 1 -- 172.21.15.79:0/1930764962 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcb080e56b0 con 0x7fcb080f5580 2021-04-09T18:32:17.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.240 7fcb05aed700 1 -- 172.21.15.79:0/1930764962 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf80098a0 con 0x7fcb080f5580 2021-04-09T18:32:17.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.240 7fcb05aed700 1 -- 172.21.15.79:0/1930764962 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcaf8009c70 con 0x7fcb080f5580 2021-04-09T18:32:17.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.240 7fcb0cdba700 1 -- 172.21.15.79:0/1930764962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb080f5580 msgr2=0x7fcb080f6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:17.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.240 7fcb0cdba700 1 --2- 172.21.15.79:0/1930764962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb080f5580 0x7fcb080f6510 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fcaf8002f30 tx=0x7fcaf800bd10).stop 2021-04-09T18:32:17.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.240 7fcb0cdba700 1 -- 172.21.15.79:0/1930764962 shutdown_connections 2021-04-09T18:32:17.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.240 7fcb0cdba700 1 --2- 172.21.15.79:0/1930764962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb080f5580 0x7fcb080f6510 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.240 7fcb0cdba700 1 --2- 172.21.15.79:0/1930764962 >> v2:172.21.15.89:3300/0 conn(0x7fcb080e9b40 0x7fcb0809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.240 7fcb0cdba700 1 -- 172.21.15.79:0/1930764962 >> 172.21.15.79:0/1930764962 conn(0x7fcb080e6040 msgr2=0x7fcb080e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:17.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.240 7fcb0cdba700 1 -- 172.21.15.79:0/1930764962 shutdown_connections 2021-04-09T18:32:17.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.240 7fcb0cdba700 1 -- 172.21.15.79:0/1930764962 wait complete. 2021-04-09T18:32:17.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb0cdba700 1 Processor -- start 2021-04-09T18:32:17.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb0cdba700 1 -- start start 2021-04-09T18:32:17.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb0cdba700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb080a7b70 0x7fcb08095170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:17.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb0cdba700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb080d5b20 0x7fcb080a8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:17.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb0cdba700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb080d5f70 0x7fcb080a9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:17.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb0cdba700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080e8b50 con 0x7fcb080d5f70 2021-04-09T18:32:17.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb0cdba700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb08094e70 con 0x7fcb080a7b70 2021-04-09T18:32:17.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb0cdba700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb08094aa0 con 0x7fcb080d5b20 2021-04-09T18:32:17.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb072f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb080d5f70 0x7fcb080a9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:17.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb072f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb080d5f70 0x7fcb080a9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59742/0 (socket says 172.21.15.79:59742) 2021-04-09T18:32:17.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb072f0700 1 -- 172.21.15.79:0/1371893879 learned_addr learned my addr 172.21.15.79:0/1371893879 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:17.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb06aef700 1 --2- 172.21.15.79:0/1371893879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb080a7b70 0x7fcb08095170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:17.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb062ee700 1 --2- 172.21.15.79:0/1371893879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb080d5b20 0x7fcb080a8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:17.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb072f0700 1 -- 172.21.15.79:0/1371893879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb080d5b20 msgr2=0x7fcb080a8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:17.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb072f0700 1 --2- 172.21.15.79:0/1371893879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb080d5b20 0x7fcb080a8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb072f0700 1 -- 172.21.15.79:0/1371893879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb080a7b70 msgr2=0x7fcb08095170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:17.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb072f0700 1 --2- 172.21.15.79:0/1371893879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb080a7b70 0x7fcb08095170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb072f0700 1 -- 172.21.15.79:0/1371893879 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb080957a0 con 0x7fcb080d5f70 2021-04-09T18:32:17.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb06aef700 1 --2- 172.21.15.79:0/1371893879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb080a7b70 0x7fcb08095170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:32:17.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb072f0700 1 --2- 172.21.15.79:0/1371893879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb080d5f70 0x7fcb080a9120 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fcb080a9c90 tx=0x7fcb0000ceb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:17.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcaff7fe700 1 -- 172.21.15.79:0/1371893879 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcb080957a0 con 0x7fcb080d5f70 2021-04-09T18:32:17.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcaff7fe700 1 -- 172.21.15.79:0/1371893879 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb00005b80 con 0x7fcb080d5f70 2021-04-09T18:32:17.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb0cdba700 1 -- 172.21.15.79:0/1371893879 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb080d77e0 con 0x7fcb080d5f70 2021-04-09T18:32:17.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcaff7fe700 1 -- 172.21.15.79:0/1371893879 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcb00007110 con 0x7fcb080d5f70 2021-04-09T18:32:17.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.244 7fcb0cdba700 1 -- 172.21.15.79:0/1371893879 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb080a98e0 con 0x7fcb080d5f70 2021-04-09T18:32:17.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.248 7fcaff7fe700 1 -- 172.21.15.79:0/1371893879 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fcb0001a020 con 0x7fcb080d5f70 2021-04-09T18:32:17.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.248 7fcaff7fe700 1 --2- 172.21.15.79:0/1371893879 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcaec029100 0x7fcaec02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:17.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.248 7fcaff7fe700 1 -- 172.21.15.79:0/1371893879 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fcb00039550 con 0x7fcb080d5f70 2021-04-09T18:32:17.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.248 7fcb06aef700 1 --2- 172.21.15.79:0/1371893879 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcaec029100 0x7fcaec02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:17.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.248 7fcb06aef700 1 --2- 172.21.15.79:0/1371893879 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcaec029100 0x7fcaec02b650 crc :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:17.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.252 7fcb0cdba700 1 -- 172.21.15.79:0/1371893879 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb08088d30 con 0x7fcb080d5f70 2021-04-09T18:32:17.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.260 7fcaff7fe700 1 -- 172.21.15.79:0/1371893879 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fcb00000f70 con 0x7fcb080d5f70 2021-04-09T18:32:17.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.428 7fcb0cdba700 1 -- 172.21.15.79:0/1371893879 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fcb080e39a0 con 0x7fcb080d5f70 2021-04-09T18:32:17.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.432 7fcaff7fe700 1 -- 172.21.15.79:0/1371893879 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v23) v1 ==== 184+0+0 (secure 0 0 0) 0x7fcb00005970 con 0x7fcb080d5f70 2021-04-09T18:32:17.438 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.2 2021-04-09T18:32:17.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.436 7fcb0cdba700 1 -- 172.21.15.79:0/1371893879 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcaec029100 msgr2=0x7fcaec02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:17.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.436 7fcb0cdba700 1 --2- 172.21.15.79:0/1371893879 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcaec029100 0x7fcaec02b650 crc :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.436 7fcb0cdba700 1 -- 172.21.15.79:0/1371893879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb080d5f70 msgr2=0x7fcb080a9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:17.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.436 7fcb0cdba700 1 --2- 172.21.15.79:0/1371893879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb080d5f70 0x7fcb080a9120 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fcb080a9c90 tx=0x7fcb0000ceb0).stop 2021-04-09T18:32:17.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.436 7fcb0cdba700 1 -- 172.21.15.79:0/1371893879 shutdown_connections 2021-04-09T18:32:17.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.436 7fcb0cdba700 1 --2- 172.21.15.79:0/1371893879 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcaec029100 0x7fcaec02b650 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.436 7fcb0cdba700 1 --2- 172.21.15.79:0/1371893879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb080a7b70 0x7fcb08095170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.436 7fcb0cdba700 1 --2- 172.21.15.79:0/1371893879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb080d5f70 0x7fcb080a9120 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.436 7fcb0cdba700 1 --2- 172.21.15.79:0/1371893879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb080d5b20 0x7fcb080a8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.436 7fcb0cdba700 1 -- 172.21.15.79:0/1371893879 >> 172.21.15.79:0/1371893879 conn(0x7fcb080bce80 msgr2=0x7fcb080938e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:17.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.436 7fcb0cdba700 1 -- 172.21.15.79:0/1371893879 shutdown_connections 2021-04-09T18:32:17.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.436 7fcb0cdba700 1 -- 172.21.15.79:0/1371893879 wait complete. 2021-04-09T18:32:17.452 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:32:17.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.540 7f1201dc9700 1 Processor -- start 2021-04-09T18:32:17.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.540 7f1201dc9700 1 -- start start 2021-04-09T18:32:17.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.540 7f1201dc9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f11fc0e9ae0 0x7f11fc09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:17.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.540 7f1201dc9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f11fc1c8010 0x7f11fc1ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:17.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.540 7f1201dc9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11fc0fbb20 con 0x7f11fc0f5520 2021-04-09T18:32:17.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.540 7f1201dc9700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11fc1c3dc0 con 0x7f11fc1c8010 2021-04-09T18:32:17.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.540 7f1201dc9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11fc0e9f30 con 0x7f11fc0e9ae0 2021-04-09T18:32:17.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.540 7f11fbfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f11fc1c8010 0x7f11fc1ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:17.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.540 7f11fbfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f11fc1c8010 0x7f11fc1ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59748/0 (socket says 172.21.15.79:59748) 2021-04-09T18:32:17.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.540 7f11fbfff700 1 -- 172.21.15.79:0/1899961998 learned_addr learned my addr 172.21.15.79:0/1899961998 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:17.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.540 7f11faffd700 1 --2- 172.21.15.79:0/1899961998 >> v2:172.21.15.89:3300/0 conn(0x7f11fc0e9ae0 0x7f11fc09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:17.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.544 7f11fbfff700 1 -- 172.21.15.79:0/1899961998 >> v2:172.21.15.89:3300/0 conn(0x7f11fc0e9ae0 msgr2=0x7f11fc09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:17.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.544 7f11fbfff700 1 --2- 172.21.15.79:0/1899961998 >> v2:172.21.15.89:3300/0 conn(0x7f11fc0e9ae0 0x7f11fc09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.544 7f11fbfff700 1 -- 172.21.15.79:0/1899961998 >> v1:172.21.15.89:6789/0 conn(0x7f11fc0f5520 legacy=0x7f11fc0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:17.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.544 7f11fbfff700 1 -- 172.21.15.79:0/1899961998 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc0e56d0 con 0x7f11fc1c8010 2021-04-09T18:32:17.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.544 7f11fbfff700 1 --2- 172.21.15.79:0/1899961998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11fc1c8010 0x7f11fc1ca470 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f11f40032b0 tx=0x7f11f400b3c0).ready entity=mon.0 client_cookie=b022eb3cc87af87f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:17.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.544 7f11fa7fc700 1 -- 172.21.15.79:0/1899961998 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11fc0e56d0 con 0x7f11fc1c8010 2021-04-09T18:32:17.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.544 7f11fa7fc700 1 -- 172.21.15.79:0/1899961998 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f400bc20 con 0x7f11fc1c8010 2021-04-09T18:32:17.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.544 7f11fa7fc700 1 -- 172.21.15.79:0/1899961998 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11f4002020 con 0x7f11fc1c8010 2021-04-09T18:32:17.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.544 7f1201dc9700 1 -- 172.21.15.79:0/1899961998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11fc1c8010 msgr2=0x7f11fc1ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:17.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.544 7f1201dc9700 1 --2- 172.21.15.79:0/1899961998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11fc1c8010 0x7f11fc1ca470 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f11f40032b0 tx=0x7f11f400b3c0).stop 2021-04-09T18:32:17.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.544 7f1201dc9700 1 -- 172.21.15.79:0/1899961998 shutdown_connections 2021-04-09T18:32:17.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.544 7f1201dc9700 1 --2- 172.21.15.79:0/1899961998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11fc1c8010 0x7f11fc1ca470 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.544 7f1201dc9700 1 --2- 172.21.15.79:0/1899961998 >> v2:172.21.15.89:3300/0 conn(0x7f11fc0e9ae0 0x7f11fc09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.544 7f1201dc9700 1 -- 172.21.15.79:0/1899961998 >> 172.21.15.79:0/1899961998 conn(0x7f11fc0e5fe0 msgr2=0x7f11fc0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:17.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.544 7f1201dc9700 1 -- 172.21.15.79:0/1899961998 shutdown_connections 2021-04-09T18:32:17.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.544 7f1201dc9700 1 -- 172.21.15.79:0/1899961998 wait complete. 2021-04-09T18:32:17.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.548 7f1201dc9700 1 Processor -- start 2021-04-09T18:32:17.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.548 7f1201dc9700 1 -- start start 2021-04-09T18:32:17.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.548 7f1201dc9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11fc0c06f0 0x7f11fc0afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:17.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.548 7f1201dc9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11fc0d5020 0x7f11fc0d5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:17.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.548 7f1201dc9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11fc19dbf0 0x7f11fc19e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:17.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.548 7f1201dc9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0b0570 con 0x7f11fc0c06f0 2021-04-09T18:32:17.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.548 7f1201dc9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0b0240 con 0x7f11fc0d5020 2021-04-09T18:32:17.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.548 7f1201dc9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc097600 con 0x7f11fc19dbf0 2021-04-09T18:32:17.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.548 7f11fb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11fc0c06f0 0x7f11fc0afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:17.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.548 7f11fb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11fc0c06f0 0x7f11fc0afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59752/0 (socket says 172.21.15.79:59752) 2021-04-09T18:32:17.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.548 7f11faffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11fc0d5020 0x7f11fc0d5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:17.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.548 7f11fb7fe700 1 -- 172.21.15.79:0/168866444 learned_addr learned my addr 172.21.15.79:0/168866444 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:17.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.548 7f11fbfff700 1 --2- 172.21.15.79:0/168866444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11fc19dbf0 0x7f11fc19e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:17.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.548 7f11fb7fe700 1 -- 172.21.15.79:0/168866444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11fc19dbf0 msgr2=0x7f11fc19e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:17.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.548 7f11fb7fe700 1 --2- 172.21.15.79:0/168866444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11fc19dbf0 0x7f11fc19e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.548 7f11fb7fe700 1 -- 172.21.15.79:0/168866444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11fc0d5020 msgr2=0x7f11fc0d5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:17.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.548 7f11fb7fe700 1 --2- 172.21.15.79:0/168866444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11fc0d5020 0x7f11fc0d5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.548 7f11fb7fe700 1 -- 172.21.15.79:0/168866444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc097830 con 0x7f11fc0c06f0 2021-04-09T18:32:17.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.548 7f11fb7fe700 1 --2- 172.21.15.79:0/168866444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11fc0c06f0 0x7f11fc0afc10 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f11ec000b80 tx=0x7f11ec00ca80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:17.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.548 7f11e3fff700 1 -- 172.21.15.79:0/168866444 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11fc097830 con 0x7f11fc0c06f0 2021-04-09T18:32:17.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.552 7f11e3fff700 1 -- 172.21.15.79:0/168866444 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ec010510 con 0x7f11fc0c06f0 2021-04-09T18:32:17.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.552 7f1201dc9700 1 -- 172.21.15.79:0/168866444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11fc097b50 con 0x7f11fc0c06f0 2021-04-09T18:32:17.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.552 7f11e3fff700 1 -- 172.21.15.79:0/168866444 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11ec0106f0 con 0x7f11fc0c06f0 2021-04-09T18:32:17.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.552 7f1201dc9700 1 -- 172.21.15.79:0/168866444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11fc098080 con 0x7f11fc0c06f0 2021-04-09T18:32:17.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.552 7f11e3fff700 1 -- 172.21.15.79:0/168866444 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f11ec019020 con 0x7f11fc0c06f0 2021-04-09T18:32:17.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.552 7f11e3fff700 1 --2- 172.21.15.79:0/168866444 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f11dc029100 0x7f11dc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:17.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.552 7f11e3fff700 1 -- 172.21.15.79:0/168866444 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f11ec038e30 con 0x7f11fc0c06f0 2021-04-09T18:32:17.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.552 7f11faffd700 1 --2- 172.21.15.79:0/168866444 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f11dc029100 0x7f11dc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:17.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.552 7f11faffd700 1 --2- 172.21.15.79:0/168866444 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f11dc029100 0x7f11dc02b650 crc :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:17.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.552 7f1201dc9700 1 -- 172.21.15.79:0/168866444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11fc0e39e0 con 0x7f11fc0c06f0 2021-04-09T18:32:17.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.560 7f11e3fff700 1 -- 172.21.15.79:0/168866444 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f11ec010300 con 0x7f11fc0c06f0 2021-04-09T18:32:17.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.728 7f1201dc9700 1 -- 172.21.15.79:0/168866444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11fc0a1cc0 con 0x7f11fc0c06f0 2021-04-09T18:32:17.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.728 7f11e3fff700 1 -- 172.21.15.79:0/168866444 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+2104 (secure 0 0 0) 0x7f11ec000bf0 con 0x7f11fc0c06f0 2021-04-09T18:32:17.733 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 40 2021-04-09T18:32:17.734 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:32:17.734 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6153,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1203679879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1203679879},{"type":"v1","addr":"172.21.15.89:6835","nonce":1203679879}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":38}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:32:14.903910","modified":"2021-04-09 18:32:16.914763","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/1131782053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1131782053},{"type":"v1","addr":"172.21.15.79:6833","nonce":1131782053}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-04-09T18:32:17.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.732 7f1201dc9700 1 -- 172.21.15.79:0/168866444 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f11dc029100 msgr2=0x7f11dc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:17.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.732 7f1201dc9700 1 --2- 172.21.15.79:0/168866444 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f11dc029100 0x7f11dc02b650 crc :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.732 7f1201dc9700 1 -- 172.21.15.79:0/168866444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11fc0c06f0 msgr2=0x7f11fc0afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:17.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.732 7f1201dc9700 1 --2- 172.21.15.79:0/168866444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11fc0c06f0 0x7f11fc0afc10 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f11ec000b80 tx=0x7f11ec00ca80).stop 2021-04-09T18:32:17.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.732 7f1201dc9700 1 -- 172.21.15.79:0/168866444 shutdown_connections 2021-04-09T18:32:17.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.732 7f1201dc9700 1 --2- 172.21.15.79:0/168866444 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f11dc029100 0x7f11dc02b650 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.732 7f1201dc9700 1 --2- 172.21.15.79:0/168866444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11fc19dbf0 0x7f11fc19e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.732 7f1201dc9700 1 --2- 172.21.15.79:0/168866444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11fc0c06f0 0x7f11fc0afc10 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.732 7f1201dc9700 1 --2- 172.21.15.79:0/168866444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11fc0d5020 0x7f11fc0d5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:17.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.732 7f1201dc9700 1 -- 172.21.15.79:0/168866444 >> 172.21.15.79:0/168866444 conn(0x7f11fc0d8280 msgr2=0x7f11fc0d86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:17.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.732 7f1201dc9700 1 -- 172.21.15.79:0/168866444 shutdown_connections 2021-04-09T18:32:17.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:17.732 7f1201dc9700 1 -- 172.21.15.79:0/168866444 wait complete. 2021-04-09T18:32:17.948 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:32:14.903910', 'modified': '2021-04-09 18:32:16.914763', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 69, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6150}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6150': {'gid': 6150, 'name': 'a', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6833/1131782053', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 1131782053}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 1131782053}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:32:17.949 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:32:17.949 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2021-04-09T18:32:18.050 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:32:18.050 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:32:18.050 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2021-04-09T18:32:18.051 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 6150, 2021-04-09T18:32:18.051 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2021-04-09T18:32:18.051 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2021-04-09T18:32:18.051 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 2.1333535299999999, 2021-04-09T18:32:18.052 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 40, 2021-04-09T18:32:18.052 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 69, 2021-04-09T18:32:18.052 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 69, 2021-04-09T18:32:18.052 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 7.1501298039999996 2021-04-09T18:32:18.053 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:32:18.057 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 6150, "want_state": "up:active", "state": "up:active", "rank_uptime": 2.1333535299999999, "mdsmap_epoch": 40, "osdmap_epoch": 69, "osdmap_epoch_barrier": 69, "uptime": 7.1501298039999996 } 2021-04-09T18:32:18.057 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:32:18.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.144 7fa865624700 1 Processor -- start 2021-04-09T18:32:18.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.144 7fa865624700 1 -- start start 2021-04-09T18:32:18.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.144 7fa865624700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa8600f5510 0x7fa8600f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:18.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.144 7fa865624700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8601c8000 0x7fa8601ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:18.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.144 7fa865624700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8600fbb10 con 0x7fa8600e9ad0 2021-04-09T18:32:18.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.144 7fa865624700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8600e9f20 con 0x7fa8600f5510 2021-04-09T18:32:18.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.144 7fa865624700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8601c3db0 con 0x7fa8601c8000 2021-04-09T18:32:18.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.144 7fa85f247700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa8600f5510 0x7fa8600f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:18.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.144 7fa85f247700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa8600f5510 0x7fa8600f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59760/0 (socket says 172.21.15.79:59760) 2021-04-09T18:32:18.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.144 7fa85f247700 1 -- 172.21.15.79:0/438161266 learned_addr learned my addr 172.21.15.79:0/438161266 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:18.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.144 7fa85fa48700 1 --2- 172.21.15.79:0/438161266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8601c8000 0x7fa8601ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:18.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.144 7fa85f247700 1 -- 172.21.15.79:0/438161266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8601c8000 msgr2=0x7fa8601ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:18.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.144 7fa85f247700 1 --2- 172.21.15.79:0/438161266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8601c8000 0x7fa8601ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.144 7fa85f247700 1 -- 172.21.15.79:0/438161266 >> v1:172.21.15.89:6789/0 conn(0x7fa8600e9ad0 legacy=0x7fa86009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:18.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.144 7fa85f247700 1 -- 172.21.15.79:0/438161266 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86009f900 con 0x7fa8600f5510 2021-04-09T18:32:18.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.144 7fa85f247700 1 --2- 172.21.15.79:0/438161266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8600f5510 0x7fa8600f64a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7fa8600f6ef0 tx=0x7fa85000b3c0).ready entity=mon.0 client_cookie=1207f159c6cd262a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:18.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.148 7fa85e245700 1 -- 172.21.15.79:0/438161266 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa86009f900 con 0x7fa8600f5510 2021-04-09T18:32:18.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.148 7fa85e245700 1 -- 172.21.15.79:0/438161266 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85000bbe0 con 0x7fa8600f5510 2021-04-09T18:32:18.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.148 7fa85e245700 1 -- 172.21.15.79:0/438161266 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa850002020 con 0x7fa8600f5510 2021-04-09T18:32:18.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.148 7fa865624700 1 -- 172.21.15.79:0/438161266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8600f5510 msgr2=0x7fa8600f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.148 7fa865624700 1 --2- 172.21.15.79:0/438161266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8600f5510 0x7fa8600f64a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7fa8600f6ef0 tx=0x7fa85000b3c0).stop 2021-04-09T18:32:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.148 7fa865624700 1 -- 172.21.15.79:0/438161266 shutdown_connections 2021-04-09T18:32:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.148 7fa865624700 1 --2- 172.21.15.79:0/438161266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8601c8000 0x7fa8601ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.148 7fa865624700 1 --2- 172.21.15.79:0/438161266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8600f5510 0x7fa8600f64a0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.148 7fa865624700 1 -- 172.21.15.79:0/438161266 >> 172.21.15.79:0/438161266 conn(0x7fa8600e5fd0 msgr2=0x7fa8600e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:18.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.148 7fa865624700 1 -- 172.21.15.79:0/438161266 shutdown_connections 2021-04-09T18:32:18.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.148 7fa865624700 1 -- 172.21.15.79:0/438161266 wait complete. 2021-04-09T18:32:18.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.148 7fa865624700 1 Processor -- start 2021-04-09T18:32:18.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.148 7fa865624700 1 -- start start 2021-04-09T18:32:18.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa865624700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8600c1760 0x7fa8600b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:18.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa865624700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8600a3490 0x7fa8600d4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:18.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa865624700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8600d5470 0x7fa8600b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:18.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa865624700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600af2e0 con 0x7fa8600a3490 2021-04-09T18:32:18.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa865624700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600b1ce0 con 0x7fa8600d5470 2021-04-09T18:32:18.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa865624700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600a3f30 con 0x7fa8600c1760 2021-04-09T18:32:18.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa85ea46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8600a3490 0x7fa8600d4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:18.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa85f247700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8600c1760 0x7fa8600b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:18.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa85ea46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8600a3490 0x7fa8600d4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59768/0 (socket says 172.21.15.79:59768) 2021-04-09T18:32:18.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa85ea46700 1 -- 172.21.15.79:0/3358669671 learned_addr learned my addr 172.21.15.79:0/3358669671 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:18.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa85fa48700 1 --2- 172.21.15.79:0/3358669671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8600d5470 0x7fa8600b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:18.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa85ea46700 1 -- 172.21.15.79:0/3358669671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8600c1760 msgr2=0x7fa8600b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:18.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa85ea46700 1 --2- 172.21.15.79:0/3358669671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8600c1760 0x7fa8600b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa85ea46700 1 -- 172.21.15.79:0/3358669671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8600d5470 msgr2=0x7fa8600b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:18.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa85ea46700 1 --2- 172.21.15.79:0/3358669671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8600d5470 0x7fa8600b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa85ea46700 1 -- 172.21.15.79:0/3358669671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600aee70 con 0x7fa8600a3490 2021-04-09T18:32:18.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa85ea46700 1 --2- 172.21.15.79:0/3358669671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8600a3490 0x7fa8600d4e40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fa848000e90 tx=0x7fa84800cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:18.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa857fff700 1 -- 172.21.15.79:0/3358669671 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa8600aee70 con 0x7fa8600a3490 2021-04-09T18:32:18.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa857fff700 1 -- 172.21.15.79:0/3358669671 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa848010510 con 0x7fa8600a3490 2021-04-09T18:32:18.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa865624700 1 -- 172.21.15.79:0/3358669671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8600af5e0 con 0x7fa8600a3490 2021-04-09T18:32:18.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa857fff700 1 -- 172.21.15.79:0/3358669671 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa8480106f0 con 0x7fa8600a3490 2021-04-09T18:32:18.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa865624700 1 -- 172.21.15.79:0/3358669671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8600a3a70 con 0x7fa8600a3490 2021-04-09T18:32:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa857fff700 1 -- 172.21.15.79:0/3358669671 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa848019020 con 0x7fa8600a3490 2021-04-09T18:32:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa857fff700 1 --2- 172.21.15.79:0/3358669671 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa838029100 0x7fa83802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:18.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa857fff700 1 -- 172.21.15.79:0/3358669671 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fa848038e60 con 0x7fa8600a3490 2021-04-09T18:32:18.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.152 7fa85f247700 1 --2- 172.21.15.79:0/3358669671 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa838029100 0x7fa83802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:18.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.156 7fa85f247700 1 --2- 172.21.15.79:0/3358669671 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa838029100 0x7fa83802b650 crc :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:18.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.160 7fa865624700 1 -- 172.21.15.79:0/3358669671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8600e39d0 con 0x7fa8600a3490 2021-04-09T18:32:18.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.164 7fa857fff700 1 -- 172.21.15.79:0/3358669671 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa8600e5c90 con 0x7fa8600a3490 2021-04-09T18:32:18.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.332 7fa865624700 1 -- 172.21.15.79:0/3358669671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8600c52e0 con 0x7fa8600a3490 2021-04-09T18:32:18.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.332 7fa857fff700 1 -- 172.21.15.79:0/3358669671 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+14348 (secure 0 0 0) 0x7fa848010300 con 0x7fa8600a3490 2021-04-09T18:32:18.338 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:32:18.338 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":69,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:32:14.953152","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:32:13.133609","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2021-04-09 18:32:13.943877","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6835/2729581928":"2021-04-10 18:32:14.953106","172.21.15.89:6834/2729581928":"2021-04-10 18:32:14.953106"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:32:18.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.336 7fa865624700 1 -- 172.21.15.79:0/3358669671 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa838029100 msgr2=0x7fa83802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:18.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.336 7fa865624700 1 --2- 172.21.15.79:0/3358669671 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa838029100 0x7fa83802b650 crc :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.336 7fa865624700 1 -- 172.21.15.79:0/3358669671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8600a3490 msgr2=0x7fa8600d4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:18.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.336 7fa865624700 1 --2- 172.21.15.79:0/3358669671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8600a3490 0x7fa8600d4e40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fa848000e90 tx=0x7fa84800cab0).stop 2021-04-09T18:32:18.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.336 7fa865624700 1 -- 172.21.15.79:0/3358669671 shutdown_connections 2021-04-09T18:32:18.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.336 7fa865624700 1 --2- 172.21.15.79:0/3358669671 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa838029100 0x7fa83802b650 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.336 7fa865624700 1 --2- 172.21.15.79:0/3358669671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8600d5470 0x7fa8600b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.336 7fa865624700 1 --2- 172.21.15.79:0/3358669671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8600c1760 0x7fa8600b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.336 7fa865624700 1 --2- 172.21.15.79:0/3358669671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8600a3490 0x7fa8600d4e40 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.336 7fa865624700 1 -- 172.21.15.79:0/3358669671 >> 172.21.15.79:0/3358669671 conn(0x7fa8600a24b0 msgr2=0x7fa8600d8350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:18.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.336 7fa865624700 1 -- 172.21.15.79:0/3358669671 shutdown_connections 2021-04-09T18:32:18.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.336 7fa865624700 1 -- 172.21.15.79:0/3358669671 wait complete. 2021-04-09T18:32:18.351 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:32:13.133609', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:32:13.943877', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:32:18.352 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:32:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.440 7f2ed6e46700 1 Processor -- start 2021-04-09T18:32:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.440 7f2ed6e46700 1 -- start start 2021-04-09T18:32:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed6e46700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2ed00f5550 0x7f2ed00f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed6e46700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ed00e9b10 0x7f2ed009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed6e46700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed00fbb50 con 0x7f2ed01c2de0 2021-04-09T18:32:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed6e46700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed00e9f60 con 0x7f2ed00f5550 2021-04-09T18:32:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed6e46700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed00e5a00 con 0x7f2ed00e9b10 2021-04-09T18:32:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed4bea700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2ed00f5550 0x7f2ed00f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ec7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ed00e9b10 0x7f2ed009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed4bea700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2ed00f5550 0x7f2ed00f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:48116/0 (socket says 172.21.15.79:48116) 2021-04-09T18:32:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed53eb700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2ed01c2de0 0x7f2ed01c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:54958/0 (socket says 172.21.15.79:54958) 2021-04-09T18:32:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed4bea700 1 -- 172.21.15.79:0/1483402418 learned_addr learned my addr 172.21.15.79:0/1483402418 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ec7fff700 1 --2- 172.21.15.79:0/1483402418 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ed00e9b10 0x7f2ed009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:56770/0 (socket says 172.21.15.79:56770) 2021-04-09T18:32:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed4bea700 1 -- 172.21.15.79:0/1483402418 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ed00e9b10 msgr2=0x7f2ed009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed4bea700 1 --2- 172.21.15.79:0/1483402418 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ed00e9b10 0x7f2ed009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed4bea700 1 -- 172.21.15.79:0/1483402418 >> v1:172.21.15.89:6789/0 conn(0x7f2ed01c2de0 legacy=0x7f2ed01c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:18.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ec77fe700 1 -- 172.21.15.79:0/1483402418 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402095548 0 0) 0x7f2ec8001450 con 0x7f2ed01c2de0 2021-04-09T18:32:18.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed4bea700 1 -- 172.21.15.79:0/1483402418 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed00e5700 con 0x7f2ed00f5550 2021-04-09T18:32:18.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ec7fff700 1 --2- 172.21.15.79:0/1483402418 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ed00e9b10 0x7f2ed009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:32:18.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed4bea700 1 --2- 172.21.15.79:0/1483402418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ed00f5550 0x7f2ed00f64e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f2ecc002f30 tx=0x7f2ecc00bda0).ready entity=mon.1 client_cookie=f75faf87787ee38c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:18.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ec77fe700 1 -- 172.21.15.79:0/1483402418 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2ed00e5700 con 0x7f2ed00f5550 2021-04-09T18:32:18.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ec77fe700 1 -- 172.21.15.79:0/1483402418 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ecc0099d0 con 0x7f2ed00f5550 2021-04-09T18:32:18.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ec77fe700 1 -- 172.21.15.79:0/1483402418 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2ecc009da0 con 0x7f2ed00f5550 2021-04-09T18:32:18.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed6e46700 1 -- 172.21.15.79:0/1483402418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ed00f5550 msgr2=0x7f2ed00f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:18.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed6e46700 1 --2- 172.21.15.79:0/1483402418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ed00f5550 0x7f2ed00f64e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f2ecc002f30 tx=0x7f2ecc00bda0).stop 2021-04-09T18:32:18.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed6e46700 1 -- 172.21.15.79:0/1483402418 shutdown_connections 2021-04-09T18:32:18.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed6e46700 1 --2- 172.21.15.79:0/1483402418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ed00f5550 0x7f2ed00f64e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed6e46700 1 --2- 172.21.15.79:0/1483402418 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ed00e9b10 0x7f2ed009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed6e46700 1 -- 172.21.15.79:0/1483402418 >> 172.21.15.79:0/1483402418 conn(0x7f2ed00e6010 msgr2=0x7f2ed00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:18.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.444 7f2ed6e46700 1 -- 172.21.15.79:0/1483402418 shutdown_connections 2021-04-09T18:32:18.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.448 7f2ed6e46700 1 -- 172.21.15.79:0/1483402418 wait complete. 2021-04-09T18:32:18.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ed6e46700 1 Processor -- start 2021-04-09T18:32:18.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ed6e46700 1 -- start start 2021-04-09T18:32:18.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ed6e46700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ed00ae270 0x7f2ed00d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:18.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ed6e46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ed00d14a0 0x7f2ed01a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:18.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ed6e46700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ed01a8460 0x7f2ed01a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:18.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ed6e46700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed00ab290 con 0x7f2ed00d14a0 2021-04-09T18:32:18.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ed6e46700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed00ab590 con 0x7f2ed01a8460 2021-04-09T18:32:18.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ed6e46700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed00aa720 con 0x7f2ed00ae270 2021-04-09T18:32:18.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ec7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ed00d14a0 0x7f2ed01a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:18.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ed4bea700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ed00ae270 0x7f2ed00d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:18.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ec7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ed00d14a0 0x7f2ed01a7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59782/0 (socket says 172.21.15.79:59782) 2021-04-09T18:32:18.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ec7fff700 1 -- 172.21.15.79:0/900454609 learned_addr learned my addr 172.21.15.79:0/900454609 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:18.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ed53eb700 1 --2- 172.21.15.79:0/900454609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ed01a8460 0x7f2ed01a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:18.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ec7fff700 1 -- 172.21.15.79:0/900454609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ed00ae270 msgr2=0x7f2ed00d0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:18.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ec7fff700 1 --2- 172.21.15.79:0/900454609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ed00ae270 0x7f2ed00d0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ec7fff700 1 -- 172.21.15.79:0/900454609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ed01a8460 msgr2=0x7f2ed01a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:18.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ec7fff700 1 --2- 172.21.15.79:0/900454609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ed01a8460 0x7f2ed01a88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ec7fff700 1 -- 172.21.15.79:0/900454609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed00d4be0 con 0x7f2ed00d14a0 2021-04-09T18:32:18.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ec7fff700 1 --2- 172.21.15.79:0/900454609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ed00d14a0 0x7f2ed01a7e30 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f2ec000efc0 tx=0x7f2ec000c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:18.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ec57fa700 1 -- 172.21.15.79:0/900454609 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2ed00d4be0 con 0x7f2ed00d14a0 2021-04-09T18:32:18.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ec57fa700 1 -- 172.21.15.79:0/900454609 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec000cdc0 con 0x7f2ed00d14a0 2021-04-09T18:32:18.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ec57fa700 1 -- 172.21.15.79:0/900454609 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2ec000f040 con 0x7f2ed00d14a0 2021-04-09T18:32:18.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ed6e46700 1 -- 172.21.15.79:0/900454609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed00aab20 con 0x7f2ed00d14a0 2021-04-09T18:32:18.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.452 7f2ed6e46700 1 -- 172.21.15.79:0/900454609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed00ae6c0 con 0x7f2ed00d14a0 2021-04-09T18:32:18.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.456 7f2ec57fa700 1 -- 172.21.15.79:0/900454609 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2ec0011070 con 0x7f2ed00d14a0 2021-04-09T18:32:18.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.456 7f2ec57fa700 1 --2- 172.21.15.79:0/900454609 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2eb0029100 0x7f2eb002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:18.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.456 7f2ec57fa700 1 -- 172.21.15.79:0/900454609 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f2ec0010040 con 0x7f2ed00d14a0 2021-04-09T18:32:18.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.456 7f2ed4bea700 1 --2- 172.21.15.79:0/900454609 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2eb0029100 0x7f2eb002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:18.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.456 7f2ed4bea700 1 --2- 172.21.15.79:0/900454609 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2eb0029100 0x7f2eb002b650 crc :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:18.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.456 7f2ed6e46700 1 -- 172.21.15.79:0/900454609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed00e39f0 con 0x7f2ed00d14a0 2021-04-09T18:32:18.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.460 7f2ec57fa700 1 -- 172.21.15.79:0/900454609 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2ec000c9c0 con 0x7f2ed00d14a0 2021-04-09T18:32:18.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.620 7f2ed6e46700 1 -- 172.21.15.79:0/900454609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f2ed00f5b50 con 0x7f2ed00d14a0 2021-04-09T18:32:18.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.620 7f2ec57fa700 1 -- 172.21.15.79:0/900454609 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v69) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2ec0000bf0 con 0x7f2ed00d14a0 2021-04-09T18:32:18.624 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:32:18.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.624 7f2ed6e46700 1 -- 172.21.15.79:0/900454609 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2eb0029100 msgr2=0x7f2eb002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:18.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.624 7f2ed6e46700 1 --2- 172.21.15.79:0/900454609 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2eb0029100 0x7f2eb002b650 crc :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.624 7f2ed6e46700 1 -- 172.21.15.79:0/900454609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ed00d14a0 msgr2=0x7f2ed01a7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:18.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.624 7f2ed6e46700 1 --2- 172.21.15.79:0/900454609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ed00d14a0 0x7f2ed01a7e30 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f2ec000efc0 tx=0x7f2ec000c430).stop 2021-04-09T18:32:18.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.624 7f2ed6e46700 1 -- 172.21.15.79:0/900454609 shutdown_connections 2021-04-09T18:32:18.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.624 7f2ed6e46700 1 --2- 172.21.15.79:0/900454609 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2eb0029100 0x7f2eb002b650 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.624 7f2ed6e46700 1 --2- 172.21.15.79:0/900454609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ed01a8460 0x7f2ed01a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.624 7f2ed6e46700 1 --2- 172.21.15.79:0/900454609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ed00ae270 0x7f2ed00d0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.624 7f2ed6e46700 1 --2- 172.21.15.79:0/900454609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ed00d14a0 0x7f2ed01a7e30 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.624 7f2ed6e46700 1 -- 172.21.15.79:0/900454609 >> 172.21.15.79:0/900454609 conn(0x7f2ed00bb0c0 msgr2=0x7f2ed00d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:18.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.624 7f2ed6e46700 1 -- 172.21.15.79:0/900454609 shutdown_connections 2021-04-09T18:32:18.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.624 7f2ed6e46700 1 -- 172.21.15.79:0/900454609 wait complete. 2021-04-09T18:32:18.637 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:32:18.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f512a294700 1 Processor -- start 2021-04-09T18:32:18.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f512a294700 1 -- start start 2021-04-09T18:32:18.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f512a294700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f51240e9b10 0x7f512409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:18.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f512a294700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51240fbb50 con 0x7f51241c8040 2021-04-09T18:32:18.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f512a294700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51240e5700 con 0x7f51240f5550 2021-04-09T18:32:18.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f512a294700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51241c3df0 con 0x7f51240e9b10 2021-04-09T18:32:18.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5128839700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f51241c8040 0x7f51241ca4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54498/0 (socket says 172.21.15.79:54498) 2021-04-09T18:32:18.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5128839700 1 -- 172.21.15.79:0/1432238200 learned_addr learned my addr 172.21.15.79:0/1432238200 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:18.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f51237fe700 1 --2- 172.21.15.79:0/1432238200 >> v2:172.21.15.89:3300/0 conn(0x7f51240e9b10 0x7f512409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:18.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5122ffd700 1 -- 172.21.15.79:0/1432238200 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462541721 0 0) 0x7f511c001450 con 0x7f51241c8040 2021-04-09T18:32:18.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5122ffd700 1 -- 172.21.15.79:0/1432238200 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5110003240 con 0x7f51241c8040 2021-04-09T18:32:18.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5122ffd700 1 -- 172.21.15.79:0/1432238200 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 681184721 0 0) 0x7f511c0019d0 con 0x7f51241c8040 2021-04-09T18:32:18.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5122ffd700 1 -- 172.21.15.79:0/1432238200 >> v2:172.21.15.89:3300/0 conn(0x7f51240e9b10 msgr2=0x7f512409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:18.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5122ffd700 1 --2- 172.21.15.79:0/1432238200 >> v2:172.21.15.89:3300/0 conn(0x7f51240e9b10 0x7f512409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5122ffd700 1 -- 172.21.15.79:0/1432238200 >> v1:172.21.15.89:6789/0 conn(0x7f51240f5550 legacy=0x7f51240f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:18.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5122ffd700 1 -- 172.21.15.79:0/1432238200 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51240e4360 con 0x7f51241c8040 2021-04-09T18:32:18.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5122ffd700 1 -- 172.21.15.79:0/1432238200 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f511c001f30 con 0x7f51241c8040 2021-04-09T18:32:18.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5122ffd700 1 -- 172.21.15.79:0/1432238200 >> v1:172.21.15.79:6789/0 conn(0x7f51241c8040 legacy=0x7f51241ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:18.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5122ffd700 1 --2- 172.21.15.79:0/1432238200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51100038c0 0x7f5110003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:18.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5122ffd700 1 --2- 172.21.15.79:0/1432238200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51100045a0 0x7f5110004a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:18.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5122ffd700 1 --2- 172.21.15.79:0/1432238200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51100097e0 0x7f511000bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:18.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5122ffd700 1 -- 172.21.15.79:0/1432238200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51241c3df0 con 0x7f51100045a0 2021-04-09T18:32:18.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5122ffd700 1 -- 172.21.15.79:0/1432238200 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511000c270 con 0x7f51100038c0 2021-04-09T18:32:18.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5122ffd700 1 -- 172.21.15.79:0/1432238200 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5110050430 con 0x7f51100097e0 2021-04-09T18:32:18.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f51237fe700 1 --2- 172.21.15.79:0/1432238200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51100045a0 0x7f5110004a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:18.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5123fff700 1 --2- 172.21.15.79:0/1432238200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51100038c0 0x7f5110003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:18.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5128839700 1 --2- 172.21.15.79:0/1432238200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51100097e0 0x7f511000bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:18.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f51237fe700 1 -- 172.21.15.79:0/1432238200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51100097e0 msgr2=0x7f511000bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:18.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f51237fe700 1 --2- 172.21.15.79:0/1432238200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51100097e0 0x7f511000bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f51237fe700 1 -- 172.21.15.79:0/1432238200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51100038c0 msgr2=0x7f5110003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:18.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f51237fe700 1 --2- 172.21.15.79:0/1432238200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51100038c0 0x7f5110003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f51237fe700 1 -- 172.21.15.79:0/1432238200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51100506a0 con 0x7f51100045a0 2021-04-09T18:32:18.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5128839700 1 --2- 172.21.15.79:0/1432238200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51100097e0 0x7f511000bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:32:18.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f5128839700 1 -- 172.21.15.79:0/1432238200 reap_dead start 2021-04-09T18:32:18.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.728 7f51237fe700 1 --2- 172.21.15.79:0/1432238200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51100045a0 0x7f5110004a30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f510c00c000 tx=0x7f510c00e1d0).ready entity=mon.0 client_cookie=e78728e91704cdfa server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:18.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.732 7f5122ffd700 1 -- 172.21.15.79:0/1432238200 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f51100506a0 con 0x7f51100045a0 2021-04-09T18:32:18.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.732 7f5122ffd700 1 -- 172.21.15.79:0/1432238200 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c00ec90 con 0x7f51100045a0 2021-04-09T18:32:18.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.732 7f5122ffd700 1 -- 172.21.15.79:0/1432238200 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f510c00f040 con 0x7f51100045a0 2021-04-09T18:32:18.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.732 7f512a294700 1 -- 172.21.15.79:0/1432238200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51100045a0 msgr2=0x7f5110004a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:18.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.732 7f512a294700 1 --2- 172.21.15.79:0/1432238200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51100045a0 0x7f5110004a30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f510c00c000 tx=0x7f510c00e1d0).stop 2021-04-09T18:32:18.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.732 7f512a294700 1 -- 172.21.15.79:0/1432238200 shutdown_connections 2021-04-09T18:32:18.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.732 7f512a294700 1 --2- 172.21.15.79:0/1432238200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51100045a0 0x7f5110004a30 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.732 7f512a294700 1 -- 172.21.15.79:0/1432238200 >> 172.21.15.79:0/1432238200 conn(0x7f51240e6010 msgr2=0x7f51240e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:18.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.732 7f512a294700 1 -- 172.21.15.79:0/1432238200 shutdown_connections 2021-04-09T18:32:18.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.732 7f512a294700 1 -- 172.21.15.79:0/1432238200 wait complete. 2021-04-09T18:32:18.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.732 7f512a294700 1 Processor -- start 2021-04-09T18:32:18.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f512a294700 1 -- start start 2021-04-09T18:32:18.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f512a294700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51240c1670 0x7f51241af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:18.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f512a294700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51241af700 0x7f51240d4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:18.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f512a294700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51240d54c0 0x7f51240c3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:18.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f512a294700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51240e9f60 con 0x7f51241af700 2021-04-09T18:32:18.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f512a294700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51240b7c70 con 0x7f51240c1670 2021-04-09T18:32:18.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f512a294700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51241afb50 con 0x7f51240d54c0 2021-04-09T18:32:18.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f51237fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51241af700 0x7f51240d4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:18.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f51237fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51241af700 0x7f51240d4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59804/0 (socket says 172.21.15.79:59804) 2021-04-09T18:32:18.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f5128839700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51240d54c0 0x7f51240c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:18.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f51237fe700 1 -- 172.21.15.79:0/2752638499 learned_addr learned my addr 172.21.15.79:0/2752638499 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:18.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f5123fff700 1 --2- 172.21.15.79:0/2752638499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51240c1670 0x7f51241af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:18.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f51237fe700 1 -- 172.21.15.79:0/2752638499 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51240d54c0 msgr2=0x7f51240c3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:18.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f51237fe700 1 --2- 172.21.15.79:0/2752638499 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51240d54c0 0x7f51240c3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f51237fe700 1 -- 172.21.15.79:0/2752638499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51240c1670 msgr2=0x7f51241af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:18.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f51237fe700 1 --2- 172.21.15.79:0/2752638499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51240c1670 0x7f51241af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f51237fe700 1 -- 172.21.15.79:0/2752638499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51240d5910 con 0x7f51241af700 2021-04-09T18:32:18.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f51237fe700 1 --2- 172.21.15.79:0/2752638499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51241af700 0x7f51240d4e90 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f510c00c000 tx=0x7f510c00a040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:18.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f5120ff9700 1 -- 172.21.15.79:0/2752638499 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f51240d5910 con 0x7f51241af700 2021-04-09T18:32:18.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f5120ff9700 1 -- 172.21.15.79:0/2752638499 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c021030 con 0x7f51241af700 2021-04-09T18:32:18.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f512a294700 1 -- 172.21.15.79:0/2752638499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51240b7800 con 0x7f51241af700 2021-04-09T18:32:18.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f5120ff9700 1 -- 172.21.15.79:0/2752638499 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f510c01cb00 con 0x7f51241af700 2021-04-09T18:32:18.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f512a294700 1 -- 172.21.15.79:0/2752638499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51240c3c50 con 0x7f51241af700 2021-04-09T18:32:18.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f5120ff9700 1 -- 172.21.15.79:0/2752638499 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f510c023020 con 0x7f51241af700 2021-04-09T18:32:18.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f5120ff9700 1 --2- 172.21.15.79:0/2752638499 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5108029100 0x7f510802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:18.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f5120ff9700 1 -- 172.21.15.79:0/2752638499 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f510c010040 con 0x7f51241af700 2021-04-09T18:32:18.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.736 7f5123fff700 1 --2- 172.21.15.79:0/2752638499 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5108029100 0x7f510802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:18.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.740 7f5123fff700 1 --2- 172.21.15.79:0/2752638499 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5108029100 0x7f510802b650 crc :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:18.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.740 7f512a294700 1 -- 172.21.15.79:0/2752638499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51240e39f0 con 0x7f51241af700 2021-04-09T18:32:18.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.744 7f5120ff9700 1 -- 172.21.15.79:0/2752638499 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f510c00e890 con 0x7f51241af700 2021-04-09T18:32:18.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.900 7f512a294700 1 -- 172.21.15.79:0/2752638499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f51240f5b50 con 0x7f51241af700 2021-04-09T18:32:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.900 7f5120ff9700 1 -- 172.21.15.79:0/2752638499 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v69) v1 ==== 104+0+10 (secure 0 0 0) 0x7f510c01c4d0 con 0x7f51241af700 2021-04-09T18:32:18.905 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:32:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.904 7f512a294700 1 -- 172.21.15.79:0/2752638499 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5108029100 msgr2=0x7f510802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.904 7f512a294700 1 --2- 172.21.15.79:0/2752638499 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5108029100 0x7f510802b650 crc :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.904 7f512a294700 1 -- 172.21.15.79:0/2752638499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51241af700 msgr2=0x7f51240d4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.904 7f512a294700 1 --2- 172.21.15.79:0/2752638499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51241af700 0x7f51240d4e90 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f510c00c000 tx=0x7f510c00a040).stop 2021-04-09T18:32:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.904 7f512a294700 1 -- 172.21.15.79:0/2752638499 shutdown_connections 2021-04-09T18:32:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.904 7f512a294700 1 --2- 172.21.15.79:0/2752638499 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5108029100 0x7f510802b650 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.904 7f512a294700 1 --2- 172.21.15.79:0/2752638499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51240c1670 0x7f51241af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.904 7f512a294700 1 --2- 172.21.15.79:0/2752638499 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51240d54c0 0x7f51240c3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.904 7f512a294700 1 --2- 172.21.15.79:0/2752638499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51241af700 0x7f51240d4e90 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:18.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.904 7f512a294700 1 -- 172.21.15.79:0/2752638499 >> 172.21.15.79:0/2752638499 conn(0x7f512409ae10 msgr2=0x7f51240d82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:18.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.904 7f512a294700 1 -- 172.21.15.79:0/2752638499 shutdown_connections 2021-04-09T18:32:18.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:18.904 7f512a294700 1 -- 172.21.15.79:0/2752638499 wait complete. 2021-04-09T18:32:18.918 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:32:19.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.024 7f9ee8116700 1 Processor -- start 2021-04-09T18:32:19.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.024 7f9ee8116700 1 -- start start 2021-04-09T18:32:19.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.024 7f9ee8116700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9ee01c9050 0x7f9ee01cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:19.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.024 7f9ee8116700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee00fbb50 con 0x7f9ee00e9b10 2021-04-09T18:32:19.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.024 7f9ee8116700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee009f910 con 0x7f9ee00f5550 2021-04-09T18:32:19.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.024 7f9ee8116700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee01c3df0 con 0x7f9ee01c9050 2021-04-09T18:32:19.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.024 7f9ee66bb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9ee01c9050 0x7f9ee01cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:19.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.024 7f9ee66bb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9ee01c9050 0x7f9ee01cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59812/0 (socket says 172.21.15.79:59812) 2021-04-09T18:32:19.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.024 7f9ee66bb700 1 -- 172.21.15.79:0/2402786761 learned_addr learned my addr 172.21.15.79:0/2402786761 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:19.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.024 7f9ee56b9700 1 --1- 172.21.15.79:0/2402786761 >> v1:172.21.15.79:6789/0 conn(0x7f9ee00e9b10 0x7f9ee009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54520/0 (socket says 172.21.15.79:54520) 2021-04-09T18:32:19.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.024 7f9ee66bb700 1 -- 172.21.15.79:0/2402786761 >> v1:172.21.15.89:6789/0 conn(0x7f9ee00f5550 legacy=0x7f9ee00f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:19.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.024 7f9ee66bb700 1 -- 172.21.15.79:0/2402786761 >> v1:172.21.15.79:6789/0 conn(0x7f9ee00e9b10 legacy=0x7f9ee009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:19.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.024 7f9ee66bb700 1 -- 172.21.15.79:0/2402786761 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee00e5700 con 0x7f9ee01c9050 2021-04-09T18:32:19.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.024 7f9ee66bb700 1 --2- 172.21.15.79:0/2402786761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ee01c9050 0x7f9ee01cb4b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f9ed8002f30 tx=0x7f9ed800bd20).ready entity=mon.0 client_cookie=5e45457f3297bca7 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:19.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.024 7f9ee4eb8700 1 -- 172.21.15.79:0/2402786761 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9ee00e5700 con 0x7f9ee01c9050 2021-04-09T18:32:19.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.024 7f9ee4eb8700 1 -- 172.21.15.79:0/2402786761 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed8009a20 con 0x7f9ee01c9050 2021-04-09T18:32:19.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.024 7f9ee4eb8700 1 -- 172.21.15.79:0/2402786761 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9ed8009df0 con 0x7f9ee01c9050 2021-04-09T18:32:19.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.024 7f9ee8116700 1 -- 172.21.15.79:0/2402786761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ee01c9050 msgr2=0x7f9ee01cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:19.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.024 7f9ee8116700 1 --2- 172.21.15.79:0/2402786761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ee01c9050 0x7f9ee01cb4b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f9ed8002f30 tx=0x7f9ed800bd20).stop 2021-04-09T18:32:19.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.028 7f9ee8116700 1 -- 172.21.15.79:0/2402786761 shutdown_connections 2021-04-09T18:32:19.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.028 7f9ee8116700 1 --2- 172.21.15.79:0/2402786761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ee01c9050 0x7f9ee01cb4b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:19.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.028 7f9ee8116700 1 -- 172.21.15.79:0/2402786761 >> 172.21.15.79:0/2402786761 conn(0x7f9ee00e6010 msgr2=0x7f9ee00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:19.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.028 7f9ee8116700 1 -- 172.21.15.79:0/2402786761 shutdown_connections 2021-04-09T18:32:19.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.028 7f9ee8116700 1 -- 172.21.15.79:0/2402786761 wait complete. 2021-04-09T18:32:19.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.028 7f9ee8116700 1 Processor -- start 2021-04-09T18:32:19.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.028 7f9ee8116700 1 -- start start 2021-04-09T18:32:19.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.028 7f9ee8116700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ee01d3b60 0x7f9ee00adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:19.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.028 7f9ee8116700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ee01cfa90 0x7f9ee01cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:19.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.028 7f9ee8116700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee00a8630 0x7f9ee00a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:19.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.028 7f9ee8116700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee00e9f60 con 0x7f9ee01cfa90 2021-04-09T18:32:19.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.028 7f9ee8116700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee00af1a0 con 0x7f9ee00a8630 2021-04-09T18:32:19.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.028 7f9ee8116700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee00af4a0 con 0x7f9ee01d3b60 2021-04-09T18:32:19.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.032 7f9ee56b9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ee01cfa90 0x7f9ee01cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:19.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.032 7f9ee56b9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ee01cfa90 0x7f9ee01cfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59816/0 (socket says 172.21.15.79:59816) 2021-04-09T18:32:19.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.032 7f9ee56b9700 1 -- 172.21.15.79:0/3053996726 learned_addr learned my addr 172.21.15.79:0/3053996726 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:19.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.032 7f9ee66bb700 1 --2- 172.21.15.79:0/3053996726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee00a8630 0x7f9ee00a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:19.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.032 7f9ee5eba700 1 --2- 172.21.15.79:0/3053996726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ee01d3b60 0x7f9ee00adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:19.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.032 7f9ee56b9700 1 -- 172.21.15.79:0/3053996726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ee01d3b60 msgr2=0x7f9ee00adc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:19.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.032 7f9ee56b9700 1 --2- 172.21.15.79:0/3053996726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ee01d3b60 0x7f9ee00adc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:19.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.032 7f9ee56b9700 1 -- 172.21.15.79:0/3053996726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee00a8630 msgr2=0x7f9ee00a8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:19.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.032 7f9ee56b9700 1 --2- 172.21.15.79:0/3053996726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee00a8630 0x7f9ee00a8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:19.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.032 7f9ee56b9700 1 -- 172.21.15.79:0/3053996726 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee00ae260 con 0x7f9ee01cfa90 2021-04-09T18:32:19.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.032 7f9ee56b9700 1 --2- 172.21.15.79:0/3053996726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ee01cfa90 0x7f9ee01cfee0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f9ed4001210 tx=0x7f9ed400cde0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:19.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.032 7f9ed27fc700 1 -- 172.21.15.79:0/3053996726 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9ee00ae260 con 0x7f9ee01cfa90 2021-04-09T18:32:19.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.032 7f9ed27fc700 1 -- 172.21.15.79:0/3053996726 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed4005b90 con 0x7f9ee01cfa90 2021-04-09T18:32:19.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.032 7f9ee8116700 1 -- 172.21.15.79:0/3053996726 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee00aed30 con 0x7f9ee01cfa90 2021-04-09T18:32:19.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.032 7f9ed27fc700 1 -- 172.21.15.79:0/3053996726 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9ed4007110 con 0x7f9ee01cfa90 2021-04-09T18:32:19.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.032 7f9ee8116700 1 -- 172.21.15.79:0/3053996726 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee00b0a20 con 0x7f9ee01cfa90 2021-04-09T18:32:19.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.032 7f9ed27fc700 1 -- 172.21.15.79:0/3053996726 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9ed401a020 con 0x7f9ee01cfa90 2021-04-09T18:32:19.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.032 7f9ed27fc700 1 --2- 172.21.15.79:0/3053996726 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9ec8029100 0x7f9ec802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:19.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.032 7f9ed27fc700 1 -- 172.21.15.79:0/3053996726 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f9ed4039600 con 0x7f9ee01cfa90 2021-04-09T18:32:19.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.032 7f9ee5eba700 1 --2- 172.21.15.79:0/3053996726 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9ec8029100 0x7f9ec802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:19.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.036 7f9ee5eba700 1 --2- 172.21.15.79:0/3053996726 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9ec8029100 0x7f9ec802b650 crc :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:19.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.040 7f9ee8116700 1 -- 172.21.15.79:0/3053996726 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee00e39f0 con 0x7f9ee01cfa90 2021-04-09T18:32:19.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.048 7f9ed27fc700 1 -- 172.21.15.79:0/3053996726 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9ee00e5cd0 con 0x7f9ee01cfa90 2021-04-09T18:32:19.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.208 7f9ee8116700 1 -- 172.21.15.79:0/3053996726 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f9ee00a1c90 con 0x7f9ee01cfa90 2021-04-09T18:32:19.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.212 7f9ed27fc700 1 -- 172.21.15.79:0/3053996726 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v69) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9ed4005980 con 0x7f9ee01cfa90 2021-04-09T18:32:19.214 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:32:19.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.212 7f9ee8116700 1 -- 172.21.15.79:0/3053996726 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9ec8029100 msgr2=0x7f9ec802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:19.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.212 7f9ee8116700 1 --2- 172.21.15.79:0/3053996726 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9ec8029100 0x7f9ec802b650 crc :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:19.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.212 7f9ee8116700 1 -- 172.21.15.79:0/3053996726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ee01cfa90 msgr2=0x7f9ee01cfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:19.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.212 7f9ee8116700 1 --2- 172.21.15.79:0/3053996726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ee01cfa90 0x7f9ee01cfee0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f9ed4001210 tx=0x7f9ed400cde0).stop 2021-04-09T18:32:19.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.212 7f9ee8116700 1 -- 172.21.15.79:0/3053996726 shutdown_connections 2021-04-09T18:32:19.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.212 7f9ee8116700 1 --2- 172.21.15.79:0/3053996726 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9ec8029100 0x7f9ec802b650 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:19.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.212 7f9ee8116700 1 --2- 172.21.15.79:0/3053996726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee00a8630 0x7f9ee00a8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:19.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.212 7f9ee8116700 1 --2- 172.21.15.79:0/3053996726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ee01d3b60 0x7f9ee00adc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:19.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.212 7f9ee8116700 1 --2- 172.21.15.79:0/3053996726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ee01cfa90 0x7f9ee01cfee0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:19.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.212 7f9ee8116700 1 -- 172.21.15.79:0/3053996726 >> 172.21.15.79:0/3053996726 conn(0x7f9ee00ba470 msgr2=0x7f9ee00974f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:19.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.212 7f9ee8116700 1 -- 172.21.15.79:0/3053996726 shutdown_connections 2021-04-09T18:32:19.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.212 7f9ee8116700 1 -- 172.21.15.79:0/3053996726 wait complete. 2021-04-09T18:32:19.226 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:32:19.226 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:32:19.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff397eed700 1 Processor -- start 2021-04-09T18:32:19.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff397eed700 1 -- start start 2021-04-09T18:32:19.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff397eed700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff3900f5510 0x7ff3900f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:19.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff397eed700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff3900e9ad0 0x7ff39009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:19.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff397eed700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3901c2da0 0x7ff3901c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:19.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff397eed700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3900e9f20 con 0x7ff3900f5510 2021-04-09T18:32:19.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff397eed700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3900e59c0 con 0x7ff3900e9ad0 2021-04-09T18:32:19.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff397eed700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3900fbb10 con 0x7ff3901c2da0 2021-04-09T18:32:19.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff395c91700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff3900f5510 0x7ff3900f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:19.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff395c91700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff3900f5510 0x7ff3900f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59822/0 (socket says 172.21.15.79:59822) 2021-04-09T18:32:19.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff395c91700 1 -- 172.21.15.79:0/256710014 learned_addr learned my addr 172.21.15.79:0/256710014 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:19.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff396492700 1 --2- 172.21.15.79:0/256710014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3901c2da0 0x7ff3901c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:19.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff395490700 1 --2- 172.21.15.79:0/256710014 >> v2:172.21.15.89:3300/0 conn(0x7ff3900e9ad0 0x7ff39009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:19.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff395c91700 1 -- 172.21.15.79:0/256710014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3901c2da0 msgr2=0x7ff3901c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:19.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff395c91700 1 --2- 172.21.15.79:0/256710014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3901c2da0 0x7ff3901c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:19.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff395c91700 1 -- 172.21.15.79:0/256710014 >> v2:172.21.15.89:3300/0 conn(0x7ff3900e9ad0 msgr2=0x7ff39009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:19.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff395c91700 1 --2- 172.21.15.79:0/256710014 >> v2:172.21.15.89:3300/0 conn(0x7ff3900e9ad0 0x7ff39009f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:19.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff395c91700 1 -- 172.21.15.79:0/256710014 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3900e56c0 con 0x7ff3900f5510 2021-04-09T18:32:19.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff395c91700 1 --2- 172.21.15.79:0/256710014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3900f5510 0x7ff3900f64a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7ff390125430 tx=0x7ff38c00bda0).ready entity=mon.0 client_cookie=67277e0906eabba8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:19.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff394c8f700 1 -- 172.21.15.79:0/256710014 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff3900e56c0 con 0x7ff3900f5510 2021-04-09T18:32:19.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff394c8f700 1 -- 172.21.15.79:0/256710014 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c009940 con 0x7ff3900f5510 2021-04-09T18:32:19.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff394c8f700 1 -- 172.21.15.79:0/256710014 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff38c009d10 con 0x7ff3900f5510 2021-04-09T18:32:19.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff397eed700 1 -- 172.21.15.79:0/256710014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3900f5510 msgr2=0x7ff3900f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:19.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.316 7ff397eed700 1 --2- 172.21.15.79:0/256710014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3900f5510 0x7ff3900f64a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7ff390125430 tx=0x7ff38c00bda0).stop 2021-04-09T18:32:19.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.320 7ff397eed700 1 -- 172.21.15.79:0/256710014 shutdown_connections 2021-04-09T18:32:19.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.320 7ff397eed700 1 --2- 172.21.15.79:0/256710014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3901c2da0 0x7ff3901c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:19.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.320 7ff397eed700 1 --2- 172.21.15.79:0/256710014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3900f5510 0x7ff3900f64a0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:19.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.320 7ff397eed700 1 --2- 172.21.15.79:0/256710014 >> v2:172.21.15.89:3300/0 conn(0x7ff3900e9ad0 0x7ff39009f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:19.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.320 7ff397eed700 1 -- 172.21.15.79:0/256710014 >> 172.21.15.79:0/256710014 conn(0x7ff3900e5fd0 msgr2=0x7ff3900e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:19.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.320 7ff397eed700 1 -- 172.21.15.79:0/256710014 shutdown_connections 2021-04-09T18:32:19.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.320 7ff397eed700 1 -- 172.21.15.79:0/256710014 wait complete. 2021-04-09T18:32:19.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff397eed700 1 Processor -- start 2021-04-09T18:32:19.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff397eed700 1 -- start start 2021-04-09T18:32:19.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff397eed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3901a16a0 0x7ff3900bae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:19.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff397eed700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff390097540 0x7ff3900c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:19.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff397eed700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff39019dbe0 0x7ff3900c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:19.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff397eed700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3900e1ac0 con 0x7ff3901a16a0 2021-04-09T18:32:19.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff397eed700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff390097e40 con 0x7ff390097540 2021-04-09T18:32:19.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff397eed700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff390098140 con 0x7ff39019dbe0 2021-04-09T18:32:19.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff395c91700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3901a16a0 0x7ff3900bae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:19.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff395c91700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3901a16a0 0x7ff3900bae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59828/0 (socket says 172.21.15.79:59828) 2021-04-09T18:32:19.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff395c91700 1 -- 172.21.15.79:0/2326919154 learned_addr learned my addr 172.21.15.79:0/2326919154 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:19.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff396492700 1 --2- 172.21.15.79:0/2326919154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff39019dbe0 0x7ff3900c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:19.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff395490700 1 --2- 172.21.15.79:0/2326919154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff390097540 0x7ff3900c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:19.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff395c91700 1 -- 172.21.15.79:0/2326919154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff39019dbe0 msgr2=0x7ff3900c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:19.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff395c91700 1 --2- 172.21.15.79:0/2326919154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff39019dbe0 0x7ff3900c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:19.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff395c91700 1 -- 172.21.15.79:0/2326919154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff390097540 msgr2=0x7ff3900c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:19.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff395c91700 1 --2- 172.21.15.79:0/2326919154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff390097540 0x7ff3900c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:19.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff395c91700 1 -- 172.21.15.79:0/2326919154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff390097990 con 0x7ff3901a16a0 2021-04-09T18:32:19.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff395c91700 1 --2- 172.21.15.79:0/2326919154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3901a16a0 0x7ff3900bae90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7ff390125430 tx=0x7ff38c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:19.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff3867fc700 1 -- 172.21.15.79:0/2326919154 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff390097990 con 0x7ff3901a16a0 2021-04-09T18:32:19.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff3867fc700 1 -- 172.21.15.79:0/2326919154 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c011d20 con 0x7ff3901a16a0 2021-04-09T18:32:19.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff397eed700 1 -- 172.21.15.79:0/2326919154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39019e030 con 0x7ff3901a16a0 2021-04-09T18:32:19.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff3867fc700 1 -- 172.21.15.79:0/2326919154 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff38c022070 con 0x7ff3901a16a0 2021-04-09T18:32:19.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.324 7ff397eed700 1 -- 172.21.15.79:0/2326919154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3900c1d50 con 0x7ff3901a16a0 2021-04-09T18:32:19.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.328 7ff3867fc700 1 -- 172.21.15.79:0/2326919154 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff38c026410 con 0x7ff3901a16a0 2021-04-09T18:32:19.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.328 7ff3867fc700 1 --2- 172.21.15.79:0/2326919154 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff378029100 0x7ff37802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:19.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.328 7ff3867fc700 1 -- 172.21.15.79:0/2326919154 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7ff38c03bea0 con 0x7ff3901a16a0 2021-04-09T18:32:19.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.328 7ff395490700 1 --2- 172.21.15.79:0/2326919154 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff378029100 0x7ff37802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:19.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.328 7ff395490700 1 --2- 172.21.15.79:0/2326919154 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff378029100 0x7ff37802b650 crc :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:19.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.328 7ff397eed700 1 -- 172.21.15.79:0/2326919154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3900e39d0 con 0x7ff3901a16a0 2021-04-09T18:32:19.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.336 7ff3867fc700 1 -- 172.21.15.79:0/2326919154 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff38c009730 con 0x7ff3901a16a0 2021-04-09T18:32:19.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.500 7ff397eed700 1 -- 172.21.15.79:0/2326919154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3900f5b10 con 0x7ff3901a16a0 2021-04-09T18:32:19.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.500 7ff3867fc700 1 -- 172.21.15.79:0/2326919154 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+2104 (secure 0 0 0) 0x7ff38c011b10 con 0x7ff3901a16a0 2021-04-09T18:32:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:32:19.507 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6153,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1203679879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1203679879},{"type":"v1","addr":"172.21.15.89:6835","nonce":1203679879}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":38}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:32:14.903910","modified":"2021-04-09 18:32:16.914763","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/1131782053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1131782053},{"type":"v1","addr":"172.21.15.79:6833","nonce":1131782053}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-04-09T18:32:19.508 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 40 2021-04-09T18:32:19.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.504 7ff397eed700 1 -- 172.21.15.79:0/2326919154 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff378029100 msgr2=0x7ff37802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:19.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.504 7ff397eed700 1 --2- 172.21.15.79:0/2326919154 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff378029100 0x7ff37802b650 crc :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:19.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.504 7ff397eed700 1 -- 172.21.15.79:0/2326919154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3901a16a0 msgr2=0x7ff3900bae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:19.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.504 7ff397eed700 1 --2- 172.21.15.79:0/2326919154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3901a16a0 0x7ff3900bae90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7ff390125430 tx=0x7ff38c006890).stop 2021-04-09T18:32:19.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.504 7ff397eed700 1 -- 172.21.15.79:0/2326919154 shutdown_connections 2021-04-09T18:32:19.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.504 7ff397eed700 1 --2- 172.21.15.79:0/2326919154 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff378029100 0x7ff37802b650 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:19.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.504 7ff397eed700 1 --2- 172.21.15.79:0/2326919154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff39019dbe0 0x7ff3900c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:19.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.504 7ff397eed700 1 --2- 172.21.15.79:0/2326919154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3901a16a0 0x7ff3900bae90 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:19.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.504 7ff397eed700 1 --2- 172.21.15.79:0/2326919154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff390097540 0x7ff3900c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:19.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.504 7ff397eed700 1 -- 172.21.15.79:0/2326919154 >> 172.21.15.79:0/2326919154 conn(0x7ff3900a7040 msgr2=0x7ff3900d80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:19.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.508 7ff397eed700 1 -- 172.21.15.79:0/2326919154 shutdown_connections 2021-04-09T18:32:19.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:19.508 7ff397eed700 1 -- 172.21.15.79:0/2326919154 wait complete. 2021-04-09T18:32:19.727 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:32:14.903910', 'modified': '2021-04-09 18:32:16.914763', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 69, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6150}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6150': {'gid': 6150, 'name': 'a', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6833/1131782053', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 1131782053}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 1131782053}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:32:19.728 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:32:19.729 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2021-04-09T18:32:19.823 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:32:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:32:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2021-04-09T18:32:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 6150, 2021-04-09T18:32:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2021-04-09T18:32:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2021-04-09T18:32:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 3.9064922210000002, 2021-04-09T18:32:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 40, 2021-04-09T18:32:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 69, 2021-04-09T18:32:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 69, 2021-04-09T18:32:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 8.9232695999999994 2021-04-09T18:32:19.825 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:32:19.830 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 6150, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.9064922210000002, "mdsmap_epoch": 40, "osdmap_epoch": 69, "osdmap_epoch_barrier": 69, "uptime": 8.9232695999999994 } 2021-04-09T18:32:19.831 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:32:19.831 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-04-09T18:32:19.832 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi090.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-04-09T18:32:19.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:19.833 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:32:19.842 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:32:19.899 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:32:19.900 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:32:19.954 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:32:19.955 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:32:19.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:19.957 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:32:20.006 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:32:20.006 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:32:20.050 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:32:20.066 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:32:20.067 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:32:20.123 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:32:20.124 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:32:20.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:20.125 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:32:20.126 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:2021-04-09 18:32:20.119 7fde90fc00c0 -1 init, newargv = 0x558aed62b540 newargc=9 2021-04-09T18:32:20.126 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13618]: starting ceph client 2021-04-09T18:32:20.133 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13618]: starting fuse 2021-04-09T18:32:20.140 INFO:teuthology.orchestra.run.smithi090.stdout:49 2021-04-09T18:32:20.140 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:32:20.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:20.141 DEBUG:teuthology.orchestra.run.smithi090:> sudo python3 -c ' 2021-04-09T18:32:20.142 DEBUG:teuthology.orchestra.run.smithi090:> import glob 2021-04-09T18:32:20.142 DEBUG:teuthology.orchestra.run.smithi090:> import re 2021-04-09T18:32:20.143 DEBUG:teuthology.orchestra.run.smithi090:> import os 2021-04-09T18:32:20.143 DEBUG:teuthology.orchestra.run.smithi090:> import subprocess 2021-04-09T18:32:20.144 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:32:20.144 DEBUG:teuthology.orchestra.run.smithi090:> def find_socket(client_name): 2021-04-09T18:32:20.145 DEBUG:teuthology.orchestra.run.smithi090:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-04-09T18:32:20.145 DEBUG:teuthology.orchestra.run.smithi090:> files = glob.glob(asok_path) 2021-04-09T18:32:20.145 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:32:20.146 DEBUG:teuthology.orchestra.run.smithi090:> # Given a non-glob path, it better be there 2021-04-09T18:32:20.146 DEBUG:teuthology.orchestra.run.smithi090:> if "*" not in asok_path: 2021-04-09T18:32:20.147 DEBUG:teuthology.orchestra.run.smithi090:> assert(len(files) == 1) 2021-04-09T18:32:20.147 DEBUG:teuthology.orchestra.run.smithi090:> return files[0] 2021-04-09T18:32:20.148 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:32:20.148 DEBUG:teuthology.orchestra.run.smithi090:> for f in files: 2021-04-09T18:32:20.148 DEBUG:teuthology.orchestra.run.smithi090:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:32:20.149 DEBUG:teuthology.orchestra.run.smithi090:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:32:20.149 DEBUG:teuthology.orchestra.run.smithi090:> return f 2021-04-09T18:32:20.149 DEBUG:teuthology.orchestra.run.smithi090:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:32:20.150 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:32:20.150 DEBUG:teuthology.orchestra.run.smithi090:> print(find_socket("client.0")) 2021-04-09T18:32:20.151 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:32:20.228 INFO:teuthology.orchestra.run.smithi090.stdout:/var/run/ceph/ceph-client.0.13618.asok 2021-04-09T18:32:20.232 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13618.asok 2021-04-09T18:32:20.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:20.233 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13618.asok status 2021-04-09T18:32:20.366 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2021-04-09T18:32:20.366 INFO:teuthology.orchestra.run.smithi090.stdout: "metadata": { 2021-04-09T18:32:20.367 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:32:20.367 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:32:20.367 INFO:teuthology.orchestra.run.smithi090.stdout: "entity_id": "0", 2021-04-09T18:32:20.367 INFO:teuthology.orchestra.run.smithi090.stdout: "hostname": "smithi090", 2021-04-09T18:32:20.368 INFO:teuthology.orchestra.run.smithi090.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-04-09T18:32:20.368 INFO:teuthology.orchestra.run.smithi090.stdout: "pid": "13618", 2021-04-09T18:32:20.368 INFO:teuthology.orchestra.run.smithi090.stdout: "root": "/" 2021-04-09T18:32:20.368 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:32:20.368 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_count": 0, 2021-04-09T18:32:20.369 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_pinned_count": 0, 2021-04-09T18:32:20.369 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 6309, 2021-04-09T18:32:20.369 INFO:teuthology.orchestra.run.smithi090.stdout: "inst": { 2021-04-09T18:32:20.369 INFO:teuthology.orchestra.run.smithi090.stdout: "name": { 2021-04-09T18:32:20.370 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "client", 2021-04-09T18:32:20.370 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6309 2021-04-09T18:32:20.370 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:32:20.370 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:32:20.370 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:32:20.371 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:32:20.371 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 30006489 2021-04-09T18:32:20.371 INFO:teuthology.orchestra.run.smithi090.stdout: } 2021-04-09T18:32:20.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:32:20.371 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:32:20.372 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:32:20.372 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:32:20.372 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 30006489 2021-04-09T18:32:20.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:32:20.373 INFO:teuthology.orchestra.run.smithi090.stdout: "inst_str": "client.6309 172.21.15.90:0/30006489", 2021-04-09T18:32:20.373 INFO:teuthology.orchestra.run.smithi090.stdout: "addr_str": "172.21.15.90:0/30006489", 2021-04-09T18:32:20.373 INFO:teuthology.orchestra.run.smithi090.stdout: "inode_count": 1, 2021-04-09T18:32:20.373 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_epoch": 40, 2021-04-09T18:32:20.373 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch": 69, 2021-04-09T18:32:20.374 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:32:20.374 INFO:teuthology.orchestra.run.smithi090.stdout: "blacklisted": false, 2021-04-09T18:32:20.374 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs" 2021-04-09T18:32:20.374 INFO:teuthology.orchestra.run.smithi090.stdout:} 2021-04-09T18:32:20.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:20.376 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:32:20.376 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:32:20.384 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:32:20.385 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:32:20.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:20.386 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:32:20.446 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:32:20.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fddb6f97700 1 Processor -- start 2021-04-09T18:32:20.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fddb6f97700 1 -- start start 2021-04-09T18:32:20.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fddb6f97700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddb00e9ae0 0x7fddb009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:20.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fddb6f97700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fddb01c8010 0x7fddb01ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:20.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fddb6f97700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb00fbb20 con 0x7fddb00f5520 2021-04-09T18:32:20.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fddb6f97700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb01c3dc0 con 0x7fddb01c8010 2021-04-09T18:32:20.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fddb6f97700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb00e9f30 con 0x7fddb00e9ae0 2021-04-09T18:32:20.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fddb4d3b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fddb00f5520 0x7fddb00f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54544/0 (socket says 172.21.15.79:54544) 2021-04-09T18:32:20.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fddb4d3b700 1 -- 172.21.15.79:0/2854300328 learned_addr learned my addr 172.21.15.79:0/2854300328 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:20.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fddb553c700 1 --2- 172.21.15.79:0/2854300328 >> v2:172.21.15.89:3300/0 conn(0x7fddb01c8010 0x7fddb01ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:20.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fdda7fff700 1 --2- 172.21.15.79:0/2854300328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddb00e9ae0 0x7fddb009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:20.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fdda77fe700 1 -- 172.21.15.79:0/2854300328 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421645653 0 0) 0x7fddac0010d0 con 0x7fddb00f5520 2021-04-09T18:32:20.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fddb553c700 1 -- 172.21.15.79:0/2854300328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddb00e9ae0 msgr2=0x7fddb009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:20.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fddb553c700 1 --2- 172.21.15.79:0/2854300328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddb00e9ae0 0x7fddb009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:20.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fddb553c700 1 -- 172.21.15.79:0/2854300328 >> v1:172.21.15.79:6789/0 conn(0x7fddb00f5520 legacy=0x7fddb00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:20.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fddb553c700 1 -- 172.21.15.79:0/2854300328 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb00e56d0 con 0x7fddb01c8010 2021-04-09T18:32:20.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fddb553c700 1 --2- 172.21.15.79:0/2854300328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddb01c8010 0x7fddb01ca470 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fdda80032b0 tx=0x7fdda800b3c0).ready entity=mon.1 client_cookie=5206b88da6631c23 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:20.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fdda77fe700 1 -- 172.21.15.79:0/2854300328 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fddb00e56d0 con 0x7fddb01c8010 2021-04-09T18:32:20.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fdda77fe700 1 -- 172.21.15.79:0/2854300328 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda800bc20 con 0x7fddb01c8010 2021-04-09T18:32:20.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fdda77fe700 1 -- 172.21.15.79:0/2854300328 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdda8002020 con 0x7fddb01c8010 2021-04-09T18:32:20.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fddb6f97700 1 -- 172.21.15.79:0/2854300328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddb01c8010 msgr2=0x7fddb01ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:20.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.540 7fddb6f97700 1 --2- 172.21.15.79:0/2854300328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddb01c8010 0x7fddb01ca470 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fdda80032b0 tx=0x7fdda800b3c0).stop 2021-04-09T18:32:20.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.544 7fddb6f97700 1 -- 172.21.15.79:0/2854300328 shutdown_connections 2021-04-09T18:32:20.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.544 7fddb6f97700 1 --2- 172.21.15.79:0/2854300328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddb01c8010 0x7fddb01ca470 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:20.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.544 7fddb6f97700 1 --2- 172.21.15.79:0/2854300328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddb00e9ae0 0x7fddb009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:20.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.544 7fddb6f97700 1 -- 172.21.15.79:0/2854300328 >> 172.21.15.79:0/2854300328 conn(0x7fddb00e5fe0 msgr2=0x7fddb00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:20.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.544 7fddb6f97700 1 -- 172.21.15.79:0/2854300328 shutdown_connections 2021-04-09T18:32:20.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.544 7fddb6f97700 1 -- 172.21.15.79:0/2854300328 wait complete. 2021-04-09T18:32:20.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fddb6f97700 1 Processor -- start 2021-04-09T18:32:20.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fddb6f97700 1 -- start start 2021-04-09T18:32:20.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fddb6f97700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddb01a8480 0x7fddb00998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:20.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fddb6f97700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddb00d69b0 0x7fddb00912f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:20.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fddb6f97700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddb0091920 0x7fddb00ce760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:20.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fddb6f97700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb00e8af0 con 0x7fddb0091920 2021-04-09T18:32:20.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fddb6f97700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb00d66e0 con 0x7fddb01a8480 2021-04-09T18:32:20.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fddb6f97700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb00d5140 con 0x7fddb00d69b0 2021-04-09T18:32:20.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fddb553c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddb0091920 0x7fddb00ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:20.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fddb553c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddb0091920 0x7fddb00ce760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59844/0 (socket says 172.21.15.79:59844) 2021-04-09T18:32:20.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fddb553c700 1 -- 172.21.15.79:0/1358860799 learned_addr learned my addr 172.21.15.79:0/1358860799 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:20.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fdda7fff700 1 --2- 172.21.15.79:0/1358860799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddb00d69b0 0x7fddb00912f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:20.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fddb4d3b700 1 --2- 172.21.15.79:0/1358860799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddb01a8480 0x7fddb00998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:20.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fddb553c700 1 -- 172.21.15.79:0/1358860799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddb00d69b0 msgr2=0x7fddb00912f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:20.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fddb553c700 1 --2- 172.21.15.79:0/1358860799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddb00d69b0 0x7fddb00912f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:20.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fddb553c700 1 -- 172.21.15.79:0/1358860799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddb01a8480 msgr2=0x7fddb00998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:20.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fddb553c700 1 --2- 172.21.15.79:0/1358860799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddb01a8480 0x7fddb00998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:20.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fddb553c700 1 -- 172.21.15.79:0/1358860799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb009a3c0 con 0x7fddb0091920 2021-04-09T18:32:20.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fddb553c700 1 --2- 172.21.15.79:0/1358860799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddb0091920 0x7fddb00ce760 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fddb0093510 tx=0x7fdda8006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:20.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fdda57fa700 1 -- 172.21.15.79:0/1358860799 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fddb009a3c0 con 0x7fddb0091920 2021-04-09T18:32:20.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fdda57fa700 1 -- 172.21.15.79:0/1358860799 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda801f020 con 0x7fddb0091920 2021-04-09T18:32:20.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fddb6f97700 1 -- 172.21.15.79:0/1358860799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb009a780 con 0x7fddb0091920 2021-04-09T18:32:20.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fdda57fa700 1 -- 172.21.15.79:0/1358860799 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdda801b830 con 0x7fddb0091920 2021-04-09T18:32:20.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.548 7fddb6f97700 1 -- 172.21.15.79:0/1358860799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb00ced90 con 0x7fddb0091920 2021-04-09T18:32:20.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.552 7fdda57fa700 1 -- 172.21.15.79:0/1358860799 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fdda800b0e0 con 0x7fddb0091920 2021-04-09T18:32:20.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.552 7fdda57fa700 1 --2- 172.21.15.79:0/1358860799 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdd90029100 0x7fdd9002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:20.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.552 7fdda57fa700 1 -- 172.21.15.79:0/1358860799 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fdda803bcc0 con 0x7fddb0091920 2021-04-09T18:32:20.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.552 7fddb6f97700 1 -- 172.21.15.79:0/1358860799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb01a6110 con 0x7fddb0091920 2021-04-09T18:32:20.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.552 7fddb4d3b700 1 --2- 172.21.15.79:0/1358860799 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdd90029100 0x7fdd9002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:20.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.552 7fddb4d3b700 1 --2- 172.21.15.79:0/1358860799 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdd90029100 0x7fdd9002b650 crc :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:20.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.560 7fdda57fa700 1 -- 172.21.15.79:0/1358860799 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fddb00f76c0 con 0x7fddb0091920 2021-04-09T18:32:20.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.728 7fddb6f97700 1 -- 172.21.15.79:0/1358860799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fddb00e39e0 con 0x7fddb0091920 2021-04-09T18:32:20.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.728 7fdda57fa700 1 -- 172.21.15.79:0/1358860799 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+14348 (secure 0 0 0) 0x7fdda801b430 con 0x7fddb0091920 2021-04-09T18:32:20.734 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:32:20.735 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":69,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:32:14.953152","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:32:13.133609","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2021-04-09 18:32:13.943877","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6835/2729581928":"2021-04-10 18:32:14.953106","172.21.15.89:6834/2729581928":"2021-04-10 18:32:14.953106"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:32:20.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.732 7fddb6f97700 1 -- 172.21.15.79:0/1358860799 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdd90029100 msgr2=0x7fdd9002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:20.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.732 7fddb6f97700 1 --2- 172.21.15.79:0/1358860799 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdd90029100 0x7fdd9002b650 crc :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:20.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.732 7fddb6f97700 1 -- 172.21.15.79:0/1358860799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddb0091920 msgr2=0x7fddb00ce760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:20.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.732 7fddb6f97700 1 --2- 172.21.15.79:0/1358860799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddb0091920 0x7fddb00ce760 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fddb0093510 tx=0x7fdda8006c10).stop 2021-04-09T18:32:20.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.732 7fddb6f97700 1 -- 172.21.15.79:0/1358860799 shutdown_connections 2021-04-09T18:32:20.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.732 7fddb6f97700 1 --2- 172.21.15.79:0/1358860799 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdd90029100 0x7fdd9002b650 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:20.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.732 7fddb6f97700 1 --2- 172.21.15.79:0/1358860799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddb01a8480 0x7fddb00998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:20.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.732 7fddb6f97700 1 --2- 172.21.15.79:0/1358860799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddb0091920 0x7fddb00ce760 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:20.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.732 7fddb6f97700 1 --2- 172.21.15.79:0/1358860799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddb00d69b0 0x7fddb00912f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:20.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.732 7fddb6f97700 1 -- 172.21.15.79:0/1358860799 >> 172.21.15.79:0/1358860799 conn(0x7fddb0093550 msgr2=0x7fddb00d8060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:20.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.732 7fddb6f97700 1 -- 172.21.15.79:0/1358860799 shutdown_connections 2021-04-09T18:32:20.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.732 7fddb6f97700 1 -- 172.21.15.79:0/1358860799 wait complete. 2021-04-09T18:32:20.747 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:32:13.133609', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:32:13.943877', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:32:20.748 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:32:20.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.840 7fb845ed6700 1 Processor -- start 2021-04-09T18:32:20.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.840 7fb845ed6700 1 -- start start 2021-04-09T18:32:20.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.840 7fb845ed6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb8400f5550 0x7fb8400f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:20.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.840 7fb845ed6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8401c8040 0x7fb8401ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:20.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.840 7fb845ed6700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8400fbb50 con 0x7fb8400e9b10 2021-04-09T18:32:20.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.840 7fb845ed6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8400e9f60 con 0x7fb8400f5550 2021-04-09T18:32:20.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.840 7fb845ed6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8401c3df0 con 0x7fb8401c8040 2021-04-09T18:32:20.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb83f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb8400f5550 0x7fb8400f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:20.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb83effd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb8400e9b10 0x7fb84009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54558/0 (socket says 172.21.15.79:54558) 2021-04-09T18:32:20.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb83effd700 1 -- 172.21.15.79:0/2503367735 learned_addr learned my addr 172.21.15.79:0/2503367735 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:20.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb83ffff700 1 --2- 172.21.15.79:0/2503367735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8401c8040 0x7fb8401ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:20.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb83e7fc700 1 -- 172.21.15.79:0/2503367735 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933830417 0 0) 0x7fb8340010d0 con 0x7fb8400e9b10 2021-04-09T18:32:20.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb83e7fc700 1 -- 172.21.15.79:0/2503367735 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb828003240 con 0x7fb8400e9b10 2021-04-09T18:32:20.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb83f7fe700 1 -- 172.21.15.79:0/2503367735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8401c8040 msgr2=0x7fb8401ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:20.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb83f7fe700 1 --2- 172.21.15.79:0/2503367735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8401c8040 0x7fb8401ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:20.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb83f7fe700 1 -- 172.21.15.79:0/2503367735 >> v1:172.21.15.79:6789/0 conn(0x7fb8400e9b10 legacy=0x7fb84009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:20.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb83f7fe700 1 -- 172.21.15.79:0/2503367735 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84009f910 con 0x7fb8400f5550 2021-04-09T18:32:20.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb83f7fe700 1 --2- 172.21.15.79:0/2503367735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8400f5550 0x7fb8400f64e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7fb8400f6f30 tx=0x7fb83000bd70).ready entity=mon.0 client_cookie=41ac6bfa37196e3a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:20.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb83e7fc700 1 -- 172.21.15.79:0/2503367735 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb84009f910 con 0x7fb8400f5550 2021-04-09T18:32:20.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb83e7fc700 1 -- 172.21.15.79:0/2503367735 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb830009810 con 0x7fb8400f5550 2021-04-09T18:32:20.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb83e7fc700 1 -- 172.21.15.79:0/2503367735 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb830009be0 con 0x7fb8400f5550 2021-04-09T18:32:20.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb845ed6700 1 -- 172.21.15.79:0/2503367735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8400f5550 msgr2=0x7fb8400f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:20.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb845ed6700 1 --2- 172.21.15.79:0/2503367735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8400f5550 0x7fb8400f64e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7fb8400f6f30 tx=0x7fb83000bd70).stop 2021-04-09T18:32:20.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb845ed6700 1 -- 172.21.15.79:0/2503367735 shutdown_connections 2021-04-09T18:32:20.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb845ed6700 1 --2- 172.21.15.79:0/2503367735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8400f5550 0x7fb8400f64e0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:20.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb845ed6700 1 --2- 172.21.15.79:0/2503367735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8401c8040 0x7fb8401ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:20.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb845ed6700 1 -- 172.21.15.79:0/2503367735 >> 172.21.15.79:0/2503367735 conn(0x7fb8400e6010 msgr2=0x7fb8400e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:20.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb845ed6700 1 -- 172.21.15.79:0/2503367735 shutdown_connections 2021-04-09T18:32:20.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.844 7fb845ed6700 1 -- 172.21.15.79:0/2503367735 wait complete. 2021-04-09T18:32:20.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.848 7fb845ed6700 1 Processor -- start 2021-04-09T18:32:20.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.848 7fb845ed6700 1 -- start start 2021-04-09T18:32:20.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.848 7fb845ed6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8400bb130 0x7fb8400c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:20.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.848 7fb845ed6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8400c1500 0x7fb8400982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:20.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.848 7fb845ed6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8400988e0 0x7fb8400c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:20.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.848 7fb845ed6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400bac90 con 0x7fb8400c1500 2021-04-09T18:32:20.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.848 7fb845ed6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb840097fb0 con 0x7fb8400988e0 2021-04-09T18:32:20.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.848 7fb845ed6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400d6920 con 0x7fb8400bb130 2021-04-09T18:32:20.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.848 7fb83effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8400c1500 0x7fb8400982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:20.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.848 7fb83effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8400c1500 0x7fb8400982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59856/0 (socket says 172.21.15.79:59856) 2021-04-09T18:32:20.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.848 7fb83effd700 1 -- 172.21.15.79:0/1525807734 learned_addr learned my addr 172.21.15.79:0/1525807734 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:20.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.848 7fb83f7fe700 1 --2- 172.21.15.79:0/1525807734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8400bb130 0x7fb8400c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:20.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.852 7fb83ffff700 1 --2- 172.21.15.79:0/1525807734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8400988e0 0x7fb8400c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:20.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.852 7fb83effd700 1 -- 172.21.15.79:0/1525807734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8400bb130 msgr2=0x7fb8400c0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:20.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.852 7fb83effd700 1 --2- 172.21.15.79:0/1525807734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8400bb130 0x7fb8400c0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:20.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.852 7fb83effd700 1 -- 172.21.15.79:0/1525807734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8400988e0 msgr2=0x7fb8400c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:20.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.852 7fb83effd700 1 --2- 172.21.15.79:0/1525807734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8400988e0 0x7fb8400c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:20.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.852 7fb83effd700 1 -- 172.21.15.79:0/1525807734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb840097860 con 0x7fb8400c1500 2021-04-09T18:32:20.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.852 7fb83effd700 1 --2- 172.21.15.79:0/1525807734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8400c1500 0x7fb8400982b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7fb8400d7f20 tx=0x7fb83400cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:20.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.852 7fb827fff700 1 -- 172.21.15.79:0/1525807734 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb840097860 con 0x7fb8400c1500 2021-04-09T18:32:20.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.852 7fb827fff700 1 -- 172.21.15.79:0/1525807734 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb834007320 con 0x7fb8400c1500 2021-04-09T18:32:20.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.852 7fb845ed6700 1 -- 172.21.15.79:0/1525807734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb840097b80 con 0x7fb8400c1500 2021-04-09T18:32:20.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.852 7fb827fff700 1 -- 172.21.15.79:0/1525807734 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb8340057e0 con 0x7fb8400c1500 2021-04-09T18:32:20.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.852 7fb845ed6700 1 -- 172.21.15.79:0/1525807734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8400c4c30 con 0x7fb8400c1500 2021-04-09T18:32:20.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.852 7fb827fff700 1 -- 172.21.15.79:0/1525807734 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb83401a060 con 0x7fb8400c1500 2021-04-09T18:32:20.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.852 7fb827fff700 1 --2- 172.21.15.79:0/1525807734 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb820029100 0x7fb82002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:20.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.852 7fb827fff700 1 -- 172.21.15.79:0/1525807734 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fb834038f60 con 0x7fb8400c1500 2021-04-09T18:32:20.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.852 7fb83f7fe700 1 --2- 172.21.15.79:0/1525807734 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb820029100 0x7fb82002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:20.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.852 7fb83f7fe700 1 --2- 172.21.15.79:0/1525807734 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb820029100 0x7fb82002b650 crc :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:20.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.856 7fb845ed6700 1 -- 172.21.15.79:0/1525807734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8400e39f0 con 0x7fb8400c1500 2021-04-09T18:32:20.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:20.860 7fb827fff700 1 -- 172.21.15.79:0/1525807734 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb834007110 con 0x7fb8400c1500 2021-04-09T18:32:21.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.008 7fb845ed6700 1 -- 172.21.15.79:0/1525807734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fb8400f5b50 con 0x7fb8400c1500 2021-04-09T18:32:21.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.012 7fb827fff700 1 -- 172.21.15.79:0/1525807734 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v69) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb8400e5cd0 con 0x7fb8400c1500 2021-04-09T18:32:21.015 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:32:21.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.012 7fb845ed6700 1 -- 172.21.15.79:0/1525807734 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb820029100 msgr2=0x7fb82002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.012 7fb845ed6700 1 --2- 172.21.15.79:0/1525807734 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb820029100 0x7fb82002b650 crc :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.012 7fb845ed6700 1 -- 172.21.15.79:0/1525807734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8400c1500 msgr2=0x7fb8400982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.012 7fb845ed6700 1 --2- 172.21.15.79:0/1525807734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8400c1500 0x7fb8400982b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7fb8400d7f20 tx=0x7fb83400cab0).stop 2021-04-09T18:32:21.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.012 7fb845ed6700 1 -- 172.21.15.79:0/1525807734 shutdown_connections 2021-04-09T18:32:21.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.012 7fb845ed6700 1 --2- 172.21.15.79:0/1525807734 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb820029100 0x7fb82002b650 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.012 7fb845ed6700 1 --2- 172.21.15.79:0/1525807734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8400988e0 0x7fb8400c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.012 7fb845ed6700 1 --2- 172.21.15.79:0/1525807734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8400bb130 0x7fb8400c0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.012 7fb845ed6700 1 --2- 172.21.15.79:0/1525807734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8400c1500 0x7fb8400982b0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.012 7fb845ed6700 1 -- 172.21.15.79:0/1525807734 >> 172.21.15.79:0/1525807734 conn(0x7fb84009aa60 msgr2=0x7fb8400d8160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:21.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.012 7fb845ed6700 1 -- 172.21.15.79:0/1525807734 shutdown_connections 2021-04-09T18:32:21.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.012 7fb845ed6700 1 -- 172.21.15.79:0/1525807734 wait complete. 2021-04-09T18:32:21.027 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:32:21.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b828a8700 1 Processor -- start 2021-04-09T18:32:21.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b828a8700 1 -- start start 2021-04-09T18:32:21.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b828a8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b7c0e9b10 0x7f4b7c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b828a8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7c0fbb50 con 0x7f4b7c0f5550 2021-04-09T18:32:21.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b828a8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7c0e5700 con 0x7f4b7c1c8040 2021-04-09T18:32:21.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b828a8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c1c3df0 con 0x7f4b7c0e9b10 2021-04-09T18:32:21.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7bfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4b7c0f5550 0x7f4b7c0f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54574/0 (socket says 172.21.15.79:54574) 2021-04-09T18:32:21.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7bfff700 1 -- 172.21.15.79:0/3470025723 learned_addr learned my addr 172.21.15.79:0/3470025723 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:21.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7b7fe700 1 --2- 172.21.15.79:0/3470025723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b7c0e9b10 0x7f4b7c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7affd700 1 -- 172.21.15.79:0/3470025723 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866944491 0 0) 0x7f4b6c001450 con 0x7f4b7c0f5550 2021-04-09T18:32:21.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7affd700 1 -- 172.21.15.79:0/3470025723 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b5c003240 con 0x7f4b7c0f5550 2021-04-09T18:32:21.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7affd700 1 -- 172.21.15.79:0/3470025723 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1573411030 0 0) 0x7f4b6c0019d0 con 0x7f4b7c0f5550 2021-04-09T18:32:21.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7affd700 1 -- 172.21.15.79:0/3470025723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b7c0e9b10 msgr2=0x7f4b7c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:21.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7affd700 1 --2- 172.21.15.79:0/3470025723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b7c0e9b10 0x7f4b7c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7affd700 1 -- 172.21.15.79:0/3470025723 >> v1:172.21.15.89:6789/0 conn(0x7f4b7c1c8040 legacy=0x7f4b7c1ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7affd700 1 -- 172.21.15.79:0/3470025723 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c0e4360 con 0x7f4b7c0f5550 2021-04-09T18:32:21.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7affd700 1 -- 172.21.15.79:0/3470025723 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f4b6c001f30 con 0x7f4b7c0f5550 2021-04-09T18:32:21.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7affd700 1 -- 172.21.15.79:0/3470025723 >> v1:172.21.15.79:6789/0 conn(0x7f4b7c0f5550 legacy=0x7f4b7c0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7affd700 1 --2- 172.21.15.79:0/3470025723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b5c0038f0 0x7f4b5c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7affd700 1 --2- 172.21.15.79:0/3470025723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b5c0045a0 0x7f4b5c0049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7affd700 1 --2- 172.21.15.79:0/3470025723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b5c005070 0x7f4b5c00b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7affd700 1 -- 172.21.15.79:0/3470025723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c1c3df0 con 0x7f4b5c0038f0 2021-04-09T18:32:21.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7affd700 1 -- 172.21.15.79:0/3470025723 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c00bf60 con 0x7f4b5c005070 2021-04-09T18:32:21.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7bfff700 1 --2- 172.21.15.79:0/3470025723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b5c0038f0 0x7f4b5c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7affd700 1 -- 172.21.15.79:0/3470025723 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c050170 con 0x7f4b5c0045a0 2021-04-09T18:32:21.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7b7fe700 1 --2- 172.21.15.79:0/3470025723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b5c0045a0 0x7f4b5c0049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b80e4d700 1 --2- 172.21.15.79:0/3470025723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b5c005070 0x7f4b5c00b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7bfff700 1 -- 172.21.15.79:0/3470025723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b5c0045a0 msgr2=0x7f4b5c0049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:21.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7bfff700 1 --2- 172.21.15.79:0/3470025723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b5c0045a0 0x7f4b5c0049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7bfff700 1 -- 172.21.15.79:0/3470025723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b5c005070 msgr2=0x7f4b5c00b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:21.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7bfff700 1 --2- 172.21.15.79:0/3470025723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b5c005070 0x7f4b5c00b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7bfff700 1 -- 172.21.15.79:0/3470025723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c050430 con 0x7f4b5c0038f0 2021-04-09T18:32:21.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7bfff700 1 --2- 172.21.15.79:0/3470025723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b5c0038f0 0x7f4b5c003dc0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f4b6c001380 tx=0x7f4b6c0057f0).ready entity=mon.0 client_cookie=613f53d7843a42a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:21.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7affd700 1 -- 172.21.15.79:0/3470025723 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4b5c050430 con 0x7f4b5c0038f0 2021-04-09T18:32:21.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7affd700 1 -- 172.21.15.79:0/3470025723 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6c005b80 con 0x7f4b5c0038f0 2021-04-09T18:32:21.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b7affd700 1 -- 172.21.15.79:0/3470025723 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4b7c0e4360 con 0x7f4b5c0038f0 2021-04-09T18:32:21.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.124 7f4b828a8700 1 -- 172.21.15.79:0/3470025723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b5c0038f0 msgr2=0x7f4b5c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.128 7f4b828a8700 1 --2- 172.21.15.79:0/3470025723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b5c0038f0 0x7f4b5c003dc0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f4b6c001380 tx=0x7f4b6c0057f0).stop 2021-04-09T18:32:21.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.128 7f4b80e4d700 1 -- 172.21.15.79:0/3470025723 reap_dead start 2021-04-09T18:32:21.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.128 7f4b828a8700 1 -- 172.21.15.79:0/3470025723 shutdown_connections 2021-04-09T18:32:21.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.128 7f4b828a8700 1 -- 172.21.15.79:0/3470025723 >> 172.21.15.79:0/3470025723 conn(0x7f4b7c0e6010 msgr2=0x7f4b7c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:21.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.128 7f4b828a8700 1 -- 172.21.15.79:0/3470025723 shutdown_connections 2021-04-09T18:32:21.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.128 7f4b828a8700 1 -- 172.21.15.79:0/3470025723 wait complete. 2021-04-09T18:32:21.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b828a8700 1 Processor -- start 2021-04-09T18:32:21.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b828a8700 1 -- start start 2021-04-09T18:32:21.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b828a8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b7c0c46c0 0x7f4b7c0afe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b828a8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b7c19dc20 0x7f4b7c0bee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b828a8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b7c19e070 0x7f4b7c0bf470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b828a8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c0e9f60 con 0x7f4b7c19dc20 2021-04-09T18:32:21.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b828a8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c096db0 con 0x7f4b7c0c46c0 2021-04-09T18:32:21.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b828a8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c0970b0 con 0x7f4b7c19e070 2021-04-09T18:32:21.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b7b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b7c19dc20 0x7f4b7c0bee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b7b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b7c19dc20 0x7f4b7c0bee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59874/0 (socket says 172.21.15.79:59874) 2021-04-09T18:32:21.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b7b7fe700 1 -- 172.21.15.79:0/2498019272 learned_addr learned my addr 172.21.15.79:0/2498019272 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:21.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b7bfff700 1 --2- 172.21.15.79:0/2498019272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b7c0c46c0 0x7f4b7c0afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b80e4d700 1 --2- 172.21.15.79:0/2498019272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b7c19e070 0x7f4b7c0bf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b7b7fe700 1 -- 172.21.15.79:0/2498019272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b7c19e070 msgr2=0x7f4b7c0bf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b7b7fe700 1 --2- 172.21.15.79:0/2498019272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b7c19e070 0x7f4b7c0bf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b7b7fe700 1 -- 172.21.15.79:0/2498019272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b7c0c46c0 msgr2=0x7f4b7c0afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b7b7fe700 1 --2- 172.21.15.79:0/2498019272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b7c0c46c0 0x7f4b7c0afe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b7b7fe700 1 -- 172.21.15.79:0/2498019272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c19e800 con 0x7f4b7c19dc20 2021-04-09T18:32:21.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b7b7fe700 1 --2- 172.21.15.79:0/2498019272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b7c19dc20 0x7f4b7c0bee40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f4b7c0d8150 tx=0x7f4b6400e4b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:21.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b78ff9700 1 -- 172.21.15.79:0/2498019272 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4b7c19e800 con 0x7f4b7c19dc20 2021-04-09T18:32:21.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b78ff9700 1 -- 172.21.15.79:0/2498019272 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6400ea40 con 0x7f4b7c19dc20 2021-04-09T18:32:21.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b828a8700 1 -- 172.21.15.79:0/2498019272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7c0b04c0 con 0x7f4b7c19dc20 2021-04-09T18:32:21.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b78ff9700 1 -- 172.21.15.79:0/2498019272 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4b6400f040 con 0x7f4b7c19dc20 2021-04-09T18:32:21.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.132 7f4b828a8700 1 -- 172.21.15.79:0/2498019272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7c096960 con 0x7f4b7c19dc20 2021-04-09T18:32:21.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.136 7f4b78ff9700 1 -- 172.21.15.79:0/2498019272 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4b64014470 con 0x7f4b7c19dc20 2021-04-09T18:32:21.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.136 7f4b78ff9700 1 --2- 172.21.15.79:0/2498019272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4b54029100 0x7f4b5402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.136 7f4b78ff9700 1 -- 172.21.15.79:0/2498019272 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f4b64039a90 con 0x7f4b7c19dc20 2021-04-09T18:32:21.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.136 7f4b7bfff700 1 --2- 172.21.15.79:0/2498019272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4b54029100 0x7f4b5402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.136 7f4b7bfff700 1 --2- 172.21.15.79:0/2498019272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4b54029100 0x7f4b5402b650 crc :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:21.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.140 7f4b828a8700 1 -- 172.21.15.79:0/2498019272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7c0e39f0 con 0x7f4b7c19dc20 2021-04-09T18:32:21.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.144 7f4b78ff9700 1 -- 172.21.15.79:0/2498019272 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4b64010da0 con 0x7f4b7c19dc20 2021-04-09T18:32:21.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.300 7f4b828a8700 1 -- 172.21.15.79:0/2498019272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f4b7c0f5b50 con 0x7f4b7c19dc20 2021-04-09T18:32:21.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.300 7f4b78ff9700 1 -- 172.21.15.79:0/2498019272 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v69) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4b64000bf0 con 0x7f4b7c19dc20 2021-04-09T18:32:21.305 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:32:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.304 7f4b828a8700 1 -- 172.21.15.79:0/2498019272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4b54029100 msgr2=0x7f4b5402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.304 7f4b828a8700 1 --2- 172.21.15.79:0/2498019272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4b54029100 0x7f4b5402b650 crc :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.304 7f4b828a8700 1 -- 172.21.15.79:0/2498019272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b7c19dc20 msgr2=0x7f4b7c0bee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.304 7f4b828a8700 1 --2- 172.21.15.79:0/2498019272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b7c19dc20 0x7f4b7c0bee40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f4b7c0d8150 tx=0x7f4b6400e4b0).stop 2021-04-09T18:32:21.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.304 7f4b828a8700 1 -- 172.21.15.79:0/2498019272 shutdown_connections 2021-04-09T18:32:21.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.304 7f4b828a8700 1 --2- 172.21.15.79:0/2498019272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4b54029100 0x7f4b5402b650 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.304 7f4b828a8700 1 --2- 172.21.15.79:0/2498019272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b7c0c46c0 0x7f4b7c0afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.304 7f4b828a8700 1 --2- 172.21.15.79:0/2498019272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b7c19e070 0x7f4b7c0bf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.304 7f4b828a8700 1 --2- 172.21.15.79:0/2498019272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b7c19dc20 0x7f4b7c0bee40 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.304 7f4b828a8700 1 -- 172.21.15.79:0/2498019272 >> 172.21.15.79:0/2498019272 conn(0x7f4b7c0c02f0 msgr2=0x7f4b7c095b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:21.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.304 7f4b828a8700 1 -- 172.21.15.79:0/2498019272 shutdown_connections 2021-04-09T18:32:21.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.304 7f4b828a8700 1 -- 172.21.15.79:0/2498019272 wait complete. 2021-04-09T18:32:21.317 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:32:21.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.404 7f92e5778700 1 Processor -- start 2021-04-09T18:32:21.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.404 7f92e5778700 1 -- start start 2021-04-09T18:32:21.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.404 7f92e5778700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92e00f5550 0x7f92e00f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.404 7f92e5778700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f92e00e9b10 0x7f92e009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.404 7f92e5778700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f92e01c2de0 0x7f92e01c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.404 7f92e5778700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e00e9f60 con 0x7f92e00e9b10 2021-04-09T18:32:21.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.404 7f92e5778700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e00e5a00 con 0x7f92e01c2de0 2021-04-09T18:32:21.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.404 7f92e5778700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e00fbb50 con 0x7f92e00f5550 2021-04-09T18:32:21.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.404 7f92decf4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f92e00e9b10 0x7f92e009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.404 7f92decf4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f92e00e9b10 0x7f92e009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59882/0 (socket says 172.21.15.79:59882) 2021-04-09T18:32:21.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.404 7f92decf4700 1 -- 172.21.15.79:0/3917647656 learned_addr learned my addr 172.21.15.79:0/3917647656 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:21.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.404 7f92df4f5700 1 --2- 172.21.15.79:0/3917647656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92e00f5550 0x7f92e00f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.404 7f92dfcf6700 1 --2- 172.21.15.79:0/3917647656 >> v2:172.21.15.89:3300/0 conn(0x7f92e01c2de0 0x7f92e01c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.404 7f92decf4700 1 -- 172.21.15.79:0/3917647656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92e00f5550 msgr2=0x7f92e00f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:21.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.404 7f92decf4700 1 --2- 172.21.15.79:0/3917647656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92e00f5550 0x7f92e00f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.404 7f92decf4700 1 -- 172.21.15.79:0/3917647656 >> v2:172.21.15.89:3300/0 conn(0x7f92e01c2de0 msgr2=0x7f92e01c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:21.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.404 7f92decf4700 1 --2- 172.21.15.79:0/3917647656 >> v2:172.21.15.89:3300/0 conn(0x7f92e01c2de0 0x7f92e01c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.404 7f92decf4700 1 -- 172.21.15.79:0/3917647656 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e00e5700 con 0x7f92e00e9b10 2021-04-09T18:32:21.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.404 7f92df4f5700 1 --2- 172.21.15.79:0/3917647656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92e00f5550 0x7f92e00f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:32:21.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.408 7f92decf4700 1 --2- 172.21.15.79:0/3917647656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92e00e9b10 0x7f92e009f110 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f92cc002f30 tx=0x7f92cc00bd70).ready entity=mon.0 client_cookie=e6fdc8c3a31bd216 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:21.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.408 7f92de4f3700 1 -- 172.21.15.79:0/3917647656 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f92e00e5700 con 0x7f92e00e9b10 2021-04-09T18:32:21.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.408 7f92de4f3700 1 -- 172.21.15.79:0/3917647656 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92cc0098b0 con 0x7f92e00e9b10 2021-04-09T18:32:21.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.408 7f92de4f3700 1 -- 172.21.15.79:0/3917647656 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f92cc009c80 con 0x7f92e00e9b10 2021-04-09T18:32:21.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.408 7f92e5778700 1 -- 172.21.15.79:0/3917647656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92e00e9b10 msgr2=0x7f92e009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.408 7f92e5778700 1 --2- 172.21.15.79:0/3917647656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92e00e9b10 0x7f92e009f110 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f92cc002f30 tx=0x7f92cc00bd70).stop 2021-04-09T18:32:21.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.408 7f92e5778700 1 -- 172.21.15.79:0/3917647656 shutdown_connections 2021-04-09T18:32:21.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.408 7f92e5778700 1 --2- 172.21.15.79:0/3917647656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92e00f5550 0x7f92e00f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.408 7f92e5778700 1 --2- 172.21.15.79:0/3917647656 >> v2:172.21.15.89:3300/0 conn(0x7f92e01c2de0 0x7f92e01c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.408 7f92e5778700 1 --2- 172.21.15.79:0/3917647656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92e00e9b10 0x7f92e009f110 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.408 7f92e5778700 1 -- 172.21.15.79:0/3917647656 >> 172.21.15.79:0/3917647656 conn(0x7f92e00e6010 msgr2=0x7f92e00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:21.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.408 7f92e5778700 1 -- 172.21.15.79:0/3917647656 shutdown_connections 2021-04-09T18:32:21.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.408 7f92e5778700 1 -- 172.21.15.79:0/3917647656 wait complete. 2021-04-09T18:32:21.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92e5778700 1 Processor -- start 2021-04-09T18:32:21.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92e5778700 1 -- start start 2021-04-09T18:32:21.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92e5778700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92e00bacf0 0x7f92e00d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92e5778700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92e00ae060 0x7f92e00ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92e5778700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92e00d4590 0x7f92e00d49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92e5778700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e00ac7c0 con 0x7f92e00d4590 2021-04-09T18:32:21.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92e5778700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e00acac0 con 0x7f92e00bacf0 2021-04-09T18:32:21.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92e5778700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e00abf00 con 0x7f92e00ae060 2021-04-09T18:32:21.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92dfcf6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92e00d4590 0x7f92e00d49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92dfcf6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92e00d4590 0x7f92e00d49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59890/0 (socket says 172.21.15.79:59890) 2021-04-09T18:32:21.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92dfcf6700 1 -- 172.21.15.79:0/721716458 learned_addr learned my addr 172.21.15.79:0/721716458 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:21.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92df4f5700 1 --2- 172.21.15.79:0/721716458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92e00bacf0 0x7f92e00d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92decf4700 1 --2- 172.21.15.79:0/721716458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92e00ae060 0x7f92e00ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92dfcf6700 1 -- 172.21.15.79:0/721716458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92e00ae060 msgr2=0x7f92e00ae4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92dfcf6700 1 --2- 172.21.15.79:0/721716458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92e00ae060 0x7f92e00ae4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92dfcf6700 1 -- 172.21.15.79:0/721716458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92e00bacf0 msgr2=0x7f92e00d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92dfcf6700 1 --2- 172.21.15.79:0/721716458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92e00bacf0 0x7f92e00d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92dfcf6700 1 -- 172.21.15.79:0/721716458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e00d63c0 con 0x7f92e00d4590 2021-04-09T18:32:21.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92dfcf6700 1 --2- 172.21.15.79:0/721716458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92e00d4590 0x7f92e00d49e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f92e00d7c90 tx=0x7f92d000beb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:21.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92d7fff700 1 -- 172.21.15.79:0/721716458 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f92e00d63c0 con 0x7f92e00d4590 2021-04-09T18:32:21.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92d7fff700 1 -- 172.21.15.79:0/721716458 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d000ca70 con 0x7f92e00d4590 2021-04-09T18:32:21.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92e5778700 1 -- 172.21.15.79:0/721716458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e00ac350 con 0x7f92e00d4590 2021-04-09T18:32:21.429 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92d7fff700 1 -- 172.21.15.79:0/721716458 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f92d000f040 con 0x7f92e00d4590 2021-04-09T18:32:21.429 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.412 7f92e5778700 1 -- 172.21.15.79:0/721716458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e00bb2d0 con 0x7f92e00d4590 2021-04-09T18:32:21.429 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.416 7f92d7fff700 1 -- 172.21.15.79:0/721716458 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f92d0011070 con 0x7f92e00d4590 2021-04-09T18:32:21.429 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.416 7f92d7fff700 1 --2- 172.21.15.79:0/721716458 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f92bc029100 0x7f92bc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.429 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.416 7f92d7fff700 1 -- 172.21.15.79:0/721716458 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f92d0010040 con 0x7f92e00d4590 2021-04-09T18:32:21.430 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.416 7f92df4f5700 1 --2- 172.21.15.79:0/721716458 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f92bc029100 0x7f92bc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.430 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.416 7f92df4f5700 1 --2- 172.21.15.79:0/721716458 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f92bc029100 0x7f92bc02b650 crc :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:21.430 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.420 7f92e5778700 1 -- 172.21.15.79:0/721716458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e00e39f0 con 0x7f92e00d4590 2021-04-09T18:32:21.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.428 7f92d7fff700 1 -- 172.21.15.79:0/721716458 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f92e00f76f0 con 0x7f92e00d4590 2021-04-09T18:32:21.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.576 7f92e5778700 1 -- 172.21.15.79:0/721716458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f92e00f5b50 con 0x7f92e00d4590 2021-04-09T18:32:21.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.576 7f92d7fff700 1 -- 172.21.15.79:0/721716458 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v69) v1 ==== 100+0+10 (secure 0 0 0) 0x7f92d000c670 con 0x7f92e00d4590 2021-04-09T18:32:21.582 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:32:21.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.580 7f92e5778700 1 -- 172.21.15.79:0/721716458 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f92bc029100 msgr2=0x7f92bc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.580 7f92e5778700 1 --2- 172.21.15.79:0/721716458 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f92bc029100 0x7f92bc02b650 crc :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.580 7f92e5778700 1 -- 172.21.15.79:0/721716458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92e00d4590 msgr2=0x7f92e00d49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.580 7f92e5778700 1 --2- 172.21.15.79:0/721716458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92e00d4590 0x7f92e00d49e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f92e00d7c90 tx=0x7f92d000beb0).stop 2021-04-09T18:32:21.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.580 7f92e5778700 1 -- 172.21.15.79:0/721716458 shutdown_connections 2021-04-09T18:32:21.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.580 7f92e5778700 1 --2- 172.21.15.79:0/721716458 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f92bc029100 0x7f92bc02b650 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.580 7f92e5778700 1 --2- 172.21.15.79:0/721716458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92e00bacf0 0x7f92e00d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.580 7f92e5778700 1 --2- 172.21.15.79:0/721716458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92e00d4590 0x7f92e00d49e0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.580 7f92e5778700 1 --2- 172.21.15.79:0/721716458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92e00ae060 0x7f92e00ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.580 7f92e5778700 1 -- 172.21.15.79:0/721716458 >> 172.21.15.79:0/721716458 conn(0x7f92e009b200 msgr2=0x7f92e00aef80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:21.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.580 7f92e5778700 1 -- 172.21.15.79:0/721716458 shutdown_connections 2021-04-09T18:32:21.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.580 7f92e5778700 1 -- 172.21.15.79:0/721716458 wait complete. 2021-04-09T18:32:21.600 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:32:21.600 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:32:21.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.684 7f01ac24b700 1 Processor -- start 2021-04-09T18:32:21.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.684 7f01ac24b700 1 -- start start 2021-04-09T18:32:21.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.684 7f01ac24b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f01a40f5510 0x7f01a40f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.684 7f01ac24b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a40fbb10 con 0x7f01a40e9ad0 2021-04-09T18:32:21.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.684 7f01ac24b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a409f900 con 0x7f01a41c8000 2021-04-09T18:32:21.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.684 7f01ac24b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a40e9f20 con 0x7f01a40f5510 2021-04-09T18:32:21.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.684 7f01a97ee700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f01a40e9ad0 0x7f01a409f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54608/0 (socket says 172.21.15.79:54608) 2021-04-09T18:32:21.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.684 7f01a97ee700 1 -- 172.21.15.79:0/3932388682 learned_addr learned my addr 172.21.15.79:0/3932388682 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:21.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.684 7f01a8fed700 1 -- 172.21.15.79:0/3932388682 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473517208 0 0) 0x7f01940010d0 con 0x7f01a40e9ad0 2021-04-09T18:32:21.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.684 7f01a9fef700 1 --2- 172.21.15.79:0/3932388682 >> v2:172.21.15.89:3300/0 conn(0x7f01a40f5510 0x7f01a40f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a8fed700 1 -- 172.21.15.79:0/3932388682 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0190003240 con 0x7f01a40e9ad0 2021-04-09T18:32:21.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a8fed700 1 -- 172.21.15.79:0/3932388682 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1142907297 0 0) 0x7f0194001650 con 0x7f01a40e9ad0 2021-04-09T18:32:21.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a8fed700 1 -- 172.21.15.79:0/3932388682 >> v2:172.21.15.89:3300/0 conn(0x7f01a40f5510 msgr2=0x7f01a40f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:21.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a8fed700 1 --2- 172.21.15.79:0/3932388682 >> v2:172.21.15.89:3300/0 conn(0x7f01a40f5510 0x7f01a40f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a8fed700 1 -- 172.21.15.79:0/3932388682 >> v1:172.21.15.89:6789/0 conn(0x7f01a41c8000 legacy=0x7f01a41ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a8fed700 1 -- 172.21.15.79:0/3932388682 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a40e56c0 con 0x7f01a40e9ad0 2021-04-09T18:32:21.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a8fed700 1 -- 172.21.15.79:0/3932388682 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f0194001bb0 con 0x7f01a40e9ad0 2021-04-09T18:32:21.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a8fed700 1 -- 172.21.15.79:0/3932388682 >> v1:172.21.15.79:6789/0 conn(0x7f01a40e9ad0 legacy=0x7f01a409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a8fed700 1 --2- 172.21.15.79:0/3932388682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01900038c0 0x7f0190003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a8fed700 1 --2- 172.21.15.79:0/3932388682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01900045a0 0x7f0190004a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a8fed700 1 --2- 172.21.15.79:0/3932388682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01900097e0 0x7f019000bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a8fed700 1 -- 172.21.15.79:0/3932388682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40e9f20 con 0x7f01900045a0 2021-04-09T18:32:21.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a8fed700 1 -- 172.21.15.79:0/3932388682 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019000c270 con 0x7f01900038c0 2021-04-09T18:32:21.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a97ee700 1 --2- 172.21.15.79:0/3932388682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01900045a0 0x7f0190004a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a8fed700 1 -- 172.21.15.79:0/3932388682 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0190050430 con 0x7f01900097e0 2021-04-09T18:32:21.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a9fef700 1 --2- 172.21.15.79:0/3932388682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01900038c0 0x7f0190003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01aa7f0700 1 --2- 172.21.15.79:0/3932388682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01900097e0 0x7f019000bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a97ee700 1 -- 172.21.15.79:0/3932388682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01900097e0 msgr2=0x7f019000bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:21.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a97ee700 1 --2- 172.21.15.79:0/3932388682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01900097e0 0x7f019000bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a97ee700 1 -- 172.21.15.79:0/3932388682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01900038c0 msgr2=0x7f0190003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:21.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a97ee700 1 --2- 172.21.15.79:0/3932388682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01900038c0 0x7f0190003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a97ee700 1 -- 172.21.15.79:0/3932388682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01900506a0 con 0x7f01900045a0 2021-04-09T18:32:21.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01aa7f0700 1 --2- 172.21.15.79:0/3932388682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01900097e0 0x7f019000bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:32:21.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01aa7f0700 1 -- 172.21.15.79:0/3932388682 reap_dead start 2021-04-09T18:32:21.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a97ee700 1 --2- 172.21.15.79:0/3932388682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01900045a0 0x7f0190004a10 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f01940018c0 tx=0x7f019400dc40).ready entity=mon.0 client_cookie=3f2f3b4e6f01144d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:21.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a8fed700 1 -- 172.21.15.79:0/3932388682 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f01900506a0 con 0x7f01900045a0 2021-04-09T18:32:21.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a8fed700 1 -- 172.21.15.79:0/3932388682 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0194008120 con 0x7f01900045a0 2021-04-09T18:32:21.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01a8fed700 1 -- 172.21.15.79:0/3932388682 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f01a40e56c0 con 0x7f01900045a0 2021-04-09T18:32:21.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01ac24b700 1 -- 172.21.15.79:0/3932388682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01900045a0 msgr2=0x7f0190004a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01ac24b700 1 --2- 172.21.15.79:0/3932388682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01900045a0 0x7f0190004a10 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f01940018c0 tx=0x7f019400dc40).stop 2021-04-09T18:32:21.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01ac24b700 1 -- 172.21.15.79:0/3932388682 shutdown_connections 2021-04-09T18:32:21.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01ac24b700 1 --2- 172.21.15.79:0/3932388682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01900045a0 0x7f0190004a10 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01ac24b700 1 -- 172.21.15.79:0/3932388682 >> 172.21.15.79:0/3932388682 conn(0x7f01a40e5fd0 msgr2=0x7f01a40e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:21.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01ac24b700 1 -- 172.21.15.79:0/3932388682 shutdown_connections 2021-04-09T18:32:21.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.688 7f01ac24b700 1 -- 172.21.15.79:0/3932388682 wait complete. 2021-04-09T18:32:21.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.692 7f01ac24b700 1 Processor -- start 2021-04-09T18:32:21.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.692 7f01ac24b700 1 -- start start 2021-04-09T18:32:21.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.692 7f01ac24b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01a41c0650 0x7f01a4096200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.692 7f01ac24b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01a419ced0 0x7f01a40ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.692 7f01ac24b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a419eec0 0x7f01a419f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.692 7f01ac24b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a41c3db0 con 0x7f01a419ced0 2021-04-09T18:32:21.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.692 7f01ac24b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40c3220 con 0x7f01a41c0650 2021-04-09T18:32:21.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.692 7f01ac24b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a419d920 con 0x7f01a419eec0 2021-04-09T18:32:21.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.692 7f01a97ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01a419ced0 0x7f01a40ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.692 7f01a97ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01a419ced0 0x7f01a40ae210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59908/0 (socket says 172.21.15.79:59908) 2021-04-09T18:32:21.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.692 7f01a97ee700 1 -- 172.21.15.79:0/3178785935 learned_addr learned my addr 172.21.15.79:0/3178785935 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:21.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.692 7f01a9fef700 1 --2- 172.21.15.79:0/3178785935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01a41c0650 0x7f01a4096200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.692 7f01aa7f0700 1 --2- 172.21.15.79:0/3178785935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a419eec0 0x7f01a419f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.696 7f01a97ee700 1 -- 172.21.15.79:0/3178785935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a419eec0 msgr2=0x7f01a419f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.696 7f01a97ee700 1 --2- 172.21.15.79:0/3178785935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a419eec0 0x7f01a419f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.696 7f01a97ee700 1 -- 172.21.15.79:0/3178785935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01a41c0650 msgr2=0x7f01a4096200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.696 7f01a97ee700 1 --2- 172.21.15.79:0/3178785935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01a41c0650 0x7f01a4096200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.696 7f01a97ee700 1 -- 172.21.15.79:0/3178785935 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a40ae840 con 0x7f01a419ced0 2021-04-09T18:32:21.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.696 7f01a97ee700 1 --2- 172.21.15.79:0/3178785935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01a419ced0 0x7f01a40ae210 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f01a40874c0 tx=0x7f01940086f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:21.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.696 7f019a7fc700 1 -- 172.21.15.79:0/3178785935 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f01a40ae840 con 0x7f01a419ced0 2021-04-09T18:32:21.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.696 7f01ac24b700 1 -- 172.21.15.79:0/3178785935 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a419b9d0 con 0x7f01a419ced0 2021-04-09T18:32:21.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.696 7f01ac24b700 1 -- 172.21.15.79:0/3178785935 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a419bf00 con 0x7f01a419ced0 2021-04-09T18:32:21.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.696 7f019a7fc700 1 -- 172.21.15.79:0/3178785935 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0194014450 con 0x7f01a419ced0 2021-04-09T18:32:21.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.696 7f019a7fc700 1 -- 172.21.15.79:0/3178785935 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f019401b070 con 0x7f01a419ced0 2021-04-09T18:32:21.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.696 7f019a7fc700 1 -- 172.21.15.79:0/3178785935 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0194014820 con 0x7f01a419ced0 2021-04-09T18:32:21.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.696 7f019a7fc700 1 --2- 172.21.15.79:0/3178785935 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f018c0290a0 0x7f018c02b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:21.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.696 7f019a7fc700 1 -- 172.21.15.79:0/3178785935 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f019403a080 con 0x7f01a419ced0 2021-04-09T18:32:21.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.696 7f01a9fef700 1 --2- 172.21.15.79:0/3178785935 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f018c0290a0 0x7f018c02b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:21.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.696 7f01a9fef700 1 --2- 172.21.15.79:0/3178785935 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f018c0290a0 0x7f018c02b5f0 crc :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:21.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.696 7f01ac24b700 1 -- 172.21.15.79:0/3178785935 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a40e39d0 con 0x7f01a419ced0 2021-04-09T18:32:21.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.704 7f019a7fc700 1 -- 172.21.15.79:0/3178785935 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f019400dd80 con 0x7f01a419ced0 2021-04-09T18:32:21.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.872 7f01ac24b700 1 -- 172.21.15.79:0/3178785935 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01a40a1cb0 con 0x7f01a419ced0 2021-04-09T18:32:21.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.872 7f019a7fc700 1 -- 172.21.15.79:0/3178785935 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+2104 (secure 0 0 0) 0x7f019402e850 con 0x7f01a419ced0 2021-04-09T18:32:21.876 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 40 2021-04-09T18:32:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:32:21.877 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6153,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1203679879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1203679879},{"type":"v1","addr":"172.21.15.89:6835","nonce":1203679879}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":38}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:32:14.903910","modified":"2021-04-09 18:32:16.914763","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/1131782053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1131782053},{"type":"v1","addr":"172.21.15.79:6833","nonce":1131782053}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-04-09T18:32:21.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.876 7f01ac24b700 1 -- 172.21.15.79:0/3178785935 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f018c0290a0 msgr2=0x7f018c02b5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.876 7f01ac24b700 1 --2- 172.21.15.79:0/3178785935 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f018c0290a0 0x7f018c02b5f0 crc :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.876 7f01ac24b700 1 -- 172.21.15.79:0/3178785935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01a419ced0 msgr2=0x7f01a40ae210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:21.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.876 7f01ac24b700 1 --2- 172.21.15.79:0/3178785935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01a419ced0 0x7f01a40ae210 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f01a40874c0 tx=0x7f01940086f0).stop 2021-04-09T18:32:21.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.876 7f01ac24b700 1 -- 172.21.15.79:0/3178785935 shutdown_connections 2021-04-09T18:32:21.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.876 7f01ac24b700 1 --2- 172.21.15.79:0/3178785935 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f018c0290a0 0x7f018c02b5f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.876 7f01ac24b700 1 --2- 172.21.15.79:0/3178785935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01a41c0650 0x7f01a4096200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.876 7f01ac24b700 1 --2- 172.21.15.79:0/3178785935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a419eec0 0x7f01a419f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.876 7f01ac24b700 1 --2- 172.21.15.79:0/3178785935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01a419ced0 0x7f01a40ae210 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:21.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.876 7f01ac24b700 1 -- 172.21.15.79:0/3178785935 >> 172.21.15.79:0/3178785935 conn(0x7f01a40baf00 msgr2=0x7f01a40af6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:21.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.876 7f01ac24b700 1 -- 172.21.15.79:0/3178785935 shutdown_connections 2021-04-09T18:32:21.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:21.876 7f01ac24b700 1 -- 172.21.15.79:0/3178785935 wait complete. 2021-04-09T18:32:22.094 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:32:14.903910', 'modified': '2021-04-09 18:32:16.914763', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 69, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6150}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6150': {'gid': 6150, 'name': 'a', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6833/1131782053', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 1131782053}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 1131782053}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:32:22.095 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:32:22.096 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2021-04-09T18:32:22.191 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:32:22.191 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:32:22.191 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2021-04-09T18:32:22.192 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 6150, 2021-04-09T18:32:22.192 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2021-04-09T18:32:22.192 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2021-04-09T18:32:22.192 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 6.2744691179999998, 2021-04-09T18:32:22.193 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 40, 2021-04-09T18:32:22.193 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 69, 2021-04-09T18:32:22.193 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 69, 2021-04-09T18:32:22.193 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 11.291241852000001 2021-04-09T18:32:22.194 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:32:22.197 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 6150, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.2744691179999998, "mdsmap_epoch": 40, "osdmap_epoch": 69, "osdmap_epoch_barrier": 69, "uptime": 11.291241852000001 } 2021-04-09T18:32:22.198 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:32:22.198 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-04-09T18:32:22.199 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi136.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-04-09T18:32:22.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:22.199 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:32:22.208 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:32:22.266 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:32:22.267 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:32:22.321 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:32:22.322 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:32:22.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:22.324 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:32:22.373 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:32:22.374 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:32:22.417 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:32:22.434 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:32:22.434 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:32:22.488 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:32:22.489 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:32:22.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:22.491 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:32:22.492 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:2021-04-09 18:32:22.490 7f029688c0c0 -1 init, newargv = 0x55861cfc1a10 newargc=9 2021-04-09T18:32:22.492 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13271]: starting ceph client 2021-04-09T18:32:22.501 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13271]: starting fuse 2021-04-09T18:32:23.599 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:32:23.614 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:32:23.615 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:32:23.668 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:32:23.669 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:32:23.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:23.671 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:32:23.717 INFO:teuthology.orchestra.run.smithi136.stdout:49 2021-04-09T18:32:23.718 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:32:23.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:23.718 DEBUG:teuthology.orchestra.run.smithi136:> sudo python3 -c ' 2021-04-09T18:32:23.719 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2021-04-09T18:32:23.719 DEBUG:teuthology.orchestra.run.smithi136:> import re 2021-04-09T18:32:23.720 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-04-09T18:32:23.720 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2021-04-09T18:32:23.720 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:32:23.721 DEBUG:teuthology.orchestra.run.smithi136:> def find_socket(client_name): 2021-04-09T18:32:23.721 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-04-09T18:32:23.722 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2021-04-09T18:32:23.722 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:32:23.722 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2021-04-09T18:32:23.723 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2021-04-09T18:32:23.723 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2021-04-09T18:32:23.724 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2021-04-09T18:32:23.724 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:32:23.724 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2021-04-09T18:32:23.725 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:32:23.725 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:32:23.725 DEBUG:teuthology.orchestra.run.smithi136:> return f 2021-04-09T18:32:23.726 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:32:23.726 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:32:23.727 DEBUG:teuthology.orchestra.run.smithi136:> print(find_socket("client.1")) 2021-04-09T18:32:23.727 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-04-09T18:32:23.806 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.1.13271.asok 2021-04-09T18:32:23.811 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13271.asok 2021-04-09T18:32:23.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:23.812 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13271.asok status 2021-04-09T18:32:23.884 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2021-04-09T18:32:23.885 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2021-04-09T18:32:23.885 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:32:23.885 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:32:23.886 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "1", 2021-04-09T18:32:23.886 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2021-04-09T18:32:23.886 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-04-09T18:32:23.886 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "13271", 2021-04-09T18:32:23.886 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2021-04-09T18:32:23.887 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:32:23.887 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2021-04-09T18:32:23.887 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2021-04-09T18:32:23.887 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 6348, 2021-04-09T18:32:23.888 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2021-04-09T18:32:23.888 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2021-04-09T18:32:23.888 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2021-04-09T18:32:23.888 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 6348 2021-04-09T18:32:23.888 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:32:23.889 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-04-09T18:32:23.889 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-04-09T18:32:23.889 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-04-09T18:32:23.889 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 1584268598 2021-04-09T18:32:23.889 INFO:teuthology.orchestra.run.smithi136.stdout: } 2021-04-09T18:32:23.890 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:32:23.890 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-04-09T18:32:23.890 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-04-09T18:32:23.890 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-04-09T18:32:23.890 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 1584268598 2021-04-09T18:32:23.891 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:32:23.891 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.6348 172.21.15.136:0/1584268598", 2021-04-09T18:32:23.891 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "172.21.15.136:0/1584268598", 2021-04-09T18:32:23.891 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2021-04-09T18:32:23.892 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 40, 2021-04-09T18:32:23.892 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 69, 2021-04-09T18:32:23.892 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:32:23.892 INFO:teuthology.orchestra.run.smithi136.stdout: "blacklisted": false, 2021-04-09T18:32:23.892 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2021-04-09T18:32:23.893 INFO:teuthology.orchestra.run.smithi136.stdout:} 2021-04-09T18:32:23.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:23.894 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:32:23.895 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:32:23.901 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-04-09T18:32:23.902 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-04-09T18:32:23.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:23.903 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:32:23.977 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:32:24.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.147 7efd4607a700 1 Processor -- start 2021-04-09T18:32:24.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.147 7efd4607a700 1 -- start start 2021-04-09T18:32:24.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd4607a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd401c9010 0x7efd401cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:24.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd4607a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd400fbb10 con 0x7efd400f5510 2021-04-09T18:32:24.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd4607a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd4009f900 con 0x7efd400e9ad0 2021-04-09T18:32:24.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd4607a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd401c3db0 con 0x7efd401c9010 2021-04-09T18:32:24.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd3ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd401c9010 0x7efd401cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:24.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd3f7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7efd400f5510 0x7efd400f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54624/0 (socket says 172.21.15.79:54624) 2021-04-09T18:32:24.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd3f7fe700 1 -- 172.21.15.79:0/1711953737 learned_addr learned my addr 172.21.15.79:0/1711953737 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:24.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd3ffff700 1 -- 172.21.15.79:0/1711953737 >> v1:172.21.15.89:6789/0 conn(0x7efd400e9ad0 legacy=0x7efd4009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:24.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd3ffff700 1 -- 172.21.15.79:0/1711953737 >> v1:172.21.15.79:6789/0 conn(0x7efd400f5510 legacy=0x7efd400f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:24.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd3e7fc700 1 -- 172.21.15.79:0/1711953737 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201278630 0 0) 0x7efd280010d0 con 0x7efd400f5510 2021-04-09T18:32:24.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd3ffff700 1 -- 172.21.15.79:0/1711953737 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd400e56c0 con 0x7efd401c9010 2021-04-09T18:32:24.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd3ffff700 1 --2- 172.21.15.79:0/1711953737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd401c9010 0x7efd401cb470 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7efd38002f30 tx=0x7efd3800bcc0).ready entity=mon.0 client_cookie=73bfbf309444d47e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:24.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd3e7fc700 1 -- 172.21.15.79:0/1711953737 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efd400e56c0 con 0x7efd401c9010 2021-04-09T18:32:24.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd3e7fc700 1 -- 172.21.15.79:0/1711953737 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd38009800 con 0x7efd401c9010 2021-04-09T18:32:24.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd3e7fc700 1 -- 172.21.15.79:0/1711953737 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efd38009bd0 con 0x7efd401c9010 2021-04-09T18:32:24.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd4607a700 1 -- 172.21.15.79:0/1711953737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd401c9010 msgr2=0x7efd401cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:24.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd4607a700 1 --2- 172.21.15.79:0/1711953737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd401c9010 0x7efd401cb470 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7efd38002f30 tx=0x7efd3800bcc0).stop 2021-04-09T18:32:24.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd4607a700 1 -- 172.21.15.79:0/1711953737 shutdown_connections 2021-04-09T18:32:24.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd4607a700 1 --2- 172.21.15.79:0/1711953737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd401c9010 0x7efd401cb470 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:24.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd4607a700 1 -- 172.21.15.79:0/1711953737 >> 172.21.15.79:0/1711953737 conn(0x7efd400e5fd0 msgr2=0x7efd400e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:24.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd4607a700 1 -- 172.21.15.79:0/1711953737 shutdown_connections 2021-04-09T18:32:24.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.151 7efd4607a700 1 -- 172.21.15.79:0/1711953737 wait complete. 2021-04-09T18:32:24.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.155 7efd4607a700 1 Processor -- start 2021-04-09T18:32:24.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.155 7efd4607a700 1 -- start start 2021-04-09T18:32:24.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd4607a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd40096200 0x7efd400b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:24.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd4607a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd401cf9a0 0x7efd401cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:24.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd4607a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd401d39f0 0x7efd401d3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:24.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd4607a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd400e9f20 con 0x7efd401cf9a0 2021-04-09T18:32:24.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd4607a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd400aacb0 con 0x7efd401d39f0 2021-04-09T18:32:24.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd4607a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd400aafb0 con 0x7efd40096200 2021-04-09T18:32:24.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd3effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd401cf9a0 0x7efd401cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:24.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd3effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd401cf9a0 0x7efd401cfdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59922/0 (socket says 172.21.15.79:59922) 2021-04-09T18:32:24.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd3f7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd40096200 0x7efd400b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:24.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd3effd700 1 -- 172.21.15.79:0/490545989 learned_addr learned my addr 172.21.15.79:0/490545989 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:24.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd3ffff700 1 --2- 172.21.15.79:0/490545989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd401d39f0 0x7efd401d3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:24.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd3effd700 1 -- 172.21.15.79:0/490545989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd40096200 msgr2=0x7efd400b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:24.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd3effd700 1 --2- 172.21.15.79:0/490545989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd40096200 0x7efd400b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:24.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd3effd700 1 -- 172.21.15.79:0/490545989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd401d39f0 msgr2=0x7efd401d3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:24.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd3effd700 1 --2- 172.21.15.79:0/490545989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd401d39f0 0x7efd401d3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:24.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd3effd700 1 -- 172.21.15.79:0/490545989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd401d4470 con 0x7efd401cf9a0 2021-04-09T18:32:24.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd3effd700 1 --2- 172.21.15.79:0/490545989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd401cf9a0 0x7efd401cfdf0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7efd30000f00 tx=0x7efd3000ce60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:24.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd37fff700 1 -- 172.21.15.79:0/490545989 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efd401d4470 con 0x7efd401cf9a0 2021-04-09T18:32:24.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd37fff700 1 -- 172.21.15.79:0/490545989 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3000a6e0 con 0x7efd401cf9a0 2021-04-09T18:32:24.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd4607a700 1 -- 172.21.15.79:0/490545989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd400b15e0 con 0x7efd401cf9a0 2021-04-09T18:32:24.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd37fff700 1 -- 172.21.15.79:0/490545989 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efd3000aab0 con 0x7efd401cf9a0 2021-04-09T18:32:24.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd4607a700 1 -- 172.21.15.79:0/490545989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd400b1170 con 0x7efd401cf9a0 2021-04-09T18:32:24.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd37fff700 1 -- 172.21.15.79:0/490545989 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7efd3000acb0 con 0x7efd401cf9a0 2021-04-09T18:32:24.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd37fff700 1 --2- 172.21.15.79:0/490545989 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efd24029100 0x7efd2402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:24.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.159 7efd37fff700 1 -- 172.21.15.79:0/490545989 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7efd30039210 con 0x7efd401cf9a0 2021-04-09T18:32:24.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.163 7efd3f7fe700 1 --2- 172.21.15.79:0/490545989 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efd24029100 0x7efd2402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:24.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.163 7efd3f7fe700 1 --2- 172.21.15.79:0/490545989 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efd24029100 0x7efd2402b650 crc :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:24.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.163 7efd4607a700 1 -- 172.21.15.79:0/490545989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd400e39d0 con 0x7efd401cf9a0 2021-04-09T18:32:24.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.171 7efd37fff700 1 -- 172.21.15.79:0/490545989 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7efd3000a4d0 con 0x7efd401cf9a0 2021-04-09T18:32:24.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.335 7efd4607a700 1 -- 172.21.15.79:0/490545989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd400a1cb0 con 0x7efd401cf9a0 2021-04-09T18:32:24.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.335 7efd37fff700 1 -- 172.21.15.79:0/490545989 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+2104 (secure 0 0 0) 0x7efd30000f70 con 0x7efd401cf9a0 2021-04-09T18:32:24.341 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 40 2021-04-09T18:32:24.342 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:32:24.343 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6153,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1203679879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1203679879},{"type":"v1","addr":"172.21.15.89:6835","nonce":1203679879}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":38}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:32:14.903910","modified":"2021-04-09 18:32:16.914763","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/1131782053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1131782053},{"type":"v1","addr":"172.21.15.79:6833","nonce":1131782053}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-04-09T18:32:24.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.339 7efd4607a700 1 -- 172.21.15.79:0/490545989 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efd24029100 msgr2=0x7efd2402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:24.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.339 7efd4607a700 1 --2- 172.21.15.79:0/490545989 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efd24029100 0x7efd2402b650 crc :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:24.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.339 7efd4607a700 1 -- 172.21.15.79:0/490545989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd401cf9a0 msgr2=0x7efd401cfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:24.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.339 7efd4607a700 1 --2- 172.21.15.79:0/490545989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd401cf9a0 0x7efd401cfdf0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7efd30000f00 tx=0x7efd3000ce60).stop 2021-04-09T18:32:24.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.339 7efd4607a700 1 -- 172.21.15.79:0/490545989 shutdown_connections 2021-04-09T18:32:24.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.339 7efd4607a700 1 --2- 172.21.15.79:0/490545989 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efd24029100 0x7efd2402b650 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:24.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.339 7efd4607a700 1 --2- 172.21.15.79:0/490545989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd401d39f0 0x7efd401d3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:24.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.339 7efd4607a700 1 --2- 172.21.15.79:0/490545989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd40096200 0x7efd400b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:24.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.339 7efd4607a700 1 --2- 172.21.15.79:0/490545989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd401cf9a0 0x7efd401cfdf0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:24.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.339 7efd4607a700 1 -- 172.21.15.79:0/490545989 >> 172.21.15.79:0/490545989 conn(0x7efd400ba470 msgr2=0x7efd40097510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:24.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.339 7efd4607a700 1 -- 172.21.15.79:0/490545989 shutdown_connections 2021-04-09T18:32:24.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.339 7efd4607a700 1 -- 172.21.15.79:0/490545989 wait complete. 2021-04-09T18:32:24.354 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:32:24.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e82746700 1 Processor -- start 2021-04-09T18:32:24.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e82746700 1 -- start start 2021-04-09T18:32:24.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e82746700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e7c0f5510 0x7f1e7c0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:24.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e82746700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7c0fbb10 con 0x7f1e7c0e9ad0 2021-04-09T18:32:24.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e82746700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7c09f900 con 0x7f1e7c1c8000 2021-04-09T18:32:24.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e82746700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0e9f20 con 0x7f1e7c0f5510 2021-04-09T18:32:24.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1e7c0e9ad0 0x7f1e7c09f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54640/0 (socket says 172.21.15.79:54640) 2021-04-09T18:32:24.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7b7fe700 1 -- 172.21.15.79:0/914550341 learned_addr learned my addr 172.21.15.79:0/914550341 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:32:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7bfff700 1 --2- 172.21.15.79:0/914550341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e7c0f5510 0x7f1e7c0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7affd700 1 -- 172.21.15.79:0/914550341 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206857774 0 0) 0x7f1e700010d0 con 0x7f1e7c0e9ad0 2021-04-09T18:32:24.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7affd700 1 -- 172.21.15.79:0/914550341 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e64003240 con 0x7f1e7c0e9ad0 2021-04-09T18:32:24.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7affd700 1 -- 172.21.15.79:0/914550341 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643412902 0 0) 0x7f1e74001450 con 0x7f1e7c1c8000 2021-04-09T18:32:24.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7affd700 1 -- 172.21.15.79:0/914550341 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e64003620 con 0x7f1e7c1c8000 2021-04-09T18:32:24.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7affd700 1 -- 172.21.15.79:0/914550341 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3284355434 0 0) 0x7f1e70001650 con 0x7f1e7c0e9ad0 2021-04-09T18:32:24.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7affd700 1 -- 172.21.15.79:0/914550341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e7c0f5510 msgr2=0x7f1e7c0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:24.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7affd700 1 --2- 172.21.15.79:0/914550341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e7c0f5510 0x7f1e7c0f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:24.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7affd700 1 -- 172.21.15.79:0/914550341 >> v1:172.21.15.89:6789/0 conn(0x7f1e7c1c8000 legacy=0x7f1e7c1ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:24.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7affd700 1 -- 172.21.15.79:0/914550341 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c0e56c0 con 0x7f1e7c0e9ad0 2021-04-09T18:32:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7affd700 1 -- 172.21.15.79:0/914550341 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f1e70001bb0 con 0x7f1e7c0e9ad0 2021-04-09T18:32:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7affd700 1 -- 172.21.15.79:0/914550341 >> v1:172.21.15.79:6789/0 conn(0x7f1e7c0e9ad0 legacy=0x7f1e7c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7affd700 1 --2- 172.21.15.79:0/914550341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e64003d40 0x7f1e640045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:24.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7affd700 1 --2- 172.21.15.79:0/914550341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e64004bd0 0x7f1e640097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:24.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7affd700 1 --2- 172.21.15.79:0/914550341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e64005020 0x7f1e6400be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:24.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7affd700 1 -- 172.21.15.79:0/914550341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0e9f20 con 0x7f1e64004bd0 2021-04-09T18:32:24.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7affd700 1 -- 172.21.15.79:0/914550341 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e64050460 con 0x7f1e64005020 2021-04-09T18:32:24.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7affd700 1 -- 172.21.15.79:0/914550341 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e64050610 con 0x7f1e64003d40 2021-04-09T18:32:24.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7b7fe700 1 --2- 172.21.15.79:0/914550341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e64004bd0 0x7f1e640097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7bfff700 1 --2- 172.21.15.79:0/914550341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e64003d40 0x7f1e640045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e80ceb700 1 --2- 172.21.15.79:0/914550341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e64005020 0x7f1e6400be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7b7fe700 1 -- 172.21.15.79:0/914550341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e64003d40 msgr2=0x7f1e640045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7b7fe700 1 --2- 172.21.15.79:0/914550341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e64003d40 0x7f1e640045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7b7fe700 1 -- 172.21.15.79:0/914550341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e64005020 msgr2=0x7f1e6400be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7b7fe700 1 --2- 172.21.15.79:0/914550341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e64005020 0x7f1e6400be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.447 7f1e7b7fe700 1 -- 172.21.15.79:0/914550341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e64050880 con 0x7f1e64004bd0 2021-04-09T18:32:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.451 7f1e7b7fe700 1 --2- 172.21.15.79:0/914550341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e64004bd0 0x7f1e640097e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f1e64004510 tx=0x7f1e7000ccb0).ready entity=mon.0 client_cookie=8a3ed91c1f466f71 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.451 7f1e7affd700 1 -- 172.21.15.79:0/914550341 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1e64050880 con 0x7f1e64004bd0 2021-04-09T18:32:24.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.451 7f1e7affd700 1 -- 172.21.15.79:0/914550341 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e70007110 con 0x7f1e64004bd0 2021-04-09T18:32:24.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.451 7f1e7affd700 1 -- 172.21.15.79:0/914550341 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1e7c0e56c0 con 0x7f1e64004bd0 2021-04-09T18:32:24.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.451 7f1e82746700 1 -- 172.21.15.79:0/914550341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e64004bd0 msgr2=0x7f1e640097e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:24.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.451 7f1e82746700 1 --2- 172.21.15.79:0/914550341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e64004bd0 0x7f1e640097e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f1e64004510 tx=0x7f1e7000ccb0).stop 2021-04-09T18:32:24.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.451 7f1e80ceb700 1 -- 172.21.15.79:0/914550341 reap_dead start 2021-04-09T18:32:24.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.451 7f1e82746700 1 -- 172.21.15.79:0/914550341 shutdown_connections 2021-04-09T18:32:24.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.451 7f1e82746700 1 -- 172.21.15.79:0/914550341 >> 172.21.15.79:0/914550341 conn(0x7f1e7c0e5fd0 msgr2=0x7f1e7c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:24.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.451 7f1e82746700 1 -- 172.21.15.79:0/914550341 shutdown_connections 2021-04-09T18:32:24.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.451 7f1e82746700 1 -- 172.21.15.79:0/914550341 wait complete. 2021-04-09T18:32:24.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.455 7f1e82746700 1 Processor -- start 2021-04-09T18:32:24.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.455 7f1e82746700 1 -- start start 2021-04-09T18:32:24.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.455 7f1e82746700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e7c0963d0 0x7f1e7c0b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:24.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.455 7f1e82746700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e7c0abe40 0x7f1e7c0d7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:24.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.455 7f1e82746700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e7c0d7f50 0x7f1e7c1af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:24.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.455 7f1e82746700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c1c3db0 con 0x7f1e7c0963d0 2021-04-09T18:32:24.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.455 7f1e82746700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0ac440 con 0x7f1e7c0abe40 2021-04-09T18:32:24.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.455 7f1e82746700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0ac740 con 0x7f1e7c0d7f50 2021-04-09T18:32:24.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.455 7f1e7bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e7c0963d0 0x7f1e7c0b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:24.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.455 7f1e7bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e7c0963d0 0x7f1e7c0b3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59940/0 (socket says 172.21.15.79:59940) 2021-04-09T18:32:24.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.455 7f1e7bfff700 1 -- 172.21.15.79:0/3213511715 learned_addr learned my addr 172.21.15.79:0/3213511715 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:32:24.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.455 7f1e7b7fe700 1 --2- 172.21.15.79:0/3213511715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e7c0abe40 0x7f1e7c0d7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:24.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.455 7f1e80ceb700 1 --2- 172.21.15.79:0/3213511715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e7c0d7f50 0x7f1e7c1af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:24.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.455 7f1e7bfff700 1 -- 172.21.15.79:0/3213511715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e7c0d7f50 msgr2=0x7f1e7c1af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:24.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.455 7f1e7bfff700 1 --2- 172.21.15.79:0/3213511715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e7c0d7f50 0x7f1e7c1af420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:24.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.459 7f1e7bfff700 1 -- 172.21.15.79:0/3213511715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e7c0abe40 msgr2=0x7f1e7c0d7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:24.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.459 7f1e7bfff700 1 --2- 172.21.15.79:0/3213511715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e7c0abe40 0x7f1e7c0d7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:24.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.459 7f1e7bfff700 1 -- 172.21.15.79:0/3213511715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c0b4050 con 0x7f1e7c0963d0 2021-04-09T18:32:24.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.459 7f1e7b7fe700 1 --2- 172.21.15.79:0/3213511715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e7c0abe40 0x7f1e7c0d7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:32:24.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.459 7f1e7bfff700 1 --2- 172.21.15.79:0/3213511715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e7c0963d0 0x7f1e7c0b3a20 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f1e7c0960c0 tx=0x7f1e6c00f520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:24.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.459 7f1e78ff9700 1 -- 172.21.15.79:0/3213511715 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1e7c0b4050 con 0x7f1e7c0963d0 2021-04-09T18:32:24.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.459 7f1e78ff9700 1 -- 172.21.15.79:0/3213511715 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c00fcc0 con 0x7f1e7c0963d0 2021-04-09T18:32:24.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.459 7f1e82746700 1 -- 172.21.15.79:0/3213511715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7c1afa50 con 0x7f1e7c0963d0 2021-04-09T18:32:24.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.459 7f1e78ff9700 1 -- 172.21.15.79:0/3213511715 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1e6c00f040 con 0x7f1e7c0963d0 2021-04-09T18:32:24.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.459 7f1e82746700 1 -- 172.21.15.79:0/3213511715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7c1aff80 con 0x7f1e7c0963d0 2021-04-09T18:32:24.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.459 7f1e78ff9700 1 -- 172.21.15.79:0/3213511715 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1e6c024060 con 0x7f1e7c0963d0 2021-04-09T18:32:24.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.459 7f1e78ff9700 1 --2- 172.21.15.79:0/3213511715 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1e5c029100 0x7f1e5c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:24.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.459 7f1e78ff9700 1 -- 172.21.15.79:0/3213511715 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f1e6c010040 con 0x7f1e7c0963d0 2021-04-09T18:32:24.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.459 7f1e7b7fe700 1 --2- 172.21.15.79:0/3213511715 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1e5c029100 0x7f1e5c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:24.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.459 7f1e7b7fe700 1 --2- 172.21.15.79:0/3213511715 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1e5c029100 0x7f1e5c02b650 crc :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:24.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.475 7f1e82746700 1 -- 172.21.15.79:0/3213511715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7c0e39d0 con 0x7f1e7c0963d0 2021-04-09T18:32:24.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.483 7f1e78ff9700 1 -- 172.21.15.79:0/3213511715 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1e6c000bf0 con 0x7f1e7c0963d0 2021-04-09T18:32:24.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.647 7f1e82746700 1 -- 172.21.15.79:0/3213511715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e7c0a1cb0 con 0x7f1e7c0963d0 2021-04-09T18:32:24.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.647 7f1e78ff9700 1 -- 172.21.15.79:0/3213511715 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+2104 (secure 0 0 0) 0x7f1e6c00fab0 con 0x7f1e7c0963d0 2021-04-09T18:32:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:32:24.655 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6153,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1203679879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1203679879},{"type":"v1","addr":"172.21.15.89:6835","nonce":1203679879}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":38}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:32:14.903910","modified":"2021-04-09 18:32:16.914763","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/1131782053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1131782053},{"type":"v1","addr":"172.21.15.79:6833","nonce":1131782053}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-04-09T18:32:24.656 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 40 2021-04-09T18:32:24.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.651 7f1e82746700 1 -- 172.21.15.79:0/3213511715 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1e5c029100 msgr2=0x7f1e5c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:24.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.651 7f1e82746700 1 --2- 172.21.15.79:0/3213511715 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1e5c029100 0x7f1e5c02b650 crc :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:24.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.651 7f1e82746700 1 -- 172.21.15.79:0/3213511715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e7c0963d0 msgr2=0x7f1e7c0b3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:24.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.651 7f1e82746700 1 --2- 172.21.15.79:0/3213511715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e7c0963d0 0x7f1e7c0b3a20 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f1e7c0960c0 tx=0x7f1e6c00f520).stop 2021-04-09T18:32:24.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.651 7f1e82746700 1 -- 172.21.15.79:0/3213511715 shutdown_connections 2021-04-09T18:32:24.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.651 7f1e82746700 1 --2- 172.21.15.79:0/3213511715 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1e5c029100 0x7f1e5c02b650 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:24.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.651 7f1e82746700 1 --2- 172.21.15.79:0/3213511715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e7c0d7f50 0x7f1e7c1af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:24.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.651 7f1e82746700 1 --2- 172.21.15.79:0/3213511715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e7c0963d0 0x7f1e7c0b3a20 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:24.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.651 7f1e82746700 1 --2- 172.21.15.79:0/3213511715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e7c0abe40 0x7f1e7c0d7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:24.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.651 7f1e82746700 1 -- 172.21.15.79:0/3213511715 >> 172.21.15.79:0/3213511715 conn(0x7f1e7c0aefd0 msgr2=0x7f1e7c096bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:24.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.651 7f1e82746700 1 -- 172.21.15.79:0/3213511715 shutdown_connections 2021-04-09T18:32:24.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:32:24.651 7f1e82746700 1 -- 172.21.15.79:0/3213511715 wait complete. 2021-04-09T18:32:24.671 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config set mds_cap_revoke_eviction_timeout 30.0 2021-04-09T18:32:24.756 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:32:24.756 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "mds_cap_revoke_eviction_timeout = '30.000000' " 2021-04-09T18:32:24.757 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:32:24.762 INFO:tasks.cephfs.filesystem:_json_asok output: { "success": "mds_cap_revoke_eviction_timeout = '30.000000' " } 2021-04-09T18:32:24.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:24.763 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:32:24.764 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:32:24.772 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:32:24.773 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:32:24.774 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-04-09T18:32:24.774 DEBUG:teuthology.orchestra.run.smithi090:> import time 2021-04-09T18:32:24.775 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:32:24.775 DEBUG:teuthology.orchestra.run.smithi090:> with open("/home/ubuntu/cephtest/mnt.0/background_file", '"'"'w'"'"') as f: 2021-04-09T18:32:24.776 DEBUG:teuthology.orchestra.run.smithi090:> f.write('"'"'content'"'"') 2021-04-09T18:32:24.776 DEBUG:teuthology.orchestra.run.smithi090:> f.flush() 2021-04-09T18:32:24.776 DEBUG:teuthology.orchestra.run.smithi090:> f.write('"'"'content2'"'"') 2021-04-09T18:32:24.777 DEBUG:teuthology.orchestra.run.smithi090:> while True: 2021-04-09T18:32:24.777 DEBUG:teuthology.orchestra.run.smithi090:> time.sleep(1) 2021-04-09T18:32:24.777 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:32:24.818 DEBUG:teuthology.orchestra.run.smithi090:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2021-04-09T18:32:24.839 INFO:teuthology.orchestra.run.smithi090.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/background_file': No such file or directory 2021-04-09T18:32:24.839 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-04-09T18:32:25.841 DEBUG:teuthology.orchestra.run.smithi090:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2021-04-09T18:32:25.857 INFO:teuthology.orchestra.run.smithi090.stdout:/home/ubuntu/cephtest/mnt.0/background_file 2021-04-09T18:32:25.859 DEBUG:tasks.cephfs.mount:File background_file became visible from 0 after 1s 2021-04-09T18:32:25.860 DEBUG:teuthology.orchestra.run.smithi136:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file 2021-04-09T18:32:25.898 INFO:teuthology.orchestra.run.smithi136.stdout:/home/ubuntu/cephtest/mnt.1/background_file 2021-04-09T18:32:25.900 DEBUG:tasks.cephfs.mount:File background_file became visible from 1 after 0s 2021-04-09T18:32:25.901 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi090.front.sepia.ceph.com... 2021-04-09T18:32:25.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:25.917 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:32:25.918 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:32:25.950 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-04-09T18:32:25.951 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-04-09T18:32:25.952 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-04-09T18:32:25.952 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-04-09T18:32:25.953 DEBUG:teuthology.orchestra.run.smithi136:> import time 2021-04-09T18:32:25.953 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:32:25.953 DEBUG:teuthology.orchestra.run.smithi136:> fd = os.open("/home/ubuntu/cephtest/mnt.1/background_file", os.O_RDWR | os.O_CREAT, 0o644) 2021-04-09T18:32:25.954 DEBUG:teuthology.orchestra.run.smithi136:> try: 2021-04-09T18:32:25.954 DEBUG:teuthology.orchestra.run.smithi136:> while True: 2021-04-09T18:32:25.955 DEBUG:teuthology.orchestra.run.smithi136:> os.write(fd, b'"'"'content'"'"') 2021-04-09T18:32:25.955 DEBUG:teuthology.orchestra.run.smithi136:> time.sleep(1) 2021-04-09T18:32:25.955 DEBUG:teuthology.orchestra.run.smithi136:> if not False: 2021-04-09T18:32:25.956 DEBUG:teuthology.orchestra.run.smithi136:> break 2021-04-09T18:32:25.956 DEBUG:teuthology.orchestra.run.smithi136:> except IOError as e: 2021-04-09T18:32:25.957 DEBUG:teuthology.orchestra.run.smithi136:> pass 2021-04-09T18:32:25.957 DEBUG:teuthology.orchestra.run.smithi136:> os.close(fd) 2021-04-09T18:32:25.957 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-04-09T18:32:44.053 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:32:44.056 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:32:44.059 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:32:44.061 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:32:44.064 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:33:07.123 INFO:tasks.cephfs.test_misc:cap_waiter waited 41.1257107257843s 2021-04-09T18:33:07.123 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist ls --format=json 2021-04-09T18:33:07.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.214 7fd817be0700 1 Processor -- start 2021-04-09T18:33:07.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.214 7fd817be0700 1 -- start start 2021-04-09T18:33:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd817be0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd8100f5520 0x7fd8100f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd817be0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8100fbb20 con 0x7fd8100e9ae0 2021-04-09T18:33:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd817be0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd81009f910 con 0x7fd8101c8010 2021-04-09T18:33:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd817be0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8100e9f30 con 0x7fd8100f5520 2021-04-09T18:33:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd815183700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd8100e9ae0 0x7fd81009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54664/0 (socket says 172.21.15.79:54664) 2021-04-09T18:33:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd815183700 1 -- 172.21.15.79:0/3839460379 learned_addr learned my addr 172.21.15.79:0/3839460379 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd815984700 1 --2- 172.21.15.79:0/3839460379 >> v2:172.21.15.89:3300/0 conn(0x7fd8100f5520 0x7fd8100f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd814982700 1 -- 172.21.15.79:0/3839460379 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923167977 0 0) 0x7fd8000010d0 con 0x7fd8100e9ae0 2021-04-09T18:33:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd814982700 1 -- 172.21.15.79:0/3839460379 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7fc003240 con 0x7fd8100e9ae0 2021-04-09T18:33:07.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd814982700 1 -- 172.21.15.79:0/3839460379 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956279046 0 0) 0x7fd808001450 con 0x7fd8101c8010 2021-04-09T18:33:07.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd814982700 1 -- 172.21.15.79:0/3839460379 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7fc003620 con 0x7fd8101c8010 2021-04-09T18:33:07.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd814982700 1 -- 172.21.15.79:0/3839460379 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3017568249 0 0) 0x7fd800001650 con 0x7fd8100e9ae0 2021-04-09T18:33:07.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd814982700 1 -- 172.21.15.79:0/3839460379 >> v2:172.21.15.89:3300/0 conn(0x7fd8100f5520 msgr2=0x7fd8100f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd814982700 1 --2- 172.21.15.79:0/3839460379 >> v2:172.21.15.89:3300/0 conn(0x7fd8100f5520 0x7fd8100f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd814982700 1 -- 172.21.15.79:0/3839460379 >> v1:172.21.15.89:6789/0 conn(0x7fd8101c8010 legacy=0x7fd8101ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd814982700 1 -- 172.21.15.79:0/3839460379 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8100e56d0 con 0x7fd8100e9ae0 2021-04-09T18:33:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd814982700 1 -- 172.21.15.79:0/3839460379 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7fd800001bb0 con 0x7fd8100e9ae0 2021-04-09T18:33:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd814982700 1 -- 172.21.15.79:0/3839460379 >> v1:172.21.15.79:6789/0 conn(0x7fd8100e9ae0 legacy=0x7fd81009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:07.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd814982700 1 --2- 172.21.15.79:0/3839460379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7fc003d10 0x7fd7fc0045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:07.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd814982700 1 --2- 172.21.15.79:0/3839460379 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7fc004bd0 0x7fd7fc0097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:07.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd814982700 1 --2- 172.21.15.79:0/3839460379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7fc005020 0x7fd7fc00be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:07.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd814982700 1 -- 172.21.15.79:0/3839460379 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100e9f30 con 0x7fd7fc005020 2021-04-09T18:33:07.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd814982700 1 -- 172.21.15.79:0/3839460379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc0505b0 con 0x7fd7fc003d10 2021-04-09T18:33:07.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd814982700 1 -- 172.21.15.79:0/3839460379 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc0507b0 con 0x7fd7fc004bd0 2021-04-09T18:33:07.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd816185700 1 --2- 172.21.15.79:0/3839460379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7fc005020 0x7fd7fc00be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:07.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd815183700 1 --2- 172.21.15.79:0/3839460379 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7fc004bd0 0x7fd7fc0097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:07.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd815984700 1 --2- 172.21.15.79:0/3839460379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7fc003d10 0x7fd7fc0045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:07.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd816185700 1 -- 172.21.15.79:0/3839460379 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7fc004bd0 msgr2=0x7fd7fc0097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:07.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd816185700 1 --2- 172.21.15.79:0/3839460379 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7fc004bd0 0x7fd7fc0097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:07.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd816185700 1 -- 172.21.15.79:0/3839460379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7fc003d10 msgr2=0x7fd7fc0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:07.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd816185700 1 --2- 172.21.15.79:0/3839460379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7fc003d10 0x7fd7fc0045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:07.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd816185700 1 -- 172.21.15.79:0/3839460379 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc050aa0 con 0x7fd7fc005020 2021-04-09T18:33:07.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd816185700 1 -- 172.21.15.79:0/3839460379 reap_dead start 2021-04-09T18:33:07.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd816185700 1 --2- 172.21.15.79:0/3839460379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7fc005020 0x7fd7fc00be20 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7fd808001360 tx=0x7fd80800c470).ready entity=mon.0 client_cookie=5e736cd95e122ada server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:07.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd814982700 1 -- 172.21.15.79:0/3839460379 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd7fc050aa0 con 0x7fd7fc005020 2021-04-09T18:33:07.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd814982700 1 -- 172.21.15.79:0/3839460379 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd808006870 con 0x7fd7fc005020 2021-04-09T18:33:07.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd814982700 1 -- 172.21.15.79:0/3839460379 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd808006c40 con 0x7fd7fc005020 2021-04-09T18:33:07.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd817be0700 1 -- 172.21.15.79:0/3839460379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7fc005020 msgr2=0x7fd7fc00be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:07.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.218 7fd817be0700 1 --2- 172.21.15.79:0/3839460379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7fc005020 0x7fd7fc00be20 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7fd808001360 tx=0x7fd80800c470).stop 2021-04-09T18:33:07.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.222 7fd817be0700 1 -- 172.21.15.79:0/3839460379 shutdown_connections 2021-04-09T18:33:07.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.222 7fd817be0700 1 --2- 172.21.15.79:0/3839460379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7fc005020 0x7fd7fc00be20 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:07.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.222 7fd817be0700 1 -- 172.21.15.79:0/3839460379 >> 172.21.15.79:0/3839460379 conn(0x7fd8100e5fe0 msgr2=0x7fd8100e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:07.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.222 7fd817be0700 1 -- 172.21.15.79:0/3839460379 shutdown_connections 2021-04-09T18:33:07.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.222 7fd817be0700 1 -- 172.21.15.79:0/3839460379 wait complete. 2021-04-09T18:33:07.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd817be0700 1 Processor -- start 2021-04-09T18:33:07.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd817be0700 1 -- start start 2021-04-09T18:33:07.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd817be0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8100bf300 0x7fd8100a2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:07.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd817be0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd810098cb0 0x7fd8100d5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:07.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd817be0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd810099100 0x7fd8100c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:07.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd817be0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8101c3dc0 con 0x7fd8100bf300 2021-04-09T18:33:07.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd817be0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100bfa80 con 0x7fd810098cb0 2021-04-09T18:33:07.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd817be0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100bfd80 con 0x7fd810099100 2021-04-09T18:33:07.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd815984700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8100bf300 0x7fd8100a2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:07.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd815984700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8100bf300 0x7fd8100a2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59964/0 (socket says 172.21.15.79:59964) 2021-04-09T18:33:07.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd815984700 1 -- 172.21.15.79:0/1421839312 learned_addr learned my addr 172.21.15.79:0/1421839312 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:07.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd815183700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd810098cb0 0x7fd8100d5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:07.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd816185700 1 --2- 172.21.15.79:0/1421839312 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd810099100 0x7fd8100c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:07.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd815984700 1 -- 172.21.15.79:0/1421839312 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd810099100 msgr2=0x7fd8100c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:07.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd815984700 1 --2- 172.21.15.79:0/1421839312 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd810099100 0x7fd8100c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:07.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd815984700 1 -- 172.21.15.79:0/1421839312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd810098cb0 msgr2=0x7fd8100d5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:07.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd815984700 1 --2- 172.21.15.79:0/1421839312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd810098cb0 0x7fd8100d5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:07.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd815984700 1 -- 172.21.15.79:0/1421839312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8100bef00 con 0x7fd8100bf300 2021-04-09T18:33:07.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd815984700 1 --2- 172.21.15.79:0/1421839312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8100bf300 0x7fd8100a2e90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7fd8100874d0 tx=0x7fd80c00e4b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:07.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd8067fc700 1 -- 172.21.15.79:0/1421839312 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd8100bef00 con 0x7fd8100bf300 2021-04-09T18:33:07.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd8067fc700 1 -- 172.21.15.79:0/1421839312 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c00ea40 con 0x7fd8100bf300 2021-04-09T18:33:07.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd817be0700 1 -- 172.21.15.79:0/1421839312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8100a34c0 con 0x7fd8100bf300 2021-04-09T18:33:07.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd8067fc700 1 -- 172.21.15.79:0/1421839312 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd80c00f040 con 0x7fd8100bf300 2021-04-09T18:33:07.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.226 7fd817be0700 1 -- 172.21.15.79:0/1421839312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8100d5980 con 0x7fd8100bf300 2021-04-09T18:33:07.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.230 7fd8067fc700 1 -- 172.21.15.79:0/1421839312 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd80c024060 con 0x7fd8100bf300 2021-04-09T18:33:07.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.230 7fd8067fc700 1 --2- 172.21.15.79:0/1421839312 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd7f8029100 0x7fd7f802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:07.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.230 7fd8067fc700 1 -- 172.21.15.79:0/1421839312 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6053+0+0 (secure 0 0 0) 0x7fd80c0395c0 con 0x7fd8100bf300 2021-04-09T18:33:07.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.230 7fd815183700 1 --2- 172.21.15.79:0/1421839312 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd7f8029100 0x7fd7f802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:07.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.230 7fd815183700 1 --2- 172.21.15.79:0/1421839312 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd7f8029100 0x7fd7f802b650 crc :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:07.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.246 7fd817be0700 1 -- 172.21.15.79:0/1421839312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8100e39e0 con 0x7fd8100bf300 2021-04-09T18:33:07.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.254 7fd8067fc700 1 -- 172.21.15.79:0/1421839312 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd80c000bf0 con 0x7fd8100bf300 2021-04-09T18:33:07.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.434 7fd817be0700 1 -- 172.21.15.79:0/1421839312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blacklist ls", "format": "json"} v 0) v1 -- 0x7fd8100a1cc0 con 0x7fd8100bf300 2021-04-09T18:33:07.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.434 7fd8067fc700 1 -- 172.21.15.79:0/1421839312 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls", "format": "json"}]=0 listed 3 entries v70) v1 ==== 98+0+227 (secure 0 0 0) 0x7fd80c010d70 con 0x7fd8100bf300 2021-04-09T18:33:07.440 INFO:teuthology.orchestra.run.smithi079.stderr:listed 3 entries 2021-04-09T18:33:07.441 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:07.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.434 7fd817be0700 1 -- 172.21.15.79:0/1421839312 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd7f8029100 msgr2=0x7fd7f802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:07.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.434 7fd817be0700 1 --2- 172.21.15.79:0/1421839312 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd7f8029100 0x7fd7f802b650 crc :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:07.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.434 7fd817be0700 1 -- 172.21.15.79:0/1421839312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8100bf300 msgr2=0x7fd8100a2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:07.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.434 7fd817be0700 1 --2- 172.21.15.79:0/1421839312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8100bf300 0x7fd8100a2e90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7fd8100874d0 tx=0x7fd80c00e4b0).stop 2021-04-09T18:33:07.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.438 7fd817be0700 1 -- 172.21.15.79:0/1421839312 shutdown_connections 2021-04-09T18:33:07.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.438 7fd817be0700 1 --2- 172.21.15.79:0/1421839312 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd7f8029100 0x7fd7f802b650 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:07.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.438 7fd817be0700 1 --2- 172.21.15.79:0/1421839312 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd810099100 0x7fd8100c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:07.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.438 7fd817be0700 1 --2- 172.21.15.79:0/1421839312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8100bf300 0x7fd8100a2e90 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:07.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.438 7fd817be0700 1 --2- 172.21.15.79:0/1421839312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd810098cb0 0x7fd8100d5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:07.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.438 7fd817be0700 1 -- 172.21.15.79:0/1421839312 >> 172.21.15.79:0/1421839312 conn(0x7fd81009a540 msgr2=0x7fd8100d84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:07.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.438 7fd817be0700 1 -- 172.21.15.79:0/1421839312 shutdown_connections 2021-04-09T18:33:07.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.438 7fd817be0700 1 -- 172.21.15.79:0/1421839312 wait complete. 2021-04-09T18:33:07.452 INFO:teuthology.orchestra.run.smithi079.stdout:[{"addr":"172.21.15.90:0/30006489","until":"2021-04-09 19:33:00.902936"},{"addr":"172.21.15.89:6835/2729581928","until":"2021-04-10 18:32:14.953106"},{"addr":"172.21.15.89:6834/2729581928","until":"2021-04-10 18:32:14.953106"}] 2021-04-09T18:33:07.467 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-04-09T18:33:07.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:07.468 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:07.469 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:07.519 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:33:07.520 INFO:teuthology.orchestra.run.smithi090.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-04-09T18:33:07.521 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-04-09T18:33:07.521 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi090.front.sepia.ceph.com... 2021-04-09T18:33:07.521 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:33:07.522 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:07.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:07.617 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:07.617 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:07.624 INFO:teuthology.orchestra.run.smithi090.stdout:ext2/ext3 2021-04-09T18:33:07.625 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:33:07.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:33:07.626 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:07.672 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:33:07.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.762 7f5f2bc96700 1 Processor -- start 2021-04-09T18:33:07.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.762 7f5f2bc96700 1 -- start start 2021-04-09T18:33:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f2bc96700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5f241c9010 0x7f5f241cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f2bc96700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f240fbb10 con 0x7f5f240e9ad0 2021-04-09T18:33:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f2bc96700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2409f900 con 0x7f5f240f5510 2021-04-09T18:33:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f2bc96700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f241c3db0 con 0x7f5f241c9010 2021-04-09T18:33:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f29239700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5f240e9ad0 0x7f5f2409f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54682/0 (socket says 172.21.15.79:54682) 2021-04-09T18:33:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f29239700 1 -- 172.21.15.79:0/2965316529 learned_addr learned my addr 172.21.15.79:0/2965316529 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f2a23b700 1 --2- 172.21.15.79:0/2965316529 >> v2:172.21.15.89:3300/0 conn(0x7f5f241c9010 0x7f5f241cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:07.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f28a38700 1 -- 172.21.15.79:0/2965316529 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2376058463 0 0) 0x7f5f140010d0 con 0x7f5f240e9ad0 2021-04-09T18:33:07.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f28a38700 1 -- 172.21.15.79:0/2965316529 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f10003240 con 0x7f5f240e9ad0 2021-04-09T18:33:07.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f2a23b700 1 -- 172.21.15.79:0/2965316529 >> v1:172.21.15.89:6789/0 conn(0x7f5f240f5510 legacy=0x7f5f240f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:07.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f28a38700 1 -- 172.21.15.79:0/2965316529 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630909394 0 0) 0x7f5f200010d0 con 0x7f5f240f5510 2021-04-09T18:33:07.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f2a23b700 1 -- 172.21.15.79:0/2965316529 >> v1:172.21.15.79:6789/0 conn(0x7f5f240e9ad0 legacy=0x7f5f2409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:07.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f2a23b700 1 -- 172.21.15.79:0/2965316529 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f240e56c0 con 0x7f5f241c9010 2021-04-09T18:33:07.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f2a23b700 1 --2- 172.21.15.79:0/2965316529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f241c9010 0x7f5f241cb470 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f5f1c0032b0 tx=0x7f5f1c00b0e0).ready entity=mon.1 client_cookie=38feec626ca779bc server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:07.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f28a38700 1 -- 172.21.15.79:0/2965316529 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5f240e56c0 con 0x7f5f241c9010 2021-04-09T18:33:07.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f28a38700 1 -- 172.21.15.79:0/2965316529 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c00bab0 con 0x7f5f241c9010 2021-04-09T18:33:07.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f28a38700 1 -- 172.21.15.79:0/2965316529 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5f1c002020 con 0x7f5f241c9010 2021-04-09T18:33:07.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f2bc96700 1 -- 172.21.15.79:0/2965316529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f241c9010 msgr2=0x7f5f241cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:07.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f2bc96700 1 --2- 172.21.15.79:0/2965316529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f241c9010 0x7f5f241cb470 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f5f1c0032b0 tx=0x7f5f1c00b0e0).stop 2021-04-09T18:33:07.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f2bc96700 1 -- 172.21.15.79:0/2965316529 shutdown_connections 2021-04-09T18:33:07.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f2bc96700 1 --2- 172.21.15.79:0/2965316529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f241c9010 0x7f5f241cb470 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:07.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f2bc96700 1 -- 172.21.15.79:0/2965316529 >> 172.21.15.79:0/2965316529 conn(0x7f5f240e5fd0 msgr2=0x7f5f240e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:07.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f2bc96700 1 -- 172.21.15.79:0/2965316529 shutdown_connections 2021-04-09T18:33:07.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.766 7f5f2bc96700 1 -- 172.21.15.79:0/2965316529 wait complete. 2021-04-09T18:33:07.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.770 7f5f2bc96700 1 Processor -- start 2021-04-09T18:33:07.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.770 7f5f2bc96700 1 -- start start 2021-04-09T18:33:07.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f2bc96700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f240c4230 0x7f5f24096b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:07.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f2bc96700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f2419b9d0 0x7f5f240b9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:07.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f2bc96700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f240c6c80 0x7f5f240c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:07.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f2bc96700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f240e9f20 con 0x7f5f240c4230 2021-04-09T18:33:07.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f2bc96700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2419ca50 con 0x7f5f2419b9d0 2021-04-09T18:33:07.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f2bc96700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2419cd50 con 0x7f5f240c6c80 2021-04-09T18:33:07.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f29a3a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f240c4230 0x7f5f24096b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:07.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f29a3a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f240c4230 0x7f5f24096b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59976/0 (socket says 172.21.15.79:59976) 2021-04-09T18:33:07.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f29a3a700 1 -- 172.21.15.79:0/1609000773 learned_addr learned my addr 172.21.15.79:0/1609000773 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:07.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f29239700 1 --2- 172.21.15.79:0/1609000773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f2419b9d0 0x7f5f240b9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:07.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f2a23b700 1 --2- 172.21.15.79:0/1609000773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f240c6c80 0x7f5f240c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:07.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f29a3a700 1 -- 172.21.15.79:0/1609000773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f240c6c80 msgr2=0x7f5f240c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:07.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f29a3a700 1 --2- 172.21.15.79:0/1609000773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f240c6c80 0x7f5f240c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:07.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f29a3a700 1 -- 172.21.15.79:0/1609000773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f2419b9d0 msgr2=0x7f5f240b9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:07.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f29a3a700 1 --2- 172.21.15.79:0/1609000773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f2419b9d0 0x7f5f240b9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:07.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f29a3a700 1 -- 172.21.15.79:0/1609000773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f240b9d40 con 0x7f5f240c4230 2021-04-09T18:33:07.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f29a3a700 1 --2- 172.21.15.79:0/1609000773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f240c4230 0x7f5f24096b20 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f5f240bb1d0 tx=0x7f5f2000cb60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:07.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f1a7fc700 1 -- 172.21.15.79:0/1609000773 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5f240b9d40 con 0x7f5f240c4230 2021-04-09T18:33:07.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f1a7fc700 1 -- 172.21.15.79:0/1609000773 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2000e4a0 con 0x7f5f240c4230 2021-04-09T18:33:07.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f2bc96700 1 -- 172.21.15.79:0/1609000773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2419be20 con 0x7f5f240c4230 2021-04-09T18:33:07.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f1a7fc700 1 -- 172.21.15.79:0/1609000773 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5f2000e870 con 0x7f5f240c4230 2021-04-09T18:33:07.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f2bc96700 1 -- 172.21.15.79:0/1609000773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f240c7700 con 0x7f5f240c4230 2021-04-09T18:33:07.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f1a7fc700 1 -- 172.21.15.79:0/1609000773 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5f2001a020 con 0x7f5f240c4230 2021-04-09T18:33:07.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f1a7fc700 1 --2- 172.21.15.79:0/1609000773 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5f0c029100 0x7f5f0c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:07.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f1a7fc700 1 -- 172.21.15.79:0/1609000773 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f5f200393a0 con 0x7f5f240c4230 2021-04-09T18:33:07.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.774 7f5f29239700 1 --2- 172.21.15.79:0/1609000773 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5f0c029100 0x7f5f0c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:07.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.778 7f5f2bc96700 1 -- 172.21.15.79:0/1609000773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f240e39d0 con 0x7f5f240c4230 2021-04-09T18:33:07.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.778 7f5f29239700 1 --2- 172.21.15.79:0/1609000773 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5f0c029100 0x7f5f0c02b650 crc :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:07.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.782 7f5f1a7fc700 1 -- 172.21.15.79:0/1609000773 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5f20000bf0 con 0x7f5f240c4230 2021-04-09T18:33:07.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.946 7f5f2bc96700 1 -- 172.21.15.79:0/1609000773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f240a1cb0 con 0x7f5f240c4230 2021-04-09T18:33:07.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.950 7f5f1a7fc700 1 -- 172.21.15.79:0/1609000773 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+14403 (secure 0 0 0) 0x7f5f2000e290 con 0x7f5f240c4230 2021-04-09T18:33:07.956 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:07.957 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":70,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:33:01.127167","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:32:13.133609","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2021-04-09 18:32:13.943877","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.90:0/30006489":"2021-04-09 19:33:00.902936","172.21.15.89:6835/2729581928":"2021-04-10 18:32:14.953106","172.21.15.89:6834/2729581928":"2021-04-10 18:32:14.953106"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:33:07.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.954 7f5f2bc96700 1 -- 172.21.15.79:0/1609000773 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5f0c029100 msgr2=0x7f5f0c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:07.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.954 7f5f2bc96700 1 --2- 172.21.15.79:0/1609000773 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5f0c029100 0x7f5f0c02b650 crc :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:07.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.954 7f5f2bc96700 1 -- 172.21.15.79:0/1609000773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f240c4230 msgr2=0x7f5f24096b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:07.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.954 7f5f2bc96700 1 --2- 172.21.15.79:0/1609000773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f240c4230 0x7f5f24096b20 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f5f240bb1d0 tx=0x7f5f2000cb60).stop 2021-04-09T18:33:07.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.954 7f5f2bc96700 1 -- 172.21.15.79:0/1609000773 shutdown_connections 2021-04-09T18:33:07.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.954 7f5f2bc96700 1 --2- 172.21.15.79:0/1609000773 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5f0c029100 0x7f5f0c02b650 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:07.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.954 7f5f2bc96700 1 --2- 172.21.15.79:0/1609000773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f240c6c80 0x7f5f240c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:07.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.954 7f5f2bc96700 1 --2- 172.21.15.79:0/1609000773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f240c4230 0x7f5f24096b20 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:07.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.954 7f5f2bc96700 1 --2- 172.21.15.79:0/1609000773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f2419b9d0 0x7f5f240b9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:07.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.954 7f5f2bc96700 1 -- 172.21.15.79:0/1609000773 >> 172.21.15.79:0/1609000773 conn(0x7f5f2409b070 msgr2=0x7f5f2409a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:07.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.954 7f5f2bc96700 1 -- 172.21.15.79:0/1609000773 shutdown_connections 2021-04-09T18:33:07.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:07.954 7f5f2bc96700 1 -- 172.21.15.79:0/1609000773 wait complete. 2021-04-09T18:33:07.969 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:32:13.133609', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:32:13.943877', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:33:07.970 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:33:08.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17d2981700 1 Processor -- start 2021-04-09T18:33:08.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17d2981700 1 -- start start 2021-04-09T18:33:08.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17d2981700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17cc0e9b10 0x7f17cc09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17d2981700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f17cc1c8040 0x7f17cc1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17d2981700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17cc0fbb50 con 0x7f17cc0f5550 2021-04-09T18:33:08.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17d2981700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17cc1c3df0 con 0x7f17cc1c8040 2021-04-09T18:33:08.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17d2981700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc0e9f60 con 0x7f17cc0e9b10 2021-04-09T18:33:08.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17d0f26700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f17cc1c8040 0x7f17cc1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17cbfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f17cc0f5550 0x7f17cc0f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54696/0 (socket says 172.21.15.79:54696) 2021-04-09T18:33:08.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17d0f26700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f17cc1c8040 0x7f17cc1ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59988/0 (socket says 172.21.15.79:59988) 2021-04-09T18:33:08.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17cbfff700 1 -- 172.21.15.79:0/4008982908 learned_addr learned my addr 172.21.15.79:0/4008982908 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:08.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17cb7fe700 1 --2- 172.21.15.79:0/4008982908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17cc0e9b10 0x7f17cc09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17d0f26700 1 -- 172.21.15.79:0/4008982908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17cc0e9b10 msgr2=0x7f17cc09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:08.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17d0f26700 1 --2- 172.21.15.79:0/4008982908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17cc0e9b10 0x7f17cc09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17d0f26700 1 -- 172.21.15.79:0/4008982908 >> v1:172.21.15.79:6789/0 conn(0x7f17cc0f5550 legacy=0x7f17cc0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17caffd700 1 -- 172.21.15.79:0/4008982908 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2298302178 0 0) 0x7f17bc0010d0 con 0x7f17cc0f5550 2021-04-09T18:33:08.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17d0f26700 1 -- 172.21.15.79:0/4008982908 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc0e5700 con 0x7f17cc1c8040 2021-04-09T18:33:08.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17d0f26700 1 --2- 172.21.15.79:0/4008982908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc1c8040 0x7f17cc1ca4a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f17c4002f30 tx=0x7f17c400bd40).ready entity=mon.0 client_cookie=f16c710dc736a1d3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:08.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17caffd700 1 -- 172.21.15.79:0/4008982908 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f17cc0e5700 con 0x7f17cc1c8040 2021-04-09T18:33:08.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17caffd700 1 -- 172.21.15.79:0/4008982908 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c4009850 con 0x7f17cc1c8040 2021-04-09T18:33:08.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17caffd700 1 -- 172.21.15.79:0/4008982908 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f17c4009c20 con 0x7f17cc1c8040 2021-04-09T18:33:08.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17d2981700 1 -- 172.21.15.79:0/4008982908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc1c8040 msgr2=0x7f17cc1ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.070 7f17d2981700 1 --2- 172.21.15.79:0/4008982908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc1c8040 0x7f17cc1ca4a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f17c4002f30 tx=0x7f17c400bd40).stop 2021-04-09T18:33:08.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.074 7f17d2981700 1 -- 172.21.15.79:0/4008982908 shutdown_connections 2021-04-09T18:33:08.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.074 7f17d2981700 1 --2- 172.21.15.79:0/4008982908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc1c8040 0x7f17cc1ca4a0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.074 7f17d2981700 1 --2- 172.21.15.79:0/4008982908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17cc0e9b10 0x7f17cc09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.074 7f17d2981700 1 -- 172.21.15.79:0/4008982908 >> 172.21.15.79:0/4008982908 conn(0x7f17cc0e6010 msgr2=0x7f17cc0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:08.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.074 7f17d2981700 1 -- 172.21.15.79:0/4008982908 shutdown_connections 2021-04-09T18:33:08.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.074 7f17d2981700 1 -- 172.21.15.79:0/4008982908 wait complete. 2021-04-09T18:33:08.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17d2981700 1 Processor -- start 2021-04-09T18:33:08.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17d2981700 1 -- start start 2021-04-09T18:33:08.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17d2981700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17cc0cf760 0x7f17cc0cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17d2981700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc1a7090 0x7f17cc1a74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17d2981700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17cc0949e0 0x7f17cc094e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17d2981700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc0d5d90 con 0x7f17cc1a7090 2021-04-09T18:33:08.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17d2981700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc0d6090 con 0x7f17cc0949e0 2021-04-09T18:33:08.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17d2981700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc1a7b10 con 0x7f17cc0cf760 2021-04-09T18:33:08.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17cb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc1a7090 0x7f17cc1a74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17cb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc1a7090 0x7f17cc1a74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59992/0 (socket says 172.21.15.79:59992) 2021-04-09T18:33:08.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17cb7fe700 1 -- 172.21.15.79:0/1780003405 learned_addr learned my addr 172.21.15.79:0/1780003405 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:08.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17cbfff700 1 --2- 172.21.15.79:0/1780003405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17cc0cf760 0x7f17cc0cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17d0f26700 1 --2- 172.21.15.79:0/1780003405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17cc0949e0 0x7f17cc094e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17cb7fe700 1 -- 172.21.15.79:0/1780003405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17cc0cf760 msgr2=0x7f17cc0cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17cb7fe700 1 --2- 172.21.15.79:0/1780003405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17cc0cf760 0x7f17cc0cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17cb7fe700 1 -- 172.21.15.79:0/1780003405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17cc0949e0 msgr2=0x7f17cc094e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17cb7fe700 1 --2- 172.21.15.79:0/1780003405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17cc0949e0 0x7f17cc094e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17cb7fe700 1 -- 172.21.15.79:0/1780003405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc1a4d50 con 0x7f17cc1a7090 2021-04-09T18:33:08.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17cb7fe700 1 --2- 172.21.15.79:0/1780003405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc1a7090 0x7f17cc1a74e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f17cc0d37f0 tx=0x7f17b400c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:08.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17c8ff9700 1 -- 172.21.15.79:0/1780003405 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f17cc1a4d50 con 0x7f17cc1a7090 2021-04-09T18:33:08.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17c8ff9700 1 -- 172.21.15.79:0/1780003405 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b400cca0 con 0x7f17cc1a7090 2021-04-09T18:33:08.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17d2981700 1 -- 172.21.15.79:0/1780003405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17cc095460 con 0x7f17cc1a7090 2021-04-09T18:33:08.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17c8ff9700 1 -- 172.21.15.79:0/1780003405 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f17b400f040 con 0x7f17cc1a7090 2021-04-09T18:33:08.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.078 7f17d2981700 1 -- 172.21.15.79:0/1780003405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17cc0a9a50 con 0x7f17cc1a7090 2021-04-09T18:33:08.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.082 7f17c8ff9700 1 -- 172.21.15.79:0/1780003405 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f17b4022060 con 0x7f17cc1a7090 2021-04-09T18:33:08.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.082 7f17c8ff9700 1 --2- 172.21.15.79:0/1780003405 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f17b0029100 0x7f17b002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.082 7f17c8ff9700 1 -- 172.21.15.79:0/1780003405 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f17b4010040 con 0x7f17cc1a7090 2021-04-09T18:33:08.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.082 7f17cbfff700 1 --2- 172.21.15.79:0/1780003405 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f17b0029100 0x7f17b002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.082 7f17cbfff700 1 --2- 172.21.15.79:0/1780003405 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f17b0029100 0x7f17b002b650 crc :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:08.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.082 7f17d2981700 1 -- 172.21.15.79:0/1780003405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17cc0e39f0 con 0x7f17cc1a7090 2021-04-09T18:33:08.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.090 7f17c8ff9700 1 -- 172.21.15.79:0/1780003405 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f17b400ca90 con 0x7f17cc1a7090 2021-04-09T18:33:08.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.254 7f17d2981700 1 -- 172.21.15.79:0/1780003405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f17cc0f5b50 con 0x7f17cc1a7090 2021-04-09T18:33:08.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.254 7f17c8ff9700 1 -- 172.21.15.79:0/1780003405 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v70) v1 ==== 92+0+10 (secure 0 0 0) 0x7f17b4000f70 con 0x7f17cc1a7090 2021-04-09T18:33:08.261 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:33:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.258 7f17d2981700 1 -- 172.21.15.79:0/1780003405 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f17b0029100 msgr2=0x7f17b002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.258 7f17d2981700 1 --2- 172.21.15.79:0/1780003405 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f17b0029100 0x7f17b002b650 crc :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.258 7f17d2981700 1 -- 172.21.15.79:0/1780003405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc1a7090 msgr2=0x7f17cc1a74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.258 7f17d2981700 1 --2- 172.21.15.79:0/1780003405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc1a7090 0x7f17cc1a74e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f17cc0d37f0 tx=0x7f17b400c430).stop 2021-04-09T18:33:08.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.258 7f17d2981700 1 -- 172.21.15.79:0/1780003405 shutdown_connections 2021-04-09T18:33:08.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.258 7f17d2981700 1 --2- 172.21.15.79:0/1780003405 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f17b0029100 0x7f17b002b650 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.258 7f17d2981700 1 --2- 172.21.15.79:0/1780003405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17cc0949e0 0x7f17cc094e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.258 7f17d2981700 1 --2- 172.21.15.79:0/1780003405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17cc0cf760 0x7f17cc0cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.258 7f17d2981700 1 --2- 172.21.15.79:0/1780003405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc1a7090 0x7f17cc1a74e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.258 7f17d2981700 1 -- 172.21.15.79:0/1780003405 >> 172.21.15.79:0/1780003405 conn(0x7f17cc091ee0 msgr2=0x7f17cc08eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:08.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.258 7f17d2981700 1 -- 172.21.15.79:0/1780003405 shutdown_connections 2021-04-09T18:33:08.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.258 7f17d2981700 1 -- 172.21.15.79:0/1780003405 wait complete. 2021-04-09T18:33:08.273 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:33:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.362 7fb4dff67700 1 Processor -- start 2021-04-09T18:33:08.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.362 7fb4dff67700 1 -- start start 2021-04-09T18:33:08.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.362 7fb4dff67700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb4d80f5550 0x7fb4d80f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.362 7fb4dff67700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb4d80e9b10 0x7fb4d809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.362 7fb4dff67700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d80fbb50 con 0x7fb4d81c2de0 2021-04-09T18:33:08.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.362 7fb4dff67700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d80e9f60 con 0x7fb4d80f5550 2021-04-09T18:33:08.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.362 7fb4dff67700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d80e5a00 con 0x7fb4d80e9b10 2021-04-09T18:33:08.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.362 7fb4ddd0b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb4d80f5550 0x7fb4d80f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.362 7fb4de50c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb4d81c2de0 0x7fb4d81c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54712/0 (socket says 172.21.15.79:54712) 2021-04-09T18:33:08.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.362 7fb4de50c700 1 -- 172.21.15.79:0/1084008727 learned_addr learned my addr 172.21.15.79:0/1084008727 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:08.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.362 7fb4dd50a700 1 --2- 172.21.15.79:0/1084008727 >> v2:172.21.15.89:3300/0 conn(0x7fb4d80e9b10 0x7fb4d809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.362 7fb4dcd09700 1 -- 172.21.15.79:0/1084008727 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755157657 0 0) 0x7fb4d0001450 con 0x7fb4d81c2de0 2021-04-09T18:33:08.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.362 7fb4dcd09700 1 -- 172.21.15.79:0/1084008727 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4c4003240 con 0x7fb4d81c2de0 2021-04-09T18:33:08.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.362 7fb4ddd0b700 1 -- 172.21.15.79:0/1084008727 >> v2:172.21.15.89:3300/0 conn(0x7fb4d80e9b10 msgr2=0x7fb4d809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:08.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.362 7fb4ddd0b700 1 --2- 172.21.15.79:0/1084008727 >> v2:172.21.15.89:3300/0 conn(0x7fb4d80e9b10 0x7fb4d809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.362 7fb4ddd0b700 1 -- 172.21.15.79:0/1084008727 >> v1:172.21.15.79:6789/0 conn(0x7fb4d81c2de0 legacy=0x7fb4d81c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.362 7fb4dcd09700 1 -- 172.21.15.79:0/1084008727 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 16402577 0 0) 0x7fb4d00019d0 con 0x7fb4d81c2de0 2021-04-09T18:33:08.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.366 7fb4ddd0b700 1 -- 172.21.15.79:0/1084008727 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d80e5700 con 0x7fb4d80f5550 2021-04-09T18:33:08.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.366 7fb4ddd0b700 1 --2- 172.21.15.79:0/1084008727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4d80f5550 0x7fb4d80f64e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7fb4d0002170 tx=0x7fb4cc00bd10).ready entity=mon.0 client_cookie=d241eabc822ef34 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:08.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.366 7fb4dcd09700 1 -- 172.21.15.79:0/1084008727 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4d80e5700 con 0x7fb4d80f5550 2021-04-09T18:33:08.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.366 7fb4dcd09700 1 -- 172.21.15.79:0/1084008727 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4cc009710 con 0x7fb4d80f5550 2021-04-09T18:33:08.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.366 7fb4dcd09700 1 -- 172.21.15.79:0/1084008727 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4d0001f30 con 0x7fb4d80f5550 2021-04-09T18:33:08.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.366 7fb4dff67700 1 -- 172.21.15.79:0/1084008727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4d80f5550 msgr2=0x7fb4d80f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.366 7fb4dff67700 1 --2- 172.21.15.79:0/1084008727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4d80f5550 0x7fb4d80f64e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7fb4d0002170 tx=0x7fb4cc00bd10).stop 2021-04-09T18:33:08.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.366 7fb4dff67700 1 -- 172.21.15.79:0/1084008727 shutdown_connections 2021-04-09T18:33:08.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.366 7fb4dff67700 1 --2- 172.21.15.79:0/1084008727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4d80f5550 0x7fb4d80f64e0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.366 7fb4dff67700 1 --2- 172.21.15.79:0/1084008727 >> v2:172.21.15.89:3300/0 conn(0x7fb4d80e9b10 0x7fb4d809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.366 7fb4dff67700 1 -- 172.21.15.79:0/1084008727 >> 172.21.15.79:0/1084008727 conn(0x7fb4d80e6010 msgr2=0x7fb4d80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:08.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.366 7fb4dff67700 1 -- 172.21.15.79:0/1084008727 shutdown_connections 2021-04-09T18:33:08.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.366 7fb4dff67700 1 -- 172.21.15.79:0/1084008727 wait complete. 2021-04-09T18:33:08.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.366 7fb4dff67700 1 Processor -- start 2021-04-09T18:33:08.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.366 7fb4dff67700 1 -- start start 2021-04-09T18:33:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4dff67700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4d80af170 0x7fb4d819ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4dff67700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4d81c0070 0x7fb4d81c04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4dff67700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4d80986f0 0x7fb4d8098b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4dff67700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d80983f0 con 0x7fb4d80986f0 2021-04-09T18:33:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4dff67700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d81ae470 con 0x7fb4d80af170 2021-04-09T18:33:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4dff67700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d81a0c40 con 0x7fb4d81c0070 2021-04-09T18:33:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4de50c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4d80986f0 0x7fb4d8098b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4de50c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4d80986f0 0x7fb4d8098b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60006/0 (socket says 172.21.15.79:60006) 2021-04-09T18:33:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4de50c700 1 -- 172.21.15.79:0/4017962511 learned_addr learned my addr 172.21.15.79:0/4017962511 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4dd50a700 1 --2- 172.21.15.79:0/4017962511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4d81c0070 0x7fb4d81c04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4ddd0b700 1 --2- 172.21.15.79:0/4017962511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4d80af170 0x7fb4d819ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4de50c700 1 -- 172.21.15.79:0/4017962511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4d81c0070 msgr2=0x7fb4d81c04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4de50c700 1 --2- 172.21.15.79:0/4017962511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4d81c0070 0x7fb4d81c04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4de50c700 1 -- 172.21.15.79:0/4017962511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4d80af170 msgr2=0x7fb4d819ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4de50c700 1 --2- 172.21.15.79:0/4017962511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4d80af170 0x7fb4d819ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4de50c700 1 -- 172.21.15.79:0/4017962511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d819f580 con 0x7fb4d80986f0 2021-04-09T18:33:08.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4de50c700 1 --2- 172.21.15.79:0/4017962511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4d80986f0 0x7fb4d8098b40 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7fb4d0007cf0 tx=0x7fb4d000ce30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:08.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4ca7fc700 1 -- 172.21.15.79:0/4017962511 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4d819f580 con 0x7fb4d80986f0 2021-04-09T18:33:08.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4ca7fc700 1 -- 172.21.15.79:0/4017962511 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d0007170 con 0x7fb4d80986f0 2021-04-09T18:33:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4dff67700 1 -- 172.21.15.79:0/4017962511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d8096890 con 0x7fb4d80986f0 2021-04-09T18:33:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4ca7fc700 1 -- 172.21.15.79:0/4017962511 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4d0007540 con 0x7fb4d80986f0 2021-04-09T18:33:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4dff67700 1 -- 172.21.15.79:0/4017962511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d8096d70 con 0x7fb4d80986f0 2021-04-09T18:33:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4ca7fc700 1 -- 172.21.15.79:0/4017962511 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb4d0007740 con 0x7fb4d80986f0 2021-04-09T18:33:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4ca7fc700 1 --2- 172.21.15.79:0/4017962511 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb4c0029100 0x7fb4c002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4ca7fc700 1 -- 172.21.15.79:0/4017962511 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6053+0+0 (secure 0 0 0) 0x7fb4d003b2a0 con 0x7fb4d80986f0 2021-04-09T18:33:08.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.370 7fb4ddd0b700 1 --2- 172.21.15.79:0/4017962511 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb4c0029100 0x7fb4c002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.374 7fb4ddd0b700 1 --2- 172.21.15.79:0/4017962511 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb4c0029100 0x7fb4c002b650 crc :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:08.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.378 7fb4dff67700 1 -- 172.21.15.79:0/4017962511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d80e39f0 con 0x7fb4d80986f0 2021-04-09T18:33:08.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.386 7fb4ca7fc700 1 -- 172.21.15.79:0/4017962511 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb4d80f76f0 con 0x7fb4d80986f0 2021-04-09T18:33:08.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.546 7fb4dff67700 1 -- 172.21.15.79:0/4017962511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fb4d80f5b50 con 0x7fb4d80986f0 2021-04-09T18:33:08.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.546 7fb4ca7fc700 1 -- 172.21.15.79:0/4017962511 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v70) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb4d0004a50 con 0x7fb4d80986f0 2021-04-09T18:33:08.553 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:33:08.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.546 7fb4dff67700 1 -- 172.21.15.79:0/4017962511 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb4c0029100 msgr2=0x7fb4c002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.546 7fb4dff67700 1 --2- 172.21.15.79:0/4017962511 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb4c0029100 0x7fb4c002b650 crc :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.546 7fb4dff67700 1 -- 172.21.15.79:0/4017962511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4d80986f0 msgr2=0x7fb4d8098b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.546 7fb4dff67700 1 --2- 172.21.15.79:0/4017962511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4d80986f0 0x7fb4d8098b40 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7fb4d0007cf0 tx=0x7fb4d000ce30).stop 2021-04-09T18:33:08.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.546 7fb4dff67700 1 -- 172.21.15.79:0/4017962511 shutdown_connections 2021-04-09T18:33:08.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.546 7fb4dff67700 1 --2- 172.21.15.79:0/4017962511 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb4c0029100 0x7fb4c002b650 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.546 7fb4dff67700 1 --2- 172.21.15.79:0/4017962511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4d80af170 0x7fb4d819ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.546 7fb4dff67700 1 --2- 172.21.15.79:0/4017962511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4d80986f0 0x7fb4d8098b40 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.546 7fb4dff67700 1 --2- 172.21.15.79:0/4017962511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4d81c0070 0x7fb4d81c04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.546 7fb4dff67700 1 -- 172.21.15.79:0/4017962511 >> 172.21.15.79:0/4017962511 conn(0x7fb4d809a340 msgr2=0x7fb4d80d86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:08.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.550 7fb4dff67700 1 -- 172.21.15.79:0/4017962511 shutdown_connections 2021-04-09T18:33:08.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.550 7fb4dff67700 1 -- 172.21.15.79:0/4017962511 wait complete. 2021-04-09T18:33:08.564 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:33:08.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.650 7fd0a6c3a700 1 Processor -- start 2021-04-09T18:33:08.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.650 7fd0a6c3a700 1 -- start start 2021-04-09T18:33:08.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.650 7fd0a6c3a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd0a00f5550 0x7fd0a00f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.650 7fd0a6c3a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a01c8040 0x7fd0a01ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.650 7fd0a6c3a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a00fbb50 con 0x7fd0a00e9b10 2021-04-09T18:33:08.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.650 7fd0a6c3a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a00e9f60 con 0x7fd0a00f5550 2021-04-09T18:33:08.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.650 7fd0a6c3a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a01c3df0 con 0x7fd0a01c8040 2021-04-09T18:33:08.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd0a49de700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd0a00f5550 0x7fd0a00f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd0a51df700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a01c8040 0x7fd0a01ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd09ffff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd0a00e9b10 0x7fd0a009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:55194/0 (socket says 172.21.15.79:55194) 2021-04-09T18:33:08.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd09ffff700 1 -- 172.21.15.79:0/3336351284 learned_addr learned my addr 172.21.15.79:0/3336351284 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:08.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd0a49de700 1 -- 172.21.15.79:0/3336351284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a01c8040 msgr2=0x7fd0a01ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:08.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd0a49de700 1 --2- 172.21.15.79:0/3336351284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a01c8040 0x7fd0a01ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd0a49de700 1 -- 172.21.15.79:0/3336351284 >> v1:172.21.15.89:6789/0 conn(0x7fd0a00e9b10 legacy=0x7fd0a009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd09f7fe700 1 -- 172.21.15.79:0/3336351284 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3395750577 0 0) 0x7fd0900010d0 con 0x7fd0a00e9b10 2021-04-09T18:33:08.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd0a49de700 1 -- 172.21.15.79:0/3336351284 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a009f910 con 0x7fd0a00f5550 2021-04-09T18:33:08.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd0a51df700 1 --2- 172.21.15.79:0/3336351284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a01c8040 0x7fd0a01ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:08.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd0a49de700 1 --2- 172.21.15.79:0/3336351284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a00f5550 0x7fd0a00f64e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fd0a00f6f30 tx=0x7fd09400bd70).ready entity=mon.1 client_cookie=29ab28242104b472 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:08.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd09f7fe700 1 -- 172.21.15.79:0/3336351284 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0a009f910 con 0x7fd0a00f5550 2021-04-09T18:33:08.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd09f7fe700 1 -- 172.21.15.79:0/3336351284 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd094009810 con 0x7fd0a00f5550 2021-04-09T18:33:08.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd09f7fe700 1 -- 172.21.15.79:0/3336351284 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd094009be0 con 0x7fd0a00f5550 2021-04-09T18:33:08.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd0a6c3a700 1 -- 172.21.15.79:0/3336351284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a00f5550 msgr2=0x7fd0a00f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd0a6c3a700 1 --2- 172.21.15.79:0/3336351284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a00f5550 0x7fd0a00f64e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fd0a00f6f30 tx=0x7fd09400bd70).stop 2021-04-09T18:33:08.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd0a6c3a700 1 -- 172.21.15.79:0/3336351284 shutdown_connections 2021-04-09T18:33:08.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd0a6c3a700 1 --2- 172.21.15.79:0/3336351284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a01c8040 0x7fd0a01ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd0a6c3a700 1 --2- 172.21.15.79:0/3336351284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a00f5550 0x7fd0a00f64e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd0a6c3a700 1 -- 172.21.15.79:0/3336351284 >> 172.21.15.79:0/3336351284 conn(0x7fd0a00e6010 msgr2=0x7fd0a00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:08.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd0a6c3a700 1 -- 172.21.15.79:0/3336351284 shutdown_connections 2021-04-09T18:33:08.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.654 7fd0a6c3a700 1 -- 172.21.15.79:0/3336351284 wait complete. 2021-04-09T18:33:08.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd0a6c3a700 1 Processor -- start 2021-04-09T18:33:08.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd0a6c3a700 1 -- start start 2021-04-09T18:33:08.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd0a6c3a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a00d2dd0 0x7fd0a00d3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd0a6c3a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0a0099870 0x7fd0a0099cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd0a6c3a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a00973c0 0x7fd0a0097810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd0a6c3a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a01a0690 con 0x7fd0a0099870 2021-04-09T18:33:08.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd0a6c3a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a019fb20 con 0x7fd0a00d2dd0 2021-04-09T18:33:08.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd0a6c3a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a019ff20 con 0x7fd0a00973c0 2021-04-09T18:33:08.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd09ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0a0099870 0x7fd0a0099cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd09ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0a0099870 0x7fd0a0099cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60018/0 (socket says 172.21.15.79:60018) 2021-04-09T18:33:08.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd09ffff700 1 -- 172.21.15.79:0/744273990 learned_addr learned my addr 172.21.15.79:0/744273990 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:08.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd0a49de700 1 --2- 172.21.15.79:0/744273990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a00d2dd0 0x7fd0a00d3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd0a51df700 1 --2- 172.21.15.79:0/744273990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a00973c0 0x7fd0a0097810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd09ffff700 1 -- 172.21.15.79:0/744273990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a00973c0 msgr2=0x7fd0a0097810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd09ffff700 1 --2- 172.21.15.79:0/744273990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a00973c0 0x7fd0a0097810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd09ffff700 1 -- 172.21.15.79:0/744273990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a00d2dd0 msgr2=0x7fd0a00d3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd09ffff700 1 --2- 172.21.15.79:0/744273990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a00d2dd0 0x7fd0a00d3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd09ffff700 1 -- 172.21.15.79:0/744273990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a009a2f0 con 0x7fd0a0099870 2021-04-09T18:33:08.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd0a51df700 1 --2- 172.21.15.79:0/744273990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a00973c0 0x7fd0a0097810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:33:08.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd09ffff700 1 --2- 172.21.15.79:0/744273990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0a0099870 0x7fd0a0099cc0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7fd090000b80 tx=0x7fd09000cb00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:08.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd09d7fa700 1 -- 172.21.15.79:0/744273990 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0a009a2f0 con 0x7fd0a0099870 2021-04-09T18:33:08.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd09d7fa700 1 -- 172.21.15.79:0/744273990 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd090007320 con 0x7fd0a0099870 2021-04-09T18:33:08.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd0a6c3a700 1 -- 172.21.15.79:0/744273990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a0097e40 con 0x7fd0a0099870 2021-04-09T18:33:08.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd09d7fa700 1 -- 172.21.15.79:0/744273990 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0900057e0 con 0x7fd0a0099870 2021-04-09T18:33:08.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd0a6c3a700 1 -- 172.21.15.79:0/744273990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a00982f0 con 0x7fd0a0099870 2021-04-09T18:33:08.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.658 7fd09d7fa700 1 -- 172.21.15.79:0/744273990 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd09001a020 con 0x7fd0a0099870 2021-04-09T18:33:08.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.662 7fd09d7fa700 1 --2- 172.21.15.79:0/744273990 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd080029100 0x7fd08002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.662 7fd09d7fa700 1 -- 172.21.15.79:0/744273990 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6053+0+0 (secure 0 0 0) 0x7fd090039300 con 0x7fd0a0099870 2021-04-09T18:33:08.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.662 7fd0a49de700 1 --2- 172.21.15.79:0/744273990 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd080029100 0x7fd08002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.662 7fd0a49de700 1 --2- 172.21.15.79:0/744273990 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd080029100 0x7fd08002b650 crc :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:08.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.666 7fd0a6c3a700 1 -- 172.21.15.79:0/744273990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a00e39f0 con 0x7fd0a0099870 2021-04-09T18:33:08.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.674 7fd09d7fa700 1 -- 172.21.15.79:0/744273990 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd090007110 con 0x7fd0a0099870 2021-04-09T18:33:08.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.826 7fd0a6c3a700 1 -- 172.21.15.79:0/744273990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fd0a00f5b50 con 0x7fd0a0099870 2021-04-09T18:33:08.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.830 7fd09d7fa700 1 -- 172.21.15.79:0/744273990 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v70) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd0a00e5cd0 con 0x7fd0a0099870 2021-04-09T18:33:08.835 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:33:08.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.830 7fd0a6c3a700 1 -- 172.21.15.79:0/744273990 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd080029100 msgr2=0x7fd08002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.830 7fd0a6c3a700 1 --2- 172.21.15.79:0/744273990 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd080029100 0x7fd08002b650 crc :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.830 7fd0a6c3a700 1 -- 172.21.15.79:0/744273990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0a0099870 msgr2=0x7fd0a0099cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.830 7fd0a6c3a700 1 --2- 172.21.15.79:0/744273990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0a0099870 0x7fd0a0099cc0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7fd090000b80 tx=0x7fd09000cb00).stop 2021-04-09T18:33:08.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.830 7fd0a6c3a700 1 -- 172.21.15.79:0/744273990 shutdown_connections 2021-04-09T18:33:08.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.830 7fd0a6c3a700 1 --2- 172.21.15.79:0/744273990 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd080029100 0x7fd08002b650 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.830 7fd0a6c3a700 1 --2- 172.21.15.79:0/744273990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a00d2dd0 0x7fd0a00d3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.830 7fd0a6c3a700 1 --2- 172.21.15.79:0/744273990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a00973c0 0x7fd0a0097810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.830 7fd0a6c3a700 1 --2- 172.21.15.79:0/744273990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0a0099870 0x7fd0a0099cc0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.830 7fd0a6c3a700 1 -- 172.21.15.79:0/744273990 >> 172.21.15.79:0/744273990 conn(0x7fd0a00ac900 msgr2=0x7fd0a00d8200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:08.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.830 7fd0a6c3a700 1 -- 172.21.15.79:0/744273990 shutdown_connections 2021-04-09T18:33:08.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.830 7fd0a6c3a700 1 -- 172.21.15.79:0/744273990 wait complete. 2021-04-09T18:33:08.851 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:33:08.852 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:08.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.934 7f0e79097700 1 Processor -- start 2021-04-09T18:33:08.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.934 7f0e79097700 1 -- start start 2021-04-09T18:33:08.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.934 7f0e79097700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0e740f5510 0x7f0e740f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.934 7f0e79097700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e741c8000 0x7f0e741ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.934 7f0e79097700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e740fbb10 con 0x7f0e740e9ad0 2021-04-09T18:33:08.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.934 7f0e79097700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e740e9f20 con 0x7f0e740f5510 2021-04-09T18:33:08.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.934 7f0e79097700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e741c3db0 con 0x7f0e741c8000 2021-04-09T18:33:08.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.934 7f0e7259c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0e740e9ad0 0x7f0e7409f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54736/0 (socket says 172.21.15.79:54736) 2021-04-09T18:33:08.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.934 7f0e7259c700 1 -- 172.21.15.79:0/265195738 learned_addr learned my addr 172.21.15.79:0/265195738 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:08.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e72d9d700 1 --2- 172.21.15.79:0/265195738 >> v2:172.21.15.89:3300/0 conn(0x7f0e740f5510 0x7f0e740f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e7359e700 1 --2- 172.21.15.79:0/265195738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e741c8000 0x7f0e741ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e71d9b700 1 -- 172.21.15.79:0/265195738 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625518359 0 0) 0x7f0e5c0010d0 con 0x7f0e740e9ad0 2021-04-09T18:33:08.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e71d9b700 1 -- 172.21.15.79:0/265195738 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e60003240 con 0x7f0e740e9ad0 2021-04-09T18:33:08.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e71d9b700 1 -- 172.21.15.79:0/265195738 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2227376076 0 0) 0x7f0e5c001650 con 0x7f0e740e9ad0 2021-04-09T18:33:08.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e71d9b700 1 -- 172.21.15.79:0/265195738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e741c8000 msgr2=0x7f0e741ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:08.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e71d9b700 1 --2- 172.21.15.79:0/265195738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e741c8000 0x7f0e741ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e71d9b700 1 -- 172.21.15.79:0/265195738 >> v2:172.21.15.89:3300/0 conn(0x7f0e740f5510 msgr2=0x7f0e740f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:08.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e71d9b700 1 --2- 172.21.15.79:0/265195738 >> v2:172.21.15.89:3300/0 conn(0x7f0e740f5510 0x7f0e740f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e71d9b700 1 -- 172.21.15.79:0/265195738 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7409f900 con 0x7f0e740e9ad0 2021-04-09T18:33:08.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e71d9b700 1 -- 172.21.15.79:0/265195738 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f0e5c001bb0 con 0x7f0e740e9ad0 2021-04-09T18:33:08.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e71d9b700 1 -- 172.21.15.79:0/265195738 >> v1:172.21.15.79:6789/0 conn(0x7f0e740e9ad0 legacy=0x7f0e7409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e71d9b700 1 --2- 172.21.15.79:0/265195738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e600038f0 0x7f0e60003d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e71d9b700 1 --2- 172.21.15.79:0/265195738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e600045a0 0x7f0e600049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e71d9b700 1 --2- 172.21.15.79:0/265195738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e60005020 0x7f0e6004f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e71d9b700 1 -- 172.21.15.79:0/265195738 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e740e9f20 con 0x7f0e600045a0 2021-04-09T18:33:08.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e71d9b700 1 -- 172.21.15.79:0/265195738 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e741c3db0 con 0x7f0e60005020 2021-04-09T18:33:08.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e71d9b700 1 -- 172.21.15.79:0/265195738 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6004ff50 con 0x7f0e600038f0 2021-04-09T18:33:08.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e72d9d700 1 --2- 172.21.15.79:0/265195738 >> v2:172.21.15.89:3300/0 conn(0x7f0e740f5510 0x7f0e740f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:08.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e7259c700 1 --2- 172.21.15.79:0/265195738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e600045a0 0x7f0e600049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e7359e700 1 --2- 172.21.15.79:0/265195738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e60005020 0x7f0e6004f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e7259c700 1 -- 172.21.15.79:0/265195738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e600038f0 msgr2=0x7f0e60003d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:08.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e72d9d700 1 --2- 172.21.15.79:0/265195738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e600038f0 0x7f0e60003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e7259c700 1 --2- 172.21.15.79:0/265195738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e600038f0 0x7f0e60003d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e7259c700 1 -- 172.21.15.79:0/265195738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e60005020 msgr2=0x7f0e6004f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:08.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e7259c700 1 --2- 172.21.15.79:0/265195738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e60005020 0x7f0e6004f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e7259c700 1 -- 172.21.15.79:0/265195738 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7409f900 con 0x7f0e600045a0 2021-04-09T18:33:08.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e7359e700 1 --2- 172.21.15.79:0/265195738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e60005020 0x7f0e6004f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:33:08.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e72d9d700 1 --2- 172.21.15.79:0/265195738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e600038f0 0x7f0e60003d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:33:08.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e7259c700 1 --2- 172.21.15.79:0/265195738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e600045a0 0x7f0e600049f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f0e5c001000 tx=0x7f0e5c00d3c0).ready entity=mon.0 client_cookie=21e55595a716e3c8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:08.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e71d9b700 1 -- 172.21.15.79:0/265195738 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e7409f900 con 0x7f0e600045a0 2021-04-09T18:33:08.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e71d9b700 1 -- 172.21.15.79:0/265195738 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5c008170 con 0x7f0e600045a0 2021-04-09T18:33:08.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e71d9b700 1 -- 172.21.15.79:0/265195738 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e5c00d950 con 0x7f0e600045a0 2021-04-09T18:33:08.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e79097700 1 -- 172.21.15.79:0/265195738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e600045a0 msgr2=0x7f0e600049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e79097700 1 --2- 172.21.15.79:0/265195738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e600045a0 0x7f0e600049f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f0e5c001000 tx=0x7f0e5c00d3c0).stop 2021-04-09T18:33:08.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e7359e700 1 -- 172.21.15.79:0/265195738 reap_dead start 2021-04-09T18:33:08.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e79097700 1 -- 172.21.15.79:0/265195738 shutdown_connections 2021-04-09T18:33:08.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e79097700 1 -- 172.21.15.79:0/265195738 >> 172.21.15.79:0/265195738 conn(0x7f0e740e5fd0 msgr2=0x7f0e740e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:08.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e79097700 1 -- 172.21.15.79:0/265195738 shutdown_connections 2021-04-09T18:33:08.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.938 7f0e79097700 1 -- 172.21.15.79:0/265195738 wait complete. 2021-04-09T18:33:08.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.942 7f0e79097700 1 Processor -- start 2021-04-09T18:33:08.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.942 7f0e79097700 1 -- start start 2021-04-09T18:33:08.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.942 7f0e79097700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e740ad990 0x7f0e74099230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.942 7f0e79097700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e74099860 0x7f0e740d5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.942 7f0e79097700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e740d5890 0x7f0e7419dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.942 7f0e79097700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7419d940 con 0x7f0e740ad990 2021-04-09T18:33:08.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.942 7f0e79097700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e740adde0 con 0x7f0e740d5890 2021-04-09T18:33:08.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.942 7f0e79097700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7419eee0 con 0x7f0e74099860 2021-04-09T18:33:08.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.942 7f0e72d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e740ad990 0x7f0e74099230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.942 7f0e72d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e740ad990 0x7f0e74099230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60036/0 (socket says 172.21.15.79:60036) 2021-04-09T18:33:08.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.942 7f0e72d9d700 1 -- 172.21.15.79:0/645607234 learned_addr learned my addr 172.21.15.79:0/645607234 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:08.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.942 7f0e7259c700 1 --2- 172.21.15.79:0/645607234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e74099860 0x7f0e740d5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.946 7f0e7359e700 1 --2- 172.21.15.79:0/645607234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e740d5890 0x7f0e7419dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.946 7f0e72d9d700 1 -- 172.21.15.79:0/645607234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e74099860 msgr2=0x7f0e740d5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.946 7f0e72d9d700 1 --2- 172.21.15.79:0/645607234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e74099860 0x7f0e740d5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.946 7f0e72d9d700 1 -- 172.21.15.79:0/645607234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e740d5890 msgr2=0x7f0e7419dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:08.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.946 7f0e72d9d700 1 --2- 172.21.15.79:0/645607234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e740d5890 0x7f0e7419dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:08.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.946 7f0e72d9d700 1 -- 172.21.15.79:0/645607234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7419d4d0 con 0x7f0e740ad990 2021-04-09T18:33:08.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.946 7f0e72d9d700 1 --2- 172.21.15.79:0/645607234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e740ad990 0x7f0e74099230 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f0e7409ae30 tx=0x7f0e6400be90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:08.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.946 7f0e6b7fe700 1 -- 172.21.15.79:0/645607234 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e7419d4d0 con 0x7f0e740ad990 2021-04-09T18:33:08.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.946 7f0e6b7fe700 1 -- 172.21.15.79:0/645607234 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6400dae0 con 0x7f0e740ad990 2021-04-09T18:33:08.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.946 7f0e79097700 1 -- 172.21.15.79:0/645607234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7419e270 con 0x7f0e740ad990 2021-04-09T18:33:08.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.946 7f0e6b7fe700 1 -- 172.21.15.79:0/645607234 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e64018070 con 0x7f0e740ad990 2021-04-09T18:33:08.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.946 7f0e79097700 1 -- 172.21.15.79:0/645607234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7419e780 con 0x7f0e740ad990 2021-04-09T18:33:08.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.946 7f0e6b7fe700 1 -- 172.21.15.79:0/645607234 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0e64013400 con 0x7f0e740ad990 2021-04-09T18:33:08.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.946 7f0e6b7fe700 1 --2- 172.21.15.79:0/645607234 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0e58029100 0x7f0e5802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:08.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.946 7f0e6b7fe700 1 -- 172.21.15.79:0/645607234 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f0e64039a60 con 0x7f0e740ad990 2021-04-09T18:33:08.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.946 7f0e7259c700 1 --2- 172.21.15.79:0/645607234 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0e58029100 0x7f0e5802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:08.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.946 7f0e7259c700 1 --2- 172.21.15.79:0/645607234 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0e58029100 0x7f0e5802b650 crc :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:08.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.950 7f0e79097700 1 -- 172.21.15.79:0/645607234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e740e39d0 con 0x7f0e740ad990 2021-04-09T18:33:08.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:08.958 7f0e6b7fe700 1 -- 172.21.15.79:0/645607234 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0e6400d6e0 con 0x7f0e740ad990 2021-04-09T18:33:09.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:09.126 7f0e79097700 1 -- 172.21.15.79:0/645607234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e74087500 con 0x7f0e740ad990 2021-04-09T18:33:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:09.126 7f0e6b7fe700 1 -- 172.21.15.79:0/645607234 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+2104 (secure 0 0 0) 0x7f0e74107f40 con 0x7f0e740ad990 2021-04-09T18:33:09.134 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:09.134 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6153,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1203679879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1203679879},{"type":"v1","addr":"172.21.15.89:6835","nonce":1203679879}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":38}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:32:14.903910","modified":"2021-04-09 18:32:16.914763","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/1131782053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1131782053},{"type":"v1","addr":"172.21.15.79:6833","nonce":1131782053}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-04-09T18:33:09.135 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 40 2021-04-09T18:33:09.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:09.130 7f0e79097700 1 -- 172.21.15.79:0/645607234 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0e58029100 msgr2=0x7f0e5802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:09.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:09.130 7f0e79097700 1 --2- 172.21.15.79:0/645607234 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0e58029100 0x7f0e5802b650 crc :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:09.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:09.130 7f0e79097700 1 -- 172.21.15.79:0/645607234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e740ad990 msgr2=0x7f0e74099230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:09.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:09.130 7f0e79097700 1 --2- 172.21.15.79:0/645607234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e740ad990 0x7f0e74099230 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f0e7409ae30 tx=0x7f0e6400be90).stop 2021-04-09T18:33:09.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:09.130 7f0e79097700 1 -- 172.21.15.79:0/645607234 shutdown_connections 2021-04-09T18:33:09.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:09.130 7f0e79097700 1 --2- 172.21.15.79:0/645607234 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0e58029100 0x7f0e5802b650 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:09.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:09.130 7f0e79097700 1 --2- 172.21.15.79:0/645607234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e740d5890 0x7f0e7419dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:09.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:09.130 7f0e79097700 1 --2- 172.21.15.79:0/645607234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e740ad990 0x7f0e74099230 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:09.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:09.130 7f0e79097700 1 --2- 172.21.15.79:0/645607234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e74099860 0x7f0e740d5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:09.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:09.130 7f0e79097700 1 -- 172.21.15.79:0/645607234 >> 172.21.15.79:0/645607234 conn(0x7f0e740babb0 msgr2=0x7f0e740a25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:09.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:09.130 7f0e79097700 1 -- 172.21.15.79:0/645607234 shutdown_connections 2021-04-09T18:33:09.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:09.130 7f0e79097700 1 -- 172.21.15.79:0/645607234 wait complete. 2021-04-09T18:33:09.349 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:32:14.903910', 'modified': '2021-04-09 18:32:16.914763', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 69, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6150}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6150': {'gid': 6150, 'name': 'a', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6833/1131782053', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 1131782053}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 1131782053}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:33:09.350 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:33:09.350 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2021-04-09T18:33:09.444 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:33:09.444 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:33:09.444 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2021-04-09T18:33:09.445 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 6150, 2021-04-09T18:33:09.445 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2021-04-09T18:33:09.445 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2021-04-09T18:33:09.445 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 53.526623287, 2021-04-09T18:33:09.446 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 40, 2021-04-09T18:33:09.446 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 70, 2021-04-09T18:33:09.446 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 70, 2021-04-09T18:33:09.446 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 58.543395148000002 2021-04-09T18:33:09.447 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:33:09.450 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 6150, "want_state": "up:active", "state": "up:active", "rank_uptime": 53.526623287, "mdsmap_epoch": 40, "osdmap_epoch": 70, "osdmap_epoch_barrier": 70, "uptime": 58.543395148000002 } 2021-04-09T18:33:09.451 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:33:09.451 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-04-09T18:33:09.452 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi090.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-04-09T18:33:09.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:09.453 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:09.460 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:33:09.517 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:33:09.517 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:33:09.572 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:33:09.573 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:33:09.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:09.574 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:33:09.623 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:33:09.624 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:09.667 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:33:09.683 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:33:09.684 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:33:09.739 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:33:09.741 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:33:09.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:09.742 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:33:09.743 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:2021-04-09 18:33:09.736 7f32a17fd0c0 -1 init, newargv = 0x55a8c2ed4bf0 newargc=9 2021-04-09T18:33:09.743 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13697]: starting ceph client 2021-04-09T18:33:09.751 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13697]: starting fuse 2021-04-09T18:33:10.851 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:33:10.868 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:33:10.868 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:33:10.924 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:33:10.925 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:33:10.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:10.927 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:33:10.977 INFO:teuthology.orchestra.run.smithi090.stdout:49 2021-04-09T18:33:10.978 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:33:10.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:10.979 DEBUG:teuthology.orchestra.run.smithi090:> sudo python3 -c ' 2021-04-09T18:33:10.980 DEBUG:teuthology.orchestra.run.smithi090:> import glob 2021-04-09T18:33:10.980 DEBUG:teuthology.orchestra.run.smithi090:> import re 2021-04-09T18:33:10.981 DEBUG:teuthology.orchestra.run.smithi090:> import os 2021-04-09T18:33:10.981 DEBUG:teuthology.orchestra.run.smithi090:> import subprocess 2021-04-09T18:33:10.982 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:33:10.982 DEBUG:teuthology.orchestra.run.smithi090:> def find_socket(client_name): 2021-04-09T18:33:10.983 DEBUG:teuthology.orchestra.run.smithi090:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-04-09T18:33:10.983 DEBUG:teuthology.orchestra.run.smithi090:> files = glob.glob(asok_path) 2021-04-09T18:33:10.983 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:33:10.984 DEBUG:teuthology.orchestra.run.smithi090:> # Given a non-glob path, it better be there 2021-04-09T18:33:10.984 DEBUG:teuthology.orchestra.run.smithi090:> if "*" not in asok_path: 2021-04-09T18:33:10.985 DEBUG:teuthology.orchestra.run.smithi090:> assert(len(files) == 1) 2021-04-09T18:33:10.985 DEBUG:teuthology.orchestra.run.smithi090:> return files[0] 2021-04-09T18:33:10.985 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:33:10.986 DEBUG:teuthology.orchestra.run.smithi090:> for f in files: 2021-04-09T18:33:10.986 DEBUG:teuthology.orchestra.run.smithi090:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:33:10.987 DEBUG:teuthology.orchestra.run.smithi090:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:33:10.987 DEBUG:teuthology.orchestra.run.smithi090:> return f 2021-04-09T18:33:10.987 DEBUG:teuthology.orchestra.run.smithi090:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:33:10.988 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:33:10.988 DEBUG:teuthology.orchestra.run.smithi090:> print(find_socket("client.0")) 2021-04-09T18:33:10.989 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:33:11.062 INFO:teuthology.orchestra.run.smithi090.stdout:/var/run/ceph/ceph-client.0.13697.asok 2021-04-09T18:33:11.067 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13697.asok 2021-04-09T18:33:11.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:11.068 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13697.asok status 2021-04-09T18:33:11.140 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2021-04-09T18:33:11.141 INFO:teuthology.orchestra.run.smithi090.stdout: "metadata": { 2021-04-09T18:33:11.141 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:33:11.141 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:33:11.142 INFO:teuthology.orchestra.run.smithi090.stdout: "entity_id": "0", 2021-04-09T18:33:11.142 INFO:teuthology.orchestra.run.smithi090.stdout: "hostname": "smithi090", 2021-04-09T18:33:11.143 INFO:teuthology.orchestra.run.smithi090.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-04-09T18:33:11.143 INFO:teuthology.orchestra.run.smithi090.stdout: "pid": "13697", 2021-04-09T18:33:11.143 INFO:teuthology.orchestra.run.smithi090.stdout: "root": "/" 2021-04-09T18:33:11.144 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:33:11.144 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_count": 0, 2021-04-09T18:33:11.145 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_pinned_count": 0, 2021-04-09T18:33:11.145 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 5750, 2021-04-09T18:33:11.145 INFO:teuthology.orchestra.run.smithi090.stdout: "inst": { 2021-04-09T18:33:11.146 INFO:teuthology.orchestra.run.smithi090.stdout: "name": { 2021-04-09T18:33:11.146 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "client", 2021-04-09T18:33:11.147 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5750 2021-04-09T18:33:11.147 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:33:11.148 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:33:11.148 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:33:11.148 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:33:11.149 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 4108510536 2021-04-09T18:33:11.149 INFO:teuthology.orchestra.run.smithi090.stdout: } 2021-04-09T18:33:11.150 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:33:11.150 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:33:11.151 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:33:11.151 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:33:11.151 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 4108510536 2021-04-09T18:33:11.152 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:33:11.152 INFO:teuthology.orchestra.run.smithi090.stdout: "inst_str": "client.5750 172.21.15.90:0/4108510536", 2021-04-09T18:33:11.153 INFO:teuthology.orchestra.run.smithi090.stdout: "addr_str": "172.21.15.90:0/4108510536", 2021-04-09T18:33:11.153 INFO:teuthology.orchestra.run.smithi090.stdout: "inode_count": 1, 2021-04-09T18:33:11.153 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_epoch": 40, 2021-04-09T18:33:11.154 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch": 70, 2021-04-09T18:33:11.154 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:33:11.155 INFO:teuthology.orchestra.run.smithi090.stdout: "blacklisted": false, 2021-04-09T18:33:11.155 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs" 2021-04-09T18:33:11.156 INFO:teuthology.orchestra.run.smithi090.stdout:} 2021-04-09T18:33:11.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:11.163 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:11.164 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:11.170 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:33:11.171 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:33:11.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:11.172 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:11.227 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:33:11.227 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:11.246 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:11.265 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:11.286 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:11.306 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:11.325 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:33:11.325 INFO:tasks.cephfs.mount:Terminating background process 2021-04-09T18:33:11.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:11.326 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:11.327 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:11.337 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:33:11.338 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:33:11.338 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi090.front.sepia.ceph.com... 2021-04-09T18:33:11.339 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:33:11.339 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:11.418 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13697]: fuse finished with error 0 and tester_r 0 2021-04-09T18:33:11.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:11.420 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:11.421 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:11.468 INFO:teuthology.orchestra.run.smithi090.stdout:ext2/ext3 2021-04-09T18:33:11.469 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:33:11.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:33:11.537 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:11.543 INFO:tasks.cephfs.mount:Terminating background process 2021-04-09T18:33:11.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:11.544 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:11.545 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:11.557 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-04-09T18:33:11.557 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-04-09T18:33:11.558 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2021-04-09T18:33:11.559 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:33:11.560 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:11.630 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13271]: fuse finished with error 0 and tester_r 0 2021-04-09T18:33:11.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:11.633 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:11.633 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:11.680 INFO:teuthology.orchestra.run.smithi136.stdout:ext2/ext3 2021-04-09T18:33:11.682 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:33:11.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:33:11.800 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:11.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:11.849 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:11.850 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:33:11.857 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:33:11.857 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:33:11.858 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:33:11.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:33:11.859 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:33:11.913 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:33:12.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.005 7f8f5db1c700 1 Processor -- start 2021-04-09T18:33:12.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.005 7f8f5db1c700 1 -- start start 2021-04-09T18:33:12.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.005 7f8f5db1c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8f580f5520 0x7f8f580f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:12.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.005 7f8f5db1c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f580e9ae0 0x7f8f5809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:12.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.005 7f8f5db1c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f580fbb20 con 0x7f8f581c2db0 2021-04-09T18:33:12.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.005 7f8f5db1c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f580e9f30 con 0x7f8f580f5520 2021-04-09T18:33:12.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.005 7f8f5db1c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f580e59d0 con 0x7f8f580e9ae0 2021-04-09T18:33:12.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.005 7f8f577fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8f580f5520 0x7f8f580f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:12.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.005 7f8f57fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8f581c2db0 0x7f8f581c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54756/0 (socket says 172.21.15.79:54756) 2021-04-09T18:33:12.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.005 7f8f57fff700 1 -- 172.21.15.79:0/784270421 learned_addr learned my addr 172.21.15.79:0/784270421 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:12.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.005 7f8f56ffd700 1 --2- 172.21.15.79:0/784270421 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f580e9ae0 0x7f8f5809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:12.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.005 7f8f577fe700 1 -- 172.21.15.79:0/784270421 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f580e9ae0 msgr2=0x7f8f5809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:12.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.005 7f8f577fe700 1 --2- 172.21.15.79:0/784270421 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f580e9ae0 0x7f8f5809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.005 7f8f577fe700 1 -- 172.21.15.79:0/784270421 >> v1:172.21.15.79:6789/0 conn(0x7f8f581c2db0 legacy=0x7f8f581c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:12.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.005 7f8f567fc700 1 -- 172.21.15.79:0/784270421 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343018477 0 0) 0x7f8f50001450 con 0x7f8f581c2db0 2021-04-09T18:33:12.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.005 7f8f577fe700 1 -- 172.21.15.79:0/784270421 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f580e56d0 con 0x7f8f580f5520 2021-04-09T18:33:12.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.005 7f8f577fe700 1 --2- 172.21.15.79:0/784270421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f580f5520 0x7f8f580f64b0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f8f48002f30 tx=0x7f8f4800bd40).ready entity=mon.0 client_cookie=6e4b12724c25a5fa server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:12.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.005 7f8f567fc700 1 -- 172.21.15.79:0/784270421 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8f580e56d0 con 0x7f8f580f5520 2021-04-09T18:33:12.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.009 7f8f567fc700 1 -- 172.21.15.79:0/784270421 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f48009850 con 0x7f8f580f5520 2021-04-09T18:33:12.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.009 7f8f567fc700 1 -- 172.21.15.79:0/784270421 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8f48009c20 con 0x7f8f580f5520 2021-04-09T18:33:12.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.009 7f8f5db1c700 1 -- 172.21.15.79:0/784270421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f580f5520 msgr2=0x7f8f580f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:12.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.009 7f8f5db1c700 1 --2- 172.21.15.79:0/784270421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f580f5520 0x7f8f580f64b0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f8f48002f30 tx=0x7f8f4800bd40).stop 2021-04-09T18:33:12.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.009 7f8f5db1c700 1 -- 172.21.15.79:0/784270421 shutdown_connections 2021-04-09T18:33:12.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.009 7f8f5db1c700 1 --2- 172.21.15.79:0/784270421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f580f5520 0x7f8f580f64b0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.009 7f8f5db1c700 1 --2- 172.21.15.79:0/784270421 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f580e9ae0 0x7f8f5809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.009 7f8f5db1c700 1 -- 172.21.15.79:0/784270421 >> 172.21.15.79:0/784270421 conn(0x7f8f580e5fe0 msgr2=0x7f8f580e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:12.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.009 7f8f5db1c700 1 -- 172.21.15.79:0/784270421 shutdown_connections 2021-04-09T18:33:12.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.009 7f8f5db1c700 1 -- 172.21.15.79:0/784270421 wait complete. 2021-04-09T18:33:12.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f5db1c700 1 Processor -- start 2021-04-09T18:33:12.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f5db1c700 1 -- start start 2021-04-09T18:33:12.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f5db1c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f580b8710 0x7f8f580cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:12.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f5db1c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f58099470 0x7f8f58094080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:12.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f5db1c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f5808e670 0x7f8f580946b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:12.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f5db1c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f580b8410 con 0x7f8f580b8710 2021-04-09T18:33:12.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f5db1c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f58095090 con 0x7f8f5808e670 2021-04-09T18:33:12.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f5db1c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f580d7f60 con 0x7f8f58099470 2021-04-09T18:33:12.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f577fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f580b8710 0x7f8f580cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:12.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f577fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f580b8710 0x7f8f580cfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60050/0 (socket says 172.21.15.79:60050) 2021-04-09T18:33:12.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f577fe700 1 -- 172.21.15.79:0/1366935000 learned_addr learned my addr 172.21.15.79:0/1366935000 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:12.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f56ffd700 1 --2- 172.21.15.79:0/1366935000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f58099470 0x7f8f58094080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:12.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f57fff700 1 --2- 172.21.15.79:0/1366935000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f5808e670 0x7f8f580946b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:12.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f577fe700 1 -- 172.21.15.79:0/1366935000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f58099470 msgr2=0x7f8f58094080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:12.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f577fe700 1 --2- 172.21.15.79:0/1366935000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f58099470 0x7f8f58094080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f577fe700 1 -- 172.21.15.79:0/1366935000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f5808e670 msgr2=0x7f8f580946b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:12.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f577fe700 1 --2- 172.21.15.79:0/1366935000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f5808e670 0x7f8f580946b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f577fe700 1 -- 172.21.15.79:0/1366935000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f580b7e10 con 0x7f8f580b8710 2021-04-09T18:33:12.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f577fe700 1 --2- 172.21.15.79:0/1366935000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f580b8710 0x7f8f580cfd30 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f8f48002f30 tx=0x7f8f48006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f4ffff700 1 -- 172.21.15.79:0/1366935000 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8f580b7e10 con 0x7f8f580b8710 2021-04-09T18:33:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f4ffff700 1 -- 172.21.15.79:0/1366935000 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f48011c50 con 0x7f8f580b8710 2021-04-09T18:33:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f4ffff700 1 -- 172.21.15.79:0/1366935000 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8f4801d630 con 0x7f8f580b8710 2021-04-09T18:33:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f5db1c700 1 -- 172.21.15.79:0/1366935000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f580b8010 con 0x7f8f580b8710 2021-04-09T18:33:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.013 7f8f5db1c700 1 -- 172.21.15.79:0/1366935000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f580d04f0 con 0x7f8f580b8710 2021-04-09T18:33:12.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.017 7f8f4ffff700 1 -- 172.21.15.79:0/1366935000 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8f48026450 con 0x7f8f580b8710 2021-04-09T18:33:12.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.017 7f8f4ffff700 1 --2- 172.21.15.79:0/1366935000 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8f30029100 0x7f8f3002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:12.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.017 7f8f4ffff700 1 -- 172.21.15.79:0/1366935000 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f8f4803adc0 con 0x7f8f580b8710 2021-04-09T18:33:12.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.017 7f8f56ffd700 1 --2- 172.21.15.79:0/1366935000 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8f30029100 0x7f8f3002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:12.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.017 7f8f56ffd700 1 --2- 172.21.15.79:0/1366935000 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8f30029100 0x7f8f3002b650 crc :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:12.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.021 7f8f5db1c700 1 -- 172.21.15.79:0/1366935000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f580e39e0 con 0x7f8f580b8710 2021-04-09T18:33:12.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.025 7f8f4ffff700 1 -- 172.21.15.79:0/1366935000 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8f48011a40 con 0x7f8f580b8710 2021-04-09T18:33:12.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.189 7f8f5db1c700 1 -- 172.21.15.79:0/1366935000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8f580f5b20 con 0x7f8f580b8710 2021-04-09T18:33:12.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.193 7f8f4ffff700 1 -- 172.21.15.79:0/1366935000 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v70) v1 ==== 81+0+30964 (secure 0 0 0) 0x7f8f48009640 con 0x7f8f580b8710 2021-04-09T18:33:12.201 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:12.202 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:33:12.202 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 70, 2021-04-09T18:33:12.203 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:33:12.203 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:33:12.203 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:33:01.127167", 2021-04-09T18:33:12.203 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:33:12.204 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:33:12.204 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:33:12.204 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:33:12.204 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:33:12.205 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:33:12.205 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:33:12.205 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:33:12.205 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:33:12.205 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:33:12.206 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:33:12.206 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:33:12.206 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:33:12.206 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:33:12.207 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:33:12.207 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 13, 2021-04-09T18:33:12.207 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:33:12.207 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:33:12.208 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:33:12.208 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:33:12.208 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:33:12.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.209 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:33:12.209 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:33:12.209 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:33:12.209 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:33:12.209 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:33:12.210 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:33:12.210 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:33:12.210 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:33:12.210 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:33:12.211 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:33:12.211 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:33:12.211 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:33:12.211 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:33:12.212 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:33:12.212 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:33:12.212 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:33:12.212 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:33:12.212 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:33:12.213 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:33:12.213 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:33:12.213 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:33:12.213 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:33:12.214 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:33:12.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.214 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:33:12.214 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:33:12.214 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:33:12.215 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:33:12.215 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:33:12.215 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:33:12.215 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:33:12.216 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:33:12.216 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:33:12.216 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:33:12.216 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:33:12.216 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:33:12.217 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:33:12.217 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:33:12.217 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:33:12.217 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:33:12.217 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:33:12.218 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:33:12.218 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:33:12.218 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:33:12.218 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:33:12.219 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:33:12.219 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:33:12.219 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:33:12.219 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:33:12.220 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:33:12.220 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:33:12.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.220 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:33:12.221 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:33:12.221 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:33:12.221 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:33:12.221 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:33:12.221 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:33:12.222 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:33:12.222 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:33:12.222 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:33:12.222 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:33:12.222 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:33:12.223 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:33:12.223 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:33:12.223 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:33:12.223 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.224 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 12, 2021-04-09T18:33:12.224 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2021-04-09T18:33:12.224 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:32:13.133609", 2021-04-09T18:33:12.225 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:33:12.225 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:33:12.225 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:33:12.225 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:33:12.226 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:33:12.226 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:33:12.226 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:33:12.226 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:33:12.226 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:33:12.227 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:33:12.227 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:33:12.227 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:33:12.227 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:33:12.228 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:33:12.228 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:33:12.228 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:33:12.228 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:33:12.229 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:33:12.229 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:33:12.229 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:33:12.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.229 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "67", 2021-04-09T18:33:12.230 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:33:12.230 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:33:12.230 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:33:12.230 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:33:12.230 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:33:12.231 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:33:12.231 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:33:12.231 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:33:12.231 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:33:12.232 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:33:12.232 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:33:12.232 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:33:12.232 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:33:12.233 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:33:12.233 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:33:12.233 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:33:12.234 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:33:12.234 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:33:12.234 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:33:12.235 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:33:12.235 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:33:12.236 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:33:12.236 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:33:12.236 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:33:12.237 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:33:12.237 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:33:12.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.237 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:33:12.237 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:33:12.238 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:33:12.238 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:33:12.238 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:33:12.238 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:33:12.239 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:33:12.239 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:33:12.239 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:33:12.239 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:33:12.239 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:33:12.240 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2021-04-09T18:33:12.240 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2021-04-09T18:33:12.240 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2021-04-09T18:33:12.240 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2021-04-09T18:33:12.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.241 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:33:12.241 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:33:12.241 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2021-04-09T18:33:12.241 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.242 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.242 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 13, 2021-04-09T18:33:12.242 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2021-04-09T18:33:12.243 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:32:13.943877", 2021-04-09T18:33:12.243 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:33:12.243 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:33:12.243 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:33:12.244 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:33:12.244 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:33:12.244 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:33:12.244 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:33:12.244 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:33:12.245 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:33:12.245 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:33:12.245 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:33:12.245 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:33:12.246 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:33:12.246 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:33:12.246 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:33:12.246 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:33:12.246 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:33:12.247 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:33:12.247 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:33:12.247 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:33:12.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.248 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "68", 2021-04-09T18:33:12.248 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:33:12.248 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:33:12.248 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:33:12.248 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:33:12.249 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:33:12.249 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:33:12.249 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:33:12.249 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:33:12.249 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:33:12.250 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:33:12.250 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:33:12.250 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:33:12.250 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:33:12.251 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:33:12.251 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:33:12.251 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:33:12.251 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:33:12.252 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:33:12.252 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:33:12.252 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:33:12.252 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:33:12.253 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:33:12.253 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:33:12.253 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:33:12.253 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:33:12.253 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:33:12.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.254 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:33:12.254 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:33:12.254 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:33:12.254 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:33:12.255 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:33:12.255 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:33:12.255 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:33:12.255 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:33:12.256 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:33:12.256 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:33:12.256 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:33:12.256 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:33:12.256 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:33:12.257 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:33:12.257 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2021-04-09T18:33:12.257 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.257 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.258 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.258 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:33:12.258 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:33:12.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.259 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:33:12.260 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:33:12.260 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:12.260 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:12.261 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:12.261 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:12.261 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:12.261 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:12.261 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:12.262 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 66, 2021-04-09T18:33:12.262 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:12.262 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:12.262 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:12.263 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.263 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.263 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:33:12.264 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:12.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.264 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.264 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:33:12.265 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:12.265 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.265 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.266 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:12.266 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.266 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.266 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:33:12.267 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:12.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.267 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.267 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:33:12.268 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:12.268 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.268 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.269 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:12.269 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.269 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.269 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:33:12.270 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:12.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.270 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.270 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:33:12.271 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:12.271 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.271 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.272 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:12.272 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.272 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.273 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:33:12.273 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:12.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.274 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.274 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:33:12.274 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:12.274 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.275 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.275 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:33:12.275 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:33:12.275 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:33:12.276 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:33:12.276 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:12.276 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:12.276 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:12.277 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.277 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:33:12.277 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:33:12.278 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:12.278 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:12.278 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:12.278 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:12.278 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:12.279 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:12.279 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:12.279 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 65, 2021-04-09T18:33:12.279 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:12.279 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:12.280 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:12.280 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.280 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.281 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:33:12.281 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:12.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.282 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.282 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:33:12.282 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:12.282 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.283 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.283 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:12.283 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.284 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.284 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:33:12.285 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:12.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.286 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.286 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:33:12.287 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:12.287 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.287 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.288 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:12.288 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.289 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.290 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:33:12.290 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:12.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.291 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.291 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:33:12.291 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:12.291 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.292 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.292 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:12.292 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.293 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.293 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:33:12.293 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:12.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.294 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.294 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:33:12.295 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:12.295 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.296 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.296 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:33:12.297 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:33:12.297 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:33:12.298 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:33:12.298 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:12.298 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:12.299 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:12.299 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.300 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:33:12.301 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:33:12.301 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:12.302 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:12.302 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:12.302 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:12.303 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:12.303 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:12.304 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:12.304 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 57, 2021-04-09T18:33:12.304 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:12.305 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:12.305 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:12.306 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.306 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.307 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:33:12.307 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:12.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.309 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.309 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:33:12.309 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:12.310 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.310 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.311 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:12.311 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.312 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.313 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:33:12.313 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:12.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.314 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.315 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:33:12.315 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:12.316 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.316 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.317 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:12.317 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.318 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.318 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:33:12.319 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:12.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.320 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.320 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:33:12.320 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:12.321 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.321 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.322 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:12.322 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.323 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.323 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:33:12.323 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:12.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.324 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.324 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:33:12.325 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:12.325 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.325 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.326 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:33:12.326 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:33:12.326 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:33:12.327 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:33:12.327 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:12.327 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:12.328 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:12.328 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.329 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:33:12.329 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:33:12.329 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:12.329 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:12.330 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:12.330 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:12.330 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:12.330 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:12.330 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:12.331 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 47, 2021-04-09T18:33:12.331 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:12.331 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:12.331 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:12.332 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.332 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.332 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:33:12.332 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:12.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.333 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.334 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:33:12.334 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:12.334 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.335 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.336 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:12.336 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.337 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.337 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:33:12.337 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:12.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.338 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.339 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:33:12.339 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:12.339 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.340 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.340 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:12.341 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.342 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.342 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:33:12.342 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:12.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.343 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.344 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:33:12.344 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:12.344 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.345 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.345 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:12.346 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.346 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.346 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:33:12.346 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:12.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.348 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.348 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:33:12.348 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:12.348 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.349 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.349 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:33:12.349 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:33:12.350 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:33:12.350 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:33:12.350 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:12.350 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:12.350 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:12.351 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.351 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:33:12.352 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:33:12.352 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:12.352 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:12.352 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:12.352 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:12.353 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:12.353 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:12.353 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:12.353 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 66, 2021-04-09T18:33:12.353 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:12.354 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:12.354 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:12.354 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.355 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.355 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:33:12.355 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:12.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.356 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.356 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:33:12.356 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:12.356 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.356 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.357 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:12.357 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.357 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.358 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:33:12.358 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:12.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.359 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.359 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:33:12.359 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:12.359 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.360 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.360 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:12.360 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.361 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.361 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:33:12.361 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:12.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.362 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.362 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:33:12.362 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:12.363 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.363 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.363 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:12.364 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.364 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.364 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:33:12.364 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:12.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.365 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.365 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:33:12.365 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:12.366 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.366 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.366 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:33:12.367 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:33:12.367 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:33:12.367 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:33:12.368 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:12.368 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:12.368 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:12.368 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.369 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:33:12.369 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:33:12.369 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:12.369 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:12.370 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:12.370 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:12.370 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:12.370 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:12.371 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:12.371 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 66, 2021-04-09T18:33:12.371 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:12.371 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:12.371 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:12.372 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.372 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.372 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:33:12.372 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:12.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.373 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.373 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:33:12.373 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:12.374 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.374 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.374 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:12.375 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.375 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.375 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:33:12.376 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:12.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.376 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.376 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:33:12.377 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:12.377 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.377 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.377 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:12.378 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.378 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.378 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:33:12.379 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:12.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.379 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.379 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:33:12.380 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:12.380 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.380 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.380 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:12.381 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.381 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.381 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:33:12.382 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:12.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.383 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.383 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:33:12.383 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:12.384 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.384 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.385 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:33:12.385 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:33:12.385 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:33:12.385 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:33:12.386 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:12.386 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:12.386 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:12.386 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.387 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:33:12.387 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:33:12.387 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:12.388 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:12.388 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:12.388 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:12.388 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:12.388 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:12.389 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:12.389 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 66, 2021-04-09T18:33:12.389 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:12.389 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:12.390 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:12.390 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.390 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.390 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:33:12.391 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:12.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.391 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.392 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:33:12.392 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:12.392 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.392 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.393 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:12.393 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.393 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.394 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:33:12.394 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:12.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.394 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.395 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:33:12.395 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:12.395 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.395 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.396 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:12.396 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.396 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.397 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:33:12.397 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:12.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.397 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.398 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:33:12.398 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:12.398 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.398 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.399 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:12.399 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.399 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.399 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:33:12.400 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:12.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.400 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.400 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:33:12.401 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:12.401 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.401 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.401 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:33:12.402 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:33:12.402 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:33:12.402 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:33:12.402 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:12.402 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:12.403 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:12.403 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.404 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:33:12.404 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:33:12.404 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:12.404 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:12.404 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:12.405 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:12.405 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:12.405 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:12.405 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:12.405 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 66, 2021-04-09T18:33:12.406 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:12.406 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:12.406 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:12.406 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.407 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.407 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:33:12.407 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:12.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.408 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.408 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:33:12.408 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:12.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.409 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.409 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:12.409 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.410 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.410 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:33:12.410 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:12.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.411 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.411 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:33:12.411 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:12.411 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.412 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.412 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:12.412 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.413 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.413 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:33:12.413 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:12.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.414 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.414 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:33:12.414 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:12.414 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.415 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.415 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:12.415 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:12.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.416 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:12.416 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:33:12.416 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:12.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.417 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:12.417 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:33:12.417 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:12.417 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.418 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.418 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:33:12.418 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:33:12.418 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:33:12.419 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:33:12.419 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:12.419 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:12.419 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:12.420 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:12.420 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.420 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:33:12.420 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:33:12.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.421 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:33:12.421 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:12.421 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:12.421 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:12.421 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:12.422 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:12.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.422 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:33:12.422 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:12.423 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:12.423 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:12.423 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:12.423 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:12.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.424 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:33:12.424 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:12.424 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:12.425 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:12.425 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:12.425 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:12.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.426 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:33:12.426 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:12.426 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:12.426 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:12.426 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:12.427 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:12.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.427 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:33:12.428 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:12.428 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:12.428 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:12.428 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:12.428 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:12.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.429 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:33:12.429 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:12.429 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:12.430 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:12.430 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:12.430 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:12.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.431 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:33:12.431 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:12.431 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:12.431 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:12.432 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:12.432 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:12.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:12.432 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:33:12.433 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:12.433 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:12.433 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:12.433 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:12.434 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:12.434 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.434 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:33:12.434 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:33:12.434 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:33:12.435 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:33:12.435 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:33:12.435 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": { 2021-04-09T18:33:12.435 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.90:0/30006489": "2021-04-09 19:33:00.902936", 2021-04-09T18:33:12.435 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6835/2729581928": "2021-04-10 18:32:14.953106", 2021-04-09T18:33:12.436 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6834/2729581928": "2021-04-10 18:32:14.953106" 2021-04-09T18:33:12.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.436 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:33:12.436 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:33:12.436 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:33:12.437 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:33:12.437 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:33:12.437 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:33:12.437 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:33:12.438 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:33:12.438 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:33:12.438 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:33:12.438 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:33:12.438 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:33:12.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.439 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:33:12.439 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:33:12.439 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:33:12.439 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:33:12.440 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:33:12.440 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:33:12.440 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:33:12.440 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:12.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:12.441 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:33:12.441 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:33:12.441 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:33:12.441 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:33:12.441 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:33:12.442 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:33:12.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.197 7f8f5db1c700 1 -- 172.21.15.79:0/1366935000 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8f30029100 msgr2=0x7f8f3002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:12.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.197 7f8f5db1c700 1 --2- 172.21.15.79:0/1366935000 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8f30029100 0x7f8f3002b650 crc :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.197 7f8f5db1c700 1 -- 172.21.15.79:0/1366935000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f580b8710 msgr2=0x7f8f580cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:12.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.197 7f8f5db1c700 1 --2- 172.21.15.79:0/1366935000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f580b8710 0x7f8f580cfd30 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f8f48002f30 tx=0x7f8f48006890).stop 2021-04-09T18:33:12.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.197 7f8f5db1c700 1 -- 172.21.15.79:0/1366935000 shutdown_connections 2021-04-09T18:33:12.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.197 7f8f5db1c700 1 --2- 172.21.15.79:0/1366935000 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8f30029100 0x7f8f3002b650 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.197 7f8f5db1c700 1 --2- 172.21.15.79:0/1366935000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f5808e670 0x7f8f580946b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.197 7f8f5db1c700 1 --2- 172.21.15.79:0/1366935000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f580b8710 0x7f8f580cfd30 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.197 7f8f5db1c700 1 --2- 172.21.15.79:0/1366935000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f58099470 0x7f8f58094080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.197 7f8f5db1c700 1 -- 172.21.15.79:0/1366935000 >> 172.21.15.79:0/1366935000 conn(0x7f8f58091c60 msgr2=0x7f8f580d30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:12.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.197 7f8f5db1c700 1 -- 172.21.15.79:0/1366935000 shutdown_connections 2021-04-09T18:33:12.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.197 7f8f5db1c700 1 -- 172.21.15.79:0/1366935000 wait complete. 2021-04-09T18:33:12.447 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:12.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b14410700 1 Processor -- start 2021-04-09T18:33:12.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b14410700 1 -- start start 2021-04-09T18:33:12.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b14410700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b0c0f5510 0x7f5b0c0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:12.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b14410700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0c0fbb10 con 0x7f5b0c0e9ad0 2021-04-09T18:33:12.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b14410700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0c09f900 con 0x7f5b0c1c8000 2021-04-09T18:33:12.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b14410700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0e9f20 con 0x7f5b0c0f5510 2021-04-09T18:33:12.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b119b3700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5b0c0e9ad0 0x7f5b0c09f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54770/0 (socket says 172.21.15.79:54770) 2021-04-09T18:33:12.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b119b3700 1 -- 172.21.15.79:0/954648911 learned_addr learned my addr 172.21.15.79:0/954648911 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:12.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b121b4700 1 --2- 172.21.15.79:0/954648911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b0c0f5510 0x7f5b0c0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:12.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b111b2700 1 -- 172.21.15.79:0/954648911 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482610338 0 0) 0x7f5afc0010d0 con 0x7f5b0c0e9ad0 2021-04-09T18:33:12.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b111b2700 1 -- 172.21.15.79:0/954648911 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5af8003240 con 0x7f5b0c0e9ad0 2021-04-09T18:33:12.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b111b2700 1 -- 172.21.15.79:0/954648911 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425867555 0 0) 0x7f5b04001450 con 0x7f5b0c1c8000 2021-04-09T18:33:12.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b111b2700 1 -- 172.21.15.79:0/954648911 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5af8003620 con 0x7f5b0c1c8000 2021-04-09T18:33:12.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b121b4700 1 -- 172.21.15.79:0/954648911 >> v1:172.21.15.89:6789/0 conn(0x7f5b0c1c8000 legacy=0x7f5b0c1ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:12.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b121b4700 1 -- 172.21.15.79:0/954648911 >> v1:172.21.15.79:6789/0 conn(0x7f5b0c0e9ad0 legacy=0x7f5b0c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:12.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b121b4700 1 -- 172.21.15.79:0/954648911 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c0e56c0 con 0x7f5b0c0f5510 2021-04-09T18:33:12.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b121b4700 1 --2- 172.21.15.79:0/954648911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b0c0f5510 0x7f5b0c0f64a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f5b08002f30 tx=0x7f5b0800bcf0).ready entity=mon.2 client_cookie=d000ac96f8868e7f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:12.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b111b2700 1 -- 172.21.15.79:0/954648911 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b0c0e56c0 con 0x7f5b0c0f5510 2021-04-09T18:33:12.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b111b2700 1 -- 172.21.15.79:0/954648911 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b08009920 con 0x7f5b0c0f5510 2021-04-09T18:33:12.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b111b2700 1 -- 172.21.15.79:0/954648911 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b08009cf0 con 0x7f5b0c0f5510 2021-04-09T18:33:12.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b14410700 1 -- 172.21.15.79:0/954648911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b0c0f5510 msgr2=0x7f5b0c0f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:12.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.537 7f5b14410700 1 --2- 172.21.15.79:0/954648911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b0c0f5510 0x7f5b0c0f64a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f5b08002f30 tx=0x7f5b0800bcf0).stop 2021-04-09T18:33:12.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.541 7f5b14410700 1 -- 172.21.15.79:0/954648911 shutdown_connections 2021-04-09T18:33:12.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.541 7f5b14410700 1 --2- 172.21.15.79:0/954648911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b0c0f5510 0x7f5b0c0f64a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.541 7f5b14410700 1 -- 172.21.15.79:0/954648911 >> 172.21.15.79:0/954648911 conn(0x7f5b0c0e5fd0 msgr2=0x7f5b0c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:12.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.541 7f5b14410700 1 -- 172.21.15.79:0/954648911 shutdown_connections 2021-04-09T18:33:12.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.541 7f5b14410700 1 -- 172.21.15.79:0/954648911 wait complete. 2021-04-09T18:33:12.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.545 7f5b14410700 1 Processor -- start 2021-04-09T18:33:12.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.545 7f5b14410700 1 -- start start 2021-04-09T18:33:12.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.545 7f5b14410700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c0b8fc0 0x7f5b0c0d7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:12.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.545 7f5b14410700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b0c093d60 0x7f5b0c0ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:12.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.545 7f5b14410700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b0c0cefd0 0x7f5b0c0d5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:12.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.545 7f5b14410700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c1c3db0 con 0x7f5b0c0b8fc0 2021-04-09T18:33:12.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.545 7f5b14410700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c090650 con 0x7f5b0c0cefd0 2021-04-09T18:33:12.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.545 7f5b14410700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c090950 con 0x7f5b0c093d60 2021-04-09T18:33:12.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.545 7f5b121b4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c0b8fc0 0x7f5b0c0d7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:12.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.545 7f5b121b4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c0b8fc0 0x7f5b0c0d7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60064/0 (socket says 172.21.15.79:60064) 2021-04-09T18:33:12.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.545 7f5b121b4700 1 -- 172.21.15.79:0/3008233946 learned_addr learned my addr 172.21.15.79:0/3008233946 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:12.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.545 7f5b129b5700 1 --2- 172.21.15.79:0/3008233946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b0c0cefd0 0x7f5b0c0d5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:12.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.545 7f5b119b3700 1 --2- 172.21.15.79:0/3008233946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b0c093d60 0x7f5b0c0ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:12.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.545 7f5b121b4700 1 -- 172.21.15.79:0/3008233946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b0c093d60 msgr2=0x7f5b0c0ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:12.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.545 7f5b121b4700 1 --2- 172.21.15.79:0/3008233946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b0c093d60 0x7f5b0c0ce9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.545 7f5b121b4700 1 -- 172.21.15.79:0/3008233946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b0c0cefd0 msgr2=0x7f5b0c0d5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:12.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.545 7f5b121b4700 1 --2- 172.21.15.79:0/3008233946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b0c0cefd0 0x7f5b0c0d5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.545 7f5b121b4700 1 -- 172.21.15.79:0/3008233946 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c0d6aa0 con 0x7f5b0c0b8fc0 2021-04-09T18:33:12.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.545 7f5b121b4700 1 --2- 172.21.15.79:0/3008233946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c0b8fc0 0x7f5b0c0d7750 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f5b0c0ad520 tx=0x7f5b08006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:12.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.549 7f5b02ffd700 1 -- 172.21.15.79:0/3008233946 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b0c0d6aa0 con 0x7f5b0c0b8fc0 2021-04-09T18:33:12.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.549 7f5b02ffd700 1 -- 172.21.15.79:0/3008233946 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0801d450 con 0x7f5b0c0b8fc0 2021-04-09T18:33:12.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.549 7f5b14410700 1 -- 172.21.15.79:0/3008233946 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0c090200 con 0x7f5b0c0b8fc0 2021-04-09T18:33:12.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.549 7f5b02ffd700 1 -- 172.21.15.79:0/3008233946 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b08022020 con 0x7f5b0c0b8fc0 2021-04-09T18:33:12.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.549 7f5b14410700 1 -- 172.21.15.79:0/3008233946 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0c0d65c0 con 0x7f5b0c0b8fc0 2021-04-09T18:33:12.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.549 7f5b02ffd700 1 -- 172.21.15.79:0/3008233946 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5b08006960 con 0x7f5b0c0b8fc0 2021-04-09T18:33:12.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.549 7f5b02ffd700 1 --2- 172.21.15.79:0/3008233946 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5af402b310 0x7f5af402d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:12.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.549 7f5b02ffd700 1 -- 172.21.15.79:0/3008233946 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f5b0803c570 con 0x7f5b0c0b8fc0 2021-04-09T18:33:12.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.549 7f5b119b3700 1 --2- 172.21.15.79:0/3008233946 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5af402b310 0x7f5af402d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:12.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.549 7f5b119b3700 1 --2- 172.21.15.79:0/3008233946 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5af402b310 0x7f5af402d860 crc :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:12.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.565 7f5b14410700 1 -- 172.21.15.79:0/3008233946 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0c0e39d0 con 0x7f5b0c0b8fc0 2021-04-09T18:33:12.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.573 7f5b02ffd700 1 -- 172.21.15.79:0/3008233946 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5b08009710 con 0x7f5b0c0b8fc0 2021-04-09T18:33:12.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.737 7f5b14410700 1 -- 172.21.15.79:0/3008233946 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b0c0a1cb0 con 0x7f5b0c0b8fc0 2021-04-09T18:33:12.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.737 7f5b02ffd700 1 -- 172.21.15.79:0/3008233946 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+2104 (secure 0 0 0) 0x7f5b08035850 con 0x7f5b0c0b8fc0 2021-04-09T18:33:12.747 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 40 2021-04-09T18:33:12.747 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:12.748 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6153,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1203679879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1203679879},{"type":"v1","addr":"172.21.15.89:6835","nonce":1203679879}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":38}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:32:14.903910","modified":"2021-04-09 18:32:16.914763","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/1131782053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1131782053},{"type":"v1","addr":"172.21.15.79:6833","nonce":1131782053}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-04-09T18:33:12.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.741 7f5b14410700 1 -- 172.21.15.79:0/3008233946 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5af402b310 msgr2=0x7f5af402d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:12.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.741 7f5b14410700 1 --2- 172.21.15.79:0/3008233946 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5af402b310 0x7f5af402d860 crc :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.741 7f5b14410700 1 -- 172.21.15.79:0/3008233946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c0b8fc0 msgr2=0x7f5b0c0d7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:12.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.741 7f5b14410700 1 --2- 172.21.15.79:0/3008233946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c0b8fc0 0x7f5b0c0d7750 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f5b0c0ad520 tx=0x7f5b08006890).stop 2021-04-09T18:33:12.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.741 7f5b14410700 1 -- 172.21.15.79:0/3008233946 shutdown_connections 2021-04-09T18:33:12.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.741 7f5b14410700 1 --2- 172.21.15.79:0/3008233946 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5af402b310 0x7f5af402d860 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.741 7f5b14410700 1 --2- 172.21.15.79:0/3008233946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b0c0cefd0 0x7f5b0c0d5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.741 7f5b14410700 1 --2- 172.21.15.79:0/3008233946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c0b8fc0 0x7f5b0c0d7750 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.741 7f5b14410700 1 --2- 172.21.15.79:0/3008233946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b0c093d60 0x7f5b0c0ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.741 7f5b14410700 1 -- 172.21.15.79:0/3008233946 >> 172.21.15.79:0/3008233946 conn(0x7f5b0c092ba0 msgr2=0x7f5b0c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:12.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.741 7f5b14410700 1 -- 172.21.15.79:0/3008233946 shutdown_connections 2021-04-09T18:33:12.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.741 7f5b14410700 1 -- 172.21.15.79:0/3008233946 wait complete. 2021-04-09T18:33:12.759 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-04-09T18:33:12.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f7712f69700 1 Processor -- start 2021-04-09T18:33:12.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f7712f69700 1 -- start start 2021-04-09T18:33:12.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f7712f69700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f770c0e9ae0 0x7f770c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:12.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f7712f69700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770c0fbb20 con 0x7f770c0f5520 2021-04-09T18:33:12.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f7712f69700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770c0e56d0 con 0x7f770c1c8010 2021-04-09T18:33:12.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f7712f69700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770c1c3dc0 con 0x7f770c0e9ae0 2021-04-09T18:33:12.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f7710d0d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f770c0f5520 0x7f770c0f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54782/0 (socket says 172.21.15.79:54782) 2021-04-09T18:33:12.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f7710d0d700 1 -- 172.21.15.79:0/1735573394 learned_addr learned my addr 172.21.15.79:0/1735573394 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:12.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f7703fff700 1 --2- 172.21.15.79:0/1735573394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f770c0e9ae0 0x7f770c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:12.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f77037fe700 1 -- 172.21.15.79:0/1735573394 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1443731442 0 0) 0x7f7708001450 con 0x7f770c0f5520 2021-04-09T18:33:12.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f77037fe700 1 -- 172.21.15.79:0/1735573394 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76f4003240 con 0x7f770c0f5520 2021-04-09T18:33:12.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f77037fe700 1 -- 172.21.15.79:0/1735573394 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074644577 0 0) 0x7f77040010d0 con 0x7f770c1c8010 2021-04-09T18:33:12.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f77037fe700 1 -- 172.21.15.79:0/1735573394 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76f4004680 con 0x7f770c1c8010 2021-04-09T18:33:12.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f7703fff700 1 -- 172.21.15.79:0/1735573394 >> v1:172.21.15.89:6789/0 conn(0x7f770c1c8010 legacy=0x7f770c1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:12.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f7703fff700 1 -- 172.21.15.79:0/1735573394 >> v1:172.21.15.79:6789/0 conn(0x7f770c0f5520 legacy=0x7f770c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:12.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f7703fff700 1 -- 172.21.15.79:0/1735573394 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c0e4330 con 0x7f770c0e9ae0 2021-04-09T18:33:12.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f7703fff700 1 --2- 172.21.15.79:0/1735573394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f770c0e9ae0 0x7f770c09f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f76fc002f30 tx=0x7f76fc00bcf0).ready entity=mon.2 client_cookie=d3046c3fc2af7371 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:12.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f77037fe700 1 -- 172.21.15.79:0/1735573394 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f770c0e4330 con 0x7f770c0e9ae0 2021-04-09T18:33:12.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f77037fe700 1 -- 172.21.15.79:0/1735573394 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76fc009920 con 0x7f770c0e9ae0 2021-04-09T18:33:12.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f77037fe700 1 -- 172.21.15.79:0/1735573394 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f76fc009cf0 con 0x7f770c0e9ae0 2021-04-09T18:33:12.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f7712f69700 1 -- 172.21.15.79:0/1735573394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f770c0e9ae0 msgr2=0x7f770c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:12.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.841 7f7712f69700 1 --2- 172.21.15.79:0/1735573394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f770c0e9ae0 0x7f770c09f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f76fc002f30 tx=0x7f76fc00bcf0).stop 2021-04-09T18:33:12.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.845 7f7712f69700 1 -- 172.21.15.79:0/1735573394 shutdown_connections 2021-04-09T18:33:12.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.845 7f7712f69700 1 --2- 172.21.15.79:0/1735573394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f770c0e9ae0 0x7f770c09f110 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.845 7f7712f69700 1 -- 172.21.15.79:0/1735573394 >> 172.21.15.79:0/1735573394 conn(0x7f770c0e5fe0 msgr2=0x7f770c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:12.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.845 7f7712f69700 1 -- 172.21.15.79:0/1735573394 shutdown_connections 2021-04-09T18:33:12.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.845 7f7712f69700 1 -- 172.21.15.79:0/1735573394 wait complete. 2021-04-09T18:33:12.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f7712f69700 1 Processor -- start 2021-04-09T18:33:12.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f7712f69700 1 -- start start 2021-04-09T18:33:12.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f7712f69700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f770c099a90 0x7f770c0d6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:12.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f7712f69700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f770c0b2370 0x7f770c0ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:12.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f7712f69700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f770c0cec20 0x7f770c0cf570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:12.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f7712f69700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c0e9f30 con 0x7f770c0cec20 2021-04-09T18:33:12.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f7712f69700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c099860 con 0x7f770c099a90 2021-04-09T18:33:12.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f7712f69700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770c0b27c0 con 0x7f770c0b2370 2021-04-09T18:33:12.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f771150e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f770c0cec20 0x7f770c0cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:12.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f771150e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f770c0cec20 0x7f770c0cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60080/0 (socket says 172.21.15.79:60080) 2021-04-09T18:33:12.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f771150e700 1 -- 172.21.15.79:0/118727306 learned_addr learned my addr 172.21.15.79:0/118727306 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:12.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f7710d0d700 1 --2- 172.21.15.79:0/118727306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f770c099a90 0x7f770c0d6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:12.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f7703fff700 1 --2- 172.21.15.79:0/118727306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f770c0b2370 0x7f770c0ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:12.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f771150e700 1 -- 172.21.15.79:0/118727306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f770c0b2370 msgr2=0x7f770c0ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:12.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f771150e700 1 --2- 172.21.15.79:0/118727306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f770c0b2370 0x7f770c0ce5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f771150e700 1 -- 172.21.15.79:0/118727306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f770c099a90 msgr2=0x7f770c0d6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:12.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f771150e700 1 --2- 172.21.15.79:0/118727306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f770c099a90 0x7f770c0d6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:12.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f771150e700 1 -- 172.21.15.79:0/118727306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c0d6860 con 0x7f770c0cec20 2021-04-09T18:33:12.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f771150e700 1 --2- 172.21.15.79:0/118727306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f770c0cec20 0x7f770c0cf570 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f770c0b2a60 tx=0x7f770400cac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:12.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f77017fa700 1 -- 172.21.15.79:0/118727306 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f770c0d6860 con 0x7f770c0cec20 2021-04-09T18:33:12.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f77017fa700 1 -- 172.21.15.79:0/118727306 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7704010510 con 0x7f770c0cec20 2021-04-09T18:33:12.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f7712f69700 1 -- 172.21.15.79:0/118727306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770c0b1e10 con 0x7f770c0cec20 2021-04-09T18:33:12.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f77017fa700 1 -- 172.21.15.79:0/118727306 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f77040106f0 con 0x7f770c0cec20 2021-04-09T18:33:12.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.849 7f7712f69700 1 -- 172.21.15.79:0/118727306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770c0cfd30 con 0x7f770c0cec20 2021-04-09T18:33:12.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.853 7f77017fa700 1 -- 172.21.15.79:0/118727306 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7704019020 con 0x7f770c0cec20 2021-04-09T18:33:12.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.853 7f77017fa700 1 --2- 172.21.15.79:0/118727306 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f76ec029100 0x7f76ec02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.853 7f77017fa700 1 -- 172.21.15.79:0/118727306 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f7704038ec0 con 0x7f770c0cec20 2021-04-09T18:33:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.853 7f7710d0d700 1 --2- 172.21.15.79:0/118727306 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f76ec029100 0x7f76ec02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.853 7f7710d0d700 1 --2- 172.21.15.79:0/118727306 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f76ec029100 0x7f76ec02b650 crc :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:12.870 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.853 7f7712f69700 1 -- 172.21.15.79:0/118727306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770c0e39e0 con 0x7f770c0cec20 2021-04-09T18:33:12.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:12.861 7f77017fa700 1 -- 172.21.15.79:0/118727306 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7704010300 con 0x7f770c0cec20 2021-04-09T18:33:13.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.017 7f7712f69700 1 -- 172.21.15.79:0/118727306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f770c0a1cc0 con 0x7f770c0cec20 2021-04-09T18:33:13.132 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:33:13.129 7fbcd0516700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:33:13.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.133 7f77017fa700 1 -- 172.21.15.79:0/118727306 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7704000bf0 con 0x7f770c0cec20 2021-04-09T18:33:13.172 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2021-04-09T18:33:13.186 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-04-09T18:33:13.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.181 7f7712f69700 1 -- 172.21.15.79:0/118727306 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f76ec029100 msgr2=0x7f76ec02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:13.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.181 7f7712f69700 1 --2- 172.21.15.79:0/118727306 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f76ec029100 0x7f76ec02b650 crc :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.181 7f7712f69700 1 -- 172.21.15.79:0/118727306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f770c0cec20 msgr2=0x7f770c0cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:13.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.181 7f7712f69700 1 --2- 172.21.15.79:0/118727306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f770c0cec20 0x7f770c0cf570 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f770c0b2a60 tx=0x7f770400cac0).stop 2021-04-09T18:33:13.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.185 7f7712f69700 1 -- 172.21.15.79:0/118727306 shutdown_connections 2021-04-09T18:33:13.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.185 7f7712f69700 1 --2- 172.21.15.79:0/118727306 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f76ec029100 0x7f76ec02b650 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.185 7f7712f69700 1 --2- 172.21.15.79:0/118727306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f770c099a90 0x7f770c0d6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.185 7f7712f69700 1 --2- 172.21.15.79:0/118727306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f770c0cec20 0x7f770c0cf570 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.185 7f7712f69700 1 --2- 172.21.15.79:0/118727306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f770c0b2370 0x7f770c0ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.185 7f7712f69700 1 -- 172.21.15.79:0/118727306 >> 172.21.15.79:0/118727306 conn(0x7f770c08e4d0 msgr2=0x7f770c0d29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:13.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.185 7f7712f69700 1 -- 172.21.15.79:0/118727306 shutdown_connections 2021-04-09T18:33:13.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.185 7f7712f69700 1 -- 172.21.15.79:0/118727306 wait complete. 2021-04-09T18:33:13.205 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:13.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.297 7f11c99b5700 1 Processor -- start 2021-04-09T18:33:13.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.297 7f11c99b5700 1 -- start start 2021-04-09T18:33:13.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.297 7f11c99b5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c40f5510 0x7f11c40f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:13.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.297 7f11c99b5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f11c40e9ad0 0x7f11c409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:13.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.297 7f11c99b5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f11c41c2da0 0x7f11c41c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:13.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.297 7f11c99b5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c40e9f20 con 0x7f11c41c2da0 2021-04-09T18:33:13.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.297 7f11c99b5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c40e59c0 con 0x7f11c40e9ad0 2021-04-09T18:33:13.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.297 7f11c99b5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c40fbb10 con 0x7f11c40f5510 2021-04-09T18:33:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c3d51700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f11c41c2da0 0x7f11c41c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c3d51700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f11c41c2da0 0x7f11c41c31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60102/0 (socket says 172.21.15.79:60102) 2021-04-09T18:33:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c3d51700 1 -- 172.21.15.79:0/1683263625 learned_addr learned my addr 172.21.15.79:0/1683263625 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c2d4f700 1 --2- 172.21.15.79:0/1683263625 >> v2:172.21.15.89:3300/0 conn(0x7f11c40e9ad0 0x7f11c409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c3550700 1 --2- 172.21.15.79:0/1683263625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c40f5510 0x7f11c40f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c3d51700 1 -- 172.21.15.79:0/1683263625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c40f5510 msgr2=0x7f11c40f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c3d51700 1 --2- 172.21.15.79:0/1683263625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c40f5510 0x7f11c40f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c3d51700 1 -- 172.21.15.79:0/1683263625 >> v2:172.21.15.89:3300/0 conn(0x7f11c40e9ad0 msgr2=0x7f11c409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c3d51700 1 --2- 172.21.15.79:0/1683263625 >> v2:172.21.15.89:3300/0 conn(0x7f11c40e9ad0 0x7f11c409f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c3d51700 1 -- 172.21.15.79:0/1683263625 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c40e56c0 con 0x7f11c41c2da0 2021-04-09T18:33:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c3d51700 1 --2- 172.21.15.79:0/1683263625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c41c2da0 0x7f11c41c31f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f11b4002f30 tx=0x7f11b400bd70).ready entity=mon.0 client_cookie=667733969ddc9e5a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c254e700 1 -- 172.21.15.79:0/1683263625 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11c40e56c0 con 0x7f11c41c2da0 2021-04-09T18:33:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c254e700 1 -- 172.21.15.79:0/1683263625 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b40098b0 con 0x7f11c41c2da0 2021-04-09T18:33:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c254e700 1 -- 172.21.15.79:0/1683263625 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11b4009c80 con 0x7f11c41c2da0 2021-04-09T18:33:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c99b5700 1 -- 172.21.15.79:0/1683263625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c41c2da0 msgr2=0x7f11c41c31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:13.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c99b5700 1 --2- 172.21.15.79:0/1683263625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c41c2da0 0x7f11c41c31f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f11b4002f30 tx=0x7f11b400bd70).stop 2021-04-09T18:33:13.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c99b5700 1 -- 172.21.15.79:0/1683263625 shutdown_connections 2021-04-09T18:33:13.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c99b5700 1 --2- 172.21.15.79:0/1683263625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c40f5510 0x7f11c40f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c99b5700 1 --2- 172.21.15.79:0/1683263625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c41c2da0 0x7f11c41c31f0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c99b5700 1 --2- 172.21.15.79:0/1683263625 >> v2:172.21.15.89:3300/0 conn(0x7f11c40e9ad0 0x7f11c409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c99b5700 1 -- 172.21.15.79:0/1683263625 >> 172.21.15.79:0/1683263625 conn(0x7f11c40e5fd0 msgr2=0x7f11c40e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c99b5700 1 -- 172.21.15.79:0/1683263625 shutdown_connections 2021-04-09T18:33:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.301 7f11c99b5700 1 -- 172.21.15.79:0/1683263625 wait complete. 2021-04-09T18:33:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c99b5700 1 Processor -- start 2021-04-09T18:33:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c99b5700 1 -- start start 2021-04-09T18:33:13.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c99b5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c41a1530 0x7f11c41c03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:13.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c99b5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c40bad40 0x7f11c40ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:13.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c99b5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c40bb190 0x7f11c40ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:13.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c99b5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c40885b0 con 0x7f11c41a1530 2021-04-09T18:33:13.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c99b5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c4098980 con 0x7f11c40bad40 2021-04-09T18:33:13.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c99b5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c4098c80 con 0x7f11c40bb190 2021-04-09T18:33:13.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c3550700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c41a1530 0x7f11c41c03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:13.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c3550700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c41a1530 0x7f11c41c03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60104/0 (socket says 172.21.15.79:60104) 2021-04-09T18:33:13.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c3550700 1 -- 172.21.15.79:0/2424144139 learned_addr learned my addr 172.21.15.79:0/2424144139 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:13.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c3d51700 1 --2- 172.21.15.79:0/2424144139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c40bb190 0x7f11c40ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:13.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c2d4f700 1 --2- 172.21.15.79:0/2424144139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c40bad40 0x7f11c40ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:13.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c3550700 1 -- 172.21.15.79:0/2424144139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c40bb190 msgr2=0x7f11c40ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:13.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c3550700 1 --2- 172.21.15.79:0/2424144139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c40bb190 0x7f11c40ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c3550700 1 -- 172.21.15.79:0/2424144139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c40bad40 msgr2=0x7f11c40ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:13.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c3550700 1 --2- 172.21.15.79:0/2424144139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c40bad40 0x7f11c40ad2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c3550700 1 -- 172.21.15.79:0/2424144139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c40c08a0 con 0x7f11c41a1530 2021-04-09T18:33:13.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c3550700 1 --2- 172.21.15.79:0/2424144139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c41a1530 0x7f11c41c03f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f11c4098900 tx=0x7f11bc00bf60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:13.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11bbfff700 1 -- 172.21.15.79:0/2424144139 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11c40c08a0 con 0x7f11c41a1530 2021-04-09T18:33:13.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11bbfff700 1 -- 172.21.15.79:0/2424144139 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc00cb80 con 0x7f11c41a1530 2021-04-09T18:33:13.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11bbfff700 1 -- 172.21.15.79:0/2424144139 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11bc00f040 con 0x7f11c41a1530 2021-04-09T18:33:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c99b5700 1 -- 172.21.15.79:0/2424144139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c40d6540 con 0x7f11c41a1530 2021-04-09T18:33:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.305 7f11c99b5700 1 -- 172.21.15.79:0/2424144139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c40adf20 con 0x7f11c41a1530 2021-04-09T18:33:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.309 7f11bbfff700 1 -- 172.21.15.79:0/2424144139 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f11bc011070 con 0x7f11c41a1530 2021-04-09T18:33:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.309 7f11bbfff700 1 --2- 172.21.15.79:0/2424144139 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f11a8029100 0x7f11a802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.309 7f11bbfff700 1 -- 172.21.15.79:0/2424144139 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6139+0+0 (secure 0 0 0) 0x7f11bc010040 con 0x7f11c41a1530 2021-04-09T18:33:13.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.309 7f11c2d4f700 1 --2- 172.21.15.79:0/2424144139 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f11a8029100 0x7f11a802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:13.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.309 7f11c2d4f700 1 --2- 172.21.15.79:0/2424144139 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f11a8029100 0x7f11a802b650 crc :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:13.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.313 7f11c99b5700 1 -- 172.21.15.79:0/2424144139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c40e39d0 con 0x7f11c41a1530 2021-04-09T18:33:13.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.321 7f11bbfff700 1 -- 172.21.15.79:0/2424144139 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f11bc00c780 con 0x7f11c41a1530 2021-04-09T18:33:13.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.489 7f11c99b5700 1 -- 172.21.15.79:0/2424144139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11c40f5b10 con 0x7f11c41a1530 2021-04-09T18:33:13.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.489 7f11bbfff700 1 -- 172.21.15.79:0/2424144139 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+1758 (secure 0 0 0) 0x7f11c4107f40 con 0x7f11c41a1530 2021-04-09T18:33:13.499 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 41 2021-04-09T18:33:13.499 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:13.499 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":41,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6153,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1203679879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1203679879},{"type":"v1","addr":"172.21.15.89:6835","nonce":1203679879}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":38}],"filesystems":[{"mdsmap":{"epoch":41,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:32:14.903910","modified":"2021-04-09 18:33:13.131194","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-04-09T18:33:13.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.493 7f11c99b5700 1 -- 172.21.15.79:0/2424144139 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f11a8029100 msgr2=0x7f11a802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:13.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.493 7f11c99b5700 1 --2- 172.21.15.79:0/2424144139 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f11a8029100 0x7f11a802b650 crc :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.493 7f11c99b5700 1 -- 172.21.15.79:0/2424144139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c41a1530 msgr2=0x7f11c41c03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:13.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.493 7f11c99b5700 1 --2- 172.21.15.79:0/2424144139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c41a1530 0x7f11c41c03f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f11c4098900 tx=0x7f11bc00bf60).stop 2021-04-09T18:33:13.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.497 7f11c99b5700 1 -- 172.21.15.79:0/2424144139 shutdown_connections 2021-04-09T18:33:13.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.497 7f11c99b5700 1 --2- 172.21.15.79:0/2424144139 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f11a8029100 0x7f11a802b650 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.497 7f11c99b5700 1 --2- 172.21.15.79:0/2424144139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c40bb190 0x7f11c40ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.497 7f11c99b5700 1 --2- 172.21.15.79:0/2424144139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c41a1530 0x7f11c41c03f0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.497 7f11c99b5700 1 --2- 172.21.15.79:0/2424144139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c40bad40 0x7f11c40ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.497 7f11c99b5700 1 -- 172.21.15.79:0/2424144139 >> 172.21.15.79:0/2424144139 conn(0x7f11c409aa30 msgr2=0x7f11c40a6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:13.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.497 7f11c99b5700 1 -- 172.21.15.79:0/2424144139 shutdown_connections 2021-04-09T18:33:13.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.497 7f11c99b5700 1 -- 172.21.15.79:0/2424144139 wait complete. 2021-04-09T18:33:13.520 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-04-09T18:33:13.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcc00e3700 1 Processor -- start 2021-04-09T18:33:13.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcc00e3700 1 -- start start 2021-04-09T18:33:13.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcc00e3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efcb80f5520 0x7efcb80f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:13.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcc00e3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcb80e9ae0 0x7efcb809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:13.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcc00e3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb80fbb20 con 0x7efcb81c2db0 2021-04-09T18:33:13.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcc00e3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb80e9f30 con 0x7efcb80f5520 2021-04-09T18:33:13.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcc00e3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb80e59d0 con 0x7efcb80e9ae0 2021-04-09T18:33:13.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcbde87700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efcb80f5520 0x7efcb80f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:13.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcbd686700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcb80e9ae0 0x7efcb809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:13.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcbd686700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcb80e9ae0 0x7efcb809f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:57108/0 (socket says 172.21.15.79:57108) 2021-04-09T18:33:13.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcbde87700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efcb80f5520 0x7efcb80f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:48458/0 (socket says 172.21.15.79:48458) 2021-04-09T18:33:13.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcbd686700 1 -- 172.21.15.79:0/3935842435 learned_addr learned my addr 172.21.15.79:0/3935842435 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:13.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcbe688700 1 --1- 172.21.15.79:0/3935842435 >> v1:172.21.15.89:6789/0 conn(0x7efcb81c2db0 0x7efcb81c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:55294/0 (socket says 172.21.15.79:55294) 2021-04-09T18:33:13.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcbde87700 1 -- 172.21.15.79:0/3935842435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcb80e9ae0 msgr2=0x7efcb809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:13.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcbde87700 1 --2- 172.21.15.79:0/3935842435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcb80e9ae0 0x7efcb809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcbde87700 1 -- 172.21.15.79:0/3935842435 >> v1:172.21.15.89:6789/0 conn(0x7efcb81c2db0 legacy=0x7efcb81c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:13.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcbde87700 1 -- 172.21.15.79:0/3935842435 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb80e56d0 con 0x7efcb80f5520 2021-04-09T18:33:13.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcbce85700 1 -- 172.21.15.79:0/3935842435 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3540796112 0 0) 0x7efcb0001450 con 0x7efcb81c2db0 2021-04-09T18:33:13.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcbd686700 1 --2- 172.21.15.79:0/3935842435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcb80e9ae0 0x7efcb809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:13.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcbde87700 1 --2- 172.21.15.79:0/3935842435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcb80f5520 0x7efcb80f64b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7efcb4002f30 tx=0x7efcb400bd40).ready entity=mon.1 client_cookie=ad1c1b23ec06032a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:13.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcbce85700 1 -- 172.21.15.79:0/3935842435 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efcb80e56d0 con 0x7efcb80f5520 2021-04-09T18:33:13.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcbce85700 1 -- 172.21.15.79:0/3935842435 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb4009850 con 0x7efcb80f5520 2021-04-09T18:33:13.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcbce85700 1 -- 172.21.15.79:0/3935842435 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efcb4009c20 con 0x7efcb80f5520 2021-04-09T18:33:13.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcc00e3700 1 -- 172.21.15.79:0/3935842435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcb80f5520 msgr2=0x7efcb80f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:13.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.609 7efcc00e3700 1 --2- 172.21.15.79:0/3935842435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcb80f5520 0x7efcb80f64b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7efcb4002f30 tx=0x7efcb400bd40).stop 2021-04-09T18:33:13.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.613 7efcc00e3700 1 -- 172.21.15.79:0/3935842435 shutdown_connections 2021-04-09T18:33:13.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.613 7efcc00e3700 1 --2- 172.21.15.79:0/3935842435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcb80f5520 0x7efcb80f64b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.613 7efcc00e3700 1 --2- 172.21.15.79:0/3935842435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcb80e9ae0 0x7efcb809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.613 7efcc00e3700 1 -- 172.21.15.79:0/3935842435 >> 172.21.15.79:0/3935842435 conn(0x7efcb80e5fe0 msgr2=0x7efcb80e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:13.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.613 7efcc00e3700 1 -- 172.21.15.79:0/3935842435 shutdown_connections 2021-04-09T18:33:13.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.613 7efcc00e3700 1 -- 172.21.15.79:0/3935842435 wait complete. 2021-04-09T18:33:13.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.613 7efcc00e3700 1 Processor -- start 2021-04-09T18:33:13.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.613 7efcc00e3700 1 -- start start 2021-04-09T18:33:13.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.613 7efcc00e3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcb80d0670 0x7efcb80d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:13.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.613 7efcc00e3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcb80d2170 0x7efcb80ce350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:13.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcc00e3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcb80ce980 0x7efcb80b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcc00e3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb80d1840 con 0x7efcb80ce980 2021-04-09T18:33:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcc00e3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb80d1010 con 0x7efcb80d2170 2021-04-09T18:33:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcc00e3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb80b9190 con 0x7efcb80d0670 2021-04-09T18:33:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcbe688700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcb80ce980 0x7efcb80b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcbe688700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcb80ce980 0x7efcb80b9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60122/0 (socket says 172.21.15.79:60122) 2021-04-09T18:33:13.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcbe688700 1 -- 172.21.15.79:0/396506728 learned_addr learned my addr 172.21.15.79:0/396506728 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:13.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcbde87700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcb80d0670 0x7efcb80d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:13.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcbd686700 1 --2- 172.21.15.79:0/396506728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcb80d2170 0x7efcb80ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:13.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcbd686700 1 -- 172.21.15.79:0/396506728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcb80d0670 msgr2=0x7efcb80d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:13.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcbd686700 1 --2- 172.21.15.79:0/396506728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcb80d0670 0x7efcb80d1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcbd686700 1 -- 172.21.15.79:0/396506728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcb80ce980 msgr2=0x7efcb80b9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:13.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcbd686700 1 --2- 172.21.15.79:0/396506728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcb80ce980 0x7efcb80b9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:13.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcbd686700 1 -- 172.21.15.79:0/396506728 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb80d0ac0 con 0x7efcb80d2170 2021-04-09T18:33:13.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcbde87700 1 --2- 172.21.15.79:0/396506728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcb80d0670 0x7efcb80d1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:13.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcbe688700 1 --2- 172.21.15.79:0/396506728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcb80ce980 0x7efcb80b9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:13.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcbd686700 1 --2- 172.21.15.79:0/396506728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcb80d2170 0x7efcb80ce350 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7efcb80932d0 tx=0x7efcac00c430).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:13.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcaa7fc700 1 -- 172.21.15.79:0/396506728 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efcb80d0ac0 con 0x7efcb80d2170 2021-04-09T18:33:13.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcaa7fc700 1 -- 172.21.15.79:0/396506728 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcac00cbd0 con 0x7efcb80d2170 2021-04-09T18:33:13.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcaa7fc700 1 -- 172.21.15.79:0/396506728 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efcac00f040 con 0x7efcb80d2170 2021-04-09T18:33:13.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcc00e3700 1 -- 172.21.15.79:0/396506728 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb80cedd0 con 0x7efcb80d2170 2021-04-09T18:33:13.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcc00e3700 1 -- 172.21.15.79:0/396506728 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb80a40d0 con 0x7efcb80d2170 2021-04-09T18:33:13.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcaa7fc700 1 -- 172.21.15.79:0/396506728 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7efcac022060 con 0x7efcb80d2170 2021-04-09T18:33:13.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcaa7fc700 1 --2- 172.21.15.79:0/396506728 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efca0029100 0x7efca002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:13.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcaa7fc700 1 -- 172.21.15.79:0/396506728 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6139+0+0 (secure 0 0 0) 0x7efcac010040 con 0x7efcb80d2170 2021-04-09T18:33:13.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.617 7efcbde87700 1 --2- 172.21.15.79:0/396506728 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efca0029100 0x7efca002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:13.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.621 7efcbde87700 1 --2- 172.21.15.79:0/396506728 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efca0029100 0x7efca002b650 crc :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:13.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.621 7efcc00e3700 1 -- 172.21.15.79:0/396506728 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb80e39e0 con 0x7efcb80d2170 2021-04-09T18:33:13.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.629 7efcaa7fc700 1 -- 172.21.15.79:0/396506728 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7efcac000bf0 con 0x7efcb80d2170 2021-04-09T18:33:13.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:13.801 7efcc00e3700 1 -- 172.21.15.79:0/396506728 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efcb80f5b20 con 0x7efcb80d2170 2021-04-09T18:33:14.120 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:33:14.122 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:33:14.125 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:33:14.127 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:33:14.129 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:33:14.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.141 7efcaa7fc700 1 -- 172.21.15.79:0/396506728 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7efcac00c9c0 con 0x7efcb80d2170 2021-04-09T18:33:14.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.173 7efcc00e3700 1 -- 172.21.15.79:0/396506728 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efca0029100 msgr2=0x7efca002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:14.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.173 7efcc00e3700 1 --2- 172.21.15.79:0/396506728 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efca0029100 0x7efca002b650 crc :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:14.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.173 7efcc00e3700 1 -- 172.21.15.79:0/396506728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcb80d2170 msgr2=0x7efcb80ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:14.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.173 7efcc00e3700 1 --2- 172.21.15.79:0/396506728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcb80d2170 0x7efcb80ce350 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7efcb80932d0 tx=0x7efcac00c430).stop 2021-04-09T18:33:14.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.173 7efcc00e3700 1 -- 172.21.15.79:0/396506728 shutdown_connections 2021-04-09T18:33:14.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.173 7efcc00e3700 1 --2- 172.21.15.79:0/396506728 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efca0029100 0x7efca002b650 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:14.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.173 7efcc00e3700 1 --2- 172.21.15.79:0/396506728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcb80ce980 0x7efcb80b9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:14.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.173 7efcc00e3700 1 --2- 172.21.15.79:0/396506728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcb80d0670 0x7efcb80d1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:14.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.173 7efcc00e3700 1 --2- 172.21.15.79:0/396506728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcb80d2170 0x7efcb80ce350 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:14.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.173 7efcc00e3700 1 -- 172.21.15.79:0/396506728 >> 172.21.15.79:0/396506728 conn(0x7efcb80d74d0 msgr2=0x7efcb80d2920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:14.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.173 7efcc00e3700 1 -- 172.21.15.79:0/396506728 shutdown_connections 2021-04-09T18:33:14.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.173 7efcc00e3700 1 -- 172.21.15.79:0/396506728 wait complete. 2021-04-09T18:33:14.193 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-04-09T18:33:14.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.325 7f7c86078700 1 Processor -- start 2021-04-09T18:33:14.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.325 7f7c86078700 1 -- start start 2021-04-09T18:33:14.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.325 7f7c86078700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c801c9040 0x7f7c801cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:14.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.325 7f7c86078700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c800fbb40 con 0x7f7c800e9b00 2021-04-09T18:33:14.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.325 7f7c86078700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c8009f900 con 0x7f7c800f5540 2021-04-09T18:33:14.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.325 7f7c86078700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c801c3de0 con 0x7f7c801c9040 2021-04-09T18:33:14.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.325 7f7c7effd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7c800e9b00 0x7f7c8009f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54838/0 (socket says 172.21.15.79:54838) 2021-04-09T18:33:14.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.325 7f7c7effd700 1 -- 172.21.15.79:0/2037766092 learned_addr learned my addr 172.21.15.79:0/2037766092 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:14.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7ffff700 1 --2- 172.21.15.79:0/2037766092 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c801c9040 0x7f7c801cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:14.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7e7fc700 1 -- 172.21.15.79:0/2037766092 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036852895 0 0) 0x7f7c740010d0 con 0x7f7c800e9b00 2021-04-09T18:33:14.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7e7fc700 1 -- 172.21.15.79:0/2037766092 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c68003240 con 0x7f7c800e9b00 2021-04-09T18:33:14.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7e7fc700 1 -- 172.21.15.79:0/2037766092 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617886381 0 0) 0x7f7c78001450 con 0x7f7c800f5540 2021-04-09T18:33:14.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7e7fc700 1 -- 172.21.15.79:0/2037766092 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c68003620 con 0x7f7c800f5540 2021-04-09T18:33:14.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7e7fc700 1 -- 172.21.15.79:0/2037766092 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 858137767 0 0) 0x7f7c74001650 con 0x7f7c800e9b00 2021-04-09T18:33:14.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7e7fc700 1 -- 172.21.15.79:0/2037766092 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c801c9040 msgr2=0x7f7c801cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:14.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7e7fc700 1 --2- 172.21.15.79:0/2037766092 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c801c9040 0x7f7c801cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:14.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7e7fc700 1 -- 172.21.15.79:0/2037766092 >> v1:172.21.15.89:6789/0 conn(0x7f7c800f5540 legacy=0x7f7c800f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:14.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7e7fc700 1 -- 172.21.15.79:0/2037766092 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c800e56f0 con 0x7f7c800e9b00 2021-04-09T18:33:14.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7e7fc700 1 -- 172.21.15.79:0/2037766092 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f7c74001bb0 con 0x7f7c800e9b00 2021-04-09T18:33:14.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7e7fc700 1 -- 172.21.15.79:0/2037766092 >> v1:172.21.15.79:6789/0 conn(0x7f7c800e9b00 legacy=0x7f7c8009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:14.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7e7fc700 1 --2- 172.21.15.79:0/2037766092 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c68003d40 0x7f7c680045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:14.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7e7fc700 1 --2- 172.21.15.79:0/2037766092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c68004bd0 0x7f7c680097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:14.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7e7fc700 1 --2- 172.21.15.79:0/2037766092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c68005020 0x7f7c6800be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:14.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7e7fc700 1 -- 172.21.15.79:0/2037766092 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c801c3de0 con 0x7f7c68005020 2021-04-09T18:33:14.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7e7fc700 1 -- 172.21.15.79:0/2037766092 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c68050460 con 0x7f7c68004bd0 2021-04-09T18:33:14.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7e7fc700 1 -- 172.21.15.79:0/2037766092 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c68050610 con 0x7f7c68003d40 2021-04-09T18:33:14.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7ffff700 1 --2- 172.21.15.79:0/2037766092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c68005020 0x7f7c6800be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:14.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7effd700 1 --2- 172.21.15.79:0/2037766092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c68004bd0 0x7f7c680097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:14.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7f7fe700 1 --2- 172.21.15.79:0/2037766092 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c68003d40 0x7f7c680045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:14.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7ffff700 1 -- 172.21.15.79:0/2037766092 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c68003d40 msgr2=0x7f7c680045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:14.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7ffff700 1 --2- 172.21.15.79:0/2037766092 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c68003d40 0x7f7c680045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:14.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7ffff700 1 -- 172.21.15.79:0/2037766092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c68004bd0 msgr2=0x7f7c680097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:14.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7ffff700 1 --2- 172.21.15.79:0/2037766092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c68004bd0 0x7f7c680097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:14.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7ffff700 1 -- 172.21.15.79:0/2037766092 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c68050880 con 0x7f7c68005020 2021-04-09T18:33:14.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7ffff700 1 --2- 172.21.15.79:0/2037766092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c68005020 0x7f7c6800be20 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f7c68004510 tx=0x7f7c7000e1d0).ready entity=mon.0 client_cookie=bc77b77bbd824c5b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:14.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7e7fc700 1 -- 172.21.15.79:0/2037766092 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c68050880 con 0x7f7c68005020 2021-04-09T18:33:14.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7e7fc700 1 -- 172.21.15.79:0/2037766092 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7000ec90 con 0x7f7c68005020 2021-04-09T18:33:14.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7e7fc700 1 -- 172.21.15.79:0/2037766092 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c7000f040 con 0x7f7c68005020 2021-04-09T18:33:14.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c86078700 1 -- 172.21.15.79:0/2037766092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c68005020 msgr2=0x7f7c6800be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:14.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c86078700 1 --2- 172.21.15.79:0/2037766092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c68005020 0x7f7c6800be20 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f7c68004510 tx=0x7f7c7000e1d0).stop 2021-04-09T18:33:14.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c7ffff700 1 -- 172.21.15.79:0/2037766092 reap_dead start 2021-04-09T18:33:14.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c86078700 1 -- 172.21.15.79:0/2037766092 shutdown_connections 2021-04-09T18:33:14.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c86078700 1 -- 172.21.15.79:0/2037766092 >> 172.21.15.79:0/2037766092 conn(0x7f7c800e6000 msgr2=0x7f7c800e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:14.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c86078700 1 -- 172.21.15.79:0/2037766092 shutdown_connections 2021-04-09T18:33:14.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.329 7f7c86078700 1 -- 172.21.15.79:0/2037766092 wait complete. 2021-04-09T18:33:14.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.333 7f7c86078700 1 Processor -- start 2021-04-09T18:33:14.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.333 7f7c86078700 1 -- start start 2021-04-09T18:33:14.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.333 7f7c86078700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c8009a290 0x7f7c800b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:14.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.333 7f7c86078700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c800d63d0 0x7f7c800d6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:14.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.333 7f7c86078700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c800b0cd0 0x7f7c800b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:14.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.333 7f7c86078700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c800e9f50 con 0x7f7c8009a290 2021-04-09T18:33:14.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.333 7f7c86078700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8009b300 con 0x7f7c800b0cd0 2021-04-09T18:33:14.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.333 7f7c86078700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c800af050 con 0x7f7c800d63d0 2021-04-09T18:33:14.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.333 7f7c7f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c8009a290 0x7f7c800b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:14.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.333 7f7c7f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c8009a290 0x7f7c800b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60140/0 (socket says 172.21.15.79:60140) 2021-04-09T18:33:14.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.333 7f7c7f7fe700 1 -- 172.21.15.79:0/1283468524 learned_addr learned my addr 172.21.15.79:0/1283468524 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:14.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.333 7f7c7effd700 1 --2- 172.21.15.79:0/1283468524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c800d63d0 0x7f7c800d6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:14.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.333 7f7c7ffff700 1 --2- 172.21.15.79:0/1283468524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c800b0cd0 0x7f7c800b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:14.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.333 7f7c7f7fe700 1 -- 172.21.15.79:0/1283468524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c800d63d0 msgr2=0x7f7c800d6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:14.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.333 7f7c7f7fe700 1 --2- 172.21.15.79:0/1283468524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c800d63d0 0x7f7c800d6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:14.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.333 7f7c7f7fe700 1 -- 172.21.15.79:0/1283468524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c800b0cd0 msgr2=0x7f7c800b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:14.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.333 7f7c7f7fe700 1 --2- 172.21.15.79:0/1283468524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c800b0cd0 0x7f7c800b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:14.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.333 7f7c7f7fe700 1 -- 172.21.15.79:0/1283468524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8009ab90 con 0x7f7c8009a290 2021-04-09T18:33:14.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.333 7f7c7f7fe700 1 --2- 172.21.15.79:0/1283468524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c8009a290 0x7f7c800b00a0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f7c800d84a0 tx=0x7f7c7800d430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:14.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.337 7f7c67fff700 1 -- 172.21.15.79:0/1283468524 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c8009ab90 con 0x7f7c8009a290 2021-04-09T18:33:14.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.337 7f7c67fff700 1 -- 172.21.15.79:0/1283468524 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7800ddc0 con 0x7f7c8009a290 2021-04-09T18:33:14.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.337 7f7c86078700 1 -- 172.21.15.79:0/1283468524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c800b06d0 con 0x7f7c8009a290 2021-04-09T18:33:14.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.337 7f7c67fff700 1 -- 172.21.15.79:0/1283468524 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c78010040 con 0x7f7c8009a290 2021-04-09T18:33:14.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.337 7f7c86078700 1 -- 172.21.15.79:0/1283468524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c800b1750 con 0x7f7c8009a290 2021-04-09T18:33:14.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.337 7f7c67fff700 1 -- 172.21.15.79:0/1283468524 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7c78012070 con 0x7f7c8009a290 2021-04-09T18:33:14.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.337 7f7c67fff700 1 --2- 172.21.15.79:0/1283468524 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c60029100 0x7f7c6002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:14.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.337 7f7c67fff700 1 -- 172.21.15.79:0/1283468524 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6139+0+0 (secure 0 0 0) 0x7f7c78003070 con 0x7f7c8009a290 2021-04-09T18:33:14.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.337 7f7c7effd700 1 --2- 172.21.15.79:0/1283468524 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c60029100 0x7f7c6002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:14.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.337 7f7c7effd700 1 --2- 172.21.15.79:0/1283468524 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c60029100 0x7f7c6002b650 crc :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:14.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.341 7f7c86078700 1 -- 172.21.15.79:0/1283468524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c800e39e0 con 0x7f7c8009a290 2021-04-09T18:33:14.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.349 7f7c67fff700 1 -- 172.21.15.79:0/1283468524 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7c80107f70 con 0x7f7c8009a290 2021-04-09T18:33:14.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:14.509 7f7c86078700 1 -- 172.21.15.79:0/1283468524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7c800a1c80 con 0x7f7c8009a290 2021-04-09T18:33:15.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.141 7f7c67fff700 1 -- 172.21.15.79:0/1283468524 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v72) v1 ==== 185+0+0 (secure 0 0 0) 0x7f7c7800d9c0 con 0x7f7c8009a290 2021-04-09T18:33:15.183 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2021-04-09T18:33:15.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.181 7f7c86078700 1 -- 172.21.15.79:0/1283468524 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c60029100 msgr2=0x7f7c6002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:15.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.181 7f7c86078700 1 --2- 172.21.15.79:0/1283468524 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c60029100 0x7f7c6002b650 crc :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:15.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.181 7f7c86078700 1 -- 172.21.15.79:0/1283468524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c8009a290 msgr2=0x7f7c800b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:15.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.181 7f7c86078700 1 --2- 172.21.15.79:0/1283468524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c8009a290 0x7f7c800b00a0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f7c800d84a0 tx=0x7f7c7800d430).stop 2021-04-09T18:33:15.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.181 7f7c86078700 1 -- 172.21.15.79:0/1283468524 shutdown_connections 2021-04-09T18:33:15.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.181 7f7c86078700 1 --2- 172.21.15.79:0/1283468524 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c60029100 0x7f7c6002b650 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:15.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.181 7f7c86078700 1 --2- 172.21.15.79:0/1283468524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c800b0cd0 0x7f7c800b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:15.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.181 7f7c86078700 1 --2- 172.21.15.79:0/1283468524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c8009a290 0x7f7c800b00a0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:15.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.181 7f7c86078700 1 --2- 172.21.15.79:0/1283468524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c800d63d0 0x7f7c800d6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:15.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.181 7f7c86078700 1 -- 172.21.15.79:0/1283468524 >> 172.21.15.79:0/1283468524 conn(0x7f7c800baaf0 msgr2=0x7f7c800d85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:15.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.181 7f7c86078700 1 -- 172.21.15.79:0/1283468524 shutdown_connections 2021-04-09T18:33:15.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.181 7f7c86078700 1 -- 172.21.15.79:0/1283468524 wait complete. 2021-04-09T18:33:15.201 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-04-09T18:33:15.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca345f0700 1 Processor -- start 2021-04-09T18:33:15.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca345f0700 1 -- start start 2021-04-09T18:33:15.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca345f0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fca2c0f5550 0x7fca2c0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca345f0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fca2c0e9b10 0x7fca2c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca345f0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca2c0fbb50 con 0x7fca2c1c2de0 2021-04-09T18:33:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca345f0700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2c0e9f60 con 0x7fca2c0e9b10 2021-04-09T18:33:15.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca345f0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2c0e5a00 con 0x7fca2c0f5550 2021-04-09T18:33:15.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca31b93700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fca2c0e9b10 0x7fca2c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:15.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca31b93700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fca2c0e9b10 0x7fca2c09f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60146/0 (socket says 172.21.15.79:60146) 2021-04-09T18:33:15.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca31b93700 1 -- 172.21.15.79:0/462592631 learned_addr learned my addr 172.21.15.79:0/462592631 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:15.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca32394700 1 --2- 172.21.15.79:0/462592631 >> v2:172.21.15.89:3300/0 conn(0x7fca2c0f5550 0x7fca2c0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:15.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca31b93700 1 -- 172.21.15.79:0/462592631 >> v2:172.21.15.89:3300/0 conn(0x7fca2c0f5550 msgr2=0x7fca2c0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:15.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca31b93700 1 --2- 172.21.15.79:0/462592631 >> v2:172.21.15.89:3300/0 conn(0x7fca2c0f5550 0x7fca2c0f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:15.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca31b93700 1 -- 172.21.15.79:0/462592631 >> v1:172.21.15.89:6789/0 conn(0x7fca2c1c2de0 legacy=0x7fca2c1c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:15.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca31b93700 1 -- 172.21.15.79:0/462592631 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c0e5700 con 0x7fca2c0e9b10 2021-04-09T18:33:15.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca31b93700 1 --2- 172.21.15.79:0/462592631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca2c0e9b10 0x7fca2c09f110 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7fca1c002f30 tx=0x7fca1c00bd70).ready entity=mon.0 client_cookie=5690f95d35848ea server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:15.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca31392700 1 -- 172.21.15.79:0/462592631 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fca2c0e5700 con 0x7fca2c0e9b10 2021-04-09T18:33:15.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca31392700 1 -- 172.21.15.79:0/462592631 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1c009900 con 0x7fca2c0e9b10 2021-04-09T18:33:15.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca31392700 1 -- 172.21.15.79:0/462592631 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fca1c009cd0 con 0x7fca2c0e9b10 2021-04-09T18:33:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca345f0700 1 -- 172.21.15.79:0/462592631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca2c0e9b10 msgr2=0x7fca2c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.305 7fca345f0700 1 --2- 172.21.15.79:0/462592631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca2c0e9b10 0x7fca2c09f110 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7fca1c002f30 tx=0x7fca1c00bd70).stop 2021-04-09T18:33:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.309 7fca345f0700 1 -- 172.21.15.79:0/462592631 shutdown_connections 2021-04-09T18:33:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.309 7fca345f0700 1 --2- 172.21.15.79:0/462592631 >> v2:172.21.15.89:3300/0 conn(0x7fca2c0f5550 0x7fca2c0f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.309 7fca345f0700 1 --2- 172.21.15.79:0/462592631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca2c0e9b10 0x7fca2c09f110 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.309 7fca345f0700 1 -- 172.21.15.79:0/462592631 >> 172.21.15.79:0/462592631 conn(0x7fca2c0e6010 msgr2=0x7fca2c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.309 7fca345f0700 1 -- 172.21.15.79:0/462592631 shutdown_connections 2021-04-09T18:33:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.309 7fca345f0700 1 -- 172.21.15.79:0/462592631 wait complete. 2021-04-09T18:33:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.309 7fca345f0700 1 Processor -- start 2021-04-09T18:33:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.309 7fca345f0700 1 -- start start 2021-04-09T18:33:15.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.309 7fca345f0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca2c0d50d0 0x7fca2c0d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:15.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.309 7fca345f0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca2c0d5520 0x7fca2c0d1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:15.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.309 7fca345f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca2c1aa070 0x7fca2c1aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:15.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.309 7fca345f0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c088580 con 0x7fca2c1aa070 2021-04-09T18:33:15.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.309 7fca345f0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c090f10 con 0x7fca2c0d5520 2021-04-09T18:33:15.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.309 7fca345f0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c0903a0 con 0x7fca2c0d50d0 2021-04-09T18:33:15.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca32b95700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca2c1aa070 0x7fca2c1aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:15.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca31b93700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca2c0d5520 0x7fca2c0d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:15.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca32394700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca2c0d50d0 0x7fca2c0d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:15.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca32b95700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca2c1aa070 0x7fca2c1aa4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60156/0 (socket says 172.21.15.79:60156) 2021-04-09T18:33:15.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca32b95700 1 -- 172.21.15.79:0/3608083003 learned_addr learned my addr 172.21.15.79:0/3608083003 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:15.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca31b93700 1 --2- 172.21.15.79:0/3608083003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca2c0d5520 0x7fca2c0d1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:48494/0 (socket says 172.21.15.79:48494) 2021-04-09T18:33:15.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca32b95700 1 -- 172.21.15.79:0/3608083003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca2c0d50d0 msgr2=0x7fca2c0d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:15.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca32b95700 1 --2- 172.21.15.79:0/3608083003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca2c0d50d0 0x7fca2c0d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:15.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca32b95700 1 -- 172.21.15.79:0/3608083003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca2c0d5520 msgr2=0x7fca2c0d1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:15.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca32b95700 1 --2- 172.21.15.79:0/3608083003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca2c0d5520 0x7fca2c0d1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:15.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca32b95700 1 -- 172.21.15.79:0/3608083003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c1a6ab0 con 0x7fca2c1aa070 2021-04-09T18:33:15.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca32b95700 1 --2- 172.21.15.79:0/3608083003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca2c1aa070 0x7fca2c1aa4c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fca2c0961f0 tx=0x7fca24009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:15.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca22ffd700 1 -- 172.21.15.79:0/3608083003 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fca2c1a6ab0 con 0x7fca2c1aa070 2021-04-09T18:33:15.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca22ffd700 1 -- 172.21.15.79:0/3608083003 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca240105e0 con 0x7fca2c1aa070 2021-04-09T18:33:15.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca345f0700 1 -- 172.21.15.79:0/3608083003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2c090aa0 con 0x7fca2c1aa070 2021-04-09T18:33:15.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca22ffd700 1 -- 172.21.15.79:0/3608083003 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fca240109b0 con 0x7fca2c1aa070 2021-04-09T18:33:15.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca345f0700 1 -- 172.21.15.79:0/3608083003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2c0d1810 con 0x7fca2c1aa070 2021-04-09T18:33:15.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca22ffd700 1 -- 172.21.15.79:0/3608083003 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fca240193b0 con 0x7fca2c1aa070 2021-04-09T18:33:15.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca22ffd700 1 --2- 172.21.15.79:0/3608083003 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fca0c029100 0x7fca0c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:15.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca22ffd700 1 -- 172.21.15.79:0/3608083003 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5701+0+0 (secure 0 0 0) 0x7fca24038c00 con 0x7fca2c1aa070 2021-04-09T18:33:15.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.313 7fca32394700 1 --2- 172.21.15.79:0/3608083003 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fca0c029100 0x7fca0c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:15.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.317 7fca32394700 1 --2- 172.21.15.79:0/3608083003 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fca0c029100 0x7fca0c02b650 crc :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:15.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.321 7fca345f0700 1 -- 172.21.15.79:0/3608083003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca2c0e39f0 con 0x7fca2c1aa070 2021-04-09T18:33:15.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.329 7fca22ffd700 1 -- 172.21.15.79:0/3608083003 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fca2c0f76f0 con 0x7fca2c1aa070 2021-04-09T18:33:15.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:15.493 7fca345f0700 1 -- 172.21.15.79:0/3608083003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fca2c0f5b50 con 0x7fca2c1aa070 2021-04-09T18:33:16.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.145 7fca22ffd700 1 -- 172.21.15.79:0/3608083003 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v73) v1 ==== 173+0+0 (secure 0 0 0) 0x7fca2400d040 con 0x7fca2c1aa070 2021-04-09T18:33:16.168 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2021-04-09T18:33:16.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.161 7fca345f0700 1 -- 172.21.15.79:0/3608083003 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fca0c029100 msgr2=0x7fca0c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:16.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.161 7fca345f0700 1 --2- 172.21.15.79:0/3608083003 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fca0c029100 0x7fca0c02b650 crc :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:16.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.161 7fca345f0700 1 -- 172.21.15.79:0/3608083003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca2c1aa070 msgr2=0x7fca2c1aa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:16.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.161 7fca345f0700 1 --2- 172.21.15.79:0/3608083003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca2c1aa070 0x7fca2c1aa4c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fca2c0961f0 tx=0x7fca24009b30).stop 2021-04-09T18:33:16.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.161 7fca345f0700 1 -- 172.21.15.79:0/3608083003 shutdown_connections 2021-04-09T18:33:16.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.161 7fca345f0700 1 --2- 172.21.15.79:0/3608083003 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fca0c029100 0x7fca0c02b650 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:16.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.161 7fca345f0700 1 --2- 172.21.15.79:0/3608083003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca2c1aa070 0x7fca2c1aa4c0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:16.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.161 7fca345f0700 1 --2- 172.21.15.79:0/3608083003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca2c0d50d0 0x7fca2c0d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:16.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.161 7fca345f0700 1 --2- 172.21.15.79:0/3608083003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca2c0d5520 0x7fca2c0d1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:16.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.161 7fca345f0700 1 -- 172.21.15.79:0/3608083003 >> 172.21.15.79:0/3608083003 conn(0x7fca2c094b00 msgr2=0x7fca2c0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:16.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.165 7fca345f0700 1 -- 172.21.15.79:0/3608083003 shutdown_connections 2021-04-09T18:33:16.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.165 7fca345f0700 1 -- 172.21.15.79:0/3608083003 wait complete. 2021-04-09T18:33:16.184 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-04-09T18:33:16.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8ba700c700 1 Processor -- start 2021-04-09T18:33:16.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8ba700c700 1 -- start start 2021-04-09T18:33:16.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8ba700c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba00e9ae0 0x7f8ba009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:16.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8ba700c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8ba01c8010 0x7f8ba01ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:16.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8ba700c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ba00fbb20 con 0x7f8ba00f5520 2021-04-09T18:33:16.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8ba700c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba01c3dc0 con 0x7f8ba01c8010 2021-04-09T18:33:16.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8ba700c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba00e9f30 con 0x7f8ba00e9ae0 2021-04-09T18:33:16.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8ba55b1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8ba01c8010 0x7f8ba01ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:16.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8ba4db0700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8ba00f5520 0x7f8ba00f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54870/0 (socket says 172.21.15.79:54870) 2021-04-09T18:33:16.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8ba4db0700 1 -- 172.21.15.79:0/3708915902 learned_addr learned my addr 172.21.15.79:0/3708915902 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:16.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8b9ffff700 1 --2- 172.21.15.79:0/3708915902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba00e9ae0 0x7f8ba009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:16.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8ba55b1700 1 -- 172.21.15.79:0/3708915902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba00e9ae0 msgr2=0x7f8ba009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:16.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8ba55b1700 1 --2- 172.21.15.79:0/3708915902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba00e9ae0 0x7f8ba009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:16.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8ba55b1700 1 -- 172.21.15.79:0/3708915902 >> v1:172.21.15.79:6789/0 conn(0x7f8ba00f5520 legacy=0x7f8ba00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:16.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8b9f7fe700 1 -- 172.21.15.79:0/3708915902 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086409823 0 0) 0x7f8b900010d0 con 0x7f8ba00f5520 2021-04-09T18:33:16.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8ba55b1700 1 -- 172.21.15.79:0/3708915902 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba00e56d0 con 0x7f8ba01c8010 2021-04-09T18:33:16.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8ba55b1700 1 --2- 172.21.15.79:0/3708915902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba01c8010 0x7f8ba01ca470 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f8b980032b0 tx=0x7f8b9800b3c0).ready entity=mon.0 client_cookie=122efcc44cedf29b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:16.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8b9f7fe700 1 -- 172.21.15.79:0/3708915902 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8ba00e56d0 con 0x7f8ba01c8010 2021-04-09T18:33:16.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8b9f7fe700 1 -- 172.21.15.79:0/3708915902 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9800bc20 con 0x7f8ba01c8010 2021-04-09T18:33:16.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8b9f7fe700 1 -- 172.21.15.79:0/3708915902 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b98002020 con 0x7f8ba01c8010 2021-04-09T18:33:16.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8ba700c700 1 -- 172.21.15.79:0/3708915902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba01c8010 msgr2=0x7f8ba01ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:16.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.285 7f8ba700c700 1 --2- 172.21.15.79:0/3708915902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba01c8010 0x7f8ba01ca470 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f8b980032b0 tx=0x7f8b9800b3c0).stop 2021-04-09T18:33:16.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.289 7f8ba700c700 1 -- 172.21.15.79:0/3708915902 shutdown_connections 2021-04-09T18:33:16.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.289 7f8ba700c700 1 --2- 172.21.15.79:0/3708915902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba01c8010 0x7f8ba01ca470 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:16.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.289 7f8ba700c700 1 --2- 172.21.15.79:0/3708915902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba00e9ae0 0x7f8ba009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:16.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.289 7f8ba700c700 1 -- 172.21.15.79:0/3708915902 >> 172.21.15.79:0/3708915902 conn(0x7f8ba00e5fe0 msgr2=0x7f8ba00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:16.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.289 7f8ba700c700 1 -- 172.21.15.79:0/3708915902 shutdown_connections 2021-04-09T18:33:16.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.289 7f8ba700c700 1 -- 172.21.15.79:0/3708915902 wait complete. 2021-04-09T18:33:16.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.293 7f8ba700c700 1 Processor -- start 2021-04-09T18:33:16.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.293 7f8ba700c700 1 -- start start 2021-04-09T18:33:16.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.293 7f8ba700c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ba00ad780 0x7f8ba0091600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:16.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.293 7f8ba700c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba00940e0 0x7f8ba00ce400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:16.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.293 7f8ba700c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba00cea30 0x7f8ba00adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:16.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.293 7f8ba700c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba00e8af0 con 0x7f8ba00940e0 2021-04-09T18:33:16.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.293 7f8ba700c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba00d59c0 con 0x7f8ba00ad780 2021-04-09T18:33:16.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.293 7f8ba700c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba00d5cc0 con 0x7f8ba00cea30 2021-04-09T18:33:16.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.293 7f8b9ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba00940e0 0x7f8ba00ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:16.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.293 7f8b9ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba00940e0 0x7f8ba00ce400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60168/0 (socket says 172.21.15.79:60168) 2021-04-09T18:33:16.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.293 7f8b9ffff700 1 -- 172.21.15.79:0/1526750226 learned_addr learned my addr 172.21.15.79:0/1526750226 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:16.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.293 7f8ba4db0700 1 --2- 172.21.15.79:0/1526750226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ba00ad780 0x7f8ba0091600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:16.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.293 7f8ba55b1700 1 --2- 172.21.15.79:0/1526750226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba00cea30 0x7f8ba00adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:16.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.293 7f8b9ffff700 1 -- 172.21.15.79:0/1526750226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba00cea30 msgr2=0x7f8ba00adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:16.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.293 7f8b9ffff700 1 --2- 172.21.15.79:0/1526750226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba00cea30 0x7f8ba00adcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:16.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.293 7f8b9ffff700 1 -- 172.21.15.79:0/1526750226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ba00ad780 msgr2=0x7f8ba0091600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:16.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.293 7f8b9ffff700 1 --2- 172.21.15.79:0/1526750226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ba00ad780 0x7f8ba0091600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:16.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.293 7f8b9ffff700 1 -- 172.21.15.79:0/1526750226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba00d4e00 con 0x7f8ba00940e0 2021-04-09T18:33:16.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.293 7f8b9ffff700 1 --2- 172.21.15.79:0/1526750226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba00940e0 0x7f8ba00ce400 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f8ba00d5940 tx=0x7f8b8800c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:16.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.293 7f8b9d7fa700 1 -- 172.21.15.79:0/1526750226 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8ba00d4e00 con 0x7f8ba00940e0 2021-04-09T18:33:16.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.297 7f8b9d7fa700 1 -- 172.21.15.79:0/1526750226 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8800cc10 con 0x7f8ba00940e0 2021-04-09T18:33:16.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.297 7f8ba700c700 1 -- 172.21.15.79:0/1526750226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba00d5550 con 0x7f8ba00940e0 2021-04-09T18:33:16.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.297 7f8b9d7fa700 1 -- 172.21.15.79:0/1526750226 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b8800f040 con 0x7f8ba00940e0 2021-04-09T18:33:16.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.297 7f8ba700c700 1 -- 172.21.15.79:0/1526750226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba00cf010 con 0x7f8ba00940e0 2021-04-09T18:33:16.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.297 7f8b9d7fa700 1 -- 172.21.15.79:0/1526750226 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8b88011070 con 0x7f8ba00940e0 2021-04-09T18:33:16.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.297 7f8b9d7fa700 1 --2- 172.21.15.79:0/1526750226 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b84029100 0x7f8b8402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:16.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.297 7f8b9d7fa700 1 -- 172.21.15.79:0/1526750226 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5319+0+0 (secure 0 0 0) 0x7f8b88010040 con 0x7f8ba00940e0 2021-04-09T18:33:16.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.297 7f8ba4db0700 1 --2- 172.21.15.79:0/1526750226 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b84029100 0x7f8b8402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:16.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.297 7f8ba4db0700 1 --2- 172.21.15.79:0/1526750226 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b84029100 0x7f8b8402b650 crc :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:16.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.301 7f8ba700c700 1 -- 172.21.15.79:0/1526750226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba00e39e0 con 0x7f8ba00940e0 2021-04-09T18:33:16.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.305 7f8b9d7fa700 1 -- 172.21.15.79:0/1526750226 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8b8800c810 con 0x7f8ba00940e0 2021-04-09T18:33:16.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.489 7f8ba700c700 1 -- 172.21.15.79:0/1526750226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8ba00f5b20 con 0x7f8ba00940e0 2021-04-09T18:33:16.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.493 7f8b9d7fa700 1 -- 172.21.15.79:0/1526750226 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8b88000bf0 con 0x7f8ba00940e0 2021-04-09T18:33:16.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.497 7f8ba700c700 1 -- 172.21.15.79:0/1526750226 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b84029100 msgr2=0x7f8b8402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:16.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.497 7f8ba700c700 1 --2- 172.21.15.79:0/1526750226 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b84029100 0x7f8b8402b650 crc :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:16.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.497 7f8ba700c700 1 -- 172.21.15.79:0/1526750226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba00940e0 msgr2=0x7f8ba00ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:16.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.497 7f8ba700c700 1 --2- 172.21.15.79:0/1526750226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba00940e0 0x7f8ba00ce400 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f8ba00d5940 tx=0x7f8b8800c150).stop 2021-04-09T18:33:16.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.497 7f8ba700c700 1 -- 172.21.15.79:0/1526750226 shutdown_connections 2021-04-09T18:33:16.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.497 7f8ba700c700 1 --2- 172.21.15.79:0/1526750226 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b84029100 0x7f8b8402b650 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:16.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.497 7f8ba700c700 1 --2- 172.21.15.79:0/1526750226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ba00ad780 0x7f8ba0091600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:16.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.497 7f8ba700c700 1 --2- 172.21.15.79:0/1526750226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba00cea30 0x7f8ba00adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:16.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.497 7f8ba700c700 1 --2- 172.21.15.79:0/1526750226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba00940e0 0x7f8ba00ce400 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:16.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.497 7f8ba700c700 1 -- 172.21.15.79:0/1526750226 >> 172.21.15.79:0/1526750226 conn(0x7f8ba0093650 msgr2=0x7f8ba00d6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:16.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.501 7f8ba700c700 1 -- 172.21.15.79:0/1526750226 shutdown_connections 2021-04-09T18:33:16.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.501 7f8ba700c700 1 -- 172.21.15.79:0/1526750226 wait complete. 2021-04-09T18:33:16.522 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2021-04-09T18:33:16.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.597 7f3746079700 1 Processor -- start 2021-04-09T18:33:16.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.597 7f3746079700 1 -- start start 2021-04-09T18:33:16.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.597 7f3746079700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f37400f5520 0x7f37400f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:16.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.597 7f3746079700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37401c8010 0x7f37401ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:16.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f3746079700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37400fbb20 con 0x7f37400e9ae0 2021-04-09T18:33:16.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f3746079700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37400e9f30 con 0x7f37400f5520 2021-04-09T18:33:16.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f3746079700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37401c3dc0 con 0x7f37401c8010 2021-04-09T18:33:16.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f373effd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f37400e9ae0 0x7f374009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54886/0 (socket says 172.21.15.79:54886) 2021-04-09T18:33:16.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f373effd700 1 -- 172.21.15.79:0/484661820 learned_addr learned my addr 172.21.15.79:0/484661820 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:16.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f373f7fe700 1 --2- 172.21.15.79:0/484661820 >> v2:172.21.15.89:3300/0 conn(0x7f37400f5520 0x7f37400f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:16.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f373ffff700 1 --2- 172.21.15.79:0/484661820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37401c8010 0x7f37401ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:16.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f373e7fc700 1 -- 172.21.15.79:0/484661820 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999766691 0 0) 0x7f37280010d0 con 0x7f37400e9ae0 2021-04-09T18:33:16.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f373e7fc700 1 -- 172.21.15.79:0/484661820 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f372c003240 con 0x7f37400e9ae0 2021-04-09T18:33:16.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f373f7fe700 1 -- 172.21.15.79:0/484661820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37401c8010 msgr2=0x7f37401ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:16.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f373f7fe700 1 --2- 172.21.15.79:0/484661820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37401c8010 0x7f37401ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:16.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f373f7fe700 1 -- 172.21.15.79:0/484661820 >> v1:172.21.15.79:6789/0 conn(0x7f37400e9ae0 legacy=0x7f374009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:16.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f373f7fe700 1 -- 172.21.15.79:0/484661820 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374009f910 con 0x7f37400f5520 2021-04-09T18:33:16.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f373f7fe700 1 --2- 172.21.15.79:0/484661820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37400f5520 0x7f37400f64b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f37400f6f00 tx=0x7f373000bd70).ready entity=mon.1 client_cookie=dc0641d14d80ad3d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:16.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f373e7fc700 1 -- 172.21.15.79:0/484661820 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f374009f910 con 0x7f37400f5520 2021-04-09T18:33:16.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f373e7fc700 1 -- 172.21.15.79:0/484661820 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3730009810 con 0x7f37400f5520 2021-04-09T18:33:16.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f373e7fc700 1 -- 172.21.15.79:0/484661820 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3730009be0 con 0x7f37400f5520 2021-04-09T18:33:16.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f3746079700 1 -- 172.21.15.79:0/484661820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37400f5520 msgr2=0x7f37400f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:16.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f3746079700 1 --2- 172.21.15.79:0/484661820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37400f5520 0x7f37400f64b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f37400f6f00 tx=0x7f373000bd70).stop 2021-04-09T18:33:16.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f3746079700 1 -- 172.21.15.79:0/484661820 shutdown_connections 2021-04-09T18:33:16.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f3746079700 1 --2- 172.21.15.79:0/484661820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37400f5520 0x7f37400f64b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:16.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f3746079700 1 --2- 172.21.15.79:0/484661820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37401c8010 0x7f37401ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:16.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f3746079700 1 -- 172.21.15.79:0/484661820 >> 172.21.15.79:0/484661820 conn(0x7f37400e5fe0 msgr2=0x7f37400e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:16.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f3746079700 1 -- 172.21.15.79:0/484661820 shutdown_connections 2021-04-09T18:33:16.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.601 7f3746079700 1 -- 172.21.15.79:0/484661820 wait complete. 2021-04-09T18:33:16.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f3746079700 1 Processor -- start 2021-04-09T18:33:16.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f3746079700 1 -- start start 2021-04-09T18:33:16.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f3746079700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37400ac0e0 0x7f37400baf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:16.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f3746079700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37400aea00 0x7f37401adf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:16.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f3746079700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37400d4e50 0x7f37400d52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:16.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f3746079700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37400ad160 con 0x7f37400ac0e0 2021-04-09T18:33:16.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f3746079700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37400ad460 con 0x7f37400d4e50 2021-04-09T18:33:16.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f3746079700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37400ac9f0 con 0x7f37400aea00 2021-04-09T18:33:16.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f373f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37400ac0e0 0x7f37400baf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:16.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f373f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37400ac0e0 0x7f37400baf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60184/0 (socket says 172.21.15.79:60184) 2021-04-09T18:33:16.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f373f7fe700 1 -- 172.21.15.79:0/168054971 learned_addr learned my addr 172.21.15.79:0/168054971 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:16.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f373effd700 1 --2- 172.21.15.79:0/168054971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37400aea00 0x7f37401adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:16.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f373ffff700 1 --2- 172.21.15.79:0/168054971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37400d4e50 0x7f37400d52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:16.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f373f7fe700 1 -- 172.21.15.79:0/168054971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37400aea00 msgr2=0x7f37401adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:16.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f373f7fe700 1 --2- 172.21.15.79:0/168054971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37400aea00 0x7f37401adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:16.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f373f7fe700 1 -- 172.21.15.79:0/168054971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37400d4e50 msgr2=0x7f37400d52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:16.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f373f7fe700 1 --2- 172.21.15.79:0/168054971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37400d4e50 0x7f37400d52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:16.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f373f7fe700 1 -- 172.21.15.79:0/168054971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37400acd10 con 0x7f37400ac0e0 2021-04-09T18:33:16.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f373f7fe700 1 --2- 172.21.15.79:0/168054971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37400ac0e0 0x7f37400baf50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f37400874d0 tx=0x7f3730006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:16.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f3737fff700 1 -- 172.21.15.79:0/168054971 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f37400acd10 con 0x7f37400ac0e0 2021-04-09T18:33:16.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f3737fff700 1 -- 172.21.15.79:0/168054971 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3730009c70 con 0x7f37400ac0e0 2021-04-09T18:33:16.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f3746079700 1 -- 172.21.15.79:0/168054971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37401ae560 con 0x7f37400ac0e0 2021-04-09T18:33:16.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.605 7f3737fff700 1 -- 172.21.15.79:0/168054971 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3730022020 con 0x7f37400ac0e0 2021-04-09T18:33:16.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.609 7f3746079700 1 -- 172.21.15.79:0/168054971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37400aefe0 con 0x7f37400ac0e0 2021-04-09T18:33:16.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.609 7f3737fff700 1 -- 172.21.15.79:0/168054971 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f373001d640 con 0x7f37400ac0e0 2021-04-09T18:33:16.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.609 7f3737fff700 1 --2- 172.21.15.79:0/168054971 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3724029100 0x7f372402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:16.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.609 7f3737fff700 1 -- 172.21.15.79:0/168054971 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5319+0+0 (secure 0 0 0) 0x7f373003bc10 con 0x7f37400ac0e0 2021-04-09T18:33:16.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.609 7f373effd700 1 --2- 172.21.15.79:0/168054971 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3724029100 0x7f372402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:16.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.609 7f373effd700 1 --2- 172.21.15.79:0/168054971 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3724029100 0x7f372402b650 crc :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:16.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.609 7f3746079700 1 -- 172.21.15.79:0/168054971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37400e39e0 con 0x7f37400ac0e0 2021-04-09T18:33:16.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.617 7f3737fff700 1 -- 172.21.15.79:0/168054971 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3730009600 con 0x7f37400ac0e0 2021-04-09T18:33:16.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:16.785 7f3746079700 1 -- 172.21.15.79:0/168054971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7f37400f5b20 con 0x7f37400ac0e0 2021-04-09T18:33:17.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.157 7f3737fff700 1 -- 172.21.15.79:0/168054971 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v186) v1 ==== 139+0+0 (secure 0 0 0) 0x7f373001ace0 con 0x7f37400ac0e0 2021-04-09T18:33:17.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.201 7f3746079700 1 -- 172.21.15.79:0/168054971 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3724029100 msgr2=0x7f372402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:17.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.201 7f3746079700 1 --2- 172.21.15.79:0/168054971 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3724029100 0x7f372402b650 crc :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:17.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.201 7f3746079700 1 -- 172.21.15.79:0/168054971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37400ac0e0 msgr2=0x7f37400baf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:17.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.201 7f3746079700 1 --2- 172.21.15.79:0/168054971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37400ac0e0 0x7f37400baf50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f37400874d0 tx=0x7f3730006890).stop 2021-04-09T18:33:17.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.201 7f3746079700 1 -- 172.21.15.79:0/168054971 shutdown_connections 2021-04-09T18:33:17.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.201 7f3746079700 1 --2- 172.21.15.79:0/168054971 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3724029100 0x7f372402b650 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:17.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.201 7f3746079700 1 --2- 172.21.15.79:0/168054971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37400d4e50 0x7f37400d52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:17.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.201 7f3746079700 1 --2- 172.21.15.79:0/168054971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37400ac0e0 0x7f37400baf50 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:17.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.201 7f3746079700 1 --2- 172.21.15.79:0/168054971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37400aea00 0x7f37401adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:17.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.201 7f3746079700 1 -- 172.21.15.79:0/168054971 >> 172.21.15.79:0/168054971 conn(0x7f374009a900 msgr2=0x7f37401a1480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:17.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.201 7f3746079700 1 -- 172.21.15.79:0/168054971 shutdown_connections 2021-04-09T18:33:17.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.201 7f3746079700 1 -- 172.21.15.79:0/168054971 wait complete. 2021-04-09T18:33:17.227 INFO:tasks.cephfs_test_runner:test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) ... ok 2021-04-09T18:33:17.228 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode (tasks.cephfs.test_misc.TestMisc) 2021-04-09T18:33:17.228 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2021-04-09T18:33:17.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.321 7f3f2682e700 1 Processor -- start 2021-04-09T18:33:17.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.321 7f3f2682e700 1 -- start start 2021-04-09T18:33:17.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.321 7f3f2682e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f200e9ad0 0x7f3f2009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:17.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.321 7f3f2682e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3f201c8000 0x7f3f201ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:17.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.321 7f3f2682e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f200fbb10 con 0x7f3f200f5510 2021-04-09T18:33:17.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.321 7f3f2682e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f201c3db0 con 0x7f3f201c8000 2021-04-09T18:33:17.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.321 7f3f2682e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200e9f20 con 0x7f3f200e9ad0 2021-04-09T18:33:17.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.321 7f3f24dd3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3f201c8000 0x7f3f201ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:17.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.321 7f3f24dd3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3f201c8000 0x7f3f201ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60192/0 (socket says 172.21.15.79:60192) 2021-04-09T18:33:17.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.321 7f3f24dd3700 1 -- 172.21.15.79:0/848415443 learned_addr learned my addr 172.21.15.79:0/848415443 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:17.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.321 7f3f1f7fe700 1 --2- 172.21.15.79:0/848415443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f200e9ad0 0x7f3f2009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:17.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.321 7f3f1effd700 1 -- 172.21.15.79:0/848415443 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396194828 0 0) 0x7f3f10001450 con 0x7f3f200f5510 2021-04-09T18:33:17.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.321 7f3f1effd700 1 -- 172.21.15.79:0/848415443 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f0c003240 con 0x7f3f200f5510 2021-04-09T18:33:17.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.321 7f3f24dd3700 1 -- 172.21.15.79:0/848415443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f200e9ad0 msgr2=0x7f3f2009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:17.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.321 7f3f24dd3700 1 --2- 172.21.15.79:0/848415443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f200e9ad0 0x7f3f2009f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:17.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.321 7f3f24dd3700 1 -- 172.21.15.79:0/848415443 >> v1:172.21.15.89:6789/0 conn(0x7f3f200f5510 legacy=0x7f3f200f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:17.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.321 7f3f24dd3700 1 -- 172.21.15.79:0/848415443 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f200e56c0 con 0x7f3f201c8000 2021-04-09T18:33:17.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.321 7f3f1f7fe700 1 --2- 172.21.15.79:0/848415443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f200e9ad0 0x7f3f2009f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:17.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.321 7f3f24dd3700 1 --2- 172.21.15.79:0/848415443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f201c8000 0x7f3f201ca460 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f3f18002f30 tx=0x7f3f1800bda0).ready entity=mon.0 client_cookie=f0edca84d36262b7 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:17.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.321 7f3f1effd700 1 -- 172.21.15.79:0/848415443 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f200e56c0 con 0x7f3f201c8000 2021-04-09T18:33:17.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.325 7f3f1effd700 1 -- 172.21.15.79:0/848415443 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f180099d0 con 0x7f3f201c8000 2021-04-09T18:33:17.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.325 7f3f1effd700 1 -- 172.21.15.79:0/848415443 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f18009da0 con 0x7f3f201c8000 2021-04-09T18:33:17.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.325 7f3f2682e700 1 -- 172.21.15.79:0/848415443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f201c8000 msgr2=0x7f3f201ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:17.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.325 7f3f2682e700 1 --2- 172.21.15.79:0/848415443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f201c8000 0x7f3f201ca460 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f3f18002f30 tx=0x7f3f1800bda0).stop 2021-04-09T18:33:17.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.325 7f3f2682e700 1 -- 172.21.15.79:0/848415443 shutdown_connections 2021-04-09T18:33:17.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.325 7f3f2682e700 1 --2- 172.21.15.79:0/848415443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f201c8000 0x7f3f201ca460 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:17.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.325 7f3f2682e700 1 --2- 172.21.15.79:0/848415443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f200e9ad0 0x7f3f2009f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:17.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.325 7f3f2682e700 1 -- 172.21.15.79:0/848415443 >> 172.21.15.79:0/848415443 conn(0x7f3f200e5fd0 msgr2=0x7f3f200e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:17.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.325 7f3f2682e700 1 -- 172.21.15.79:0/848415443 shutdown_connections 2021-04-09T18:33:17.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.325 7f3f2682e700 1 -- 172.21.15.79:0/848415443 wait complete. 2021-04-09T18:33:17.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.325 7f3f2682e700 1 Processor -- start 2021-04-09T18:33:17.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.325 7f3f2682e700 1 -- start start 2021-04-09T18:33:17.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f2682e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f200bd8b0 0x7f3f2008f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:17.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f2682e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f201aea60 0x7f3f201aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:17.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f2682e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f201af4e0 0x7f3f201aa950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:17.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f2682e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200e8ae0 con 0x7f3f201aea60 2021-04-09T18:33:17.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f2682e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200bbe60 con 0x7f3f201af4e0 2021-04-09T18:33:17.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f2682e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200bc160 con 0x7f3f200bd8b0 2021-04-09T18:33:17.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f1f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f201aea60 0x7f3f201aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:17.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f1f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f201aea60 0x7f3f201aeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60196/0 (socket says 172.21.15.79:60196) 2021-04-09T18:33:17.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f24dd3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f201af4e0 0x7f3f201aa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:17.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f1f7fe700 1 -- 172.21.15.79:0/1400258569 learned_addr learned my addr 172.21.15.79:0/1400258569 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:17.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f1ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f200bd8b0 0x7f3f2008f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:17.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f1f7fe700 1 -- 172.21.15.79:0/1400258569 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f200bd8b0 msgr2=0x7f3f2008f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:17.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f1f7fe700 1 --2- 172.21.15.79:0/1400258569 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f200bd8b0 0x7f3f2008f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:17.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f1f7fe700 1 -- 172.21.15.79:0/1400258569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f201af4e0 msgr2=0x7f3f201aa950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:17.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f1f7fe700 1 --2- 172.21.15.79:0/1400258569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f201af4e0 0x7f3f201aa950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:17.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f1f7fe700 1 -- 172.21.15.79:0/1400258569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f201af930 con 0x7f3f201aea60 2021-04-09T18:33:17.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f1f7fe700 1 --2- 172.21.15.79:0/1400258569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f201aea60 0x7f3f201aeeb0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f3f0800efc0 tx=0x7f3f0800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:17.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f1cff9700 1 -- 172.21.15.79:0/1400258569 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f201af930 con 0x7f3f201aea60 2021-04-09T18:33:17.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f1cff9700 1 -- 172.21.15.79:0/1400258569 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f080123f0 con 0x7f3f201aea60 2021-04-09T18:33:17.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f1cff9700 1 -- 172.21.15.79:0/1400258569 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f0800f040 con 0x7f3f201aea60 2021-04-09T18:33:17.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f2682e700 1 -- 172.21.15.79:0/1400258569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f200bba90 con 0x7f3f201aea60 2021-04-09T18:33:17.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f2682e700 1 -- 172.21.15.79:0/1400258569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f201ab110 con 0x7f3f201aea60 2021-04-09T18:33:17.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.329 7f3f1cff9700 1 -- 172.21.15.79:0/1400258569 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3f08011070 con 0x7f3f201aea60 2021-04-09T18:33:17.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.333 7f3f1cff9700 1 --2- 172.21.15.79:0/1400258569 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3f04029100 0x7f3f0402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:17.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.333 7f3f1cff9700 1 -- 172.21.15.79:0/1400258569 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5319+0+0 (secure 0 0 0) 0x7f3f08010040 con 0x7f3f201aea60 2021-04-09T18:33:17.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.333 7f3f1ffff700 1 --2- 172.21.15.79:0/1400258569 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3f04029100 0x7f3f0402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:17.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.333 7f3f1ffff700 1 --2- 172.21.15.79:0/1400258569 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3f04029100 0x7f3f0402b650 crc :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:17.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.337 7f3f2682e700 1 -- 172.21.15.79:0/1400258569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f20092820 con 0x7f3f201aea60 2021-04-09T18:33:17.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.341 7f3f1cff9700 1 -- 172.21.15.79:0/1400258569 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3f08000bf0 con 0x7f3f201aea60 2021-04-09T18:33:17.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:17.505 7f3f2682e700 1 -- 172.21.15.79:0/1400258569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7f3f2008f9f0 con 0x7f3f201aea60 2021-04-09T18:33:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.161 7f3f1cff9700 1 -- 172.21.15.79:0/1400258569 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v187) v1 ==== 129+0+0 (secure 0 0 0) 0x7f3f0800ca90 con 0x7f3f201aea60 2021-04-09T18:33:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.173 7f3f2682e700 1 -- 172.21.15.79:0/1400258569 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3f04029100 msgr2=0x7f3f0402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.177 7f3f2682e700 1 --2- 172.21.15.79:0/1400258569 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3f04029100 0x7f3f0402b650 crc :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.177 7f3f2682e700 1 -- 172.21.15.79:0/1400258569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f201aea60 msgr2=0x7f3f201aeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.177 7f3f2682e700 1 --2- 172.21.15.79:0/1400258569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f201aea60 0x7f3f201aeeb0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f3f0800efc0 tx=0x7f3f0800c430).stop 2021-04-09T18:33:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.177 7f3f2682e700 1 -- 172.21.15.79:0/1400258569 shutdown_connections 2021-04-09T18:33:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.177 7f3f2682e700 1 --2- 172.21.15.79:0/1400258569 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3f04029100 0x7f3f0402b650 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.177 7f3f2682e700 1 --2- 172.21.15.79:0/1400258569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f201af4e0 0x7f3f201aa950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.177 7f3f2682e700 1 --2- 172.21.15.79:0/1400258569 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f200bd8b0 0x7f3f2008f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.177 7f3f2682e700 1 --2- 172.21.15.79:0/1400258569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f201aea60 0x7f3f201aeeb0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.177 7f3f2682e700 1 -- 172.21.15.79:0/1400258569 >> 172.21.15.79:0/1400258569 conn(0x7f3f200bdd90 msgr2=0x7f3f2008fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.177 7f3f2682e700 1 -- 172.21.15.79:0/1400258569 shutdown_connections 2021-04-09T18:33:18.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.177 7f3f2682e700 1 -- 172.21.15.79:0/1400258569 wait complete. 2021-04-09T18:33:18.201 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-04-09T18:33:18.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655c7c8700 1 Processor -- start 2021-04-09T18:33:18.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655c7c8700 1 -- start start 2021-04-09T18:33:18.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655c7c8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65540f5550 0x7f65540f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:18.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655c7c8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65541c8040 0x7f65541ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:18.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655c7c8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65540fbb50 con 0x7f65540e9b10 2021-04-09T18:33:18.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655c7c8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65540e9f60 con 0x7f65541c8040 2021-04-09T18:33:18.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655c7c8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65541c3df0 con 0x7f65540f5550 2021-04-09T18:33:18.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655ad6d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65541c8040 0x7f65541ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:18.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655ad6d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65541c8040 0x7f65541ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60208/0 (socket says 172.21.15.79:60208) 2021-04-09T18:33:18.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655ad6d700 1 -- 172.21.15.79:0/2542040553 learned_addr learned my addr 172.21.15.79:0/2542040553 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:18.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655a56c700 1 --2- 172.21.15.79:0/2542040553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65540f5550 0x7f65540f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:18.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655ad6d700 1 -- 172.21.15.79:0/2542040553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65540f5550 msgr2=0x7f65540f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:18.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655ad6d700 1 --2- 172.21.15.79:0/2542040553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65540f5550 0x7f65540f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:18.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655ad6d700 1 -- 172.21.15.79:0/2542040553 >> v1:172.21.15.89:6789/0 conn(0x7f65540e9b10 legacy=0x7f655409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:18.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655ad6d700 1 -- 172.21.15.79:0/2542040553 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655409f910 con 0x7f65541c8040 2021-04-09T18:33:18.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655ad6d700 1 --2- 172.21.15.79:0/2542040553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65541c8040 0x7f65541ca4a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f654c002f30 tx=0x7f654c00bda0).ready entity=mon.0 client_cookie=53aee442af5d5f28 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:18.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655956a700 1 -- 172.21.15.79:0/2542040553 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f655409f910 con 0x7f65541c8040 2021-04-09T18:33:18.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655956a700 1 -- 172.21.15.79:0/2542040553 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c0099d0 con 0x7f65541c8040 2021-04-09T18:33:18.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655956a700 1 -- 172.21.15.79:0/2542040553 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f654c009da0 con 0x7f65541c8040 2021-04-09T18:33:18.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655c7c8700 1 -- 172.21.15.79:0/2542040553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65541c8040 msgr2=0x7f65541ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:18.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655c7c8700 1 --2- 172.21.15.79:0/2542040553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65541c8040 0x7f65541ca4a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f654c002f30 tx=0x7f654c00bda0).stop 2021-04-09T18:33:18.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655c7c8700 1 -- 172.21.15.79:0/2542040553 shutdown_connections 2021-04-09T18:33:18.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655c7c8700 1 --2- 172.21.15.79:0/2542040553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65541c8040 0x7f65541ca4a0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:18.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655c7c8700 1 --2- 172.21.15.79:0/2542040553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65540f5550 0x7f65540f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:18.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655c7c8700 1 -- 172.21.15.79:0/2542040553 >> 172.21.15.79:0/2542040553 conn(0x7f65540e6010 msgr2=0x7f65540e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:18.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655c7c8700 1 -- 172.21.15.79:0/2542040553 shutdown_connections 2021-04-09T18:33:18.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.293 7f655c7c8700 1 -- 172.21.15.79:0/2542040553 wait complete. 2021-04-09T18:33:18.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.297 7f655c7c8700 1 Processor -- start 2021-04-09T18:33:18.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.297 7f655c7c8700 1 -- start start 2021-04-09T18:33:18.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.297 7f655c7c8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6554097ac0 0x7f65540c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:18.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.297 7f655c7c8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65540c35c0 0x7f65540ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:18.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.297 7f655c7c8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65540d5150 0x7f65540d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:18.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.297 7f655c7c8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6554088590 con 0x7f65540d5150 2021-04-09T18:33:18.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.297 7f655c7c8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65540c55f0 con 0x7f6554097ac0 2021-04-09T18:33:18.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.297 7f655c7c8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65540c58f0 con 0x7f65540c35c0 2021-04-09T18:33:18.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.297 7f655ad6d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65540d5150 0x7f65540d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:18.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.297 7f655ad6d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65540d5150 0x7f65540d55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60210/0 (socket says 172.21.15.79:60210) 2021-04-09T18:33:18.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.297 7f655ad6d700 1 -- 172.21.15.79:0/1039039706 learned_addr learned my addr 172.21.15.79:0/1039039706 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:18.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.297 7f655a56c700 1 --2- 172.21.15.79:0/1039039706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6554097ac0 0x7f65540c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:18.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.297 7f6559d6b700 1 --2- 172.21.15.79:0/1039039706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65540c35c0 0x7f65540ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:18.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.297 7f655ad6d700 1 -- 172.21.15.79:0/1039039706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65540c35c0 msgr2=0x7f65540ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:18.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.297 7f655ad6d700 1 --2- 172.21.15.79:0/1039039706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65540c35c0 0x7f65540ae120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:18.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.297 7f655ad6d700 1 -- 172.21.15.79:0/1039039706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6554097ac0 msgr2=0x7f65540c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:18.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.297 7f655ad6d700 1 --2- 172.21.15.79:0/1039039706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6554097ac0 0x7f65540c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:18.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.297 7f655ad6d700 1 -- 172.21.15.79:0/1039039706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65540c5280 con 0x7f65540d5150 2021-04-09T18:33:18.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.297 7f655a56c700 1 --2- 172.21.15.79:0/1039039706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6554097ac0 0x7f65540c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:18.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.301 7f655ad6d700 1 --2- 172.21.15.79:0/1039039706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65540d5150 0x7f65540d55a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f65540d82a0 tx=0x7f654c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:18.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.301 7f6552ffd700 1 -- 172.21.15.79:0/1039039706 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f65540c5280 con 0x7f65540d5150 2021-04-09T18:33:18.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.301 7f6552ffd700 1 -- 172.21.15.79:0/1039039706 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c011a90 con 0x7f65540d5150 2021-04-09T18:33:18.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.301 7f6552ffd700 1 -- 172.21.15.79:0/1039039706 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f654c01d440 con 0x7f65540d5150 2021-04-09T18:33:18.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.301 7f655c7c8700 1 -- 172.21.15.79:0/1039039706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65540c3a10 con 0x7f65540d5150 2021-04-09T18:33:18.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.301 7f655c7c8700 1 -- 172.21.15.79:0/1039039706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65540ae8e0 con 0x7f65540d5150 2021-04-09T18:33:18.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.301 7f6552ffd700 1 -- 172.21.15.79:0/1039039706 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f654c026450 con 0x7f65540d5150 2021-04-09T18:33:18.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.301 7f6552ffd700 1 --2- 172.21.15.79:0/1039039706 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6538029100 0x7f653802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:18.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.301 7f6552ffd700 1 -- 172.21.15.79:0/1039039706 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5319+0+0 (secure 0 0 0) 0x7f654c03aae0 con 0x7f65540d5150 2021-04-09T18:33:18.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.301 7f655a56c700 1 --2- 172.21.15.79:0/1039039706 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6538029100 0x7f653802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:18.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.301 7f655a56c700 1 --2- 172.21.15.79:0/1039039706 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6538029100 0x7f653802b650 crc :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:18.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.305 7f655c7c8700 1 -- 172.21.15.79:0/1039039706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65540e39f0 con 0x7f65540d5150 2021-04-09T18:33:18.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.317 7f6552ffd700 1 -- 172.21.15.79:0/1039039706 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f654c0097c0 con 0x7f65540d5150 2021-04-09T18:33:18.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.501 7f655c7c8700 1 -- 172.21.15.79:0/1039039706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f65540f5b50 con 0x7f65540d5150 2021-04-09T18:33:18.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.509 7f6552ffd700 1 -- 172.21.15.79:0/1039039706 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f654c012440 con 0x7f65540d5150 2021-04-09T18:33:18.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.521 7f655c7c8700 1 -- 172.21.15.79:0/1039039706 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6538029100 msgr2=0x7f653802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:18.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.521 7f655c7c8700 1 --2- 172.21.15.79:0/1039039706 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6538029100 0x7f653802b650 crc :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:18.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.521 7f655c7c8700 1 -- 172.21.15.79:0/1039039706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65540d5150 msgr2=0x7f65540d55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:18.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.521 7f655c7c8700 1 --2- 172.21.15.79:0/1039039706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65540d5150 0x7f65540d55a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f65540d82a0 tx=0x7f654c006890).stop 2021-04-09T18:33:18.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.521 7f655c7c8700 1 -- 172.21.15.79:0/1039039706 shutdown_connections 2021-04-09T18:33:18.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.521 7f655c7c8700 1 --2- 172.21.15.79:0/1039039706 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6538029100 0x7f653802b650 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:18.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.521 7f655c7c8700 1 --2- 172.21.15.79:0/1039039706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6554097ac0 0x7f65540c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:18.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.521 7f655c7c8700 1 --2- 172.21.15.79:0/1039039706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65540d5150 0x7f65540d55a0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:18.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.521 7f655c7c8700 1 --2- 172.21.15.79:0/1039039706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65540c35c0 0x7f65540ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:18.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.521 7f655c7c8700 1 -- 172.21.15.79:0/1039039706 >> 172.21.15.79:0/1039039706 conn(0x7f6554099a50 msgr2=0x7f65540b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:18.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.521 7f655c7c8700 1 -- 172.21.15.79:0/1039039706 shutdown_connections 2021-04-09T18:33:18.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.521 7f655c7c8700 1 -- 172.21.15.79:0/1039039706 wait complete. 2021-04-09T18:33:18.540 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:33:18.541 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:18.558 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:18.578 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:18.597 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:18.616 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:18.635 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:33:18.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:18.636 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:18.636 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:18.644 INFO:teuthology.orchestra.run.smithi090.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-04-09T18:33:18.644 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:33:18.645 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-04-09T18:33:18.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:18.646 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:18.647 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:18.664 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-04-09T18:33:18.665 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:33:18.666 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-04-09T18:33:18.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:18.666 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:18.667 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:33:18.684 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:33:18.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:33:18.686 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:33:18.686 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:33:18.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.777 7f5baf542700 1 Processor -- start 2021-04-09T18:33:18.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.781 7f5baf542700 1 -- start start 2021-04-09T18:33:18.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.781 7f5baf542700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5ba80e9ad0 0x7f5ba809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:18.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.781 7f5baf542700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5ba81c8000 0x7f5ba81ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:18.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.781 7f5baf542700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba80fbb10 con 0x7f5ba80f5510 2021-04-09T18:33:18.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.781 7f5baf542700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba81c3db0 con 0x7f5ba80e9ad0 2021-04-09T18:33:18.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.781 7f5baf542700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba80e9f20 con 0x7f5ba81c8000 2021-04-09T18:33:18.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.781 7f5bacae5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5ba80e9ad0 0x7f5ba809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:18.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.781 7f5bacae5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5ba80e9ad0 0x7f5ba809f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60220/0 (socket says 172.21.15.79:60220) 2021-04-09T18:33:18.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.781 7f5bacae5700 1 -- 172.21.15.79:0/3232404466 learned_addr learned my addr 172.21.15.79:0/3232404466 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:18.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.781 7f5badae7700 1 --2- 172.21.15.79:0/3232404466 >> v2:172.21.15.89:3300/0 conn(0x7f5ba81c8000 0x7f5ba81ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:18.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.781 7f5bacae5700 1 -- 172.21.15.79:0/3232404466 >> v2:172.21.15.89:3300/0 conn(0x7f5ba81c8000 msgr2=0x7f5ba81ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:18.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.781 7f5bacae5700 1 --2- 172.21.15.79:0/3232404466 >> v2:172.21.15.89:3300/0 conn(0x7f5ba81c8000 0x7f5ba81ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:18.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.781 7f5bacae5700 1 -- 172.21.15.79:0/3232404466 >> v1:172.21.15.89:6789/0 conn(0x7f5ba80f5510 legacy=0x7f5ba80f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:18.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.781 7f5bacae5700 1 -- 172.21.15.79:0/3232404466 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba80e56c0 con 0x7f5ba80e9ad0 2021-04-09T18:33:18.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.781 7f5bacae5700 1 --2- 172.21.15.79:0/3232404466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ba80e9ad0 0x7f5ba809f100 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f5b98002f30 tx=0x7f5b9800bd70).ready entity=mon.0 client_cookie=d01279cf19af88c1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:18.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.781 7f5b9ffff700 1 -- 172.21.15.79:0/3232404466 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5ba80e56c0 con 0x7f5ba80e9ad0 2021-04-09T18:33:18.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.781 7f5b9ffff700 1 -- 172.21.15.79:0/3232404466 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b98009950 con 0x7f5ba80e9ad0 2021-04-09T18:33:18.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.781 7f5b9ffff700 1 -- 172.21.15.79:0/3232404466 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b98009d20 con 0x7f5ba80e9ad0 2021-04-09T18:33:18.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.781 7f5baf542700 1 -- 172.21.15.79:0/3232404466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ba80e9ad0 msgr2=0x7f5ba809f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:18.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.781 7f5baf542700 1 --2- 172.21.15.79:0/3232404466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ba80e9ad0 0x7f5ba809f100 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f5b98002f30 tx=0x7f5b9800bd70).stop 2021-04-09T18:33:18.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.785 7f5baf542700 1 -- 172.21.15.79:0/3232404466 shutdown_connections 2021-04-09T18:33:18.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.785 7f5baf542700 1 --2- 172.21.15.79:0/3232404466 >> v2:172.21.15.89:3300/0 conn(0x7f5ba81c8000 0x7f5ba81ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:18.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.785 7f5baf542700 1 --2- 172.21.15.79:0/3232404466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ba80e9ad0 0x7f5ba809f100 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:18.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.785 7f5baf542700 1 -- 172.21.15.79:0/3232404466 >> 172.21.15.79:0/3232404466 conn(0x7f5ba80e5fd0 msgr2=0x7f5ba80e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:18.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.785 7f5baf542700 1 -- 172.21.15.79:0/3232404466 shutdown_connections 2021-04-09T18:33:18.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.785 7f5baf542700 1 -- 172.21.15.79:0/3232404466 wait complete. 2021-04-09T18:33:18.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5baf542700 1 Processor -- start 2021-04-09T18:33:18.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5baf542700 1 -- start start 2021-04-09T18:33:18.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5baf542700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ba80bade0 0x7f5ba80d5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:18.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5baf542700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ba80ae230 0x7f5ba80ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:18.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5baf542700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba80d4a20 0x7f5ba80d4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:18.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5baf542700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba80ac990 con 0x7f5ba80bade0 2021-04-09T18:33:18.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5baf542700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba80acc90 con 0x7f5ba80ae230 2021-04-09T18:33:18.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5baf542700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba80d54a0 con 0x7f5ba80d4a20 2021-04-09T18:33:18.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5bad2e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ba80bade0 0x7f5ba80d5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:18.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5bad2e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ba80bade0 0x7f5ba80d5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60224/0 (socket says 172.21.15.79:60224) 2021-04-09T18:33:18.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5badae7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba80d4a20 0x7f5ba80d4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:18.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5bad2e6700 1 -- 172.21.15.79:0/2092020671 learned_addr learned my addr 172.21.15.79:0/2092020671 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:18.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5bacae5700 1 --2- 172.21.15.79:0/2092020671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ba80ae230 0x7f5ba80ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:18.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5bad2e6700 1 -- 172.21.15.79:0/2092020671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba80d4a20 msgr2=0x7f5ba80d4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:18.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5bad2e6700 1 --2- 172.21.15.79:0/2092020671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba80d4a20 0x7f5ba80d4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:18.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5bad2e6700 1 -- 172.21.15.79:0/2092020671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ba80ae230 msgr2=0x7f5ba80ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:18.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5bad2e6700 1 --2- 172.21.15.79:0/2092020671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ba80ae230 0x7f5ba80ae680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:18.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5bad2e6700 1 -- 172.21.15.79:0/2092020671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba80d63f0 con 0x7f5ba80bade0 2021-04-09T18:33:18.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5bad2e6700 1 --2- 172.21.15.79:0/2092020671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ba80bade0 0x7f5ba80d5dc0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f5ba80874c0 tx=0x7f5ba400cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:18.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5b9dffb700 1 -- 172.21.15.79:0/2092020671 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5ba80d63f0 con 0x7f5ba80bade0 2021-04-09T18:33:18.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5b9dffb700 1 -- 172.21.15.79:0/2092020671 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba4010510 con 0x7f5ba80bade0 2021-04-09T18:33:18.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5baf542700 1 -- 172.21.15.79:0/2092020671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba80ac520 con 0x7f5ba80bade0 2021-04-09T18:33:18.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5b9dffb700 1 -- 172.21.15.79:0/2092020671 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5ba40106f0 con 0x7f5ba80bade0 2021-04-09T18:33:18.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.789 7f5baf542700 1 -- 172.21.15.79:0/2092020671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba81adc40 con 0x7f5ba80bade0 2021-04-09T18:33:18.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.793 7f5b9dffb700 1 -- 172.21.15.79:0/2092020671 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5ba4019020 con 0x7f5ba80bade0 2021-04-09T18:33:18.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.793 7f5b9dffb700 1 --2- 172.21.15.79:0/2092020671 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5b88029100 0x7f5b8802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:18.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.793 7f5b9dffb700 1 -- 172.21.15.79:0/2092020671 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5319+0+0 (secure 0 0 0) 0x7f5ba4038c60 con 0x7f5ba80bade0 2021-04-09T18:33:18.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.793 7f5bacae5700 1 --2- 172.21.15.79:0/2092020671 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5b88029100 0x7f5b8802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:18.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.793 7f5bacae5700 1 --2- 172.21.15.79:0/2092020671 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5b88029100 0x7f5b8802b650 crc :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:18.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.809 7f5baf542700 1 -- 172.21.15.79:0/2092020671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba80e39d0 con 0x7f5ba80bade0 2021-04-09T18:33:18.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.817 7f5b9dffb700 1 -- 172.21.15.79:0/2092020671 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5ba4000bf0 con 0x7f5ba80bade0 2021-04-09T18:33:18.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.993 7f5baf542700 1 -- 172.21.15.79:0/2092020671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5ba80f5b10 con 0x7f5ba80bade0 2021-04-09T18:33:19.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.993 7f5b9dffb700 1 -- 172.21.15.79:0/2092020671 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v73) v1 ==== 81+0+26138 (secure 0 0 0) 0x7f5ba4010300 con 0x7f5ba80bade0 2021-04-09T18:33:19.003 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:19.003 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:33:19.004 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 73, 2021-04-09T18:33:19.004 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:33:19.004 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:33:19.004 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:33:16.145271", 2021-04-09T18:33:19.005 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:33:19.005 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:33:19.005 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:33:19.005 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:33:19.005 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:33:19.006 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:33:19.006 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:33:19.006 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:33:19.006 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:33:19.007 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:33:19.007 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:33:19.007 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:33:19.007 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:33:19.008 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:33:19.008 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:33:19.008 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 13, 2021-04-09T18:33:19.008 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:33:19.008 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:33:19.009 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:33:19.009 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:33:19.009 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:33:19.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.010 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:33:19.010 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:33:19.010 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:33:19.010 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:33:19.010 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:33:19.011 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:33:19.011 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:33:19.011 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:33:19.011 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:33:19.012 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:33:19.012 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:33:19.012 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:33:19.012 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:33:19.012 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:33:19.013 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:33:19.013 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:33:19.013 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:33:19.013 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:33:19.014 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:33:19.014 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:33:19.014 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:33:19.014 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:33:19.014 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:33:19.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.015 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:33:19.015 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:33:19.015 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:33:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:33:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:33:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:33:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:33:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:33:19.017 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:33:19.017 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:33:19.017 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:33:19.017 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:33:19.017 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:33:19.018 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:33:19.018 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:33:19.018 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:33:19.018 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:33:19.019 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:33:19.019 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:33:19.019 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:33:19.019 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:33:19.020 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:33:19.020 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:33:19.020 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:33:19.020 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:33:19.020 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:33:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:33:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:33:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:33:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:33:19.022 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:33:19.022 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:33:19.022 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:33:19.022 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:33:19.023 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:33:19.023 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:33:19.023 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:33:19.023 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:33:19.023 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:33:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:33:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:33:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:33:19.025 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:33:19.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.025 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:33:19.025 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:33:19.025 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:19.026 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:19.026 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:19.026 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:19.026 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:19.026 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:19.027 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:19.027 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 66, 2021-04-09T18:33:19.027 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:19.027 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:19.028 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:19.028 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.028 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.028 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:33:19.029 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:19.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.029 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.029 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:33:19.030 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:19.030 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.030 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.031 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:19.031 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.031 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.031 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:33:19.032 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:19.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.032 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.033 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:33:19.033 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:19.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.033 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.034 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:19.034 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.034 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.034 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:33:19.035 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:19.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.035 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.036 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:33:19.036 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:19.036 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.036 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.037 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:19.037 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.037 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.037 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:33:19.038 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:19.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.038 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.038 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:33:19.039 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:19.039 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.039 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.040 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:33:19.040 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:33:19.040 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:33:19.040 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:33:19.040 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.042 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:33:19.042 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:33:19.042 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:19.042 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:19.044 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 65, 2021-04-09T18:33:19.044 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:19.044 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:19.044 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:19.045 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.045 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.045 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:33:19.045 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:19.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.046 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.046 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:33:19.046 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:19.047 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.047 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.047 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:19.048 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.048 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.048 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:33:19.048 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:19.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.049 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.049 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:33:19.050 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:19.050 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.050 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.050 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:19.051 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.051 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.051 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:33:19.052 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:19.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.052 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.052 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:33:19.053 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:19.053 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.053 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.053 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:19.054 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.054 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.054 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:33:19.054 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:19.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.055 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.055 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:33:19.056 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:19.056 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.056 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.056 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:33:19.057 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:33:19.057 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:33:19.057 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:33:19.057 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:19.057 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:19.058 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:19.058 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.058 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:33:19.059 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:33:19.059 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:19.059 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:19.059 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:19.060 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:19.060 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:19.060 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:19.060 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:19.060 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 57, 2021-04-09T18:33:19.061 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:19.061 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:19.061 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:19.061 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.062 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.062 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:33:19.062 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:19.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.063 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:33:19.063 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:19.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.064 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.064 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:19.064 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.065 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.065 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:33:19.065 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:19.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.066 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.066 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:33:19.066 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:19.066 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.067 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.067 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:19.067 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.068 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.068 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:33:19.068 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:19.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.069 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.069 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:33:19.069 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:19.069 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.070 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.070 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:19.070 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.071 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.071 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:33:19.071 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:19.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.072 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.072 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:33:19.072 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:19.073 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.073 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.073 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:33:19.073 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:33:19.074 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:33:19.074 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:33:19.074 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:19.074 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:19.075 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:19.075 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.076 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:33:19.076 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:33:19.076 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:19.076 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:19.076 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:19.077 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:19.077 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:19.077 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:19.077 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:19.078 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 47, 2021-04-09T18:33:19.078 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:19.078 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:19.078 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:19.078 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.079 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.079 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:33:19.079 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:19.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.080 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.080 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:33:19.080 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:19.081 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.081 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.081 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:19.081 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.082 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.082 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:33:19.082 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:19.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.083 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.083 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:33:19.083 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:19.084 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.084 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.084 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:19.084 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.085 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.085 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:33:19.085 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:19.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.086 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.086 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:33:19.086 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:19.087 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.087 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.087 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:19.088 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.088 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.088 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:33:19.088 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:19.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.089 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.089 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:33:19.090 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:19.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.090 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.090 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:33:19.091 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:33:19.091 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:33:19.091 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:33:19.091 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:19.092 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:19.092 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:19.092 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.093 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:33:19.093 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:33:19.093 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:19.093 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:19.094 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:19.094 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:19.094 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:19.094 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:19.094 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:19.095 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 66, 2021-04-09T18:33:19.095 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:19.095 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:19.095 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:19.096 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.096 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.096 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:33:19.096 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:19.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.097 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.097 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:33:19.098 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:19.098 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.098 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.098 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:19.099 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.099 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.099 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:33:19.100 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:19.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.100 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.100 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:33:19.101 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:19.101 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.101 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.102 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:19.102 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.102 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.102 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:33:19.103 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:19.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.103 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.103 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:33:19.104 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:19.104 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.104 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.105 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:19.105 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.105 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.105 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:33:19.106 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:19.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.106 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.106 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:33:19.107 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:19.107 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.107 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.107 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:33:19.108 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:33:19.108 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:33:19.108 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:33:19.108 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:19.109 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:19.109 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:19.109 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.110 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:33:19.110 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:33:19.110 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:19.110 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:19.111 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:19.111 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:19.111 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:19.111 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:19.111 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:19.112 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 66, 2021-04-09T18:33:19.112 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:19.112 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:19.112 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:19.113 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.113 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.113 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:33:19.113 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:19.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.114 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.114 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:33:19.115 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:19.115 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.115 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.115 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:19.116 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.116 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.116 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:33:19.116 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:19.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.117 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.117 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:33:19.118 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:19.118 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.118 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.119 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:19.119 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.119 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.120 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:33:19.120 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:19.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.120 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.121 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:33:19.121 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:19.121 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.121 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.122 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:19.122 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.122 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.123 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:33:19.123 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:19.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.124 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.124 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:33:19.124 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:19.124 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.124 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.125 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:33:19.125 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:33:19.125 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:33:19.125 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:33:19.126 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:19.126 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:19.126 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:19.126 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.127 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:33:19.127 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:33:19.127 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:19.128 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:19.128 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:19.128 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:19.128 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:19.128 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:19.129 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:19.129 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 66, 2021-04-09T18:33:19.129 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:19.129 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:19.129 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:19.130 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.130 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.130 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:33:19.131 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:19.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.131 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.131 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:33:19.132 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:19.132 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.132 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.133 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:19.133 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.133 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:33:19.134 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:19.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.134 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.135 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:33:19.135 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:19.135 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.135 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.136 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:19.136 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.136 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.137 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:33:19.137 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:19.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.138 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.138 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:33:19.138 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:19.138 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.139 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.139 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:19.139 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.140 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.140 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:33:19.140 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:19.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.141 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.141 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:33:19.141 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:19.141 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.142 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.142 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:33:19.142 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:33:19.142 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:33:19.143 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:33:19.143 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:19.143 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:19.143 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:19.144 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.144 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:33:19.144 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:33:19.145 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:19.145 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:19.145 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:19.145 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:19.146 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:19.146 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:19.146 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:19.147 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 66, 2021-04-09T18:33:19.147 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:19.148 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:19.148 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:19.148 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.149 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.149 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:33:19.149 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:19.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.150 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.150 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:33:19.150 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:19.150 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.150 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.151 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:19.151 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.152 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.152 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:33:19.152 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:19.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:33:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.154 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.154 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:19.154 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.155 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.155 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:33:19.155 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:19.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.156 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.156 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:33:19.156 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:19.157 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.157 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.157 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:19.157 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:19.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.158 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:19.158 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:33:19.158 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:33:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:19.160 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.160 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.160 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:33:19.160 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:33:19.161 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:33:19.161 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:33:19.161 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:19.161 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:19.162 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:19.162 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:19.162 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.162 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:33:19.162 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:33:19.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.163 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:33:19.163 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:19.163 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:19.164 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:19.164 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:19.164 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:19.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.165 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:33:19.165 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:19.165 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:19.165 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:33:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:33:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:33:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:33:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:33:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:33:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:33:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:33:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:33:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:33:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:33:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": { 2021-04-09T18:33:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.90:0/30006489": "2021-04-09 19:33:00.902936", 2021-04-09T18:33:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.79:6833/1131782053": "2021-04-10 18:33:13.022600", 2021-04-09T18:33:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6835/2729581928": "2021-04-10 18:32:14.953106", 2021-04-09T18:33:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.79:6832/1131782053": "2021-04-10 18:33:13.022600", 2021-04-09T18:33:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6834/2729581928": "2021-04-10 18:32:14.953106" 2021-04-09T18:33:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:33:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:33:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:33:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:33:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:33:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:33:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:33:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:33:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:33:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:33:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:33:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:33:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:33:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:33:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:33:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:33:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:33:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:33:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:33:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:33:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:33:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:33:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:33:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:33:19.186 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:33:19.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.997 7f5baf542700 1 -- 172.21.15.79:0/2092020671 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5b88029100 msgr2=0x7f5b8802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:19.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.997 7f5baf542700 1 --2- 172.21.15.79:0/2092020671 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5b88029100 0x7f5b8802b650 crc :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.997 7f5baf542700 1 -- 172.21.15.79:0/2092020671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ba80bade0 msgr2=0x7f5ba80d5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:19.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.997 7f5baf542700 1 --2- 172.21.15.79:0/2092020671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ba80bade0 0x7f5ba80d5dc0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f5ba80874c0 tx=0x7f5ba400cae0).stop 2021-04-09T18:33:19.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.997 7f5baf542700 1 -- 172.21.15.79:0/2092020671 shutdown_connections 2021-04-09T18:33:19.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.997 7f5baf542700 1 --2- 172.21.15.79:0/2092020671 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5b88029100 0x7f5b8802b650 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.997 7f5baf542700 1 --2- 172.21.15.79:0/2092020671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba80d4a20 0x7f5ba80d4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.997 7f5baf542700 1 --2- 172.21.15.79:0/2092020671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ba80bade0 0x7f5ba80d5dc0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.997 7f5baf542700 1 --2- 172.21.15.79:0/2092020671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ba80ae230 0x7f5ba80ae680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.997 7f5baf542700 1 -- 172.21.15.79:0/2092020671 >> 172.21.15.79:0/2092020671 conn(0x7f5ba81a1310 msgr2=0x7f5ba80955b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:19.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.997 7f5baf542700 1 -- 172.21.15.79:0/2092020671 shutdown_connections 2021-04-09T18:33:19.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:18.997 7f5baf542700 1 -- 172.21.15.79:0/2092020671 wait complete. 2021-04-09T18:33:19.191 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:19.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f58781d6700 1 Processor -- start 2021-04-09T18:33:19.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f58781d6700 1 -- start start 2021-04-09T18:33:19.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f58781d6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f58701c9020 0x7f58701cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:19.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f58781d6700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58700fbb20 con 0x7f58700f5520 2021-04-09T18:33:19.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f58781d6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587009f910 con 0x7f58700e9ae0 2021-04-09T18:33:19.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f58781d6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58701c3dc0 con 0x7f58701c9020 2021-04-09T18:33:19.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f5875f7a700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f58700f5520 0x7f58700f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54942/0 (socket says 172.21.15.79:54942) 2021-04-09T18:33:19.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f5875f7a700 1 -- 172.21.15.79:0/1599478311 learned_addr learned my addr 172.21.15.79:0/1599478311 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:19.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f587677b700 1 --2- 172.21.15.79:0/1599478311 >> v2:172.21.15.89:3300/0 conn(0x7f58701c9020 0x7f58701cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:19.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f5874f78700 1 -- 172.21.15.79:0/1599478311 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476897005 0 0) 0x7f5858001450 con 0x7f58700f5520 2021-04-09T18:33:19.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f5874f78700 1 -- 172.21.15.79:0/1599478311 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f585c003240 con 0x7f58700f5520 2021-04-09T18:33:19.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f5874f78700 1 -- 172.21.15.79:0/1599478311 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076006991 0 0) 0x7f58600010d0 con 0x7f58700e9ae0 2021-04-09T18:33:19.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f5874f78700 1 -- 172.21.15.79:0/1599478311 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f585c003620 con 0x7f58700e9ae0 2021-04-09T18:33:19.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f5874f78700 1 -- 172.21.15.79:0/1599478311 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3323439053 0 0) 0x7f58580019d0 con 0x7f58700f5520 2021-04-09T18:33:19.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f587677b700 1 -- 172.21.15.79:0/1599478311 >> v1:172.21.15.89:6789/0 conn(0x7f58700e9ae0 legacy=0x7f587009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:19.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f587677b700 1 -- 172.21.15.79:0/1599478311 >> v1:172.21.15.79:6789/0 conn(0x7f58700f5520 legacy=0x7f58700f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:19.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f587677b700 1 -- 172.21.15.79:0/1599478311 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58700e56d0 con 0x7f58701c9020 2021-04-09T18:33:19.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f587677b700 1 --2- 172.21.15.79:0/1599478311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58701c9020 0x7f58701cb480 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f5858001d00 tx=0x7f586800bcc0).ready entity=mon.1 client_cookie=e054056fd71558f8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:19.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f5874f78700 1 -- 172.21.15.79:0/1599478311 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f58700e56d0 con 0x7f58701c9020 2021-04-09T18:33:19.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f5874f78700 1 -- 172.21.15.79:0/1599478311 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58680096c0 con 0x7f58701c9020 2021-04-09T18:33:19.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f5874f78700 1 -- 172.21.15.79:0/1599478311 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5858001f30 con 0x7f58701c9020 2021-04-09T18:33:19.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f58781d6700 1 -- 172.21.15.79:0/1599478311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58701c9020 msgr2=0x7f58701cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:19.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.285 7f58781d6700 1 --2- 172.21.15.79:0/1599478311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58701c9020 0x7f58701cb480 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f5858001d00 tx=0x7f586800bcc0).stop 2021-04-09T18:33:19.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.289 7f58781d6700 1 -- 172.21.15.79:0/1599478311 shutdown_connections 2021-04-09T18:33:19.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.289 7f58781d6700 1 --2- 172.21.15.79:0/1599478311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58701c9020 0x7f58701cb480 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.289 7f58781d6700 1 -- 172.21.15.79:0/1599478311 >> 172.21.15.79:0/1599478311 conn(0x7f58700e5fe0 msgr2=0x7f58700e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:19.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.289 7f58781d6700 1 -- 172.21.15.79:0/1599478311 shutdown_connections 2021-04-09T18:33:19.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.289 7f58781d6700 1 -- 172.21.15.79:0/1599478311 wait complete. 2021-04-09T18:33:19.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f58781d6700 1 Processor -- start 2021-04-09T18:33:19.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f58781d6700 1 -- start start 2021-04-09T18:33:19.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f58781d6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f587019e450 0x7f58700c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:19.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f58781d6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58700c72c0 0x7f58701b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:19.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f58781d6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58700c7710 0x7f58701b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:19.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f58781d6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58700e9f30 con 0x7f58700c72c0 2021-04-09T18:33:19.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f58781d6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587019bd30 con 0x7f587019e450 2021-04-09T18:33:19.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f58781d6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587019e8a0 con 0x7f58700c7710 2021-04-09T18:33:19.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f5875779700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58700c72c0 0x7f58701b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:19.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f5875f7a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f587019e450 0x7f58700c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:19.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f5875779700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58700c72c0 0x7f58701b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60240/0 (socket says 172.21.15.79:60240) 2021-04-09T18:33:19.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f5875779700 1 -- 172.21.15.79:0/559004155 learned_addr learned my addr 172.21.15.79:0/559004155 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:19.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f587677b700 1 --2- 172.21.15.79:0/559004155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58700c7710 0x7f58701b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:19.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f5875779700 1 -- 172.21.15.79:0/559004155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58700c7710 msgr2=0x7f58701b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:19.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f5875779700 1 --2- 172.21.15.79:0/559004155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58700c7710 0x7f58701b1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f5875779700 1 -- 172.21.15.79:0/559004155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f587019e450 msgr2=0x7f58700c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:19.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f5875779700 1 --2- 172.21.15.79:0/559004155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f587019e450 0x7f58700c6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f5875779700 1 -- 172.21.15.79:0/559004155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587019bab0 con 0x7f58700c72c0 2021-04-09T18:33:19.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f5875f7a700 1 --2- 172.21.15.79:0/559004155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f587019e450 0x7f58700c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:19.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f5875779700 1 --2- 172.21.15.79:0/559004155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58700c72c0 0x7f58701b1690 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f5860000b80 tx=0x7f5860007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:19.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f586e7fc700 1 -- 172.21.15.79:0/559004155 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f587019bab0 con 0x7f58700c72c0 2021-04-09T18:33:19.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f586e7fc700 1 -- 172.21.15.79:0/559004155 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586000e4a0 con 0x7f58700c72c0 2021-04-09T18:33:19.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f58781d6700 1 -- 172.21.15.79:0/559004155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5870099020 con 0x7f58700c72c0 2021-04-09T18:33:19.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f586e7fc700 1 -- 172.21.15.79:0/559004155 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f586000e870 con 0x7f58700c72c0 2021-04-09T18:33:19.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.293 7f58781d6700 1 -- 172.21.15.79:0/559004155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58700c41f0 con 0x7f58700c72c0 2021-04-09T18:33:19.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.297 7f586e7fc700 1 -- 172.21.15.79:0/559004155 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f586000ea70 con 0x7f58700c72c0 2021-04-09T18:33:19.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.297 7f586e7fc700 1 --2- 172.21.15.79:0/559004155 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5854029100 0x7f585402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:19.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.297 7f586e7fc700 1 -- 172.21.15.79:0/559004155 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5319+0+0 (secure 0 0 0) 0x7f5860038b10 con 0x7f58700c72c0 2021-04-09T18:33:19.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.297 7f5875f7a700 1 --2- 172.21.15.79:0/559004155 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5854029100 0x7f585402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:19.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.297 7f5875f7a700 1 --2- 172.21.15.79:0/559004155 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5854029100 0x7f585402b650 crc :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:19.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.297 7f58781d6700 1 -- 172.21.15.79:0/559004155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58700e39e0 con 0x7f58700c72c0 2021-04-09T18:33:19.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.301 7f586e7fc700 1 -- 172.21.15.79:0/559004155 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f586000e290 con 0x7f58700c72c0 2021-04-09T18:33:19.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.469 7f58781d6700 1 -- 172.21.15.79:0/559004155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58700a1cc0 con 0x7f58700c72c0 2021-04-09T18:33:19.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.469 7f586e7fc700 1 -- 172.21.15.79:0/559004155 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+1171 (secure 0 0 0) 0x7f58700e5ca0 con 0x7f58700c72c0 2021-04-09T18:33:19.476 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 43 2021-04-09T18:33:19.477 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:19.477 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":43,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6153,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1203679879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1203679879},{"type":"v1","addr":"172.21.15.89:6835","nonce":1203679879}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":38},{"gid":6438,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/58925568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":58925568},{"type":"v1","addr":"172.21.15.79:6833","nonce":58925568}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":43}],"filesystems":[]} 2021-04-09T18:33:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.469 7f58781d6700 1 -- 172.21.15.79:0/559004155 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5854029100 msgr2=0x7f585402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.469 7f58781d6700 1 --2- 172.21.15.79:0/559004155 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5854029100 0x7f585402b650 crc :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.469 7f58781d6700 1 -- 172.21.15.79:0/559004155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58700c72c0 msgr2=0x7f58701b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.469 7f58781d6700 1 --2- 172.21.15.79:0/559004155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58700c72c0 0x7f58701b1690 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f5860000b80 tx=0x7f5860007f70).stop 2021-04-09T18:33:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.469 7f58781d6700 1 -- 172.21.15.79:0/559004155 shutdown_connections 2021-04-09T18:33:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.469 7f58781d6700 1 --2- 172.21.15.79:0/559004155 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5854029100 0x7f585402b650 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.469 7f58781d6700 1 --2- 172.21.15.79:0/559004155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f587019e450 0x7f58700c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.469 7f58781d6700 1 --2- 172.21.15.79:0/559004155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58700c7710 0x7f58701b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.469 7f58781d6700 1 --2- 172.21.15.79:0/559004155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58700c72c0 0x7f58701b1690 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.469 7f58781d6700 1 -- 172.21.15.79:0/559004155 >> 172.21.15.79:0/559004155 conn(0x7f58700ba870 msgr2=0x7f587009a530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:19.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.473 7f58781d6700 1 -- 172.21.15.79:0/559004155 shutdown_connections 2021-04-09T18:33:19.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.473 7f58781d6700 1 -- 172.21.15.79:0/559004155 wait complete. 2021-04-09T18:33:19.489 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:19.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2dcfb7700 1 Processor -- start 2021-04-09T18:33:19.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2dcfb7700 1 -- start start 2021-04-09T18:33:19.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2dcfb7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe2d80f5510 0x7fe2d80f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:19.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2dcfb7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe2d80e9ad0 0x7fe2d809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:19.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2dcfb7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d80fbb10 con 0x7fe2d81c2da0 2021-04-09T18:33:19.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2dcfb7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d80e9f20 con 0x7fe2d80f5510 2021-04-09T18:33:19.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2dcfb7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d80e59c0 con 0x7fe2d80e9ad0 2021-04-09T18:33:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2d6aef700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe2d80f5510 0x7fe2d80f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2d6aef700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe2d80f5510 0x7fe2d80f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60248/0 (socket says 172.21.15.79:60248) 2021-04-09T18:33:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2d6aef700 1 -- 172.21.15.79:0/3265745491 learned_addr learned my addr 172.21.15.79:0/3265745491 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2d62ee700 1 --2- 172.21.15.79:0/3265745491 >> v2:172.21.15.89:3300/0 conn(0x7fe2d80e9ad0 0x7fe2d809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:19.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2d6aef700 1 -- 172.21.15.79:0/3265745491 >> v2:172.21.15.89:3300/0 conn(0x7fe2d80e9ad0 msgr2=0x7fe2d809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2d6aef700 1 --2- 172.21.15.79:0/3265745491 >> v2:172.21.15.89:3300/0 conn(0x7fe2d80e9ad0 0x7fe2d809f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2d6aef700 1 -- 172.21.15.79:0/3265745491 >> v1:172.21.15.89:6789/0 conn(0x7fe2d81c2da0 legacy=0x7fe2d81c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2d6aef700 1 -- 172.21.15.79:0/3265745491 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d80e56c0 con 0x7fe2d80f5510 2021-04-09T18:33:19.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2d6aef700 1 --2- 172.21.15.79:0/3265745491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2d80f5510 0x7fe2d80f64a0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7fe2c80032b0 tx=0x7fe2c800b3c0).ready entity=mon.0 client_cookie=aba322e69806c760 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:19.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2d5aed700 1 -- 172.21.15.79:0/3265745491 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe2d80e56c0 con 0x7fe2d80f5510 2021-04-09T18:33:19.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2d5aed700 1 -- 172.21.15.79:0/3265745491 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c800bc20 con 0x7fe2d80f5510 2021-04-09T18:33:19.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2d5aed700 1 -- 172.21.15.79:0/3265745491 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe2c8002020 con 0x7fe2d80f5510 2021-04-09T18:33:19.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2dcfb7700 1 -- 172.21.15.79:0/3265745491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2d80f5510 msgr2=0x7fe2d80f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:19.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2dcfb7700 1 --2- 172.21.15.79:0/3265745491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2d80f5510 0x7fe2d80f64a0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7fe2c80032b0 tx=0x7fe2c800b3c0).stop 2021-04-09T18:33:19.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2dcfb7700 1 -- 172.21.15.79:0/3265745491 shutdown_connections 2021-04-09T18:33:19.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2dcfb7700 1 --2- 172.21.15.79:0/3265745491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2d80f5510 0x7fe2d80f64a0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2dcfb7700 1 --2- 172.21.15.79:0/3265745491 >> v2:172.21.15.89:3300/0 conn(0x7fe2d80e9ad0 0x7fe2d809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2dcfb7700 1 -- 172.21.15.79:0/3265745491 >> 172.21.15.79:0/3265745491 conn(0x7fe2d80e5fd0 msgr2=0x7fe2d80e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:19.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2dcfb7700 1 -- 172.21.15.79:0/3265745491 shutdown_connections 2021-04-09T18:33:19.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.577 7fe2dcfb7700 1 -- 172.21.15.79:0/3265745491 wait complete. 2021-04-09T18:33:19.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.581 7fe2dcfb7700 1 Processor -- start 2021-04-09T18:33:19.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.581 7fe2dcfb7700 1 -- start start 2021-04-09T18:33:19.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.581 7fe2dcfb7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2d80a6340 0x7fe2d80d6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:19.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.581 7fe2dcfb7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2d80a6790 0x7fe2d80bfea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:19.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.581 7fe2dcfb7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2d80965d0 0x7fe2d8096a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:19.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.581 7fe2dcfb7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d80d6050 con 0x7fe2d80965d0 2021-04-09T18:33:19.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.581 7fe2dcfb7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d80af080 con 0x7fe2d80a6340 2021-04-09T18:33:19.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.581 7fe2dcfb7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d80c0a90 con 0x7fe2d80a6790 2021-04-09T18:33:19.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.585 7fe2d72f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2d80965d0 0x7fe2d8096a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:19.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.585 7fe2d72f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2d80965d0 0x7fe2d8096a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60254/0 (socket says 172.21.15.79:60254) 2021-04-09T18:33:19.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.585 7fe2d72f0700 1 -- 172.21.15.79:0/1733110242 learned_addr learned my addr 172.21.15.79:0/1733110242 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:19.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.585 7fe2d6aef700 1 --2- 172.21.15.79:0/1733110242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2d80a6340 0x7fe2d80d6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:19.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.585 7fe2d62ee700 1 --2- 172.21.15.79:0/1733110242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2d80a6790 0x7fe2d80bfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:19.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.585 7fe2d72f0700 1 -- 172.21.15.79:0/1733110242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2d80a6790 msgr2=0x7fe2d80bfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:19.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.585 7fe2d72f0700 1 --2- 172.21.15.79:0/1733110242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2d80a6790 0x7fe2d80bfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.585 7fe2d72f0700 1 -- 172.21.15.79:0/1733110242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2d80a6340 msgr2=0x7fe2d80d6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:19.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.585 7fe2d72f0700 1 --2- 172.21.15.79:0/1733110242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2d80a6340 0x7fe2d80d6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.585 7fe2d72f0700 1 -- 172.21.15.79:0/1733110242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d80d6980 con 0x7fe2d80965d0 2021-04-09T18:33:19.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.585 7fe2d72f0700 1 --2- 172.21.15.79:0/1733110242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2d80965d0 0x7fe2d8096a20 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7fe2d80af230 tx=0x7fe2d000cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:19.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.585 7fe2cf7fe700 1 -- 172.21.15.79:0/1733110242 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe2d80d6980 con 0x7fe2d80965d0 2021-04-09T18:33:19.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.585 7fe2cf7fe700 1 -- 172.21.15.79:0/1733110242 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d0007240 con 0x7fe2d80965d0 2021-04-09T18:33:19.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.585 7fe2cf7fe700 1 -- 172.21.15.79:0/1733110242 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe2d00066e0 con 0x7fe2d80965d0 2021-04-09T18:33:19.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.585 7fe2dcfb7700 1 -- 172.21.15.79:0/1733110242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d80c04d0 con 0x7fe2d80965d0 2021-04-09T18:33:19.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.585 7fe2dcfb7700 1 -- 172.21.15.79:0/1733110242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d80971e0 con 0x7fe2d80965d0 2021-04-09T18:33:19.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.585 7fe2cf7fe700 1 -- 172.21.15.79:0/1733110242 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe2d00068e0 con 0x7fe2d80965d0 2021-04-09T18:33:19.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.585 7fe2cf7fe700 1 --2- 172.21.15.79:0/1733110242 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe2bc029100 0x7fe2bc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:19.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.585 7fe2cf7fe700 1 -- 172.21.15.79:0/1733110242 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5319+0+0 (secure 0 0 0) 0x7fe2d00389e0 con 0x7fe2d80965d0 2021-04-09T18:33:19.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.585 7fe2d6aef700 1 --2- 172.21.15.79:0/1733110242 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe2bc029100 0x7fe2bc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:19.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.589 7fe2d6aef700 1 --2- 172.21.15.79:0/1733110242 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe2bc029100 0x7fe2bc02b650 crc :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:19.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.589 7fe2dcfb7700 1 -- 172.21.15.79:0/1733110242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d80e39d0 con 0x7fe2d80965d0 2021-04-09T18:33:19.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.597 7fe2cf7fe700 1 -- 172.21.15.79:0/1733110242 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe2d0007030 con 0x7fe2d80965d0 2021-04-09T18:33:19.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.769 7fe2dcfb7700 1 -- 172.21.15.79:0/1733110242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2d80f5b10 con 0x7fe2d80965d0 2021-04-09T18:33:19.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.769 7fe2cf7fe700 1 -- 172.21.15.79:0/1733110242 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+1171 (secure 0 0 0) 0x7fe2d0000bf0 con 0x7fe2d80965d0 2021-04-09T18:33:19.777 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 43 2021-04-09T18:33:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:19.777 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":43,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6153,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1203679879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1203679879},{"type":"v1","addr":"172.21.15.89:6835","nonce":1203679879}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":38},{"gid":6438,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/58925568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":58925568},{"type":"v1","addr":"172.21.15.79:6833","nonce":58925568}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":43}],"filesystems":[]} 2021-04-09T18:33:19.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.773 7fe2dcfb7700 1 -- 172.21.15.79:0/1733110242 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe2bc029100 msgr2=0x7fe2bc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:19.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.773 7fe2dcfb7700 1 --2- 172.21.15.79:0/1733110242 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe2bc029100 0x7fe2bc02b650 crc :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.773 7fe2dcfb7700 1 -- 172.21.15.79:0/1733110242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2d80965d0 msgr2=0x7fe2d8096a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.773 7fe2dcfb7700 1 --2- 172.21.15.79:0/1733110242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2d80965d0 0x7fe2d8096a20 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7fe2d80af230 tx=0x7fe2d000cae0).stop 2021-04-09T18:33:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.773 7fe2dcfb7700 1 -- 172.21.15.79:0/1733110242 shutdown_connections 2021-04-09T18:33:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.773 7fe2dcfb7700 1 --2- 172.21.15.79:0/1733110242 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe2bc029100 0x7fe2bc02b650 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.773 7fe2dcfb7700 1 --2- 172.21.15.79:0/1733110242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2d80a6340 0x7fe2d80d6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.773 7fe2dcfb7700 1 --2- 172.21.15.79:0/1733110242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2d80965d0 0x7fe2d8096a20 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.773 7fe2dcfb7700 1 --2- 172.21.15.79:0/1733110242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2d80a6790 0x7fe2d80bfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.773 7fe2dcfb7700 1 -- 172.21.15.79:0/1733110242 >> 172.21.15.79:0/1733110242 conn(0x7fe2d809aa00 msgr2=0x7fe2d809a080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.773 7fe2dcfb7700 1 -- 172.21.15.79:0/1733110242 shutdown_connections 2021-04-09T18:33:19.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.773 7fe2dcfb7700 1 -- 172.21.15.79:0/1733110242 wait complete. 2021-04-09T18:33:19.794 INFO:tasks.ceph.mds.a:Restarting daemon 2021-04-09T18:33:19.794 INFO:tasks.ceph.mds.a:Stopping old one... 2021-04-09T18:33:19.795 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-04-09T18:33:19.795 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:33:19.795 INFO:tasks.ceph.mds.b:Restarting daemon 2021-04-09T18:33:19.796 INFO:tasks.ceph.mds.b:Stopping old one... 2021-04-09T18:33:19.796 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-04-09T18:33:19.796 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:33:19.808 INFO:tasks.ceph.mds.a:Stopped 2021-04-09T18:33:19.808 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-04-09T18:33:19.812 INFO:tasks.ceph.mds.b:Stopped 2021-04-09T18:33:19.812 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-04-09T18:33:19.852 INFO:tasks.ceph.mds.a:Started 2021-04-09T18:33:19.852 DEBUG:teuthology.parallel:result is None 2021-04-09T18:33:19.857 INFO:tasks.ceph.mds.b:Started 2021-04-09T18:33:19.857 DEBUG:teuthology.parallel:result is None 2021-04-09T18:33:19.858 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-04-09T18:33:19.924 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2021-04-09T18:33:19.937 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2021-04-09T18:33:19.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.949 7f035b36c700 1 Processor -- start 2021-04-09T18:33:19.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.949 7f035b36c700 1 -- start start 2021-04-09T18:33:19.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.949 7f035b36c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03540f5520 0x7f03540f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:19.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.949 7f035b36c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f03541c8010 0x7f03541ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:19.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.949 7f035b36c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03540fbb20 con 0x7f03540e9ae0 2021-04-09T18:33:19.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.949 7f035b36c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03540e9f30 con 0x7f03541c8010 2021-04-09T18:33:19.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.949 7f035b36c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03541c3dc0 con 0x7f03540f5520 2021-04-09T18:33:19.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.949 7f0359110700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03540f5520 0x7f03540f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:19.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.949 7f0359110700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03540f5520 0x7f03540f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:57268/0 (socket says 172.21.15.79:57268) 2021-04-09T18:33:19.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.949 7f0359110700 1 -- 172.21.15.79:0/3789102912 learned_addr learned my addr 172.21.15.79:0/3789102912 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:19.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.949 7f0359911700 1 --2- 172.21.15.79:0/3789102912 >> v2:172.21.15.89:3300/0 conn(0x7f03541c8010 0x7f03541ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:19.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.953 7f0359911700 1 -- 172.21.15.79:0/3789102912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03540f5520 msgr2=0x7f03540f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:19.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.953 7f0359911700 1 --2- 172.21.15.79:0/3789102912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03540f5520 0x7f03540f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.953 7f0359911700 1 -- 172.21.15.79:0/3789102912 >> v1:172.21.15.89:6789/0 conn(0x7f03540e9ae0 legacy=0x7f035409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:19.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.953 7f0359911700 1 -- 172.21.15.79:0/3789102912 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035409f910 con 0x7f03541c8010 2021-04-09T18:33:19.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.953 7f0359110700 1 --2- 172.21.15.79:0/3789102912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03540f5520 0x7f03540f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:19.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.953 7f0359911700 1 --2- 172.21.15.79:0/3789102912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03541c8010 0x7f03541ca470 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f033c002f30 tx=0x7f033c00bd40).ready entity=mon.1 client_cookie=fe691b5553627e50 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:19.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.953 7f0353fff700 1 -- 172.21.15.79:0/3789102912 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f035409f910 con 0x7f03541c8010 2021-04-09T18:33:19.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.953 7f0353fff700 1 -- 172.21.15.79:0/3789102912 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c009850 con 0x7f03541c8010 2021-04-09T18:33:19.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.953 7f0353fff700 1 -- 172.21.15.79:0/3789102912 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f033c009c60 con 0x7f03541c8010 2021-04-09T18:33:19.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.953 7f035b36c700 1 -- 172.21.15.79:0/3789102912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03541c8010 msgr2=0x7f03541ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:19.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.953 7f035b36c700 1 --2- 172.21.15.79:0/3789102912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03541c8010 0x7f03541ca470 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f033c002f30 tx=0x7f033c00bd40).stop 2021-04-09T18:33:19.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.957 7f035b36c700 1 -- 172.21.15.79:0/3789102912 shutdown_connections 2021-04-09T18:33:19.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.957 7f035b36c700 1 --2- 172.21.15.79:0/3789102912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03541c8010 0x7f03541ca470 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.957 7f035b36c700 1 --2- 172.21.15.79:0/3789102912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03540f5520 0x7f03540f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.957 7f035b36c700 1 -- 172.21.15.79:0/3789102912 >> 172.21.15.79:0/3789102912 conn(0x7f03540e5fe0 msgr2=0x7f03540e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:19.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.957 7f035b36c700 1 -- 172.21.15.79:0/3789102912 shutdown_connections 2021-04-09T18:33:19.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.957 7f035b36c700 1 -- 172.21.15.79:0/3789102912 wait complete. 2021-04-09T18:33:19.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f035b36c700 1 Processor -- start 2021-04-09T18:33:19.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f035b36c700 1 -- start start 2021-04-09T18:33:19.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f035b36c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0354096270 0x7f03540989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:19.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f035b36c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03540bb180 0x7f035419fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:19.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f035b36c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03541a0420 0x7f03540af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:19.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f035b36c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0354097140 con 0x7f0354096270 2021-04-09T18:33:19.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f035b36c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0354097440 con 0x7f03541a0420 2021-04-09T18:33:19.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f035b36c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03541a0870 con 0x7f03540bb180 2021-04-09T18:33:19.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f0359110700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0354096270 0x7f03540989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:19.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f0359110700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0354096270 0x7f03540989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60278/0 (socket says 172.21.15.79:60278) 2021-04-09T18:33:19.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f0359110700 1 -- 172.21.15.79:0/3451126602 learned_addr learned my addr 172.21.15.79:0/3451126602 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:19.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f035890f700 1 --2- 172.21.15.79:0/3451126602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03540bb180 0x7f035419fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:19.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f0359911700 1 --2- 172.21.15.79:0/3451126602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03541a0420 0x7f03540af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:19.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f0359110700 1 -- 172.21.15.79:0/3451126602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03540bb180 msgr2=0x7f035419fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:19.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f0359110700 1 --2- 172.21.15.79:0/3451126602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03540bb180 0x7f035419fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f0359110700 1 -- 172.21.15.79:0/3451126602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03541a0420 msgr2=0x7f03540af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:19.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f0359110700 1 --2- 172.21.15.79:0/3451126602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03541a0420 0x7f03540af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:19.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f0359110700 1 -- 172.21.15.79:0/3451126602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0354096cd0 con 0x7f0354096270 2021-04-09T18:33:19.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f0359110700 1 --2- 172.21.15.79:0/3451126602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0354096270 0x7f03540989c0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f03540d7d50 tx=0x7f034400c680).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:19.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f0351ffb700 1 -- 172.21.15.79:0/3451126602 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0354096cd0 con 0x7f0354096270 2021-04-09T18:33:19.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f0351ffb700 1 -- 172.21.15.79:0/3451126602 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03440123f0 con 0x7f0354096270 2021-04-09T18:33:19.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f035b36c700 1 -- 172.21.15.79:0/3451126602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03540af740 con 0x7f0354096270 2021-04-09T18:33:19.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f0351ffb700 1 -- 172.21.15.79:0/3451126602 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f034400f040 con 0x7f0354096270 2021-04-09T18:33:19.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f035b36c700 1 -- 172.21.15.79:0/3451126602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03540afc70 con 0x7f0354096270 2021-04-09T18:33:19.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.961 7f0351ffb700 1 -- 172.21.15.79:0/3451126602 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0344011070 con 0x7f0354096270 2021-04-09T18:33:19.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.965 7f0351ffb700 1 --2- 172.21.15.79:0/3451126602 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0338029100 0x7f033802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:19.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.965 7f0351ffb700 1 -- 172.21.15.79:0/3451126602 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5319+0+0 (secure 0 0 0) 0x7f0344003020 con 0x7f0354096270 2021-04-09T18:33:19.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.965 7f035890f700 1 --2- 172.21.15.79:0/3451126602 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0338029100 0x7f033802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:19.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.965 7f035b36c700 1 -- 172.21.15.79:0/3451126602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03540e39e0 con 0x7f0354096270 2021-04-09T18:33:19.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.965 7f035890f700 1 --2- 172.21.15.79:0/3451126602 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0338029100 0x7f033802b650 crc :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:19.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:19.969 7f0351ffb700 1 -- 172.21.15.79:0/3451126602 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f034400cce0 con 0x7f0354096270 2021-04-09T18:33:20.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:20.141 7f035b36c700 1 -- 172.21.15.79:0/3451126602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f03540f5b20 con 0x7f0354096270 2021-04-09T18:33:20.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:20.969 7f0351ffb700 1 -- 172.21.15.79:0/3451126602 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v75) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0344000f70 con 0x7f0354096270 2021-04-09T18:33:21.016 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blacklist entries 2021-04-09T18:33:21.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.013 7f035b36c700 1 -- 172.21.15.79:0/3451126602 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0338029100 msgr2=0x7f033802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.013 7f035b36c700 1 --2- 172.21.15.79:0/3451126602 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0338029100 0x7f033802b650 crc :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.013 7f035b36c700 1 -- 172.21.15.79:0/3451126602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0354096270 msgr2=0x7f03540989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.013 7f035b36c700 1 --2- 172.21.15.79:0/3451126602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0354096270 0x7f03540989c0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f03540d7d50 tx=0x7f034400c680).stop 2021-04-09T18:33:21.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.013 7f035b36c700 1 -- 172.21.15.79:0/3451126602 shutdown_connections 2021-04-09T18:33:21.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.013 7f035b36c700 1 --2- 172.21.15.79:0/3451126602 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0338029100 0x7f033802b650 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.013 7f035b36c700 1 --2- 172.21.15.79:0/3451126602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03541a0420 0x7f03540af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.013 7f035b36c700 1 --2- 172.21.15.79:0/3451126602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0354096270 0x7f03540989c0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.013 7f035b36c700 1 --2- 172.21.15.79:0/3451126602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03540bb180 0x7f035419fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.013 7f035b36c700 1 -- 172.21.15.79:0/3451126602 >> 172.21.15.79:0/3451126602 conn(0x7f03540a7090 msgr2=0x7f035409a700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:21.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.013 7f035b36c700 1 -- 172.21.15.79:0/3451126602 shutdown_connections 2021-04-09T18:33:21.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.013 7f035b36c700 1 -- 172.21.15.79:0/3451126602 wait complete. 2021-04-09T18:33:21.040 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-04-09T18:33:21.040 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-04-09T18:33:21.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.133 7f7f4ba68700 1 Processor -- start 2021-04-09T18:33:21.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.133 7f7f4ba68700 1 -- start start 2021-04-09T18:33:21.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4ba68700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7f440f5510 0x7f7f440f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:21.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4ba68700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7f440e9ad0 0x7f7f4409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:21.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4ba68700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f440fbb10 con 0x7f7f441c2da0 2021-04-09T18:33:21.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4ba68700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f440e9f20 con 0x7f7f440e9ad0 2021-04-09T18:33:21.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4ba68700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f440e59c0 con 0x7f7f440f5510 2021-04-09T18:33:21.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4a00d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7f441c2da0 0x7f7f441c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55000/0 (socket says 172.21.15.79:55000) 2021-04-09T18:33:21.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4a00d700 1 -- 172.21.15.79:0/3210909847 learned_addr learned my addr 172.21.15.79:0/3210909847 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:21.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4900b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7f440e9ad0 0x7f7f4409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:21.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4980c700 1 --2- 172.21.15.79:0/3210909847 >> v2:172.21.15.89:3300/0 conn(0x7f7f440f5510 0x7f7f440f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:21.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4880a700 1 -- 172.21.15.79:0/3210909847 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506700112 0 0) 0x7f7f3c001450 con 0x7f7f441c2da0 2021-04-09T18:33:21.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4880a700 1 -- 172.21.15.79:0/3210909847 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f30003240 con 0x7f7f441c2da0 2021-04-09T18:33:21.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4980c700 1 -- 172.21.15.79:0/3210909847 >> v2:172.21.15.79:3300/0 conn(0x7f7f440e9ad0 msgr2=0x7f7f4409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:21.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4980c700 1 --2- 172.21.15.79:0/3210909847 >> v2:172.21.15.79:3300/0 conn(0x7f7f440e9ad0 0x7f7f4409f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4880a700 1 -- 172.21.15.79:0/3210909847 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3672146567 0 0) 0x7f7f3c0019d0 con 0x7f7f441c2da0 2021-04-09T18:33:21.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4980c700 1 -- 172.21.15.79:0/3210909847 >> v1:172.21.15.79:6789/0 conn(0x7f7f441c2da0 legacy=0x7f7f441c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4980c700 1 -- 172.21.15.79:0/3210909847 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f440e56c0 con 0x7f7f440f5510 2021-04-09T18:33:21.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4900b700 1 --2- 172.21.15.79:0/3210909847 >> v2:172.21.15.79:3300/0 conn(0x7f7f440e9ad0 0x7f7f4409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:21.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4980c700 1 --2- 172.21.15.79:0/3210909847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f440f5510 0x7f7f440f64a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f7f3c002170 tx=0x7f7f4000bc90).ready entity=mon.1 client_cookie=b9e4954db47cde6b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:21.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4880a700 1 -- 172.21.15.79:0/3210909847 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7f440e56c0 con 0x7f7f440f5510 2021-04-09T18:33:21.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4880a700 1 -- 172.21.15.79:0/3210909847 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f400096c0 con 0x7f7f440f5510 2021-04-09T18:33:21.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4880a700 1 -- 172.21.15.79:0/3210909847 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7f3c001f30 con 0x7f7f440f5510 2021-04-09T18:33:21.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4ba68700 1 -- 172.21.15.79:0/3210909847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f440f5510 msgr2=0x7f7f440f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4ba68700 1 --2- 172.21.15.79:0/3210909847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f440f5510 0x7f7f440f64a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f7f3c002170 tx=0x7f7f4000bc90).stop 2021-04-09T18:33:21.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4ba68700 1 -- 172.21.15.79:0/3210909847 shutdown_connections 2021-04-09T18:33:21.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4ba68700 1 --2- 172.21.15.79:0/3210909847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f440f5510 0x7f7f440f64a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4ba68700 1 --2- 172.21.15.79:0/3210909847 >> v2:172.21.15.79:3300/0 conn(0x7f7f440e9ad0 0x7f7f4409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.137 7f7f4ba68700 1 -- 172.21.15.79:0/3210909847 >> 172.21.15.79:0/3210909847 conn(0x7f7f440e5fd0 msgr2=0x7f7f440e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:21.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.141 7f7f4ba68700 1 -- 172.21.15.79:0/3210909847 shutdown_connections 2021-04-09T18:33:21.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.141 7f7f4ba68700 1 -- 172.21.15.79:0/3210909847 wait complete. 2021-04-09T18:33:21.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.141 7f7f4ba68700 1 Processor -- start 2021-04-09T18:33:21.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.141 7f7f4ba68700 1 -- start start 2021-04-09T18:33:21.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.141 7f7f4ba68700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f441a2e00 0x7f7f440afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:21.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.141 7f7f4ba68700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f440ad620 0x7f7f440c4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:21.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.141 7f7f4ba68700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f440d5100 0x7f7f440d5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:21.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.141 7f7f4ba68700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f440ae650 con 0x7f7f441a2e00 2021-04-09T18:33:21.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.141 7f7f4ba68700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f440ae950 con 0x7f7f440d5100 2021-04-09T18:33:21.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.141 7f7f4ba68700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f440b0520 con 0x7f7f440ad620 2021-04-09T18:33:21.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f4980c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f441a2e00 0x7f7f440afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:21.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f4980c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f441a2e00 0x7f7f440afef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60292/0 (socket says 172.21.15.79:60292) 2021-04-09T18:33:21.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f4980c700 1 -- 172.21.15.79:0/889865636 learned_addr learned my addr 172.21.15.79:0/889865636 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:21.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f4900b700 1 --2- 172.21.15.79:0/889865636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f440ad620 0x7f7f440c4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:21.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f4a00d700 1 --2- 172.21.15.79:0/889865636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f440d5100 0x7f7f440d5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:21.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f4980c700 1 -- 172.21.15.79:0/889865636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f440ad620 msgr2=0x7f7f440c4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f4980c700 1 --2- 172.21.15.79:0/889865636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f440ad620 0x7f7f440c4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f4980c700 1 -- 172.21.15.79:0/889865636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f440d5100 msgr2=0x7f7f440d5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f4980c700 1 --2- 172.21.15.79:0/889865636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f440d5100 0x7f7f440d5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f4980c700 1 -- 172.21.15.79:0/889865636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f440adee0 con 0x7f7f441a2e00 2021-04-09T18:33:21.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f4a00d700 1 --2- 172.21.15.79:0/889865636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f440d5100 0x7f7f440d5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:21.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f4980c700 1 --2- 172.21.15.79:0/889865636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f441a2e00 0x7f7f440afef0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f7f440d8220 tx=0x7f7f40006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:21.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f3a7fc700 1 -- 172.21.15.79:0/889865636 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7f440adee0 con 0x7f7f441a2e00 2021-04-09T18:33:21.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f3a7fc700 1 -- 172.21.15.79:0/889865636 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f400119d0 con 0x7f7f441a2e00 2021-04-09T18:33:21.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f4ba68700 1 -- 172.21.15.79:0/889865636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f441abe50 con 0x7f7f441a2e00 2021-04-09T18:33:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f3a7fc700 1 -- 172.21.15.79:0/889865636 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7f40011da0 con 0x7f7f441a2e00 2021-04-09T18:33:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f4ba68700 1 -- 172.21.15.79:0/889865636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f440c5560 con 0x7f7f441a2e00 2021-04-09T18:33:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f3a7fc700 1 -- 172.21.15.79:0/889865636 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7f40026450 con 0x7f7f441a2e00 2021-04-09T18:33:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f3a7fc700 1 --2- 172.21.15.79:0/889865636 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7f2c029100 0x7f7f2c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f3a7fc700 1 -- 172.21.15.79:0/889865636 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f7f4003a6c0 con 0x7f7f441a2e00 2021-04-09T18:33:21.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.145 7f7f4900b700 1 --2- 172.21.15.79:0/889865636 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7f2c029100 0x7f7f2c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:21.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.149 7f7f4900b700 1 --2- 172.21.15.79:0/889865636 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7f2c029100 0x7f7f2c02b650 crc :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:21.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.149 7f7f4ba68700 1 -- 172.21.15.79:0/889865636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f440e39d0 con 0x7f7f441a2e00 2021-04-09T18:33:21.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.157 7f7f3a7fc700 1 -- 172.21.15.79:0/889865636 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7f400094b0 con 0x7f7f441a2e00 2021-04-09T18:33:21.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.317 7f7f4ba68700 1 -- 172.21.15.79:0/889865636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7f440a1cb0 con 0x7f7f441a2e00 2021-04-09T18:33:21.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.317 7f7f3a7fc700 1 -- 172.21.15.79:0/889865636 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f7f400117c0 con 0x7f7f441a2e00 2021-04-09T18:33:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:21.329 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:33:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2021-04-09T18:33:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2021-04-09T18:33:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgovEoMhAAbDfArG3lSFAdk80rS/4iEQ==", 2021-04-09T18:33:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:33:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2021-04-09T18:33:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgN4sfOBAAPjvDX11uLM+vgdFpdP49Kw==", 2021-04-09T18:33:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:33:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2021-04-09T18:33:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQALnHBgro0COxAAgbe5jxAZH9bD7zDLbtdkhQ==", 2021-04-09T18:33:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2021-04-09T18:33:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAPnHBghZ/oARAAhkN+fnZJiskmHnvvs+G8NA==", 2021-04-09T18:33:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2021-04-09T18:33:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQASnHBgWT2FBxAACrSTbwbF18k9aPeYNohelw==", 2021-04-09T18:33:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2021-04-09T18:33:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAVnHBgPHy6CxAAFq+yki4AZe5ybodgTO/4/Q==", 2021-04-09T18:33:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2021-04-09T18:33:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAanHBgfbs4NhAAQzxM9dDML4RgQP8yamkuVw==", 2021-04-09T18:33:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2021-04-09T18:33:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAdnHBgi0WLOhAA4OBguOCjtmzqulUjTJ+GhQ==", 2021-04-09T18:33:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2021-04-09T18:33:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAhnHBgCs+PAxAAOm0wSMe/1Bu9vfTrpmrLkg==", 2021-04-09T18:33:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2021-04-09T18:33:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAknHBgH1S3CBAAUcdUIW7O6wH482l1yZBKBw==", 2021-04-09T18:33:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2021-04-09T18:33:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgxEq9BxAAap2nrjhcrf2aHzygtMclVw==", 2021-04-09T18:33:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:33:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:33:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:33:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2021-04-09T18:33:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBguJFeDRAAWL4NV4tsYRAqcwJ26kjm2Q==", 2021-04-09T18:33:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:33:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:33:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:33:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2021-04-09T18:33:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgN9X5EhAA3DBPdlRHVBHXJNH9nRFW0A==", 2021-04-09T18:33:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:33:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:33:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:33:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2021-04-09T18:33:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgHOSVDBAAMMqd8paqBSTQRgR7n4EXGQ==", 2021-04-09T18:33:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:33:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2021-04-09T18:33:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgmHJhLxAAyhBrx08J7ZFKu34MYC2Wyg==", 2021-04-09T18:33:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:33:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:33:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2021-04-09T18:33:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgNCCXKhAA/bKOzzjVHldj6RpMGu0c8g==", 2021-04-09T18:33:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:33:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:33:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:21.365 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:33:21.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.321 7f7f4ba68700 1 -- 172.21.15.79:0/889865636 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7f2c029100 msgr2=0x7f7f2c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.325 7f7f4ba68700 1 --2- 172.21.15.79:0/889865636 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7f2c029100 0x7f7f2c02b650 crc :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.325 7f7f4ba68700 1 -- 172.21.15.79:0/889865636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f441a2e00 msgr2=0x7f7f440afef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.325 7f7f4ba68700 1 --2- 172.21.15.79:0/889865636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f441a2e00 0x7f7f440afef0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f7f440d8220 tx=0x7f7f40006890).stop 2021-04-09T18:33:21.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.325 7f7f4ba68700 1 -- 172.21.15.79:0/889865636 shutdown_connections 2021-04-09T18:33:21.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.325 7f7f4ba68700 1 --2- 172.21.15.79:0/889865636 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7f2c029100 0x7f7f2c02b650 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.325 7f7f4ba68700 1 --2- 172.21.15.79:0/889865636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f440d5100 0x7f7f440d5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.325 7f7f4ba68700 1 --2- 172.21.15.79:0/889865636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f441a2e00 0x7f7f440afef0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.325 7f7f4ba68700 1 --2- 172.21.15.79:0/889865636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f440ad620 0x7f7f440c4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.325 7f7f4ba68700 1 -- 172.21.15.79:0/889865636 >> 172.21.15.79:0/889865636 conn(0x7f7f440a41b0 msgr2=0x7f7f440d8460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:21.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.325 7f7f4ba68700 1 -- 172.21.15.79:0/889865636 shutdown_connections 2021-04-09T18:33:21.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.325 7f7f4ba68700 1 -- 172.21.15.79:0/889865636 wait complete. 2021-04-09T18:33:21.370 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:33:21.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.461 7f4d35ca3700 1 Processor -- start 2021-04-09T18:33:21.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.461 7f4d35ca3700 1 -- start start 2021-04-09T18:33:21.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.461 7f4d35ca3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d300e9ae0 0x7f4d3009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:21.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.461 7f4d35ca3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d301c8010 0x7f4d301ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:21.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.461 7f4d35ca3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d300fbb20 con 0x7f4d300f5520 2021-04-09T18:33:21.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.461 7f4d35ca3700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d301c3dc0 con 0x7f4d300e9ae0 2021-04-09T18:33:21.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.461 7f4d35ca3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300e9f30 con 0x7f4d301c8010 2021-04-09T18:33:21.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.461 7f4d2effd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d300e9ae0 0x7f4d3009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:21.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.461 7f4d2effd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d300e9ae0 0x7f4d3009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60302/0 (socket says 172.21.15.79:60302) 2021-04-09T18:33:21.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.461 7f4d2effd700 1 -- 172.21.15.79:0/2867469098 learned_addr learned my addr 172.21.15.79:0/2867469098 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:21.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.461 7f4d2ffff700 1 --2- 172.21.15.79:0/2867469098 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d301c8010 0x7f4d301ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:21.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.465 7f4d2effd700 1 -- 172.21.15.79:0/2867469098 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d301c8010 msgr2=0x7f4d301ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:21.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.465 7f4d2effd700 1 --2- 172.21.15.79:0/2867469098 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d301c8010 0x7f4d301ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.465 7f4d2effd700 1 -- 172.21.15.79:0/2867469098 >> v1:172.21.15.89:6789/0 conn(0x7f4d300f5520 legacy=0x7f4d300f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.465 7f4d2effd700 1 -- 172.21.15.79:0/2867469098 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d300e56d0 con 0x7f4d300e9ae0 2021-04-09T18:33:21.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.465 7f4d2effd700 1 --2- 172.21.15.79:0/2867469098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d300e9ae0 0x7f4d3009f110 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f4d300f6f00 tx=0x7f4d2400bdd0).ready entity=mon.0 client_cookie=c33502d70dca2fdf server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:21.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.465 7f4d2e7fc700 1 -- 172.21.15.79:0/2867469098 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d300e56d0 con 0x7f4d300e9ae0 2021-04-09T18:33:21.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.465 7f4d2e7fc700 1 -- 172.21.15.79:0/2867469098 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d24009990 con 0x7f4d300e9ae0 2021-04-09T18:33:21.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.465 7f4d2e7fc700 1 -- 172.21.15.79:0/2867469098 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d24009d60 con 0x7f4d300e9ae0 2021-04-09T18:33:21.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.465 7f4d35ca3700 1 -- 172.21.15.79:0/2867469098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d300e9ae0 msgr2=0x7f4d3009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.465 7f4d35ca3700 1 --2- 172.21.15.79:0/2867469098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d300e9ae0 0x7f4d3009f110 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f4d300f6f00 tx=0x7f4d2400bdd0).stop 2021-04-09T18:33:21.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.465 7f4d35ca3700 1 -- 172.21.15.79:0/2867469098 shutdown_connections 2021-04-09T18:33:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.465 7f4d35ca3700 1 --2- 172.21.15.79:0/2867469098 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d301c8010 0x7f4d301ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.465 7f4d35ca3700 1 --2- 172.21.15.79:0/2867469098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d300e9ae0 0x7f4d3009f110 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.465 7f4d35ca3700 1 -- 172.21.15.79:0/2867469098 >> 172.21.15.79:0/2867469098 conn(0x7f4d300e5fe0 msgr2=0x7f4d300e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.465 7f4d35ca3700 1 -- 172.21.15.79:0/2867469098 shutdown_connections 2021-04-09T18:33:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.465 7f4d35ca3700 1 -- 172.21.15.79:0/2867469098 wait complete. 2021-04-09T18:33:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d35ca3700 1 Processor -- start 2021-04-09T18:33:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d35ca3700 1 -- start start 2021-04-09T18:33:21.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d35ca3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d300b0060 0x7f4d300d5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:21.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d35ca3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d300d57b0 0x7f4d300bbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:21.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d35ca3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d300bc480 0x7f4d300bc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:21.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d35ca3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300bfb40 con 0x7f4d300bc480 2021-04-09T18:33:21.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d35ca3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300bf3d0 con 0x7f4d300d57b0 2021-04-09T18:33:21.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d35ca3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d301ae290 con 0x7f4d300b0060 2021-04-09T18:33:21.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d2ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d300bc480 0x7f4d300bc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:21.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d2ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d300bc480 0x7f4d300bc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60310/0 (socket says 172.21.15.79:60310) 2021-04-09T18:33:21.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d2ffff700 1 -- 172.21.15.79:0/2458781549 learned_addr learned my addr 172.21.15.79:0/2458781549 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:21.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d2effd700 1 --2- 172.21.15.79:0/2458781549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d300d57b0 0x7f4d300bbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:21.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d2f7fe700 1 --2- 172.21.15.79:0/2458781549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d300b0060 0x7f4d300d5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:21.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d2ffff700 1 -- 172.21.15.79:0/2458781549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d300b0060 msgr2=0x7f4d300d5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d2ffff700 1 --2- 172.21.15.79:0/2458781549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d300b0060 0x7f4d300d5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d2ffff700 1 -- 172.21.15.79:0/2458781549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d300d57b0 msgr2=0x7f4d300bbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d2ffff700 1 --2- 172.21.15.79:0/2458781549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d300d57b0 0x7f4d300bbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d2ffff700 1 -- 172.21.15.79:0/2458781549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d300b04b0 con 0x7f4d300bc480 2021-04-09T18:33:21.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d2effd700 1 --2- 172.21.15.79:0/2458781549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d300d57b0 0x7f4d300bbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:21.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d2ffff700 1 --2- 172.21.15.79:0/2458781549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d300bc480 0x7f4d300bc8d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f4d300874d0 tx=0x7f4d2800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:21.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d17fff700 1 -- 172.21.15.79:0/2458781549 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d300b04b0 con 0x7f4d300bc480 2021-04-09T18:33:21.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d17fff700 1 -- 172.21.15.79:0/2458781549 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2800cbd0 con 0x7f4d300bc480 2021-04-09T18:33:21.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d17fff700 1 -- 172.21.15.79:0/2458781549 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d2800f040 con 0x7f4d300bc480 2021-04-09T18:33:21.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.469 7f4d35ca3700 1 -- 172.21.15.79:0/2458781549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d300bf6f0 con 0x7f4d300bc480 2021-04-09T18:33:21.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.473 7f4d35ca3700 1 -- 172.21.15.79:0/2458781549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d300bbaa0 con 0x7f4d300bc480 2021-04-09T18:33:21.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.473 7f4d17fff700 1 -- 172.21.15.79:0/2458781549 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4d28022060 con 0x7f4d300bc480 2021-04-09T18:33:21.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.473 7f4d17fff700 1 --2- 172.21.15.79:0/2458781549 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d10029100 0x7f4d1002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:21.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.473 7f4d17fff700 1 -- 172.21.15.79:0/2458781549 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f4d28010040 con 0x7f4d300bc480 2021-04-09T18:33:21.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.473 7f4d2f7fe700 1 --2- 172.21.15.79:0/2458781549 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d10029100 0x7f4d1002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:21.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.473 7f4d2f7fe700 1 --2- 172.21.15.79:0/2458781549 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d10029100 0x7f4d1002b650 crc :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:21.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.477 7f4d35ca3700 1 -- 172.21.15.79:0/2458781549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d300e39e0 con 0x7f4d300bc480 2021-04-09T18:33:21.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.485 7f4d17fff700 1 -- 172.21.15.79:0/2458781549 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4d2800c9c0 con 0x7f4d300bc480 2021-04-09T18:33:21.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.653 7f4d35ca3700 1 -- 172.21.15.79:0/2458781549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d300a1cc0 con 0x7f4d300bc480 2021-04-09T18:33:21.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.653 7f4d17fff700 1 -- 172.21.15.79:0/2458781549 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+11378 (secure 0 0 0) 0x7f4d28000f70 con 0x7f4d300bc480 2021-04-09T18:33:21.664 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:21.664 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":75,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:33:20.962292","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:33:21.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.657 7f4d35ca3700 1 -- 172.21.15.79:0/2458781549 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d10029100 msgr2=0x7f4d1002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.657 7f4d35ca3700 1 --2- 172.21.15.79:0/2458781549 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d10029100 0x7f4d1002b650 crc :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.657 7f4d35ca3700 1 -- 172.21.15.79:0/2458781549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d300bc480 msgr2=0x7f4d300bc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.657 7f4d35ca3700 1 --2- 172.21.15.79:0/2458781549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d300bc480 0x7f4d300bc8d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f4d300874d0 tx=0x7f4d2800c430).stop 2021-04-09T18:33:21.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.657 7f4d35ca3700 1 -- 172.21.15.79:0/2458781549 shutdown_connections 2021-04-09T18:33:21.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.657 7f4d35ca3700 1 --2- 172.21.15.79:0/2458781549 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d10029100 0x7f4d1002b650 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.657 7f4d35ca3700 1 --2- 172.21.15.79:0/2458781549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d300bc480 0x7f4d300bc8d0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.657 7f4d35ca3700 1 --2- 172.21.15.79:0/2458781549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d300b0060 0x7f4d300d5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.657 7f4d35ca3700 1 --2- 172.21.15.79:0/2458781549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d300d57b0 0x7f4d300bbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.657 7f4d35ca3700 1 -- 172.21.15.79:0/2458781549 >> 172.21.15.79:0/2458781549 conn(0x7f4d3009adc0 msgr2=0x7f4d3009a320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:21.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.657 7f4d35ca3700 1 -- 172.21.15.79:0/2458781549 shutdown_connections 2021-04-09T18:33:21.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.661 7f4d35ca3700 1 -- 172.21.15.79:0/2458781549 wait complete. 2021-04-09T18:33:21.677 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-04-09T18:33:21.678 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:33:21.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.761 7f33ee4b2700 1 Processor -- start 2021-04-09T18:33:21.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.761 7f33ee4b2700 1 -- start start 2021-04-09T18:33:21.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33ee4b2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f33e80e9b10 0x7f33e809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:21.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33ee4b2700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e80fbb50 con 0x7f33e80f5550 2021-04-09T18:33:21.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33ee4b2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e80e5700 con 0x7f33e81c8040 2021-04-09T18:33:21.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33ee4b2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e81c3df0 con 0x7f33e80e9b10 2021-04-09T18:33:21.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e7fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f33e80f5550 0x7f33e80f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55024/0 (socket says 172.21.15.79:55024) 2021-04-09T18:33:21.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e7fff700 1 -- 172.21.15.79:0/2419533974 learned_addr learned my addr 172.21.15.79:0/2419533974 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:21.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e77fe700 1 --2- 172.21.15.79:0/2419533974 >> v2:172.21.15.89:3300/0 conn(0x7f33e80e9b10 0x7f33e809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:21.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e6ffd700 1 -- 172.21.15.79:0/2419533974 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803677206 0 0) 0x7f33d80010d0 con 0x7f33e80f5550 2021-04-09T18:33:21.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e6ffd700 1 -- 172.21.15.79:0/2419533974 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33d0003240 con 0x7f33e80f5550 2021-04-09T18:33:21.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e6ffd700 1 -- 172.21.15.79:0/2419533974 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2258923274 0 0) 0x7f33d8001650 con 0x7f33e80f5550 2021-04-09T18:33:21.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e6ffd700 1 -- 172.21.15.79:0/2419533974 >> v2:172.21.15.89:3300/0 conn(0x7f33e80e9b10 msgr2=0x7f33e809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:21.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e6ffd700 1 --2- 172.21.15.79:0/2419533974 >> v2:172.21.15.89:3300/0 conn(0x7f33e80e9b10 0x7f33e809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e6ffd700 1 -- 172.21.15.79:0/2419533974 >> v1:172.21.15.89:6789/0 conn(0x7f33e81c8040 legacy=0x7f33e81ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e6ffd700 1 -- 172.21.15.79:0/2419533974 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e80e4360 con 0x7f33e80f5550 2021-04-09T18:33:21.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e6ffd700 1 -- 172.21.15.79:0/2419533974 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f33d8001bb0 con 0x7f33e80f5550 2021-04-09T18:33:21.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e77fe700 1 --2- 172.21.15.79:0/2419533974 >> v2:172.21.15.89:3300/0 conn(0x7f33e80e9b10 0x7f33e809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:21.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e6ffd700 1 -- 172.21.15.79:0/2419533974 >> v1:172.21.15.79:6789/0 conn(0x7f33e80f5550 legacy=0x7f33e80f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e6ffd700 1 --2- 172.21.15.79:0/2419533974 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33d00038c0 0x7f33d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:21.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e6ffd700 1 --2- 172.21.15.79:0/2419533974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33d00045a0 0x7f33d0004a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:21.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e6ffd700 1 --2- 172.21.15.79:0/2419533974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33d00097e0 0x7f33d000bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:21.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e6ffd700 1 -- 172.21.15.79:0/2419533974 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e81c3df0 con 0x7f33d00097e0 2021-04-09T18:33:21.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e6ffd700 1 -- 172.21.15.79:0/2419533974 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d000c270 con 0x7f33d00045a0 2021-04-09T18:33:21.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e6ffd700 1 -- 172.21.15.79:0/2419533974 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d0050430 con 0x7f33d00038c0 2021-04-09T18:33:21.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33eca57700 1 --2- 172.21.15.79:0/2419533974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33d00097e0 0x7f33d000bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:21.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e77fe700 1 --2- 172.21.15.79:0/2419533974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33d00045a0 0x7f33d0004a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:21.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e7fff700 1 --2- 172.21.15.79:0/2419533974 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33d00038c0 0x7f33d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:21.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33eca57700 1 -- 172.21.15.79:0/2419533974 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33d00038c0 msgr2=0x7f33d0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:21.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33eca57700 1 --2- 172.21.15.79:0/2419533974 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33d00038c0 0x7f33d0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33eca57700 1 -- 172.21.15.79:0/2419533974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33d00045a0 msgr2=0x7f33d0004a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:21.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33eca57700 1 --2- 172.21.15.79:0/2419533974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33d00045a0 0x7f33d0004a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33eca57700 1 -- 172.21.15.79:0/2419533974 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d00506a0 con 0x7f33d00097e0 2021-04-09T18:33:21.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33eca57700 1 -- 172.21.15.79:0/2419533974 reap_dead start 2021-04-09T18:33:21.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33eca57700 1 --2- 172.21.15.79:0/2419533974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33d00097e0 0x7f33d000bc40 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f33e0001380 tx=0x7f33e000c0e0).ready entity=mon.0 client_cookie=6bbbfe29d768ace5 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:21.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e6ffd700 1 -- 172.21.15.79:0/2419533974 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33d00506a0 con 0x7f33d00097e0 2021-04-09T18:33:21.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e6ffd700 1 -- 172.21.15.79:0/2419533974 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e000ca30 con 0x7f33d00097e0 2021-04-09T18:33:21.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33e6ffd700 1 -- 172.21.15.79:0/2419533974 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33e000ce00 con 0x7f33d00097e0 2021-04-09T18:33:21.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33ee4b2700 1 -- 172.21.15.79:0/2419533974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33d00097e0 msgr2=0x7f33d000bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33ee4b2700 1 --2- 172.21.15.79:0/2419533974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33d00097e0 0x7f33d000bc40 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f33e0001380 tx=0x7f33e000c0e0).stop 2021-04-09T18:33:21.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33ee4b2700 1 -- 172.21.15.79:0/2419533974 shutdown_connections 2021-04-09T18:33:21.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33ee4b2700 1 --2- 172.21.15.79:0/2419533974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33d00097e0 0x7f33d000bc40 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33ee4b2700 1 -- 172.21.15.79:0/2419533974 >> 172.21.15.79:0/2419533974 conn(0x7f33e80e6010 msgr2=0x7f33e80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:21.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33ee4b2700 1 -- 172.21.15.79:0/2419533974 shutdown_connections 2021-04-09T18:33:21.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.765 7f33ee4b2700 1 -- 172.21.15.79:0/2419533974 wait complete. 2021-04-09T18:33:21.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.769 7f33ee4b2700 1 Processor -- start 2021-04-09T18:33:21.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33ee4b2700 1 -- start start 2021-04-09T18:33:21.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33ee4b2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33e80bdc80 0x7f33e8096850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:21.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33ee4b2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33e80d4db0 0x7f33e80d5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:21.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33ee4b2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33e80c0180 0x7f33e80c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:21.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33ee4b2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e80e9f60 con 0x7f33e80bdc80 2021-04-09T18:33:21.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33ee4b2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e80bfe80 con 0x7f33e80d4db0 2021-04-09T18:33:21.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33ee4b2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e81ace50 con 0x7f33e80c0180 2021-04-09T18:33:21.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33e7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33e80bdc80 0x7f33e8096850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:21.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33e7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33e80bdc80 0x7f33e8096850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60326/0 (socket says 172.21.15.79:60326) 2021-04-09T18:33:21.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33e7fff700 1 -- 172.21.15.79:0/3167298944 learned_addr learned my addr 172.21.15.79:0/3167298944 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:21.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33e77fe700 1 --2- 172.21.15.79:0/3167298944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33e80d4db0 0x7f33e80d5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:21.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33eca57700 1 --2- 172.21.15.79:0/3167298944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33e80c0180 0x7f33e80c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:21.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33e7fff700 1 -- 172.21.15.79:0/3167298944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33e80c0180 msgr2=0x7f33e80c05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33e7fff700 1 --2- 172.21.15.79:0/3167298944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33e80c0180 0x7f33e80c05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33e7fff700 1 -- 172.21.15.79:0/3167298944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33e80d4db0 msgr2=0x7f33e80d5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33e7fff700 1 --2- 172.21.15.79:0/3167298944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33e80d4db0 0x7f33e80d5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33e7fff700 1 -- 172.21.15.79:0/3167298944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e80c0c00 con 0x7f33e80bdc80 2021-04-09T18:33:21.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33e7fff700 1 --2- 172.21.15.79:0/3167298944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33e80bdc80 0x7f33e8096850 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f33e80967a0 tx=0x7f33d800f440).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:21.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33e4ff9700 1 -- 172.21.15.79:0/3167298944 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33e80c0c00 con 0x7f33e80bdc80 2021-04-09T18:33:21.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33e4ff9700 1 -- 172.21.15.79:0/3167298944 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d8015430 con 0x7f33e80bdc80 2021-04-09T18:33:21.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33ee4b2700 1 -- 172.21.15.79:0/3167298944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e8096e80 con 0x7f33e80bdc80 2021-04-09T18:33:21.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33e4ff9700 1 -- 172.21.15.79:0/3167298944 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33d8011040 con 0x7f33e80bdc80 2021-04-09T18:33:21.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33ee4b2700 1 -- 172.21.15.79:0/3167298944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e80d67c0 con 0x7f33e80bdc80 2021-04-09T18:33:21.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.773 7f33e4ff9700 1 -- 172.21.15.79:0/3167298944 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f33d801d070 con 0x7f33e80bdc80 2021-04-09T18:33:21.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.777 7f33e4ff9700 1 --2- 172.21.15.79:0/3167298944 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f33c8029100 0x7f33c802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:21.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.777 7f33e4ff9700 1 -- 172.21.15.79:0/3167298944 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f33d8004d90 con 0x7f33e80bdc80 2021-04-09T18:33:21.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.777 7f33e77fe700 1 --2- 172.21.15.79:0/3167298944 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f33c8029100 0x7f33c802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.777 7f33ee4b2700 1 -- 172.21.15.79:0/3167298944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e80e39f0 con 0x7f33e80bdc80 2021-04-09T18:33:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.777 7f33e77fe700 1 --2- 172.21.15.79:0/3167298944 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f33c8029100 0x7f33c802b650 crc :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.781 7f33e4ff9700 1 -- 172.21.15.79:0/3167298944 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f33d800faa0 con 0x7f33e80bdc80 2021-04-09T18:33:21.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.937 7f33ee4b2700 1 -- 172.21.15.79:0/3167298944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f33e80f5b50 con 0x7f33e80bdc80 2021-04-09T18:33:21.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.937 7f33e4ff9700 1 -- 172.21.15.79:0/3167298944 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v75) v1 ==== 92+0+10 (secure 0 0 0) 0x7f33d8000bf0 con 0x7f33e80bdc80 2021-04-09T18:33:21.944 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:33:21.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.937 7f33ee4b2700 1 -- 172.21.15.79:0/3167298944 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f33c8029100 msgr2=0x7f33c802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.937 7f33ee4b2700 1 --2- 172.21.15.79:0/3167298944 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f33c8029100 0x7f33c802b650 crc :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.937 7f33ee4b2700 1 -- 172.21.15.79:0/3167298944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33e80bdc80 msgr2=0x7f33e8096850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:21.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.937 7f33ee4b2700 1 --2- 172.21.15.79:0/3167298944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33e80bdc80 0x7f33e8096850 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f33e80967a0 tx=0x7f33d800f440).stop 2021-04-09T18:33:21.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.937 7f33ee4b2700 1 -- 172.21.15.79:0/3167298944 shutdown_connections 2021-04-09T18:33:21.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.937 7f33ee4b2700 1 --2- 172.21.15.79:0/3167298944 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f33c8029100 0x7f33c802b650 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.937 7f33ee4b2700 1 --2- 172.21.15.79:0/3167298944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33e80c0180 0x7f33e80c05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.937 7f33ee4b2700 1 --2- 172.21.15.79:0/3167298944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33e80bdc80 0x7f33e8096850 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.937 7f33ee4b2700 1 --2- 172.21.15.79:0/3167298944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33e80d4db0 0x7f33e80d5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:21.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.937 7f33ee4b2700 1 -- 172.21.15.79:0/3167298944 >> 172.21.15.79:0/3167298944 conn(0x7f33e80d8180 msgr2=0x7f33e80d85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:21.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.937 7f33ee4b2700 1 -- 172.21.15.79:0/3167298944 shutdown_connections 2021-04-09T18:33:21.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:21.937 7f33ee4b2700 1 -- 172.21.15.79:0/3167298944 wait complete. 2021-04-09T18:33:21.956 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-04-09T18:33:22.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.041 7f29d80f2700 1 Processor -- start 2021-04-09T18:33:22.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.041 7f29d80f2700 1 -- start start 2021-04-09T18:33:22.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.041 7f29d80f2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f29d00e9ae0 0x7f29d009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:22.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.041 7f29d80f2700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d00fbb20 con 0x7f29d00f5520 2021-04-09T18:33:22.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.041 7f29d80f2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d00e56d0 con 0x7f29d01c8010 2021-04-09T18:33:22.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.041 7f29d80f2700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d01c3dc0 con 0x7f29d00e9ae0 2021-04-09T18:33:22.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.041 7f29d5695700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f29d00e9ae0 0x7f29d009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:22.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.041 7f29d5e96700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f29d00f5520 0x7f29d00f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55044/0 (socket says 172.21.15.79:55044) 2021-04-09T18:33:22.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.045 7f29d5e96700 1 -- 172.21.15.79:0/1440078752 learned_addr learned my addr 172.21.15.79:0/1440078752 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:22.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.045 7f29d5695700 1 --2- 172.21.15.79:0/1440078752 >> v2:172.21.15.79:3300/0 conn(0x7f29d00e9ae0 0x7f29d009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60336/0 (socket says 172.21.15.79:60336) 2021-04-09T18:33:22.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.045 7f29d5695700 1 -- 172.21.15.79:0/1440078752 >> v1:172.21.15.89:6789/0 conn(0x7f29d01c8010 legacy=0x7f29d01ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:22.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.045 7f29d5695700 1 -- 172.21.15.79:0/1440078752 >> v1:172.21.15.79:6789/0 conn(0x7f29d00f5520 legacy=0x7f29d00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:22.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.045 7f29d5695700 1 -- 172.21.15.79:0/1440078752 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d00e4330 con 0x7f29d00e9ae0 2021-04-09T18:33:22.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.045 7f29d5695700 1 --2- 172.21.15.79:0/1440078752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29d00e9ae0 0x7f29d009f110 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f29c0002f30 tx=0x7f29c000bcc0).ready entity=mon.0 client_cookie=3fd94bc72697c2f6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:22.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.045 7f29d4e94700 1 -- 172.21.15.79:0/1440078752 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f29d00e4330 con 0x7f29d00e9ae0 2021-04-09T18:33:22.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.045 7f29d4e94700 1 -- 172.21.15.79:0/1440078752 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c0009800 con 0x7f29d00e9ae0 2021-04-09T18:33:22.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.045 7f29d4e94700 1 -- 172.21.15.79:0/1440078752 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f29c0009c10 con 0x7f29d00e9ae0 2021-04-09T18:33:22.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.045 7f29d80f2700 1 -- 172.21.15.79:0/1440078752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29d00e9ae0 msgr2=0x7f29d009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:22.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.045 7f29d80f2700 1 --2- 172.21.15.79:0/1440078752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29d00e9ae0 0x7f29d009f110 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f29c0002f30 tx=0x7f29c000bcc0).stop 2021-04-09T18:33:22.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.045 7f29d80f2700 1 -- 172.21.15.79:0/1440078752 shutdown_connections 2021-04-09T18:33:22.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.045 7f29d80f2700 1 --2- 172.21.15.79:0/1440078752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29d00e9ae0 0x7f29d009f110 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:22.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.045 7f29d80f2700 1 -- 172.21.15.79:0/1440078752 >> 172.21.15.79:0/1440078752 conn(0x7f29d00e5fe0 msgr2=0x7f29d00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:22.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.045 7f29d80f2700 1 -- 172.21.15.79:0/1440078752 shutdown_connections 2021-04-09T18:33:22.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.045 7f29d80f2700 1 -- 172.21.15.79:0/1440078752 wait complete. 2021-04-09T18:33:22.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.049 7f29d80f2700 1 Processor -- start 2021-04-09T18:33:22.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.049 7f29d80f2700 1 -- start start 2021-04-09T18:33:22.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.049 7f29d80f2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29d00a87b0 0x7f29d00afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:22.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.049 7f29d80f2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29d0095c40 0x7f29d00b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:22.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.049 7f29d80f2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29d00b1a00 0x7f29d01cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:22.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.049 7f29d80f2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d00e9f30 con 0x7f29d00a87b0 2021-04-09T18:33:22.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.049 7f29d80f2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d00afb50 con 0x7f29d0095c40 2021-04-09T18:33:22.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.049 7f29d80f2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d00af2d0 con 0x7f29d00b1a00 2021-04-09T18:33:22.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.049 7f29d5e96700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29d00a87b0 0x7f29d00afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:22.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.049 7f29d5e96700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29d00a87b0 0x7f29d00afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60340/0 (socket says 172.21.15.79:60340) 2021-04-09T18:33:22.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.049 7f29d5e96700 1 -- 172.21.15.79:0/4037206364 learned_addr learned my addr 172.21.15.79:0/4037206364 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:22.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.049 7f29d5695700 1 --2- 172.21.15.79:0/4037206364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29d0095c40 0x7f29d00b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:22.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.049 7f29d6697700 1 --2- 172.21.15.79:0/4037206364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29d00b1a00 0x7f29d01cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:22.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.053 7f29d5e96700 1 -- 172.21.15.79:0/4037206364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29d00b1a00 msgr2=0x7f29d01cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:22.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.053 7f29d5e96700 1 --2- 172.21.15.79:0/4037206364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29d00b1a00 0x7f29d01cfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:22.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.053 7f29d5e96700 1 -- 172.21.15.79:0/4037206364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29d0095c40 msgr2=0x7f29d00b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:22.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.053 7f29d5e96700 1 --2- 172.21.15.79:0/4037206364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29d0095c40 0x7f29d00b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:22.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.053 7f29d5e96700 1 -- 172.21.15.79:0/4037206364 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d0096090 con 0x7f29d00a87b0 2021-04-09T18:33:22.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.053 7f29d6697700 1 --2- 172.21.15.79:0/4037206364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29d00b1a00 0x7f29d01cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:22.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.053 7f29d5e96700 1 --2- 172.21.15.79:0/4037206364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29d00a87b0 0x7f29d00afe80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f29cc000b80 tx=0x7f29cc00cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:22.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.053 7f29c67fc700 1 -- 172.21.15.79:0/4037206364 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f29d0096090 con 0x7f29d00a87b0 2021-04-09T18:33:22.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.053 7f29c67fc700 1 -- 172.21.15.79:0/4037206364 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc007320 con 0x7f29d00a87b0 2021-04-09T18:33:22.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.053 7f29d80f2700 1 -- 172.21.15.79:0/4037206364 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d01d0090 con 0x7f29d00a87b0 2021-04-09T18:33:22.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.053 7f29c67fc700 1 -- 172.21.15.79:0/4037206364 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f29cc0057e0 con 0x7f29d00a87b0 2021-04-09T18:33:22.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.053 7f29d80f2700 1 -- 172.21.15.79:0/4037206364 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d0093ba0 con 0x7f29d00a87b0 2021-04-09T18:33:22.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.053 7f29c67fc700 1 -- 172.21.15.79:0/4037206364 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f29cc01a060 con 0x7f29d00a87b0 2021-04-09T18:33:22.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.053 7f29c67fc700 1 --2- 172.21.15.79:0/4037206364 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f29b802b310 0x7f29b802d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:22.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.053 7f29c67fc700 1 -- 172.21.15.79:0/4037206364 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f29cc038960 con 0x7f29d00a87b0 2021-04-09T18:33:22.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.053 7f29d5695700 1 --2- 172.21.15.79:0/4037206364 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f29b802b310 0x7f29b802d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:22.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.053 7f29d5695700 1 --2- 172.21.15.79:0/4037206364 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f29b802b310 0x7f29b802d860 crc :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:22.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.053 7f29d80f2700 1 -- 172.21.15.79:0/4037206364 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d00e39e0 con 0x7f29d00a87b0 2021-04-09T18:33:22.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.057 7f29c67fc700 1 -- 172.21.15.79:0/4037206364 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f29cc007110 con 0x7f29d00a87b0 2021-04-09T18:33:22.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.213 7f29d80f2700 1 -- 172.21.15.79:0/4037206364 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f29d00a1cc0 con 0x7f29d00a87b0 2021-04-09T18:33:22.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.213 7f29c67fc700 1 -- 172.21.15.79:0/4037206364 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) v1 ==== 84+0+64 (secure 0 0 0) 0x7f29cc000bf0 con 0x7f29d00a87b0 2021-04-09T18:33:22.221 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:22.221 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2021-04-09T18:33:22.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:22.222 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2021-04-09T18:33:22.222 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": "rbd" 2021-04-09T18:33:22.222 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:22.222 INFO:teuthology.orchestra.run.smithi079.stdout:] 2021-04-09T18:33:22.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.217 7f29d80f2700 1 -- 172.21.15.79:0/4037206364 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f29b802b310 msgr2=0x7f29b802d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:22.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.217 7f29d80f2700 1 --2- 172.21.15.79:0/4037206364 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f29b802b310 0x7f29b802d860 crc :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:22.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.217 7f29d80f2700 1 -- 172.21.15.79:0/4037206364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29d00a87b0 msgr2=0x7f29d00afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:22.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.217 7f29d80f2700 1 --2- 172.21.15.79:0/4037206364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29d00a87b0 0x7f29d00afe80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f29cc000b80 tx=0x7f29cc00cab0).stop 2021-04-09T18:33:22.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.217 7f29d80f2700 1 -- 172.21.15.79:0/4037206364 shutdown_connections 2021-04-09T18:33:22.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.217 7f29d80f2700 1 --2- 172.21.15.79:0/4037206364 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f29b802b310 0x7f29b802d860 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:22.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.217 7f29d80f2700 1 --2- 172.21.15.79:0/4037206364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29d00b1a00 0x7f29d01cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:22.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.217 7f29d80f2700 1 --2- 172.21.15.79:0/4037206364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29d00a87b0 0x7f29d00afe80 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:22.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.217 7f29d80f2700 1 --2- 172.21.15.79:0/4037206364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29d0095c40 0x7f29d00b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:22.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.217 7f29d80f2700 1 -- 172.21.15.79:0/4037206364 >> 172.21.15.79:0/4037206364 conn(0x7f29d0097650 msgr2=0x7f29d0097aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:22.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.217 7f29d80f2700 1 -- 172.21.15.79:0/4037206364 shutdown_connections 2021-04-09T18:33:22.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.217 7f29d80f2700 1 -- 172.21.15.79:0/4037206364 wait complete. 2021-04-09T18:33:22.233 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-04-09T18:33:22.234 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-04-09T18:33:22.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca9e2fb700 1 Processor -- start 2021-04-09T18:33:22.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca9e2fb700 1 -- start start 2021-04-09T18:33:22.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca9e2fb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fca980f5550 0x7fca980f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:22.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca9e2fb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca980e9b10 0x7fca9809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:22.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca9e2fb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca980fbb50 con 0x7fca981c2de0 2021-04-09T18:33:22.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca9e2fb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca980e9f60 con 0x7fca980f5550 2021-04-09T18:33:22.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca9e2fb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca980e5a00 con 0x7fca980e9b10 2021-04-09T18:33:22.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca977fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca980e9b10 0x7fca9809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:22.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca97fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fca980f5550 0x7fca980f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:22.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca977fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca980e9b10 0x7fca9809f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:57346/0 (socket says 172.21.15.79:57346) 2021-04-09T18:33:22.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca97fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fca980f5550 0x7fca980f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:48690/0 (socket says 172.21.15.79:48690) 2021-04-09T18:33:22.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca977fe700 1 -- 172.21.15.79:0/1028854008 learned_addr learned my addr 172.21.15.79:0/1028854008 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:22.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca9c8a0700 1 --1- 172.21.15.79:0/1028854008 >> v1:172.21.15.89:6789/0 conn(0x7fca981c2de0 0x7fca981c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:55532/0 (socket says 172.21.15.79:55532) 2021-04-09T18:33:22.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca977fe700 1 -- 172.21.15.79:0/1028854008 >> v2:172.21.15.89:3300/0 conn(0x7fca980f5550 msgr2=0x7fca980f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:22.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca977fe700 1 --2- 172.21.15.79:0/1028854008 >> v2:172.21.15.89:3300/0 conn(0x7fca980f5550 0x7fca980f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:22.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca977fe700 1 -- 172.21.15.79:0/1028854008 >> v1:172.21.15.89:6789/0 conn(0x7fca981c2de0 legacy=0x7fca981c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:22.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca977fe700 1 -- 172.21.15.79:0/1028854008 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca980e5700 con 0x7fca980e9b10 2021-04-09T18:33:22.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca977fe700 1 --2- 172.21.15.79:0/1028854008 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca980e9b10 0x7fca9809f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fca80002f30 tx=0x7fca8000bd20).ready entity=mon.2 client_cookie=b16ce7af840c8a6a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:22.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca96ffd700 1 -- 172.21.15.79:0/1028854008 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fca980e5700 con 0x7fca980e9b10 2021-04-09T18:33:22.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca96ffd700 1 -- 172.21.15.79:0/1028854008 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca80009980 con 0x7fca980e9b10 2021-04-09T18:33:22.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca96ffd700 1 -- 172.21.15.79:0/1028854008 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fca80009d50 con 0x7fca980e9b10 2021-04-09T18:33:22.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca9e2fb700 1 -- 172.21.15.79:0/1028854008 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca980e9b10 msgr2=0x7fca9809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:22.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.317 7fca9e2fb700 1 --2- 172.21.15.79:0/1028854008 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca980e9b10 0x7fca9809f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fca80002f30 tx=0x7fca8000bd20).stop 2021-04-09T18:33:22.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.321 7fca9e2fb700 1 -- 172.21.15.79:0/1028854008 shutdown_connections 2021-04-09T18:33:22.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.321 7fca9e2fb700 1 --2- 172.21.15.79:0/1028854008 >> v2:172.21.15.89:3300/0 conn(0x7fca980f5550 0x7fca980f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:22.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.321 7fca9e2fb700 1 --2- 172.21.15.79:0/1028854008 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca980e9b10 0x7fca9809f110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:22.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.321 7fca9e2fb700 1 -- 172.21.15.79:0/1028854008 >> 172.21.15.79:0/1028854008 conn(0x7fca980e6010 msgr2=0x7fca980e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:22.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.321 7fca9e2fb700 1 -- 172.21.15.79:0/1028854008 shutdown_connections 2021-04-09T18:33:22.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.321 7fca9e2fb700 1 -- 172.21.15.79:0/1028854008 wait complete. 2021-04-09T18:33:22.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.321 7fca9e2fb700 1 Processor -- start 2021-04-09T18:33:22.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.321 7fca9e2fb700 1 -- start start 2021-04-09T18:33:22.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca9e2fb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca980b3660 0x7fca981a9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:22.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca9e2fb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca98095980 0x7fca981a9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:22.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca9e2fb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca980ba4f0 0x7fca980b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:22.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca9e2fb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca980b3db0 con 0x7fca980b3660 2021-04-09T18:33:22.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca9e2fb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca98095dd0 con 0x7fca98095980 2021-04-09T18:33:22.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca9e2fb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca980b3ab0 con 0x7fca980ba4f0 2021-04-09T18:33:22.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca97fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca980b3660 0x7fca981a9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:22.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca97fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca980b3660 0x7fca981a9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60354/0 (socket says 172.21.15.79:60354) 2021-04-09T18:33:22.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca97fff700 1 -- 172.21.15.79:0/823822200 learned_addr learned my addr 172.21.15.79:0/823822200 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:22.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca977fe700 1 --2- 172.21.15.79:0/823822200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca98095980 0x7fca981a9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:22.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca9c8a0700 1 --2- 172.21.15.79:0/823822200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca980ba4f0 0x7fca980b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:22.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca97fff700 1 -- 172.21.15.79:0/823822200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca980ba4f0 msgr2=0x7fca980b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:22.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca97fff700 1 --2- 172.21.15.79:0/823822200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca980ba4f0 0x7fca980b58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:22.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca97fff700 1 -- 172.21.15.79:0/823822200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca98095980 msgr2=0x7fca981a9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:22.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca97fff700 1 --2- 172.21.15.79:0/823822200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca98095980 0x7fca981a9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:22.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca97fff700 1 -- 172.21.15.79:0/823822200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca981aa470 con 0x7fca980b3660 2021-04-09T18:33:22.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca97fff700 1 --2- 172.21.15.79:0/823822200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca980b3660 0x7fca981a9810 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7fca9000efc0 tx=0x7fca9000c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:22.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca94ff9700 1 -- 172.21.15.79:0/823822200 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fca981aa470 con 0x7fca980b3660 2021-04-09T18:33:22.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca94ff9700 1 -- 172.21.15.79:0/823822200 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9001a470 con 0x7fca980b3660 2021-04-09T18:33:22.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca94ff9700 1 -- 172.21.15.79:0/823822200 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fca9000f040 con 0x7fca980b3660 2021-04-09T18:33:22.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca9e2fb700 1 -- 172.21.15.79:0/823822200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca980b5ee0 con 0x7fca980b3660 2021-04-09T18:33:22.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca9e2fb700 1 -- 172.21.15.79:0/823822200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca980b63c0 con 0x7fca980b3660 2021-04-09T18:33:22.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca94ff9700 1 -- 172.21.15.79:0/823822200 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fca90011450 con 0x7fca980b3660 2021-04-09T18:33:22.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca94ff9700 1 --2- 172.21.15.79:0/823822200 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fca7c029100 0x7fca7c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:22.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.325 7fca94ff9700 1 -- 172.21.15.79:0/823822200 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fca9003b610 con 0x7fca980b3660 2021-04-09T18:33:22.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.329 7fca977fe700 1 --2- 172.21.15.79:0/823822200 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fca7c029100 0x7fca7c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:22.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.329 7fca977fe700 1 --2- 172.21.15.79:0/823822200 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fca7c029100 0x7fca7c02b650 crc :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:22.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.329 7fca9e2fb700 1 -- 172.21.15.79:0/823822200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca980e39f0 con 0x7fca980b3660 2021-04-09T18:33:22.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.337 7fca94ff9700 1 -- 172.21.15.79:0/823822200 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fca9000caf0 con 0x7fca980b3660 2021-04-09T18:33:22.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:22.493 7fca9e2fb700 1 -- 172.21.15.79:0/823822200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7fca980f5b50 con 0x7fca980b3660 2021-04-09T18:33:23.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.189 7fca94ff9700 1 -- 172.21.15.79:0/823822200 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v76) v1 ==== 133+0+0 (secure 0 0 0) 0x7fca90000f70 con 0x7fca980b3660 2021-04-09T18:33:23.214 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2021-04-09T18:33:23.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.209 7fca9e2fb700 1 -- 172.21.15.79:0/823822200 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fca7c029100 msgr2=0x7fca7c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:23.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.209 7fca9e2fb700 1 --2- 172.21.15.79:0/823822200 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fca7c029100 0x7fca7c02b650 crc :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:23.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.209 7fca9e2fb700 1 -- 172.21.15.79:0/823822200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca980b3660 msgr2=0x7fca981a9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:23.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.209 7fca9e2fb700 1 --2- 172.21.15.79:0/823822200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca980b3660 0x7fca981a9810 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7fca9000efc0 tx=0x7fca9000c430).stop 2021-04-09T18:33:23.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.209 7fca9e2fb700 1 -- 172.21.15.79:0/823822200 shutdown_connections 2021-04-09T18:33:23.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.209 7fca9e2fb700 1 --2- 172.21.15.79:0/823822200 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fca7c029100 0x7fca7c02b650 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:23.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.209 7fca9e2fb700 1 --2- 172.21.15.79:0/823822200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca980ba4f0 0x7fca980b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:23.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.209 7fca9e2fb700 1 --2- 172.21.15.79:0/823822200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca980b3660 0x7fca981a9810 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:23.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.209 7fca9e2fb700 1 --2- 172.21.15.79:0/823822200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca98095980 0x7fca981a9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:23.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.209 7fca9e2fb700 1 -- 172.21.15.79:0/823822200 >> 172.21.15.79:0/823822200 conn(0x7fca980978b0 msgr2=0x7fca980c3050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:23.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.209 7fca9e2fb700 1 -- 172.21.15.79:0/823822200 shutdown_connections 2021-04-09T18:33:23.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.209 7fca9e2fb700 1 -- 172.21.15.79:0/823822200 wait complete. 2021-04-09T18:33:23.231 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-04-09T18:33:23.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.321 7fb0b0346700 1 Processor -- start 2021-04-09T18:33:23.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.321 7fb0b0346700 1 -- start start 2021-04-09T18:33:23.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.321 7fb0b0346700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb0a80f5550 0x7fb0a80f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:23.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.321 7fb0b0346700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb0a80e9b10 0x7fb0a809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:23.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.321 7fb0b0346700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a80fbb50 con 0x7fb0a81c2de0 2021-04-09T18:33:23.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.321 7fb0b0346700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a80e9f60 con 0x7fb0a80e9b10 2021-04-09T18:33:23.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.321 7fb0b0346700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a80e5a00 con 0x7fb0a80f5550 2021-04-09T18:33:23.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.321 7fb0ad8e9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb0a80e9b10 0x7fb0a809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:23.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.321 7fb0ae8eb700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb0a81c2de0 0x7fb0a81c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55076/0 (socket says 172.21.15.79:55076) 2021-04-09T18:33:23.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.321 7fb0ae8eb700 1 -- 172.21.15.79:0/4104705450 learned_addr learned my addr 172.21.15.79:0/4104705450 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:23.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.321 7fb0ae0ea700 1 --2- 172.21.15.79:0/4104705450 >> v2:172.21.15.89:3300/0 conn(0x7fb0a80f5550 0x7fb0a80f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:23.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.321 7fb0ad8e9700 1 -- 172.21.15.79:0/4104705450 >> v2:172.21.15.89:3300/0 conn(0x7fb0a80f5550 msgr2=0x7fb0a80f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:23.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.321 7fb0ad8e9700 1 --2- 172.21.15.79:0/4104705450 >> v2:172.21.15.89:3300/0 conn(0x7fb0a80f5550 0x7fb0a80f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:23.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.321 7fb0ad8e9700 1 -- 172.21.15.79:0/4104705450 >> v1:172.21.15.79:6789/0 conn(0x7fb0a81c2de0 legacy=0x7fb0a81c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:23.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.321 7fb0ad8e9700 1 -- 172.21.15.79:0/4104705450 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a80e5700 con 0x7fb0a80e9b10 2021-04-09T18:33:23.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.321 7fb0ad0e8700 1 -- 172.21.15.79:0/4104705450 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956067241 0 0) 0x7fb0a00010d0 con 0x7fb0a81c2de0 2021-04-09T18:33:23.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.321 7fb0ad8e9700 1 --2- 172.21.15.79:0/4104705450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a80e9b10 0x7fb0a809f110 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7fb09c0032b0 tx=0x7fb09c00b3c0).ready entity=mon.0 client_cookie=49900cdefa3b2784 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:23.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.325 7fb0ad0e8700 1 -- 172.21.15.79:0/4104705450 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb0a80e5700 con 0x7fb0a80e9b10 2021-04-09T18:33:23.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.325 7fb0ad0e8700 1 -- 172.21.15.79:0/4104705450 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c00bc20 con 0x7fb0a80e9b10 2021-04-09T18:33:23.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.325 7fb0ad0e8700 1 -- 172.21.15.79:0/4104705450 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb09c002020 con 0x7fb0a80e9b10 2021-04-09T18:33:23.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.325 7fb0b0346700 1 -- 172.21.15.79:0/4104705450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a80e9b10 msgr2=0x7fb0a809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:23.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.325 7fb0b0346700 1 --2- 172.21.15.79:0/4104705450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a80e9b10 0x7fb0a809f110 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7fb09c0032b0 tx=0x7fb09c00b3c0).stop 2021-04-09T18:33:23.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.325 7fb0b0346700 1 -- 172.21.15.79:0/4104705450 shutdown_connections 2021-04-09T18:33:23.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.325 7fb0b0346700 1 --2- 172.21.15.79:0/4104705450 >> v2:172.21.15.89:3300/0 conn(0x7fb0a80f5550 0x7fb0a80f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:23.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.325 7fb0b0346700 1 --2- 172.21.15.79:0/4104705450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a80e9b10 0x7fb0a809f110 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:23.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.325 7fb0b0346700 1 -- 172.21.15.79:0/4104705450 >> 172.21.15.79:0/4104705450 conn(0x7fb0a80e6010 msgr2=0x7fb0a80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:23.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.325 7fb0b0346700 1 -- 172.21.15.79:0/4104705450 shutdown_connections 2021-04-09T18:33:23.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.325 7fb0b0346700 1 -- 172.21.15.79:0/4104705450 wait complete. 2021-04-09T18:33:23.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.325 7fb0b0346700 1 Processor -- start 2021-04-09T18:33:23.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.325 7fb0b0346700 1 -- start start 2021-04-09T18:33:23.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb0b0346700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0a80d6940 0x7fb0a80d7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:23.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb0b0346700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0a81a6ab0 0x7fb0a8093f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:23.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb0b0346700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a80ceb50 0x7fb0a80cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:23.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb0b0346700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80e8b20 con 0x7fb0a80ceb50 2021-04-09T18:33:23.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb0b0346700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80d50c0 con 0x7fb0a80d6940 2021-04-09T18:33:23.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb0b0346700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80d53c0 con 0x7fb0a81a6ab0 2021-04-09T18:33:23.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb0ae8eb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a80ceb50 0x7fb0a80cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:23.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb0ad8e9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0a81a6ab0 0x7fb0a8093f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:23.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb0ae8eb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a80ceb50 0x7fb0a80cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60372/0 (socket says 172.21.15.79:60372) 2021-04-09T18:33:23.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb0ae8eb700 1 -- 172.21.15.79:0/3809038135 learned_addr learned my addr 172.21.15.79:0/3809038135 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:23.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb0ae0ea700 1 --2- 172.21.15.79:0/3809038135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0a80d6940 0x7fb0a80d7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:23.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb0ae8eb700 1 -- 172.21.15.79:0/3809038135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0a81a6ab0 msgr2=0x7fb0a8093f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:23.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb0ae8eb700 1 --2- 172.21.15.79:0/3809038135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0a81a6ab0 0x7fb0a8093f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:23.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb0ae8eb700 1 -- 172.21.15.79:0/3809038135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0a80d6940 msgr2=0x7fb0a80d7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:23.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb0ae8eb700 1 --2- 172.21.15.79:0/3809038135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0a80d6940 0x7fb0a80d7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:23.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb0ae8eb700 1 -- 172.21.15.79:0/3809038135 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a80d6d90 con 0x7fb0a80ceb50 2021-04-09T18:33:23.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb0ad8e9700 1 --2- 172.21.15.79:0/3809038135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0a81a6ab0 0x7fb0a8093f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:23.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb0ae8eb700 1 --2- 172.21.15.79:0/3809038135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a80ceb50 0x7fb0a80cefa0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fb0a80baad0 tx=0x7fb0a000cb60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:23.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb09affd700 1 -- 172.21.15.79:0/3809038135 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb0a80d6d90 con 0x7fb0a80ceb50 2021-04-09T18:33:23.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb09affd700 1 -- 172.21.15.79:0/3809038135 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a00072e0 con 0x7fb0a80ceb50 2021-04-09T18:33:23.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb09affd700 1 -- 172.21.15.79:0/3809038135 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb0a00057e0 con 0x7fb0a80ceb50 2021-04-09T18:33:23.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb0b0346700 1 -- 172.21.15.79:0/3809038135 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a8094ed0 con 0x7fb0a80ceb50 2021-04-09T18:33:23.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb0b0346700 1 -- 172.21.15.79:0/3809038135 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a8094590 con 0x7fb0a80ceb50 2021-04-09T18:33:23.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb09affd700 1 -- 172.21.15.79:0/3809038135 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb0a00059e0 con 0x7fb0a80ceb50 2021-04-09T18:33:23.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb09affd700 1 --2- 172.21.15.79:0/3809038135 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb090029100 0x7fb09002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:23.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.329 7fb09affd700 1 -- 172.21.15.79:0/3809038135 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5458+0+0 (secure 0 0 0) 0x7fb0a0038c50 con 0x7fb0a80ceb50 2021-04-09T18:33:23.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.333 7fb0ae0ea700 1 --2- 172.21.15.79:0/3809038135 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb090029100 0x7fb09002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:23.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.333 7fb0ae0ea700 1 --2- 172.21.15.79:0/3809038135 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb090029100 0x7fb09002b650 crc :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:23.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.337 7fb0b0346700 1 -- 172.21.15.79:0/3809038135 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a80e39f0 con 0x7fb0a80ceb50 2021-04-09T18:33:23.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.341 7fb09affd700 1 -- 172.21.15.79:0/3809038135 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb0a0000bf0 con 0x7fb0a80ceb50 2021-04-09T18:33:23.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.501 7fb0b0346700 1 -- 172.21.15.79:0/3809038135 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7fb0a80f5b50 con 0x7fb0a80ceb50 2021-04-09T18:33:23.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:23.981 7fb09affd700 1 -- 172.21.15.79:0/3809038135 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v77) v1 ==== 125+0+0 (secure 0 0 0) 0x7fb0a00070d0 con 0x7fb0a80ceb50 2021-04-09T18:33:24.022 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2021-04-09T18:33:24.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.017 7fb0b0346700 1 -- 172.21.15.79:0/3809038135 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb090029100 msgr2=0x7fb09002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.017 7fb0b0346700 1 --2- 172.21.15.79:0/3809038135 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb090029100 0x7fb09002b650 crc :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.017 7fb0b0346700 1 -- 172.21.15.79:0/3809038135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a80ceb50 msgr2=0x7fb0a80cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.017 7fb0b0346700 1 --2- 172.21.15.79:0/3809038135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a80ceb50 0x7fb0a80cefa0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fb0a80baad0 tx=0x7fb0a000cb60).stop 2021-04-09T18:33:24.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.017 7fb0b0346700 1 -- 172.21.15.79:0/3809038135 shutdown_connections 2021-04-09T18:33:24.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.017 7fb0b0346700 1 --2- 172.21.15.79:0/3809038135 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb090029100 0x7fb09002b650 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.017 7fb0b0346700 1 --2- 172.21.15.79:0/3809038135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0a80d6940 0x7fb0a80d7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.017 7fb0b0346700 1 --2- 172.21.15.79:0/3809038135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a80ceb50 0x7fb0a80cefa0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.017 7fb0b0346700 1 --2- 172.21.15.79:0/3809038135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0a81a6ab0 0x7fb0a8093f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.017 7fb0b0346700 1 -- 172.21.15.79:0/3809038135 >> 172.21.15.79:0/3809038135 conn(0x7fb0a80935d0 msgr2=0x7fb0a80d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:24.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.017 7fb0b0346700 1 -- 172.21.15.79:0/3809038135 shutdown_connections 2021-04-09T18:33:24.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.017 7fb0b0346700 1 -- 172.21.15.79:0/3809038135 wait complete. 2021-04-09T18:33:24.037 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-04-09T18:33:24.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f842cb2e700 1 Processor -- start 2021-04-09T18:33:24.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f842cb2e700 1 -- start start 2021-04-09T18:33:24.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f842cb2e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84280f5550 0x7f84280f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:24.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f842cb2e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84280fbb50 con 0x7f84280e9b10 2021-04-09T18:33:24.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f842cb2e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842809f910 con 0x7f84281c8040 2021-04-09T18:33:24.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f842cb2e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84280e9f60 con 0x7f84280f5550 2021-04-09T18:33:24.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f8425fe5700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f84280e9b10 0x7f842809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55086/0 (socket says 172.21.15.79:55086) 2021-04-09T18:33:24.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f8425fe5700 1 -- 172.21.15.79:0/4085926477 learned_addr learned my addr 172.21.15.79:0/4085926477 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:24.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84267e6700 1 --2- 172.21.15.79:0/4085926477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84280f5550 0x7f84280f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:24.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84257e4700 1 -- 172.21.15.79:0/4085926477 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190648629 0 0) 0x7f841c0010d0 con 0x7f84280e9b10 2021-04-09T18:33:24.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84257e4700 1 -- 172.21.15.79:0/4085926477 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8410003240 con 0x7f84280e9b10 2021-04-09T18:33:24.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84257e4700 1 -- 172.21.15.79:0/4085926477 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3466951999 0 0) 0x7f8420001450 con 0x7f84281c8040 2021-04-09T18:33:24.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84257e4700 1 -- 172.21.15.79:0/4085926477 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8410003620 con 0x7f84281c8040 2021-04-09T18:33:24.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84257e4700 1 -- 172.21.15.79:0/4085926477 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1311473626 0 0) 0x7f841c001650 con 0x7f84280e9b10 2021-04-09T18:33:24.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84257e4700 1 -- 172.21.15.79:0/4085926477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84280f5550 msgr2=0x7f84280f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:24.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84257e4700 1 --2- 172.21.15.79:0/4085926477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84280f5550 0x7f84280f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84257e4700 1 -- 172.21.15.79:0/4085926477 >> v1:172.21.15.89:6789/0 conn(0x7f84281c8040 legacy=0x7f84281ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84257e4700 1 -- 172.21.15.79:0/4085926477 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84280e5700 con 0x7f84280e9b10 2021-04-09T18:33:24.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84257e4700 1 -- 172.21.15.79:0/4085926477 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f841c001bb0 con 0x7f84280e9b10 2021-04-09T18:33:24.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84257e4700 1 -- 172.21.15.79:0/4085926477 >> v1:172.21.15.79:6789/0 conn(0x7f84280e9b10 legacy=0x7f842809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84257e4700 1 --2- 172.21.15.79:0/4085926477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8410003d40 0x7f84100045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:24.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84257e4700 1 --2- 172.21.15.79:0/4085926477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8410004bd0 0x7f84100097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:24.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84257e4700 1 --2- 172.21.15.79:0/4085926477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8410005020 0x7f841000be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:24.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84257e4700 1 -- 172.21.15.79:0/4085926477 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84280e9f60 con 0x7f8410005020 2021-04-09T18:33:24.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84257e4700 1 -- 172.21.15.79:0/4085926477 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8410050460 con 0x7f8410003d40 2021-04-09T18:33:24.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84257e4700 1 -- 172.21.15.79:0/4085926477 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8410050610 con 0x7f8410004bd0 2021-04-09T18:33:24.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f8426fe7700 1 --2- 172.21.15.79:0/4085926477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8410005020 0x7f841000be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:24.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f8425fe5700 1 --2- 172.21.15.79:0/4085926477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8410004bd0 0x7f84100097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:24.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84267e6700 1 --2- 172.21.15.79:0/4085926477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8410003d40 0x7f84100045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:24.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f8426fe7700 1 -- 172.21.15.79:0/4085926477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8410004bd0 msgr2=0x7f84100097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:24.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f8426fe7700 1 --2- 172.21.15.79:0/4085926477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8410004bd0 0x7f84100097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f8426fe7700 1 -- 172.21.15.79:0/4085926477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8410003d40 msgr2=0x7f84100045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:24.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f8426fe7700 1 --2- 172.21.15.79:0/4085926477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8410003d40 0x7f84100045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f8426fe7700 1 -- 172.21.15.79:0/4085926477 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8410050880 con 0x7f8410005020 2021-04-09T18:33:24.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f8426fe7700 1 --2- 172.21.15.79:0/4085926477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8410005020 0x7f841000be20 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f8420001360 tx=0x7f842000c470).ready entity=mon.0 client_cookie=fa6b8cfa6c3ec2ea server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:24.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84257e4700 1 -- 172.21.15.79:0/4085926477 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8410050880 con 0x7f8410005020 2021-04-09T18:33:24.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84257e4700 1 -- 172.21.15.79:0/4085926477 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842000cda0 con 0x7f8410005020 2021-04-09T18:33:24.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f84257e4700 1 -- 172.21.15.79:0/4085926477 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8420006a60 con 0x7f8410005020 2021-04-09T18:33:24.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f842cb2e700 1 -- 172.21.15.79:0/4085926477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8410005020 msgr2=0x7f841000be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f842cb2e700 1 --2- 172.21.15.79:0/4085926477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8410005020 0x7f841000be20 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f8420001360 tx=0x7f842000c470).stop 2021-04-09T18:33:24.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f8426fe7700 1 -- 172.21.15.79:0/4085926477 reap_dead start 2021-04-09T18:33:24.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f842cb2e700 1 -- 172.21.15.79:0/4085926477 shutdown_connections 2021-04-09T18:33:24.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f842cb2e700 1 -- 172.21.15.79:0/4085926477 >> 172.21.15.79:0/4085926477 conn(0x7f84280e6010 msgr2=0x7f84280e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:24.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f842cb2e700 1 -- 172.21.15.79:0/4085926477 shutdown_connections 2021-04-09T18:33:24.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.133 7f842cb2e700 1 -- 172.21.15.79:0/4085926477 wait complete. 2021-04-09T18:33:24.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.137 7f842cb2e700 1 Processor -- start 2021-04-09T18:33:24.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.137 7f842cb2e700 1 -- start start 2021-04-09T18:33:24.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.137 7f842cb2e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84280c40e0 0x7f842819d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:24.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.137 7f842cb2e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84280a2790 0x7f84280a30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:24.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.137 7f842cb2e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84280a2be0 0x7f84281ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:24.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.137 7f842cb2e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84281c3df0 con 0x7f84280a2be0 2021-04-09T18:33:24.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.137 7f842cb2e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842819bb60 con 0x7f84280c40e0 2021-04-09T18:33:24.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.137 7f842cb2e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84280c4530 con 0x7f84280a2790 2021-04-09T18:33:24.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.137 7f8426fe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84280a2be0 0x7f84281ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:24.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.137 7f8426fe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84280a2be0 0x7f84281ad6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60392/0 (socket says 172.21.15.79:60392) 2021-04-09T18:33:24.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.137 7f8426fe7700 1 -- 172.21.15.79:0/2712212989 learned_addr learned my addr 172.21.15.79:0/2712212989 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:24.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.137 7f8425fe5700 1 --2- 172.21.15.79:0/2712212989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84280a2790 0x7f84280a30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:24.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.137 7f84267e6700 1 --2- 172.21.15.79:0/2712212989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84280c40e0 0x7f842819d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:24.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.137 7f8426fe7700 1 -- 172.21.15.79:0/2712212989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84280a2790 msgr2=0x7f84280a30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.137 7f8426fe7700 1 --2- 172.21.15.79:0/2712212989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84280a2790 0x7f84280a30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.137 7f8426fe7700 1 -- 172.21.15.79:0/2712212989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84280c40e0 msgr2=0x7f842819d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.137 7f8426fe7700 1 --2- 172.21.15.79:0/2712212989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84280c40e0 0x7f842819d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.137 7f8426fe7700 1 -- 172.21.15.79:0/2712212989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84280a3720 con 0x7f84280a2be0 2021-04-09T18:33:24.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.141 7f8426fe7700 1 --2- 172.21.15.79:0/2712212989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84280a2be0 0x7f84281ad6d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f842809b320 tx=0x7f8420007970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:24.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.141 7f8416ffd700 1 -- 172.21.15.79:0/2712212989 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f84280a3720 con 0x7f84280a2be0 2021-04-09T18:33:24.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.141 7f8416ffd700 1 -- 172.21.15.79:0/2712212989 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8420006c70 con 0x7f84280a2be0 2021-04-09T18:33:24.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.141 7f842cb2e700 1 -- 172.21.15.79:0/2712212989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84280c2c40 con 0x7f84280a2be0 2021-04-09T18:33:24.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.141 7f8416ffd700 1 -- 172.21.15.79:0/2712212989 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8420018040 con 0x7f84280a2be0 2021-04-09T18:33:24.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.141 7f842cb2e700 1 -- 172.21.15.79:0/2712212989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84281add00 con 0x7f84280a2be0 2021-04-09T18:33:24.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.141 7f8416ffd700 1 -- 172.21.15.79:0/2712212989 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8420023060 con 0x7f84280a2be0 2021-04-09T18:33:24.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.141 7f8416ffd700 1 --2- 172.21.15.79:0/2712212989 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f840c029100 0x7f840c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:24.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.141 7f8416ffd700 1 -- 172.21.15.79:0/2712212989 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f8420003070 con 0x7f84280a2be0 2021-04-09T18:33:24.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.141 7f84267e6700 1 --2- 172.21.15.79:0/2712212989 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f840c029100 0x7f840c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:24.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.141 7f84267e6700 1 --2- 172.21.15.79:0/2712212989 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f840c029100 0x7f840c02b650 crc :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:24.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.145 7f842cb2e700 1 -- 172.21.15.79:0/2712212989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84280e39f0 con 0x7f84280a2be0 2021-04-09T18:33:24.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.153 7f8416ffd700 1 -- 172.21.15.79:0/2712212989 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8420000f70 con 0x7f84280a2be0 2021-04-09T18:33:24.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.309 7f842cb2e700 1 -- 172.21.15.79:0/2712212989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f84280f5b50 con 0x7f84280a2be0 2021-04-09T18:33:24.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.317 7f8416ffd700 1 -- 172.21.15.79:0/2712212989 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 14 and data pool 15 v46) v1 ==== 189+0+0 (secure 0 0 0) 0x7f8420006870 con 0x7f84280a2be0 2021-04-09T18:33:24.333 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 14 and data pool 15 2021-04-09T18:33:24.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.329 7f842cb2e700 1 -- 172.21.15.79:0/2712212989 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f840c029100 msgr2=0x7f840c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.329 7f842cb2e700 1 --2- 172.21.15.79:0/2712212989 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f840c029100 0x7f840c02b650 crc :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.329 7f842cb2e700 1 -- 172.21.15.79:0/2712212989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84280a2be0 msgr2=0x7f84281ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.329 7f842cb2e700 1 --2- 172.21.15.79:0/2712212989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84280a2be0 0x7f84281ad6d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f842809b320 tx=0x7f8420007970).stop 2021-04-09T18:33:24.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.329 7f842cb2e700 1 -- 172.21.15.79:0/2712212989 shutdown_connections 2021-04-09T18:33:24.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.329 7f842cb2e700 1 --2- 172.21.15.79:0/2712212989 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f840c029100 0x7f840c02b650 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.329 7f842cb2e700 1 --2- 172.21.15.79:0/2712212989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84280c40e0 0x7f842819d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.329 7f842cb2e700 1 --2- 172.21.15.79:0/2712212989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84280a2be0 0x7f84281ad6d0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.329 7f842cb2e700 1 --2- 172.21.15.79:0/2712212989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84280a2790 0x7f84280a30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.329 7f842cb2e700 1 -- 172.21.15.79:0/2712212989 >> 172.21.15.79:0/2712212989 conn(0x7f84280bab90 msgr2=0x7f842809a770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:24.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.329 7f842cb2e700 1 -- 172.21.15.79:0/2712212989 shutdown_connections 2021-04-09T18:33:24.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.329 7f842cb2e700 1 -- 172.21.15.79:0/2712212989 wait complete. 2021-04-09T18:33:24.350 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:33:24.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9ea050e700 1 Processor -- start 2021-04-09T18:33:24.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9ea050e700 1 -- start start 2021-04-09T18:33:24.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9ea050e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9e980f5520 0x7f9e980f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:24.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9ea050e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e980fbb20 con 0x7f9e980e9ae0 2021-04-09T18:33:24.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9ea050e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9809f910 con 0x7f9e981c8010 2021-04-09T18:33:24.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9ea050e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e980e9f30 con 0x7f9e980f5520 2021-04-09T18:33:24.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9e9dab1700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9e980e9ae0 0x7f9e9809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55108/0 (socket says 172.21.15.79:55108) 2021-04-09T18:33:24.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9e9dab1700 1 -- 172.21.15.79:0/1509642476 learned_addr learned my addr 172.21.15.79:0/1509642476 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:24.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9e9e2b2700 1 --2- 172.21.15.79:0/1509642476 >> v2:172.21.15.89:3300/0 conn(0x7f9e980f5520 0x7f9e980f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:24.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9e9d2b0700 1 -- 172.21.15.79:0/1509642476 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3001092517 0 0) 0x7f9e94001450 con 0x7f9e980e9ae0 2021-04-09T18:33:24.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9e9d2b0700 1 -- 172.21.15.79:0/1509642476 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e84003240 con 0x7f9e980e9ae0 2021-04-09T18:33:24.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9e9d2b0700 1 -- 172.21.15.79:0/1509642476 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4128785563 0 0) 0x7f9e940019d0 con 0x7f9e980e9ae0 2021-04-09T18:33:24.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9e9e2b2700 1 -- 172.21.15.79:0/1509642476 >> v1:172.21.15.89:6789/0 conn(0x7f9e981c8010 legacy=0x7f9e981ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9e9e2b2700 1 -- 172.21.15.79:0/1509642476 >> v1:172.21.15.79:6789/0 conn(0x7f9e980e9ae0 legacy=0x7f9e9809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9e9e2b2700 1 -- 172.21.15.79:0/1509642476 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e980e56d0 con 0x7f9e980f5520 2021-04-09T18:33:24.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9e9e2b2700 1 --2- 172.21.15.79:0/1509642476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e980f5520 0x7f9e980f64b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f9e94002130 tx=0x7f9e8800bcc0).ready entity=mon.1 client_cookie=ebd01758a61ccd1a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:24.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9e9d2b0700 1 -- 172.21.15.79:0/1509642476 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9e980e56d0 con 0x7f9e980f5520 2021-04-09T18:33:24.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9e9d2b0700 1 -- 172.21.15.79:0/1509642476 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e880096c0 con 0x7f9e980f5520 2021-04-09T18:33:24.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9e9d2b0700 1 -- 172.21.15.79:0/1509642476 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9e94001f30 con 0x7f9e980f5520 2021-04-09T18:33:24.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9ea050e700 1 -- 172.21.15.79:0/1509642476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e980f5520 msgr2=0x7f9e980f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9ea050e700 1 --2- 172.21.15.79:0/1509642476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e980f5520 0x7f9e980f64b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f9e94002130 tx=0x7f9e8800bcc0).stop 2021-04-09T18:33:24.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9ea050e700 1 -- 172.21.15.79:0/1509642476 shutdown_connections 2021-04-09T18:33:24.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9ea050e700 1 --2- 172.21.15.79:0/1509642476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e980f5520 0x7f9e980f64b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9ea050e700 1 -- 172.21.15.79:0/1509642476 >> 172.21.15.79:0/1509642476 conn(0x7f9e980e5fe0 msgr2=0x7f9e980e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:24.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9ea050e700 1 -- 172.21.15.79:0/1509642476 shutdown_connections 2021-04-09T18:33:24.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9ea050e700 1 -- 172.21.15.79:0/1509642476 wait complete. 2021-04-09T18:33:24.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.429 7f9ea050e700 1 Processor -- start 2021-04-09T18:33:24.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9ea050e700 1 -- start start 2021-04-09T18:33:24.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9ea050e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e980b03b0 0x7f9e980afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:24.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9ea050e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e981b18f0 0x7f9e981b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:24.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9ea050e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e981b2370 0x7f9e981ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:24.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9ea050e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e981c3dc0 con 0x7f9e981b2370 2021-04-09T18:33:24.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9ea050e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9819d870 con 0x7f9e980b03b0 2021-04-09T18:33:24.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9ea050e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9819d100 con 0x7f9e981b18f0 2021-04-09T18:33:24.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9e9eab3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e981b2370 0x7f9e981ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:24.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9e9eab3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e981b2370 0x7f9e981ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60406/0 (socket says 172.21.15.79:60406) 2021-04-09T18:33:24.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9e9eab3700 1 -- 172.21.15.79:0/2503169587 learned_addr learned my addr 172.21.15.79:0/2503169587 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:24.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9e9e2b2700 1 --2- 172.21.15.79:0/2503169587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e980b03b0 0x7f9e980afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:24.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9e9dab1700 1 --2- 172.21.15.79:0/2503169587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e981b18f0 0x7f9e981b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:24.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9e9eab3700 1 -- 172.21.15.79:0/2503169587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e981b18f0 msgr2=0x7f9e981b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9e9eab3700 1 --2- 172.21.15.79:0/2503169587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e981b18f0 0x7f9e981b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9e9eab3700 1 -- 172.21.15.79:0/2503169587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e980b03b0 msgr2=0x7f9e980afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9e9eab3700 1 --2- 172.21.15.79:0/2503169587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e980b03b0 0x7f9e980afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9e9eab3700 1 -- 172.21.15.79:0/2503169587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e981b27c0 con 0x7f9e981b2370 2021-04-09T18:33:24.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9e9e2b2700 1 --2- 172.21.15.79:0/2503169587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e980b03b0 0x7f9e980afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:24.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9e9eab3700 1 --2- 172.21.15.79:0/2503169587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e981b2370 0x7f9e981ad770 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f9e98096ae0 tx=0x7f9e9000ca60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:24.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9e8effd700 1 -- 172.21.15.79:0/2503169587 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9e981b27c0 con 0x7f9e981b2370 2021-04-09T18:33:24.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9ea050e700 1 -- 172.21.15.79:0/2503169587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e980b0030 con 0x7f9e981b2370 2021-04-09T18:33:24.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9e8effd700 1 -- 172.21.15.79:0/2503169587 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e90007240 con 0x7f9e981b2370 2021-04-09T18:33:24.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9e8effd700 1 -- 172.21.15.79:0/2503169587 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9e900066e0 con 0x7f9e981b2370 2021-04-09T18:33:24.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9ea050e700 1 -- 172.21.15.79:0/2503169587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9819d420 con 0x7f9e981b2370 2021-04-09T18:33:24.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9e8effd700 1 -- 172.21.15.79:0/2503169587 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9e900068e0 con 0x7f9e981b2370 2021-04-09T18:33:24.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9e8effd700 1 --2- 172.21.15.79:0/2503169587 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9e80029100 0x7f9e8002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:24.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.433 7f9e8effd700 1 -- 172.21.15.79:0/2503169587 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f9e90038f10 con 0x7f9e981b2370 2021-04-09T18:33:24.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.437 7f9e9e2b2700 1 --2- 172.21.15.79:0/2503169587 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9e80029100 0x7f9e8002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:24.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.437 7f9e9e2b2700 1 --2- 172.21.15.79:0/2503169587 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9e80029100 0x7f9e8002b650 crc :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:24.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.441 7f9ea050e700 1 -- 172.21.15.79:0/2503169587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e980e39e0 con 0x7f9e981b2370 2021-04-09T18:33:24.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.453 7f9e8effd700 1 -- 172.21.15.79:0/2503169587 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9e90000bf0 con 0x7f9e981b2370 2021-04-09T18:33:24.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.617 7f9ea050e700 1 -- 172.21.15.79:0/2503169587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e980a1cc0 con 0x7f9e981b2370 2021-04-09T18:33:24.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.617 7f9e8effd700 1 -- 172.21.15.79:0/2503169587 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+14242 (secure 0 0 0) 0x7f9e90007030 con 0x7f9e981b2370 2021-04-09T18:33:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:24.628 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":78,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:33:24.317149","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:33:22.552244","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2021-04-09 18:33:23.559196","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:33:24.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.625 7f9ea050e700 1 -- 172.21.15.79:0/2503169587 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9e80029100 msgr2=0x7f9e8002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.625 7f9ea050e700 1 --2- 172.21.15.79:0/2503169587 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9e80029100 0x7f9e8002b650 crc :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.625 7f9ea050e700 1 -- 172.21.15.79:0/2503169587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e981b2370 msgr2=0x7f9e981ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.625 7f9ea050e700 1 --2- 172.21.15.79:0/2503169587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e981b2370 0x7f9e981ad770 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f9e98096ae0 tx=0x7f9e9000ca60).stop 2021-04-09T18:33:24.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.625 7f9ea050e700 1 -- 172.21.15.79:0/2503169587 shutdown_connections 2021-04-09T18:33:24.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.625 7f9ea050e700 1 --2- 172.21.15.79:0/2503169587 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9e80029100 0x7f9e8002b650 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.625 7f9ea050e700 1 --2- 172.21.15.79:0/2503169587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e980b03b0 0x7f9e980afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.625 7f9ea050e700 1 --2- 172.21.15.79:0/2503169587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e981b2370 0x7f9e981ad770 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.625 7f9ea050e700 1 --2- 172.21.15.79:0/2503169587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e981b18f0 0x7f9e981b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.625 7f9ea050e700 1 -- 172.21.15.79:0/2503169587 >> 172.21.15.79:0/2503169587 conn(0x7f9e980ba9f0 msgr2=0x7f9e980d86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:24.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.625 7f9ea050e700 1 -- 172.21.15.79:0/2503169587 shutdown_connections 2021-04-09T18:33:24.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.625 7f9ea050e700 1 -- 172.21.15.79:0/2503169587 wait complete. 2021-04-09T18:33:24.640 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:33:24.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecd4ea8700 1 Processor -- start 2021-04-09T18:33:24.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecd4ea8700 1 -- start start 2021-04-09T18:33:24.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecd4ea8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fecd00f5520 0x7fecd00f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:24.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecd4ea8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fecd00e9ae0 0x7fecd009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:24.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecd4ea8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd00fbb20 con 0x7fecd01c2db0 2021-04-09T18:33:24.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecd4ea8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd00e9f30 con 0x7fecd00f5520 2021-04-09T18:33:24.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecd4ea8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd00e59d0 con 0x7fecd00e9ae0 2021-04-09T18:33:24.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecceaef700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fecd00f5520 0x7fecd00f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:24.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7feccf2f0700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fecd01c2db0 0x7fecd01c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55124/0 (socket says 172.21.15.79:55124) 2021-04-09T18:33:24.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7feccf2f0700 1 -- 172.21.15.79:0/16616108 learned_addr learned my addr 172.21.15.79:0/16616108 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:24.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecce2ee700 1 --2- 172.21.15.79:0/16616108 >> v2:172.21.15.89:3300/0 conn(0x7fecd00e9ae0 0x7fecd009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:24.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecceaef700 1 -- 172.21.15.79:0/16616108 >> v2:172.21.15.89:3300/0 conn(0x7fecd00e9ae0 msgr2=0x7fecd009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:24.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecceaef700 1 --2- 172.21.15.79:0/16616108 >> v2:172.21.15.89:3300/0 conn(0x7fecd00e9ae0 0x7fecd009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecceaef700 1 -- 172.21.15.79:0/16616108 >> v1:172.21.15.79:6789/0 conn(0x7fecd01c2db0 legacy=0x7fecd01c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7feccdaed700 1 -- 172.21.15.79:0/16616108 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879895463 0 0) 0x7fecc80010d0 con 0x7fecd01c2db0 2021-04-09T18:33:24.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecceaef700 1 -- 172.21.15.79:0/16616108 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd00e56d0 con 0x7fecd00f5520 2021-04-09T18:33:24.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecceaef700 1 --2- 172.21.15.79:0/16616108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecd00f5520 0x7fecd00f64b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7fecc00032b0 tx=0x7fecc000b3c0).ready entity=mon.0 client_cookie=931ad9f943519b0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:24.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7feccdaed700 1 -- 172.21.15.79:0/16616108 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fecd00e56d0 con 0x7fecd00f5520 2021-04-09T18:33:24.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7feccdaed700 1 -- 172.21.15.79:0/16616108 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc000bc20 con 0x7fecd00f5520 2021-04-09T18:33:24.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7feccdaed700 1 -- 172.21.15.79:0/16616108 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fecc0002020 con 0x7fecd00f5520 2021-04-09T18:33:24.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecd4ea8700 1 -- 172.21.15.79:0/16616108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecd00f5520 msgr2=0x7fecd00f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecd4ea8700 1 --2- 172.21.15.79:0/16616108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecd00f5520 0x7fecd00f64b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7fecc00032b0 tx=0x7fecc000b3c0).stop 2021-04-09T18:33:24.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecd4ea8700 1 -- 172.21.15.79:0/16616108 shutdown_connections 2021-04-09T18:33:24.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecd4ea8700 1 --2- 172.21.15.79:0/16616108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecd00f5520 0x7fecd00f64b0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecd4ea8700 1 --2- 172.21.15.79:0/16616108 >> v2:172.21.15.89:3300/0 conn(0x7fecd00e9ae0 0x7fecd009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecd4ea8700 1 -- 172.21.15.79:0/16616108 >> 172.21.15.79:0/16616108 conn(0x7fecd00e5fe0 msgr2=0x7fecd00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:24.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecd4ea8700 1 -- 172.21.15.79:0/16616108 shutdown_connections 2021-04-09T18:33:24.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.733 7fecd4ea8700 1 -- 172.21.15.79:0/16616108 wait complete. 2021-04-09T18:33:24.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7fecd4ea8700 1 Processor -- start 2021-04-09T18:33:24.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7fecd4ea8700 1 -- start start 2021-04-09T18:33:24.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7fecd4ea8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecd01a2980 0x7fecd01c01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:24.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7fecd4ea8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecd01a11a0 0x7fecd01a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:24.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7fecd4ea8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecd00b49c0 0x7fecd00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:24.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7fecd4ea8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd0097190 con 0x7fecd00b49c0 2021-04-09T18:33:24.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7fecd4ea8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd01c07e0 con 0x7fecd01a11a0 2021-04-09T18:33:24.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7fecd4ea8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd00bac40 con 0x7fecd01a2980 2021-04-09T18:33:24.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7feccf2f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecd00b49c0 0x7fecd00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:24.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7feccf2f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecd00b49c0 0x7fecd00b4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60420/0 (socket says 172.21.15.79:60420) 2021-04-09T18:33:24.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7feccf2f0700 1 -- 172.21.15.79:0/129907641 learned_addr learned my addr 172.21.15.79:0/129907641 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7fecceaef700 1 --2- 172.21.15.79:0/129907641 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecd01a2980 0x7fecd01c01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7fecce2ee700 1 --2- 172.21.15.79:0/129907641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecd01a11a0 0x7fecd01a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7feccf2f0700 1 -- 172.21.15.79:0/129907641 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecd01a2980 msgr2=0x7fecd01c01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7feccf2f0700 1 --2- 172.21.15.79:0/129907641 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecd01a2980 0x7fecd01c01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7feccf2f0700 1 -- 172.21.15.79:0/129907641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecd01a11a0 msgr2=0x7fecd01a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7feccf2f0700 1 --2- 172.21.15.79:0/129907641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecd01a11a0 0x7fecd01a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7feccf2f0700 1 -- 172.21.15.79:0/129907641 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd0095a30 con 0x7fecd00b49c0 2021-04-09T18:33:24.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7feccf2f0700 1 --2- 172.21.15.79:0/129907641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecd00b49c0 0x7fecd00b4e10 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7fecc8000b80 tx=0x7fecc800cb00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:24.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7fecc77fe700 1 -- 172.21.15.79:0/129907641 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fecd0095a30 con 0x7fecd00b49c0 2021-04-09T18:33:24.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7fecc77fe700 1 -- 172.21.15.79:0/129907641 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc8007320 con 0x7fecd00b49c0 2021-04-09T18:33:24.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7fecd4ea8700 1 -- 172.21.15.79:0/129907641 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd0095d50 con 0x7fecd00b49c0 2021-04-09T18:33:24.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7fecc77fe700 1 -- 172.21.15.79:0/129907641 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fecc80057e0 con 0x7fecd00b49c0 2021-04-09T18:33:24.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.737 7fecd4ea8700 1 -- 172.21.15.79:0/129907641 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd00962b0 con 0x7fecd00b49c0 2021-04-09T18:33:24.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.745 7fecc77fe700 1 -- 172.21.15.79:0/129907641 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fecc801a020 con 0x7fecd00b49c0 2021-04-09T18:33:24.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.745 7fecc77fe700 1 --2- 172.21.15.79:0/129907641 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fecb4029100 0x7fecb402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:24.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.745 7fecc77fe700 1 -- 172.21.15.79:0/129907641 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fecc8039170 con 0x7fecd00b49c0 2021-04-09T18:33:24.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.745 7fecceaef700 1 --2- 172.21.15.79:0/129907641 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fecb4029100 0x7fecb402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:24.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.745 7fecceaef700 1 --2- 172.21.15.79:0/129907641 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fecb4029100 0x7fecb402b650 crc :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:24.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.749 7fecd4ea8700 1 -- 172.21.15.79:0/129907641 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd00e39e0 con 0x7fecd00b49c0 2021-04-09T18:33:24.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.757 7fecc77fe700 1 -- 172.21.15.79:0/129907641 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fecc8007110 con 0x7fecd00b49c0 2021-04-09T18:33:24.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.925 7fecd4ea8700 1 -- 172.21.15.79:0/129907641 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecd01b27d0 con 0x7fecd00b49c0 2021-04-09T18:33:24.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.929 7fecc77fe700 1 -- 172.21.15.79:0/129907641 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+14242 (secure 0 0 0) 0x7fecd00f76c0 con 0x7fecd00b49c0 2021-04-09T18:33:24.933 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:24.934 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":78,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:33:24.317149","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:33:22.552244","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2021-04-09 18:33:23.559196","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:33:24.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.933 7fecd4ea8700 1 -- 172.21.15.79:0/129907641 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fecb4029100 msgr2=0x7fecb402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.933 7fecd4ea8700 1 --2- 172.21.15.79:0/129907641 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fecb4029100 0x7fecb402b650 crc :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.933 7fecd4ea8700 1 -- 172.21.15.79:0/129907641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecd00b49c0 msgr2=0x7fecd00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:24.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.933 7fecd4ea8700 1 --2- 172.21.15.79:0/129907641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecd00b49c0 0x7fecd00b4e10 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7fecc8000b80 tx=0x7fecc800cb00).stop 2021-04-09T18:33:24.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.933 7fecd4ea8700 1 -- 172.21.15.79:0/129907641 shutdown_connections 2021-04-09T18:33:24.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.933 7fecd4ea8700 1 --2- 172.21.15.79:0/129907641 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fecb4029100 0x7fecb402b650 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.933 7fecd4ea8700 1 --2- 172.21.15.79:0/129907641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecd00b49c0 0x7fecd00b4e10 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.933 7fecd4ea8700 1 --2- 172.21.15.79:0/129907641 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecd01a2980 0x7fecd01c01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.933 7fecd4ea8700 1 --2- 172.21.15.79:0/129907641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecd01a11a0 0x7fecd01a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:24.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.933 7fecd4ea8700 1 -- 172.21.15.79:0/129907641 >> 172.21.15.79:0/129907641 conn(0x7fecd00ac730 msgr2=0x7fecd00d83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:24.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.933 7fecd4ea8700 1 -- 172.21.15.79:0/129907641 shutdown_connections 2021-04-09T18:33:24.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:24.933 7fecd4ea8700 1 -- 172.21.15.79:0/129907641 wait complete. 2021-04-09T18:33:24.947 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-04-09T18:33:25.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.037 7ff3c5181700 1 Processor -- start 2021-04-09T18:33:25.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.037 7ff3c5181700 1 -- start start 2021-04-09T18:33:25.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3c5181700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff3c00f5550 0x7ff3c00f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:25.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3c5181700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3c01c8040 0x7ff3c01ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:25.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3c5181700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c00fbb50 con 0x7ff3c00e9b10 2021-04-09T18:33:25.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3c5181700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c00e9f60 con 0x7ff3c00f5550 2021-04-09T18:33:25.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3c5181700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c01c3df0 con 0x7ff3c01c8040 2021-04-09T18:33:25.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3bed9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff3c00f5550 0x7ff3c00f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:25.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3be59c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff3c00e9b10 0x7ff3c009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55136/0 (socket says 172.21.15.79:55136) 2021-04-09T18:33:25.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3be59c700 1 -- 172.21.15.79:0/4194593140 learned_addr learned my addr 172.21.15.79:0/4194593140 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:25.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3bf59e700 1 --2- 172.21.15.79:0/4194593140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3c01c8040 0x7ff3c01ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:25.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3bed9d700 1 -- 172.21.15.79:0/4194593140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3c01c8040 msgr2=0x7ff3c01ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:25.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3bed9d700 1 --2- 172.21.15.79:0/4194593140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3c01c8040 0x7ff3c01ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3bed9d700 1 -- 172.21.15.79:0/4194593140 >> v1:172.21.15.79:6789/0 conn(0x7ff3c00e9b10 legacy=0x7ff3c009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:25.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3bdd9b700 1 -- 172.21.15.79:0/4194593140 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218190233 0 0) 0x7ff3a8001450 con 0x7ff3c00e9b10 2021-04-09T18:33:25.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3bed9d700 1 -- 172.21.15.79:0/4194593140 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c009f910 con 0x7ff3c00f5550 2021-04-09T18:33:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3bed9d700 1 --2- 172.21.15.79:0/4194593140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c00f5550 0x7ff3c00f64e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7ff3c00f6f30 tx=0x7ff3b000bd70).ready entity=mon.0 client_cookie=2b217cd19a8df899 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3bdd9b700 1 -- 172.21.15.79:0/4194593140 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff3c009f910 con 0x7ff3c00f5550 2021-04-09T18:33:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3bdd9b700 1 -- 172.21.15.79:0/4194593140 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b0009810 con 0x7ff3c00f5550 2021-04-09T18:33:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3bdd9b700 1 -- 172.21.15.79:0/4194593140 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff3b0009be0 con 0x7ff3c00f5550 2021-04-09T18:33:25.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3c5181700 1 -- 172.21.15.79:0/4194593140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c00f5550 msgr2=0x7ff3c00f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:25.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3c5181700 1 --2- 172.21.15.79:0/4194593140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c00f5550 0x7ff3c00f64e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7ff3c00f6f30 tx=0x7ff3b000bd70).stop 2021-04-09T18:33:25.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3c5181700 1 -- 172.21.15.79:0/4194593140 shutdown_connections 2021-04-09T18:33:25.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3c5181700 1 --2- 172.21.15.79:0/4194593140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c00f5550 0x7ff3c00f64e0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3c5181700 1 --2- 172.21.15.79:0/4194593140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3c01c8040 0x7ff3c01ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3c5181700 1 -- 172.21.15.79:0/4194593140 >> 172.21.15.79:0/4194593140 conn(0x7ff3c00e6010 msgr2=0x7ff3c00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:25.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3c5181700 1 -- 172.21.15.79:0/4194593140 shutdown_connections 2021-04-09T18:33:25.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.041 7ff3c5181700 1 -- 172.21.15.79:0/4194593140 wait complete. 2021-04-09T18:33:25.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3c5181700 1 Processor -- start 2021-04-09T18:33:25.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3c5181700 1 -- start start 2021-04-09T18:33:25.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3c5181700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3c0092c00 0x7ff3c0091680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:25.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3c5181700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3c00d2090 0x7ff3c00d24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:25.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3c5181700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c00d2b10 0x7ff3c01aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:25.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3c5181700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c00e1ac0 con 0x7ff3c00d2b10 2021-04-09T18:33:25.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3c5181700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c0091380 con 0x7ff3c0092c00 2021-04-09T18:33:25.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3c5181700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c00906f0 con 0x7ff3c00d2090 2021-04-09T18:33:25.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3bf59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c00d2b10 0x7ff3c01aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:25.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3bf59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c00d2b10 0x7ff3c01aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60430/0 (socket says 172.21.15.79:60430) 2021-04-09T18:33:25.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3bf59e700 1 -- 172.21.15.79:0/4256169868 learned_addr learned my addr 172.21.15.79:0/4256169868 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:25.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3be59c700 1 --2- 172.21.15.79:0/4256169868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3c00d2090 0x7ff3c00d24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:25.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3bed9d700 1 --2- 172.21.15.79:0/4256169868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3c0092c00 0x7ff3c0091680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:25.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3bf59e700 1 -- 172.21.15.79:0/4256169868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3c00d2090 msgr2=0x7ff3c00d24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:25.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3bf59e700 1 --2- 172.21.15.79:0/4256169868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3c00d2090 0x7ff3c00d24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3bf59e700 1 -- 172.21.15.79:0/4256169868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3c0092c00 msgr2=0x7ff3c0091680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:25.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3bf59e700 1 --2- 172.21.15.79:0/4256169868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3c0092c00 0x7ff3c0091680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3bf59e700 1 -- 172.21.15.79:0/4256169868 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c01a88a0 con 0x7ff3c00d2b10 2021-04-09T18:33:25.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3bed9d700 1 --2- 172.21.15.79:0/4256169868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3c0092c00 0x7ff3c0091680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:33:25.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3bf59e700 1 --2- 172.21.15.79:0/4256169868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c00d2b10 0x7ff3c01aacf0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7ff3c0091300 tx=0x7ff3b800bf00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:25.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3b77fe700 1 -- 172.21.15.79:0/4256169868 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff3c01a88a0 con 0x7ff3c00d2b10 2021-04-09T18:33:25.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3b77fe700 1 -- 172.21.15.79:0/4256169868 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b800cb20 con 0x7ff3c00d2b10 2021-04-09T18:33:25.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3b77fe700 1 -- 172.21.15.79:0/4256169868 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff3b800f040 con 0x7ff3c00d2b10 2021-04-09T18:33:25.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3c5181700 1 -- 172.21.15.79:0/4256169868 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c01ab320 con 0x7ff3c00d2b10 2021-04-09T18:33:25.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.045 7ff3c5181700 1 -- 172.21.15.79:0/4256169868 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c01ab830 con 0x7ff3c00d2b10 2021-04-09T18:33:25.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.049 7ff3b77fe700 1 -- 172.21.15.79:0/4256169868 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff3b8011070 con 0x7ff3c00d2b10 2021-04-09T18:33:25.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.049 7ff3b77fe700 1 --2- 172.21.15.79:0/4256169868 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff3a4029100 0x7ff3a402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:25.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.049 7ff3b77fe700 1 -- 172.21.15.79:0/4256169868 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5924+0+0 (secure 0 0 0) 0x7ff3b8010040 con 0x7ff3c00d2b10 2021-04-09T18:33:25.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.049 7ff3bed9d700 1 --2- 172.21.15.79:0/4256169868 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff3a4029100 0x7ff3a402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:25.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.049 7ff3bed9d700 1 --2- 172.21.15.79:0/4256169868 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff3a4029100 0x7ff3a402b650 crc :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:25.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.053 7ff3c5181700 1 -- 172.21.15.79:0/4256169868 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c0091cb0 con 0x7ff3c00d2b10 2021-04-09T18:33:25.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.061 7ff3b77fe700 1 -- 172.21.15.79:0/4256169868 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff3c00f76f0 con 0x7ff3c00d2b10 2021-04-09T18:33:25.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.233 7ff3c5181700 1 -- 172.21.15.79:0/4256169868 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7ff3c00e39f0 con 0x7ff3c00d2b10 2021-04-09T18:33:25.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.325 7ff3b77fe700 1 -- 172.21.15.79:0/4256169868 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v47) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff3b800c720 con 0x7ff3c00d2b10 2021-04-09T18:33:25.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.349 7ff3c5181700 1 -- 172.21.15.79:0/4256169868 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff3a4029100 msgr2=0x7ff3a402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:25.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.349 7ff3c5181700 1 --2- 172.21.15.79:0/4256169868 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff3a4029100 0x7ff3a402b650 crc :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.349 7ff3c5181700 1 -- 172.21.15.79:0/4256169868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c00d2b10 msgr2=0x7ff3c01aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:25.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.349 7ff3c5181700 1 --2- 172.21.15.79:0/4256169868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c00d2b10 0x7ff3c01aacf0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7ff3c0091300 tx=0x7ff3b800bf00).stop 2021-04-09T18:33:25.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.353 7ff3c5181700 1 -- 172.21.15.79:0/4256169868 shutdown_connections 2021-04-09T18:33:25.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.353 7ff3c5181700 1 --2- 172.21.15.79:0/4256169868 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff3a4029100 0x7ff3a402b650 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.353 7ff3c5181700 1 --2- 172.21.15.79:0/4256169868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3c0092c00 0x7ff3c0091680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.353 7ff3c5181700 1 --2- 172.21.15.79:0/4256169868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c00d2b10 0x7ff3c01aacf0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.353 7ff3c5181700 1 --2- 172.21.15.79:0/4256169868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3c00d2090 0x7ff3c00d24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.353 7ff3c5181700 1 -- 172.21.15.79:0/4256169868 >> 172.21.15.79:0/4256169868 conn(0x7ff3c0095410 msgr2=0x7ff3c0094970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:25.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.353 7ff3c5181700 1 -- 172.21.15.79:0/4256169868 shutdown_connections 2021-04-09T18:33:25.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.353 7ff3c5181700 1 -- 172.21.15.79:0/4256169868 wait complete. 2021-04-09T18:33:25.373 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:25.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.469 7f52c2d43700 1 Processor -- start 2021-04-09T18:33:25.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.473 7f52c2d43700 1 -- start start 2021-04-09T18:33:25.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.473 7f52c2d43700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52bc0e9ae0 0x7f52bc09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:25.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.473 7f52c2d43700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52bc0fbb20 con 0x7f52bc1c8010 2021-04-09T18:33:25.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.473 7f52c2d43700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52bc0e56d0 con 0x7f52bc0f5520 2021-04-09T18:33:25.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.473 7f52c2d43700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc1c3dc0 con 0x7f52bc0e9ae0 2021-04-09T18:33:25.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.473 7f52c12e8700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f52bc1c8010 0x7f52bc1ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55152/0 (socket says 172.21.15.79:55152) 2021-04-09T18:33:25.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.473 7f52c12e8700 1 -- 172.21.15.79:0/4209074821 learned_addr learned my addr 172.21.15.79:0/4209074821 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:25.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.473 7f52bbfff700 1 --2- 172.21.15.79:0/4209074821 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52bc0e9ae0 0x7f52bc09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:25.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.473 7f52bb7fe700 1 -- 172.21.15.79:0/4209074821 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288823994 0 0) 0x7f52b4001450 con 0x7f52bc1c8010 2021-04-09T18:33:25.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.473 7f52bb7fe700 1 -- 172.21.15.79:0/4209074821 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52a8003240 con 0x7f52bc1c8010 2021-04-09T18:33:25.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.473 7f52bb7fe700 1 -- 172.21.15.79:0/4209074821 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 97691129 0 0) 0x7f52a40010d0 con 0x7f52bc0f5520 2021-04-09T18:33:25.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.473 7f52bbfff700 1 -- 172.21.15.79:0/4209074821 >> v1:172.21.15.89:6789/0 conn(0x7f52bc0f5520 legacy=0x7f52bc0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:25.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.473 7f52bbfff700 1 -- 172.21.15.79:0/4209074821 >> v1:172.21.15.79:6789/0 conn(0x7f52bc1c8010 legacy=0x7f52bc1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:25.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.473 7f52bbfff700 1 -- 172.21.15.79:0/4209074821 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc0e4330 con 0x7f52bc0e9ae0 2021-04-09T18:33:25.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.473 7f52bbfff700 1 --2- 172.21.15.79:0/4209074821 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52bc0e9ae0 0x7f52bc09f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f52ac002f30 tx=0x7f52ac00bcf0).ready entity=mon.2 client_cookie=11d6817eec45bfa9 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:25.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.473 7f52bb7fe700 1 -- 172.21.15.79:0/4209074821 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f52bc0e4330 con 0x7f52bc0e9ae0 2021-04-09T18:33:25.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.473 7f52bb7fe700 1 -- 172.21.15.79:0/4209074821 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ac009920 con 0x7f52bc0e9ae0 2021-04-09T18:33:25.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.473 7f52bb7fe700 1 -- 172.21.15.79:0/4209074821 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f52ac009cf0 con 0x7f52bc0e9ae0 2021-04-09T18:33:25.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.473 7f52c2d43700 1 -- 172.21.15.79:0/4209074821 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52bc0e9ae0 msgr2=0x7f52bc09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:25.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.473 7f52c2d43700 1 --2- 172.21.15.79:0/4209074821 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52bc0e9ae0 0x7f52bc09f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f52ac002f30 tx=0x7f52ac00bcf0).stop 2021-04-09T18:33:25.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.477 7f52c2d43700 1 -- 172.21.15.79:0/4209074821 shutdown_connections 2021-04-09T18:33:25.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.477 7f52c2d43700 1 --2- 172.21.15.79:0/4209074821 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52bc0e9ae0 0x7f52bc09f110 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.477 7f52c2d43700 1 -- 172.21.15.79:0/4209074821 >> 172.21.15.79:0/4209074821 conn(0x7f52bc0e5fe0 msgr2=0x7f52bc0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:25.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.477 7f52c2d43700 1 -- 172.21.15.79:0/4209074821 shutdown_connections 2021-04-09T18:33:25.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.477 7f52c2d43700 1 -- 172.21.15.79:0/4209074821 wait complete. 2021-04-09T18:33:25.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.477 7f52c2d43700 1 Processor -- start 2021-04-09T18:33:25.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.477 7f52c2d43700 1 -- start start 2021-04-09T18:33:25.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.477 7f52c2d43700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52bc091200 0x7f52bc0cea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:25.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.477 7f52c2d43700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52bc0cf040 0x7f52bc0d4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:25.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.477 7f52c2d43700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52bc0d55d0 0x7f52bc099aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:25.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.477 7f52c2d43700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0e9f30 con 0x7f52bc0d55d0 2021-04-09T18:33:25.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.477 7f52c2d43700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc090f00 con 0x7f52bc0cf040 2021-04-09T18:33:25.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.477 7f52c2d43700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0cf490 con 0x7f52bc091200 2021-04-09T18:33:25.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.477 7f52c12e8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52bc0d55d0 0x7f52bc099aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:25.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.477 7f52c12e8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52bc0d55d0 0x7f52bc099aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60446/0 (socket says 172.21.15.79:60446) 2021-04-09T18:33:25.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.477 7f52c12e8700 1 -- 172.21.15.79:0/520304195 learned_addr learned my addr 172.21.15.79:0/520304195 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:25.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.477 7f52bbfff700 1 --2- 172.21.15.79:0/520304195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52bc0cf040 0x7f52bc0d4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:25.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.477 7f52c0ae7700 1 --2- 172.21.15.79:0/520304195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52bc091200 0x7f52bc0cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:25.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.481 7f52c0ae7700 1 -- 172.21.15.79:0/520304195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52bc0cf040 msgr2=0x7f52bc0d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:25.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.481 7f52c0ae7700 1 --2- 172.21.15.79:0/520304195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52bc0cf040 0x7f52bc0d4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.481 7f52c0ae7700 1 -- 172.21.15.79:0/520304195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52bc0d55d0 msgr2=0x7f52bc099aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:25.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.481 7f52c0ae7700 1 --2- 172.21.15.79:0/520304195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52bc0d55d0 0x7f52bc099aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.481 7f52c0ae7700 1 -- 172.21.15.79:0/520304195 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc091650 con 0x7f52bc091200 2021-04-09T18:33:25.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.481 7f52c0ae7700 1 --2- 172.21.15.79:0/520304195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52bc091200 0x7f52bc0cea10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f52bc090e80 tx=0x7f52a400cab0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:25.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.481 7f52b97fa700 1 -- 172.21.15.79:0/520304195 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f52bc091650 con 0x7f52bc091200 2021-04-09T18:33:25.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.481 7f52b97fa700 1 -- 172.21.15.79:0/520304195 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a4010510 con 0x7f52bc091200 2021-04-09T18:33:25.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.481 7f52c2d43700 1 -- 172.21.15.79:0/520304195 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52bc0903d0 con 0x7f52bc091200 2021-04-09T18:33:25.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.481 7f52b97fa700 1 -- 172.21.15.79:0/520304195 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f52a40106f0 con 0x7f52bc091200 2021-04-09T18:33:25.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.481 7f52c2d43700 1 -- 172.21.15.79:0/520304195 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52bc0993d0 con 0x7f52bc091200 2021-04-09T18:33:25.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.485 7f52b97fa700 1 -- 172.21.15.79:0/520304195 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f52a4019020 con 0x7f52bc091200 2021-04-09T18:33:25.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.485 7f52b97fa700 1 --2- 172.21.15.79:0/520304195 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f52a0029100 0x7f52a002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:25.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.485 7f52b97fa700 1 -- 172.21.15.79:0/520304195 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f52a4038dd0 con 0x7f52bc091200 2021-04-09T18:33:25.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.485 7f52bbfff700 1 --2- 172.21.15.79:0/520304195 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f52a0029100 0x7f52a002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:25.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.485 7f52bbfff700 1 --2- 172.21.15.79:0/520304195 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f52a0029100 0x7f52a002b650 crc :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:25.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.485 7f52c2d43700 1 -- 172.21.15.79:0/520304195 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52bc0e39e0 con 0x7f52bc091200 2021-04-09T18:33:25.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.493 7f52b97fa700 1 -- 172.21.15.79:0/520304195 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f52a4000bf0 con 0x7f52bc091200 2021-04-09T18:33:25.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.657 7f52c2d43700 1 -- 172.21.15.79:0/520304195 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52bc0a1cc0 con 0x7f52bc091200 2021-04-09T18:33:25.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.657 7f52b97fa700 1 -- 172.21.15.79:0/520304195 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2103 (secure 0 0 0) 0x7f52a4010300 con 0x7f52bc091200 2021-04-09T18:33:25.664 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 47 2021-04-09T18:33:25.664 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:25.665 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":47,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6510,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/4230183300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4230183300},{"type":"v1","addr":"172.21.15.79:6833","nonce":4230183300}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:33:24.317443","modified":"2021-04-09 18:33:25.319829","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5837},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5837":{"gid":5837,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/1825266006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1825266006},{"type":"v1","addr":"172.21.15.89:6835","nonce":1825266006}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-04-09T18:33:25.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.661 7f52c2d43700 1 -- 172.21.15.79:0/520304195 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f52a0029100 msgr2=0x7f52a002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:25.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.661 7f52c2d43700 1 --2- 172.21.15.79:0/520304195 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f52a0029100 0x7f52a002b650 crc :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.661 7f52c2d43700 1 -- 172.21.15.79:0/520304195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52bc091200 msgr2=0x7f52bc0cea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:25.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.661 7f52c2d43700 1 --2- 172.21.15.79:0/520304195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52bc091200 0x7f52bc0cea10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f52bc090e80 tx=0x7f52a400cab0).stop 2021-04-09T18:33:25.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.661 7f52c2d43700 1 -- 172.21.15.79:0/520304195 shutdown_connections 2021-04-09T18:33:25.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.661 7f52c2d43700 1 --2- 172.21.15.79:0/520304195 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f52a0029100 0x7f52a002b650 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.661 7f52c2d43700 1 --2- 172.21.15.79:0/520304195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52bc0d55d0 0x7f52bc099aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.661 7f52c2d43700 1 --2- 172.21.15.79:0/520304195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52bc091200 0x7f52bc0cea10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.661 7f52c2d43700 1 --2- 172.21.15.79:0/520304195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52bc0cf040 0x7f52bc0d4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.661 7f52c2d43700 1 -- 172.21.15.79:0/520304195 >> 172.21.15.79:0/520304195 conn(0x7f52bc0d31b0 msgr2=0x7f52bc0d8850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:25.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.661 7f52c2d43700 1 -- 172.21.15.79:0/520304195 shutdown_connections 2021-04-09T18:33:25.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.661 7f52c2d43700 1 -- 172.21.15.79:0/520304195 wait complete. 2021-04-09T18:33:25.681 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:33:25.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.769 7f27179ab700 1 Processor -- start 2021-04-09T18:33:25.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.769 7f27179ab700 1 -- start start 2021-04-09T18:33:25.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.769 7f27179ab700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27100e9ae0 0x7f271009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:25.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.769 7f27179ab700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27101c8010 0x7f27101ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:25.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f27179ab700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27100fbb20 con 0x7f27100f5520 2021-04-09T18:33:25.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f27179ab700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27101c3dc0 con 0x7f27100e9ae0 2021-04-09T18:33:25.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f27179ab700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27100e9f30 con 0x7f27101c8010 2021-04-09T18:33:25.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f2714f4e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27100e9ae0 0x7f271009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:25.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f2714f4e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27100e9ae0 0x7f271009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60454/0 (socket says 172.21.15.79:60454) 2021-04-09T18:33:25.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f2714f4e700 1 -- 172.21.15.79:0/1053011701 learned_addr learned my addr 172.21.15.79:0/1053011701 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:25.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f2715f50700 1 --2- 172.21.15.79:0/1053011701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27101c8010 0x7f27101ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:25.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f2714f4e700 1 -- 172.21.15.79:0/1053011701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27101c8010 msgr2=0x7f27101ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:25.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f2714f4e700 1 --2- 172.21.15.79:0/1053011701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27101c8010 0x7f27101ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f2714f4e700 1 -- 172.21.15.79:0/1053011701 >> v1:172.21.15.89:6789/0 conn(0x7f27100f5520 legacy=0x7f27100f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:25.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f2714f4e700 1 -- 172.21.15.79:0/1053011701 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27100e56d0 con 0x7f27100e9ae0 2021-04-09T18:33:25.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f2714f4e700 1 --2- 172.21.15.79:0/1053011701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27100e9ae0 0x7f271009f110 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f27100f6f00 tx=0x7f270000bdd0).ready entity=mon.0 client_cookie=ee1435d42966d1a0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:25.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f2707fff700 1 -- 172.21.15.79:0/1053011701 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f27100e56d0 con 0x7f27100e9ae0 2021-04-09T18:33:25.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f2707fff700 1 -- 172.21.15.79:0/1053011701 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2700009990 con 0x7f27100e9ae0 2021-04-09T18:33:25.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f2707fff700 1 -- 172.21.15.79:0/1053011701 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2700009d60 con 0x7f27100e9ae0 2021-04-09T18:33:25.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f27179ab700 1 -- 172.21.15.79:0/1053011701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27100e9ae0 msgr2=0x7f271009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:25.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f27179ab700 1 --2- 172.21.15.79:0/1053011701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27100e9ae0 0x7f271009f110 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f27100f6f00 tx=0x7f270000bdd0).stop 2021-04-09T18:33:25.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f27179ab700 1 -- 172.21.15.79:0/1053011701 shutdown_connections 2021-04-09T18:33:25.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f27179ab700 1 --2- 172.21.15.79:0/1053011701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27101c8010 0x7f27101ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f27179ab700 1 --2- 172.21.15.79:0/1053011701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27100e9ae0 0x7f271009f110 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f27179ab700 1 -- 172.21.15.79:0/1053011701 >> 172.21.15.79:0/1053011701 conn(0x7f27100e5fe0 msgr2=0x7f27100e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:25.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f27179ab700 1 -- 172.21.15.79:0/1053011701 shutdown_connections 2021-04-09T18:33:25.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.773 7f27179ab700 1 -- 172.21.15.79:0/1053011701 wait complete. 2021-04-09T18:33:25.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.777 7f27179ab700 1 Processor -- start 2021-04-09T18:33:25.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.777 7f27179ab700 1 -- start start 2021-04-09T18:33:25.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.777 7f27179ab700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27101aac90 0x7f27100afab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:25.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.777 7f27179ab700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27100bee70 0x7f27100d5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:25.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.777 7f27179ab700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27100d5830 0x7f27101ae490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:25.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.777 7f27179ab700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27100bf650 con 0x7f27100bee70 2021-04-09T18:33:25.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.777 7f27179ab700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27100bf950 con 0x7f27100d5830 2021-04-09T18:33:25.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.777 7f27179ab700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27101abec0 con 0x7f27101aac90 2021-04-09T18:33:25.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.777 7f2714f4e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27100bee70 0x7f27100d5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:25.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.781 7f2714f4e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27100bee70 0x7f27100d5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60458/0 (socket says 172.21.15.79:60458) 2021-04-09T18:33:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.781 7f2714f4e700 1 -- 172.21.15.79:0/2213562756 learned_addr learned my addr 172.21.15.79:0/2213562756 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.781 7f271574f700 1 --2- 172.21.15.79:0/2213562756 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27101aac90 0x7f27100afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.781 7f2715f50700 1 --2- 172.21.15.79:0/2213562756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27100d5830 0x7f27101ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.781 7f2714f4e700 1 -- 172.21.15.79:0/2213562756 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27101aac90 msgr2=0x7f27100afab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.781 7f2714f4e700 1 --2- 172.21.15.79:0/2213562756 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27101aac90 0x7f27100afab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.781 7f2714f4e700 1 -- 172.21.15.79:0/2213562756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27100d5830 msgr2=0x7f27101ae490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.781 7f2714f4e700 1 --2- 172.21.15.79:0/2213562756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27100d5830 0x7f27101ae490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.781 7f2714f4e700 1 -- 172.21.15.79:0/2213562756 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27100b00e0 con 0x7f27100bee70 2021-04-09T18:33:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.781 7f2714f4e700 1 --2- 172.21.15.79:0/2213562756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27100bee70 0x7f27100d5200 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f271009ad00 tx=0x7f2700006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.781 7f2705ffb700 1 -- 172.21.15.79:0/2213562756 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f27100b00e0 con 0x7f27100bee70 2021-04-09T18:33:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.781 7f2705ffb700 1 -- 172.21.15.79:0/2213562756 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2700011d50 con 0x7f27100bee70 2021-04-09T18:33:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.781 7f27179ab700 1 -- 172.21.15.79:0/2213562756 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27101aeac0 con 0x7f27100bee70 2021-04-09T18:33:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.781 7f2705ffb700 1 -- 172.21.15.79:0/2213562756 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2700022070 con 0x7f27100bee70 2021-04-09T18:33:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.781 7f27179ab700 1 -- 172.21.15.79:0/2213562756 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27101aefc0 con 0x7f27100bee70 2021-04-09T18:33:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.781 7f2705ffb700 1 -- 172.21.15.79:0/2213562756 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2700026410 con 0x7f27100bee70 2021-04-09T18:33:25.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.781 7f2705ffb700 1 --2- 172.21.15.79:0/2213562756 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f26f0029100 0x7f26f002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:25.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.781 7f2705ffb700 1 -- 172.21.15.79:0/2213562756 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f270003bb10 con 0x7f27100bee70 2021-04-09T18:33:25.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.781 7f271574f700 1 --2- 172.21.15.79:0/2213562756 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f26f0029100 0x7f26f002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:25.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.781 7f271574f700 1 --2- 172.21.15.79:0/2213562756 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f26f0029100 0x7f26f002b650 crc :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:25.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.785 7f27179ab700 1 -- 172.21.15.79:0/2213562756 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27100e39e0 con 0x7f27100bee70 2021-04-09T18:33:25.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.789 7f2705ffb700 1 -- 172.21.15.79:0/2213562756 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2700000bf0 con 0x7f27100bee70 2021-04-09T18:33:25.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.949 7f27179ab700 1 -- 172.21.15.79:0/2213562756 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27100a1cc0 con 0x7f27100bee70 2021-04-09T18:33:25.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.949 7f2705ffb700 1 -- 172.21.15.79:0/2213562756 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+14229 (secure 0 0 0) 0x7f27000377b0 con 0x7f27100bee70 2021-04-09T18:33:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:25.955 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":79,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:33:25.320368","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:33:22.552244","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2021-04-09 18:33:23.559196","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:33:25.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.953 7f27179ab700 1 -- 172.21.15.79:0/2213562756 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f26f0029100 msgr2=0x7f26f002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:25.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.953 7f27179ab700 1 --2- 172.21.15.79:0/2213562756 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f26f0029100 0x7f26f002b650 crc :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.953 7f27179ab700 1 -- 172.21.15.79:0/2213562756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27100bee70 msgr2=0x7f27100d5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:25.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.953 7f27179ab700 1 --2- 172.21.15.79:0/2213562756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27100bee70 0x7f27100d5200 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f271009ad00 tx=0x7f2700006890).stop 2021-04-09T18:33:25.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.953 7f27179ab700 1 -- 172.21.15.79:0/2213562756 shutdown_connections 2021-04-09T18:33:25.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.953 7f27179ab700 1 --2- 172.21.15.79:0/2213562756 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f26f0029100 0x7f26f002b650 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.953 7f27179ab700 1 --2- 172.21.15.79:0/2213562756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27100d5830 0x7f27101ae490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.953 7f27179ab700 1 --2- 172.21.15.79:0/2213562756 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27101aac90 0x7f27100afab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.953 7f27179ab700 1 --2- 172.21.15.79:0/2213562756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27100bee70 0x7f27100d5200 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:25.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.953 7f27179ab700 1 -- 172.21.15.79:0/2213562756 >> 172.21.15.79:0/2213562756 conn(0x7f271009ad40 msgr2=0x7f271009a330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:25.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.953 7f27179ab700 1 -- 172.21.15.79:0/2213562756 shutdown_connections 2021-04-09T18:33:25.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:25.953 7f27179ab700 1 -- 172.21.15.79:0/2213562756 wait complete. 2021-04-09T18:33:25.968 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:33:26.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4150fcf700 1 Processor -- start 2021-04-09T18:33:26.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4150fcf700 1 -- start start 2021-04-09T18:33:26.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4150fcf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f414c0f5580 0x7f414c0f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4150fcf700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414c0fbb80 con 0x7f414c0e9b40 2021-04-09T18:33:26.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4150fcf700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414c09f910 con 0x7f414c1c7e40 2021-04-09T18:33:26.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4150fcf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c0e9f90 con 0x7f414c0f5580 2021-04-09T18:33:26.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f414a2ee700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f414c0e9b40 0x7f414c09f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55176/0 (socket says 172.21.15.79:55176) 2021-04-09T18:33:26.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f414a2ee700 1 -- 172.21.15.79:0/269962141 learned_addr learned my addr 172.21.15.79:0/269962141 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:26.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f414aaef700 1 --2- 172.21.15.79:0/269962141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f414c0f5580 0x7f414c0f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4149aed700 1 -- 172.21.15.79:0/269962141 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3628531504 0 0) 0x7f41340010d0 con 0x7f414c0e9b40 2021-04-09T18:33:26.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4149aed700 1 -- 172.21.15.79:0/269962141 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f412c003240 con 0x7f414c0e9b40 2021-04-09T18:33:26.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4149aed700 1 -- 172.21.15.79:0/269962141 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2868281125 0 0) 0x7f4134001650 con 0x7f414c0e9b40 2021-04-09T18:33:26.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4149aed700 1 -- 172.21.15.79:0/269962141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f414c0f5580 msgr2=0x7f414c0f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:26.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4149aed700 1 --2- 172.21.15.79:0/269962141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f414c0f5580 0x7f414c0f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4149aed700 1 -- 172.21.15.79:0/269962141 >> v1:172.21.15.89:6789/0 conn(0x7f414c1c7e40 legacy=0x7f414c1ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4149aed700 1 -- 172.21.15.79:0/269962141 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c0e56b0 con 0x7f414c0e9b40 2021-04-09T18:33:26.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4149aed700 1 -- 172.21.15.79:0/269962141 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f4134001bb0 con 0x7f414c0e9b40 2021-04-09T18:33:26.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4149aed700 1 -- 172.21.15.79:0/269962141 >> v1:172.21.15.79:6789/0 conn(0x7f414c0e9b40 legacy=0x7f414c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4149aed700 1 --2- 172.21.15.79:0/269962141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f412c0038f0 0x7f412c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4149aed700 1 --2- 172.21.15.79:0/269962141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f412c0045a0 0x7f412c0049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4149aed700 1 --2- 172.21.15.79:0/269962141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f412c005070 0x7f412c00b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4149aed700 1 -- 172.21.15.79:0/269962141 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c0e9f90 con 0x7f412c0038f0 2021-04-09T18:33:26.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4149aed700 1 -- 172.21.15.79:0/269962141 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c00bf10 con 0x7f412c005070 2021-04-09T18:33:26.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f414aaef700 1 --2- 172.21.15.79:0/269962141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f412c0038f0 0x7f412c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f4149aed700 1 -- 172.21.15.79:0/269962141 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412c050120 con 0x7f412c0045a0 2021-04-09T18:33:26.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f414a2ee700 1 --2- 172.21.15.79:0/269962141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f412c0045a0 0x7f412c0049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f414b2f0700 1 --2- 172.21.15.79:0/269962141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f412c005070 0x7f412c00b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f414aaef700 1 -- 172.21.15.79:0/269962141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f412c0045a0 msgr2=0x7f412c0049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:26.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f414aaef700 1 --2- 172.21.15.79:0/269962141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f412c0045a0 0x7f412c0049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f414aaef700 1 -- 172.21.15.79:0/269962141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f412c005070 msgr2=0x7f412c00b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:26.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f414aaef700 1 --2- 172.21.15.79:0/269962141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f412c005070 0x7f412c00b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f414aaef700 1 -- 172.21.15.79:0/269962141 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c0503e0 con 0x7f412c0038f0 2021-04-09T18:33:26.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.069 7f414a2ee700 1 --2- 172.21.15.79:0/269962141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f412c0045a0 0x7f412c0049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:26.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.073 7f414aaef700 1 --2- 172.21.15.79:0/269962141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f412c0038f0 0x7f412c003da0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f414400c000 tx=0x7f414400e4b0).ready entity=mon.0 client_cookie=ba6fc92c9844fa70 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:26.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.073 7f4149aed700 1 -- 172.21.15.79:0/269962141 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f412c0503e0 con 0x7f412c0038f0 2021-04-09T18:33:26.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.073 7f4149aed700 1 -- 172.21.15.79:0/269962141 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414400ed20 con 0x7f412c0038f0 2021-04-09T18:33:26.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.073 7f4149aed700 1 -- 172.21.15.79:0/269962141 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f414400f040 con 0x7f412c0038f0 2021-04-09T18:33:26.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.073 7f4150fcf700 1 -- 172.21.15.79:0/269962141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f412c0038f0 msgr2=0x7f412c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.073 7f4150fcf700 1 --2- 172.21.15.79:0/269962141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f412c0038f0 0x7f412c003da0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f414400c000 tx=0x7f414400e4b0).stop 2021-04-09T18:33:26.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.073 7f414b2f0700 1 -- 172.21.15.79:0/269962141 reap_dead start 2021-04-09T18:33:26.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.073 7f4150fcf700 1 -- 172.21.15.79:0/269962141 shutdown_connections 2021-04-09T18:33:26.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.073 7f4150fcf700 1 -- 172.21.15.79:0/269962141 >> 172.21.15.79:0/269962141 conn(0x7f414c0e6040 msgr2=0x7f414c0e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:26.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.073 7f4150fcf700 1 -- 172.21.15.79:0/269962141 shutdown_connections 2021-04-09T18:33:26.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.073 7f4150fcf700 1 -- 172.21.15.79:0/269962141 wait complete. 2021-04-09T18:33:26.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.077 7f4150fcf700 1 Processor -- start 2021-04-09T18:33:26.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.077 7f4150fcf700 1 -- start start 2021-04-09T18:33:26.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.077 7f4150fcf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f414c1a0f70 0x7f414c19cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.077 7f4150fcf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f414c19d570 0x7f414c0d5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.077 7f4150fcf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f414c0d5830 0x7f414c0c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.077 7f4150fcf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c1a1ed0 con 0x7f414c19d570 2021-04-09T18:33:26.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.077 7f4150fcf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c0b2db0 con 0x7f414c1a0f70 2021-04-09T18:33:26.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.077 7f4150fcf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c1a1760 con 0x7f414c0d5830 2021-04-09T18:33:26.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.077 7f414a2ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f414c19d570 0x7f414c0d5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.077 7f414aaef700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f414c1a0f70 0x7f414c19cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.077 7f414a2ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f414c19d570 0x7f414c0d5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60482/0 (socket says 172.21.15.79:60482) 2021-04-09T18:33:26.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.077 7f414a2ee700 1 -- 172.21.15.79:0/2093179734 learned_addr learned my addr 172.21.15.79:0/2093179734 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:26.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.077 7f414b2f0700 1 --2- 172.21.15.79:0/2093179734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f414c0d5830 0x7f414c0c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.077 7f414a2ee700 1 -- 172.21.15.79:0/2093179734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f414c0d5830 msgr2=0x7f414c0c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.077 7f414a2ee700 1 --2- 172.21.15.79:0/2093179734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f414c0d5830 0x7f414c0c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.077 7f414a2ee700 1 -- 172.21.15.79:0/2093179734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f414c1a0f70 msgr2=0x7f414c19cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.077 7f414a2ee700 1 --2- 172.21.15.79:0/2093179734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f414c1a0f70 0x7f414c19cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.077 7f414a2ee700 1 -- 172.21.15.79:0/2093179734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c1a1a80 con 0x7f414c19d570 2021-04-09T18:33:26.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.081 7f414a2ee700 1 --2- 172.21.15.79:0/2093179734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f414c19d570 0x7f414c0d5200 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7f414c19bb60 tx=0x7f413400e430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:26.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.081 7f41437fe700 1 -- 172.21.15.79:0/2093179734 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f414c1a1a80 con 0x7f414c19d570 2021-04-09T18:33:26.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.081 7f41437fe700 1 -- 172.21.15.79:0/2093179734 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413400e9c0 con 0x7f414c19d570 2021-04-09T18:33:26.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.081 7f4150fcf700 1 -- 172.21.15.79:0/2093179734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414c0c70c0 con 0x7f414c19d570 2021-04-09T18:33:26.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.081 7f41437fe700 1 -- 172.21.15.79:0/2093179734 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f414c0e56b0 con 0x7f414c19d570 2021-04-09T18:33:26.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.081 7f4150fcf700 1 -- 172.21.15.79:0/2093179734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414c099ff0 con 0x7f414c19d570 2021-04-09T18:33:26.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.081 7f41437fe700 1 -- 172.21.15.79:0/2093179734 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f413401c3d0 con 0x7f414c19d570 2021-04-09T18:33:26.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.081 7f41437fe700 1 --2- 172.21.15.79:0/2093179734 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4124029100 0x7f412402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.081 7f41437fe700 1 -- 172.21.15.79:0/2093179734 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f4134038ff0 con 0x7f414c19d570 2021-04-09T18:33:26.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.081 7f414aaef700 1 --2- 172.21.15.79:0/2093179734 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4124029100 0x7f412402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.081 7f414aaef700 1 --2- 172.21.15.79:0/2093179734 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4124029100 0x7f412402b650 crc :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:26.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.085 7f4150fcf700 1 -- 172.21.15.79:0/2093179734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414c088d30 con 0x7f414c19d570 2021-04-09T18:33:26.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.089 7f41437fe700 1 -- 172.21.15.79:0/2093179734 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4134005d80 con 0x7f414c19d570 2021-04-09T18:33:26.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.245 7f4150fcf700 1 -- 172.21.15.79:0/2093179734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f414c0e39a0 con 0x7f414c19d570 2021-04-09T18:33:26.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.253 7f41437fe700 1 -- 172.21.15.79:0/2093179734 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v24) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4134000bf0 con 0x7f414c19d570 2021-04-09T18:33:26.256 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2021-04-09T18:33:26.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.257 7f4150fcf700 1 -- 172.21.15.79:0/2093179734 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4124029100 msgr2=0x7f412402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.257 7f4150fcf700 1 --2- 172.21.15.79:0/2093179734 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4124029100 0x7f412402b650 crc :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.257 7f4150fcf700 1 -- 172.21.15.79:0/2093179734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f414c19d570 msgr2=0x7f414c0d5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.257 7f4150fcf700 1 --2- 172.21.15.79:0/2093179734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f414c19d570 0x7f414c0d5200 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7f414c19bb60 tx=0x7f413400e430).stop 2021-04-09T18:33:26.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.257 7f4150fcf700 1 -- 172.21.15.79:0/2093179734 shutdown_connections 2021-04-09T18:33:26.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.257 7f4150fcf700 1 --2- 172.21.15.79:0/2093179734 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4124029100 0x7f412402b650 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.257 7f4150fcf700 1 --2- 172.21.15.79:0/2093179734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f414c1a0f70 0x7f414c19cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.257 7f4150fcf700 1 --2- 172.21.15.79:0/2093179734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f414c0d5830 0x7f414c0c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.257 7f4150fcf700 1 --2- 172.21.15.79:0/2093179734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f414c19d570 0x7f414c0d5200 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.257 7f4150fcf700 1 -- 172.21.15.79:0/2093179734 >> 172.21.15.79:0/2093179734 conn(0x7f414c09b100 msgr2=0x7f414c099400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:26.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.257 7f4150fcf700 1 -- 172.21.15.79:0/2093179734 shutdown_connections 2021-04-09T18:33:26.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.257 7f4150fcf700 1 -- 172.21.15.79:0/2093179734 wait complete. 2021-04-09T18:33:26.276 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:33:26.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5ae33c3700 1 Processor -- start 2021-04-09T18:33:26.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5ae33c3700 1 -- start start 2021-04-09T18:33:26.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5ae33c3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5adc0e9b30 0x7f5adc09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5ae33c3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5adc0fbb70 con 0x7f5adc0f5570 2021-04-09T18:33:26.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5ae33c3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5adc0e56a0 con 0x7f5adc1c7e30 2021-04-09T18:33:26.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5ae33c3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0e9f80 con 0x7f5adc0e9b30 2021-04-09T18:33:26.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5ae1167700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5adc0f5570 0x7f5adc0f6500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55196/0 (socket says 172.21.15.79:55196) 2021-04-09T18:33:26.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5ae1167700 1 -- 172.21.15.79:0/323589700 learned_addr learned my addr 172.21.15.79:0/323589700 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:26.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5ae0966700 1 --2- 172.21.15.79:0/323589700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5adc0e9b30 0x7f5adc09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5adbfff700 1 -- 172.21.15.79:0/323589700 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198070386 0 0) 0x7f5ad40010d0 con 0x7f5adc0f5570 2021-04-09T18:33:26.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5adbfff700 1 -- 172.21.15.79:0/323589700 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ac8003240 con 0x7f5adc0f5570 2021-04-09T18:33:26.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5adbfff700 1 -- 172.21.15.79:0/323589700 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585002514 0 0) 0x7f5ac40010d0 con 0x7f5adc1c7e30 2021-04-09T18:33:26.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5adbfff700 1 -- 172.21.15.79:0/323589700 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ac8003620 con 0x7f5adc1c7e30 2021-04-09T18:33:26.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5adbfff700 1 -- 172.21.15.79:0/323589700 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3502115828 0 0) 0x7f5ad4001650 con 0x7f5adc0f5570 2021-04-09T18:33:26.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5adbfff700 1 -- 172.21.15.79:0/323589700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5adc0e9b30 msgr2=0x7f5adc09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:26.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5adbfff700 1 --2- 172.21.15.79:0/323589700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5adc0e9b30 0x7f5adc09f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5adbfff700 1 -- 172.21.15.79:0/323589700 >> v1:172.21.15.89:6789/0 conn(0x7f5adc1c7e30 legacy=0x7f5adc1ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5adbfff700 1 -- 172.21.15.79:0/323589700 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc0e4300 con 0x7f5adc0f5570 2021-04-09T18:33:26.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5adbfff700 1 -- 172.21.15.79:0/323589700 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f5ad4001bb0 con 0x7f5adc0f5570 2021-04-09T18:33:26.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5ae0966700 1 --2- 172.21.15.79:0/323589700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5adc0e9b30 0x7f5adc09f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:26.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5adbfff700 1 -- 172.21.15.79:0/323589700 >> v1:172.21.15.79:6789/0 conn(0x7f5adc0f5570 legacy=0x7f5adc0f6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5adbfff700 1 --2- 172.21.15.79:0/323589700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ac8003d40 0x7f5ac80045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5adbfff700 1 --2- 172.21.15.79:0/323589700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac8004bd0 0x7f5ac80097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5adbfff700 1 --2- 172.21.15.79:0/323589700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ac8005020 0x7f5ac800be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5adbfff700 1 -- 172.21.15.79:0/323589700 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0e9f80 con 0x7f5ac8004bd0 2021-04-09T18:33:26.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5adbfff700 1 -- 172.21.15.79:0/323589700 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac8050460 con 0x7f5ac8003d40 2021-04-09T18:33:26.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5adbfff700 1 -- 172.21.15.79:0/323589700 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac8050610 con 0x7f5ac8005020 2021-04-09T18:33:26.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5ae0966700 1 --2- 172.21.15.79:0/323589700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac8004bd0 0x7f5ac80097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5ae1968700 1 --2- 172.21.15.79:0/323589700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ac8005020 0x7f5ac800be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5ae1167700 1 --2- 172.21.15.79:0/323589700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ac8003d40 0x7f5ac80045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5ae0966700 1 -- 172.21.15.79:0/323589700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ac8005020 msgr2=0x7f5ac800be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5ae0966700 1 --2- 172.21.15.79:0/323589700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ac8005020 0x7f5ac800be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5ae0966700 1 -- 172.21.15.79:0/323589700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ac8003d40 msgr2=0x7f5ac80045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:26.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5ae0966700 1 --2- 172.21.15.79:0/323589700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ac8003d40 0x7f5ac80045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5ae0966700 1 -- 172.21.15.79:0/323589700 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac8050880 con 0x7f5ac8004bd0 2021-04-09T18:33:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5ae1968700 1 --2- 172.21.15.79:0/323589700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ac8005020 0x7f5ac800be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.377 7f5ae0966700 1 --2- 172.21.15.79:0/323589700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac8004bd0 0x7f5ac80097e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f5ac8005570 tx=0x7f5acc00e6d0).ready entity=mon.0 client_cookie=f53513740a4fc930 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.381 7f5adbfff700 1 -- 172.21.15.79:0/323589700 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5ac8050880 con 0x7f5ac8004bd0 2021-04-09T18:33:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.381 7f5adbfff700 1 -- 172.21.15.79:0/323589700 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc0123f0 con 0x7f5ac8004bd0 2021-04-09T18:33:26.412 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.381 7f5adbfff700 1 -- 172.21.15.79:0/323589700 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5acc00f040 con 0x7f5ac8004bd0 2021-04-09T18:33:26.412 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.381 7f5ae33c3700 1 -- 172.21.15.79:0/323589700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac8004bd0 msgr2=0x7f5ac80097e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.412 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.381 7f5ae33c3700 1 --2- 172.21.15.79:0/323589700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac8004bd0 0x7f5ac80097e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f5ac8005570 tx=0x7f5acc00e6d0).stop 2021-04-09T18:33:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.381 7f5ae1968700 1 -- 172.21.15.79:0/323589700 reap_dead start 2021-04-09T18:33:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.381 7f5ae33c3700 1 -- 172.21.15.79:0/323589700 shutdown_connections 2021-04-09T18:33:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.381 7f5ae33c3700 1 -- 172.21.15.79:0/323589700 >> 172.21.15.79:0/323589700 conn(0x7f5adc0e6030 msgr2=0x7f5adc0e9330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:26.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.381 7f5ae33c3700 1 -- 172.21.15.79:0/323589700 shutdown_connections 2021-04-09T18:33:26.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.381 7f5ae33c3700 1 -- 172.21.15.79:0/323589700 wait complete. 2021-04-09T18:33:26.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae33c3700 1 Processor -- start 2021-04-09T18:33:26.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae33c3700 1 -- start start 2021-04-09T18:33:26.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae33c3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5adc0996f0 0x7f5adc1c0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae33c3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5adc0c4aa0 0x7f5adc1b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae33c3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5adc0c4ef0 0x7f5adc1b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae33c3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc099e40 con 0x7f5adc0c4ef0 2021-04-09T18:33:26.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae33c3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc099b40 con 0x7f5adc0996f0 2021-04-09T18:33:26.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae33c3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc09a140 con 0x7f5adc0c4aa0 2021-04-09T18:33:26.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae1968700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5adc0c4ef0 0x7f5adc1b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae1968700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5adc0c4ef0 0x7f5adc1b31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60500/0 (socket says 172.21.15.79:60500) 2021-04-09T18:33:26.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae1968700 1 -- 172.21.15.79:0/3713272986 learned_addr learned my addr 172.21.15.79:0/3713272986 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:26.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae1167700 1 --2- 172.21.15.79:0/3713272986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5adc0996f0 0x7f5adc1c0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae0966700 1 --2- 172.21.15.79:0/3713272986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5adc0c4aa0 0x7f5adc1b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae1968700 1 -- 172.21.15.79:0/3713272986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5adc0c4aa0 msgr2=0x7f5adc1b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae1968700 1 --2- 172.21.15.79:0/3713272986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5adc0c4aa0 0x7f5adc1b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae1968700 1 -- 172.21.15.79:0/3713272986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5adc0996f0 msgr2=0x7f5adc1c0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae1968700 1 --2- 172.21.15.79:0/3713272986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5adc0996f0 0x7f5adc1c0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae1968700 1 -- 172.21.15.79:0/3713272986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc1c08b0 con 0x7f5adc0c4ef0 2021-04-09T18:33:26.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae1968700 1 --2- 172.21.15.79:0/3713272986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5adc0c4ef0 0x7f5adc1b31a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f5adc1a30d0 tx=0x7f5ac40015a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:26.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ad9ffb700 1 -- 172.21.15.79:0/3713272986 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5adc1c08b0 con 0x7f5adc0c4ef0 2021-04-09T18:33:26.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ad9ffb700 1 -- 172.21.15.79:0/3713272986 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac400d940 con 0x7f5adc0c4ef0 2021-04-09T18:33:26.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ad9ffb700 1 -- 172.21.15.79:0/3713272986 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5ac4010040 con 0x7f5adc0c4ef0 2021-04-09T18:33:26.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae33c3700 1 -- 172.21.15.79:0/3713272986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5adc1b37d0 con 0x7f5adc0c4ef0 2021-04-09T18:33:26.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ae33c3700 1 -- 172.21.15.79:0/3713272986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5adc1af5e0 con 0x7f5adc0c4ef0 2021-04-09T18:33:26.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.385 7f5ad9ffb700 1 -- 172.21.15.79:0/3713272986 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5ac4012070 con 0x7f5adc0c4ef0 2021-04-09T18:33:26.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.389 7f5ad9ffb700 1 --2- 172.21.15.79:0/3713272986 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5ac0029100 0x7f5ac002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.389 7f5ad9ffb700 1 -- 172.21.15.79:0/3713272986 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f5ac4011040 con 0x7f5adc0c4ef0 2021-04-09T18:33:26.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.389 7f5ae1167700 1 --2- 172.21.15.79:0/3713272986 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5ac0029100 0x7f5ac002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.389 7f5ae1167700 1 --2- 172.21.15.79:0/3713272986 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5ac0029100 0x7f5ac002b650 crc :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:26.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.389 7f5ae33c3700 1 -- 172.21.15.79:0/3713272986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5adc088d20 con 0x7f5adc0c4ef0 2021-04-09T18:33:26.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.397 7f5ad9ffb700 1 -- 172.21.15.79:0/3713272986 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5adc0f7710 con 0x7f5adc0c4ef0 2021-04-09T18:33:26.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.557 7f5ae33c3700 1 -- 172.21.15.79:0/3713272986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f5adc0e3990 con 0x7f5adc0c4ef0 2021-04-09T18:33:26.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.565 7f5ad9ffb700 1 -- 172.21.15.79:0/3713272986 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v25) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5ac400d540 con 0x7f5adc0c4ef0 2021-04-09T18:33:26.576 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.1 2021-04-09T18:33:26.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.573 7f5ae33c3700 1 -- 172.21.15.79:0/3713272986 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5ac0029100 msgr2=0x7f5ac002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.573 7f5ae33c3700 1 --2- 172.21.15.79:0/3713272986 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5ac0029100 0x7f5ac002b650 crc :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.573 7f5ae33c3700 1 -- 172.21.15.79:0/3713272986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5adc0c4ef0 msgr2=0x7f5adc1b31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.573 7f5ae33c3700 1 --2- 172.21.15.79:0/3713272986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5adc0c4ef0 0x7f5adc1b31a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f5adc1a30d0 tx=0x7f5ac40015a0).stop 2021-04-09T18:33:26.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.577 7f5ae33c3700 1 -- 172.21.15.79:0/3713272986 shutdown_connections 2021-04-09T18:33:26.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.577 7f5ae33c3700 1 --2- 172.21.15.79:0/3713272986 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5ac0029100 0x7f5ac002b650 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.577 7f5ae33c3700 1 --2- 172.21.15.79:0/3713272986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5adc0996f0 0x7f5adc1c0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.577 7f5ae33c3700 1 --2- 172.21.15.79:0/3713272986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5adc0c4ef0 0x7f5adc1b31a0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.577 7f5ae33c3700 1 --2- 172.21.15.79:0/3713272986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5adc0c4aa0 0x7f5adc1b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.577 7f5ae33c3700 1 -- 172.21.15.79:0/3713272986 >> 172.21.15.79:0/3713272986 conn(0x7f5adc0a6450 msgr2=0x7f5adc0d8670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:26.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.577 7f5ae33c3700 1 -- 172.21.15.79:0/3713272986 shutdown_connections 2021-04-09T18:33:26.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.577 7f5ae33c3700 1 -- 172.21.15.79:0/3713272986 wait complete. 2021-04-09T18:33:26.590 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:33:26.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.689 7f6724400700 1 Processor -- start 2021-04-09T18:33:26.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.689 7f6724400700 1 -- start start 2021-04-09T18:33:26.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f6724400700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f671c0e9b30 0x7f671c09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f6724400700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c1c7e30 0x7f671c1ca290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f6724400700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f671c0fbb70 con 0x7f671c0f5570 2021-04-09T18:33:26.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f6724400700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671c0e9f80 con 0x7f671c0e9b30 2021-04-09T18:33:26.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f6724400700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671c0e59a0 con 0x7f671c1c7e30 2021-04-09T18:33:26.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f67219a3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f671c0e9b30 0x7f671c09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f67219a3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f671c0e9b30 0x7f671c09f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60506/0 (socket says 172.21.15.79:60506) 2021-04-09T18:33:26.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f67219a3700 1 -- 172.21.15.79:0/2241992397 learned_addr learned my addr 172.21.15.79:0/2241992397 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:26.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f67221a4700 1 --1- 172.21.15.79:0/2241992397 >> v1:172.21.15.79:6789/0 conn(0x7f671c0f5570 0x7f671c0f6500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55218/0 (socket says 172.21.15.79:55218) 2021-04-09T18:33:26.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f67229a5700 1 --2- 172.21.15.79:0/2241992397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c1c7e30 0x7f671c1ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f67219a3700 1 -- 172.21.15.79:0/2241992397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c1c7e30 msgr2=0x7f671c1ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:26.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f67219a3700 1 --2- 172.21.15.79:0/2241992397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c1c7e30 0x7f671c1ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f67219a3700 1 -- 172.21.15.79:0/2241992397 >> v1:172.21.15.79:6789/0 conn(0x7f671c0f5570 legacy=0x7f671c0f6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f67219a3700 1 -- 172.21.15.79:0/2241992397 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671c0e56a0 con 0x7f671c0e9b30 2021-04-09T18:33:26.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f67211a2700 1 -- 172.21.15.79:0/2241992397 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471108484 0 0) 0x7f67180010d0 con 0x7f671c0f5570 2021-04-09T18:33:26.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f67219a3700 1 --2- 172.21.15.79:0/2241992397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f671c0e9b30 0x7f671c09f100 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f670c002f30 tx=0x7f670c00bda0).ready entity=mon.0 client_cookie=ff4d6c586ad67318 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:26.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f67211a2700 1 -- 172.21.15.79:0/2241992397 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f671c0e56a0 con 0x7f671c0e9b30 2021-04-09T18:33:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f67211a2700 1 -- 172.21.15.79:0/2241992397 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c0099d0 con 0x7f671c0e9b30 2021-04-09T18:33:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f67211a2700 1 -- 172.21.15.79:0/2241992397 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f670c009da0 con 0x7f671c0e9b30 2021-04-09T18:33:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f6724400700 1 -- 172.21.15.79:0/2241992397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f671c0e9b30 msgr2=0x7f671c09f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f6724400700 1 --2- 172.21.15.79:0/2241992397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f671c0e9b30 0x7f671c09f100 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f670c002f30 tx=0x7f670c00bda0).stop 2021-04-09T18:33:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f6724400700 1 -- 172.21.15.79:0/2241992397 shutdown_connections 2021-04-09T18:33:26.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f6724400700 1 --2- 172.21.15.79:0/2241992397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c1c7e30 0x7f671c1ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f6724400700 1 --2- 172.21.15.79:0/2241992397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f671c0e9b30 0x7f671c09f100 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f6724400700 1 -- 172.21.15.79:0/2241992397 >> 172.21.15.79:0/2241992397 conn(0x7f671c0e6030 msgr2=0x7f671c0e9330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:26.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f6724400700 1 -- 172.21.15.79:0/2241992397 shutdown_connections 2021-04-09T18:33:26.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.693 7f6724400700 1 -- 172.21.15.79:0/2241992397 wait complete. 2021-04-09T18:33:26.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f6724400700 1 Processor -- start 2021-04-09T18:33:26.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f6724400700 1 -- start start 2021-04-09T18:33:26.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f6724400700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c0c3910 0x7f671c19ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f6724400700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f671c1a0b10 0x7f671c0a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f6724400700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f671c0a2a90 0x7f671c0c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f6724400700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671c0474f0 con 0x7f671c1a0b10 2021-04-09T18:33:26.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f6724400700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671c0c4230 con 0x7f671c0a2a90 2021-04-09T18:33:26.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f6724400700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671c0a2ee0 con 0x7f671c0c3910 2021-04-09T18:33:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f67219a3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f671c1a0b10 0x7f671c0a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f67219a3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f671c1a0b10 0x7f671c0a2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60512/0 (socket says 172.21.15.79:60512) 2021-04-09T18:33:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f67219a3700 1 -- 172.21.15.79:0/4113559349 learned_addr learned my addr 172.21.15.79:0/4113559349 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f67221a4700 1 --2- 172.21.15.79:0/4113559349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c0c3910 0x7f671c19ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f67229a5700 1 --2- 172.21.15.79:0/4113559349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f671c0a2a90 0x7f671c0c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f67219a3700 1 -- 172.21.15.79:0/4113559349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c0c3910 msgr2=0x7f671c19ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f67219a3700 1 --2- 172.21.15.79:0/4113559349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c0c3910 0x7f671c19ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f67219a3700 1 -- 172.21.15.79:0/4113559349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f671c0a2a90 msgr2=0x7f671c0c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f67219a3700 1 --2- 172.21.15.79:0/4113559349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f671c0a2a90 0x7f671c0c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f67219a3700 1 -- 172.21.15.79:0/4113559349 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671c0a3110 con 0x7f671c1a0b10 2021-04-09T18:33:26.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f67219a3700 1 --2- 172.21.15.79:0/4113559349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f671c1a0b10 0x7f671c0a2460 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f670c002f30 tx=0x7f670c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:26.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f6712ffd700 1 -- 172.21.15.79:0/4113559349 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f671c0a3110 con 0x7f671c1a0b10 2021-04-09T18:33:26.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f6712ffd700 1 -- 172.21.15.79:0/4113559349 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c018580 con 0x7f671c1a0b10 2021-04-09T18:33:26.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f6724400700 1 -- 172.21.15.79:0/4113559349 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671c0c9f80 con 0x7f671c1a0b10 2021-04-09T18:33:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f6712ffd700 1 -- 172.21.15.79:0/4113559349 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f670c018950 con 0x7f671c1a0b10 2021-04-09T18:33:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.697 7f6724400700 1 -- 172.21.15.79:0/4113559349 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671c0ca490 con 0x7f671c1a0b10 2021-04-09T18:33:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.701 7f6712ffd700 1 -- 172.21.15.79:0/4113559349 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f670c018b50 con 0x7f671c1a0b10 2021-04-09T18:33:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.701 7f6712ffd700 1 --2- 172.21.15.79:0/4113559349 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6704029100 0x7f670402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.701 7f6712ffd700 1 -- 172.21.15.79:0/4113559349 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f670c03c990 con 0x7f671c1a0b10 2021-04-09T18:33:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.701 7f67221a4700 1 --2- 172.21.15.79:0/4113559349 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6704029100 0x7f670402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.701 7f67221a4700 1 --2- 172.21.15.79:0/4113559349 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6704029100 0x7f670402b650 crc :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.705 7f6724400700 1 -- 172.21.15.79:0/4113559349 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671c088d20 con 0x7f671c1a0b10 2021-04-09T18:33:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.713 7f6712ffd700 1 -- 172.21.15.79:0/4113559349 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f670c0097c0 con 0x7f671c1a0b10 2021-04-09T18:33:26.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.873 7f6724400700 1 -- 172.21.15.79:0/4113559349 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f671c0e3990 con 0x7f671c1a0b10 2021-04-09T18:33:26.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.877 7f6712ffd700 1 -- 172.21.15.79:0/4113559349 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v26) v1 ==== 184+0+0 (secure 0 0 0) 0x7f670c018370 con 0x7f671c1a0b10 2021-04-09T18:33:26.882 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.2 2021-04-09T18:33:26.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.881 7f6724400700 1 -- 172.21.15.79:0/4113559349 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6704029100 msgr2=0x7f670402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.881 7f6724400700 1 --2- 172.21.15.79:0/4113559349 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6704029100 0x7f670402b650 crc :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.881 7f6724400700 1 -- 172.21.15.79:0/4113559349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f671c1a0b10 msgr2=0x7f671c0a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.881 7f6724400700 1 --2- 172.21.15.79:0/4113559349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f671c1a0b10 0x7f671c0a2460 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f670c002f30 tx=0x7f670c006890).stop 2021-04-09T18:33:26.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.881 7f6724400700 1 -- 172.21.15.79:0/4113559349 shutdown_connections 2021-04-09T18:33:26.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.881 7f6724400700 1 --2- 172.21.15.79:0/4113559349 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6704029100 0x7f670402b650 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.881 7f6724400700 1 --2- 172.21.15.79:0/4113559349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f671c0a2a90 0x7f671c0c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.881 7f6724400700 1 --2- 172.21.15.79:0/4113559349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c0c3910 0x7f671c19ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.881 7f6724400700 1 --2- 172.21.15.79:0/4113559349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f671c1a0b10 0x7f671c0a2460 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.881 7f6724400700 1 -- 172.21.15.79:0/4113559349 >> 172.21.15.79:0/4113559349 conn(0x7f671c09a860 msgr2=0x7f671c0a4520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:26.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.881 7f6724400700 1 -- 172.21.15.79:0/4113559349 shutdown_connections 2021-04-09T18:33:26.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.881 7f6724400700 1 -- 172.21.15.79:0/4113559349 wait complete. 2021-04-09T18:33:26.896 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:26.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f3d369700 1 Processor -- start 2021-04-09T18:33:26.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f3d369700 1 -- start start 2021-04-09T18:33:27.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f3d369700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2f380f5510 0x7f2f380f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:27.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f3d369700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f380e9ad0 0x7f2f3809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:27.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f3d369700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2f381c2da0 0x7f2f381c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:27.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f3d369700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f380e9f20 con 0x7f2f380f5510 2021-04-09T18:33:27.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f3d369700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f380e59c0 con 0x7f2f381c2da0 2021-04-09T18:33:27.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f3d369700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380fbb10 con 0x7f2f380e9ad0 2021-04-09T18:33:27.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f37005700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2f380f5510 0x7f2f380f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:27.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f37005700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2f380f5510 0x7f2f380f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60522/0 (socket says 172.21.15.79:60522) 2021-04-09T18:33:27.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f37005700 1 -- 172.21.15.79:0/937550744 learned_addr learned my addr 172.21.15.79:0/937550744 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:27.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f37806700 1 --2- 172.21.15.79:0/937550744 >> v2:172.21.15.89:3300/0 conn(0x7f2f381c2da0 0x7f2f381c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:27.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f2ffff700 1 --2- 172.21.15.79:0/937550744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f380e9ad0 0x7f2f3809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:27.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f37005700 1 -- 172.21.15.79:0/937550744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f380e9ad0 msgr2=0x7f2f3809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:27.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f37005700 1 --2- 172.21.15.79:0/937550744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f380e9ad0 0x7f2f3809f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f37005700 1 -- 172.21.15.79:0/937550744 >> v2:172.21.15.89:3300/0 conn(0x7f2f381c2da0 msgr2=0x7f2f381c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:27.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f37005700 1 --2- 172.21.15.79:0/937550744 >> v2:172.21.15.89:3300/0 conn(0x7f2f381c2da0 0x7f2f381c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f37005700 1 -- 172.21.15.79:0/937550744 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f380e56c0 con 0x7f2f380f5510 2021-04-09T18:33:27.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f37005700 1 --2- 172.21.15.79:0/937550744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f380f5510 0x7f2f380f64a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f2f28002f30 tx=0x7f2f2800bd70).ready entity=mon.0 client_cookie=4a2281ed967769cb server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:27.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f36804700 1 -- 172.21.15.79:0/937550744 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2f380e56c0 con 0x7f2f380f5510 2021-04-09T18:33:27.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f36804700 1 -- 172.21.15.79:0/937550744 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f280098b0 con 0x7f2f380f5510 2021-04-09T18:33:27.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f36804700 1 -- 172.21.15.79:0/937550744 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2f28009c80 con 0x7f2f380f5510 2021-04-09T18:33:27.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f3d369700 1 -- 172.21.15.79:0/937550744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f380f5510 msgr2=0x7f2f380f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:27.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.989 7f2f3d369700 1 --2- 172.21.15.79:0/937550744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f380f5510 0x7f2f380f64a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f2f28002f30 tx=0x7f2f2800bd70).stop 2021-04-09T18:33:27.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.993 7f2f3d369700 1 -- 172.21.15.79:0/937550744 shutdown_connections 2021-04-09T18:33:27.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.993 7f2f3d369700 1 --2- 172.21.15.79:0/937550744 >> v2:172.21.15.89:3300/0 conn(0x7f2f381c2da0 0x7f2f381c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.993 7f2f3d369700 1 --2- 172.21.15.79:0/937550744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f380f5510 0x7f2f380f64a0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.993 7f2f3d369700 1 --2- 172.21.15.79:0/937550744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f380e9ad0 0x7f2f3809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.993 7f2f3d369700 1 -- 172.21.15.79:0/937550744 >> 172.21.15.79:0/937550744 conn(0x7f2f380e5fd0 msgr2=0x7f2f380e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:27.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.993 7f2f3d369700 1 -- 172.21.15.79:0/937550744 shutdown_connections 2021-04-09T18:33:27.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.993 7f2f3d369700 1 -- 172.21.15.79:0/937550744 wait complete. 2021-04-09T18:33:27.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f3d369700 1 Processor -- start 2021-04-09T18:33:27.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f3d369700 1 -- start start 2021-04-09T18:33:27.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f3d369700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f380971e0 0x7f2f381adb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:27.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f3d369700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f38097630 0x7f2f3819caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:27.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f3d369700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f3819d0d0 0x7f2f3819b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f3d369700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3819dfd0 con 0x7f2f380971e0 2021-04-09T18:33:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f3d369700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3819e2d0 con 0x7f2f3819d0d0 2021-04-09T18:33:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f3d369700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3819f870 con 0x7f2f38097630 2021-04-09T18:33:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f37005700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f380971e0 0x7f2f381adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:27.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f37005700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f380971e0 0x7f2f381adb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60526/0 (socket says 172.21.15.79:60526) 2021-04-09T18:33:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f37005700 1 -- 172.21.15.79:0/764209042 learned_addr learned my addr 172.21.15.79:0/764209042 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f2ffff700 1 --2- 172.21.15.79:0/764209042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f38097630 0x7f2f3819caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f37806700 1 --2- 172.21.15.79:0/764209042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f3819d0d0 0x7f2f3819b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:27.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f37005700 1 -- 172.21.15.79:0/764209042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f38097630 msgr2=0x7f2f3819caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f37005700 1 --2- 172.21.15.79:0/764209042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f38097630 0x7f2f3819caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f37005700 1 -- 172.21.15.79:0/764209042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f3819d0d0 msgr2=0x7f2f3819b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f37005700 1 --2- 172.21.15.79:0/764209042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f3819d0d0 0x7f2f3819b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f37005700 1 -- 172.21.15.79:0/764209042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f381ae1c0 con 0x7f2f380971e0 2021-04-09T18:33:27.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f37005700 1 --2- 172.21.15.79:0/764209042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f380971e0 0x7f2f381adb90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f2f381a2ed0 tx=0x7f2f28006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:27.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f34800700 1 -- 172.21.15.79:0/764209042 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2f381ae1c0 con 0x7f2f380971e0 2021-04-09T18:33:27.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f34800700 1 -- 172.21.15.79:0/764209042 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f28009d10 con 0x7f2f380971e0 2021-04-09T18:33:27.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f3d369700 1 -- 172.21.15.79:0/764209042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3819db60 con 0x7f2f380971e0 2021-04-09T18:33:27.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f34800700 1 -- 172.21.15.79:0/764209042 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2f28023070 con 0x7f2f380971e0 2021-04-09T18:33:27.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:26.997 7f2f3d369700 1 -- 172.21.15.79:0/764209042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3819c190 con 0x7f2f380971e0 2021-04-09T18:33:27.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.001 7f2f34800700 1 -- 172.21.15.79:0/764209042 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2f28006a20 con 0x7f2f380971e0 2021-04-09T18:33:27.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.001 7f2f34800700 1 --2- 172.21.15.79:0/764209042 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2f1c029100 0x7f2f1c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:27.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.001 7f2f34800700 1 -- 172.21.15.79:0/764209042 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f2f2803cff0 con 0x7f2f380971e0 2021-04-09T18:33:27.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.001 7f2f2ffff700 1 --2- 172.21.15.79:0/764209042 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2f1c029100 0x7f2f1c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:27.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.001 7f2f3d369700 1 -- 172.21.15.79:0/764209042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f380e39d0 con 0x7f2f380971e0 2021-04-09T18:33:27.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.001 7f2f2ffff700 1 --2- 172.21.15.79:0/764209042 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2f1c029100 0x7f2f1c02b650 crc :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:27.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.005 7f2f34800700 1 -- 172.21.15.79:0/764209042 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2f280096a0 con 0x7f2f380971e0 2021-04-09T18:33:27.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.169 7f2f3d369700 1 -- 172.21.15.79:0/764209042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f380f5b10 con 0x7f2f380971e0 2021-04-09T18:33:27.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.169 7f2f34800700 1 -- 172.21.15.79:0/764209042 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2103 (secure 0 0 0) 0x7f2f28035850 con 0x7f2f380971e0 2021-04-09T18:33:27.172 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 47 2021-04-09T18:33:27.172 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:27.173 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":47,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6510,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/4230183300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4230183300},{"type":"v1","addr":"172.21.15.79:6833","nonce":4230183300}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:33:24.317443","modified":"2021-04-09 18:33:25.319829","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5837},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5837":{"gid":5837,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/1825266006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1825266006},{"type":"v1","addr":"172.21.15.89:6835","nonce":1825266006}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-04-09T18:33:27.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.169 7f2f3d369700 1 -- 172.21.15.79:0/764209042 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2f1c029100 msgr2=0x7f2f1c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:27.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.169 7f2f3d369700 1 --2- 172.21.15.79:0/764209042 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2f1c029100 0x7f2f1c02b650 crc :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.169 7f2f3d369700 1 -- 172.21.15.79:0/764209042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f380971e0 msgr2=0x7f2f381adb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:27.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.169 7f2f3d369700 1 --2- 172.21.15.79:0/764209042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f380971e0 0x7f2f381adb90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f2f381a2ed0 tx=0x7f2f28006890).stop 2021-04-09T18:33:27.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.169 7f2f3d369700 1 -- 172.21.15.79:0/764209042 shutdown_connections 2021-04-09T18:33:27.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.169 7f2f3d369700 1 --2- 172.21.15.79:0/764209042 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2f1c029100 0x7f2f1c02b650 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.169 7f2f3d369700 1 --2- 172.21.15.79:0/764209042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f3819d0d0 0x7f2f3819b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.169 7f2f3d369700 1 --2- 172.21.15.79:0/764209042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f380971e0 0x7f2f381adb90 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.169 7f2f3d369700 1 --2- 172.21.15.79:0/764209042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f38097630 0x7f2f3819caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.169 7f2f3d369700 1 -- 172.21.15.79:0/764209042 >> 172.21.15.79:0/764209042 conn(0x7f2f3809a970 msgr2=0x7f2f380aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.169 7f2f3d369700 1 -- 172.21.15.79:0/764209042 shutdown_connections 2021-04-09T18:33:27.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.169 7f2f3d369700 1 -- 172.21.15.79:0/764209042 wait complete. 2021-04-09T18:33:27.386 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:33:24.317443', 'modified': '2021-04-09 18:33:25.319829', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5837}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5837': {'gid': 5837, 'name': 'b', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6835/1825266006', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 1825266006}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 1825266006}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:33:27.386 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:33:27.387 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2021-04-09T18:33:27.479 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:33:27.479 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:33:27.479 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2021-04-09T18:33:27.480 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 5837, 2021-04-09T18:33:27.480 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2021-04-09T18:33:27.480 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2021-04-09T18:33:27.480 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 3.1554899920000001, 2021-04-09T18:33:27.481 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 47, 2021-04-09T18:33:27.481 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 79, 2021-04-09T18:33:27.481 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 78, 2021-04-09T18:33:27.481 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 7.5397389199999996 2021-04-09T18:33:27.481 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:33:27.485 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 5837, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.1554899920000001, "mdsmap_epoch": 47, "osdmap_epoch": 79, "osdmap_epoch_barrier": 78, "uptime": 7.5397389199999996 } 2021-04-09T18:33:27.486 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:33:27.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.581 7fd8a521d700 1 Processor -- start 2021-04-09T18:33:27.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.581 7fd8a521d700 1 -- start start 2021-04-09T18:33:27.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd8a521d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd8a00e9ae0 0x7fd8a009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:27.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd8a521d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a00fbb20 con 0x7fd8a01c8010 2021-04-09T18:33:27.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd8a521d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a00e56d0 con 0x7fd8a00f5520 2021-04-09T18:33:27.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd8a521d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a01c3dc0 con 0x7fd8a00e9ae0 2021-04-09T18:33:27.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd89f59e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd8a01c8010 0x7fd8a01ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55248/0 (socket says 172.21.15.79:55248) 2021-04-09T18:33:27.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd89e59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd8a00e9ae0 0x7fd8a009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:27.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd89f59e700 1 -- 172.21.15.79:0/4145000688 learned_addr learned my addr 172.21.15.79:0/4145000688 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:27.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd89e59c700 1 -- 172.21.15.79:0/4145000688 >> v1:172.21.15.89:6789/0 conn(0x7fd8a00f5520 legacy=0x7fd8a00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:27.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd89e59c700 1 -- 172.21.15.79:0/4145000688 >> v1:172.21.15.79:6789/0 conn(0x7fd8a01c8010 legacy=0x7fd8a01ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:27.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd89dd9b700 1 -- 172.21.15.79:0/4145000688 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 133134466 0 0) 0x7fd898001450 con 0x7fd8a01c8010 2021-04-09T18:33:27.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd89e59c700 1 -- 172.21.15.79:0/4145000688 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a00e4330 con 0x7fd8a00e9ae0 2021-04-09T18:33:27.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd89e59c700 1 --2- 172.21.15.79:0/4145000688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a00e9ae0 0x7fd8a009f110 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7fd894002f30 tx=0x7fd89400bcc0).ready entity=mon.0 client_cookie=ff13f3c4f1861dba server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:27.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd89dd9b700 1 -- 172.21.15.79:0/4145000688 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd8a00e4330 con 0x7fd8a00e9ae0 2021-04-09T18:33:27.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd89dd9b700 1 -- 172.21.15.79:0/4145000688 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd894009800 con 0x7fd8a00e9ae0 2021-04-09T18:33:27.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd89dd9b700 1 -- 172.21.15.79:0/4145000688 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd894009bd0 con 0x7fd8a00e9ae0 2021-04-09T18:33:27.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd8a521d700 1 -- 172.21.15.79:0/4145000688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a00e9ae0 msgr2=0x7fd8a009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:27.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd8a521d700 1 --2- 172.21.15.79:0/4145000688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a00e9ae0 0x7fd8a009f110 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7fd894002f30 tx=0x7fd89400bcc0).stop 2021-04-09T18:33:27.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd8a521d700 1 -- 172.21.15.79:0/4145000688 shutdown_connections 2021-04-09T18:33:27.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd8a521d700 1 --2- 172.21.15.79:0/4145000688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a00e9ae0 0x7fd8a009f110 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd8a521d700 1 -- 172.21.15.79:0/4145000688 >> 172.21.15.79:0/4145000688 conn(0x7fd8a00e5fe0 msgr2=0x7fd8a00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:27.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd8a521d700 1 -- 172.21.15.79:0/4145000688 shutdown_connections 2021-04-09T18:33:27.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.585 7fd8a521d700 1 -- 172.21.15.79:0/4145000688 wait complete. 2021-04-09T18:33:27.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.589 7fd8a521d700 1 Processor -- start 2021-04-09T18:33:27.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.589 7fd8a521d700 1 -- start start 2021-04-09T18:33:27.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.589 7fd8a521d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a00b1ab0 0x7fd8a00a8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:27.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.589 7fd8a521d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8a01cfdf0 0x7fd8a00ac780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:27.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.589 7fd8a521d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8a01d0240 0x7fd8a01d9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:27.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.589 7fd8a521d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a00e9f30 con 0x7fd8a00b1ab0 2021-04-09T18:33:27.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.589 7fd8a521d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a00af170 con 0x7fd8a01d0240 2021-04-09T18:33:27.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.589 7fd8a521d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a00af470 con 0x7fd8a01cfdf0 2021-04-09T18:33:27.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd89ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a00b1ab0 0x7fd8a00a8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:27.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd89ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a00b1ab0 0x7fd8a00a8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60540/0 (socket says 172.21.15.79:60540) 2021-04-09T18:33:27.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd89ed9d700 1 -- 172.21.15.79:0/140954697 learned_addr learned my addr 172.21.15.79:0/140954697 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:27.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd89f59e700 1 --2- 172.21.15.79:0/140954697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8a01d0240 0x7fd8a01d9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:27.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd89e59c700 1 --2- 172.21.15.79:0/140954697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8a01cfdf0 0x7fd8a00ac780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:27.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd89ed9d700 1 -- 172.21.15.79:0/140954697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8a01cfdf0 msgr2=0x7fd8a00ac780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:27.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd89ed9d700 1 --2- 172.21.15.79:0/140954697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8a01cfdf0 0x7fd8a00ac780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd89ed9d700 1 -- 172.21.15.79:0/140954697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8a01d0240 msgr2=0x7fd8a01d9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:27.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd89ed9d700 1 --2- 172.21.15.79:0/140954697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8a01d0240 0x7fd8a01d9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd89ed9d700 1 -- 172.21.15.79:0/140954697 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a00b1f00 con 0x7fd8a00b1ab0 2021-04-09T18:33:27.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd89f59e700 1 --2- 172.21.15.79:0/140954697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8a01d0240 0x7fd8a01d9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:27.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd89ed9d700 1 --2- 172.21.15.79:0/140954697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a00b1ab0 0x7fd8a00a8780 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7fd8a009b3f0 tx=0x7fd89000cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:27.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd88f7fe700 1 -- 172.21.15.79:0/140954697 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd8a00b1f00 con 0x7fd8a00b1ab0 2021-04-09T18:33:27.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd88f7fe700 1 -- 172.21.15.79:0/140954697 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd890010510 con 0x7fd8a00b1ab0 2021-04-09T18:33:27.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd8a521d700 1 -- 172.21.15.79:0/140954697 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a00ad550 con 0x7fd8a00b1ab0 2021-04-09T18:33:27.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd88f7fe700 1 -- 172.21.15.79:0/140954697 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd8900106f0 con 0x7fd8a00b1ab0 2021-04-09T18:33:27.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd8a521d700 1 -- 172.21.15.79:0/140954697 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a00b06f0 con 0x7fd8a00b1ab0 2021-04-09T18:33:27.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd88f7fe700 1 -- 172.21.15.79:0/140954697 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd890019020 con 0x7fd8a00b1ab0 2021-04-09T18:33:27.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd88f7fe700 1 --2- 172.21.15.79:0/140954697 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd884029100 0x7fd88402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:27.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd88f7fe700 1 -- 172.21.15.79:0/140954697 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fd890038e20 con 0x7fd8a00b1ab0 2021-04-09T18:33:27.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.593 7fd89e59c700 1 --2- 172.21.15.79:0/140954697 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd884029100 0x7fd88402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:27.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.597 7fd89e59c700 1 --2- 172.21.15.79:0/140954697 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd884029100 0x7fd88402b650 crc :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:27.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.597 7fd8a521d700 1 -- 172.21.15.79:0/140954697 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a00e39e0 con 0x7fd8a00b1ab0 2021-04-09T18:33:27.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.601 7fd88f7fe700 1 -- 172.21.15.79:0/140954697 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd890000bf0 con 0x7fd8a00b1ab0 2021-04-09T18:33:27.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.761 7fd8a521d700 1 -- 172.21.15.79:0/140954697 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8a00a1cc0 con 0x7fd8a00b1ab0 2021-04-09T18:33:27.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.765 7fd88f7fe700 1 -- 172.21.15.79:0/140954697 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+14229 (secure 0 0 0) 0x7fd890010300 con 0x7fd8a00b1ab0 2021-04-09T18:33:27.769 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:27.769 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":79,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:33:25.320368","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:33:22.552244","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2021-04-09 18:33:23.559196","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:33:27.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.769 7fd8a521d700 1 -- 172.21.15.79:0/140954697 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd884029100 msgr2=0x7fd88402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:27.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.769 7fd8a521d700 1 --2- 172.21.15.79:0/140954697 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd884029100 0x7fd88402b650 crc :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.769 7fd8a521d700 1 -- 172.21.15.79:0/140954697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a00b1ab0 msgr2=0x7fd8a00a8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:27.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.769 7fd8a521d700 1 --2- 172.21.15.79:0/140954697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a00b1ab0 0x7fd8a00a8780 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7fd8a009b3f0 tx=0x7fd89000cae0).stop 2021-04-09T18:33:27.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.769 7fd8a521d700 1 -- 172.21.15.79:0/140954697 shutdown_connections 2021-04-09T18:33:27.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.769 7fd8a521d700 1 --2- 172.21.15.79:0/140954697 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd884029100 0x7fd88402b650 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.769 7fd8a521d700 1 --2- 172.21.15.79:0/140954697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8a01d0240 0x7fd8a01d9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.769 7fd8a521d700 1 --2- 172.21.15.79:0/140954697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a00b1ab0 0x7fd8a00a8780 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.769 7fd8a521d700 1 --2- 172.21.15.79:0/140954697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8a01cfdf0 0x7fd8a00ac780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.769 7fd8a521d700 1 -- 172.21.15.79:0/140954697 >> 172.21.15.79:0/140954697 conn(0x7fd8a009ac40 msgr2=0x7fd8a00ba670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:27.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.769 7fd8a521d700 1 -- 172.21.15.79:0/140954697 shutdown_connections 2021-04-09T18:33:27.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.769 7fd8a521d700 1 -- 172.21.15.79:0/140954697 wait complete. 2021-04-09T18:33:27.781 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:33:22.552244', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:33:23.559196', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:33:27.782 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:33:27.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.881 7f86855fb700 1 Processor -- start 2021-04-09T18:33:27.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.881 7f86855fb700 1 -- start start 2021-04-09T18:33:27.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.881 7f86855fb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f86800f5550 0x7f86800f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:27.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.881 7f86855fb700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86800fbb50 con 0x7f86801c8040 2021-04-09T18:33:27.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.881 7f86855fb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868009f910 con 0x7f86800e9b10 2021-04-09T18:33:27.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.881 7f86855fb700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86800e9f60 con 0x7f86800f5550 2021-04-09T18:33:27.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.881 7f867f247700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f86800f5550 0x7f86800f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:27.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.881 7f867fa48700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f86801c8040 0x7f86801ca4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55262/0 (socket says 172.21.15.79:55262) 2021-04-09T18:33:27.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.881 7f867fa48700 1 -- 172.21.15.79:0/3440787038 learned_addr learned my addr 172.21.15.79:0/3440787038 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:27.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.881 7f867f247700 1 -- 172.21.15.79:0/3440787038 >> v1:172.21.15.89:6789/0 conn(0x7f86800e9b10 legacy=0x7f868009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:27.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.881 7f867f247700 1 -- 172.21.15.79:0/3440787038 >> v1:172.21.15.79:6789/0 conn(0x7f86801c8040 legacy=0x7f86801ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:27.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.881 7f867f247700 1 -- 172.21.15.79:0/3440787038 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86800e5700 con 0x7f86800f5550 2021-04-09T18:33:27.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.881 7f867e245700 1 -- 172.21.15.79:0/3440787038 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173970351 0 0) 0x7f8678001450 con 0x7f86801c8040 2021-04-09T18:33:27.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.885 7f867f247700 1 --2- 172.21.15.79:0/3440787038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86800f5550 0x7f86800f64e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f8668002f30 tx=0x7f866800bcc0).ready entity=mon.0 client_cookie=50ab954d9f012a3f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:27.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.885 7f867e245700 1 -- 172.21.15.79:0/3440787038 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f86800e5700 con 0x7f86800f5550 2021-04-09T18:33:27.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.885 7f867e245700 1 -- 172.21.15.79:0/3440787038 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8668009800 con 0x7f86800f5550 2021-04-09T18:33:27.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.885 7f867e245700 1 -- 172.21.15.79:0/3440787038 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8668009bd0 con 0x7f86800f5550 2021-04-09T18:33:27.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.885 7f86855fb700 1 -- 172.21.15.79:0/3440787038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86800f5550 msgr2=0x7f86800f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:27.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.885 7f86855fb700 1 --2- 172.21.15.79:0/3440787038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86800f5550 0x7f86800f64e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f8668002f30 tx=0x7f866800bcc0).stop 2021-04-09T18:33:27.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.885 7f86855fb700 1 -- 172.21.15.79:0/3440787038 shutdown_connections 2021-04-09T18:33:27.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.885 7f86855fb700 1 --2- 172.21.15.79:0/3440787038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86800f5550 0x7f86800f64e0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.885 7f86855fb700 1 -- 172.21.15.79:0/3440787038 >> 172.21.15.79:0/3440787038 conn(0x7f86800e6010 msgr2=0x7f86800e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:27.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.885 7f86855fb700 1 -- 172.21.15.79:0/3440787038 shutdown_connections 2021-04-09T18:33:27.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.885 7f86855fb700 1 -- 172.21.15.79:0/3440787038 wait complete. 2021-04-09T18:33:27.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.889 7f86855fb700 1 Processor -- start 2021-04-09T18:33:27.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.889 7f86855fb700 1 -- start start 2021-04-09T18:33:27.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.889 7f86855fb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86800bba70 0x7f86800a8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:27.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.889 7f86855fb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86801d0a90 0x7f86801d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:27.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.889 7f86855fb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86800b10f0 0x7f86800b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:27.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.889 7f86855fb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86801c3df0 con 0x7f86800bba70 2021-04-09T18:33:27.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.889 7f86855fb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86800b0df0 con 0x7f86801d0a90 2021-04-09T18:33:27.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.889 7f86855fb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86800bbec0 con 0x7f86800b10f0 2021-04-09T18:33:27.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.889 7f867f247700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86800bba70 0x7f86800a8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:27.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.889 7f867f247700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86800bba70 0x7f86800a8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60554/0 (socket says 172.21.15.79:60554) 2021-04-09T18:33:27.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.889 7f867f247700 1 -- 172.21.15.79:0/2089113438 learned_addr learned my addr 172.21.15.79:0/2089113438 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:27.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.889 7f867fa48700 1 --2- 172.21.15.79:0/2089113438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86800b10f0 0x7f86800b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:27.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.889 7f867ea46700 1 --2- 172.21.15.79:0/2089113438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86801d0a90 0x7f86801d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:27.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.889 7f867f247700 1 -- 172.21.15.79:0/2089113438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86800b10f0 msgr2=0x7f86800b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:27.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.889 7f867f247700 1 --2- 172.21.15.79:0/2089113438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86800b10f0 0x7f86800b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.889 7f867f247700 1 -- 172.21.15.79:0/2089113438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86801d0a90 msgr2=0x7f86801d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:27.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.889 7f867f247700 1 --2- 172.21.15.79:0/2089113438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86801d0a90 0x7f86801d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.889 7f867f247700 1 -- 172.21.15.79:0/2089113438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86800b1b70 con 0x7f86800bba70 2021-04-09T18:33:27.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.893 7f867f247700 1 --2- 172.21.15.79:0/2089113438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86800bba70 0x7f86800a8780 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f86800b0d70 tx=0x7f8668006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:27.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.893 7f8677fff700 1 -- 172.21.15.79:0/2089113438 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f86800b1b70 con 0x7f86800bba70 2021-04-09T18:33:27.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.893 7f86855fb700 1 -- 172.21.15.79:0/2089113438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86800b0980 con 0x7f86800bba70 2021-04-09T18:33:27.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.893 7f8677fff700 1 -- 172.21.15.79:0/2089113438 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866801d450 con 0x7f86800bba70 2021-04-09T18:33:27.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.893 7f8677fff700 1 -- 172.21.15.79:0/2089113438 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8668022020 con 0x7f86800bba70 2021-04-09T18:33:27.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.893 7f86855fb700 1 -- 172.21.15.79:0/2089113438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86800b02b0 con 0x7f86800bba70 2021-04-09T18:33:27.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.893 7f8677fff700 1 -- 172.21.15.79:0/2089113438 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f866801d820 con 0x7f86800bba70 2021-04-09T18:33:27.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.893 7f8677fff700 1 --2- 172.21.15.79:0/2089113438 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8658029100 0x7f865802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:27.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.893 7f8677fff700 1 -- 172.21.15.79:0/2089113438 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f866803c690 con 0x7f86800bba70 2021-04-09T18:33:27.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.893 7f867ea46700 1 --2- 172.21.15.79:0/2089113438 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8658029100 0x7f865802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:27.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.893 7f867ea46700 1 --2- 172.21.15.79:0/2089113438 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8658029100 0x7f865802b650 crc :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:27.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.897 7f86855fb700 1 -- 172.21.15.79:0/2089113438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86800e39f0 con 0x7f86800bba70 2021-04-09T18:33:27.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:27.905 7f8677fff700 1 -- 172.21.15.79:0/2089113438 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8668011dd0 con 0x7f86800bba70 2021-04-09T18:33:28.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.065 7f86855fb700 1 -- 172.21.15.79:0/2089113438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f86800a1c90 con 0x7f86800bba70 2021-04-09T18:33:28.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.065 7f8677fff700 1 -- 172.21.15.79:0/2089113438 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v79) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8668000bf0 con 0x7f86800bba70 2021-04-09T18:33:28.072 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:33:28.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.069 7f86855fb700 1 -- 172.21.15.79:0/2089113438 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8658029100 msgr2=0x7f865802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.069 7f86855fb700 1 --2- 172.21.15.79:0/2089113438 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8658029100 0x7f865802b650 crc :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.069 7f86855fb700 1 -- 172.21.15.79:0/2089113438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86800bba70 msgr2=0x7f86800a8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.069 7f86855fb700 1 --2- 172.21.15.79:0/2089113438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86800bba70 0x7f86800a8780 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f86800b0d70 tx=0x7f8668006890).stop 2021-04-09T18:33:28.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.069 7f86855fb700 1 -- 172.21.15.79:0/2089113438 shutdown_connections 2021-04-09T18:33:28.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.069 7f86855fb700 1 --2- 172.21.15.79:0/2089113438 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8658029100 0x7f865802b650 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.069 7f86855fb700 1 --2- 172.21.15.79:0/2089113438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86800b10f0 0x7f86800b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.069 7f86855fb700 1 --2- 172.21.15.79:0/2089113438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86800bba70 0x7f86800a8780 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.069 7f86855fb700 1 --2- 172.21.15.79:0/2089113438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86801d0a90 0x7f86801d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.069 7f86855fb700 1 -- 172.21.15.79:0/2089113438 >> 172.21.15.79:0/2089113438 conn(0x7f868009abb0 msgr2=0x7f86800acc40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:28.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.073 7f86855fb700 1 -- 172.21.15.79:0/2089113438 shutdown_connections 2021-04-09T18:33:28.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.073 7f86855fb700 1 -- 172.21.15.79:0/2089113438 wait complete. 2021-04-09T18:33:28.085 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:33:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.173 7f9e9fcc4700 1 Processor -- start 2021-04-09T18:33:28.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.173 7f9e9fcc4700 1 -- start start 2021-04-09T18:33:28.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9fcc4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9e980f5550 0x7f9e980f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:28.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9fcc4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e981c8040 0x7f9e981ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9fcc4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e980fbb50 con 0x7f9e980e9b10 2021-04-09T18:33:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9fcc4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e980e9f60 con 0x7f9e980f5550 2021-04-09T18:33:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9fcc4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e981c3df0 con 0x7f9e981c8040 2021-04-09T18:33:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9e269700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e981c8040 0x7f9e981ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9da68700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9e980f5550 0x7f9e980f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9e269700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e981c8040 0x7f9e981ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:57562/0 (socket says 172.21.15.79:57562) 2021-04-09T18:33:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9d267700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9e980e9b10 0x7f9e9809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:55742/0 (socket says 172.21.15.79:55742) 2021-04-09T18:33:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9e269700 1 -- 172.21.15.79:0/3084517009 learned_addr learned my addr 172.21.15.79:0/3084517009 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9e269700 1 -- 172.21.15.79:0/3084517009 >> v2:172.21.15.89:3300/0 conn(0x7f9e980f5550 msgr2=0x7f9e980f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9e269700 1 --2- 172.21.15.79:0/3084517009 >> v2:172.21.15.89:3300/0 conn(0x7f9e980f5550 0x7f9e980f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9e269700 1 -- 172.21.15.79:0/3084517009 >> v1:172.21.15.89:6789/0 conn(0x7f9e980e9b10 legacy=0x7f9e9809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9e269700 1 -- 172.21.15.79:0/3084517009 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9809f910 con 0x7f9e981c8040 2021-04-09T18:33:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9da68700 1 --2- 172.21.15.79:0/3084517009 >> v2:172.21.15.89:3300/0 conn(0x7f9e980f5550 0x7f9e980f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9e269700 1 --2- 172.21.15.79:0/3084517009 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e981c8040 0x7f9e981ca4a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f9e900032b0 tx=0x7f9e9000b3c0).ready entity=mon.2 client_cookie=7c8fb78f8c7b45fe server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9ca66700 1 -- 172.21.15.79:0/3084517009 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9e9809f910 con 0x7f9e981c8040 2021-04-09T18:33:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9ca66700 1 -- 172.21.15.79:0/3084517009 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9000bca0 con 0x7f9e981c8040 2021-04-09T18:33:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9ca66700 1 -- 172.21.15.79:0/3084517009 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9e90002020 con 0x7f9e981c8040 2021-04-09T18:33:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9fcc4700 1 -- 172.21.15.79:0/3084517009 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e981c8040 msgr2=0x7f9e981ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9fcc4700 1 --2- 172.21.15.79:0/3084517009 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e981c8040 0x7f9e981ca4a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f9e900032b0 tx=0x7f9e9000b3c0).stop 2021-04-09T18:33:28.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9fcc4700 1 -- 172.21.15.79:0/3084517009 shutdown_connections 2021-04-09T18:33:28.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9fcc4700 1 --2- 172.21.15.79:0/3084517009 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e981c8040 0x7f9e981ca4a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9fcc4700 1 --2- 172.21.15.79:0/3084517009 >> v2:172.21.15.89:3300/0 conn(0x7f9e980f5550 0x7f9e980f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9fcc4700 1 -- 172.21.15.79:0/3084517009 >> 172.21.15.79:0/3084517009 conn(0x7f9e980e6010 msgr2=0x7f9e980e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:28.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9fcc4700 1 -- 172.21.15.79:0/3084517009 shutdown_connections 2021-04-09T18:33:28.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.177 7f9e9fcc4700 1 -- 172.21.15.79:0/3084517009 wait complete. 2021-04-09T18:33:28.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.181 7f9e9fcc4700 1 Processor -- start 2021-04-09T18:33:28.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.181 7f9e9fcc4700 1 -- start start 2021-04-09T18:33:28.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.181 7f9e9fcc4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e980d5730 0x7f9e980b92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:28.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.181 7f9e9fcc4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e980d5b80 0x7f9e981a6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:28.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.181 7f9e9fcc4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e980b98e0 0x7f9e981a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:28.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.181 7f9e9fcc4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e98088590 con 0x7f9e980d5730 2021-04-09T18:33:28.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.181 7f9e9fcc4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e980b8fb0 con 0x7f9e980b98e0 2021-04-09T18:33:28.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.181 7f9e9fcc4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e980b8b40 con 0x7f9e980d5b80 2021-04-09T18:33:28.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e9da68700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e980d5730 0x7f9e980b92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:28.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e9da68700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e980d5730 0x7f9e980b92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60568/0 (socket says 172.21.15.79:60568) 2021-04-09T18:33:28.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e9da68700 1 -- 172.21.15.79:0/2817112120 learned_addr learned my addr 172.21.15.79:0/2817112120 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:28.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e9d267700 1 --2- 172.21.15.79:0/2817112120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e980d5b80 0x7f9e981a6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:28.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e9e269700 1 --2- 172.21.15.79:0/2817112120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e980b98e0 0x7f9e981a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:28.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e9da68700 1 -- 172.21.15.79:0/2817112120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e980d5b80 msgr2=0x7f9e981a6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e9da68700 1 --2- 172.21.15.79:0/2817112120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e980d5b80 0x7f9e981a6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e9da68700 1 -- 172.21.15.79:0/2817112120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e980b98e0 msgr2=0x7f9e981a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e9da68700 1 --2- 172.21.15.79:0/2817112120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e980b98e0 0x7f9e981a6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e9da68700 1 -- 172.21.15.79:0/2817112120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e98094c00 con 0x7f9e980d5730 2021-04-09T18:33:28.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e9e269700 1 --2- 172.21.15.79:0/2817112120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e980b98e0 0x7f9e981a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:28.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e9da68700 1 --2- 172.21.15.79:0/2817112120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e980d5730 0x7f9e980b92b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f9e9400efc0 tx=0x7f9e9400c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:28.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e8e7fc700 1 -- 172.21.15.79:0/2817112120 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9e98094c00 con 0x7f9e980d5730 2021-04-09T18:33:28.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e8e7fc700 1 -- 172.21.15.79:0/2817112120 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e940123f0 con 0x7f9e980d5730 2021-04-09T18:33:28.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e8e7fc700 1 -- 172.21.15.79:0/2817112120 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9e9400f040 con 0x7f9e980d5730 2021-04-09T18:33:28.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e9fcc4700 1 -- 172.21.15.79:0/2817112120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e980d6110 con 0x7f9e980d5730 2021-04-09T18:33:28.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e9fcc4700 1 -- 172.21.15.79:0/2817112120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e980d65c0 con 0x7f9e980d5730 2021-04-09T18:33:28.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e8e7fc700 1 -- 172.21.15.79:0/2817112120 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9e94011070 con 0x7f9e980d5730 2021-04-09T18:33:28.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e8e7fc700 1 --2- 172.21.15.79:0/2817112120 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9e80029100 0x7f9e8002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:28.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e8e7fc700 1 -- 172.21.15.79:0/2817112120 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f9e94010040 con 0x7f9e980d5730 2021-04-09T18:33:28.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e9d267700 1 --2- 172.21.15.79:0/2817112120 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9e80029100 0x7f9e8002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:28.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.185 7f9e9d267700 1 --2- 172.21.15.79:0/2817112120 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9e80029100 0x7f9e8002b650 crc :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:28.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.189 7f9e9fcc4700 1 -- 172.21.15.79:0/2817112120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e980e39f0 con 0x7f9e980d5730 2021-04-09T18:33:28.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.193 7f9e8e7fc700 1 -- 172.21.15.79:0/2817112120 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9e9400ca90 con 0x7f9e980d5730 2021-04-09T18:33:28.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.349 7f9e9fcc4700 1 -- 172.21.15.79:0/2817112120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f9e980f5b50 con 0x7f9e980d5730 2021-04-09T18:33:28.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.349 7f9e8e7fc700 1 -- 172.21.15.79:0/2817112120 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v79) v1 ==== 104+0+10 (secure 0 0 0) 0x7f9e94000bf0 con 0x7f9e980d5730 2021-04-09T18:33:28.354 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:33:28.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.353 7f9e9fcc4700 1 -- 172.21.15.79:0/2817112120 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9e80029100 msgr2=0x7f9e8002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.353 7f9e9fcc4700 1 --2- 172.21.15.79:0/2817112120 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9e80029100 0x7f9e8002b650 crc :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.353 7f9e9fcc4700 1 -- 172.21.15.79:0/2817112120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e980d5730 msgr2=0x7f9e980b92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.353 7f9e9fcc4700 1 --2- 172.21.15.79:0/2817112120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e980d5730 0x7f9e980b92b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f9e9400efc0 tx=0x7f9e9400c430).stop 2021-04-09T18:33:28.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.353 7f9e9fcc4700 1 -- 172.21.15.79:0/2817112120 shutdown_connections 2021-04-09T18:33:28.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.353 7f9e9fcc4700 1 --2- 172.21.15.79:0/2817112120 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9e80029100 0x7f9e8002b650 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.353 7f9e9fcc4700 1 --2- 172.21.15.79:0/2817112120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e980b98e0 0x7f9e981a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.353 7f9e9fcc4700 1 --2- 172.21.15.79:0/2817112120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e980d5730 0x7f9e980b92b0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.353 7f9e9fcc4700 1 --2- 172.21.15.79:0/2817112120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e980d5b80 0x7f9e981a6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.353 7f9e9fcc4700 1 -- 172.21.15.79:0/2817112120 >> 172.21.15.79:0/2817112120 conn(0x7f9e980d3cb0 msgr2=0x7f9e980d77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:28.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.353 7f9e9fcc4700 1 -- 172.21.15.79:0/2817112120 shutdown_connections 2021-04-09T18:33:28.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.353 7f9e9fcc4700 1 -- 172.21.15.79:0/2817112120 wait complete. 2021-04-09T18:33:28.366 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:33:28.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.453 7f7949732700 1 Processor -- start 2021-04-09T18:33:28.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.453 7f7949732700 1 -- start start 2021-04-09T18:33:28.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.453 7f7949732700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f79440f5550 0x7f79440f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:28.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.453 7f7949732700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79440fbb50 con 0x7f79441c8040 2021-04-09T18:33:28.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.453 7f7949732700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794409f910 con 0x7f79440e9b10 2021-04-09T18:33:28.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.453 7f7949732700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79440e9f60 con 0x7f79440f5550 2021-04-09T18:33:28.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.453 7f7943a48700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f79441c8040 0x7f79441ca4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55290/0 (socket says 172.21.15.79:55290) 2021-04-09T18:33:28.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.453 7f7943a48700 1 -- 172.21.15.79:0/3859480248 learned_addr learned my addr 172.21.15.79:0/3859480248 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:28.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.457 7f7943247700 1 --2- 172.21.15.79:0/3859480248 >> v2:172.21.15.89:3300/0 conn(0x7f79440f5550 0x7f79440f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:28.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.457 7f7942245700 1 -- 172.21.15.79:0/3859480248 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2658482764 0 0) 0x7f7934001450 con 0x7f79441c8040 2021-04-09T18:33:28.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.457 7f7942245700 1 -- 172.21.15.79:0/3859480248 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7930003240 con 0x7f79441c8040 2021-04-09T18:33:28.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.457 7f7943247700 1 -- 172.21.15.79:0/3859480248 >> v1:172.21.15.89:6789/0 conn(0x7f79440e9b10 legacy=0x7f794409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.457 7f7943247700 1 -- 172.21.15.79:0/3859480248 >> v1:172.21.15.79:6789/0 conn(0x7f79441c8040 legacy=0x7f79441ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.457 7f7943247700 1 -- 172.21.15.79:0/3859480248 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79440e5700 con 0x7f79440f5550 2021-04-09T18:33:28.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.457 7f7943247700 1 --2- 172.21.15.79:0/3859480248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79440f5550 0x7f79440f64e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f793c002f30 tx=0x7f793c00bcc0).ready entity=mon.1 client_cookie=9812599ed92cac7e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:28.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.457 7f7942245700 1 -- 172.21.15.79:0/3859480248 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f79440e5700 con 0x7f79440f5550 2021-04-09T18:33:28.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.457 7f7942245700 1 -- 172.21.15.79:0/3859480248 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c009800 con 0x7f79440f5550 2021-04-09T18:33:28.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.457 7f7942245700 1 -- 172.21.15.79:0/3859480248 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f793c009bd0 con 0x7f79440f5550 2021-04-09T18:33:28.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.457 7f7949732700 1 -- 172.21.15.79:0/3859480248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79440f5550 msgr2=0x7f79440f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.457 7f7949732700 1 --2- 172.21.15.79:0/3859480248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79440f5550 0x7f79440f64e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f793c002f30 tx=0x7f793c00bcc0).stop 2021-04-09T18:33:28.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.457 7f7949732700 1 -- 172.21.15.79:0/3859480248 shutdown_connections 2021-04-09T18:33:28.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.457 7f7949732700 1 --2- 172.21.15.79:0/3859480248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79440f5550 0x7f79440f64e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.457 7f7949732700 1 -- 172.21.15.79:0/3859480248 >> 172.21.15.79:0/3859480248 conn(0x7f79440e6010 msgr2=0x7f79440e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:28.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.457 7f7949732700 1 -- 172.21.15.79:0/3859480248 shutdown_connections 2021-04-09T18:33:28.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.457 7f7949732700 1 -- 172.21.15.79:0/3859480248 wait complete. 2021-04-09T18:33:28.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7949732700 1 Processor -- start 2021-04-09T18:33:28.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7949732700 1 -- start start 2021-04-09T18:33:28.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7949732700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7944099290 0x7f79440996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:28.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7949732700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79440c6e70 0x7f79440c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:28.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7949732700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79440c78f0 0x7f7944095f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:28.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7949732700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79441c3df0 con 0x7f7944099290 2021-04-09T18:33:28.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7949732700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79440b0a10 con 0x7f79440c78f0 2021-04-09T18:33:28.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7949732700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7944097d10 con 0x7f79440c6e70 2021-04-09T18:33:28.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7943247700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7944099290 0x7f79440996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:28.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7943247700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7944099290 0x7f79440996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60584/0 (socket says 172.21.15.79:60584) 2021-04-09T18:33:28.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7943247700 1 -- 172.21.15.79:0/61398237 learned_addr learned my addr 172.21.15.79:0/61398237 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:28.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7942a46700 1 --2- 172.21.15.79:0/61398237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79440c6e70 0x7f79440c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:28.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7943a48700 1 --2- 172.21.15.79:0/61398237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79440c78f0 0x7f7944095f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:28.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7943247700 1 -- 172.21.15.79:0/61398237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79440c6e70 msgr2=0x7f79440c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7943247700 1 --2- 172.21.15.79:0/61398237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79440c6e70 0x7f79440c72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7943247700 1 -- 172.21.15.79:0/61398237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79440c78f0 msgr2=0x7f7944095f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7943247700 1 --2- 172.21.15.79:0/61398237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79440c78f0 0x7f7944095f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7943247700 1 -- 172.21.15.79:0/61398237 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7944097560 con 0x7f7944099290 2021-04-09T18:33:28.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7943247700 1 --2- 172.21.15.79:0/61398237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7944099290 0x7f79440996e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f793c002f30 tx=0x7f793c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:28.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f793bfff700 1 -- 172.21.15.79:0/61398237 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7944097560 con 0x7f7944099290 2021-04-09T18:33:28.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f793bfff700 1 -- 172.21.15.79:0/61398237 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c01a570 con 0x7f7944099290 2021-04-09T18:33:28.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f793bfff700 1 -- 172.21.15.79:0/61398237 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f793c01a940 con 0x7f7944099290 2021-04-09T18:33:28.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7949732700 1 -- 172.21.15.79:0/61398237 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7944097140 con 0x7f7944099290 2021-04-09T18:33:28.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.461 7f7949732700 1 -- 172.21.15.79:0/61398237 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7944096700 con 0x7f7944099290 2021-04-09T18:33:28.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.465 7f793bfff700 1 -- 172.21.15.79:0/61398237 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f793c01ab40 con 0x7f7944099290 2021-04-09T18:33:28.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.465 7f793bfff700 1 --2- 172.21.15.79:0/61398237 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7928029100 0x7f792802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:28.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.465 7f793bfff700 1 -- 172.21.15.79:0/61398237 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f793c03b440 con 0x7f7944099290 2021-04-09T18:33:28.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.465 7f7942a46700 1 --2- 172.21.15.79:0/61398237 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7928029100 0x7f792802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:28.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.465 7f7942a46700 1 --2- 172.21.15.79:0/61398237 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7928029100 0x7f792802b650 crc :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:28.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.469 7f7949732700 1 -- 172.21.15.79:0/61398237 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79440e39f0 con 0x7f7944099290 2021-04-09T18:33:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.477 7f793bfff700 1 -- 172.21.15.79:0/61398237 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f793c0095f0 con 0x7f7944099290 2021-04-09T18:33:28.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.641 7f7949732700 1 -- 172.21.15.79:0/61398237 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f79440a1c90 con 0x7f7944099290 2021-04-09T18:33:28.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.645 7f793bfff700 1 -- 172.21.15.79:0/61398237 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v79) v1 ==== 100+0+10 (secure 0 0 0) 0x7f793c01a360 con 0x7f7944099290 2021-04-09T18:33:28.647 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:33:28.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.645 7f7949732700 1 -- 172.21.15.79:0/61398237 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7928029100 msgr2=0x7f792802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.645 7f7949732700 1 --2- 172.21.15.79:0/61398237 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7928029100 0x7f792802b650 crc :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.645 7f7949732700 1 -- 172.21.15.79:0/61398237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7944099290 msgr2=0x7f79440996e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.645 7f7949732700 1 --2- 172.21.15.79:0/61398237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7944099290 0x7f79440996e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f793c002f30 tx=0x7f793c006890).stop 2021-04-09T18:33:28.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.645 7f7949732700 1 -- 172.21.15.79:0/61398237 shutdown_connections 2021-04-09T18:33:28.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.645 7f7949732700 1 --2- 172.21.15.79:0/61398237 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7928029100 0x7f792802b650 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.645 7f7949732700 1 --2- 172.21.15.79:0/61398237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79440c78f0 0x7f7944095f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.645 7f7949732700 1 --2- 172.21.15.79:0/61398237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7944099290 0x7f79440996e0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.645 7f7949732700 1 --2- 172.21.15.79:0/61398237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79440c6e70 0x7f79440c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.645 7f7949732700 1 -- 172.21.15.79:0/61398237 >> 172.21.15.79:0/61398237 conn(0x7f79440a3090 msgr2=0x7f79440ba790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:28.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.645 7f7949732700 1 -- 172.21.15.79:0/61398237 shutdown_connections 2021-04-09T18:33:28.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.645 7f7949732700 1 -- 172.21.15.79:0/61398237 wait complete. 2021-04-09T18:33:28.659 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:33:28.660 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:28.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.749 7f3243f48700 1 Processor -- start 2021-04-09T18:33:28.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.749 7f3243f48700 1 -- start start 2021-04-09T18:33:28.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.749 7f3243f48700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f323c0f5510 0x7f323c0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:28.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.749 7f3243f48700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f323c1c8000 0x7f323c1ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:28.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.749 7f3243f48700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323c0fbb10 con 0x7f323c0e9ad0 2021-04-09T18:33:28.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.749 7f3243f48700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323c0e9f20 con 0x7f323c1c8000 2021-04-09T18:33:28.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.749 7f3243f48700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323c1c3db0 con 0x7f323c0f5510 2021-04-09T18:33:28.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.749 7f32414eb700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f323c0e9ad0 0x7f323c09f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55302/0 (socket says 172.21.15.79:55302) 2021-04-09T18:33:28.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.749 7f32414eb700 1 -- 172.21.15.79:0/1926429440 learned_addr learned my addr 172.21.15.79:0/1926429440 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:28.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.749 7f32424ed700 1 --2- 172.21.15.79:0/1926429440 >> v2:172.21.15.79:3300/0 conn(0x7f323c1c8000 0x7f323c1ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:28.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.749 7f3241cec700 1 --2- 172.21.15.79:0/1926429440 >> v2:172.21.15.89:3300/0 conn(0x7f323c0f5510 0x7f323c0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:28.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.749 7f32424ed700 1 -- 172.21.15.79:0/1926429440 >> v2:172.21.15.89:3300/0 conn(0x7f323c0f5510 msgr2=0x7f323c0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:28.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.749 7f32424ed700 1 --2- 172.21.15.79:0/1926429440 >> v2:172.21.15.89:3300/0 conn(0x7f323c0f5510 0x7f323c0f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.749 7f32424ed700 1 -- 172.21.15.79:0/1926429440 >> v1:172.21.15.79:6789/0 conn(0x7f323c0e9ad0 legacy=0x7f323c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.749 7f3240cea700 1 -- 172.21.15.79:0/1926429440 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593193475 0 0) 0x7f322c0010d0 con 0x7f323c0e9ad0 2021-04-09T18:33:28.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.749 7f32424ed700 1 -- 172.21.15.79:0/1926429440 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c09f900 con 0x7f323c1c8000 2021-04-09T18:33:28.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.749 7f32424ed700 1 --2- 172.21.15.79:0/1926429440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f323c1c8000 0x7f323c1ca460 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f32340032b0 tx=0x7f323400b3c0).ready entity=mon.0 client_cookie=1f3f6fed7e9d44db server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:28.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.753 7f3240cea700 1 -- 172.21.15.79:0/1926429440 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f323c09f900 con 0x7f323c1c8000 2021-04-09T18:33:28.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.753 7f3240cea700 1 -- 172.21.15.79:0/1926429440 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323400bc20 con 0x7f323c1c8000 2021-04-09T18:33:28.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.753 7f3240cea700 1 -- 172.21.15.79:0/1926429440 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3234002020 con 0x7f323c1c8000 2021-04-09T18:33:28.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.753 7f3243f48700 1 -- 172.21.15.79:0/1926429440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f323c1c8000 msgr2=0x7f323c1ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.753 7f3243f48700 1 --2- 172.21.15.79:0/1926429440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f323c1c8000 0x7f323c1ca460 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f32340032b0 tx=0x7f323400b3c0).stop 2021-04-09T18:33:28.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.753 7f3243f48700 1 -- 172.21.15.79:0/1926429440 shutdown_connections 2021-04-09T18:33:28.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.753 7f3243f48700 1 --2- 172.21.15.79:0/1926429440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f323c1c8000 0x7f323c1ca460 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.753 7f3243f48700 1 --2- 172.21.15.79:0/1926429440 >> v2:172.21.15.89:3300/0 conn(0x7f323c0f5510 0x7f323c0f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.753 7f3243f48700 1 -- 172.21.15.79:0/1926429440 >> 172.21.15.79:0/1926429440 conn(0x7f323c0e5fd0 msgr2=0x7f323c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:28.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.753 7f3243f48700 1 -- 172.21.15.79:0/1926429440 shutdown_connections 2021-04-09T18:33:28.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.753 7f3243f48700 1 -- 172.21.15.79:0/1926429440 wait complete. 2021-04-09T18:33:28.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f3243f48700 1 Processor -- start 2021-04-09T18:33:28.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f3243f48700 1 -- start start 2021-04-09T18:33:28.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f3243f48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f323c0b9da0 0x7f323c08feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:28.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f3243f48700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f323c0904e0 0x7f323c090930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:28.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f3243f48700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f323c1aa5d0 0x7f323c1aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:28.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f3243f48700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c0ba510 con 0x7f323c0b9da0 2021-04-09T18:33:28.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f3243f48700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c0ba1f0 con 0x7f323c1aa5d0 2021-04-09T18:33:28.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f3243f48700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c0ba810 con 0x7f323c0904e0 2021-04-09T18:33:28.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f3241cec700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f323c0b9da0 0x7f323c08feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:28.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f3241cec700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f323c0b9da0 0x7f323c08feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60596/0 (socket says 172.21.15.79:60596) 2021-04-09T18:33:28.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f3241cec700 1 -- 172.21.15.79:0/2450588542 learned_addr learned my addr 172.21.15.79:0/2450588542 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:28.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f32424ed700 1 --2- 172.21.15.79:0/2450588542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f323c1aa5d0 0x7f323c1aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:28.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f32414eb700 1 --2- 172.21.15.79:0/2450588542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f323c0904e0 0x7f323c090930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:28.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f3241cec700 1 -- 172.21.15.79:0/2450588542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f323c0904e0 msgr2=0x7f323c090930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f3241cec700 1 --2- 172.21.15.79:0/2450588542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f323c0904e0 0x7f323c090930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f3241cec700 1 -- 172.21.15.79:0/2450588542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f323c1aa5d0 msgr2=0x7f323c1aaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f3241cec700 1 --2- 172.21.15.79:0/2450588542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f323c1aa5d0 0x7f323c1aaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f3241cec700 1 -- 172.21.15.79:0/2450588542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c1ab050 con 0x7f323c0b9da0 2021-04-09T18:33:28.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f32414eb700 1 --2- 172.21.15.79:0/2450588542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f323c0904e0 0x7f323c090930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:28.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f32424ed700 1 --2- 172.21.15.79:0/2450588542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f323c1aa5d0 0x7f323c1aaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:28.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f3241cec700 1 --2- 172.21.15.79:0/2450588542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f323c0b9da0 0x7f323c08feb0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f323c0d4880 tx=0x7f323800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:28.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f32327fc700 1 -- 172.21.15.79:0/2450588542 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f323c1ab050 con 0x7f323c0b9da0 2021-04-09T18:33:28.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f32327fc700 1 -- 172.21.15.79:0/2450588542 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323800cd60 con 0x7f323c0b9da0 2021-04-09T18:33:28.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f32327fc700 1 -- 172.21.15.79:0/2450588542 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f323800f040 con 0x7f323c0b9da0 2021-04-09T18:33:28.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f3243f48700 1 -- 172.21.15.79:0/2450588542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323c1ab370 con 0x7f323c0b9da0 2021-04-09T18:33:28.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f3243f48700 1 -- 172.21.15.79:0/2450588542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323c1a6190 con 0x7f323c0b9da0 2021-04-09T18:33:28.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f32327fc700 1 -- 172.21.15.79:0/2450588542 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3238011070 con 0x7f323c0b9da0 2021-04-09T18:33:28.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f32327fc700 1 --2- 172.21.15.79:0/2450588542 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3224029100 0x7f322402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:28.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.757 7f32327fc700 1 -- 172.21.15.79:0/2450588542 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f3238010040 con 0x7f323c0b9da0 2021-04-09T18:33:28.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.761 7f32414eb700 1 --2- 172.21.15.79:0/2450588542 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3224029100 0x7f322402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:28.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.761 7f32414eb700 1 --2- 172.21.15.79:0/2450588542 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3224029100 0x7f322402b650 crc :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:28.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.761 7f3243f48700 1 -- 172.21.15.79:0/2450588542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323c0e39d0 con 0x7f323c0b9da0 2021-04-09T18:33:28.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.765 7f32327fc700 1 -- 172.21.15.79:0/2450588542 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f323800c960 con 0x7f323c0b9da0 2021-04-09T18:33:28.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.929 7f3243f48700 1 -- 172.21.15.79:0/2450588542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f323c0f5b10 con 0x7f323c0b9da0 2021-04-09T18:33:28.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.929 7f32327fc700 1 -- 172.21.15.79:0/2450588542 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2103 (secure 0 0 0) 0x7f3238000bf0 con 0x7f323c0b9da0 2021-04-09T18:33:28.936 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:28.936 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":47,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6510,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/4230183300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4230183300},{"type":"v1","addr":"172.21.15.79:6833","nonce":4230183300}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:33:24.317443","modified":"2021-04-09 18:33:25.319829","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5837},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5837":{"gid":5837,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/1825266006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1825266006},{"type":"v1","addr":"172.21.15.89:6835","nonce":1825266006}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-04-09T18:33:28.937 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 47 2021-04-09T18:33:28.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.933 7f3243f48700 1 -- 172.21.15.79:0/2450588542 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3224029100 msgr2=0x7f322402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.933 7f3243f48700 1 --2- 172.21.15.79:0/2450588542 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3224029100 0x7f322402b650 crc :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.933 7f3243f48700 1 -- 172.21.15.79:0/2450588542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f323c0b9da0 msgr2=0x7f323c08feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:28.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.933 7f3243f48700 1 --2- 172.21.15.79:0/2450588542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f323c0b9da0 0x7f323c08feb0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f323c0d4880 tx=0x7f323800c430).stop 2021-04-09T18:33:28.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.933 7f3243f48700 1 -- 172.21.15.79:0/2450588542 shutdown_connections 2021-04-09T18:33:28.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.933 7f3243f48700 1 --2- 172.21.15.79:0/2450588542 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3224029100 0x7f322402b650 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.933 7f3243f48700 1 --2- 172.21.15.79:0/2450588542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f323c1aa5d0 0x7f323c1aaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.933 7f3243f48700 1 --2- 172.21.15.79:0/2450588542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f323c0b9da0 0x7f323c08feb0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.933 7f3243f48700 1 --2- 172.21.15.79:0/2450588542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f323c0904e0 0x7f323c090930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:28.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.933 7f3243f48700 1 -- 172.21.15.79:0/2450588542 >> 172.21.15.79:0/2450588542 conn(0x7f323c0d4ac0 msgr2=0x7f323c092a50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:28.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.937 7f3243f48700 1 -- 172.21.15.79:0/2450588542 shutdown_connections 2021-04-09T18:33:28.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:28.937 7f3243f48700 1 -- 172.21.15.79:0/2450588542 wait complete. 2021-04-09T18:33:29.150 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:33:24.317443', 'modified': '2021-04-09 18:33:25.319829', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5837}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5837': {'gid': 5837, 'name': 'b', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6835/1825266006', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 1825266006}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 1825266006}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:33:29.151 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:33:29.151 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2021-04-09T18:33:29.247 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:33:29.247 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:33:29.248 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2021-04-09T18:33:29.248 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 5837, 2021-04-09T18:33:29.248 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2021-04-09T18:33:29.248 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2021-04-09T18:33:29.249 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 4.9236229649999999, 2021-04-09T18:33:29.249 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 47, 2021-04-09T18:33:29.249 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 79, 2021-04-09T18:33:29.249 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 78, 2021-04-09T18:33:29.250 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 9.3078727509999997 2021-04-09T18:33:29.250 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:33:29.254 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 5837, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.9236229649999999, "mdsmap_epoch": 47, "osdmap_epoch": 79, "osdmap_epoch_barrier": 78, "uptime": 9.3078727509999997 } 2021-04-09T18:33:29.254 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:33:29.254 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-04-09T18:33:29.255 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi090.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-04-09T18:33:29.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:29.256 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:29.265 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:33:29.321 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:33:29.322 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:33:29.376 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:33:29.379 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:33:29.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:29.382 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:33:29.427 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:33:29.428 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:29.471 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:33:29.488 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:33:29.489 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:33:29.544 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:33:29.545 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:33:29.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:29.547 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:33:29.551 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:2021-04-09 18:33:29.548 7ff4535580c0 -1 init, newargv = 0x564b46b7a710 newargc=9 2021-04-09T18:33:29.551 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13783]: starting ceph client 2021-04-09T18:33:29.559 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13783]: starting fuse 2021-04-09T18:33:30.657 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:33:30.674 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:33:30.675 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:33:30.732 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:33:30.733 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:33:30.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:30.734 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:33:30.784 INFO:teuthology.orchestra.run.smithi090.stdout:49 2021-04-09T18:33:30.785 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:33:30.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:30.786 DEBUG:teuthology.orchestra.run.smithi090:> sudo python3 -c ' 2021-04-09T18:33:30.786 DEBUG:teuthology.orchestra.run.smithi090:> import glob 2021-04-09T18:33:30.788 DEBUG:teuthology.orchestra.run.smithi090:> import re 2021-04-09T18:33:30.789 DEBUG:teuthology.orchestra.run.smithi090:> import os 2021-04-09T18:33:30.789 DEBUG:teuthology.orchestra.run.smithi090:> import subprocess 2021-04-09T18:33:30.789 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:33:30.790 DEBUG:teuthology.orchestra.run.smithi090:> def find_socket(client_name): 2021-04-09T18:33:30.790 DEBUG:teuthology.orchestra.run.smithi090:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-04-09T18:33:30.791 DEBUG:teuthology.orchestra.run.smithi090:> files = glob.glob(asok_path) 2021-04-09T18:33:30.791 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:33:30.791 DEBUG:teuthology.orchestra.run.smithi090:> # Given a non-glob path, it better be there 2021-04-09T18:33:30.792 DEBUG:teuthology.orchestra.run.smithi090:> if "*" not in asok_path: 2021-04-09T18:33:30.792 DEBUG:teuthology.orchestra.run.smithi090:> assert(len(files) == 1) 2021-04-09T18:33:30.792 DEBUG:teuthology.orchestra.run.smithi090:> return files[0] 2021-04-09T18:33:30.793 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:33:30.793 DEBUG:teuthology.orchestra.run.smithi090:> for f in files: 2021-04-09T18:33:30.794 DEBUG:teuthology.orchestra.run.smithi090:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:33:30.794 DEBUG:teuthology.orchestra.run.smithi090:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:33:30.794 DEBUG:teuthology.orchestra.run.smithi090:> return f 2021-04-09T18:33:30.795 DEBUG:teuthology.orchestra.run.smithi090:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:33:30.795 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:33:30.796 DEBUG:teuthology.orchestra.run.smithi090:> print(find_socket("client.0")) 2021-04-09T18:33:30.796 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:33:30.873 INFO:teuthology.orchestra.run.smithi090.stdout:/var/run/ceph/ceph-client.0.13783.asok 2021-04-09T18:33:30.878 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13783.asok 2021-04-09T18:33:30.878 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:30.879 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13783.asok status 2021-04-09T18:33:30.954 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2021-04-09T18:33:30.954 INFO:teuthology.orchestra.run.smithi090.stdout: "metadata": { 2021-04-09T18:33:30.954 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:33:30.955 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:33:30.955 INFO:teuthology.orchestra.run.smithi090.stdout: "entity_id": "0", 2021-04-09T18:33:30.955 INFO:teuthology.orchestra.run.smithi090.stdout: "hostname": "smithi090", 2021-04-09T18:33:30.955 INFO:teuthology.orchestra.run.smithi090.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-04-09T18:33:30.955 INFO:teuthology.orchestra.run.smithi090.stdout: "pid": "13783", 2021-04-09T18:33:30.956 INFO:teuthology.orchestra.run.smithi090.stdout: "root": "/" 2021-04-09T18:33:30.956 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:33:30.956 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_count": 0, 2021-04-09T18:33:30.956 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_pinned_count": 0, 2021-04-09T18:33:30.957 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 5945, 2021-04-09T18:33:30.957 INFO:teuthology.orchestra.run.smithi090.stdout: "inst": { 2021-04-09T18:33:30.957 INFO:teuthology.orchestra.run.smithi090.stdout: "name": { 2021-04-09T18:33:30.957 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "client", 2021-04-09T18:33:30.957 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5945 2021-04-09T18:33:30.958 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:33:30.958 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:33:30.958 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:33:30.958 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:33:30.958 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 626731956 2021-04-09T18:33:30.959 INFO:teuthology.orchestra.run.smithi090.stdout: } 2021-04-09T18:33:30.959 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:33:30.959 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:33:30.959 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:33:30.960 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:33:30.960 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 626731956 2021-04-09T18:33:30.960 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:33:30.960 INFO:teuthology.orchestra.run.smithi090.stdout: "inst_str": "client.5945 172.21.15.90:0/626731956", 2021-04-09T18:33:30.960 INFO:teuthology.orchestra.run.smithi090.stdout: "addr_str": "172.21.15.90:0/626731956", 2021-04-09T18:33:30.961 INFO:teuthology.orchestra.run.smithi090.stdout: "inode_count": 1, 2021-04-09T18:33:30.961 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_epoch": 47, 2021-04-09T18:33:30.961 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch": 79, 2021-04-09T18:33:30.961 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:33:30.961 INFO:teuthology.orchestra.run.smithi090.stdout: "blacklisted": false, 2021-04-09T18:33:30.962 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs" 2021-04-09T18:33:30.962 INFO:teuthology.orchestra.run.smithi090.stdout:} 2021-04-09T18:33:30.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:30.964 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:30.964 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:30.971 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:33:30.973 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:33:30.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:30.974 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:31.031 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:33:31.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.129 7f7d2b599700 1 Processor -- start 2021-04-09T18:33:31.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.129 7f7d2b599700 1 -- start start 2021-04-09T18:33:31.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.129 7f7d2b599700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d240f5510 0x7f7d240f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:31.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.129 7f7d2b599700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d240e9ad0 0x7f7d2409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:31.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.129 7f7d2b599700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d240fbb10 con 0x7f7d241c2da0 2021-04-09T18:33:31.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.129 7f7d2b599700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d240e9f20 con 0x7f7d240f5510 2021-04-09T18:33:31.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.129 7f7d2b599700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d240e59c0 con 0x7f7d240e9ad0 2021-04-09T18:33:31.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.129 7f7d28b3c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d240e9ad0 0x7f7d2409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:31.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.129 7f7d2933d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d240f5510 0x7f7d240f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:31.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.129 7f7d28b3c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d240e9ad0 0x7f7d2409f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:57602/0 (socket says 172.21.15.79:57602) 2021-04-09T18:33:31.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.129 7f7d28b3c700 1 -- 172.21.15.79:0/1144060294 learned_addr learned my addr 172.21.15.79:0/1144060294 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:31.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.129 7f7d29b3e700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7d241c2da0 0x7f7d241c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:55788/0 (socket says 172.21.15.79:55788) 2021-04-09T18:33:31.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.129 7f7d2933d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d240f5510 0x7f7d240f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:48946/0 (socket says 172.21.15.79:48946) 2021-04-09T18:33:31.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.129 7f7d28b3c700 1 -- 172.21.15.79:0/1144060294 >> v2:172.21.15.89:3300/0 conn(0x7f7d240f5510 msgr2=0x7f7d240f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:31.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.129 7f7d28b3c700 1 --2- 172.21.15.79:0/1144060294 >> v2:172.21.15.89:3300/0 conn(0x7f7d240f5510 0x7f7d240f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.129 7f7d28b3c700 1 -- 172.21.15.79:0/1144060294 >> v1:172.21.15.89:6789/0 conn(0x7f7d241c2da0 legacy=0x7f7d241c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:31.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.129 7f7d28b3c700 1 -- 172.21.15.79:0/1144060294 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d240e56c0 con 0x7f7d240e9ad0 2021-04-09T18:33:31.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.129 7f7d1bfff700 1 -- 172.21.15.79:0/1144060294 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838439949 0 0) 0x7f7d1c001450 con 0x7f7d241c2da0 2021-04-09T18:33:31.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.129 7f7d2933d700 1 --2- 172.21.15.79:0/1144060294 >> v2:172.21.15.89:3300/0 conn(0x7f7d240f5510 0x7f7d240f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:31.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.129 7f7d28b3c700 1 --2- 172.21.15.79:0/1144060294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d240e9ad0 0x7f7d2409f100 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f7d14002f30 tx=0x7f7d1400bd20).ready entity=mon.2 client_cookie=d45153b47d5af9f3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:31.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.133 7f7d1bfff700 1 -- 172.21.15.79:0/1144060294 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7d240e56c0 con 0x7f7d240e9ad0 2021-04-09T18:33:31.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.133 7f7d1bfff700 1 -- 172.21.15.79:0/1144060294 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d14009980 con 0x7f7d240e9ad0 2021-04-09T18:33:31.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.133 7f7d1bfff700 1 -- 172.21.15.79:0/1144060294 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7d14009d50 con 0x7f7d240e9ad0 2021-04-09T18:33:31.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.133 7f7d2b599700 1 -- 172.21.15.79:0/1144060294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d240e9ad0 msgr2=0x7f7d2409f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:31.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.133 7f7d2b599700 1 --2- 172.21.15.79:0/1144060294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d240e9ad0 0x7f7d2409f100 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f7d14002f30 tx=0x7f7d1400bd20).stop 2021-04-09T18:33:31.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.133 7f7d2b599700 1 -- 172.21.15.79:0/1144060294 shutdown_connections 2021-04-09T18:33:31.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.133 7f7d2b599700 1 --2- 172.21.15.79:0/1144060294 >> v2:172.21.15.89:3300/0 conn(0x7f7d240f5510 0x7f7d240f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.133 7f7d2b599700 1 --2- 172.21.15.79:0/1144060294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d240e9ad0 0x7f7d2409f100 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.133 7f7d2b599700 1 -- 172.21.15.79:0/1144060294 >> 172.21.15.79:0/1144060294 conn(0x7f7d240e5fd0 msgr2=0x7f7d240e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:31.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.133 7f7d2b599700 1 -- 172.21.15.79:0/1144060294 shutdown_connections 2021-04-09T18:33:31.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.133 7f7d2b599700 1 -- 172.21.15.79:0/1144060294 wait complete. 2021-04-09T18:33:31.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.137 7f7d2b599700 1 Processor -- start 2021-04-09T18:33:31.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.137 7f7d2b599700 1 -- start start 2021-04-09T18:33:31.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.137 7f7d2b599700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d240d6a80 0x7f7d240b9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:31.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.137 7f7d2b599700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d241a7f40 0x7f7d24094010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:31.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.137 7f7d2b599700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d24094640 0x7f7d24099aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:31.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.137 7f7d2b599700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d240d5500 con 0x7f7d24094640 2021-04-09T18:33:31.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.137 7f7d2b599700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2409abe0 con 0x7f7d240d6a80 2021-04-09T18:33:31.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.137 7f7d2b599700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d24095050 con 0x7f7d241a7f40 2021-04-09T18:33:31.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.137 7f7d29b3e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d24094640 0x7f7d24099aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:31.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.137 7f7d29b3e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d24094640 0x7f7d24099aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60612/0 (socket says 172.21.15.79:60612) 2021-04-09T18:33:31.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.137 7f7d29b3e700 1 -- 172.21.15.79:0/1175111203 learned_addr learned my addr 172.21.15.79:0/1175111203 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:31.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.137 7f7d28b3c700 1 --2- 172.21.15.79:0/1175111203 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d241a7f40 0x7f7d24094010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:31.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.137 7f7d2933d700 1 --2- 172.21.15.79:0/1175111203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d240d6a80 0x7f7d240b9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:31.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.137 7f7d29b3e700 1 -- 172.21.15.79:0/1175111203 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d241a7f40 msgr2=0x7f7d24094010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:31.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.137 7f7d29b3e700 1 --2- 172.21.15.79:0/1175111203 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d241a7f40 0x7f7d24094010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.137 7f7d29b3e700 1 -- 172.21.15.79:0/1175111203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d240d6a80 msgr2=0x7f7d240b9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:31.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.137 7f7d29b3e700 1 --2- 172.21.15.79:0/1175111203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d240d6a80 0x7f7d240b9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.137 7f7d29b3e700 1 -- 172.21.15.79:0/1175111203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d241a8390 con 0x7f7d24094640 2021-04-09T18:33:31.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.137 7f7d2933d700 1 --2- 172.21.15.79:0/1175111203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d240d6a80 0x7f7d240b9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:31.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.141 7f7d29b3e700 1 --2- 172.21.15.79:0/1175111203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d24094640 0x7f7d24099aa0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f7d240b9a30 tx=0x7f7d1c00cee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:31.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.141 7f7d19ffb700 1 -- 172.21.15.79:0/1175111203 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7d241a8390 con 0x7f7d24094640 2021-04-09T18:33:31.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.141 7f7d19ffb700 1 -- 172.21.15.79:0/1175111203 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1c005ac0 con 0x7f7d24094640 2021-04-09T18:33:31.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.141 7f7d2b599700 1 -- 172.21.15.79:0/1175111203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d2409a0d0 con 0x7f7d24094640 2021-04-09T18:33:31.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.141 7f7d19ffb700 1 -- 172.21.15.79:0/1175111203 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7d1c007110 con 0x7f7d24094640 2021-04-09T18:33:31.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.141 7f7d2b599700 1 -- 172.21.15.79:0/1175111203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d2409a600 con 0x7f7d24094640 2021-04-09T18:33:31.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.141 7f7d19ffb700 1 -- 172.21.15.79:0/1175111203 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7d1c01a020 con 0x7f7d24094640 2021-04-09T18:33:31.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.141 7f7d19ffb700 1 --2- 172.21.15.79:0/1175111203 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7d04029100 0x7f7d0402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:31.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.141 7f7d19ffb700 1 -- 172.21.15.79:0/1175111203 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f7d1c0395c0 con 0x7f7d24094640 2021-04-09T18:33:31.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.141 7f7d2933d700 1 --2- 172.21.15.79:0/1175111203 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7d04029100 0x7f7d0402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:31.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.141 7f7d2933d700 1 --2- 172.21.15.79:0/1175111203 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7d04029100 0x7f7d0402b650 crc :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:31.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.157 7f7d2b599700 1 -- 172.21.15.79:0/1175111203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d240e39d0 con 0x7f7d24094640 2021-04-09T18:33:31.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.165 7f7d19ffb700 1 -- 172.21.15.79:0/1175111203 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7d1c0058b0 con 0x7f7d24094640 2021-04-09T18:33:31.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.333 7f7d2b599700 1 -- 172.21.15.79:0/1175111203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d240f5b10 con 0x7f7d24094640 2021-04-09T18:33:31.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.333 7f7d19ffb700 1 -- 172.21.15.79:0/1175111203 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+14229 (secure 0 0 0) 0x7f7d1c000f70 con 0x7f7d24094640 2021-04-09T18:33:31.341 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:31.341 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":79,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:33:25.320368","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:33:22.552244","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2021-04-09 18:33:23.559196","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:33:31.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.341 7f7d2b599700 1 -- 172.21.15.79:0/1175111203 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7d04029100 msgr2=0x7f7d0402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:31.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.341 7f7d2b599700 1 --2- 172.21.15.79:0/1175111203 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7d04029100 0x7f7d0402b650 crc :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.341 7f7d2b599700 1 -- 172.21.15.79:0/1175111203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d24094640 msgr2=0x7f7d24099aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:31.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.341 7f7d2b599700 1 --2- 172.21.15.79:0/1175111203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d24094640 0x7f7d24099aa0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f7d240b9a30 tx=0x7f7d1c00cee0).stop 2021-04-09T18:33:31.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.341 7f7d2b599700 1 -- 172.21.15.79:0/1175111203 shutdown_connections 2021-04-09T18:33:31.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.341 7f7d2b599700 1 --2- 172.21.15.79:0/1175111203 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7d04029100 0x7f7d0402b650 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.341 7f7d2b599700 1 --2- 172.21.15.79:0/1175111203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d240d6a80 0x7f7d240b9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.341 7f7d2b599700 1 --2- 172.21.15.79:0/1175111203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d24094640 0x7f7d24099aa0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.341 7f7d2b599700 1 --2- 172.21.15.79:0/1175111203 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d241a7f40 0x7f7d24094010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.341 7f7d2b599700 1 -- 172.21.15.79:0/1175111203 >> 172.21.15.79:0/1175111203 conn(0x7f7d24093680 msgr2=0x7f7d240d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:31.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.341 7f7d2b599700 1 -- 172.21.15.79:0/1175111203 shutdown_connections 2021-04-09T18:33:31.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.341 7f7d2b599700 1 -- 172.21.15.79:0/1175111203 wait complete. 2021-04-09T18:33:31.357 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:33:22.552244', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:33:23.559196', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:33:31.358 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:33:31.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.445 7fb5b420e700 1 Processor -- start 2021-04-09T18:33:31.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b420e700 1 -- start start 2021-04-09T18:33:31.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b420e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb5ac0f5550 0x7fb5ac0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:31.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b420e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb5ac0e9b10 0x7fb5ac09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:31.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b420e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5ac1c2de0 0x7fb5ac1c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:31.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b420e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ac0e9f60 con 0x7fb5ac0e9b10 2021-04-09T18:33:31.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b420e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ac0e5a00 con 0x7fb5ac0f5550 2021-04-09T18:33:31.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b420e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac0fbb50 con 0x7fb5ac1c2de0 2021-04-09T18:33:31.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b17b1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb5ac0e9b10 0x7fb5ac09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:31.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b17b1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb5ac0e9b10 0x7fb5ac09f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60620/0 (socket says 172.21.15.79:60620) 2021-04-09T18:33:31.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b17b1700 1 -- 172.21.15.79:0/3937117979 learned_addr learned my addr 172.21.15.79:0/3937117979 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:31.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b1fb2700 1 --2- 172.21.15.79:0/3937117979 >> v2:172.21.15.89:3300/0 conn(0x7fb5ac0f5550 0x7fb5ac0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:31.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b27b3700 1 --2- 172.21.15.79:0/3937117979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5ac1c2de0 0x7fb5ac1c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:31.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b17b1700 1 -- 172.21.15.79:0/3937117979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5ac1c2de0 msgr2=0x7fb5ac1c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:31.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b17b1700 1 --2- 172.21.15.79:0/3937117979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5ac1c2de0 0x7fb5ac1c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b17b1700 1 -- 172.21.15.79:0/3937117979 >> v2:172.21.15.89:3300/0 conn(0x7fb5ac0f5550 msgr2=0x7fb5ac0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:31.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b17b1700 1 --2- 172.21.15.79:0/3937117979 >> v2:172.21.15.89:3300/0 conn(0x7fb5ac0f5550 0x7fb5ac0f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b17b1700 1 -- 172.21.15.79:0/3937117979 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac0e5700 con 0x7fb5ac0e9b10 2021-04-09T18:33:31.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b17b1700 1 --2- 172.21.15.79:0/3937117979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5ac0e9b10 0x7fb5ac09f110 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fb5ac125470 tx=0x7fb5a000b3c0).ready entity=mon.0 client_cookie=5e8ace24db9ded45 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:31.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b0fb0700 1 -- 172.21.15.79:0/3937117979 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb5ac0e5700 con 0x7fb5ac0e9b10 2021-04-09T18:33:31.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b0fb0700 1 -- 172.21.15.79:0/3937117979 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a000bbe0 con 0x7fb5ac0e9b10 2021-04-09T18:33:31.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b0fb0700 1 -- 172.21.15.79:0/3937117979 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb5a0002020 con 0x7fb5ac0e9b10 2021-04-09T18:33:31.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b420e700 1 -- 172.21.15.79:0/3937117979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5ac0e9b10 msgr2=0x7fb5ac09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:31.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b420e700 1 --2- 172.21.15.79:0/3937117979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5ac0e9b10 0x7fb5ac09f110 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fb5ac125470 tx=0x7fb5a000b3c0).stop 2021-04-09T18:33:31.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b420e700 1 -- 172.21.15.79:0/3937117979 shutdown_connections 2021-04-09T18:33:31.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b420e700 1 --2- 172.21.15.79:0/3937117979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5ac1c2de0 0x7fb5ac1c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b420e700 1 --2- 172.21.15.79:0/3937117979 >> v2:172.21.15.89:3300/0 conn(0x7fb5ac0f5550 0x7fb5ac0f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b420e700 1 --2- 172.21.15.79:0/3937117979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5ac0e9b10 0x7fb5ac09f110 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b420e700 1 -- 172.21.15.79:0/3937117979 >> 172.21.15.79:0/3937117979 conn(0x7fb5ac0e6010 msgr2=0x7fb5ac0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:31.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b420e700 1 -- 172.21.15.79:0/3937117979 shutdown_connections 2021-04-09T18:33:31.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.449 7fb5b420e700 1 -- 172.21.15.79:0/3937117979 wait complete. 2021-04-09T18:33:31.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.453 7fb5b420e700 1 Processor -- start 2021-04-09T18:33:31.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.453 7fb5b420e700 1 -- start start 2021-04-09T18:33:31.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb5b420e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5ac0afb50 0x7fb5ac0be060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:31.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb5b420e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5ac0affa0 0x7fb5ac1ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:31.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb5b420e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5ac0d4e60 0x7fb5ac0d52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:31.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb5b420e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac0bf7d0 con 0x7fb5ac0d4e60 2021-04-09T18:33:31.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb5b420e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac0bfad0 con 0x7fb5ac0afb50 2021-04-09T18:33:31.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb5b420e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac0bf360 con 0x7fb5ac0affa0 2021-04-09T18:33:31.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb5b27b3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5ac0d4e60 0x7fb5ac0d52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:31.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb5b1fb2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5ac0afb50 0x7fb5ac0be060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:31.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb5b17b1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5ac0affa0 0x7fb5ac1ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:31.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb5b27b3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5ac0d4e60 0x7fb5ac0d52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60628/0 (socket says 172.21.15.79:60628) 2021-04-09T18:33:31.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb5b27b3700 1 -- 172.21.15.79:0/1616874395 learned_addr learned my addr 172.21.15.79:0/1616874395 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:31.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb5b27b3700 1 -- 172.21.15.79:0/1616874395 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5ac0affa0 msgr2=0x7fb5ac1ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:31.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb5b27b3700 1 --2- 172.21.15.79:0/1616874395 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5ac0affa0 0x7fb5ac1ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb5b27b3700 1 -- 172.21.15.79:0/1616874395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5ac0afb50 msgr2=0x7fb5ac0be060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:31.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb5b27b3700 1 --2- 172.21.15.79:0/1616874395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5ac0afb50 0x7fb5ac0be060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb5b27b3700 1 -- 172.21.15.79:0/1616874395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac0be690 con 0x7fb5ac0d4e60 2021-04-09T18:33:31.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb5b27b3700 1 --2- 172.21.15.79:0/1616874395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5ac0d4e60 0x7fb5ac0d52b0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7fb5a400c000 tx=0x7fb5a400ee30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:31.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb59e7fc700 1 -- 172.21.15.79:0/1616874395 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb5ac0be690 con 0x7fb5ac0d4e60 2021-04-09T18:33:31.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb59e7fc700 1 -- 172.21.15.79:0/1616874395 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a400c9e0 con 0x7fb5ac0d4e60 2021-04-09T18:33:31.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb59e7fc700 1 -- 172.21.15.79:0/1616874395 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb5a400f040 con 0x7fb5ac0d4e60 2021-04-09T18:33:31.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb5b420e700 1 -- 172.21.15.79:0/1616874395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ac1ae910 con 0x7fb5ac0d4e60 2021-04-09T18:33:31.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb5b420e700 1 -- 172.21.15.79:0/1616874395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ac096760 con 0x7fb5ac0d4e60 2021-04-09T18:33:31.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb59e7fc700 1 -- 172.21.15.79:0/1616874395 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb5a4011450 con 0x7fb5ac0d4e60 2021-04-09T18:33:31.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb59e7fc700 1 --2- 172.21.15.79:0/1616874395 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb594029100 0x7fb59402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:31.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.457 7fb59e7fc700 1 -- 172.21.15.79:0/1616874395 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fb5a403b520 con 0x7fb5ac0d4e60 2021-04-09T18:33:31.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.461 7fb5b1fb2700 1 --2- 172.21.15.79:0/1616874395 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb594029100 0x7fb59402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:31.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.461 7fb5b1fb2700 1 --2- 172.21.15.79:0/1616874395 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb594029100 0x7fb59402b650 crc :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:31.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.461 7fb5b420e700 1 -- 172.21.15.79:0/1616874395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ac0e39f0 con 0x7fb5ac0d4e60 2021-04-09T18:33:31.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.469 7fb59e7fc700 1 -- 172.21.15.79:0/1616874395 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb5a400c5e0 con 0x7fb5ac0d4e60 2021-04-09T18:33:31.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.621 7fb5b420e700 1 -- 172.21.15.79:0/1616874395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fb5ac0f5b50 con 0x7fb5ac0d4e60 2021-04-09T18:33:31.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.621 7fb59e7fc700 1 -- 172.21.15.79:0/1616874395 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v79) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb5ac0f76f0 con 0x7fb5ac0d4e60 2021-04-09T18:33:31.624 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:33:31.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.621 7fb5b420e700 1 -- 172.21.15.79:0/1616874395 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb594029100 msgr2=0x7fb59402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:31.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.621 7fb5b420e700 1 --2- 172.21.15.79:0/1616874395 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb594029100 0x7fb59402b650 crc :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.621 7fb5b420e700 1 -- 172.21.15.79:0/1616874395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5ac0d4e60 msgr2=0x7fb5ac0d52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:31.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.621 7fb5b420e700 1 --2- 172.21.15.79:0/1616874395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5ac0d4e60 0x7fb5ac0d52b0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7fb5a400c000 tx=0x7fb5a400ee30).stop 2021-04-09T18:33:31.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.621 7fb5b420e700 1 -- 172.21.15.79:0/1616874395 shutdown_connections 2021-04-09T18:33:31.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.621 7fb5b420e700 1 --2- 172.21.15.79:0/1616874395 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb594029100 0x7fb59402b650 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.621 7fb5b420e700 1 --2- 172.21.15.79:0/1616874395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5ac0afb50 0x7fb5ac0be060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.621 7fb5b420e700 1 --2- 172.21.15.79:0/1616874395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5ac0d4e60 0x7fb5ac0d52b0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.621 7fb5b420e700 1 --2- 172.21.15.79:0/1616874395 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5ac0affa0 0x7fb5ac1ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.621 7fb5b420e700 1 -- 172.21.15.79:0/1616874395 >> 172.21.15.79:0/1616874395 conn(0x7fb5ac09acb0 msgr2=0x7fb5ac09a210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:31.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.621 7fb5b420e700 1 -- 172.21.15.79:0/1616874395 shutdown_connections 2021-04-09T18:33:31.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.621 7fb5b420e700 1 -- 172.21.15.79:0/1616874395 wait complete. 2021-04-09T18:33:31.636 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:33:31.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.725 7f6aa3c22700 1 Processor -- start 2021-04-09T18:33:31.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.725 7f6aa3c22700 1 -- start start 2021-04-09T18:33:31.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa3c22700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6a9c0f5550 0x7f6a9c0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:31.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa3c22700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a9c1c8040 0x7f6a9c1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:31.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa3c22700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c0fbb50 con 0x7f6a9c0e9b10 2021-04-09T18:33:31.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa3c22700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9c0e9f60 con 0x7f6a9c0f5550 2021-04-09T18:33:31.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa3c22700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c1c3df0 con 0x7f6a9c1c8040 2021-04-09T18:33:31.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa11c5700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6a9c0e9b10 0x7f6a9c09f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55344/0 (socket says 172.21.15.79:55344) 2021-04-09T18:33:31.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa11c5700 1 -- 172.21.15.79:0/4010216948 learned_addr learned my addr 172.21.15.79:0/4010216948 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:31.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa21c7700 1 --2- 172.21.15.79:0/4010216948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a9c1c8040 0x7f6a9c1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:31.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa19c6700 1 --2- 172.21.15.79:0/4010216948 >> v2:172.21.15.89:3300/0 conn(0x7f6a9c0f5550 0x7f6a9c0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:31.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa09c4700 1 -- 172.21.15.79:0/4010216948 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784463043 0 0) 0x7f6a90001450 con 0x7f6a9c0e9b10 2021-04-09T18:33:31.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa09c4700 1 -- 172.21.15.79:0/4010216948 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a84003240 con 0x7f6a9c0e9b10 2021-04-09T18:33:31.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa21c7700 1 -- 172.21.15.79:0/4010216948 >> v2:172.21.15.89:3300/0 conn(0x7f6a9c0f5550 msgr2=0x7f6a9c0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:31.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa21c7700 1 --2- 172.21.15.79:0/4010216948 >> v2:172.21.15.89:3300/0 conn(0x7f6a9c0f5550 0x7f6a9c0f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa21c7700 1 -- 172.21.15.79:0/4010216948 >> v1:172.21.15.79:6789/0 conn(0x7f6a9c0e9b10 legacy=0x7f6a9c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:31.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa21c7700 1 -- 172.21.15.79:0/4010216948 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c09f910 con 0x7f6a9c1c8040 2021-04-09T18:33:31.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa21c7700 1 --2- 172.21.15.79:0/4010216948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a9c1c8040 0x7f6a9c1ca4a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f6a94002f30 tx=0x7f6a9400bcc0).ready entity=mon.2 client_cookie=d7ad56d98b8fd517 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:31.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa09c4700 1 -- 172.21.15.79:0/4010216948 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6a9c09f910 con 0x7f6a9c1c8040 2021-04-09T18:33:31.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa09c4700 1 -- 172.21.15.79:0/4010216948 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a94009800 con 0x7f6a9c1c8040 2021-04-09T18:33:31.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa09c4700 1 -- 172.21.15.79:0/4010216948 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6a94009bd0 con 0x7f6a9c1c8040 2021-04-09T18:33:31.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa3c22700 1 -- 172.21.15.79:0/4010216948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a9c1c8040 msgr2=0x7f6a9c1ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:31.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa3c22700 1 --2- 172.21.15.79:0/4010216948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a9c1c8040 0x7f6a9c1ca4a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f6a94002f30 tx=0x7f6a9400bcc0).stop 2021-04-09T18:33:31.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa3c22700 1 -- 172.21.15.79:0/4010216948 shutdown_connections 2021-04-09T18:33:31.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa3c22700 1 --2- 172.21.15.79:0/4010216948 >> v2:172.21.15.89:3300/0 conn(0x7f6a9c0f5550 0x7f6a9c0f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa3c22700 1 --2- 172.21.15.79:0/4010216948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a9c1c8040 0x7f6a9c1ca4a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa3c22700 1 -- 172.21.15.79:0/4010216948 >> 172.21.15.79:0/4010216948 conn(0x7f6a9c0e6010 msgr2=0x7f6a9c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:31.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa3c22700 1 -- 172.21.15.79:0/4010216948 shutdown_connections 2021-04-09T18:33:31.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.729 7f6aa3c22700 1 -- 172.21.15.79:0/4010216948 wait complete. 2021-04-09T18:33:31.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa3c22700 1 Processor -- start 2021-04-09T18:33:31.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa3c22700 1 -- start start 2021-04-09T18:33:31.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa3c22700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a9c0a8cf0 0x7f6a9c1a6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:31.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa3c22700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a9c0a9140 0x7f6a9c1a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:31.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa3c22700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a9c1aa6e0 0x7f6a9c1aab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:31.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa3c22700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c088590 con 0x7f6a9c0a8cf0 2021-04-09T18:33:31.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa3c22700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c092770 con 0x7f6a9c0a9140 2021-04-09T18:33:31.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa3c22700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c092a70 con 0x7f6a9c1aa6e0 2021-04-09T18:33:31.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa19c6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a9c0a8cf0 0x7f6a9c1a6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:31.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa19c6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a9c0a8cf0 0x7f6a9c1a6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60640/0 (socket says 172.21.15.79:60640) 2021-04-09T18:33:31.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa19c6700 1 -- 172.21.15.79:0/1618911192 learned_addr learned my addr 172.21.15.79:0/1618911192 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:31.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa11c5700 1 --2- 172.21.15.79:0/1618911192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a9c0a9140 0x7f6a9c1a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:31.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa21c7700 1 --2- 172.21.15.79:0/1618911192 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a9c1aa6e0 0x7f6a9c1aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:31.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa19c6700 1 -- 172.21.15.79:0/1618911192 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a9c1aa6e0 msgr2=0x7f6a9c1aab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:31.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa19c6700 1 --2- 172.21.15.79:0/1618911192 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a9c1aa6e0 0x7f6a9c1aab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa19c6700 1 -- 172.21.15.79:0/1618911192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a9c0a9140 msgr2=0x7f6a9c1a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:31.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa19c6700 1 --2- 172.21.15.79:0/1618911192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a9c0a9140 0x7f6a9c1a6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa19c6700 1 -- 172.21.15.79:0/1618911192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c092000 con 0x7f6a9c0a8cf0 2021-04-09T18:33:31.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa19c6700 1 --2- 172.21.15.79:0/1618911192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a9c0a8cf0 0x7f6a9c1a6540 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f6a9c0d5090 tx=0x7f6a8c00c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:31.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6a9a7fc700 1 -- 172.21.15.79:0/1618911192 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6a9c092000 con 0x7f6a9c0a8cf0 2021-04-09T18:33:31.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6a9a7fc700 1 -- 172.21.15.79:0/1618911192 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c00cd60 con 0x7f6a9c0a8cf0 2021-04-09T18:33:31.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa3c22700 1 -- 172.21.15.79:0/1618911192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9c0baaa0 con 0x7f6a9c0a8cf0 2021-04-09T18:33:31.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6a9a7fc700 1 -- 172.21.15.79:0/1618911192 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6a8c00f040 con 0x7f6a9c0a8cf0 2021-04-09T18:33:31.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.733 7f6aa3c22700 1 -- 172.21.15.79:0/1618911192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9c1ab160 con 0x7f6a9c0a8cf0 2021-04-09T18:33:31.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.737 7f6a9a7fc700 1 -- 172.21.15.79:0/1618911192 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6a8c011070 con 0x7f6a9c0a8cf0 2021-04-09T18:33:31.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.737 7f6a9a7fc700 1 --2- 172.21.15.79:0/1618911192 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6a7c029100 0x7f6a7c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:31.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.737 7f6a9a7fc700 1 -- 172.21.15.79:0/1618911192 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f6a8c010040 con 0x7f6a9c0a8cf0 2021-04-09T18:33:31.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.737 7f6aa11c5700 1 --2- 172.21.15.79:0/1618911192 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6a7c029100 0x7f6a7c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:31.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.737 7f6aa11c5700 1 --2- 172.21.15.79:0/1618911192 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6a7c029100 0x7f6a7c02b650 crc :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:31.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.741 7f6aa3c22700 1 -- 172.21.15.79:0/1618911192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9c0e39f0 con 0x7f6a9c0a8cf0 2021-04-09T18:33:31.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.749 7f6a9a7fc700 1 -- 172.21.15.79:0/1618911192 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6a8c000bf0 con 0x7f6a9c0a8cf0 2021-04-09T18:33:31.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.909 7f6aa3c22700 1 -- 172.21.15.79:0/1618911192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f6a9c0f5b50 con 0x7f6a9c0a8cf0 2021-04-09T18:33:31.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.913 7f6a9a7fc700 1 -- 172.21.15.79:0/1618911192 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v79) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6a8c00c960 con 0x7f6a9c0a8cf0 2021-04-09T18:33:31.916 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:33:31.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.913 7f6aa3c22700 1 -- 172.21.15.79:0/1618911192 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6a7c029100 msgr2=0x7f6a7c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:31.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.913 7f6aa3c22700 1 --2- 172.21.15.79:0/1618911192 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6a7c029100 0x7f6a7c02b650 crc :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.913 7f6aa3c22700 1 -- 172.21.15.79:0/1618911192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a9c0a8cf0 msgr2=0x7f6a9c1a6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:31.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.913 7f6aa3c22700 1 --2- 172.21.15.79:0/1618911192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a9c0a8cf0 0x7f6a9c1a6540 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f6a9c0d5090 tx=0x7f6a8c00c430).stop 2021-04-09T18:33:31.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.913 7f6aa3c22700 1 -- 172.21.15.79:0/1618911192 shutdown_connections 2021-04-09T18:33:31.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.913 7f6aa3c22700 1 --2- 172.21.15.79:0/1618911192 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6a7c029100 0x7f6a7c02b650 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.913 7f6aa3c22700 1 --2- 172.21.15.79:0/1618911192 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a9c1aa6e0 0x7f6a9c1aab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.913 7f6aa3c22700 1 --2- 172.21.15.79:0/1618911192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a9c0a8cf0 0x7f6a9c1a6540 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.913 7f6aa3c22700 1 --2- 172.21.15.79:0/1618911192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a9c0a9140 0x7f6a9c1a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:31.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.913 7f6aa3c22700 1 -- 172.21.15.79:0/1618911192 >> 172.21.15.79:0/1618911192 conn(0x7f6a9c094630 msgr2=0x7f6a9c0a9870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:31.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.913 7f6aa3c22700 1 -- 172.21.15.79:0/1618911192 shutdown_connections 2021-04-09T18:33:31.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:31.913 7f6aa3c22700 1 -- 172.21.15.79:0/1618911192 wait complete. 2021-04-09T18:33:31.929 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:33:32.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90f1dda700 1 Processor -- start 2021-04-09T18:33:32.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90f1dda700 1 -- start start 2021-04-09T18:33:32.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90f1dda700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f90ec0f5550 0x7f90ec0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:32.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90f1dda700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f90ec0e9b10 0x7f90ec09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:32.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90f1dda700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ec0fbb50 con 0x7f90ec1c2de0 2021-04-09T18:33:32.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90f1dda700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ec0e9f60 con 0x7f90ec0f5550 2021-04-09T18:33:32.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90f1dda700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ec0e5a00 con 0x7f90ec0e9b10 2021-04-09T18:33:32.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90ebfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f90ec1c2de0 0x7f90ec1c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55360/0 (socket says 172.21.15.79:55360) 2021-04-09T18:33:32.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90ebfff700 1 -- 172.21.15.79:0/4231876548 learned_addr learned my addr 172.21.15.79:0/4231876548 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:32.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90eb7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f90ec0f5550 0x7f90ec0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:32.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90eaffd700 1 --2- 172.21.15.79:0/4231876548 >> v2:172.21.15.89:3300/0 conn(0x7f90ec0e9b10 0x7f90ec09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:32.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90ea7fc700 1 -- 172.21.15.79:0/4231876548 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224517814 0 0) 0x7f90e4001450 con 0x7f90ec1c2de0 2021-04-09T18:33:32.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90ea7fc700 1 -- 172.21.15.79:0/4231876548 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90d4003240 con 0x7f90ec1c2de0 2021-04-09T18:33:32.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90eaffd700 1 -- 172.21.15.79:0/4231876548 >> v2:172.21.15.79:3300/0 conn(0x7f90ec0f5550 msgr2=0x7f90ec0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:32.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90eaffd700 1 --2- 172.21.15.79:0/4231876548 >> v2:172.21.15.79:3300/0 conn(0x7f90ec0f5550 0x7f90ec0f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:32.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90eaffd700 1 -- 172.21.15.79:0/4231876548 >> v1:172.21.15.79:6789/0 conn(0x7f90ec1c2de0 legacy=0x7f90ec1c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:32.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90ea7fc700 1 -- 172.21.15.79:0/4231876548 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2174930953 0 0) 0x7f90e40019d0 con 0x7f90ec1c2de0 2021-04-09T18:33:32.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90eaffd700 1 -- 172.21.15.79:0/4231876548 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec0e5700 con 0x7f90ec0e9b10 2021-04-09T18:33:32.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90eb7fe700 1 --2- 172.21.15.79:0/4231876548 >> v2:172.21.15.79:3300/0 conn(0x7f90ec0f5550 0x7f90ec0f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:32.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90eaffd700 1 --2- 172.21.15.79:0/4231876548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90ec0e9b10 0x7f90ec09f110 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f90e0002f30 tx=0x7f90e000bc90).ready entity=mon.1 client_cookie=c1f3f50be6ed0f42 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:32.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90ea7fc700 1 -- 172.21.15.79:0/4231876548 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90ec0e5700 con 0x7f90ec0e9b10 2021-04-09T18:33:32.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90ea7fc700 1 -- 172.21.15.79:0/4231876548 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e0009800 con 0x7f90ec0e9b10 2021-04-09T18:33:32.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90ea7fc700 1 -- 172.21.15.79:0/4231876548 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90e0009bd0 con 0x7f90ec0e9b10 2021-04-09T18:33:32.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90f1dda700 1 -- 172.21.15.79:0/4231876548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90ec0e9b10 msgr2=0x7f90ec09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:32.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.025 7f90f1dda700 1 --2- 172.21.15.79:0/4231876548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90ec0e9b10 0x7f90ec09f110 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f90e0002f30 tx=0x7f90e000bc90).stop 2021-04-09T18:33:32.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.029 7f90f1dda700 1 -- 172.21.15.79:0/4231876548 shutdown_connections 2021-04-09T18:33:32.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.029 7f90f1dda700 1 --2- 172.21.15.79:0/4231876548 >> v2:172.21.15.79:3300/0 conn(0x7f90ec0f5550 0x7f90ec0f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:32.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.029 7f90f1dda700 1 --2- 172.21.15.79:0/4231876548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90ec0e9b10 0x7f90ec09f110 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:32.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.029 7f90f1dda700 1 -- 172.21.15.79:0/4231876548 >> 172.21.15.79:0/4231876548 conn(0x7f90ec0e6010 msgr2=0x7f90ec0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:32.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.029 7f90f1dda700 1 -- 172.21.15.79:0/4231876548 shutdown_connections 2021-04-09T18:33:32.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.029 7f90f1dda700 1 -- 172.21.15.79:0/4231876548 wait complete. 2021-04-09T18:33:32.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90f1dda700 1 Processor -- start 2021-04-09T18:33:32.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90f1dda700 1 -- start start 2021-04-09T18:33:32.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90f1dda700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90ec0abe20 0x7f90ec0add70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:32.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90f1dda700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90ec1c0590 0x7f90ec0980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:32.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90f1dda700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90ec0c2fd0 0x7f90ec0c3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:32.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90f1dda700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0ac4f0 con 0x7f90ec0c2fd0 2021-04-09T18:33:32.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90f1dda700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0ac7f0 con 0x7f90ec0abe20 2021-04-09T18:33:32.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90f1dda700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0ae3a0 con 0x7f90ec1c0590 2021-04-09T18:33:32.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90ebfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90ec0c2fd0 0x7f90ec0c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:32.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90ebfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90ec0c2fd0 0x7f90ec0c3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60654/0 (socket says 172.21.15.79:60654) 2021-04-09T18:33:32.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90ebfff700 1 -- 172.21.15.79:0/3261434337 learned_addr learned my addr 172.21.15.79:0/3261434337 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:32.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90eb7fe700 1 --2- 172.21.15.79:0/3261434337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90ec0abe20 0x7f90ec0add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:32.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90eaffd700 1 --2- 172.21.15.79:0/3261434337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90ec1c0590 0x7f90ec0980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:32.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90ebfff700 1 -- 172.21.15.79:0/3261434337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90ec1c0590 msgr2=0x7f90ec0980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:32.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90ebfff700 1 --2- 172.21.15.79:0/3261434337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90ec1c0590 0x7f90ec0980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:32.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90ebfff700 1 -- 172.21.15.79:0/3261434337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90ec0abe20 msgr2=0x7f90ec0add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:32.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90ebfff700 1 --2- 172.21.15.79:0/3261434337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90ec0abe20 0x7f90ec0add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:32.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90ebfff700 1 -- 172.21.15.79:0/3261434337 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec0c3bc0 con 0x7f90ec0c2fd0 2021-04-09T18:33:32.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90ebfff700 1 --2- 172.21.15.79:0/3261434337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90ec0c2fd0 0x7f90ec0c3420 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f90e4001210 tx=0x7f90e400ceb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:32.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90d3fff700 1 -- 172.21.15.79:0/3261434337 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90ec0c3bc0 con 0x7f90ec0c2fd0 2021-04-09T18:33:32.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90d3fff700 1 -- 172.21.15.79:0/3261434337 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e4005b80 con 0x7f90ec0c2fd0 2021-04-09T18:33:32.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90d3fff700 1 -- 172.21.15.79:0/3261434337 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90e4004880 con 0x7f90ec0c2fd0 2021-04-09T18:33:32.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90f1dda700 1 -- 172.21.15.79:0/3261434337 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ec0986e0 con 0x7f90ec0c2fd0 2021-04-09T18:33:32.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.033 7f90f1dda700 1 -- 172.21.15.79:0/3261434337 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ec0960c0 con 0x7f90ec0c2fd0 2021-04-09T18:33:32.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.037 7f90d3fff700 1 -- 172.21.15.79:0/3261434337 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f90e401c070 con 0x7f90ec0c2fd0 2021-04-09T18:33:32.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.037 7f90d3fff700 1 --2- 172.21.15.79:0/3261434337 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f90cc029100 0x7f90cc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:32.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.037 7f90d3fff700 1 -- 172.21.15.79:0/3261434337 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f90e4039170 con 0x7f90ec0c2fd0 2021-04-09T18:33:32.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.037 7f90eb7fe700 1 --2- 172.21.15.79:0/3261434337 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f90cc029100 0x7f90cc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:32.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.037 7f90eb7fe700 1 --2- 172.21.15.79:0/3261434337 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f90cc029100 0x7f90cc02b650 crc :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:32.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.037 7f90f1dda700 1 -- 172.21.15.79:0/3261434337 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ec0e39f0 con 0x7f90ec0c2fd0 2021-04-09T18:33:32.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.041 7f90d3fff700 1 -- 172.21.15.79:0/3261434337 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f90e4005970 con 0x7f90ec0c2fd0 2021-04-09T18:33:32.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.197 7f90f1dda700 1 -- 172.21.15.79:0/3261434337 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f90ec0f5b50 con 0x7f90ec0c2fd0 2021-04-09T18:33:32.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.197 7f90d3fff700 1 -- 172.21.15.79:0/3261434337 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v79) v1 ==== 100+0+10 (secure 0 0 0) 0x7f90ec0f76f0 con 0x7f90ec0c2fd0 2021-04-09T18:33:32.203 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:33:32.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.201 7f90f1dda700 1 -- 172.21.15.79:0/3261434337 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f90cc029100 msgr2=0x7f90cc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:32.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.201 7f90f1dda700 1 --2- 172.21.15.79:0/3261434337 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f90cc029100 0x7f90cc02b650 crc :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:32.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.201 7f90f1dda700 1 -- 172.21.15.79:0/3261434337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90ec0c2fd0 msgr2=0x7f90ec0c3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:32.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.201 7f90f1dda700 1 --2- 172.21.15.79:0/3261434337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90ec0c2fd0 0x7f90ec0c3420 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f90e4001210 tx=0x7f90e400ceb0).stop 2021-04-09T18:33:32.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.201 7f90f1dda700 1 -- 172.21.15.79:0/3261434337 shutdown_connections 2021-04-09T18:33:32.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.201 7f90f1dda700 1 --2- 172.21.15.79:0/3261434337 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f90cc029100 0x7f90cc02b650 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:32.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.201 7f90f1dda700 1 --2- 172.21.15.79:0/3261434337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90ec0abe20 0x7f90ec0add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:32.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.201 7f90f1dda700 1 --2- 172.21.15.79:0/3261434337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90ec0c2fd0 0x7f90ec0c3420 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:32.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.201 7f90f1dda700 1 --2- 172.21.15.79:0/3261434337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90ec1c0590 0x7f90ec0980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:32.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.201 7f90f1dda700 1 -- 172.21.15.79:0/3261434337 >> 172.21.15.79:0/3261434337 conn(0x7f90ec098ab0 msgr2=0x7f90ec1a11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:32.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.201 7f90f1dda700 1 -- 172.21.15.79:0/3261434337 shutdown_connections 2021-04-09T18:33:32.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.201 7f90f1dda700 1 -- 172.21.15.79:0/3261434337 wait complete. 2021-04-09T18:33:32.215 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:33:32.215 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:32.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.309 7fdd21ef3700 1 Processor -- start 2021-04-09T18:33:32.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.309 7fdd21ef3700 1 -- start start 2021-04-09T18:33:32.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd21ef3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdd1c0e9ad0 0x7fdd1c09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:32.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd21ef3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd1c1c8000 0x7fdd1c1ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:32.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd21ef3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1c0fbb10 con 0x7fdd1c0f5510 2021-04-09T18:33:32.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd21ef3700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1c1c3db0 con 0x7fdd1c0e9ad0 2021-04-09T18:33:32.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd21ef3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0e9f20 con 0x7fdd1c1c8000 2021-04-09T18:33:32.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd1affd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdd1c0e9ad0 0x7fdd1c09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:32.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd1b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdd1c0f5510 0x7fdd1c0f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55370/0 (socket says 172.21.15.79:55370) 2021-04-09T18:33:32.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd1b7fe700 1 -- 172.21.15.79:0/2019543789 learned_addr learned my addr 172.21.15.79:0/2019543789 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:32.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd1bfff700 1 --2- 172.21.15.79:0/2019543789 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd1c1c8000 0x7fdd1c1ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:32.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd1affd700 1 -- 172.21.15.79:0/2019543789 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd1c1c8000 msgr2=0x7fdd1c1ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:32.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd1affd700 1 --2- 172.21.15.79:0/2019543789 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd1c1c8000 0x7fdd1c1ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:32.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd1affd700 1 -- 172.21.15.79:0/2019543789 >> v1:172.21.15.79:6789/0 conn(0x7fdd1c0f5510 legacy=0x7fdd1c0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:32.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd1a7fc700 1 -- 172.21.15.79:0/2019543789 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3995103937 0 0) 0x7fdd0c0010d0 con 0x7fdd1c0f5510 2021-04-09T18:33:32.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd1affd700 1 -- 172.21.15.79:0/2019543789 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c0e56c0 con 0x7fdd1c0e9ad0 2021-04-09T18:33:32.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd1affd700 1 --2- 172.21.15.79:0/2019543789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd1c0e9ad0 0x7fdd1c09f100 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7fdd1c0f6ef0 tx=0x7fdd1000bd70).ready entity=mon.0 client_cookie=640175f4a7c9e500 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:32.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd1a7fc700 1 -- 172.21.15.79:0/2019543789 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd1c0e56c0 con 0x7fdd1c0e9ad0 2021-04-09T18:33:32.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd1a7fc700 1 -- 172.21.15.79:0/2019543789 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd10009810 con 0x7fdd1c0e9ad0 2021-04-09T18:33:32.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd1a7fc700 1 -- 172.21.15.79:0/2019543789 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd10009be0 con 0x7fdd1c0e9ad0 2021-04-09T18:33:32.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd21ef3700 1 -- 172.21.15.79:0/2019543789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd1c0e9ad0 msgr2=0x7fdd1c09f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:32.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd21ef3700 1 --2- 172.21.15.79:0/2019543789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd1c0e9ad0 0x7fdd1c09f100 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7fdd1c0f6ef0 tx=0x7fdd1000bd70).stop 2021-04-09T18:33:32.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd21ef3700 1 -- 172.21.15.79:0/2019543789 shutdown_connections 2021-04-09T18:33:32.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd21ef3700 1 --2- 172.21.15.79:0/2019543789 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd1c1c8000 0x7fdd1c1ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:32.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd21ef3700 1 --2- 172.21.15.79:0/2019543789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd1c0e9ad0 0x7fdd1c09f100 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:32.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd21ef3700 1 -- 172.21.15.79:0/2019543789 >> 172.21.15.79:0/2019543789 conn(0x7fdd1c0e5fd0 msgr2=0x7fdd1c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:32.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd21ef3700 1 -- 172.21.15.79:0/2019543789 shutdown_connections 2021-04-09T18:33:32.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.313 7fdd21ef3700 1 -- 172.21.15.79:0/2019543789 wait complete. 2021-04-09T18:33:32.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.317 7fdd21ef3700 1 Processor -- start 2021-04-09T18:33:32.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.317 7fdd21ef3700 1 -- start start 2021-04-09T18:33:32.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd21ef3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd1c095300 0x7fdd1c0d70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:32.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd21ef3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd1c094980 0x7fdd1c0a8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:32.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd21ef3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd1c1a69c0 0x7fdd1c1a6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:32.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd21ef3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0d5b60 con 0x7fdd1c094980 2021-04-09T18:33:32.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd21ef3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c095750 con 0x7fdd1c095300 2021-04-09T18:33:32.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd21ef3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c095a70 con 0x7fdd1c1a69c0 2021-04-09T18:33:32.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd1affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd1c094980 0x7fdd1c0a8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:32.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd1affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd1c094980 0x7fdd1c0a8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60666/0 (socket says 172.21.15.79:60666) 2021-04-09T18:33:32.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd1affd700 1 -- 172.21.15.79:0/1757221412 learned_addr learned my addr 172.21.15.79:0/1757221412 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:32.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd1bfff700 1 --2- 172.21.15.79:0/1757221412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd1c1a69c0 0x7fdd1c1a6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:32.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd1b7fe700 1 --2- 172.21.15.79:0/1757221412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd1c095300 0x7fdd1c0d70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:32.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd1affd700 1 -- 172.21.15.79:0/1757221412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd1c1a69c0 msgr2=0x7fdd1c1a6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:32.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd1affd700 1 --2- 172.21.15.79:0/1757221412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd1c1a69c0 0x7fdd1c1a6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:32.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd1affd700 1 -- 172.21.15.79:0/1757221412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd1c095300 msgr2=0x7fdd1c0d70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:32.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd1affd700 1 --2- 172.21.15.79:0/1757221412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd1c095300 0x7fdd1c0d70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd1affd700 1 -- 172.21.15.79:0/1757221412 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c0a98c0 con 0x7fdd1c094980 2021-04-09T18:33:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd1b7fe700 1 --2- 172.21.15.79:0/1757221412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd1c095300 0x7fdd1c0d70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:33:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd1affd700 1 --2- 172.21.15.79:0/1757221412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd1c094980 0x7fdd1c0a8eb0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7fdd1c0959f0 tx=0x7fdd10006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd03fff700 1 -- 172.21.15.79:0/1757221412 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd1c0a98c0 con 0x7fdd1c094980 2021-04-09T18:33:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd03fff700 1 -- 172.21.15.79:0/1757221412 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1001d450 con 0x7fdd1c094980 2021-04-09T18:33:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd03fff700 1 -- 172.21.15.79:0/1757221412 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd10022020 con 0x7fdd1c094980 2021-04-09T18:33:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd21ef3700 1 -- 172.21.15.79:0/1757221412 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1c0a94e0 con 0x7fdd1c094980 2021-04-09T18:33:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd21ef3700 1 -- 172.21.15.79:0/1757221412 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1c1a7440 con 0x7fdd1c094980 2021-04-09T18:33:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd03fff700 1 -- 172.21.15.79:0/1757221412 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fdd1001d820 con 0x7fdd1c094980 2021-04-09T18:33:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd03fff700 1 --2- 172.21.15.79:0/1757221412 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdcfc029100 0x7fdcfc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd03fff700 1 -- 172.21.15.79:0/1757221412 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fdd1003c4f0 con 0x7fdd1c094980 2021-04-09T18:33:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.321 7fdd1b7fe700 1 --2- 172.21.15.79:0/1757221412 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdcfc029100 0x7fdcfc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.325 7fdd1b7fe700 1 --2- 172.21.15.79:0/1757221412 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdcfc029100 0x7fdcfc02b650 crc :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.325 7fdd21ef3700 1 -- 172.21.15.79:0/1757221412 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1c0e39d0 con 0x7fdd1c094980 2021-04-09T18:33:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.325 7fdd03fff700 1 -- 172.21.15.79:0/1757221412 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fdd10009600 con 0x7fdd1c094980 2021-04-09T18:33:32.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.493 7fdd21ef3700 1 -- 172.21.15.79:0/1757221412 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd1c09a0c0 con 0x7fdd1c094980 2021-04-09T18:33:32.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.497 7fdd03fff700 1 -- 172.21.15.79:0/1757221412 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2103 (secure 0 0 0) 0x7fdd10035850 con 0x7fdd1c094980 2021-04-09T18:33:32.499 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 47 2021-04-09T18:33:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:32.500 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":47,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6510,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/4230183300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4230183300},{"type":"v1","addr":"172.21.15.79:6833","nonce":4230183300}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:33:24.317443","modified":"2021-04-09 18:33:25.319829","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5837},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5837":{"gid":5837,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/1825266006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1825266006},{"type":"v1","addr":"172.21.15.89:6835","nonce":1825266006}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-04-09T18:33:32.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.497 7fdd21ef3700 1 -- 172.21.15.79:0/1757221412 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdcfc029100 msgr2=0x7fdcfc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:32.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.497 7fdd21ef3700 1 --2- 172.21.15.79:0/1757221412 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdcfc029100 0x7fdcfc02b650 crc :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:32.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.497 7fdd21ef3700 1 -- 172.21.15.79:0/1757221412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd1c094980 msgr2=0x7fdd1c0a8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:32.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.497 7fdd21ef3700 1 --2- 172.21.15.79:0/1757221412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd1c094980 0x7fdd1c0a8eb0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7fdd1c0959f0 tx=0x7fdd10006890).stop 2021-04-09T18:33:32.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.497 7fdd21ef3700 1 -- 172.21.15.79:0/1757221412 shutdown_connections 2021-04-09T18:33:32.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.497 7fdd21ef3700 1 --2- 172.21.15.79:0/1757221412 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdcfc029100 0x7fdcfc02b650 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:32.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.497 7fdd21ef3700 1 --2- 172.21.15.79:0/1757221412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd1c095300 0x7fdd1c0d70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:32.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.497 7fdd21ef3700 1 --2- 172.21.15.79:0/1757221412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd1c1a69c0 0x7fdd1c1a6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:32.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.497 7fdd21ef3700 1 --2- 172.21.15.79:0/1757221412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd1c094980 0x7fdd1c0a8eb0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:32.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.497 7fdd21ef3700 1 -- 172.21.15.79:0/1757221412 >> 172.21.15.79:0/1757221412 conn(0x7fdd1c0bb150 msgr2=0x7fdd1c0bceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:32.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.497 7fdd21ef3700 1 -- 172.21.15.79:0/1757221412 shutdown_connections 2021-04-09T18:33:32.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:32.497 7fdd21ef3700 1 -- 172.21.15.79:0/1757221412 wait complete. 2021-04-09T18:33:32.714 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:33:24.317443', 'modified': '2021-04-09 18:33:25.319829', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5837}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5837': {'gid': 5837, 'name': 'b', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6835/1825266006', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 1825266006}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 1825266006}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:33:32.714 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:33:32.715 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2021-04-09T18:33:32.809 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:33:32.809 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:33:32.809 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2021-04-09T18:33:32.809 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 5837, 2021-04-09T18:33:32.810 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2021-04-09T18:33:32.810 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2021-04-09T18:33:32.810 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 8.4852355579999994, 2021-04-09T18:33:32.810 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 47, 2021-04-09T18:33:32.811 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 79, 2021-04-09T18:33:32.811 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 78, 2021-04-09T18:33:32.811 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 12.869492375 2021-04-09T18:33:32.812 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:33:32.815 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 5837, "want_state": "up:active", "state": "up:active", "rank_uptime": 8.4852355579999994, "mdsmap_epoch": 47, "osdmap_epoch": 79, "osdmap_epoch_barrier": 78, "uptime": 12.869492375 } 2021-04-09T18:33:32.816 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:33:32.816 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-04-09T18:33:32.816 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi136.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-04-09T18:33:32.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:32.817 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:32.825 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:33:32.881 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:33:32.882 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:33:32.937 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:33:32.938 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:33:32.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:32.940 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:33:32.988 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:33:32.989 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:33.032 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:33:33.048 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:33:33.049 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:33:33.106 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:33:33.107 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:33:33.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:33.110 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:33:33.111 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:2021-04-09 18:33:33.101 7fc722b0b0c0 -1 init, newargv = 0x561940d5e6f0 newargc=9 2021-04-09T18:33:33.112 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13368]: starting ceph client 2021-04-09T18:33:33.117 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13368]: starting fuse 2021-04-09T18:33:33.124 INFO:teuthology.orchestra.run.smithi136.stdout:49 2021-04-09T18:33:33.124 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:33:33.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:33.126 DEBUG:teuthology.orchestra.run.smithi136:> sudo python3 -c ' 2021-04-09T18:33:33.127 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2021-04-09T18:33:33.127 DEBUG:teuthology.orchestra.run.smithi136:> import re 2021-04-09T18:33:33.128 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-04-09T18:33:33.129 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2021-04-09T18:33:33.129 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:33:33.130 DEBUG:teuthology.orchestra.run.smithi136:> def find_socket(client_name): 2021-04-09T18:33:33.131 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-04-09T18:33:33.132 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2021-04-09T18:33:33.132 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:33:33.133 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2021-04-09T18:33:33.134 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2021-04-09T18:33:33.134 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2021-04-09T18:33:33.135 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2021-04-09T18:33:33.136 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:33:33.137 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2021-04-09T18:33:33.137 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:33:33.138 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:33:33.139 DEBUG:teuthology.orchestra.run.smithi136:> return f 2021-04-09T18:33:33.139 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:33:33.140 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:33:33.141 DEBUG:teuthology.orchestra.run.smithi136:> print(find_socket("client.1")) 2021-04-09T18:33:33.142 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-04-09T18:33:33.214 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.1.13368.asok 2021-04-09T18:33:33.219 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13368.asok 2021-04-09T18:33:33.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:33.220 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13368.asok status 2021-04-09T18:33:33.344 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2021-04-09T18:33:33.345 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2021-04-09T18:33:33.345 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:33:33.345 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:33:33.346 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "1", 2021-04-09T18:33:33.346 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2021-04-09T18:33:33.346 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-04-09T18:33:33.347 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "13368", 2021-04-09T18:33:33.347 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2021-04-09T18:33:33.347 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:33:33.347 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2021-04-09T18:33:33.347 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2021-04-09T18:33:33.348 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 6714, 2021-04-09T18:33:33.348 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2021-04-09T18:33:33.348 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2021-04-09T18:33:33.348 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2021-04-09T18:33:33.349 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 6714 2021-04-09T18:33:33.349 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:33:33.349 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-04-09T18:33:33.349 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-04-09T18:33:33.349 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-04-09T18:33:33.350 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 2667230405 2021-04-09T18:33:33.350 INFO:teuthology.orchestra.run.smithi136.stdout: } 2021-04-09T18:33:33.350 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:33:33.350 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-04-09T18:33:33.351 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-04-09T18:33:33.351 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-04-09T18:33:33.351 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 2667230405 2021-04-09T18:33:33.351 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:33:33.351 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.6714 172.21.15.136:0/2667230405", 2021-04-09T18:33:33.352 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "172.21.15.136:0/2667230405", 2021-04-09T18:33:33.352 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2021-04-09T18:33:33.352 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 47, 2021-04-09T18:33:33.352 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 79, 2021-04-09T18:33:33.353 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:33:33.353 INFO:teuthology.orchestra.run.smithi136.stdout: "blacklisted": false, 2021-04-09T18:33:33.353 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2021-04-09T18:33:33.353 INFO:teuthology.orchestra.run.smithi136.stdout:} 2021-04-09T18:33:33.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:33.355 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:33.355 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:33.363 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-04-09T18:33:33.364 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-04-09T18:33:33.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:33.365 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:33.424 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:33.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.517 7fad055c7700 1 Processor -- start 2021-04-09T18:33:33.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.517 7fad055c7700 1 -- start start 2021-04-09T18:33:33.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.517 7fad055c7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fad001c9010 0x7fad001cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:33.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.517 7fad055c7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad000fbb10 con 0x7fad000e9ad0 2021-04-09T18:33:33.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.517 7fad055c7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0009f900 con 0x7fad000f5510 2021-04-09T18:33:33.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.517 7fad055c7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad001c3db0 con 0x7fad001c9010 2021-04-09T18:33:33.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.517 7facffa48700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fad001c9010 0x7fad001cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:33.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.517 7facfea46700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fad000e9ad0 0x7fad0009f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55386/0 (socket says 172.21.15.79:55386) 2021-04-09T18:33:33.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.517 7facfea46700 1 -- 172.21.15.79:0/1726185353 learned_addr learned my addr 172.21.15.79:0/1726185353 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:33.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.517 7facffa48700 1 -- 172.21.15.79:0/1726185353 >> v1:172.21.15.89:6789/0 conn(0x7fad000f5510 legacy=0x7fad000f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:33.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.517 7facffa48700 1 -- 172.21.15.79:0/1726185353 >> v1:172.21.15.79:6789/0 conn(0x7fad000e9ad0 legacy=0x7fad0009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:33.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.517 7facffa48700 1 -- 172.21.15.79:0/1726185353 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad000e56c0 con 0x7fad001c9010 2021-04-09T18:33:33.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.517 7facfe245700 1 -- 172.21.15.79:0/1726185353 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838697894 0 0) 0x7facf40010d0 con 0x7fad000e9ad0 2021-04-09T18:33:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.517 7facffa48700 1 --2- 172.21.15.79:0/1726185353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad001c9010 0x7fad001cb470 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7facf80032b0 tx=0x7facf800b0e0).ready entity=mon.0 client_cookie=a364f94e66c5af56 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.517 7facfe245700 1 -- 172.21.15.79:0/1726185353 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fad000e56c0 con 0x7fad001c9010 2021-04-09T18:33:33.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.517 7facfe245700 1 -- 172.21.15.79:0/1726185353 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf800bab0 con 0x7fad001c9010 2021-04-09T18:33:33.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.517 7facfe245700 1 -- 172.21.15.79:0/1726185353 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7facf8002020 con 0x7fad001c9010 2021-04-09T18:33:33.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.517 7fad055c7700 1 -- 172.21.15.79:0/1726185353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad001c9010 msgr2=0x7fad001cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:33.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.517 7fad055c7700 1 --2- 172.21.15.79:0/1726185353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad001c9010 0x7fad001cb470 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7facf80032b0 tx=0x7facf800b0e0).stop 2021-04-09T18:33:33.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.521 7fad055c7700 1 -- 172.21.15.79:0/1726185353 shutdown_connections 2021-04-09T18:33:33.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.521 7fad055c7700 1 --2- 172.21.15.79:0/1726185353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad001c9010 0x7fad001cb470 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:33.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.521 7fad055c7700 1 -- 172.21.15.79:0/1726185353 >> 172.21.15.79:0/1726185353 conn(0x7fad000e5fd0 msgr2=0x7fad000e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:33.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.521 7fad055c7700 1 -- 172.21.15.79:0/1726185353 shutdown_connections 2021-04-09T18:33:33.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.521 7fad055c7700 1 -- 172.21.15.79:0/1726185353 wait complete. 2021-04-09T18:33:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.525 7fad055c7700 1 Processor -- start 2021-04-09T18:33:33.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.525 7fad055c7700 1 -- start start 2021-04-09T18:33:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.525 7fad055c7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad00095f50 0x7fad00093a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.525 7fad055c7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad001d4b80 0x7fad001d4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.525 7fad055c7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad001d0a30 0x7fad001d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.525 7fad055c7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad000e9f20 con 0x7fad001d4b80 2021-04-09T18:33:33.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.525 7fad055c7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad000abeb0 con 0x7fad00095f50 2021-04-09T18:33:33.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.525 7fad055c7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad000ac1b0 con 0x7fad001d0a30 2021-04-09T18:33:33.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.525 7facfea46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad001d4b80 0x7fad001d4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:33.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.525 7facfea46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad001d4b80 0x7fad001d4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60682/0 (socket says 172.21.15.79:60682) 2021-04-09T18:33:33.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.525 7facfea46700 1 -- 172.21.15.79:0/2145428467 learned_addr learned my addr 172.21.15.79:0/2145428467 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:33.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.525 7facff247700 1 --2- 172.21.15.79:0/2145428467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad00095f50 0x7fad00093a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:33.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.525 7facffa48700 1 --2- 172.21.15.79:0/2145428467 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad001d0a30 0x7fad001d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:33.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.525 7facfea46700 1 -- 172.21.15.79:0/2145428467 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad001d0a30 msgr2=0x7fad001d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:33.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.525 7facfea46700 1 --2- 172.21.15.79:0/2145428467 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad001d0a30 0x7fad001d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:33.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.525 7facfea46700 1 -- 172.21.15.79:0/2145428467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad00095f50 msgr2=0x7fad00093a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:33.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.525 7facfea46700 1 --2- 172.21.15.79:0/2145428467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad00095f50 0x7fad00093a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:33.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.525 7facfea46700 1 -- 172.21.15.79:0/2145428467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad00094930 con 0x7fad001d4b80 2021-04-09T18:33:33.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.525 7facfea46700 1 --2- 172.21.15.79:0/2145428467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad001d4b80 0x7fad001d4fd0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7fad000d7850 tx=0x7facf400cb60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:33.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.529 7face7fff700 1 -- 172.21.15.79:0/2145428467 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7facf4007320 con 0x7fad001d4b80 2021-04-09T18:33:33.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.529 7fad055c7700 1 -- 172.21.15.79:0/2145428467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad00094500 con 0x7fad001d4b80 2021-04-09T18:33:33.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.529 7face7fff700 1 -- 172.21.15.79:0/2145428467 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf40055f0 con 0x7fad001d4b80 2021-04-09T18:33:33.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.529 7face7fff700 1 -- 172.21.15.79:0/2145428467 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7facf40059c0 con 0x7fad001d4b80 2021-04-09T18:33:33.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.529 7fad055c7700 1 -- 172.21.15.79:0/2145428467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad000ab940 con 0x7fad001d4b80 2021-04-09T18:33:33.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.529 7face7fff700 1 -- 172.21.15.79:0/2145428467 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7facf401a020 con 0x7fad001d4b80 2021-04-09T18:33:33.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.529 7face7fff700 1 --2- 172.21.15.79:0/2145428467 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7face0029100 0x7face002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:33.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.529 7face7fff700 1 -- 172.21.15.79:0/2145428467 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5924+0+0 (secure 0 0 0) 0x7facf4039360 con 0x7fad001d4b80 2021-04-09T18:33:33.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.529 7facff247700 1 --2- 172.21.15.79:0/2145428467 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7face0029100 0x7face002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:33.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.529 7facff247700 1 --2- 172.21.15.79:0/2145428467 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7face0029100 0x7face002b650 crc :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:33.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.545 7fad055c7700 1 -- 172.21.15.79:0/2145428467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad000e39d0 con 0x7fad001d4b80 2021-04-09T18:33:33.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.553 7face7fff700 1 -- 172.21.15.79:0/2145428467 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7facf4007110 con 0x7fad001d4b80 2021-04-09T18:33:33.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.729 7fad055c7700 1 -- 172.21.15.79:0/2145428467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad000a1cb0 con 0x7fad001d4b80 2021-04-09T18:33:33.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.729 7face7fff700 1 -- 172.21.15.79:0/2145428467 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2103 (secure 0 0 0) 0x7facf4000bf0 con 0x7fad001d4b80 2021-04-09T18:33:33.734 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 47 2021-04-09T18:33:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:33.735 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":47,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6510,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/4230183300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4230183300},{"type":"v1","addr":"172.21.15.79:6833","nonce":4230183300}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:33:24.317443","modified":"2021-04-09 18:33:25.319829","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5837},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5837":{"gid":5837,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/1825266006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1825266006},{"type":"v1","addr":"172.21.15.89:6835","nonce":1825266006}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-04-09T18:33:33.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.733 7fad055c7700 1 -- 172.21.15.79:0/2145428467 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7face0029100 msgr2=0x7face002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:33.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.733 7fad055c7700 1 --2- 172.21.15.79:0/2145428467 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7face0029100 0x7face002b650 crc :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:33.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.733 7fad055c7700 1 -- 172.21.15.79:0/2145428467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad001d4b80 msgr2=0x7fad001d4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:33.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.733 7fad055c7700 1 --2- 172.21.15.79:0/2145428467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad001d4b80 0x7fad001d4fd0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7fad000d7850 tx=0x7facf400cb60).stop 2021-04-09T18:33:33.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.733 7fad055c7700 1 -- 172.21.15.79:0/2145428467 shutdown_connections 2021-04-09T18:33:33.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.733 7fad055c7700 1 --2- 172.21.15.79:0/2145428467 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7face0029100 0x7face002b650 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:33.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.733 7fad055c7700 1 --2- 172.21.15.79:0/2145428467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad00095f50 0x7fad00093a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:33.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.733 7fad055c7700 1 --2- 172.21.15.79:0/2145428467 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad001d0a30 0x7fad001d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:33.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.733 7fad055c7700 1 --2- 172.21.15.79:0/2145428467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad001d4b80 0x7fad001d4fd0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:33.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.733 7fad055c7700 1 -- 172.21.15.79:0/2145428467 >> 172.21.15.79:0/2145428467 conn(0x7fad00098100 msgr2=0x7fad000ba470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:33.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.733 7fad055c7700 1 -- 172.21.15.79:0/2145428467 shutdown_connections 2021-04-09T18:33:33.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:33.733 7fad055c7700 1 -- 172.21.15.79:0/2145428467 wait complete. 2021-04-09T18:33:33.747 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok dump inode 1 2021-04-09T18:33:33.832 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:33:33.832 INFO:teuthology.orchestra.run.smithi089.stdout: "path": "/", 2021-04-09T18:33:33.832 INFO:teuthology.orchestra.run.smithi089.stdout: "ino": 1, 2021-04-09T18:33:33.833 INFO:teuthology.orchestra.run.smithi089.stdout: "rdev": 0, 2021-04-09T18:33:33.833 INFO:teuthology.orchestra.run.smithi089.stdout: "ctime": "2021-04-09 18:33:31.025640", 2021-04-09T18:33:33.833 INFO:teuthology.orchestra.run.smithi089.stdout: "btime": "2021-04-09 18:33:24.322263", 2021-04-09T18:33:33.833 INFO:teuthology.orchestra.run.smithi089.stdout: "mode": 17407, 2021-04-09T18:33:33.834 INFO:teuthology.orchestra.run.smithi089.stdout: "uid": 0, 2021-04-09T18:33:33.834 INFO:teuthology.orchestra.run.smithi089.stdout: "gid": 0, 2021-04-09T18:33:33.834 INFO:teuthology.orchestra.run.smithi089.stdout: "nlink": 1, 2021-04-09T18:33:33.834 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_layout": { 2021-04-09T18:33:33.835 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_hash": 2 2021-04-09T18:33:33.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:33.835 INFO:teuthology.orchestra.run.smithi089.stdout: "layout": { 2021-04-09T18:33:33.835 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_unit": 4194304, 2021-04-09T18:33:33.836 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_count": 1, 2021-04-09T18:33:33.836 INFO:teuthology.orchestra.run.smithi089.stdout: "object_size": 4194304, 2021-04-09T18:33:33.836 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_id": 15, 2021-04-09T18:33:33.836 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_ns": "" 2021-04-09T18:33:33.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:33.837 INFO:teuthology.orchestra.run.smithi089.stdout: "old_pools": [], 2021-04-09T18:33:33.837 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 0, 2021-04-09T18:33:33.837 INFO:teuthology.orchestra.run.smithi089.stdout: "truncate_seq": 0, 2021-04-09T18:33:33.838 INFO:teuthology.orchestra.run.smithi089.stdout: "truncate_size": 18446744073709551615, 2021-04-09T18:33:33.838 INFO:teuthology.orchestra.run.smithi089.stdout: "truncate_from": 0, 2021-04-09T18:33:33.838 INFO:teuthology.orchestra.run.smithi089.stdout: "truncate_pending": 0, 2021-04-09T18:33:33.838 INFO:teuthology.orchestra.run.smithi089.stdout: "mtime": "2021-04-09 18:33:24.322263", 2021-04-09T18:33:33.839 INFO:teuthology.orchestra.run.smithi089.stdout: "atime": "0.000000", 2021-04-09T18:33:33.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time_warp_seq": 0, 2021-04-09T18:33:33.839 INFO:teuthology.orchestra.run.smithi089.stdout: "change_attr": 1, 2021-04-09T18:33:33.839 INFO:teuthology.orchestra.run.smithi089.stdout: "export_pin": -1, 2021-04-09T18:33:33.839 INFO:teuthology.orchestra.run.smithi089.stdout: "client_ranges": [], 2021-04-09T18:33:33.840 INFO:teuthology.orchestra.run.smithi089.stdout: "dirstat": { 2021-04-09T18:33:33.840 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 0, 2021-04-09T18:33:33.841 INFO:teuthology.orchestra.run.smithi089.stdout: "mtime": "0.000000", 2021-04-09T18:33:33.841 INFO:teuthology.orchestra.run.smithi089.stdout: "num_files": 0, 2021-04-09T18:33:33.841 INFO:teuthology.orchestra.run.smithi089.stdout: "num_subdirs": 0 2021-04-09T18:33:33.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:33.841 INFO:teuthology.orchestra.run.smithi089.stdout: "rstat": { 2021-04-09T18:33:33.842 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 0, 2021-04-09T18:33:33.842 INFO:teuthology.orchestra.run.smithi089.stdout: "rbytes": 0, 2021-04-09T18:33:33.842 INFO:teuthology.orchestra.run.smithi089.stdout: "rfiles": 0, 2021-04-09T18:33:33.842 INFO:teuthology.orchestra.run.smithi089.stdout: "rsubdirs": 1, 2021-04-09T18:33:33.842 INFO:teuthology.orchestra.run.smithi089.stdout: "rsnaps": 0, 2021-04-09T18:33:33.843 INFO:teuthology.orchestra.run.smithi089.stdout: "rctime": "2021-04-09 18:33:31.025640" 2021-04-09T18:33:33.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:33.843 INFO:teuthology.orchestra.run.smithi089.stdout: "accounted_rstat": { 2021-04-09T18:33:33.843 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 0, 2021-04-09T18:33:33.844 INFO:teuthology.orchestra.run.smithi089.stdout: "rbytes": 0, 2021-04-09T18:33:33.844 INFO:teuthology.orchestra.run.smithi089.stdout: "rfiles": 0, 2021-04-09T18:33:33.844 INFO:teuthology.orchestra.run.smithi089.stdout: "rsubdirs": 1, 2021-04-09T18:33:33.844 INFO:teuthology.orchestra.run.smithi089.stdout: "rsnaps": 0, 2021-04-09T18:33:33.844 INFO:teuthology.orchestra.run.smithi089.stdout: "rctime": "2021-04-09 18:33:24.322263" 2021-04-09T18:33:33.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:33.845 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 3, 2021-04-09T18:33:33.845 INFO:teuthology.orchestra.run.smithi089.stdout: "file_data_version": 0, 2021-04-09T18:33:33.845 INFO:teuthology.orchestra.run.smithi089.stdout: "xattr_version": 1, 2021-04-09T18:33:33.845 INFO:teuthology.orchestra.run.smithi089.stdout: "backtrace_version": 3, 2021-04-09T18:33:33.846 INFO:teuthology.orchestra.run.smithi089.stdout: "stray_prior_path": "", 2021-04-09T18:33:33.846 INFO:teuthology.orchestra.run.smithi089.stdout: "symlink": "", 2021-04-09T18:33:33.846 INFO:teuthology.orchestra.run.smithi089.stdout: "old_inodes": [], 2021-04-09T18:33:33.846 INFO:teuthology.orchestra.run.smithi089.stdout: "dirfragtree": { 2021-04-09T18:33:33.846 INFO:teuthology.orchestra.run.smithi089.stdout: "splits": [] 2021-04-09T18:33:33.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:33.847 INFO:teuthology.orchestra.run.smithi089.stdout: "is_auth": true, 2021-04-09T18:33:33.847 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_state": { 2021-04-09T18:33:33.847 INFO:teuthology.orchestra.run.smithi089.stdout: "replicas": {} 2021-04-09T18:33:33.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:33.848 INFO:teuthology.orchestra.run.smithi089.stdout: "replica_state": { 2021-04-09T18:33:33.848 INFO:teuthology.orchestra.run.smithi089.stdout: "authority": [ 2021-04-09T18:33:33.848 INFO:teuthology.orchestra.run.smithi089.stdout: 0, 2021-04-09T18:33:33.848 INFO:teuthology.orchestra.run.smithi089.stdout: -2 2021-04-09T18:33:33.849 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2021-04-09T18:33:33.849 INFO:teuthology.orchestra.run.smithi089.stdout: "replica_nonce": 0 2021-04-09T18:33:33.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:33.849 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_pins": 2, 2021-04-09T18:33:33.849 INFO:teuthology.orchestra.run.smithi089.stdout: "is_frozen": false, 2021-04-09T18:33:33.850 INFO:teuthology.orchestra.run.smithi089.stdout: "is_freezing": false, 2021-04-09T18:33:33.850 INFO:teuthology.orchestra.run.smithi089.stdout: "pins": { 2021-04-09T18:33:33.850 INFO:teuthology.orchestra.run.smithi089.stdout: "request": 1, 2021-04-09T18:33:33.850 INFO:teuthology.orchestra.run.smithi089.stdout: "lock": 3, 2021-04-09T18:33:33.850 INFO:teuthology.orchestra.run.smithi089.stdout: "dirfrag": 1, 2021-04-09T18:33:33.851 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": 1, 2021-04-09T18:33:33.851 INFO:teuthology.orchestra.run.smithi089.stdout: "dirtyparent": 1, 2021-04-09T18:33:33.851 INFO:teuthology.orchestra.run.smithi089.stdout: "dirty": 1, 2021-04-09T18:33:33.851 INFO:teuthology.orchestra.run.smithi089.stdout: "authpin": 1 2021-04-09T18:33:33.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:33.852 INFO:teuthology.orchestra.run.smithi089.stdout: "nref": 9, 2021-04-09T18:33:33.852 INFO:teuthology.orchestra.run.smithi089.stdout: "versionlock": { 2021-04-09T18:33:33.852 INFO:teuthology.orchestra.run.smithi089.stdout: "gather_set": [], 2021-04-09T18:33:33.852 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "lock", 2021-04-09T18:33:33.853 INFO:teuthology.orchestra.run.smithi089.stdout: "is_leased": false, 2021-04-09T18:33:33.853 INFO:teuthology.orchestra.run.smithi089.stdout: "num_rdlocks": 0, 2021-04-09T18:33:33.853 INFO:teuthology.orchestra.run.smithi089.stdout: "num_wrlocks": 1, 2021-04-09T18:33:33.853 INFO:teuthology.orchestra.run.smithi089.stdout: "num_xlocks": 0, 2021-04-09T18:33:33.853 INFO:teuthology.orchestra.run.smithi089.stdout: "xlock_by": {} 2021-04-09T18:33:33.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:33.854 INFO:teuthology.orchestra.run.smithi089.stdout: "authlock": { 2021-04-09T18:33:33.854 INFO:teuthology.orchestra.run.smithi089.stdout: "gather_set": [], 2021-04-09T18:33:33.854 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "xlockdone", 2021-04-09T18:33:33.854 INFO:teuthology.orchestra.run.smithi089.stdout: "is_leased": false, 2021-04-09T18:33:33.855 INFO:teuthology.orchestra.run.smithi089.stdout: "num_rdlocks": 0, 2021-04-09T18:33:33.855 INFO:teuthology.orchestra.run.smithi089.stdout: "num_wrlocks": 0, 2021-04-09T18:33:33.855 INFO:teuthology.orchestra.run.smithi089.stdout: "num_xlocks": 1, 2021-04-09T18:33:33.855 INFO:teuthology.orchestra.run.smithi089.stdout: "xlock_by": {} 2021-04-09T18:33:33.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:33.856 INFO:teuthology.orchestra.run.smithi089.stdout: "linklock": {}, 2021-04-09T18:33:33.856 INFO:teuthology.orchestra.run.smithi089.stdout: "dirfragtreelock": {}, 2021-04-09T18:33:33.856 INFO:teuthology.orchestra.run.smithi089.stdout: "filelock": {}, 2021-04-09T18:33:33.856 INFO:teuthology.orchestra.run.smithi089.stdout: "xattrlock": {}, 2021-04-09T18:33:33.857 INFO:teuthology.orchestra.run.smithi089.stdout: "snaplock": { 2021-04-09T18:33:33.857 INFO:teuthology.orchestra.run.smithi089.stdout: "gather_set": [], 2021-04-09T18:33:33.857 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "sync", 2021-04-09T18:33:33.857 INFO:teuthology.orchestra.run.smithi089.stdout: "is_leased": false, 2021-04-09T18:33:33.857 INFO:teuthology.orchestra.run.smithi089.stdout: "num_rdlocks": 1, 2021-04-09T18:33:33.858 INFO:teuthology.orchestra.run.smithi089.stdout: "num_wrlocks": 0, 2021-04-09T18:33:33.858 INFO:teuthology.orchestra.run.smithi089.stdout: "num_xlocks": 0, 2021-04-09T18:33:33.858 INFO:teuthology.orchestra.run.smithi089.stdout: "xlock_by": {} 2021-04-09T18:33:33.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:33.859 INFO:teuthology.orchestra.run.smithi089.stdout: "nestlock": {}, 2021-04-09T18:33:33.859 INFO:teuthology.orchestra.run.smithi089.stdout: "flocklock": {}, 2021-04-09T18:33:33.859 INFO:teuthology.orchestra.run.smithi089.stdout: "policylock": {}, 2021-04-09T18:33:33.859 INFO:teuthology.orchestra.run.smithi089.stdout: "states": [ 2021-04-09T18:33:33.859 INFO:teuthology.orchestra.run.smithi089.stdout: "auth", 2021-04-09T18:33:33.860 INFO:teuthology.orchestra.run.smithi089.stdout: "dirty", 2021-04-09T18:33:33.860 INFO:teuthology.orchestra.run.smithi089.stdout: "dirtyparent" 2021-04-09T18:33:33.860 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2021-04-09T18:33:33.860 INFO:teuthology.orchestra.run.smithi089.stdout: "client_caps": [ 2021-04-09T18:33:33.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2021-04-09T18:33:33.861 INFO:teuthology.orchestra.run.smithi089.stdout: "client_id": 5945, 2021-04-09T18:33:33.861 INFO:teuthology.orchestra.run.smithi089.stdout: "pending": "pLsXsFs", 2021-04-09T18:33:33.861 INFO:teuthology.orchestra.run.smithi089.stdout: "issued": "pLsXsFs", 2021-04-09T18:33:33.861 INFO:teuthology.orchestra.run.smithi089.stdout: "wanted": "-", 2021-04-09T18:33:33.861 INFO:teuthology.orchestra.run.smithi089.stdout: "last_sent": 2 2021-04-09T18:33:33.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:33.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2021-04-09T18:33:33.862 INFO:teuthology.orchestra.run.smithi089.stdout: "client_id": 6714, 2021-04-09T18:33:33.862 INFO:teuthology.orchestra.run.smithi089.stdout: "pending": "pLsXsFs", 2021-04-09T18:33:33.862 INFO:teuthology.orchestra.run.smithi089.stdout: "issued": "pLsXsFs", 2021-04-09T18:33:33.863 INFO:teuthology.orchestra.run.smithi089.stdout: "wanted": "-", 2021-04-09T18:33:33.863 INFO:teuthology.orchestra.run.smithi089.stdout: "last_sent": 2 2021-04-09T18:33:33.863 INFO:teuthology.orchestra.run.smithi089.stdout: } 2021-04-09T18:33:33.863 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2021-04-09T18:33:33.864 INFO:teuthology.orchestra.run.smithi089.stdout: "loner": -1, 2021-04-09T18:33:33.864 INFO:teuthology.orchestra.run.smithi089.stdout: "want_loner": -1, 2021-04-09T18:33:33.864 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_caps_wanted": [] 2021-04-09T18:33:33.864 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:33:33.865 INFO:tasks.cephfs.filesystem:_json_asok output: { "path": "/", "ino": 1, "rdev": 0, "ctime": "2021-04-09 18:33:31.025640", "btime": "2021-04-09 18:33:24.322263", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 15, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2021-04-09 18:33:24.322263", "atime": "0.000000", "time_warp_seq": 0, "change_attr": 1, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2021-04-09 18:33:31.025640" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "2021-04-09 18:33:24.322263" }, "version": 3, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 3, "stray_prior_path": "", "symlink": "", "old_inodes": [], "dirfragtree": { "splits": [] }, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 2, "is_frozen": false, "is_freezing": false, "pins": { "request": 1, "lock": 3, "dirfrag": 1, "caps": 1, "dirtyparent": 1, "dirty": 1, "authpin": 1 }, "nref": 9, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 1, "num_xlocks": 0, "xlock_by": {} }, "authlock": { "gather_set": [], "state": "xlockdone", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 1, "xlock_by": {} }, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": { "gather_set": [], "state": "sync", "is_leased": false, "num_rdlocks": 1, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "nestlock": {}, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent" ], "client_caps": [ { "client_id": 5945, "pending": "pLsXsFs", "issued": "pLsXsFs", "wanted": "-", "last_sent": 2 }, { "client_id": 6714, "pending": "pLsXsFs", "issued": "pLsXsFs", "wanted": "-", "last_sent": 2 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [] } 2021-04-09T18:33:33.866 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:33:33.866 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:33.884 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:33.902 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:33.921 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:33.939 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:33.958 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:33:33.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:33.959 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:33.959 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:33.969 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:33:33.970 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:33:33.970 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi090.front.sepia.ceph.com... 2021-04-09T18:33:33.971 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:33:33.971 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:34.050 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13783]: fuse finished with error 0 and tester_r 0 2021-04-09T18:33:34.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:34.053 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:34.053 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:34.100 INFO:teuthology.orchestra.run.smithi090.stdout:ext2/ext3 2021-04-09T18:33:34.102 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:33:34.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:33:34.147 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:34.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:34.197 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:34.197 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:34.206 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-04-09T18:33:34.207 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-04-09T18:33:34.207 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2021-04-09T18:33:34.208 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:33:34.208 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:34.283 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13368]: fuse finished with error 0 and tester_r 0 2021-04-09T18:33:34.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:34.285 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:34.286 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:34.337 INFO:teuthology.orchestra.run.smithi136.stdout:ext2/ext3 2021-04-09T18:33:34.338 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:33:34.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:33:34.454 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:34.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:34.502 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:34.503 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:33:34.509 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:33:34.509 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:33:34.510 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:33:34.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:33:34.511 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:33:34.561 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:33:34.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.657 7f450d4d4700 1 Processor -- start 2021-04-09T18:33:34.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.657 7f450d4d4700 1 -- start start 2021-04-09T18:33:34.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f450d4d4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45080e9ae0 0x7f450809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:34.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f450d4d4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f45081c8010 0x7f45081ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:34.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f450d4d4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45080fbb20 con 0x7f45080f5520 2021-04-09T18:33:34.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f450d4d4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45081c3dc0 con 0x7f45081c8010 2021-04-09T18:33:34.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f450d4d4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45080e9f30 con 0x7f45080e9ae0 2021-04-09T18:33:34.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f4506a46700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45080e9ae0 0x7f450809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:34.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f4507a48700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f45081c8010 0x7f45081ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:34.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f4506a46700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45080e9ae0 0x7f450809f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:57686/0 (socket says 172.21.15.79:57686) 2021-04-09T18:33:34.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f4506a46700 1 -- 172.21.15.79:0/167211490 learned_addr learned my addr 172.21.15.79:0/167211490 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:34.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f4507a48700 1 -- 172.21.15.79:0/167211490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45080e9ae0 msgr2=0x7f450809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:34.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f4507a48700 1 --2- 172.21.15.79:0/167211490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45080e9ae0 0x7f450809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:34.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f4507a48700 1 -- 172.21.15.79:0/167211490 >> v1:172.21.15.89:6789/0 conn(0x7f45080f5520 legacy=0x7f45080f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:34.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f4507a48700 1 -- 172.21.15.79:0/167211490 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45080e56d0 con 0x7f45081c8010 2021-04-09T18:33:34.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f4506a46700 1 --2- 172.21.15.79:0/167211490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45080e9ae0 0x7f450809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:34.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f4507a48700 1 --2- 172.21.15.79:0/167211490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45081c8010 0x7f45081ca470 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f45000032b0 tx=0x7f450000b3c0).ready entity=mon.1 client_cookie=523ff652018a84ab server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:34.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f4506245700 1 -- 172.21.15.79:0/167211490 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f45080e56d0 con 0x7f45081c8010 2021-04-09T18:33:34.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f4506245700 1 -- 172.21.15.79:0/167211490 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450000bc20 con 0x7f45081c8010 2021-04-09T18:33:34.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f4506245700 1 -- 172.21.15.79:0/167211490 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4500002020 con 0x7f45081c8010 2021-04-09T18:33:34.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f450d4d4700 1 -- 172.21.15.79:0/167211490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45081c8010 msgr2=0x7f45081ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:34.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f450d4d4700 1 --2- 172.21.15.79:0/167211490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45081c8010 0x7f45081ca470 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f45000032b0 tx=0x7f450000b3c0).stop 2021-04-09T18:33:34.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f450d4d4700 1 -- 172.21.15.79:0/167211490 shutdown_connections 2021-04-09T18:33:34.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f450d4d4700 1 --2- 172.21.15.79:0/167211490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45081c8010 0x7f45081ca470 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:34.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f450d4d4700 1 --2- 172.21.15.79:0/167211490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45080e9ae0 0x7f450809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:34.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f450d4d4700 1 -- 172.21.15.79:0/167211490 >> 172.21.15.79:0/167211490 conn(0x7f45080e5fe0 msgr2=0x7f45080e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:34.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f450d4d4700 1 -- 172.21.15.79:0/167211490 shutdown_connections 2021-04-09T18:33:34.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.661 7f450d4d4700 1 -- 172.21.15.79:0/167211490 wait complete. 2021-04-09T18:33:34.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.665 7f450d4d4700 1 Processor -- start 2021-04-09T18:33:34.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.665 7f450d4d4700 1 -- start start 2021-04-09T18:33:34.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.665 7f450d4d4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f450809a580 0x7f45080bbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:34.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.665 7f450d4d4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f450809a9d0 0x7f4508094740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:34.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.665 7f450d4d4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45080d0bd0 0x7f45080d1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:34.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.665 7f450d4d4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450809a280 con 0x7f450809a9d0 2021-04-09T18:33:34.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.665 7f450d4d4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45080955c0 con 0x7f450809a580 2021-04-09T18:33:34.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.665 7f450d4d4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45080bc5d0 con 0x7f45080d0bd0 2021-04-09T18:33:34.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.665 7f4506a46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f450809a9d0 0x7f4508094740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:34.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.665 7f4506a46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f450809a9d0 0x7f4508094740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60694/0 (socket says 172.21.15.79:60694) 2021-04-09T18:33:34.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.665 7f4506a46700 1 -- 172.21.15.79:0/568977808 learned_addr learned my addr 172.21.15.79:0/568977808 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:34.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.665 7f4507a48700 1 --2- 172.21.15.79:0/568977808 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45080d0bd0 0x7f45080d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:34.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.665 7f4507247700 1 --2- 172.21.15.79:0/568977808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f450809a580 0x7f45080bbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:34.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.665 7f4506a46700 1 -- 172.21.15.79:0/568977808 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45080d0bd0 msgr2=0x7f45080d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:34.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.665 7f4506a46700 1 --2- 172.21.15.79:0/568977808 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45080d0bd0 0x7f45080d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:34.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.665 7f4506a46700 1 -- 172.21.15.79:0/568977808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f450809a580 msgr2=0x7f45080bbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:34.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.665 7f4506a46700 1 --2- 172.21.15.79:0/568977808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f450809a580 0x7f45080bbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:34.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.665 7f4506a46700 1 -- 172.21.15.79:0/568977808 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4508094d70 con 0x7f450809a9d0 2021-04-09T18:33:34.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.665 7f4506a46700 1 --2- 172.21.15.79:0/568977808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f450809a9d0 0x7f4508094740 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f44f800c000 tx=0x7f44f800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:34.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.669 7f44fffff700 1 -- 172.21.15.79:0/568977808 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4508094d70 con 0x7f450809a9d0 2021-04-09T18:33:34.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.669 7f44fffff700 1 -- 172.21.15.79:0/568977808 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f800cbd0 con 0x7f450809a9d0 2021-04-09T18:33:34.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.669 7f450d4d4700 1 -- 172.21.15.79:0/568977808 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f450808ee50 con 0x7f450809a9d0 2021-04-09T18:33:34.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.669 7f44fffff700 1 -- 172.21.15.79:0/568977808 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f44f800f040 con 0x7f450809a9d0 2021-04-09T18:33:34.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.669 7f450d4d4700 1 -- 172.21.15.79:0/568977808 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45080d79b0 con 0x7f450809a9d0 2021-04-09T18:33:34.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.669 7f44fffff700 1 -- 172.21.15.79:0/568977808 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f44f8011070 con 0x7f450809a9d0 2021-04-09T18:33:34.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.669 7f44fffff700 1 --2- 172.21.15.79:0/568977808 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f44ec029100 0x7f44ec02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:34.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.669 7f44fffff700 1 -- 172.21.15.79:0/568977808 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f44f8010040 con 0x7f450809a9d0 2021-04-09T18:33:34.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.669 7f4507247700 1 --2- 172.21.15.79:0/568977808 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f44ec029100 0x7f44ec02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:34.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.669 7f4507247700 1 --2- 172.21.15.79:0/568977808 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f44ec029100 0x7f44ec02b650 crc :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:34.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.673 7f450d4d4700 1 -- 172.21.15.79:0/568977808 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45080e39e0 con 0x7f450809a9d0 2021-04-09T18:33:34.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.677 7f44fffff700 1 -- 172.21.15.79:0/568977808 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f44f8000bf0 con 0x7f450809a9d0 2021-04-09T18:33:34.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.841 7f450d4d4700 1 -- 172.21.15.79:0/568977808 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f45080f5b20 con 0x7f450809a9d0 2021-04-09T18:33:34.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.841 7f44fffff700 1 -- 172.21.15.79:0/568977808 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v79) v1 ==== 81+0+30755 (secure 0 0 0) 0x7f44f800c9c0 con 0x7f450809a9d0 2021-04-09T18:33:34.848 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:34.848 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:33:34.849 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 79, 2021-04-09T18:33:34.849 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:33:34.849 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:33:34.849 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:33:25.320368", 2021-04-09T18:33:34.850 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:33:34.850 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:33:34.850 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:33:34.850 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:33:34.850 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:33:34.851 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:33:34.851 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:33:34.851 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:33:34.852 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:33:34.852 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:33:34.852 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:33:34.852 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:33:34.852 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:33:34.853 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:33:34.853 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:33:34.853 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 15, 2021-04-09T18:33:34.853 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:33:34.854 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:33:34.854 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:33:34.854 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:33:34.854 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:33:34.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.855 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:33:34.855 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:33:34.855 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:33:34.855 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:33:34.856 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:33:34.856 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:33:34.856 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:33:34.856 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:33:34.857 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:33:34.857 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:33:34.857 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:33:34.857 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:33:34.857 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:33:34.858 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:33:34.858 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:33:34.858 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:33:34.858 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:33:34.859 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:33:34.859 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:33:34.859 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:33:34.859 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:33:34.860 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:33:34.860 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:33:34.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.860 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:33:34.861 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:33:34.861 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:33:34.861 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:33:34.861 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:33:34.862 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:33:34.862 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:33:34.862 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:33:34.862 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:33:34.863 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:33:34.863 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:33:34.863 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:33:34.863 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:33:34.863 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:33:34.864 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:33:34.864 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:33:34.864 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:33:34.864 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:33:34.865 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:33:34.865 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:33:34.865 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:33:34.865 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:33:34.865 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:33:34.866 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:33:34.866 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:33:34.866 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:33:34.866 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:33:34.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.867 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:33:34.867 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:33:34.867 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:33:34.867 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:33:34.868 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:33:34.868 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:33:34.868 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:33:34.868 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:33:34.869 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:33:34.869 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:33:34.869 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:33:34.869 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:33:34.870 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:33:34.870 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:33:34.870 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.871 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 14, 2021-04-09T18:33:34.871 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2021-04-09T18:33:34.871 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:33:22.552244", 2021-04-09T18:33:34.872 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:33:34.872 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:33:34.872 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:33:34.872 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:33:34.873 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:33:34.873 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:33:34.873 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:33:34.873 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:33:34.873 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:33:34.874 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:33:34.874 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:33:34.874 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:33:34.874 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:33:34.875 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:33:34.875 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:33:34.875 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:33:34.875 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:33:34.876 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:33:34.876 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:33:34.876 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:33:34.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.876 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "78", 2021-04-09T18:33:34.877 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:33:34.877 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:33:34.877 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:33:34.877 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:33:34.878 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:33:34.878 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:33:34.878 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:33:34.878 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:33:34.878 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:33:34.879 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:33:34.879 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:33:34.879 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:33:34.879 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:33:34.880 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:33:34.880 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:33:34.880 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:33:34.880 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:33:34.880 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:33:34.881 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:33:34.881 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:33:34.881 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:33:34.881 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:33:34.882 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:33:34.882 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:33:34.882 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:33:34.882 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:33:34.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.883 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:33:34.883 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:33:34.883 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:33:34.883 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:33:34.884 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:33:34.884 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:33:34.884 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:33:34.884 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:33:34.885 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:33:34.885 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:33:34.885 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:33:34.885 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2021-04-09T18:33:34.886 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2021-04-09T18:33:34.886 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2021-04-09T18:33:34.886 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2021-04-09T18:33:34.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.886 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:33:34.887 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:33:34.887 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2021-04-09T18:33:34.887 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.887 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.888 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 15, 2021-04-09T18:33:34.888 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2021-04-09T18:33:34.888 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:33:23.559196", 2021-04-09T18:33:34.889 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:33:34.889 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:33:34.889 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:33:34.889 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:33:34.890 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:33:34.890 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:33:34.890 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:33:34.890 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:33:34.890 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:33:34.891 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:33:34.891 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:33:34.891 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:33:34.891 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:33:34.892 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:33:34.892 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:33:34.892 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:33:34.892 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:33:34.893 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:33:34.893 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:33:34.893 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:33:34.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.894 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "79", 2021-04-09T18:33:34.894 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:33:34.894 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:33:34.894 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:33:34.894 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:33:34.895 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:33:34.895 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:33:34.895 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:33:34.895 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:33:34.896 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:33:34.896 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:33:34.896 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:33:34.896 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:33:34.897 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:33:34.897 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:33:34.897 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:33:34.897 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:33:34.897 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:33:34.898 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:33:34.898 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:33:34.898 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:33:34.898 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:33:34.899 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:33:34.899 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:33:34.899 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:33:34.899 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:33:34.900 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:33:34.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.900 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:33:34.900 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:33:34.900 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:33:34.901 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:33:34.901 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:33:34.901 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:33:34.901 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:33:34.902 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:33:34.902 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:33:34.902 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:33:34.902 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:33:34.902 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:33:34.903 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:33:34.903 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:33:34.903 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2021-04-09T18:33:34.903 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.904 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.904 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.904 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:33:34.904 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:33:34.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.905 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:33:34.905 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:33:34.905 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:34.906 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:34.906 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:34.906 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:34.906 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:34.907 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:34.907 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:34.907 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 77, 2021-04-09T18:33:34.907 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:34.908 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:34.908 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:34.908 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:34.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.908 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:34.909 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:33:34.909 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:34.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.909 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:34.910 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:33:34.910 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:34.910 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.910 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.911 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:34.911 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:34.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.912 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:34.912 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:33:34.912 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:34.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.913 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:34.913 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:33:34.914 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:34.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.914 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.915 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:34.915 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:34.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.915 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:34.916 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:33:34.916 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:34.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.916 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:34.917 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:33:34.917 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:34.917 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.917 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.918 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:34.918 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:34.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.919 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:34.919 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:33:34.919 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:34.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.920 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:34.920 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:33:34.921 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:34.921 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.921 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.922 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:33:34.922 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:33:34.922 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:33:34.922 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:33:34.922 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:34.923 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:34.923 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:34.923 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.924 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:33:34.924 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:33:34.924 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:34.925 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:34.925 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:34.925 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:34.925 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:34.926 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:34.926 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:34.926 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 77, 2021-04-09T18:33:34.926 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:34.927 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:34.927 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:34.927 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:34.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.928 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:34.928 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:33:34.928 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:34.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.929 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:34.929 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:33:34.929 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:34.930 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.930 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.930 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:34.931 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:34.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.931 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:34.931 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:33:34.932 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:34.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:34.933 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:33:34.933 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:34.933 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.933 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.934 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:34.934 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:34.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.934 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:34.935 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:33:34.935 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:34.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.936 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:34.936 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:33:34.936 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:34.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.937 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.937 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:34.937 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:34.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.938 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:34.938 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:33:34.938 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:34.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.939 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:34.939 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:33:34.940 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:34.940 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.940 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.940 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:33:34.941 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:33:34.941 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:33:34.941 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:33:34.941 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:34.942 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:34.942 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:34.942 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.943 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:33:34.943 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:33:34.943 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:34.944 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:34.944 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:34.944 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:34.944 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:34.944 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:34.945 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:34.945 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 77, 2021-04-09T18:33:34.945 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:34.945 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:34.946 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:34.946 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:34.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.946 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:34.946 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:33:34.947 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:34.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.947 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:34.948 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:33:34.948 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:34.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.948 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.949 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:34.949 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:34.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.950 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:34.950 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:33:34.950 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:34.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.951 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:34.951 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:33:34.951 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:34.951 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.952 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.952 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:34.952 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:34.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.953 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:34.953 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:33:34.953 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:34.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:34.954 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:33:34.954 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:34.955 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.955 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.955 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:34.956 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:34.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.956 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:34.956 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:33:34.957 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:34.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.957 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:34.958 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:33:34.958 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:34.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.958 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.959 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:33:34.959 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:33:34.959 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:33:34.959 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:33:34.960 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:34.960 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:34.960 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:34.960 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.961 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:33:34.961 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:33:34.961 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:34.962 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:34.962 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:34.962 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:34.962 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:34.962 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:34.963 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:34.963 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 76, 2021-04-09T18:33:34.963 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:34.963 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:34.964 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:34.964 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:34.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.964 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:34.965 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:33:34.965 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:34.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.966 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:34.966 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:33:34.966 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:34.966 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.967 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.967 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:34.968 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:34.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.968 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:34.969 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:33:34.969 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:34.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.970 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:34.970 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:33:34.970 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:34.971 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.971 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.972 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:34.972 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:34.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.972 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:34.973 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:33:34.973 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:34.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.974 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:34.974 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:33:34.975 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:34.975 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.975 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.976 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:34.976 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:34.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.977 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:34.977 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:33:34.977 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:34.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.978 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:34.978 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:33:34.978 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:34.978 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.979 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.979 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:33:34.979 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:33:34.980 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:33:34.980 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:33:34.980 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:34.980 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:34.981 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:34.981 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:33:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:33:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 77, 2021-04-09T18:33:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:33:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:34.987 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:33:34.987 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:34.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.987 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:33:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:33:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:33:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:33:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:33:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:33:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:33:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:33:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:33:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:33:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:33:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:33:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 76, 2021-04-09T18:33:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:33:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:33:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:33:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:33:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:33:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:33:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:33:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:33:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:33:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:33:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:33:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:33:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:33:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:33:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 77, 2021-04-09T18:33:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:33:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:33:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:33:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:33:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:33:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:33:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:33:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:33:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:33:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:33:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:33:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:33:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:33:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:33:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 66, 2021-04-09T18:33:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:33:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:33:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:33:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:33:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:33:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:33:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:33:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:33:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:33:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:33:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:33:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:33:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:33:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:33:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:33:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:33:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:33:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:33:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:35.064 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:35.064 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:35.064 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:35.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.065 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:33:35.065 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:35.065 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:35.065 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:35.066 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:35.066 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:35.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.067 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:33:35.067 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:35.067 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:35.067 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:35.068 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:35.068 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:35.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.069 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:33:35.069 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:35.069 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:35.069 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:35.070 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:35.070 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:35.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:35.071 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:33:35.071 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:35.071 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:35.071 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:35.072 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:35.072 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:35.072 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:35.072 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:33:35.072 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:33:35.073 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:33:35.073 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:33:35.073 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:33:35.073 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": {}, 2021-04-09T18:33:35.074 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:33:35.074 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:33:35.074 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:33:35.074 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:33:35.075 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:33:35.075 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:33:35.075 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:33:35.075 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:33:35.076 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:33:35.076 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:33:35.076 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:33:35.076 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:33:35.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.077 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:33:35.077 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:33:35.077 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:33:35.077 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:33:35.078 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:33:35.078 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:33:35.078 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:33:35.078 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:35.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:35.079 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:33:35.079 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:33:35.079 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:33:35.080 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:33:35.080 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:33:35.080 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:33:35.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.845 7f450d4d4700 1 -- 172.21.15.79:0/568977808 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f44ec029100 msgr2=0x7f44ec02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:35.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.845 7f450d4d4700 1 --2- 172.21.15.79:0/568977808 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f44ec029100 0x7f44ec02b650 crc :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.845 7f450d4d4700 1 -- 172.21.15.79:0/568977808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f450809a9d0 msgr2=0x7f4508094740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:35.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.845 7f450d4d4700 1 --2- 172.21.15.79:0/568977808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f450809a9d0 0x7f4508094740 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f44f800c000 tx=0x7f44f800c430).stop 2021-04-09T18:33:35.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.845 7f450d4d4700 1 -- 172.21.15.79:0/568977808 shutdown_connections 2021-04-09T18:33:35.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.845 7f450d4d4700 1 --2- 172.21.15.79:0/568977808 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f44ec029100 0x7f44ec02b650 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.845 7f450d4d4700 1 --2- 172.21.15.79:0/568977808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f450809a580 0x7f45080bbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.845 7f450d4d4700 1 --2- 172.21.15.79:0/568977808 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45080d0bd0 0x7f45080d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.845 7f450d4d4700 1 --2- 172.21.15.79:0/568977808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f450809a9d0 0x7f4508094740 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.845 7f450d4d4700 1 -- 172.21.15.79:0/568977808 >> 172.21.15.79:0/568977808 conn(0x7f45080b9990 msgr2=0x7f45080a46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:35.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.845 7f450d4d4700 1 -- 172.21.15.79:0/568977808 shutdown_connections 2021-04-09T18:33:35.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:34.845 7f450d4d4700 1 -- 172.21.15.79:0/568977808 wait complete. 2021-04-09T18:33:35.086 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:35.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f212d131700 1 Processor -- start 2021-04-09T18:33:35.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f212d131700 1 -- start start 2021-04-09T18:33:35.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f212d131700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21280e9ae0 0x7f212809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:35.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f212d131700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f21281c8010 0x7f21281ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:35.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f212d131700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21280fbb20 con 0x7f21280f5520 2021-04-09T18:33:35.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f212d131700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21281c3dc0 con 0x7f21280e9ae0 2021-04-09T18:33:35.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f212d131700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21280e9f30 con 0x7f21281c8010 2021-04-09T18:33:35.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f212659c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21280e9ae0 0x7f212809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:35.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f2126d9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f21280f5520 0x7f21280f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55412/0 (socket says 172.21.15.79:55412) 2021-04-09T18:33:35.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f2126d9d700 1 -- 172.21.15.79:0/2192479239 learned_addr learned my addr 172.21.15.79:0/2192479239 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:35.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f212759e700 1 --2- 172.21.15.79:0/2192479239 >> v2:172.21.15.89:3300/0 conn(0x7f21281c8010 0x7f21281ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:35.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f212659c700 1 -- 172.21.15.79:0/2192479239 >> v2:172.21.15.89:3300/0 conn(0x7f21281c8010 msgr2=0x7f21281ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:35.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f212659c700 1 --2- 172.21.15.79:0/2192479239 >> v2:172.21.15.89:3300/0 conn(0x7f21281c8010 0x7f21281ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f2125d9b700 1 -- 172.21.15.79:0/2192479239 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581965246 0 0) 0x7f2118001450 con 0x7f21280f5520 2021-04-09T18:33:35.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f212659c700 1 -- 172.21.15.79:0/2192479239 >> v1:172.21.15.79:6789/0 conn(0x7f21280f5520 legacy=0x7f21280f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:35.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f212659c700 1 -- 172.21.15.79:0/2192479239 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21280e56d0 con 0x7f21280e9ae0 2021-04-09T18:33:35.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f212659c700 1 --2- 172.21.15.79:0/2192479239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21280e9ae0 0x7f212809f110 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f211c002f30 tx=0x7f211c00bd10).ready entity=mon.0 client_cookie=a774b3259f6ab24c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:35.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f2125d9b700 1 -- 172.21.15.79:0/2192479239 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f21280e56d0 con 0x7f21280e9ae0 2021-04-09T18:33:35.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f2125d9b700 1 -- 172.21.15.79:0/2192479239 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c0098a0 con 0x7f21280e9ae0 2021-04-09T18:33:35.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f2125d9b700 1 -- 172.21.15.79:0/2192479239 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f211c009c70 con 0x7f21280e9ae0 2021-04-09T18:33:35.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f212d131700 1 -- 172.21.15.79:0/2192479239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21280e9ae0 msgr2=0x7f212809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:35.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.181 7f212d131700 1 --2- 172.21.15.79:0/2192479239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21280e9ae0 0x7f212809f110 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f211c002f30 tx=0x7f211c00bd10).stop 2021-04-09T18:33:35.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.185 7f212d131700 1 -- 172.21.15.79:0/2192479239 shutdown_connections 2021-04-09T18:33:35.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.185 7f212d131700 1 --2- 172.21.15.79:0/2192479239 >> v2:172.21.15.89:3300/0 conn(0x7f21281c8010 0x7f21281ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.185 7f212d131700 1 --2- 172.21.15.79:0/2192479239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21280e9ae0 0x7f212809f110 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.185 7f212d131700 1 -- 172.21.15.79:0/2192479239 >> 172.21.15.79:0/2192479239 conn(0x7f21280e5fe0 msgr2=0x7f21280e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:35.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.185 7f212d131700 1 -- 172.21.15.79:0/2192479239 shutdown_connections 2021-04-09T18:33:35.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.185 7f212d131700 1 -- 172.21.15.79:0/2192479239 wait complete. 2021-04-09T18:33:35.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.189 7f212d131700 1 Processor -- start 2021-04-09T18:33:35.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.189 7f212d131700 1 -- start start 2021-04-09T18:33:35.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.189 7f212d131700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21280d6510 0x7f212819bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:35.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.189 7f212d131700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21280bae00 0x7f212819dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:35.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.189 7f212d131700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f212819e4f0 0x7f21280d4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:35.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.189 7f212d131700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21280e8af0 con 0x7f21280bae00 2021-04-09T18:33:35.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.189 7f212d131700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212819c620 con 0x7f21280d6510 2021-04-09T18:33:35.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.189 7f212d131700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212819c920 con 0x7f212819e4f0 2021-04-09T18:33:35.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.189 7f212659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21280bae00 0x7f212819dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:35.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.189 7f212659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21280bae00 0x7f212819dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60712/0 (socket says 172.21.15.79:60712) 2021-04-09T18:33:35.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.189 7f212659c700 1 -- 172.21.15.79:0/2747287899 learned_addr learned my addr 172.21.15.79:0/2747287899 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:35.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.189 7f2126d9d700 1 --2- 172.21.15.79:0/2747287899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21280d6510 0x7f212819bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:35.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.189 7f212759e700 1 --2- 172.21.15.79:0/2747287899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f212819e4f0 0x7f21280d4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:35.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.189 7f212659c700 1 -- 172.21.15.79:0/2747287899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f212819e4f0 msgr2=0x7f21280d4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:35.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.189 7f212659c700 1 --2- 172.21.15.79:0/2747287899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f212819e4f0 0x7f21280d4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.189 7f212659c700 1 -- 172.21.15.79:0/2747287899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21280d6510 msgr2=0x7f212819bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:35.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.189 7f212659c700 1 --2- 172.21.15.79:0/2747287899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21280d6510 0x7f212819bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.189 7f212659c700 1 -- 172.21.15.79:0/2747287899 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2128098df0 con 0x7f21280bae00 2021-04-09T18:33:35.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.193 7f212659c700 1 --2- 172.21.15.79:0/2747287899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21280bae00 0x7f212819dec0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f21280d7e80 tx=0x7f211c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:35.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.193 7f21177fe700 1 -- 172.21.15.79:0/2747287899 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2128098df0 con 0x7f21280bae00 2021-04-09T18:33:35.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.193 7f21177fe700 1 -- 172.21.15.79:0/2747287899 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c011dc0 con 0x7f21280bae00 2021-04-09T18:33:35.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.193 7f212d131700 1 -- 172.21.15.79:0/2747287899 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21280bb250 con 0x7f21280bae00 2021-04-09T18:33:35.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.193 7f21177fe700 1 -- 172.21.15.79:0/2747287899 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f211c01d670 con 0x7f21280bae00 2021-04-09T18:33:35.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.193 7f212d131700 1 -- 172.21.15.79:0/2747287899 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21280d52d0 con 0x7f21280bae00 2021-04-09T18:33:35.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.193 7f21177fe700 1 -- 172.21.15.79:0/2747287899 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f211c01d870 con 0x7f21280bae00 2021-04-09T18:33:35.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.193 7f21177fe700 1 --2- 172.21.15.79:0/2747287899 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f210c029100 0x7f210c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:35.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.193 7f21177fe700 1 -- 172.21.15.79:0/2747287899 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f211c03b440 con 0x7f21280bae00 2021-04-09T18:33:35.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.193 7f2126d9d700 1 --2- 172.21.15.79:0/2747287899 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f210c029100 0x7f210c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:35.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.193 7f2126d9d700 1 --2- 172.21.15.79:0/2747287899 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f210c029100 0x7f210c02b650 crc :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:35.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.209 7f212d131700 1 -- 172.21.15.79:0/2747287899 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21280e39e0 con 0x7f21280bae00 2021-04-09T18:33:35.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.217 7f21177fe700 1 -- 172.21.15.79:0/2747287899 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f211c009690 con 0x7f21280bae00 2021-04-09T18:33:35.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.389 7f212d131700 1 -- 172.21.15.79:0/2747287899 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21280f5b20 con 0x7f21280bae00 2021-04-09T18:33:35.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.393 7f21177fe700 1 -- 172.21.15.79:0/2747287899 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2103 (secure 0 0 0) 0x7f211c011bb0 con 0x7f21280bae00 2021-04-09T18:33:35.397 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 47 2021-04-09T18:33:35.398 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:35.398 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":47,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6510,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/4230183300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4230183300},{"type":"v1","addr":"172.21.15.79:6833","nonce":4230183300}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:33:24.317443","modified":"2021-04-09 18:33:25.319829","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5837},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5837":{"gid":5837,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/1825266006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1825266006},{"type":"v1","addr":"172.21.15.89:6835","nonce":1825266006}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-04-09T18:33:35.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.397 7f212d131700 1 -- 172.21.15.79:0/2747287899 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f210c029100 msgr2=0x7f210c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:35.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.397 7f212d131700 1 --2- 172.21.15.79:0/2747287899 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f210c029100 0x7f210c02b650 crc :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.397 7f212d131700 1 -- 172.21.15.79:0/2747287899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21280bae00 msgr2=0x7f212819dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:35.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.397 7f212d131700 1 --2- 172.21.15.79:0/2747287899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21280bae00 0x7f212819dec0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f21280d7e80 tx=0x7f211c006890).stop 2021-04-09T18:33:35.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.397 7f212d131700 1 -- 172.21.15.79:0/2747287899 shutdown_connections 2021-04-09T18:33:35.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.397 7f212d131700 1 --2- 172.21.15.79:0/2747287899 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f210c029100 0x7f210c02b650 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.397 7f212d131700 1 --2- 172.21.15.79:0/2747287899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21280d6510 0x7f212819bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.397 7f212d131700 1 --2- 172.21.15.79:0/2747287899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f212819e4f0 0x7f21280d4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.397 7f212d131700 1 --2- 172.21.15.79:0/2747287899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21280bae00 0x7f212819dec0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.397 7f212d131700 1 -- 172.21.15.79:0/2747287899 >> 172.21.15.79:0/2747287899 conn(0x7f21280afeb0 msgr2=0x7f21280a7020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.397 7f212d131700 1 -- 172.21.15.79:0/2747287899 shutdown_connections 2021-04-09T18:33:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.397 7f212d131700 1 -- 172.21.15.79:0/2747287899 wait complete. 2021-04-09T18:33:35.410 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-04-09T18:33:35.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.505 7f27b6fe4700 1 Processor -- start 2021-04-09T18:33:35.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.505 7f27b6fe4700 1 -- start start 2021-04-09T18:33:35.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.505 7f27b6fe4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f27b00f5520 0x7f27b00f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:35.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.505 7f27b6fe4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b00e9ae0 0x7f27b009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:35.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.505 7f27b6fe4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27b01c2db0 0x7f27b01c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:35.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.505 7f27b6fe4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b00e9f30 con 0x7f27b01c2db0 2021-04-09T18:33:35.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.505 7f27b6fe4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b00e59d0 con 0x7f27b00f5520 2021-04-09T18:33:35.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.505 7f27b6fe4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b00fbb20 con 0x7f27b00e9ae0 2021-04-09T18:33:35.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27b5589700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27b01c2db0 0x7f27b01c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:35.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27b5589700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27b01c2db0 0x7f27b01c3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60720/0 (socket says 172.21.15.79:60720) 2021-04-09T18:33:35.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27b5589700 1 -- 172.21.15.79:0/1751805759 learned_addr learned my addr 172.21.15.79:0/1751805759 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:35.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27affff700 1 --2- 172.21.15.79:0/1751805759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b00e9ae0 0x7f27b009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:35.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27b4d88700 1 --2- 172.21.15.79:0/1751805759 >> v2:172.21.15.89:3300/0 conn(0x7f27b00f5520 0x7f27b00f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:35.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27b5589700 1 -- 172.21.15.79:0/1751805759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b00e9ae0 msgr2=0x7f27b009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:35.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27b5589700 1 --2- 172.21.15.79:0/1751805759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b00e9ae0 0x7f27b009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27b5589700 1 -- 172.21.15.79:0/1751805759 >> v2:172.21.15.89:3300/0 conn(0x7f27b00f5520 msgr2=0x7f27b00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:35.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27b5589700 1 --2- 172.21.15.79:0/1751805759 >> v2:172.21.15.89:3300/0 conn(0x7f27b00f5520 0x7f27b00f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27b5589700 1 -- 172.21.15.79:0/1751805759 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b00e56d0 con 0x7f27b01c2db0 2021-04-09T18:33:35.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27affff700 1 --2- 172.21.15.79:0/1751805759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b00e9ae0 0x7f27b009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:35.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27b4d88700 1 --2- 172.21.15.79:0/1751805759 >> v2:172.21.15.89:3300/0 conn(0x7f27b00f5520 0x7f27b00f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:35.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27b5589700 1 --2- 172.21.15.79:0/1751805759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27b01c2db0 0x7f27b01c3200 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f27a80032b0 tx=0x7f27a800b3c0).ready entity=mon.0 client_cookie=dae895104b85f94e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:35.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27af7fe700 1 -- 172.21.15.79:0/1751805759 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f27b00e56d0 con 0x7f27b01c2db0 2021-04-09T18:33:35.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27af7fe700 1 -- 172.21.15.79:0/1751805759 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a800bc20 con 0x7f27b01c2db0 2021-04-09T18:33:35.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27af7fe700 1 -- 172.21.15.79:0/1751805759 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f27a8002020 con 0x7f27b01c2db0 2021-04-09T18:33:35.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27b6fe4700 1 -- 172.21.15.79:0/1751805759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27b01c2db0 msgr2=0x7f27b01c3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:35.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27b6fe4700 1 --2- 172.21.15.79:0/1751805759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27b01c2db0 0x7f27b01c3200 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f27a80032b0 tx=0x7f27a800b3c0).stop 2021-04-09T18:33:35.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27b6fe4700 1 -- 172.21.15.79:0/1751805759 shutdown_connections 2021-04-09T18:33:35.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27b6fe4700 1 --2- 172.21.15.79:0/1751805759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27b01c2db0 0x7f27b01c3200 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27b6fe4700 1 --2- 172.21.15.79:0/1751805759 >> v2:172.21.15.89:3300/0 conn(0x7f27b00f5520 0x7f27b00f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27b6fe4700 1 --2- 172.21.15.79:0/1751805759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b00e9ae0 0x7f27b009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27b6fe4700 1 -- 172.21.15.79:0/1751805759 >> 172.21.15.79:0/1751805759 conn(0x7f27b00e5fe0 msgr2=0x7f27b00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:35.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27b6fe4700 1 -- 172.21.15.79:0/1751805759 shutdown_connections 2021-04-09T18:33:35.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.509 7f27b6fe4700 1 -- 172.21.15.79:0/1751805759 wait complete. 2021-04-09T18:33:35.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27b6fe4700 1 Processor -- start 2021-04-09T18:33:35.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27b6fe4700 1 -- start start 2021-04-09T18:33:35.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27b6fe4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27b00d6520 0x7f27b00c1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:35.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27b6fe4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b00d4ec0 0x7f27b00b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:35.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27b6fe4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27b00d5310 0x7f27b00b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:35.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27b6fe4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b0096cc0 con 0x7f27b00d6520 2021-04-09T18:33:35.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27b6fe4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b00b16e0 con 0x7f27b00d5310 2021-04-09T18:33:35.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27b6fe4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b00c18c0 con 0x7f27b00d4ec0 2021-04-09T18:33:35.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27b4d88700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27b00d6520 0x7f27b00c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:35.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27b4d88700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27b00d6520 0x7f27b00c1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60722/0 (socket says 172.21.15.79:60722) 2021-04-09T18:33:35.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27b4d88700 1 -- 172.21.15.79:0/1423937296 learned_addr learned my addr 172.21.15.79:0/1423937296 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:35.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27affff700 1 --2- 172.21.15.79:0/1423937296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b00d4ec0 0x7f27b00b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:35.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27b5589700 1 --2- 172.21.15.79:0/1423937296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27b00d5310 0x7f27b00b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:35.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27b4d88700 1 -- 172.21.15.79:0/1423937296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b00d4ec0 msgr2=0x7f27b00b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:35.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27b4d88700 1 --2- 172.21.15.79:0/1423937296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b00d4ec0 0x7f27b00b46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27b4d88700 1 -- 172.21.15.79:0/1423937296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27b00d5310 msgr2=0x7f27b00b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:35.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27b4d88700 1 --2- 172.21.15.79:0/1423937296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27b00d5310 0x7f27b00b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:35.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27b4d88700 1 -- 172.21.15.79:0/1423937296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b00b5350 con 0x7f27b00d6520 2021-04-09T18:33:35.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27b4d88700 1 --2- 172.21.15.79:0/1423937296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27b00d6520 0x7f27b00c1290 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f27b00874d0 tx=0x7f27a400df00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:35.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27ad7fa700 1 -- 172.21.15.79:0/1423937296 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f27b00b5350 con 0x7f27b00d6520 2021-04-09T18:33:35.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27b6fe4700 1 -- 172.21.15.79:0/1423937296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b00b2c80 con 0x7f27b00d6520 2021-04-09T18:33:35.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27ad7fa700 1 -- 172.21.15.79:0/1423937296 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a4010070 con 0x7f27b00d6520 2021-04-09T18:33:35.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.513 7f27ad7fa700 1 -- 172.21.15.79:0/1423937296 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f27a400ba90 con 0x7f27b00d6520 2021-04-09T18:33:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.517 7f27b6fe4700 1 -- 172.21.15.79:0/1423937296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b00b3130 con 0x7f27b00d6520 2021-04-09T18:33:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.517 7f27ad7fa700 1 -- 172.21.15.79:0/1423937296 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f27a4012070 con 0x7f27b00d6520 2021-04-09T18:33:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.517 7f27ad7fa700 1 --2- 172.21.15.79:0/1423937296 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2790029100 0x7f279002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.517 7f27ad7fa700 1 -- 172.21.15.79:0/1423937296 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f27a4039340 con 0x7f27b00d6520 2021-04-09T18:33:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.517 7f27affff700 1 --2- 172.21.15.79:0/1423937296 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2790029100 0x7f279002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:35.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.517 7f27affff700 1 --2- 172.21.15.79:0/1423937296 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2790029100 0x7f279002b650 crc :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:35.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.521 7f27b6fe4700 1 -- 172.21.15.79:0/1423937296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b00e39e0 con 0x7f27b00d6520 2021-04-09T18:33:35.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.525 7f27ad7fa700 1 -- 172.21.15.79:0/1423937296 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f27a400b4a0 con 0x7f27b00d6520 2021-04-09T18:33:35.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:35.681 7f27b6fe4700 1 -- 172.21.15.79:0/1423937296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f27b00f5b20 con 0x7f27b00d6520 2021-04-09T18:33:36.414 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:33:36.409 7fbcd0516700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:33:36.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.421 7f27ad7fa700 1 -- 172.21.15.79:0/1423937296 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) v1 ==== 161+0+0 (secure 0 0 0) 0x7f27a4000bf0 con 0x7f27b00d6520 2021-04-09T18:33:36.450 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-04-09T18:33:36.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.449 7f27b6fe4700 1 -- 172.21.15.79:0/1423937296 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2790029100 msgr2=0x7f279002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:36.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.449 7f27b6fe4700 1 --2- 172.21.15.79:0/1423937296 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2790029100 0x7f279002b650 crc :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:36.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.449 7f27b6fe4700 1 -- 172.21.15.79:0/1423937296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27b00d6520 msgr2=0x7f27b00c1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:36.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.449 7f27b6fe4700 1 --2- 172.21.15.79:0/1423937296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27b00d6520 0x7f27b00c1290 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f27b00874d0 tx=0x7f27a400df00).stop 2021-04-09T18:33:36.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.449 7f27b6fe4700 1 -- 172.21.15.79:0/1423937296 shutdown_connections 2021-04-09T18:33:36.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.449 7f27b6fe4700 1 --2- 172.21.15.79:0/1423937296 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2790029100 0x7f279002b650 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:36.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.449 7f27b6fe4700 1 --2- 172.21.15.79:0/1423937296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27b00d5310 0x7f27b00b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:36.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.449 7f27b6fe4700 1 --2- 172.21.15.79:0/1423937296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27b00d6520 0x7f27b00c1290 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:36.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.449 7f27b6fe4700 1 --2- 172.21.15.79:0/1423937296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b00d4ec0 0x7f27b00b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:36.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.449 7f27b6fe4700 1 -- 172.21.15.79:0/1423937296 >> 172.21.15.79:0/1423937296 conn(0x7f27b00a3c10 msgr2=0x7f27b0099d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:36.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.449 7f27b6fe4700 1 -- 172.21.15.79:0/1423937296 shutdown_connections 2021-04-09T18:33:36.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.449 7f27b6fe4700 1 -- 172.21.15.79:0/1423937296 wait complete. 2021-04-09T18:33:36.459 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2021-04-09T18:33:36.475 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:36.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f59a5378700 1 Processor -- start 2021-04-09T18:33:36.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f59a5378700 1 -- start start 2021-04-09T18:33:36.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f59a5378700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a01c9010 0x7f59a01cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:36.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f59a5378700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a00fbb10 con 0x7f59a00f5510 2021-04-09T18:33:36.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f59a5378700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a009f900 con 0x7f59a00e9ad0 2021-04-09T18:33:36.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f59a5378700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a01c3db0 con 0x7f59a01c9010 2021-04-09T18:33:36.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f599f005700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f59a00f5510 0x7f59a00f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55440/0 (socket says 172.21.15.79:55440) 2021-04-09T18:33:36.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f599f005700 1 -- 172.21.15.79:0/649641034 learned_addr learned my addr 172.21.15.79:0/649641034 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:36.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f599f806700 1 --2- 172.21.15.79:0/649641034 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a01c9010 0x7f59a01cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:36.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f599e003700 1 -- 172.21.15.79:0/649641034 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915371373 0 0) 0x7f59880010d0 con 0x7f59a00f5510 2021-04-09T18:33:36.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f599e003700 1 -- 172.21.15.79:0/649641034 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f598c003240 con 0x7f59a00f5510 2021-04-09T18:33:36.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f599e003700 1 -- 172.21.15.79:0/649641034 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762197799 0 0) 0x7f5990001450 con 0x7f59a00e9ad0 2021-04-09T18:33:36.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f599e003700 1 -- 172.21.15.79:0/649641034 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f598c004680 con 0x7f59a00e9ad0 2021-04-09T18:33:36.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f599f806700 1 -- 172.21.15.79:0/649641034 >> v1:172.21.15.89:6789/0 conn(0x7f59a00e9ad0 legacy=0x7f59a009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:36.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f599f806700 1 -- 172.21.15.79:0/649641034 >> v1:172.21.15.79:6789/0 conn(0x7f59a00f5510 legacy=0x7f59a00f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:36.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f599f806700 1 -- 172.21.15.79:0/649641034 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a00e56c0 con 0x7f59a01c9010 2021-04-09T18:33:36.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f599f806700 1 --2- 172.21.15.79:0/649641034 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a01c9010 0x7f59a01cb470 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f5998002f30 tx=0x7f599800bcf0).ready entity=mon.2 client_cookie=bed9235ec7e0a76a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:36.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f599e003700 1 -- 172.21.15.79:0/649641034 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59a00e56c0 con 0x7f59a01c9010 2021-04-09T18:33:36.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f599e003700 1 -- 172.21.15.79:0/649641034 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5998009920 con 0x7f59a01c9010 2021-04-09T18:33:36.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f599e003700 1 -- 172.21.15.79:0/649641034 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5998009cf0 con 0x7f59a01c9010 2021-04-09T18:33:36.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f59a5378700 1 -- 172.21.15.79:0/649641034 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a01c9010 msgr2=0x7f59a01cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:36.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.565 7f59a5378700 1 --2- 172.21.15.79:0/649641034 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a01c9010 0x7f59a01cb470 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f5998002f30 tx=0x7f599800bcf0).stop 2021-04-09T18:33:36.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.569 7f59a5378700 1 -- 172.21.15.79:0/649641034 shutdown_connections 2021-04-09T18:33:36.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.569 7f59a5378700 1 --2- 172.21.15.79:0/649641034 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a01c9010 0x7f59a01cb470 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:36.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.569 7f59a5378700 1 -- 172.21.15.79:0/649641034 >> 172.21.15.79:0/649641034 conn(0x7f59a00e5fd0 msgr2=0x7f59a00e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:36.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.569 7f59a5378700 1 -- 172.21.15.79:0/649641034 shutdown_connections 2021-04-09T18:33:36.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.569 7f59a5378700 1 -- 172.21.15.79:0/649641034 wait complete. 2021-04-09T18:33:36.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.569 7f59a5378700 1 Processor -- start 2021-04-09T18:33:36.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.569 7f59a5378700 1 -- start start 2021-04-09T18:33:36.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.569 7f59a5378700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59a008e040 0x7f59a00bd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:36.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.569 7f59a5378700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59a00d8760 0x7f59a00a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:36.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.569 7f59a5378700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a00bcd20 0x7f59a00d0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:36.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.569 7f59a5378700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00885b0 con 0x7f59a00d8760 2021-04-09T18:33:36.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.569 7f59a5378700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00e9f20 con 0x7f59a008e040 2021-04-09T18:33:36.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.569 7f59a5378700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a008e640 con 0x7f59a00bcd20 2021-04-09T18:33:36.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.569 7f599e804700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59a00d8760 0x7f59a00a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:36.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f599f005700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59a008e040 0x7f59a00bd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f599e804700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59a00d8760 0x7f59a00a8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60740/0 (socket says 172.21.15.79:60740) 2021-04-09T18:33:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f599f005700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59a008e040 0x7f59a00bd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:49078/0 (socket says 172.21.15.79:49078) 2021-04-09T18:33:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f599e804700 1 -- 172.21.15.79:0/2685710300 learned_addr learned my addr 172.21.15.79:0/2685710300 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f599f806700 1 --2- 172.21.15.79:0/2685710300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a00bcd20 0x7f59a00d0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f599e804700 1 -- 172.21.15.79:0/2685710300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a00bcd20 msgr2=0x7f59a00d0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:36.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f599e804700 1 --2- 172.21.15.79:0/2685710300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a00bcd20 0x7f59a00d0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:36.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f599e804700 1 -- 172.21.15.79:0/2685710300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59a008e040 msgr2=0x7f59a00bd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:36.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f599e804700 1 --2- 172.21.15.79:0/2685710300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59a008e040 0x7f59a00bd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:36.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f599e804700 1 -- 172.21.15.79:0/2685710300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a00a91f0 con 0x7f59a00d8760 2021-04-09T18:33:36.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f599f005700 1 --2- 172.21.15.79:0/2685710300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59a008e040 0x7f59a00bd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:36.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f599e804700 1 --2- 172.21.15.79:0/2685710300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59a00d8760 0x7f59a00a8bc0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f59a00d56e0 tx=0x7f599000cec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:36.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f5997fff700 1 -- 172.21.15.79:0/2685710300 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59a00a91f0 con 0x7f59a00d8760 2021-04-09T18:33:36.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f5997fff700 1 -- 172.21.15.79:0/2685710300 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599000a7f0 con 0x7f59a00d8760 2021-04-09T18:33:36.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f5997fff700 1 -- 172.21.15.79:0/2685710300 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f599000a9d0 con 0x7f59a00d8760 2021-04-09T18:33:36.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f59a5378700 1 -- 172.21.15.79:0/2685710300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a00d0c80 con 0x7f59a00d8760 2021-04-09T18:33:36.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f59a5378700 1 -- 172.21.15.79:0/2685710300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a0094a20 con 0x7f59a00d8760 2021-04-09T18:33:36.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f5997fff700 1 -- 172.21.15.79:0/2685710300 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5990019020 con 0x7f59a00d8760 2021-04-09T18:33:36.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f5997fff700 1 --2- 172.21.15.79:0/2685710300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5984029100 0x7f598402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:36.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f5997fff700 1 -- 172.21.15.79:0/2685710300 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f59900391f0 con 0x7f59a00d8760 2021-04-09T18:33:36.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.573 7f599f005700 1 --2- 172.21.15.79:0/2685710300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5984029100 0x7f598402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:36.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.577 7f599f005700 1 --2- 172.21.15.79:0/2685710300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5984029100 0x7f598402b650 crc :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:36.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.581 7f59a5378700 1 -- 172.21.15.79:0/2685710300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a00e39d0 con 0x7f59a00d8760 2021-04-09T18:33:36.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.589 7f5997fff700 1 -- 172.21.15.79:0/2685710300 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f599000a5e0 con 0x7f59a00d8760 2021-04-09T18:33:36.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.757 7f59a5378700 1 -- 172.21.15.79:0/2685710300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59a00f5b10 con 0x7f59a00d8760 2021-04-09T18:33:36.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.761 7f5997fff700 1 -- 172.21.15.79:0/2685710300 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+1758 (secure 0 0 0) 0x7f5990000f70 con 0x7f59a00d8760 2021-04-09T18:33:36.763 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 48 2021-04-09T18:33:36.764 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:36.764 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":48,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6510,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/4230183300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4230183300},{"type":"v1","addr":"172.21.15.79:6833","nonce":4230183300}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":48,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:33:24.317443","modified":"2021-04-09 18:33:36.412162","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-04-09T18:33:36.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.761 7f59a5378700 1 -- 172.21.15.79:0/2685710300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5984029100 msgr2=0x7f598402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:36.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.761 7f59a5378700 1 --2- 172.21.15.79:0/2685710300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5984029100 0x7f598402b650 crc :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:36.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.761 7f59a5378700 1 -- 172.21.15.79:0/2685710300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59a00d8760 msgr2=0x7f59a00a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:36.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.761 7f59a5378700 1 --2- 172.21.15.79:0/2685710300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59a00d8760 0x7f59a00a8bc0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f59a00d56e0 tx=0x7f599000cec0).stop 2021-04-09T18:33:36.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.761 7f59a5378700 1 -- 172.21.15.79:0/2685710300 shutdown_connections 2021-04-09T18:33:36.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.761 7f59a5378700 1 --2- 172.21.15.79:0/2685710300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5984029100 0x7f598402b650 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:36.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.761 7f59a5378700 1 --2- 172.21.15.79:0/2685710300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59a008e040 0x7f59a00bd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:36.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.761 7f59a5378700 1 --2- 172.21.15.79:0/2685710300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59a00bcd20 0x7f59a00d0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:36.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.761 7f59a5378700 1 --2- 172.21.15.79:0/2685710300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59a00d8760 0x7f59a00a8bc0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:36.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.761 7f59a5378700 1 -- 172.21.15.79:0/2685710300 >> 172.21.15.79:0/2685710300 conn(0x7f59a00baee0 msgr2=0x7f59a00938e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:36.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.761 7f59a5378700 1 -- 172.21.15.79:0/2685710300 shutdown_connections 2021-04-09T18:33:36.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.761 7f59a5378700 1 -- 172.21.15.79:0/2685710300 wait complete. 2021-04-09T18:33:36.776 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-04-09T18:33:36.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f4682f44700 1 Processor -- start 2021-04-09T18:33:36.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f4682f44700 1 -- start start 2021-04-09T18:33:36.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f4682f44700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f467c0f5520 0x7f467c0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:36.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f4682f44700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f467c0e9ae0 0x7f467c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:36.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f4682f44700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f467c1c2db0 0x7f467c1c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:36.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f4682f44700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467c0e9f30 con 0x7f467c0e9ae0 2021-04-09T18:33:36.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f4682f44700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467c0e59d0 con 0x7f467c0f5520 2021-04-09T18:33:36.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f4682f44700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0fbb20 con 0x7f467c1c2db0 2021-04-09T18:33:36.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f467bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f467c0e9ae0 0x7f467c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:36.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f467bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f467c0e9ae0 0x7f467c09f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60746/0 (socket says 172.21.15.79:60746) 2021-04-09T18:33:36.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f467bfff700 1 -- 172.21.15.79:0/4098434214 learned_addr learned my addr 172.21.15.79:0/4098434214 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:36.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f46814e9700 1 --2- 172.21.15.79:0/4098434214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f467c1c2db0 0x7f467c1c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:36.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f4680ce8700 1 --2- 172.21.15.79:0/4098434214 >> v2:172.21.15.89:3300/0 conn(0x7f467c0f5520 0x7f467c0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:36.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f467bfff700 1 -- 172.21.15.79:0/4098434214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f467c1c2db0 msgr2=0x7f467c1c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:36.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f467bfff700 1 --2- 172.21.15.79:0/4098434214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f467c1c2db0 0x7f467c1c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:36.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f467bfff700 1 -- 172.21.15.79:0/4098434214 >> v2:172.21.15.89:3300/0 conn(0x7f467c0f5520 msgr2=0x7f467c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:36.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f467bfff700 1 --2- 172.21.15.79:0/4098434214 >> v2:172.21.15.89:3300/0 conn(0x7f467c0f5520 0x7f467c0f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:36.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f467bfff700 1 -- 172.21.15.79:0/4098434214 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c0e56d0 con 0x7f467c0e9ae0 2021-04-09T18:33:36.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f467bfff700 1 --2- 172.21.15.79:0/4098434214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f467c0e9ae0 0x7f467c09f110 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f467c125440 tx=0x7f466400bda0).ready entity=mon.0 client_cookie=8b0415afc6496d5e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:36.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f467b7fe700 1 -- 172.21.15.79:0/4098434214 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f467c0e56d0 con 0x7f467c0e9ae0 2021-04-09T18:33:36.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.865 7f467b7fe700 1 -- 172.21.15.79:0/4098434214 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4664009940 con 0x7f467c0e9ae0 2021-04-09T18:33:36.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.869 7f467b7fe700 1 -- 172.21.15.79:0/4098434214 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4664009d10 con 0x7f467c0e9ae0 2021-04-09T18:33:36.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.869 7f4682f44700 1 -- 172.21.15.79:0/4098434214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f467c0e9ae0 msgr2=0x7f467c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:36.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.869 7f4682f44700 1 --2- 172.21.15.79:0/4098434214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f467c0e9ae0 0x7f467c09f110 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f467c125440 tx=0x7f466400bda0).stop 2021-04-09T18:33:36.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.869 7f4682f44700 1 -- 172.21.15.79:0/4098434214 shutdown_connections 2021-04-09T18:33:36.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.869 7f4682f44700 1 --2- 172.21.15.79:0/4098434214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f467c1c2db0 0x7f467c1c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:36.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.869 7f4682f44700 1 --2- 172.21.15.79:0/4098434214 >> v2:172.21.15.89:3300/0 conn(0x7f467c0f5520 0x7f467c0f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:36.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.869 7f4682f44700 1 --2- 172.21.15.79:0/4098434214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f467c0e9ae0 0x7f467c09f110 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:36.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.869 7f4682f44700 1 -- 172.21.15.79:0/4098434214 >> 172.21.15.79:0/4098434214 conn(0x7f467c0e5fe0 msgr2=0x7f467c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:36.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.869 7f4682f44700 1 -- 172.21.15.79:0/4098434214 shutdown_connections 2021-04-09T18:33:36.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.869 7f4682f44700 1 -- 172.21.15.79:0/4098434214 wait complete. 2021-04-09T18:33:36.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.873 7f4682f44700 1 Processor -- start 2021-04-09T18:33:36.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.873 7f4682f44700 1 -- start start 2021-04-09T18:33:36.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.873 7f4682f44700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f467c0c3410 0x7f467c0ac290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:36.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.873 7f4682f44700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f467c098510 0x7f467c098960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:36.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.873 7f4682f44700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f467c0d4f30 0x7f467c0d5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:36.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.873 7f4682f44700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c098210 con 0x7f467c098510 2021-04-09T18:33:36.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.873 7f4682f44700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0ac8c0 con 0x7f467c0d4f30 2021-04-09T18:33:36.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.873 7f4682f44700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c1a1b70 con 0x7f467c0c3410 2021-04-09T18:33:36.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.873 7f467bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f467c098510 0x7f467c098960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:36.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.873 7f467bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f467c098510 0x7f467c098960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60752/0 (socket says 172.21.15.79:60752) 2021-04-09T18:33:36.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.873 7f467bfff700 1 -- 172.21.15.79:0/924573158 learned_addr learned my addr 172.21.15.79:0/924573158 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:36.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.873 7f46814e9700 1 --2- 172.21.15.79:0/924573158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f467c0d4f30 0x7f467c0d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:36.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.873 7f4680ce8700 1 --2- 172.21.15.79:0/924573158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f467c0c3410 0x7f467c0ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:36.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.873 7f467bfff700 1 -- 172.21.15.79:0/924573158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f467c0c3410 msgr2=0x7f467c0ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:36.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.873 7f467bfff700 1 --2- 172.21.15.79:0/924573158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f467c0c3410 0x7f467c0ac290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:36.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.873 7f467bfff700 1 -- 172.21.15.79:0/924573158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f467c0d4f30 msgr2=0x7f467c0d5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:36.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.873 7f467bfff700 1 --2- 172.21.15.79:0/924573158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f467c0d4f30 0x7f467c0d5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:36.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.873 7f467bfff700 1 -- 172.21.15.79:0/924573158 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c097da0 con 0x7f467c098510 2021-04-09T18:33:36.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.877 7f467bfff700 1 --2- 172.21.15.79:0/924573158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f467c098510 0x7f467c098960 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f467c125440 tx=0x7f4664006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:36.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.877 7f46797fa700 1 -- 172.21.15.79:0/924573158 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f467c097da0 con 0x7f467c098510 2021-04-09T18:33:36.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.877 7f4682f44700 1 -- 172.21.15.79:0/924573158 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467c0c3860 con 0x7f467c098510 2021-04-09T18:33:36.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.877 7f46797fa700 1 -- 172.21.15.79:0/924573158 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4664011ca0 con 0x7f467c098510 2021-04-09T18:33:36.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.877 7f46797fa700 1 -- 172.21.15.79:0/924573158 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4664022070 con 0x7f467c098510 2021-04-09T18:33:36.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.877 7f4682f44700 1 -- 172.21.15.79:0/924573158 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467c0c4860 con 0x7f467c098510 2021-04-09T18:33:36.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.877 7f46797fa700 1 -- 172.21.15.79:0/924573158 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4664026410 con 0x7f467c098510 2021-04-09T18:33:36.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.877 7f46797fa700 1 --2- 172.21.15.79:0/924573158 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4660029100 0x7f466002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:36.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.877 7f46797fa700 1 -- 172.21.15.79:0/924573158 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f466403bb60 con 0x7f467c098510 2021-04-09T18:33:36.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.877 7f4680ce8700 1 --2- 172.21.15.79:0/924573158 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4660029100 0x7f466002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:36.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.877 7f4680ce8700 1 --2- 172.21.15.79:0/924573158 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4660029100 0x7f466002b650 crc :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:36.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.877 7f4682f44700 1 -- 172.21.15.79:0/924573158 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467c0e39e0 con 0x7f467c098510 2021-04-09T18:33:36.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:36.885 7f46797fa700 1 -- 172.21.15.79:0/924573158 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4664009730 con 0x7f467c098510 2021-04-09T18:33:37.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.053 7f4682f44700 1 -- 172.21.15.79:0/924573158 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f467c0f5b20 con 0x7f467c098510 2021-04-09T18:33:37.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.689 7f46797fa700 1 -- 172.21.15.79:0/924573158 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4664011a90 con 0x7f467c098510 2021-04-09T18:33:37.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.721 7f4682f44700 1 -- 172.21.15.79:0/924573158 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4660029100 msgr2=0x7f466002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:37.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.721 7f4682f44700 1 --2- 172.21.15.79:0/924573158 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4660029100 0x7f466002b650 crc :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:37.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.721 7f4682f44700 1 -- 172.21.15.79:0/924573158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f467c098510 msgr2=0x7f467c098960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:37.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.721 7f4682f44700 1 --2- 172.21.15.79:0/924573158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f467c098510 0x7f467c098960 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f467c125440 tx=0x7f4664006890).stop 2021-04-09T18:33:37.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.721 7f4682f44700 1 -- 172.21.15.79:0/924573158 shutdown_connections 2021-04-09T18:33:37.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.721 7f4682f44700 1 --2- 172.21.15.79:0/924573158 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4660029100 0x7f466002b650 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:37.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.721 7f4682f44700 1 --2- 172.21.15.79:0/924573158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f467c0d4f30 0x7f467c0d5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.721 7f4682f44700 1 --2- 172.21.15.79:0/924573158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f467c0c3410 0x7f467c0ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.721 7f4682f44700 1 --2- 172.21.15.79:0/924573158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f467c098510 0x7f467c098960 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.721 7f4682f44700 1 -- 172.21.15.79:0/924573158 >> 172.21.15.79:0/924573158 conn(0x7f467c09abd0 msgr2=0x7f467c09a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.721 7f4682f44700 1 -- 172.21.15.79:0/924573158 shutdown_connections 2021-04-09T18:33:37.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.721 7f4682f44700 1 -- 172.21.15.79:0/924573158 wait complete. 2021-04-09T18:33:37.742 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-04-09T18:33:37.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe95a0a700 1 Processor -- start 2021-04-09T18:33:37.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe95a0a700 1 -- start start 2021-04-09T18:33:37.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe95a0a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efe900e9b10 0x7efe9009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:37.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe95a0a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efe901c8040 0x7efe901ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:37.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe95a0a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe900fbb50 con 0x7efe900f5550 2021-04-09T18:33:37.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe95a0a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe901c3df0 con 0x7efe900e9b10 2021-04-09T18:33:37.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe95a0a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe900e9f60 con 0x7efe901c8040 2021-04-09T18:33:37.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe8ed4f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efe900e9b10 0x7efe9009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:37.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe8ed4f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efe900e9b10 0x7efe9009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60758/0 (socket says 172.21.15.79:60758) 2021-04-09T18:33:37.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe8ed4f700 1 -- 172.21.15.79:0/2340467417 learned_addr learned my addr 172.21.15.79:0/2340467417 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:37.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe8fd51700 1 --2- 172.21.15.79:0/2340467417 >> v2:172.21.15.89:3300/0 conn(0x7efe901c8040 0x7efe901ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:37.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe8ed4f700 1 -- 172.21.15.79:0/2340467417 >> v2:172.21.15.89:3300/0 conn(0x7efe901c8040 msgr2=0x7efe901ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:37.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe8ed4f700 1 --2- 172.21.15.79:0/2340467417 >> v2:172.21.15.89:3300/0 conn(0x7efe901c8040 0x7efe901ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:37.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe8ed4f700 1 -- 172.21.15.79:0/2340467417 >> v1:172.21.15.89:6789/0 conn(0x7efe900f5550 legacy=0x7efe900f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:37.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe8ed4f700 1 -- 172.21.15.79:0/2340467417 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe900e5700 con 0x7efe900e9b10 2021-04-09T18:33:37.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe8fd51700 1 --2- 172.21.15.79:0/2340467417 >> v2:172.21.15.89:3300/0 conn(0x7efe901c8040 0x7efe901ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:33:37.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe8ed4f700 1 --2- 172.21.15.79:0/2340467417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe900e9b10 0x7efe9009f110 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7efe78002f30 tx=0x7efe7800bd70).ready entity=mon.0 client_cookie=c7acbfe09e22b5b3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:37.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe8e54e700 1 -- 172.21.15.79:0/2340467417 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efe900e5700 con 0x7efe900e9b10 2021-04-09T18:33:37.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe8e54e700 1 -- 172.21.15.79:0/2340467417 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe78009900 con 0x7efe900e9b10 2021-04-09T18:33:37.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe8e54e700 1 -- 172.21.15.79:0/2340467417 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efe78009cd0 con 0x7efe900e9b10 2021-04-09T18:33:37.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe95a0a700 1 -- 172.21.15.79:0/2340467417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe900e9b10 msgr2=0x7efe9009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:37.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.849 7efe95a0a700 1 --2- 172.21.15.79:0/2340467417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe900e9b10 0x7efe9009f110 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7efe78002f30 tx=0x7efe7800bd70).stop 2021-04-09T18:33:37.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe95a0a700 1 -- 172.21.15.79:0/2340467417 shutdown_connections 2021-04-09T18:33:37.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe95a0a700 1 --2- 172.21.15.79:0/2340467417 >> v2:172.21.15.89:3300/0 conn(0x7efe901c8040 0x7efe901ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:37.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe95a0a700 1 --2- 172.21.15.79:0/2340467417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe900e9b10 0x7efe9009f110 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:37.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe95a0a700 1 -- 172.21.15.79:0/2340467417 >> 172.21.15.79:0/2340467417 conn(0x7efe900e6010 msgr2=0x7efe900e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:37.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe95a0a700 1 -- 172.21.15.79:0/2340467417 shutdown_connections 2021-04-09T18:33:37.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe95a0a700 1 -- 172.21.15.79:0/2340467417 wait complete. 2021-04-09T18:33:37.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe95a0a700 1 Processor -- start 2021-04-09T18:33:37.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe95a0a700 1 -- start start 2021-04-09T18:33:37.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe95a0a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe901a6f90 0x7efe900c0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:37.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe95a0a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe900a8980 0x7efe900a8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:37.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe95a0a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe900a9400 0x7efe901a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:37.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe95a0a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe90047500 con 0x7efe900a8980 2021-04-09T18:33:37.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe95a0a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe900a9d10 con 0x7efe901a6f90 2021-04-09T18:33:37.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe95a0a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe900aa010 con 0x7efe900a9400 2021-04-09T18:33:37.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe8ed4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe900a8980 0x7efe900a8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:37.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe8ed4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe900a8980 0x7efe900a8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60768/0 (socket says 172.21.15.79:60768) 2021-04-09T18:33:37.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe8ed4f700 1 -- 172.21.15.79:0/950146025 learned_addr learned my addr 172.21.15.79:0/950146025 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:37.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe8fd51700 1 --2- 172.21.15.79:0/950146025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe900a9400 0x7efe901a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:37.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe8f550700 1 --2- 172.21.15.79:0/950146025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe901a6f90 0x7efe900c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:37.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe8ed4f700 1 -- 172.21.15.79:0/950146025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe900a9400 msgr2=0x7efe901a5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:37.870 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe8ed4f700 1 --2- 172.21.15.79:0/950146025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe900a9400 0x7efe901a5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:37.870 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe8ed4f700 1 -- 172.21.15.79:0/950146025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe901a6f90 msgr2=0x7efe900c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:37.870 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.853 7efe8ed4f700 1 --2- 172.21.15.79:0/950146025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe901a6f90 0x7efe900c0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:37.870 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.857 7efe8ed4f700 1 -- 172.21.15.79:0/950146025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe900ab590 con 0x7efe900a8980 2021-04-09T18:33:37.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.857 7efe8fd51700 1 --2- 172.21.15.79:0/950146025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe900a9400 0x7efe901a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:37.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.857 7efe8f550700 1 --2- 172.21.15.79:0/950146025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe901a6f90 0x7efe900c0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:37.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.857 7efe8ed4f700 1 --2- 172.21.15.79:0/950146025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe900a8980 0x7efe900a8dd0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7efe900d6f40 tx=0x7efe78006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:37.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.857 7efe87fff700 1 -- 172.21.15.79:0/950146025 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efe900ab590 con 0x7efe900a8980 2021-04-09T18:33:37.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.857 7efe87fff700 1 -- 172.21.15.79:0/950146025 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7801b5e0 con 0x7efe900a8980 2021-04-09T18:33:37.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.857 7efe95a0a700 1 -- 172.21.15.79:0/950146025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe900a98c0 con 0x7efe900a8980 2021-04-09T18:33:37.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.857 7efe87fff700 1 -- 172.21.15.79:0/950146025 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efe78017040 con 0x7efe900a8980 2021-04-09T18:33:37.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.857 7efe95a0a700 1 -- 172.21.15.79:0/950146025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe901a6520 con 0x7efe900a8980 2021-04-09T18:33:37.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.857 7efe87fff700 1 -- 172.21.15.79:0/950146025 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7efe7801b9b0 con 0x7efe900a8980 2021-04-09T18:33:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.857 7efe87fff700 1 --2- 172.21.15.79:0/950146025 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efe74029100 0x7efe7402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.857 7efe87fff700 1 -- 172.21.15.79:0/950146025 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6010+0+0 (secure 0 0 0) 0x7efe78018030 con 0x7efe900a8980 2021-04-09T18:33:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.857 7efe8f550700 1 --2- 172.21.15.79:0/950146025 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efe74029100 0x7efe7402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.857 7efe8f550700 1 --2- 172.21.15.79:0/950146025 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efe74029100 0x7efe7402b650 crc :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:37.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.865 7efe95a0a700 1 -- 172.21.15.79:0/950146025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe900e39f0 con 0x7efe900a8980 2021-04-09T18:33:37.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:37.869 7efe87fff700 1 -- 172.21.15.79:0/950146025 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7efe7801b3d0 con 0x7efe900a8980 2021-04-09T18:33:38.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.029 7efe95a0a700 1 -- 172.21.15.79:0/950146025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efe900f5b50 con 0x7efe900a8980 2021-04-09T18:33:38.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.701 7efe87fff700 1 -- 172.21.15.79:0/950146025 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v81) v1 ==== 185+0+0 (secure 0 0 0) 0x7efe780096f0 con 0x7efe900a8980 2021-04-09T18:33:38.749 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2021-04-09T18:33:38.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.749 7efe95a0a700 1 -- 172.21.15.79:0/950146025 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efe74029100 msgr2=0x7efe7402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:38.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.749 7efe95a0a700 1 --2- 172.21.15.79:0/950146025 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efe74029100 0x7efe7402b650 crc :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:38.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.749 7efe95a0a700 1 -- 172.21.15.79:0/950146025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe900a8980 msgr2=0x7efe900a8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:38.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.749 7efe95a0a700 1 --2- 172.21.15.79:0/950146025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe900a8980 0x7efe900a8dd0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7efe900d6f40 tx=0x7efe78006890).stop 2021-04-09T18:33:38.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.749 7efe95a0a700 1 -- 172.21.15.79:0/950146025 shutdown_connections 2021-04-09T18:33:38.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.749 7efe95a0a700 1 --2- 172.21.15.79:0/950146025 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efe74029100 0x7efe7402b650 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:38.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.749 7efe95a0a700 1 --2- 172.21.15.79:0/950146025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe901a6f90 0x7efe900c0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:38.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.749 7efe95a0a700 1 --2- 172.21.15.79:0/950146025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe900a9400 0x7efe901a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:38.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.749 7efe95a0a700 1 --2- 172.21.15.79:0/950146025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe900a8980 0x7efe900a8dd0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:38.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.749 7efe95a0a700 1 -- 172.21.15.79:0/950146025 >> 172.21.15.79:0/950146025 conn(0x7efe90092250 msgr2=0x7efe900ab890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:38.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.749 7efe95a0a700 1 -- 172.21.15.79:0/950146025 shutdown_connections 2021-04-09T18:33:38.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.749 7efe95a0a700 1 -- 172.21.15.79:0/950146025 wait complete. 2021-04-09T18:33:38.768 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-04-09T18:33:38.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.869 7f87b1e55700 1 Processor -- start 2021-04-09T18:33:38.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.869 7f87b1e55700 1 -- start start 2021-04-09T18:33:38.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87b1e55700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87ac0f5550 0x7f87ac0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:38.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87b1e55700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87ac1c8040 0x7f87ac1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:38.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87b1e55700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ac0fbb50 con 0x7f87ac0e9b10 2021-04-09T18:33:38.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87b1e55700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ac0e9f60 con 0x7f87ac0f5550 2021-04-09T18:33:38.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87b1e55700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac1c3df0 con 0x7f87ac1c8040 2021-04-09T18:33:38.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87ab7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87ac0f5550 0x7f87ac0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:38.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87ab7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87ac0f5550 0x7f87ac0f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60772/0 (socket says 172.21.15.79:60772) 2021-04-09T18:33:38.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87ab7fe700 1 -- 172.21.15.79:0/3913758648 learned_addr learned my addr 172.21.15.79:0/3913758648 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:38.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87abfff700 1 --2- 172.21.15.79:0/3913758648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87ac1c8040 0x7f87ac1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:38.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87ab7fe700 1 -- 172.21.15.79:0/3913758648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87ac1c8040 msgr2=0x7f87ac1ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:38.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87ab7fe700 1 --2- 172.21.15.79:0/3913758648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87ac1c8040 0x7f87ac1ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:38.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87ab7fe700 1 -- 172.21.15.79:0/3913758648 >> v1:172.21.15.89:6789/0 conn(0x7f87ac0e9b10 legacy=0x7f87ac09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:38.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87ab7fe700 1 -- 172.21.15.79:0/3913758648 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac09f910 con 0x7f87ac0f5550 2021-04-09T18:33:38.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87ab7fe700 1 --2- 172.21.15.79:0/3913758648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87ac0f5550 0x7f87ac0f64e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f87ac0f6f30 tx=0x7f879c00bdd0).ready entity=mon.0 client_cookie=726b44fcf75125be server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:38.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87aa7fc700 1 -- 172.21.15.79:0/3913758648 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f87ac09f910 con 0x7f87ac0f5550 2021-04-09T18:33:38.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87aa7fc700 1 -- 172.21.15.79:0/3913758648 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c009990 con 0x7f87ac0f5550 2021-04-09T18:33:38.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87aa7fc700 1 -- 172.21.15.79:0/3913758648 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f879c009d60 con 0x7f87ac0f5550 2021-04-09T18:33:38.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87b1e55700 1 -- 172.21.15.79:0/3913758648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87ac0f5550 msgr2=0x7f87ac0f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:38.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87b1e55700 1 --2- 172.21.15.79:0/3913758648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87ac0f5550 0x7f87ac0f64e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f87ac0f6f30 tx=0x7f879c00bdd0).stop 2021-04-09T18:33:38.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87b1e55700 1 -- 172.21.15.79:0/3913758648 shutdown_connections 2021-04-09T18:33:38.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87b1e55700 1 --2- 172.21.15.79:0/3913758648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87ac1c8040 0x7f87ac1ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:38.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87b1e55700 1 --2- 172.21.15.79:0/3913758648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87ac0f5550 0x7f87ac0f64e0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:38.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87b1e55700 1 -- 172.21.15.79:0/3913758648 >> 172.21.15.79:0/3913758648 conn(0x7f87ac0e6010 msgr2=0x7f87ac0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:38.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87b1e55700 1 -- 172.21.15.79:0/3913758648 shutdown_connections 2021-04-09T18:33:38.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.873 7f87b1e55700 1 -- 172.21.15.79:0/3913758648 wait complete. 2021-04-09T18:33:38.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.877 7f87b1e55700 1 Processor -- start 2021-04-09T18:33:38.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.877 7f87b1e55700 1 -- start start 2021-04-09T18:33:38.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.877 7f87b1e55700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87ac1c0650 0x7f87ac0badc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:38.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.877 7f87b1e55700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87ac0ae430 0x7f87ac0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:38.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.877 7f87b1e55700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87ac097310 0x7f87ac097760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:38.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.877 7f87b1e55700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac098a70 con 0x7f87ac1c0650 2021-04-09T18:33:38.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.877 7f87b1e55700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0aeeb0 con 0x7f87ac0ae430 2021-04-09T18:33:38.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.877 7f87b1e55700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0bb3f0 con 0x7f87ac097310 2021-04-09T18:33:38.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.877 7f87ab7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87ac1c0650 0x7f87ac0badc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:38.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.877 7f87ab7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87ac1c0650 0x7f87ac0badc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60778/0 (socket says 172.21.15.79:60778) 2021-04-09T18:33:38.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.877 7f87ab7fe700 1 -- 172.21.15.79:0/1893130979 learned_addr learned my addr 172.21.15.79:0/1893130979 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:38.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.877 7f87abfff700 1 --2- 172.21.15.79:0/1893130979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87ac097310 0x7f87ac097760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:38.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.877 7f87aaffd700 1 --2- 172.21.15.79:0/1893130979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87ac0ae430 0x7f87ac0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:38.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.881 7f87ab7fe700 1 -- 172.21.15.79:0/1893130979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87ac097310 msgr2=0x7f87ac097760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:38.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.881 7f87ab7fe700 1 --2- 172.21.15.79:0/1893130979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87ac097310 0x7f87ac097760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:38.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.881 7f87ab7fe700 1 -- 172.21.15.79:0/1893130979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87ac0ae430 msgr2=0x7f87ac0ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:38.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.881 7f87ab7fe700 1 --2- 172.21.15.79:0/1893130979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87ac0ae430 0x7f87ac0ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:38.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.881 7f87ab7fe700 1 -- 172.21.15.79:0/1893130979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac1a17c0 con 0x7f87ac1c0650 2021-04-09T18:33:38.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.881 7f87ab7fe700 1 --2- 172.21.15.79:0/1893130979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87ac1c0650 0x7f87ac0badc0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f87ac09b380 tx=0x7f879c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:38.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.881 7f8793fff700 1 -- 172.21.15.79:0/1893130979 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f87ac1a17c0 con 0x7f87ac1c0650 2021-04-09T18:33:38.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.881 7f8793fff700 1 -- 172.21.15.79:0/1893130979 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c011cf0 con 0x7f87ac1c0650 2021-04-09T18:33:38.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.881 7f87b1e55700 1 -- 172.21.15.79:0/1893130979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ac0ad390 con 0x7f87ac1c0650 2021-04-09T18:33:38.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.881 7f8793fff700 1 -- 172.21.15.79:0/1893130979 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f879c01d640 con 0x7f87ac1c0650 2021-04-09T18:33:38.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.881 7f87b1e55700 1 -- 172.21.15.79:0/1893130979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ac097f20 con 0x7f87ac1c0650 2021-04-09T18:33:38.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.881 7f8793fff700 1 -- 172.21.15.79:0/1893130979 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f879c01d840 con 0x7f87ac1c0650 2021-04-09T18:33:38.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.881 7f8793fff700 1 --2- 172.21.15.79:0/1893130979 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f878c029100 0x7f878c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:38.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.881 7f8793fff700 1 -- 172.21.15.79:0/1893130979 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5572+0+0 (secure 0 0 0) 0x7f879c03c830 con 0x7f87ac1c0650 2021-04-09T18:33:38.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.881 7f87aaffd700 1 --2- 172.21.15.79:0/1893130979 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f878c029100 0x7f878c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:38.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.881 7f87aaffd700 1 --2- 172.21.15.79:0/1893130979 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f878c029100 0x7f878c02b650 crc :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:38.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.885 7f87b1e55700 1 -- 172.21.15.79:0/1893130979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ac0e39f0 con 0x7f87ac1c0650 2021-04-09T18:33:38.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:38.889 7f8793fff700 1 -- 172.21.15.79:0/1893130979 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f879c009780 con 0x7f87ac1c0650 2021-04-09T18:33:39.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.049 7f87b1e55700 1 -- 172.21.15.79:0/1893130979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f87ac0f5b50 con 0x7f87ac1c0650 2021-04-09T18:33:39.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.709 7f8793fff700 1 -- 172.21.15.79:0/1893130979 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v82) v1 ==== 173+0+0 (secure 0 0 0) 0x7f879c011ae0 con 0x7f87ac1c0650 2021-04-09T18:33:39.719 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2021-04-09T18:33:39.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.721 7f87b1e55700 1 -- 172.21.15.79:0/1893130979 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f878c029100 msgr2=0x7f878c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:39.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.721 7f87b1e55700 1 --2- 172.21.15.79:0/1893130979 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f878c029100 0x7f878c02b650 crc :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:39.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.721 7f87b1e55700 1 -- 172.21.15.79:0/1893130979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87ac1c0650 msgr2=0x7f87ac0badc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:39.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.721 7f87b1e55700 1 --2- 172.21.15.79:0/1893130979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87ac1c0650 0x7f87ac0badc0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f87ac09b380 tx=0x7f879c006890).stop 2021-04-09T18:33:39.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.721 7f87b1e55700 1 -- 172.21.15.79:0/1893130979 shutdown_connections 2021-04-09T18:33:39.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.721 7f87b1e55700 1 --2- 172.21.15.79:0/1893130979 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f878c029100 0x7f878c02b650 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:39.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.721 7f87b1e55700 1 --2- 172.21.15.79:0/1893130979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87ac097310 0x7f87ac097760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:39.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.721 7f87b1e55700 1 --2- 172.21.15.79:0/1893130979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87ac1c0650 0x7f87ac0badc0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:39.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.721 7f87b1e55700 1 --2- 172.21.15.79:0/1893130979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87ac0ae430 0x7f87ac0ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:39.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.721 7f87b1e55700 1 -- 172.21.15.79:0/1893130979 >> 172.21.15.79:0/1893130979 conn(0x7f87ac0afd40 msgr2=0x7f87ac0a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:39.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.721 7f87b1e55700 1 -- 172.21.15.79:0/1893130979 shutdown_connections 2021-04-09T18:33:39.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.721 7f87b1e55700 1 -- 172.21.15.79:0/1893130979 wait complete. 2021-04-09T18:33:39.735 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-04-09T18:33:39.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.825 7f3cc2928700 1 Processor -- start 2021-04-09T18:33:39.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.825 7f3cc2928700 1 -- start start 2021-04-09T18:33:39.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cc2928700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3cbc0f5520 0x7f3cbc0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:39.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cc2928700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3cbc0e9ae0 0x7f3cbc09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:39.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cc2928700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cbc0fbb20 con 0x7f3cbc1c2db0 2021-04-09T18:33:39.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cc2928700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cbc0e9f30 con 0x7f3cbc0f5520 2021-04-09T18:33:39.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cc2928700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cbc0e59d0 con 0x7f3cbc0e9ae0 2021-04-09T18:33:39.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cbbfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3cbc0f5520 0x7f3cbc0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:39.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cbbfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3cbc0f5520 0x7f3cbc0f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60786/0 (socket says 172.21.15.79:60786) 2021-04-09T18:33:39.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cbbfff700 1 -- 172.21.15.79:0/463698296 learned_addr learned my addr 172.21.15.79:0/463698296 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:39.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cbb7fe700 1 --2- 172.21.15.79:0/463698296 >> v2:172.21.15.89:3300/0 conn(0x7f3cbc0e9ae0 0x7f3cbc09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:39.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cbbfff700 1 -- 172.21.15.79:0/463698296 >> v2:172.21.15.89:3300/0 conn(0x7f3cbc0e9ae0 msgr2=0x7f3cbc09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:39.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cbbfff700 1 --2- 172.21.15.79:0/463698296 >> v2:172.21.15.89:3300/0 conn(0x7f3cbc0e9ae0 0x7f3cbc09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:39.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cbbfff700 1 -- 172.21.15.79:0/463698296 >> v1:172.21.15.89:6789/0 conn(0x7f3cbc1c2db0 legacy=0x7f3cbc1c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:39.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cbbfff700 1 -- 172.21.15.79:0/463698296 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc0e56d0 con 0x7f3cbc0f5520 2021-04-09T18:33:39.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cbbfff700 1 --2- 172.21.15.79:0/463698296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cbc0f5520 0x7f3cbc0f64b0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f3cac002f30 tx=0x7f3cac00bd70).ready entity=mon.0 client_cookie=1c16d91fcfba5a8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:39.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cbaffd700 1 -- 172.21.15.79:0/463698296 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3cbc0e56d0 con 0x7f3cbc0f5520 2021-04-09T18:33:39.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cbaffd700 1 -- 172.21.15.79:0/463698296 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac009950 con 0x7f3cbc0f5520 2021-04-09T18:33:39.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cbaffd700 1 -- 172.21.15.79:0/463698296 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3cac009d20 con 0x7f3cbc0f5520 2021-04-09T18:33:39.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cc2928700 1 -- 172.21.15.79:0/463698296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cbc0f5520 msgr2=0x7f3cbc0f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:39.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cc2928700 1 --2- 172.21.15.79:0/463698296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cbc0f5520 0x7f3cbc0f64b0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f3cac002f30 tx=0x7f3cac00bd70).stop 2021-04-09T18:33:39.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cc2928700 1 -- 172.21.15.79:0/463698296 shutdown_connections 2021-04-09T18:33:39.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cc2928700 1 --2- 172.21.15.79:0/463698296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cbc0f5520 0x7f3cbc0f64b0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:39.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cc2928700 1 --2- 172.21.15.79:0/463698296 >> v2:172.21.15.89:3300/0 conn(0x7f3cbc0e9ae0 0x7f3cbc09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:39.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cc2928700 1 -- 172.21.15.79:0/463698296 >> 172.21.15.79:0/463698296 conn(0x7f3cbc0e5fe0 msgr2=0x7f3cbc0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:39.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cc2928700 1 -- 172.21.15.79:0/463698296 shutdown_connections 2021-04-09T18:33:39.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.829 7f3cc2928700 1 -- 172.21.15.79:0/463698296 wait complete. 2021-04-09T18:33:39.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.833 7f3cc2928700 1 Processor -- start 2021-04-09T18:33:39.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.833 7f3cc2928700 1 -- start start 2021-04-09T18:33:39.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.833 7f3cc2928700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cbc1af130 0x7f3cbc098940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:39.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.833 7f3cc2928700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cbc0ae380 0x7f3cbc0ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:39.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.833 7f3cc2928700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cbc0aee00 0x7f3cbc0c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:39.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.833 7f3cc2928700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc0970a0 con 0x7f3cbc1af130 2021-04-09T18:33:39.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.833 7f3cc2928700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc0973a0 con 0x7f3cbc0aee00 2021-04-09T18:33:39.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.833 7f3cc2928700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc098f70 con 0x7f3cbc0ae380 2021-04-09T18:33:39.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.833 7f3cbbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cbc1af130 0x7f3cbc098940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:39.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.833 7f3cbbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cbc1af130 0x7f3cbc098940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60794/0 (socket says 172.21.15.79:60794) 2021-04-09T18:33:39.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.833 7f3cbbfff700 1 -- 172.21.15.79:0/2182461984 learned_addr learned my addr 172.21.15.79:0/2182461984 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:39.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.833 7f3cbb7fe700 1 --2- 172.21.15.79:0/2182461984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cbc0ae380 0x7f3cbc0ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:39.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.833 7f3cc0ecd700 1 --2- 172.21.15.79:0/2182461984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cbc0aee00 0x7f3cbc0c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:39.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.833 7f3cbbfff700 1 -- 172.21.15.79:0/2182461984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cbc0ae380 msgr2=0x7f3cbc0ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:39.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.833 7f3cbbfff700 1 --2- 172.21.15.79:0/2182461984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cbc0ae380 0x7f3cbc0ae7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:39.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.833 7f3cbbfff700 1 -- 172.21.15.79:0/2182461984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cbc0aee00 msgr2=0x7f3cbc0c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:39.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.833 7f3cbbfff700 1 --2- 172.21.15.79:0/2182461984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cbc0aee00 0x7f3cbc0c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:39.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.833 7f3cbbfff700 1 -- 172.21.15.79:0/2182461984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc096530 con 0x7f3cbc1af130 2021-04-09T18:33:39.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.833 7f3cbbfff700 1 --2- 172.21.15.79:0/2182461984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cbc1af130 0x7f3cbc098940 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f3cbc0c1040 tx=0x7f3cac006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:39.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.837 7f3cb8ff9700 1 -- 172.21.15.79:0/2182461984 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3cbc096530 con 0x7f3cbc1af130 2021-04-09T18:33:39.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.837 7f3cb8ff9700 1 -- 172.21.15.79:0/2182461984 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac011c70 con 0x7f3cbc1af130 2021-04-09T18:33:39.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.837 7f3cc2928700 1 -- 172.21.15.79:0/2182461984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cbc0c4bc0 con 0x7f3cbc1af130 2021-04-09T18:33:39.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.837 7f3cb8ff9700 1 -- 172.21.15.79:0/2182461984 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3cac01d630 con 0x7f3cbc1af130 2021-04-09T18:33:39.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.837 7f3cc2928700 1 -- 172.21.15.79:0/2182461984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cbc0c4fb0 con 0x7f3cbc1af130 2021-04-09T18:33:39.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.837 7f3cb8ff9700 1 -- 172.21.15.79:0/2182461984 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3cac026450 con 0x7f3cbc1af130 2021-04-09T18:33:39.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.837 7f3cb8ff9700 1 --2- 172.21.15.79:0/2182461984 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3c9c029100 0x7f3c9c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:39.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.837 7f3cb8ff9700 1 -- 172.21.15.79:0/2182461984 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f3cac03ac00 con 0x7f3cbc1af130 2021-04-09T18:33:39.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.837 7f3cbb7fe700 1 --2- 172.21.15.79:0/2182461984 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3c9c029100 0x7f3c9c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:39.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.837 7f3cbb7fe700 1 --2- 172.21.15.79:0/2182461984 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3c9c029100 0x7f3c9c02b650 crc :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:39.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.841 7f3cc2928700 1 -- 172.21.15.79:0/2182461984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cbc0e39e0 con 0x7f3cbc1af130 2021-04-09T18:33:39.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:39.849 7f3cb8ff9700 1 -- 172.21.15.79:0/2182461984 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3cac011a60 con 0x7f3cbc1af130 2021-04-09T18:33:40.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.033 7f3cc2928700 1 -- 172.21.15.79:0/2182461984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3cbc0f5b20 con 0x7f3cbc1af130 2021-04-09T18:33:40.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.037 7f3cb8ff9700 1 -- 172.21.15.79:0/2182461984 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3cac009740 con 0x7f3cbc1af130 2021-04-09T18:33:40.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.041 7f3cc2928700 1 -- 172.21.15.79:0/2182461984 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3c9c029100 msgr2=0x7f3c9c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:40.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.041 7f3cc2928700 1 --2- 172.21.15.79:0/2182461984 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3c9c029100 0x7f3c9c02b650 crc :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:40.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.041 7f3cc2928700 1 -- 172.21.15.79:0/2182461984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cbc1af130 msgr2=0x7f3cbc098940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:40.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.041 7f3cc2928700 1 --2- 172.21.15.79:0/2182461984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cbc1af130 0x7f3cbc098940 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f3cbc0c1040 tx=0x7f3cac006890).stop 2021-04-09T18:33:40.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.041 7f3cc2928700 1 -- 172.21.15.79:0/2182461984 shutdown_connections 2021-04-09T18:33:40.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.041 7f3cc2928700 1 --2- 172.21.15.79:0/2182461984 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3c9c029100 0x7f3c9c02b650 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:40.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.041 7f3cc2928700 1 --2- 172.21.15.79:0/2182461984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cbc0aee00 0x7f3cbc0c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:40.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.041 7f3cc2928700 1 --2- 172.21.15.79:0/2182461984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cbc1af130 0x7f3cbc098940 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:40.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.041 7f3cc2928700 1 --2- 172.21.15.79:0/2182461984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cbc0ae380 0x7f3cbc0ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:40.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.041 7f3cc2928700 1 -- 172.21.15.79:0/2182461984 >> 172.21.15.79:0/2182461984 conn(0x7f3cbc1a1790 msgr2=0x7f3cbc1a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:40.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.041 7f3cc2928700 1 -- 172.21.15.79:0/2182461984 shutdown_connections 2021-04-09T18:33:40.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.045 7f3cc2928700 1 -- 172.21.15.79:0/2182461984 wait complete. 2021-04-09T18:33:40.057 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2021-04-09T18:33:40.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f342ee08700 1 Processor -- start 2021-04-09T18:33:40.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f342ee08700 1 -- start start 2021-04-09T18:33:40.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f342ee08700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34280e9ad0 0x7f342809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:40.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f342ee08700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f34281c8000 0x7f34281ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:40.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f342ee08700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34280fbb10 con 0x7f34280f5510 2021-04-09T18:33:40.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f342ee08700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34281c3db0 con 0x7f34281c8000 2021-04-09T18:33:40.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f342ee08700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34280e9f20 con 0x7f34280e9ad0 2021-04-09T18:33:40.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f342cbac700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f34280f5510 0x7f34280f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:55982/0 (socket says 172.21.15.79:55982) 2021-04-09T18:33:40.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f3427fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34280e9ad0 0x7f342809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:40.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f342cbac700 1 -- 172.21.15.79:0/3953019470 learned_addr learned my addr 172.21.15.79:0/3953019470 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:40.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f342d3ad700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f34281c8000 0x7f34281ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:40.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f342d3ad700 1 -- 172.21.15.79:0/3953019470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34280e9ad0 msgr2=0x7f342809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:40.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f342d3ad700 1 --2- 172.21.15.79:0/3953019470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34280e9ad0 0x7f342809f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:40.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f342d3ad700 1 -- 172.21.15.79:0/3953019470 >> v1:172.21.15.89:6789/0 conn(0x7f34280f5510 legacy=0x7f34280f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:40.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f342d3ad700 1 -- 172.21.15.79:0/3953019470 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34280e56c0 con 0x7f34281c8000 2021-04-09T18:33:40.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f34277fe700 1 -- 172.21.15.79:0/3953019470 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715149373 0 0) 0x7f3418001450 con 0x7f34280f5510 2021-04-09T18:33:40.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f3427fff700 1 --2- 172.21.15.79:0/3953019470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34280e9ad0 0x7f342809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:40.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f342d3ad700 1 --2- 172.21.15.79:0/3953019470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34281c8000 0x7f34281ca460 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f3420002f30 tx=0x7f342000bd40).ready entity=mon.1 client_cookie=efed7aabe06e7d1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:40.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f34277fe700 1 -- 172.21.15.79:0/3953019470 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f34280e56c0 con 0x7f34281c8000 2021-04-09T18:33:40.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f34277fe700 1 -- 172.21.15.79:0/3953019470 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3420009850 con 0x7f34281c8000 2021-04-09T18:33:40.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f34277fe700 1 -- 172.21.15.79:0/3953019470 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3420009c20 con 0x7f34281c8000 2021-04-09T18:33:40.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.153 7f342ee08700 1 -- 172.21.15.79:0/3953019470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34281c8000 msgr2=0x7f34281ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:40.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.157 7f342ee08700 1 --2- 172.21.15.79:0/3953019470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34281c8000 0x7f34281ca460 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f3420002f30 tx=0x7f342000bd40).stop 2021-04-09T18:33:40.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.157 7f342ee08700 1 -- 172.21.15.79:0/3953019470 shutdown_connections 2021-04-09T18:33:40.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.157 7f342ee08700 1 --2- 172.21.15.79:0/3953019470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34281c8000 0x7f34281ca460 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:40.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.157 7f342ee08700 1 --2- 172.21.15.79:0/3953019470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34280e9ad0 0x7f342809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:40.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.157 7f342ee08700 1 -- 172.21.15.79:0/3953019470 >> 172.21.15.79:0/3953019470 conn(0x7f34280e5fd0 msgr2=0x7f34280e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:40.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.157 7f342ee08700 1 -- 172.21.15.79:0/3953019470 shutdown_connections 2021-04-09T18:33:40.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.157 7f342ee08700 1 -- 172.21.15.79:0/3953019470 wait complete. 2021-04-09T18:33:40.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f342ee08700 1 Processor -- start 2021-04-09T18:33:40.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f342ee08700 1 -- start start 2021-04-09T18:33:40.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f342ee08700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34280bd3f0 0x7f34280bba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:40.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f342ee08700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34280cfba0 0x7f34280cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:40.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f342ee08700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f342809a930 0x7f342809ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:40.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f342ee08700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342809a630 con 0x7f34280bd3f0 2021-04-09T18:33:40.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f342ee08700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34280a46c0 con 0x7f34280cfba0 2021-04-09T18:33:40.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f342ee08700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342809b3b0 con 0x7f342809a930 2021-04-09T18:33:40.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f342cbac700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34280bd3f0 0x7f34280bba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:40.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f342cbac700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34280bd3f0 0x7f34280bba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60808/0 (socket says 172.21.15.79:60808) 2021-04-09T18:33:40.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f342cbac700 1 -- 172.21.15.79:0/2636566416 learned_addr learned my addr 172.21.15.79:0/2636566416 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:40.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f342d3ad700 1 --2- 172.21.15.79:0/2636566416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f342809a930 0x7f342809ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:40.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f3427fff700 1 --2- 172.21.15.79:0/2636566416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34280cfba0 0x7f34280cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:40.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f342cbac700 1 -- 172.21.15.79:0/2636566416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f342809a930 msgr2=0x7f342809ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:40.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f342cbac700 1 --2- 172.21.15.79:0/2636566416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f342809a930 0x7f342809ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:40.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f342cbac700 1 -- 172.21.15.79:0/2636566416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34280cfba0 msgr2=0x7f34280cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:40.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f342cbac700 1 --2- 172.21.15.79:0/2636566416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34280cfba0 0x7f34280cfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:40.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f342cbac700 1 -- 172.21.15.79:0/2636566416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34280bc0c0 con 0x7f34280bd3f0 2021-04-09T18:33:40.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f342cbac700 1 --2- 172.21.15.79:0/2636566416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34280bd3f0 0x7f34280bba90 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f342809a5b0 tx=0x7f341800cf10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:40.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f34257fa700 1 -- 172.21.15.79:0/2636566416 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f34280bc0c0 con 0x7f34280bd3f0 2021-04-09T18:33:40.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f34257fa700 1 -- 172.21.15.79:0/2636566416 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3418005b80 con 0x7f34280bd3f0 2021-04-09T18:33:40.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f342ee08700 1 -- 172.21.15.79:0/2636566416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3428095280 con 0x7f34280bd3f0 2021-04-09T18:33:40.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f34257fa700 1 -- 172.21.15.79:0/2636566416 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3418007110 con 0x7f34280bd3f0 2021-04-09T18:33:40.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.161 7f342ee08700 1 -- 172.21.15.79:0/2636566416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34280babf0 con 0x7f34280bd3f0 2021-04-09T18:33:40.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.165 7f34257fa700 1 -- 172.21.15.79:0/2636566416 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f341801a060 con 0x7f34280bd3f0 2021-04-09T18:33:40.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.165 7f34257fa700 1 --2- 172.21.15.79:0/2636566416 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f340c029100 0x7f340c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:40.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.165 7f34257fa700 1 -- 172.21.15.79:0/2636566416 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f3418038da0 con 0x7f34280bd3f0 2021-04-09T18:33:40.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.165 7f3427fff700 1 --2- 172.21.15.79:0/2636566416 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f340c029100 0x7f340c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:40.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.165 7f3427fff700 1 --2- 172.21.15.79:0/2636566416 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f340c029100 0x7f340c02b650 crc :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:40.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.165 7f342ee08700 1 -- 172.21.15.79:0/2636566416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34280e39d0 con 0x7f34280bd3f0 2021-04-09T18:33:40.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.173 7f34257fa700 1 -- 172.21.15.79:0/2636566416 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3418005970 con 0x7f34280bd3f0 2021-04-09T18:33:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.333 7f342ee08700 1 -- 172.21.15.79:0/2636566416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7f34280f5b10 con 0x7f34280bd3f0 2021-04-09T18:33:40.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.713 7f34257fa700 1 -- 172.21.15.79:0/2636566416 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v208) v1 ==== 126+0+0 (secure 0 0 0) 0x7f3418000f70 con 0x7f34280bd3f0 2021-04-09T18:33:40.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.753 7f342ee08700 1 -- 172.21.15.79:0/2636566416 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f340c029100 msgr2=0x7f340c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:40.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.753 7f342ee08700 1 --2- 172.21.15.79:0/2636566416 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f340c029100 0x7f340c02b650 crc :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:40.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.753 7f342ee08700 1 -- 172.21.15.79:0/2636566416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34280bd3f0 msgr2=0x7f34280bba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:40.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.753 7f342ee08700 1 --2- 172.21.15.79:0/2636566416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34280bd3f0 0x7f34280bba90 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f342809a5b0 tx=0x7f341800cf10).stop 2021-04-09T18:33:40.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.753 7f342ee08700 1 -- 172.21.15.79:0/2636566416 shutdown_connections 2021-04-09T18:33:40.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.753 7f342ee08700 1 --2- 172.21.15.79:0/2636566416 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f340c029100 0x7f340c02b650 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:40.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.753 7f342ee08700 1 --2- 172.21.15.79:0/2636566416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f342809a930 0x7f342809ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:40.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.753 7f342ee08700 1 --2- 172.21.15.79:0/2636566416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34280bd3f0 0x7f34280bba90 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:40.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.753 7f342ee08700 1 --2- 172.21.15.79:0/2636566416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34280cfba0 0x7f34280cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:40.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.753 7f342ee08700 1 -- 172.21.15.79:0/2636566416 >> 172.21.15.79:0/2636566416 conn(0x7f34280ba1a0 msgr2=0x7f342808ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:40.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.753 7f342ee08700 1 -- 172.21.15.79:0/2636566416 shutdown_connections 2021-04-09T18:33:40.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.753 7f342ee08700 1 -- 172.21.15.79:0/2636566416 wait complete. 2021-04-09T18:33:40.825 INFO:tasks.cephfs_test_runner:test_dump_inode (tasks.cephfs.test_misc.TestMisc) ... ok 2021-04-09T18:33:40.825 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) 2021-04-09T18:33:40.826 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2021-04-09T18:33:40.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.921 7f8e21a22700 1 Processor -- start 2021-04-09T18:33:40.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.921 7f8e21a22700 1 -- start start 2021-04-09T18:33:40.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.921 7f8e21a22700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8e1c0e9ae0 0x7f8e1c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:40.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.921 7f8e21a22700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1c0fbb20 con 0x7f8e1c0f5520 2021-04-09T18:33:40.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.921 7f8e21a22700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1c0e56d0 con 0x7f8e1c1c8010 2021-04-09T18:33:40.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.921 7f8e21a22700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1c1c3dc0 con 0x7f8e1c0e9ae0 2021-04-09T18:33:40.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.921 7f8e1ad4f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8e1c0e9ae0 0x7f8e1c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:40.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.921 7f8e1ad4f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8e1c0e9ae0 0x7f8e1c09f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60816/0 (socket says 172.21.15.79:60816) 2021-04-09T18:33:40.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.921 7f8e1ad4f700 1 -- 172.21.15.79:0/3292894146 learned_addr learned my addr 172.21.15.79:0/3292894146 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:40.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.921 7f8e1b550700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8e1c0f5520 0x7f8e1c0f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55524/0 (socket says 172.21.15.79:55524) 2021-04-09T18:33:40.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.925 7f8e1ad4f700 1 -- 172.21.15.79:0/3292894146 >> v1:172.21.15.89:6789/0 conn(0x7f8e1c1c8010 legacy=0x7f8e1c1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:40.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.925 7f8e1ad4f700 1 -- 172.21.15.79:0/3292894146 >> v1:172.21.15.79:6789/0 conn(0x7f8e1c0f5520 legacy=0x7f8e1c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:40.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.925 7f8e1a54e700 1 -- 172.21.15.79:0/3292894146 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640246841 0 0) 0x7f8e0c0010d0 con 0x7f8e1c0f5520 2021-04-09T18:33:40.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.925 7f8e1ad4f700 1 -- 172.21.15.79:0/3292894146 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c0e4330 con 0x7f8e1c0e9ae0 2021-04-09T18:33:40.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.925 7f8e1ad4f700 1 --2- 172.21.15.79:0/3292894146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e1c0e9ae0 0x7f8e1c09f110 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f8e10002f30 tx=0x7f8e1000bd20).ready entity=mon.0 client_cookie=908c8c31345ff8fa server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:40.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.925 7f8e1a54e700 1 -- 172.21.15.79:0/3292894146 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e1c0e4330 con 0x7f8e1c0e9ae0 2021-04-09T18:33:40.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.925 7f8e1a54e700 1 -- 172.21.15.79:0/3292894146 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e10009a20 con 0x7f8e1c0e9ae0 2021-04-09T18:33:40.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.925 7f8e1a54e700 1 -- 172.21.15.79:0/3292894146 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e10009df0 con 0x7f8e1c0e9ae0 2021-04-09T18:33:40.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.925 7f8e21a22700 1 -- 172.21.15.79:0/3292894146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e1c0e9ae0 msgr2=0x7f8e1c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:40.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.925 7f8e21a22700 1 --2- 172.21.15.79:0/3292894146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e1c0e9ae0 0x7f8e1c09f110 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f8e10002f30 tx=0x7f8e1000bd20).stop 2021-04-09T18:33:40.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.925 7f8e21a22700 1 -- 172.21.15.79:0/3292894146 shutdown_connections 2021-04-09T18:33:40.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.925 7f8e21a22700 1 --2- 172.21.15.79:0/3292894146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e1c0e9ae0 0x7f8e1c09f110 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:40.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.925 7f8e21a22700 1 -- 172.21.15.79:0/3292894146 >> 172.21.15.79:0/3292894146 conn(0x7f8e1c0e5fe0 msgr2=0x7f8e1c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:40.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.925 7f8e21a22700 1 -- 172.21.15.79:0/3292894146 shutdown_connections 2021-04-09T18:33:40.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.925 7f8e21a22700 1 -- 172.21.15.79:0/3292894146 wait complete. 2021-04-09T18:33:40.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.929 7f8e21a22700 1 Processor -- start 2021-04-09T18:33:40.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.929 7f8e21a22700 1 -- start start 2021-04-09T18:33:40.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.929 7f8e21a22700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e1c094340 0x7f8e1c0c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:40.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.929 7f8e21a22700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e1c0c2170 0x7f8e1c1d6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:40.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.929 7f8e21a22700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e1c1d7330 0x7f8e1c1d7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:40.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.929 7f8e21a22700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0e9f30 con 0x7f8e1c094340 2021-04-09T18:33:40.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.929 7f8e21a22700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0c02c0 con 0x7f8e1c1d7330 2021-04-09T18:33:40.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.929 7f8e21a22700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0c05c0 con 0x7f8e1c0c2170 2021-04-09T18:33:40.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.929 7f8e1b550700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e1c094340 0x7f8e1c0c1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:40.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.929 7f8e1b550700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e1c094340 0x7f8e1c0c1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60822/0 (socket says 172.21.15.79:60822) 2021-04-09T18:33:40.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.929 7f8e1b550700 1 -- 172.21.15.79:0/3899845911 learned_addr learned my addr 172.21.15.79:0/3899845911 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:40.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.929 7f8e1ad4f700 1 --2- 172.21.15.79:0/3899845911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e1c0c2170 0x7f8e1c1d6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:40.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.929 7f8e1bd51700 1 --2- 172.21.15.79:0/3899845911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e1c1d7330 0x7f8e1c1d7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:40.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.929 7f8e1b550700 1 -- 172.21.15.79:0/3899845911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e1c0c2170 msgr2=0x7f8e1c1d6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:40.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.929 7f8e1b550700 1 --2- 172.21.15.79:0/3899845911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e1c0c2170 0x7f8e1c1d6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:40.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.929 7f8e1b550700 1 -- 172.21.15.79:0/3899845911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e1c1d7330 msgr2=0x7f8e1c1d7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:40.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.929 7f8e1b550700 1 --2- 172.21.15.79:0/3899845911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e1c1d7330 0x7f8e1c1d7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:40.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.929 7f8e1b550700 1 -- 172.21.15.79:0/3899845911 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c0bfeb0 con 0x7f8e1c094340 2021-04-09T18:33:40.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.929 7f8e1b550700 1 --2- 172.21.15.79:0/3899845911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e1c094340 0x7f8e1c0c1b40 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f8e1c0d7ec0 tx=0x7f8e0c00cb30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:40.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.933 7f8e03fff700 1 -- 172.21.15.79:0/3899845911 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e1c0bfeb0 con 0x7f8e1c094340 2021-04-09T18:33:40.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.933 7f8e03fff700 1 -- 172.21.15.79:0/3899845911 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0c007320 con 0x7f8e1c094340 2021-04-09T18:33:40.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.933 7f8e21a22700 1 -- 172.21.15.79:0/3899845911 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1c094790 con 0x7f8e1c094340 2021-04-09T18:33:40.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.933 7f8e03fff700 1 -- 172.21.15.79:0/3899845911 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e0c005720 con 0x7f8e1c094340 2021-04-09T18:33:40.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.933 7f8e21a22700 1 -- 172.21.15.79:0/3899845911 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1c1d2bf0 con 0x7f8e1c094340 2021-04-09T18:33:40.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.933 7f8e03fff700 1 -- 172.21.15.79:0/3899845911 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8e0c01a020 con 0x7f8e1c094340 2021-04-09T18:33:40.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.933 7f8e03fff700 1 --2- 172.21.15.79:0/3899845911 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8dfc029100 0x7f8dfc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:40.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.933 7f8e03fff700 1 -- 172.21.15.79:0/3899845911 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f8e0c038e80 con 0x7f8e1c094340 2021-04-09T18:33:40.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.933 7f8e1ad4f700 1 --2- 172.21.15.79:0/3899845911 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8dfc029100 0x7f8dfc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:40.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.933 7f8e1ad4f700 1 --2- 172.21.15.79:0/3899845911 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8dfc029100 0x7f8dfc02b650 crc :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:40.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.933 7f8e21a22700 1 -- 172.21.15.79:0/3899845911 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1c0e39e0 con 0x7f8e1c094340 2021-04-09T18:33:40.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:40.941 7f8e03fff700 1 -- 172.21.15.79:0/3899845911 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8e0c007110 con 0x7f8e1c094340 2021-04-09T18:33:41.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.113 7f8e21a22700 1 -- 172.21.15.79:0/3899845911 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7f8e1c0a1cc0 con 0x7f8e1c094340 2021-04-09T18:33:41.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.713 7f8e03fff700 1 -- 172.21.15.79:0/3899845911 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v209) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8e0c000bf0 con 0x7f8e1c094340 2021-04-09T18:33:41.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.733 7f8e21a22700 1 -- 172.21.15.79:0/3899845911 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8dfc029100 msgr2=0x7f8dfc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:41.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.733 7f8e21a22700 1 --2- 172.21.15.79:0/3899845911 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8dfc029100 0x7f8dfc02b650 crc :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:41.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.733 7f8e21a22700 1 -- 172.21.15.79:0/3899845911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e1c094340 msgr2=0x7f8e1c0c1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:41.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.733 7f8e21a22700 1 --2- 172.21.15.79:0/3899845911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e1c094340 0x7f8e1c0c1b40 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f8e1c0d7ec0 tx=0x7f8e0c00cb30).stop 2021-04-09T18:33:41.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.733 7f8e21a22700 1 -- 172.21.15.79:0/3899845911 shutdown_connections 2021-04-09T18:33:41.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.733 7f8e21a22700 1 --2- 172.21.15.79:0/3899845911 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8dfc029100 0x7f8dfc02b650 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:41.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.733 7f8e21a22700 1 --2- 172.21.15.79:0/3899845911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e1c1d7330 0x7f8e1c1d7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:41.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.733 7f8e21a22700 1 --2- 172.21.15.79:0/3899845911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e1c094340 0x7f8e1c0c1b40 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.733 7f8e21a22700 1 --2- 172.21.15.79:0/3899845911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e1c0c2170 0x7f8e1c1d6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.733 7f8e21a22700 1 -- 172.21.15.79:0/3899845911 >> 172.21.15.79:0/3899845911 conn(0x7f8e1c0986b0 msgr2=0x7f8e1c0a99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.733 7f8e21a22700 1 -- 172.21.15.79:0/3899845911 shutdown_connections 2021-04-09T18:33:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.733 7f8e21a22700 1 -- 172.21.15.79:0/3899845911 wait complete. 2021-04-09T18:33:41.753 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-04-09T18:33:41.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.849 7f6e89075700 1 Processor -- start 2021-04-09T18:33:41.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.849 7f6e89075700 1 -- start start 2021-04-09T18:33:41.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e89075700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6e840e9b10 0x7f6e8409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:41.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e89075700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e840fbb50 con 0x7f6e840f5550 2021-04-09T18:33:41.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e89075700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e840e5700 con 0x7f6e841c8040 2021-04-09T18:33:41.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e89075700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e841c3df0 con 0x7f6e840e9b10 2021-04-09T18:33:41.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e8259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6e840e9b10 0x7f6e8409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:41.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e82d9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6e840f5550 0x7f6e840f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55538/0 (socket says 172.21.15.79:55538) 2021-04-09T18:33:41.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e82d9d700 1 -- 172.21.15.79:0/1851952047 learned_addr learned my addr 172.21.15.79:0/1851952047 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:41.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e8259c700 1 -- 172.21.15.79:0/1851952047 >> v1:172.21.15.89:6789/0 conn(0x7f6e841c8040 legacy=0x7f6e841ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:41.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e8259c700 1 -- 172.21.15.79:0/1851952047 >> v1:172.21.15.79:6789/0 conn(0x7f6e840f5550 legacy=0x7f6e840f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:41.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e8259c700 1 -- 172.21.15.79:0/1851952047 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e840e4360 con 0x7f6e840e9b10 2021-04-09T18:33:41.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e81d9b700 1 -- 172.21.15.79:0/1851952047 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053989881 0 0) 0x7f6e740010d0 con 0x7f6e840f5550 2021-04-09T18:33:41.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e8259c700 1 --2- 172.21.15.79:0/1851952047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e840e9b10 0x7f6e8409f110 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f6e78002f30 tx=0x7f6e7800bcc0).ready entity=mon.0 client_cookie=d63ad818099a2b2c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:41.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e81d9b700 1 -- 172.21.15.79:0/1851952047 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6e840e4360 con 0x7f6e840e9b10 2021-04-09T18:33:41.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e81d9b700 1 -- 172.21.15.79:0/1851952047 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e78009800 con 0x7f6e840e9b10 2021-04-09T18:33:41.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e81d9b700 1 -- 172.21.15.79:0/1851952047 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6e78009c10 con 0x7f6e840e9b10 2021-04-09T18:33:41.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e89075700 1 -- 172.21.15.79:0/1851952047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e840e9b10 msgr2=0x7f6e8409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:41.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e89075700 1 --2- 172.21.15.79:0/1851952047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e840e9b10 0x7f6e8409f110 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f6e78002f30 tx=0x7f6e7800bcc0).stop 2021-04-09T18:33:41.870 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e89075700 1 -- 172.21.15.79:0/1851952047 shutdown_connections 2021-04-09T18:33:41.870 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e89075700 1 --2- 172.21.15.79:0/1851952047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e840e9b10 0x7f6e8409f110 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:41.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e89075700 1 -- 172.21.15.79:0/1851952047 >> 172.21.15.79:0/1851952047 conn(0x7f6e840e6010 msgr2=0x7f6e840e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:41.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e89075700 1 -- 172.21.15.79:0/1851952047 shutdown_connections 2021-04-09T18:33:41.872 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.853 7f6e89075700 1 -- 172.21.15.79:0/1851952047 wait complete. 2021-04-09T18:33:41.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.857 7f6e89075700 1 Processor -- start 2021-04-09T18:33:41.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.857 7f6e89075700 1 -- start start 2021-04-09T18:33:41.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e89075700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e840bba70 0x7f6e840a8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:41.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e89075700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e84093bd0 0x7f6e84094020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:41.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e89075700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e841d0ce0 0x7f6e841d1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:41.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e89075700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e840e9f60 con 0x7f6e841d0ce0 2021-04-09T18:33:41.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e89075700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e840980c0 con 0x7f6e840bba70 2021-04-09T18:33:41.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e89075700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e840b1280 con 0x7f6e84093bd0 2021-04-09T18:33:41.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e8359e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e841d0ce0 0x7f6e841d1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:41.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e8359e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e841d0ce0 0x7f6e841d1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60838/0 (socket says 172.21.15.79:60838) 2021-04-09T18:33:41.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e8359e700 1 -- 172.21.15.79:0/1510536455 learned_addr learned my addr 172.21.15.79:0/1510536455 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:41.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e8259c700 1 --2- 172.21.15.79:0/1510536455 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e84093bd0 0x7f6e84094020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:41.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e82d9d700 1 --2- 172.21.15.79:0/1510536455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e840bba70 0x7f6e840a8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:41.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e8359e700 1 -- 172.21.15.79:0/1510536455 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e84093bd0 msgr2=0x7f6e84094020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:41.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e8359e700 1 --2- 172.21.15.79:0/1510536455 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e84093bd0 0x7f6e84094020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:41.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e8359e700 1 -- 172.21.15.79:0/1510536455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e840bba70 msgr2=0x7f6e840a8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:41.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e8359e700 1 --2- 172.21.15.79:0/1510536455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e840bba70 0x7f6e840a8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:41.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e8359e700 1 -- 172.21.15.79:0/1510536455 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e840bbec0 con 0x7f6e841d0ce0 2021-04-09T18:33:41.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e8259c700 1 --2- 172.21.15.79:0/1510536455 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e84093bd0 0x7f6e84094020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:41.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e8359e700 1 --2- 172.21.15.79:0/1510536455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e841d0ce0 0x7f6e841d1130 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f6e840d8d80 tx=0x7f6e7c00ce60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:41.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e737fe700 1 -- 172.21.15.79:0/1510536455 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6e840bbec0 con 0x7f6e841d0ce0 2021-04-09T18:33:41.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e737fe700 1 -- 172.21.15.79:0/1510536455 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c006870 con 0x7f6e841d0ce0 2021-04-09T18:33:41.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e89075700 1 -- 172.21.15.79:0/1510536455 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8409b360 con 0x7f6e841d0ce0 2021-04-09T18:33:41.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e737fe700 1 -- 172.21.15.79:0/1510536455 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6e7c006c40 con 0x7f6e841d0ce0 2021-04-09T18:33:41.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e89075700 1 -- 172.21.15.79:0/1510536455 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e840a8e60 con 0x7f6e841d0ce0 2021-04-09T18:33:41.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e737fe700 1 -- 172.21.15.79:0/1510536455 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6e7c00a770 con 0x7f6e841d0ce0 2021-04-09T18:33:41.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e737fe700 1 --2- 172.21.15.79:0/1510536455 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6e68029100 0x7f6e6802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:41.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e737fe700 1 -- 172.21.15.79:0/1510536455 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f6e7c038f90 con 0x7f6e841d0ce0 2021-04-09T18:33:41.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.861 7f6e82d9d700 1 --2- 172.21.15.79:0/1510536455 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6e68029100 0x7f6e6802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:41.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.865 7f6e82d9d700 1 --2- 172.21.15.79:0/1510536455 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6e68029100 0x7f6e6802b650 crc :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:41.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.865 7f6e89075700 1 -- 172.21.15.79:0/1510536455 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e840e39f0 con 0x7f6e841d0ce0 2021-04-09T18:33:41.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:41.869 7f6e737fe700 1 -- 172.21.15.79:0/1510536455 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6e840f76f0 con 0x7f6e841d0ce0 2021-04-09T18:33:42.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.057 7f6e89075700 1 -- 172.21.15.79:0/1510536455 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6e840a1c90 con 0x7f6e841d0ce0 2021-04-09T18:33:42.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.061 7f6e737fe700 1 -- 172.21.15.79:0/1510536455 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6e7c00a560 con 0x7f6e841d0ce0 2021-04-09T18:33:42.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.065 7f6e89075700 1 -- 172.21.15.79:0/1510536455 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6e68029100 msgr2=0x7f6e6802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:42.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.065 7f6e89075700 1 --2- 172.21.15.79:0/1510536455 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6e68029100 0x7f6e6802b650 crc :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:42.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.065 7f6e89075700 1 -- 172.21.15.79:0/1510536455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e841d0ce0 msgr2=0x7f6e841d1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:42.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.065 7f6e89075700 1 --2- 172.21.15.79:0/1510536455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e841d0ce0 0x7f6e841d1130 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f6e840d8d80 tx=0x7f6e7c00ce60).stop 2021-04-09T18:33:42.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.065 7f6e89075700 1 -- 172.21.15.79:0/1510536455 shutdown_connections 2021-04-09T18:33:42.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.065 7f6e89075700 1 --2- 172.21.15.79:0/1510536455 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6e68029100 0x7f6e6802b650 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:42.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.065 7f6e89075700 1 --2- 172.21.15.79:0/1510536455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e840bba70 0x7f6e840a8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:42.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.069 7f6e89075700 1 --2- 172.21.15.79:0/1510536455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e841d0ce0 0x7f6e841d1130 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:42.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.069 7f6e89075700 1 --2- 172.21.15.79:0/1510536455 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e84093bd0 0x7f6e84094020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:42.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.069 7f6e89075700 1 -- 172.21.15.79:0/1510536455 >> 172.21.15.79:0/1510536455 conn(0x7f6e840ad0f0 msgr2=0x7f6e840ba640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:42.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.069 7f6e89075700 1 -- 172.21.15.79:0/1510536455 shutdown_connections 2021-04-09T18:33:42.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.069 7f6e89075700 1 -- 172.21.15.79:0/1510536455 wait complete. 2021-04-09T18:33:42.082 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:33:42.082 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:42.095 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:42.113 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:42.131 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:42.149 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:42.168 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:33:42.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:42.169 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:42.169 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:42.184 INFO:teuthology.orchestra.run.smithi090.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-04-09T18:33:42.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:33:42.185 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-04-09T18:33:42.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:42.187 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:42.187 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:42.196 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-04-09T18:33:42.197 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:33:42.198 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-04-09T18:33:42.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:42.199 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:42.199 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:33:42.220 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:33:42.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:33:42.222 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:33:42.223 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:33:42.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.321 7f7b9c3a5700 1 Processor -- start 2021-04-09T18:33:42.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.321 7f7b9c3a5700 1 -- start start 2021-04-09T18:33:42.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.321 7f7b9c3a5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b940f5520 0x7f7b940f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:42.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.321 7f7b9c3a5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7b940e9ae0 0x7f7b9409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:42.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.321 7f7b9c3a5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b940fbb20 con 0x7f7b941c2db0 2021-04-09T18:33:42.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.321 7f7b9c3a5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b940e9f30 con 0x7f7b940e9ae0 2021-04-09T18:33:42.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.321 7f7b9c3a5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940e59d0 con 0x7f7b940f5520 2021-04-09T18:33:42.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.321 7f7b99948700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7b940e9ae0 0x7f7b9409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:42.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.321 7f7b99948700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7b940e9ae0 0x7f7b9409f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60846/0 (socket says 172.21.15.79:60846) 2021-04-09T18:33:42.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.321 7f7b99948700 1 -- 172.21.15.79:0/3012345914 learned_addr learned my addr 172.21.15.79:0/3012345914 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:42.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.321 7f7b9a149700 1 --2- 172.21.15.79:0/3012345914 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b940f5520 0x7f7b940f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:42.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.325 7f7b99948700 1 -- 172.21.15.79:0/3012345914 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b940f5520 msgr2=0x7f7b940f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:42.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.325 7f7b99948700 1 --2- 172.21.15.79:0/3012345914 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b940f5520 0x7f7b940f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:42.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.325 7f7b99948700 1 -- 172.21.15.79:0/3012345914 >> v1:172.21.15.89:6789/0 conn(0x7f7b941c2db0 legacy=0x7f7b941c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:42.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.325 7f7b99147700 1 -- 172.21.15.79:0/3012345914 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1006557409 0 0) 0x7f7b8c001450 con 0x7f7b941c2db0 2021-04-09T18:33:42.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.325 7f7b99948700 1 -- 172.21.15.79:0/3012345914 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b940e56d0 con 0x7f7b940e9ae0 2021-04-09T18:33:42.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.325 7f7b99948700 1 --2- 172.21.15.79:0/3012345914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b940e9ae0 0x7f7b9409f110 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f7b84002f30 tx=0x7f7b8400bda0).ready entity=mon.0 client_cookie=d8f8304db87be02 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:42.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.325 7f7b99147700 1 -- 172.21.15.79:0/3012345914 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7b940e56d0 con 0x7f7b940e9ae0 2021-04-09T18:33:42.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.325 7f7b99147700 1 -- 172.21.15.79:0/3012345914 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b840099d0 con 0x7f7b940e9ae0 2021-04-09T18:33:42.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.325 7f7b99147700 1 -- 172.21.15.79:0/3012345914 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7b84009da0 con 0x7f7b940e9ae0 2021-04-09T18:33:42.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.325 7f7b9c3a5700 1 -- 172.21.15.79:0/3012345914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b940e9ae0 msgr2=0x7f7b9409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:42.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.325 7f7b9c3a5700 1 --2- 172.21.15.79:0/3012345914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b940e9ae0 0x7f7b9409f110 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f7b84002f30 tx=0x7f7b8400bda0).stop 2021-04-09T18:33:42.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.325 7f7b9c3a5700 1 -- 172.21.15.79:0/3012345914 shutdown_connections 2021-04-09T18:33:42.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.325 7f7b9c3a5700 1 --2- 172.21.15.79:0/3012345914 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b940f5520 0x7f7b940f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:42.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.325 7f7b9c3a5700 1 --2- 172.21.15.79:0/3012345914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b940e9ae0 0x7f7b9409f110 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:42.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.325 7f7b9c3a5700 1 -- 172.21.15.79:0/3012345914 >> 172.21.15.79:0/3012345914 conn(0x7f7b940e5fe0 msgr2=0x7f7b940e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:42.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.325 7f7b9c3a5700 1 -- 172.21.15.79:0/3012345914 shutdown_connections 2021-04-09T18:33:42.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.325 7f7b9c3a5700 1 -- 172.21.15.79:0/3012345914 wait complete. 2021-04-09T18:33:42.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b9c3a5700 1 Processor -- start 2021-04-09T18:33:42.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b9c3a5700 1 -- start start 2021-04-09T18:33:42.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b9c3a5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b94092ed0 0x7f7b94090140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:42.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b9c3a5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b940d3020 0x7f7b940d3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:42.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b9c3a5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b941a6930 0x7f7b941a6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:42.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b9c3a5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940913b0 con 0x7f7b941a6930 2021-04-09T18:33:42.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b9c3a5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940916b0 con 0x7f7b94092ed0 2021-04-09T18:33:42.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b9c3a5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b94092c50 con 0x7f7b940d3020 2021-04-09T18:33:42.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b9a94a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b941a6930 0x7f7b941a6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:42.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b9a94a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b941a6930 0x7f7b941a6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60850/0 (socket says 172.21.15.79:60850) 2021-04-09T18:33:42.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b9a94a700 1 -- 172.21.15.79:0/4206833003 learned_addr learned my addr 172.21.15.79:0/4206833003 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:42.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b99948700 1 --2- 172.21.15.79:0/4206833003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b940d3020 0x7f7b940d3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:42.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b9a149700 1 --2- 172.21.15.79:0/4206833003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b94092ed0 0x7f7b94090140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:42.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b9a94a700 1 -- 172.21.15.79:0/4206833003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b940d3020 msgr2=0x7f7b940d3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:42.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b9a94a700 1 --2- 172.21.15.79:0/4206833003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b940d3020 0x7f7b940d3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:42.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b9a94a700 1 -- 172.21.15.79:0/4206833003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b94092ed0 msgr2=0x7f7b94090140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:42.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b9a94a700 1 --2- 172.21.15.79:0/4206833003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b94092ed0 0x7f7b94090140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:42.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b9a94a700 1 -- 172.21.15.79:0/4206833003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b941a73b0 con 0x7f7b941a6930 2021-04-09T18:33:42.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b9a94a700 1 --2- 172.21.15.79:0/4206833003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b941a6930 0x7f7b941a6d80 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f7b94094db0 tx=0x7f7b8c00cf10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:42.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b8affd700 1 -- 172.21.15.79:0/4206833003 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7b941a73b0 con 0x7f7b941a6930 2021-04-09T18:33:42.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b8affd700 1 -- 172.21.15.79:0/4206833003 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8c003070 con 0x7f7b941a6930 2021-04-09T18:33:42.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b8affd700 1 -- 172.21.15.79:0/4206833003 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7b8c006c70 con 0x7f7b941a6930 2021-04-09T18:33:42.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b9c3a5700 1 -- 172.21.15.79:0/4206833003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b94090df0 con 0x7f7b941a6930 2021-04-09T18:33:42.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.329 7f7b9c3a5700 1 -- 172.21.15.79:0/4206833003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b94093320 con 0x7f7b941a6930 2021-04-09T18:33:42.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.333 7f7b8affd700 1 -- 172.21.15.79:0/4206833003 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7b8c01a060 con 0x7f7b941a6930 2021-04-09T18:33:42.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.333 7f7b8affd700 1 --2- 172.21.15.79:0/4206833003 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7b7c029100 0x7f7b7c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:42.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.333 7f7b8affd700 1 -- 172.21.15.79:0/4206833003 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f7b8c038be0 con 0x7f7b941a6930 2021-04-09T18:33:42.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.333 7f7b9a149700 1 --2- 172.21.15.79:0/4206833003 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7b7c029100 0x7f7b7c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:42.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.333 7f7b9a149700 1 --2- 172.21.15.79:0/4206833003 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7b7c029100 0x7f7b7c02b650 crc :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:42.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.337 7f7b9c3a5700 1 -- 172.21.15.79:0/4206833003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b940e39e0 con 0x7f7b941a6930 2021-04-09T18:33:42.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.345 7f7b8affd700 1 -- 172.21.15.79:0/4206833003 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7b8c006870 con 0x7f7b941a6930 2021-04-09T18:33:42.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.517 7f7b9c3a5700 1 -- 172.21.15.79:0/4206833003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f7b940f5b20 con 0x7f7b941a6930 2021-04-09T18:33:42.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.517 7f7b8affd700 1 -- 172.21.15.79:0/4206833003 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v82) v1 ==== 81+0+25933 (secure 0 0 0) 0x7f7b940f76c0 con 0x7f7b941a6930 2021-04-09T18:33:42.523 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:42.523 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:33:42.523 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 82, 2021-04-09T18:33:42.523 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:33:42.524 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:33:42.524 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:33:39.700258", 2021-04-09T18:33:42.524 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:33:42.524 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:33:42.525 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:33:42.525 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:33:42.525 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:33:42.525 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:33:42.526 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:33:42.526 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:33:42.526 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:33:42.526 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:33:42.527 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:33:42.527 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:33:42.527 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:33:42.527 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:33:42.527 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:33:42.528 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 15, 2021-04-09T18:33:42.528 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:33:42.528 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:33:42.528 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:33:42.529 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:33:42.529 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:33:42.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.529 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:33:42.529 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:33:42.530 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:33:42.530 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:33:42.530 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:33:42.530 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:33:42.531 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:33:42.531 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:33:42.531 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:33:42.531 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:33:42.532 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:33:42.532 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:33:42.532 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:33:42.532 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:33:42.532 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:33:42.533 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:33:42.533 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:33:42.533 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:33:42.533 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:33:42.534 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:33:42.534 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:33:42.534 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:33:42.534 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:33:42.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.535 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:33:42.535 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:33:42.535 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:33:42.535 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:33:42.536 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:33:42.536 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:33:42.536 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:33:42.536 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:33:42.536 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:33:42.537 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:33:42.537 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:33:42.537 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:33:42.537 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:33:42.537 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:33:42.538 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:33:42.538 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:33:42.538 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:33:42.538 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:33:42.538 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:33:42.539 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:33:42.539 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:33:42.539 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:33:42.539 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:33:42.540 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:33:42.540 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:33:42.540 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:33:42.540 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:33:42.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.541 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:33:42.541 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:33:42.541 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:33:42.541 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:33:42.541 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:33:42.542 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:33:42.542 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:33:42.542 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:33:42.542 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:33:42.542 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:33:42.543 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:33:42.543 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:33:42.543 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:33:42.543 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:33:42.544 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.544 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.544 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:33:42.544 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:33:42.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.545 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:33:42.545 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:33:42.545 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:42.545 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:42.546 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:42.546 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:42.546 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:42.546 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:42.547 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:42.547 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 77, 2021-04-09T18:33:42.547 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:42.547 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:42.548 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:42.548 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.548 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.549 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:33:42.549 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:42.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.549 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.550 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:33:42.550 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:42.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.550 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.551 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:42.551 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.551 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.552 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:33:42.552 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:42.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.552 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.553 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:33:42.553 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:42.553 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.553 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.554 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:42.554 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.554 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.555 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:33:42.555 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:42.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.556 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.556 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:33:42.556 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:42.556 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.556 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.557 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:42.557 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.557 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.558 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:33:42.558 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:42.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.559 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.559 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:33:42.560 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:42.560 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.561 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.561 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:33:42.562 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:33:42.562 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:33:42.563 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:33:42.563 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:42.564 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:42.564 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:42.565 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.566 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:33:42.566 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:33:42.567 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:42.567 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:42.568 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:42.568 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:42.568 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:42.569 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:42.569 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:42.570 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 77, 2021-04-09T18:33:42.570 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:42.571 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:42.571 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:42.572 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.573 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.573 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:33:42.573 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:42.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.575 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.575 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:33:42.576 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:42.576 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.577 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.577 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:42.578 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.579 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.579 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:33:42.580 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:42.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.581 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.581 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:33:42.582 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:42.582 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.582 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.582 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:42.583 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.583 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.583 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:33:42.584 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:42.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.584 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.585 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:33:42.585 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:42.585 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.585 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.586 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:42.586 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.586 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.587 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:33:42.587 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:42.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.588 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.588 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:33:42.588 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:42.588 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.589 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.589 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:33:42.590 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:33:42.590 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:33:42.590 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:33:42.590 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:42.590 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:42.591 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:42.591 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.592 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:33:42.592 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:33:42.592 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:42.592 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:42.593 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:42.593 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:42.593 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:42.593 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:42.593 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:42.594 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 77, 2021-04-09T18:33:42.594 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:42.594 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:42.594 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:42.594 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.595 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.595 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:33:42.595 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:42.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.596 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.596 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:33:42.596 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:42.597 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.597 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.597 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:42.598 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.598 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.598 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:33:42.598 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:42.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.599 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.599 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:33:42.600 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:42.600 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.600 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.600 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:42.601 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.601 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.601 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:33:42.602 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:42.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.602 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.602 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:33:42.603 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:42.603 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.603 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.604 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:42.604 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.604 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.604 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:33:42.605 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:42.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.605 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.606 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:33:42.606 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:42.606 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.606 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.607 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:33:42.607 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:33:42.607 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:33:42.607 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:33:42.608 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:42.608 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:42.608 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:42.608 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.609 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:33:42.609 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:33:42.609 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:42.610 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:42.610 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:42.610 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:42.610 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:42.611 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:42.611 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:42.611 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 76, 2021-04-09T18:33:42.611 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:42.611 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:42.612 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:42.612 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.612 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.612 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:33:42.613 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:42.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.614 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:33:42.614 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:42.614 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.614 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.615 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:42.615 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.615 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.616 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:33:42.616 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:42.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.617 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.617 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:33:42.617 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:42.617 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.617 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.618 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:42.618 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.618 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.619 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:33:42.619 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:42.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.620 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.620 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:33:42.621 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:42.621 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.621 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.622 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:42.622 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.622 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.622 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:33:42.622 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:42.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.623 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.623 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:33:42.624 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:42.624 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.624 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.624 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:33:42.624 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:33:42.625 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:33:42.625 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:33:42.625 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:42.625 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:42.625 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:42.626 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.626 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:33:42.627 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:33:42.627 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:42.627 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:42.627 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:42.627 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:42.628 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:42.628 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:42.628 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:42.628 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 77, 2021-04-09T18:33:42.628 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:42.629 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:42.629 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:42.629 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.629 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.630 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:33:42.630 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:42.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.631 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.631 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:33:42.631 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:42.631 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.631 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.632 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:42.632 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.632 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.633 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:33:42.633 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:42.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.633 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.634 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:33:42.634 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:42.634 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.634 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.635 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:42.635 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.635 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.635 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:33:42.636 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:42.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.636 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.636 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:33:42.637 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:42.637 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.637 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.637 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:42.638 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.638 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.638 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:33:42.638 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:42.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.639 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.639 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:33:42.640 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:42.640 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.640 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.640 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:33:42.641 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:33:42.641 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:33:42.641 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:33:42.641 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:42.642 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:42.642 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:42.642 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.643 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:33:42.643 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:33:42.643 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:42.643 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:42.644 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:42.644 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:42.644 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:42.644 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:42.644 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:42.645 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 76, 2021-04-09T18:33:42.645 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:42.645 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:42.645 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:42.645 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.646 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.646 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:33:42.646 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:42.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.647 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.647 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:33:42.648 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:42.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.648 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.649 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:42.649 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.649 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.649 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:33:42.650 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:42.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.650 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.651 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:33:42.651 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:42.651 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.651 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.652 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:42.652 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.653 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.653 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:33:42.653 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:42.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.654 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.655 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:33:42.655 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:42.656 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.656 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.657 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:42.657 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.658 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.658 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:33:42.658 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:42.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.659 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.660 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:33:42.660 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:42.661 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.661 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.662 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:33:42.662 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:33:42.662 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:33:42.663 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:33:42.663 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:42.664 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:42.664 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:42.664 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.665 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:33:42.666 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:33:42.666 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:42.666 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:42.667 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:42.667 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:42.667 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:42.668 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:42.668 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:42.669 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 77, 2021-04-09T18:33:42.669 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:42.669 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:42.670 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:42.670 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.671 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.671 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:33:42.672 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:42.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.673 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.673 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:33:42.673 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:42.674 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.674 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.675 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:42.675 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:33:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.677 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.677 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:33:42.677 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:42.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.678 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.678 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:42.679 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.679 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.679 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:33:42.680 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:42.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.680 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.680 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:33:42.681 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:42.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.681 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.681 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:42.682 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.682 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.682 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:33:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:33:42.684 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:42.684 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.684 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:33:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:33:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:33:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:33:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:42.686 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:42.686 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:42.686 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.687 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:33:42.687 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:33:42.687 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:42.687 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:42.688 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:42.688 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:42.688 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:42.688 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:42.689 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:42.689 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 66, 2021-04-09T18:33:42.689 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:42.689 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:42.690 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:42.690 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.690 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.690 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:33:42.691 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:42.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.691 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.692 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:33:42.692 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:42.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.692 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.693 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:42.693 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.693 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.694 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:33:42.694 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:42.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.694 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.695 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:33:42.695 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:42.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.695 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.696 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:42.696 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.696 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.697 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:33:42.697 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:42.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.697 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.698 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:33:42.698 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:42.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.698 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.699 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:42.699 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:42.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.699 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:42.700 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:33:42.700 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:42.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.701 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:42.701 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:33:42.701 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:42.701 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.701 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.702 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:33:42.702 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:33:42.702 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:33:42.702 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:33:42.703 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:42.703 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:42.703 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:42.703 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:42.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.704 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:33:42.704 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:33:42.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.705 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:33:42.705 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:42.705 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:42.705 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:42.705 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:42.706 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:42.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.706 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:33:42.706 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:42.707 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:42.707 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:42.707 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:42.707 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:42.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.708 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:33:42.708 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:42.708 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:42.709 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:42.709 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:42.709 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:42.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.710 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:33:42.710 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:42.710 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:42.710 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:42.711 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:42.711 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:42.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.712 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:33:42.712 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:42.712 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:42.712 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:42.712 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:42.713 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:42.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.713 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:33:42.714 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:42.714 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:42.714 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:42.714 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:42.714 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:42.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.715 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:33:42.715 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:42.716 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:42.716 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:42.716 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:42.716 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:42.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:42.717 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:33:42.717 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:42.718 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:42.718 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:42.718 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:42.718 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:42.718 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.719 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:33:42.719 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:33:42.719 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:33:42.719 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:33:42.720 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:33:42.720 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": { 2021-04-09T18:33:42.720 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6835/1825266006": "2021-04-10 18:33:35.683600", 2021-04-09T18:33:42.720 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6834/1825266006": "2021-04-10 18:33:35.683600" 2021-04-09T18:33:42.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.721 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:33:42.721 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:33:42.721 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:33:42.721 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:33:42.722 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:33:42.722 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:33:42.722 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:33:42.722 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:33:42.723 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:33:42.723 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:33:42.723 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:33:42.723 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:33:42.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.724 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:33:42.724 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:33:42.724 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:33:42.724 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:33:42.725 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:33:42.725 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:33:42.725 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:33:42.725 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:42.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:42.726 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:33:42.726 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:33:42.726 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:33:42.726 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:33:42.727 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:33:42.727 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:33:42.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.521 7f7b9c3a5700 1 -- 172.21.15.79:0/4206833003 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7b7c029100 msgr2=0x7f7b7c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:42.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.521 7f7b9c3a5700 1 --2- 172.21.15.79:0/4206833003 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7b7c029100 0x7f7b7c02b650 crc :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:42.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.521 7f7b9c3a5700 1 -- 172.21.15.79:0/4206833003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b941a6930 msgr2=0x7f7b941a6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:42.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.521 7f7b9c3a5700 1 --2- 172.21.15.79:0/4206833003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b941a6930 0x7f7b941a6d80 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f7b94094db0 tx=0x7f7b8c00cf10).stop 2021-04-09T18:33:42.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.521 7f7b9c3a5700 1 -- 172.21.15.79:0/4206833003 shutdown_connections 2021-04-09T18:33:42.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.521 7f7b9c3a5700 1 --2- 172.21.15.79:0/4206833003 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7b7c029100 0x7f7b7c02b650 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:42.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.521 7f7b9c3a5700 1 --2- 172.21.15.79:0/4206833003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b94092ed0 0x7f7b94090140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:42.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.521 7f7b9c3a5700 1 --2- 172.21.15.79:0/4206833003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b941a6930 0x7f7b941a6d80 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:42.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.521 7f7b9c3a5700 1 --2- 172.21.15.79:0/4206833003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b940d3020 0x7f7b940d3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:42.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.521 7f7b9c3a5700 1 -- 172.21.15.79:0/4206833003 >> 172.21.15.79:0/4206833003 conn(0x7f7b940baf70 msgr2=0x7f7b940d81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:42.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.521 7f7b9c3a5700 1 -- 172.21.15.79:0/4206833003 shutdown_connections 2021-04-09T18:33:42.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.521 7f7b9c3a5700 1 -- 172.21.15.79:0/4206833003 wait complete. 2021-04-09T18:33:42.732 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:42.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.825 7ff93b35d700 1 Processor -- start 2021-04-09T18:33:42.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.825 7ff93b35d700 1 -- start start 2021-04-09T18:33:42.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.825 7ff93b35d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9340f5510 0x7ff9340f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:42.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.825 7ff93b35d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff9340e9ad0 0x7ff93409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:42.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.825 7ff93b35d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9340fbb10 con 0x7ff9341c2da0 2021-04-09T18:33:42.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.825 7ff93b35d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9340e9f20 con 0x7ff9340e9ad0 2021-04-09T18:33:42.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.825 7ff93b35d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9340e59c0 con 0x7ff9340f5510 2021-04-09T18:33:42.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.825 7ff938900700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff9340e9ad0 0x7ff93409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:42.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.825 7ff938900700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff9340e9ad0 0x7ff93409f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60858/0 (socket says 172.21.15.79:60858) 2021-04-09T18:33:42.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.825 7ff938900700 1 -- 172.21.15.79:0/3046749682 learned_addr learned my addr 172.21.15.79:0/3046749682 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:42.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.825 7ff939101700 1 --2- 172.21.15.79:0/3046749682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9340f5510 0x7ff9340f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:42.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.829 7ff938900700 1 -- 172.21.15.79:0/3046749682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9340f5510 msgr2=0x7ff9340f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:42.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.829 7ff938900700 1 --2- 172.21.15.79:0/3046749682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9340f5510 0x7ff9340f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:42.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.829 7ff938900700 1 -- 172.21.15.79:0/3046749682 >> v1:172.21.15.89:6789/0 conn(0x7ff9341c2da0 legacy=0x7ff9341c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:42.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.829 7ff938900700 1 -- 172.21.15.79:0/3046749682 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9340e56c0 con 0x7ff9340e9ad0 2021-04-09T18:33:42.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.829 7ff938900700 1 --2- 172.21.15.79:0/3046749682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9340e9ad0 0x7ff93409f100 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7ff924002f30 tx=0x7ff92400bda0).ready entity=mon.0 client_cookie=65ecf2cbb6be021e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:42.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.829 7ff92bfff700 1 -- 172.21.15.79:0/3046749682 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff9340e56c0 con 0x7ff9340e9ad0 2021-04-09T18:33:42.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.829 7ff92bfff700 1 -- 172.21.15.79:0/3046749682 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9240099d0 con 0x7ff9340e9ad0 2021-04-09T18:33:42.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.829 7ff92bfff700 1 -- 172.21.15.79:0/3046749682 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff924009da0 con 0x7ff9340e9ad0 2021-04-09T18:33:42.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.829 7ff93b35d700 1 -- 172.21.15.79:0/3046749682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9340e9ad0 msgr2=0x7ff93409f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:42.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.829 7ff93b35d700 1 --2- 172.21.15.79:0/3046749682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9340e9ad0 0x7ff93409f100 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7ff924002f30 tx=0x7ff92400bda0).stop 2021-04-09T18:33:42.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.829 7ff93b35d700 1 -- 172.21.15.79:0/3046749682 shutdown_connections 2021-04-09T18:33:42.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.829 7ff93b35d700 1 --2- 172.21.15.79:0/3046749682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9340f5510 0x7ff9340f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:42.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.829 7ff93b35d700 1 --2- 172.21.15.79:0/3046749682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9340e9ad0 0x7ff93409f100 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:42.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.829 7ff93b35d700 1 -- 172.21.15.79:0/3046749682 >> 172.21.15.79:0/3046749682 conn(0x7ff9340e5fd0 msgr2=0x7ff9340e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:42.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.829 7ff93b35d700 1 -- 172.21.15.79:0/3046749682 shutdown_connections 2021-04-09T18:33:42.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.829 7ff93b35d700 1 -- 172.21.15.79:0/3046749682 wait complete. 2021-04-09T18:33:42.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.833 7ff93b35d700 1 Processor -- start 2021-04-09T18:33:42.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.833 7ff93b35d700 1 -- start start 2021-04-09T18:33:42.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.833 7ff93b35d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9340a39f0 0x7ff9340af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:42.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.833 7ff93b35d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9340a2e40 0x7ff9340c1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:42.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.833 7ff93b35d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9340c1680 0x7ff9340d45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:42.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.833 7ff93b35d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9340acef0 con 0x7ff9340c1680 2021-04-09T18:33:42.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.833 7ff93b35d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9340a3e40 con 0x7ff9340a2e40 2021-04-09T18:33:42.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.833 7ff93b35d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9340ad1f0 con 0x7ff9340a39f0 2021-04-09T18:33:42.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.833 7ff939902700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9340c1680 0x7ff9340d45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:42.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.833 7ff939902700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9340c1680 0x7ff9340d45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60864/0 (socket says 172.21.15.79:60864) 2021-04-09T18:33:42.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.833 7ff939902700 1 -- 172.21.15.79:0/3969428234 learned_addr learned my addr 172.21.15.79:0/3969428234 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:42.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.833 7ff939101700 1 --2- 172.21.15.79:0/3969428234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9340a39f0 0x7ff9340af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:42.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.833 7ff938900700 1 --2- 172.21.15.79:0/3969428234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9340a2e40 0x7ff9340c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:42.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.833 7ff939902700 1 -- 172.21.15.79:0/3969428234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9340a39f0 msgr2=0x7ff9340af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:42.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.833 7ff939902700 1 --2- 172.21.15.79:0/3969428234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9340a39f0 0x7ff9340af7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:42.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.833 7ff939902700 1 -- 172.21.15.79:0/3969428234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9340a2e40 msgr2=0x7ff9340c1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:42.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.833 7ff939902700 1 --2- 172.21.15.79:0/3969428234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9340a2e40 0x7ff9340c1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.833 7ff939902700 1 -- 172.21.15.79:0/3969428234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9340afe20 con 0x7ff9340c1680 2021-04-09T18:33:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.833 7ff939101700 1 --2- 172.21.15.79:0/3969428234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9340a39f0 0x7ff9340af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.837 7ff939902700 1 --2- 172.21.15.79:0/3969428234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9340c1680 0x7ff9340d45a0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7ff9340c1e10 tx=0x7ff92c00cec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.837 7ff929ffb700 1 -- 172.21.15.79:0/3969428234 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff9340afe20 con 0x7ff9340c1680 2021-04-09T18:33:42.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.837 7ff929ffb700 1 -- 172.21.15.79:0/3969428234 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c006a80 con 0x7ff9340c1680 2021-04-09T18:33:42.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.837 7ff93b35d700 1 -- 172.21.15.79:0/3969428234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9340a3290 con 0x7ff9340c1680 2021-04-09T18:33:42.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.837 7ff929ffb700 1 -- 172.21.15.79:0/3969428234 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff92c007030 con 0x7ff9340c1680 2021-04-09T18:33:42.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.837 7ff93b35d700 1 -- 172.21.15.79:0/3969428234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9340d4bd0 con 0x7ff9340c1680 2021-04-09T18:33:42.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.837 7ff929ffb700 1 -- 172.21.15.79:0/3969428234 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff92c01a020 con 0x7ff9340c1680 2021-04-09T18:33:42.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.837 7ff929ffb700 1 --2- 172.21.15.79:0/3969428234 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff914029100 0x7ff91402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:42.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.837 7ff929ffb700 1 -- 172.21.15.79:0/3969428234 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5190+0+0 (secure 0 0 0) 0x7ff92c0392b0 con 0x7ff9340c1680 2021-04-09T18:33:42.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.837 7ff939101700 1 --2- 172.21.15.79:0/3969428234 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff914029100 0x7ff91402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:42.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.837 7ff939101700 1 --2- 172.21.15.79:0/3969428234 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff914029100 0x7ff91402b650 crc :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:42.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.837 7ff93b35d700 1 -- 172.21.15.79:0/3969428234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9340e39d0 con 0x7ff9340c1680 2021-04-09T18:33:42.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:42.845 7ff929ffb700 1 -- 172.21.15.79:0/3969428234 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff9340f76b0 con 0x7ff9340c1680 2021-04-09T18:33:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.009 7ff93b35d700 1 -- 172.21.15.79:0/3969428234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9340f5b10 con 0x7ff9340c1680 2021-04-09T18:33:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.013 7ff929ffb700 1 -- 172.21.15.79:0/3969428234 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+1177 (secure 0 0 0) 0x7ff92c006870 con 0x7ff9340c1680 2021-04-09T18:33:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 50 2021-04-09T18:33:43.016 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:43.016 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":50,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6510,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/4230183300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4230183300},{"type":"v1","addr":"172.21.15.79:6833","nonce":4230183300}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":44},{"gid":6775,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1545343583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1545343583},{"type":"v1","addr":"172.21.15.89:6835","nonce":1545343583}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":50}],"filesystems":[]} 2021-04-09T18:33:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.013 7ff93b35d700 1 -- 172.21.15.79:0/3969428234 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff914029100 msgr2=0x7ff91402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.013 7ff93b35d700 1 --2- 172.21.15.79:0/3969428234 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff914029100 0x7ff91402b650 crc :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:43.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.013 7ff93b35d700 1 -- 172.21.15.79:0/3969428234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9340c1680 msgr2=0x7ff9340d45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:43.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.013 7ff93b35d700 1 --2- 172.21.15.79:0/3969428234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9340c1680 0x7ff9340d45a0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7ff9340c1e10 tx=0x7ff92c00cec0).stop 2021-04-09T18:33:43.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.013 7ff93b35d700 1 -- 172.21.15.79:0/3969428234 shutdown_connections 2021-04-09T18:33:43.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.013 7ff93b35d700 1 --2- 172.21.15.79:0/3969428234 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff914029100 0x7ff91402b650 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:43.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.013 7ff93b35d700 1 --2- 172.21.15.79:0/3969428234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9340c1680 0x7ff9340d45a0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:43.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.013 7ff93b35d700 1 --2- 172.21.15.79:0/3969428234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9340a39f0 0x7ff9340af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:43.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.013 7ff93b35d700 1 --2- 172.21.15.79:0/3969428234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9340a2e40 0x7ff9340c1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:43.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.013 7ff93b35d700 1 -- 172.21.15.79:0/3969428234 >> 172.21.15.79:0/3969428234 conn(0x7ff93409aeb0 msgr2=0x7ff9340d7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:43.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.013 7ff93b35d700 1 -- 172.21.15.79:0/3969428234 shutdown_connections 2021-04-09T18:33:43.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.013 7ff93b35d700 1 -- 172.21.15.79:0/3969428234 wait complete. 2021-04-09T18:33:43.028 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:43.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb63594e700 1 Processor -- start 2021-04-09T18:33:43.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb63594e700 1 -- start start 2021-04-09T18:33:43.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb63594e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb6301c9010 0x7fb6301cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:43.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb63594e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6300fbb10 con 0x7fb6300e9ad0 2021-04-09T18:33:43.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb63594e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63009f900 con 0x7fb6300f5510 2021-04-09T18:33:43.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb63594e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6301c3db0 con 0x7fb6301c9010 2021-04-09T18:33:43.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb62ed4f700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb6300e9ad0 0x7fb63009f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55580/0 (socket says 172.21.15.79:55580) 2021-04-09T18:33:43.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb62ed4f700 1 -- 172.21.15.79:0/543763911 learned_addr learned my addr 172.21.15.79:0/543763911 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:43.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb62fd51700 1 --2- 172.21.15.79:0/543763911 >> v2:172.21.15.79:3300/0 conn(0x7fb6301c9010 0x7fb6301cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:43.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb62e54e700 1 -- 172.21.15.79:0/543763911 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248350609 0 0) 0x7fb6180010d0 con 0x7fb6300e9ad0 2021-04-09T18:33:43.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb62e54e700 1 -- 172.21.15.79:0/543763911 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb61c003240 con 0x7fb6300e9ad0 2021-04-09T18:33:43.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb62fd51700 1 -- 172.21.15.79:0/543763911 >> v1:172.21.15.89:6789/0 conn(0x7fb6300f5510 legacy=0x7fb6300f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:43.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb62e54e700 1 -- 172.21.15.79:0/543763911 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435674885 0 0) 0x7fb620001450 con 0x7fb6300f5510 2021-04-09T18:33:43.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb62fd51700 1 -- 172.21.15.79:0/543763911 >> v1:172.21.15.79:6789/0 conn(0x7fb6300e9ad0 legacy=0x7fb63009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:43.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb62fd51700 1 -- 172.21.15.79:0/543763911 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6300e56c0 con 0x7fb6301c9010 2021-04-09T18:33:43.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb62fd51700 1 --2- 172.21.15.79:0/543763911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6301c9010 0x7fb6301cb470 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7fb628002f30 tx=0x7fb62800bcc0).ready entity=mon.0 client_cookie=ac76fec03ec4a198 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:43.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb62e54e700 1 -- 172.21.15.79:0/543763911 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb6300e56c0 con 0x7fb6301c9010 2021-04-09T18:33:43.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb62e54e700 1 -- 172.21.15.79:0/543763911 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb628009800 con 0x7fb6301c9010 2021-04-09T18:33:43.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb62e54e700 1 -- 172.21.15.79:0/543763911 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb628009bd0 con 0x7fb6301c9010 2021-04-09T18:33:43.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb63594e700 1 -- 172.21.15.79:0/543763911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6301c9010 msgr2=0x7fb6301cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:43.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb63594e700 1 --2- 172.21.15.79:0/543763911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6301c9010 0x7fb6301cb470 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7fb628002f30 tx=0x7fb62800bcc0).stop 2021-04-09T18:33:43.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb63594e700 1 -- 172.21.15.79:0/543763911 shutdown_connections 2021-04-09T18:33:43.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb63594e700 1 --2- 172.21.15.79:0/543763911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6301c9010 0x7fb6301cb470 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:43.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb63594e700 1 -- 172.21.15.79:0/543763911 >> 172.21.15.79:0/543763911 conn(0x7fb6300e5fd0 msgr2=0x7fb6300e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:43.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb63594e700 1 -- 172.21.15.79:0/543763911 shutdown_connections 2021-04-09T18:33:43.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.121 7fb63594e700 1 -- 172.21.15.79:0/543763911 wait complete. 2021-04-09T18:33:43.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.125 7fb63594e700 1 Processor -- start 2021-04-09T18:33:43.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.125 7fb63594e700 1 -- start start 2021-04-09T18:33:43.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.125 7fb63594e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb630097410 0x7fb6300c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:43.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.125 7fb63594e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6300aeff0 0x7fb6300afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:43.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.125 7fb63594e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6300af440 0x7fb6300b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:43.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.125 7fb63594e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300e9f20 con 0x7fb6300aeff0 2021-04-09T18:33:43.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.125 7fb63594e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300ada70 con 0x7fb630097410 2021-04-09T18:33:43.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.125 7fb63594e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb630097860 con 0x7fb6300af440 2021-04-09T18:33:43.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.125 7fb62ed4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6300aeff0 0x7fb6300afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:43.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.125 7fb62ed4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6300aeff0 0x7fb6300afb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60878/0 (socket says 172.21.15.79:60878) 2021-04-09T18:33:43.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.125 7fb62ed4f700 1 -- 172.21.15.79:0/3512326423 learned_addr learned my addr 172.21.15.79:0/3512326423 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:43.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.125 7fb62f550700 1 --2- 172.21.15.79:0/3512326423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb630097410 0x7fb6300c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:43.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.125 7fb62fd51700 1 --2- 172.21.15.79:0/3512326423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6300af440 0x7fb6300b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:43.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.125 7fb62ed4f700 1 -- 172.21.15.79:0/3512326423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6300af440 msgr2=0x7fb6300b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:43.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.125 7fb62ed4f700 1 --2- 172.21.15.79:0/3512326423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6300af440 0x7fb6300b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:43.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.125 7fb62ed4f700 1 -- 172.21.15.79:0/3512326423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb630097410 msgr2=0x7fb6300c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:43.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.125 7fb62ed4f700 1 --2- 172.21.15.79:0/3512326423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb630097410 0x7fb6300c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.125 7fb62ed4f700 1 -- 172.21.15.79:0/3512326423 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6300d5d90 con 0x7fb6300aeff0 2021-04-09T18:33:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.129 7fb62ed4f700 1 --2- 172.21.15.79:0/3512326423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6300aeff0 0x7fb6300afb60 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7fb6300d8270 tx=0x7fb61800cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.129 7fb627fff700 1 -- 172.21.15.79:0/3512326423 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb6300d5d90 con 0x7fb6300aeff0 2021-04-09T18:33:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.129 7fb627fff700 1 -- 172.21.15.79:0/3512326423 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb618007320 con 0x7fb6300aeff0 2021-04-09T18:33:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.129 7fb63594e700 1 -- 172.21.15.79:0/3512326423 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6300d60b0 con 0x7fb6300aeff0 2021-04-09T18:33:43.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.129 7fb627fff700 1 -- 172.21.15.79:0/3512326423 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb6180057e0 con 0x7fb6300aeff0 2021-04-09T18:33:43.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.129 7fb63594e700 1 -- 172.21.15.79:0/3512326423 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6300d6590 con 0x7fb6300aeff0 2021-04-09T18:33:43.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.129 7fb627fff700 1 -- 172.21.15.79:0/3512326423 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb61801a060 con 0x7fb6300aeff0 2021-04-09T18:33:43.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.129 7fb627fff700 1 --2- 172.21.15.79:0/3512326423 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb614029100 0x7fb61402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:43.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.129 7fb627fff700 1 -- 172.21.15.79:0/3512326423 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5190+0+0 (secure 0 0 0) 0x7fb618038920 con 0x7fb6300aeff0 2021-04-09T18:33:43.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.129 7fb62f550700 1 --2- 172.21.15.79:0/3512326423 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb614029100 0x7fb61402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:43.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.129 7fb62f550700 1 --2- 172.21.15.79:0/3512326423 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb614029100 0x7fb61402b650 crc :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:43.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.137 7fb63594e700 1 -- 172.21.15.79:0/3512326423 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6300e39d0 con 0x7fb6300aeff0 2021-04-09T18:33:43.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.145 7fb627fff700 1 -- 172.21.15.79:0/3512326423 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb6300e5c90 con 0x7fb6300aeff0 2021-04-09T18:33:43.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.313 7fb63594e700 1 -- 172.21.15.79:0/3512326423 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6300a1cb0 con 0x7fb6300aeff0 2021-04-09T18:33:43.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.313 7fb627fff700 1 -- 172.21.15.79:0/3512326423 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+1177 (secure 0 0 0) 0x7fb618007110 con 0x7fb6300aeff0 2021-04-09T18:33:43.317 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 50 2021-04-09T18:33:43.317 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:43.317 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":50,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6510,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/4230183300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4230183300},{"type":"v1","addr":"172.21.15.79:6833","nonce":4230183300}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":44},{"gid":6775,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1545343583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1545343583},{"type":"v1","addr":"172.21.15.89:6835","nonce":1545343583}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":50}],"filesystems":[]} 2021-04-09T18:33:43.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.313 7fb63594e700 1 -- 172.21.15.79:0/3512326423 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb614029100 msgr2=0x7fb61402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:43.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.313 7fb63594e700 1 --2- 172.21.15.79:0/3512326423 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb614029100 0x7fb61402b650 crc :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:43.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.313 7fb63594e700 1 -- 172.21.15.79:0/3512326423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6300aeff0 msgr2=0x7fb6300afb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:43.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.313 7fb63594e700 1 --2- 172.21.15.79:0/3512326423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6300aeff0 0x7fb6300afb60 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7fb6300d8270 tx=0x7fb61800cae0).stop 2021-04-09T18:33:43.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.317 7fb63594e700 1 -- 172.21.15.79:0/3512326423 shutdown_connections 2021-04-09T18:33:43.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.317 7fb63594e700 1 --2- 172.21.15.79:0/3512326423 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb614029100 0x7fb61402b650 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:43.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.317 7fb63594e700 1 --2- 172.21.15.79:0/3512326423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb630097410 0x7fb6300c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:43.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.317 7fb63594e700 1 --2- 172.21.15.79:0/3512326423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6300af440 0x7fb6300b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:43.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.317 7fb63594e700 1 --2- 172.21.15.79:0/3512326423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6300aeff0 0x7fb6300afb60 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:43.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.317 7fb63594e700 1 -- 172.21.15.79:0/3512326423 >> 172.21.15.79:0/3512326423 conn(0x7fb6300ba840 msgr2=0x7fb6300a2540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:43.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.317 7fb63594e700 1 -- 172.21.15.79:0/3512326423 shutdown_connections 2021-04-09T18:33:43.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.317 7fb63594e700 1 -- 172.21.15.79:0/3512326423 wait complete. 2021-04-09T18:33:43.329 INFO:tasks.ceph.mds.a:Restarting daemon 2021-04-09T18:33:43.329 INFO:tasks.ceph.mds.a:Stopping old one... 2021-04-09T18:33:43.329 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-04-09T18:33:43.330 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:33:43.330 INFO:tasks.ceph.mds.b:Restarting daemon 2021-04-09T18:33:43.330 INFO:tasks.ceph.mds.b:Stopping old one... 2021-04-09T18:33:43.331 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-04-09T18:33:43.331 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:33:43.341 INFO:tasks.ceph.mds.a:Stopped 2021-04-09T18:33:43.341 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-04-09T18:33:43.345 INFO:tasks.ceph.mds.b:Stopped 2021-04-09T18:33:43.345 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-04-09T18:33:43.384 INFO:tasks.ceph.mds.a:Started 2021-04-09T18:33:43.385 DEBUG:teuthology.parallel:result is None 2021-04-09T18:33:43.389 INFO:tasks.ceph.mds.b:Started 2021-04-09T18:33:43.389 DEBUG:teuthology.parallel:result is None 2021-04-09T18:33:43.390 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-04-09T18:33:43.457 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2021-04-09T18:33:43.468 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2021-04-09T18:33:43.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.485 7fcc413a9700 1 Processor -- start 2021-04-09T18:33:43.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.485 7fcc413a9700 1 -- start start 2021-04-09T18:33:43.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.485 7fcc413a9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcc3c1c9020 0x7fcc3c1cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:43.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.485 7fcc413a9700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc3c0fbb20 con 0x7fcc3c0f5520 2021-04-09T18:33:43.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.485 7fcc413a9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc3c09f910 con 0x7fcc3c0e9ae0 2021-04-09T18:33:43.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.485 7fcc413a9700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3c1c3dc0 con 0x7fcc3c1c9020 2021-04-09T18:33:43.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.485 7fcc3b005700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcc3c0f5520 0x7fcc3c0f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55612/0 (socket says 172.21.15.79:55612) 2021-04-09T18:33:43.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.485 7fcc3b005700 1 -- 172.21.15.79:0/2082335288 learned_addr learned my addr 172.21.15.79:0/2082335288 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:43.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.485 7fcc3b806700 1 --2- 172.21.15.79:0/2082335288 >> v2:172.21.15.79:3300/0 conn(0x7fcc3c1c9020 0x7fcc3c1cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:43.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.485 7fcc3b806700 1 -- 172.21.15.79:0/2082335288 >> v1:172.21.15.89:6789/0 conn(0x7fcc3c0e9ae0 legacy=0x7fcc3c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:43.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.485 7fcc3b806700 1 -- 172.21.15.79:0/2082335288 >> v1:172.21.15.79:6789/0 conn(0x7fcc3c0f5520 legacy=0x7fcc3c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:43.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.485 7fcc3b806700 1 -- 172.21.15.79:0/2082335288 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3c0e56d0 con 0x7fcc3c1c9020 2021-04-09T18:33:43.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.485 7fcc3b806700 1 --2- 172.21.15.79:0/2082335288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc3c1c9020 0x7fcc3c1cb480 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7fcc34002f30 tx=0x7fcc3400bcc0).ready entity=mon.0 client_cookie=2b0fa4daf3e267c6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:43.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.489 7fcc3a003700 1 -- 172.21.15.79:0/2082335288 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcc3c0e56d0 con 0x7fcc3c1c9020 2021-04-09T18:33:43.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.489 7fcc3a003700 1 -- 172.21.15.79:0/2082335288 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc34009800 con 0x7fcc3c1c9020 2021-04-09T18:33:43.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.489 7fcc413a9700 1 -- 172.21.15.79:0/2082335288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc3c1c9020 msgr2=0x7fcc3c1cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:43.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.489 7fcc3a003700 1 -- 172.21.15.79:0/2082335288 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcc34009bd0 con 0x7fcc3c1c9020 2021-04-09T18:33:43.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.489 7fcc413a9700 1 --2- 172.21.15.79:0/2082335288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc3c1c9020 0x7fcc3c1cb480 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7fcc34002f30 tx=0x7fcc3400bcc0).stop 2021-04-09T18:33:43.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.489 7fcc413a9700 1 -- 172.21.15.79:0/2082335288 shutdown_connections 2021-04-09T18:33:43.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.489 7fcc413a9700 1 --2- 172.21.15.79:0/2082335288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc3c1c9020 0x7fcc3c1cb480 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:43.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.489 7fcc413a9700 1 -- 172.21.15.79:0/2082335288 >> 172.21.15.79:0/2082335288 conn(0x7fcc3c0e5fe0 msgr2=0x7fcc3c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:43.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.489 7fcc413a9700 1 -- 172.21.15.79:0/2082335288 shutdown_connections 2021-04-09T18:33:43.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.489 7fcc413a9700 1 -- 172.21.15.79:0/2082335288 wait complete. 2021-04-09T18:33:43.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc413a9700 1 Processor -- start 2021-04-09T18:33:43.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc413a9700 1 -- start start 2021-04-09T18:33:43.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc413a9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc3c0bf5e0 0x7fcc3c1aa350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:43.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc413a9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc3c0acab0 0x7fcc3c0bea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:43.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc413a9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc3c0bf050 0x7fcc3c0d59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:43.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc413a9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c0e9f30 con 0x7fcc3c0acab0 2021-04-09T18:33:43.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc413a9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c0be720 con 0x7fcc3c0bf5e0 2021-04-09T18:33:43.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc413a9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c1aa980 con 0x7fcc3c0bf050 2021-04-09T18:33:43.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc3a804700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc3c0acab0 0x7fcc3c0bea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:43.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc3a804700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc3c0acab0 0x7fcc3c0bea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60910/0 (socket says 172.21.15.79:60910) 2021-04-09T18:33:43.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc3a804700 1 -- 172.21.15.79:0/1875284682 learned_addr learned my addr 172.21.15.79:0/1875284682 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:43.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc3b806700 1 --2- 172.21.15.79:0/1875284682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc3c0bf050 0x7fcc3c0d59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:43.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc3b005700 1 --2- 172.21.15.79:0/1875284682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc3c0bf5e0 0x7fcc3c1aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:43.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc3a804700 1 -- 172.21.15.79:0/1875284682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc3c0bf050 msgr2=0x7fcc3c0d59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:43.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc3a804700 1 --2- 172.21.15.79:0/1875284682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc3c0bf050 0x7fcc3c0d59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:43.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc3a804700 1 -- 172.21.15.79:0/1875284682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc3c0bf5e0 msgr2=0x7fcc3c1aa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:43.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc3a804700 1 --2- 172.21.15.79:0/1875284682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc3c0bf5e0 0x7fcc3c1aa350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:43.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc3a804700 1 -- 172.21.15.79:0/1875284682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3c0d6020 con 0x7fcc3c0acab0 2021-04-09T18:33:43.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc3a804700 1 --2- 172.21.15.79:0/1875284682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc3c0acab0 0x7fcc3c0bea20 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fcc24007ba0 tx=0x7fcc2400cd80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:43.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc33fff700 1 -- 172.21.15.79:0/1875284682 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcc3c0d6020 con 0x7fcc3c0acab0 2021-04-09T18:33:43.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc33fff700 1 -- 172.21.15.79:0/1875284682 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc24011a30 con 0x7fcc3c0acab0 2021-04-09T18:33:43.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc413a9700 1 -- 172.21.15.79:0/1875284682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc3c0d6340 con 0x7fcc3c0acab0 2021-04-09T18:33:43.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc33fff700 1 -- 172.21.15.79:0/1875284682 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcc24011e00 con 0x7fcc3c0acab0 2021-04-09T18:33:43.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.493 7fcc413a9700 1 -- 172.21.15.79:0/1875284682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc3c0be1a0 con 0x7fcc3c0acab0 2021-04-09T18:33:43.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.497 7fcc33fff700 1 -- 172.21.15.79:0/1875284682 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fcc2400a4f0 con 0x7fcc3c0acab0 2021-04-09T18:33:43.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.497 7fcc33fff700 1 --2- 172.21.15.79:0/1875284682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcc20029100 0x7fcc2002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:43.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.497 7fcc33fff700 1 -- 172.21.15.79:0/1875284682 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5190+0+0 (secure 0 0 0) 0x7fcc2403d4d0 con 0x7fcc3c0acab0 2021-04-09T18:33:43.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.497 7fcc3b005700 1 --2- 172.21.15.79:0/1875284682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcc20029100 0x7fcc2002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:43.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.497 7fcc3b005700 1 --2- 172.21.15.79:0/1875284682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcc20029100 0x7fcc2002b650 crc :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:43.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.497 7fcc413a9700 1 -- 172.21.15.79:0/1875284682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc3c0e39e0 con 0x7fcc3c0acab0 2021-04-09T18:33:43.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.505 7fcc33fff700 1 -- 172.21.15.79:0/1875284682 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fcc24000f70 con 0x7fcc3c0acab0 2021-04-09T18:33:43.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:43.677 7fcc413a9700 1 -- 172.21.15.79:0/1875284682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fcc3c0a1cc0 con 0x7fcc3c0acab0 2021-04-09T18:33:44.180 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:33:44.182 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:33:44.184 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:33:44.187 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:33:44.189 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:33:44.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.497 7fcc33fff700 1 -- 172.21.15.79:0/1875284682 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v84) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcc24011630 con 0x7fcc3c0acab0 2021-04-09T18:33:44.545 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blacklist entries 2021-04-09T18:33:44.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.545 7fcc413a9700 1 -- 172.21.15.79:0/1875284682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcc20029100 msgr2=0x7fcc2002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:44.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.545 7fcc413a9700 1 --2- 172.21.15.79:0/1875284682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcc20029100 0x7fcc2002b650 crc :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:44.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.545 7fcc413a9700 1 -- 172.21.15.79:0/1875284682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc3c0acab0 msgr2=0x7fcc3c0bea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:44.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.545 7fcc413a9700 1 --2- 172.21.15.79:0/1875284682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc3c0acab0 0x7fcc3c0bea20 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fcc24007ba0 tx=0x7fcc2400cd80).stop 2021-04-09T18:33:44.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.545 7fcc413a9700 1 -- 172.21.15.79:0/1875284682 shutdown_connections 2021-04-09T18:33:44.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.545 7fcc413a9700 1 --2- 172.21.15.79:0/1875284682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcc20029100 0x7fcc2002b650 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:44.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.545 7fcc413a9700 1 --2- 172.21.15.79:0/1875284682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc3c0bf5e0 0x7fcc3c1aa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:44.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.545 7fcc413a9700 1 --2- 172.21.15.79:0/1875284682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc3c0bf050 0x7fcc3c0d59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:44.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.545 7fcc413a9700 1 --2- 172.21.15.79:0/1875284682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc3c0acab0 0x7fcc3c0bea20 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:44.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.545 7fcc413a9700 1 -- 172.21.15.79:0/1875284682 >> 172.21.15.79:0/1875284682 conn(0x7fcc3c0d7c60 msgr2=0x7fcc3c0d8820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:44.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.545 7fcc413a9700 1 -- 172.21.15.79:0/1875284682 shutdown_connections 2021-04-09T18:33:44.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.545 7fcc413a9700 1 -- 172.21.15.79:0/1875284682 wait complete. 2021-04-09T18:33:44.568 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-04-09T18:33:44.569 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-04-09T18:33:44.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.669 7fed08e50700 1 Processor -- start 2021-04-09T18:33:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.669 7fed08e50700 1 -- start start 2021-04-09T18:33:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.669 7fed08e50700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fed040f5510 0x7fed040f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.669 7fed08e50700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fed041c8000 0x7fed041ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.669 7fed08e50700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed040fbb10 con 0x7fed040e9ad0 2021-04-09T18:33:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed08e50700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed040e9f20 con 0x7fed041c8000 2021-04-09T18:33:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed08e50700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed041c3db0 con 0x7fed040f5510 2021-04-09T18:33:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed032f0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fed041c8000 0x7fed041ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed022ee700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fed040e9ad0 0x7fed0409f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55630/0 (socket says 172.21.15.79:55630) 2021-04-09T18:33:44.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed022ee700 1 -- 172.21.15.79:0/931322265 learned_addr learned my addr 172.21.15.79:0/931322265 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:44.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed02aef700 1 --2- 172.21.15.79:0/931322265 >> v2:172.21.15.89:3300/0 conn(0x7fed040f5510 0x7fed040f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:44.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed032f0700 1 -- 172.21.15.79:0/931322265 >> v2:172.21.15.89:3300/0 conn(0x7fed040f5510 msgr2=0x7fed040f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:44.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed032f0700 1 --2- 172.21.15.79:0/931322265 >> v2:172.21.15.89:3300/0 conn(0x7fed040f5510 0x7fed040f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:44.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed032f0700 1 -- 172.21.15.79:0/931322265 >> v1:172.21.15.79:6789/0 conn(0x7fed040e9ad0 legacy=0x7fed0409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:44.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed01aed700 1 -- 172.21.15.79:0/931322265 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466090190 0 0) 0x7fecf80010d0 con 0x7fed040e9ad0 2021-04-09T18:33:44.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed032f0700 1 -- 172.21.15.79:0/931322265 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0409f900 con 0x7fed041c8000 2021-04-09T18:33:44.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed032f0700 1 --2- 172.21.15.79:0/931322265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed041c8000 0x7fed041ca460 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7fecfc0032b0 tx=0x7fecfc00b3c0).ready entity=mon.0 client_cookie=1e5c00cadb007c79 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:44.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed01aed700 1 -- 172.21.15.79:0/931322265 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fed0409f900 con 0x7fed041c8000 2021-04-09T18:33:44.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed01aed700 1 -- 172.21.15.79:0/931322265 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc00bc20 con 0x7fed041c8000 2021-04-09T18:33:44.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed01aed700 1 -- 172.21.15.79:0/931322265 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fecfc002020 con 0x7fed041c8000 2021-04-09T18:33:44.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed08e50700 1 -- 172.21.15.79:0/931322265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed041c8000 msgr2=0x7fed041ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:44.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed08e50700 1 --2- 172.21.15.79:0/931322265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed041c8000 0x7fed041ca460 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7fecfc0032b0 tx=0x7fecfc00b3c0).stop 2021-04-09T18:33:44.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed08e50700 1 -- 172.21.15.79:0/931322265 shutdown_connections 2021-04-09T18:33:44.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed08e50700 1 --2- 172.21.15.79:0/931322265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed041c8000 0x7fed041ca460 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:44.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed08e50700 1 --2- 172.21.15.79:0/931322265 >> v2:172.21.15.89:3300/0 conn(0x7fed040f5510 0x7fed040f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:44.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed08e50700 1 -- 172.21.15.79:0/931322265 >> 172.21.15.79:0/931322265 conn(0x7fed040e5fd0 msgr2=0x7fed040e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:44.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed08e50700 1 -- 172.21.15.79:0/931322265 shutdown_connections 2021-04-09T18:33:44.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.673 7fed08e50700 1 -- 172.21.15.79:0/931322265 wait complete. 2021-04-09T18:33:44.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.677 7fed08e50700 1 Processor -- start 2021-04-09T18:33:44.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.677 7fed08e50700 1 -- start start 2021-04-09T18:33:44.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fed08e50700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed040bab50 0x7fed0409ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:44.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fed08e50700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed0409a070 0x7fed04094e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:44.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fed08e50700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed0409a4c0 0x7fed041a64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:44.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fed08e50700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed04094b00 con 0x7fed040bab50 2021-04-09T18:33:44.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fed08e50700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed040bafa0 con 0x7fed0409a4c0 2021-04-09T18:33:44.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fed08e50700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed04094690 con 0x7fed0409a070 2021-04-09T18:33:44.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fed02aef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed040bab50 0x7fed0409ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:44.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fed02aef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed040bab50 0x7fed0409ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60926/0 (socket says 172.21.15.79:60926) 2021-04-09T18:33:44.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fed022ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed0409a070 0x7fed04094e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:44.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fed02aef700 1 -- 172.21.15.79:0/2172051231 learned_addr learned my addr 172.21.15.79:0/2172051231 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:44.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fed032f0700 1 --2- 172.21.15.79:0/2172051231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed0409a4c0 0x7fed041a64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:44.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fed02aef700 1 -- 172.21.15.79:0/2172051231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed0409a070 msgr2=0x7fed04094e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:44.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fed02aef700 1 --2- 172.21.15.79:0/2172051231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed0409a070 0x7fed04094e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:44.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fed02aef700 1 -- 172.21.15.79:0/2172051231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed0409a4c0 msgr2=0x7fed041a64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:44.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fed02aef700 1 --2- 172.21.15.79:0/2172051231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed0409a4c0 0x7fed041a64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:44.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fed02aef700 1 -- 172.21.15.79:0/2172051231 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed04095430 con 0x7fed040bab50 2021-04-09T18:33:44.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fed02aef700 1 --2- 172.21.15.79:0/2172051231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed040bab50 0x7fed0409ac60 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7fed04099e20 tx=0x7fecf400c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:44.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fecf37fe700 1 -- 172.21.15.79:0/2172051231 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fed04095430 con 0x7fed040bab50 2021-04-09T18:33:44.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fed08e50700 1 -- 172.21.15.79:0/2172051231 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed041a6af0 con 0x7fed040bab50 2021-04-09T18:33:44.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fed08e50700 1 -- 172.21.15.79:0/2172051231 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed041aa5d0 con 0x7fed040bab50 2021-04-09T18:33:44.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fecf37fe700 1 -- 172.21.15.79:0/2172051231 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf400cd60 con 0x7fed040bab50 2021-04-09T18:33:44.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fecf37fe700 1 -- 172.21.15.79:0/2172051231 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fecf400f040 con 0x7fed040bab50 2021-04-09T18:33:44.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fecf37fe700 1 -- 172.21.15.79:0/2172051231 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fecf4011070 con 0x7fed040bab50 2021-04-09T18:33:44.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fecf37fe700 1 --2- 172.21.15.79:0/2172051231 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fece8029100 0x7fece802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:44.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.681 7fecf37fe700 1 -- 172.21.15.79:0/2172051231 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fecf4010040 con 0x7fed040bab50 2021-04-09T18:33:44.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.685 7fed022ee700 1 --2- 172.21.15.79:0/2172051231 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fece8029100 0x7fece802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:44.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.685 7fed022ee700 1 --2- 172.21.15.79:0/2172051231 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fece8029100 0x7fece802b650 crc :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:44.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.685 7fed08e50700 1 -- 172.21.15.79:0/2172051231 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecdc003350 con 0x7fed040bab50 2021-04-09T18:33:44.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.689 7fecf37fe700 1 -- 172.21.15.79:0/2172051231 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fecf4000bf0 con 0x7fed040bab50 2021-04-09T18:33:44.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.857 7fed08e50700 1 -- 172.21.15.79:0/2172051231 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fecdc0039a0 con 0x7fed040bab50 2021-04-09T18:33:44.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.857 7fecf37fe700 1 -- 172.21.15.79:0/2172051231 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fecf400c960 con 0x7fed040bab50 2021-04-09T18:33:44.865 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:44.865 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:33:44.866 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2021-04-09T18:33:44.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:44.866 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2021-04-09T18:33:44.866 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgovEoMhAAbDfArG3lSFAdk80rS/4iEQ==", 2021-04-09T18:33:44.866 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:44.867 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:33:44.867 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:44.867 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:44.867 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:44.868 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:44.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:44.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:44.868 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2021-04-09T18:33:44.869 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgN4sfOBAAPjvDX11uLM+vgdFpdP49Kw==", 2021-04-09T18:33:44.869 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:44.869 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:33:44.869 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:44.869 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:44.870 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:44.870 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:44.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:44.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:44.871 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2021-04-09T18:33:44.871 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQALnHBgro0COxAAgbe5jxAZH9bD7zDLbtdkhQ==", 2021-04-09T18:33:44.871 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:44.871 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:44.871 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:44.872 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:44.872 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:44.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:44.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:44.873 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2021-04-09T18:33:44.873 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAPnHBghZ/oARAAhkN+fnZJiskmHnvvs+G8NA==", 2021-04-09T18:33:44.873 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:44.873 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:44.873 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:44.874 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:44.874 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:44.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:44.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:44.875 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2021-04-09T18:33:44.875 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQASnHBgWT2FBxAACrSTbwbF18k9aPeYNohelw==", 2021-04-09T18:33:44.875 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:44.876 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:44.876 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:44.876 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:44.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:44.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:44.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:44.877 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2021-04-09T18:33:44.877 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAVnHBgPHy6CxAAFq+yki4AZe5ybodgTO/4/Q==", 2021-04-09T18:33:44.877 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:44.878 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:44.878 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:44.878 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:44.878 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:44.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:44.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:44.879 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2021-04-09T18:33:44.879 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAanHBgfbs4NhAAQzxM9dDML4RgQP8yamkuVw==", 2021-04-09T18:33:44.879 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:44.880 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:44.880 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:44.880 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:44.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:44.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:44.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:44.881 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2021-04-09T18:33:44.881 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAdnHBgi0WLOhAA4OBguOCjtmzqulUjTJ+GhQ==", 2021-04-09T18:33:44.881 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:44.882 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:44.882 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:44.882 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:44.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:44.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:44.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:44.883 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2021-04-09T18:33:44.883 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAhnHBgCs+PAxAAOm0wSMe/1Bu9vfTrpmrLkg==", 2021-04-09T18:33:44.883 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:44.884 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:44.884 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:44.884 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:44.884 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:44.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:44.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:44.885 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2021-04-09T18:33:44.885 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAknHBgH1S3CBAAUcdUIW7O6wH482l1yZBKBw==", 2021-04-09T18:33:44.885 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:44.886 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:44.886 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:44.886 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:44.886 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:44.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:44.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:44.887 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2021-04-09T18:33:44.887 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgxEq9BxAAap2nrjhcrf2aHzygtMclVw==", 2021-04-09T18:33:44.887 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:44.888 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:33:44.888 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:33:44.888 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:33:44.888 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:44.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:44.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:44.889 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2021-04-09T18:33:44.889 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBguJFeDRAAWL4NV4tsYRAqcwJ26kjm2Q==", 2021-04-09T18:33:44.889 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:44.890 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:33:44.890 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:33:44.890 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:33:44.890 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:44.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:44.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:44.891 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2021-04-09T18:33:44.891 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgN9X5EhAA3DBPdlRHVBHXJNH9nRFW0A==", 2021-04-09T18:33:44.891 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:44.892 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:33:44.892 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:33:44.892 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:33:44.892 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:44.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:44.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:44.893 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2021-04-09T18:33:44.893 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgHOSVDBAAMMqd8paqBSTQRgR7n4EXGQ==", 2021-04-09T18:33:44.893 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:44.894 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:33:44.894 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:33:44.894 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:33:44.894 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:44.894 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:44.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:44.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:44.895 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2021-04-09T18:33:44.895 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgmHJhLxAAyhBrx08J7ZFKu34MYC2Wyg==", 2021-04-09T18:33:44.896 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:44.896 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:33:44.896 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:33:44.896 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:44.897 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:44.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:44.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:44.897 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2021-04-09T18:33:44.898 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgNCCXKhAA/bKOzzjVHldj6RpMGu0c8g==", 2021-04-09T18:33:44.898 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:33:44.898 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:33:44.898 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:33:44.898 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:33:44.899 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:44.899 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:44.899 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:44.899 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:33:44.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.865 7fed08e50700 1 -- 172.21.15.79:0/2172051231 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fece8029100 msgr2=0x7fece802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:44.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.865 7fed08e50700 1 --2- 172.21.15.79:0/2172051231 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fece8029100 0x7fece802b650 crc :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:44.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.865 7fed08e50700 1 -- 172.21.15.79:0/2172051231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed040bab50 msgr2=0x7fed0409ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:44.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.865 7fed08e50700 1 --2- 172.21.15.79:0/2172051231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed040bab50 0x7fed0409ac60 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7fed04099e20 tx=0x7fecf400c430).stop 2021-04-09T18:33:44.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.865 7fed08e50700 1 -- 172.21.15.79:0/2172051231 shutdown_connections 2021-04-09T18:33:44.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.865 7fed08e50700 1 --2- 172.21.15.79:0/2172051231 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fece8029100 0x7fece802b650 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:44.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.865 7fed08e50700 1 --2- 172.21.15.79:0/2172051231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed0409a4c0 0x7fed041a64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:44.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.865 7fed08e50700 1 --2- 172.21.15.79:0/2172051231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed040bab50 0x7fed0409ac60 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:44.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.865 7fed08e50700 1 --2- 172.21.15.79:0/2172051231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed0409a070 0x7fed04094e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:44.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.865 7fed08e50700 1 -- 172.21.15.79:0/2172051231 >> 172.21.15.79:0/2172051231 conn(0x7fed040d3bf0 msgr2=0x7fed040d8810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:44.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.865 7fed08e50700 1 -- 172.21.15.79:0/2172051231 shutdown_connections 2021-04-09T18:33:44.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.865 7fed08e50700 1 -- 172.21.15.79:0/2172051231 wait complete. 2021-04-09T18:33:44.904 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:33:45.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.993 7fa695b3d700 1 Processor -- start 2021-04-09T18:33:45.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.993 7fa695b3d700 1 -- start start 2021-04-09T18:33:45.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa695b3d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6900f5520 0x7fa6900f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa695b3d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa6900e9ae0 0x7fa69009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa695b3d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6900fbb20 con 0x7fa6901c2db0 2021-04-09T18:33:45.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa695b3d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6900e9f30 con 0x7fa6900f5520 2021-04-09T18:33:45.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa695b3d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6900e59d0 con 0x7fa6900e9ae0 2021-04-09T18:33:45.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa68ffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa6901c2db0 0x7fa6901c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55644/0 (socket says 172.21.15.79:55644) 2021-04-09T18:33:45.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa68ffff700 1 -- 172.21.15.79:0/1631275261 learned_addr learned my addr 172.21.15.79:0/1631275261 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:45.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa68f7fe700 1 --2- 172.21.15.79:0/1631275261 >> v2:172.21.15.79:3300/0 conn(0x7fa6900f5520 0x7fa6900f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa68effd700 1 --2- 172.21.15.79:0/1631275261 >> v2:172.21.15.89:3300/0 conn(0x7fa6900e9ae0 0x7fa69009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa68e7fc700 1 -- 172.21.15.79:0/1631275261 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184985054 0 0) 0x7fa688001450 con 0x7fa6901c2db0 2021-04-09T18:33:45.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa68e7fc700 1 -- 172.21.15.79:0/1631275261 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa678003240 con 0x7fa6901c2db0 2021-04-09T18:33:45.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa68f7fe700 1 -- 172.21.15.79:0/1631275261 >> v2:172.21.15.89:3300/0 conn(0x7fa6900e9ae0 msgr2=0x7fa69009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:45.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa68f7fe700 1 --2- 172.21.15.79:0/1631275261 >> v2:172.21.15.89:3300/0 conn(0x7fa6900e9ae0 0x7fa69009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa68f7fe700 1 -- 172.21.15.79:0/1631275261 >> v1:172.21.15.79:6789/0 conn(0x7fa6901c2db0 legacy=0x7fa6901c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa68e7fc700 1 -- 172.21.15.79:0/1631275261 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3411633836 0 0) 0x7fa6880019d0 con 0x7fa6901c2db0 2021-04-09T18:33:45.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa68f7fe700 1 -- 172.21.15.79:0/1631275261 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6900e56d0 con 0x7fa6900f5520 2021-04-09T18:33:45.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa68effd700 1 --2- 172.21.15.79:0/1631275261 >> v2:172.21.15.89:3300/0 conn(0x7fa6900e9ae0 0x7fa69009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:45.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa68f7fe700 1 --2- 172.21.15.79:0/1631275261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6900f5520 0x7fa6900f64b0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7fa688002170 tx=0x7fa68000bd10).ready entity=mon.0 client_cookie=27ede79448465909 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:45.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa68e7fc700 1 -- 172.21.15.79:0/1631275261 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa6900e56d0 con 0x7fa6900f5520 2021-04-09T18:33:45.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa68e7fc700 1 -- 172.21.15.79:0/1631275261 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa680009710 con 0x7fa6900f5520 2021-04-09T18:33:45.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa68e7fc700 1 -- 172.21.15.79:0/1631275261 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa688001f30 con 0x7fa6900f5520 2021-04-09T18:33:45.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa695b3d700 1 -- 172.21.15.79:0/1631275261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6900f5520 msgr2=0x7fa6900f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa695b3d700 1 --2- 172.21.15.79:0/1631275261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6900f5520 0x7fa6900f64b0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7fa688002170 tx=0x7fa68000bd10).stop 2021-04-09T18:33:45.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa695b3d700 1 -- 172.21.15.79:0/1631275261 shutdown_connections 2021-04-09T18:33:45.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa695b3d700 1 --2- 172.21.15.79:0/1631275261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6900f5520 0x7fa6900f64b0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa695b3d700 1 --2- 172.21.15.79:0/1631275261 >> v2:172.21.15.89:3300/0 conn(0x7fa6900e9ae0 0x7fa69009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa695b3d700 1 -- 172.21.15.79:0/1631275261 >> 172.21.15.79:0/1631275261 conn(0x7fa6900e5fe0 msgr2=0x7fa6900e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:45.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa695b3d700 1 -- 172.21.15.79:0/1631275261 shutdown_connections 2021-04-09T18:33:45.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:44.997 7fa695b3d700 1 -- 172.21.15.79:0/1631275261 wait complete. 2021-04-09T18:33:45.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.001 7fa695b3d700 1 Processor -- start 2021-04-09T18:33:45.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.001 7fa695b3d700 1 -- start start 2021-04-09T18:33:45.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.001 7fa695b3d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa690090a60 0x7fa6900a75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.001 7fa695b3d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6900ab010 0x7fa6900acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.001 7fa695b3d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6900ad310 0x7fa6901a64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.001 7fa695b3d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6900aad10 con 0x7fa6900ab010 2021-04-09T18:33:45.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.001 7fa695b3d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6900aa4e0 con 0x7fa6900ad310 2021-04-09T18:33:45.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.001 7fa695b3d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6900aa8a0 con 0x7fa690090a60 2021-04-09T18:33:45.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.001 7fa68effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6900ab010 0x7fa6900acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.001 7fa68effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6900ab010 0x7fa6900acce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60942/0 (socket says 172.21.15.79:60942) 2021-04-09T18:33:45.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.001 7fa68effd700 1 -- 172.21.15.79:0/4101427382 learned_addr learned my addr 172.21.15.79:0/4101427382 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:45.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.001 7fa68f7fe700 1 --2- 172.21.15.79:0/4101427382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa690090a60 0x7fa6900a75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.001 7fa68ffff700 1 --2- 172.21.15.79:0/4101427382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6900ad310 0x7fa6901a64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.001 7fa68effd700 1 -- 172.21.15.79:0/4101427382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa690090a60 msgr2=0x7fa6900a75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.001 7fa68effd700 1 --2- 172.21.15.79:0/4101427382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa690090a60 0x7fa6900a75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.001 7fa68effd700 1 -- 172.21.15.79:0/4101427382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6900ad310 msgr2=0x7fa6901a64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.001 7fa68effd700 1 --2- 172.21.15.79:0/4101427382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6900ad310 0x7fa6901a64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.001 7fa68effd700 1 -- 172.21.15.79:0/4101427382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa690090eb0 con 0x7fa6900ab010 2021-04-09T18:33:45.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.001 7fa68effd700 1 --2- 172.21.15.79:0/4101427382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6900ab010 0x7fa6900acce0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7fa68400a000 tx=0x7fa68400df30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:45.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.001 7fa677fff700 1 -- 172.21.15.79:0/4101427382 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa690090eb0 con 0x7fa6900ab010 2021-04-09T18:33:45.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.005 7fa677fff700 1 -- 172.21.15.79:0/4101427382 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6840099b0 con 0x7fa6900ab010 2021-04-09T18:33:45.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.005 7fa695b3d700 1 -- 172.21.15.79:0/4101427382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6900ab460 con 0x7fa6900ab010 2021-04-09T18:33:45.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.005 7fa677fff700 1 -- 172.21.15.79:0/4101427382 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa68400f040 con 0x7fa6900ab010 2021-04-09T18:33:45.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.005 7fa695b3d700 1 -- 172.21.15.79:0/4101427382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6901a6c90 con 0x7fa6900ab010 2021-04-09T18:33:45.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.005 7fa677fff700 1 -- 172.21.15.79:0/4101427382 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa684013480 con 0x7fa6900ab010 2021-04-09T18:33:45.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.005 7fa677fff700 1 --2- 172.21.15.79:0/4101427382 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa670029100 0x7fa67002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.005 7fa677fff700 1 -- 172.21.15.79:0/4101427382 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fa684010070 con 0x7fa6900ab010 2021-04-09T18:33:45.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.005 7fa68f7fe700 1 --2- 172.21.15.79:0/4101427382 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa670029100 0x7fa67002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.005 7fa68f7fe700 1 --2- 172.21.15.79:0/4101427382 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa670029100 0x7fa67002b650 crc :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:45.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.009 7fa695b3d700 1 -- 172.21.15.79:0/4101427382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6900e39e0 con 0x7fa6900ab010 2021-04-09T18:33:45.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.013 7fa677fff700 1 -- 172.21.15.79:0/4101427382 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa684000bf0 con 0x7fa6900ab010 2021-04-09T18:33:45.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.177 7fa695b3d700 1 -- 172.21.15.79:0/4101427382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6900f5b20 con 0x7fa6900ab010 2021-04-09T18:33:45.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.177 7fa677fff700 1 -- 172.21.15.79:0/4101427382 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+11378 (secure 0 0 0) 0x7fa6840095b0 con 0x7fa6900ab010 2021-04-09T18:33:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:45.184 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":84,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:33:44.494449","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:33:45.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.181 7fa695b3d700 1 -- 172.21.15.79:0/4101427382 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa670029100 msgr2=0x7fa67002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.181 7fa695b3d700 1 --2- 172.21.15.79:0/4101427382 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa670029100 0x7fa67002b650 crc :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.181 7fa695b3d700 1 -- 172.21.15.79:0/4101427382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6900ab010 msgr2=0x7fa6900acce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.181 7fa695b3d700 1 --2- 172.21.15.79:0/4101427382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6900ab010 0x7fa6900acce0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7fa68400a000 tx=0x7fa68400df30).stop 2021-04-09T18:33:45.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.181 7fa695b3d700 1 -- 172.21.15.79:0/4101427382 shutdown_connections 2021-04-09T18:33:45.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.181 7fa695b3d700 1 --2- 172.21.15.79:0/4101427382 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa670029100 0x7fa67002b650 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.181 7fa695b3d700 1 --2- 172.21.15.79:0/4101427382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6900ad310 0x7fa6901a64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.181 7fa695b3d700 1 --2- 172.21.15.79:0/4101427382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa690090a60 0x7fa6900a75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.181 7fa695b3d700 1 --2- 172.21.15.79:0/4101427382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6900ab010 0x7fa6900acce0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.181 7fa695b3d700 1 -- 172.21.15.79:0/4101427382 >> 172.21.15.79:0/4101427382 conn(0x7fa6900d8ae0 msgr2=0x7fa6900ba530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.181 7fa695b3d700 1 -- 172.21.15.79:0/4101427382 shutdown_connections 2021-04-09T18:33:45.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.181 7fa695b3d700 1 -- 172.21.15.79:0/4101427382 wait complete. 2021-04-09T18:33:45.198 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-04-09T18:33:45.199 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:33:45.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.293 7fa34a78b700 1 Processor -- start 2021-04-09T18:33:45.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.293 7fa34a78b700 1 -- start start 2021-04-09T18:33:45.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa34a78b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa3440f5550 0x7fa3440f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa34a78b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3440e9b10 0x7fa34409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa34a78b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3440fbb50 con 0x7fa3441c2de0 2021-04-09T18:33:45.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa34a78b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3440e9f60 con 0x7fa3440f5550 2021-04-09T18:33:45.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa34a78b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3440e5a00 con 0x7fa3440e9b10 2021-04-09T18:33:45.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa343fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa3440f5550 0x7fa3440f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa348d30700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa3441c2de0 0x7fa3441c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55660/0 (socket says 172.21.15.79:55660) 2021-04-09T18:33:45.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa343fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa3440f5550 0x7fa3440f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60946/0 (socket says 172.21.15.79:60946) 2021-04-09T18:33:45.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa348d30700 1 -- 172.21.15.79:0/1811158337 learned_addr learned my addr 172.21.15.79:0/1811158337 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:45.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa3437fe700 1 --2- 172.21.15.79:0/1811158337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3440e9b10 0x7fa34409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa342ffd700 1 -- 172.21.15.79:0/1811158337 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196078216 0 0) 0x7fa33c0010d0 con 0x7fa3441c2de0 2021-04-09T18:33:45.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa343fff700 1 -- 172.21.15.79:0/1811158337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3440e9b10 msgr2=0x7fa34409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:45.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa343fff700 1 --2- 172.21.15.79:0/1811158337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3440e9b10 0x7fa34409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa343fff700 1 -- 172.21.15.79:0/1811158337 >> v1:172.21.15.79:6789/0 conn(0x7fa3441c2de0 legacy=0x7fa3441c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa343fff700 1 -- 172.21.15.79:0/1811158337 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3440e5700 con 0x7fa3440f5550 2021-04-09T18:33:45.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa343fff700 1 --2- 172.21.15.79:0/1811158337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3440f5550 0x7fa3440f64e0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7fa32c002f30 tx=0x7fa32c00bd40).ready entity=mon.0 client_cookie=6fe8be1bf2910321 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:45.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa342ffd700 1 -- 172.21.15.79:0/1811158337 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa3440e5700 con 0x7fa3440f5550 2021-04-09T18:33:45.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa342ffd700 1 -- 172.21.15.79:0/1811158337 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c009850 con 0x7fa3440f5550 2021-04-09T18:33:45.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa342ffd700 1 -- 172.21.15.79:0/1811158337 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa32c009c20 con 0x7fa3440f5550 2021-04-09T18:33:45.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa34a78b700 1 -- 172.21.15.79:0/1811158337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3440f5550 msgr2=0x7fa3440f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa34a78b700 1 --2- 172.21.15.79:0/1811158337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3440f5550 0x7fa3440f64e0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7fa32c002f30 tx=0x7fa32c00bd40).stop 2021-04-09T18:33:45.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa34a78b700 1 -- 172.21.15.79:0/1811158337 shutdown_connections 2021-04-09T18:33:45.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa34a78b700 1 --2- 172.21.15.79:0/1811158337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3440f5550 0x7fa3440f64e0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa34a78b700 1 --2- 172.21.15.79:0/1811158337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3440e9b10 0x7fa34409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa34a78b700 1 -- 172.21.15.79:0/1811158337 >> 172.21.15.79:0/1811158337 conn(0x7fa3440e6010 msgr2=0x7fa3440e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:45.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa34a78b700 1 -- 172.21.15.79:0/1811158337 shutdown_connections 2021-04-09T18:33:45.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.297 7fa34a78b700 1 -- 172.21.15.79:0/1811158337 wait complete. 2021-04-09T18:33:45.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa34a78b700 1 Processor -- start 2021-04-09T18:33:45.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa34a78b700 1 -- start start 2021-04-09T18:33:45.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa34a78b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3440b88c0 0x7fa3440b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa34a78b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3440b7e00 0x7fa3440c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa34a78b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3440b8250 0x7fa3440d4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa34a78b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3440b90f0 con 0x7fa3440b88c0 2021-04-09T18:33:45.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa34a78b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3440b93f0 con 0x7fa3440b8250 2021-04-09T18:33:45.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa34a78b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3440ba990 con 0x7fa3440b7e00 2021-04-09T18:33:45.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa343fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3440b88c0 0x7fa3440b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa343fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3440b88c0 0x7fa3440b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60952/0 (socket says 172.21.15.79:60952) 2021-04-09T18:33:45.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa343fff700 1 -- 172.21.15.79:0/566710051 learned_addr learned my addr 172.21.15.79:0/566710051 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:45.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa348d30700 1 --2- 172.21.15.79:0/566710051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3440b8250 0x7fa3440d4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa3437fe700 1 --2- 172.21.15.79:0/566710051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3440b7e00 0x7fa3440c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa343fff700 1 -- 172.21.15.79:0/566710051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3440b7e00 msgr2=0x7fa3440c33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa343fff700 1 --2- 172.21.15.79:0/566710051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3440b7e00 0x7fa3440c33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa343fff700 1 -- 172.21.15.79:0/566710051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3440b8250 msgr2=0x7fa3440d4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa343fff700 1 --2- 172.21.15.79:0/566710051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3440b8250 0x7fa3440d4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa343fff700 1 -- 172.21.15.79:0/566710051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3440bac60 con 0x7fa3440b88c0 2021-04-09T18:33:45.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa343fff700 1 --2- 172.21.15.79:0/566710051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3440b88c0 0x7fa3440b18e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7fa3440b9070 tx=0x7fa32c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:45.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa340ff9700 1 -- 172.21.15.79:0/566710051 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa3440bac60 con 0x7fa3440b88c0 2021-04-09T18:33:45.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa340ff9700 1 -- 172.21.15.79:0/566710051 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c011c10 con 0x7fa3440b88c0 2021-04-09T18:33:45.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa340ff9700 1 -- 172.21.15.79:0/566710051 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa32c01d440 con 0x7fa3440b88c0 2021-04-09T18:33:45.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa34a78b700 1 -- 172.21.15.79:0/566710051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3440b8d10 con 0x7fa3440b88c0 2021-04-09T18:33:45.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.301 7fa34a78b700 1 -- 172.21.15.79:0/566710051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3440c3a00 con 0x7fa3440b88c0 2021-04-09T18:33:45.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.305 7fa340ff9700 1 -- 172.21.15.79:0/566710051 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa32c01d640 con 0x7fa3440b88c0 2021-04-09T18:33:45.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.305 7fa340ff9700 1 --2- 172.21.15.79:0/566710051 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa328029100 0x7fa32802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.305 7fa340ff9700 1 -- 172.21.15.79:0/566710051 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fa32c03b100 con 0x7fa3440b88c0 2021-04-09T18:33:45.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.305 7fa3437fe700 1 --2- 172.21.15.79:0/566710051 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa328029100 0x7fa32802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.305 7fa3437fe700 1 --2- 172.21.15.79:0/566710051 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa328029100 0x7fa32802b650 crc :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:45.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.309 7fa34a78b700 1 -- 172.21.15.79:0/566710051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3440b20a0 con 0x7fa3440b88c0 2021-04-09T18:33:45.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.317 7fa340ff9700 1 -- 172.21.15.79:0/566710051 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa32c009640 con 0x7fa3440b88c0 2021-04-09T18:33:45.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.481 7fa34a78b700 1 -- 172.21.15.79:0/566710051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fa3440e39f0 con 0x7fa3440b88c0 2021-04-09T18:33:45.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.481 7fa340ff9700 1 -- 172.21.15.79:0/566710051 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v84) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa32c011a00 con 0x7fa3440b88c0 2021-04-09T18:33:45.487 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:33:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.485 7fa34a78b700 1 -- 172.21.15.79:0/566710051 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa328029100 msgr2=0x7fa32802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.485 7fa34a78b700 1 --2- 172.21.15.79:0/566710051 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa328029100 0x7fa32802b650 crc :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.485 7fa34a78b700 1 -- 172.21.15.79:0/566710051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3440b88c0 msgr2=0x7fa3440b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.485 7fa34a78b700 1 --2- 172.21.15.79:0/566710051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3440b88c0 0x7fa3440b18e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7fa3440b9070 tx=0x7fa32c006890).stop 2021-04-09T18:33:45.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.485 7fa34a78b700 1 -- 172.21.15.79:0/566710051 shutdown_connections 2021-04-09T18:33:45.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.485 7fa34a78b700 1 --2- 172.21.15.79:0/566710051 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa328029100 0x7fa32802b650 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.485 7fa34a78b700 1 --2- 172.21.15.79:0/566710051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3440b8250 0x7fa3440d4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.485 7fa34a78b700 1 --2- 172.21.15.79:0/566710051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3440b88c0 0x7fa3440b18e0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.485 7fa34a78b700 1 --2- 172.21.15.79:0/566710051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3440b7e00 0x7fa3440c33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.485 7fa34a78b700 1 -- 172.21.15.79:0/566710051 >> 172.21.15.79:0/566710051 conn(0x7fa3440b2430 msgr2=0x7fa3440b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.485 7fa34a78b700 1 -- 172.21.15.79:0/566710051 shutdown_connections 2021-04-09T18:33:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.485 7fa34a78b700 1 -- 172.21.15.79:0/566710051 wait complete. 2021-04-09T18:33:45.500 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-04-09T18:33:45.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.589 7f094ab3d700 1 Processor -- start 2021-04-09T18:33:45.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.589 7f094ab3d700 1 -- start start 2021-04-09T18:33:45.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f094ab3d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f09440f5510 0x7f09440f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f094ab3d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f09441c8000 0x7f09441ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f094ab3d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09440fbb10 con 0x7f09440e9ad0 2021-04-09T18:33:45.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f094ab3d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09440e9f20 con 0x7f09441c8000 2021-04-09T18:33:45.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f094ab3d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09441c3db0 con 0x7f09440f5510 2021-04-09T18:33:45.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f09490e2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f09441c8000 0x7f09441ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f09490e2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f09441c8000 0x7f09441ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60964/0 (socket says 172.21.15.79:60964) 2021-04-09T18:33:45.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f09490e2700 1 -- 172.21.15.79:0/4173096784 learned_addr learned my addr 172.21.15.79:0/4173096784 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:45.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f09488e1700 1 --2- 172.21.15.79:0/4173096784 >> v2:172.21.15.89:3300/0 conn(0x7f09440f5510 0x7f09440f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f09490e2700 1 -- 172.21.15.79:0/4173096784 >> v2:172.21.15.89:3300/0 conn(0x7f09440f5510 msgr2=0x7f09440f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:45.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f09490e2700 1 --2- 172.21.15.79:0/4173096784 >> v2:172.21.15.89:3300/0 conn(0x7f09440f5510 0x7f09440f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f09490e2700 1 -- 172.21.15.79:0/4173096784 >> v1:172.21.15.79:6789/0 conn(0x7f09440e9ad0 legacy=0x7f094409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f093b7fe700 1 -- 172.21.15.79:0/4173096784 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318910864 0 0) 0x7f09340010d0 con 0x7f09440e9ad0 2021-04-09T18:33:45.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f09490e2700 1 -- 172.21.15.79:0/4173096784 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094409f900 con 0x7f09441c8000 2021-04-09T18:33:45.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f09490e2700 1 --2- 172.21.15.79:0/4173096784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09441c8000 0x7f09441ca460 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f093c0032b0 tx=0x7f093c00b3c0).ready entity=mon.0 client_cookie=b61c69b22e4fad17 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:45.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f093b7fe700 1 -- 172.21.15.79:0/4173096784 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f094409f900 con 0x7f09441c8000 2021-04-09T18:33:45.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f093b7fe700 1 -- 172.21.15.79:0/4173096784 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c00bc20 con 0x7f09441c8000 2021-04-09T18:33:45.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f093b7fe700 1 -- 172.21.15.79:0/4173096784 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f093c002020 con 0x7f09441c8000 2021-04-09T18:33:45.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f094ab3d700 1 -- 172.21.15.79:0/4173096784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09441c8000 msgr2=0x7f09441ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f094ab3d700 1 --2- 172.21.15.79:0/4173096784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09441c8000 0x7f09441ca460 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f093c0032b0 tx=0x7f093c00b3c0).stop 2021-04-09T18:33:45.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f094ab3d700 1 -- 172.21.15.79:0/4173096784 shutdown_connections 2021-04-09T18:33:45.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f094ab3d700 1 --2- 172.21.15.79:0/4173096784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09441c8000 0x7f09441ca460 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f094ab3d700 1 --2- 172.21.15.79:0/4173096784 >> v2:172.21.15.89:3300/0 conn(0x7f09440f5510 0x7f09440f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f094ab3d700 1 -- 172.21.15.79:0/4173096784 >> 172.21.15.79:0/4173096784 conn(0x7f09440e5fd0 msgr2=0x7f09440e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:45.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f094ab3d700 1 -- 172.21.15.79:0/4173096784 shutdown_connections 2021-04-09T18:33:45.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.593 7f094ab3d700 1 -- 172.21.15.79:0/4173096784 wait complete. 2021-04-09T18:33:45.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.597 7f094ab3d700 1 Processor -- start 2021-04-09T18:33:45.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f094ab3d700 1 -- start start 2021-04-09T18:33:45.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f094ab3d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09440a4f00 0x7f09440b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f094ab3d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09440a46c0 0x7f09440cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f094ab3d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09440d0090 0x7f094409a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f094ab3d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09440e8ae0 con 0x7f09440d0090 2021-04-09T18:33:45.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f094ab3d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094409a490 con 0x7f09440a46c0 2021-04-09T18:33:45.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f094ab3d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094409a150 con 0x7f09440a4f00 2021-04-09T18:33:45.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f09490e2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09440d0090 0x7f094409a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f09490e2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09440d0090 0x7f094409a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60968/0 (socket says 172.21.15.79:60968) 2021-04-09T18:33:45.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f09490e2700 1 -- 172.21.15.79:0/721376697 learned_addr learned my addr 172.21.15.79:0/721376697 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:45.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f09488e1700 1 --2- 172.21.15.79:0/721376697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09440a4f00 0x7f09440b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f093bfff700 1 --2- 172.21.15.79:0/721376697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09440a46c0 0x7f09440cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f09490e2700 1 -- 172.21.15.79:0/721376697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09440a4f00 msgr2=0x7f09440b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f09490e2700 1 --2- 172.21.15.79:0/721376697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09440a4f00 0x7f09440b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f09490e2700 1 -- 172.21.15.79:0/721376697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09440a46c0 msgr2=0x7f09440cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f09490e2700 1 --2- 172.21.15.79:0/721376697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09440a46c0 0x7f09440cfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f09490e2700 1 -- 172.21.15.79:0/721376697 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09440b9aa0 con 0x7f09440d0090 2021-04-09T18:33:45.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f09490e2700 1 --2- 172.21.15.79:0/721376697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09440d0090 0x7f094409a790 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f09440d3bc0 tx=0x7f093c006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:45.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f09397fa700 1 -- 172.21.15.79:0/721376697 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f09440b9aa0 con 0x7f09440d0090 2021-04-09T18:33:45.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f09397fa700 1 -- 172.21.15.79:0/721376697 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c00be50 con 0x7f09440d0090 2021-04-09T18:33:45.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f094ab3d700 1 -- 172.21.15.79:0/721376697 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09440a4b10 con 0x7f09440d0090 2021-04-09T18:33:45.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f09397fa700 1 -- 172.21.15.79:0/721376697 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f093c020020 con 0x7f09440d0090 2021-04-09T18:33:45.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f094ab3d700 1 -- 172.21.15.79:0/721376697 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094409af50 con 0x7f09440d0090 2021-04-09T18:33:45.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f09397fa700 1 -- 172.21.15.79:0/721376697 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f093c019040 con 0x7f09440d0090 2021-04-09T18:33:45.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f09397fa700 1 --2- 172.21.15.79:0/721376697 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0924029100 0x7f092402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.601 7f09397fa700 1 -- 172.21.15.79:0/721376697 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f093c003020 con 0x7f09440d0090 2021-04-09T18:33:45.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.605 7f09488e1700 1 --2- 172.21.15.79:0/721376697 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0924029100 0x7f092402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.605 7f09488e1700 1 --2- 172.21.15.79:0/721376697 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0924029100 0x7f092402b650 crc :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:45.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.605 7f094ab3d700 1 -- 172.21.15.79:0/721376697 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09440e39d0 con 0x7f09440d0090 2021-04-09T18:33:45.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.609 7f09397fa700 1 -- 172.21.15.79:0/721376697 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f09440f76b0 con 0x7f09440d0090 2021-04-09T18:33:45.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.760 7f094ab3d700 1 -- 172.21.15.79:0/721376697 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f09440f5b10 con 0x7f09440d0090 2021-04-09T18:33:45.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.760 7f09397fa700 1 -- 172.21.15.79:0/721376697 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v84) v1 ==== 84+0+64 (secure 0 0 0) 0x7f093c010730 con 0x7f09440d0090 2021-04-09T18:33:45.768 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:45.769 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2021-04-09T18:33:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2021-04-09T18:33:45.771 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": "rbd" 2021-04-09T18:33:45.771 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:45.772 INFO:teuthology.orchestra.run.smithi079.stdout:] 2021-04-09T18:33:45.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.764 7f094ab3d700 1 -- 172.21.15.79:0/721376697 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0924029100 msgr2=0x7f092402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.764 7f094ab3d700 1 --2- 172.21.15.79:0/721376697 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0924029100 0x7f092402b650 crc :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.764 7f094ab3d700 1 -- 172.21.15.79:0/721376697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09440d0090 msgr2=0x7f094409a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.764 7f094ab3d700 1 --2- 172.21.15.79:0/721376697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09440d0090 0x7f094409a790 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f09440d3bc0 tx=0x7f093c006c10).stop 2021-04-09T18:33:45.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.764 7f094ab3d700 1 -- 172.21.15.79:0/721376697 shutdown_connections 2021-04-09T18:33:45.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.764 7f094ab3d700 1 --2- 172.21.15.79:0/721376697 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0924029100 0x7f092402b650 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.764 7f094ab3d700 1 --2- 172.21.15.79:0/721376697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09440d0090 0x7f094409a790 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.764 7f094ab3d700 1 --2- 172.21.15.79:0/721376697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09440a4f00 0x7f09440b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.764 7f094ab3d700 1 --2- 172.21.15.79:0/721376697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09440a46c0 0x7f09440cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.764 7f094ab3d700 1 -- 172.21.15.79:0/721376697 >> 172.21.15.79:0/721376697 conn(0x7f09440d8810 msgr2=0x7f09440d76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:45.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.764 7f094ab3d700 1 -- 172.21.15.79:0/721376697 shutdown_connections 2021-04-09T18:33:45.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.764 7f094ab3d700 1 -- 172.21.15.79:0/721376697 wait complete. 2021-04-09T18:33:45.783 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-04-09T18:33:45.783 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-04-09T18:33:45.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.876 7f2c5260e700 1 Processor -- start 2021-04-09T18:33:45.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.876 7f2c5260e700 1 -- start start 2021-04-09T18:33:45.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c5260e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2c4c0f5550 0x7f2c4c0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c5260e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c4c0e9b10 0x7f2c4c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c5260e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4c0fbb50 con 0x7f2c4c1c2de0 2021-04-09T18:33:45.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c5260e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4c0e9f60 con 0x7f2c4c0f5550 2021-04-09T18:33:45.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c5260e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c0e5a00 con 0x7f2c4c0e9b10 2021-04-09T18:33:45.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c50bb3700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2c4c1c2de0 0x7f2c4c1c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55686/0 (socket says 172.21.15.79:55686) 2021-04-09T18:33:45.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c50bb3700 1 -- 172.21.15.79:0/2286796975 learned_addr learned my addr 172.21.15.79:0/2286796975 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:45.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c4bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2c4c0f5550 0x7f2c4c0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c4b7fe700 1 --2- 172.21.15.79:0/2286796975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c4c0e9b10 0x7f2c4c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c4bfff700 1 -- 172.21.15.79:0/2286796975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c4c0e9b10 msgr2=0x7f2c4c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:45.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c4bfff700 1 --2- 172.21.15.79:0/2286796975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c4c0e9b10 0x7f2c4c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c4bfff700 1 -- 172.21.15.79:0/2286796975 >> v1:172.21.15.79:6789/0 conn(0x7f2c4c1c2de0 legacy=0x7f2c4c1c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c4bfff700 1 -- 172.21.15.79:0/2286796975 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c0e5700 con 0x7f2c4c0f5550 2021-04-09T18:33:45.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c4affd700 1 -- 172.21.15.79:0/2286796975 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678191852 0 0) 0x7f2c44001450 con 0x7f2c4c1c2de0 2021-04-09T18:33:45.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c4bfff700 1 --2- 172.21.15.79:0/2286796975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c4c0f5550 0x7f2c4c0f64e0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f2c3c002f30 tx=0x7f2c3c00bd40).ready entity=mon.0 client_cookie=19480496a92af43c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:45.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c4affd700 1 -- 172.21.15.79:0/2286796975 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c4c0e5700 con 0x7f2c4c0f5550 2021-04-09T18:33:45.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c4affd700 1 -- 172.21.15.79:0/2286796975 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c009850 con 0x7f2c4c0f5550 2021-04-09T18:33:45.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c4affd700 1 -- 172.21.15.79:0/2286796975 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c3c009c20 con 0x7f2c4c0f5550 2021-04-09T18:33:45.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c5260e700 1 -- 172.21.15.79:0/2286796975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c4c0f5550 msgr2=0x7f2c4c0f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c5260e700 1 --2- 172.21.15.79:0/2286796975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c4c0f5550 0x7f2c4c0f64e0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f2c3c002f30 tx=0x7f2c3c00bd40).stop 2021-04-09T18:33:45.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c5260e700 1 -- 172.21.15.79:0/2286796975 shutdown_connections 2021-04-09T18:33:45.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c5260e700 1 --2- 172.21.15.79:0/2286796975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c4c0f5550 0x7f2c4c0f64e0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c5260e700 1 --2- 172.21.15.79:0/2286796975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c4c0e9b10 0x7f2c4c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c5260e700 1 -- 172.21.15.79:0/2286796975 >> 172.21.15.79:0/2286796975 conn(0x7f2c4c0e6010 msgr2=0x7f2c4c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:45.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c5260e700 1 -- 172.21.15.79:0/2286796975 shutdown_connections 2021-04-09T18:33:45.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.880 7f2c5260e700 1 -- 172.21.15.79:0/2286796975 wait complete. 2021-04-09T18:33:45.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.884 7f2c5260e700 1 Processor -- start 2021-04-09T18:33:45.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.884 7f2c5260e700 1 -- start start 2021-04-09T18:33:45.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c5260e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c4c0b9010 0x7f2c4c1a7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c5260e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c4c0ced80 0x7f2c4c0cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c5260e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c4c093f30 0x7f2c4c094380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c5260e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c0d5450 con 0x7f2c4c0ced80 2021-04-09T18:33:45.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c5260e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c0d5750 con 0x7f2c4c093f30 2021-04-09T18:33:45.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c5260e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c0b9460 con 0x7f2c4c0b9010 2021-04-09T18:33:45.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c4b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c4c0ced80 0x7f2c4c0cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c4b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c4c0ced80 0x7f2c4c0cf1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60982/0 (socket says 172.21.15.79:60982) 2021-04-09T18:33:45.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c4b7fe700 1 -- 172.21.15.79:0/3349043652 learned_addr learned my addr 172.21.15.79:0/3349043652 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:45.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c50bb3700 1 --2- 172.21.15.79:0/3349043652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c4c093f30 0x7f2c4c094380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c4bfff700 1 --2- 172.21.15.79:0/3349043652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c4c0b9010 0x7f2c4c1a7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c50bb3700 1 -- 172.21.15.79:0/3349043652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c4c0b9010 msgr2=0x7f2c4c1a7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c50bb3700 1 --2- 172.21.15.79:0/3349043652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c4c0b9010 0x7f2c4c1a7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c50bb3700 1 -- 172.21.15.79:0/3349043652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c4c0ced80 msgr2=0x7f2c4c0cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:45.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c50bb3700 1 --2- 172.21.15.79:0/3349043652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c4c0ced80 0x7f2c4c0cf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:45.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c50bb3700 1 -- 172.21.15.79:0/3349043652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c0d6cf0 con 0x7f2c4c093f30 2021-04-09T18:33:45.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c50bb3700 1 --2- 172.21.15.79:0/3349043652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c4c093f30 0x7f2c4c094380 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f2c4c0d2dc0 tx=0x7f2c4400ceb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:45.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c48ff9700 1 -- 172.21.15.79:0/3349043652 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c4c0d6cf0 con 0x7f2c4c093f30 2021-04-09T18:33:45.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c48ff9700 1 -- 172.21.15.79:0/3349043652 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c44005b80 con 0x7f2c4c093f30 2021-04-09T18:33:45.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c5260e700 1 -- 172.21.15.79:0/3349043652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c4c0949b0 con 0x7f2c4c093f30 2021-04-09T18:33:45.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c48ff9700 1 -- 172.21.15.79:0/3349043652 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c44007110 con 0x7f2c4c093f30 2021-04-09T18:33:45.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c5260e700 1 -- 172.21.15.79:0/3349043652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c4c1a85d0 con 0x7f2c4c093f30 2021-04-09T18:33:45.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.888 7f2c48ff9700 1 -- 172.21.15.79:0/3349043652 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2c4401a020 con 0x7f2c4c093f30 2021-04-09T18:33:45.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.892 7f2c48ff9700 1 --2- 172.21.15.79:0/3349043652 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2c2c029100 0x7f2c2c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:45.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.892 7f2c48ff9700 1 -- 172.21.15.79:0/3349043652 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f2c440391f0 con 0x7f2c4c093f30 2021-04-09T18:33:45.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.892 7f2c4bfff700 1 --2- 172.21.15.79:0/3349043652 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2c2c029100 0x7f2c2c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:45.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.892 7f2c4bfff700 1 --2- 172.21.15.79:0/3349043652 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2c2c029100 0x7f2c2c02b650 crc :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:45.912 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.908 7f2c5260e700 1 -- 172.21.15.79:0/3349043652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4c0e39f0 con 0x7f2c4c093f30 2021-04-09T18:33:45.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:45.916 7f2c48ff9700 1 -- 172.21.15.79:0/3349043652 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2c4c0f76f0 con 0x7f2c4c093f30 2021-04-09T18:33:46.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:46.076 7f2c5260e700 1 -- 172.21.15.79:0/3349043652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f2c4c0f5b50 con 0x7f2c4c093f30 2021-04-09T18:33:47.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.092 7f2c48ff9700 1 -- 172.21.15.79:0/3349043652 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v85) v1 ==== 133+0+0 (secure 0 0 0) 0x7f2c44005970 con 0x7f2c4c093f30 2021-04-09T18:33:47.098 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2021-04-09T18:33:47.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.096 7f2c5260e700 1 -- 172.21.15.79:0/3349043652 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2c2c029100 msgr2=0x7f2c2c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:47.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.096 7f2c5260e700 1 --2- 172.21.15.79:0/3349043652 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2c2c029100 0x7f2c2c02b650 crc :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.096 7f2c5260e700 1 -- 172.21.15.79:0/3349043652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c4c093f30 msgr2=0x7f2c4c094380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:47.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.096 7f2c5260e700 1 --2- 172.21.15.79:0/3349043652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c4c093f30 0x7f2c4c094380 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f2c4c0d2dc0 tx=0x7f2c4400ceb0).stop 2021-04-09T18:33:47.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.096 7f2c5260e700 1 -- 172.21.15.79:0/3349043652 shutdown_connections 2021-04-09T18:33:47.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.096 7f2c5260e700 1 --2- 172.21.15.79:0/3349043652 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2c2c029100 0x7f2c2c02b650 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.096 7f2c5260e700 1 --2- 172.21.15.79:0/3349043652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c4c093f30 0x7f2c4c094380 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.096 7f2c5260e700 1 --2- 172.21.15.79:0/3349043652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c4c0b9010 0x7f2c4c1a7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.096 7f2c5260e700 1 --2- 172.21.15.79:0/3349043652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c4c0ced80 0x7f2c4c0cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.096 7f2c5260e700 1 -- 172.21.15.79:0/3349043652 >> 172.21.15.79:0/3349043652 conn(0x7f2c4c0935a0 msgr2=0x7f2c4c0d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:47.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.096 7f2c5260e700 1 -- 172.21.15.79:0/3349043652 shutdown_connections 2021-04-09T18:33:47.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.096 7f2c5260e700 1 -- 172.21.15.79:0/3349043652 wait complete. 2021-04-09T18:33:47.113 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-04-09T18:33:47.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.208 7f24d5572700 1 Processor -- start 2021-04-09T18:33:47.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24d5572700 1 -- start start 2021-04-09T18:33:47.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24d5572700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f24d00f5550 0x7f24d00f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:47.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24d5572700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24d00e9b10 0x7f24d009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:47.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24d5572700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d00fbb50 con 0x7f24d01c2de0 2021-04-09T18:33:47.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24d5572700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d00e9f60 con 0x7f24d00f5550 2021-04-09T18:33:47.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24d5572700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00e5a00 con 0x7f24d00e9b10 2021-04-09T18:33:47.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24cfa48700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f24d01c2de0 0x7f24d01c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55702/0 (socket says 172.21.15.79:55702) 2021-04-09T18:33:47.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24cfa48700 1 -- 172.21.15.79:0/3248926537 learned_addr learned my addr 172.21.15.79:0/3248926537 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:47.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24cea46700 1 --2- 172.21.15.79:0/3248926537 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24d00e9b10 0x7f24d009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:47.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24cf247700 1 --2- 172.21.15.79:0/3248926537 >> v2:172.21.15.89:3300/0 conn(0x7f24d00f5550 0x7f24d00f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:47.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24ce245700 1 -- 172.21.15.79:0/3248926537 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960178372 0 0) 0x7f24c00010d0 con 0x7f24d01c2de0 2021-04-09T18:33:47.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24ce245700 1 -- 172.21.15.79:0/3248926537 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24bc003240 con 0x7f24d01c2de0 2021-04-09T18:33:47.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24cea46700 1 -- 172.21.15.79:0/3248926537 >> v2:172.21.15.89:3300/0 conn(0x7f24d00f5550 msgr2=0x7f24d00f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:47.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24cea46700 1 --2- 172.21.15.79:0/3248926537 >> v2:172.21.15.89:3300/0 conn(0x7f24d00f5550 0x7f24d00f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24cea46700 1 -- 172.21.15.79:0/3248926537 >> v1:172.21.15.79:6789/0 conn(0x7f24d01c2de0 legacy=0x7f24d01c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:47.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24cea46700 1 -- 172.21.15.79:0/3248926537 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d00e5700 con 0x7f24d00e9b10 2021-04-09T18:33:47.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24cea46700 1 --2- 172.21.15.79:0/3248926537 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24d00e9b10 0x7f24d009f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f24b8002f30 tx=0x7f24b800bcc0).ready entity=mon.2 client_cookie=28a0bc65fedf5475 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:47.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24ce245700 1 -- 172.21.15.79:0/3248926537 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f24d00e5700 con 0x7f24d00e9b10 2021-04-09T18:33:47.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24ce245700 1 -- 172.21.15.79:0/3248926537 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b8009800 con 0x7f24d00e9b10 2021-04-09T18:33:47.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24ce245700 1 -- 172.21.15.79:0/3248926537 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f24b8009bd0 con 0x7f24d00e9b10 2021-04-09T18:33:47.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24d5572700 1 -- 172.21.15.79:0/3248926537 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24d00e9b10 msgr2=0x7f24d009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:47.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.212 7f24d5572700 1 --2- 172.21.15.79:0/3248926537 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24d00e9b10 0x7f24d009f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f24b8002f30 tx=0x7f24b800bcc0).stop 2021-04-09T18:33:47.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.216 7f24d5572700 1 -- 172.21.15.79:0/3248926537 shutdown_connections 2021-04-09T18:33:47.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.216 7f24d5572700 1 --2- 172.21.15.79:0/3248926537 >> v2:172.21.15.89:3300/0 conn(0x7f24d00f5550 0x7f24d00f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.216 7f24d5572700 1 --2- 172.21.15.79:0/3248926537 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24d00e9b10 0x7f24d009f110 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.216 7f24d5572700 1 -- 172.21.15.79:0/3248926537 >> 172.21.15.79:0/3248926537 conn(0x7f24d00e6010 msgr2=0x7f24d00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:47.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.216 7f24d5572700 1 -- 172.21.15.79:0/3248926537 shutdown_connections 2021-04-09T18:33:47.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.216 7f24d5572700 1 -- 172.21.15.79:0/3248926537 wait complete. 2021-04-09T18:33:47.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24d5572700 1 Processor -- start 2021-04-09T18:33:47.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24d5572700 1 -- start start 2021-04-09T18:33:47.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24d5572700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24d00b9220 0x7f24d01a4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:47.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24d5572700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24d00d6af0 0x7f24d00cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:47.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24d5572700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24d00cec30 0x7f24d00cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:47.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24d5572700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00d5570 con 0x7f24d00cec30 2021-04-09T18:33:47.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24d5572700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00d0290 con 0x7f24d00b9220 2021-04-09T18:33:47.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24d5572700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00d7d80 con 0x7f24d00d6af0 2021-04-09T18:33:47.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24cfa48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24d00cec30 0x7f24d00cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:47.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24cfa48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24d00cec30 0x7f24d00cf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60998/0 (socket says 172.21.15.79:60998) 2021-04-09T18:33:47.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24cf247700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24d00b9220 0x7f24d01a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:47.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24cfa48700 1 -- 172.21.15.79:0/2575700545 learned_addr learned my addr 172.21.15.79:0/2575700545 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:47.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24cea46700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24d00d6af0 0x7f24d00cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:47.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24cfa48700 1 -- 172.21.15.79:0/2575700545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24d00d6af0 msgr2=0x7f24d00cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:47.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24cfa48700 1 --2- 172.21.15.79:0/2575700545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24d00d6af0 0x7f24d00cfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24cfa48700 1 -- 172.21.15.79:0/2575700545 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24d00b9220 msgr2=0x7f24d01a4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:47.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24cfa48700 1 --2- 172.21.15.79:0/2575700545 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24d00b9220 0x7f24d01a4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24cfa48700 1 -- 172.21.15.79:0/2575700545 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d00d7fb0 con 0x7f24d00cec30 2021-04-09T18:33:47.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24cfa48700 1 --2- 172.21.15.79:0/2575700545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24d00cec30 0x7f24d00cf080 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f24c0000b80 tx=0x7f24c000cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:47.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24c7fff700 1 -- 172.21.15.79:0/2575700545 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f24d00d7fb0 con 0x7f24d00cec30 2021-04-09T18:33:47.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24c7fff700 1 -- 172.21.15.79:0/2575700545 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c00072e0 con 0x7f24d00cec30 2021-04-09T18:33:47.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24d5572700 1 -- 172.21.15.79:0/2575700545 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d00994d0 con 0x7f24d00cec30 2021-04-09T18:33:47.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24c7fff700 1 -- 172.21.15.79:0/2575700545 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f24c00057e0 con 0x7f24d00cec30 2021-04-09T18:33:47.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.220 7f24d5572700 1 -- 172.21.15.79:0/2575700545 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d01a8000 con 0x7f24d00cec30 2021-04-09T18:33:47.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.224 7f24c7fff700 1 -- 172.21.15.79:0/2575700545 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f24c001b070 con 0x7f24d00cec30 2021-04-09T18:33:47.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.224 7f24c7fff700 1 --2- 172.21.15.79:0/2575700545 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f24b4029100 0x7f24b402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:47.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.224 7f24c7fff700 1 -- 172.21.15.79:0/2575700545 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5458+0+0 (secure 0 0 0) 0x7f24c00388f0 con 0x7f24d00cec30 2021-04-09T18:33:47.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.224 7f24cf247700 1 --2- 172.21.15.79:0/2575700545 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f24b4029100 0x7f24b402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:47.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.224 7f24cf247700 1 --2- 172.21.15.79:0/2575700545 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f24b4029100 0x7f24b402b650 crc :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:47.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.224 7f24d5572700 1 -- 172.21.15.79:0/2575700545 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d00e39f0 con 0x7f24d00cec30 2021-04-09T18:33:47.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.232 7f24c7fff700 1 -- 172.21.15.79:0/2575700545 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f24d00f76f0 con 0x7f24d00cec30 2021-04-09T18:33:47.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.388 7f24d5572700 1 -- 172.21.15.79:0/2575700545 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f24d00f5b50 con 0x7f24d00cec30 2021-04-09T18:33:47.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.520 7f24c7fff700 1 -- 172.21.15.79:0/2575700545 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v86) v1 ==== 125+0+0 (secure 0 0 0) 0x7f24c00070d0 con 0x7f24d00cec30 2021-04-09T18:33:47.556 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2021-04-09T18:33:47.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.556 7f24d5572700 1 -- 172.21.15.79:0/2575700545 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f24b4029100 msgr2=0x7f24b402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:47.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.556 7f24d5572700 1 --2- 172.21.15.79:0/2575700545 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f24b4029100 0x7f24b402b650 crc :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.556 7f24d5572700 1 -- 172.21.15.79:0/2575700545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24d00cec30 msgr2=0x7f24d00cf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:47.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.556 7f24d5572700 1 --2- 172.21.15.79:0/2575700545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24d00cec30 0x7f24d00cf080 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f24c0000b80 tx=0x7f24c000cab0).stop 2021-04-09T18:33:47.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.556 7f24d5572700 1 -- 172.21.15.79:0/2575700545 shutdown_connections 2021-04-09T18:33:47.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.556 7f24d5572700 1 --2- 172.21.15.79:0/2575700545 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f24b4029100 0x7f24b402b650 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.556 7f24d5572700 1 --2- 172.21.15.79:0/2575700545 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24d00b9220 0x7f24d01a4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.556 7f24d5572700 1 --2- 172.21.15.79:0/2575700545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24d00cec30 0x7f24d00cf080 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.556 7f24d5572700 1 --2- 172.21.15.79:0/2575700545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24d00d6af0 0x7f24d00cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.556 7f24d5572700 1 -- 172.21.15.79:0/2575700545 >> 172.21.15.79:0/2575700545 conn(0x7f24d008e640 msgr2=0x7f24d00d2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:47.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.556 7f24d5572700 1 -- 172.21.15.79:0/2575700545 shutdown_connections 2021-04-09T18:33:47.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.556 7f24d5572700 1 -- 172.21.15.79:0/2575700545 wait complete. 2021-04-09T18:33:47.571 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-04-09T18:33:47.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.672 7f9421084700 1 Processor -- start 2021-04-09T18:33:47.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.672 7f9421084700 1 -- start start 2021-04-09T18:33:47.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.672 7f9421084700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f941c0e9b10 0x7f941c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:47.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.672 7f9421084700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f941c1c8040 0x7f941c1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:47.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.672 7f9421084700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941c0fbb50 con 0x7f941c0f5550 2021-04-09T18:33:47.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.672 7f9421084700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941c1c3df0 con 0x7f941c0e9b10 2021-04-09T18:33:47.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.672 7f9421084700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0e9f60 con 0x7f941c1c8040 2021-04-09T18:33:47.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.672 7f941a59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f941c0e9b10 0x7f941c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:47.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.672 7f941a59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f941c0e9b10 0x7f941c09f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32772/0 (socket says 172.21.15.79:32772) 2021-04-09T18:33:47.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.672 7f941a59c700 1 -- 172.21.15.79:0/1373970257 learned_addr learned my addr 172.21.15.79:0/1373970257 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:47.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.672 7f941b59e700 1 --2- 172.21.15.79:0/1373970257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f941c1c8040 0x7f941c1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:47.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.672 7f941a59c700 1 -- 172.21.15.79:0/1373970257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f941c1c8040 msgr2=0x7f941c1ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:47.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.672 7f941a59c700 1 --2- 172.21.15.79:0/1373970257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f941c1c8040 0x7f941c1ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.672 7f941a59c700 1 -- 172.21.15.79:0/1373970257 >> v1:172.21.15.89:6789/0 conn(0x7f941c0f5550 legacy=0x7f941c0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:47.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.672 7f941a59c700 1 -- 172.21.15.79:0/1373970257 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0e5700 con 0x7f941c0e9b10 2021-04-09T18:33:47.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.676 7f941a59c700 1 --2- 172.21.15.79:0/1373970257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f941c0e9b10 0x7f941c09f110 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f941c0f6f30 tx=0x7f940400b3c0).ready entity=mon.0 client_cookie=5374668f30222e89 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:47.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.676 7f9419d9b700 1 -- 172.21.15.79:0/1373970257 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f941c0e5700 con 0x7f941c0e9b10 2021-04-09T18:33:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.676 7f9419d9b700 1 -- 172.21.15.79:0/1373970257 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940400bbe0 con 0x7f941c0e9b10 2021-04-09T18:33:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.676 7f9419d9b700 1 -- 172.21.15.79:0/1373970257 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9404002020 con 0x7f941c0e9b10 2021-04-09T18:33:47.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.676 7f9421084700 1 -- 172.21.15.79:0/1373970257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f941c0e9b10 msgr2=0x7f941c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.676 7f9421084700 1 --2- 172.21.15.79:0/1373970257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f941c0e9b10 0x7f941c09f110 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f941c0f6f30 tx=0x7f940400b3c0).stop 2021-04-09T18:33:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.676 7f9421084700 1 -- 172.21.15.79:0/1373970257 shutdown_connections 2021-04-09T18:33:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.676 7f9421084700 1 --2- 172.21.15.79:0/1373970257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f941c1c8040 0x7f941c1ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.676 7f9421084700 1 --2- 172.21.15.79:0/1373970257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f941c0e9b10 0x7f941c09f110 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.676 7f9421084700 1 -- 172.21.15.79:0/1373970257 >> 172.21.15.79:0/1373970257 conn(0x7f941c0e6010 msgr2=0x7f941c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:47.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.676 7f9421084700 1 -- 172.21.15.79:0/1373970257 shutdown_connections 2021-04-09T18:33:47.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.676 7f9421084700 1 -- 172.21.15.79:0/1373970257 wait complete. 2021-04-09T18:33:47.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f9421084700 1 Processor -- start 2021-04-09T18:33:47.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f9421084700 1 -- start start 2021-04-09T18:33:47.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f9421084700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f941c0c18e0 0x7f941c09a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:47.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f9421084700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f941c09abf0 0x7f941c09b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:47.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f9421084700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f941c0d52b0 0x7f941c0d5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:47.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f9421084700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0b7b40 con 0x7f941c0d52b0 2021-04-09T18:33:47.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f9421084700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0b7e40 con 0x7f941c0c18e0 2021-04-09T18:33:47.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f9421084700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c09a870 con 0x7f941c09abf0 2021-04-09T18:33:47.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f941b59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f941c0d52b0 0x7f941c0d5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:47.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f941b59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f941c0d52b0 0x7f941c0d5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32778/0 (socket says 172.21.15.79:32778) 2021-04-09T18:33:47.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f941b59e700 1 -- 172.21.15.79:0/2610624933 learned_addr learned my addr 172.21.15.79:0/2610624933 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:47.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f941a59c700 1 --2- 172.21.15.79:0/2610624933 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f941c09abf0 0x7f941c09b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:47.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f941ad9d700 1 --2- 172.21.15.79:0/2610624933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f941c0c18e0 0x7f941c09a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:47.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f941b59e700 1 -- 172.21.15.79:0/2610624933 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f941c09abf0 msgr2=0x7f941c09b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:47.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f941b59e700 1 --2- 172.21.15.79:0/2610624933 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f941c09abf0 0x7f941c09b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f941b59e700 1 -- 172.21.15.79:0/2610624933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f941c0c18e0 msgr2=0x7f941c09a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:47.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f941b59e700 1 --2- 172.21.15.79:0/2610624933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f941c0c18e0 0x7f941c09a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f941b59e700 1 -- 172.21.15.79:0/2610624933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0b76f0 con 0x7f941c0d52b0 2021-04-09T18:33:47.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f941b59e700 1 --2- 172.21.15.79:0/2610624933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f941c0d52b0 0x7f941c0d5700 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f941c0b8040 tx=0x7f941400bf00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:47.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f94137fe700 1 -- 172.21.15.79:0/2610624933 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f941c0b76f0 con 0x7f941c0d52b0 2021-04-09T18:33:47.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f94137fe700 1 -- 172.21.15.79:0/2610624933 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941400cb20 con 0x7f941c0d52b0 2021-04-09T18:33:47.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f9421084700 1 -- 172.21.15.79:0/2610624933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941c0b7240 con 0x7f941c0d52b0 2021-04-09T18:33:47.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.680 7f94137fe700 1 -- 172.21.15.79:0/2610624933 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f941400f040 con 0x7f941c0d52b0 2021-04-09T18:33:47.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.684 7f9421084700 1 -- 172.21.15.79:0/2610624933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c0c3770 con 0x7f941c0d52b0 2021-04-09T18:33:47.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.684 7f94137fe700 1 -- 172.21.15.79:0/2610624933 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9414011070 con 0x7f941c0d52b0 2021-04-09T18:33:47.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.684 7f94137fe700 1 --2- 172.21.15.79:0/2610624933 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9400029100 0x7f940002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:47.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.684 7f94137fe700 1 -- 172.21.15.79:0/2610624933 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f9414010040 con 0x7f941c0d52b0 2021-04-09T18:33:47.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.684 7f941ad9d700 1 --2- 172.21.15.79:0/2610624933 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9400029100 0x7f940002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:47.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.684 7f941ad9d700 1 --2- 172.21.15.79:0/2610624933 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9400029100 0x7f940002b650 crc :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:47.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.688 7f9421084700 1 -- 172.21.15.79:0/2610624933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941c0e39f0 con 0x7f941c0d52b0 2021-04-09T18:33:47.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.692 7f94137fe700 1 -- 172.21.15.79:0/2610624933 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f941c0f76f0 con 0x7f941c0d52b0 2021-04-09T18:33:47.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.852 7f9421084700 1 -- 172.21.15.79:0/2610624933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f941c0a1c90 con 0x7f941c0d52b0 2021-04-09T18:33:47.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.860 7f94137fe700 1 -- 172.21.15.79:0/2610624933 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 16 and data pool 17 v52) v1 ==== 189+0+0 (secure 0 0 0) 0x7f941400c720 con 0x7f941c0d52b0 2021-04-09T18:33:47.871 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 16 and data pool 17 2021-04-09T18:33:47.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.876 7f9421084700 1 -- 172.21.15.79:0/2610624933 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9400029100 msgr2=0x7f940002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:47.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.876 7f9421084700 1 --2- 172.21.15.79:0/2610624933 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9400029100 0x7f940002b650 crc :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.876 7f9421084700 1 -- 172.21.15.79:0/2610624933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f941c0d52b0 msgr2=0x7f941c0d5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:47.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.876 7f9421084700 1 --2- 172.21.15.79:0/2610624933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f941c0d52b0 0x7f941c0d5700 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f941c0b8040 tx=0x7f941400bf00).stop 2021-04-09T18:33:47.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.876 7f9421084700 1 -- 172.21.15.79:0/2610624933 shutdown_connections 2021-04-09T18:33:47.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.876 7f9421084700 1 --2- 172.21.15.79:0/2610624933 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9400029100 0x7f940002b650 crc :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.876 7f9421084700 1 --2- 172.21.15.79:0/2610624933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f941c0c18e0 0x7f941c09a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.876 7f9421084700 1 --2- 172.21.15.79:0/2610624933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f941c0d52b0 0x7f941c0d5700 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.876 7f9421084700 1 --2- 172.21.15.79:0/2610624933 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f941c09abf0 0x7f941c09b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:47.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.876 7f9421084700 1 -- 172.21.15.79:0/2610624933 >> 172.21.15.79:0/2610624933 conn(0x7f941c0a2490 msgr2=0x7f941c0d8570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:47.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.876 7f9421084700 1 -- 172.21.15.79:0/2610624933 shutdown_connections 2021-04-09T18:33:47.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.876 7f9421084700 1 -- 172.21.15.79:0/2610624933 wait complete. 2021-04-09T18:33:47.899 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:33:47.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.984 7efc1d987700 1 Processor -- start 2021-04-09T18:33:48.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.984 7efc1d987700 1 -- start start 2021-04-09T18:33:48.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.984 7efc1d987700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc180f5510 0x7efc180f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:48.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.984 7efc1d987700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efc180e9ad0 0x7efc1809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:48.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.984 7efc1d987700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efc181c2da0 0x7efc181c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:48.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.984 7efc1d987700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc180e9f20 con 0x7efc180e9ad0 2021-04-09T18:33:48.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.984 7efc1d987700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc180e59c0 con 0x7efc181c2da0 2021-04-09T18:33:48.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.984 7efc1d987700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc180fbb10 con 0x7efc180f5510 2021-04-09T18:33:48.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc16d4f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efc180e9ad0 0x7efc1809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:48.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc16d4f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efc180e9ad0 0x7efc1809f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32788/0 (socket says 172.21.15.79:32788) 2021-04-09T18:33:48.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc16d4f700 1 -- 172.21.15.79:0/2074734323 learned_addr learned my addr 172.21.15.79:0/2074734323 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:48.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc17550700 1 --2- 172.21.15.79:0/2074734323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc180f5510 0x7efc180f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:48.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc17d51700 1 --2- 172.21.15.79:0/2074734323 >> v2:172.21.15.89:3300/0 conn(0x7efc181c2da0 0x7efc181c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:48.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc16d4f700 1 -- 172.21.15.79:0/2074734323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc180f5510 msgr2=0x7efc180f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:48.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc16d4f700 1 --2- 172.21.15.79:0/2074734323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc180f5510 0x7efc180f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc16d4f700 1 -- 172.21.15.79:0/2074734323 >> v2:172.21.15.89:3300/0 conn(0x7efc181c2da0 msgr2=0x7efc181c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:48.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc16d4f700 1 --2- 172.21.15.79:0/2074734323 >> v2:172.21.15.89:3300/0 conn(0x7efc181c2da0 0x7efc181c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc16d4f700 1 -- 172.21.15.79:0/2074734323 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc180e56c0 con 0x7efc180e9ad0 2021-04-09T18:33:48.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc16d4f700 1 --2- 172.21.15.79:0/2074734323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc180e9ad0 0x7efc1809f100 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7efc00002f30 tx=0x7efc0000bd70).ready entity=mon.0 client_cookie=35f0a0aa39c66b6a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:48.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc1654e700 1 -- 172.21.15.79:0/2074734323 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efc180e56c0 con 0x7efc180e9ad0 2021-04-09T18:33:48.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc1654e700 1 -- 172.21.15.79:0/2074734323 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc000098b0 con 0x7efc180e9ad0 2021-04-09T18:33:48.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc1654e700 1 -- 172.21.15.79:0/2074734323 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efc00009c80 con 0x7efc180e9ad0 2021-04-09T18:33:48.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc1d987700 1 -- 172.21.15.79:0/2074734323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc180e9ad0 msgr2=0x7efc1809f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:48.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc1d987700 1 --2- 172.21.15.79:0/2074734323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc180e9ad0 0x7efc1809f100 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7efc00002f30 tx=0x7efc0000bd70).stop 2021-04-09T18:33:48.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc1d987700 1 -- 172.21.15.79:0/2074734323 shutdown_connections 2021-04-09T18:33:48.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc1d987700 1 --2- 172.21.15.79:0/2074734323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc180f5510 0x7efc180f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc1d987700 1 --2- 172.21.15.79:0/2074734323 >> v2:172.21.15.89:3300/0 conn(0x7efc181c2da0 0x7efc181c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc1d987700 1 --2- 172.21.15.79:0/2074734323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc180e9ad0 0x7efc1809f100 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc1d987700 1 -- 172.21.15.79:0/2074734323 >> 172.21.15.79:0/2074734323 conn(0x7efc180e5fd0 msgr2=0x7efc180e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:48.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc1d987700 1 -- 172.21.15.79:0/2074734323 shutdown_connections 2021-04-09T18:33:48.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.988 7efc1d987700 1 -- 172.21.15.79:0/2074734323 wait complete. 2021-04-09T18:33:48.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.992 7efc1d987700 1 Processor -- start 2021-04-09T18:33:48.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.992 7efc1d987700 1 -- start start 2021-04-09T18:33:48.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.992 7efc1d987700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc180d4360 0x7efc18094d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:48.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.992 7efc1d987700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc18091140 0x7efc18095680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:48.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.992 7efc1d987700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc180d0700 0x7efc180d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:48.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.992 7efc1d987700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc180d2a20 con 0x7efc180d4360 2021-04-09T18:33:48.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.992 7efc1d987700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc18091590 con 0x7efc18091140 2021-04-09T18:33:48.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.992 7efc1d987700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc18095370 con 0x7efc180d0700 2021-04-09T18:33:48.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.992 7efc17550700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc180d4360 0x7efc18094d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:48.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.992 7efc17550700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc180d4360 0x7efc18094d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32790/0 (socket says 172.21.15.79:32790) 2021-04-09T18:33:48.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.992 7efc17550700 1 -- 172.21.15.79:0/2192655169 learned_addr learned my addr 172.21.15.79:0/2192655169 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:48.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.992 7efc16d4f700 1 --2- 172.21.15.79:0/2192655169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc18091140 0x7efc18095680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:48.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.992 7efc17d51700 1 --2- 172.21.15.79:0/2192655169 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc180d0700 0x7efc180d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:48.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.992 7efc17550700 1 -- 172.21.15.79:0/2192655169 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc180d0700 msgr2=0x7efc180d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:48.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.992 7efc17550700 1 --2- 172.21.15.79:0/2192655169 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc180d0700 0x7efc180d0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.992 7efc17550700 1 -- 172.21.15.79:0/2192655169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc18091140 msgr2=0x7efc18095680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:48.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.992 7efc17550700 1 --2- 172.21.15.79:0/2192655169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc18091140 0x7efc18095680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.992 7efc17550700 1 -- 172.21.15.79:0/2192655169 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc180928e0 con 0x7efc180d4360 2021-04-09T18:33:48.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.992 7efc17550700 1 --2- 172.21.15.79:0/2192655169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc180d4360 0x7efc18094d40 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7efc1809b3c0 tx=0x7efc0800df30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:48.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.996 7efc0ffff700 1 -- 172.21.15.79:0/2192655169 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efc180928e0 con 0x7efc180d4360 2021-04-09T18:33:48.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.996 7efc1d987700 1 -- 172.21.15.79:0/2192655169 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc18095cb0 con 0x7efc180d4360 2021-04-09T18:33:48.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.996 7efc0ffff700 1 -- 172.21.15.79:0/2192655169 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc080099e0 con 0x7efc180d4360 2021-04-09T18:33:48.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.996 7efc0ffff700 1 -- 172.21.15.79:0/2192655169 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efc0800f040 con 0x7efc180d4360 2021-04-09T18:33:48.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.996 7efc1d987700 1 -- 172.21.15.79:0/2192655169 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc181a79d0 con 0x7efc180d4360 2021-04-09T18:33:48.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.996 7efc0ffff700 1 -- 172.21.15.79:0/2192655169 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7efc08013480 con 0x7efc180d4360 2021-04-09T18:33:48.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.996 7efc0ffff700 1 --2- 172.21.15.79:0/2192655169 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efbfc029100 0x7efbfc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:48.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.996 7efc0ffff700 1 -- 172.21.15.79:0/2192655169 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5924+0+0 (secure 0 0 0) 0x7efc08010070 con 0x7efc180d4360 2021-04-09T18:33:48.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.996 7efc16d4f700 1 --2- 172.21.15.79:0/2192655169 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efbfc029100 0x7efbfc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:48.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:47.996 7efc16d4f700 1 --2- 172.21.15.79:0/2192655169 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efbfc029100 0x7efbfc02b650 crc :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:48.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.000 7efc1d987700 1 -- 172.21.15.79:0/2192655169 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc180e39d0 con 0x7efc180d4360 2021-04-09T18:33:48.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.008 7efc0ffff700 1 -- 172.21.15.79:0/2192655169 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7efc08000bf0 con 0x7efc180d4360 2021-04-09T18:33:48.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.180 7efc1d987700 1 -- 172.21.15.79:0/2192655169 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc180f5b10 con 0x7efc180d4360 2021-04-09T18:33:48.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.180 7efc0ffff700 1 -- 172.21.15.79:0/2192655169 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+14242 (secure 0 0 0) 0x7efc080095e0 con 0x7efc180d4360 2021-04-09T18:33:48.187 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:48.188 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":87,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:33:47.856035","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:33:46.135398","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2021-04-09 18:33:47.443962","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:33:48.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.184 7efc1d987700 1 -- 172.21.15.79:0/2192655169 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efbfc029100 msgr2=0x7efbfc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:48.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.184 7efc1d987700 1 --2- 172.21.15.79:0/2192655169 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efbfc029100 0x7efbfc02b650 crc :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.184 7efc1d987700 1 -- 172.21.15.79:0/2192655169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc180d4360 msgr2=0x7efc18094d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:48.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.184 7efc1d987700 1 --2- 172.21.15.79:0/2192655169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc180d4360 0x7efc18094d40 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7efc1809b3c0 tx=0x7efc0800df30).stop 2021-04-09T18:33:48.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.184 7efc1d987700 1 -- 172.21.15.79:0/2192655169 shutdown_connections 2021-04-09T18:33:48.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.184 7efc1d987700 1 --2- 172.21.15.79:0/2192655169 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7efbfc029100 0x7efbfc02b650 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.184 7efc1d987700 1 --2- 172.21.15.79:0/2192655169 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc180d0700 0x7efc180d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.184 7efc1d987700 1 --2- 172.21.15.79:0/2192655169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc180d4360 0x7efc18094d40 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.184 7efc1d987700 1 --2- 172.21.15.79:0/2192655169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc18091140 0x7efc18095680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.184 7efc1d987700 1 -- 172.21.15.79:0/2192655169 >> 172.21.15.79:0/2192655169 conn(0x7efc1808fad0 msgr2=0x7efc18093c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:48.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.184 7efc1d987700 1 -- 172.21.15.79:0/2192655169 shutdown_connections 2021-04-09T18:33:48.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.184 7efc1d987700 1 -- 172.21.15.79:0/2192655169 wait complete. 2021-04-09T18:33:48.200 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:33:48.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.288 7fb53e959700 1 Processor -- start 2021-04-09T18:33:48.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.288 7fb53e959700 1 -- start start 2021-04-09T18:33:48.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.288 7fb53e959700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb5380e9ae0 0x7fb53809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:48.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.288 7fb53e959700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb5381c8010 0x7fb5381ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:48.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.288 7fb53e959700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5380fbb20 con 0x7fb5380f5520 2021-04-09T18:33:48.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.288 7fb53e959700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5381c3dc0 con 0x7fb5381c8010 2021-04-09T18:33:48.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.288 7fb53e959700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5380e9f30 con 0x7fb5380e9ae0 2021-04-09T18:33:48.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.288 7fb537fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb5380f5520 0x7fb5380f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55740/0 (socket says 172.21.15.79:55740) 2021-04-09T18:33:48.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.288 7fb537fff700 1 -- 172.21.15.79:0/4090478025 learned_addr learned my addr 172.21.15.79:0/4090478025 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:48.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.288 7fb53cefe700 1 --2- 172.21.15.79:0/4090478025 >> v2:172.21.15.79:3300/0 conn(0x7fb5381c8010 0x7fb5381ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:48.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.288 7fb5377fe700 1 --2- 172.21.15.79:0/4090478025 >> v2:172.21.15.89:3300/0 conn(0x7fb5380e9ae0 0x7fb53809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:48.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.288 7fb536ffd700 1 -- 172.21.15.79:0/4090478025 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253892162 0 0) 0x7fb528001450 con 0x7fb5380f5520 2021-04-09T18:33:48.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.288 7fb536ffd700 1 -- 172.21.15.79:0/4090478025 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb524003240 con 0x7fb5380f5520 2021-04-09T18:33:48.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.288 7fb53cefe700 1 -- 172.21.15.79:0/4090478025 >> v2:172.21.15.89:3300/0 conn(0x7fb5380e9ae0 msgr2=0x7fb53809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:48.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.288 7fb53cefe700 1 --2- 172.21.15.79:0/4090478025 >> v2:172.21.15.89:3300/0 conn(0x7fb5380e9ae0 0x7fb53809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.288 7fb53cefe700 1 -- 172.21.15.79:0/4090478025 >> v1:172.21.15.79:6789/0 conn(0x7fb5380f5520 legacy=0x7fb5380f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:48.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.288 7fb53cefe700 1 -- 172.21.15.79:0/4090478025 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5380e56d0 con 0x7fb5381c8010 2021-04-09T18:33:48.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.292 7fb53cefe700 1 --2- 172.21.15.79:0/4090478025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5381c8010 0x7fb5381ca470 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7fb530002f30 tx=0x7fb53000bd10).ready entity=mon.0 client_cookie=6b1e1a6e5e3be590 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:48.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.292 7fb536ffd700 1 -- 172.21.15.79:0/4090478025 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb5380e56d0 con 0x7fb5381c8010 2021-04-09T18:33:48.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.292 7fb536ffd700 1 -- 172.21.15.79:0/4090478025 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5300098a0 con 0x7fb5381c8010 2021-04-09T18:33:48.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.292 7fb536ffd700 1 -- 172.21.15.79:0/4090478025 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb530009c70 con 0x7fb5381c8010 2021-04-09T18:33:48.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.292 7fb53e959700 1 -- 172.21.15.79:0/4090478025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5381c8010 msgr2=0x7fb5381ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:48.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.292 7fb53e959700 1 --2- 172.21.15.79:0/4090478025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5381c8010 0x7fb5381ca470 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7fb530002f30 tx=0x7fb53000bd10).stop 2021-04-09T18:33:48.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.292 7fb53e959700 1 -- 172.21.15.79:0/4090478025 shutdown_connections 2021-04-09T18:33:48.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.292 7fb53e959700 1 --2- 172.21.15.79:0/4090478025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5381c8010 0x7fb5381ca470 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.292 7fb53e959700 1 --2- 172.21.15.79:0/4090478025 >> v2:172.21.15.89:3300/0 conn(0x7fb5380e9ae0 0x7fb53809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.292 7fb53e959700 1 -- 172.21.15.79:0/4090478025 >> 172.21.15.79:0/4090478025 conn(0x7fb5380e5fe0 msgr2=0x7fb5380e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:48.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.292 7fb53e959700 1 -- 172.21.15.79:0/4090478025 shutdown_connections 2021-04-09T18:33:48.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.292 7fb53e959700 1 -- 172.21.15.79:0/4090478025 wait complete. 2021-04-09T18:33:48.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb53e959700 1 Processor -- start 2021-04-09T18:33:48.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb53e959700 1 -- start start 2021-04-09T18:33:48.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb53e959700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5380c0250 0x7fb538098ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:48.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb53e959700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5380967b0 0x7fb5381ad330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:48.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb53e959700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb538096c00 0x7fb538097070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:48.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb53e959700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380bff50 con 0x7fb538096c00 2021-04-09T18:33:48.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb53e959700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380bb000 con 0x7fb5380c0250 2021-04-09T18:33:48.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb53e959700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380ba740 con 0x7fb5380967b0 2021-04-09T18:33:48.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb53cefe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb538096c00 0x7fb538097070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:48.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb53cefe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb538096c00 0x7fb538097070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32808/0 (socket says 172.21.15.79:32808) 2021-04-09T18:33:48.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb53cefe700 1 -- 172.21.15.79:0/4127770720 learned_addr learned my addr 172.21.15.79:0/4127770720 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:48.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb5377fe700 1 --2- 172.21.15.79:0/4127770720 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5380967b0 0x7fb5381ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:48.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb537fff700 1 --2- 172.21.15.79:0/4127770720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5380c0250 0x7fb538098ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:48.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb53cefe700 1 -- 172.21.15.79:0/4127770720 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5380967b0 msgr2=0x7fb5381ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:48.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb53cefe700 1 --2- 172.21.15.79:0/4127770720 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5380967b0 0x7fb5381ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb53cefe700 1 -- 172.21.15.79:0/4127770720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5380c0250 msgr2=0x7fb538098ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:48.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb53cefe700 1 --2- 172.21.15.79:0/4127770720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5380c0250 0x7fb538098ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb53cefe700 1 -- 172.21.15.79:0/4127770720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5381ad960 con 0x7fb538096c00 2021-04-09T18:33:48.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb53cefe700 1 --2- 172.21.15.79:0/4127770720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb538096c00 0x7fb538097070 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7fb530002f30 tx=0x7fb530006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:48.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb534ff9700 1 -- 172.21.15.79:0/4127770720 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb5381ad960 con 0x7fb538096c00 2021-04-09T18:33:48.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb534ff9700 1 -- 172.21.15.79:0/4127770720 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb530011c70 con 0x7fb538096c00 2021-04-09T18:33:48.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb534ff9700 1 -- 172.21.15.79:0/4127770720 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb53001d630 con 0x7fb538096c00 2021-04-09T18:33:48.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb53e959700 1 -- 172.21.15.79:0/4127770720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5381adbc0 con 0x7fb538096c00 2021-04-09T18:33:48.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.296 7fb53e959700 1 -- 172.21.15.79:0/4127770720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5380976a0 con 0x7fb538096c00 2021-04-09T18:33:48.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.300 7fb534ff9700 1 -- 172.21.15.79:0/4127770720 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb530026450 con 0x7fb538096c00 2021-04-09T18:33:48.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.300 7fb534ff9700 1 --2- 172.21.15.79:0/4127770720 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb51c029100 0x7fb51c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:48.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.300 7fb534ff9700 1 -- 172.21.15.79:0/4127770720 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fb53003ad40 con 0x7fb538096c00 2021-04-09T18:33:48.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.300 7fb537fff700 1 --2- 172.21.15.79:0/4127770720 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb51c029100 0x7fb51c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:48.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.300 7fb537fff700 1 --2- 172.21.15.79:0/4127770720 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb51c029100 0x7fb51c02b650 crc :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:48.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.300 7fb53e959700 1 -- 172.21.15.79:0/4127770720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5380e39e0 con 0x7fb538096c00 2021-04-09T18:33:48.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.308 7fb534ff9700 1 -- 172.21.15.79:0/4127770720 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb530011a60 con 0x7fb538096c00 2021-04-09T18:33:48.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.468 7fb53e959700 1 -- 172.21.15.79:0/4127770720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5380a1cc0 con 0x7fb538096c00 2021-04-09T18:33:48.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.472 7fb534ff9700 1 -- 172.21.15.79:0/4127770720 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+14242 (secure 0 0 0) 0x7fb530009690 con 0x7fb538096c00 2021-04-09T18:33:48.477 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:48.477 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":87,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:33:47.856035","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:33:46.135398","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2021-04-09 18:33:47.443962","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:33:48.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.476 7fb53e959700 1 -- 172.21.15.79:0/4127770720 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb51c029100 msgr2=0x7fb51c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:48.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.476 7fb53e959700 1 --2- 172.21.15.79:0/4127770720 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb51c029100 0x7fb51c02b650 crc :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.476 7fb53e959700 1 -- 172.21.15.79:0/4127770720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb538096c00 msgr2=0x7fb538097070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:48.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.476 7fb53e959700 1 --2- 172.21.15.79:0/4127770720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb538096c00 0x7fb538097070 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7fb530002f30 tx=0x7fb530006890).stop 2021-04-09T18:33:48.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.476 7fb53e959700 1 -- 172.21.15.79:0/4127770720 shutdown_connections 2021-04-09T18:33:48.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.476 7fb53e959700 1 --2- 172.21.15.79:0/4127770720 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb51c029100 0x7fb51c02b650 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.476 7fb53e959700 1 --2- 172.21.15.79:0/4127770720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5380c0250 0x7fb538098ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.476 7fb53e959700 1 --2- 172.21.15.79:0/4127770720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb538096c00 0x7fb538097070 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.476 7fb53e959700 1 --2- 172.21.15.79:0/4127770720 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5380967b0 0x7fb5381ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.476 7fb53e959700 1 -- 172.21.15.79:0/4127770720 >> 172.21.15.79:0/4127770720 conn(0x7fb5380d8440 msgr2=0x7fb53809a260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:48.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.476 7fb53e959700 1 -- 172.21.15.79:0/4127770720 shutdown_connections 2021-04-09T18:33:48.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.476 7fb53e959700 1 -- 172.21.15.79:0/4127770720 wait complete. 2021-04-09T18:33:48.491 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-04-09T18:33:48.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.580 7f8c7df57700 1 Processor -- start 2021-04-09T18:33:48.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.580 7f8c7df57700 1 -- start start 2021-04-09T18:33:48.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.580 7f8c7df57700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8c780f5550 0x7f8c780f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:48.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.580 7f8c7df57700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c780e9b10 0x7f8c7809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:48.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.580 7f8c7df57700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8c781c2de0 0x7f8c781c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:48.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.580 7f8c7df57700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c780e9f60 con 0x7f8c781c2de0 2021-04-09T18:33:48.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.580 7f8c7df57700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c780e5a00 con 0x7f8c780f5550 2021-04-09T18:33:48.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.580 7f8c7df57700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780fbb50 con 0x7f8c780e9b10 2021-04-09T18:33:48.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c77fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8c781c2de0 0x7f8c781c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:48.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c76ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c780e9b10 0x7f8c7809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:48.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c77fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8c781c2de0 0x7f8c781c3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32816/0 (socket says 172.21.15.79:32816) 2021-04-09T18:33:48.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c77fff700 1 -- 172.21.15.79:0/2429976078 learned_addr learned my addr 172.21.15.79:0/2429976078 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:48.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c777fe700 1 --2- 172.21.15.79:0/2429976078 >> v2:172.21.15.89:3300/0 conn(0x7f8c780f5550 0x7f8c780f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:48.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c77fff700 1 -- 172.21.15.79:0/2429976078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c780e9b10 msgr2=0x7f8c7809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:48.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c77fff700 1 --2- 172.21.15.79:0/2429976078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c780e9b10 0x7f8c7809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c77fff700 1 -- 172.21.15.79:0/2429976078 >> v2:172.21.15.89:3300/0 conn(0x7f8c780f5550 msgr2=0x7f8c780f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:48.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c77fff700 1 --2- 172.21.15.79:0/2429976078 >> v2:172.21.15.89:3300/0 conn(0x7f8c780f5550 0x7f8c780f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c77fff700 1 -- 172.21.15.79:0/2429976078 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c780e5700 con 0x7f8c781c2de0 2021-04-09T18:33:48.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c777fe700 1 --2- 172.21.15.79:0/2429976078 >> v2:172.21.15.89:3300/0 conn(0x7f8c780f5550 0x7f8c780f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:48.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c77fff700 1 --2- 172.21.15.79:0/2429976078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c781c2de0 0x7f8c781c3230 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f8c70002f30 tx=0x7f8c7000bd70).ready entity=mon.0 client_cookie=c4d67c38a7942c3a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:48.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c767fc700 1 -- 172.21.15.79:0/2429976078 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8c780e5700 con 0x7f8c781c2de0 2021-04-09T18:33:48.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c767fc700 1 -- 172.21.15.79:0/2429976078 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c700098b0 con 0x7f8c781c2de0 2021-04-09T18:33:48.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c767fc700 1 -- 172.21.15.79:0/2429976078 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8c70009c80 con 0x7f8c781c2de0 2021-04-09T18:33:48.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c7df57700 1 -- 172.21.15.79:0/2429976078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c781c2de0 msgr2=0x7f8c781c3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:48.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c7df57700 1 --2- 172.21.15.79:0/2429976078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c781c2de0 0x7f8c781c3230 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f8c70002f30 tx=0x7f8c7000bd70).stop 2021-04-09T18:33:48.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c7df57700 1 -- 172.21.15.79:0/2429976078 shutdown_connections 2021-04-09T18:33:48.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c7df57700 1 --2- 172.21.15.79:0/2429976078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c781c2de0 0x7f8c781c3230 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c7df57700 1 --2- 172.21.15.79:0/2429976078 >> v2:172.21.15.89:3300/0 conn(0x7f8c780f5550 0x7f8c780f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c7df57700 1 --2- 172.21.15.79:0/2429976078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c780e9b10 0x7f8c7809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c7df57700 1 -- 172.21.15.79:0/2429976078 >> 172.21.15.79:0/2429976078 conn(0x7f8c780e6010 msgr2=0x7f8c780e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:48.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c7df57700 1 -- 172.21.15.79:0/2429976078 shutdown_connections 2021-04-09T18:33:48.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.584 7f8c7df57700 1 -- 172.21.15.79:0/2429976078 wait complete. 2021-04-09T18:33:48.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c7df57700 1 Processor -- start 2021-04-09T18:33:48.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c7df57700 1 -- start start 2021-04-09T18:33:48.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c7df57700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c780afa90 0x7f8c780c1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:48.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c7df57700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c780b0070 0x7f8c781a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:48.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c7df57700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c780d4b30 0x7f8c780d4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:48.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c7df57700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780ad030 con 0x7f8c780afa90 2021-04-09T18:33:48.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c7df57700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780ad330 con 0x7f8c780d4b30 2021-04-09T18:33:48.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c7df57700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c781a2600 con 0x7f8c780b0070 2021-04-09T18:33:48.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c777fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c780afa90 0x7f8c780c1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:48.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c777fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c780afa90 0x7f8c780c1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32820/0 (socket says 172.21.15.79:32820) 2021-04-09T18:33:48.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c76ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c780b0070 0x7f8c781a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:48.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c777fe700 1 -- 172.21.15.79:0/68192594 learned_addr learned my addr 172.21.15.79:0/68192594 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:48.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c77fff700 1 --2- 172.21.15.79:0/68192594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c780d4b30 0x7f8c780d4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:48.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c777fe700 1 -- 172.21.15.79:0/68192594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c780b0070 msgr2=0x7f8c781a1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:48.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c777fe700 1 --2- 172.21.15.79:0/68192594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c780b0070 0x7f8c781a1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c777fe700 1 -- 172.21.15.79:0/68192594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c780d4b30 msgr2=0x7f8c780d4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:48.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c777fe700 1 --2- 172.21.15.79:0/68192594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c780d4b30 0x7f8c780d4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:48.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c777fe700 1 -- 172.21.15.79:0/68192594 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c780b0ef0 con 0x7f8c780afa90 2021-04-09T18:33:48.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c76ffd700 1 --2- 172.21.15.79:0/68192594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c780b0070 0x7f8c781a1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:48.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c777fe700 1 --2- 172.21.15.79:0/68192594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c780afa90 0x7f8c780c1030 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f8c780874d0 tx=0x7f8c6800c540).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:48.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c6ffff700 1 -- 172.21.15.79:0/68192594 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8c780b0ef0 con 0x7f8c780afa90 2021-04-09T18:33:48.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c6ffff700 1 -- 172.21.15.79:0/68192594 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6800ce10 con 0x7f8c780afa90 2021-04-09T18:33:48.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c7df57700 1 -- 172.21.15.79:0/68192594 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c780b04c0 con 0x7f8c780afa90 2021-04-09T18:33:48.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c6ffff700 1 -- 172.21.15.79:0/68192594 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8c6800f040 con 0x7f8c780afa90 2021-04-09T18:33:48.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.588 7f8c7df57700 1 -- 172.21.15.79:0/68192594 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c78097350 con 0x7f8c780afa90 2021-04-09T18:33:48.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.592 7f8c6ffff700 1 -- 172.21.15.79:0/68192594 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8c68011070 con 0x7f8c780afa90 2021-04-09T18:33:48.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.592 7f8c6ffff700 1 --2- 172.21.15.79:0/68192594 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8c5c029100 0x7f8c5c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:48.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.592 7f8c6ffff700 1 -- 172.21.15.79:0/68192594 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f8c68003020 con 0x7f8c780afa90 2021-04-09T18:33:48.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.592 7f8c76ffd700 1 --2- 172.21.15.79:0/68192594 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8c5c029100 0x7f8c5c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:48.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.592 7f8c76ffd700 1 --2- 172.21.15.79:0/68192594 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8c5c029100 0x7f8c5c02b650 crc :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:48.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.596 7f8c7df57700 1 -- 172.21.15.79:0/68192594 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c780e39f0 con 0x7f8c780afa90 2021-04-09T18:33:48.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.604 7f8c6ffff700 1 -- 172.21.15.79:0/68192594 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8c68000f70 con 0x7f8c780afa90 2021-04-09T18:33:48.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:48.772 7f8c7df57700 1 -- 172.21.15.79:0/68192594 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f8c780f5b50 con 0x7f8c780afa90 2021-04-09T18:33:49.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.096 7f8c6ffff700 1 -- 172.21.15.79:0/68192594 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v54) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8c6800cc00 con 0x7f8c780afa90 2021-04-09T18:33:49.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.140 7f8c7df57700 1 -- 172.21.15.79:0/68192594 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8c5c029100 msgr2=0x7f8c5c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.140 7f8c7df57700 1 --2- 172.21.15.79:0/68192594 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8c5c029100 0x7f8c5c02b650 crc :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.140 7f8c7df57700 1 -- 172.21.15.79:0/68192594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c780afa90 msgr2=0x7f8c780c1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.140 7f8c7df57700 1 --2- 172.21.15.79:0/68192594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c780afa90 0x7f8c780c1030 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f8c780874d0 tx=0x7f8c6800c540).stop 2021-04-09T18:33:49.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.140 7f8c7df57700 1 -- 172.21.15.79:0/68192594 shutdown_connections 2021-04-09T18:33:49.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.140 7f8c7df57700 1 --2- 172.21.15.79:0/68192594 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8c5c029100 0x7f8c5c02b650 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.140 7f8c7df57700 1 --2- 172.21.15.79:0/68192594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c780d4b30 0x7f8c780d4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.140 7f8c7df57700 1 --2- 172.21.15.79:0/68192594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c780afa90 0x7f8c780c1030 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.140 7f8c7df57700 1 --2- 172.21.15.79:0/68192594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c780b0070 0x7f8c781a1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.140 7f8c7df57700 1 -- 172.21.15.79:0/68192594 >> 172.21.15.79:0/68192594 conn(0x7f8c78095ed0 msgr2=0x7f8c7809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:49.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.140 7f8c7df57700 1 -- 172.21.15.79:0/68192594 shutdown_connections 2021-04-09T18:33:49.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.140 7f8c7df57700 1 -- 172.21.15.79:0/68192594 wait complete. 2021-04-09T18:33:49.163 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:49.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.256 7f301542d700 1 Processor -- start 2021-04-09T18:33:49.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.256 7f301542d700 1 -- start start 2021-04-09T18:33:49.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.256 7f301542d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f30101c9010 0x7f30101cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:49.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.256 7f301542d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30100fbb10 con 0x7f30100f5510 2021-04-09T18:33:49.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.256 7f301542d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301009f900 con 0x7f30100e9ad0 2021-04-09T18:33:49.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.256 7f301542d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30101c3db0 con 0x7f30101c9010 2021-04-09T18:33:49.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.256 7f300f005700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f30100f5510 0x7f30100f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55770/0 (socket says 172.21.15.79:55770) 2021-04-09T18:33:49.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.256 7f300f005700 1 -- 172.21.15.79:0/1632428230 learned_addr learned my addr 172.21.15.79:0/1632428230 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:49.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.256 7f300f806700 1 --2- 172.21.15.79:0/1632428230 >> v2:172.21.15.79:3300/0 conn(0x7f30101c9010 0x7f30101cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:49.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.256 7f300e003700 1 -- 172.21.15.79:0/1632428230 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866360659 0 0) 0x7f30000010d0 con 0x7f30100f5510 2021-04-09T18:33:49.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.256 7f300e003700 1 -- 172.21.15.79:0/1632428230 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ffc003240 con 0x7f30100f5510 2021-04-09T18:33:49.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.256 7f300e003700 1 -- 172.21.15.79:0/1632428230 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661723630 0 0) 0x7f2ff80010d0 con 0x7f30100e9ad0 2021-04-09T18:33:49.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.256 7f300e003700 1 -- 172.21.15.79:0/1632428230 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ffc003620 con 0x7f30100e9ad0 2021-04-09T18:33:49.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.256 7f300f806700 1 -- 172.21.15.79:0/1632428230 >> v1:172.21.15.89:6789/0 conn(0x7f30100e9ad0 legacy=0x7f301009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.256 7f300f806700 1 -- 172.21.15.79:0/1632428230 >> v1:172.21.15.79:6789/0 conn(0x7f30100f5510 legacy=0x7f30100f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.256 7f300f806700 1 -- 172.21.15.79:0/1632428230 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30100e56c0 con 0x7f30101c9010 2021-04-09T18:33:49.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.260 7f300f806700 1 --2- 172.21.15.79:0/1632428230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30101c9010 0x7f30101cb470 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f30080032b0 tx=0x7f300800b0e0).ready entity=mon.0 client_cookie=3d1e5fe835dfca3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:49.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.260 7f300e003700 1 -- 172.21.15.79:0/1632428230 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f30100e56c0 con 0x7f30101c9010 2021-04-09T18:33:49.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.260 7f300e003700 1 -- 172.21.15.79:0/1632428230 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300800bab0 con 0x7f30101c9010 2021-04-09T18:33:49.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.260 7f300e003700 1 -- 172.21.15.79:0/1632428230 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3008002020 con 0x7f30101c9010 2021-04-09T18:33:49.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.260 7f301542d700 1 -- 172.21.15.79:0/1632428230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30101c9010 msgr2=0x7f30101cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.260 7f301542d700 1 --2- 172.21.15.79:0/1632428230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30101c9010 0x7f30101cb470 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f30080032b0 tx=0x7f300800b0e0).stop 2021-04-09T18:33:49.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.260 7f301542d700 1 -- 172.21.15.79:0/1632428230 shutdown_connections 2021-04-09T18:33:49.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.260 7f301542d700 1 --2- 172.21.15.79:0/1632428230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30101c9010 0x7f30101cb470 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.260 7f301542d700 1 -- 172.21.15.79:0/1632428230 >> 172.21.15.79:0/1632428230 conn(0x7f30100e5fd0 msgr2=0x7f30100e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:49.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.260 7f301542d700 1 -- 172.21.15.79:0/1632428230 shutdown_connections 2021-04-09T18:33:49.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.260 7f301542d700 1 -- 172.21.15.79:0/1632428230 wait complete. 2021-04-09T18:33:49.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.264 7f301542d700 1 Processor -- start 2021-04-09T18:33:49.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.264 7f301542d700 1 -- start start 2021-04-09T18:33:49.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.264 7f301542d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3010099770 0x7f3010091590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:49.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.264 7f301542d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3010093c00 0x7f30100d8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:49.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.264 7f301542d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30100ce620 0x7f30100cea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:49.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.264 7f301542d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30100e9f20 con 0x7f3010093c00 2021-04-09T18:33:49.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.264 7f301542d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301009a6c0 con 0x7f3010099770 2021-04-09T18:33:49.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.264 7f301542d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3010094050 con 0x7f30100ce620 2021-04-09T18:33:49.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.264 7f300e804700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3010093c00 0x7f30100d8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:49.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.264 7f300e804700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3010093c00 0x7f30100d8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32834/0 (socket says 172.21.15.79:32834) 2021-04-09T18:33:49.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.264 7f300e804700 1 -- 172.21.15.79:0/3055014196 learned_addr learned my addr 172.21.15.79:0/3055014196 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:49.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.264 7f300f806700 1 --2- 172.21.15.79:0/3055014196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30100ce620 0x7f30100cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:49.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.264 7f300f005700 1 --2- 172.21.15.79:0/3055014196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3010099770 0x7f3010091590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:49.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.264 7f300e804700 1 -- 172.21.15.79:0/3055014196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30100ce620 msgr2=0x7f30100cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.264 7f300e804700 1 --2- 172.21.15.79:0/3055014196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30100ce620 0x7f30100cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.264 7f300e804700 1 -- 172.21.15.79:0/3055014196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3010099770 msgr2=0x7f3010091590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.264 7f300e804700 1 --2- 172.21.15.79:0/3055014196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3010099770 0x7f3010091590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.264 7f300e804700 1 -- 172.21.15.79:0/3055014196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30100d89b0 con 0x7f3010093c00 2021-04-09T18:33:49.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.264 7f300f005700 1 --2- 172.21.15.79:0/3055014196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3010099770 0x7f3010091590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:49.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.264 7f300e804700 1 --2- 172.21.15.79:0/3055014196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3010093c00 0x7f30100d8380 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f30100d2620 tx=0x7f2ff8007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:49.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.268 7f3007fff700 1 -- 172.21.15.79:0/3055014196 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f30100d89b0 con 0x7f3010093c00 2021-04-09T18:33:49.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.268 7f3007fff700 1 -- 172.21.15.79:0/3055014196 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff800e4a0 con 0x7f3010093c00 2021-04-09T18:33:49.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.268 7f3007fff700 1 -- 172.21.15.79:0/3055014196 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2ff800e870 con 0x7f3010093c00 2021-04-09T18:33:49.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.268 7f301542d700 1 -- 172.21.15.79:0/3055014196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f301009a250 con 0x7f3010093c00 2021-04-09T18:33:49.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.268 7f301542d700 1 -- 172.21.15.79:0/3055014196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30100d8d00 con 0x7f3010093c00 2021-04-09T18:33:49.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.268 7f3007fff700 1 -- 172.21.15.79:0/3055014196 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2ff800ea70 con 0x7f3010093c00 2021-04-09T18:33:49.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.268 7f3007fff700 1 --2- 172.21.15.79:0/3055014196 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2ff4029100 0x7f2ff402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:49.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.268 7f3007fff700 1 -- 172.21.15.79:0/3055014196 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f2ff8038cd0 con 0x7f3010093c00 2021-04-09T18:33:49.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.268 7f300f005700 1 --2- 172.21.15.79:0/3055014196 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2ff4029100 0x7f2ff402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:49.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.268 7f300f005700 1 --2- 172.21.15.79:0/3055014196 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2ff4029100 0x7f2ff402b650 crc :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:49.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.272 7f301542d700 1 -- 172.21.15.79:0/3055014196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30100e39d0 con 0x7f3010093c00 2021-04-09T18:33:49.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.280 7f3007fff700 1 -- 172.21.15.79:0/3055014196 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2ff800e290 con 0x7f3010093c00 2021-04-09T18:33:49.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.452 7f301542d700 1 -- 172.21.15.79:0/3055014196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30100a1cb0 con 0x7f3010093c00 2021-04-09T18:33:49.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.452 7f3007fff700 1 -- 172.21.15.79:0/3055014196 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2103 (secure 0 0 0) 0x7f30100e5c90 con 0x7f3010093c00 2021-04-09T18:33:49.461 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:49.461 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":54,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6831,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3171732398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3171732398},{"type":"v1","addr":"172.21.15.79:6833","nonce":3171732398}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":51}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:33:47.856435","modified":"2021-04-09 18:33:49.091531","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6059":{"gid":6059,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/2698757363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2698757363},{"type":"v1","addr":"172.21.15.89:6835","nonce":2698757363}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-04-09T18:33:49.461 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 54 2021-04-09T18:33:49.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.456 7f301542d700 1 -- 172.21.15.79:0/3055014196 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2ff4029100 msgr2=0x7f2ff402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.460 7f301542d700 1 --2- 172.21.15.79:0/3055014196 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2ff4029100 0x7f2ff402b650 crc :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.460 7f301542d700 1 -- 172.21.15.79:0/3055014196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3010093c00 msgr2=0x7f30100d8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.460 7f301542d700 1 --2- 172.21.15.79:0/3055014196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3010093c00 0x7f30100d8380 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f30100d2620 tx=0x7f2ff8007f70).stop 2021-04-09T18:33:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.460 7f301542d700 1 -- 172.21.15.79:0/3055014196 shutdown_connections 2021-04-09T18:33:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.460 7f301542d700 1 --2- 172.21.15.79:0/3055014196 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2ff4029100 0x7f2ff402b650 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.460 7f301542d700 1 --2- 172.21.15.79:0/3055014196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3010099770 0x7f3010091590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.460 7f301542d700 1 --2- 172.21.15.79:0/3055014196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30100ce620 0x7f30100cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.460 7f301542d700 1 --2- 172.21.15.79:0/3055014196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3010093c00 0x7f30100d8380 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.460 7f301542d700 1 -- 172.21.15.79:0/3055014196 >> 172.21.15.79:0/3055014196 conn(0x7f301008e3a0 msgr2=0x7f30100d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.460 7f301542d700 1 -- 172.21.15.79:0/3055014196 shutdown_connections 2021-04-09T18:33:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.460 7f301542d700 1 -- 172.21.15.79:0/3055014196 wait complete. 2021-04-09T18:33:49.473 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:33:49.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f5be1f700 1 Processor -- start 2021-04-09T18:33:49.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f5be1f700 1 -- start start 2021-04-09T18:33:49.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f5be1f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2f540f5510 0x7f2f540f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:49.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f5be1f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f540fbb10 con 0x7f2f540e9ad0 2021-04-09T18:33:49.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f5be1f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5409f900 con 0x7f2f541c8000 2021-04-09T18:33:49.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f5be1f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f540e9f20 con 0x7f2f540f5510 2021-04-09T18:33:49.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f593c2700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2f540e9ad0 0x7f2f5409f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55782/0 (socket says 172.21.15.79:55782) 2021-04-09T18:33:49.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f593c2700 1 -- 172.21.15.79:0/752215120 learned_addr learned my addr 172.21.15.79:0/752215120 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:49.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f59bc3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2f540f5510 0x7f2f540f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:49.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f59bc3700 1 -- 172.21.15.79:0/752215120 >> v1:172.21.15.89:6789/0 conn(0x7f2f541c8000 legacy=0x7f2f541ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f59bc3700 1 -- 172.21.15.79:0/752215120 >> v1:172.21.15.79:6789/0 conn(0x7f2f540e9ad0 legacy=0x7f2f5409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f59bc3700 1 -- 172.21.15.79:0/752215120 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f540e56c0 con 0x7f2f540f5510 2021-04-09T18:33:49.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f59bc3700 1 --2- 172.21.15.79:0/752215120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f540f5510 0x7f2f540f64a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f2f44001340 tx=0x7f2f44001040).ready entity=mon.0 client_cookie=7587a2a361706e90 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:49.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f58bc1700 1 -- 172.21.15.79:0/752215120 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2f540e56c0 con 0x7f2f540f5510 2021-04-09T18:33:49.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f58bc1700 1 -- 172.21.15.79:0/752215120 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5000b920 con 0x7f2f540f5510 2021-04-09T18:33:49.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f58bc1700 1 -- 172.21.15.79:0/752215120 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2f50002020 con 0x7f2f540f5510 2021-04-09T18:33:49.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f5be1f700 1 -- 172.21.15.79:0/752215120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f540f5510 msgr2=0x7f2f540f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f5be1f700 1 --2- 172.21.15.79:0/752215120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f540f5510 0x7f2f540f64a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f2f44001340 tx=0x7f2f44001040).stop 2021-04-09T18:33:49.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f5be1f700 1 -- 172.21.15.79:0/752215120 shutdown_connections 2021-04-09T18:33:49.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f5be1f700 1 --2- 172.21.15.79:0/752215120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f540f5510 0x7f2f540f64a0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f5be1f700 1 -- 172.21.15.79:0/752215120 >> 172.21.15.79:0/752215120 conn(0x7f2f540e5fd0 msgr2=0x7f2f540e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:49.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f5be1f700 1 -- 172.21.15.79:0/752215120 shutdown_connections 2021-04-09T18:33:49.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.560 7f2f5be1f700 1 -- 172.21.15.79:0/752215120 wait complete. 2021-04-09T18:33:49.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.564 7f2f5be1f700 1 Processor -- start 2021-04-09T18:33:49.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.564 7f2f5be1f700 1 -- start start 2021-04-09T18:33:49.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f5be1f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f540b0d00 0x7f2f54096150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:49.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f5be1f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f540a85a0 0x7f2f5409a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:49.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f5be1f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f541d0bc0 0x7f2f54093b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:49.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f5be1f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f541c3db0 con 0x7f2f540a85a0 2021-04-09T18:33:49.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f5be1f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f540b0a00 con 0x7f2f541d0bc0 2021-04-09T18:33:49.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f5be1f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f540b0590 con 0x7f2f540b0d00 2021-04-09T18:33:49.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f593c2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f540a85a0 0x7f2f5409a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:49.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f59bc3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f540b0d00 0x7f2f54096150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:49.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f593c2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f540a85a0 0x7f2f5409a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32848/0 (socket says 172.21.15.79:32848) 2021-04-09T18:33:49.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f593c2700 1 -- 172.21.15.79:0/3428167603 learned_addr learned my addr 172.21.15.79:0/3428167603 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:49.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f5a3c4700 1 --2- 172.21.15.79:0/3428167603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f541d0bc0 0x7f2f54093b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:49.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f593c2700 1 -- 172.21.15.79:0/3428167603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f540b0d00 msgr2=0x7f2f54096150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f593c2700 1 --2- 172.21.15.79:0/3428167603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f540b0d00 0x7f2f54096150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f593c2700 1 -- 172.21.15.79:0/3428167603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f541d0bc0 msgr2=0x7f2f54093b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f593c2700 1 --2- 172.21.15.79:0/3428167603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f541d0bc0 0x7f2f54093b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f593c2700 1 -- 172.21.15.79:0/3428167603 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5409aab0 con 0x7f2f540a85a0 2021-04-09T18:33:49.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f593c2700 1 --2- 172.21.15.79:0/3428167603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f540a85a0 0x7f2f5409a480 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f2f540929d0 tx=0x7f2f44007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:49.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f4a7fc700 1 -- 172.21.15.79:0/3428167603 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2f5409aab0 con 0x7f2f540a85a0 2021-04-09T18:33:49.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f4a7fc700 1 -- 172.21.15.79:0/3428167603 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f44007320 con 0x7f2f540a85a0 2021-04-09T18:33:49.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f5be1f700 1 -- 172.21.15.79:0/3428167603 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f540bba90 con 0x7f2f540a85a0 2021-04-09T18:33:49.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f4a7fc700 1 -- 172.21.15.79:0/3428167603 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2f440057e0 con 0x7f2f540a85a0 2021-04-09T18:33:49.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f5be1f700 1 -- 172.21.15.79:0/3428167603 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f541d1010 con 0x7f2f540a85a0 2021-04-09T18:33:49.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.568 7f2f4a7fc700 1 -- 172.21.15.79:0/3428167603 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2f4401a060 con 0x7f2f540a85a0 2021-04-09T18:33:49.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.572 7f2f4a7fc700 1 --2- 172.21.15.79:0/3428167603 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2f3c029100 0x7f2f3c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:49.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.572 7f2f4a7fc700 1 -- 172.21.15.79:0/3428167603 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f2f440390e0 con 0x7f2f540a85a0 2021-04-09T18:33:49.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.572 7f2f59bc3700 1 --2- 172.21.15.79:0/3428167603 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2f3c029100 0x7f2f3c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:49.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.572 7f2f59bc3700 1 --2- 172.21.15.79:0/3428167603 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2f3c029100 0x7f2f3c02b650 crc :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:49.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.572 7f2f5be1f700 1 -- 172.21.15.79:0/3428167603 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f540e39d0 con 0x7f2f540a85a0 2021-04-09T18:33:49.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.580 7f2f4a7fc700 1 -- 172.21.15.79:0/3428167603 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2f44007110 con 0x7f2f540a85a0 2021-04-09T18:33:49.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.740 7f2f5be1f700 1 -- 172.21.15.79:0/3428167603 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f540a1cb0 con 0x7f2f540a85a0 2021-04-09T18:33:49.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.740 7f2f4a7fc700 1 -- 172.21.15.79:0/3428167603 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+14242 (secure 0 0 0) 0x7f2f44000bf0 con 0x7f2f540a85a0 2021-04-09T18:33:49.747 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:49.748 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":88,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:33:48.858892","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:33:46.135398","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2021-04-09 18:33:47.443962","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:33:49.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.744 7f2f5be1f700 1 -- 172.21.15.79:0/3428167603 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2f3c029100 msgr2=0x7f2f3c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.744 7f2f5be1f700 1 --2- 172.21.15.79:0/3428167603 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2f3c029100 0x7f2f3c02b650 crc :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.744 7f2f5be1f700 1 -- 172.21.15.79:0/3428167603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f540a85a0 msgr2=0x7f2f5409a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.744 7f2f5be1f700 1 --2- 172.21.15.79:0/3428167603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f540a85a0 0x7f2f5409a480 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f2f540929d0 tx=0x7f2f44007f70).stop 2021-04-09T18:33:49.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.744 7f2f5be1f700 1 -- 172.21.15.79:0/3428167603 shutdown_connections 2021-04-09T18:33:49.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.744 7f2f5be1f700 1 --2- 172.21.15.79:0/3428167603 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2f3c029100 0x7f2f3c02b650 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.744 7f2f5be1f700 1 --2- 172.21.15.79:0/3428167603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f541d0bc0 0x7f2f54093b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.744 7f2f5be1f700 1 --2- 172.21.15.79:0/3428167603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f540b0d00 0x7f2f54096150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.744 7f2f5be1f700 1 --2- 172.21.15.79:0/3428167603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f540a85a0 0x7f2f5409a480 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.744 7f2f5be1f700 1 -- 172.21.15.79:0/3428167603 >> 172.21.15.79:0/3428167603 conn(0x7f2f540975d0 msgr2=0x7f2f540ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:49.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.744 7f2f5be1f700 1 -- 172.21.15.79:0/3428167603 shutdown_connections 2021-04-09T18:33:49.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.744 7f2f5be1f700 1 -- 172.21.15.79:0/3428167603 wait complete. 2021-04-09T18:33:49.760 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:33:49.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.860 7f7e49f97700 1 Processor -- start 2021-04-09T18:33:49.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.860 7f7e49f97700 1 -- start start 2021-04-09T18:33:49.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.860 7f7e49f97700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7e440e9b40 0x7f7e4409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:49.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.860 7f7e49f97700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e440fbb80 con 0x7f7e440f5580 2021-04-09T18:33:49.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.860 7f7e49f97700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e440e56b0 con 0x7f7e441c7e40 2021-04-09T18:33:49.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.860 7f7e49f97700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e440e9f90 con 0x7f7e440e9b40 2021-04-09T18:33:49.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.860 7f7e437fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7e440f5580 0x7f7e440f6510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55796/0 (socket says 172.21.15.79:55796) 2021-04-09T18:33:49.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.860 7f7e437fe700 1 -- 172.21.15.79:0/650817149 learned_addr learned my addr 172.21.15.79:0/650817149 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:49.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.860 7f7e42ffd700 1 --2- 172.21.15.79:0/650817149 >> v2:172.21.15.89:3300/0 conn(0x7f7e440e9b40 0x7f7e4409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:49.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.864 7f7e42ffd700 1 -- 172.21.15.79:0/650817149 >> v1:172.21.15.89:6789/0 conn(0x7f7e441c7e40 legacy=0x7f7e441ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.864 7f7e42ffd700 1 -- 172.21.15.79:0/650817149 >> v1:172.21.15.79:6789/0 conn(0x7f7e440f5580 legacy=0x7f7e440f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.864 7f7e42ffd700 1 -- 172.21.15.79:0/650817149 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e440e4310 con 0x7f7e440e9b40 2021-04-09T18:33:49.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.864 7f7e42ffd700 1 --2- 172.21.15.79:0/650817149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e440e9b40 0x7f7e4409f110 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f7e38002f30 tx=0x7f7e3800bcc0).ready entity=mon.1 client_cookie=78293b5f554ecb9b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:49.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.868 7f7e427fc700 1 -- 172.21.15.79:0/650817149 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7e440e4310 con 0x7f7e440e9b40 2021-04-09T18:33:49.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.868 7f7e427fc700 1 -- 172.21.15.79:0/650817149 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e38009800 con 0x7f7e440e9b40 2021-04-09T18:33:49.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.868 7f7e427fc700 1 -- 172.21.15.79:0/650817149 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7e38009bd0 con 0x7f7e440e9b40 2021-04-09T18:33:49.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.868 7f7e49f97700 1 -- 172.21.15.79:0/650817149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e440e9b40 msgr2=0x7f7e4409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.868 7f7e49f97700 1 --2- 172.21.15.79:0/650817149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e440e9b40 0x7f7e4409f110 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f7e38002f30 tx=0x7f7e3800bcc0).stop 2021-04-09T18:33:49.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.868 7f7e49f97700 1 -- 172.21.15.79:0/650817149 shutdown_connections 2021-04-09T18:33:49.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.868 7f7e49f97700 1 --2- 172.21.15.79:0/650817149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e440e9b40 0x7f7e4409f110 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.868 7f7e49f97700 1 -- 172.21.15.79:0/650817149 >> 172.21.15.79:0/650817149 conn(0x7f7e440e6040 msgr2=0x7f7e440e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:49.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.868 7f7e49f97700 1 -- 172.21.15.79:0/650817149 shutdown_connections 2021-04-09T18:33:49.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.868 7f7e49f97700 1 -- 172.21.15.79:0/650817149 wait complete. 2021-04-09T18:33:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.872 7f7e49f97700 1 Processor -- start 2021-04-09T18:33:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.872 7f7e49f97700 1 -- start start 2021-04-09T18:33:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e49f97700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e44098b30 0x7f7e440b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e49f97700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e440be050 0x7f7e440d4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e49f97700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e440be4a0 0x7f7e440af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e49f97700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e44088820 con 0x7f7e440be4a0 2021-04-09T18:33:49.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e49f97700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4409a9b0 con 0x7f7e44098b30 2021-04-09T18:33:49.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e49f97700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440bba50 con 0x7f7e440be050 2021-04-09T18:33:49.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e43fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e440be4a0 0x7f7e440af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:49.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e43fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e440be4a0 0x7f7e440af3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32864/0 (socket says 172.21.15.79:32864) 2021-04-09T18:33:49.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e43fff700 1 -- 172.21.15.79:0/8900735 learned_addr learned my addr 172.21.15.79:0/8900735 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:49.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e437fe700 1 --2- 172.21.15.79:0/8900735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e44098b30 0x7f7e440b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:49.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e42ffd700 1 --2- 172.21.15.79:0/8900735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e440be050 0x7f7e440d4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:49.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e43fff700 1 -- 172.21.15.79:0/8900735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e440be050 msgr2=0x7f7e440d4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e43fff700 1 --2- 172.21.15.79:0/8900735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e440be050 0x7f7e440d4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e43fff700 1 -- 172.21.15.79:0/8900735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e44098b30 msgr2=0x7f7e440b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:49.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e43fff700 1 --2- 172.21.15.79:0/8900735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e44098b30 0x7f7e440b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:49.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e43fff700 1 -- 172.21.15.79:0/8900735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e440d5540 con 0x7f7e440be4a0 2021-04-09T18:33:49.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e43fff700 1 --2- 172.21.15.79:0/8900735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e440be4a0 0x7f7e440af3d0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f7e440d8080 tx=0x7f7e3c00ce90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e2bfff700 1 -- 172.21.15.79:0/8900735 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7e440d5540 con 0x7f7e440be4a0 2021-04-09T18:33:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e2bfff700 1 -- 172.21.15.79:0/8900735 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c006870 con 0x7f7e440be4a0 2021-04-09T18:33:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e2bfff700 1 -- 172.21.15.79:0/8900735 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7e3c006c40 con 0x7f7e440be4a0 2021-04-09T18:33:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e49f97700 1 -- 172.21.15.79:0/8900735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e440d5860 con 0x7f7e440be4a0 2021-04-09T18:33:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e49f97700 1 -- 172.21.15.79:0/8900735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e440afb90 con 0x7f7e440be4a0 2021-04-09T18:33:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e2bfff700 1 -- 172.21.15.79:0/8900735 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7e3c00a790 con 0x7f7e440be4a0 2021-04-09T18:33:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e2bfff700 1 --2- 172.21.15.79:0/8900735 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7e24029100 0x7f7e2402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e2bfff700 1 -- 172.21.15.79:0/8900735 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f7e3c039160 con 0x7f7e440be4a0 2021-04-09T18:33:49.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.876 7f7e437fe700 1 --2- 172.21.15.79:0/8900735 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7e24029100 0x7f7e2402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:49.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.880 7f7e437fe700 1 --2- 172.21.15.79:0/8900735 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7e24029100 0x7f7e2402b650 crc :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:49.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.888 7f7e49f97700 1 -- 172.21.15.79:0/8900735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e44088d30 con 0x7f7e440be4a0 2021-04-09T18:33:49.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:49.900 7f7e2bfff700 1 -- 172.21.15.79:0/8900735 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7e3c00a580 con 0x7f7e440be4a0 2021-04-09T18:33:50.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.072 7f7e49f97700 1 -- 172.21.15.79:0/8900735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7e440e39a0 con 0x7f7e440be4a0 2021-04-09T18:33:50.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.076 7f7e2bfff700 1 -- 172.21.15.79:0/8900735 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v27) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7e440f7720 con 0x7f7e440be4a0 2021-04-09T18:33:50.082 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2021-04-09T18:33:50.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.080 7f7e49f97700 1 -- 172.21.15.79:0/8900735 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7e24029100 msgr2=0x7f7e2402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:50.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.080 7f7e49f97700 1 --2- 172.21.15.79:0/8900735 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7e24029100 0x7f7e2402b650 crc :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.080 7f7e49f97700 1 -- 172.21.15.79:0/8900735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e440be4a0 msgr2=0x7f7e440af3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:50.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.080 7f7e49f97700 1 --2- 172.21.15.79:0/8900735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e440be4a0 0x7f7e440af3d0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f7e440d8080 tx=0x7f7e3c00ce90).stop 2021-04-09T18:33:50.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.080 7f7e49f97700 1 -- 172.21.15.79:0/8900735 shutdown_connections 2021-04-09T18:33:50.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.080 7f7e49f97700 1 --2- 172.21.15.79:0/8900735 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7e24029100 0x7f7e2402b650 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.080 7f7e49f97700 1 --2- 172.21.15.79:0/8900735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e44098b30 0x7f7e440b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.080 7f7e49f97700 1 --2- 172.21.15.79:0/8900735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e440be4a0 0x7f7e440af3d0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.080 7f7e49f97700 1 --2- 172.21.15.79:0/8900735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e440be050 0x7f7e440d4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.080 7f7e49f97700 1 -- 172.21.15.79:0/8900735 >> 172.21.15.79:0/8900735 conn(0x7f7e4409a2d0 msgr2=0x7f7e440c0380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:50.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.080 7f7e49f97700 1 -- 172.21.15.79:0/8900735 shutdown_connections 2021-04-09T18:33:50.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.080 7f7e49f97700 1 -- 172.21.15.79:0/8900735 wait complete. 2021-04-09T18:33:50.097 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:33:50.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316ff9e700 1 Processor -- start 2021-04-09T18:33:50.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316ff9e700 1 -- start start 2021-04-09T18:33:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316ff9e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31680f5580 0x7f31680f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316ff9e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f31680e9b40 0x7f316809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316ff9e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f31681c6e30 0x7f31681c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316ff9e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31680e9f90 con 0x7f31681c6e30 2021-04-09T18:33:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316ff9e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31680e59b0 con 0x7f31680e9b40 2021-04-09T18:33:50.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316ff9e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31680fbb80 con 0x7f31680f5580 2021-04-09T18:33:50.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316e543700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f31681c6e30 0x7f31681c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:50.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316e543700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f31681c6e30 0x7f31681c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32872/0 (socket says 172.21.15.79:32872) 2021-04-09T18:33:50.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316e543700 1 -- 172.21.15.79:0/450268485 learned_addr learned my addr 172.21.15.79:0/450268485 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:50.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316dd42700 1 --2- 172.21.15.79:0/450268485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31680f5580 0x7f31680f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:50.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316d541700 1 --2- 172.21.15.79:0/450268485 >> v2:172.21.15.89:3300/0 conn(0x7f31680e9b40 0x7f316809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:50.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316e543700 1 -- 172.21.15.79:0/450268485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31680f5580 msgr2=0x7f31680f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:50.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316e543700 1 --2- 172.21.15.79:0/450268485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31680f5580 0x7f31680f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316e543700 1 -- 172.21.15.79:0/450268485 >> v2:172.21.15.89:3300/0 conn(0x7f31680e9b40 msgr2=0x7f316809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:50.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316e543700 1 --2- 172.21.15.79:0/450268485 >> v2:172.21.15.89:3300/0 conn(0x7f31680e9b40 0x7f316809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316e543700 1 -- 172.21.15.79:0/450268485 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31680e56b0 con 0x7f31681c6e30 2021-04-09T18:33:50.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316d541700 1 --2- 172.21.15.79:0/450268485 >> v2:172.21.15.89:3300/0 conn(0x7f31680e9b40 0x7f316809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:50.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316e543700 1 --2- 172.21.15.79:0/450268485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31681c6e30 0x7f31681c9290 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f31600032b0 tx=0x7f316000b3c0).ready entity=mon.0 client_cookie=4b90cb5defed3748 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:50.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316cd40700 1 -- 172.21.15.79:0/450268485 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f31680e56b0 con 0x7f31681c6e30 2021-04-09T18:33:50.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316cd40700 1 -- 172.21.15.79:0/450268485 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316000bbc0 con 0x7f31681c6e30 2021-04-09T18:33:50.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316cd40700 1 -- 172.21.15.79:0/450268485 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3160002020 con 0x7f31681c6e30 2021-04-09T18:33:50.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316ff9e700 1 -- 172.21.15.79:0/450268485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31681c6e30 msgr2=0x7f31681c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:50.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316ff9e700 1 --2- 172.21.15.79:0/450268485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31681c6e30 0x7f31681c9290 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f31600032b0 tx=0x7f316000b3c0).stop 2021-04-09T18:33:50.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316ff9e700 1 -- 172.21.15.79:0/450268485 shutdown_connections 2021-04-09T18:33:50.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316ff9e700 1 --2- 172.21.15.79:0/450268485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31680f5580 0x7f31680f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316ff9e700 1 --2- 172.21.15.79:0/450268485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31681c6e30 0x7f31681c9290 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316ff9e700 1 --2- 172.21.15.79:0/450268485 >> v2:172.21.15.89:3300/0 conn(0x7f31680e9b40 0x7f316809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316ff9e700 1 -- 172.21.15.79:0/450268485 >> 172.21.15.79:0/450268485 conn(0x7f31680e6040 msgr2=0x7f31680e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:50.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316ff9e700 1 -- 172.21.15.79:0/450268485 shutdown_connections 2021-04-09T18:33:50.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.200 7f316ff9e700 1 -- 172.21.15.79:0/450268485 wait complete. 2021-04-09T18:33:50.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316ff9e700 1 Processor -- start 2021-04-09T18:33:50.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316ff9e700 1 -- start start 2021-04-09T18:33:50.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316ff9e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31680abc90 0x7f31681a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:50.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316ff9e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31681a0730 0x7f31681c00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:50.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316ff9e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31681c0710 0x7f31681ab850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:50.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316ff9e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31680ae4c0 con 0x7f31680abc90 2021-04-09T18:33:50.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316ff9e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31680ae7c0 con 0x7f31681c0710 2021-04-09T18:33:50.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316ff9e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31680adfe0 con 0x7f31681a0730 2021-04-09T18:33:50.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316dd42700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31680abc90 0x7f31681a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:50.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316dd42700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31680abc90 0x7f31681a0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32876/0 (socket says 172.21.15.79:32876) 2021-04-09T18:33:50.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316dd42700 1 -- 172.21.15.79:0/2992426621 learned_addr learned my addr 172.21.15.79:0/2992426621 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:50.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316d541700 1 --2- 172.21.15.79:0/2992426621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31681a0730 0x7f31681c00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:50.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316e543700 1 --2- 172.21.15.79:0/2992426621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31681c0710 0x7f31681ab850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:50.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316dd42700 1 -- 172.21.15.79:0/2992426621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31681a0730 msgr2=0x7f31681c00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:50.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316dd42700 1 --2- 172.21.15.79:0/2992426621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31681a0730 0x7f31681c00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316dd42700 1 -- 172.21.15.79:0/2992426621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31681c0710 msgr2=0x7f31681ab850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:50.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316dd42700 1 --2- 172.21.15.79:0/2992426621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31681c0710 0x7f31681ab850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316dd42700 1 -- 172.21.15.79:0/2992426621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31680ac8e0 con 0x7f31680abc90 2021-04-09T18:33:50.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316d541700 1 --2- 172.21.15.79:0/2992426621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31681a0730 0x7f31681c00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:50.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316dd42700 1 --2- 172.21.15.79:0/2992426621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31680abc90 0x7f31681a0100 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f31680ae440 tx=0x7f315c00dc70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:50.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f315a7fc700 1 -- 172.21.15.79:0/2992426621 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f31680ac8e0 con 0x7f31680abc90 2021-04-09T18:33:50.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316ff9e700 1 -- 172.21.15.79:0/2992426621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31680ac0e0 con 0x7f31680abc90 2021-04-09T18:33:50.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f315a7fc700 1 -- 172.21.15.79:0/2992426621 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c010070 con 0x7f31680abc90 2021-04-09T18:33:50.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f315a7fc700 1 -- 172.21.15.79:0/2992426621 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f315c00ba90 con 0x7f31680abc90 2021-04-09T18:33:50.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.204 7f316ff9e700 1 -- 172.21.15.79:0/2992426621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31681abe80 con 0x7f31680abc90 2021-04-09T18:33:50.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.208 7f315a7fc700 1 -- 172.21.15.79:0/2992426621 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f315c012070 con 0x7f31680abc90 2021-04-09T18:33:50.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.208 7f315a7fc700 1 --2- 172.21.15.79:0/2992426621 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3150029100 0x7f315002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:50.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.208 7f315a7fc700 1 -- 172.21.15.79:0/2992426621 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f315c039430 con 0x7f31680abc90 2021-04-09T18:33:50.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.208 7f316d541700 1 --2- 172.21.15.79:0/2992426621 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3150029100 0x7f315002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:50.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.208 7f316d541700 1 --2- 172.21.15.79:0/2992426621 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3150029100 0x7f315002b650 crc :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:50.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.212 7f316ff9e700 1 -- 172.21.15.79:0/2992426621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3168088d30 con 0x7f31680abc90 2021-04-09T18:33:50.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.220 7f315a7fc700 1 -- 172.21.15.79:0/2992426621 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f315c00b4a0 con 0x7f31680abc90 2021-04-09T18:33:50.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.380 7f316ff9e700 1 -- 172.21.15.79:0/2992426621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f31680e39a0 con 0x7f31680abc90 2021-04-09T18:33:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.384 7f315a7fc700 1 -- 172.21.15.79:0/2992426621 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v28) v1 ==== 184+0+0 (secure 0 0 0) 0x7f315c000bf0 con 0x7f31680abc90 2021-04-09T18:33:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.1 2021-04-09T18:33:50.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.388 7f316ff9e700 1 -- 172.21.15.79:0/2992426621 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3150029100 msgr2=0x7f315002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:50.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.388 7f316ff9e700 1 --2- 172.21.15.79:0/2992426621 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3150029100 0x7f315002b650 crc :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.388 7f316ff9e700 1 -- 172.21.15.79:0/2992426621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31680abc90 msgr2=0x7f31681a0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:50.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.388 7f316ff9e700 1 --2- 172.21.15.79:0/2992426621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31680abc90 0x7f31681a0100 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f31680ae440 tx=0x7f315c00dc70).stop 2021-04-09T18:33:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.388 7f316ff9e700 1 -- 172.21.15.79:0/2992426621 shutdown_connections 2021-04-09T18:33:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.388 7f316ff9e700 1 --2- 172.21.15.79:0/2992426621 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3150029100 0x7f315002b650 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.388 7f316ff9e700 1 --2- 172.21.15.79:0/2992426621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31681c0710 0x7f31681ab850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.388 7f316ff9e700 1 --2- 172.21.15.79:0/2992426621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31680abc90 0x7f31681a0100 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.388 7f316ff9e700 1 --2- 172.21.15.79:0/2992426621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31681a0730 0x7f31681c00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.388 7f316ff9e700 1 -- 172.21.15.79:0/2992426621 >> 172.21.15.79:0/2992426621 conn(0x7f316809aea0 msgr2=0x7f31680ad4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.388 7f316ff9e700 1 -- 172.21.15.79:0/2992426621 shutdown_connections 2021-04-09T18:33:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.388 7f316ff9e700 1 -- 172.21.15.79:0/2992426621 wait complete. 2021-04-09T18:33:50.405 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:33:50.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd8a088700 1 Processor -- start 2021-04-09T18:33:50.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd8a088700 1 -- start start 2021-04-09T18:33:50.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd8a088700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdd840f5580 0x7fdd840f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:50.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd8a088700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd840fbb80 con 0x7fdd841c7e40 2021-04-09T18:33:50.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd8a088700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8409f910 con 0x7fdd840e9b40 2021-04-09T18:33:50.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd8a088700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd840e9f90 con 0x7fdd840f5580 2021-04-09T18:33:50.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd83fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdd841c7e40 0x7fdd841ca2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55828/0 (socket says 172.21.15.79:55828) 2021-04-09T18:33:50.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd83fff700 1 -- 172.21.15.79:0/3285040876 learned_addr learned my addr 172.21.15.79:0/3285040876 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:50.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd837fe700 1 --2- 172.21.15.79:0/3285040876 >> v2:172.21.15.89:3300/0 conn(0x7fdd840f5580 0x7fdd840f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:50.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd827fc700 1 -- 172.21.15.79:0/3285040876 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952019236 0 0) 0x7fdd7c001450 con 0x7fdd841c7e40 2021-04-09T18:33:50.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd827fc700 1 -- 172.21.15.79:0/3285040876 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd70003240 con 0x7fdd841c7e40 2021-04-09T18:33:50.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd827fc700 1 -- 172.21.15.79:0/3285040876 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199344151 0 0) 0x7fdd6c0010d0 con 0x7fdd840e9b40 2021-04-09T18:33:50.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd827fc700 1 -- 172.21.15.79:0/3285040876 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd70003620 con 0x7fdd840e9b40 2021-04-09T18:33:50.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd837fe700 1 -- 172.21.15.79:0/3285040876 >> v1:172.21.15.89:6789/0 conn(0x7fdd840e9b40 legacy=0x7fdd8409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:50.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd837fe700 1 -- 172.21.15.79:0/3285040876 >> v1:172.21.15.79:6789/0 conn(0x7fdd841c7e40 legacy=0x7fdd841ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:50.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd837fe700 1 -- 172.21.15.79:0/3285040876 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd840e56b0 con 0x7fdd840f5580 2021-04-09T18:33:50.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd837fe700 1 --2- 172.21.15.79:0/3285040876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd840f5580 0x7fdd840f6510 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fdd74002f30 tx=0x7fdd7400bcc0).ready entity=mon.1 client_cookie=92b86d934964892e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:50.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd827fc700 1 -- 172.21.15.79:0/3285040876 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd840e56b0 con 0x7fdd840f5580 2021-04-09T18:33:50.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd827fc700 1 -- 172.21.15.79:0/3285040876 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd74009800 con 0x7fdd840f5580 2021-04-09T18:33:50.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd827fc700 1 -- 172.21.15.79:0/3285040876 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd74009bd0 con 0x7fdd840f5580 2021-04-09T18:33:50.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd8a088700 1 -- 172.21.15.79:0/3285040876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd840f5580 msgr2=0x7fdd840f6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:50.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.508 7fdd8a088700 1 --2- 172.21.15.79:0/3285040876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd840f5580 0x7fdd840f6510 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fdd74002f30 tx=0x7fdd7400bcc0).stop 2021-04-09T18:33:50.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.512 7fdd8a088700 1 -- 172.21.15.79:0/3285040876 shutdown_connections 2021-04-09T18:33:50.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.512 7fdd8a088700 1 --2- 172.21.15.79:0/3285040876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd840f5580 0x7fdd840f6510 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.512 7fdd8a088700 1 -- 172.21.15.79:0/3285040876 >> 172.21.15.79:0/3285040876 conn(0x7fdd840e6040 msgr2=0x7fdd840e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:50.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.512 7fdd8a088700 1 -- 172.21.15.79:0/3285040876 shutdown_connections 2021-04-09T18:33:50.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.512 7fdd8a088700 1 -- 172.21.15.79:0/3285040876 wait complete. 2021-04-09T18:33:50.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.512 7fdd8a088700 1 Processor -- start 2021-04-09T18:33:50.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.512 7fdd8a088700 1 -- start start 2021-04-09T18:33:50.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.512 7fdd8a088700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd8408f100 0x7fdd84096050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:50.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.512 7fdd8a088700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd841a7a60 0x7fdd841a7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:50.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.512 7fdd8a088700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd840d07a0 0x7fdd840d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:50.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.512 7fdd8a088700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8408ee00 con 0x7fdd841a7a60 2021-04-09T18:33:50.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.512 7fdd8a088700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd841a84e0 con 0x7fdd8408f100 2021-04-09T18:33:50.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.512 7fdd8a088700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840d1220 con 0x7fdd840d07a0 2021-04-09T18:33:50.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.516 7fdd82ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd841a7a60 0x7fdd841a7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:50.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.516 7fdd83fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd840d07a0 0x7fdd840d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:50.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.516 7fdd82ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd841a7a60 0x7fdd841a7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32890/0 (socket says 172.21.15.79:32890) 2021-04-09T18:33:50.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.516 7fdd837fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd8408f100 0x7fdd84096050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:50.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.516 7fdd82ffd700 1 -- 172.21.15.79:0/2576452886 learned_addr learned my addr 172.21.15.79:0/2576452886 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:50.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.516 7fdd82ffd700 1 -- 172.21.15.79:0/2576452886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd840d07a0 msgr2=0x7fdd840d0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:50.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.516 7fdd82ffd700 1 --2- 172.21.15.79:0/2576452886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd840d07a0 0x7fdd840d0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.516 7fdd82ffd700 1 -- 172.21.15.79:0/2576452886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd8408f100 msgr2=0x7fdd84096050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:50.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.516 7fdd82ffd700 1 --2- 172.21.15.79:0/2576452886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd8408f100 0x7fdd84096050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.516 7fdd82ffd700 1 -- 172.21.15.79:0/2576452886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8408e690 con 0x7fdd841a7a60 2021-04-09T18:33:50.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.516 7fdd82ffd700 1 --2- 172.21.15.79:0/2576452886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd841a7a60 0x7fdd841a7eb0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fdd840874d0 tx=0x7fdd6c00cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:50.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.516 7fdd7bfff700 1 -- 172.21.15.79:0/2576452886 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd8408e690 con 0x7fdd841a7a60 2021-04-09T18:33:50.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.516 7fdd7bfff700 1 -- 172.21.15.79:0/2576452886 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6c010510 con 0x7fdd841a7a60 2021-04-09T18:33:50.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.516 7fdd8a088700 1 -- 172.21.15.79:0/2576452886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd84096680 con 0x7fdd841a7a60 2021-04-09T18:33:50.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.516 7fdd7bfff700 1 -- 172.21.15.79:0/2576452886 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd6c0108e0 con 0x7fdd841a7a60 2021-04-09T18:33:50.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.516 7fdd8a088700 1 -- 172.21.15.79:0/2576452886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8408f550 con 0x7fdd841a7a60 2021-04-09T18:33:50.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.516 7fdd7bfff700 1 -- 172.21.15.79:0/2576452886 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fdd6c010ae0 con 0x7fdd841a7a60 2021-04-09T18:33:50.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.516 7fdd7bfff700 1 --2- 172.21.15.79:0/2576452886 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdd68029100 0x7fdd6802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:50.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.516 7fdd7bfff700 1 -- 172.21.15.79:0/2576452886 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fdd6c038d60 con 0x7fdd841a7a60 2021-04-09T18:33:50.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.516 7fdd837fe700 1 --2- 172.21.15.79:0/2576452886 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdd68029100 0x7fdd6802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:50.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.520 7fdd837fe700 1 --2- 172.21.15.79:0/2576452886 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdd68029100 0x7fdd6802b650 crc :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:50.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.520 7fdd8a088700 1 -- 172.21.15.79:0/2576452886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd84088d30 con 0x7fdd841a7a60 2021-04-09T18:33:50.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.528 7fdd7bfff700 1 -- 172.21.15.79:0/2576452886 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fdd6c010300 con 0x7fdd841a7a60 2021-04-09T18:33:50.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.696 7fdd8a088700 1 -- 172.21.15.79:0/2576452886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fdd840e39a0 con 0x7fdd841a7a60 2021-04-09T18:33:50.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.700 7fdd7bfff700 1 -- 172.21.15.79:0/2576452886 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v29) v1 ==== 184+0+0 (secure 0 0 0) 0x7fdd840e5c80 con 0x7fdd841a7a60 2021-04-09T18:33:50.708 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.2 2021-04-09T18:33:50.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.704 7fdd8a088700 1 -- 172.21.15.79:0/2576452886 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdd68029100 msgr2=0x7fdd6802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:50.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.704 7fdd8a088700 1 --2- 172.21.15.79:0/2576452886 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdd68029100 0x7fdd6802b650 crc :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.704 7fdd8a088700 1 -- 172.21.15.79:0/2576452886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd841a7a60 msgr2=0x7fdd841a7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:50.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.704 7fdd8a088700 1 --2- 172.21.15.79:0/2576452886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd841a7a60 0x7fdd841a7eb0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fdd840874d0 tx=0x7fdd6c00cab0).stop 2021-04-09T18:33:50.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.704 7fdd8a088700 1 -- 172.21.15.79:0/2576452886 shutdown_connections 2021-04-09T18:33:50.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.704 7fdd8a088700 1 --2- 172.21.15.79:0/2576452886 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdd68029100 0x7fdd6802b650 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.704 7fdd8a088700 1 --2- 172.21.15.79:0/2576452886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd8408f100 0x7fdd84096050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.704 7fdd8a088700 1 --2- 172.21.15.79:0/2576452886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd840d07a0 0x7fdd840d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.704 7fdd8a088700 1 --2- 172.21.15.79:0/2576452886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd841a7a60 0x7fdd841a7eb0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.704 7fdd8a088700 1 -- 172.21.15.79:0/2576452886 >> 172.21.15.79:0/2576452886 conn(0x7fdd8409b2c0 msgr2=0x7fdd840bac70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:50.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.704 7fdd8a088700 1 -- 172.21.15.79:0/2576452886 shutdown_connections 2021-04-09T18:33:50.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.704 7fdd8a088700 1 -- 172.21.15.79:0/2576452886 wait complete. 2021-04-09T18:33:50.721 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:50.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f586e1f7700 1 Processor -- start 2021-04-09T18:33:50.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f586e1f7700 1 -- start start 2021-04-09T18:33:50.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f586e1f7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f58680f5520 0x7f58680f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:50.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f586e1f7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58681c8010 0x7f58681ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:50.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f586e1f7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58680fbb20 con 0x7f58680e9ae0 2021-04-09T18:33:50.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f586e1f7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58680e9f30 con 0x7f58680f5520 2021-04-09T18:33:50.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f586e1f7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58681c3dc0 con 0x7f58681c8010 2021-04-09T18:33:50.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f58677fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f58680f5520 0x7f58680f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:50.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f5866ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f58680e9ae0 0x7f586809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55840/0 (socket says 172.21.15.79:55840) 2021-04-09T18:33:50.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f5866ffd700 1 -- 172.21.15.79:0/72266948 learned_addr learned my addr 172.21.15.79:0/72266948 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:50.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f5867fff700 1 --2- 172.21.15.79:0/72266948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58681c8010 0x7f58681ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:50.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f58677fe700 1 -- 172.21.15.79:0/72266948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58681c8010 msgr2=0x7f58681ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:50.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f58677fe700 1 --2- 172.21.15.79:0/72266948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58681c8010 0x7f58681ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f58677fe700 1 -- 172.21.15.79:0/72266948 >> v1:172.21.15.79:6789/0 conn(0x7f58680e9ae0 legacy=0x7f586809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:50.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f58667fc700 1 -- 172.21.15.79:0/72266948 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085920908 0 0) 0x7f585c0010d0 con 0x7f58680e9ae0 2021-04-09T18:33:50.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f58677fe700 1 -- 172.21.15.79:0/72266948 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586809f910 con 0x7f58680f5520 2021-04-09T18:33:50.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f58677fe700 1 --2- 172.21.15.79:0/72266948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58680f5520 0x7f58680f64b0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f58680f6f00 tx=0x7f585800bd70).ready entity=mon.0 client_cookie=ee123fe3a7fba899 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:50.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f58667fc700 1 -- 172.21.15.79:0/72266948 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f586809f910 con 0x7f58680f5520 2021-04-09T18:33:50.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f58667fc700 1 -- 172.21.15.79:0/72266948 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5858009810 con 0x7f58680f5520 2021-04-09T18:33:50.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f586e1f7700 1 -- 172.21.15.79:0/72266948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58680f5520 msgr2=0x7f58680f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:50.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f58667fc700 1 -- 172.21.15.79:0/72266948 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5858009be0 con 0x7f58680f5520 2021-04-09T18:33:50.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.808 7f586e1f7700 1 --2- 172.21.15.79:0/72266948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58680f5520 0x7f58680f64b0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f58680f6f00 tx=0x7f585800bd70).stop 2021-04-09T18:33:50.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.812 7f586e1f7700 1 -- 172.21.15.79:0/72266948 shutdown_connections 2021-04-09T18:33:50.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.812 7f586e1f7700 1 --2- 172.21.15.79:0/72266948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58680f5520 0x7f58680f64b0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.812 7f586e1f7700 1 --2- 172.21.15.79:0/72266948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58681c8010 0x7f58681ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.812 7f586e1f7700 1 -- 172.21.15.79:0/72266948 >> 172.21.15.79:0/72266948 conn(0x7f58680e5fe0 msgr2=0x7f58680e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:50.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.812 7f586e1f7700 1 -- 172.21.15.79:0/72266948 shutdown_connections 2021-04-09T18:33:50.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.812 7f586e1f7700 1 -- 172.21.15.79:0/72266948 wait complete. 2021-04-09T18:33:50.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f586e1f7700 1 Processor -- start 2021-04-09T18:33:50.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f586e1f7700 1 -- start start 2021-04-09T18:33:50.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f586e1f7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58680c0f50 0x7f58680c13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:50.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f586e1f7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58680d4b70 0x7f58680d4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:50.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f586e1f7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58681adf10 0x7f58681ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:50.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f586e1f7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58680c2430 con 0x7f58681adf10 2021-04-09T18:33:50.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f586e1f7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58680c2730 con 0x7f58680d4b70 2021-04-09T18:33:50.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f586e1f7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58680c3cb0 con 0x7f58680c0f50 2021-04-09T18:33:50.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f5867fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58681adf10 0x7f58681ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:50.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f5867fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58681adf10 0x7f58681ae360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32906/0 (socket says 172.21.15.79:32906) 2021-04-09T18:33:50.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f5867fff700 1 -- 172.21.15.79:0/3107975245 learned_addr learned my addr 172.21.15.79:0/3107975245 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:50.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f5866ffd700 1 --2- 172.21.15.79:0/3107975245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58680d4b70 0x7f58680d4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:50.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f58677fe700 1 --2- 172.21.15.79:0/3107975245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58680c0f50 0x7f58680c13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:50.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f5867fff700 1 -- 172.21.15.79:0/3107975245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58680c0f50 msgr2=0x7f58680c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:50.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f5867fff700 1 --2- 172.21.15.79:0/3107975245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58680c0f50 0x7f58680c13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f5867fff700 1 -- 172.21.15.79:0/3107975245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58680d4b70 msgr2=0x7f58680d4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:50.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f5867fff700 1 --2- 172.21.15.79:0/3107975245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58680d4b70 0x7f58680d4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:50.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f5867fff700 1 -- 172.21.15.79:0/3107975245 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58680c1cc0 con 0x7f58681adf10 2021-04-09T18:33:50.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f5867fff700 1 --2- 172.21.15.79:0/3107975245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58681adf10 0x7f58681ae360 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f58681a2f50 tx=0x7f586000c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:50.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f584ffff700 1 -- 172.21.15.79:0/3107975245 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f58680c1cc0 con 0x7f58681adf10 2021-04-09T18:33:50.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f584ffff700 1 -- 172.21.15.79:0/3107975245 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586000cca0 con 0x7f58681adf10 2021-04-09T18:33:50.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f586e1f7700 1 -- 172.21.15.79:0/3107975245 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58681aa900 con 0x7f58681adf10 2021-04-09T18:33:50.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f584ffff700 1 -- 172.21.15.79:0/3107975245 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f586000f040 con 0x7f58681adf10 2021-04-09T18:33:50.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f586e1f7700 1 -- 172.21.15.79:0/3107975245 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58681ae990 con 0x7f58681adf10 2021-04-09T18:33:50.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f584ffff700 1 -- 172.21.15.79:0/3107975245 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5860022060 con 0x7f58681adf10 2021-04-09T18:33:50.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.816 7f584ffff700 1 --2- 172.21.15.79:0/3107975245 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5848029100 0x7f584802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:50.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.820 7f584ffff700 1 -- 172.21.15.79:0/3107975245 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f5860010040 con 0x7f58681adf10 2021-04-09T18:33:50.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.820 7f58677fe700 1 --2- 172.21.15.79:0/3107975245 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5848029100 0x7f584802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:50.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.820 7f58677fe700 1 --2- 172.21.15.79:0/3107975245 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5848029100 0x7f584802b650 crc :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:50.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.820 7f586e1f7700 1 -- 172.21.15.79:0/3107975245 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58680e39e0 con 0x7f58681adf10 2021-04-09T18:33:50.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:50.828 7f584ffff700 1 -- 172.21.15.79:0/3107975245 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f586000ca90 con 0x7f58681adf10 2021-04-09T18:33:51.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.000 7f586e1f7700 1 -- 172.21.15.79:0/3107975245 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58680f5b20 con 0x7f58681adf10 2021-04-09T18:33:51.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.000 7f584ffff700 1 -- 172.21.15.79:0/3107975245 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2103 (secure 0 0 0) 0x7f5860000f70 con 0x7f58681adf10 2021-04-09T18:33:51.007 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 54 2021-04-09T18:33:51.008 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:51.008 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":54,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6831,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3171732398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3171732398},{"type":"v1","addr":"172.21.15.79:6833","nonce":3171732398}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":51}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:33:47.856435","modified":"2021-04-09 18:33:49.091531","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6059":{"gid":6059,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/2698757363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2698757363},{"type":"v1","addr":"172.21.15.89:6835","nonce":2698757363}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-04-09T18:33:51.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.004 7f586e1f7700 1 -- 172.21.15.79:0/3107975245 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5848029100 msgr2=0x7f584802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:51.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.004 7f586e1f7700 1 --2- 172.21.15.79:0/3107975245 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5848029100 0x7f584802b650 crc :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.004 7f586e1f7700 1 -- 172.21.15.79:0/3107975245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58681adf10 msgr2=0x7f58681ae360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:51.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.004 7f586e1f7700 1 --2- 172.21.15.79:0/3107975245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58681adf10 0x7f58681ae360 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f58681a2f50 tx=0x7f586000c430).stop 2021-04-09T18:33:51.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.004 7f586e1f7700 1 -- 172.21.15.79:0/3107975245 shutdown_connections 2021-04-09T18:33:51.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.004 7f586e1f7700 1 --2- 172.21.15.79:0/3107975245 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5848029100 0x7f584802b650 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.004 7f586e1f7700 1 --2- 172.21.15.79:0/3107975245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58681adf10 0x7f58681ae360 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.004 7f586e1f7700 1 --2- 172.21.15.79:0/3107975245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58680c0f50 0x7f58680c13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.004 7f586e1f7700 1 --2- 172.21.15.79:0/3107975245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58680d4b70 0x7f58680d4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.004 7f586e1f7700 1 -- 172.21.15.79:0/3107975245 >> 172.21.15.79:0/3107975245 conn(0x7f586809aae0 msgr2=0x7f58680af270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:51.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.004 7f586e1f7700 1 -- 172.21.15.79:0/3107975245 shutdown_connections 2021-04-09T18:33:51.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.004 7f586e1f7700 1 -- 172.21.15.79:0/3107975245 wait complete. 2021-04-09T18:33:51.225 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:33:47.856435', 'modified': '2021-04-09 18:33:49.091531', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6059}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6059': {'gid': 6059, 'name': 'b', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6835/2698757363', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 2698757363}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 2698757363}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:33:51.226 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:33:51.226 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2021-04-09T18:33:51.318 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:33:51.318 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:33:51.318 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2021-04-09T18:33:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 6059, 2021-04-09T18:33:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2021-04-09T18:33:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2021-04-09T18:33:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 3.45557727, 2021-04-09T18:33:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 54, 2021-04-09T18:33:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 89, 2021-04-09T18:33:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 88, 2021-04-09T18:33:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 7.8466550240000004 2021-04-09T18:33:51.320 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:33:51.324 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 6059, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.45557727, "mdsmap_epoch": 54, "osdmap_epoch": 89, "osdmap_epoch_barrier": 88, "uptime": 7.8466550240000004 } 2021-04-09T18:33:51.325 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:33:51.429 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71f1d5f700 1 Processor -- start 2021-04-09T18:33:51.429 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71f1d5f700 1 -- start start 2021-04-09T18:33:51.430 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71f1d5f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f71ec0f5520 0x7f71ec0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:51.430 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71f1d5f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f71ec0e9ae0 0x7f71ec09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:51.430 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71f1d5f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71ec1c2db0 0x7f71ec1c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:51.430 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71f1d5f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ec0e9f30 con 0x7f71ec0e9ae0 2021-04-09T18:33:51.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71f1d5f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ec0e59d0 con 0x7f71ec0f5520 2021-04-09T18:33:51.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71f1d5f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec0fbb20 con 0x7f71ec1c2db0 2021-04-09T18:33:51.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71eaffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f71ec0e9ae0 0x7f71ec09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:51.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71eaffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f71ec0e9ae0 0x7f71ec09f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32912/0 (socket says 172.21.15.79:32912) 2021-04-09T18:33:51.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71eaffd700 1 -- 172.21.15.79:0/997665545 learned_addr learned my addr 172.21.15.79:0/997665545 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:51.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71eb7fe700 1 --2- 172.21.15.79:0/997665545 >> v2:172.21.15.89:3300/0 conn(0x7f71ec0f5520 0x7f71ec0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:51.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71ebfff700 1 --2- 172.21.15.79:0/997665545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71ec1c2db0 0x7f71ec1c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:51.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71eaffd700 1 -- 172.21.15.79:0/997665545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71ec1c2db0 msgr2=0x7f71ec1c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:51.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71eaffd700 1 --2- 172.21.15.79:0/997665545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71ec1c2db0 0x7f71ec1c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71eaffd700 1 -- 172.21.15.79:0/997665545 >> v2:172.21.15.89:3300/0 conn(0x7f71ec0f5520 msgr2=0x7f71ec0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:51.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71eaffd700 1 --2- 172.21.15.79:0/997665545 >> v2:172.21.15.89:3300/0 conn(0x7f71ec0f5520 0x7f71ec0f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71eaffd700 1 -- 172.21.15.79:0/997665545 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec0e56d0 con 0x7f71ec0e9ae0 2021-04-09T18:33:51.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71eaffd700 1 --2- 172.21.15.79:0/997665545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ec0e9ae0 0x7f71ec09f110 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f71ec125440 tx=0x7f71d400bda0).ready entity=mon.0 client_cookie=8ada907c7b1fd376 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:51.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71ea7fc700 1 -- 172.21.15.79:0/997665545 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71ec0e56d0 con 0x7f71ec0e9ae0 2021-04-09T18:33:51.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71ea7fc700 1 -- 172.21.15.79:0/997665545 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d4009940 con 0x7f71ec0e9ae0 2021-04-09T18:33:51.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71ea7fc700 1 -- 172.21.15.79:0/997665545 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71d4009d10 con 0x7f71ec0e9ae0 2021-04-09T18:33:51.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71f1d5f700 1 -- 172.21.15.79:0/997665545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ec0e9ae0 msgr2=0x7f71ec09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:51.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.420 7f71f1d5f700 1 --2- 172.21.15.79:0/997665545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ec0e9ae0 0x7f71ec09f110 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f71ec125440 tx=0x7f71d400bda0).stop 2021-04-09T18:33:51.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71f1d5f700 1 -- 172.21.15.79:0/997665545 shutdown_connections 2021-04-09T18:33:51.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71f1d5f700 1 --2- 172.21.15.79:0/997665545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71ec1c2db0 0x7f71ec1c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71f1d5f700 1 --2- 172.21.15.79:0/997665545 >> v2:172.21.15.89:3300/0 conn(0x7f71ec0f5520 0x7f71ec0f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71f1d5f700 1 --2- 172.21.15.79:0/997665545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ec0e9ae0 0x7f71ec09f110 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71f1d5f700 1 -- 172.21.15.79:0/997665545 >> 172.21.15.79:0/997665545 conn(0x7f71ec0e5fe0 msgr2=0x7f71ec0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:51.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71f1d5f700 1 -- 172.21.15.79:0/997665545 shutdown_connections 2021-04-09T18:33:51.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71f1d5f700 1 -- 172.21.15.79:0/997665545 wait complete. 2021-04-09T18:33:51.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71f1d5f700 1 Processor -- start 2021-04-09T18:33:51.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71f1d5f700 1 -- start start 2021-04-09T18:33:51.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71f1d5f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ec0baba0 0x7f71ec1bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:51.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71f1d5f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71ec1c0510 0x7f71ec099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:51.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71f1d5f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71ec09a090 0x7f71ec09a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:51.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71f1d5f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec0c2540 con 0x7f71ec0baba0 2021-04-09T18:33:51.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71f1d5f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec1c0960 con 0x7f71ec1c0510 2021-04-09T18:33:51.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71f1d5f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec0ba460 con 0x7f71ec09a090 2021-04-09T18:33:51.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71eb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ec0baba0 0x7f71ec1bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:51.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71eb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ec0baba0 0x7f71ec1bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32916/0 (socket says 172.21.15.79:32916) 2021-04-09T18:33:51.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71eb7fe700 1 -- 172.21.15.79:0/2588623443 learned_addr learned my addr 172.21.15.79:0/2588623443 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:51.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71ebfff700 1 --2- 172.21.15.79:0/2588623443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71ec09a090 0x7f71ec09a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:51.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71eaffd700 1 --2- 172.21.15.79:0/2588623443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71ec1c0510 0x7f71ec099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:51.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71eb7fe700 1 -- 172.21.15.79:0/2588623443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71ec09a090 msgr2=0x7f71ec09a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:51.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71eb7fe700 1 --2- 172.21.15.79:0/2588623443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71ec09a090 0x7f71ec09a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71eb7fe700 1 -- 172.21.15.79:0/2588623443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71ec1c0510 msgr2=0x7f71ec099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:51.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71eb7fe700 1 --2- 172.21.15.79:0/2588623443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71ec1c0510 0x7f71ec099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.424 7f71eb7fe700 1 -- 172.21.15.79:0/2588623443 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec09b050 con 0x7f71ec0baba0 2021-04-09T18:33:51.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.428 7f71ebfff700 1 --2- 172.21.15.79:0/2588623443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71ec09a090 0x7f71ec09a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:51.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.428 7f71eb7fe700 1 --2- 172.21.15.79:0/2588623443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ec0baba0 0x7f71ec1bfee0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f71ec1c0b10 tx=0x7f71e400c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:51.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.428 7f71e3fff700 1 -- 172.21.15.79:0/2588623443 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71ec09b050 con 0x7f71ec0baba0 2021-04-09T18:33:51.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.428 7f71e3fff700 1 -- 172.21.15.79:0/2588623443 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e400cd60 con 0x7f71ec0baba0 2021-04-09T18:33:51.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.428 7f71e3fff700 1 -- 172.21.15.79:0/2588623443 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71e400f040 con 0x7f71ec0baba0 2021-04-09T18:33:51.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.428 7f71f1d5f700 1 -- 172.21.15.79:0/2588623443 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ec0c3ae0 con 0x7f71ec0baba0 2021-04-09T18:33:51.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.428 7f71f1d5f700 1 -- 172.21.15.79:0/2588623443 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ec0c4050 con 0x7f71ec0baba0 2021-04-09T18:33:51.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.428 7f71e3fff700 1 -- 172.21.15.79:0/2588623443 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f71e4011070 con 0x7f71ec0baba0 2021-04-09T18:33:51.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.428 7f71e3fff700 1 --2- 172.21.15.79:0/2588623443 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f71d0029100 0x7f71d002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:51.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.428 7f71e3fff700 1 -- 172.21.15.79:0/2588623443 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f71e4010040 con 0x7f71ec0baba0 2021-04-09T18:33:51.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.428 7f71eaffd700 1 --2- 172.21.15.79:0/2588623443 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f71d0029100 0x7f71d002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:51.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.428 7f71eaffd700 1 --2- 172.21.15.79:0/2588623443 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f71d0029100 0x7f71d002b650 crc :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:51.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.432 7f71f1d5f700 1 -- 172.21.15.79:0/2588623443 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71ec0e39e0 con 0x7f71ec0baba0 2021-04-09T18:33:51.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.436 7f71e3fff700 1 -- 172.21.15.79:0/2588623443 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f71e400c960 con 0x7f71ec0baba0 2021-04-09T18:33:51.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.604 7f71f1d5f700 1 -- 172.21.15.79:0/2588623443 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71ec0f5b20 con 0x7f71ec0baba0 2021-04-09T18:33:51.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.604 7f71e3fff700 1 -- 172.21.15.79:0/2588623443 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+14229 (secure 0 0 0) 0x7f71e4000bf0 con 0x7f71ec0baba0 2021-04-09T18:33:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:51.611 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":89,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:33:49.861312","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:33:46.135398","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2021-04-09 18:33:47.443962","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:33:51.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.608 7f71f1d5f700 1 -- 172.21.15.79:0/2588623443 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f71d0029100 msgr2=0x7f71d002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:51.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.608 7f71f1d5f700 1 --2- 172.21.15.79:0/2588623443 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f71d0029100 0x7f71d002b650 crc :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.608 7f71f1d5f700 1 -- 172.21.15.79:0/2588623443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ec0baba0 msgr2=0x7f71ec1bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:51.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.608 7f71f1d5f700 1 --2- 172.21.15.79:0/2588623443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ec0baba0 0x7f71ec1bfee0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f71ec1c0b10 tx=0x7f71e400c430).stop 2021-04-09T18:33:51.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.608 7f71f1d5f700 1 -- 172.21.15.79:0/2588623443 shutdown_connections 2021-04-09T18:33:51.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.608 7f71f1d5f700 1 --2- 172.21.15.79:0/2588623443 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f71d0029100 0x7f71d002b650 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.608 7f71f1d5f700 1 --2- 172.21.15.79:0/2588623443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71ec09a090 0x7f71ec09a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.608 7f71f1d5f700 1 --2- 172.21.15.79:0/2588623443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71ec0baba0 0x7f71ec1bfee0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.608 7f71f1d5f700 1 --2- 172.21.15.79:0/2588623443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71ec1c0510 0x7f71ec099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.608 7f71f1d5f700 1 -- 172.21.15.79:0/2588623443 >> 172.21.15.79:0/2588623443 conn(0x7f71ec0d85b0 msgr2=0x7f71ec0a24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:51.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.608 7f71f1d5f700 1 -- 172.21.15.79:0/2588623443 shutdown_connections 2021-04-09T18:33:51.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.608 7f71f1d5f700 1 -- 172.21.15.79:0/2588623443 wait complete. 2021-04-09T18:33:51.623 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:33:46.135398', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:33:47.443962', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:33:51.624 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:33:51.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.712 7fa97c16e700 1 Processor -- start 2021-04-09T18:33:51.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.712 7fa97c16e700 1 -- start start 2021-04-09T18:33:51.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.712 7fa97c16e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa9740e9b00 0x7fa97409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:51.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.712 7fa97c16e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9740fbb40 con 0x7fa9741c8030 2021-04-09T18:33:51.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.712 7fa97c16e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9740e56f0 con 0x7fa9740f5540 2021-04-09T18:33:51.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.712 7fa97c16e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9741c3de0 con 0x7fa9740e9b00 2021-04-09T18:33:51.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.712 7fa97a713700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa9741c8030 0x7fa9741ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55870/0 (socket says 172.21.15.79:55870) 2021-04-09T18:33:51.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.712 7fa97a713700 1 -- 172.21.15.79:0/1817106780 learned_addr learned my addr 172.21.15.79:0/1817106780 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:51.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.716 7fa979711700 1 --2- 172.21.15.79:0/1817106780 >> v2:172.21.15.89:3300/0 conn(0x7fa9740e9b00 0x7fa97409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:51.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.716 7fa978f10700 1 -- 172.21.15.79:0/1817106780 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4294964883 0 0) 0x7fa964001450 con 0x7fa9741c8030 2021-04-09T18:33:51.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.716 7fa978f10700 1 -- 172.21.15.79:0/1817106780 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa960003240 con 0x7fa9741c8030 2021-04-09T18:33:51.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.716 7fa979711700 1 -- 172.21.15.79:0/1817106780 >> v1:172.21.15.89:6789/0 conn(0x7fa9740f5540 legacy=0x7fa9740f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:51.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.716 7fa979711700 1 -- 172.21.15.79:0/1817106780 >> v1:172.21.15.79:6789/0 conn(0x7fa9741c8030 legacy=0x7fa9741ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:51.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.716 7fa979711700 1 -- 172.21.15.79:0/1817106780 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9740e4350 con 0x7fa9740e9b00 2021-04-09T18:33:51.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.716 7fa979711700 1 --2- 172.21.15.79:0/1817106780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9740e9b00 0x7fa97409f100 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fa96c001340 tx=0x7fa96c001040).ready entity=mon.1 client_cookie=95b4329efc006410 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:51.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.716 7fa978f10700 1 -- 172.21.15.79:0/1817106780 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa9740e4350 con 0x7fa9740e9b00 2021-04-09T18:33:51.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.716 7fa978f10700 1 -- 172.21.15.79:0/1817106780 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95c0096c0 con 0x7fa9740e9b00 2021-04-09T18:33:51.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.716 7fa97c16e700 1 -- 172.21.15.79:0/1817106780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9740e9b00 msgr2=0x7fa97409f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:51.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.716 7fa978f10700 1 -- 172.21.15.79:0/1817106780 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa95c009a90 con 0x7fa9740e9b00 2021-04-09T18:33:51.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.716 7fa97c16e700 1 --2- 172.21.15.79:0/1817106780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9740e9b00 0x7fa97409f100 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fa96c001340 tx=0x7fa96c001040).stop 2021-04-09T18:33:51.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.716 7fa97c16e700 1 -- 172.21.15.79:0/1817106780 shutdown_connections 2021-04-09T18:33:51.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.716 7fa97c16e700 1 --2- 172.21.15.79:0/1817106780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9740e9b00 0x7fa97409f100 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.716 7fa97c16e700 1 -- 172.21.15.79:0/1817106780 >> 172.21.15.79:0/1817106780 conn(0x7fa9740e6000 msgr2=0x7fa9740e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:51.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.716 7fa97c16e700 1 -- 172.21.15.79:0/1817106780 shutdown_connections 2021-04-09T18:33:51.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.716 7fa97c16e700 1 -- 172.21.15.79:0/1817106780 wait complete. 2021-04-09T18:33:51.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa97c16e700 1 Processor -- start 2021-04-09T18:33:51.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa97c16e700 1 -- start start 2021-04-09T18:33:51.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa97c16e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa97419dc10 0x7fa9740ac720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:51.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa97c16e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9740d52d0 0x7fa9740989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:51.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa97c16e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9740d5720 0x7fa9740ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:51.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa97c16e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9740e9f50 con 0x7fa9740d5720 2021-04-09T18:33:51.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa97c16e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9740986c0 con 0x7fa97419dc10 2021-04-09T18:33:51.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa97c16e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9740a79d0 con 0x7fa9740d52d0 2021-04-09T18:33:51.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa97a713700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9740d5720 0x7fa9740ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:51.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa97a713700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9740d5720 0x7fa9740ad060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32932/0 (socket says 172.21.15.79:32932) 2021-04-09T18:33:51.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa97a713700 1 -- 172.21.15.79:0/1450500888 learned_addr learned my addr 172.21.15.79:0/1450500888 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:51.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa979711700 1 --2- 172.21.15.79:0/1450500888 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9740d52d0 0x7fa9740989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:51.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa979f12700 1 --2- 172.21.15.79:0/1450500888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa97419dc10 0x7fa9740ac720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:51.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa97a713700 1 -- 172.21.15.79:0/1450500888 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9740d52d0 msgr2=0x7fa9740989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:51.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa97a713700 1 --2- 172.21.15.79:0/1450500888 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9740d52d0 0x7fa9740989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa97a713700 1 -- 172.21.15.79:0/1450500888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa97419dc10 msgr2=0x7fa9740ac720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:51.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa97a713700 1 --2- 172.21.15.79:0/1450500888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa97419dc10 0x7fa9740ac720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa97a713700 1 -- 172.21.15.79:0/1450500888 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9740acd50 con 0x7fa9740d5720 2021-04-09T18:33:51.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa979f12700 1 --2- 172.21.15.79:0/1450500888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa97419dc10 0x7fa9740ac720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:51.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa97a713700 1 --2- 172.21.15.79:0/1450500888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9740d5720 0x7fa9740ad060 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7fa974098640 tx=0x7fa96400cec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:51.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa9727fc700 1 -- 172.21.15.79:0/1450500888 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa9740acd50 con 0x7fa9740d5720 2021-04-09T18:33:51.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa9727fc700 1 -- 172.21.15.79:0/1450500888 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa964005b80 con 0x7fa9740d5720 2021-04-09T18:33:51.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa9727fc700 1 -- 172.21.15.79:0/1450500888 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa964007110 con 0x7fa9740d5720 2021-04-09T18:33:51.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa97c16e700 1 -- 172.21.15.79:0/1450500888 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa974098250 con 0x7fa9740d5720 2021-04-09T18:33:51.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa97c16e700 1 -- 172.21.15.79:0/1450500888 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa974098ff0 con 0x7fa9740d5720 2021-04-09T18:33:51.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.720 7fa9727fc700 1 -- 172.21.15.79:0/1450500888 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa96401a060 con 0x7fa9740d5720 2021-04-09T18:33:51.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.724 7fa9727fc700 1 --2- 172.21.15.79:0/1450500888 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa958029100 0x7fa95802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:51.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.724 7fa9727fc700 1 -- 172.21.15.79:0/1450500888 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fa964039070 con 0x7fa9740d5720 2021-04-09T18:33:51.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.724 7fa979f12700 1 --2- 172.21.15.79:0/1450500888 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa958029100 0x7fa95802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:51.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.724 7fa979f12700 1 --2- 172.21.15.79:0/1450500888 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa958029100 0x7fa95802b650 crc :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:51.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.728 7fa97c16e700 1 -- 172.21.15.79:0/1450500888 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9740e39e0 con 0x7fa9740d5720 2021-04-09T18:33:51.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.736 7fa9727fc700 1 -- 172.21.15.79:0/1450500888 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa964005970 con 0x7fa9740d5720 2021-04-09T18:33:51.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.896 7fa97c16e700 1 -- 172.21.15.79:0/1450500888 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fa97409b4f0 con 0x7fa9740d5720 2021-04-09T18:33:51.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.896 7fa9727fc700 1 -- 172.21.15.79:0/1450500888 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v89) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa9740f76e0 con 0x7fa9740d5720 2021-04-09T18:33:51.903 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:33:51.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.900 7fa97c16e700 1 -- 172.21.15.79:0/1450500888 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa958029100 msgr2=0x7fa95802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:51.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.900 7fa97c16e700 1 --2- 172.21.15.79:0/1450500888 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa958029100 0x7fa95802b650 crc :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.900 7fa97c16e700 1 -- 172.21.15.79:0/1450500888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9740d5720 msgr2=0x7fa9740ad060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:51.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.900 7fa97c16e700 1 --2- 172.21.15.79:0/1450500888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9740d5720 0x7fa9740ad060 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7fa974098640 tx=0x7fa96400cec0).stop 2021-04-09T18:33:51.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.900 7fa97c16e700 1 -- 172.21.15.79:0/1450500888 shutdown_connections 2021-04-09T18:33:51.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.900 7fa97c16e700 1 --2- 172.21.15.79:0/1450500888 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa958029100 0x7fa95802b650 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.900 7fa97c16e700 1 --2- 172.21.15.79:0/1450500888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa97419dc10 0x7fa9740ac720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.900 7fa97c16e700 1 --2- 172.21.15.79:0/1450500888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9740d5720 0x7fa9740ad060 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.900 7fa97c16e700 1 --2- 172.21.15.79:0/1450500888 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9740d52d0 0x7fa9740989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:51.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.900 7fa97c16e700 1 -- 172.21.15.79:0/1450500888 >> 172.21.15.79:0/1450500888 conn(0x7fa9740ba770 msgr2=0x7fa9740d8440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:51.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.900 7fa97c16e700 1 -- 172.21.15.79:0/1450500888 shutdown_connections 2021-04-09T18:33:51.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:51.900 7fa97c16e700 1 -- 172.21.15.79:0/1450500888 wait complete. 2021-04-09T18:33:51.914 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:33:52.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.000 7f3a8dbb7700 1 Processor -- start 2021-04-09T18:33:52.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.000 7f3a8dbb7700 1 -- start start 2021-04-09T18:33:52.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a8dbb7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3a881c9050 0x7f3a881cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:52.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a8dbb7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a880fbb50 con 0x7f3a880e9b10 2021-04-09T18:33:52.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a8dbb7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8809f910 con 0x7f3a880f5550 2021-04-09T18:33:52.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a8dbb7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a881c3df0 con 0x7f3a881c9050 2021-04-09T18:33:52.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a86ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3a880e9b10 0x7f3a8809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55880/0 (socket says 172.21.15.79:55880) 2021-04-09T18:33:52.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a86ffd700 1 -- 172.21.15.79:0/2959197634 learned_addr learned my addr 172.21.15.79:0/2959197634 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:52.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a87fff700 1 --2- 172.21.15.79:0/2959197634 >> v2:172.21.15.89:3300/0 conn(0x7f3a881c9050 0x7f3a881cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:52.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a867fc700 1 -- 172.21.15.79:0/2959197634 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122958306 0 0) 0x7f3a700010d0 con 0x7f3a880e9b10 2021-04-09T18:33:52.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a867fc700 1 -- 172.21.15.79:0/2959197634 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a74003240 con 0x7f3a880e9b10 2021-04-09T18:33:52.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a87fff700 1 -- 172.21.15.79:0/2959197634 >> v1:172.21.15.89:6789/0 conn(0x7f3a880f5550 legacy=0x7f3a880f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:52.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a87fff700 1 -- 172.21.15.79:0/2959197634 >> v1:172.21.15.79:6789/0 conn(0x7f3a880e9b10 legacy=0x7f3a8809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:52.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a87fff700 1 -- 172.21.15.79:0/2959197634 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a880e5700 con 0x7f3a881c9050 2021-04-09T18:33:52.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a87fff700 1 --2- 172.21.15.79:0/2959197634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a881c9050 0x7f3a881cb4b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f3a80002f30 tx=0x7f3a8000bcc0).ready entity=mon.1 client_cookie=6ec8f740dca1c49 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:52.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a867fc700 1 -- 172.21.15.79:0/2959197634 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a880e5700 con 0x7f3a881c9050 2021-04-09T18:33:52.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a867fc700 1 -- 172.21.15.79:0/2959197634 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a80009800 con 0x7f3a881c9050 2021-04-09T18:33:52.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a867fc700 1 -- 172.21.15.79:0/2959197634 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a80009bd0 con 0x7f3a881c9050 2021-04-09T18:33:52.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a8dbb7700 1 -- 172.21.15.79:0/2959197634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a881c9050 msgr2=0x7f3a881cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:52.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a8dbb7700 1 --2- 172.21.15.79:0/2959197634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a881c9050 0x7f3a881cb4b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f3a80002f30 tx=0x7f3a8000bcc0).stop 2021-04-09T18:33:52.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a8dbb7700 1 -- 172.21.15.79:0/2959197634 shutdown_connections 2021-04-09T18:33:52.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a8dbb7700 1 --2- 172.21.15.79:0/2959197634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a881c9050 0x7f3a881cb4b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a8dbb7700 1 -- 172.21.15.79:0/2959197634 >> 172.21.15.79:0/2959197634 conn(0x7f3a880e6010 msgr2=0x7f3a880e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:52.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a8dbb7700 1 -- 172.21.15.79:0/2959197634 shutdown_connections 2021-04-09T18:33:52.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.004 7f3a8dbb7700 1 -- 172.21.15.79:0/2959197634 wait complete. 2021-04-09T18:33:52.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.008 7f3a8dbb7700 1 Processor -- start 2021-04-09T18:33:52.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.008 7f3a8dbb7700 1 -- start start 2021-04-09T18:33:52.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.008 7f3a8dbb7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a8809ab70 0x7f3a880afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:52.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.008 7f3a8dbb7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a880b0380 0x7f3a881a78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:52.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.008 7f3a8dbb7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a881a7f10 0x7f3a881b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:52.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.008 7f3a8dbb7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880e9f60 con 0x7f3a881a7f10 2021-04-09T18:33:52.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.008 7f3a8dbb7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880ae4b0 con 0x7f3a8809ab70 2021-04-09T18:33:52.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.008 7f3a8dbb7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880ae7b0 con 0x7f3a880b0380 2021-04-09T18:33:52.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.008 7f3a87fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a881a7f10 0x7f3a881b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:52.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.008 7f3a87fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a881a7f10 0x7f3a881b5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32948/0 (socket says 172.21.15.79:32948) 2021-04-09T18:33:52.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.008 7f3a87fff700 1 -- 172.21.15.79:0/737167099 learned_addr learned my addr 172.21.15.79:0/737167099 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:52.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.008 7f3a86ffd700 1 --2- 172.21.15.79:0/737167099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a880b0380 0x7f3a881a78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:52.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.008 7f3a877fe700 1 --2- 172.21.15.79:0/737167099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a8809ab70 0x7f3a880afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:52.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.008 7f3a87fff700 1 -- 172.21.15.79:0/737167099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a880b0380 msgr2=0x7f3a881a78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:52.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.008 7f3a87fff700 1 --2- 172.21.15.79:0/737167099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a880b0380 0x7f3a881a78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.008 7f3a87fff700 1 -- 172.21.15.79:0/737167099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a8809ab70 msgr2=0x7f3a880afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:52.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.008 7f3a87fff700 1 --2- 172.21.15.79:0/737167099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a8809ab70 0x7f3a880afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.008 7f3a87fff700 1 -- 172.21.15.79:0/737167099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8809afc0 con 0x7f3a881a7f10 2021-04-09T18:33:52.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.008 7f3a87fff700 1 --2- 172.21.15.79:0/737167099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a881a7f10 0x7f3a881b5b30 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f3a80002f30 tx=0x7f3a80006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:52.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.008 7f3a7ffff700 1 -- 172.21.15.79:0/737167099 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a8809afc0 con 0x7f3a881a7f10 2021-04-09T18:33:52.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.012 7f3a7ffff700 1 -- 172.21.15.79:0/737167099 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8001a570 con 0x7f3a881a7f10 2021-04-09T18:33:52.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.012 7f3a7ffff700 1 -- 172.21.15.79:0/737167099 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a8001a940 con 0x7f3a881a7f10 2021-04-09T18:33:52.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.012 7f3a8dbb7700 1 -- 172.21.15.79:0/737167099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a880ae040 con 0x7f3a881a7f10 2021-04-09T18:33:52.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.012 7f3a8dbb7700 1 -- 172.21.15.79:0/737167099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a880ad8e0 con 0x7f3a881a7f10 2021-04-09T18:33:52.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.012 7f3a7ffff700 1 -- 172.21.15.79:0/737167099 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3a8001ab40 con 0x7f3a881a7f10 2021-04-09T18:33:52.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.012 7f3a7ffff700 1 --2- 172.21.15.79:0/737167099 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a6c029100 0x7f3a6c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:52.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.012 7f3a7ffff700 1 -- 172.21.15.79:0/737167099 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f3a8003b8e0 con 0x7f3a881a7f10 2021-04-09T18:33:52.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.012 7f3a877fe700 1 --2- 172.21.15.79:0/737167099 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a6c029100 0x7f3a6c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:52.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.012 7f3a877fe700 1 --2- 172.21.15.79:0/737167099 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a6c029100 0x7f3a6c02b650 crc :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:52.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.016 7f3a8dbb7700 1 -- 172.21.15.79:0/737167099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a880e39f0 con 0x7f3a881a7f10 2021-04-09T18:33:52.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.024 7f3a7ffff700 1 -- 172.21.15.79:0/737167099 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3a800095f0 con 0x7f3a881a7f10 2021-04-09T18:33:52.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.184 7f3a8dbb7700 1 -- 172.21.15.79:0/737167099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f3a880a1c90 con 0x7f3a881a7f10 2021-04-09T18:33:52.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.184 7f3a7ffff700 1 -- 172.21.15.79:0/737167099 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v89) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3a8001a360 con 0x7f3a881a7f10 2021-04-09T18:33:52.191 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:33:52.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.188 7f3a8dbb7700 1 -- 172.21.15.79:0/737167099 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a6c029100 msgr2=0x7f3a6c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:52.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.188 7f3a8dbb7700 1 --2- 172.21.15.79:0/737167099 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a6c029100 0x7f3a6c02b650 crc :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.188 7f3a8dbb7700 1 -- 172.21.15.79:0/737167099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a881a7f10 msgr2=0x7f3a881b5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:52.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.188 7f3a8dbb7700 1 --2- 172.21.15.79:0/737167099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a881a7f10 0x7f3a881b5b30 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f3a80002f30 tx=0x7f3a80006890).stop 2021-04-09T18:33:52.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.188 7f3a8dbb7700 1 -- 172.21.15.79:0/737167099 shutdown_connections 2021-04-09T18:33:52.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.188 7f3a8dbb7700 1 --2- 172.21.15.79:0/737167099 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a6c029100 0x7f3a6c02b650 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.188 7f3a8dbb7700 1 --2- 172.21.15.79:0/737167099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a8809ab70 0x7f3a880afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.188 7f3a8dbb7700 1 --2- 172.21.15.79:0/737167099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a881a7f10 0x7f3a881b5b30 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.188 7f3a8dbb7700 1 --2- 172.21.15.79:0/737167099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a880b0380 0x7f3a881a78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.188 7f3a8dbb7700 1 -- 172.21.15.79:0/737167099 >> 172.21.15.79:0/737167099 conn(0x7f3a880ba930 msgr2=0x7f3a880d8500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:52.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.188 7f3a8dbb7700 1 -- 172.21.15.79:0/737167099 shutdown_connections 2021-04-09T18:33:52.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.188 7f3a8dbb7700 1 -- 172.21.15.79:0/737167099 wait complete. 2021-04-09T18:33:52.204 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:33:52.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0fc0d700 1 Processor -- start 2021-04-09T18:33:52.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0fc0d700 1 -- start start 2021-04-09T18:33:52.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0fc0d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2a080f5550 0x7f2a080f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:52.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0fc0d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a080e9b10 0x7f2a0809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:52.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0fc0d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a080fbb50 con 0x7f2a081c2de0 2021-04-09T18:33:52.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0fc0d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a080e9f60 con 0x7f2a080f5550 2021-04-09T18:33:52.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0fc0d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a080e5a00 con 0x7f2a080e9b10 2021-04-09T18:33:52.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0d9b1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2a080f5550 0x7f2a080f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:52.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0d1b0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a080e9b10 0x7f2a0809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:52.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0e1b2700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2a081c2de0 0x7f2a081c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:56368/0 (socket says 172.21.15.79:56368) 2021-04-09T18:33:52.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0d9b1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2a080f5550 0x7f2a080f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:49526/0 (socket says 172.21.15.79:49526) 2021-04-09T18:33:52.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0e1b2700 1 -- 172.21.15.79:0/2303808612 learned_addr learned my addr 172.21.15.79:0/2303808612 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:52.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0d1b0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a080e9b10 0x7f2a0809f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:58182/0 (socket says 172.21.15.79:58182) 2021-04-09T18:33:52.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0d9b1700 1 -- 172.21.15.79:0/2303808612 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a080e9b10 msgr2=0x7f2a0809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:52.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0d9b1700 1 --2- 172.21.15.79:0/2303808612 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a080e9b10 0x7f2a0809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0d9b1700 1 -- 172.21.15.79:0/2303808612 >> v1:172.21.15.89:6789/0 conn(0x7f2a081c2de0 legacy=0x7f2a081c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:52.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0d9b1700 1 -- 172.21.15.79:0/2303808612 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a080e5700 con 0x7f2a080f5550 2021-04-09T18:33:52.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0d9b1700 1 --2- 172.21.15.79:0/2303808612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a080f5550 0x7f2a080f64e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f2a04002f30 tx=0x7f2a0400bd40).ready entity=mon.1 client_cookie=e4326cc7444102bb server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:52.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0c9af700 1 -- 172.21.15.79:0/2303808612 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2a080e5700 con 0x7f2a080f5550 2021-04-09T18:33:52.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0c9af700 1 -- 172.21.15.79:0/2303808612 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a04009850 con 0x7f2a080f5550 2021-04-09T18:33:52.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0c9af700 1 -- 172.21.15.79:0/2303808612 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2a04009c60 con 0x7f2a080f5550 2021-04-09T18:33:52.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0fc0d700 1 -- 172.21.15.79:0/2303808612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a080f5550 msgr2=0x7f2a080f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:52.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.300 7f2a0fc0d700 1 --2- 172.21.15.79:0/2303808612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a080f5550 0x7f2a080f64e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f2a04002f30 tx=0x7f2a0400bd40).stop 2021-04-09T18:33:52.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.304 7f2a0fc0d700 1 -- 172.21.15.79:0/2303808612 shutdown_connections 2021-04-09T18:33:52.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.304 7f2a0fc0d700 1 --2- 172.21.15.79:0/2303808612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a080f5550 0x7f2a080f64e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.304 7f2a0fc0d700 1 --2- 172.21.15.79:0/2303808612 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a080e9b10 0x7f2a0809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.304 7f2a0fc0d700 1 -- 172.21.15.79:0/2303808612 >> 172.21.15.79:0/2303808612 conn(0x7f2a080e6010 msgr2=0x7f2a080e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:52.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.304 7f2a0fc0d700 1 -- 172.21.15.79:0/2303808612 shutdown_connections 2021-04-09T18:33:52.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.304 7f2a0fc0d700 1 -- 172.21.15.79:0/2303808612 wait complete. 2021-04-09T18:33:52.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0fc0d700 1 Processor -- start 2021-04-09T18:33:52.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0fc0d700 1 -- start start 2021-04-09T18:33:52.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0fc0d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a080d6960 0x7f2a080b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:52.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0fc0d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a080d4320 0x7f2a08093ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:52.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0fc0d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a08094510 0x7f2a08099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:52.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0fc0d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a080d50c0 con 0x7f2a080d6960 2021-04-09T18:33:52.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0fc0d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a080d4770 con 0x7f2a080d4320 2021-04-09T18:33:52.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0fc0d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a080d53c0 con 0x7f2a08094510 2021-04-09T18:33:52.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0d9b1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a080d6960 0x7f2a080b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:52.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0d9b1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a080d6960 0x7f2a080b8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32958/0 (socket says 172.21.15.79:32958) 2021-04-09T18:33:52.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0d9b1700 1 -- 172.21.15.79:0/2387914542 learned_addr learned my addr 172.21.15.79:0/2387914542 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:52.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0e1b2700 1 --2- 172.21.15.79:0/2387914542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a08094510 0x7f2a08099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:52.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0d1b0700 1 --2- 172.21.15.79:0/2387914542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a080d4320 0x7f2a08093ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:52.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0d9b1700 1 -- 172.21.15.79:0/2387914542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a08094510 msgr2=0x7f2a08099a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:52.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0d9b1700 1 --2- 172.21.15.79:0/2387914542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a08094510 0x7f2a08099a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0d9b1700 1 -- 172.21.15.79:0/2387914542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a080d4320 msgr2=0x7f2a08093ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:52.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0d9b1700 1 --2- 172.21.15.79:0/2387914542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a080d4320 0x7f2a08093ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0d9b1700 1 -- 172.21.15.79:0/2387914542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a08094b40 con 0x7f2a080d6960 2021-04-09T18:33:52.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0d9b1700 1 --2- 172.21.15.79:0/2387914542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a080d6960 0x7f2a080b8d60 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f2a080874d0 tx=0x7f2a04006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:52.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f29fe7fc700 1 -- 172.21.15.79:0/2387914542 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2a08094b40 con 0x7f2a080d6960 2021-04-09T18:33:52.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f29fe7fc700 1 -- 172.21.15.79:0/2387914542 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a04011d10 con 0x7f2a080d6960 2021-04-09T18:33:52.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0fc0d700 1 -- 172.21.15.79:0/2387914542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a080b9390 con 0x7f2a080d6960 2021-04-09T18:33:52.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f29fe7fc700 1 -- 172.21.15.79:0/2387914542 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2a0401d630 con 0x7f2a080d6960 2021-04-09T18:33:52.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.308 7f2a0fc0d700 1 -- 172.21.15.79:0/2387914542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a08094d80 con 0x7f2a080d6960 2021-04-09T18:33:52.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.312 7f29fe7fc700 1 -- 172.21.15.79:0/2387914542 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2a04026450 con 0x7f2a080d6960 2021-04-09T18:33:52.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.312 7f29fe7fc700 1 --2- 172.21.15.79:0/2387914542 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f29f0029100 0x7f29f002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:52.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.312 7f29fe7fc700 1 -- 172.21.15.79:0/2387914542 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f2a0403aee0 con 0x7f2a080d6960 2021-04-09T18:33:52.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.312 7f2a0d1b0700 1 --2- 172.21.15.79:0/2387914542 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f29f0029100 0x7f29f002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:52.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.312 7f2a0d1b0700 1 --2- 172.21.15.79:0/2387914542 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f29f0029100 0x7f29f002b650 crc :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:52.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.328 7f2a0fc0d700 1 -- 172.21.15.79:0/2387914542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a080e39f0 con 0x7f2a080d6960 2021-04-09T18:33:52.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.336 7f29fe7fc700 1 -- 172.21.15.79:0/2387914542 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2a04009640 con 0x7f2a080d6960 2021-04-09T18:33:52.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.496 7f2a0fc0d700 1 -- 172.21.15.79:0/2387914542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f2a080f5b50 con 0x7f2a080d6960 2021-04-09T18:33:52.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.496 7f29fe7fc700 1 -- 172.21.15.79:0/2387914542 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v89) v1 ==== 100+0+10 (secure 0 0 0) 0x7f2a04011b00 con 0x7f2a080d6960 2021-04-09T18:33:52.500 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:33:52.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.496 7f2a0fc0d700 1 -- 172.21.15.79:0/2387914542 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f29f0029100 msgr2=0x7f29f002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:52.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.496 7f2a0fc0d700 1 --2- 172.21.15.79:0/2387914542 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f29f0029100 0x7f29f002b650 crc :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.496 7f2a0fc0d700 1 -- 172.21.15.79:0/2387914542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a080d6960 msgr2=0x7f2a080b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:52.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.496 7f2a0fc0d700 1 --2- 172.21.15.79:0/2387914542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a080d6960 0x7f2a080b8d60 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f2a080874d0 tx=0x7f2a04006890).stop 2021-04-09T18:33:52.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.496 7f2a0fc0d700 1 -- 172.21.15.79:0/2387914542 shutdown_connections 2021-04-09T18:33:52.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.496 7f2a0fc0d700 1 --2- 172.21.15.79:0/2387914542 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f29f0029100 0x7f29f002b650 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.496 7f2a0fc0d700 1 --2- 172.21.15.79:0/2387914542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a08094510 0x7f2a08099a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.496 7f2a0fc0d700 1 --2- 172.21.15.79:0/2387914542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a080d6960 0x7f2a080b8d60 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.496 7f2a0fc0d700 1 --2- 172.21.15.79:0/2387914542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a080d4320 0x7f2a08093ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.496 7f2a0fc0d700 1 -- 172.21.15.79:0/2387914542 >> 172.21.15.79:0/2387914542 conn(0x7f2a08099380 msgr2=0x7f2a080baec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:52.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.496 7f2a0fc0d700 1 -- 172.21.15.79:0/2387914542 shutdown_connections 2021-04-09T18:33:52.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.500 7f2a0fc0d700 1 -- 172.21.15.79:0/2387914542 wait complete. 2021-04-09T18:33:52.513 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:33:52.513 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:52.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.600 7f2427e90700 1 Processor -- start 2021-04-09T18:33:52.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.600 7f2427e90700 1 -- start start 2021-04-09T18:33:52.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2427e90700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f24200f5510 0x7f24200f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:52.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2427e90700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24201c8000 0x7f24201ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:52.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2427e90700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24200fbb10 con 0x7f24200e9ad0 2021-04-09T18:33:52.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2427e90700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24200e9f20 con 0x7f24200f5510 2021-04-09T18:33:52.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2427e90700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24201c3db0 con 0x7f24201c8000 2021-04-09T18:33:52.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2425c34700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f24200f5510 0x7f24200f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:52.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2425c34700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f24200f5510 0x7f24200f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32966/0 (socket says 172.21.15.79:32966) 2021-04-09T18:33:52.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2425433700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f24200e9ad0 0x7f242009f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55910/0 (socket says 172.21.15.79:55910) 2021-04-09T18:33:52.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2425c34700 1 -- 172.21.15.79:0/2954853055 learned_addr learned my addr 172.21.15.79:0/2954853055 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:52.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2426435700 1 --2- 172.21.15.79:0/2954853055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24201c8000 0x7f24201ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:52.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2425c34700 1 -- 172.21.15.79:0/2954853055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24201c8000 msgr2=0x7f24201ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:52.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2425c34700 1 --2- 172.21.15.79:0/2954853055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24201c8000 0x7f24201ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2425c34700 1 -- 172.21.15.79:0/2954853055 >> v1:172.21.15.79:6789/0 conn(0x7f24200e9ad0 legacy=0x7f242009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:52.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2425c34700 1 -- 172.21.15.79:0/2954853055 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242009f900 con 0x7f24200f5510 2021-04-09T18:33:52.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2426435700 1 --2- 172.21.15.79:0/2954853055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24201c8000 0x7f24201ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:52.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2425c34700 1 --2- 172.21.15.79:0/2954853055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24200f5510 0x7f24200f64a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f24200f6ef0 tx=0x7f241c00bdd0).ready entity=mon.0 client_cookie=21ba5c9f1d44c8db server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:52.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2424c32700 1 -- 172.21.15.79:0/2954853055 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f242009f900 con 0x7f24200f5510 2021-04-09T18:33:52.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2424c32700 1 -- 172.21.15.79:0/2954853055 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241c009990 con 0x7f24200f5510 2021-04-09T18:33:52.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2424c32700 1 -- 172.21.15.79:0/2954853055 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f241c009d60 con 0x7f24200f5510 2021-04-09T18:33:52.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2427e90700 1 -- 172.21.15.79:0/2954853055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24200f5510 msgr2=0x7f24200f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:52.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2427e90700 1 --2- 172.21.15.79:0/2954853055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24200f5510 0x7f24200f64a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f24200f6ef0 tx=0x7f241c00bdd0).stop 2021-04-09T18:33:52.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2427e90700 1 -- 172.21.15.79:0/2954853055 shutdown_connections 2021-04-09T18:33:52.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2427e90700 1 --2- 172.21.15.79:0/2954853055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24200f5510 0x7f24200f64a0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2427e90700 1 --2- 172.21.15.79:0/2954853055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24201c8000 0x7f24201ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2427e90700 1 -- 172.21.15.79:0/2954853055 >> 172.21.15.79:0/2954853055 conn(0x7f24200e5fd0 msgr2=0x7f24200e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:52.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2427e90700 1 -- 172.21.15.79:0/2954853055 shutdown_connections 2021-04-09T18:33:52.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.604 7f2427e90700 1 -- 172.21.15.79:0/2954853055 wait complete. 2021-04-09T18:33:52.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.608 7f2427e90700 1 Processor -- start 2021-04-09T18:33:52.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f2427e90700 1 -- start start 2021-04-09T18:33:52.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f2427e90700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2420095610 0x7f24201a6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:52.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f2427e90700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24201a6f40 0x7f24201aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:52.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f2427e90700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24201ab050 0x7f24201ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:52.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f2427e90700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2420095310 con 0x7f24201a6f40 2021-04-09T18:33:52.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f2427e90700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24200d7830 con 0x7f2420095610 2021-04-09T18:33:52.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f2427e90700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2420094ba0 con 0x7f24201ab050 2021-04-09T18:33:52.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f2425433700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24201a6f40 0x7f24201aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:52.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f2425433700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24201a6f40 0x7f24201aaa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32974/0 (socket says 172.21.15.79:32974) 2021-04-09T18:33:52.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f2425433700 1 -- 172.21.15.79:0/2375546453 learned_addr learned my addr 172.21.15.79:0/2375546453 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:52.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f2425c34700 1 --2- 172.21.15.79:0/2375546453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2420095610 0x7f24201a6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:52.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f2426435700 1 --2- 172.21.15.79:0/2375546453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24201ab050 0x7f24201ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:52.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f2425433700 1 -- 172.21.15.79:0/2375546453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24201ab050 msgr2=0x7f24201ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:52.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f2425433700 1 --2- 172.21.15.79:0/2375546453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24201ab050 0x7f24201ab4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f2425433700 1 -- 172.21.15.79:0/2375546453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2420095610 msgr2=0x7f24201a6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:52.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f2425433700 1 --2- 172.21.15.79:0/2375546453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2420095610 0x7f24201a6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f2425433700 1 -- 172.21.15.79:0/2375546453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24200d5a10 con 0x7f24201a6f40 2021-04-09T18:33:52.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f2425433700 1 --2- 172.21.15.79:0/2375546453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24201a6f40 0x7f24201aaa20 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f2410000b80 tx=0x7f241000cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:52.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f24167fc700 1 -- 172.21.15.79:0/2375546453 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f24200d5a10 con 0x7f24201a6f40 2021-04-09T18:33:52.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f24167fc700 1 -- 172.21.15.79:0/2375546453 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2410007320 con 0x7f24201a6f40 2021-04-09T18:33:52.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f24167fc700 1 -- 172.21.15.79:0/2375546453 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2410005720 con 0x7f24201a6f40 2021-04-09T18:33:52.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f2427e90700 1 -- 172.21.15.79:0/2375546453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24200d5c70 con 0x7f24201a6f40 2021-04-09T18:33:52.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.612 7f2427e90700 1 -- 172.21.15.79:0/2375546453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24200d6150 con 0x7f24201a6f40 2021-04-09T18:33:52.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.616 7f24167fc700 1 -- 172.21.15.79:0/2375546453 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f241001a020 con 0x7f24201a6f40 2021-04-09T18:33:52.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.616 7f24167fc700 1 --2- 172.21.15.79:0/2375546453 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2408029100 0x7f240802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:52.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.616 7f24167fc700 1 -- 172.21.15.79:0/2375546453 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f2410039130 con 0x7f24201a6f40 2021-04-09T18:33:52.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.616 7f2425c34700 1 --2- 172.21.15.79:0/2375546453 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2408029100 0x7f240802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:52.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.616 7f2425c34700 1 --2- 172.21.15.79:0/2375546453 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2408029100 0x7f240802b650 crc :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:52.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.616 7f2427e90700 1 -- 172.21.15.79:0/2375546453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24200e39d0 con 0x7f24201a6f40 2021-04-09T18:33:52.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.624 7f24167fc700 1 -- 172.21.15.79:0/2375546453 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2410000bf0 con 0x7f24201a6f40 2021-04-09T18:33:52.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.796 7f2427e90700 1 -- 172.21.15.79:0/2375546453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24200a1cb0 con 0x7f24201a6f40 2021-04-09T18:33:52.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.796 7f24167fc700 1 -- 172.21.15.79:0/2375546453 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2103 (secure 0 0 0) 0x7f2410007110 con 0x7f24201a6f40 2021-04-09T18:33:52.801 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:52.802 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":54,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6831,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3171732398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3171732398},{"type":"v1","addr":"172.21.15.79:6833","nonce":3171732398}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":51}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:33:47.856435","modified":"2021-04-09 18:33:49.091531","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6059":{"gid":6059,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/2698757363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2698757363},{"type":"v1","addr":"172.21.15.89:6835","nonce":2698757363}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-04-09T18:33:52.802 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 54 2021-04-09T18:33:52.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.800 7f2427e90700 1 -- 172.21.15.79:0/2375546453 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2408029100 msgr2=0x7f240802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:52.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.800 7f2427e90700 1 --2- 172.21.15.79:0/2375546453 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2408029100 0x7f240802b650 crc :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.800 7f2427e90700 1 -- 172.21.15.79:0/2375546453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24201a6f40 msgr2=0x7f24201aaa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:52.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.800 7f2427e90700 1 --2- 172.21.15.79:0/2375546453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24201a6f40 0x7f24201aaa20 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f2410000b80 tx=0x7f241000cab0).stop 2021-04-09T18:33:52.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.800 7f2427e90700 1 -- 172.21.15.79:0/2375546453 shutdown_connections 2021-04-09T18:33:52.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.800 7f2427e90700 1 --2- 172.21.15.79:0/2375546453 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2408029100 0x7f240802b650 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.800 7f2427e90700 1 --2- 172.21.15.79:0/2375546453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2420095610 0x7f24201a6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.800 7f2427e90700 1 --2- 172.21.15.79:0/2375546453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24201ab050 0x7f24201ab4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.800 7f2427e90700 1 --2- 172.21.15.79:0/2375546453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24201a6f40 0x7f24201aaa20 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:52.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.800 7f2427e90700 1 -- 172.21.15.79:0/2375546453 >> 172.21.15.79:0/2375546453 conn(0x7f24200b9a70 msgr2=0x7f24200bce30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:52.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.800 7f2427e90700 1 -- 172.21.15.79:0/2375546453 shutdown_connections 2021-04-09T18:33:52.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:52.800 7f2427e90700 1 -- 172.21.15.79:0/2375546453 wait complete. 2021-04-09T18:33:53.016 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:33:47.856435', 'modified': '2021-04-09 18:33:49.091531', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6059}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6059': {'gid': 6059, 'name': 'b', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6835/2698757363', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 2698757363}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 2698757363}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:33:53.017 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:33:53.017 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2021-04-09T18:33:53.111 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:33:53.112 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:33:53.112 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2021-04-09T18:33:53.112 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 6059, 2021-04-09T18:33:53.113 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2021-04-09T18:33:53.113 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2021-04-09T18:33:53.113 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 5.2494217049999996, 2021-04-09T18:33:53.113 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 54, 2021-04-09T18:33:53.113 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 89, 2021-04-09T18:33:53.114 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 88, 2021-04-09T18:33:53.114 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 9.6404927449999995 2021-04-09T18:33:53.114 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:33:53.119 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 6059, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.2494217049999996, "mdsmap_epoch": 54, "osdmap_epoch": 89, "osdmap_epoch_barrier": 88, "uptime": 9.6404927449999995 } 2021-04-09T18:33:53.119 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:33:53.120 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-04-09T18:33:53.120 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi090.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-04-09T18:33:53.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:53.121 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:53.129 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:33:53.184 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:33:53.185 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:33:53.240 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:33:53.241 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:33:53.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:53.243 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:33:53.292 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:33:53.292 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:53.336 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:33:53.352 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:33:53.352 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:33:53.411 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:33:53.413 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:33:53.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:53.415 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:33:53.416 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:2021-04-09 18:33:53.411 7f66919db0c0 -1 init, newargv = 0x5618674117a0 newargc=9ceph-fuse[13870]: starting ceph client 2021-04-09T18:33:53.417 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr: 2021-04-09T18:33:53.423 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13870]: starting fuse 2021-04-09T18:33:53.429 INFO:teuthology.orchestra.run.smithi090.stdout:49 2021-04-09T18:33:53.429 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:33:53.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:53.430 DEBUG:teuthology.orchestra.run.smithi090:> sudo python3 -c ' 2021-04-09T18:33:53.431 DEBUG:teuthology.orchestra.run.smithi090:> import glob 2021-04-09T18:33:53.431 DEBUG:teuthology.orchestra.run.smithi090:> import re 2021-04-09T18:33:53.432 DEBUG:teuthology.orchestra.run.smithi090:> import os 2021-04-09T18:33:53.432 DEBUG:teuthology.orchestra.run.smithi090:> import subprocess 2021-04-09T18:33:53.433 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:33:53.433 DEBUG:teuthology.orchestra.run.smithi090:> def find_socket(client_name): 2021-04-09T18:33:53.434 DEBUG:teuthology.orchestra.run.smithi090:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-04-09T18:33:53.434 DEBUG:teuthology.orchestra.run.smithi090:> files = glob.glob(asok_path) 2021-04-09T18:33:53.435 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:33:53.435 DEBUG:teuthology.orchestra.run.smithi090:> # Given a non-glob path, it better be there 2021-04-09T18:33:53.436 DEBUG:teuthology.orchestra.run.smithi090:> if "*" not in asok_path: 2021-04-09T18:33:53.436 DEBUG:teuthology.orchestra.run.smithi090:> assert(len(files) == 1) 2021-04-09T18:33:53.437 DEBUG:teuthology.orchestra.run.smithi090:> return files[0] 2021-04-09T18:33:53.437 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:33:53.437 DEBUG:teuthology.orchestra.run.smithi090:> for f in files: 2021-04-09T18:33:53.438 DEBUG:teuthology.orchestra.run.smithi090:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:33:53.438 DEBUG:teuthology.orchestra.run.smithi090:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:33:53.439 DEBUG:teuthology.orchestra.run.smithi090:> return f 2021-04-09T18:33:53.439 DEBUG:teuthology.orchestra.run.smithi090:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:33:53.439 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:33:53.440 DEBUG:teuthology.orchestra.run.smithi090:> print(find_socket("client.0")) 2021-04-09T18:33:53.440 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:33:53.514 INFO:teuthology.orchestra.run.smithi090.stdout:/var/run/ceph/ceph-client.0.13870.asok 2021-04-09T18:33:53.518 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13870.asok 2021-04-09T18:33:53.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:53.519 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13870.asok status 2021-04-09T18:33:53.640 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2021-04-09T18:33:53.641 INFO:teuthology.orchestra.run.smithi090.stdout: "metadata": { 2021-04-09T18:33:53.641 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:33:53.641 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:33:53.641 INFO:teuthology.orchestra.run.smithi090.stdout: "entity_id": "0", 2021-04-09T18:33:53.642 INFO:teuthology.orchestra.run.smithi090.stdout: "hostname": "smithi090", 2021-04-09T18:33:53.642 INFO:teuthology.orchestra.run.smithi090.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-04-09T18:33:53.642 INFO:teuthology.orchestra.run.smithi090.stdout: "pid": "13870", 2021-04-09T18:33:53.642 INFO:teuthology.orchestra.run.smithi090.stdout: "root": "/" 2021-04-09T18:33:53.643 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:33:53.643 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_count": 0, 2021-04-09T18:33:53.643 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_pinned_count": 0, 2021-04-09T18:33:53.643 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 6994, 2021-04-09T18:33:53.644 INFO:teuthology.orchestra.run.smithi090.stdout: "inst": { 2021-04-09T18:33:53.644 INFO:teuthology.orchestra.run.smithi090.stdout: "name": { 2021-04-09T18:33:53.644 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "client", 2021-04-09T18:33:53.644 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6994 2021-04-09T18:33:53.645 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:33:53.645 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:33:53.645 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:33:53.645 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:33:53.645 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 3206674751 2021-04-09T18:33:53.646 INFO:teuthology.orchestra.run.smithi090.stdout: } 2021-04-09T18:33:53.646 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:33:53.646 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:33:53.646 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:33:53.647 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:33:53.647 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 3206674751 2021-04-09T18:33:53.647 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:33:53.647 INFO:teuthology.orchestra.run.smithi090.stdout: "inst_str": "client.6994 172.21.15.90:0/3206674751", 2021-04-09T18:33:53.648 INFO:teuthology.orchestra.run.smithi090.stdout: "addr_str": "172.21.15.90:0/3206674751", 2021-04-09T18:33:53.648 INFO:teuthology.orchestra.run.smithi090.stdout: "inode_count": 1, 2021-04-09T18:33:53.648 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_epoch": 54, 2021-04-09T18:33:53.648 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch": 89, 2021-04-09T18:33:53.648 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:33:53.649 INFO:teuthology.orchestra.run.smithi090.stdout: "blacklisted": false, 2021-04-09T18:33:53.649 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs" 2021-04-09T18:33:53.649 INFO:teuthology.orchestra.run.smithi090.stdout:} 2021-04-09T18:33:53.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:53.651 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:53.651 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:53.659 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:33:53.660 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:33:53.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:53.661 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:53.718 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:33:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.812 7f4a4bd7d700 1 Processor -- start 2021-04-09T18:33:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.812 7f4a4bd7d700 1 -- start start 2021-04-09T18:33:53.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.812 7f4a4bd7d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a440f5510 0x7f4a440f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:53.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.812 7f4a4bd7d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4a441c8000 0x7f4a441ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:53.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.812 7f4a4bd7d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a440fbb10 con 0x7f4a440e9ad0 2021-04-09T18:33:53.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.812 7f4a4bd7d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a440e9f20 con 0x7f4a441c8000 2021-04-09T18:33:53.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.812 7f4a4bd7d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a441c3db0 con 0x7f4a440f5510 2021-04-09T18:33:53.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.812 7f4a49b21700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a440f5510 0x7f4a440f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:53.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.812 7f4a49b21700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a440f5510 0x7f4a440f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:58208/0 (socket says 172.21.15.79:58208) 2021-04-09T18:33:53.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.812 7f4a49b21700 1 -- 172.21.15.79:0/1476793726 learned_addr learned my addr 172.21.15.79:0/1476793726 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:53.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.812 7f4a49320700 1 --1- 172.21.15.79:0/1476793726 >> v1:172.21.15.89:6789/0 conn(0x7f4a440e9ad0 0x7f4a4409f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:56394/0 (socket says 172.21.15.79:56394) 2021-04-09T18:33:53.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.812 7f4a4a322700 1 --2- 172.21.15.79:0/1476793726 >> v2:172.21.15.89:3300/0 conn(0x7f4a441c8000 0x7f4a441ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:53.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.816 7f4a48b1f700 1 -- 172.21.15.79:0/1476793726 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829097923 0 0) 0x7f4a380010d0 con 0x7f4a440e9ad0 2021-04-09T18:33:53.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.816 7f4a48b1f700 1 -- 172.21.15.79:0/1476793726 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a30003240 con 0x7f4a440e9ad0 2021-04-09T18:33:53.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.816 7f4a49b21700 1 -- 172.21.15.79:0/1476793726 >> v2:172.21.15.89:3300/0 conn(0x7f4a441c8000 msgr2=0x7f4a441ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:53.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.816 7f4a49b21700 1 --2- 172.21.15.79:0/1476793726 >> v2:172.21.15.89:3300/0 conn(0x7f4a441c8000 0x7f4a441ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:53.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.816 7f4a49b21700 1 -- 172.21.15.79:0/1476793726 >> v1:172.21.15.89:6789/0 conn(0x7f4a440e9ad0 legacy=0x7f4a4409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:53.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.816 7f4a49b21700 1 -- 172.21.15.79:0/1476793726 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4409f900 con 0x7f4a440f5510 2021-04-09T18:33:53.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.816 7f4a4a322700 1 --2- 172.21.15.79:0/1476793726 >> v2:172.21.15.89:3300/0 conn(0x7f4a441c8000 0x7f4a441ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:53.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.816 7f4a49b21700 1 --2- 172.21.15.79:0/1476793726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a440f5510 0x7f4a440f64a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f4a400032b0 tx=0x7f4a4000b3c0).ready entity=mon.2 client_cookie=ef243f4cace54ce server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:53.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.816 7f4a48b1f700 1 -- 172.21.15.79:0/1476793726 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a4409f900 con 0x7f4a440f5510 2021-04-09T18:33:53.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.816 7f4a48b1f700 1 -- 172.21.15.79:0/1476793726 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4000bca0 con 0x7f4a440f5510 2021-04-09T18:33:53.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.816 7f4a48b1f700 1 -- 172.21.15.79:0/1476793726 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a40002020 con 0x7f4a440f5510 2021-04-09T18:33:53.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.816 7f4a4bd7d700 1 -- 172.21.15.79:0/1476793726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a440f5510 msgr2=0x7f4a440f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:53.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.816 7f4a4bd7d700 1 --2- 172.21.15.79:0/1476793726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a440f5510 0x7f4a440f64a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f4a400032b0 tx=0x7f4a4000b3c0).stop 2021-04-09T18:33:53.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.816 7f4a4bd7d700 1 -- 172.21.15.79:0/1476793726 shutdown_connections 2021-04-09T18:33:53.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.816 7f4a4bd7d700 1 --2- 172.21.15.79:0/1476793726 >> v2:172.21.15.89:3300/0 conn(0x7f4a441c8000 0x7f4a441ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:53.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.816 7f4a4bd7d700 1 --2- 172.21.15.79:0/1476793726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a440f5510 0x7f4a440f64a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:53.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.816 7f4a4bd7d700 1 -- 172.21.15.79:0/1476793726 >> 172.21.15.79:0/1476793726 conn(0x7f4a440e5fd0 msgr2=0x7f4a440e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:53.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.816 7f4a4bd7d700 1 -- 172.21.15.79:0/1476793726 shutdown_connections 2021-04-09T18:33:53.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.816 7f4a4bd7d700 1 -- 172.21.15.79:0/1476793726 wait complete. 2021-04-09T18:33:53.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.820 7f4a4bd7d700 1 Processor -- start 2021-04-09T18:33:53.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.820 7f4a4bd7d700 1 -- start start 2021-04-09T18:33:53.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.820 7f4a4bd7d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a440c0fe0 0x7f4a4419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:53.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.820 7f4a4bd7d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a440c1430 0x7f4a440985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:53.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.820 7f4a4bd7d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a440d4df0 0x7f4a440d5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:53.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.820 7f4a4bd7d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a440e8ae0 con 0x7f4a440c1430 2021-04-09T18:33:53.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.820 7f4a4bd7d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a44098000 con 0x7f4a440c0fe0 2021-04-09T18:33:53.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.820 7f4a4bd7d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a44098300 con 0x7f4a440d4df0 2021-04-09T18:33:53.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.820 7f4a49320700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a440c1430 0x7f4a440985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:53.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.820 7f4a49320700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a440c1430 0x7f4a440985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:32988/0 (socket says 172.21.15.79:32988) 2021-04-09T18:33:53.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.824 7f4a49320700 1 -- 172.21.15.79:0/3470766705 learned_addr learned my addr 172.21.15.79:0/3470766705 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:53.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.824 7f4a4a322700 1 --2- 172.21.15.79:0/3470766705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a440d4df0 0x7f4a440d5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:53.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.824 7f4a49b21700 1 --2- 172.21.15.79:0/3470766705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a440c0fe0 0x7f4a4419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.824 7f4a49320700 1 -- 172.21.15.79:0/3470766705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a440d4df0 msgr2=0x7f4a440d5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.824 7f4a49320700 1 --2- 172.21.15.79:0/3470766705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a440d4df0 0x7f4a440d5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:53.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.824 7f4a49320700 1 -- 172.21.15.79:0/3470766705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a440c0fe0 msgr2=0x7f4a4419dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:53.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.824 7f4a49320700 1 --2- 172.21.15.79:0/3470766705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a440c0fe0 0x7f4a4419dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:53.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.824 7f4a49320700 1 -- 172.21.15.79:0/3470766705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a44097bb0 con 0x7f4a440c1430 2021-04-09T18:33:53.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.824 7f4a49320700 1 --2- 172.21.15.79:0/3470766705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a440c1430 0x7f4a440985d0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7f4a440b0490 tx=0x7f4a3800ca80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:53.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.824 7f4a367fc700 1 -- 172.21.15.79:0/3470766705 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a44097bb0 con 0x7f4a440c1430 2021-04-09T18:33:53.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.824 7f4a367fc700 1 -- 172.21.15.79:0/3470766705 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a38007320 con 0x7f4a440c1430 2021-04-09T18:33:53.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.824 7f4a4bd7d700 1 -- 172.21.15.79:0/3470766705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4419e210 con 0x7f4a440c1430 2021-04-09T18:33:53.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.824 7f4a367fc700 1 -- 172.21.15.79:0/3470766705 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a38005720 con 0x7f4a440c1430 2021-04-09T18:33:53.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.824 7f4a4bd7d700 1 -- 172.21.15.79:0/3470766705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a44097890 con 0x7f4a440c1430 2021-04-09T18:33:53.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.824 7f4a367fc700 1 -- 172.21.15.79:0/3470766705 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4a3801a060 con 0x7f4a440c1430 2021-04-09T18:33:53.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.824 7f4a367fc700 1 --2- 172.21.15.79:0/3470766705 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a2c029100 0x7f4a2c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:53.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.824 7f4a367fc700 1 -- 172.21.15.79:0/3470766705 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f4a38038d70 con 0x7f4a440c1430 2021-04-09T18:33:53.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.824 7f4a49b21700 1 --2- 172.21.15.79:0/3470766705 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a2c029100 0x7f4a2c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:53.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.824 7f4a49b21700 1 --2- 172.21.15.79:0/3470766705 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a2c029100 0x7f4a2c02b650 crc :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:53.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.828 7f4a4bd7d700 1 -- 172.21.15.79:0/3470766705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a440e39d0 con 0x7f4a440c1430 2021-04-09T18:33:53.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.832 7f4a367fc700 1 -- 172.21.15.79:0/3470766705 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4a38007110 con 0x7f4a440c1430 2021-04-09T18:33:54.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:53.996 7f4a4bd7d700 1 -- 172.21.15.79:0/3470766705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a440f5b10 con 0x7f4a440c1430 2021-04-09T18:33:54.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.000 7f4a367fc700 1 -- 172.21.15.79:0/3470766705 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+14229 (secure 0 0 0) 0x7f4a440e5c90 con 0x7f4a440c1430 2021-04-09T18:33:54.005 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:54.005 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":89,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:33:49.861312","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:33:46.135398","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2021-04-09 18:33:47.443962","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:33:54.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.004 7f4a4bd7d700 1 -- 172.21.15.79:0/3470766705 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a2c029100 msgr2=0x7f4a2c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.004 7f4a4bd7d700 1 --2- 172.21.15.79:0/3470766705 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a2c029100 0x7f4a2c02b650 crc :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.004 7f4a4bd7d700 1 -- 172.21.15.79:0/3470766705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a440c1430 msgr2=0x7f4a440985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.004 7f4a4bd7d700 1 --2- 172.21.15.79:0/3470766705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a440c1430 0x7f4a440985d0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7f4a440b0490 tx=0x7f4a3800ca80).stop 2021-04-09T18:33:54.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.004 7f4a4bd7d700 1 -- 172.21.15.79:0/3470766705 shutdown_connections 2021-04-09T18:33:54.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.004 7f4a4bd7d700 1 --2- 172.21.15.79:0/3470766705 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a2c029100 0x7f4a2c02b650 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.004 7f4a4bd7d700 1 --2- 172.21.15.79:0/3470766705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a440c0fe0 0x7f4a4419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.004 7f4a4bd7d700 1 --2- 172.21.15.79:0/3470766705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a440d4df0 0x7f4a440d5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.004 7f4a4bd7d700 1 --2- 172.21.15.79:0/3470766705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a440c1430 0x7f4a440985d0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.004 7f4a4bd7d700 1 -- 172.21.15.79:0/3470766705 >> 172.21.15.79:0/3470766705 conn(0x7f4a4409aa30 msgr2=0x7f4a440a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:54.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.004 7f4a4bd7d700 1 -- 172.21.15.79:0/3470766705 shutdown_connections 2021-04-09T18:33:54.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.004 7f4a4bd7d700 1 -- 172.21.15.79:0/3470766705 wait complete. 2021-04-09T18:33:54.018 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:33:46.135398', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:33:47.443962', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:33:54.019 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:33:54.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.108 7f88ccd93700 1 Processor -- start 2021-04-09T18:33:54.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.108 7f88ccd93700 1 -- start start 2021-04-09T18:33:54.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.108 7f88ccd93700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f88c80e9b10 0x7f88c809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.108 7f88ccd93700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88c81c8040 0x7f88c81ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.108 7f88ccd93700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c80fbb50 con 0x7f88c80f5550 2021-04-09T18:33:54.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.108 7f88ccd93700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c81c3df0 con 0x7f88c80e9b10 2021-04-09T18:33:54.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.108 7f88ccd93700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80e9f60 con 0x7f88c81c8040 2021-04-09T18:33:54.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.108 7f88c72f0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88c81c8040 0x7f88c81ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.108 7f88c62ee700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f88c80e9b10 0x7f88c809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.108 7f88c6aef700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f88c80f5550 0x7f88c80f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:56406/0 (socket says 172.21.15.79:56406) 2021-04-09T18:33:54.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.108 7f88c6aef700 1 -- 172.21.15.79:0/2534968099 learned_addr learned my addr 172.21.15.79:0/2534968099 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:54.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.112 7f88c72f0700 1 -- 172.21.15.79:0/2534968099 >> v2:172.21.15.89:3300/0 conn(0x7f88c80e9b10 msgr2=0x7f88c809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:54.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.112 7f88c72f0700 1 --2- 172.21.15.79:0/2534968099 >> v2:172.21.15.89:3300/0 conn(0x7f88c80e9b10 0x7f88c809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.112 7f88c72f0700 1 -- 172.21.15.79:0/2534968099 >> v1:172.21.15.89:6789/0 conn(0x7f88c80f5550 legacy=0x7f88c80f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.112 7f88c72f0700 1 -- 172.21.15.79:0/2534968099 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c80e5700 con 0x7f88c81c8040 2021-04-09T18:33:54.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.112 7f88c62ee700 1 --2- 172.21.15.79:0/2534968099 >> v2:172.21.15.89:3300/0 conn(0x7f88c80e9b10 0x7f88c809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:54.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.112 7f88c72f0700 1 --2- 172.21.15.79:0/2534968099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88c81c8040 0x7f88c81ca4a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f88c00032b0 tx=0x7f88c000b0e0).ready entity=mon.2 client_cookie=860b4a33863e226d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:54.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.112 7f88c5aed700 1 -- 172.21.15.79:0/2534968099 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88c80e5700 con 0x7f88c81c8040 2021-04-09T18:33:54.126 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.112 7f88c5aed700 1 -- 172.21.15.79:0/2534968099 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c000bab0 con 0x7f88c81c8040 2021-04-09T18:33:54.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.112 7f88c5aed700 1 -- 172.21.15.79:0/2534968099 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88c0002020 con 0x7f88c81c8040 2021-04-09T18:33:54.127 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.112 7f88ccd93700 1 -- 172.21.15.79:0/2534968099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88c81c8040 msgr2=0x7f88c81ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.112 7f88ccd93700 1 --2- 172.21.15.79:0/2534968099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88c81c8040 0x7f88c81ca4a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f88c00032b0 tx=0x7f88c000b0e0).stop 2021-04-09T18:33:54.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.112 7f88ccd93700 1 -- 172.21.15.79:0/2534968099 shutdown_connections 2021-04-09T18:33:54.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.112 7f88ccd93700 1 --2- 172.21.15.79:0/2534968099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88c81c8040 0x7f88c81ca4a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.112 7f88ccd93700 1 --2- 172.21.15.79:0/2534968099 >> v2:172.21.15.89:3300/0 conn(0x7f88c80e9b10 0x7f88c809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.128 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.112 7f88ccd93700 1 -- 172.21.15.79:0/2534968099 >> 172.21.15.79:0/2534968099 conn(0x7f88c80e6010 msgr2=0x7f88c80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:54.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.112 7f88ccd93700 1 -- 172.21.15.79:0/2534968099 shutdown_connections 2021-04-09T18:33:54.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.112 7f88ccd93700 1 -- 172.21.15.79:0/2534968099 wait complete. 2021-04-09T18:33:54.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.116 7f88ccd93700 1 Processor -- start 2021-04-09T18:33:54.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.116 7f88ccd93700 1 -- start start 2021-04-09T18:33:54.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.116 7f88ccd93700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88c80baab0 0x7f88c808f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.116 7f88ccd93700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88c80a5800 0x7f88c808fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.116 7f88ccd93700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88c81a65b0 0x7f88c81a6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.116 7f88ccd93700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c8088590 con 0x7f88c80a5800 2021-04-09T18:33:54.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.116 7f88ccd93700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80926b0 con 0x7f88c80baab0 2021-04-09T18:33:54.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.116 7f88ccd93700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c808f6a0 con 0x7f88c81a65b0 2021-04-09T18:33:54.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.116 7f88c62ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88c80a5800 0x7f88c808fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88c62ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88c80a5800 0x7f88c808fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33004/0 (socket says 172.21.15.79:33004) 2021-04-09T18:33:54.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88c62ee700 1 -- 172.21.15.79:0/3528256939 learned_addr learned my addr 172.21.15.79:0/3528256939 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:54.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88c72f0700 1 --2- 172.21.15.79:0/3528256939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88c81a65b0 0x7f88c81a6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88c6aef700 1 --2- 172.21.15.79:0/3528256939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88c80baab0 0x7f88c808f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88c62ee700 1 -- 172.21.15.79:0/3528256939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88c81a65b0 msgr2=0x7f88c81a6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88c62ee700 1 --2- 172.21.15.79:0/3528256939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88c81a65b0 0x7f88c81a6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88c62ee700 1 -- 172.21.15.79:0/3528256939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88c80baab0 msgr2=0x7f88c808f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88c62ee700 1 --2- 172.21.15.79:0/3528256939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88c80baab0 0x7f88c808f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88c62ee700 1 -- 172.21.15.79:0/3528256939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c8092240 con 0x7f88c80a5800 2021-04-09T18:33:54.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88c6aef700 1 --2- 172.21.15.79:0/3528256939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88c80baab0 0x7f88c808f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:54.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88c62ee700 1 --2- 172.21.15.79:0/3528256939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88c80a5800 0x7f88c808fa10 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f88bc00efc0 tx=0x7f88bc00c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:54.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88b77fe700 1 -- 172.21.15.79:0/3528256939 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88c8092240 con 0x7f88c80a5800 2021-04-09T18:33:54.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88b77fe700 1 -- 172.21.15.79:0/3528256939 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88bc00cdc0 con 0x7f88c80a5800 2021-04-09T18:33:54.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88ccd93700 1 -- 172.21.15.79:0/3528256939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c80929b0 con 0x7f88c80a5800 2021-04-09T18:33:54.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88b77fe700 1 -- 172.21.15.79:0/3528256939 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88bc00f040 con 0x7f88c80a5800 2021-04-09T18:33:54.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88ccd93700 1 -- 172.21.15.79:0/3528256939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c80901d0 con 0x7f88c80a5800 2021-04-09T18:33:54.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88b77fe700 1 -- 172.21.15.79:0/3528256939 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f88bc011070 con 0x7f88c80a5800 2021-04-09T18:33:54.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88b77fe700 1 --2- 172.21.15.79:0/3528256939 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f88ac029100 0x7f88ac02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88b77fe700 1 -- 172.21.15.79:0/3528256939 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f88bc010040 con 0x7f88c80a5800 2021-04-09T18:33:54.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88c6aef700 1 --2- 172.21.15.79:0/3528256939 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f88ac029100 0x7f88ac02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88c6aef700 1 --2- 172.21.15.79:0/3528256939 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f88ac029100 0x7f88ac02b650 crc :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:54.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.120 7f88ccd93700 1 -- 172.21.15.79:0/3528256939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c80e39f0 con 0x7f88c80a5800 2021-04-09T18:33:54.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.128 7f88b77fe700 1 -- 172.21.15.79:0/3528256939 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f88bc00c9c0 con 0x7f88c80a5800 2021-04-09T18:33:54.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.288 7f88ccd93700 1 -- 172.21.15.79:0/3528256939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f88c80f5b50 con 0x7f88c80a5800 2021-04-09T18:33:54.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.288 7f88b77fe700 1 -- 172.21.15.79:0/3528256939 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v89) v1 ==== 92+0+10 (secure 0 0 0) 0x7f88bc000bf0 con 0x7f88c80a5800 2021-04-09T18:33:54.296 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:33:54.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.292 7f88ccd93700 1 -- 172.21.15.79:0/3528256939 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f88ac029100 msgr2=0x7f88ac02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.292 7f88ccd93700 1 --2- 172.21.15.79:0/3528256939 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f88ac029100 0x7f88ac02b650 crc :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.292 7f88ccd93700 1 -- 172.21.15.79:0/3528256939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88c80a5800 msgr2=0x7f88c808fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.292 7f88ccd93700 1 --2- 172.21.15.79:0/3528256939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88c80a5800 0x7f88c808fa10 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f88bc00efc0 tx=0x7f88bc00c430).stop 2021-04-09T18:33:54.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.292 7f88ccd93700 1 -- 172.21.15.79:0/3528256939 shutdown_connections 2021-04-09T18:33:54.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.292 7f88ccd93700 1 --2- 172.21.15.79:0/3528256939 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f88ac029100 0x7f88ac02b650 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.292 7f88ccd93700 1 --2- 172.21.15.79:0/3528256939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88c80baab0 0x7f88c808f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.292 7f88ccd93700 1 --2- 172.21.15.79:0/3528256939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88c81a65b0 0x7f88c81a6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.292 7f88ccd93700 1 --2- 172.21.15.79:0/3528256939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88c80a5800 0x7f88c808fa10 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.292 7f88ccd93700 1 -- 172.21.15.79:0/3528256939 >> 172.21.15.79:0/3528256939 conn(0x7f88c80946c0 msgr2=0x7f88c8095d70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:54.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.292 7f88ccd93700 1 -- 172.21.15.79:0/3528256939 shutdown_connections 2021-04-09T18:33:54.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.292 7f88ccd93700 1 -- 172.21.15.79:0/3528256939 wait complete. 2021-04-09T18:33:54.307 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:33:54.411 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27fdecf700 1 Processor -- start 2021-04-09T18:33:54.411 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27fdecf700 1 -- start start 2021-04-09T18:33:54.411 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27fdecf700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27f80f5550 0x7f27f80f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.412 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27fdecf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27f81c8040 0x7f27f81ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.412 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27fdecf700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f80fbb50 con 0x7f27f80e9b10 2021-04-09T18:33:54.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27fdecf700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f80e9f60 con 0x7f27f80f5550 2021-04-09T18:33:54.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27fdecf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f81c3df0 con 0x7f27f81c8040 2021-04-09T18:33:54.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27f77fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27f80f5550 0x7f27f80f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27f6ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f27f80e9b10 0x7f27f809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55952/0 (socket says 172.21.15.79:55952) 2021-04-09T18:33:54.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27f6ffd700 1 -- 172.21.15.79:0/3342608815 learned_addr learned my addr 172.21.15.79:0/3342608815 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:54.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27f7fff700 1 --2- 172.21.15.79:0/3342608815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27f81c8040 0x7f27f81ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27f67fc700 1 -- 172.21.15.79:0/3342608815 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055776852 0 0) 0x7f27ec0010d0 con 0x7f27f80e9b10 2021-04-09T18:33:54.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27f67fc700 1 -- 172.21.15.79:0/3342608815 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27e0003240 con 0x7f27f80e9b10 2021-04-09T18:33:54.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27f77fe700 1 -- 172.21.15.79:0/3342608815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27f81c8040 msgr2=0x7f27f81ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:54.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27f77fe700 1 --2- 172.21.15.79:0/3342608815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27f81c8040 0x7f27f81ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27f77fe700 1 -- 172.21.15.79:0/3342608815 >> v1:172.21.15.79:6789/0 conn(0x7f27f80e9b10 legacy=0x7f27f809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27f77fe700 1 -- 172.21.15.79:0/3342608815 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f809f910 con 0x7f27f80f5550 2021-04-09T18:33:54.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27f77fe700 1 --2- 172.21.15.79:0/3342608815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f80f5550 0x7f27f80f64e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f27f80f6f30 tx=0x7f27e800bd70).ready entity=mon.0 client_cookie=25b67432c4341814 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:54.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27f67fc700 1 -- 172.21.15.79:0/3342608815 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f27f809f910 con 0x7f27f80f5550 2021-04-09T18:33:54.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27f67fc700 1 -- 172.21.15.79:0/3342608815 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e8009810 con 0x7f27f80f5550 2021-04-09T18:33:54.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27f67fc700 1 -- 172.21.15.79:0/3342608815 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f27e8009be0 con 0x7f27f80f5550 2021-04-09T18:33:54.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27fdecf700 1 -- 172.21.15.79:0/3342608815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f80f5550 msgr2=0x7f27f80f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.400 7f27fdecf700 1 --2- 172.21.15.79:0/3342608815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f80f5550 0x7f27f80f64e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f27f80f6f30 tx=0x7f27e800bd70).stop 2021-04-09T18:33:54.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.404 7f27fdecf700 1 -- 172.21.15.79:0/3342608815 shutdown_connections 2021-04-09T18:33:54.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.404 7f27fdecf700 1 --2- 172.21.15.79:0/3342608815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f80f5550 0x7f27f80f64e0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.404 7f27fdecf700 1 --2- 172.21.15.79:0/3342608815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27f81c8040 0x7f27f81ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.404 7f27fdecf700 1 -- 172.21.15.79:0/3342608815 >> 172.21.15.79:0/3342608815 conn(0x7f27f80e6010 msgr2=0x7f27f80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:54.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.404 7f27fdecf700 1 -- 172.21.15.79:0/3342608815 shutdown_connections 2021-04-09T18:33:54.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.404 7f27fdecf700 1 -- 172.21.15.79:0/3342608815 wait complete. 2021-04-09T18:33:54.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27fdecf700 1 Processor -- start 2021-04-09T18:33:54.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27fdecf700 1 -- start start 2021-04-09T18:33:54.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27fdecf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f819ba10 0x7f27f8098340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27fdecf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27f8098970 0x7f27f80c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27fdecf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27f819be60 0x7f27f80c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27fdecf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f8098040 con 0x7f27f819ba10 2021-04-09T18:33:54.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27fdecf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80978d0 con 0x7f27f8098970 2021-04-09T18:33:54.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27fdecf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80bfe80 con 0x7f27f819be60 2021-04-09T18:33:54.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27f77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f819ba10 0x7f27f8098340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27f77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f819ba10 0x7f27f8098340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33014/0 (socket says 172.21.15.79:33014) 2021-04-09T18:33:54.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27f77fe700 1 -- 172.21.15.79:0/3983532195 learned_addr learned my addr 172.21.15.79:0/3983532195 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:54.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27f7fff700 1 --2- 172.21.15.79:0/3983532195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27f819be60 0x7f27f80c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27f6ffd700 1 --2- 172.21.15.79:0/3983532195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27f8098970 0x7f27f80c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27f77fe700 1 -- 172.21.15.79:0/3983532195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27f819be60 msgr2=0x7f27f80c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27f77fe700 1 --2- 172.21.15.79:0/3983532195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27f819be60 0x7f27f80c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27f77fe700 1 -- 172.21.15.79:0/3983532195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27f8098970 msgr2=0x7f27f80c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27f77fe700 1 --2- 172.21.15.79:0/3983532195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27f8098970 0x7f27f80c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27f77fe700 1 -- 172.21.15.79:0/3983532195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f8097bf0 con 0x7f27f819ba10 2021-04-09T18:33:54.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27f6ffd700 1 --2- 172.21.15.79:0/3983532195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27f8098970 0x7f27f80c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:54.429 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27f77fe700 1 --2- 172.21.15.79:0/3983532195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f819ba10 0x7f27f8098340 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f27f80f6f30 tx=0x7f27e8006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:54.429 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27dffff700 1 -- 172.21.15.79:0/3983532195 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f27f8097bf0 con 0x7f27f819ba10 2021-04-09T18:33:54.429 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27dffff700 1 -- 172.21.15.79:0/3983532195 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e8018580 con 0x7f27f819ba10 2021-04-09T18:33:54.430 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27fdecf700 1 -- 172.21.15.79:0/3983532195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f80c70f0 con 0x7f27f819ba10 2021-04-09T18:33:54.430 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27dffff700 1 -- 172.21.15.79:0/3983532195 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f27e8018760 con 0x7f27f819ba10 2021-04-09T18:33:54.430 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.408 7f27fdecf700 1 -- 172.21.15.79:0/3983532195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f80bb270 con 0x7f27f819ba10 2021-04-09T18:33:54.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.412 7f27dffff700 1 -- 172.21.15.79:0/3983532195 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f27e8018960 con 0x7f27f819ba10 2021-04-09T18:33:54.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.412 7f27dffff700 1 --2- 172.21.15.79:0/3983532195 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f27d8029100 0x7f27d802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.412 7f27dffff700 1 -- 172.21.15.79:0/3983532195 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f27e803a440 con 0x7f27f819ba10 2021-04-09T18:33:54.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.412 7f27f6ffd700 1 --2- 172.21.15.79:0/3983532195 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f27d8029100 0x7f27d802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.412 7f27fdecf700 1 -- 172.21.15.79:0/3983532195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f80e39f0 con 0x7f27f819ba10 2021-04-09T18:33:54.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.412 7f27f6ffd700 1 --2- 172.21.15.79:0/3983532195 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f27d8029100 0x7f27d802b650 crc :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:54.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.420 7f27dffff700 1 -- 172.21.15.79:0/3983532195 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f27e8018370 con 0x7f27f819ba10 2021-04-09T18:33:54.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.572 7f27fdecf700 1 -- 172.21.15.79:0/3983532195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f27f80f5b50 con 0x7f27f819ba10 2021-04-09T18:33:54.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.572 7f27dffff700 1 -- 172.21.15.79:0/3983532195 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v89) v1 ==== 104+0+10 (secure 0 0 0) 0x7f27e8009600 con 0x7f27f819ba10 2021-04-09T18:33:54.579 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:33:54.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.576 7f27fdecf700 1 -- 172.21.15.79:0/3983532195 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f27d8029100 msgr2=0x7f27d802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.576 7f27fdecf700 1 --2- 172.21.15.79:0/3983532195 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f27d8029100 0x7f27d802b650 crc :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.576 7f27fdecf700 1 -- 172.21.15.79:0/3983532195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f819ba10 msgr2=0x7f27f8098340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.576 7f27fdecf700 1 --2- 172.21.15.79:0/3983532195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f819ba10 0x7f27f8098340 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f27f80f6f30 tx=0x7f27e8006890).stop 2021-04-09T18:33:54.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.576 7f27fdecf700 1 -- 172.21.15.79:0/3983532195 shutdown_connections 2021-04-09T18:33:54.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.576 7f27fdecf700 1 --2- 172.21.15.79:0/3983532195 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f27d8029100 0x7f27d802b650 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.576 7f27fdecf700 1 --2- 172.21.15.79:0/3983532195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27f819be60 0x7f27f80c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.576 7f27fdecf700 1 --2- 172.21.15.79:0/3983532195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f819ba10 0x7f27f8098340 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.576 7f27fdecf700 1 --2- 172.21.15.79:0/3983532195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27f8098970 0x7f27f80c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.576 7f27fdecf700 1 -- 172.21.15.79:0/3983532195 >> 172.21.15.79:0/3983532195 conn(0x7f27f809aa60 msgr2=0x7f27f80d8160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:54.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.576 7f27fdecf700 1 -- 172.21.15.79:0/3983532195 shutdown_connections 2021-04-09T18:33:54.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.576 7f27fdecf700 1 -- 172.21.15.79:0/3983532195 wait complete. 2021-04-09T18:33:54.590 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:33:54.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.684 7f48c1a7c700 1 Processor -- start 2021-04-09T18:33:54.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.684 7f48c1a7c700 1 -- start start 2021-04-09T18:33:54.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48c1a7c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f48bc0e9b10 0x7f48bc09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48c1a7c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48bc1c8040 0x7f48bc1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48c1a7c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48bc0fbb50 con 0x7f48bc0f5550 2021-04-09T18:33:54.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48c1a7c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48bc1c3df0 con 0x7f48bc0e9b10 2021-04-09T18:33:54.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48c1a7c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc0e9f60 con 0x7f48bc1c8040 2021-04-09T18:33:54.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48baffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f48bc0e9b10 0x7f48bc09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48bb7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f48bc0f5550 0x7f48bc0f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55964/0 (socket says 172.21.15.79:55964) 2021-04-09T18:33:54.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48bb7fe700 1 -- 172.21.15.79:0/2256971809 learned_addr learned my addr 172.21.15.79:0/2256971809 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:54.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48bbfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48bc1c8040 0x7f48bc1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48baffd700 1 -- 172.21.15.79:0/2256971809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48bc1c8040 msgr2=0x7f48bc1ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:54.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48baffd700 1 --2- 172.21.15.79:0/2256971809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48bc1c8040 0x7f48bc1ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48baffd700 1 -- 172.21.15.79:0/2256971809 >> v1:172.21.15.79:6789/0 conn(0x7f48bc0f5550 legacy=0x7f48bc0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48ba7fc700 1 -- 172.21.15.79:0/2256971809 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296682091 0 0) 0x7f48ac0010d0 con 0x7f48bc0f5550 2021-04-09T18:33:54.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48baffd700 1 -- 172.21.15.79:0/2256971809 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc0e5700 con 0x7f48bc0e9b10 2021-04-09T18:33:54.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48bbfff700 1 --2- 172.21.15.79:0/2256971809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48bc1c8040 0x7f48bc1ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:54.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48baffd700 1 --2- 172.21.15.79:0/2256971809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc0e9b10 0x7f48bc09f110 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f48bc0f6f30 tx=0x7f48b000b3c0).ready entity=mon.0 client_cookie=3d54148ac0d1d363 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:54.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48ba7fc700 1 -- 172.21.15.79:0/2256971809 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48bc0e5700 con 0x7f48bc0e9b10 2021-04-09T18:33:54.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48ba7fc700 1 -- 172.21.15.79:0/2256971809 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b000bbe0 con 0x7f48bc0e9b10 2021-04-09T18:33:54.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48ba7fc700 1 -- 172.21.15.79:0/2256971809 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48b0002020 con 0x7f48bc0e9b10 2021-04-09T18:33:54.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48c1a7c700 1 -- 172.21.15.79:0/2256971809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc0e9b10 msgr2=0x7f48bc09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48c1a7c700 1 --2- 172.21.15.79:0/2256971809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc0e9b10 0x7f48bc09f110 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f48bc0f6f30 tx=0x7f48b000b3c0).stop 2021-04-09T18:33:54.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48c1a7c700 1 -- 172.21.15.79:0/2256971809 shutdown_connections 2021-04-09T18:33:54.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48c1a7c700 1 --2- 172.21.15.79:0/2256971809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48bc1c8040 0x7f48bc1ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48c1a7c700 1 --2- 172.21.15.79:0/2256971809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc0e9b10 0x7f48bc09f110 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48c1a7c700 1 -- 172.21.15.79:0/2256971809 >> 172.21.15.79:0/2256971809 conn(0x7f48bc0e6010 msgr2=0x7f48bc0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:54.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48c1a7c700 1 -- 172.21.15.79:0/2256971809 shutdown_connections 2021-04-09T18:33:54.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.688 7f48c1a7c700 1 -- 172.21.15.79:0/2256971809 wait complete. 2021-04-09T18:33:54.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.692 7f48c1a7c700 1 Processor -- start 2021-04-09T18:33:54.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.692 7f48c1a7c700 1 -- start start 2021-04-09T18:33:54.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.692 7f48c1a7c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48bc0c2490 0x7f48bc0c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.692 7f48c1a7c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc096290 0x7f48bc0ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.692 7f48c1a7c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48bc0d7e80 0x7f48bc0acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.692 7f48c1a7c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc0e1ac0 con 0x7f48bc096290 2021-04-09T18:33:54.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.692 7f48c1a7c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc0967c0 con 0x7f48bc0d7e80 2021-04-09T18:33:54.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.692 7f48c1a7c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc0c2be0 con 0x7f48bc0c2490 2021-04-09T18:33:54.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.692 7f48baffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc096290 0x7f48bc0ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.692 7f48baffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc096290 0x7f48bc0ac4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33030/0 (socket says 172.21.15.79:33030) 2021-04-09T18:33:54.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.692 7f48baffd700 1 -- 172.21.15.79:0/3035127443 learned_addr learned my addr 172.21.15.79:0/3035127443 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:54.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.692 7f48bb7fe700 1 --2- 172.21.15.79:0/3035127443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48bc0c2490 0x7f48bc0c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.692 7f48bbfff700 1 --2- 172.21.15.79:0/3035127443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48bc0d7e80 0x7f48bc0acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.692 7f48baffd700 1 -- 172.21.15.79:0/3035127443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48bc0c2490 msgr2=0x7f48bc0c2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.692 7f48baffd700 1 --2- 172.21.15.79:0/3035127443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48bc0c2490 0x7f48bc0c2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.692 7f48baffd700 1 -- 172.21.15.79:0/3035127443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48bc0d7e80 msgr2=0x7f48bc0acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.692 7f48baffd700 1 --2- 172.21.15.79:0/3035127443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48bc0d7e80 0x7f48bc0acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.692 7f48baffd700 1 -- 172.21.15.79:0/3035127443 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc0abbf0 con 0x7f48bc096290 2021-04-09T18:33:54.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.692 7f48baffd700 1 --2- 172.21.15.79:0/3035127443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc096290 0x7f48bc0ac4b0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f48bc095e60 tx=0x7f48b0006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:54.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.696 7f48a3fff700 1 -- 172.21.15.79:0/3035127443 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48bc0abbf0 con 0x7f48bc096290 2021-04-09T18:33:54.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.696 7f48a3fff700 1 -- 172.21.15.79:0/3035127443 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b001c650 con 0x7f48bc096290 2021-04-09T18:33:54.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.696 7f48c1a7c700 1 -- 172.21.15.79:0/3035127443 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48bc0ad110 con 0x7f48bc096290 2021-04-09T18:33:54.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.696 7f48a3fff700 1 -- 172.21.15.79:0/3035127443 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48b001ca20 con 0x7f48bc096290 2021-04-09T18:33:54.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.696 7f48c1a7c700 1 -- 172.21.15.79:0/3035127443 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48bc0ba6c0 con 0x7f48bc096290 2021-04-09T18:33:54.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.696 7f48a3fff700 1 -- 172.21.15.79:0/3035127443 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f48b0019030 con 0x7f48bc096290 2021-04-09T18:33:54.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.696 7f48a3fff700 1 --2- 172.21.15.79:0/3035127443 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f489c029100 0x7f489c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.696 7f48a3fff700 1 -- 172.21.15.79:0/3035127443 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f48b0018040 con 0x7f48bc096290 2021-04-09T18:33:54.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.696 7f48bb7fe700 1 --2- 172.21.15.79:0/3035127443 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f489c029100 0x7f489c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.696 7f48bb7fe700 1 --2- 172.21.15.79:0/3035127443 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f489c029100 0x7f489c02b650 crc :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:54.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.700 7f48c1a7c700 1 -- 172.21.15.79:0/3035127443 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48bc0e39f0 con 0x7f48bc096290 2021-04-09T18:33:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.708 7f48a3fff700 1 -- 172.21.15.79:0/3035127443 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f48b001c440 con 0x7f48bc096290 2021-04-09T18:33:54.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.868 7f48c1a7c700 1 -- 172.21.15.79:0/3035127443 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f48bc0a1c90 con 0x7f48bc096290 2021-04-09T18:33:54.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.872 7f48a3fff700 1 -- 172.21.15.79:0/3035127443 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v89) v1 ==== 100+0+10 (secure 0 0 0) 0x7f48b000b9d0 con 0x7f48bc096290 2021-04-09T18:33:54.876 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:33:54.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.872 7f48c1a7c700 1 -- 172.21.15.79:0/3035127443 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f489c029100 msgr2=0x7f489c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.872 7f48c1a7c700 1 --2- 172.21.15.79:0/3035127443 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f489c029100 0x7f489c02b650 crc :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.872 7f48c1a7c700 1 -- 172.21.15.79:0/3035127443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc096290 msgr2=0x7f48bc0ac4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.872 7f48c1a7c700 1 --2- 172.21.15.79:0/3035127443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc096290 0x7f48bc0ac4b0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f48bc095e60 tx=0x7f48b0006c10).stop 2021-04-09T18:33:54.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.872 7f48c1a7c700 1 -- 172.21.15.79:0/3035127443 shutdown_connections 2021-04-09T18:33:54.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.872 7f48c1a7c700 1 --2- 172.21.15.79:0/3035127443 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f489c029100 0x7f489c02b650 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.872 7f48c1a7c700 1 --2- 172.21.15.79:0/3035127443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48bc0d7e80 0x7f48bc0acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.872 7f48c1a7c700 1 --2- 172.21.15.79:0/3035127443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48bc0c2490 0x7f48bc0c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.872 7f48c1a7c700 1 --2- 172.21.15.79:0/3035127443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc096290 0x7f48bc0ac4b0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.872 7f48c1a7c700 1 -- 172.21.15.79:0/3035127443 >> 172.21.15.79:0/3035127443 conn(0x7f48bc0baf50 msgr2=0x7f48bc0aed80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.872 7f48c1a7c700 1 -- 172.21.15.79:0/3035127443 shutdown_connections 2021-04-09T18:33:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.872 7f48c1a7c700 1 -- 172.21.15.79:0/3035127443 wait complete. 2021-04-09T18:33:54.888 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:33:54.889 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:54.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.972 7fd1ace75700 1 Processor -- start 2021-04-09T18:33:54.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.972 7fd1ace75700 1 -- start start 2021-04-09T18:33:54.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.972 7fd1ace75700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd1a80f5510 0x7fd1a80f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.972 7fd1ace75700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd1a81c8000 0x7fd1a81ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.972 7fd1ace75700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a80fbb10 con 0x7fd1a80e9ad0 2021-04-09T18:33:54.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.972 7fd1ace75700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a80e9f20 con 0x7fd1a81c8000 2021-04-09T18:33:54.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.972 7fd1ace75700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a81c3db0 con 0x7fd1a80f5510 2021-04-09T18:33:54.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.976 7fd1a72f0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd1a81c8000 0x7fd1a81ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.976 7fd1a62ee700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd1a80e9ad0 0x7fd1a809f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55980/0 (socket says 172.21.15.79:55980) 2021-04-09T18:33:54.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.976 7fd1a62ee700 1 -- 172.21.15.79:0/768999628 learned_addr learned my addr 172.21.15.79:0/768999628 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:54.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.976 7fd1a6aef700 1 --2- 172.21.15.79:0/768999628 >> v2:172.21.15.89:3300/0 conn(0x7fd1a80f5510 0x7fd1a80f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.976 7fd1a72f0700 1 -- 172.21.15.79:0/768999628 >> v2:172.21.15.89:3300/0 conn(0x7fd1a80f5510 msgr2=0x7fd1a80f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:54.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.976 7fd1a72f0700 1 --2- 172.21.15.79:0/768999628 >> v2:172.21.15.89:3300/0 conn(0x7fd1a80f5510 0x7fd1a80f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.976 7fd1a72f0700 1 -- 172.21.15.79:0/768999628 >> v1:172.21.15.79:6789/0 conn(0x7fd1a80e9ad0 legacy=0x7fd1a809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.976 7fd1a72f0700 1 -- 172.21.15.79:0/768999628 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a809f900 con 0x7fd1a81c8000 2021-04-09T18:33:54.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.976 7fd1a72f0700 1 --2- 172.21.15.79:0/768999628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a81c8000 0x7fd1a81ca460 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7fd1a00032b0 tx=0x7fd1a000b3c0).ready entity=mon.0 client_cookie=d74cbdf10164a7ff server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:54.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.976 7fd1a5aed700 1 -- 172.21.15.79:0/768999628 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1a809f900 con 0x7fd1a81c8000 2021-04-09T18:33:54.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.976 7fd1a5aed700 1 -- 172.21.15.79:0/768999628 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a000bc20 con 0x7fd1a81c8000 2021-04-09T18:33:54.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.976 7fd1a5aed700 1 -- 172.21.15.79:0/768999628 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1a0002020 con 0x7fd1a81c8000 2021-04-09T18:33:54.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.976 7fd1ace75700 1 -- 172.21.15.79:0/768999628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a81c8000 msgr2=0x7fd1a81ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.976 7fd1ace75700 1 --2- 172.21.15.79:0/768999628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a81c8000 0x7fd1a81ca460 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7fd1a00032b0 tx=0x7fd1a000b3c0).stop 2021-04-09T18:33:54.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.976 7fd1ace75700 1 -- 172.21.15.79:0/768999628 shutdown_connections 2021-04-09T18:33:54.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.976 7fd1ace75700 1 --2- 172.21.15.79:0/768999628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a81c8000 0x7fd1a81ca460 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.976 7fd1ace75700 1 --2- 172.21.15.79:0/768999628 >> v2:172.21.15.89:3300/0 conn(0x7fd1a80f5510 0x7fd1a80f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.976 7fd1ace75700 1 -- 172.21.15.79:0/768999628 >> 172.21.15.79:0/768999628 conn(0x7fd1a80e5fd0 msgr2=0x7fd1a80e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:54.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.976 7fd1ace75700 1 -- 172.21.15.79:0/768999628 shutdown_connections 2021-04-09T18:33:54.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.976 7fd1ace75700 1 -- 172.21.15.79:0/768999628 wait complete. 2021-04-09T18:33:54.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1ace75700 1 Processor -- start 2021-04-09T18:33:54.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1ace75700 1 -- start start 2021-04-09T18:33:54.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1ace75700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1a80baf20 0x7fd1a819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1ace75700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a80c1e80 0x7fd1a80d4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1ace75700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a80c22d0 0x7fd1a81aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:54.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1ace75700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a80c3620 con 0x7fd1a80c1e80 2021-04-09T18:33:54.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1ace75700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a80c2bb0 con 0x7fd1a80baf20 2021-04-09T18:33:54.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1ace75700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a819f210 con 0x7fd1a80c22d0 2021-04-09T18:33:54.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1a62ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a80c1e80 0x7fd1a80d4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1a62ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a80c1e80 0x7fd1a80d4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33046/0 (socket says 172.21.15.79:33046) 2021-04-09T18:33:54.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1a6aef700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1a80baf20 0x7fd1a819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1a62ee700 1 -- 172.21.15.79:0/224038784 learned_addr learned my addr 172.21.15.79:0/224038784 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:54.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1a72f0700 1 --2- 172.21.15.79:0/224038784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a80c22d0 0x7fd1a81aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:54.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1a62ee700 1 -- 172.21.15.79:0/224038784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a80c22d0 msgr2=0x7fd1a81aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1a62ee700 1 --2- 172.21.15.79:0/224038784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a80c22d0 0x7fd1a81aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1a62ee700 1 -- 172.21.15.79:0/224038784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1a80baf20 msgr2=0x7fd1a819ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:54.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1a62ee700 1 --2- 172.21.15.79:0/224038784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1a80baf20 0x7fd1a819ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:54.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1a62ee700 1 -- 172.21.15.79:0/224038784 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a80bb370 con 0x7fd1a80c1e80 2021-04-09T18:33:54.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1a62ee700 1 --2- 172.21.15.79:0/224038784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a80c1e80 0x7fd1a80d4c40 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7fd1a80c32a0 tx=0x7fd19800cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:54.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1977fe700 1 -- 172.21.15.79:0/224038784 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1a80bb370 con 0x7fd1a80c1e80 2021-04-09T18:33:54.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1977fe700 1 -- 172.21.15.79:0/224038784 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd198007320 con 0x7fd1a80c1e80 2021-04-09T18:33:54.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1977fe700 1 -- 172.21.15.79:0/224038784 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1980057e0 con 0x7fd1a80c1e80 2021-04-09T18:33:54.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1ace75700 1 -- 172.21.15.79:0/224038784 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a80c2df0 con 0x7fd1a80c1e80 2021-04-09T18:33:54.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1ace75700 1 -- 172.21.15.79:0/224038784 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a80d5270 con 0x7fd1a80c1e80 2021-04-09T18:33:54.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1977fe700 1 -- 172.21.15.79:0/224038784 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd19801a020 con 0x7fd1a80c1e80 2021-04-09T18:33:54.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.980 7fd1977fe700 1 --2- 172.21.15.79:0/224038784 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd18c029100 0x7fd18c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:55.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.984 7fd1977fe700 1 -- 172.21.15.79:0/224038784 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fd1980391e0 con 0x7fd1a80c1e80 2021-04-09T18:33:55.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.984 7fd1a6aef700 1 --2- 172.21.15.79:0/224038784 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd18c029100 0x7fd18c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:55.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.984 7fd1a6aef700 1 --2- 172.21.15.79:0/224038784 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd18c029100 0x7fd18c02b650 crc :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:55.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.988 7fd1ace75700 1 -- 172.21.15.79:0/224038784 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a80e39d0 con 0x7fd1a80c1e80 2021-04-09T18:33:55.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:54.996 7fd1977fe700 1 -- 172.21.15.79:0/224038784 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd198007110 con 0x7fd1a80c1e80 2021-04-09T18:33:55.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:55.168 7fd1ace75700 1 -- 172.21.15.79:0/224038784 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1a80f5b10 con 0x7fd1a80c1e80 2021-04-09T18:33:55.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:55.168 7fd1977fe700 1 -- 172.21.15.79:0/224038784 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2103 (secure 0 0 0) 0x7fd1a80e5c90 con 0x7fd1a80c1e80 2021-04-09T18:33:55.173 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 54 2021-04-09T18:33:55.173 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:55.173 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":54,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6831,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3171732398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3171732398},{"type":"v1","addr":"172.21.15.79:6833","nonce":3171732398}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":51}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:33:47.856435","modified":"2021-04-09 18:33:49.091531","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6059":{"gid":6059,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/2698757363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2698757363},{"type":"v1","addr":"172.21.15.89:6835","nonce":2698757363}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-04-09T18:33:55.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:55.172 7fd1ace75700 1 -- 172.21.15.79:0/224038784 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd18c029100 msgr2=0x7fd18c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:55.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:55.172 7fd1ace75700 1 --2- 172.21.15.79:0/224038784 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd18c029100 0x7fd18c02b650 crc :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:55.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:55.172 7fd1ace75700 1 -- 172.21.15.79:0/224038784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a80c1e80 msgr2=0x7fd1a80d4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:55.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:55.172 7fd1ace75700 1 --2- 172.21.15.79:0/224038784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a80c1e80 0x7fd1a80d4c40 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7fd1a80c32a0 tx=0x7fd19800cae0).stop 2021-04-09T18:33:55.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:55.172 7fd1ace75700 1 -- 172.21.15.79:0/224038784 shutdown_connections 2021-04-09T18:33:55.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:55.172 7fd1ace75700 1 --2- 172.21.15.79:0/224038784 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd18c029100 0x7fd18c02b650 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:55.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:55.172 7fd1ace75700 1 --2- 172.21.15.79:0/224038784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1a80baf20 0x7fd1a819ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:55.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:55.172 7fd1ace75700 1 --2- 172.21.15.79:0/224038784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a80c22d0 0x7fd1a81aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:55.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:55.172 7fd1ace75700 1 --2- 172.21.15.79:0/224038784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a80c1e80 0x7fd1a80d4c40 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:55.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:55.172 7fd1ace75700 1 -- 172.21.15.79:0/224038784 >> 172.21.15.79:0/224038784 conn(0x7fd1a80ac740 msgr2=0x7fd1a80d8030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:55.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:55.172 7fd1ace75700 1 -- 172.21.15.79:0/224038784 shutdown_connections 2021-04-09T18:33:55.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:55.172 7fd1ace75700 1 -- 172.21.15.79:0/224038784 wait complete. 2021-04-09T18:33:55.387 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:33:47.856435', 'modified': '2021-04-09 18:33:49.091531', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6059}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6059': {'gid': 6059, 'name': 'b', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6835/2698757363', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 2698757363}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 2698757363}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:33:55.388 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:33:55.388 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2021-04-09T18:33:55.484 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:33:55.484 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:33:55.484 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2021-04-09T18:33:55.485 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 6059, 2021-04-09T18:33:55.485 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2021-04-09T18:33:55.485 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2021-04-09T18:33:55.485 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 7.6214484479999998, 2021-04-09T18:33:55.486 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 54, 2021-04-09T18:33:55.486 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 89, 2021-04-09T18:33:55.486 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 88, 2021-04-09T18:33:55.486 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 12.012526848 2021-04-09T18:33:55.486 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:33:55.491 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 6059, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.6214484479999998, "mdsmap_epoch": 54, "osdmap_epoch": 89, "osdmap_epoch_barrier": 88, "uptime": 12.012526848 } 2021-04-09T18:33:55.491 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:33:55.492 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-04-09T18:33:55.492 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi136.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-04-09T18:33:55.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:55.493 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:55.500 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:33:55.557 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:33:55.558 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:33:55.613 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:33:55.614 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:33:55.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:55.615 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:33:55.664 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:33:55.665 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:55.708 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:33:55.723 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:33:55.724 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:33:55.778 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13449]: starting ceph client 2021-04-09T18:33:55.778 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:2021-04-09 18:33:55.769 7f13964e00c0 -1 init, newargv = 0x555e42658b10 newargc=9 2021-04-09T18:33:55.780 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:33:55.781 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:33:55.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:55.783 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:33:55.788 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13449]: starting fuse 2021-04-09T18:33:55.793 INFO:teuthology.orchestra.run.smithi136.stdout:49 2021-04-09T18:33:55.793 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:33:55.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:55.794 DEBUG:teuthology.orchestra.run.smithi136:> sudo python3 -c ' 2021-04-09T18:33:55.795 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2021-04-09T18:33:55.796 DEBUG:teuthology.orchestra.run.smithi136:> import re 2021-04-09T18:33:55.796 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-04-09T18:33:55.797 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2021-04-09T18:33:55.797 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:33:55.797 DEBUG:teuthology.orchestra.run.smithi136:> def find_socket(client_name): 2021-04-09T18:33:55.798 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-04-09T18:33:55.798 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2021-04-09T18:33:55.798 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:33:55.799 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2021-04-09T18:33:55.800 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2021-04-09T18:33:55.800 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2021-04-09T18:33:55.801 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2021-04-09T18:33:55.801 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:33:55.802 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2021-04-09T18:33:55.803 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:33:55.804 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:33:55.804 DEBUG:teuthology.orchestra.run.smithi136:> return f 2021-04-09T18:33:55.805 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:33:55.806 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:33:55.807 DEBUG:teuthology.orchestra.run.smithi136:> print(find_socket("client.1")) 2021-04-09T18:33:55.807 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-04-09T18:33:55.882 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.1.13449.asok 2021-04-09T18:33:55.886 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13449.asok 2021-04-09T18:33:55.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:55.887 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13449.asok status 2021-04-09T18:33:55.964 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2021-04-09T18:33:55.965 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2021-04-09T18:33:55.966 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:33:55.966 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:33:55.966 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "1", 2021-04-09T18:33:55.967 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2021-04-09T18:33:55.967 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-04-09T18:33:55.968 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "13449", 2021-04-09T18:33:55.968 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2021-04-09T18:33:55.968 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:33:55.969 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2021-04-09T18:33:55.969 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2021-04-09T18:33:55.970 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 7027, 2021-04-09T18:33:55.970 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2021-04-09T18:33:55.971 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2021-04-09T18:33:55.971 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2021-04-09T18:33:55.972 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 7027 2021-04-09T18:33:55.972 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:33:55.973 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-04-09T18:33:55.973 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-04-09T18:33:55.973 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-04-09T18:33:55.974 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 2409889377 2021-04-09T18:33:55.974 INFO:teuthology.orchestra.run.smithi136.stdout: } 2021-04-09T18:33:55.975 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:33:55.975 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-04-09T18:33:55.975 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-04-09T18:33:55.975 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-04-09T18:33:55.976 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 2409889377 2021-04-09T18:33:55.976 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:33:55.976 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.7027 172.21.15.136:0/2409889377", 2021-04-09T18:33:55.976 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "172.21.15.136:0/2409889377", 2021-04-09T18:33:55.976 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2021-04-09T18:33:55.977 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 54, 2021-04-09T18:33:55.977 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 89, 2021-04-09T18:33:55.977 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:33:55.977 INFO:teuthology.orchestra.run.smithi136.stdout: "blacklisted": false, 2021-04-09T18:33:55.977 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2021-04-09T18:33:55.978 INFO:teuthology.orchestra.run.smithi136.stdout:} 2021-04-09T18:33:55.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:55.979 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:55.980 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:55.988 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-04-09T18:33:55.989 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-04-09T18:33:55.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:55.990 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:56.048 DEBUG:teuthology.orchestra.run.smithi090:> cd /home/ubuntu/cephtest/mnt.0 && sudo mkdir -p foo 2021-04-09T18:33:56.081 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-04-09T18:33:56.081 DEBUG:teuthology.orchestra.run.smithi090:> import os 2021-04-09T18:33:56.082 DEBUG:teuthology.orchestra.run.smithi090:> import stat 2021-04-09T18:33:56.082 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:33:56.082 DEBUG:teuthology.orchestra.run.smithi090:> print(os.stat("/home/ubuntu/cephtest/mnt.0/foo").st_ino) 2021-04-09T18:33:56.083 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:33:56.194 INFO:teuthology.orchestra.run.smithi090.stdout:1099511627776 2021-04-09T18:33:56.388 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:56.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f612b2ea700 1 Processor -- start 2021-04-09T18:33:56.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f612b2ea700 1 -- start start 2021-04-09T18:33:56.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f612b2ea700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f61240f5520 0x7f61240f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:56.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f612b2ea700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61240fbb20 con 0x7f61241c8010 2021-04-09T18:33:56.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f612b2ea700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612409f910 con 0x7f61240e9ae0 2021-04-09T18:33:56.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f612b2ea700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61240e9f30 con 0x7f61240f5520 2021-04-09T18:33:56.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f612988f700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f61241c8010 0x7f61241ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55996/0 (socket says 172.21.15.79:55996) 2021-04-09T18:33:56.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f612988f700 1 -- 172.21.15.79:0/2252480135 learned_addr learned my addr 172.21.15.79:0/2252480135 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:56.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f612908e700 1 --2- 172.21.15.79:0/2252480135 >> v2:172.21.15.89:3300/0 conn(0x7f61240f5520 0x7f61240f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:56.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f611bfff700 1 -- 172.21.15.79:0/2252480135 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1056873388 0 0) 0x7f611c001450 con 0x7f61241c8010 2021-04-09T18:33:56.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f611bfff700 1 -- 172.21.15.79:0/2252480135 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6110003240 con 0x7f61241c8010 2021-04-09T18:33:56.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f611bfff700 1 -- 172.21.15.79:0/2252480135 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3048271842 0 0) 0x7f611c0019d0 con 0x7f61241c8010 2021-04-09T18:33:56.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f611bfff700 1 -- 172.21.15.79:0/2252480135 >> v2:172.21.15.89:3300/0 conn(0x7f61240f5520 msgr2=0x7f61240f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:56.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f611bfff700 1 --2- 172.21.15.79:0/2252480135 >> v2:172.21.15.89:3300/0 conn(0x7f61240f5520 0x7f61240f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:56.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f611bfff700 1 -- 172.21.15.79:0/2252480135 >> v1:172.21.15.89:6789/0 conn(0x7f61240e9ae0 legacy=0x7f612409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:56.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f611bfff700 1 -- 172.21.15.79:0/2252480135 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61240e56d0 con 0x7f61241c8010 2021-04-09T18:33:56.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f611bfff700 1 -- 172.21.15.79:0/2252480135 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f611c001f30 con 0x7f61241c8010 2021-04-09T18:33:56.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f611bfff700 1 -- 172.21.15.79:0/2252480135 >> v1:172.21.15.79:6789/0 conn(0x7f61241c8010 legacy=0x7f61241ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:56.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f611bfff700 1 --2- 172.21.15.79:0/2252480135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61100038c0 0x7f6110003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:56.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f611bfff700 1 --2- 172.21.15.79:0/2252480135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61100045a0 0x7f6110004a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:56.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f611bfff700 1 --2- 172.21.15.79:0/2252480135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61100097e0 0x7f611000bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:56.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f611bfff700 1 -- 172.21.15.79:0/2252480135 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61240e9f30 con 0x7f61100038c0 2021-04-09T18:33:56.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f611bfff700 1 -- 172.21.15.79:0/2252480135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611000c270 con 0x7f61100045a0 2021-04-09T18:33:56.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f612908e700 1 --2- 172.21.15.79:0/2252480135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61100038c0 0x7f6110003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:56.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f611bfff700 1 -- 172.21.15.79:0/2252480135 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6110050430 con 0x7f61100097e0 2021-04-09T18:33:56.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f612888d700 1 --2- 172.21.15.79:0/2252480135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61100045a0 0x7f6110004a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:56.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.480 7f612988f700 1 --2- 172.21.15.79:0/2252480135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61100097e0 0x7f611000bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:56.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.484 7f612908e700 1 -- 172.21.15.79:0/2252480135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61100097e0 msgr2=0x7f611000bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:56.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.484 7f612908e700 1 --2- 172.21.15.79:0/2252480135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61100097e0 0x7f611000bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:56.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.484 7f612908e700 1 -- 172.21.15.79:0/2252480135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61100045a0 msgr2=0x7f6110004a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:56.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.484 7f612908e700 1 --2- 172.21.15.79:0/2252480135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61100045a0 0x7f6110004a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:56.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.484 7f612988f700 1 -- 172.21.15.79:0/2252480135 reap_dead start 2021-04-09T18:33:56.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.484 7f612908e700 1 -- 172.21.15.79:0/2252480135 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61100506a0 con 0x7f61100038c0 2021-04-09T18:33:56.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.484 7f612908e700 1 --2- 172.21.15.79:0/2252480135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61100038c0 0x7f6110003d70 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f612000c000 tx=0x7f612000e1d0).ready entity=mon.0 client_cookie=7301c00e23ca6c42 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:56.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.484 7f611bfff700 1 -- 172.21.15.79:0/2252480135 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f61100506a0 con 0x7f61100038c0 2021-04-09T18:33:56.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.484 7f611bfff700 1 -- 172.21.15.79:0/2252480135 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612000ec90 con 0x7f61100038c0 2021-04-09T18:33:56.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.484 7f611bfff700 1 -- 172.21.15.79:0/2252480135 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f612000f040 con 0x7f61100038c0 2021-04-09T18:33:56.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.484 7f612b2ea700 1 -- 172.21.15.79:0/2252480135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61100038c0 msgr2=0x7f6110003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:56.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.484 7f612b2ea700 1 --2- 172.21.15.79:0/2252480135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61100038c0 0x7f6110003d70 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f612000c000 tx=0x7f612000e1d0).stop 2021-04-09T18:33:56.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.484 7f612b2ea700 1 -- 172.21.15.79:0/2252480135 shutdown_connections 2021-04-09T18:33:56.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.484 7f612b2ea700 1 --2- 172.21.15.79:0/2252480135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61100038c0 0x7f6110003d70 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:56.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.484 7f612b2ea700 1 -- 172.21.15.79:0/2252480135 >> 172.21.15.79:0/2252480135 conn(0x7f61240e5fe0 msgr2=0x7f61240e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:56.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.484 7f612b2ea700 1 -- 172.21.15.79:0/2252480135 shutdown_connections 2021-04-09T18:33:56.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.484 7f612b2ea700 1 -- 172.21.15.79:0/2252480135 wait complete. 2021-04-09T18:33:56.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612b2ea700 1 Processor -- start 2021-04-09T18:33:56.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612b2ea700 1 -- start start 2021-04-09T18:33:56.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612b2ea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61241aac50 0x7f61240d64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:56.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612b2ea700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61240d5460 0x7f61241ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:56.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612b2ea700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61240d58b0 0x7f61241aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:56.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612b2ea700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61241c3dc0 con 0x7f61241aac50 2021-04-09T18:33:56.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612b2ea700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61240bf970 con 0x7f61240d58b0 2021-04-09T18:33:56.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612b2ea700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61240bfc70 con 0x7f61240d5460 2021-04-09T18:33:56.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612908e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61241aac50 0x7f61240d64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:56.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612908e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61241aac50 0x7f61240d64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33062/0 (socket says 172.21.15.79:33062) 2021-04-09T18:33:56.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612908e700 1 -- 172.21.15.79:0/3411350193 learned_addr learned my addr 172.21.15.79:0/3411350193 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:56.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612988f700 1 --2- 172.21.15.79:0/3411350193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61240d58b0 0x7f61241aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:56.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612888d700 1 --2- 172.21.15.79:0/3411350193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61240d5460 0x7f61241ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:56.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612908e700 1 -- 172.21.15.79:0/3411350193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61240d5460 msgr2=0x7f61241ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:56.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612908e700 1 --2- 172.21.15.79:0/3411350193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61240d5460 0x7f61241ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:56.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612908e700 1 -- 172.21.15.79:0/3411350193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61240d58b0 msgr2=0x7f61241aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:56.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612908e700 1 --2- 172.21.15.79:0/3411350193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61240d58b0 0x7f61241aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:56.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612908e700 1 -- 172.21.15.79:0/3411350193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61241ab0a0 con 0x7f61241aac50 2021-04-09T18:33:56.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612908e700 1 --2- 172.21.15.79:0/3411350193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61241aac50 0x7f61240d64f0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f61240d82f0 tx=0x7f612000a040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:56.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f6119ffb700 1 -- 172.21.15.79:0/3411350193 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f61241ab0a0 con 0x7f61241aac50 2021-04-09T18:33:56.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f6119ffb700 1 -- 172.21.15.79:0/3411350193 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6120006920 con 0x7f61241aac50 2021-04-09T18:33:56.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612b2ea700 1 -- 172.21.15.79:0/3411350193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61240d6b20 con 0x7f61241aac50 2021-04-09T18:33:56.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f6119ffb700 1 -- 172.21.15.79:0/3411350193 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6120023020 con 0x7f61241aac50 2021-04-09T18:33:56.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.488 7f612b2ea700 1 -- 172.21.15.79:0/3411350193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61240bf500 con 0x7f61241aac50 2021-04-09T18:33:56.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.492 7f6119ffb700 1 -- 172.21.15.79:0/3411350193 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6120011070 con 0x7f61241aac50 2021-04-09T18:33:56.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.492 7f6119ffb700 1 --2- 172.21.15.79:0/3411350193 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6104029100 0x7f610402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:56.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.492 7f6119ffb700 1 -- 172.21.15.79:0/3411350193 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f6120010040 con 0x7f61241aac50 2021-04-09T18:33:56.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.492 7f612888d700 1 --2- 172.21.15.79:0/3411350193 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6104029100 0x7f610402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:56.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.492 7f612888d700 1 --2- 172.21.15.79:0/3411350193 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6104029100 0x7f610402b650 crc :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:56.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.492 7f612b2ea700 1 -- 172.21.15.79:0/3411350193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61240e39e0 con 0x7f61241aac50 2021-04-09T18:33:56.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.500 7f6119ffb700 1 -- 172.21.15.79:0/3411350193 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f612001d410 con 0x7f61241aac50 2021-04-09T18:33:56.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.664 7f612b2ea700 1 -- 172.21.15.79:0/3411350193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61240a1cc0 con 0x7f61241aac50 2021-04-09T18:33:56.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.668 7f6119ffb700 1 -- 172.21.15.79:0/3411350193 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2103 (secure 0 0 0) 0x7f612000e890 con 0x7f61241aac50 2021-04-09T18:33:56.674 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 54 2021-04-09T18:33:56.675 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:56.675 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":54,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6831,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3171732398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3171732398},{"type":"v1","addr":"172.21.15.79:6833","nonce":3171732398}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":51}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:33:47.856435","modified":"2021-04-09 18:33:49.091531","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6059":{"gid":6059,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/2698757363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2698757363},{"type":"v1","addr":"172.21.15.89:6835","nonce":2698757363}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-04-09T18:33:56.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.672 7f612b2ea700 1 -- 172.21.15.79:0/3411350193 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6104029100 msgr2=0x7f610402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:56.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.672 7f612b2ea700 1 --2- 172.21.15.79:0/3411350193 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6104029100 0x7f610402b650 crc :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:56.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.672 7f612b2ea700 1 -- 172.21.15.79:0/3411350193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61241aac50 msgr2=0x7f61240d64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:56.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.672 7f612b2ea700 1 --2- 172.21.15.79:0/3411350193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61241aac50 0x7f61240d64f0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f61240d82f0 tx=0x7f612000a040).stop 2021-04-09T18:33:56.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.672 7f612b2ea700 1 -- 172.21.15.79:0/3411350193 shutdown_connections 2021-04-09T18:33:56.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.672 7f612b2ea700 1 --2- 172.21.15.79:0/3411350193 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6104029100 0x7f610402b650 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:56.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.672 7f612b2ea700 1 --2- 172.21.15.79:0/3411350193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61240d58b0 0x7f61241aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:56.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.672 7f612b2ea700 1 --2- 172.21.15.79:0/3411350193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61241aac50 0x7f61240d64f0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:56.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.672 7f612b2ea700 1 --2- 172.21.15.79:0/3411350193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61240d5460 0x7f61241ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:56.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.672 7f612b2ea700 1 -- 172.21.15.79:0/3411350193 >> 172.21.15.79:0/3411350193 conn(0x7f612409a550 msgr2=0x7f61240d8530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:56.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.672 7f612b2ea700 1 -- 172.21.15.79:0/3411350193 shutdown_connections 2021-04-09T18:33:56.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:56.672 7f612b2ea700 1 -- 172.21.15.79:0/3411350193 wait complete. 2021-04-09T18:33:56.690 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok dump inode 0x10000000000 2021-04-09T18:33:56.779 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:33:56.779 INFO:teuthology.orchestra.run.smithi089.stdout: "path": "/foo", 2021-04-09T18:33:56.779 INFO:teuthology.orchestra.run.smithi089.stdout: "ino": 1099511627776, 2021-04-09T18:33:56.779 INFO:teuthology.orchestra.run.smithi089.stdout: "rdev": 0, 2021-04-09T18:33:56.780 INFO:teuthology.orchestra.run.smithi089.stdout: "ctime": "2021-04-09 18:33:56.068205", 2021-04-09T18:33:56.780 INFO:teuthology.orchestra.run.smithi089.stdout: "btime": "2021-04-09 18:33:56.068205", 2021-04-09T18:33:56.780 INFO:teuthology.orchestra.run.smithi089.stdout: "mode": 16877, 2021-04-09T18:33:56.780 INFO:teuthology.orchestra.run.smithi089.stdout: "uid": 0, 2021-04-09T18:33:56.781 INFO:teuthology.orchestra.run.smithi089.stdout: "gid": 0, 2021-04-09T18:33:56.781 INFO:teuthology.orchestra.run.smithi089.stdout: "nlink": 1, 2021-04-09T18:33:56.781 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_layout": { 2021-04-09T18:33:56.781 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_hash": 2 2021-04-09T18:33:56.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:56.782 INFO:teuthology.orchestra.run.smithi089.stdout: "layout": { 2021-04-09T18:33:56.782 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_unit": 0, 2021-04-09T18:33:56.782 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_count": 0, 2021-04-09T18:33:56.783 INFO:teuthology.orchestra.run.smithi089.stdout: "object_size": 0, 2021-04-09T18:33:56.783 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_id": -1, 2021-04-09T18:33:56.783 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_ns": "" 2021-04-09T18:33:56.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:56.784 INFO:teuthology.orchestra.run.smithi089.stdout: "old_pools": [], 2021-04-09T18:33:56.784 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 0, 2021-04-09T18:33:56.784 INFO:teuthology.orchestra.run.smithi089.stdout: "truncate_seq": 1, 2021-04-09T18:33:56.784 INFO:teuthology.orchestra.run.smithi089.stdout: "truncate_size": 18446744073709551615, 2021-04-09T18:33:56.784 INFO:teuthology.orchestra.run.smithi089.stdout: "truncate_from": 0, 2021-04-09T18:33:56.785 INFO:teuthology.orchestra.run.smithi089.stdout: "truncate_pending": 0, 2021-04-09T18:33:56.785 INFO:teuthology.orchestra.run.smithi089.stdout: "mtime": "2021-04-09 18:33:56.068205", 2021-04-09T18:33:56.785 INFO:teuthology.orchestra.run.smithi089.stdout: "atime": "2021-04-09 18:33:56.068205", 2021-04-09T18:33:56.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time_warp_seq": 0, 2021-04-09T18:33:56.786 INFO:teuthology.orchestra.run.smithi089.stdout: "change_attr": 0, 2021-04-09T18:33:56.787 INFO:teuthology.orchestra.run.smithi089.stdout: "export_pin": -1, 2021-04-09T18:33:56.788 INFO:teuthology.orchestra.run.smithi089.stdout: "client_ranges": [], 2021-04-09T18:33:56.788 INFO:teuthology.orchestra.run.smithi089.stdout: "dirstat": { 2021-04-09T18:33:56.789 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 0, 2021-04-09T18:33:56.789 INFO:teuthology.orchestra.run.smithi089.stdout: "mtime": "0.000000", 2021-04-09T18:33:56.789 INFO:teuthology.orchestra.run.smithi089.stdout: "num_files": 0, 2021-04-09T18:33:56.790 INFO:teuthology.orchestra.run.smithi089.stdout: "num_subdirs": 0 2021-04-09T18:33:56.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:56.791 INFO:teuthology.orchestra.run.smithi089.stdout: "rstat": { 2021-04-09T18:33:56.791 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 0, 2021-04-09T18:33:56.791 INFO:teuthology.orchestra.run.smithi089.stdout: "rbytes": 0, 2021-04-09T18:33:56.792 INFO:teuthology.orchestra.run.smithi089.stdout: "rfiles": 0, 2021-04-09T18:33:56.792 INFO:teuthology.orchestra.run.smithi089.stdout: "rsubdirs": 1, 2021-04-09T18:33:56.793 INFO:teuthology.orchestra.run.smithi089.stdout: "rsnaps": 0, 2021-04-09T18:33:56.793 INFO:teuthology.orchestra.run.smithi089.stdout: "rctime": "0.000000" 2021-04-09T18:33:56.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:56.794 INFO:teuthology.orchestra.run.smithi089.stdout: "accounted_rstat": { 2021-04-09T18:33:56.794 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 0, 2021-04-09T18:33:56.795 INFO:teuthology.orchestra.run.smithi089.stdout: "rbytes": 0, 2021-04-09T18:33:56.795 INFO:teuthology.orchestra.run.smithi089.stdout: "rfiles": 0, 2021-04-09T18:33:56.796 INFO:teuthology.orchestra.run.smithi089.stdout: "rsubdirs": 1, 2021-04-09T18:33:56.796 INFO:teuthology.orchestra.run.smithi089.stdout: "rsnaps": 0, 2021-04-09T18:33:56.797 INFO:teuthology.orchestra.run.smithi089.stdout: "rctime": "0.000000" 2021-04-09T18:33:56.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:56.797 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 2, 2021-04-09T18:33:56.798 INFO:teuthology.orchestra.run.smithi089.stdout: "file_data_version": 0, 2021-04-09T18:33:56.798 INFO:teuthology.orchestra.run.smithi089.stdout: "xattr_version": 1, 2021-04-09T18:33:56.799 INFO:teuthology.orchestra.run.smithi089.stdout: "backtrace_version": 2, 2021-04-09T18:33:56.799 INFO:teuthology.orchestra.run.smithi089.stdout: "stray_prior_path": "", 2021-04-09T18:33:56.800 INFO:teuthology.orchestra.run.smithi089.stdout: "symlink": "", 2021-04-09T18:33:56.800 INFO:teuthology.orchestra.run.smithi089.stdout: "old_inodes": [], 2021-04-09T18:33:56.800 INFO:teuthology.orchestra.run.smithi089.stdout: "dirfragtree": { 2021-04-09T18:33:56.801 INFO:teuthology.orchestra.run.smithi089.stdout: "splits": [] 2021-04-09T18:33:56.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:56.802 INFO:teuthology.orchestra.run.smithi089.stdout: "is_auth": true, 2021-04-09T18:33:56.802 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_state": { 2021-04-09T18:33:56.803 INFO:teuthology.orchestra.run.smithi089.stdout: "replicas": {} 2021-04-09T18:33:56.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:56.803 INFO:teuthology.orchestra.run.smithi089.stdout: "replica_state": { 2021-04-09T18:33:56.804 INFO:teuthology.orchestra.run.smithi089.stdout: "authority": [ 2021-04-09T18:33:56.804 INFO:teuthology.orchestra.run.smithi089.stdout: 0, 2021-04-09T18:33:56.805 INFO:teuthology.orchestra.run.smithi089.stdout: -2 2021-04-09T18:33:56.805 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2021-04-09T18:33:56.805 INFO:teuthology.orchestra.run.smithi089.stdout: "replica_nonce": 0 2021-04-09T18:33:56.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:56.806 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_pins": 0, 2021-04-09T18:33:56.807 INFO:teuthology.orchestra.run.smithi089.stdout: "is_frozen": false, 2021-04-09T18:33:56.807 INFO:teuthology.orchestra.run.smithi089.stdout: "is_freezing": false, 2021-04-09T18:33:56.808 INFO:teuthology.orchestra.run.smithi089.stdout: "pins": { 2021-04-09T18:33:56.808 INFO:teuthology.orchestra.run.smithi089.stdout: "request": 0, 2021-04-09T18:33:56.808 INFO:teuthology.orchestra.run.smithi089.stdout: "dirfrag": 1, 2021-04-09T18:33:56.809 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": 1, 2021-04-09T18:33:56.809 INFO:teuthology.orchestra.run.smithi089.stdout: "dirtyparent": 1, 2021-04-09T18:33:56.809 INFO:teuthology.orchestra.run.smithi089.stdout: "dirty": 1 2021-04-09T18:33:56.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:56.810 INFO:teuthology.orchestra.run.smithi089.stdout: "nref": 4, 2021-04-09T18:33:56.810 INFO:teuthology.orchestra.run.smithi089.stdout: "versionlock": { 2021-04-09T18:33:56.811 INFO:teuthology.orchestra.run.smithi089.stdout: "gather_set": [], 2021-04-09T18:33:56.811 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "lock", 2021-04-09T18:33:56.811 INFO:teuthology.orchestra.run.smithi089.stdout: "is_leased": false, 2021-04-09T18:33:56.812 INFO:teuthology.orchestra.run.smithi089.stdout: "num_rdlocks": 0, 2021-04-09T18:33:56.812 INFO:teuthology.orchestra.run.smithi089.stdout: "num_wrlocks": 0, 2021-04-09T18:33:56.812 INFO:teuthology.orchestra.run.smithi089.stdout: "num_xlocks": 0, 2021-04-09T18:33:56.813 INFO:teuthology.orchestra.run.smithi089.stdout: "xlock_by": {} 2021-04-09T18:33:56.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:56.813 INFO:teuthology.orchestra.run.smithi089.stdout: "authlock": { 2021-04-09T18:33:56.814 INFO:teuthology.orchestra.run.smithi089.stdout: "gather_set": [], 2021-04-09T18:33:56.814 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "excl", 2021-04-09T18:33:56.814 INFO:teuthology.orchestra.run.smithi089.stdout: "is_leased": false, 2021-04-09T18:33:56.815 INFO:teuthology.orchestra.run.smithi089.stdout: "num_rdlocks": 0, 2021-04-09T18:33:56.815 INFO:teuthology.orchestra.run.smithi089.stdout: "num_wrlocks": 0, 2021-04-09T18:33:56.815 INFO:teuthology.orchestra.run.smithi089.stdout: "num_xlocks": 0, 2021-04-09T18:33:56.816 INFO:teuthology.orchestra.run.smithi089.stdout: "xlock_by": {} 2021-04-09T18:33:56.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:56.817 INFO:teuthology.orchestra.run.smithi089.stdout: "linklock": {}, 2021-04-09T18:33:56.817 INFO:teuthology.orchestra.run.smithi089.stdout: "dirfragtreelock": {}, 2021-04-09T18:33:56.817 INFO:teuthology.orchestra.run.smithi089.stdout: "filelock": { 2021-04-09T18:33:56.818 INFO:teuthology.orchestra.run.smithi089.stdout: "gather_set": [], 2021-04-09T18:33:56.818 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "excl", 2021-04-09T18:33:56.819 INFO:teuthology.orchestra.run.smithi089.stdout: "is_leased": false, 2021-04-09T18:33:56.819 INFO:teuthology.orchestra.run.smithi089.stdout: "num_rdlocks": 0, 2021-04-09T18:33:56.820 INFO:teuthology.orchestra.run.smithi089.stdout: "num_wrlocks": 0, 2021-04-09T18:33:56.820 INFO:teuthology.orchestra.run.smithi089.stdout: "num_xlocks": 0, 2021-04-09T18:33:56.820 INFO:teuthology.orchestra.run.smithi089.stdout: "xlock_by": {} 2021-04-09T18:33:56.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:56.821 INFO:teuthology.orchestra.run.smithi089.stdout: "xattrlock": { 2021-04-09T18:33:56.822 INFO:teuthology.orchestra.run.smithi089.stdout: "gather_set": [], 2021-04-09T18:33:56.822 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "excl", 2021-04-09T18:33:56.823 INFO:teuthology.orchestra.run.smithi089.stdout: "is_leased": false, 2021-04-09T18:33:56.823 INFO:teuthology.orchestra.run.smithi089.stdout: "num_rdlocks": 0, 2021-04-09T18:33:56.824 INFO:teuthology.orchestra.run.smithi089.stdout: "num_wrlocks": 0, 2021-04-09T18:33:56.824 INFO:teuthology.orchestra.run.smithi089.stdout: "num_xlocks": 0, 2021-04-09T18:33:56.825 INFO:teuthology.orchestra.run.smithi089.stdout: "xlock_by": {} 2021-04-09T18:33:56.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:56.825 INFO:teuthology.orchestra.run.smithi089.stdout: "snaplock": {}, 2021-04-09T18:33:56.826 INFO:teuthology.orchestra.run.smithi089.stdout: "nestlock": { 2021-04-09T18:33:56.826 INFO:teuthology.orchestra.run.smithi089.stdout: "gather_set": [], 2021-04-09T18:33:56.827 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "lock", 2021-04-09T18:33:56.827 INFO:teuthology.orchestra.run.smithi089.stdout: "is_leased": false, 2021-04-09T18:33:56.828 INFO:teuthology.orchestra.run.smithi089.stdout: "num_rdlocks": 0, 2021-04-09T18:33:56.828 INFO:teuthology.orchestra.run.smithi089.stdout: "num_wrlocks": 0, 2021-04-09T18:33:56.829 INFO:teuthology.orchestra.run.smithi089.stdout: "num_xlocks": 0, 2021-04-09T18:33:56.829 INFO:teuthology.orchestra.run.smithi089.stdout: "xlock_by": {} 2021-04-09T18:33:56.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2021-04-09T18:33:56.830 INFO:teuthology.orchestra.run.smithi089.stdout: "flocklock": {}, 2021-04-09T18:33:56.830 INFO:teuthology.orchestra.run.smithi089.stdout: "policylock": {}, 2021-04-09T18:33:56.831 INFO:teuthology.orchestra.run.smithi089.stdout: "states": [ 2021-04-09T18:33:56.831 INFO:teuthology.orchestra.run.smithi089.stdout: "auth", 2021-04-09T18:33:56.832 INFO:teuthology.orchestra.run.smithi089.stdout: "dirty", 2021-04-09T18:33:56.832 INFO:teuthology.orchestra.run.smithi089.stdout: "dirtyparent", 2021-04-09T18:33:56.833 INFO:teuthology.orchestra.run.smithi089.stdout: "dirtypool" 2021-04-09T18:33:56.833 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2021-04-09T18:33:56.834 INFO:teuthology.orchestra.run.smithi089.stdout: "client_caps": [ 2021-04-09T18:33:56.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2021-04-09T18:33:56.834 INFO:teuthology.orchestra.run.smithi089.stdout: "client_id": 6994, 2021-04-09T18:33:56.835 INFO:teuthology.orchestra.run.smithi089.stdout: "pending": "pAsxLsXsxFsx", 2021-04-09T18:33:56.835 INFO:teuthology.orchestra.run.smithi089.stdout: "issued": "pAsxLsXsxFsx", 2021-04-09T18:33:56.836 INFO:teuthology.orchestra.run.smithi089.stdout: "wanted": "-", 2021-04-09T18:33:56.836 INFO:teuthology.orchestra.run.smithi089.stdout: "last_sent": 1 2021-04-09T18:33:56.837 INFO:teuthology.orchestra.run.smithi089.stdout: } 2021-04-09T18:33:56.837 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2021-04-09T18:33:56.837 INFO:teuthology.orchestra.run.smithi089.stdout: "loner": 6994, 2021-04-09T18:33:56.838 INFO:teuthology.orchestra.run.smithi089.stdout: "want_loner": 6994, 2021-04-09T18:33:56.838 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_caps_wanted": [] 2021-04-09T18:33:56.839 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:33:56.841 INFO:tasks.cephfs.filesystem:_json_asok output: { "path": "/foo", "ino": 1099511627776, "rdev": 0, "ctime": "2021-04-09 18:33:56.068205", "btime": "2021-04-09 18:33:56.068205", "mode": 16877, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2 }, "layout": { "stripe_unit": 0, "stripe_count": 0, "object_size": 0, "pool_id": -1, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2021-04-09 18:33:56.068205", "atime": "2021-04-09 18:33:56.068205", "time_warp_seq": 0, "change_attr": 0, "export_pin": -1, "client_ranges": [], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "0.000000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 0, "rsubdirs": 1, "rsnaps": 0, "rctime": "0.000000" }, "version": 2, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 2, "stray_prior_path": "", "symlink": "", "old_inodes": [], "dirfragtree": { "splits": [] }, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "request": 0, "dirfrag": 1, "caps": 1, "dirtyparent": 1, "dirty": 1 }, "nref": 4, "versionlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": { "gather_set": [], "state": "excl", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "linklock": {}, "dirfragtreelock": {}, "filelock": { "gather_set": [], "state": "excl", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "xattrlock": { "gather_set": [], "state": "excl", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "snaplock": {}, "nestlock": { "gather_set": [], "state": "lock", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 6994, "pending": "pAsxLsXsxFsx", "issued": "pAsxLsXsxFsx", "wanted": "-", "last_sent": 1 } ], "loner": 6994, "want_loner": 6994, "mds_caps_wanted": [] } 2021-04-09T18:33:56.842 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:33:56.842 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:56.861 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:56.880 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:56.899 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:56.918 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:33:56.936 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:33:56.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:56.937 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:56.938 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:56.953 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:33:56.954 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:33:56.955 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi090.front.sepia.ceph.com... 2021-04-09T18:33:56.956 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:33:56.956 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:57.034 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13870]: fuse finished with error 0 and tester_r 0 2021-04-09T18:33:57.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:57.037 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:57.037 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:57.084 INFO:teuthology.orchestra.run.smithi090.stdout:ext2/ext3 2021-04-09T18:33:57.085 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:33:57.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:33:57.201 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:33:57.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:57.249 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:57.250 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:57.257 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-04-09T18:33:57.258 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-04-09T18:33:57.259 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2021-04-09T18:33:57.259 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:33:57.260 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:57.343 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13449]: fuse finished with error 0 and tester_r 0 2021-04-09T18:33:57.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:57.345 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:57.346 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:57.415 INFO:teuthology.orchestra.run.smithi136.stdout:ext2/ext3 2021-04-09T18:33:57.417 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:33:57.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:33:57.418 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:33:57.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:33:57.466 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:33:57.466 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:33:57.473 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:33:57.474 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:33:57.476 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:33:57.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:33:57.477 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:33:57.525 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:33:57.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.616 7f66751aa700 1 Processor -- start 2021-04-09T18:33:57.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.616 7f66751aa700 1 -- start start 2021-04-09T18:33:57.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.616 7f66751aa700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f66700f5510 0x7f66700f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:57.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.616 7f66751aa700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66700fbb10 con 0x7f66700e9ad0 2021-04-09T18:33:57.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.616 7f66751aa700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667009f900 con 0x7f66701c8000 2021-04-09T18:33:57.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.616 7f66751aa700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66700e9f20 con 0x7f66700f5510 2021-04-09T18:33:57.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.620 7f666ed9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f66700f5510 0x7f66700f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:57.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.620 7f666ed9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f66700f5510 0x7f66700f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33070/0 (socket says 172.21.15.79:33070) 2021-04-09T18:33:57.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.620 7f666ed9d700 1 -- 172.21.15.79:0/1340635431 learned_addr learned my addr 172.21.15.79:0/1340635431 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:57.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.620 7f666ed9d700 1 -- 172.21.15.79:0/1340635431 >> v1:172.21.15.89:6789/0 conn(0x7f66701c8000 legacy=0x7f66701ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:57.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.620 7f666ed9d700 1 -- 172.21.15.79:0/1340635431 >> v1:172.21.15.79:6789/0 conn(0x7f66700e9ad0 legacy=0x7f667009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:57.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.620 7f666dd9b700 1 -- 172.21.15.79:0/1340635431 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177687249 0 0) 0x7f66580010d0 con 0x7f66700e9ad0 2021-04-09T18:33:57.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.620 7f666ed9d700 1 -- 172.21.15.79:0/1340635431 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66700e56c0 con 0x7f66700f5510 2021-04-09T18:33:57.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.620 7f666ed9d700 1 --2- 172.21.15.79:0/1340635431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66700f5510 0x7f66700f64a0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f6668002f30 tx=0x7f666800bd20).ready entity=mon.0 client_cookie=15aa7ebd8223f327 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:57.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.620 7f666dd9b700 1 -- 172.21.15.79:0/1340635431 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f66700e56c0 con 0x7f66700f5510 2021-04-09T18:33:57.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.620 7f666dd9b700 1 -- 172.21.15.79:0/1340635431 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6668009a20 con 0x7f66700f5510 2021-04-09T18:33:57.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.620 7f666dd9b700 1 -- 172.21.15.79:0/1340635431 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6668009df0 con 0x7f66700f5510 2021-04-09T18:33:57.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.620 7f66751aa700 1 -- 172.21.15.79:0/1340635431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66700f5510 msgr2=0x7f66700f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:57.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.620 7f66751aa700 1 --2- 172.21.15.79:0/1340635431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66700f5510 0x7f66700f64a0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f6668002f30 tx=0x7f666800bd20).stop 2021-04-09T18:33:57.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.620 7f66751aa700 1 -- 172.21.15.79:0/1340635431 shutdown_connections 2021-04-09T18:33:57.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.620 7f66751aa700 1 --2- 172.21.15.79:0/1340635431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66700f5510 0x7f66700f64a0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:57.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.620 7f66751aa700 1 -- 172.21.15.79:0/1340635431 >> 172.21.15.79:0/1340635431 conn(0x7f66700e5fd0 msgr2=0x7f66700e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:57.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.620 7f66751aa700 1 -- 172.21.15.79:0/1340635431 shutdown_connections 2021-04-09T18:33:57.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.620 7f66751aa700 1 -- 172.21.15.79:0/1340635431 wait complete. 2021-04-09T18:33:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.624 7f66751aa700 1 Processor -- start 2021-04-09T18:33:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.624 7f66751aa700 1 -- start start 2021-04-09T18:33:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.624 7f66751aa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66701a0860 0x7f66700b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.624 7f66751aa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66700c42b0 0x7f66700af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.624 7f66751aa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66700d30c0 0x7f66700d3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.624 7f66751aa700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66701c3db0 con 0x7f66700c42b0 2021-04-09T18:33:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.624 7f66751aa700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6670096c40 con 0x7f66700d30c0 2021-04-09T18:33:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.624 7f66751aa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66701a0cb0 con 0x7f66701a0860 2021-04-09T18:33:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.624 7f666e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66700c42b0 0x7f66700af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.624 7f666e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66700c42b0 0x7f66700af9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33078/0 (socket says 172.21.15.79:33078) 2021-04-09T18:33:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.624 7f666e59c700 1 -- 172.21.15.79:0/447444818 learned_addr learned my addr 172.21.15.79:0/447444818 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.624 7f666ed9d700 1 --2- 172.21.15.79:0/447444818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66701a0860 0x7f66700b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.624 7f666f59e700 1 --2- 172.21.15.79:0/447444818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66700d30c0 0x7f66700d3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.624 7f666e59c700 1 -- 172.21.15.79:0/447444818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66701a0860 msgr2=0x7f66700b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.624 7f666e59c700 1 --2- 172.21.15.79:0/447444818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66701a0860 0x7f66700b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.628 7f666e59c700 1 -- 172.21.15.79:0/447444818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66700d30c0 msgr2=0x7f66700d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.628 7f666e59c700 1 --2- 172.21.15.79:0/447444818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66700d30c0 0x7f66700d3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.628 7f666e59c700 1 -- 172.21.15.79:0/447444818 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66700affe0 con 0x7f66700c42b0 2021-04-09T18:33:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.628 7f666e59c700 1 --2- 172.21.15.79:0/447444818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66700c42b0 0x7f66700af9b0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f66700d8380 tx=0x7f665800cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.628 7f66677fe700 1 -- 172.21.15.79:0/447444818 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f66700affe0 con 0x7f66700c42b0 2021-04-09T18:33:57.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.628 7f66677fe700 1 -- 172.21.15.79:0/447444818 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6658010510 con 0x7f66700c42b0 2021-04-09T18:33:57.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.628 7f66751aa700 1 -- 172.21.15.79:0/447444818 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66701af720 con 0x7f66700c42b0 2021-04-09T18:33:57.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.628 7f66677fe700 1 -- 172.21.15.79:0/447444818 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f66580106f0 con 0x7f66700c42b0 2021-04-09T18:33:57.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.628 7f66751aa700 1 -- 172.21.15.79:0/447444818 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66700981e0 con 0x7f66700c42b0 2021-04-09T18:33:57.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.628 7f66677fe700 1 -- 172.21.15.79:0/447444818 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6658019020 con 0x7f66700c42b0 2021-04-09T18:33:57.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.628 7f66677fe700 1 --2- 172.21.15.79:0/447444818 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6654029100 0x7f665402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:57.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.628 7f66677fe700 1 -- 172.21.15.79:0/447444818 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f6658038dc0 con 0x7f66700c42b0 2021-04-09T18:33:57.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.628 7f666ed9d700 1 --2- 172.21.15.79:0/447444818 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6654029100 0x7f665402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:57.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.628 7f666ed9d700 1 --2- 172.21.15.79:0/447444818 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6654029100 0x7f665402b650 crc :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:57.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.632 7f66751aa700 1 -- 172.21.15.79:0/447444818 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66700e39d0 con 0x7f66700c42b0 2021-04-09T18:33:57.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.640 7f66677fe700 1 -- 172.21.15.79:0/447444818 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6658010300 con 0x7f66700c42b0 2021-04-09T18:33:57.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.808 7f66751aa700 1 -- 172.21.15.79:0/447444818 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f66700a1cb0 con 0x7f66700c42b0 2021-04-09T18:33:57.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.812 7f66677fe700 1 -- 172.21.15.79:0/447444818 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v89) v1 ==== 81+0+30755 (secure 0 0 0) 0x7f66700e5c90 con 0x7f66700c42b0 2021-04-09T18:33:57.817 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:57.817 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:33:57.817 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 89, 2021-04-09T18:33:57.817 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:33:57.818 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:33:57.818 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:33:49.861312", 2021-04-09T18:33:57.818 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:33:57.818 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:33:57.819 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:33:57.819 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:33:57.819 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:33:57.819 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:33:57.819 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:33:57.820 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:33:57.820 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:33:57.820 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:33:57.820 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:33:57.821 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:33:57.821 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:33:57.821 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:33:57.821 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:33:57.821 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 17, 2021-04-09T18:33:57.822 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:33:57.822 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:33:57.822 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:33:57.822 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:33:57.822 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:33:57.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.823 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:33:57.823 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:33:57.823 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:33:57.824 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:33:57.824 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:33:57.824 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:33:57.824 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:33:57.824 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:33:57.825 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:33:57.825 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:33:57.825 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:33:57.825 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:33:57.825 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:33:57.826 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:33:57.826 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:33:57.826 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:33:57.826 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:33:57.827 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:33:57.827 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:33:57.827 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:33:57.827 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:33:57.827 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:33:57.828 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:33:57.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.828 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:33:57.828 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:33:57.828 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:33:57.829 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:33:57.829 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:33:57.829 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:33:57.829 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:33:57.830 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:33:57.830 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:33:57.830 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:33:57.830 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:33:57.830 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:33:57.831 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:33:57.831 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:33:57.831 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:33:57.831 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:33:57.831 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:33:57.832 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:33:57.832 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:33:57.832 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:33:57.832 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:33:57.833 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:33:57.833 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:33:57.833 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:33:57.833 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:33:57.833 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:33:57.834 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:33:57.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.834 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:33:57.834 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:33:57.834 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:33:57.835 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:33:57.835 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:33:57.835 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:33:57.835 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:33:57.835 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:33:57.836 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:33:57.836 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:33:57.836 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:33:57.836 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:33:57.837 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:33:57.837 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:33:57.837 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.838 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 16, 2021-04-09T18:33:57.838 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2021-04-09T18:33:57.838 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:33:46.135398", 2021-04-09T18:33:57.838 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:33:57.838 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:33:57.839 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:33:57.839 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:33:57.839 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:33:57.839 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:33:57.840 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:33:57.840 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:33:57.840 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:33:57.840 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:33:57.840 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:33:57.841 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:33:57.841 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:33:57.841 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:33:57.841 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:33:57.841 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:33:57.842 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:33:57.842 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:33:57.842 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:33:57.842 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:33:57.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.843 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "87", 2021-04-09T18:33:57.843 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:33:57.843 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:33:57.843 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:33:57.844 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:33:57.844 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:33:57.844 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:33:57.844 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:33:57.844 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:33:57.845 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:33:57.845 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:33:57.845 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:33:57.845 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:33:57.845 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:33:57.846 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:33:57.846 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:33:57.846 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:33:57.846 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:33:57.846 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:33:57.847 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:33:57.847 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:33:57.847 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:33:57.847 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:33:57.848 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:33:57.848 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:33:57.848 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:33:57.848 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:33:57.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:33:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:33:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:33:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:33:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:33:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:33:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:33:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:33:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:33:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:33:57.851 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:33:57.851 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2021-04-09T18:33:57.851 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2021-04-09T18:33:57.851 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2021-04-09T18:33:57.852 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2021-04-09T18:33:57.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.852 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:33:57.852 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:33:57.852 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2021-04-09T18:33:57.853 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.853 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.853 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 17, 2021-04-09T18:33:57.854 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2021-04-09T18:33:57.854 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:33:47.443962", 2021-04-09T18:33:57.854 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:33:57.854 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:33:57.854 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:33:57.855 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:33:57.855 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:33:57.855 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:33:57.855 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:33:57.856 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:33:57.856 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:33:57.856 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:33:57.856 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:33:57.856 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:33:57.857 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:33:57.857 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:33:57.857 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:33:57.857 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:33:57.857 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:33:57.858 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:33:57.858 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:33:57.858 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:33:57.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.858 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "89", 2021-04-09T18:33:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:33:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:33:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:33:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:33:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:33:57.860 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:33:57.860 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:33:57.860 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:33:57.860 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:33:57.861 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:33:57.861 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:33:57.861 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:33:57.861 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:33:57.861 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:33:57.862 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:33:57.862 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:33:57.862 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:33:57.862 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:33:57.862 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:33:57.863 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:33:57.863 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:33:57.863 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:33:57.863 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:33:57.864 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:33:57.864 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:33:57.864 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:33:57.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.865 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:33:57.865 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:33:57.865 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:33:57.865 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:33:57.866 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:33:57.866 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:33:57.866 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:33:57.866 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:33:57.866 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:33:57.867 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:33:57.867 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:33:57.867 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:33:57.867 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:33:57.868 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:33:57.868 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2021-04-09T18:33:57.868 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.868 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.868 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.869 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:33:57.869 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:33:57.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.869 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:33:57.870 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:33:57.870 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:57.870 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:57.870 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:57.870 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:57.871 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:57.871 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:57.871 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:57.871 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 86, 2021-04-09T18:33:57.872 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:57.872 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:57.872 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:57.872 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.873 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.873 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:33:57.873 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:57.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.874 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.874 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:33:57.874 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:57.874 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.874 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.875 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:57.875 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.875 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.876 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:33:57.876 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:57.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.877 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.877 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:33:57.877 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:57.877 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.877 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.878 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:57.878 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.878 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.879 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:33:57.879 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:57.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.879 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.880 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:33:57.880 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:57.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.880 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.881 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:57.881 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.881 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.882 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:33:57.882 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:57.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.882 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.883 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:33:57.883 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:33:57.883 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.883 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.884 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:33:57.884 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:33:57.884 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:33:57.884 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:33:57.884 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:57.885 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:57.885 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:57.885 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.886 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:33:57.886 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:33:57.886 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:57.886 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:57.887 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:57.887 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:57.887 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:57.887 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:57.887 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:57.888 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 77, 2021-04-09T18:33:57.888 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:57.888 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:57.888 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:57.888 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.889 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.889 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:33:57.889 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:57.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.890 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.890 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:33:57.890 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:57.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.891 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.891 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:57.891 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.892 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.892 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:33:57.892 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:57.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.893 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.893 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:33:57.893 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:57.893 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.894 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.894 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:57.894 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.895 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.895 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:33:57.895 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:57.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.896 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.896 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:33:57.896 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:57.896 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.897 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.897 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:57.897 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.898 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.898 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:33:57.898 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:57.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.899 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.899 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:33:57.899 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:33:57.899 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.899 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.900 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:33:57.900 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:33:57.900 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:33:57.901 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:33:57.901 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:57.901 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:57.901 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:57.901 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.902 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:33:57.902 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:33:57.902 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:57.903 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:57.903 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:57.903 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:57.903 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:57.903 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 85, 2021-04-09T18:33:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:57.905 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.905 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.905 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:33:57.905 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:57.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.906 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.906 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:33:57.906 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:57.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.907 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.907 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:57.908 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.908 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.908 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:33:57.908 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:57.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.909 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.909 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:33:57.909 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:33:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:33:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:33:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:33:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:33:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:33:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:33:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:33:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:33:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:33:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:33:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 85, 2021-04-09T18:33:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:33:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:33:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:33:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:33:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:33:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:33:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:33:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:33:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:33:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:33:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:33:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:33:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:33:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:33:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:33:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 86, 2021-04-09T18:33:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:33:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:33:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:33:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:33:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:33:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.949 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:33:57.949 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:57.949 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.949 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.950 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:57.950 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.950 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.950 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:33:57.951 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:57.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.951 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.952 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:33:57.952 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:33:57.952 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.952 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.953 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:33:57.953 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:33:57.953 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:33:57.953 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:33:57.953 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:57.954 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:57.954 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:57.954 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.955 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:33:57.955 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:33:57.955 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:57.955 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:57.956 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:57.956 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:57.956 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:57.956 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:57.956 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 85, 2021-04-09T18:33:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.958 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.958 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:33:57.958 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:57.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:33:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.960 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.960 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:57.960 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.961 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.961 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:33:57.961 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:57.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.962 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.962 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:33:57.962 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:57.962 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.963 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.963 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:57.963 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.964 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.964 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:33:57.964 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:57.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.965 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:33:57.965 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:57.965 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.965 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.966 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:57.966 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.966 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.967 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:33:57.967 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:57.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:33:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:33:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:33:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:33:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:33:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:33:57.970 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:57.970 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:57.970 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:57.970 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.971 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:33:57.971 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:33:57.971 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:57.971 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:57.973 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:57.973 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 86, 2021-04-09T18:33:57.973 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:57.973 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:57.973 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:57.974 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.974 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.974 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:33:57.974 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:57.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.975 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.975 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:33:57.975 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:57.976 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.976 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.976 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:33:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:33:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:57.980 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.980 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.980 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:33:57.980 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:57.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.981 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.981 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:33:57.981 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:33:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:33:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:33:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:33:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:33:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:33:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:33:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:33:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:33:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:33:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:33:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:33:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:33:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:33:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:33:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:33:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 87, 2021-04-09T18:33:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:33:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:33:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:33:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:33:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:33:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:33:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:33:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:33:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:33:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:33:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:33:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:33:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:33:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:33:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:33:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:33:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:33:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:33:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:33:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:33:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:33:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:33:58.003 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:33:58.003 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:33:58.003 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:33:58.003 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:33:58.004 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:58.004 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:33:58.004 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:33:58.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:58.004 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:33:58.005 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:58.005 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:58.005 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:58.005 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:58.005 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:58.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:58.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:58.006 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:33:58.006 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:58.007 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:58.007 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:58.007 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:58.007 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:58.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:58.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:58.008 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:33:58.008 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:58.008 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:58.008 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:58.009 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:58.009 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:58.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:58.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:58.010 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:33:58.010 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:58.010 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:58.010 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:58.010 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:58.011 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:58.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:58.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:58.011 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:33:58.011 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:58.012 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:58.012 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:58.012 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:58.012 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:58.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:58.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:58.013 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:33:58.013 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:58.013 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:58.014 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:58.014 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:58.014 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:58.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:58.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:58.015 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:33:58.015 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:58.015 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:58.015 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:58.016 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:58.016 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:58.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:58.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:33:58.016 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:33:58.017 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:33:58.017 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:33:58.017 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:33:58.017 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:33:58.017 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:33:58.018 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:58.018 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:33:58.018 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:33:58.018 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:33:58.018 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:33:58.019 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:33:58.019 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": {}, 2021-04-09T18:33:58.019 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:33:58.019 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:33:58.020 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:33:58.020 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:33:58.020 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:33:58.020 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:33:58.020 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:33:58.021 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:33:58.021 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:33:58.021 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:33:58.021 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:33:58.021 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:33:58.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:58.022 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:33:58.022 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:33:58.022 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:33:58.022 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:33:58.023 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:33:58.023 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:33:58.023 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:33:58.023 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:33:58.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:33:58.024 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:33:58.024 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:33:58.024 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:33:58.024 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:33:58.024 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:33:58.025 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:33:58.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.812 7f66751aa700 1 -- 172.21.15.79:0/447444818 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6654029100 msgr2=0x7f665402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:58.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.812 7f66751aa700 1 --2- 172.21.15.79:0/447444818 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6654029100 0x7f665402b650 crc :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:58.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.816 7f66751aa700 1 -- 172.21.15.79:0/447444818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66700c42b0 msgr2=0x7f66700af9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:58.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.816 7f66751aa700 1 --2- 172.21.15.79:0/447444818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66700c42b0 0x7f66700af9b0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f66700d8380 tx=0x7f665800cae0).stop 2021-04-09T18:33:58.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.816 7f66751aa700 1 -- 172.21.15.79:0/447444818 shutdown_connections 2021-04-09T18:33:58.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.816 7f66751aa700 1 --2- 172.21.15.79:0/447444818 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6654029100 0x7f665402b650 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:58.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.816 7f66751aa700 1 --2- 172.21.15.79:0/447444818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66700d30c0 0x7f66700d3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:58.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.816 7f66751aa700 1 --2- 172.21.15.79:0/447444818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66701a0860 0x7f66700b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:58.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.816 7f66751aa700 1 --2- 172.21.15.79:0/447444818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66700c42b0 0x7f66700af9b0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:58.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.816 7f66751aa700 1 -- 172.21.15.79:0/447444818 >> 172.21.15.79:0/447444818 conn(0x7f66700ba930 msgr2=0x7f667009a510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:58.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.816 7f66751aa700 1 -- 172.21.15.79:0/447444818 shutdown_connections 2021-04-09T18:33:58.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:57.816 7f66751aa700 1 -- 172.21.15.79:0/447444818 wait complete. 2021-04-09T18:33:58.030 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:58.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff46c069700 1 Processor -- start 2021-04-09T18:33:58.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff46c069700 1 -- start start 2021-04-09T18:33:58.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff46c069700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff4640f5510 0x7ff4640f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:58.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff46c069700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4640e9ad0 0x7ff46409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:58.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff46c069700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4640fbb10 con 0x7ff4641c2da0 2021-04-09T18:33:58.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff46c069700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4640e9f20 con 0x7ff4640f5510 2021-04-09T18:33:58.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff46c069700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4640e59c0 con 0x7ff4640e9ad0 2021-04-09T18:33:58.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff46960c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4640e9ad0 0x7ff46409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:58.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff469e0d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff4640f5510 0x7ff4640f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:58.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff46960c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4640e9ad0 0x7ff46409f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:58312/0 (socket says 172.21.15.79:58312) 2021-04-09T18:33:58.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff46960c700 1 -- 172.21.15.79:0/2936440290 learned_addr learned my addr 172.21.15.79:0/2936440290 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:58.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff46960c700 1 -- 172.21.15.79:0/2936440290 >> v2:172.21.15.89:3300/0 conn(0x7ff4640f5510 msgr2=0x7ff4640f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:58.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff46960c700 1 --2- 172.21.15.79:0/2936440290 >> v2:172.21.15.89:3300/0 conn(0x7ff4640f5510 0x7ff4640f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:58.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff46960c700 1 -- 172.21.15.79:0/2936440290 >> v1:172.21.15.89:6789/0 conn(0x7ff4641c2da0 legacy=0x7ff4641c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:58.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff46960c700 1 -- 172.21.15.79:0/2936440290 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4640e56c0 con 0x7ff4640e9ad0 2021-04-09T18:33:58.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff469e0d700 1 --2- 172.21.15.79:0/2936440290 >> v2:172.21.15.89:3300/0 conn(0x7ff4640f5510 0x7ff4640f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:58.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff46960c700 1 --2- 172.21.15.79:0/2936440290 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4640e9ad0 0x7ff46409f100 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7ff454002f30 tx=0x7ff45400bd20).ready entity=mon.2 client_cookie=32dc5fcff8bbd998 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:58.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff468e0b700 1 -- 172.21.15.79:0/2936440290 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff4640e56c0 con 0x7ff4640e9ad0 2021-04-09T18:33:58.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff468e0b700 1 -- 172.21.15.79:0/2936440290 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff454009980 con 0x7ff4640e9ad0 2021-04-09T18:33:58.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff468e0b700 1 -- 172.21.15.79:0/2936440290 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff454009d50 con 0x7ff4640e9ad0 2021-04-09T18:33:58.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff46c069700 1 -- 172.21.15.79:0/2936440290 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4640e9ad0 msgr2=0x7ff46409f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:58.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.124 7ff46c069700 1 --2- 172.21.15.79:0/2936440290 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4640e9ad0 0x7ff46409f100 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7ff454002f30 tx=0x7ff45400bd20).stop 2021-04-09T18:33:58.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.128 7ff46c069700 1 -- 172.21.15.79:0/2936440290 shutdown_connections 2021-04-09T18:33:58.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.128 7ff46c069700 1 --2- 172.21.15.79:0/2936440290 >> v2:172.21.15.89:3300/0 conn(0x7ff4640f5510 0x7ff4640f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:58.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.128 7ff46c069700 1 --2- 172.21.15.79:0/2936440290 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4640e9ad0 0x7ff46409f100 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:58.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.128 7ff46c069700 1 -- 172.21.15.79:0/2936440290 >> 172.21.15.79:0/2936440290 conn(0x7ff4640e5fd0 msgr2=0x7ff4640e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:58.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.128 7ff46c069700 1 -- 172.21.15.79:0/2936440290 shutdown_connections 2021-04-09T18:33:58.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.128 7ff46c069700 1 -- 172.21.15.79:0/2936440290 wait complete. 2021-04-09T18:33:58.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.132 7ff46c069700 1 Processor -- start 2021-04-09T18:33:58.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.132 7ff46c069700 1 -- start start 2021-04-09T18:33:58.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.132 7ff46c069700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4640d67f0 0x7ff4641aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:58.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.132 7ff46c069700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff464094010 0x7ff464094460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:58.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.132 7ff46c069700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4641a9d60 0x7ff4641aa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:58.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.132 7ff46c069700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4640d5200 con 0x7ff464094010 2021-04-09T18:33:58.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.132 7ff46c069700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4641ab3c0 con 0x7ff4640d67f0 2021-04-09T18:33:58.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.132 7ff46c069700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff464094d10 con 0x7ff4641a9d60 2021-04-09T18:33:58.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.132 7ff46960c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff464094010 0x7ff464094460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:58.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.132 7ff46960c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff464094010 0x7ff464094460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33092/0 (socket says 172.21.15.79:33092) 2021-04-09T18:33:58.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.132 7ff46960c700 1 -- 172.21.15.79:0/2453907128 learned_addr learned my addr 172.21.15.79:0/2453907128 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:58.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.132 7ff469e0d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4640d67f0 0x7ff4641aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:58.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.132 7ff46a60e700 1 --2- 172.21.15.79:0/2453907128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4641a9d60 0x7ff4641aa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:58.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.132 7ff46960c700 1 -- 172.21.15.79:0/2453907128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4641a9d60 msgr2=0x7ff4641aa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:58.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.132 7ff46960c700 1 --2- 172.21.15.79:0/2453907128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4641a9d60 0x7ff4641aa1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:58.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.132 7ff46960c700 1 -- 172.21.15.79:0/2453907128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4640d67f0 msgr2=0x7ff4641aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:58.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.132 7ff46960c700 1 --2- 172.21.15.79:0/2453907128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4640d67f0 0x7ff4641aad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:58.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.132 7ff46960c700 1 -- 172.21.15.79:0/2453907128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4640d6c40 con 0x7ff464094010 2021-04-09T18:33:58.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.132 7ff46960c700 1 --2- 172.21.15.79:0/2453907128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff464094010 0x7ff464094460 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7ff454002f30 tx=0x7ff454006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:58.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.136 7ff45a7fc700 1 -- 172.21.15.79:0/2453907128 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff4640d6c40 con 0x7ff464094010 2021-04-09T18:33:58.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.136 7ff45a7fc700 1 -- 172.21.15.79:0/2453907128 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff454011c90 con 0x7ff464094010 2021-04-09T18:33:58.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.136 7ff45a7fc700 1 -- 172.21.15.79:0/2453907128 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff45401d630 con 0x7ff464094010 2021-04-09T18:33:58.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.136 7ff46c069700 1 -- 172.21.15.79:0/2453907128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4640b6490 con 0x7ff464094010 2021-04-09T18:33:58.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.136 7ff46c069700 1 -- 172.21.15.79:0/2453907128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4641aa970 con 0x7ff464094010 2021-04-09T18:33:58.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.136 7ff45a7fc700 1 -- 172.21.15.79:0/2453907128 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff45400b130 con 0x7ff464094010 2021-04-09T18:33:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.136 7ff45a7fc700 1 --2- 172.21.15.79:0/2453907128 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff44c029100 0x7ff44c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.136 7ff45a7fc700 1 -- 172.21.15.79:0/2453907128 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5924+0+0 (secure 0 0 0) 0x7ff45403b080 con 0x7ff464094010 2021-04-09T18:33:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.136 7ff469e0d700 1 --2- 172.21.15.79:0/2453907128 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff44c029100 0x7ff44c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.136 7ff469e0d700 1 --2- 172.21.15.79:0/2453907128 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff44c029100 0x7ff44c02b650 crc :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:58.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.152 7ff46c069700 1 -- 172.21.15.79:0/2453907128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4640e39d0 con 0x7ff464094010 2021-04-09T18:33:58.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.160 7ff45a7fc700 1 -- 172.21.15.79:0/2453907128 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff454011a80 con 0x7ff464094010 2021-04-09T18:33:58.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.324 7ff46c069700 1 -- 172.21.15.79:0/2453907128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4640f5b10 con 0x7ff464094010 2021-04-09T18:33:58.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.328 7ff45a7fc700 1 -- 172.21.15.79:0/2453907128 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2103 (secure 0 0 0) 0x7ff454009770 con 0x7ff464094010 2021-04-09T18:33:58.333 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 54 2021-04-09T18:33:58.334 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:58.334 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":54,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6831,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3171732398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3171732398},{"type":"v1","addr":"172.21.15.79:6833","nonce":3171732398}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":51}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:33:47.856435","modified":"2021-04-09 18:33:49.091531","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6059":{"gid":6059,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/2698757363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2698757363},{"type":"v1","addr":"172.21.15.89:6835","nonce":2698757363}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-04-09T18:33:58.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.332 7ff46c069700 1 -- 172.21.15.79:0/2453907128 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff44c029100 msgr2=0x7ff44c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:58.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.332 7ff46c069700 1 --2- 172.21.15.79:0/2453907128 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff44c029100 0x7ff44c02b650 crc :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:58.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.332 7ff46c069700 1 -- 172.21.15.79:0/2453907128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff464094010 msgr2=0x7ff464094460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:58.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.332 7ff46c069700 1 --2- 172.21.15.79:0/2453907128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff464094010 0x7ff464094460 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7ff454002f30 tx=0x7ff454006890).stop 2021-04-09T18:33:58.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.332 7ff46c069700 1 -- 172.21.15.79:0/2453907128 shutdown_connections 2021-04-09T18:33:58.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.332 7ff46c069700 1 --2- 172.21.15.79:0/2453907128 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff44c029100 0x7ff44c02b650 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:58.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.332 7ff46c069700 1 --2- 172.21.15.79:0/2453907128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4640d67f0 0x7ff4641aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:58.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.332 7ff46c069700 1 --2- 172.21.15.79:0/2453907128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4641a9d60 0x7ff4641aa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:58.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.332 7ff46c069700 1 --2- 172.21.15.79:0/2453907128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff464094010 0x7ff464094460 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:58.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.332 7ff46c069700 1 -- 172.21.15.79:0/2453907128 >> 172.21.15.79:0/2453907128 conn(0x7ff464093680 msgr2=0x7ff4640d2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:58.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.332 7ff46c069700 1 -- 172.21.15.79:0/2453907128 shutdown_connections 2021-04-09T18:33:58.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.332 7ff46c069700 1 -- 172.21.15.79:0/2453907128 wait complete. 2021-04-09T18:33:58.347 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-04-09T18:33:58.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.436 7f30b7b33700 1 Processor -- start 2021-04-09T18:33:58.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.436 7f30b7b33700 1 -- start start 2021-04-09T18:33:58.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b7b33700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f30b00e9ae0 0x7f30b009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:58.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b7b33700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b01c8010 0x7f30b01ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:58.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b7b33700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30b00fbb20 con 0x7f30b00f5520 2021-04-09T18:33:58.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b7b33700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30b01c3dc0 con 0x7f30b00e9ae0 2021-04-09T18:33:58.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b7b33700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b00e9f30 con 0x7f30b01c8010 2021-04-09T18:33:58.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b60d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b01c8010 0x7f30b01ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:58.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b60d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b01c8010 0x7f30b01ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:58330/0 (socket says 172.21.15.79:58330) 2021-04-09T18:33:58.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b60d8700 1 -- 172.21.15.79:0/4243584088 learned_addr learned my addr 172.21.15.79:0/4243584088 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:58.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b50d6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f30b00e9ae0 0x7f30b009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:58.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b60d8700 1 -- 172.21.15.79:0/4243584088 >> v2:172.21.15.89:3300/0 conn(0x7f30b00e9ae0 msgr2=0x7f30b009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:58.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b60d8700 1 --2- 172.21.15.79:0/4243584088 >> v2:172.21.15.89:3300/0 conn(0x7f30b00e9ae0 0x7f30b009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:58.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b60d8700 1 -- 172.21.15.79:0/4243584088 >> v1:172.21.15.89:6789/0 conn(0x7f30b00f5520 legacy=0x7f30b00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:58.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b60d8700 1 -- 172.21.15.79:0/4243584088 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b00e56d0 con 0x7f30b01c8010 2021-04-09T18:33:58.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b60d8700 1 --2- 172.21.15.79:0/4243584088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b01c8010 0x7f30b01ca470 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f30a80032b0 tx=0x7f30a800b3c0).ready entity=mon.2 client_cookie=4934974b92a0b003 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:58.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b48d5700 1 -- 172.21.15.79:0/4243584088 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f30b00e56d0 con 0x7f30b01c8010 2021-04-09T18:33:58.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b48d5700 1 -- 172.21.15.79:0/4243584088 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a800bca0 con 0x7f30b01c8010 2021-04-09T18:33:58.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b48d5700 1 -- 172.21.15.79:0/4243584088 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f30a8002020 con 0x7f30b01c8010 2021-04-09T18:33:58.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b7b33700 1 -- 172.21.15.79:0/4243584088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b01c8010 msgr2=0x7f30b01ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:58.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b7b33700 1 --2- 172.21.15.79:0/4243584088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b01c8010 0x7f30b01ca470 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f30a80032b0 tx=0x7f30a800b3c0).stop 2021-04-09T18:33:58.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b7b33700 1 -- 172.21.15.79:0/4243584088 shutdown_connections 2021-04-09T18:33:58.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b7b33700 1 --2- 172.21.15.79:0/4243584088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b01c8010 0x7f30b01ca470 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:58.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b7b33700 1 --2- 172.21.15.79:0/4243584088 >> v2:172.21.15.89:3300/0 conn(0x7f30b00e9ae0 0x7f30b009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:58.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b7b33700 1 -- 172.21.15.79:0/4243584088 >> 172.21.15.79:0/4243584088 conn(0x7f30b00e5fe0 msgr2=0x7f30b00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:58.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b7b33700 1 -- 172.21.15.79:0/4243584088 shutdown_connections 2021-04-09T18:33:58.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.440 7f30b7b33700 1 -- 172.21.15.79:0/4243584088 wait complete. 2021-04-09T18:33:58.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.444 7f30b7b33700 1 Processor -- start 2021-04-09T18:33:58.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.444 7f30b7b33700 1 -- start start 2021-04-09T18:33:58.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.444 7f30b7b33700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b009a930 0x7f30b009ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:58.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.444 7f30b7b33700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b00a8780 0x7f30b00a8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:58.459 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.444 7f30b7b33700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30b01aa550 0x7f30b01aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:58.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.444 7f30b7b33700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b009a630 con 0x7f30b009a930 2021-04-09T18:33:58.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.444 7f30b7b33700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b00a9200 con 0x7f30b01aa550 2021-04-09T18:33:58.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.444 7f30b7b33700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b009a0c0 con 0x7f30b00a8780 2021-04-09T18:33:58.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.444 7f30b58d7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b009a930 0x7f30b009ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:58.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.444 7f30b58d7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b009a930 0x7f30b009ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33104/0 (socket says 172.21.15.79:33104) 2021-04-09T18:33:58.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.444 7f30b58d7700 1 -- 172.21.15.79:0/3786652965 learned_addr learned my addr 172.21.15.79:0/3786652965 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:58.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.444 7f30b50d6700 1 --2- 172.21.15.79:0/3786652965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b00a8780 0x7f30b00a8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:58.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.444 7f30b60d8700 1 --2- 172.21.15.79:0/3786652965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30b01aa550 0x7f30b01aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:58.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.444 7f30b58d7700 1 -- 172.21.15.79:0/3786652965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b00a8780 msgr2=0x7f30b00a8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:58.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.444 7f30b58d7700 1 --2- 172.21.15.79:0/3786652965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b00a8780 0x7f30b00a8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:58.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.444 7f30b58d7700 1 -- 172.21.15.79:0/3786652965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30b01aa550 msgr2=0x7f30b01aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:58.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.444 7f30b58d7700 1 --2- 172.21.15.79:0/3786652965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30b01aa550 0x7f30b01aa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:58.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.444 7f30b58d7700 1 -- 172.21.15.79:0/3786652965 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b01aafd0 con 0x7f30b009a930 2021-04-09T18:33:58.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.448 7f30b58d7700 1 --2- 172.21.15.79:0/3786652965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b009a930 0x7f30b009ad80 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f30ac000b80 tx=0x7f30ac00ca80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:58.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.448 7f30a67fc700 1 -- 172.21.15.79:0/3786652965 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f30b01aafd0 con 0x7f30b009a930 2021-04-09T18:33:58.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.448 7f30a67fc700 1 -- 172.21.15.79:0/3786652965 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ac010510 con 0x7f30b009a930 2021-04-09T18:33:58.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.448 7f30b7b33700 1 -- 172.21.15.79:0/3786652965 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b01ab290 con 0x7f30b009a930 2021-04-09T18:33:58.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.448 7f30a67fc700 1 -- 172.21.15.79:0/3786652965 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f30ac0106f0 con 0x7f30b009a930 2021-04-09T18:33:58.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.448 7f30b7b33700 1 -- 172.21.15.79:0/3786652965 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30b01a65a0 con 0x7f30b009a930 2021-04-09T18:33:58.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.448 7f30a67fc700 1 -- 172.21.15.79:0/3786652965 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f30ac019020 con 0x7f30b009a930 2021-04-09T18:33:58.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.448 7f30a67fc700 1 --2- 172.21.15.79:0/3786652965 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3098029100 0x7f309802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:58.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.448 7f30a67fc700 1 -- 172.21.15.79:0/3786652965 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f30ac038dd0 con 0x7f30b009a930 2021-04-09T18:33:58.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.448 7f30b50d6700 1 --2- 172.21.15.79:0/3786652965 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3098029100 0x7f309802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:58.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.448 7f30b50d6700 1 --2- 172.21.15.79:0/3786652965 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3098029100 0x7f309802b650 crc :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:58.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.452 7f30b7b33700 1 -- 172.21.15.79:0/3786652965 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30b00e39e0 con 0x7f30b009a930 2021-04-09T18:33:58.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.456 7f30a67fc700 1 -- 172.21.15.79:0/3786652965 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f30ac000bf0 con 0x7f30b009a930 2021-04-09T18:33:58.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:58.612 7f30b7b33700 1 -- 172.21.15.79:0/3786652965 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f30b00f5b20 con 0x7f30b009a930 2021-04-09T18:33:59.143 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:33:59.140 7fbcd0516700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:33:59.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.144 7f30a67fc700 1 -- 172.21.15.79:0/3786652965 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v55) v1 ==== 161+0+0 (secure 0 0 0) 0x7f30ac010300 con 0x7f30b009a930 2021-04-09T18:33:59.178 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2021-04-09T18:33:59.183 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-04-09T18:33:59.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.184 7f30b7b33700 1 -- 172.21.15.79:0/3786652965 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3098029100 msgr2=0x7f309802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:59.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.184 7f30b7b33700 1 --2- 172.21.15.79:0/3786652965 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3098029100 0x7f309802b650 crc :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:59.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.184 7f30b7b33700 1 -- 172.21.15.79:0/3786652965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b009a930 msgr2=0x7f30b009ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:59.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.184 7f30b7b33700 1 --2- 172.21.15.79:0/3786652965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b009a930 0x7f30b009ad80 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f30ac000b80 tx=0x7f30ac00ca80).stop 2021-04-09T18:33:59.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.184 7f30b7b33700 1 -- 172.21.15.79:0/3786652965 shutdown_connections 2021-04-09T18:33:59.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.184 7f30b7b33700 1 --2- 172.21.15.79:0/3786652965 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3098029100 0x7f309802b650 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:59.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.184 7f30b7b33700 1 --2- 172.21.15.79:0/3786652965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30b01aa550 0x7f30b01aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:59.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.184 7f30b7b33700 1 --2- 172.21.15.79:0/3786652965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b009a930 0x7f30b009ad80 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:59.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.184 7f30b7b33700 1 --2- 172.21.15.79:0/3786652965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b00a8780 0x7f30b00a8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:59.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.184 7f30b7b33700 1 -- 172.21.15.79:0/3786652965 >> 172.21.15.79:0/3786652965 conn(0x7f30b00d3b50 msgr2=0x7f30b00b8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:59.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.184 7f30b7b33700 1 -- 172.21.15.79:0/3786652965 shutdown_connections 2021-04-09T18:33:59.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.184 7f30b7b33700 1 -- 172.21.15.79:0/3786652965 wait complete. 2021-04-09T18:33:59.207 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:33:59.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.300 7f11623f0700 1 Processor -- start 2021-04-09T18:33:59.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.300 7f11623f0700 1 -- start start 2021-04-09T18:33:59.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.300 7f11623f0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f115c0e9ae0 0x7f115c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:59.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.300 7f11623f0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115c0fbb20 con 0x7f115c1c8010 2021-04-09T18:33:59.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.300 7f11623f0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115c0e56d0 con 0x7f115c0f5520 2021-04-09T18:33:59.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.300 7f11623f0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115c1c3dc0 con 0x7f115c0e9ae0 2021-04-09T18:33:59.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.300 7f1160995700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f115c1c8010 0x7f115c1ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56058/0 (socket says 172.21.15.79:56058) 2021-04-09T18:33:59.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.300 7f1160995700 1 -- 172.21.15.79:0/2528409251 learned_addr learned my addr 172.21.15.79:0/2528409251 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:59.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.300 7f115b7fe700 1 --2- 172.21.15.79:0/2528409251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f115c0e9ae0 0x7f115c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:59.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.300 7f115affd700 1 -- 172.21.15.79:0/2528409251 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324707128 0 0) 0x7f1154001450 con 0x7f115c1c8010 2021-04-09T18:33:59.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.300 7f115affd700 1 -- 172.21.15.79:0/2528409251 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1144003240 con 0x7f115c1c8010 2021-04-09T18:33:59.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.300 7f115affd700 1 -- 172.21.15.79:0/2528409251 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679459442 0 0) 0x7f114c0010d0 con 0x7f115c0f5520 2021-04-09T18:33:59.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.300 7f115affd700 1 -- 172.21.15.79:0/2528409251 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1144003620 con 0x7f115c0f5520 2021-04-09T18:33:59.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.300 7f115b7fe700 1 -- 172.21.15.79:0/2528409251 >> v1:172.21.15.89:6789/0 conn(0x7f115c0f5520 legacy=0x7f115c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:59.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.300 7f115b7fe700 1 -- 172.21.15.79:0/2528409251 >> v1:172.21.15.79:6789/0 conn(0x7f115c1c8010 legacy=0x7f115c1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:59.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.300 7f115b7fe700 1 -- 172.21.15.79:0/2528409251 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c0e4330 con 0x7f115c0e9ae0 2021-04-09T18:33:59.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.300 7f115b7fe700 1 --2- 172.21.15.79:0/2528409251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f115c0e9ae0 0x7f115c09f110 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f1150002f30 tx=0x7f115000bcf0).ready entity=mon.2 client_cookie=61671c81eb662e16 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:59.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.300 7f115affd700 1 -- 172.21.15.79:0/2528409251 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f115c0e4330 con 0x7f115c0e9ae0 2021-04-09T18:33:59.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.300 7f115affd700 1 -- 172.21.15.79:0/2528409251 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1150009920 con 0x7f115c0e9ae0 2021-04-09T18:33:59.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.300 7f115affd700 1 -- 172.21.15.79:0/2528409251 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1150009cf0 con 0x7f115c0e9ae0 2021-04-09T18:33:59.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.304 7f11623f0700 1 -- 172.21.15.79:0/2528409251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f115c0e9ae0 msgr2=0x7f115c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:59.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.304 7f11623f0700 1 --2- 172.21.15.79:0/2528409251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f115c0e9ae0 0x7f115c09f110 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f1150002f30 tx=0x7f115000bcf0).stop 2021-04-09T18:33:59.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.304 7f11623f0700 1 -- 172.21.15.79:0/2528409251 shutdown_connections 2021-04-09T18:33:59.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.304 7f11623f0700 1 --2- 172.21.15.79:0/2528409251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f115c0e9ae0 0x7f115c09f110 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:59.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.304 7f11623f0700 1 -- 172.21.15.79:0/2528409251 >> 172.21.15.79:0/2528409251 conn(0x7f115c0e5fe0 msgr2=0x7f115c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:59.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.304 7f11623f0700 1 -- 172.21.15.79:0/2528409251 shutdown_connections 2021-04-09T18:33:59.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.304 7f11623f0700 1 -- 172.21.15.79:0/2528409251 wait complete. 2021-04-09T18:33:59.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.336 7f11623f0700 1 Processor -- start 2021-04-09T18:33:59.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.336 7f11623f0700 1 -- start start 2021-04-09T18:33:59.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f11623f0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f115c0b4ca0 0x7f115c0b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:59.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f11623f0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f115c0d7670 0x7f115c0b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:59.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f11623f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115c0d7ac0 0x7f115c0b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:59.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f11623f0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115c0e9f30 con 0x7f115c0d7ac0 2021-04-09T18:33:59.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f11623f0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115c0b2b60 con 0x7f115c0d7670 2021-04-09T18:33:59.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f11623f0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115c0b2e60 con 0x7f115c0b4ca0 2021-04-09T18:33:59.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f1160995700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115c0d7ac0 0x7f115c0b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:59.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f1160995700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115c0d7ac0 0x7f115c0b1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33122/0 (socket says 172.21.15.79:33122) 2021-04-09T18:33:59.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f1160995700 1 -- 172.21.15.79:0/3025112558 learned_addr learned my addr 172.21.15.79:0/3025112558 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:59.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f115b7fe700 1 --2- 172.21.15.79:0/3025112558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f115c0d7670 0x7f115c0b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:59.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f115bfff700 1 --2- 172.21.15.79:0/3025112558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f115c0b4ca0 0x7f115c0b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:59.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f1160995700 1 -- 172.21.15.79:0/3025112558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f115c0b4ca0 msgr2=0x7f115c0b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:59.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f1160995700 1 --2- 172.21.15.79:0/3025112558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f115c0b4ca0 0x7f115c0b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:59.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f1160995700 1 -- 172.21.15.79:0/3025112558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f115c0d7670 msgr2=0x7f115c0b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:59.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f1160995700 1 --2- 172.21.15.79:0/3025112558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f115c0d7670 0x7f115c0b1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:59.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f1160995700 1 -- 172.21.15.79:0/3025112558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c0b4a30 con 0x7f115c0d7ac0 2021-04-09T18:33:59.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f1160995700 1 --2- 172.21.15.79:0/3025112558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115c0d7ac0 0x7f115c0b1730 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f1154001210 tx=0x7f115400ce60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:59.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f1158ff9700 1 -- 172.21.15.79:0/3025112558 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1154005b80 con 0x7f115c0d7ac0 2021-04-09T18:33:59.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f1158ff9700 1 -- 172.21.15.79:0/3025112558 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1154005d80 con 0x7f115c0d7ac0 2021-04-09T18:33:59.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f11623f0700 1 -- 172.21.15.79:0/3025112558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f115c0b26f0 con 0x7f115c0d7ac0 2021-04-09T18:33:59.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f1158ff9700 1 -- 172.21.15.79:0/3025112558 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1154007300 con 0x7f115c0d7ac0 2021-04-09T18:33:59.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f11623f0700 1 -- 172.21.15.79:0/3025112558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115c0b1d60 con 0x7f115c0d7ac0 2021-04-09T18:33:59.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.340 7f1158ff9700 1 -- 172.21.15.79:0/3025112558 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f115401a060 con 0x7f115c0d7ac0 2021-04-09T18:33:59.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.344 7f1158ff9700 1 --2- 172.21.15.79:0/3025112558 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f113c029100 0x7f113c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:59.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.344 7f1158ff9700 1 -- 172.21.15.79:0/3025112558 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f11540392d0 con 0x7f115c0d7ac0 2021-04-09T18:33:59.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.344 7f115bfff700 1 --2- 172.21.15.79:0/3025112558 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f113c029100 0x7f113c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:59.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.344 7f115bfff700 1 --2- 172.21.15.79:0/3025112558 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f113c029100 0x7f113c02b650 crc :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:59.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.360 7f11623f0700 1 -- 172.21.15.79:0/3025112558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f115c0e39e0 con 0x7f115c0d7ac0 2021-04-09T18:33:59.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.368 7f1158ff9700 1 -- 172.21.15.79:0/3025112558 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1154005970 con 0x7f115c0d7ac0 2021-04-09T18:33:59.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.540 7f11623f0700 1 -- 172.21.15.79:0/3025112558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f115c0a1cc0 con 0x7f115c0d7ac0 2021-04-09T18:33:59.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.540 7f1158ff9700 1 -- 172.21.15.79:0/3025112558 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+1758 (secure 0 0 0) 0x7f1154000f70 con 0x7f115c0d7ac0 2021-04-09T18:33:59.548 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:33:59.549 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":55,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6831,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3171732398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3171732398},{"type":"v1","addr":"172.21.15.79:6833","nonce":3171732398}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":51}],"filesystems":[{"mdsmap":{"epoch":55,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:33:47.856435","modified":"2021-04-09 18:33:59.142122","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-04-09T18:33:59.551 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 55 2021-04-09T18:33:59.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.544 7f11623f0700 1 -- 172.21.15.79:0/3025112558 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f113c029100 msgr2=0x7f113c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:59.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.544 7f11623f0700 1 --2- 172.21.15.79:0/3025112558 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f113c029100 0x7f113c02b650 crc :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:59.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.544 7f11623f0700 1 -- 172.21.15.79:0/3025112558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115c0d7ac0 msgr2=0x7f115c0b1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:59.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.544 7f11623f0700 1 --2- 172.21.15.79:0/3025112558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115c0d7ac0 0x7f115c0b1730 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f1154001210 tx=0x7f115400ce60).stop 2021-04-09T18:33:59.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.544 7f11623f0700 1 -- 172.21.15.79:0/3025112558 shutdown_connections 2021-04-09T18:33:59.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.544 7f11623f0700 1 --2- 172.21.15.79:0/3025112558 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f113c029100 0x7f113c02b650 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:59.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.544 7f11623f0700 1 --2- 172.21.15.79:0/3025112558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115c0d7ac0 0x7f115c0b1730 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:59.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.544 7f11623f0700 1 --2- 172.21.15.79:0/3025112558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f115c0b4ca0 0x7f115c0b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:59.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.544 7f11623f0700 1 --2- 172.21.15.79:0/3025112558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f115c0d7670 0x7f115c0b1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:59.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.544 7f11623f0700 1 -- 172.21.15.79:0/3025112558 >> 172.21.15.79:0/3025112558 conn(0x7f115c0bad40 msgr2=0x7f115c09a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:59.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.544 7f11623f0700 1 -- 172.21.15.79:0/3025112558 shutdown_connections 2021-04-09T18:33:59.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.544 7f11623f0700 1 -- 172.21.15.79:0/3025112558 wait complete. 2021-04-09T18:33:59.560 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-04-09T18:33:59.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.644 7fc60f50f700 1 Processor -- start 2021-04-09T18:33:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.644 7fc60f50f700 1 -- start start 2021-04-09T18:33:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.644 7fc60f50f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc6080f5520 0x7fc6080f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.644 7fc60f50f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6080fbb20 con 0x7fc6080e9ae0 2021-04-09T18:33:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.644 7fc60f50f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60809f910 con 0x7fc6081c8010 2021-04-09T18:33:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.644 7fc60f50f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6080e9f30 con 0x7fc6080f5520 2021-04-09T18:33:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.644 7fc60cab2700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc6080e9ae0 0x7fc60809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56068/0 (socket says 172.21.15.79:56068) 2021-04-09T18:33:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.644 7fc60cab2700 1 -- 172.21.15.79:0/733766743 learned_addr learned my addr 172.21.15.79:0/733766743 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:33:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.648 7fc60d2b3700 1 --2- 172.21.15.79:0/733766743 >> v2:172.21.15.89:3300/0 conn(0x7fc6080f5520 0x7fc6080f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.648 7fc5fffff700 1 -- 172.21.15.79:0/733766743 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229925025 0 0) 0x7fc5f80010d0 con 0x7fc6080e9ae0 2021-04-09T18:33:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.648 7fc5fffff700 1 -- 172.21.15.79:0/733766743 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5f4003240 con 0x7fc6080e9ae0 2021-04-09T18:33:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.648 7fc60d2b3700 1 -- 172.21.15.79:0/733766743 >> v1:172.21.15.89:6789/0 conn(0x7fc6081c8010 legacy=0x7fc6081ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.648 7fc60d2b3700 1 -- 172.21.15.79:0/733766743 >> v1:172.21.15.79:6789/0 conn(0x7fc6080e9ae0 legacy=0x7fc60809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.648 7fc5fffff700 1 -- 172.21.15.79:0/733766743 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3733220278 0 0) 0x7fc5f8001650 con 0x7fc6080e9ae0 2021-04-09T18:33:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.648 7fc60d2b3700 1 -- 172.21.15.79:0/733766743 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6080e56d0 con 0x7fc6080f5520 2021-04-09T18:33:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.648 7fc60d2b3700 1 --2- 172.21.15.79:0/733766743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6080f5520 0x7fc6080f64b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fc5f8001db0 tx=0x7fc60400bcc0).ready entity=mon.1 client_cookie=fde116cf11c09d09 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.648 7fc5fffff700 1 -- 172.21.15.79:0/733766743 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc6080e56d0 con 0x7fc6080f5520 2021-04-09T18:33:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.648 7fc5fffff700 1 -- 172.21.15.79:0/733766743 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6040096c0 con 0x7fc6080f5520 2021-04-09T18:33:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.648 7fc5fffff700 1 -- 172.21.15.79:0/733766743 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc5f8001bb0 con 0x7fc6080f5520 2021-04-09T18:33:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.648 7fc60f50f700 1 -- 172.21.15.79:0/733766743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6080f5520 msgr2=0x7fc6080f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.648 7fc60f50f700 1 --2- 172.21.15.79:0/733766743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6080f5520 0x7fc6080f64b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fc5f8001db0 tx=0x7fc60400bcc0).stop 2021-04-09T18:33:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.648 7fc60f50f700 1 -- 172.21.15.79:0/733766743 shutdown_connections 2021-04-09T18:33:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.648 7fc60f50f700 1 --2- 172.21.15.79:0/733766743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6080f5520 0x7fc6080f64b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.648 7fc60f50f700 1 -- 172.21.15.79:0/733766743 >> 172.21.15.79:0/733766743 conn(0x7fc6080e5fe0 msgr2=0x7fc6080e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:59.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.648 7fc60f50f700 1 -- 172.21.15.79:0/733766743 shutdown_connections 2021-04-09T18:33:59.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.648 7fc60f50f700 1 -- 172.21.15.79:0/733766743 wait complete. 2021-04-09T18:33:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.652 7fc60f50f700 1 Processor -- start 2021-04-09T18:33:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.652 7fc60f50f700 1 -- start start 2021-04-09T18:33:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.652 7fc60f50f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6080cf4e0 0x7fc6080cf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.652 7fc60f50f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6080a7bc0 0x7fc6080a8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.652 7fc60f50f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6080d15b0 0x7fc6080d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.652 7fc60f50f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6081c3dc0 con 0x7fc6080d15b0 2021-04-09T18:33:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.652 7fc60f50f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6080a8c20 con 0x7fc6080cf4e0 2021-04-09T18:33:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.652 7fc60f50f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60808f540 con 0x7fc6080a7bc0 2021-04-09T18:33:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.652 7fc60dab4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6080d15b0 0x7fc6080d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.652 7fc60dab4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6080d15b0 0x7fc6080d1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33136/0 (socket says 172.21.15.79:33136) 2021-04-09T18:33:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.652 7fc60dab4700 1 -- 172.21.15.79:0/3660304108 learned_addr learned my addr 172.21.15.79:0/3660304108 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:33:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.652 7fc60cab2700 1 --2- 172.21.15.79:0/3660304108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6080a7bc0 0x7fc6080a8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.652 7fc60d2b3700 1 --2- 172.21.15.79:0/3660304108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6080cf4e0 0x7fc6080cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.656 7fc60dab4700 1 -- 172.21.15.79:0/3660304108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6080a7bc0 msgr2=0x7fc6080a8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:59.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.656 7fc60dab4700 1 --2- 172.21.15.79:0/3660304108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6080a7bc0 0x7fc6080a8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:59.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.656 7fc60dab4700 1 -- 172.21.15.79:0/3660304108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6080cf4e0 msgr2=0x7fc6080cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:59.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.656 7fc60dab4700 1 --2- 172.21.15.79:0/3660304108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6080cf4e0 0x7fc6080cf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:59.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.656 7fc60dab4700 1 -- 172.21.15.79:0/3660304108 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6080a8640 con 0x7fc6080d15b0 2021-04-09T18:33:59.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.656 7fc60dab4700 1 --2- 172.21.15.79:0/3660304108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6080d15b0 0x7fc6080d1a00 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7fc6080874f0 tx=0x7fc60000cec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:59.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.656 7fc5fdffb700 1 -- 172.21.15.79:0/3660304108 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc6080a8640 con 0x7fc6080d15b0 2021-04-09T18:33:59.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.656 7fc5fdffb700 1 -- 172.21.15.79:0/3660304108 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc600006a80 con 0x7fc6080d15b0 2021-04-09T18:33:59.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.656 7fc60f50f700 1 -- 172.21.15.79:0/3660304108 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60808eaf0 con 0x7fc6080d15b0 2021-04-09T18:33:59.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.656 7fc5fdffb700 1 -- 172.21.15.79:0/3660304108 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc600007030 con 0x7fc6080d15b0 2021-04-09T18:33:59.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.656 7fc60f50f700 1 -- 172.21.15.79:0/3660304108 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60808edc0 con 0x7fc6080d15b0 2021-04-09T18:33:59.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.656 7fc5fdffb700 1 -- 172.21.15.79:0/3660304108 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc60001b070 con 0x7fc6080d15b0 2021-04-09T18:33:59.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.656 7fc5fdffb700 1 --2- 172.21.15.79:0/3660304108 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc5e8029100 0x7fc5e802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:59.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.656 7fc5fdffb700 1 -- 172.21.15.79:0/3660304108 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fc6000396d0 con 0x7fc6080d15b0 2021-04-09T18:33:59.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.656 7fc60d2b3700 1 --2- 172.21.15.79:0/3660304108 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc5e8029100 0x7fc5e802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:59.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.656 7fc60d2b3700 1 --2- 172.21.15.79:0/3660304108 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc5e8029100 0x7fc5e802b650 crc :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:59.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.660 7fc60f50f700 1 -- 172.21.15.79:0/3660304108 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6080e39e0 con 0x7fc6080d15b0 2021-04-09T18:33:59.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.664 7fc5fdffb700 1 -- 172.21.15.79:0/3660304108 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc600006870 con 0x7fc6080d15b0 2021-04-09T18:33:59.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:33:59.832 7fc60f50f700 1 -- 172.21.15.79:0/3660304108 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc6080a1cc0 con 0x7fc6080d15b0 2021-04-09T18:34:00.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.156 7fc5fdffb700 1 -- 172.21.15.79:0/3660304108 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v56) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc6080f76c0 con 0x7fc6080d15b0 2021-04-09T18:34:00.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.200 7fc60f50f700 1 -- 172.21.15.79:0/3660304108 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc5e8029100 msgr2=0x7fc5e802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:00.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.200 7fc60f50f700 1 --2- 172.21.15.79:0/3660304108 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc5e8029100 0x7fc5e802b650 crc :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:00.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.200 7fc60f50f700 1 -- 172.21.15.79:0/3660304108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6080d15b0 msgr2=0x7fc6080d1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:00.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.200 7fc60f50f700 1 --2- 172.21.15.79:0/3660304108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6080d15b0 0x7fc6080d1a00 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7fc6080874f0 tx=0x7fc60000cec0).stop 2021-04-09T18:34:00.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.200 7fc60f50f700 1 -- 172.21.15.79:0/3660304108 shutdown_connections 2021-04-09T18:34:00.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.200 7fc60f50f700 1 --2- 172.21.15.79:0/3660304108 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc5e8029100 0x7fc5e802b650 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.200 7fc60f50f700 1 --2- 172.21.15.79:0/3660304108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6080cf4e0 0x7fc6080cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.200 7fc60f50f700 1 --2- 172.21.15.79:0/3660304108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6080d15b0 0x7fc6080d1a00 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.200 7fc60f50f700 1 --2- 172.21.15.79:0/3660304108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6080a7bc0 0x7fc6080a8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.200 7fc60f50f700 1 -- 172.21.15.79:0/3660304108 >> 172.21.15.79:0/3660304108 conn(0x7fc6080d6d10 msgr2=0x7fc608090ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.200 7fc60f50f700 1 -- 172.21.15.79:0/3660304108 shutdown_connections 2021-04-09T18:34:00.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.200 7fc60f50f700 1 -- 172.21.15.79:0/3660304108 wait complete. 2021-04-09T18:34:00.222 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-04-09T18:34:00.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.312 7fdea8705700 1 Processor -- start 2021-04-09T18:34:00.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.312 7fdea8705700 1 -- start start 2021-04-09T18:34:00.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.312 7fdea8705700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdea00f5550 0x7fdea00f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:00.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.312 7fdea8705700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdea00e9b10 0x7fdea009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:00.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.312 7fdea8705700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdea01c2de0 0x7fdea01c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:00.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.312 7fdea8705700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea00e9f60 con 0x7fdea00f5550 2021-04-09T18:34:00.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.312 7fdea8705700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea00e5a00 con 0x7fdea01c2de0 2021-04-09T18:34:00.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.312 7fdea8705700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea00fbb50 con 0x7fdea00e9b10 2021-04-09T18:34:00.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea64a9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdea00f5550 0x7fdea00f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:00.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea64a9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdea00f5550 0x7fdea00f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33140/0 (socket says 172.21.15.79:33140) 2021-04-09T18:34:00.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea64a9700 1 -- 172.21.15.79:0/2224286212 learned_addr learned my addr 172.21.15.79:0/2224286212 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:00.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea5ca8700 1 --2- 172.21.15.79:0/2224286212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdea00e9b10 0x7fdea009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:00.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea6caa700 1 --2- 172.21.15.79:0/2224286212 >> v2:172.21.15.89:3300/0 conn(0x7fdea01c2de0 0x7fdea01c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:00.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea64a9700 1 -- 172.21.15.79:0/2224286212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdea00e9b10 msgr2=0x7fdea009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:00.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea64a9700 1 --2- 172.21.15.79:0/2224286212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdea00e9b10 0x7fdea009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:00.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea64a9700 1 -- 172.21.15.79:0/2224286212 >> v2:172.21.15.89:3300/0 conn(0x7fdea01c2de0 msgr2=0x7fdea01c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:00.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea64a9700 1 --2- 172.21.15.79:0/2224286212 >> v2:172.21.15.89:3300/0 conn(0x7fdea01c2de0 0x7fdea01c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:00.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea64a9700 1 -- 172.21.15.79:0/2224286212 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea00e5700 con 0x7fdea00f5550 2021-04-09T18:34:00.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea64a9700 1 --2- 172.21.15.79:0/2224286212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdea00f5550 0x7fdea00f64e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7fde90002f30 tx=0x7fde9000bd70).ready entity=mon.0 client_cookie=1e5033dacdb86f0d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:00.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea54a7700 1 -- 172.21.15.79:0/2224286212 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdea00e5700 con 0x7fdea00f5550 2021-04-09T18:34:00.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea54a7700 1 -- 172.21.15.79:0/2224286212 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde900098b0 con 0x7fdea00f5550 2021-04-09T18:34:00.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea54a7700 1 -- 172.21.15.79:0/2224286212 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fde90009c80 con 0x7fdea00f5550 2021-04-09T18:34:00.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea8705700 1 -- 172.21.15.79:0/2224286212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdea00f5550 msgr2=0x7fdea00f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:00.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea8705700 1 --2- 172.21.15.79:0/2224286212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdea00f5550 0x7fdea00f64e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7fde90002f30 tx=0x7fde9000bd70).stop 2021-04-09T18:34:00.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea8705700 1 -- 172.21.15.79:0/2224286212 shutdown_connections 2021-04-09T18:34:00.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea8705700 1 --2- 172.21.15.79:0/2224286212 >> v2:172.21.15.89:3300/0 conn(0x7fdea01c2de0 0x7fdea01c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:00.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea8705700 1 --2- 172.21.15.79:0/2224286212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdea00f5550 0x7fdea00f64e0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:00.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea8705700 1 --2- 172.21.15.79:0/2224286212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdea00e9b10 0x7fdea009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:00.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea8705700 1 -- 172.21.15.79:0/2224286212 >> 172.21.15.79:0/2224286212 conn(0x7fdea00e6010 msgr2=0x7fdea00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:00.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea8705700 1 -- 172.21.15.79:0/2224286212 shutdown_connections 2021-04-09T18:34:00.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.316 7fdea8705700 1 -- 172.21.15.79:0/2224286212 wait complete. 2021-04-09T18:34:00.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea8705700 1 Processor -- start 2021-04-09T18:34:00.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea8705700 1 -- start start 2021-04-09T18:34:00.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea8705700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdea00aa5c0 0x7fdea01a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:00.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea8705700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdea00aaa10 0x7fdea00d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:00.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea8705700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdea00be100 0x7fdea00be550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:00.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea8705700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea00bc860 con 0x7fdea00be100 2021-04-09T18:34:00.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea8705700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea00bcb60 con 0x7fdea00aa5c0 2021-04-09T18:34:00.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea8705700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea00bc3f0 con 0x7fdea00aaa10 2021-04-09T18:34:00.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea6caa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdea00be100 0x7fdea00be550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:00.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea6caa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdea00be100 0x7fdea00be550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33146/0 (socket says 172.21.15.79:33146) 2021-04-09T18:34:00.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea6caa700 1 -- 172.21.15.79:0/1155668655 learned_addr learned my addr 172.21.15.79:0/1155668655 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:00.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea5ca8700 1 --2- 172.21.15.79:0/1155668655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdea00aaa10 0x7fdea00d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:00.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea64a9700 1 --2- 172.21.15.79:0/1155668655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdea00aa5c0 0x7fdea01a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:00.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea6caa700 1 -- 172.21.15.79:0/1155668655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdea00aaa10 msgr2=0x7fdea00d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:00.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea6caa700 1 --2- 172.21.15.79:0/1155668655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdea00aaa10 0x7fdea00d1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:00.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea6caa700 1 -- 172.21.15.79:0/1155668655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdea00aa5c0 msgr2=0x7fdea01a5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:00.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea6caa700 1 --2- 172.21.15.79:0/1155668655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdea00aa5c0 0x7fdea01a5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:00.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea6caa700 1 -- 172.21.15.79:0/1155668655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea01a5d30 con 0x7fdea00be100 2021-04-09T18:34:00.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea64a9700 1 --2- 172.21.15.79:0/1155668655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdea00aa5c0 0x7fdea01a5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:00.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea6caa700 1 --2- 172.21.15.79:0/1155668655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdea00be100 0x7fdea00be550 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7fdea0087490 tx=0x7fde9800dba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:00.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fde9effd700 1 -- 172.21.15.79:0/1155668655 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdea01a5d30 con 0x7fdea00be100 2021-04-09T18:34:00.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fde9effd700 1 -- 172.21.15.79:0/1155668655 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde98010070 con 0x7fdea00be100 2021-04-09T18:34:00.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea8705700 1 -- 172.21.15.79:0/1155668655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea00d2210 con 0x7fdea00be100 2021-04-09T18:34:00.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fde9effd700 1 -- 172.21.15.79:0/1155668655 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fde98012940 con 0x7fdea00be100 2021-04-09T18:34:00.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fdea8705700 1 -- 172.21.15.79:0/1155668655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea01a8eb0 con 0x7fdea00be100 2021-04-09T18:34:00.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.320 7fde9effd700 1 -- 172.21.15.79:0/1155668655 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fde98012070 con 0x7fdea00be100 2021-04-09T18:34:00.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.324 7fde9effd700 1 --2- 172.21.15.79:0/1155668655 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fde84029100 0x7fde8402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:00.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.324 7fde9effd700 1 -- 172.21.15.79:0/1155668655 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fde980393b0 con 0x7fdea00be100 2021-04-09T18:34:00.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.324 7fdea64a9700 1 --2- 172.21.15.79:0/1155668655 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fde84029100 0x7fde8402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:00.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.324 7fdea64a9700 1 --2- 172.21.15.79:0/1155668655 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fde84029100 0x7fde8402b650 crc :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:00.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.328 7fdea8705700 1 -- 172.21.15.79:0/1155668655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea00e39f0 con 0x7fdea00be100 2021-04-09T18:34:00.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.336 7fde9effd700 1 -- 172.21.15.79:0/1155668655 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fdea00f76f0 con 0x7fdea00be100 2021-04-09T18:34:00.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:00.504 7fdea8705700 1 -- 172.21.15.79:0/1155668655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdea00f5b50 con 0x7fdea00be100 2021-04-09T18:34:01.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.164 7fde9effd700 1 -- 172.21.15.79:0/1155668655 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v91) v1 ==== 185+0+0 (secure 0 0 0) 0x7fde98012350 con 0x7fdea00be100 2021-04-09T18:34:01.175 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2021-04-09T18:34:01.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.176 7fdea8705700 1 -- 172.21.15.79:0/1155668655 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fde84029100 msgr2=0x7fde8402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:01.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.176 7fdea8705700 1 --2- 172.21.15.79:0/1155668655 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fde84029100 0x7fde8402b650 crc :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:01.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.176 7fdea8705700 1 -- 172.21.15.79:0/1155668655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdea00be100 msgr2=0x7fdea00be550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:01.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.176 7fdea8705700 1 --2- 172.21.15.79:0/1155668655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdea00be100 0x7fdea00be550 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7fdea0087490 tx=0x7fde9800dba0).stop 2021-04-09T18:34:01.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.176 7fdea8705700 1 -- 172.21.15.79:0/1155668655 shutdown_connections 2021-04-09T18:34:01.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.176 7fdea8705700 1 --2- 172.21.15.79:0/1155668655 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fde84029100 0x7fde8402b650 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:01.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.176 7fdea8705700 1 --2- 172.21.15.79:0/1155668655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdea00aa5c0 0x7fdea01a5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:01.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.176 7fdea8705700 1 --2- 172.21.15.79:0/1155668655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdea00be100 0x7fdea00be550 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:01.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.176 7fdea8705700 1 --2- 172.21.15.79:0/1155668655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdea00aaa10 0x7fdea00d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:01.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.176 7fdea8705700 1 -- 172.21.15.79:0/1155668655 >> 172.21.15.79:0/1155668655 conn(0x7fdea00d4d60 msgr2=0x7fdea00d3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:01.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.176 7fdea8705700 1 -- 172.21.15.79:0/1155668655 shutdown_connections 2021-04-09T18:34:01.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.176 7fdea8705700 1 -- 172.21.15.79:0/1155668655 wait complete. 2021-04-09T18:34:01.191 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-04-09T18:34:01.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.284 7f5d0c167700 1 Processor -- start 2021-04-09T18:34:01.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.284 7f5d0c167700 1 -- start start 2021-04-09T18:34:01.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.284 7f5d0c167700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5d041c9050 0x7f5d041cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:01.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.284 7f5d0c167700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d040fbb50 con 0x7f5d040e9b10 2021-04-09T18:34:01.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.284 7f5d0c167700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d0409f910 con 0x7f5d040f5550 2021-04-09T18:34:01.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.284 7f5d0c167700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d041c3df0 con 0x7f5d041c9050 2021-04-09T18:34:01.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.284 7f5d0a70c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5d041c9050 0x7f5d041cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:01.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.284 7f5d0970a700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5d040e9b10 0x7f5d0409f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56096/0 (socket says 172.21.15.79:56096) 2021-04-09T18:34:01.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.284 7f5d0970a700 1 -- 172.21.15.79:0/1927747934 learned_addr learned my addr 172.21.15.79:0/1927747934 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:01.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.284 7f5d0a70c700 1 -- 172.21.15.79:0/1927747934 >> v1:172.21.15.89:6789/0 conn(0x7f5d040f5550 legacy=0x7f5d040f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:01.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.284 7f5d0a70c700 1 -- 172.21.15.79:0/1927747934 >> v1:172.21.15.79:6789/0 conn(0x7f5d040e9b10 legacy=0x7f5d0409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:01.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.284 7f5d0a70c700 1 -- 172.21.15.79:0/1927747934 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d040e5700 con 0x7f5d041c9050 2021-04-09T18:34:01.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.284 7f5d0a70c700 1 --2- 172.21.15.79:0/1927747934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d041c9050 0x7f5d041cb4b0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f5cfc0032b0 tx=0x7f5cfc00b0e0).ready entity=mon.0 client_cookie=6183d7422744ab59 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:01.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.288 7f5d08f09700 1 -- 172.21.15.79:0/1927747934 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5d040e5700 con 0x7f5d041c9050 2021-04-09T18:34:01.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.288 7f5d08f09700 1 -- 172.21.15.79:0/1927747934 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc00bab0 con 0x7f5d041c9050 2021-04-09T18:34:01.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.288 7f5d08f09700 1 -- 172.21.15.79:0/1927747934 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5cfc002020 con 0x7f5d041c9050 2021-04-09T18:34:01.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.288 7f5d0c167700 1 -- 172.21.15.79:0/1927747934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d041c9050 msgr2=0x7f5d041cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:01.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.288 7f5d0c167700 1 --2- 172.21.15.79:0/1927747934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d041c9050 0x7f5d041cb4b0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f5cfc0032b0 tx=0x7f5cfc00b0e0).stop 2021-04-09T18:34:01.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.288 7f5d0c167700 1 -- 172.21.15.79:0/1927747934 shutdown_connections 2021-04-09T18:34:01.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.288 7f5d0c167700 1 --2- 172.21.15.79:0/1927747934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d041c9050 0x7f5d041cb4b0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:01.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.288 7f5d0c167700 1 -- 172.21.15.79:0/1927747934 >> 172.21.15.79:0/1927747934 conn(0x7f5d040e6010 msgr2=0x7f5d040e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:01.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.288 7f5d0c167700 1 -- 172.21.15.79:0/1927747934 shutdown_connections 2021-04-09T18:34:01.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.288 7f5d0c167700 1 -- 172.21.15.79:0/1927747934 wait complete. 2021-04-09T18:34:01.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d0c167700 1 Processor -- start 2021-04-09T18:34:01.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d0c167700 1 -- start start 2021-04-09T18:34:01.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d0c167700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d040ac310 0x7f5d04095b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:01.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d0c167700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d040bdc80 0x7f5d040a8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:01.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d0c167700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d041d0a90 0x7f5d041d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:01.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d0c167700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d040e9f60 con 0x7f5d040bdc80 2021-04-09T18:34:01.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d0c167700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d040a98f0 con 0x7f5d041d0a90 2021-04-09T18:34:01.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d0c167700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d040a9bf0 con 0x7f5d040ac310 2021-04-09T18:34:01.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d0970a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d040bdc80 0x7f5d040a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:01.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d0970a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d040bdc80 0x7f5d040a8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33160/0 (socket says 172.21.15.79:33160) 2021-04-09T18:34:01.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d0970a700 1 -- 172.21.15.79:0/3203277653 learned_addr learned my addr 172.21.15.79:0/3203277653 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:01.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d09f0b700 1 --2- 172.21.15.79:0/3203277653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d040ac310 0x7f5d04095b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:01.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d0a70c700 1 --2- 172.21.15.79:0/3203277653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d041d0a90 0x7f5d041d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:01.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d0970a700 1 -- 172.21.15.79:0/3203277653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d040ac310 msgr2=0x7f5d04095b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:01.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d0970a700 1 --2- 172.21.15.79:0/3203277653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d040ac310 0x7f5d04095b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:01.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d0970a700 1 -- 172.21.15.79:0/3203277653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d041d0a90 msgr2=0x7f5d041d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:01.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d0970a700 1 --2- 172.21.15.79:0/3203277653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d041d0a90 0x7f5d041d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:01.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d0970a700 1 -- 172.21.15.79:0/3203277653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d040be7f0 con 0x7f5d040bdc80 2021-04-09T18:34:01.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d0a70c700 1 --2- 172.21.15.79:0/3203277653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d041d0a90 0x7f5d041d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:01.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d09f0b700 1 --2- 172.21.15.79:0/3203277653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d040ac310 0x7f5d04095b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:01.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5d0970a700 1 --2- 172.21.15.79:0/3203277653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d040bdc80 0x7f5d040a8970 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f5d040d7dc0 tx=0x7f5cf400cb10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:01.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.292 7f5cfa7fc700 1 -- 172.21.15.79:0/3203277653 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5d040be7f0 con 0x7f5d040bdc80 2021-04-09T18:34:01.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.296 7f5cfa7fc700 1 -- 172.21.15.79:0/3203277653 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf40072e0 con 0x7f5d040bdc80 2021-04-09T18:34:01.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.296 7f5cfa7fc700 1 -- 172.21.15.79:0/3203277653 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5cf40057e0 con 0x7f5d040bdc80 2021-04-09T18:34:01.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.296 7f5d0c167700 1 -- 172.21.15.79:0/3203277653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d04096190 con 0x7f5d040bdc80 2021-04-09T18:34:01.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.296 7f5d0c167700 1 -- 172.21.15.79:0/3203277653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d04093ac0 con 0x7f5d040bdc80 2021-04-09T18:34:01.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.296 7f5cfa7fc700 1 -- 172.21.15.79:0/3203277653 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5cf401b070 con 0x7f5d040bdc80 2021-04-09T18:34:01.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.296 7f5cfa7fc700 1 --2- 172.21.15.79:0/3203277653 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5cec029100 0x7f5cec02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:01.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.296 7f5cfa7fc700 1 -- 172.21.15.79:0/3203277653 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5572+0+0 (secure 0 0 0) 0x7f5cf4038b20 con 0x7f5d040bdc80 2021-04-09T18:34:01.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.296 7f5d09f0b700 1 --2- 172.21.15.79:0/3203277653 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5cec029100 0x7f5cec02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:01.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.296 7f5d09f0b700 1 --2- 172.21.15.79:0/3203277653 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5cec029100 0x7f5cec02b650 crc :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:01.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.296 7f5d0c167700 1 -- 172.21.15.79:0/3203277653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d040e39f0 con 0x7f5d040bdc80 2021-04-09T18:34:01.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.304 7f5cfa7fc700 1 -- 172.21.15.79:0/3203277653 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5cf40070d0 con 0x7f5d040bdc80 2021-04-09T18:34:01.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:01.464 7f5d0c167700 1 -- 172.21.15.79:0/3203277653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5d040a1c90 con 0x7f5d040bdc80 2021-04-09T18:34:02.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.176 7f5cfa7fc700 1 -- 172.21.15.79:0/3203277653 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v92) v1 ==== 173+0+0 (secure 0 0 0) 0x7f5cf4000bf0 con 0x7f5d040bdc80 2021-04-09T18:34:02.186 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2021-04-09T18:34:02.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.184 7f5d0c167700 1 -- 172.21.15.79:0/3203277653 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5cec029100 msgr2=0x7f5cec02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:02.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.184 7f5d0c167700 1 --2- 172.21.15.79:0/3203277653 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5cec029100 0x7f5cec02b650 crc :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:02.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.184 7f5d0c167700 1 -- 172.21.15.79:0/3203277653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d040bdc80 msgr2=0x7f5d040a8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:02.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.184 7f5d0c167700 1 --2- 172.21.15.79:0/3203277653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d040bdc80 0x7f5d040a8970 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f5d040d7dc0 tx=0x7f5cf400cb10).stop 2021-04-09T18:34:02.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.184 7f5d0c167700 1 -- 172.21.15.79:0/3203277653 shutdown_connections 2021-04-09T18:34:02.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.184 7f5d0c167700 1 --2- 172.21.15.79:0/3203277653 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5cec029100 0x7f5cec02b650 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:02.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.184 7f5d0c167700 1 --2- 172.21.15.79:0/3203277653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d041d0a90 0x7f5d041d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:02.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.184 7f5d0c167700 1 --2- 172.21.15.79:0/3203277653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d040ac310 0x7f5d04095b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:02.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.184 7f5d0c167700 1 --2- 172.21.15.79:0/3203277653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d040bdc80 0x7f5d040a8970 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:02.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.184 7f5d0c167700 1 -- 172.21.15.79:0/3203277653 >> 172.21.15.79:0/3203277653 conn(0x7f5d04097570 msgr2=0x7f5d040c0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:02.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.184 7f5d0c167700 1 -- 172.21.15.79:0/3203277653 shutdown_connections 2021-04-09T18:34:02.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.184 7f5d0c167700 1 -- 172.21.15.79:0/3203277653 wait complete. 2021-04-09T18:34:02.200 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-04-09T18:34:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.280 7f15fd5d1700 1 Processor -- start 2021-04-09T18:34:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15fd5d1700 1 -- start start 2021-04-09T18:34:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15fd5d1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f15f80f5520 0x7f15f80f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15fd5d1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f80fbb20 con 0x7f15f81c8010 2021-04-09T18:34:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15fd5d1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f809f910 con 0x7f15f80e9ae0 2021-04-09T18:34:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15fd5d1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f80e9f30 con 0x7f15f80f5520 2021-04-09T18:34:02.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15f7247700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f15f80f5520 0x7f15f80f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:02.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15f7a48700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f15f81c8010 0x7f15f81ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56110/0 (socket says 172.21.15.79:56110) 2021-04-09T18:34:02.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15f7a48700 1 -- 172.21.15.79:0/30639361 learned_addr learned my addr 172.21.15.79:0/30639361 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:02.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15f7247700 1 -- 172.21.15.79:0/30639361 >> v1:172.21.15.89:6789/0 conn(0x7f15f80e9ae0 legacy=0x7f15f809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:02.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15f7247700 1 -- 172.21.15.79:0/30639361 >> v1:172.21.15.79:6789/0 conn(0x7f15f81c8010 legacy=0x7f15f81ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:02.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15f6245700 1 -- 172.21.15.79:0/30639361 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50415449 0 0) 0x7f15f00010d0 con 0x7f15f81c8010 2021-04-09T18:34:02.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15f7247700 1 -- 172.21.15.79:0/30639361 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f80e56d0 con 0x7f15f80f5520 2021-04-09T18:34:02.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15f7247700 1 --2- 172.21.15.79:0/30639361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15f80f5520 0x7f15f80f64b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f15e8002f30 tx=0x7f15e800bcc0).ready entity=mon.0 client_cookie=b0728d741f8201b6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:02.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15f6245700 1 -- 172.21.15.79:0/30639361 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f15f80e56d0 con 0x7f15f80f5520 2021-04-09T18:34:02.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15f6245700 1 -- 172.21.15.79:0/30639361 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e8009800 con 0x7f15f80f5520 2021-04-09T18:34:02.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15f6245700 1 -- 172.21.15.79:0/30639361 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f15e8009bd0 con 0x7f15f80f5520 2021-04-09T18:34:02.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15fd5d1700 1 -- 172.21.15.79:0/30639361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15f80f5520 msgr2=0x7f15f80f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:02.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15fd5d1700 1 --2- 172.21.15.79:0/30639361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15f80f5520 0x7f15f80f64b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f15e8002f30 tx=0x7f15e800bcc0).stop 2021-04-09T18:34:02.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15fd5d1700 1 -- 172.21.15.79:0/30639361 shutdown_connections 2021-04-09T18:34:02.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15fd5d1700 1 --2- 172.21.15.79:0/30639361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15f80f5520 0x7f15f80f64b0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:02.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15fd5d1700 1 -- 172.21.15.79:0/30639361 >> 172.21.15.79:0/30639361 conn(0x7f15f80e5fe0 msgr2=0x7f15f80e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:02.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15fd5d1700 1 -- 172.21.15.79:0/30639361 shutdown_connections 2021-04-09T18:34:02.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.284 7f15fd5d1700 1 -- 172.21.15.79:0/30639361 wait complete. 2021-04-09T18:34:02.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.288 7f15fd5d1700 1 Processor -- start 2021-04-09T18:34:02.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.288 7f15fd5d1700 1 -- start start 2021-04-09T18:34:02.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15fd5d1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15f80b02c0 0x7f15f80af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:02.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15fd5d1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15f80c3fc0 0x7f15f80c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:02.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15fd5d1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15f80d30d0 0x7f15f80d3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:02.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15fd5d1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f81c3dc0 con 0x7f15f80b02c0 2021-04-09T18:34:02.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15fd5d1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f819f5a0 con 0x7f15f80d30d0 2021-04-09T18:34:02.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15fd5d1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f819f8a0 con 0x7f15f80c3fc0 2021-04-09T18:34:02.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15f7247700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15f80b02c0 0x7f15f80af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:02.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15f7247700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15f80b02c0 0x7f15f80af910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33172/0 (socket says 172.21.15.79:33172) 2021-04-09T18:34:02.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15f7247700 1 -- 172.21.15.79:0/896329075 learned_addr learned my addr 172.21.15.79:0/896329075 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:02.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15f7a48700 1 --2- 172.21.15.79:0/896329075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15f80d30d0 0x7f15f80d3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:02.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15f6a46700 1 --2- 172.21.15.79:0/896329075 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15f80c3fc0 0x7f15f80c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:02.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15f7247700 1 -- 172.21.15.79:0/896329075 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15f80c3fc0 msgr2=0x7f15f80c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:02.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15f7247700 1 --2- 172.21.15.79:0/896329075 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15f80c3fc0 0x7f15f80c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:02.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15f7247700 1 -- 172.21.15.79:0/896329075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15f80d30d0 msgr2=0x7f15f80d3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:02.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15f7247700 1 --2- 172.21.15.79:0/896329075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15f80d30d0 0x7f15f80d3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:02.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15f7247700 1 -- 172.21.15.79:0/896329075 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f81a0e20 con 0x7f15f80b02c0 2021-04-09T18:34:02.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15f7a48700 1 --2- 172.21.15.79:0/896329075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15f80d30d0 0x7f15f80d3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:02.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15f6a46700 1 --2- 172.21.15.79:0/896329075 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15f80c3fc0 0x7f15f80c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:02.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15f7247700 1 --2- 172.21.15.79:0/896329075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15f80b02c0 0x7f15f80af910 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f15f80d83b0 tx=0x7f15e8006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:02.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15effff700 1 -- 172.21.15.79:0/896329075 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f15f81a0e20 con 0x7f15f80b02c0 2021-04-09T18:34:02.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15effff700 1 -- 172.21.15.79:0/896329075 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e801d450 con 0x7f15f80b02c0 2021-04-09T18:34:02.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15fd5d1700 1 -- 172.21.15.79:0/896329075 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f80aff40 con 0x7f15f80b02c0 2021-04-09T18:34:02.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15effff700 1 -- 172.21.15.79:0/896329075 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f15e8022020 con 0x7f15f80b02c0 2021-04-09T18:34:02.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15fd5d1700 1 -- 172.21.15.79:0/896329075 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f81ae6f0 con 0x7f15f80b02c0 2021-04-09T18:34:02.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15effff700 1 -- 172.21.15.79:0/896329075 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f15e801d820 con 0x7f15f80b02c0 2021-04-09T18:34:02.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15effff700 1 --2- 172.21.15.79:0/896329075 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f15dc029100 0x7f15dc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:02.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15effff700 1 -- 172.21.15.79:0/896329075 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f15e803c210 con 0x7f15f80b02c0 2021-04-09T18:34:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.292 7f15f6a46700 1 --2- 172.21.15.79:0/896329075 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f15dc029100 0x7f15dc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.296 7f15f6a46700 1 --2- 172.21.15.79:0/896329075 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f15dc029100 0x7f15dc02b650 crc :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.296 7f15fd5d1700 1 -- 172.21.15.79:0/896329075 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f80e39e0 con 0x7f15f80b02c0 2021-04-09T18:34:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.300 7f15effff700 1 -- 172.21.15.79:0/896329075 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f15e80095f0 con 0x7f15f80b02c0 2021-04-09T18:34:02.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.484 7f15fd5d1700 1 -- 172.21.15.79:0/896329075 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f15f80bb530 con 0x7f15f80b02c0 2021-04-09T18:34:02.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.488 7f15effff700 1 -- 172.21.15.79:0/896329075 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f15e8011d90 con 0x7f15f80b02c0 2021-04-09T18:34:02.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.492 7f15fd5d1700 1 -- 172.21.15.79:0/896329075 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f15dc029100 msgr2=0x7f15dc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:02.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.492 7f15fd5d1700 1 --2- 172.21.15.79:0/896329075 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f15dc029100 0x7f15dc02b650 crc :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:02.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.492 7f15fd5d1700 1 -- 172.21.15.79:0/896329075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15f80b02c0 msgr2=0x7f15f80af910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:02.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.492 7f15fd5d1700 1 --2- 172.21.15.79:0/896329075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15f80b02c0 0x7f15f80af910 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f15f80d83b0 tx=0x7f15e8006890).stop 2021-04-09T18:34:02.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.492 7f15fd5d1700 1 -- 172.21.15.79:0/896329075 shutdown_connections 2021-04-09T18:34:02.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.492 7f15fd5d1700 1 --2- 172.21.15.79:0/896329075 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f15dc029100 0x7f15dc02b650 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:02.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.492 7f15fd5d1700 1 --2- 172.21.15.79:0/896329075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15f80d30d0 0x7f15f80d3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:02.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.492 7f15fd5d1700 1 --2- 172.21.15.79:0/896329075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15f80b02c0 0x7f15f80af910 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:02.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.492 7f15fd5d1700 1 --2- 172.21.15.79:0/896329075 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15f80c3fc0 0x7f15f80c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:02.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.492 7f15fd5d1700 1 -- 172.21.15.79:0/896329075 >> 172.21.15.79:0/896329075 conn(0x7f15f80ba990 msgr2=0x7f15f809a580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:02.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.492 7f15fd5d1700 1 -- 172.21.15.79:0/896329075 shutdown_connections 2021-04-09T18:34:02.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.492 7f15fd5d1700 1 -- 172.21.15.79:0/896329075 wait complete. 2021-04-09T18:34:02.511 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2021-04-09T18:34:02.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.596 7f8def8ca700 1 Processor -- start 2021-04-09T18:34:02.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.596 7f8def8ca700 1 -- start start 2021-04-09T18:34:02.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8def8ca700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8de80f5520 0x7f8de80f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:02.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8def8ca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de80e9ae0 0x7f8de809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:02.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8def8ca700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de80fbb20 con 0x7f8de81c2db0 2021-04-09T18:34:02.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8def8ca700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de80e9f30 con 0x7f8de80f5520 2021-04-09T18:34:02.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8def8ca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de80e59d0 con 0x7f8de80e9ae0 2021-04-09T18:34:02.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8dede6f700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8de81c2db0 0x7f8de81c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56126/0 (socket says 172.21.15.79:56126) 2021-04-09T18:34:02.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8dede6f700 1 -- 172.21.15.79:0/3887325504 learned_addr learned my addr 172.21.15.79:0/3887325504 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:02.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8dece6d700 1 --2- 172.21.15.79:0/3887325504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de80e9ae0 0x7f8de809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:02.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8ded66e700 1 --2- 172.21.15.79:0/3887325504 >> v2:172.21.15.89:3300/0 conn(0x7f8de80f5520 0x7f8de80f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:02.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8ddffff700 1 -- 172.21.15.79:0/3887325504 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240494347 0 0) 0x7f8de0001450 con 0x7f8de81c2db0 2021-04-09T18:34:02.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8ddffff700 1 -- 172.21.15.79:0/3887325504 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dd4003240 con 0x7f8de81c2db0 2021-04-09T18:34:02.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8dece6d700 1 -- 172.21.15.79:0/3887325504 >> v2:172.21.15.89:3300/0 conn(0x7f8de80f5520 msgr2=0x7f8de80f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:02.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8dece6d700 1 --2- 172.21.15.79:0/3887325504 >> v2:172.21.15.89:3300/0 conn(0x7f8de80f5520 0x7f8de80f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:02.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8dece6d700 1 -- 172.21.15.79:0/3887325504 >> v1:172.21.15.79:6789/0 conn(0x7f8de81c2db0 legacy=0x7f8de81c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:02.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8ddffff700 1 -- 172.21.15.79:0/3887325504 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 508498723 0 0) 0x7f8de00019d0 con 0x7f8de81c2db0 2021-04-09T18:34:02.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8dece6d700 1 -- 172.21.15.79:0/3887325504 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de80e56d0 con 0x7f8de80e9ae0 2021-04-09T18:34:02.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8dece6d700 1 --2- 172.21.15.79:0/3887325504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de80e9ae0 0x7f8de809f110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f8dd8002f30 tx=0x7f8dd800bcc0).ready entity=mon.2 client_cookie=154e858957084dc1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:02.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8ddffff700 1 -- 172.21.15.79:0/3887325504 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8de80e56d0 con 0x7f8de80e9ae0 2021-04-09T18:34:02.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8ddffff700 1 -- 172.21.15.79:0/3887325504 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd8009800 con 0x7f8de80e9ae0 2021-04-09T18:34:02.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8ddffff700 1 -- 172.21.15.79:0/3887325504 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8dd8009bd0 con 0x7f8de80e9ae0 2021-04-09T18:34:02.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8def8ca700 1 -- 172.21.15.79:0/3887325504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de80e9ae0 msgr2=0x7f8de809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:02.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8def8ca700 1 --2- 172.21.15.79:0/3887325504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de80e9ae0 0x7f8de809f110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f8dd8002f30 tx=0x7f8dd800bcc0).stop 2021-04-09T18:34:02.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8def8ca700 1 -- 172.21.15.79:0/3887325504 shutdown_connections 2021-04-09T18:34:02.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8def8ca700 1 --2- 172.21.15.79:0/3887325504 >> v2:172.21.15.89:3300/0 conn(0x7f8de80f5520 0x7f8de80f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:02.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8def8ca700 1 --2- 172.21.15.79:0/3887325504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de80e9ae0 0x7f8de809f110 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:02.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8def8ca700 1 -- 172.21.15.79:0/3887325504 >> 172.21.15.79:0/3887325504 conn(0x7f8de80e5fe0 msgr2=0x7f8de80e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:02.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8def8ca700 1 -- 172.21.15.79:0/3887325504 shutdown_connections 2021-04-09T18:34:02.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.600 7f8def8ca700 1 -- 172.21.15.79:0/3887325504 wait complete. 2021-04-09T18:34:02.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8def8ca700 1 Processor -- start 2021-04-09T18:34:02.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8def8ca700 1 -- start start 2021-04-09T18:34:02.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8def8ca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de80ac0c0 0x7f8de80d64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:02.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8def8ca700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8de8098200 0x7f8de80bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:02.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8def8ca700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8de81acfd0 0x7f8de81ad420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:02.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8def8ca700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de8097f00 con 0x7f8de81acfd0 2021-04-09T18:34:02.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8def8ca700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de80ac510 con 0x7f8de8098200 2021-04-09T18:34:02.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8def8ca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de80c04e0 con 0x7f8de80ac0c0 2021-04-09T18:34:02.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8dede6f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8de81acfd0 0x7f8de81ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:02.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8dede6f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8de81acfd0 0x7f8de81ad420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33190/0 (socket says 172.21.15.79:33190) 2021-04-09T18:34:02.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8dede6f700 1 -- 172.21.15.79:0/914421039 learned_addr learned my addr 172.21.15.79:0/914421039 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:02.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8ded66e700 1 --2- 172.21.15.79:0/914421039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de80ac0c0 0x7f8de80d64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:02.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8dece6d700 1 --2- 172.21.15.79:0/914421039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8de8098200 0x7f8de80bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:02.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8dede6f700 1 -- 172.21.15.79:0/914421039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de80ac0c0 msgr2=0x7f8de80d64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:02.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8dede6f700 1 --2- 172.21.15.79:0/914421039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de80ac0c0 0x7f8de80d64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:02.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8dede6f700 1 -- 172.21.15.79:0/914421039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8de8098200 msgr2=0x7f8de80bfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:02.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8dede6f700 1 --2- 172.21.15.79:0/914421039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8de8098200 0x7f8de80bfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:02.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8dede6f700 1 -- 172.21.15.79:0/914421039 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de8097a90 con 0x7f8de81acfd0 2021-04-09T18:34:02.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8ded66e700 1 --2- 172.21.15.79:0/914421039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de80ac0c0 0x7f8de80d64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:02.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8dede6f700 1 --2- 172.21.15.79:0/914421039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8de81acfd0 0x7f8de81ad420 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f8de80d7eb0 tx=0x7f8de000cee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:02.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8dddffb700 1 -- 172.21.15.79:0/914421039 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8de8097a90 con 0x7f8de81acfd0 2021-04-09T18:34:02.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8dddffb700 1 -- 172.21.15.79:0/914421039 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de0005b80 con 0x7f8de81acfd0 2021-04-09T18:34:02.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8def8ca700 1 -- 172.21.15.79:0/914421039 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de8098650 con 0x7f8de81acfd0 2021-04-09T18:34:02.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8dddffb700 1 -- 172.21.15.79:0/914421039 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8de0004880 con 0x7f8de81acfd0 2021-04-09T18:34:02.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.608 7f8def8ca700 1 -- 172.21.15.79:0/914421039 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de80ac890 con 0x7f8de81acfd0 2021-04-09T18:34:02.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.612 7f8dddffb700 1 -- 172.21.15.79:0/914421039 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8de0004a80 con 0x7f8de81acfd0 2021-04-09T18:34:02.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.612 7f8dddffb700 1 --2- 172.21.15.79:0/914421039 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8dc8029100 0x7f8dc802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:02.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.612 7f8dddffb700 1 -- 172.21.15.79:0/914421039 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f8de0039160 con 0x7f8de81acfd0 2021-04-09T18:34:02.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.612 7f8ded66e700 1 --2- 172.21.15.79:0/914421039 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8dc8029100 0x7f8dc802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:02.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.612 7f8ded66e700 1 --2- 172.21.15.79:0/914421039 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8dc8029100 0x7f8dc802b650 crc :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:02.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.628 7f8def8ca700 1 -- 172.21.15.79:0/914421039 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de80e39e0 con 0x7f8de81acfd0 2021-04-09T18:34:02.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.632 7f8dddffb700 1 -- 172.21.15.79:0/914421039 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8de0005970 con 0x7f8de81acfd0 2021-04-09T18:34:02.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:02.796 7f8def8ca700 1 -- 172.21.15.79:0/914421039 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7f8de80f5b20 con 0x7f8de81acfd0 2021-04-09T18:34:03.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.176 7f8dddffb700 1 -- 172.21.15.79:0/914421039 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v230) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8de80f76c0 con 0x7f8de81acfd0 2021-04-09T18:34:03.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.212 7f8def8ca700 1 -- 172.21.15.79:0/914421039 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8dc8029100 msgr2=0x7f8dc802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:03.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.212 7f8def8ca700 1 --2- 172.21.15.79:0/914421039 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8dc8029100 0x7f8dc802b650 crc :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:03.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.212 7f8def8ca700 1 -- 172.21.15.79:0/914421039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8de81acfd0 msgr2=0x7f8de81ad420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:03.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.212 7f8def8ca700 1 --2- 172.21.15.79:0/914421039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8de81acfd0 0x7f8de81ad420 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f8de80d7eb0 tx=0x7f8de000cee0).stop 2021-04-09T18:34:03.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.212 7f8def8ca700 1 -- 172.21.15.79:0/914421039 shutdown_connections 2021-04-09T18:34:03.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.212 7f8def8ca700 1 --2- 172.21.15.79:0/914421039 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8dc8029100 0x7f8dc802b650 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:03.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.212 7f8def8ca700 1 --2- 172.21.15.79:0/914421039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8de81acfd0 0x7f8de81ad420 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:03.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.212 7f8def8ca700 1 --2- 172.21.15.79:0/914421039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de80ac0c0 0x7f8de80d64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:03.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.212 7f8def8ca700 1 --2- 172.21.15.79:0/914421039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8de8098200 0x7f8de80bfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:03.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.212 7f8def8ca700 1 -- 172.21.15.79:0/914421039 >> 172.21.15.79:0/914421039 conn(0x7f8de809a810 msgr2=0x7f8de81a1320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:03.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.212 7f8def8ca700 1 -- 172.21.15.79:0/914421039 shutdown_connections 2021-04-09T18:34:03.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.216 7f8def8ca700 1 -- 172.21.15.79:0/914421039 wait complete. 2021-04-09T18:34:03.237 INFO:tasks.cephfs_test_runner:test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) ... ok 2021-04-09T18:34:03.238 INFO:tasks.cephfs_test_runner:Starting test: test_filtered_df (tasks.cephfs.test_misc.TestMisc) 2021-04-09T18:34:03.239 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2021-04-09T18:34:03.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.332 7f863aa64700 1 Processor -- start 2021-04-09T18:34:03.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.332 7f863aa64700 1 -- start start 2021-04-09T18:34:03.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.332 7f863aa64700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86340e9ae0 0x7f863409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:03.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.332 7f863aa64700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86340fbb20 con 0x7f86341c8010 2021-04-09T18:34:03.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.332 7f863aa64700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86340e56d0 con 0x7f86340f5520 2021-04-09T18:34:03.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.332 7f863aa64700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86341c3dc0 con 0x7f86340e9ae0 2021-04-09T18:34:03.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.332 7f8639009700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f86341c8010 0x7f86341ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56138/0 (socket says 172.21.15.79:56138) 2021-04-09T18:34:03.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.332 7f8639009700 1 -- 172.21.15.79:0/1642541827 learned_addr learned my addr 172.21.15.79:0/1642541827 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:03.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.332 7f8633fff700 1 --2- 172.21.15.79:0/1642541827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86340e9ae0 0x7f863409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:03.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.336 7f86337fe700 1 -- 172.21.15.79:0/1642541827 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624811584 0 0) 0x7f862c0010d0 con 0x7f86341c8010 2021-04-09T18:34:03.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.336 7f86337fe700 1 -- 172.21.15.79:0/1642541827 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f861c003240 con 0x7f86341c8010 2021-04-09T18:34:03.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.336 7f86337fe700 1 -- 172.21.15.79:0/1642541827 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980385514 0 0) 0x7f86240010d0 con 0x7f86340f5520 2021-04-09T18:34:03.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.336 7f86337fe700 1 -- 172.21.15.79:0/1642541827 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f861c003620 con 0x7f86340f5520 2021-04-09T18:34:03.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.336 7f8633fff700 1 -- 172.21.15.79:0/1642541827 >> v1:172.21.15.89:6789/0 conn(0x7f86340f5520 legacy=0x7f86340f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:03.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.336 7f8633fff700 1 -- 172.21.15.79:0/1642541827 >> v1:172.21.15.79:6789/0 conn(0x7f86341c8010 legacy=0x7f86341ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:03.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.336 7f8633fff700 1 -- 172.21.15.79:0/1642541827 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86340e4330 con 0x7f86340e9ae0 2021-04-09T18:34:03.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.336 7f8633fff700 1 --2- 172.21.15.79:0/1642541827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86340e9ae0 0x7f863409f110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f86280032b0 tx=0x7f862800b0e0).ready entity=mon.2 client_cookie=33589ec230dbe20b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:03.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.336 7f86337fe700 1 -- 172.21.15.79:0/1642541827 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f86340e4330 con 0x7f86340e9ae0 2021-04-09T18:34:03.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.336 7f86337fe700 1 -- 172.21.15.79:0/1642541827 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862800baf0 con 0x7f86340e9ae0 2021-04-09T18:34:03.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.336 7f86337fe700 1 -- 172.21.15.79:0/1642541827 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8628002020 con 0x7f86340e9ae0 2021-04-09T18:34:03.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.336 7f863aa64700 1 -- 172.21.15.79:0/1642541827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86340e9ae0 msgr2=0x7f863409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:03.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.336 7f863aa64700 1 --2- 172.21.15.79:0/1642541827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86340e9ae0 0x7f863409f110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f86280032b0 tx=0x7f862800b0e0).stop 2021-04-09T18:34:03.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.336 7f863aa64700 1 -- 172.21.15.79:0/1642541827 shutdown_connections 2021-04-09T18:34:03.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.336 7f863aa64700 1 --2- 172.21.15.79:0/1642541827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86340e9ae0 0x7f863409f110 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:03.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.336 7f863aa64700 1 -- 172.21.15.79:0/1642541827 >> 172.21.15.79:0/1642541827 conn(0x7f86340e5fe0 msgr2=0x7f86340e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:03.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.336 7f863aa64700 1 -- 172.21.15.79:0/1642541827 shutdown_connections 2021-04-09T18:34:03.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.336 7f863aa64700 1 -- 172.21.15.79:0/1642541827 wait complete. 2021-04-09T18:34:03.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.340 7f863aa64700 1 Processor -- start 2021-04-09T18:34:03.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.340 7f863aa64700 1 -- start start 2021-04-09T18:34:03.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.340 7f863aa64700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86340b23f0 0x7f86340b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:03.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.340 7f863aa64700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86340b1100 0x7f86340d7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:03.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.340 7f863aa64700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86340b1550 0x7f86340b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:03.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.340 7f863aa64700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86340e9f30 con 0x7f86340b1100 2021-04-09T18:34:03.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.340 7f863aa64700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86340b2b60 con 0x7f86340b1550 2021-04-09T18:34:03.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.340 7f863aa64700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86340b2e60 con 0x7f86340b23f0 2021-04-09T18:34:03.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.344 7f8633fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86340b1100 0x7f86340d7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:03.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.344 7f8633fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86340b1100 0x7f86340d7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33204/0 (socket says 172.21.15.79:33204) 2021-04-09T18:34:03.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.344 7f8633fff700 1 -- 172.21.15.79:0/4094017535 learned_addr learned my addr 172.21.15.79:0/4094017535 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:03.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.344 7f8638808700 1 --2- 172.21.15.79:0/4094017535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86340b23f0 0x7f86340b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:03.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.344 7f8639009700 1 --2- 172.21.15.79:0/4094017535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86340b1550 0x7f86340b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:03.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.344 7f8633fff700 1 -- 172.21.15.79:0/4094017535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86340b23f0 msgr2=0x7f86340b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:03.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.344 7f8633fff700 1 --2- 172.21.15.79:0/4094017535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86340b23f0 0x7f86340b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:03.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.344 7f8633fff700 1 -- 172.21.15.79:0/4094017535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86340b1550 msgr2=0x7f86340b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:03.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.344 7f8633fff700 1 --2- 172.21.15.79:0/4094017535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86340b1550 0x7f86340b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:03.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.344 7f8633fff700 1 -- 172.21.15.79:0/4094017535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86340d7ca0 con 0x7f86340b1100 2021-04-09T18:34:03.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.344 7f8633fff700 1 --2- 172.21.15.79:0/4094017535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86340b1100 0x7f86340d7670 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f8634095da0 tx=0x7f8628006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:03.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.344 7f86317fa700 1 -- 172.21.15.79:0/4094017535 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f86340d7ca0 con 0x7f86340b1100 2021-04-09T18:34:03.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.344 7f86317fa700 1 -- 172.21.15.79:0/4094017535 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862801f020 con 0x7f86340b1100 2021-04-09T18:34:03.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.344 7f863aa64700 1 -- 172.21.15.79:0/4094017535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86340b4a30 con 0x7f86340b1100 2021-04-09T18:34:03.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.344 7f86317fa700 1 -- 172.21.15.79:0/4094017535 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f862801b830 con 0x7f86340b1100 2021-04-09T18:34:03.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.344 7f863aa64700 1 -- 172.21.15.79:0/4094017535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86340b4f40 con 0x7f86340b1100 2021-04-09T18:34:03.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.344 7f86317fa700 1 -- 172.21.15.79:0/4094017535 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8628006ce0 con 0x7f86340b1100 2021-04-09T18:34:03.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.344 7f86317fa700 1 --2- 172.21.15.79:0/4094017535 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8614029100 0x7f861402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:03.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.344 7f86317fa700 1 -- 172.21.15.79:0/4094017535 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f862803b7f0 con 0x7f86340b1100 2021-04-09T18:34:03.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.344 7f8638808700 1 --2- 172.21.15.79:0/4094017535 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8614029100 0x7f861402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:03.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.348 7f8638808700 1 --2- 172.21.15.79:0/4094017535 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8614029100 0x7f861402b650 crc :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:03.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.360 7f863aa64700 1 -- 172.21.15.79:0/4094017535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86340e39e0 con 0x7f86340b1100 2021-04-09T18:34:03.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.372 7f86317fa700 1 -- 172.21.15.79:0/4094017535 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f862800b8e0 con 0x7f86340b1100 2021-04-09T18:34:03.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:03.544 7f863aa64700 1 -- 172.21.15.79:0/4094017535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7f86340a1cc0 con 0x7f86340b1100 2021-04-09T18:34:04.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.180 7f86317fa700 1 -- 172.21.15.79:0/4094017535 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v231) v1 ==== 130+0+0 (secure 0 0 0) 0x7f862801b430 con 0x7f86340b1100 2021-04-09T18:34:04.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.212 7f863aa64700 1 -- 172.21.15.79:0/4094017535 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8614029100 msgr2=0x7f861402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:04.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.212 7f863aa64700 1 --2- 172.21.15.79:0/4094017535 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8614029100 0x7f861402b650 crc :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:04.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.212 7f863aa64700 1 -- 172.21.15.79:0/4094017535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86340b1100 msgr2=0x7f86340d7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:04.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.212 7f863aa64700 1 --2- 172.21.15.79:0/4094017535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86340b1100 0x7f86340d7670 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f8634095da0 tx=0x7f8628006c10).stop 2021-04-09T18:34:04.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.212 7f863aa64700 1 -- 172.21.15.79:0/4094017535 shutdown_connections 2021-04-09T18:34:04.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.212 7f863aa64700 1 --2- 172.21.15.79:0/4094017535 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8614029100 0x7f861402b650 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:04.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.212 7f863aa64700 1 --2- 172.21.15.79:0/4094017535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86340b1550 0x7f86340b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:04.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.212 7f863aa64700 1 --2- 172.21.15.79:0/4094017535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86340b23f0 0x7f86340b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:04.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.212 7f863aa64700 1 --2- 172.21.15.79:0/4094017535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86340b1100 0x7f86340d7670 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:04.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.212 7f863aa64700 1 -- 172.21.15.79:0/4094017535 >> 172.21.15.79:0/4094017535 conn(0x7f86340bad40 msgr2=0x7f863409a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:04.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.212 7f863aa64700 1 -- 172.21.15.79:0/4094017535 shutdown_connections 2021-04-09T18:34:04.221 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.212 7f863aa64700 1 -- 172.21.15.79:0/4094017535 wait complete. 2021-04-09T18:34:04.236 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-04-09T18:34:04.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.332 7f80d3b5f700 1 Processor -- start 2021-04-09T18:34:04.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.332 7f80d3b5f700 1 -- start start 2021-04-09T18:34:04.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.332 7f80d3b5f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80cc0e9b10 0x7f80cc09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:04.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.332 7f80d3b5f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f80cc1c8040 0x7f80cc1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:04.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.332 7f80d3b5f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80cc0fbb50 con 0x7f80cc0f5550 2021-04-09T18:34:04.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.332 7f80d3b5f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80cc1c3df0 con 0x7f80cc1c8040 2021-04-09T18:34:04.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.332 7f80d3b5f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc0e9f60 con 0x7f80cc0e9b10 2021-04-09T18:34:04.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.332 7f80d2104700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f80cc1c8040 0x7f80cc1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:04.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.332 7f80d2104700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f80cc1c8040 0x7f80cc1ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33212/0 (socket says 172.21.15.79:33212) 2021-04-09T18:34:04.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.332 7f80d2104700 1 -- 172.21.15.79:0/4187544406 learned_addr learned my addr 172.21.15.79:0/4187544406 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:04.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.332 7f80d1102700 1 --2- 172.21.15.79:0/4187544406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80cc0e9b10 0x7f80cc09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:04.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.332 7f80d2104700 1 -- 172.21.15.79:0/4187544406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80cc0e9b10 msgr2=0x7f80cc09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:04.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.332 7f80d2104700 1 --2- 172.21.15.79:0/4187544406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80cc0e9b10 0x7f80cc09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:04.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.332 7f80d2104700 1 -- 172.21.15.79:0/4187544406 >> v1:172.21.15.89:6789/0 conn(0x7f80cc0f5550 legacy=0x7f80cc0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:04.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.332 7f80d2104700 1 -- 172.21.15.79:0/4187544406 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc0e5700 con 0x7f80cc1c8040 2021-04-09T18:34:04.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.332 7f80d1102700 1 --2- 172.21.15.79:0/4187544406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80cc0e9b10 0x7f80cc09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:04.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.332 7f80d2104700 1 --2- 172.21.15.79:0/4187544406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80cc1c8040 0x7f80cc1ca4a0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f80c40032b0 tx=0x7f80c400b3c0).ready entity=mon.0 client_cookie=224a8ac40e8f0f21 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:04.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.336 7f80d0901700 1 -- 172.21.15.79:0/4187544406 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f80cc0e5700 con 0x7f80cc1c8040 2021-04-09T18:34:04.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.336 7f80d0901700 1 -- 172.21.15.79:0/4187544406 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c400bc20 con 0x7f80cc1c8040 2021-04-09T18:34:04.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.336 7f80d0901700 1 -- 172.21.15.79:0/4187544406 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f80c4002020 con 0x7f80cc1c8040 2021-04-09T18:34:04.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.336 7f80d3b5f700 1 -- 172.21.15.79:0/4187544406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80cc1c8040 msgr2=0x7f80cc1ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:04.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.336 7f80d3b5f700 1 --2- 172.21.15.79:0/4187544406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80cc1c8040 0x7f80cc1ca4a0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f80c40032b0 tx=0x7f80c400b3c0).stop 2021-04-09T18:34:04.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.336 7f80d3b5f700 1 -- 172.21.15.79:0/4187544406 shutdown_connections 2021-04-09T18:34:04.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.336 7f80d3b5f700 1 --2- 172.21.15.79:0/4187544406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80cc1c8040 0x7f80cc1ca4a0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:04.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.336 7f80d3b5f700 1 --2- 172.21.15.79:0/4187544406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80cc0e9b10 0x7f80cc09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:04.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.336 7f80d3b5f700 1 -- 172.21.15.79:0/4187544406 >> 172.21.15.79:0/4187544406 conn(0x7f80cc0e6010 msgr2=0x7f80cc0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:04.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.336 7f80d3b5f700 1 -- 172.21.15.79:0/4187544406 shutdown_connections 2021-04-09T18:34:04.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.336 7f80d3b5f700 1 -- 172.21.15.79:0/4187544406 wait complete. 2021-04-09T18:34:04.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.336 7f80d3b5f700 1 Processor -- start 2021-04-09T18:34:04.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.336 7f80d3b5f700 1 -- start start 2021-04-09T18:34:04.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80d3b5f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80cc0ba910 0x7f80cc0d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:04.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80d3b5f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80cc0d57d0 0x7f80cc0d5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:04.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80d3b5f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80cc1a84b0 0x7f80cc1a8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:04.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80d3b5f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc088590 con 0x7f80cc0d57d0 2021-04-09T18:34:04.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80d3b5f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc0a2490 con 0x7f80cc1a84b0 2021-04-09T18:34:04.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80d3b5f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc0a2a90 con 0x7f80cc0ba910 2021-04-09T18:34:04.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80d1102700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80cc0d57d0 0x7f80cc0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:04.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80d1102700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80cc0d57d0 0x7f80cc0d5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33214/0 (socket says 172.21.15.79:33214) 2021-04-09T18:34:04.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80d1102700 1 -- 172.21.15.79:0/994854531 learned_addr learned my addr 172.21.15.79:0/994854531 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:04.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80d1903700 1 --2- 172.21.15.79:0/994854531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80cc0ba910 0x7f80cc0d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:04.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80d2104700 1 --2- 172.21.15.79:0/994854531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80cc1a84b0 0x7f80cc1a8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:04.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80d1102700 1 -- 172.21.15.79:0/994854531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80cc0ba910 msgr2=0x7f80cc0d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:04.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80d1102700 1 --2- 172.21.15.79:0/994854531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80cc0ba910 0x7f80cc0d1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:04.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80d1102700 1 -- 172.21.15.79:0/994854531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80cc1a84b0 msgr2=0x7f80cc1a8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:04.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80d1102700 1 --2- 172.21.15.79:0/994854531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80cc1a84b0 0x7f80cc1a8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:04.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80d1102700 1 -- 172.21.15.79:0/994854531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc0d2570 con 0x7f80cc0d57d0 2021-04-09T18:34:04.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80d1102700 1 --2- 172.21.15.79:0/994854531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80cc0d57d0 0x7f80cc0d5c20 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f80cc095240 tx=0x7f80bc00be90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:04.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80c27fc700 1 -- 172.21.15.79:0/994854531 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f80cc0d2570 con 0x7f80cc0d57d0 2021-04-09T18:34:04.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80c27fc700 1 -- 172.21.15.79:0/994854531 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80bc0099e0 con 0x7f80cc0d57d0 2021-04-09T18:34:04.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80d3b5f700 1 -- 172.21.15.79:0/994854531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80cc1a8f30 con 0x7f80cc0d57d0 2021-04-09T18:34:04.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80c27fc700 1 -- 172.21.15.79:0/994854531 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f80bc00f040 con 0x7f80cc0d57d0 2021-04-09T18:34:04.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80d3b5f700 1 -- 172.21.15.79:0/994854531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80cc0a4010 con 0x7f80cc0d57d0 2021-04-09T18:34:04.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80c27fc700 1 -- 172.21.15.79:0/994854531 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f80bc013480 con 0x7f80cc0d57d0 2021-04-09T18:34:04.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.340 7f80c27fc700 1 --2- 172.21.15.79:0/994854531 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f80b4029100 0x7f80b402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:04.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.344 7f80c27fc700 1 -- 172.21.15.79:0/994854531 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f80bc010070 con 0x7f80cc0d57d0 2021-04-09T18:34:04.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.344 7f80d1903700 1 --2- 172.21.15.79:0/994854531 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f80b4029100 0x7f80b402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:04.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.344 7f80d1903700 1 --2- 172.21.15.79:0/994854531 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f80b4029100 0x7f80b402b650 crc :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:04.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.348 7f80d3b5f700 1 -- 172.21.15.79:0/994854531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80cc0e39f0 con 0x7f80cc0d57d0 2021-04-09T18:34:04.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.352 7f80c27fc700 1 -- 172.21.15.79:0/994854531 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f80bc0095e0 con 0x7f80cc0d57d0 2021-04-09T18:34:04.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.536 7f80d3b5f700 1 -- 172.21.15.79:0/994854531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f80cc0f5b50 con 0x7f80cc0d57d0 2021-04-09T18:34:04.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.540 7f80c27fc700 1 -- 172.21.15.79:0/994854531 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f80bc000bf0 con 0x7f80cc0d57d0 2021-04-09T18:34:04.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.544 7f80d3b5f700 1 -- 172.21.15.79:0/994854531 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f80b4029100 msgr2=0x7f80b402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:04.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.544 7f80d3b5f700 1 --2- 172.21.15.79:0/994854531 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f80b4029100 0x7f80b402b650 crc :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:04.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.544 7f80d3b5f700 1 -- 172.21.15.79:0/994854531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80cc0d57d0 msgr2=0x7f80cc0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:04.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.544 7f80d3b5f700 1 --2- 172.21.15.79:0/994854531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80cc0d57d0 0x7f80cc0d5c20 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f80cc095240 tx=0x7f80bc00be90).stop 2021-04-09T18:34:04.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.544 7f80d3b5f700 1 -- 172.21.15.79:0/994854531 shutdown_connections 2021-04-09T18:34:04.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.544 7f80d3b5f700 1 --2- 172.21.15.79:0/994854531 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f80b4029100 0x7f80b402b650 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:04.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.544 7f80d3b5f700 1 --2- 172.21.15.79:0/994854531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80cc1a84b0 0x7f80cc1a8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:04.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.544 7f80d3b5f700 1 --2- 172.21.15.79:0/994854531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80cc0ba910 0x7f80cc0d1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:04.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.544 7f80d3b5f700 1 --2- 172.21.15.79:0/994854531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80cc0d57d0 0x7f80cc0d5c20 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:04.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.544 7f80d3b5f700 1 -- 172.21.15.79:0/994854531 >> 172.21.15.79:0/994854531 conn(0x7f80cc0957f0 msgr2=0x7f80cc096080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:04.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.544 7f80d3b5f700 1 -- 172.21.15.79:0/994854531 shutdown_connections 2021-04-09T18:34:04.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.544 7f80d3b5f700 1 -- 172.21.15.79:0/994854531 wait complete. 2021-04-09T18:34:04.561 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:34:04.562 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:34:04.581 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:34:04.601 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:34:04.619 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:34:04.638 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:34:04.656 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:34:04.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:04.657 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:34:04.657 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:34:04.672 INFO:teuthology.orchestra.run.smithi090.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-04-09T18:34:04.673 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:34:04.674 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-04-09T18:34:04.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:04.675 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:34:04.675 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:34:04.684 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-04-09T18:34:04.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:34:04.686 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-04-09T18:34:04.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:04.687 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:34:04.687 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:34:04.705 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:34:04.706 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:34:04.706 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:34:04.707 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:34:04.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.804 7fa25820a700 1 Processor -- start 2021-04-09T18:34:04.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.804 7fa25820a700 1 -- start start 2021-04-09T18:34:04.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.804 7fa25820a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2501c9020 0x7fa2501cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:04.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.804 7fa25820a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2500fbb20 con 0x7fa2500f5520 2021-04-09T18:34:04.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.804 7fa25820a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25009f910 con 0x7fa2500e9ae0 2021-04-09T18:34:04.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.804 7fa25820a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2501c3dc0 con 0x7fa2501c9020 2021-04-09T18:34:04.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.804 7fa255fae700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa2500f5520 0x7fa2500f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56164/0 (socket says 172.21.15.79:56164) 2021-04-09T18:34:04.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.804 7fa255fae700 1 -- 172.21.15.79:0/3663744761 learned_addr learned my addr 172.21.15.79:0/3663744761 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:04.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.804 7fa2567af700 1 --2- 172.21.15.79:0/3663744761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2501c9020 0x7fa2501cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:04.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.804 7fa254fac700 1 -- 172.21.15.79:0/3663744761 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206138024 0 0) 0x7fa24c0010d0 con 0x7fa2500f5520 2021-04-09T18:34:04.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.804 7fa254fac700 1 -- 172.21.15.79:0/3663744761 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa23c003240 con 0x7fa2500f5520 2021-04-09T18:34:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.804 7fa254fac700 1 -- 172.21.15.79:0/3663744761 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434339546 0 0) 0x7fa2400010d0 con 0x7fa2500e9ae0 2021-04-09T18:34:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.804 7fa254fac700 1 -- 172.21.15.79:0/3663744761 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa23c003620 con 0x7fa2500e9ae0 2021-04-09T18:34:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.804 7fa2567af700 1 -- 172.21.15.79:0/3663744761 >> v1:172.21.15.89:6789/0 conn(0x7fa2500e9ae0 legacy=0x7fa25009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.804 7fa254fac700 1 -- 172.21.15.79:0/3663744761 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3632676480 0 0) 0x7fa24c001650 con 0x7fa2500f5520 2021-04-09T18:34:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.804 7fa2567af700 1 -- 172.21.15.79:0/3663744761 >> v1:172.21.15.79:6789/0 conn(0x7fa2500f5520 legacy=0x7fa2500f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:04.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.804 7fa2567af700 1 -- 172.21.15.79:0/3663744761 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2500e56d0 con 0x7fa2501c9020 2021-04-09T18:34:04.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.804 7fa2567af700 1 --2- 172.21.15.79:0/3663744761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2501c9020 0x7fa2501cb480 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fa24c001980 tx=0x7fa24800b0e0).ready entity=mon.2 client_cookie=4ae0a558998d687c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.808 7fa254fac700 1 -- 172.21.15.79:0/3663744761 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa2500e56d0 con 0x7fa2501c9020 2021-04-09T18:34:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.808 7fa254fac700 1 -- 172.21.15.79:0/3663744761 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24800b9b0 con 0x7fa2501c9020 2021-04-09T18:34:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.808 7fa254fac700 1 -- 172.21.15.79:0/3663744761 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa248002020 con 0x7fa2501c9020 2021-04-09T18:34:04.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.808 7fa25820a700 1 -- 172.21.15.79:0/3663744761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2501c9020 msgr2=0x7fa2501cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:04.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.808 7fa25820a700 1 --2- 172.21.15.79:0/3663744761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2501c9020 0x7fa2501cb480 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fa24c001980 tx=0x7fa24800b0e0).stop 2021-04-09T18:34:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.808 7fa25820a700 1 -- 172.21.15.79:0/3663744761 shutdown_connections 2021-04-09T18:34:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.808 7fa25820a700 1 --2- 172.21.15.79:0/3663744761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2501c9020 0x7fa2501cb480 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.808 7fa25820a700 1 -- 172.21.15.79:0/3663744761 >> 172.21.15.79:0/3663744761 conn(0x7fa2500e5fe0 msgr2=0x7fa2500e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.808 7fa25820a700 1 -- 172.21.15.79:0/3663744761 shutdown_connections 2021-04-09T18:34:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.808 7fa25820a700 1 -- 172.21.15.79:0/3663744761 wait complete. 2021-04-09T18:34:04.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa25820a700 1 Processor -- start 2021-04-09T18:34:04.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa25820a700 1 -- start start 2021-04-09T18:34:04.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa25820a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2500b0180 0x7fa2500af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:04.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa25820a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2500d4e70 0x7fa2500d52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:04.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa25820a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2501ae130 0x7fa2501ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:04.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa25820a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500e9f30 con 0x7fa2500b0180 2021-04-09T18:34:04.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa25820a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500bf720 con 0x7fa2501ae130 2021-04-09T18:34:04.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa25820a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500bfa20 con 0x7fa2500d4e70 2021-04-09T18:34:04.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa255fae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2500b0180 0x7fa2500af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:04.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa255fae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2500b0180 0x7fa2500af840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33228/0 (socket says 172.21.15.79:33228) 2021-04-09T18:34:04.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa255fae700 1 -- 172.21.15.79:0/42341485 learned_addr learned my addr 172.21.15.79:0/42341485 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:04.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa2557ad700 1 --2- 172.21.15.79:0/42341485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2500d4e70 0x7fa2500d52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa2567af700 1 --2- 172.21.15.79:0/42341485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2501ae130 0x7fa2501ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa255fae700 1 -- 172.21.15.79:0/42341485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2500d4e70 msgr2=0x7fa2500d52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa255fae700 1 --2- 172.21.15.79:0/42341485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2500d4e70 0x7fa2500d52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa255fae700 1 -- 172.21.15.79:0/42341485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2501ae130 msgr2=0x7fa2501ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:04.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa255fae700 1 --2- 172.21.15.79:0/42341485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2501ae130 0x7fa2501ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:04.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa255fae700 1 -- 172.21.15.79:0/42341485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2500beea0 con 0x7fa2500b0180 2021-04-09T18:34:04.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa255fae700 1 --2- 172.21.15.79:0/42341485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2500b0180 0x7fa2500af840 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7fa2500bf6a0 tx=0x7fa24c00cf70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:04.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa2467fc700 1 -- 172.21.15.79:0/42341485 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa2500beea0 con 0x7fa2500b0180 2021-04-09T18:34:04.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa2467fc700 1 -- 172.21.15.79:0/42341485 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24c007170 con 0x7fa2500b0180 2021-04-09T18:34:04.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa25820a700 1 -- 172.21.15.79:0/42341485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2500afe70 con 0x7fa2500b0180 2021-04-09T18:34:04.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa2467fc700 1 -- 172.21.15.79:0/42341485 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa24c00aa30 con 0x7fa2500b0180 2021-04-09T18:34:04.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.812 7fa25820a700 1 -- 172.21.15.79:0/42341485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2500bf1f0 con 0x7fa2500b0180 2021-04-09T18:34:04.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.816 7fa2467fc700 1 -- 172.21.15.79:0/42341485 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa24c00ac30 con 0x7fa2500b0180 2021-04-09T18:34:04.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.816 7fa2467fc700 1 --2- 172.21.15.79:0/42341485 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa238029100 0x7fa23802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:04.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.816 7fa2467fc700 1 -- 172.21.15.79:0/42341485 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5190+0+0 (secure 0 0 0) 0x7fa24c039490 con 0x7fa2500b0180 2021-04-09T18:34:04.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.816 7fa2557ad700 1 --2- 172.21.15.79:0/42341485 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa238029100 0x7fa23802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:04.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.816 7fa2557ad700 1 --2- 172.21.15.79:0/42341485 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa238029100 0x7fa23802b650 crc :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:04.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.816 7fa25820a700 1 -- 172.21.15.79:0/42341485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2500e39e0 con 0x7fa2500b0180 2021-04-09T18:34:04.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.824 7fa2467fc700 1 -- 172.21.15.79:0/42341485 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa24c00a630 con 0x7fa2500b0180 2021-04-09T18:34:05.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:04.996 7fa25820a700 1 -- 172.21.15.79:0/42341485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa2500f5b20 con 0x7fa2500b0180 2021-04-09T18:34:05.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.000 7fa2467fc700 1 -- 172.21.15.79:0/42341485 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v92) v1 ==== 81+0+25933 (secure 0 0 0) 0x7fa250107f50 con 0x7fa2500b0180 2021-04-09T18:34:05.006 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:05.007 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:34:05.007 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 92, 2021-04-09T18:34:05.008 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:34:05.008 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:34:05.008 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:34:02.166284", 2021-04-09T18:34:05.009 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:34:05.009 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:34:05.010 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:34:05.010 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:34:05.010 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:34:05.011 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:34:05.011 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:34:05.012 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:34:05.012 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:34:05.012 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:34:05.013 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:34:05.013 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:34:05.014 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:34:05.014 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:34:05.014 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:34:05.015 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 17, 2021-04-09T18:34:05.015 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:34:05.016 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:34:05.016 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:34:05.016 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:34:05.017 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:34:05.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.018 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:34:05.018 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:34:05.018 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:34:05.019 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:34:05.019 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:34:05.020 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:34:05.020 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:34:05.021 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:34:05.021 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:34:05.021 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:34:05.022 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:34:05.022 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:34:05.022 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:34:05.023 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:34:05.023 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:34:05.024 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:34:05.024 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:34:05.025 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:34:05.025 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:34:05.025 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:34:05.026 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:34:05.026 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:34:05.027 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:34:05.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.027 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:34:05.028 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:34:05.028 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:34:05.029 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:34:05.029 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:34:05.029 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:34:05.030 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:34:05.030 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:34:05.031 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:34:05.031 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:34:05.031 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:34:05.032 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:34:05.032 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:34:05.033 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:34:05.033 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:34:05.033 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:34:05.034 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:34:05.034 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:34:05.035 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:34:05.035 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:34:05.035 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:34:05.036 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:34:05.036 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:34:05.037 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:34:05.037 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:34:05.038 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:34:05.038 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:34:05.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.038 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:34:05.039 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:34:05.039 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:34:05.039 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:34:05.039 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:34:05.039 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:34:05.040 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:34:05.040 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:34:05.040 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:34:05.040 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:34:05.041 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:34:05.041 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:34:05.041 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:34:05.041 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:34:05.041 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.042 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.042 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:34:05.042 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:34:05.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.042 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:34:05.043 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:34:05.043 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:05.043 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:05.043 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:05.044 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:05.044 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:05.044 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:05.044 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:05.044 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 86, 2021-04-09T18:34:05.045 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:05.045 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:05.045 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:05.045 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.046 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.046 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:34:05.046 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:05.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.047 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.047 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:34:05.047 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:05.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.048 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.048 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:05.049 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.049 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.049 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:34:05.049 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:05.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.050 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.050 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:34:05.051 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:05.051 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.051 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.051 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:05.052 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.052 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.052 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:34:05.053 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:05.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.053 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.054 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:34:05.054 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:05.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.054 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.055 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:05.055 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.055 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.056 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:34:05.056 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:05.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.057 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.057 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:34:05.057 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:05.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.057 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.058 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:34:05.058 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:34:05.058 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:34:05.058 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:34:05.059 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:05.059 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:05.059 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:05.059 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.060 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:34:05.060 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:34:05.060 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:05.061 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:05.061 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:05.061 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:05.061 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:05.061 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:05.062 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:05.062 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 77, 2021-04-09T18:34:05.062 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:05.062 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:05.062 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:05.063 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.063 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:34:05.064 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:05.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.064 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.064 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:34:05.065 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:05.065 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.065 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.065 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:05.066 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.066 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.066 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:34:05.066 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:05.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.067 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.067 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:34:05.067 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:05.068 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.068 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.068 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:05.068 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.069 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.069 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:34:05.069 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:05.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.070 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.070 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:34:05.070 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:05.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.071 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.071 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:05.071 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.072 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.072 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:34:05.072 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:05.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.073 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.073 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:34:05.073 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:05.073 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.074 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.074 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:34:05.074 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:34:05.075 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:34:05.075 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:34:05.075 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:05.075 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:05.075 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:05.076 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.076 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:34:05.076 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:34:05.077 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:05.077 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:05.077 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:05.077 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:05.078 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:05.078 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:05.078 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:05.078 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 85, 2021-04-09T18:34:05.078 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:05.079 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:05.079 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:05.079 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.079 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.080 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:34:05.080 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:05.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.080 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.081 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:34:05.081 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:05.081 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.081 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.082 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:05.082 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.082 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.083 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:34:05.083 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:05.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.083 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.084 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:34:05.084 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:05.084 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.084 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.085 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:05.085 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.085 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.086 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:34:05.086 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:05.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.086 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.087 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:34:05.087 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:05.087 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.087 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.088 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:05.088 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.088 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.088 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:34:05.089 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:05.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.089 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.090 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:34:05.090 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:05.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.090 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.091 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:34:05.091 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:34:05.091 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:34:05.091 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:34:05.091 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:05.092 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:05.092 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:05.092 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.093 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:34:05.093 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:34:05.093 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:05.093 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:05.094 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:05.094 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:05.094 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:05.094 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:05.094 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:05.095 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 85, 2021-04-09T18:34:05.095 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:05.095 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:05.095 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:05.095 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.096 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.096 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:34:05.096 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:05.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.097 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.097 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:34:05.097 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:05.097 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.098 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.098 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:05.098 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.099 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.099 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:34:05.099 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:05.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.100 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.100 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:34:05.100 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:05.100 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.101 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.101 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:05.101 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.102 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.102 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:34:05.102 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:05.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.103 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.103 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:34:05.103 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:05.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.103 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.104 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:05.104 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.105 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.105 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:34:05.105 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:05.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.106 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.106 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:34:05.106 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:05.106 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.106 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.107 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:34:05.107 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:34:05.107 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:34:05.107 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:34:05.108 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:05.108 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:05.108 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:05.108 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.109 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:34:05.109 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:34:05.109 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:05.110 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:05.110 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:05.110 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:05.110 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:05.110 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:05.111 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:05.111 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 86, 2021-04-09T18:34:05.111 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:05.111 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:05.111 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:05.112 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.112 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.112 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:34:05.112 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:05.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.113 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.113 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:34:05.113 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:05.114 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.114 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.114 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:05.114 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.115 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.115 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:34:05.115 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:05.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.116 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.116 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:34:05.116 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:05.117 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.117 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.117 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:05.117 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.118 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.118 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:34:05.118 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:05.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.119 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.119 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:34:05.119 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:05.120 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.120 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.120 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:05.120 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.121 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.121 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:34:05.121 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:05.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.122 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.122 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:34:05.122 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:05.122 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.123 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.123 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:34:05.123 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:34:05.124 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:34:05.124 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:34:05.124 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:05.124 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:05.125 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:05.125 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.125 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:34:05.126 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:34:05.126 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:05.126 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:05.126 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:05.126 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:05.127 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:05.127 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:05.127 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:05.127 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 85, 2021-04-09T18:34:05.127 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:05.128 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:05.128 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:05.128 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.129 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.129 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:34:05.129 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:05.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.130 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.130 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:34:05.130 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:05.130 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.130 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.131 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:05.131 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.131 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.132 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:34:05.132 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:05.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.133 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:34:05.133 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:05.133 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.134 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.134 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:05.134 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.135 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.135 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:34:05.135 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:05.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.136 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.136 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:34:05.136 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:05.136 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.137 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.137 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:05.137 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.138 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.138 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:34:05.138 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:05.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.139 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.139 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:34:05.139 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:05.139 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.140 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.140 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:34:05.140 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:34:05.140 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:34:05.141 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:34:05.141 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:05.141 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:05.141 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:05.141 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.143 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:34:05.143 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:34:05.143 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:05.143 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:05.144 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:05.144 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:05.144 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:05.144 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:05.145 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:05.145 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 86, 2021-04-09T18:34:05.145 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:05.145 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:05.145 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:05.146 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.146 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.146 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:34:05.146 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:05.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.147 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.147 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:34:05.148 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:05.148 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.148 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.148 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:05.149 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.149 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.149 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:34:05.149 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:05.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.150 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.150 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:34:05.150 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:05.151 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.151 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.151 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:05.152 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.152 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.152 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:34:05.152 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:05.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.153 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.153 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:34:05.153 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:05.154 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.154 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.155 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:05.155 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.155 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.155 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:34:05.156 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:05.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.156 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.156 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:34:05.157 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:05.157 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.157 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.158 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:34:05.158 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:34:05.158 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:34:05.158 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:34:05.158 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:05.159 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:05.159 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:05.159 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.160 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:34:05.160 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:34:05.160 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:05.160 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:05.161 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:05.161 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:05.161 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:05.161 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:05.161 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:05.162 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 87, 2021-04-09T18:34:05.162 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:05.162 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:05.162 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:05.162 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.163 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.163 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:34:05.164 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:05.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.165 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.165 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:34:05.165 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:05.166 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.166 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.166 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:05.167 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.167 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.167 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:34:05.167 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:05.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.168 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.168 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:34:05.168 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:05.169 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.169 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.169 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:05.170 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.170 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.170 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:34:05.170 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:05.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.171 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.171 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:34:05.171 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:05.172 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.172 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.172 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:05.173 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:05.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.173 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:05.173 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:34:05.173 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:05.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.174 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:05.174 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:34:05.174 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:05.175 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.175 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.175 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:34:05.175 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:34:05.176 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:34:05.176 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:34:05.176 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:05.176 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:05.177 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:05.177 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:05.177 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.177 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:34:05.177 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:34:05.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.178 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:34:05.178 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:05.178 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:05.178 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:05.179 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:05.179 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:05.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.180 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:34:05.180 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:05.180 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:05.180 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:05.180 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:05.181 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:05.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.181 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:34:05.181 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:05.182 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:05.182 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:05.182 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:05.182 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:05.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.183 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:34:05.183 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:05.183 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:05.184 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:05.184 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:05.184 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:05.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.185 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:34:05.185 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:05.185 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:05.185 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:05.185 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:05.186 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:05.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.186 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:34:05.186 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:05.187 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:05.187 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:05.187 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:05.187 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:05.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.188 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:34:05.188 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:05.188 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:05.189 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:05.189 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:05.189 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:05.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:05.190 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:34:05.190 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:05.190 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:05.190 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:05.190 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:05.191 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:05.191 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.191 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:34:05.191 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:34:05.192 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:34:05.192 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:34:05.192 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:34:05.192 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": { 2021-04-09T18:34:05.192 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6835/2698757363": "2021-04-10 18:33:58.617491", 2021-04-09T18:34:05.193 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6834/2698757363": "2021-04-10 18:33:58.617491" 2021-04-09T18:34:05.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.193 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:34:05.193 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:34:05.193 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:34:05.194 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:34:05.194 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:34:05.194 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:34:05.194 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:34:05.194 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:34:05.195 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:34:05.195 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:34:05.195 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:34:05.195 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:34:05.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.196 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:34:05.196 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:34:05.196 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:34:05.196 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:34:05.196 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:34:05.197 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:34:05.197 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:34:05.197 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:05.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:05.198 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:34:05.198 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:34:05.198 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:34:05.198 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:34:05.198 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:34:05.199 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:34:05.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.004 7fa25820a700 1 -- 172.21.15.79:0/42341485 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa238029100 msgr2=0x7fa23802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:05.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.004 7fa25820a700 1 --2- 172.21.15.79:0/42341485 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa238029100 0x7fa23802b650 crc :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.004 7fa25820a700 1 -- 172.21.15.79:0/42341485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2500b0180 msgr2=0x7fa2500af840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:05.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.004 7fa25820a700 1 --2- 172.21.15.79:0/42341485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2500b0180 0x7fa2500af840 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7fa2500bf6a0 tx=0x7fa24c00cf70).stop 2021-04-09T18:34:05.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.004 7fa25820a700 1 -- 172.21.15.79:0/42341485 shutdown_connections 2021-04-09T18:34:05.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.004 7fa25820a700 1 --2- 172.21.15.79:0/42341485 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa238029100 0x7fa23802b650 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.004 7fa25820a700 1 --2- 172.21.15.79:0/42341485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2501ae130 0x7fa2501ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.004 7fa25820a700 1 --2- 172.21.15.79:0/42341485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2500b0180 0x7fa2500af840 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.004 7fa25820a700 1 --2- 172.21.15.79:0/42341485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2500d4e70 0x7fa2500d52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.004 7fa25820a700 1 -- 172.21.15.79:0/42341485 >> 172.21.15.79:0/42341485 conn(0x7fa2500959e0 msgr2=0x7fa2500d8280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:05.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.004 7fa25820a700 1 -- 172.21.15.79:0/42341485 shutdown_connections 2021-04-09T18:34:05.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.004 7fa25820a700 1 -- 172.21.15.79:0/42341485 wait complete. 2021-04-09T18:34:05.204 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:34:05.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.300 7f5b0d8a1700 1 Processor -- start 2021-04-09T18:34:05.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.300 7f5b0d8a1700 1 -- start start 2021-04-09T18:34:05.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.300 7f5b0d8a1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5b080f5520 0x7f5b080f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:05.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.300 7f5b0d8a1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5b081c8010 0x7f5b081ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:05.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.300 7f5b0d8a1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b080fbb20 con 0x7f5b080e9ae0 2021-04-09T18:34:05.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.300 7f5b0d8a1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b080e9f30 con 0x7f5b080f5520 2021-04-09T18:34:05.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.300 7f5b0d8a1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b081c3dc0 con 0x7f5b081c8010 2021-04-09T18:34:05.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.300 7f5b06d4f700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5b080e9ae0 0x7f5b0809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56180/0 (socket says 172.21.15.79:56180) 2021-04-09T18:34:05.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.300 7f5b06d4f700 1 -- 172.21.15.79:0/2494185777 learned_addr learned my addr 172.21.15.79:0/2494185777 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:05.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.300 7f5b07550700 1 --2- 172.21.15.79:0/2494185777 >> v2:172.21.15.79:3300/0 conn(0x7f5b080f5520 0x7f5b080f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:05.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.300 7f5b07d51700 1 --2- 172.21.15.79:0/2494185777 >> v2:172.21.15.89:3300/0 conn(0x7f5b081c8010 0x7f5b081ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:05.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.304 7f5b0654e700 1 -- 172.21.15.79:0/2494185777 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203864281 0 0) 0x7f5af80010d0 con 0x7f5b080e9ae0 2021-04-09T18:34:05.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.304 7f5b0654e700 1 -- 172.21.15.79:0/2494185777 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5af0003240 con 0x7f5b080e9ae0 2021-04-09T18:34:05.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.304 7f5b07550700 1 -- 172.21.15.79:0/2494185777 >> v2:172.21.15.89:3300/0 conn(0x7f5b081c8010 msgr2=0x7f5b081ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:05.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.304 7f5b07550700 1 --2- 172.21.15.79:0/2494185777 >> v2:172.21.15.89:3300/0 conn(0x7f5b081c8010 0x7f5b081ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.304 7f5b07550700 1 -- 172.21.15.79:0/2494185777 >> v1:172.21.15.79:6789/0 conn(0x7f5b080e9ae0 legacy=0x7f5b0809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:05.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.304 7f5b07550700 1 -- 172.21.15.79:0/2494185777 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0809f910 con 0x7f5b080f5520 2021-04-09T18:34:05.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.304 7f5b07550700 1 --2- 172.21.15.79:0/2494185777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b080f5520 0x7f5b080f64b0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7f5afc002f30 tx=0x7f5afc00bd10).ready entity=mon.0 client_cookie=fc318fcb42ec8826 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:05.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.304 7f5b0654e700 1 -- 172.21.15.79:0/2494185777 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b0809f910 con 0x7f5b080f5520 2021-04-09T18:34:05.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.304 7f5b0654e700 1 -- 172.21.15.79:0/2494185777 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc0098a0 con 0x7f5b080f5520 2021-04-09T18:34:05.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.304 7f5b0654e700 1 -- 172.21.15.79:0/2494185777 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5afc009c70 con 0x7f5b080f5520 2021-04-09T18:34:05.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.304 7f5b0d8a1700 1 -- 172.21.15.79:0/2494185777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b080f5520 msgr2=0x7f5b080f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:05.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.304 7f5b0d8a1700 1 --2- 172.21.15.79:0/2494185777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b080f5520 0x7f5b080f64b0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7f5afc002f30 tx=0x7f5afc00bd10).stop 2021-04-09T18:34:05.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.304 7f5b0d8a1700 1 -- 172.21.15.79:0/2494185777 shutdown_connections 2021-04-09T18:34:05.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.304 7f5b0d8a1700 1 --2- 172.21.15.79:0/2494185777 >> v2:172.21.15.89:3300/0 conn(0x7f5b081c8010 0x7f5b081ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.304 7f5b0d8a1700 1 --2- 172.21.15.79:0/2494185777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b080f5520 0x7f5b080f64b0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.304 7f5b0d8a1700 1 -- 172.21.15.79:0/2494185777 >> 172.21.15.79:0/2494185777 conn(0x7f5b080e5fe0 msgr2=0x7f5b080e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:05.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.304 7f5b0d8a1700 1 -- 172.21.15.79:0/2494185777 shutdown_connections 2021-04-09T18:34:05.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.304 7f5b0d8a1700 1 -- 172.21.15.79:0/2494185777 wait complete. 2021-04-09T18:34:05.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.308 7f5b0d8a1700 1 Processor -- start 2021-04-09T18:34:05.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.308 7f5b0d8a1700 1 -- start start 2021-04-09T18:34:05.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.308 7f5b0d8a1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b080d7020 0x7f5b080d7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:05.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.308 7f5b0d8a1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b080d1090 0x7f5b080d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:05.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.308 7f5b0d8a1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b08094b00 0x7f5b08094f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:05.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.308 7f5b0d8a1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b080a9980 con 0x7f5b08094b00 2021-04-09T18:34:05.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.308 7f5b0d8a1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b080d1b10 con 0x7f5b080d7020 2021-04-09T18:34:05.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.308 7f5b0d8a1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b080ae030 con 0x7f5b080d1090 2021-04-09T18:34:05.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.308 7f5b07d51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b08094b00 0x7f5b08094f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:05.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.308 7f5b06d4f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b080d1090 0x7f5b080d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:05.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.308 7f5b07d51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b08094b00 0x7f5b08094f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33246/0 (socket says 172.21.15.79:33246) 2021-04-09T18:34:05.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.308 7f5b07d51700 1 -- 172.21.15.79:0/873409614 learned_addr learned my addr 172.21.15.79:0/873409614 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:05.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.308 7f5b07550700 1 --2- 172.21.15.79:0/873409614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b080d7020 0x7f5b080d7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:05.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.312 7f5b07d51700 1 -- 172.21.15.79:0/873409614 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b080d1090 msgr2=0x7f5b080d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:05.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.312 7f5b07d51700 1 --2- 172.21.15.79:0/873409614 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b080d1090 0x7f5b080d14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.312 7f5b07d51700 1 -- 172.21.15.79:0/873409614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b080d7020 msgr2=0x7f5b080d7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:05.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.312 7f5b07d51700 1 --2- 172.21.15.79:0/873409614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b080d7020 0x7f5b080d7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.312 7f5b07d51700 1 -- 172.21.15.79:0/873409614 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b080a8b40 con 0x7f5b08094b00 2021-04-09T18:34:05.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.312 7f5b07d51700 1 --2- 172.21.15.79:0/873409614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b08094b00 0x7f5b08094f50 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f5b00006de0 tx=0x7f5b0000c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:05.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.312 7f5aeffff700 1 -- 172.21.15.79:0/873409614 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b080a8b40 con 0x7f5b08094b00 2021-04-09T18:34:05.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.312 7f5aeffff700 1 -- 172.21.15.79:0/873409614 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0000cca0 con 0x7f5b08094b00 2021-04-09T18:34:05.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.312 7f5b0d8a1700 1 -- 172.21.15.79:0/873409614 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b08095580 con 0x7f5b08094b00 2021-04-09T18:34:05.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.312 7f5aeffff700 1 -- 172.21.15.79:0/873409614 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b0000f040 con 0x7f5b08094b00 2021-04-09T18:34:05.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.312 7f5b0d8a1700 1 -- 172.21.15.79:0/873409614 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b081a6630 con 0x7f5b08094b00 2021-04-09T18:34:05.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.312 7f5aeffff700 1 -- 172.21.15.79:0/873409614 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5b00022060 con 0x7f5b08094b00 2021-04-09T18:34:05.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.312 7f5aeffff700 1 --2- 172.21.15.79:0/873409614 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5ae8029100 0x7f5ae802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:05.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.312 7f5aeffff700 1 -- 172.21.15.79:0/873409614 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f5b00010040 con 0x7f5b08094b00 2021-04-09T18:34:05.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.312 7f5b07550700 1 --2- 172.21.15.79:0/873409614 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5ae8029100 0x7f5ae802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:05.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.312 7f5b07550700 1 --2- 172.21.15.79:0/873409614 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5ae8029100 0x7f5ae802b650 crc :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:05.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.316 7f5b0d8a1700 1 -- 172.21.15.79:0/873409614 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b080e39e0 con 0x7f5b08094b00 2021-04-09T18:34:05.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.324 7f5aeffff700 1 -- 172.21.15.79:0/873409614 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5b080f76c0 con 0x7f5b08094b00 2021-04-09T18:34:05.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.496 7f5b0d8a1700 1 -- 172.21.15.79:0/873409614 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b0809a130 con 0x7f5b08094b00 2021-04-09T18:34:05.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.496 7f5aeffff700 1 -- 172.21.15.79:0/873409614 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+1177 (secure 0 0 0) 0x7f5b0000ca90 con 0x7f5b08094b00 2021-04-09T18:34:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 57 2021-04-09T18:34:05.503 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:05.503 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/2412239832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2412239832},{"type":"v1","addr":"172.21.15.89:6835","nonce":2412239832}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":57},{"gid":6831,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3171732398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3171732398},{"type":"v1","addr":"172.21.15.79:6833","nonce":3171732398}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":51}],"filesystems":[]} 2021-04-09T18:34:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.500 7f5b0d8a1700 1 -- 172.21.15.79:0/873409614 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5ae8029100 msgr2=0x7f5ae802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.500 7f5b0d8a1700 1 --2- 172.21.15.79:0/873409614 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5ae8029100 0x7f5ae802b650 crc :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.500 7f5b0d8a1700 1 -- 172.21.15.79:0/873409614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b08094b00 msgr2=0x7f5b08094f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.500 7f5b0d8a1700 1 --2- 172.21.15.79:0/873409614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b08094b00 0x7f5b08094f50 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f5b00006de0 tx=0x7f5b0000c430).stop 2021-04-09T18:34:05.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.500 7f5b0d8a1700 1 -- 172.21.15.79:0/873409614 shutdown_connections 2021-04-09T18:34:05.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.500 7f5b0d8a1700 1 --2- 172.21.15.79:0/873409614 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5ae8029100 0x7f5ae802b650 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.500 7f5b0d8a1700 1 --2- 172.21.15.79:0/873409614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b080d7020 0x7f5b080d7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.500 7f5b0d8a1700 1 --2- 172.21.15.79:0/873409614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b08094b00 0x7f5b08094f50 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.500 7f5b0d8a1700 1 --2- 172.21.15.79:0/873409614 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b080d1090 0x7f5b080d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.500 7f5b0d8a1700 1 -- 172.21.15.79:0/873409614 >> 172.21.15.79:0/873409614 conn(0x7f5b080d86c0 msgr2=0x7f5b080d7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:05.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.500 7f5b0d8a1700 1 -- 172.21.15.79:0/873409614 shutdown_connections 2021-04-09T18:34:05.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.500 7f5b0d8a1700 1 -- 172.21.15.79:0/873409614 wait complete. 2021-04-09T18:34:05.515 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:34:05.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.604 7fd87785c700 1 Processor -- start 2021-04-09T18:34:05.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.604 7fd87785c700 1 -- start start 2021-04-09T18:34:05.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd87785c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd8700f5510 0x7fd8700f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd87785c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd8701c8000 0x7fd8701ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd87785c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8700fbb10 con 0x7fd8700e9ad0 2021-04-09T18:34:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd87785c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8700e9f20 con 0x7fd8700f5510 2021-04-09T18:34:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd87785c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8701c3db0 con 0x7fd8701c8000 2021-04-09T18:34:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd874dff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd8700e9ad0 0x7fd87009f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56192/0 (socket says 172.21.15.79:56192) 2021-04-09T18:34:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd874dff700 1 -- 172.21.15.79:0/278489708 learned_addr learned my addr 172.21.15.79:0/278489708 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd875600700 1 --2- 172.21.15.79:0/278489708 >> v2:172.21.15.79:3300/0 conn(0x7fd8700f5510 0x7fd8700f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd875e01700 1 --2- 172.21.15.79:0/278489708 >> v2:172.21.15.89:3300/0 conn(0x7fd8701c8000 0x7fd8701ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd863fff700 1 -- 172.21.15.79:0/278489708 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491002508 0 0) 0x7fd86c0010d0 con 0x7fd8700e9ad0 2021-04-09T18:34:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd863fff700 1 -- 172.21.15.79:0/278489708 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd85c003240 con 0x7fd8700e9ad0 2021-04-09T18:34:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd875600700 1 -- 172.21.15.79:0/278489708 >> v2:172.21.15.89:3300/0 conn(0x7fd8701c8000 msgr2=0x7fd8701ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd875600700 1 --2- 172.21.15.79:0/278489708 >> v2:172.21.15.89:3300/0 conn(0x7fd8701c8000 0x7fd8701ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd863fff700 1 -- 172.21.15.79:0/278489708 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 647148263 0 0) 0x7fd86c001650 con 0x7fd8700e9ad0 2021-04-09T18:34:05.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd875600700 1 -- 172.21.15.79:0/278489708 >> v1:172.21.15.79:6789/0 conn(0x7fd8700e9ad0 legacy=0x7fd87009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:05.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd875600700 1 -- 172.21.15.79:0/278489708 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87009f900 con 0x7fd8700f5510 2021-04-09T18:34:05.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd875600700 1 --2- 172.21.15.79:0/278489708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8700f5510 0x7fd8700f64a0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7fd86c001df0 tx=0x7fd86400bd10).ready entity=mon.0 client_cookie=ec59894e23285f1e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:05.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd863fff700 1 -- 172.21.15.79:0/278489708 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd87009f900 con 0x7fd8700f5510 2021-04-09T18:34:05.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd863fff700 1 -- 172.21.15.79:0/278489708 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd864009710 con 0x7fd8700f5510 2021-04-09T18:34:05.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd863fff700 1 -- 172.21.15.79:0/278489708 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd86c001bb0 con 0x7fd8700f5510 2021-04-09T18:34:05.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd87785c700 1 -- 172.21.15.79:0/278489708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8700f5510 msgr2=0x7fd8700f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:05.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd87785c700 1 --2- 172.21.15.79:0/278489708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8700f5510 0x7fd8700f64a0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7fd86c001df0 tx=0x7fd86400bd10).stop 2021-04-09T18:34:05.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd87785c700 1 -- 172.21.15.79:0/278489708 shutdown_connections 2021-04-09T18:34:05.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd87785c700 1 --2- 172.21.15.79:0/278489708 >> v2:172.21.15.89:3300/0 conn(0x7fd8701c8000 0x7fd8701ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd87785c700 1 --2- 172.21.15.79:0/278489708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8700f5510 0x7fd8700f64a0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd87785c700 1 -- 172.21.15.79:0/278489708 >> 172.21.15.79:0/278489708 conn(0x7fd8700e5fd0 msgr2=0x7fd8700e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:05.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd87785c700 1 -- 172.21.15.79:0/278489708 shutdown_connections 2021-04-09T18:34:05.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.608 7fd87785c700 1 -- 172.21.15.79:0/278489708 wait complete. 2021-04-09T18:34:05.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd87785c700 1 Processor -- start 2021-04-09T18:34:05.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd87785c700 1 -- start start 2021-04-09T18:34:05.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd87785c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8700d6090 0x7fd8701ad300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:05.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd87785c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8700d64e0 0x7fd8701ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:05.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd87785c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd870097fc0 0x7fd870098410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:05.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd87785c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd870096a40 con 0x7fd8700d6090 2021-04-09T18:34:05.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd87785c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8700d6c50 con 0x7fd8700d64e0 2021-04-09T18:34:05.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd87785c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8700967c0 con 0x7fd870097fc0 2021-04-09T18:34:05.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd875600700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8700d6090 0x7fd8701ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:05.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd875600700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8700d6090 0x7fd8701ad300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33256/0 (socket says 172.21.15.79:33256) 2021-04-09T18:34:05.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd875600700 1 -- 172.21.15.79:0/1591055230 learned_addr learned my addr 172.21.15.79:0/1591055230 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:05.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd875e01700 1 --2- 172.21.15.79:0/1591055230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd870097fc0 0x7fd870098410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:05.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd874dff700 1 --2- 172.21.15.79:0/1591055230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8700d64e0 0x7fd8701ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:05.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd875e01700 1 -- 172.21.15.79:0/1591055230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8700d64e0 msgr2=0x7fd8701ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:05.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd875e01700 1 --2- 172.21.15.79:0/1591055230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8700d64e0 0x7fd8701ad930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd875e01700 1 -- 172.21.15.79:0/1591055230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8700d6090 msgr2=0x7fd8701ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:05.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd875e01700 1 --2- 172.21.15.79:0/1591055230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8700d6090 0x7fd8701ad300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd875e01700 1 -- 172.21.15.79:0/1591055230 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8700c0770 con 0x7fd870097fc0 2021-04-09T18:34:05.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd875e01700 1 --2- 172.21.15.79:0/1591055230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd870097fc0 0x7fd870098410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fd8700d81d0 tx=0x7fd86800c430).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:05.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd861ffb700 1 -- 172.21.15.79:0/1591055230 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd8700c0770 con 0x7fd870097fc0 2021-04-09T18:34:05.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd861ffb700 1 -- 172.21.15.79:0/1591055230 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86800cc50 con 0x7fd870097fc0 2021-04-09T18:34:05.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd87785c700 1 -- 172.21.15.79:0/1591055230 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8701adf60 con 0x7fd870097fc0 2021-04-09T18:34:05.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd861ffb700 1 -- 172.21.15.79:0/1591055230 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd86800f040 con 0x7fd870097fc0 2021-04-09T18:34:05.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.612 7fd87785c700 1 -- 172.21.15.79:0/1591055230 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd870098a40 con 0x7fd870097fc0 2021-04-09T18:34:05.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.616 7fd861ffb700 1 -- 172.21.15.79:0/1591055230 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd868022060 con 0x7fd870097fc0 2021-04-09T18:34:05.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.616 7fd861ffb700 1 --2- 172.21.15.79:0/1591055230 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd850029100 0x7fd85002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:05.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.616 7fd861ffb700 1 -- 172.21.15.79:0/1591055230 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5190+0+0 (secure 0 0 0) 0x7fd868010040 con 0x7fd870097fc0 2021-04-09T18:34:05.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.616 7fd875600700 1 --2- 172.21.15.79:0/1591055230 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd850029100 0x7fd85002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:05.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.616 7fd875600700 1 --2- 172.21.15.79:0/1591055230 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd850029100 0x7fd85002b650 crc :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:05.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.620 7fd87785c700 1 -- 172.21.15.79:0/1591055230 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8700e39d0 con 0x7fd870097fc0 2021-04-09T18:34:05.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.628 7fd861ffb700 1 -- 172.21.15.79:0/1591055230 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd86800ca40 con 0x7fd870097fc0 2021-04-09T18:34:05.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.800 7fd87785c700 1 -- 172.21.15.79:0/1591055230 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8700a1cb0 con 0x7fd870097fc0 2021-04-09T18:34:05.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.800 7fd861ffb700 1 -- 172.21.15.79:0/1591055230 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+1177 (secure 0 0 0) 0x7fd8700f76b0 con 0x7fd870097fc0 2021-04-09T18:34:05.808 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:05.808 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/2412239832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2412239832},{"type":"v1","addr":"172.21.15.89:6835","nonce":2412239832}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":57},{"gid":6831,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3171732398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3171732398},{"type":"v1","addr":"172.21.15.79:6833","nonce":3171732398}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":51}],"filesystems":[]} 2021-04-09T18:34:05.809 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 57 2021-04-09T18:34:05.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.804 7fd87785c700 1 -- 172.21.15.79:0/1591055230 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd850029100 msgr2=0x7fd85002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:05.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.804 7fd87785c700 1 --2- 172.21.15.79:0/1591055230 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd850029100 0x7fd85002b650 crc :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.804 7fd87785c700 1 -- 172.21.15.79:0/1591055230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd870097fc0 msgr2=0x7fd870098410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:05.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.804 7fd87785c700 1 --2- 172.21.15.79:0/1591055230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd870097fc0 0x7fd870098410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fd8700d81d0 tx=0x7fd86800c430).stop 2021-04-09T18:34:05.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.804 7fd87785c700 1 -- 172.21.15.79:0/1591055230 shutdown_connections 2021-04-09T18:34:05.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.804 7fd87785c700 1 --2- 172.21.15.79:0/1591055230 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd850029100 0x7fd85002b650 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.804 7fd87785c700 1 --2- 172.21.15.79:0/1591055230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd870097fc0 0x7fd870098410 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.804 7fd87785c700 1 --2- 172.21.15.79:0/1591055230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8700d6090 0x7fd8701ad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.804 7fd87785c700 1 --2- 172.21.15.79:0/1591055230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8700d64e0 0x7fd8701ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.804 7fd87785c700 1 -- 172.21.15.79:0/1591055230 >> 172.21.15.79:0/1591055230 conn(0x7fd870098fe0 msgr2=0x7fd87009a270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:05.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.808 7fd87785c700 1 -- 172.21.15.79:0/1591055230 shutdown_connections 2021-04-09T18:34:05.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.808 7fd87785c700 1 -- 172.21.15.79:0/1591055230 wait complete. 2021-04-09T18:34:05.822 INFO:tasks.ceph.mds.a:Restarting daemon 2021-04-09T18:34:05.822 INFO:tasks.ceph.mds.a:Stopping old one... 2021-04-09T18:34:05.823 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-04-09T18:34:05.823 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:34:05.824 INFO:tasks.ceph.mds.b:Restarting daemon 2021-04-09T18:34:05.824 INFO:tasks.ceph.mds.b:Stopping old one... 2021-04-09T18:34:05.824 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-04-09T18:34:05.825 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:34:05.837 INFO:tasks.ceph.mds.a:Stopped 2021-04-09T18:34:05.837 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-04-09T18:34:05.839 INFO:tasks.ceph.mds.b:Stopped 2021-04-09T18:34:05.839 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-04-09T18:34:05.881 INFO:tasks.ceph.mds.a:Started 2021-04-09T18:34:05.881 DEBUG:teuthology.parallel:result is None 2021-04-09T18:34:05.885 INFO:tasks.ceph.mds.b:Started 2021-04-09T18:34:05.885 DEBUG:teuthology.parallel:result is None 2021-04-09T18:34:05.886 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-04-09T18:34:05.957 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2021-04-09T18:34:05.959 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2021-04-09T18:34:05.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbda815700 1 Processor -- start 2021-04-09T18:34:05.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbda815700 1 -- start start 2021-04-09T18:34:05.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbda815700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffbd40f5520 0x7ffbd40f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:05.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbda815700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd40e9ae0 0x7ffbd409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:05.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbda815700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd40fbb20 con 0x7ffbd41c2db0 2021-04-09T18:34:05.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbda815700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd40e9f30 con 0x7ffbd40f5520 2021-04-09T18:34:05.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbda815700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40e59d0 con 0x7ffbd40e9ae0 2021-04-09T18:34:05.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbd3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffbd40f5520 0x7ffbd40f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:05.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbd8dba700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ffbd41c2db0 0x7ffbd41c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56220/0 (socket says 172.21.15.79:56220) 2021-04-09T18:34:05.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbd8dba700 1 -- 172.21.15.79:0/794194924 learned_addr learned my addr 172.21.15.79:0/794194924 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:05.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbd3fff700 1 --2- 172.21.15.79:0/794194924 >> v2:172.21.15.79:3300/0 conn(0x7ffbd40f5520 0x7ffbd40f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33278/0 (socket says 172.21.15.79:33278) 2021-04-09T18:34:05.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbd37fe700 1 --2- 172.21.15.79:0/794194924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd40e9ae0 0x7ffbd409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:05.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbd3fff700 1 -- 172.21.15.79:0/794194924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd40e9ae0 msgr2=0x7ffbd409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:05.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbd3fff700 1 --2- 172.21.15.79:0/794194924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd40e9ae0 0x7ffbd409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbd3fff700 1 -- 172.21.15.79:0/794194924 >> v1:172.21.15.79:6789/0 conn(0x7ffbd41c2db0 legacy=0x7ffbd41c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:05.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbd2ffd700 1 -- 172.21.15.79:0/794194924 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555053869 0 0) 0x7ffbc40010d0 con 0x7ffbd41c2db0 2021-04-09T18:34:05.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbd3fff700 1 -- 172.21.15.79:0/794194924 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd40e56d0 con 0x7ffbd40f5520 2021-04-09T18:34:05.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbd37fe700 1 --2- 172.21.15.79:0/794194924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd40e9ae0 0x7ffbd409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:05.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbd3fff700 1 --2- 172.21.15.79:0/794194924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbd40f5520 0x7ffbd40f64b0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7ffbcc0032b0 tx=0x7ffbcc00b3c0).ready entity=mon.0 client_cookie=7520b24696af5c44 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:05.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbd2ffd700 1 -- 172.21.15.79:0/794194924 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffbd40e56d0 con 0x7ffbd40f5520 2021-04-09T18:34:05.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbd2ffd700 1 -- 172.21.15.79:0/794194924 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc00bc20 con 0x7ffbd40f5520 2021-04-09T18:34:05.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbd2ffd700 1 -- 172.21.15.79:0/794194924 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffbcc002020 con 0x7ffbd40f5520 2021-04-09T18:34:05.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbda815700 1 -- 172.21.15.79:0/794194924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbd40f5520 msgr2=0x7ffbd40f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:05.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.968 7ffbda815700 1 --2- 172.21.15.79:0/794194924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbd40f5520 0x7ffbd40f64b0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7ffbcc0032b0 tx=0x7ffbcc00b3c0).stop 2021-04-09T18:34:05.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.972 7ffbda815700 1 -- 172.21.15.79:0/794194924 shutdown_connections 2021-04-09T18:34:05.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.972 7ffbda815700 1 --2- 172.21.15.79:0/794194924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbd40f5520 0x7ffbd40f64b0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.972 7ffbda815700 1 --2- 172.21.15.79:0/794194924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd40e9ae0 0x7ffbd409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:05.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.972 7ffbda815700 1 -- 172.21.15.79:0/794194924 >> 172.21.15.79:0/794194924 conn(0x7ffbd40e5fe0 msgr2=0x7ffbd40e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:05.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.972 7ffbda815700 1 -- 172.21.15.79:0/794194924 shutdown_connections 2021-04-09T18:34:05.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.972 7ffbda815700 1 -- 172.21.15.79:0/794194924 wait complete. 2021-04-09T18:34:05.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.972 7ffbda815700 1 Processor -- start 2021-04-09T18:34:05.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.972 7ffbda815700 1 -- start start 2021-04-09T18:34:05.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.972 7ffbda815700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbd40d6b30 0x7ffbd4094350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:05.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.972 7ffbda815700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd408f170 0x7ffbd40d6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:05.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.972 7ffbda815700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbd40d6630 0x7ffbd40ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:05.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.972 7ffbda815700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40d5d00 con 0x7ffbd40d6630 2021-04-09T18:34:05.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.972 7ffbda815700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40d5890 con 0x7ffbd40d6b30 2021-04-09T18:34:06.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.972 7ffbda815700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd4094980 con 0x7ffbd408f170 2021-04-09T18:34:06.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbd8dba700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbd40d6630 0x7ffbd40ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbd8dba700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbd40d6630 0x7ffbd40ce8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33286/0 (socket says 172.21.15.79:33286) 2021-04-09T18:34:06.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbd8dba700 1 -- 172.21.15.79:0/1691128276 learned_addr learned my addr 172.21.15.79:0/1691128276 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:06.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbd3fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbd40d6b30 0x7ffbd4094350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbd37fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd408f170 0x7ffbd40d6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbd8dba700 1 -- 172.21.15.79:0/1691128276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd408f170 msgr2=0x7ffbd40d6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbd8dba700 1 --2- 172.21.15.79:0/1691128276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd408f170 0x7ffbd40d6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbd8dba700 1 -- 172.21.15.79:0/1691128276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbd40d6b30 msgr2=0x7ffbd4094350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbd8dba700 1 --2- 172.21.15.79:0/1691128276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbd40d6b30 0x7ffbd4094350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbd8dba700 1 -- 172.21.15.79:0/1691128276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd40cef20 con 0x7ffbd40d6630 2021-04-09T18:34:06.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbd8dba700 1 --2- 172.21.15.79:0/1691128276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbd40d6630 0x7ffbd40ce8f0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7ffbc4000b80 tx=0x7ffbc400cb00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:06.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbd0ff9700 1 -- 172.21.15.79:0/1691128276 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffbd40cef20 con 0x7ffbd40d6630 2021-04-09T18:34:06.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbd0ff9700 1 -- 172.21.15.79:0/1691128276 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc4007320 con 0x7ffbd40d6630 2021-04-09T18:34:06.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbda815700 1 -- 172.21.15.79:0/1691128276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd40cf240 con 0x7ffbd40d6630 2021-04-09T18:34:06.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbd0ff9700 1 -- 172.21.15.79:0/1691128276 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffbc40057e0 con 0x7ffbd40d6630 2021-04-09T18:34:06.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbda815700 1 -- 172.21.15.79:0/1691128276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd408f7b0 con 0x7ffbd40d6630 2021-04-09T18:34:06.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbd0ff9700 1 -- 172.21.15.79:0/1691128276 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ffbc401a020 con 0x7ffbd40d6630 2021-04-09T18:34:06.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbd0ff9700 1 --2- 172.21.15.79:0/1691128276 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffbac029100 0x7ffbac02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:06.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbd0ff9700 1 -- 172.21.15.79:0/1691128276 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5190+0+0 (secure 0 0 0) 0x7ffbc4038e90 con 0x7ffbd40d6630 2021-04-09T18:34:06.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbd3fff700 1 --2- 172.21.15.79:0/1691128276 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffbac029100 0x7ffbac02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.976 7ffbd3fff700 1 --2- 172.21.15.79:0/1691128276 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffbac029100 0x7ffbac02b650 crc :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:06.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.984 7ffbda815700 1 -- 172.21.15.79:0/1691128276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd40e39e0 con 0x7ffbd40d6630 2021-04-09T18:34:06.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:05.988 7ffbd0ff9700 1 -- 172.21.15.79:0/1691128276 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ffbc4007110 con 0x7ffbd40d6630 2021-04-09T18:34:06.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.160 7ffbda815700 1 -- 172.21.15.79:0/1691128276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7ffbd40f5b20 con 0x7ffbd40d6630 2021-04-09T18:34:06.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.188 7ffbd0ff9700 1 -- 172.21.15.79:0/1691128276 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v93) v1 ==== 97+0+0 (secure 0 0 0) 0x7ffbd40f76c0 con 0x7ffbd40d6630 2021-04-09T18:34:06.200 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blacklist entries 2021-04-09T18:34:06.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.196 7ffbda815700 1 -- 172.21.15.79:0/1691128276 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffbac029100 msgr2=0x7ffbac02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.196 7ffbda815700 1 --2- 172.21.15.79:0/1691128276 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffbac029100 0x7ffbac02b650 crc :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.196 7ffbda815700 1 -- 172.21.15.79:0/1691128276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbd40d6630 msgr2=0x7ffbd40ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.196 7ffbda815700 1 --2- 172.21.15.79:0/1691128276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbd40d6630 0x7ffbd40ce8f0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7ffbc4000b80 tx=0x7ffbc400cb00).stop 2021-04-09T18:34:06.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.196 7ffbda815700 1 -- 172.21.15.79:0/1691128276 shutdown_connections 2021-04-09T18:34:06.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.196 7ffbda815700 1 --2- 172.21.15.79:0/1691128276 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffbac029100 0x7ffbac02b650 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.196 7ffbda815700 1 --2- 172.21.15.79:0/1691128276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbd40d6b30 0x7ffbd4094350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.196 7ffbda815700 1 --2- 172.21.15.79:0/1691128276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbd40d6630 0x7ffbd40ce8f0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.196 7ffbda815700 1 --2- 172.21.15.79:0/1691128276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd408f170 0x7ffbd40d6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.196 7ffbda815700 1 -- 172.21.15.79:0/1691128276 >> 172.21.15.79:0/1691128276 conn(0x7ffbd40937b0 msgr2=0x7ffbd40d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:06.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.196 7ffbda815700 1 -- 172.21.15.79:0/1691128276 shutdown_connections 2021-04-09T18:34:06.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.196 7ffbda815700 1 -- 172.21.15.79:0/1691128276 wait complete. 2021-04-09T18:34:06.214 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-04-09T18:34:06.215 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-04-09T18:34:06.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e9cf3e700 1 Processor -- start 2021-04-09T18:34:06.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e9cf3e700 1 -- start start 2021-04-09T18:34:06.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e9cf3e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e980f5520 0x7f8e980f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:06.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e9cf3e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8e981c8010 0x7f8e981ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:06.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e9cf3e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e980fbb20 con 0x7f8e980e9ae0 2021-04-09T18:34:06.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e9cf3e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e980e9f30 con 0x7f8e981c8010 2021-04-09T18:34:06.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e9cf3e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e981c3dc0 con 0x7f8e980f5520 2021-04-09T18:34:06.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e962ee700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8e980e9ae0 0x7f8e9809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56232/0 (socket says 172.21.15.79:56232) 2021-04-09T18:34:06.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e962ee700 1 -- 172.21.15.79:0/2359770018 learned_addr learned my addr 172.21.15.79:0/2359770018 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:06.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e96aef700 1 --2- 172.21.15.79:0/2359770018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e980f5520 0x7f8e980f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e972f0700 1 --2- 172.21.15.79:0/2359770018 >> v2:172.21.15.89:3300/0 conn(0x7f8e981c8010 0x7f8e981ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e95aed700 1 -- 172.21.15.79:0/2359770018 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877472914 0 0) 0x7f8e880010d0 con 0x7f8e980e9ae0 2021-04-09T18:34:06.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e95aed700 1 -- 172.21.15.79:0/2359770018 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e84003240 con 0x7f8e980e9ae0 2021-04-09T18:34:06.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e96aef700 1 -- 172.21.15.79:0/2359770018 >> v2:172.21.15.89:3300/0 conn(0x7f8e981c8010 msgr2=0x7f8e981ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:06.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e96aef700 1 --2- 172.21.15.79:0/2359770018 >> v2:172.21.15.89:3300/0 conn(0x7f8e981c8010 0x7f8e981ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e96aef700 1 -- 172.21.15.79:0/2359770018 >> v1:172.21.15.79:6789/0 conn(0x7f8e980e9ae0 legacy=0x7f8e9809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e96aef700 1 -- 172.21.15.79:0/2359770018 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9809f910 con 0x7f8e980f5520 2021-04-09T18:34:06.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e96aef700 1 --2- 172.21.15.79:0/2359770018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e980f5520 0x7f8e980f64b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f8e80002f30 tx=0x7f8e8000bcc0).ready entity=mon.2 client_cookie=474997d743fdd00 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:06.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e95aed700 1 -- 172.21.15.79:0/2359770018 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e9809f910 con 0x7f8e980f5520 2021-04-09T18:34:06.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e95aed700 1 -- 172.21.15.79:0/2359770018 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e80009800 con 0x7f8e980f5520 2021-04-09T18:34:06.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e95aed700 1 -- 172.21.15.79:0/2359770018 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e80009bd0 con 0x7f8e980f5520 2021-04-09T18:34:06.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e9cf3e700 1 -- 172.21.15.79:0/2359770018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e980f5520 msgr2=0x7f8e980f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.312 7f8e9cf3e700 1 --2- 172.21.15.79:0/2359770018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e980f5520 0x7f8e980f64b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f8e80002f30 tx=0x7f8e8000bcc0).stop 2021-04-09T18:34:06.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.316 7f8e9cf3e700 1 -- 172.21.15.79:0/2359770018 shutdown_connections 2021-04-09T18:34:06.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.316 7f8e9cf3e700 1 --2- 172.21.15.79:0/2359770018 >> v2:172.21.15.89:3300/0 conn(0x7f8e981c8010 0x7f8e981ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.316 7f8e9cf3e700 1 --2- 172.21.15.79:0/2359770018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e980f5520 0x7f8e980f64b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.316 7f8e9cf3e700 1 -- 172.21.15.79:0/2359770018 >> 172.21.15.79:0/2359770018 conn(0x7f8e980e5fe0 msgr2=0x7f8e980e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:06.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.316 7f8e9cf3e700 1 -- 172.21.15.79:0/2359770018 shutdown_connections 2021-04-09T18:34:06.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.316 7f8e9cf3e700 1 -- 172.21.15.79:0/2359770018 wait complete. 2021-04-09T18:34:06.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.316 7f8e9cf3e700 1 Processor -- start 2021-04-09T18:34:06.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e9cf3e700 1 -- start start 2021-04-09T18:34:06.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e9cf3e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e980bd8d0 0x7f8e981a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:06.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e9cf3e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e9808fcc0 0x7f8e980d1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:06.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e9cf3e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e98090110 0x7f8e980ba3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:06.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e9cf3e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980b85b0 con 0x7f8e980bd8d0 2021-04-09T18:34:06.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e9cf3e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980b8bb0 con 0x7f8e9808fcc0 2021-04-09T18:34:06.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e9cf3e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980b88b0 con 0x7f8e98090110 2021-04-09T18:34:06.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e96aef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e980bd8d0 0x7f8e981a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e96aef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e980bd8d0 0x7f8e981a4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33296/0 (socket says 172.21.15.79:33296) 2021-04-09T18:34:06.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e96aef700 1 -- 172.21.15.79:0/1004661791 learned_addr learned my addr 172.21.15.79:0/1004661791 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:06.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e962ee700 1 --2- 172.21.15.79:0/1004661791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e9808fcc0 0x7f8e980d1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e972f0700 1 --2- 172.21.15.79:0/1004661791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e98090110 0x7f8e980ba3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e96aef700 1 -- 172.21.15.79:0/1004661791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e98090110 msgr2=0x7f8e980ba3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e96aef700 1 --2- 172.21.15.79:0/1004661791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e98090110 0x7f8e980ba3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e96aef700 1 -- 172.21.15.79:0/1004661791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e9808fcc0 msgr2=0x7f8e980d1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e96aef700 1 --2- 172.21.15.79:0/1004661791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e9808fcc0 0x7f8e980d1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e96aef700 1 -- 172.21.15.79:0/1004661791 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e981a55a0 con 0x7f8e980bd8d0 2021-04-09T18:34:06.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e962ee700 1 --2- 172.21.15.79:0/1004661791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e9808fcc0 0x7f8e980d1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:06.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e96aef700 1 --2- 172.21.15.79:0/1004661791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e980bd8d0 0x7f8e981a4f70 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f8e9808e8a0 tx=0x7f8e80006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:06.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e8f7fe700 1 -- 172.21.15.79:0/1004661791 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e981a55a0 con 0x7f8e980bd8d0 2021-04-09T18:34:06.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e8f7fe700 1 -- 172.21.15.79:0/1004661791 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e80011990 con 0x7f8e980bd8d0 2021-04-09T18:34:06.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e9cf3e700 1 -- 172.21.15.79:0/1004661791 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e980d2580 con 0x7f8e980bd8d0 2021-04-09T18:34:06.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e8f7fe700 1 -- 172.21.15.79:0/1004661791 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e80011d60 con 0x7f8e980bd8d0 2021-04-09T18:34:06.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.320 7f8e9cf3e700 1 -- 172.21.15.79:0/1004661791 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e980baa10 con 0x7f8e980bd8d0 2021-04-09T18:34:06.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.324 7f8e8f7fe700 1 -- 172.21.15.79:0/1004661791 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8e8001c3e0 con 0x7f8e980bd8d0 2021-04-09T18:34:06.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.324 7f8e8f7fe700 1 --2- 172.21.15.79:0/1004661791 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8e7c029100 0x7f8e7c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:06.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.324 7f8e8f7fe700 1 -- 172.21.15.79:0/1004661791 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f8e8003a8e0 con 0x7f8e980bd8d0 2021-04-09T18:34:06.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.324 7f8e962ee700 1 --2- 172.21.15.79:0/1004661791 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8e7c029100 0x7f8e7c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.324 7f8e962ee700 1 --2- 172.21.15.79:0/1004661791 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8e7c029100 0x7f8e7c02b650 crc :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:06.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.324 7f8e9cf3e700 1 -- 172.21.15.79:0/1004661791 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e980e39e0 con 0x7f8e980bd8d0 2021-04-09T18:34:06.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.332 7f8e8f7fe700 1 -- 172.21.15.79:0/1004661791 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8e80011780 con 0x7f8e980bd8d0 2021-04-09T18:34:06.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.500 7f8e9cf3e700 1 -- 172.21.15.79:0/1004661791 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8e980f5b20 con 0x7f8e980bd8d0 2021-04-09T18:34:06.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.500 7f8e8f7fe700 1 -- 172.21.15.79:0/1004661791 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v29) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f8e800095f0 con 0x7f8e980bd8d0 2021-04-09T18:34:06.508 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:06.509 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:34:06.509 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2021-04-09T18:34:06.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:06.511 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2021-04-09T18:34:06.511 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgovEoMhAAbDfArG3lSFAdk80rS/4iEQ==", 2021-04-09T18:34:06.512 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:06.512 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:34:06.513 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:06.513 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:06.513 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:06.513 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:06.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:06.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:06.514 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2021-04-09T18:34:06.514 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgN4sfOBAAPjvDX11uLM+vgdFpdP49Kw==", 2021-04-09T18:34:06.514 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:06.515 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:34:06.515 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:06.515 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:06.516 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:06.516 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:06.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:06.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:06.517 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2021-04-09T18:34:06.517 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQALnHBgro0COxAAgbe5jxAZH9bD7zDLbtdkhQ==", 2021-04-09T18:34:06.517 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:06.517 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:06.518 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:06.518 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:06.518 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:06.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:06.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:06.519 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2021-04-09T18:34:06.519 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAPnHBghZ/oARAAhkN+fnZJiskmHnvvs+G8NA==", 2021-04-09T18:34:06.519 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:06.520 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:06.520 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:06.520 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:06.521 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:06.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:06.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:06.522 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2021-04-09T18:34:06.522 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQASnHBgWT2FBxAACrSTbwbF18k9aPeYNohelw==", 2021-04-09T18:34:06.522 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:06.523 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:06.523 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:06.524 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:06.524 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:06.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:06.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:06.525 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2021-04-09T18:34:06.525 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAVnHBgPHy6CxAAFq+yki4AZe5ybodgTO/4/Q==", 2021-04-09T18:34:06.526 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:06.526 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:06.526 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:06.527 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:06.527 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:06.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:06.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:06.528 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2021-04-09T18:34:06.529 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAanHBgfbs4NhAAQzxM9dDML4RgQP8yamkuVw==", 2021-04-09T18:34:06.529 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:06.529 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:06.530 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:06.530 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:06.531 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:06.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:06.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:06.532 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2021-04-09T18:34:06.532 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAdnHBgi0WLOhAA4OBguOCjtmzqulUjTJ+GhQ==", 2021-04-09T18:34:06.533 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:06.533 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:06.533 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:06.534 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:06.534 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:06.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:06.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:06.535 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2021-04-09T18:34:06.535 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAhnHBgCs+PAxAAOm0wSMe/1Bu9vfTrpmrLkg==", 2021-04-09T18:34:06.536 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:06.536 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:06.536 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:06.537 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:06.537 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:06.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:06.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:06.538 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2021-04-09T18:34:06.538 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAknHBgH1S3CBAAUcdUIW7O6wH482l1yZBKBw==", 2021-04-09T18:34:06.538 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:06.538 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:06.538 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:06.539 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:06.539 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:06.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:06.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:06.540 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2021-04-09T18:34:06.540 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgxEq9BxAAap2nrjhcrf2aHzygtMclVw==", 2021-04-09T18:34:06.540 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:06.540 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:34:06.540 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:34:06.541 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:34:06.541 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:06.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:06.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:06.542 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2021-04-09T18:34:06.542 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBguJFeDRAAWL4NV4tsYRAqcwJ26kjm2Q==", 2021-04-09T18:34:06.542 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:06.542 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:34:06.542 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:34:06.543 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:34:06.543 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:06.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:06.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:06.543 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2021-04-09T18:34:06.544 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgN9X5EhAA3DBPdlRHVBHXJNH9nRFW0A==", 2021-04-09T18:34:06.544 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:06.544 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:34:06.544 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:34:06.545 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:34:06.545 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:06.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:06.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:06.546 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2021-04-09T18:34:06.546 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgHOSVDBAAMMqd8paqBSTQRgR7n4EXGQ==", 2021-04-09T18:34:06.546 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:06.546 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:34:06.546 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:06.547 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:06.547 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:06.547 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:06.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:06.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:06.548 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2021-04-09T18:34:06.548 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgmHJhLxAAyhBrx08J7ZFKu34MYC2Wyg==", 2021-04-09T18:34:06.548 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:06.548 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:34:06.549 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:34:06.549 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:06.549 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:06.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:06.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:06.550 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2021-04-09T18:34:06.550 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgNCCXKhAA/bKOzzjVHldj6RpMGu0c8g==", 2021-04-09T18:34:06.550 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:06.550 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:34:06.551 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:34:06.551 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:06.551 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:06.551 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:06.552 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:06.552 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:34:06.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.504 7f8e9cf3e700 1 -- 172.21.15.79:0/1004661791 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8e7c029100 msgr2=0x7f8e7c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.504 7f8e9cf3e700 1 --2- 172.21.15.79:0/1004661791 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8e7c029100 0x7f8e7c02b650 crc :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.504 7f8e9cf3e700 1 -- 172.21.15.79:0/1004661791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e980bd8d0 msgr2=0x7f8e981a4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.504 7f8e9cf3e700 1 --2- 172.21.15.79:0/1004661791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e980bd8d0 0x7f8e981a4f70 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f8e9808e8a0 tx=0x7f8e80006890).stop 2021-04-09T18:34:06.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.504 7f8e9cf3e700 1 -- 172.21.15.79:0/1004661791 shutdown_connections 2021-04-09T18:34:06.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.504 7f8e9cf3e700 1 --2- 172.21.15.79:0/1004661791 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8e7c029100 0x7f8e7c02b650 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.504 7f8e9cf3e700 1 --2- 172.21.15.79:0/1004661791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e98090110 0x7f8e980ba3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.504 7f8e9cf3e700 1 --2- 172.21.15.79:0/1004661791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e980bd8d0 0x7f8e981a4f70 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.504 7f8e9cf3e700 1 --2- 172.21.15.79:0/1004661791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e9808fcc0 0x7f8e980d1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.504 7f8e9cf3e700 1 -- 172.21.15.79:0/1004661791 >> 172.21.15.79:0/1004661791 conn(0x7f8e980d5880 msgr2=0x7f8e980bddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:06.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.504 7f8e9cf3e700 1 -- 172.21.15.79:0/1004661791 shutdown_connections 2021-04-09T18:34:06.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.504 7f8e9cf3e700 1 -- 172.21.15.79:0/1004661791 wait complete. 2021-04-09T18:34:06.558 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:34:06.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.648 7fadc5052700 1 Processor -- start 2021-04-09T18:34:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.648 7fadc5052700 1 -- start start 2021-04-09T18:34:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.648 7fadc5052700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadc00e9ad0 0x7fadc009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.648 7fadc5052700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc00fbb10 con 0x7fadc00f5510 2021-04-09T18:34:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.648 7fadc5052700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc00e56c0 con 0x7fadc01c8000 2021-04-09T18:34:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.648 7fadc5052700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc01c3db0 con 0x7fadc00e9ad0 2021-04-09T18:34:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.648 7fadbed9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fadc00f5510 0x7fadc00f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56246/0 (socket says 172.21.15.79:56246) 2021-04-09T18:34:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.648 7fadbed9d700 1 -- 172.21.15.79:0/3001220031 learned_addr learned my addr 172.21.15.79:0/3001220031 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.648 7fadbe59c700 1 --2- 172.21.15.79:0/3001220031 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadc00e9ad0 0x7fadc009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.648 7fadbdd9b700 1 -- 172.21.15.79:0/3001220031 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951529173 0 0) 0x7fadb00010d0 con 0x7fadc00f5510 2021-04-09T18:34:06.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.648 7fadbdd9b700 1 -- 172.21.15.79:0/3001220031 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fada8003240 con 0x7fadc00f5510 2021-04-09T18:34:06.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.648 7fadbdd9b700 1 -- 172.21.15.79:0/3001220031 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362205526 0 0) 0x7fadb8001450 con 0x7fadc01c8000 2021-04-09T18:34:06.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.648 7fadbdd9b700 1 -- 172.21.15.79:0/3001220031 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fada8003620 con 0x7fadc01c8000 2021-04-09T18:34:06.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbdd9b700 1 -- 172.21.15.79:0/3001220031 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 370630832 0 0) 0x7fadb0001650 con 0x7fadc00f5510 2021-04-09T18:34:06.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbdd9b700 1 -- 172.21.15.79:0/3001220031 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadc00e9ad0 msgr2=0x7fadc009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:06.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbdd9b700 1 --2- 172.21.15.79:0/3001220031 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadc00e9ad0 0x7fadc009f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbdd9b700 1 -- 172.21.15.79:0/3001220031 >> v1:172.21.15.89:6789/0 conn(0x7fadc01c8000 legacy=0x7fadc01ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbdd9b700 1 -- 172.21.15.79:0/3001220031 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc00e4320 con 0x7fadc00f5510 2021-04-09T18:34:06.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbdd9b700 1 -- 172.21.15.79:0/3001220031 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7fadb0001bb0 con 0x7fadc00f5510 2021-04-09T18:34:06.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbdd9b700 1 -- 172.21.15.79:0/3001220031 >> v1:172.21.15.79:6789/0 conn(0x7fadc00f5510 legacy=0x7fadc00f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbdd9b700 1 --2- 172.21.15.79:0/3001220031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada8003d40 0x7fada80045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:06.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbdd9b700 1 --2- 172.21.15.79:0/3001220031 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada8004bd0 0x7fada80097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:06.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbdd9b700 1 --2- 172.21.15.79:0/3001220031 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada8005020 0x7fada800be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:06.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbdd9b700 1 -- 172.21.15.79:0/3001220031 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc01c3db0 con 0x7fada8003d40 2021-04-09T18:34:06.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbdd9b700 1 -- 172.21.15.79:0/3001220031 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada8050460 con 0x7fada8004bd0 2021-04-09T18:34:06.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbdd9b700 1 -- 172.21.15.79:0/3001220031 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada8050610 con 0x7fada8005020 2021-04-09T18:34:06.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbed9d700 1 --2- 172.21.15.79:0/3001220031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada8003d40 0x7fada80045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbe59c700 1 --2- 172.21.15.79:0/3001220031 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada8004bd0 0x7fada80097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbf59e700 1 --2- 172.21.15.79:0/3001220031 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada8005020 0x7fada800be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbed9d700 1 -- 172.21.15.79:0/3001220031 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada8005020 msgr2=0x7fada800be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:06.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbed9d700 1 --2- 172.21.15.79:0/3001220031 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada8005020 0x7fada800be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbed9d700 1 -- 172.21.15.79:0/3001220031 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada8004bd0 msgr2=0x7fada80097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:06.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbed9d700 1 --2- 172.21.15.79:0/3001220031 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada8004bd0 0x7fada80097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbed9d700 1 -- 172.21.15.79:0/3001220031 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada8050880 con 0x7fada8003d40 2021-04-09T18:34:06.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbf59e700 1 --2- 172.21.15.79:0/3001220031 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada8005020 0x7fada800be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:34:06.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbed9d700 1 --2- 172.21.15.79:0/3001220031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada8003d40 0x7fada80045a0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7fadb0001980 tx=0x7fadb000cca0).ready entity=mon.0 client_cookie=2241923474c58577 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:06.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbdd9b700 1 -- 172.21.15.79:0/3001220031 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fada8050880 con 0x7fada8003d40 2021-04-09T18:34:06.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbdd9b700 1 -- 172.21.15.79:0/3001220031 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb0007110 con 0x7fada8003d40 2021-04-09T18:34:06.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbdd9b700 1 -- 172.21.15.79:0/3001220031 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fadc00e4320 con 0x7fada8003d40 2021-04-09T18:34:06.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadc5052700 1 -- 172.21.15.79:0/3001220031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada8003d40 msgr2=0x7fada80045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadc5052700 1 --2- 172.21.15.79:0/3001220031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada8003d40 0x7fada80045a0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7fadb0001980 tx=0x7fadb000cca0).stop 2021-04-09T18:34:06.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadbf59e700 1 -- 172.21.15.79:0/3001220031 reap_dead start 2021-04-09T18:34:06.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadc5052700 1 -- 172.21.15.79:0/3001220031 shutdown_connections 2021-04-09T18:34:06.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadc5052700 1 -- 172.21.15.79:0/3001220031 >> 172.21.15.79:0/3001220031 conn(0x7fadc00e5fd0 msgr2=0x7fadc00e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:06.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadc5052700 1 -- 172.21.15.79:0/3001220031 shutdown_connections 2021-04-09T18:34:06.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.652 7fadc5052700 1 -- 172.21.15.79:0/3001220031 wait complete. 2021-04-09T18:34:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.656 7fadc5052700 1 Processor -- start 2021-04-09T18:34:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.656 7fadc5052700 1 -- start start 2021-04-09T18:34:06.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.656 7fadc5052700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadc01a2100 0x7fadc00ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:06.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.656 7fadc5052700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadc01a2550 0x7fadc00d7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:06.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.656 7fadc5052700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadc00d7cb0 0x7fadc019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:06.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.656 7fadc5052700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00885b0 con 0x7fadc00d7cb0 2021-04-09T18:34:06.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.656 7fadc5052700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00e9f20 con 0x7fadc01a2100 2021-04-09T18:34:06.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.656 7fadc5052700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00ae130 con 0x7fadc01a2550 2021-04-09T18:34:06.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.656 7fadbf59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadc00d7cb0 0x7fadc019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.656 7fadbed9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadc01a2100 0x7fadc00ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.656 7fadbf59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadc00d7cb0 0x7fadc019b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33320/0 (socket says 172.21.15.79:33320) 2021-04-09T18:34:06.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.656 7fadbf59e700 1 -- 172.21.15.79:0/2556115574 learned_addr learned my addr 172.21.15.79:0/2556115574 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:06.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.656 7fadbe59c700 1 --2- 172.21.15.79:0/2556115574 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadc01a2550 0x7fadc00d7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.660 7fadbf59e700 1 -- 172.21.15.79:0/2556115574 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadc01a2550 msgr2=0x7fadc00d7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.660 7fadbf59e700 1 --2- 172.21.15.79:0/2556115574 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadc01a2550 0x7fadc00d7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.660 7fadbf59e700 1 -- 172.21.15.79:0/2556115574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadc01a2100 msgr2=0x7fadc00ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.660 7fadbf59e700 1 --2- 172.21.15.79:0/2556115574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadc01a2100 0x7fadc00ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.660 7fadbf59e700 1 -- 172.21.15.79:0/2556115574 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc00adcc0 con 0x7fadc00d7cb0 2021-04-09T18:34:06.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.660 7fadbed9d700 1 --2- 172.21.15.79:0/2556115574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadc01a2100 0x7fadc00ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:06.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.660 7fadbf59e700 1 --2- 172.21.15.79:0/2556115574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadc00d7cb0 0x7fadc019b9d0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7fadb8001680 tx=0x7fadb800de40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:06.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.660 7fadaf7fe700 1 -- 172.21.15.79:0/2556115574 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fadc00adcc0 con 0x7fadc00d7cb0 2021-04-09T18:34:06.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.660 7fadaf7fe700 1 -- 172.21.15.79:0/2556115574 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb800b650 con 0x7fadc00d7cb0 2021-04-09T18:34:06.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.660 7fadc5052700 1 -- 172.21.15.79:0/2556115574 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc00aea60 con 0x7fadc00d7cb0 2021-04-09T18:34:06.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.660 7fadaf7fe700 1 -- 172.21.15.79:0/2556115574 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fadb800ba20 con 0x7fadc00d7cb0 2021-04-09T18:34:06.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.660 7fadc5052700 1 -- 172.21.15.79:0/2556115574 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc019c000 con 0x7fadc00d7cb0 2021-04-09T18:34:06.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.660 7fadaf7fe700 1 -- 172.21.15.79:0/2556115574 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fadb800bc20 con 0x7fadc00d7cb0 2021-04-09T18:34:06.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.660 7fadaf7fe700 1 --2- 172.21.15.79:0/2556115574 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fada4029100 0x7fada402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:06.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.660 7fadaf7fe700 1 -- 172.21.15.79:0/2556115574 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fadb8038de0 con 0x7fadc00d7cb0 2021-04-09T18:34:06.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.660 7fadbed9d700 1 --2- 172.21.15.79:0/2556115574 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fada4029100 0x7fada402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.660 7fadbed9d700 1 --2- 172.21.15.79:0/2556115574 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fada4029100 0x7fada402b650 crc :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:06.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.660 7fadc5052700 1 -- 172.21.15.79:0/2556115574 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc00e39d0 con 0x7fadc00d7cb0 2021-04-09T18:34:06.706 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.668 7fadaf7fe700 1 -- 172.21.15.79:0/2556115574 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fadb800b440 con 0x7fadc00d7cb0 2021-04-09T18:34:06.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.832 7fadc5052700 1 -- 172.21.15.79:0/2556115574 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadc00f5b10 con 0x7fadc00d7cb0 2021-04-09T18:34:06.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.832 7fadaf7fe700 1 -- 172.21.15.79:0/2556115574 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+11378 (secure 0 0 0) 0x7fadc00f76b0 con 0x7fadc00d7cb0 2021-04-09T18:34:06.839 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:06.839 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":93,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:34:06.182685","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:34:06.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.836 7fadc5052700 1 -- 172.21.15.79:0/2556115574 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fada4029100 msgr2=0x7fada402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.836 7fadc5052700 1 --2- 172.21.15.79:0/2556115574 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fada4029100 0x7fada402b650 crc :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.836 7fadc5052700 1 -- 172.21.15.79:0/2556115574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadc00d7cb0 msgr2=0x7fadc019b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.836 7fadc5052700 1 --2- 172.21.15.79:0/2556115574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadc00d7cb0 0x7fadc019b9d0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7fadb8001680 tx=0x7fadb800de40).stop 2021-04-09T18:34:06.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.836 7fadc5052700 1 -- 172.21.15.79:0/2556115574 shutdown_connections 2021-04-09T18:34:06.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.836 7fadc5052700 1 --2- 172.21.15.79:0/2556115574 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fada4029100 0x7fada402b650 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.836 7fadc5052700 1 --2- 172.21.15.79:0/2556115574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadc01a2100 0x7fadc00ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.836 7fadc5052700 1 --2- 172.21.15.79:0/2556115574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadc00d7cb0 0x7fadc019b9d0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.836 7fadc5052700 1 --2- 172.21.15.79:0/2556115574 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadc01a2550 0x7fadc00d7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.836 7fadc5052700 1 -- 172.21.15.79:0/2556115574 >> 172.21.15.79:0/2556115574 conn(0x7fadc00c34f0 msgr2=0x7fadc00af750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:06.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.836 7fadc5052700 1 -- 172.21.15.79:0/2556115574 shutdown_connections 2021-04-09T18:34:06.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.836 7fadc5052700 1 -- 172.21.15.79:0/2556115574 wait complete. 2021-04-09T18:34:06.852 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-04-09T18:34:06.853 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:34:06.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.952 7fd8e74d2700 1 Processor -- start 2021-04-09T18:34:06.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.952 7fd8e74d2700 1 -- start start 2021-04-09T18:34:06.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e74d2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd8e00f5550 0x7fd8e00f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:06.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e74d2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e00e9b10 0x7fd8e009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:06.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e74d2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e00fbb50 con 0x7fd8e01c2de0 2021-04-09T18:34:06.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e74d2700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e00e9f60 con 0x7fd8e00f5550 2021-04-09T18:34:06.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e74d2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e00e5a00 con 0x7fd8e00e9b10 2021-04-09T18:34:06.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e5276700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd8e00f5550 0x7fd8e00f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e5276700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd8e00f5550 0x7fd8e00f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33326/0 (socket says 172.21.15.79:33326) 2021-04-09T18:34:06.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e5276700 1 -- 172.21.15.79:0/3757309707 learned_addr learned my addr 172.21.15.79:0/3757309707 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:06.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e4a75700 1 --2- 172.21.15.79:0/3757309707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e00e9b10 0x7fd8e009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e5276700 1 -- 172.21.15.79:0/3757309707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e00e9b10 msgr2=0x7fd8e009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:06.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e5276700 1 --2- 172.21.15.79:0/3757309707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e00e9b10 0x7fd8e009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e5276700 1 -- 172.21.15.79:0/3757309707 >> v1:172.21.15.89:6789/0 conn(0x7fd8e01c2de0 legacy=0x7fd8e01c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e5276700 1 -- 172.21.15.79:0/3757309707 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e00e5700 con 0x7fd8e00f5550 2021-04-09T18:34:06.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e4a75700 1 --2- 172.21.15.79:0/3757309707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e00e9b10 0x7fd8e009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:06.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e5276700 1 --2- 172.21.15.79:0/3757309707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8e00f5550 0x7fd8e00f64e0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7fd8d80032b0 tx=0x7fd8d800b3c0).ready entity=mon.0 client_cookie=8d97d8472193364e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:06.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8d7fff700 1 -- 172.21.15.79:0/3757309707 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd8e00e5700 con 0x7fd8e00f5550 2021-04-09T18:34:06.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8d7fff700 1 -- 172.21.15.79:0/3757309707 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d800bc20 con 0x7fd8e00f5550 2021-04-09T18:34:06.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8d7fff700 1 -- 172.21.15.79:0/3757309707 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd8d8002020 con 0x7fd8e00f5550 2021-04-09T18:34:06.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e74d2700 1 -- 172.21.15.79:0/3757309707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8e00f5550 msgr2=0x7fd8e00f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e74d2700 1 --2- 172.21.15.79:0/3757309707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8e00f5550 0x7fd8e00f64e0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7fd8d80032b0 tx=0x7fd8d800b3c0).stop 2021-04-09T18:34:06.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e74d2700 1 -- 172.21.15.79:0/3757309707 shutdown_connections 2021-04-09T18:34:06.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e74d2700 1 --2- 172.21.15.79:0/3757309707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8e00f5550 0x7fd8e00f64e0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e74d2700 1 --2- 172.21.15.79:0/3757309707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e00e9b10 0x7fd8e009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e74d2700 1 -- 172.21.15.79:0/3757309707 >> 172.21.15.79:0/3757309707 conn(0x7fd8e00e6010 msgr2=0x7fd8e00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:06.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e74d2700 1 -- 172.21.15.79:0/3757309707 shutdown_connections 2021-04-09T18:34:06.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.956 7fd8e74d2700 1 -- 172.21.15.79:0/3757309707 wait complete. 2021-04-09T18:34:06.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.960 7fd8e74d2700 1 Processor -- start 2021-04-09T18:34:06.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.960 7fd8e74d2700 1 -- start start 2021-04-09T18:34:06.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.960 7fd8e74d2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8e00ba2c0 0x7fd8e01a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:06.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.960 7fd8e74d2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e008e7f0 0x7fd8e008f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:06.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.960 7fd8e74d2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8e008ec40 0x7fd8e00d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:06.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.960 7fd8e74d2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e0097bd0 con 0x7fd8e00ba2c0 2021-04-09T18:34:06.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.960 7fd8e74d2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e0097ed0 con 0x7fd8e008ec40 2021-04-09T18:34:06.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.960 7fd8e74d2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e008f760 con 0x7fd8e008e7f0 2021-04-09T18:34:06.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.960 7fd8e5276700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8e00ba2c0 0x7fd8e01a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.960 7fd8e5276700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8e00ba2c0 0x7fd8e01a7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33330/0 (socket says 172.21.15.79:33330) 2021-04-09T18:34:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.960 7fd8e5276700 1 -- 172.21.15.79:0/3669638134 learned_addr learned my addr 172.21.15.79:0/3669638134 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.960 7fd8e5a77700 1 --2- 172.21.15.79:0/3669638134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8e008ec40 0x7fd8e00d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.964 7fd8e4a75700 1 --2- 172.21.15.79:0/3669638134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e008e7f0 0x7fd8e008f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.964 7fd8e5276700 1 -- 172.21.15.79:0/3669638134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e008e7f0 msgr2=0x7fd8e008f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.964 7fd8e5276700 1 --2- 172.21.15.79:0/3669638134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e008e7f0 0x7fd8e008f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.964 7fd8e5276700 1 -- 172.21.15.79:0/3669638134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8e008ec40 msgr2=0x7fd8e00d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:06.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.964 7fd8e5276700 1 --2- 172.21.15.79:0/3669638134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8e008ec40 0x7fd8e00d0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:06.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.964 7fd8e5276700 1 -- 172.21.15.79:0/3669638134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e00d1540 con 0x7fd8e00ba2c0 2021-04-09T18:34:06.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.964 7fd8e4a75700 1 --2- 172.21.15.79:0/3669638134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e008e7f0 0x7fd8e008f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:06.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.964 7fd8e5276700 1 --2- 172.21.15.79:0/3669638134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8e00ba2c0 0x7fd8e01a7e30 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7fd8e00d3fe0 tx=0x7fd8d8006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:06.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.964 7fd8d5ffb700 1 -- 172.21.15.79:0/3669638134 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd8e00d1540 con 0x7fd8e00ba2c0 2021-04-09T18:34:06.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.964 7fd8d5ffb700 1 -- 172.21.15.79:0/3669638134 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d801b670 con 0x7fd8e00ba2c0 2021-04-09T18:34:06.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.964 7fd8e74d2700 1 -- 172.21.15.79:0/3669638134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e00d1800 con 0x7fd8e00ba2c0 2021-04-09T18:34:06.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.964 7fd8d5ffb700 1 -- 172.21.15.79:0/3669638134 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd8d8020020 con 0x7fd8e00ba2c0 2021-04-09T18:34:07.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.964 7fd8e74d2700 1 -- 172.21.15.79:0/3669638134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e0099600 con 0x7fd8e00ba2c0 2021-04-09T18:34:07.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.964 7fd8d5ffb700 1 -- 172.21.15.79:0/3669638134 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd8d8019040 con 0x7fd8e00ba2c0 2021-04-09T18:34:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.964 7fd8d5ffb700 1 --2- 172.21.15.79:0/3669638134 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd8c0029100 0x7fd8c002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.964 7fd8d5ffb700 1 -- 172.21.15.79:0/3669638134 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fd8d8003020 con 0x7fd8e00ba2c0 2021-04-09T18:34:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.964 7fd8e4a75700 1 --2- 172.21.15.79:0/3669638134 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd8c0029100 0x7fd8c002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.968 7fd8e4a75700 1 --2- 172.21.15.79:0/3669638134 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd8c0029100 0x7fd8c002b650 crc :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:07.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.968 7fd8e74d2700 1 -- 172.21.15.79:0/3669638134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e00e39f0 con 0x7fd8e00ba2c0 2021-04-09T18:34:07.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:06.972 7fd8d5ffb700 1 -- 172.21.15.79:0/3669638134 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd8d800ba10 con 0x7fd8e00ba2c0 2021-04-09T18:34:07.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.128 7fd8e74d2700 1 -- 172.21.15.79:0/3669638134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fd8e00f5b50 con 0x7fd8e00ba2c0 2021-04-09T18:34:07.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.128 7fd8d5ffb700 1 -- 172.21.15.79:0/3669638134 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v93) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd8d801b460 con 0x7fd8e00ba2c0 2021-04-09T18:34:07.134 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:34:07.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.128 7fd8e74d2700 1 -- 172.21.15.79:0/3669638134 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd8c0029100 msgr2=0x7fd8c002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:07.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.128 7fd8e74d2700 1 --2- 172.21.15.79:0/3669638134 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd8c0029100 0x7fd8c002b650 crc :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.128 7fd8e74d2700 1 -- 172.21.15.79:0/3669638134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8e00ba2c0 msgr2=0x7fd8e01a7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:07.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.128 7fd8e74d2700 1 --2- 172.21.15.79:0/3669638134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8e00ba2c0 0x7fd8e01a7e30 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7fd8e00d3fe0 tx=0x7fd8d8006c10).stop 2021-04-09T18:34:07.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.132 7fd8e74d2700 1 -- 172.21.15.79:0/3669638134 shutdown_connections 2021-04-09T18:34:07.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.132 7fd8e74d2700 1 --2- 172.21.15.79:0/3669638134 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd8c0029100 0x7fd8c002b650 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.132 7fd8e74d2700 1 --2- 172.21.15.79:0/3669638134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8e008ec40 0x7fd8e00d0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.132 7fd8e74d2700 1 --2- 172.21.15.79:0/3669638134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8e00ba2c0 0x7fd8e01a7e30 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.132 7fd8e74d2700 1 --2- 172.21.15.79:0/3669638134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e008e7f0 0x7fd8e008f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.132 7fd8e74d2700 1 -- 172.21.15.79:0/3669638134 >> 172.21.15.79:0/3669638134 conn(0x7fd8e00d8b60 msgr2=0x7fd8e00d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:07.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.132 7fd8e74d2700 1 -- 172.21.15.79:0/3669638134 shutdown_connections 2021-04-09T18:34:07.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.132 7fd8e74d2700 1 -- 172.21.15.79:0/3669638134 wait complete. 2021-04-09T18:34:07.146 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-04-09T18:34:07.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.232 7f6bf1639700 1 Processor -- start 2021-04-09T18:34:07.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6bf1639700 1 -- start start 2021-04-09T18:34:07.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6bf1639700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6bec0f5510 0x7f6bec0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:07.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6bf1639700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6bec0e9ad0 0x7f6bec09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:07.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6bf1639700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bec0fbb10 con 0x7f6bec1c2da0 2021-04-09T18:34:07.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6bf1639700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bec0e9f20 con 0x7f6bec0e9ad0 2021-04-09T18:34:07.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6bf1639700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bec0e59c0 con 0x7f6bec0f5510 2021-04-09T18:34:07.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6beaa46700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6bec0e9ad0 0x7f6bec09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:07.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6beba48700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6bec1c2da0 0x7f6bec1c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56284/0 (socket says 172.21.15.79:56284) 2021-04-09T18:34:07.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6beba48700 1 -- 172.21.15.79:0/2528325073 learned_addr learned my addr 172.21.15.79:0/2528325073 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:07.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6beb247700 1 --2- 172.21.15.79:0/2528325073 >> v2:172.21.15.89:3300/0 conn(0x7f6bec0f5510 0x7f6bec0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:07.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6beaa46700 1 -- 172.21.15.79:0/2528325073 >> v2:172.21.15.89:3300/0 conn(0x7f6bec0f5510 msgr2=0x7f6bec0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:07.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6beaa46700 1 --2- 172.21.15.79:0/2528325073 >> v2:172.21.15.89:3300/0 conn(0x7f6bec0f5510 0x7f6bec0f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6beaa46700 1 -- 172.21.15.79:0/2528325073 >> v1:172.21.15.79:6789/0 conn(0x7f6bec1c2da0 legacy=0x7f6bec1c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:07.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6beaa46700 1 -- 172.21.15.79:0/2528325073 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec0e56c0 con 0x7f6bec0e9ad0 2021-04-09T18:34:07.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6bea245700 1 -- 172.21.15.79:0/2528325073 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228419563 0 0) 0x7f6be4001450 con 0x7f6bec1c2da0 2021-04-09T18:34:07.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6beaa46700 1 --2- 172.21.15.79:0/2528325073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bec0e9ad0 0x7f6bec09f100 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f6be0002f30 tx=0x7f6be000bd10).ready entity=mon.0 client_cookie=de0cea0acb82bc70 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:07.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6bea245700 1 -- 172.21.15.79:0/2528325073 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6bec0e56c0 con 0x7f6bec0e9ad0 2021-04-09T18:34:07.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6bea245700 1 -- 172.21.15.79:0/2528325073 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be00098a0 con 0x7f6bec0e9ad0 2021-04-09T18:34:07.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6bea245700 1 -- 172.21.15.79:0/2528325073 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6be0009c70 con 0x7f6bec0e9ad0 2021-04-09T18:34:07.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6bf1639700 1 -- 172.21.15.79:0/2528325073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bec0e9ad0 msgr2=0x7f6bec09f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:07.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6bf1639700 1 --2- 172.21.15.79:0/2528325073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bec0e9ad0 0x7f6bec09f100 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f6be0002f30 tx=0x7f6be000bd10).stop 2021-04-09T18:34:07.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6bf1639700 1 -- 172.21.15.79:0/2528325073 shutdown_connections 2021-04-09T18:34:07.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6bf1639700 1 --2- 172.21.15.79:0/2528325073 >> v2:172.21.15.89:3300/0 conn(0x7f6bec0f5510 0x7f6bec0f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6bf1639700 1 --2- 172.21.15.79:0/2528325073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bec0e9ad0 0x7f6bec09f100 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6bf1639700 1 -- 172.21.15.79:0/2528325073 >> 172.21.15.79:0/2528325073 conn(0x7f6bec0e5fd0 msgr2=0x7f6bec0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:07.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6bf1639700 1 -- 172.21.15.79:0/2528325073 shutdown_connections 2021-04-09T18:34:07.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.236 7f6bf1639700 1 -- 172.21.15.79:0/2528325073 wait complete. 2021-04-09T18:34:07.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.240 7f6bf1639700 1 Processor -- start 2021-04-09T18:34:07.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.240 7f6bf1639700 1 -- start start 2021-04-09T18:34:07.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6bf1639700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bec0ad8f0 0x7f6bec0adf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:07.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6bf1639700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bec0d0de0 0x7f6bec0d1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:07.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6bf1639700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bec0d4b60 0x7f6bec0d4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:07.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6bf1639700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0aae90 con 0x7f6bec0d4b60 2021-04-09T18:34:07.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6bf1639700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0ab190 con 0x7f6bec0d0de0 2021-04-09T18:34:07.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6bf1639700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0add40 con 0x7f6bec0ad8f0 2021-04-09T18:34:07.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6beba48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bec0d4b60 0x7f6bec0d4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:07.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6beba48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bec0d4b60 0x7f6bec0d4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33348/0 (socket says 172.21.15.79:33348) 2021-04-09T18:34:07.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6beba48700 1 -- 172.21.15.79:0/625051171 learned_addr learned my addr 172.21.15.79:0/625051171 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:07.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6beaa46700 1 --2- 172.21.15.79:0/625051171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bec0d0de0 0x7f6bec0d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:07.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6beb247700 1 --2- 172.21.15.79:0/625051171 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bec0ad8f0 0x7f6bec0adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:07.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6beba48700 1 -- 172.21.15.79:0/625051171 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bec0ad8f0 msgr2=0x7f6bec0adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:07.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6beba48700 1 --2- 172.21.15.79:0/625051171 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bec0ad8f0 0x7f6bec0adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6beba48700 1 -- 172.21.15.79:0/625051171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bec0d0de0 msgr2=0x7f6bec0d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:07.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6beba48700 1 --2- 172.21.15.79:0/625051171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bec0d0de0 0x7f6bec0d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6beba48700 1 -- 172.21.15.79:0/625051171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec0d5aa0 con 0x7f6bec0d4b60 2021-04-09T18:34:07.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6beba48700 1 --2- 172.21.15.79:0/625051171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bec0d4b60 0x7f6bec0d4fb0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f6bec09b430 tx=0x7f6be400cee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:07.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6bd3fff700 1 -- 172.21.15.79:0/625051171 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6be4005b80 con 0x7f6bec0d4b60 2021-04-09T18:34:07.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6bd3fff700 1 -- 172.21.15.79:0/625051171 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be4005d80 con 0x7f6bec0d4b60 2021-04-09T18:34:07.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6bf1639700 1 -- 172.21.15.79:0/625051171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bec0aa960 con 0x7f6bec0d4b60 2021-04-09T18:34:07.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6bd3fff700 1 -- 172.21.15.79:0/625051171 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6be4007300 con 0x7f6bec0d4b60 2021-04-09T18:34:07.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6bf1639700 1 -- 172.21.15.79:0/625051171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bec0d55e0 con 0x7f6bec0d4b60 2021-04-09T18:34:07.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6bd3fff700 1 -- 172.21.15.79:0/625051171 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6be401a020 con 0x7f6bec0d4b60 2021-04-09T18:34:07.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6bd3fff700 1 --2- 172.21.15.79:0/625051171 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6bcc029100 0x7f6bcc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:07.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.244 7f6bd3fff700 1 -- 172.21.15.79:0/625051171 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f6be4039390 con 0x7f6bec0d4b60 2021-04-09T18:34:07.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.248 7f6beb247700 1 --2- 172.21.15.79:0/625051171 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6bcc029100 0x7f6bcc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:07.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.248 7f6beb247700 1 --2- 172.21.15.79:0/625051171 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6bcc029100 0x7f6bcc02b650 crc :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:07.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.248 7f6bf1639700 1 -- 172.21.15.79:0/625051171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bec0e39d0 con 0x7f6bec0d4b60 2021-04-09T18:34:07.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.252 7f6bd3fff700 1 -- 172.21.15.79:0/625051171 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6be4005970 con 0x7f6bec0d4b60 2021-04-09T18:34:07.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.408 7f6bf1639700 1 -- 172.21.15.79:0/625051171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6bec0f5b10 con 0x7f6bec0d4b60 2021-04-09T18:34:07.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.408 7f6bd3fff700 1 -- 172.21.15.79:0/625051171 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v93) v1 ==== 84+0+64 (secure 0 0 0) 0x7f6be4000f70 con 0x7f6bec0d4b60 2021-04-09T18:34:07.416 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:07.416 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2021-04-09T18:34:07.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:07.417 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2021-04-09T18:34:07.418 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": "rbd" 2021-04-09T18:34:07.418 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:07.418 INFO:teuthology.orchestra.run.smithi079.stdout:] 2021-04-09T18:34:07.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.412 7f6bf1639700 1 -- 172.21.15.79:0/625051171 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6bcc029100 msgr2=0x7f6bcc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:07.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.412 7f6bf1639700 1 --2- 172.21.15.79:0/625051171 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6bcc029100 0x7f6bcc02b650 crc :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.412 7f6bf1639700 1 -- 172.21.15.79:0/625051171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bec0d4b60 msgr2=0x7f6bec0d4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:07.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.412 7f6bf1639700 1 --2- 172.21.15.79:0/625051171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bec0d4b60 0x7f6bec0d4fb0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f6bec09b430 tx=0x7f6be400cee0).stop 2021-04-09T18:34:07.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.412 7f6bf1639700 1 -- 172.21.15.79:0/625051171 shutdown_connections 2021-04-09T18:34:07.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.412 7f6bf1639700 1 --2- 172.21.15.79:0/625051171 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6bcc029100 0x7f6bcc02b650 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.412 7f6bf1639700 1 --2- 172.21.15.79:0/625051171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bec0d4b60 0x7f6bec0d4fb0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.412 7f6bf1639700 1 --2- 172.21.15.79:0/625051171 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bec0ad8f0 0x7f6bec0adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.412 7f6bf1639700 1 --2- 172.21.15.79:0/625051171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bec0d0de0 0x7f6bec0d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.412 7f6bf1639700 1 -- 172.21.15.79:0/625051171 >> 172.21.15.79:0/625051171 conn(0x7f6bec0d8b80 msgr2=0x7f6bec0b9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:07.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.412 7f6bf1639700 1 -- 172.21.15.79:0/625051171 shutdown_connections 2021-04-09T18:34:07.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.412 7f6bf1639700 1 -- 172.21.15.79:0/625051171 wait complete. 2021-04-09T18:34:07.430 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-04-09T18:34:07.435 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-04-09T18:34:07.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.528 7f2090326700 1 Processor -- start 2021-04-09T18:34:07.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.528 7f2090326700 1 -- start start 2021-04-09T18:34:07.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.528 7f2090326700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f20880f5550 0x7f20880f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:07.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.528 7f2090326700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20880e9b10 0x7f208809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:07.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.528 7f2090326700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f20881c2de0 0x7f20881c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:07.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.528 7f2090326700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20880e9f60 con 0x7f20880f5550 2021-04-09T18:34:07.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.528 7f2090326700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20880e5a00 con 0x7f20881c2de0 2021-04-09T18:34:07.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.528 7f2090326700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20880fbb50 con 0x7f20880e9b10 2021-04-09T18:34:07.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.528 7f208e0ca700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f20880f5550 0x7f20880f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:07.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f208e0ca700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f20880f5550 0x7f20880f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33352/0 (socket says 172.21.15.79:33352) 2021-04-09T18:34:07.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f208e0ca700 1 -- 172.21.15.79:0/3084159054 learned_addr learned my addr 172.21.15.79:0/3084159054 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:07.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f208d8c9700 1 --2- 172.21.15.79:0/3084159054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20880e9b10 0x7f208809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:07.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f208e8cb700 1 --2- 172.21.15.79:0/3084159054 >> v2:172.21.15.89:3300/0 conn(0x7f20881c2de0 0x7f20881c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:07.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f208e0ca700 1 -- 172.21.15.79:0/3084159054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20880e9b10 msgr2=0x7f208809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:07.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f208e0ca700 1 --2- 172.21.15.79:0/3084159054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20880e9b10 0x7f208809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f208e0ca700 1 -- 172.21.15.79:0/3084159054 >> v2:172.21.15.89:3300/0 conn(0x7f20881c2de0 msgr2=0x7f20881c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:07.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f208e0ca700 1 --2- 172.21.15.79:0/3084159054 >> v2:172.21.15.89:3300/0 conn(0x7f20881c2de0 0x7f20881c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f208e0ca700 1 -- 172.21.15.79:0/3084159054 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20880e5700 con 0x7f20880f5550 2021-04-09T18:34:07.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f208e8cb700 1 --2- 172.21.15.79:0/3084159054 >> v2:172.21.15.89:3300/0 conn(0x7f20881c2de0 0x7f20881c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:07.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f208e0ca700 1 --2- 172.21.15.79:0/3084159054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20880f5550 0x7f20880f64e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f20780032b0 tx=0x7f207800b3c0).ready entity=mon.0 client_cookie=ec8dddabf974dc80 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f208d0c8700 1 -- 172.21.15.79:0/3084159054 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f20880e5700 con 0x7f20880f5550 2021-04-09T18:34:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f208d0c8700 1 -- 172.21.15.79:0/3084159054 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207800bc20 con 0x7f20880f5550 2021-04-09T18:34:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f208d0c8700 1 -- 172.21.15.79:0/3084159054 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2078002020 con 0x7f20880f5550 2021-04-09T18:34:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f2090326700 1 -- 172.21.15.79:0/3084159054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20880f5550 msgr2=0x7f20880f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:07.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f2090326700 1 --2- 172.21.15.79:0/3084159054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20880f5550 0x7f20880f64e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f20780032b0 tx=0x7f207800b3c0).stop 2021-04-09T18:34:07.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f2090326700 1 -- 172.21.15.79:0/3084159054 shutdown_connections 2021-04-09T18:34:07.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f2090326700 1 --2- 172.21.15.79:0/3084159054 >> v2:172.21.15.89:3300/0 conn(0x7f20881c2de0 0x7f20881c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f2090326700 1 --2- 172.21.15.79:0/3084159054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20880f5550 0x7f20880f64e0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f2090326700 1 --2- 172.21.15.79:0/3084159054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20880e9b10 0x7f208809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f2090326700 1 -- 172.21.15.79:0/3084159054 >> 172.21.15.79:0/3084159054 conn(0x7f20880e6010 msgr2=0x7f20880e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:07.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f2090326700 1 -- 172.21.15.79:0/3084159054 shutdown_connections 2021-04-09T18:34:07.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.532 7f2090326700 1 -- 172.21.15.79:0/3084159054 wait complete. 2021-04-09T18:34:07.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f2090326700 1 Processor -- start 2021-04-09T18:34:07.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f2090326700 1 -- start start 2021-04-09T18:34:07.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f2090326700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2088098ea0 0x7f2088099c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:07.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f2090326700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2088098390 0x7f20880d8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:07.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f2090326700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20880987e0 0x7f2088094e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:07.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f2090326700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20880996d0 con 0x7f20880987e0 2021-04-09T18:34:07.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f2090326700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20880999d0 con 0x7f2088098ea0 2021-04-09T18:34:07.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f2090326700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20880992f0 con 0x7f2088098390 2021-04-09T18:34:07.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f208e8cb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20880987e0 0x7f2088094e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:07.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f208e8cb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20880987e0 0x7f2088094e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33360/0 (socket says 172.21.15.79:33360) 2021-04-09T18:34:07.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f208e8cb700 1 -- 172.21.15.79:0/3454686428 learned_addr learned my addr 172.21.15.79:0/3454686428 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:07.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f208d8c9700 1 --2- 172.21.15.79:0/3454686428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2088098390 0x7f20880d8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:07.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f208e0ca700 1 --2- 172.21.15.79:0/3454686428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2088098ea0 0x7f2088099c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:07.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f208e8cb700 1 -- 172.21.15.79:0/3454686428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2088098390 msgr2=0x7f20880d8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:07.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f208e8cb700 1 --2- 172.21.15.79:0/3454686428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2088098390 0x7f20880d8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f208e8cb700 1 -- 172.21.15.79:0/3454686428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2088098ea0 msgr2=0x7f2088099c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f208e8cb700 1 --2- 172.21.15.79:0/3454686428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2088098ea0 0x7f2088099c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:07.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f208e8cb700 1 -- 172.21.15.79:0/3454686428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208809a240 con 0x7f20880987e0 2021-04-09T18:34:07.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f208e8cb700 1 --2- 172.21.15.79:0/3454686428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20880987e0 0x7f2088094e60 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f20880d3bb0 tx=0x7f208000dc50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:07.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f207effd700 1 -- 172.21.15.79:0/3454686428 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f208000b8a0 con 0x7f20880987e0 2021-04-09T18:34:07.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f207effd700 1 -- 172.21.15.79:0/3454686428 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2080010070 con 0x7f20880987e0 2021-04-09T18:34:07.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f2090326700 1 -- 172.21.15.79:0/3454686428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20880d8b80 con 0x7f20880987e0 2021-04-09T18:34:07.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f207effd700 1 -- 172.21.15.79:0/3454686428 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f208000bc90 con 0x7f20880987e0 2021-04-09T18:34:07.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.536 7f2090326700 1 -- 172.21.15.79:0/3454686428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2088095490 con 0x7f20880987e0 2021-04-09T18:34:07.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.540 7f207effd700 1 -- 172.21.15.79:0/3454686428 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2080012070 con 0x7f20880987e0 2021-04-09T18:34:07.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.540 7f207effd700 1 --2- 172.21.15.79:0/3454686428 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2068029100 0x7f206802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:07.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.540 7f207effd700 1 -- 172.21.15.79:0/3454686428 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f2080039400 con 0x7f20880987e0 2021-04-09T18:34:07.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.540 7f208e0ca700 1 --2- 172.21.15.79:0/3454686428 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2068029100 0x7f206802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:07.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.540 7f208e0ca700 1 --2- 172.21.15.79:0/3454686428 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2068029100 0x7f206802b650 crc :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:07.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.544 7f2090326700 1 -- 172.21.15.79:0/3454686428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20880e39f0 con 0x7f20880987e0 2021-04-09T18:34:07.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.552 7f207effd700 1 -- 172.21.15.79:0/3454686428 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f20880f76f0 con 0x7f20880987e0 2021-04-09T18:34:07.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:07.708 7f2090326700 1 -- 172.21.15.79:0/3454686428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f20880f5b50 con 0x7f20880987e0 2021-04-09T18:34:08.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.196 7f207effd700 1 -- 172.21.15.79:0/3454686428 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v94) v1 ==== 133+0+0 (secure 0 0 0) 0x7f208000b4a0 con 0x7f20880987e0 2021-04-09T18:34:08.227 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2021-04-09T18:34:08.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.224 7f2090326700 1 -- 172.21.15.79:0/3454686428 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2068029100 msgr2=0x7f206802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:08.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.224 7f2090326700 1 --2- 172.21.15.79:0/3454686428 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2068029100 0x7f206802b650 crc :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:08.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.224 7f2090326700 1 -- 172.21.15.79:0/3454686428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20880987e0 msgr2=0x7f2088094e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:08.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.224 7f2090326700 1 --2- 172.21.15.79:0/3454686428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20880987e0 0x7f2088094e60 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f20880d3bb0 tx=0x7f208000dc50).stop 2021-04-09T18:34:08.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.228 7f2090326700 1 -- 172.21.15.79:0/3454686428 shutdown_connections 2021-04-09T18:34:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.228 7f2090326700 1 --2- 172.21.15.79:0/3454686428 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2068029100 0x7f206802b650 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.228 7f2090326700 1 --2- 172.21.15.79:0/3454686428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2088098ea0 0x7f2088099c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.228 7f2090326700 1 --2- 172.21.15.79:0/3454686428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20880987e0 0x7f2088094e60 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.228 7f2090326700 1 --2- 172.21.15.79:0/3454686428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2088098390 0x7f20880d8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.228 7f2090326700 1 -- 172.21.15.79:0/3454686428 >> 172.21.15.79:0/3454686428 conn(0x7f2088094860 msgr2=0x7f2088093ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:08.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.228 7f2090326700 1 -- 172.21.15.79:0/3454686428 shutdown_connections 2021-04-09T18:34:08.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.228 7f2090326700 1 -- 172.21.15.79:0/3454686428 wait complete. 2021-04-09T18:34:08.244 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-04-09T18:34:08.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.348 7f3130767700 1 Processor -- start 2021-04-09T18:34:08.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.348 7f3130767700 1 -- start start 2021-04-09T18:34:08.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.348 7f3130767700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31280e9b10 0x7f312809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:08.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.348 7f3130767700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f31281c8040 0x7f31281ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:08.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.348 7f3130767700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31280fbb50 con 0x7f31280f5550 2021-04-09T18:34:08.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.348 7f3130767700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31281c3df0 con 0x7f31281c8040 2021-04-09T18:34:08.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.348 7f3130767700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31280e9f60 con 0x7f31280e9b10 2021-04-09T18:34:08.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.348 7f312ed0c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f31281c8040 0x7f31281ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:08.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.348 7f312ed0c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f31281c8040 0x7f31281ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33370/0 (socket says 172.21.15.79:33370) 2021-04-09T18:34:08.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.348 7f312ed0c700 1 -- 172.21.15.79:0/508990810 learned_addr learned my addr 172.21.15.79:0/508990810 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:08.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.348 7f312dd0a700 1 --2- 172.21.15.79:0/508990810 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31280e9b10 0x7f312809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:08.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.348 7f312ed0c700 1 -- 172.21.15.79:0/508990810 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31280e9b10 msgr2=0x7f312809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:08.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.348 7f312ed0c700 1 --2- 172.21.15.79:0/508990810 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31280e9b10 0x7f312809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:08.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.348 7f312ed0c700 1 -- 172.21.15.79:0/508990810 >> v1:172.21.15.89:6789/0 conn(0x7f31280f5550 legacy=0x7f31280f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:08.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.348 7f312d509700 1 -- 172.21.15.79:0/508990810 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662430153 0 0) 0x7f31240010d0 con 0x7f31280f5550 2021-04-09T18:34:08.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.348 7f312ed0c700 1 -- 172.21.15.79:0/508990810 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31280e5700 con 0x7f31281c8040 2021-04-09T18:34:08.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.348 7f312ed0c700 1 --2- 172.21.15.79:0/508990810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31281c8040 0x7f31281ca4a0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f3120002f30 tx=0x7f312000bda0).ready entity=mon.0 client_cookie=f9a3bf457439accb server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:08.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.352 7f312d509700 1 -- 172.21.15.79:0/508990810 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f31280e5700 con 0x7f31281c8040 2021-04-09T18:34:08.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.352 7f312d509700 1 -- 172.21.15.79:0/508990810 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31200099d0 con 0x7f31281c8040 2021-04-09T18:34:08.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.352 7f312d509700 1 -- 172.21.15.79:0/508990810 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3120009da0 con 0x7f31281c8040 2021-04-09T18:34:08.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.352 7f3130767700 1 -- 172.21.15.79:0/508990810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31281c8040 msgr2=0x7f31281ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:08.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.352 7f3130767700 1 --2- 172.21.15.79:0/508990810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31281c8040 0x7f31281ca4a0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f3120002f30 tx=0x7f312000bda0).stop 2021-04-09T18:34:08.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.352 7f3130767700 1 -- 172.21.15.79:0/508990810 shutdown_connections 2021-04-09T18:34:08.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.352 7f3130767700 1 --2- 172.21.15.79:0/508990810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31281c8040 0x7f31281ca4a0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:08.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.352 7f3130767700 1 --2- 172.21.15.79:0/508990810 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31280e9b10 0x7f312809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:08.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.352 7f3130767700 1 -- 172.21.15.79:0/508990810 >> 172.21.15.79:0/508990810 conn(0x7f31280e6010 msgr2=0x7f31280e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:08.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.352 7f3130767700 1 -- 172.21.15.79:0/508990810 shutdown_connections 2021-04-09T18:34:08.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.352 7f3130767700 1 -- 172.21.15.79:0/508990810 wait complete. 2021-04-09T18:34:08.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f3130767700 1 Processor -- start 2021-04-09T18:34:08.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f3130767700 1 -- start start 2021-04-09T18:34:08.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f3130767700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3128095c00 0x7f31280bd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:08.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f3130767700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3128096050 0x7f31281aa610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:08.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f3130767700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31281aac40 0x7f31281ab090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:08.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f3130767700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31280bbbc0 con 0x7f31281aac40 2021-04-09T18:34:08.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f3130767700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31280bbec0 con 0x7f3128096050 2021-04-09T18:34:08.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f3130767700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31280926e0 con 0x7f3128095c00 2021-04-09T18:34:08.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f312ed0c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31281aac40 0x7f31281ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:08.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f312ed0c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31281aac40 0x7f31281ab090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33376/0 (socket says 172.21.15.79:33376) 2021-04-09T18:34:08.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f312ed0c700 1 -- 172.21.15.79:0/967933174 learned_addr learned my addr 172.21.15.79:0/967933174 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:08.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f312e50b700 1 --2- 172.21.15.79:0/967933174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3128095c00 0x7f31280bd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:08.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f312dd0a700 1 --2- 172.21.15.79:0/967933174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3128096050 0x7f31281aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:08.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f312ed0c700 1 -- 172.21.15.79:0/967933174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3128095c00 msgr2=0x7f31280bd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:08.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f312ed0c700 1 --2- 172.21.15.79:0/967933174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3128095c00 0x7f31280bd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:08.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f312ed0c700 1 -- 172.21.15.79:0/967933174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3128096050 msgr2=0x7f31281aa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:08.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f312ed0c700 1 --2- 172.21.15.79:0/967933174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3128096050 0x7f31281aa610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:08.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f312ed0c700 1 -- 172.21.15.79:0/967933174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31280bda70 con 0x7f31281aac40 2021-04-09T18:34:08.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f312ed0c700 1 --2- 172.21.15.79:0/967933174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31281aac40 0x7f31281ab090 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f3120002f30 tx=0x7f3120006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:08.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f311affd700 1 -- 172.21.15.79:0/967933174 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f31280bda70 con 0x7f31281aac40 2021-04-09T18:34:08.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f311affd700 1 -- 172.21.15.79:0/967933174 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3120011c90 con 0x7f31281aac40 2021-04-09T18:34:08.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f3130767700 1 -- 172.21.15.79:0/967933174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31281a6470 con 0x7f31281aac40 2021-04-09T18:34:08.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f311affd700 1 -- 172.21.15.79:0/967933174 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f312001d630 con 0x7f31281aac40 2021-04-09T18:34:08.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.356 7f3130767700 1 -- 172.21.15.79:0/967933174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31281a68f0 con 0x7f31281aac40 2021-04-09T18:34:08.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.360 7f311affd700 1 -- 172.21.15.79:0/967933174 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3120026450 con 0x7f31281aac40 2021-04-09T18:34:08.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.360 7f311affd700 1 --2- 172.21.15.79:0/967933174 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3110029100 0x7f311002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:08.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.360 7f311affd700 1 -- 172.21.15.79:0/967933174 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5458+0+0 (secure 0 0 0) 0x7f312003aeb0 con 0x7f31281aac40 2021-04-09T18:34:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.360 7f312e50b700 1 --2- 172.21.15.79:0/967933174 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3110029100 0x7f311002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.360 7f312e50b700 1 --2- 172.21.15.79:0/967933174 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3110029100 0x7f311002b650 crc :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.364 7f3130767700 1 -- 172.21.15.79:0/967933174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31280e39f0 con 0x7f31281aac40 2021-04-09T18:34:08.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.372 7f311affd700 1 -- 172.21.15.79:0/967933174 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3120011a80 con 0x7f31281aac40 2021-04-09T18:34:08.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:08.540 7f3130767700 1 -- 172.21.15.79:0/967933174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f31280f5b50 con 0x7f31281aac40 2021-04-09T18:34:09.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.200 7f311affd700 1 -- 172.21.15.79:0/967933174 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v95) v1 ==== 125+0+0 (secure 0 0 0) 0x7f31200097c0 con 0x7f31281aac40 2021-04-09T18:34:09.209 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2021-04-09T18:34:09.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.208 7f3130767700 1 -- 172.21.15.79:0/967933174 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3110029100 msgr2=0x7f311002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.208 7f3130767700 1 --2- 172.21.15.79:0/967933174 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3110029100 0x7f311002b650 crc :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.208 7f3130767700 1 -- 172.21.15.79:0/967933174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31281aac40 msgr2=0x7f31281ab090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.208 7f3130767700 1 --2- 172.21.15.79:0/967933174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31281aac40 0x7f31281ab090 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f3120002f30 tx=0x7f3120006890).stop 2021-04-09T18:34:09.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.212 7f3130767700 1 -- 172.21.15.79:0/967933174 shutdown_connections 2021-04-09T18:34:09.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.212 7f3130767700 1 --2- 172.21.15.79:0/967933174 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3110029100 0x7f311002b650 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.212 7f3130767700 1 --2- 172.21.15.79:0/967933174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31281aac40 0x7f31281ab090 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.212 7f3130767700 1 --2- 172.21.15.79:0/967933174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3128095c00 0x7f31280bd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.212 7f3130767700 1 --2- 172.21.15.79:0/967933174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3128096050 0x7f31281aa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.212 7f3130767700 1 -- 172.21.15.79:0/967933174 >> 172.21.15.79:0/967933174 conn(0x7f31280d89e0 msgr2=0x7f312808fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:09.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.212 7f3130767700 1 -- 172.21.15.79:0/967933174 shutdown_connections 2021-04-09T18:34:09.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.212 7f3130767700 1 -- 172.21.15.79:0/967933174 wait complete. 2021-04-09T18:34:09.228 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-04-09T18:34:09.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f6297988700 1 Processor -- start 2021-04-09T18:34:09.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f6297988700 1 -- start start 2021-04-09T18:34:09.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f6297988700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62901c9050 0x7f62901cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:09.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f6297988700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62900fbb50 con 0x7f62900f5550 2021-04-09T18:34:09.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f6297988700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629009f910 con 0x7f62900e9b10 2021-04-09T18:34:09.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f6297988700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62901c3df0 con 0x7f62901c9050 2021-04-09T18:34:09.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f629572c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f62900f5550 0x7f62900f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56322/0 (socket says 172.21.15.79:56322) 2021-04-09T18:34:09.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f629572c700 1 -- 172.21.15.79:0/1097611233 learned_addr learned my addr 172.21.15.79:0/1097611233 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:09.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f6295f2d700 1 --2- 172.21.15.79:0/1097611233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62901c9050 0x7f62901cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:09.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f6287fff700 1 -- 172.21.15.79:0/1097611233 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168360849 0 0) 0x7f628c0010d0 con 0x7f62900f5550 2021-04-09T18:34:09.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f6287fff700 1 -- 172.21.15.79:0/1097611233 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f627c003240 con 0x7f62900f5550 2021-04-09T18:34:09.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f6287fff700 1 -- 172.21.15.79:0/1097611233 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953861838 0 0) 0x7f62800010d0 con 0x7f62900e9b10 2021-04-09T18:34:09.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f6295f2d700 1 -- 172.21.15.79:0/1097611233 >> v1:172.21.15.89:6789/0 conn(0x7f62900e9b10 legacy=0x7f629009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f6295f2d700 1 -- 172.21.15.79:0/1097611233 >> v1:172.21.15.79:6789/0 conn(0x7f62900f5550 legacy=0x7f62900f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f6295f2d700 1 -- 172.21.15.79:0/1097611233 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62900e5700 con 0x7f62901c9050 2021-04-09T18:34:09.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f6295f2d700 1 --2- 172.21.15.79:0/1097611233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62901c9050 0x7f62901cb4b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f62880032b0 tx=0x7f628800b0e0).ready entity=mon.2 client_cookie=fec1e243dad80b1c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:09.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f6287fff700 1 -- 172.21.15.79:0/1097611233 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f62900e5700 con 0x7f62901c9050 2021-04-09T18:34:09.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f6287fff700 1 -- 172.21.15.79:0/1097611233 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628800baf0 con 0x7f62901c9050 2021-04-09T18:34:09.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f6287fff700 1 -- 172.21.15.79:0/1097611233 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6288002020 con 0x7f62901c9050 2021-04-09T18:34:09.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f6297988700 1 -- 172.21.15.79:0/1097611233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62901c9050 msgr2=0x7f62901cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.324 7f6297988700 1 --2- 172.21.15.79:0/1097611233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62901c9050 0x7f62901cb4b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f62880032b0 tx=0x7f628800b0e0).stop 2021-04-09T18:34:09.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.328 7f6297988700 1 -- 172.21.15.79:0/1097611233 shutdown_connections 2021-04-09T18:34:09.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.328 7f6297988700 1 --2- 172.21.15.79:0/1097611233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62901c9050 0x7f62901cb4b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.328 7f6297988700 1 -- 172.21.15.79:0/1097611233 >> 172.21.15.79:0/1097611233 conn(0x7f62900e6010 msgr2=0x7f62900e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:09.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.328 7f6297988700 1 -- 172.21.15.79:0/1097611233 shutdown_connections 2021-04-09T18:34:09.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.328 7f6297988700 1 -- 172.21.15.79:0/1097611233 wait complete. 2021-04-09T18:34:09.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f6297988700 1 Processor -- start 2021-04-09T18:34:09.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f6297988700 1 -- start start 2021-04-09T18:34:09.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f6297988700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62900bfcc0 0x7f62900b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:09.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f6297988700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62900d5080 0x7f62900d54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:09.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f6297988700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62900bbd90 0x7f62900bc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:09.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f6297988700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6290088580 con 0x7f62900bfcc0 2021-04-09T18:34:09.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f6297988700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62900e9f60 con 0x7f62900d5080 2021-04-09T18:34:09.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f6297988700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62900bf9c0 con 0x7f62900bbd90 2021-04-09T18:34:09.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f629572c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62900bfcc0 0x7f62900b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:09.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f629572c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62900bfcc0 0x7f62900b5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33386/0 (socket says 172.21.15.79:33386) 2021-04-09T18:34:09.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f629572c700 1 -- 172.21.15.79:0/3816890578 learned_addr learned my addr 172.21.15.79:0/3816890578 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:09.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f6295f2d700 1 --2- 172.21.15.79:0/3816890578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62900bbd90 0x7f62900bc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:09.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f6294f2b700 1 --2- 172.21.15.79:0/3816890578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62900d5080 0x7f62900d54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:09.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f629572c700 1 -- 172.21.15.79:0/3816890578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62900bbd90 msgr2=0x7f62900bc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f629572c700 1 --2- 172.21.15.79:0/3816890578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62900bbd90 0x7f62900bc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f629572c700 1 -- 172.21.15.79:0/3816890578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62900d5080 msgr2=0x7f62900d54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f629572c700 1 --2- 172.21.15.79:0/3816890578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62900d5080 0x7f62900d54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f629572c700 1 -- 172.21.15.79:0/3816890578 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62900bf550 con 0x7f62900bfcc0 2021-04-09T18:34:09.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f6294f2b700 1 --2- 172.21.15.79:0/3816890578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62900d5080 0x7f62900d54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:09.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f629572c700 1 --2- 172.21.15.79:0/3816890578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62900bfcc0 0x7f62900b5940 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f628c000b80 tx=0x7f628c00cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:09.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f6285ffb700 1 -- 172.21.15.79:0/3816890578 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f62900bf550 con 0x7f62900bfcc0 2021-04-09T18:34:09.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f6285ffb700 1 -- 172.21.15.79:0/3816890578 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c007320 con 0x7f62900bfcc0 2021-04-09T18:34:09.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f6297988700 1 -- 172.21.15.79:0/3816890578 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62900bee40 con 0x7f62900bfcc0 2021-04-09T18:34:09.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.332 7f6285ffb700 1 -- 172.21.15.79:0/3816890578 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f628c0057e0 con 0x7f62900bfcc0 2021-04-09T18:34:09.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.336 7f6297988700 1 -- 172.21.15.79:0/3816890578 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62900bc810 con 0x7f62900bfcc0 2021-04-09T18:34:09.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.336 7f6285ffb700 1 -- 172.21.15.79:0/3816890578 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f628c01a060 con 0x7f62900bfcc0 2021-04-09T18:34:09.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.336 7f6285ffb700 1 --2- 172.21.15.79:0/3816890578 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6270029100 0x7f627002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:09.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.336 7f6285ffb700 1 -- 172.21.15.79:0/3816890578 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f628c038bb0 con 0x7f62900bfcc0 2021-04-09T18:34:09.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.336 7f6294f2b700 1 --2- 172.21.15.79:0/3816890578 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6270029100 0x7f627002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:09.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.336 7f6294f2b700 1 --2- 172.21.15.79:0/3816890578 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6270029100 0x7f627002b650 crc :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:09.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.340 7f6297988700 1 -- 172.21.15.79:0/3816890578 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62900e39f0 con 0x7f62900bfcc0 2021-04-09T18:34:09.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.348 7f6285ffb700 1 -- 172.21.15.79:0/3816890578 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f628c007110 con 0x7f62900bfcc0 2021-04-09T18:34:09.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.508 7f6297988700 1 -- 172.21.15.79:0/3816890578 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f62900f5b50 con 0x7f62900bfcc0 2021-04-09T18:34:09.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.516 7f6285ffb700 1 -- 172.21.15.79:0/3816890578 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 18 and data pool 19 v58) v1 ==== 189+0+0 (secure 0 0 0) 0x7f6290107f80 con 0x7f62900bfcc0 2021-04-09T18:34:09.528 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 18 and data pool 19 2021-04-09T18:34:09.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.528 7f6297988700 1 -- 172.21.15.79:0/3816890578 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6270029100 msgr2=0x7f627002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.528 7f6297988700 1 --2- 172.21.15.79:0/3816890578 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6270029100 0x7f627002b650 crc :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.528 7f6297988700 1 -- 172.21.15.79:0/3816890578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62900bfcc0 msgr2=0x7f62900b5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.528 7f6297988700 1 --2- 172.21.15.79:0/3816890578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62900bfcc0 0x7f62900b5940 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f628c000b80 tx=0x7f628c00cab0).stop 2021-04-09T18:34:09.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.528 7f6297988700 1 -- 172.21.15.79:0/3816890578 shutdown_connections 2021-04-09T18:34:09.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.528 7f6297988700 1 --2- 172.21.15.79:0/3816890578 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6270029100 0x7f627002b650 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.528 7f6297988700 1 --2- 172.21.15.79:0/3816890578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62900bbd90 0x7f62900bc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.528 7f6297988700 1 --2- 172.21.15.79:0/3816890578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62900bfcc0 0x7f62900b5940 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.528 7f6297988700 1 --2- 172.21.15.79:0/3816890578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62900d5080 0x7f62900d54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.528 7f6297988700 1 -- 172.21.15.79:0/3816890578 >> 172.21.15.79:0/3816890578 conn(0x7f629009ab30 msgr2=0x7f62900d83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.528 7f6297988700 1 -- 172.21.15.79:0/3816890578 shutdown_connections 2021-04-09T18:34:09.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.528 7f6297988700 1 -- 172.21.15.79:0/3816890578 wait complete. 2021-04-09T18:34:09.544 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:34:09.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.628 7fe3b2a44700 1 Processor -- start 2021-04-09T18:34:09.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.628 7fe3b2a44700 1 -- start start 2021-04-09T18:34:09.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3b2a44700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3ac0f5510 0x7fe3ac0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:09.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3b2a44700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3ac0fbb10 con 0x7fe3ac1c8000 2021-04-09T18:34:09.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3b2a44700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3ac09f900 con 0x7fe3ac0e9ad0 2021-04-09T18:34:09.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3b2a44700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac0e9f20 con 0x7fe3ac0f5510 2021-04-09T18:34:09.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3b0fe9700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe3ac1c8000 0x7fe3ac1ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56340/0 (socket says 172.21.15.79:56340) 2021-04-09T18:34:09.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3b0fe9700 1 -- 172.21.15.79:0/3694284567 learned_addr learned my addr 172.21.15.79:0/3694284567 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:09.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3abfff700 1 --2- 172.21.15.79:0/3694284567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3ac0f5510 0x7fe3ac0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:09.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3aaffd700 1 -- 172.21.15.79:0/3694284567 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171799824 0 0) 0x7fe3a4001450 con 0x7fe3ac1c8000 2021-04-09T18:34:09.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3aaffd700 1 -- 172.21.15.79:0/3694284567 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe394003240 con 0x7fe3ac1c8000 2021-04-09T18:34:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3aaffd700 1 -- 172.21.15.79:0/3694284567 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1856874340 0 0) 0x7fe3a00010d0 con 0x7fe3ac0e9ad0 2021-04-09T18:34:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3aaffd700 1 -- 172.21.15.79:0/3694284567 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe394003620 con 0x7fe3ac0e9ad0 2021-04-09T18:34:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3abfff700 1 -- 172.21.15.79:0/3694284567 >> v1:172.21.15.89:6789/0 conn(0x7fe3ac0e9ad0 legacy=0x7fe3ac09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3abfff700 1 -- 172.21.15.79:0/3694284567 >> v1:172.21.15.79:6789/0 conn(0x7fe3ac1c8000 legacy=0x7fe3ac1ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3abfff700 1 -- 172.21.15.79:0/3694284567 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ac0e56c0 con 0x7fe3ac0f5510 2021-04-09T18:34:09.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3abfff700 1 --2- 172.21.15.79:0/3694284567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3ac0f5510 0x7fe3ac0f64a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fe39c002f30 tx=0x7fe39c00bcf0).ready entity=mon.2 client_cookie=450994efdbfce924 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:09.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3aaffd700 1 -- 172.21.15.79:0/3694284567 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe3ac0e56c0 con 0x7fe3ac0f5510 2021-04-09T18:34:09.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3aaffd700 1 -- 172.21.15.79:0/3694284567 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c009920 con 0x7fe3ac0f5510 2021-04-09T18:34:09.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3aaffd700 1 -- 172.21.15.79:0/3694284567 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe39c009cf0 con 0x7fe3ac0f5510 2021-04-09T18:34:09.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3b2a44700 1 -- 172.21.15.79:0/3694284567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3ac0f5510 msgr2=0x7fe3ac0f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3b2a44700 1 --2- 172.21.15.79:0/3694284567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3ac0f5510 0x7fe3ac0f64a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fe39c002f30 tx=0x7fe39c00bcf0).stop 2021-04-09T18:34:09.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3b2a44700 1 -- 172.21.15.79:0/3694284567 shutdown_connections 2021-04-09T18:34:09.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3b2a44700 1 --2- 172.21.15.79:0/3694284567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3ac0f5510 0x7fe3ac0f64a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3b2a44700 1 -- 172.21.15.79:0/3694284567 >> 172.21.15.79:0/3694284567 conn(0x7fe3ac0e5fd0 msgr2=0x7fe3ac0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:09.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3b2a44700 1 -- 172.21.15.79:0/3694284567 shutdown_connections 2021-04-09T18:34:09.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.632 7fe3b2a44700 1 -- 172.21.15.79:0/3694284567 wait complete. 2021-04-09T18:34:09.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.636 7fe3b2a44700 1 Processor -- start 2021-04-09T18:34:09.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.636 7fe3b2a44700 1 -- start start 2021-04-09T18:34:09.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3b2a44700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3ac08efc0 0x7fe3ac08e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:09.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3b2a44700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3ac0d4ff0 0x7fe3ac091590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:09.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3b2a44700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3ac0d5440 0x7fe3ac0d0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:09.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3b2a44700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac1c3db0 con 0x7fe3ac08efc0 2021-04-09T18:34:09.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3b2a44700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac08f730 con 0x7fe3ac0d5440 2021-04-09T18:34:09.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3b2a44700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac08f410 con 0x7fe3ac0d4ff0 2021-04-09T18:34:09.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3abfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3ac08efc0 0x7fe3ac08e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:09.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3abfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3ac08efc0 0x7fe3ac08e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33404/0 (socket says 172.21.15.79:33404) 2021-04-09T18:34:09.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3abfff700 1 -- 172.21.15.79:0/3185429580 learned_addr learned my addr 172.21.15.79:0/3185429580 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:09.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3b0fe9700 1 --2- 172.21.15.79:0/3185429580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3ac0d5440 0x7fe3ac0d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:09.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3ab7fe700 1 --2- 172.21.15.79:0/3185429580 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3ac0d4ff0 0x7fe3ac091590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:09.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3abfff700 1 -- 172.21.15.79:0/3185429580 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3ac0d4ff0 msgr2=0x7fe3ac091590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3abfff700 1 --2- 172.21.15.79:0/3185429580 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3ac0d4ff0 0x7fe3ac091590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3abfff700 1 -- 172.21.15.79:0/3185429580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3ac0d5440 msgr2=0x7fe3ac0d0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3abfff700 1 --2- 172.21.15.79:0/3185429580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3ac0d5440 0x7fe3ac0d0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3abfff700 1 -- 172.21.15.79:0/3185429580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ac08eaf0 con 0x7fe3ac08efc0 2021-04-09T18:34:09.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3ab7fe700 1 --2- 172.21.15.79:0/3185429580 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3ac0d4ff0 0x7fe3ac091590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:09.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3b0fe9700 1 --2- 172.21.15.79:0/3185429580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3ac0d5440 0x7fe3ac0d0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:09.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3abfff700 1 --2- 172.21.15.79:0/3185429580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3ac08efc0 0x7fe3ac08e4c0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7fe3ac0d3b10 tx=0x7fe39c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:09.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3a8ff9700 1 -- 172.21.15.79:0/3185429580 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe3ac08eaf0 con 0x7fe3ac08efc0 2021-04-09T18:34:09.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3a8ff9700 1 -- 172.21.15.79:0/3185429580 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c01d450 con 0x7fe3ac08efc0 2021-04-09T18:34:09.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3b2a44700 1 -- 172.21.15.79:0/3185429580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3ac1a67c0 con 0x7fe3ac08efc0 2021-04-09T18:34:09.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3a8ff9700 1 -- 172.21.15.79:0/3185429580 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe39c022020 con 0x7fe3ac08efc0 2021-04-09T18:34:09.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3b2a44700 1 -- 172.21.15.79:0/3185429580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3ac091db0 con 0x7fe3ac08efc0 2021-04-09T18:34:09.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3a8ff9700 1 -- 172.21.15.79:0/3185429580 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe39c006960 con 0x7fe3ac08efc0 2021-04-09T18:34:09.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3a8ff9700 1 --2- 172.21.15.79:0/3185429580 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe38c029100 0x7fe38c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:09.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3a8ff9700 1 -- 172.21.15.79:0/3185429580 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fe39c03c4f0 con 0x7fe3ac08efc0 2021-04-09T18:34:09.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.640 7fe3ab7fe700 1 --2- 172.21.15.79:0/3185429580 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe38c029100 0x7fe38c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:09.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.644 7fe3ab7fe700 1 --2- 172.21.15.79:0/3185429580 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe38c029100 0x7fe38c02b650 crc :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:09.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.644 7fe3b2a44700 1 -- 172.21.15.79:0/3185429580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3ac0e39d0 con 0x7fe3ac08efc0 2021-04-09T18:34:09.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.652 7fe3a8ff9700 1 -- 172.21.15.79:0/3185429580 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe39c009710 con 0x7fe3ac08efc0 2021-04-09T18:34:09.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.820 7fe3b2a44700 1 -- 172.21.15.79:0/3185429580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3ac0a1cb0 con 0x7fe3ac08efc0 2021-04-09T18:34:09.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.824 7fe3a8ff9700 1 -- 172.21.15.79:0/3185429580 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+14242 (secure 0 0 0) 0x7fe39c011d90 con 0x7fe3ac08efc0 2021-04-09T18:34:09.829 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:09.829 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":96,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:34:09.512531","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:34:07.761734","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2021-04-09 18:34:08.596089","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:34:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.828 7fe3b2a44700 1 -- 172.21.15.79:0/3185429580 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe38c029100 msgr2=0x7fe38c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.828 7fe3b2a44700 1 --2- 172.21.15.79:0/3185429580 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe38c029100 0x7fe38c02b650 crc :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.828 7fe3b2a44700 1 -- 172.21.15.79:0/3185429580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3ac08efc0 msgr2=0x7fe3ac08e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.828 7fe3b2a44700 1 --2- 172.21.15.79:0/3185429580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3ac08efc0 0x7fe3ac08e4c0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7fe3ac0d3b10 tx=0x7fe39c006890).stop 2021-04-09T18:34:09.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.828 7fe3b2a44700 1 -- 172.21.15.79:0/3185429580 shutdown_connections 2021-04-09T18:34:09.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.828 7fe3b2a44700 1 --2- 172.21.15.79:0/3185429580 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe38c029100 0x7fe38c02b650 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.828 7fe3b2a44700 1 --2- 172.21.15.79:0/3185429580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3ac0d5440 0x7fe3ac0d0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.828 7fe3b2a44700 1 --2- 172.21.15.79:0/3185429580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3ac08efc0 0x7fe3ac08e4c0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.828 7fe3b2a44700 1 --2- 172.21.15.79:0/3185429580 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3ac0d4ff0 0x7fe3ac091590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.828 7fe3b2a44700 1 -- 172.21.15.79:0/3185429580 >> 172.21.15.79:0/3185429580 conn(0x7fe3ac08fc70 msgr2=0x7fe3ac0923d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:09.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.828 7fe3b2a44700 1 -- 172.21.15.79:0/3185429580 shutdown_connections 2021-04-09T18:34:09.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.828 7fe3b2a44700 1 -- 172.21.15.79:0/3185429580 wait complete. 2021-04-09T18:34:09.842 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:34:09.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.928 7f23c803b700 1 Processor -- start 2021-04-09T18:34:09.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.928 7f23c803b700 1 -- start start 2021-04-09T18:34:09.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.928 7f23c803b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23c01c9010 0x7f23c01cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:09.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.928 7f23c803b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c00fbb10 con 0x7f23c00f5510 2021-04-09T18:34:09.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.928 7f23c803b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c009f900 con 0x7f23c00e9ad0 2021-04-09T18:34:09.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.928 7f23c803b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c01c3db0 con 0x7f23c01c9010 2021-04-09T18:34:09.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.928 7f23c5ddf700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f23c00f5510 0x7f23c00f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56350/0 (socket says 172.21.15.79:56350) 2021-04-09T18:34:09.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.928 7f23c5ddf700 1 -- 172.21.15.79:0/3950697470 learned_addr learned my addr 172.21.15.79:0/3950697470 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:09.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.932 7f23c65e0700 1 --2- 172.21.15.79:0/3950697470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23c01c9010 0x7f23c01cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:09.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.932 7f23c4ddd700 1 -- 172.21.15.79:0/3950697470 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585483575 0 0) 0x7f23b80010d0 con 0x7f23c00f5510 2021-04-09T18:34:09.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.932 7f23c4ddd700 1 -- 172.21.15.79:0/3950697470 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23a8003240 con 0x7f23c00f5510 2021-04-09T18:34:09.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.932 7f23c4ddd700 1 -- 172.21.15.79:0/3950697470 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79061039 0 0) 0x7f23bc001450 con 0x7f23c00e9ad0 2021-04-09T18:34:09.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.932 7f23c4ddd700 1 -- 172.21.15.79:0/3950697470 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23a8003620 con 0x7f23c00e9ad0 2021-04-09T18:34:09.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.932 7f23c65e0700 1 -- 172.21.15.79:0/3950697470 >> v1:172.21.15.89:6789/0 conn(0x7f23c00e9ad0 legacy=0x7f23c009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.932 7f23c65e0700 1 -- 172.21.15.79:0/3950697470 >> v1:172.21.15.79:6789/0 conn(0x7f23c00f5510 legacy=0x7f23c00f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.932 7f23c65e0700 1 -- 172.21.15.79:0/3950697470 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c00e56c0 con 0x7f23c01c9010 2021-04-09T18:34:09.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.932 7f23c65e0700 1 --2- 172.21.15.79:0/3950697470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23c01c9010 0x7f23c01cb470 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f23b0002f30 tx=0x7f23b000bcf0).ready entity=mon.2 client_cookie=74cf673265c46c29 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:09.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.932 7f23c4ddd700 1 -- 172.21.15.79:0/3950697470 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f23c00e56c0 con 0x7f23c01c9010 2021-04-09T18:34:09.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.932 7f23c4ddd700 1 -- 172.21.15.79:0/3950697470 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b0009920 con 0x7f23c01c9010 2021-04-09T18:34:09.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.932 7f23c4ddd700 1 -- 172.21.15.79:0/3950697470 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f23b0009cf0 con 0x7f23c01c9010 2021-04-09T18:34:09.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.932 7f23c803b700 1 -- 172.21.15.79:0/3950697470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23c01c9010 msgr2=0x7f23c01cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.932 7f23c803b700 1 --2- 172.21.15.79:0/3950697470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23c01c9010 0x7f23c01cb470 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f23b0002f30 tx=0x7f23b000bcf0).stop 2021-04-09T18:34:09.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.932 7f23c803b700 1 -- 172.21.15.79:0/3950697470 shutdown_connections 2021-04-09T18:34:09.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.932 7f23c803b700 1 --2- 172.21.15.79:0/3950697470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23c01c9010 0x7f23c01cb470 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.932 7f23c803b700 1 -- 172.21.15.79:0/3950697470 >> 172.21.15.79:0/3950697470 conn(0x7f23c00e5fd0 msgr2=0x7f23c00e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:09.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.932 7f23c803b700 1 -- 172.21.15.79:0/3950697470 shutdown_connections 2021-04-09T18:34:09.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.932 7f23c803b700 1 -- 172.21.15.79:0/3950697470 wait complete. 2021-04-09T18:34:09.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c803b700 1 Processor -- start 2021-04-09T18:34:09.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c803b700 1 -- start start 2021-04-09T18:34:09.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c803b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23c008e040 0x7f23c00bd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:09.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c803b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23c00d8760 0x7f23c00a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:09.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c803b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23c00bcd20 0x7f23c00d0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:09.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c803b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c00885b0 con 0x7f23c00d8760 2021-04-09T18:34:09.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c803b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c00e9f20 con 0x7f23c008e040 2021-04-09T18:34:09.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c803b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c008e640 con 0x7f23c00bcd20 2021-04-09T18:34:09.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c55de700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23c00d8760 0x7f23c00a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:09.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c55de700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23c00d8760 0x7f23c00a8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33416/0 (socket says 172.21.15.79:33416) 2021-04-09T18:34:09.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c55de700 1 -- 172.21.15.79:0/3108776037 learned_addr learned my addr 172.21.15.79:0/3108776037 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:09.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c5ddf700 1 --2- 172.21.15.79:0/3108776037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23c008e040 0x7f23c00bd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:09.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c65e0700 1 --2- 172.21.15.79:0/3108776037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23c00bcd20 0x7f23c00d0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:09.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c55de700 1 -- 172.21.15.79:0/3108776037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23c00bcd20 msgr2=0x7f23c00d0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c55de700 1 --2- 172.21.15.79:0/3108776037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23c00bcd20 0x7f23c00d0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c55de700 1 -- 172.21.15.79:0/3108776037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23c008e040 msgr2=0x7f23c00bd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:09.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c55de700 1 --2- 172.21.15.79:0/3108776037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23c008e040 0x7f23c00bd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:09.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c55de700 1 -- 172.21.15.79:0/3108776037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c00a91f0 con 0x7f23c00d8760 2021-04-09T18:34:09.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c65e0700 1 --2- 172.21.15.79:0/3108776037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23c00bcd20 0x7f23c00d0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:09.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c55de700 1 --2- 172.21.15.79:0/3108776037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23c00d8760 0x7f23c00a8bc0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7f23c00d56e0 tx=0x7f23bc00cec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:09.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23b67fc700 1 -- 172.21.15.79:0/3108776037 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f23c00a91f0 con 0x7f23c00d8760 2021-04-09T18:34:09.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c803b700 1 -- 172.21.15.79:0/3108776037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c00d0c80 con 0x7f23c00d8760 2021-04-09T18:34:09.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23b67fc700 1 -- 172.21.15.79:0/3108776037 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23bc00a7f0 con 0x7f23c00d8760 2021-04-09T18:34:09.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23b67fc700 1 -- 172.21.15.79:0/3108776037 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f23bc00a9d0 con 0x7f23c00d8760 2021-04-09T18:34:09.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.936 7f23c803b700 1 -- 172.21.15.79:0/3108776037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c0094a20 con 0x7f23c00d8760 2021-04-09T18:34:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.940 7f23b67fc700 1 -- 172.21.15.79:0/3108776037 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f23bc019020 con 0x7f23c00d8760 2021-04-09T18:34:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.940 7f23b67fc700 1 --2- 172.21.15.79:0/3108776037 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f23a0029100 0x7f23a002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.940 7f23b67fc700 1 -- 172.21.15.79:0/3108776037 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f23bc0391a0 con 0x7f23c00d8760 2021-04-09T18:34:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.940 7f23c5ddf700 1 --2- 172.21.15.79:0/3108776037 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f23a0029100 0x7f23a002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:09.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.940 7f23c5ddf700 1 --2- 172.21.15.79:0/3108776037 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f23a0029100 0x7f23a002b650 crc :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:09.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.944 7f23c803b700 1 -- 172.21.15.79:0/3108776037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c00e39d0 con 0x7f23c00d8760 2021-04-09T18:34:09.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:09.952 7f23b67fc700 1 -- 172.21.15.79:0/3108776037 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f23bc000f70 con 0x7f23c00d8760 2021-04-09T18:34:10.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.124 7f23c803b700 1 -- 172.21.15.79:0/3108776037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23c00f5b10 con 0x7f23c00d8760 2021-04-09T18:34:10.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.128 7f23b67fc700 1 -- 172.21.15.79:0/3108776037 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+14348 (secure 0 0 0) 0x7f23bc00a5e0 con 0x7f23c00d8760 2021-04-09T18:34:10.134 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:10.134 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":98,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:34:10.009667","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:34:07.761734","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2021-04-09 18:34:08.596089","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6835/2412239832":"2021-04-10 18:34:09.999325","172.21.15.89:6834/2412239832":"2021-04-10 18:34:09.999325"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:34:10.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.132 7f23c803b700 1 -- 172.21.15.79:0/3108776037 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f23a0029100 msgr2=0x7f23a002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:10.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.132 7f23c803b700 1 --2- 172.21.15.79:0/3108776037 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f23a0029100 0x7f23a002b650 crc :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.132 7f23c803b700 1 -- 172.21.15.79:0/3108776037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23c00d8760 msgr2=0x7f23c00a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:10.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.132 7f23c803b700 1 --2- 172.21.15.79:0/3108776037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23c00d8760 0x7f23c00a8bc0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7f23c00d56e0 tx=0x7f23bc00cec0).stop 2021-04-09T18:34:10.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.132 7f23c803b700 1 -- 172.21.15.79:0/3108776037 shutdown_connections 2021-04-09T18:34:10.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.132 7f23c803b700 1 --2- 172.21.15.79:0/3108776037 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f23a0029100 0x7f23a002b650 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.132 7f23c803b700 1 --2- 172.21.15.79:0/3108776037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23c008e040 0x7f23c00bd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.132 7f23c803b700 1 --2- 172.21.15.79:0/3108776037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23c00bcd20 0x7f23c00d0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.132 7f23c803b700 1 --2- 172.21.15.79:0/3108776037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23c00d8760 0x7f23c00a8bc0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.132 7f23c803b700 1 -- 172.21.15.79:0/3108776037 >> 172.21.15.79:0/3108776037 conn(0x7f23c00baee0 msgr2=0x7f23c00938e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:10.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.132 7f23c803b700 1 -- 172.21.15.79:0/3108776037 shutdown_connections 2021-04-09T18:34:10.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.132 7f23c803b700 1 -- 172.21.15.79:0/3108776037 wait complete. 2021-04-09T18:34:10.148 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-04-09T18:34:10.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.236 7f941c302700 1 Processor -- start 2021-04-09T18:34:10.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.236 7f941c302700 1 -- start start 2021-04-09T18:34:10.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.236 7f941c302700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94140f5550 0x7f94140f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:10.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.236 7f941c302700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f94140e9b10 0x7f941409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:10.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.236 7f941c302700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94140fbb50 con 0x7f94141c2de0 2021-04-09T18:34:10.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.236 7f941c302700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94140e9f60 con 0x7f94140e9b10 2021-04-09T18:34:10.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.236 7f941c302700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94140e5a00 con 0x7f94140f5550 2021-04-09T18:34:10.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.236 7f94198a5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f94140e9b10 0x7f941409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:10.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.236 7f941a8a7700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f94141c2de0 0x7f94141c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56368/0 (socket says 172.21.15.79:56368) 2021-04-09T18:34:10.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.236 7f941a8a7700 1 -- 172.21.15.79:0/3606500973 learned_addr learned my addr 172.21.15.79:0/3606500973 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f941a0a6700 1 --2- 172.21.15.79:0/3606500973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94140f5550 0x7f94140f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94190a4700 1 -- 172.21.15.79:0/3606500973 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419582376 0 0) 0x7f940c0010d0 con 0x7f94141c2de0 2021-04-09T18:34:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94190a4700 1 -- 172.21.15.79:0/3606500973 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93fc003240 con 0x7f94141c2de0 2021-04-09T18:34:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94190a4700 1 -- 172.21.15.79:0/3606500973 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 242919666 0 0) 0x7f940c001650 con 0x7f94141c2de0 2021-04-09T18:34:10.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94190a4700 1 -- 172.21.15.79:0/3606500973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94140f5550 msgr2=0x7f94140f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:10.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94190a4700 1 --2- 172.21.15.79:0/3606500973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94140f5550 0x7f94140f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94190a4700 1 -- 172.21.15.79:0/3606500973 >> v2:172.21.15.79:3300/0 conn(0x7f94140e9b10 msgr2=0x7f941409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:10.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94190a4700 1 --2- 172.21.15.79:0/3606500973 >> v2:172.21.15.79:3300/0 conn(0x7f94140e9b10 0x7f941409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94190a4700 1 -- 172.21.15.79:0/3606500973 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94140e5700 con 0x7f94141c2de0 2021-04-09T18:34:10.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94190a4700 1 -- 172.21.15.79:0/3606500973 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f940c001bb0 con 0x7f94141c2de0 2021-04-09T18:34:10.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94190a4700 1 -- 172.21.15.79:0/3606500973 >> v1:172.21.15.79:6789/0 conn(0x7f94141c2de0 legacy=0x7f94141c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:10.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94190a4700 1 --2- 172.21.15.79:0/3606500973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93fc0038c0 0x7f93fc003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:10.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94190a4700 1 --2- 172.21.15.79:0/3606500973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93fc0045a0 0x7f93fc0049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:10.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94190a4700 1 --2- 172.21.15.79:0/3606500973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93fc005020 0x7f93fc04f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:10.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94190a4700 1 -- 172.21.15.79:0/3606500973 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94140e9f60 con 0x7f93fc0045a0 2021-04-09T18:34:10.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94190a4700 1 -- 172.21.15.79:0/3606500973 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94140e5a00 con 0x7f93fc005020 2021-04-09T18:34:10.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94190a4700 1 -- 172.21.15.79:0/3606500973 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc04ffa0 con 0x7f93fc0038c0 2021-04-09T18:34:10.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94198a5700 1 --2- 172.21.15.79:0/3606500973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93fc0045a0 0x7f93fc0049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:10.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f941a0a6700 1 --2- 172.21.15.79:0/3606500973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93fc0038c0 0x7f93fc003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:10.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f941a8a7700 1 --2- 172.21.15.79:0/3606500973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93fc005020 0x7f93fc04f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:10.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94198a5700 1 -- 172.21.15.79:0/3606500973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93fc0038c0 msgr2=0x7f93fc003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:10.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94198a5700 1 --2- 172.21.15.79:0/3606500973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93fc0038c0 0x7f93fc003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94198a5700 1 -- 172.21.15.79:0/3606500973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93fc005020 msgr2=0x7f93fc04f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:10.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94198a5700 1 --2- 172.21.15.79:0/3606500973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93fc005020 0x7f93fc04f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94198a5700 1 -- 172.21.15.79:0/3606500973 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc050290 con 0x7f93fc0045a0 2021-04-09T18:34:10.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94198a5700 1 --2- 172.21.15.79:0/3606500973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93fc0045a0 0x7f93fc0049f0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f940800c000 tx=0x7f940800e1d0).ready entity=mon.0 client_cookie=6fef9dba78fbc279 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:10.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94190a4700 1 -- 172.21.15.79:0/3606500973 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f93fc050290 con 0x7f93fc0045a0 2021-04-09T18:34:10.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94190a4700 1 -- 172.21.15.79:0/3606500973 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940800ec90 con 0x7f93fc0045a0 2021-04-09T18:34:10.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f94190a4700 1 -- 172.21.15.79:0/3606500973 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f940800f040 con 0x7f93fc0045a0 2021-04-09T18:34:10.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f941c302700 1 -- 172.21.15.79:0/3606500973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93fc0045a0 msgr2=0x7f93fc0049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:10.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f941c302700 1 --2- 172.21.15.79:0/3606500973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93fc0045a0 0x7f93fc0049f0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f940800c000 tx=0x7f940800e1d0).stop 2021-04-09T18:34:10.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f941a8a7700 1 -- 172.21.15.79:0/3606500973 reap_dead start 2021-04-09T18:34:10.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f941c302700 1 -- 172.21.15.79:0/3606500973 shutdown_connections 2021-04-09T18:34:10.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f941c302700 1 -- 172.21.15.79:0/3606500973 >> 172.21.15.79:0/3606500973 conn(0x7f94140e6010 msgr2=0x7f94140e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:10.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f941c302700 1 -- 172.21.15.79:0/3606500973 shutdown_connections 2021-04-09T18:34:10.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.240 7f941c302700 1 -- 172.21.15.79:0/3606500973 wait complete. 2021-04-09T18:34:10.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941c302700 1 Processor -- start 2021-04-09T18:34:10.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941c302700 1 -- start start 2021-04-09T18:34:10.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941c302700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94141a15b0 0x7f94140b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:10.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941c302700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94141ad570 0x7f94141ad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:10.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941c302700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94140b5100 0x7f94140b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:10.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941c302700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941419fd50 con 0x7f94141a15b0 2021-04-09T18:34:10.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941c302700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941419ff80 con 0x7f94141ad570 2021-04-09T18:34:10.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941c302700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94140b5b80 con 0x7f94140b5100 2021-04-09T18:34:10.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941a0a6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94141a15b0 0x7f94140b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941a0a6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94141a15b0 0x7f94140b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33434/0 (socket says 172.21.15.79:33434) 2021-04-09T18:34:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941a0a6700 1 -- 172.21.15.79:0/834742549 learned_addr learned my addr 172.21.15.79:0/834742549 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f94198a5700 1 --2- 172.21.15.79:0/834742549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94141ad570 0x7f94141ad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:10.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941a8a7700 1 --2- 172.21.15.79:0/834742549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94140b5100 0x7f94140b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:10.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941a0a6700 1 -- 172.21.15.79:0/834742549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94140b5100 msgr2=0x7f94140b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:10.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941a0a6700 1 --2- 172.21.15.79:0/834742549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94140b5100 0x7f94140b5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941a0a6700 1 -- 172.21.15.79:0/834742549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94141ad570 msgr2=0x7f94141ad9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941a0a6700 1 --2- 172.21.15.79:0/834742549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94141ad570 0x7f94141ad9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941a0a6700 1 -- 172.21.15.79:0/834742549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94140b0c70 con 0x7f94141a15b0 2021-04-09T18:34:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941a8a7700 1 --2- 172.21.15.79:0/834742549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94140b5100 0x7f94140b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f94198a5700 1 --2- 172.21.15.79:0/834742549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94141ad570 0x7f94141ad9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941a0a6700 1 --2- 172.21.15.79:0/834742549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94141a15b0 0x7f94140b0640 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f94141a0180 tx=0x7f940400f520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f9412ffd700 1 -- 172.21.15.79:0/834742549 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f94140b0c70 con 0x7f94141a15b0 2021-04-09T18:34:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f9412ffd700 1 -- 172.21.15.79:0/834742549 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940400fd00 con 0x7f94141a15b0 2021-04-09T18:34:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f9412ffd700 1 -- 172.21.15.79:0/834742549 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f940400f040 con 0x7f94141a15b0 2021-04-09T18:34:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941c302700 1 -- 172.21.15.79:0/834742549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94140b10a0 con 0x7f94141a15b0 2021-04-09T18:34:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.244 7f941c302700 1 -- 172.21.15.79:0/834742549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94141a1a00 con 0x7f94141a15b0 2021-04-09T18:34:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.248 7f9412ffd700 1 -- 172.21.15.79:0/834742549 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9404014630 con 0x7f94141a15b0 2021-04-09T18:34:10.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.248 7f9412ffd700 1 --2- 172.21.15.79:0/834742549 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f93f4029100 0x7f93f402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:10.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.248 7f9412ffd700 1 -- 172.21.15.79:0/834742549 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f9404010040 con 0x7f94141a15b0 2021-04-09T18:34:10.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.248 7f94198a5700 1 --2- 172.21.15.79:0/834742549 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f93f4029100 0x7f93f402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:10.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.248 7f94198a5700 1 --2- 172.21.15.79:0/834742549 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f93f4029100 0x7f93f402b650 crc :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:10.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.252 7f941c302700 1 -- 172.21.15.79:0/834742549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94140e39f0 con 0x7f94141a15b0 2021-04-09T18:34:10.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.260 7f9412ffd700 1 -- 172.21.15.79:0/834742549 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f940400faf0 con 0x7f94141a15b0 2021-04-09T18:34:10.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.432 7f941c302700 1 -- 172.21.15.79:0/834742549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f94140f5b50 con 0x7f94141a15b0 2021-04-09T18:34:10.517 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:34:10.512 7fbcd0516700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:34:10.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.520 7f9412ffd700 1 -- 172.21.15.79:0/834742549 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v59) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9404000f70 con 0x7f94141a15b0 2021-04-09T18:34:10.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.548 7f941c302700 1 -- 172.21.15.79:0/834742549 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f93f4029100 msgr2=0x7f93f402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:10.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.548 7f941c302700 1 --2- 172.21.15.79:0/834742549 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f93f4029100 0x7f93f402b650 crc :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.548 7f941c302700 1 -- 172.21.15.79:0/834742549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94141a15b0 msgr2=0x7f94140b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:10.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.548 7f941c302700 1 --2- 172.21.15.79:0/834742549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94141a15b0 0x7f94140b0640 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f94141a0180 tx=0x7f940400f520).stop 2021-04-09T18:34:10.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.548 7f941c302700 1 -- 172.21.15.79:0/834742549 shutdown_connections 2021-04-09T18:34:10.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.548 7f941c302700 1 --2- 172.21.15.79:0/834742549 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f93f4029100 0x7f93f402b650 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.548 7f941c302700 1 --2- 172.21.15.79:0/834742549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94140b5100 0x7f94140b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.548 7f941c302700 1 --2- 172.21.15.79:0/834742549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94141a15b0 0x7f94140b0640 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.548 7f941c302700 1 --2- 172.21.15.79:0/834742549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94141ad570 0x7f94141ad9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.548 7f941c302700 1 -- 172.21.15.79:0/834742549 >> 172.21.15.79:0/834742549 conn(0x7f9414096ea0 msgr2=0x7f94140d8430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:10.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.548 7f941c302700 1 -- 172.21.15.79:0/834742549 shutdown_connections 2021-04-09T18:34:10.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.548 7f941c302700 1 -- 172.21.15.79:0/834742549 wait complete. 2021-04-09T18:34:10.565 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:34:10.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.656 7fe92d8cd700 1 Processor -- start 2021-04-09T18:34:10.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.656 7fe92d8cd700 1 -- start start 2021-04-09T18:34:10.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.656 7fe92d8cd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9280e9ad0 0x7fe92809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:10.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.656 7fe92d8cd700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9280fbb10 con 0x7fe9281c8000 2021-04-09T18:34:10.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.656 7fe92d8cd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9280e56c0 con 0x7fe9280f5510 2021-04-09T18:34:10.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.656 7fe92d8cd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9281c3db0 con 0x7fe9280e9ad0 2021-04-09T18:34:10.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.656 7fe927d51700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe9281c8000 0x7fe9281ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56388/0 (socket says 172.21.15.79:56388) 2021-04-09T18:34:10.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.656 7fe927d51700 1 -- 172.21.15.79:0/3178520834 learned_addr learned my addr 172.21.15.79:0/3178520834 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:10.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.656 7fe91ed4f700 1 --2- 172.21.15.79:0/3178520834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9280e9ad0 0x7fe92809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:10.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.656 7fe926d4f700 1 -- 172.21.15.79:0/3178520834 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 680745581 0 0) 0x7fe920001450 con 0x7fe9281c8000 2021-04-09T18:34:10.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.656 7fe926d4f700 1 -- 172.21.15.79:0/3178520834 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe914003240 con 0x7fe9281c8000 2021-04-09T18:34:10.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.656 7fe926d4f700 1 -- 172.21.15.79:0/3178520834 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193483057 0 0) 0x7fe9180010d0 con 0x7fe9280f5510 2021-04-09T18:34:10.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.656 7fe926d4f700 1 -- 172.21.15.79:0/3178520834 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe914003620 con 0x7fe9280f5510 2021-04-09T18:34:10.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.656 7fe926d4f700 1 -- 172.21.15.79:0/3178520834 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 29131716 0 0) 0x7fe9200019d0 con 0x7fe9281c8000 2021-04-09T18:34:10.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.656 7fe91ed4f700 1 -- 172.21.15.79:0/3178520834 >> v1:172.21.15.89:6789/0 conn(0x7fe9280f5510 legacy=0x7fe9280f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:10.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.656 7fe91ed4f700 1 -- 172.21.15.79:0/3178520834 >> v1:172.21.15.79:6789/0 conn(0x7fe9281c8000 legacy=0x7fe9281ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:10.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.656 7fe91ed4f700 1 -- 172.21.15.79:0/3178520834 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9280e4320 con 0x7fe9280e9ad0 2021-04-09T18:34:10.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.656 7fe91ed4f700 1 --2- 172.21.15.79:0/3178520834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9280e9ad0 0x7fe92809f100 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fe920001d00 tx=0x7fe91000bcf0).ready entity=mon.2 client_cookie=489122873ea3f83 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:10.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.660 7fe926d4f700 1 -- 172.21.15.79:0/3178520834 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe9280e4320 con 0x7fe9280e9ad0 2021-04-09T18:34:10.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.660 7fe926d4f700 1 -- 172.21.15.79:0/3178520834 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe910009790 con 0x7fe9280e9ad0 2021-04-09T18:34:10.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.660 7fe926d4f700 1 -- 172.21.15.79:0/3178520834 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe920001f30 con 0x7fe9280e9ad0 2021-04-09T18:34:10.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.660 7fe92d8cd700 1 -- 172.21.15.79:0/3178520834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9280e9ad0 msgr2=0x7fe92809f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:10.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.660 7fe92d8cd700 1 --2- 172.21.15.79:0/3178520834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9280e9ad0 0x7fe92809f100 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fe920001d00 tx=0x7fe91000bcf0).stop 2021-04-09T18:34:10.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.660 7fe92d8cd700 1 -- 172.21.15.79:0/3178520834 shutdown_connections 2021-04-09T18:34:10.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.660 7fe92d8cd700 1 --2- 172.21.15.79:0/3178520834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9280e9ad0 0x7fe92809f100 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.660 7fe92d8cd700 1 -- 172.21.15.79:0/3178520834 >> 172.21.15.79:0/3178520834 conn(0x7fe9280e5fd0 msgr2=0x7fe9280e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:10.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.660 7fe92d8cd700 1 -- 172.21.15.79:0/3178520834 shutdown_connections 2021-04-09T18:34:10.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.660 7fe92d8cd700 1 -- 172.21.15.79:0/3178520834 wait complete. 2021-04-09T18:34:10.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe92d8cd700 1 Processor -- start 2021-04-09T18:34:10.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe92d8cd700 1 -- start start 2021-04-09T18:34:10.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe92d8cd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9280aa6d0 0x7fe9280abc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:10.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe92d8cd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9280d7520 0x7fe9280d7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:10.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe92d8cd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9281b1aa0 0x7fe9281b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:10.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe92d8cd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280e9f20 con 0x7fe9280d7520 2021-04-09T18:34:10.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe92d8cd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280aa3d0 con 0x7fe9280aa6d0 2021-04-09T18:34:10.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe92d8cd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280a9c60 con 0x7fe9281b1aa0 2021-04-09T18:34:10.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe91ed4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9280d7520 0x7fe9280d7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:10.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe91ed4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9280d7520 0x7fe9280d7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33454/0 (socket says 172.21.15.79:33454) 2021-04-09T18:34:10.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe927d51700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9281b1aa0 0x7fe9281b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:10.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe91ed4f700 1 -- 172.21.15.79:0/2271680048 learned_addr learned my addr 172.21.15.79:0/2271680048 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:10.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe927550700 1 --2- 172.21.15.79:0/2271680048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9280aa6d0 0x7fe9280abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:10.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe927d51700 1 -- 172.21.15.79:0/2271680048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9280aa6d0 msgr2=0x7fe9280abc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:10.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe927d51700 1 --2- 172.21.15.79:0/2271680048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9280aa6d0 0x7fe9280abc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe927d51700 1 -- 172.21.15.79:0/2271680048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9280d7520 msgr2=0x7fe9280d7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:10.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe927d51700 1 --2- 172.21.15.79:0/2271680048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9280d7520 0x7fe9280d7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe927d51700 1 -- 172.21.15.79:0/2271680048 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9281af690 con 0x7fe9281b1aa0 2021-04-09T18:34:10.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe91ed4f700 1 --2- 172.21.15.79:0/2271680048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9280d7520 0x7fe9280d7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:10.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe927d51700 1 --2- 172.21.15.79:0/2271680048 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9281b1aa0 0x7fe9281b1ef0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fe9280bb540 tx=0x7fe92000ce60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:10.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe924d4b700 1 -- 172.21.15.79:0/2271680048 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe9281af690 con 0x7fe9281b1aa0 2021-04-09T18:34:10.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe924d4b700 1 -- 172.21.15.79:0/2271680048 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe920004a90 con 0x7fe9281b1aa0 2021-04-09T18:34:10.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe924d4b700 1 -- 172.21.15.79:0/2271680048 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe920007170 con 0x7fe9281b1aa0 2021-04-09T18:34:10.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe92d8cd700 1 -- 172.21.15.79:0/2271680048 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9280a9f80 con 0x7fe9281b1aa0 2021-04-09T18:34:10.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.664 7fe92d8cd700 1 -- 172.21.15.79:0/2271680048 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9281b2520 con 0x7fe9281b1aa0 2021-04-09T18:34:10.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.668 7fe924d4b700 1 -- 172.21.15.79:0/2271680048 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe920007370 con 0x7fe9281b1aa0 2021-04-09T18:34:10.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.668 7fe924d4b700 1 --2- 172.21.15.79:0/2271680048 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe90c029100 0x7fe90c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:10.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.668 7fe924d4b700 1 -- 172.21.15.79:0/2271680048 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fe920039360 con 0x7fe9281b1aa0 2021-04-09T18:34:10.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.668 7fe927550700 1 --2- 172.21.15.79:0/2271680048 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe90c029100 0x7fe90c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:10.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.668 7fe927550700 1 --2- 172.21.15.79:0/2271680048 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe90c029100 0x7fe90c02b650 crc :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:10.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.668 7fe92d8cd700 1 -- 172.21.15.79:0/2271680048 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9280e39d0 con 0x7fe9281b1aa0 2021-04-09T18:34:10.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.676 7fe924d4b700 1 -- 172.21.15.79:0/2271680048 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe920004880 con 0x7fe9281b1aa0 2021-04-09T18:34:10.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.848 7fe92d8cd700 1 -- 172.21.15.79:0/2271680048 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9280a1cb0 con 0x7fe9281b1aa0 2021-04-09T18:34:10.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.848 7fe924d4b700 1 -- 172.21.15.79:0/2271680048 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+2100 (secure 0 0 0) 0x7fe9280f76b0 con 0x7fe9281b1aa0 2021-04-09T18:34:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:10.857 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":60,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7155,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/1349682878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1349682878},{"type":"v1","addr":"172.21.15.79:6833","nonce":1349682878}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":59}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:34:09.512814","modified":"2021-04-09 18:34:10.523650","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7147":{"gid":7147,"name":"b","rank":0,"incarnation":60,"state":"up:creating","state_seq":2,"addr":"172.21.15.89:6835/57205751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":57205751},{"type":"v1","addr":"172.21.15.89:6835","nonce":57205751}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-04-09T18:34:10.858 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 60 2021-04-09T18:34:10.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.856 7fe92d8cd700 1 -- 172.21.15.79:0/2271680048 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe90c029100 msgr2=0x7fe90c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:10.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.856 7fe92d8cd700 1 --2- 172.21.15.79:0/2271680048 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe90c029100 0x7fe90c02b650 crc :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.856 7fe92d8cd700 1 -- 172.21.15.79:0/2271680048 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9281b1aa0 msgr2=0x7fe9281b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:10.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.856 7fe92d8cd700 1 --2- 172.21.15.79:0/2271680048 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9281b1aa0 0x7fe9281b1ef0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fe9280bb540 tx=0x7fe92000ce60).stop 2021-04-09T18:34:10.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.856 7fe92d8cd700 1 -- 172.21.15.79:0/2271680048 shutdown_connections 2021-04-09T18:34:10.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.856 7fe92d8cd700 1 --2- 172.21.15.79:0/2271680048 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe90c029100 0x7fe90c02b650 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.856 7fe92d8cd700 1 --2- 172.21.15.79:0/2271680048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9280aa6d0 0x7fe9280abc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.856 7fe92d8cd700 1 --2- 172.21.15.79:0/2271680048 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9281b1aa0 0x7fe9281b1ef0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.856 7fe92d8cd700 1 --2- 172.21.15.79:0/2271680048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9280d7520 0x7fe9280d7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.856 7fe92d8cd700 1 -- 172.21.15.79:0/2271680048 >> 172.21.15.79:0/2271680048 conn(0x7fe92809b280 msgr2=0x7fe92809a900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:10.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.856 7fe92d8cd700 1 -- 172.21.15.79:0/2271680048 shutdown_connections 2021-04-09T18:34:10.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.856 7fe92d8cd700 1 -- 172.21.15.79:0/2271680048 wait complete. 2021-04-09T18:34:10.869 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:34:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.956 7f49bc1ce700 1 Processor -- start 2021-04-09T18:34:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.956 7f49bc1ce700 1 -- start start 2021-04-09T18:34:10.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.956 7f49bc1ce700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49b40e9ad0 0x7f49b409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:10.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.956 7f49bc1ce700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b40fbb10 con 0x7f49b41c8000 2021-04-09T18:34:10.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.956 7f49bc1ce700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b40e56c0 con 0x7f49b40f5510 2021-04-09T18:34:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.956 7f49bc1ce700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b41c3db0 con 0x7f49b40e9ad0 2021-04-09T18:34:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.956 7f49ba773700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f49b41c8000 0x7f49b41ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56402/0 (socket says 172.21.15.79:56402) 2021-04-09T18:34:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.956 7f49ba773700 1 -- 172.21.15.79:0/2869987020 learned_addr learned my addr 172.21.15.79:0/2869987020 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.956 7f49b9771700 1 --2- 172.21.15.79:0/2869987020 >> v2:172.21.15.89:3300/0 conn(0x7f49b40e9ad0 0x7f49b409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.956 7f49b8f70700 1 -- 172.21.15.79:0/2869987020 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3633721580 0 0) 0x7f49ac001450 con 0x7f49b41c8000 2021-04-09T18:34:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.956 7f49b8f70700 1 -- 172.21.15.79:0/2869987020 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49a0003240 con 0x7f49b41c8000 2021-04-09T18:34:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.956 7f49b9771700 1 -- 172.21.15.79:0/2869987020 >> v1:172.21.15.89:6789/0 conn(0x7f49b40f5510 legacy=0x7f49b40f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.956 7f49b9771700 1 -- 172.21.15.79:0/2869987020 >> v1:172.21.15.79:6789/0 conn(0x7f49b41c8000 legacy=0x7f49b41ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.956 7f49b9771700 1 -- 172.21.15.79:0/2869987020 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b40e4320 con 0x7f49b40e9ad0 2021-04-09T18:34:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.956 7f49b9771700 1 --2- 172.21.15.79:0/2869987020 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49b40e9ad0 0x7f49b409f100 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f49a8002f30 tx=0x7f49a800bcc0).ready entity=mon.1 client_cookie=338a27a2183812fe server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.960 7f49b8f70700 1 -- 172.21.15.79:0/2869987020 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f49b40e4320 con 0x7f49b40e9ad0 2021-04-09T18:34:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.960 7f49b8f70700 1 -- 172.21.15.79:0/2869987020 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a8009800 con 0x7f49b40e9ad0 2021-04-09T18:34:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.960 7f49b8f70700 1 -- 172.21.15.79:0/2869987020 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f49a8009bd0 con 0x7f49b40e9ad0 2021-04-09T18:34:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.960 7f49bc1ce700 1 -- 172.21.15.79:0/2869987020 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49b40e9ad0 msgr2=0x7f49b409f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.960 7f49bc1ce700 1 --2- 172.21.15.79:0/2869987020 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49b40e9ad0 0x7f49b409f100 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f49a8002f30 tx=0x7f49a800bcc0).stop 2021-04-09T18:34:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.960 7f49bc1ce700 1 -- 172.21.15.79:0/2869987020 shutdown_connections 2021-04-09T18:34:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.960 7f49bc1ce700 1 --2- 172.21.15.79:0/2869987020 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49b40e9ad0 0x7f49b409f100 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.960 7f49bc1ce700 1 -- 172.21.15.79:0/2869987020 >> 172.21.15.79:0/2869987020 conn(0x7f49b40e5fd0 msgr2=0x7f49b40e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.960 7f49bc1ce700 1 -- 172.21.15.79:0/2869987020 shutdown_connections 2021-04-09T18:34:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.960 7f49bc1ce700 1 -- 172.21.15.79:0/2869987020 wait complete. 2021-04-09T18:34:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49bc1ce700 1 Processor -- start 2021-04-09T18:34:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49bc1ce700 1 -- start start 2021-04-09T18:34:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49bc1ce700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49b419c430 0x7f49b4096b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49bc1ce700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49b419b9d0 0x7f49b419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49bc1ce700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49b419d4d0 0x7f49b40c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49bc1ce700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b40e9f20 con 0x7f49b419c430 2021-04-09T18:34:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49bc1ce700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b419cba0 con 0x7f49b419d4d0 2021-04-09T18:34:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49bc1ce700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b40c41e0 con 0x7f49b419b9d0 2021-04-09T18:34:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49b9f72700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49b419c430 0x7f49b4096b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49b9f72700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49b419c430 0x7f49b4096b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33464/0 (socket says 172.21.15.79:33464) 2021-04-09T18:34:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49b9f72700 1 -- 172.21.15.79:0/4270592460 learned_addr learned my addr 172.21.15.79:0/4270592460 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49ba773700 1 --2- 172.21.15.79:0/4270592460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49b419d4d0 0x7f49b40c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49b9771700 1 --2- 172.21.15.79:0/4270592460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49b419b9d0 0x7f49b419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49b9f72700 1 -- 172.21.15.79:0/4270592460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49b419b9d0 msgr2=0x7f49b419cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49b9f72700 1 --2- 172.21.15.79:0/4270592460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49b419b9d0 0x7f49b419cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49b9f72700 1 -- 172.21.15.79:0/4270592460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49b419d4d0 msgr2=0x7f49b40c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49b9f72700 1 --2- 172.21.15.79:0/4270592460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49b419d4d0 0x7f49b40c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49b9f72700 1 -- 172.21.15.79:0/4270592460 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b40ac230 con 0x7f49b419c430 2021-04-09T18:34:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49b9f72700 1 --2- 172.21.15.79:0/4270592460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49b419c430 0x7f49b4096b60 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f49b419cb20 tx=0x7f49b000cb60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49a67fc700 1 -- 172.21.15.79:0/4270592460 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f49b40ac230 con 0x7f49b419c430 2021-04-09T18:34:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49a67fc700 1 -- 172.21.15.79:0/4270592460 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b0010510 con 0x7f49b419c430 2021-04-09T18:34:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49bc1ce700 1 -- 172.21.15.79:0/4270592460 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b419be20 con 0x7f49b419c430 2021-04-09T18:34:10.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49a67fc700 1 -- 172.21.15.79:0/4270592460 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f49b00106f0 con 0x7f49b419c430 2021-04-09T18:34:10.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49bc1ce700 1 -- 172.21.15.79:0/4270592460 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b40c72f0 con 0x7f49b419c430 2021-04-09T18:34:10.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49a67fc700 1 -- 172.21.15.79:0/4270592460 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f49b0019020 con 0x7f49b419c430 2021-04-09T18:34:10.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49a67fc700 1 --2- 172.21.15.79:0/4270592460 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f499c029100 0x7f499c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:10.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.964 7f49a67fc700 1 -- 172.21.15.79:0/4270592460 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f49b0038f20 con 0x7f49b419c430 2021-04-09T18:34:10.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.968 7f49b9771700 1 --2- 172.21.15.79:0/4270592460 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f499c029100 0x7f499c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:10.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.968 7f49b9771700 1 --2- 172.21.15.79:0/4270592460 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f499c029100 0x7f499c02b650 crc :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:10.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.968 7f49bc1ce700 1 -- 172.21.15.79:0/4270592460 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b40e39d0 con 0x7f49b419c430 2021-04-09T18:34:10.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:10.976 7f49a67fc700 1 -- 172.21.15.79:0/4270592460 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f49b0010300 con 0x7f49b419c430 2021-04-09T18:34:11.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.136 7f49bc1ce700 1 -- 172.21.15.79:0/4270592460 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49b40a1cb0 con 0x7f49b419c430 2021-04-09T18:34:11.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.136 7f49a67fc700 1 -- 172.21.15.79:0/4270592460 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+14348 (secure 0 0 0) 0x7f49b4107f40 con 0x7f49b419c430 2021-04-09T18:34:11.143 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:11.144 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":98,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:34:10.009667","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:34:07.761734","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2021-04-09 18:34:08.596089","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6835/2412239832":"2021-04-10 18:34:09.999325","172.21.15.89:6834/2412239832":"2021-04-10 18:34:09.999325"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:34:11.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.140 7f49bc1ce700 1 -- 172.21.15.79:0/4270592460 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f499c029100 msgr2=0x7f499c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:11.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.140 7f49bc1ce700 1 --2- 172.21.15.79:0/4270592460 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f499c029100 0x7f499c02b650 crc :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.140 7f49bc1ce700 1 -- 172.21.15.79:0/4270592460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49b419c430 msgr2=0x7f49b4096b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:11.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.140 7f49bc1ce700 1 --2- 172.21.15.79:0/4270592460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49b419c430 0x7f49b4096b60 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f49b419cb20 tx=0x7f49b000cb60).stop 2021-04-09T18:34:11.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.140 7f49bc1ce700 1 -- 172.21.15.79:0/4270592460 shutdown_connections 2021-04-09T18:34:11.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.140 7f49bc1ce700 1 --2- 172.21.15.79:0/4270592460 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f499c029100 0x7f499c02b650 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.140 7f49bc1ce700 1 --2- 172.21.15.79:0/4270592460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49b419d4d0 0x7f49b40c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.140 7f49bc1ce700 1 --2- 172.21.15.79:0/4270592460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49b419c430 0x7f49b4096b60 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.140 7f49bc1ce700 1 --2- 172.21.15.79:0/4270592460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49b419b9d0 0x7f49b419cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.140 7f49bc1ce700 1 -- 172.21.15.79:0/4270592460 >> 172.21.15.79:0/4270592460 conn(0x7f49b409b0b0 msgr2=0x7f49b409a610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:11.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.140 7f49bc1ce700 1 -- 172.21.15.79:0/4270592460 shutdown_connections 2021-04-09T18:34:11.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.140 7f49bc1ce700 1 -- 172.21.15.79:0/4270592460 wait complete. 2021-04-09T18:34:11.157 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:34:11.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f100699c700 1 Processor -- start 2021-04-09T18:34:11.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f100699c700 1 -- start start 2021-04-09T18:34:11.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f100699c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10001c8e50 0x7f10001cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f100699c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10000fbb80 con 0x7f10000f5580 2021-04-09T18:34:11.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f100699c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f100009f910 con 0x7f10000e9b40 2021-04-09T18:34:11.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f100699c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10000e9f90 con 0x7f10001c8e50 2021-04-09T18:34:11.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f10000f5580 0x7f10000f6510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56416/0 (socket says 172.21.15.79:56416) 2021-04-09T18:34:11.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffffff700 1 -- 172.21.15.79:0/3139257937 learned_addr learned my addr 172.21.15.79:0/3139257937 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:11.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f1004f41700 1 --2- 172.21.15.79:0/3139257937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10001c8e50 0x7f10001cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffeffd700 1 -- 172.21.15.79:0/3139257937 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593663854 0 0) 0x7f0ff00010d0 con 0x7f10000f5580 2021-04-09T18:34:11.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffeffd700 1 -- 172.21.15.79:0/3139257937 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fe0003240 con 0x7f10000f5580 2021-04-09T18:34:11.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffeffd700 1 -- 172.21.15.79:0/3139257937 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 873796472 0 0) 0x7f0ff0001650 con 0x7f10000f5580 2021-04-09T18:34:11.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffeffd700 1 -- 172.21.15.79:0/3139257937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10001c8e50 msgr2=0x7f10001cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:11.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffeffd700 1 --2- 172.21.15.79:0/3139257937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10001c8e50 0x7f10001cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffeffd700 1 -- 172.21.15.79:0/3139257937 >> v1:172.21.15.89:6789/0 conn(0x7f10000e9b40 legacy=0x7f100009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:11.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffeffd700 1 -- 172.21.15.79:0/3139257937 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10000e56b0 con 0x7f10000f5580 2021-04-09T18:34:11.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffeffd700 1 -- 172.21.15.79:0/3139257937 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f0ff0001bb0 con 0x7f10000f5580 2021-04-09T18:34:11.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffeffd700 1 -- 172.21.15.79:0/3139257937 >> v1:172.21.15.79:6789/0 conn(0x7f10000f5580 legacy=0x7f10000f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:11.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffeffd700 1 --2- 172.21.15.79:0/3139257937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fe00038f0 0x7f0fe0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffeffd700 1 --2- 172.21.15.79:0/3139257937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fe00045a0 0x7f0fe00049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffeffd700 1 --2- 172.21.15.79:0/3139257937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fe00097e0 0x7f0fe000bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffeffd700 1 -- 172.21.15.79:0/3139257937 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10000e9f90 con 0x7f0fe00038f0 2021-04-09T18:34:11.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffeffd700 1 -- 172.21.15.79:0/3139257937 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe0005270 con 0x7f0fe00045a0 2021-04-09T18:34:11.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffeffd700 1 -- 172.21.15.79:0/3139257937 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe000c270 con 0x7f0fe00097e0 2021-04-09T18:34:11.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffffff700 1 --2- 172.21.15.79:0/3139257937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fe00038f0 0x7f0fe0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0fff7fe700 1 --2- 172.21.15.79:0/3139257937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fe00045a0 0x7f0fe00049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f1004f41700 1 --2- 172.21.15.79:0/3139257937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fe00097e0 0x7f0fe000bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffffff700 1 -- 172.21.15.79:0/3139257937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fe00097e0 msgr2=0x7f0fe000bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:11.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffffff700 1 --2- 172.21.15.79:0/3139257937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fe00097e0 0x7f0fe000bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffffff700 1 -- 172.21.15.79:0/3139257937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fe00045a0 msgr2=0x7f0fe00049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:11.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffffff700 1 --2- 172.21.15.79:0/3139257937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fe00045a0 0x7f0fe00049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffffff700 1 -- 172.21.15.79:0/3139257937 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe000c420 con 0x7f0fe00038f0 2021-04-09T18:34:11.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffffff700 1 --2- 172.21.15.79:0/3139257937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fe00038f0 0x7f0fe0003da0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f0ff0001db0 tx=0x7f0ff0005260).ready entity=mon.0 client_cookie=1d2f083c00cf74ee server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:11.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffeffd700 1 -- 172.21.15.79:0/3139257937 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0fe000c420 con 0x7f0fe00038f0 2021-04-09T18:34:11.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffeffd700 1 -- 172.21.15.79:0/3139257937 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff00070d0 con 0x7f0fe00038f0 2021-04-09T18:34:11.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f0ffeffd700 1 -- 172.21.15.79:0/3139257937 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f10000e56b0 con 0x7f0fe00038f0 2021-04-09T18:34:11.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f100699c700 1 -- 172.21.15.79:0/3139257937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fe00038f0 msgr2=0x7f0fe0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:11.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f100699c700 1 --2- 172.21.15.79:0/3139257937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fe00038f0 0x7f0fe0003da0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f0ff0001db0 tx=0x7f0ff0005260).stop 2021-04-09T18:34:11.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.244 7f1004f41700 1 -- 172.21.15.79:0/3139257937 reap_dead start 2021-04-09T18:34:11.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.248 7f100699c700 1 -- 172.21.15.79:0/3139257937 shutdown_connections 2021-04-09T18:34:11.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.248 7f100699c700 1 -- 172.21.15.79:0/3139257937 >> 172.21.15.79:0/3139257937 conn(0x7f10000e6040 msgr2=0x7f10000e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:11.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.248 7f100699c700 1 -- 172.21.15.79:0/3139257937 shutdown_connections 2021-04-09T18:34:11.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.248 7f100699c700 1 -- 172.21.15.79:0/3139257937 wait complete. 2021-04-09T18:34:11.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f100699c700 1 Processor -- start 2021-04-09T18:34:11.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f100699c700 1 -- start start 2021-04-09T18:34:11.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f100699c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10000c33b0 0x7f10000b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f100699c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10000b1920 0x7f10000a2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f100699c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10000b1d70 0x7f10000a2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f100699c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1000099ec0 con 0x7f10000b1d70 2021-04-09T18:34:11.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f100699c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100009a1c0 con 0x7f10000c33b0 2021-04-09T18:34:11.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f100699c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10000b8e50 con 0x7f10000b1920 2021-04-09T18:34:11.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f1004f41700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10000b1d70 0x7f10000a2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f1004f41700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10000b1d70 0x7f10000a2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33488/0 (socket says 172.21.15.79:33488) 2021-04-09T18:34:11.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f1004f41700 1 -- 172.21.15.79:0/3497266848 learned_addr learned my addr 172.21.15.79:0/3497266848 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:11.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f0ffffff700 1 --2- 172.21.15.79:0/3497266848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10000c33b0 0x7f10000b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f0fff7fe700 1 --2- 172.21.15.79:0/3497266848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10000b1920 0x7f10000a2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f1004f41700 1 -- 172.21.15.79:0/3497266848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10000b1920 msgr2=0x7f10000a2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:11.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f1004f41700 1 --2- 172.21.15.79:0/3497266848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10000b1920 0x7f10000a2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f1004f41700 1 -- 172.21.15.79:0/3497266848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10000c33b0 msgr2=0x7f10000b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:11.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f1004f41700 1 --2- 172.21.15.79:0/3497266848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10000c33b0 0x7f10000b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f1004f41700 1 -- 172.21.15.79:0/3497266848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1000099a50 con 0x7f10000b1d70 2021-04-09T18:34:11.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f1004f41700 1 --2- 172.21.15.79:0/3497266848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10000b1d70 0x7f10000a2aa0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f10000b2b00 tx=0x7f0ff800d830).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:11.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f0ffcff9700 1 -- 172.21.15.79:0/3497266848 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1000099a50 con 0x7f10000b1d70 2021-04-09T18:34:11.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f0ffcff9700 1 -- 172.21.15.79:0/3497266848 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff8013800 con 0x7f10000b1d70 2021-04-09T18:34:11.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f0ffcff9700 1 -- 172.21.15.79:0/3497266848 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ff8018070 con 0x7f10000b1d70 2021-04-09T18:34:11.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f100699c700 1 -- 172.21.15.79:0/3497266848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10000c3800 con 0x7f10000b1d70 2021-04-09T18:34:11.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.252 7f100699c700 1 -- 172.21.15.79:0/3497266848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10000991f0 con 0x7f10000b1d70 2021-04-09T18:34:11.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.256 7f0ffcff9700 1 -- 172.21.15.79:0/3497266848 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0ff8013bd0 con 0x7f10000b1d70 2021-04-09T18:34:11.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.256 7f0ffcff9700 1 --2- 172.21.15.79:0/3497266848 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0fd8029100 0x7f0fd802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.256 7f0ffcff9700 1 -- 172.21.15.79:0/3497266848 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f0ff8039270 con 0x7f10000b1d70 2021-04-09T18:34:11.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.256 7f0ffffff700 1 --2- 172.21.15.79:0/3497266848 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0fd8029100 0x7f0fd802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.256 7f0ffffff700 1 --2- 172.21.15.79:0/3497266848 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0fd8029100 0x7f0fd802b650 crc :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:11.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.256 7f100699c700 1 -- 172.21.15.79:0/3497266848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1000088d30 con 0x7f10000b1d70 2021-04-09T18:34:11.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.264 7f0ffcff9700 1 -- 172.21.15.79:0/3497266848 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0ff8013400 con 0x7f10000b1d70 2021-04-09T18:34:11.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.424 7f100699c700 1 -- 172.21.15.79:0/3497266848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f10000e39a0 con 0x7f10000b1d70 2021-04-09T18:34:11.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.428 7f0ffcff9700 1 -- 172.21.15.79:0/3497266848 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v30) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0ff8000bf0 con 0x7f10000b1d70 2021-04-09T18:34:11.476 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2021-04-09T18:34:11.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.432 7f100699c700 1 -- 172.21.15.79:0/3497266848 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0fd8029100 msgr2=0x7f0fd802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:11.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.432 7f100699c700 1 --2- 172.21.15.79:0/3497266848 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0fd8029100 0x7f0fd802b650 crc :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.432 7f100699c700 1 -- 172.21.15.79:0/3497266848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10000b1d70 msgr2=0x7f10000a2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:11.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.432 7f100699c700 1 --2- 172.21.15.79:0/3497266848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10000b1d70 0x7f10000a2aa0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f10000b2b00 tx=0x7f0ff800d830).stop 2021-04-09T18:34:11.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.432 7f100699c700 1 -- 172.21.15.79:0/3497266848 shutdown_connections 2021-04-09T18:34:11.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.432 7f100699c700 1 --2- 172.21.15.79:0/3497266848 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0fd8029100 0x7f0fd802b650 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.432 7f100699c700 1 --2- 172.21.15.79:0/3497266848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10000c33b0 0x7f10000b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.432 7f100699c700 1 --2- 172.21.15.79:0/3497266848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10000b1d70 0x7f10000a2aa0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.432 7f100699c700 1 --2- 172.21.15.79:0/3497266848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10000b1920 0x7f10000a2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.432 7f100699c700 1 -- 172.21.15.79:0/3497266848 >> 172.21.15.79:0/3497266848 conn(0x7f10000d8640 msgr2=0x7f10000b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:11.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.432 7f100699c700 1 -- 172.21.15.79:0/3497266848 shutdown_connections 2021-04-09T18:34:11.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.432 7f100699c700 1 -- 172.21.15.79:0/3497266848 wait complete. 2021-04-09T18:34:11.479 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:34:11.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.576 7f67fa1a8700 1 Processor -- start 2021-04-09T18:34:11.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.576 7f67fa1a8700 1 -- start start 2021-04-09T18:34:11.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.576 7f67fa1a8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f67f40e9b40 0x7f67f409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.576 7f67fa1a8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67f41c7e40 0x7f67f41ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.576 7f67fa1a8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f40fbb80 con 0x7f67f40f5580 2021-04-09T18:34:11.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.576 7f67fa1a8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f40e9f90 con 0x7f67f40e9b40 2021-04-09T18:34:11.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.576 7f67fa1a8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f40e59b0 con 0x7f67f41c7e40 2021-04-09T18:34:11.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.576 7f67f37fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f67f40f5580 0x7f67f40f6510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56436/0 (socket says 172.21.15.79:56436) 2021-04-09T18:34:11.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.576 7f67f37fe700 1 -- 172.21.15.79:0/253701151 learned_addr learned my addr 172.21.15.79:0/253701151 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:11.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67f2ffd700 1 --2- 172.21.15.79:0/253701151 >> v2:172.21.15.89:3300/0 conn(0x7f67f40e9b40 0x7f67f409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67f3fff700 1 --2- 172.21.15.79:0/253701151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67f41c7e40 0x7f67f41ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67f27fc700 1 -- 172.21.15.79:0/253701151 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170565897 0 0) 0x7f67e40010d0 con 0x7f67f40f5580 2021-04-09T18:34:11.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67f27fc700 1 -- 172.21.15.79:0/253701151 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67e0003240 con 0x7f67f40f5580 2021-04-09T18:34:11.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67f27fc700 1 -- 172.21.15.79:0/253701151 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4029643453 0 0) 0x7f67e4001650 con 0x7f67f40f5580 2021-04-09T18:34:11.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67f2ffd700 1 -- 172.21.15.79:0/253701151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67f41c7e40 msgr2=0x7f67f41ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:11.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67f2ffd700 1 --2- 172.21.15.79:0/253701151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67f41c7e40 0x7f67f41ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67f2ffd700 1 -- 172.21.15.79:0/253701151 >> v1:172.21.15.79:6789/0 conn(0x7f67f40f5580 legacy=0x7f67f40f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:11.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67f2ffd700 1 -- 172.21.15.79:0/253701151 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f40e56b0 con 0x7f67f40e9b40 2021-04-09T18:34:11.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67f2ffd700 1 --2- 172.21.15.79:0/253701151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67f40e9b40 0x7f67f409f110 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f67e4001df0 tx=0x7f67dc00b3c0).ready entity=mon.1 client_cookie=64482aa2eaaf2994 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:11.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67f27fc700 1 -- 172.21.15.79:0/253701151 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67f40e56b0 con 0x7f67f40e9b40 2021-04-09T18:34:11.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67f27fc700 1 -- 172.21.15.79:0/253701151 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67dc00bae0 con 0x7f67f40e9b40 2021-04-09T18:34:11.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67f27fc700 1 -- 172.21.15.79:0/253701151 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67dc002020 con 0x7f67f40e9b40 2021-04-09T18:34:11.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67fa1a8700 1 -- 172.21.15.79:0/253701151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67f40e9b40 msgr2=0x7f67f409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:11.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67fa1a8700 1 --2- 172.21.15.79:0/253701151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67f40e9b40 0x7f67f409f110 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f67e4001df0 tx=0x7f67dc00b3c0).stop 2021-04-09T18:34:11.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67fa1a8700 1 -- 172.21.15.79:0/253701151 shutdown_connections 2021-04-09T18:34:11.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67fa1a8700 1 --2- 172.21.15.79:0/253701151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67f41c7e40 0x7f67f41ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67fa1a8700 1 --2- 172.21.15.79:0/253701151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67f40e9b40 0x7f67f409f110 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67fa1a8700 1 -- 172.21.15.79:0/253701151 >> 172.21.15.79:0/253701151 conn(0x7f67f40e6040 msgr2=0x7f67f40e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:11.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67fa1a8700 1 -- 172.21.15.79:0/253701151 shutdown_connections 2021-04-09T18:34:11.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.580 7f67fa1a8700 1 -- 172.21.15.79:0/253701151 wait complete. 2021-04-09T18:34:11.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67fa1a8700 1 Processor -- start 2021-04-09T18:34:11.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67fa1a8700 1 -- start start 2021-04-09T18:34:11.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67fa1a8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67f41a4130 0x7f67f41a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67fa1a8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67f40b23b0 0x7f67f40b2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67fa1a8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67f40b2e30 0x7f67f41b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67fa1a8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f4047500 con 0x7f67f40b2e30 2021-04-09T18:34:11.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67fa1a8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f40a5e60 con 0x7f67f40b23b0 2021-04-09T18:34:11.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67fa1a8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f40a6160 con 0x7f67f41a4130 2021-04-09T18:34:11.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67f3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67f40b2e30 0x7f67f41b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67f3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67f40b2e30 0x7f67f41b4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33502/0 (socket says 172.21.15.79:33502) 2021-04-09T18:34:11.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67f37fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67f41a4130 0x7f67f41a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67f3fff700 1 -- 172.21.15.79:0/2452765369 learned_addr learned my addr 172.21.15.79:0/2452765369 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:11.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67f2ffd700 1 --2- 172.21.15.79:0/2452765369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67f40b23b0 0x7f67f40b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67f3fff700 1 -- 172.21.15.79:0/2452765369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67f41a4130 msgr2=0x7f67f41a4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:11.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67f3fff700 1 --2- 172.21.15.79:0/2452765369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67f41a4130 0x7f67f41a4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67f3fff700 1 -- 172.21.15.79:0/2452765369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67f40b23b0 msgr2=0x7f67f40b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:11.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67f3fff700 1 --2- 172.21.15.79:0/2452765369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67f40b23b0 0x7f67f40b2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67f3fff700 1 -- 172.21.15.79:0/2452765369 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f40a56f0 con 0x7f67f40b2e30 2021-04-09T18:34:11.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67f3fff700 1 --2- 172.21.15.79:0/2452765369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67f40b2e30 0x7f67f41b4660 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f67f40a6360 tx=0x7f67ec00bf00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:11.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67ebfff700 1 -- 172.21.15.79:0/2452765369 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67f40a56f0 con 0x7f67f40b2e30 2021-04-09T18:34:11.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67ebfff700 1 -- 172.21.15.79:0/2452765369 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec00cac0 con 0x7f67f40b2e30 2021-04-09T18:34:11.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67ebfff700 1 -- 172.21.15.79:0/2452765369 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67ec00f040 con 0x7f67f40b2e30 2021-04-09T18:34:11.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67fa1a8700 1 -- 172.21.15.79:0/2452765369 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f41a4bb0 con 0x7f67f40b2e30 2021-04-09T18:34:11.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.584 7f67fa1a8700 1 -- 172.21.15.79:0/2452765369 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f41b4e20 con 0x7f67f40b2e30 2021-04-09T18:34:11.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.588 7f67ebfff700 1 -- 172.21.15.79:0/2452765369 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f67ec011070 con 0x7f67f40b2e30 2021-04-09T18:34:11.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.588 7f67ebfff700 1 --2- 172.21.15.79:0/2452765369 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f67d8029100 0x7f67d802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.588 7f67ebfff700 1 -- 172.21.15.79:0/2452765369 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f67ec010040 con 0x7f67f40b2e30 2021-04-09T18:34:11.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.588 7f67f37fe700 1 --2- 172.21.15.79:0/2452765369 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f67d8029100 0x7f67d802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.588 7f67f37fe700 1 --2- 172.21.15.79:0/2452765369 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f67d8029100 0x7f67d802b650 crc :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:11.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.592 7f67fa1a8700 1 -- 172.21.15.79:0/2452765369 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f4088d30 con 0x7f67f40b2e30 2021-04-09T18:34:11.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.600 7f67ebfff700 1 -- 172.21.15.79:0/2452765369 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f67f40f7720 con 0x7f67f40b2e30 2021-04-09T18:34:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.764 7f67fa1a8700 1 -- 172.21.15.79:0/2452765369 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f67f40e39a0 con 0x7f67f40b2e30 2021-04-09T18:34:11.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.768 7f67ebfff700 1 -- 172.21.15.79:0/2452765369 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v31) v1 ==== 184+0+0 (secure 0 0 0) 0x7f67ec00c6c0 con 0x7f67f40b2e30 2021-04-09T18:34:11.774 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.1 2021-04-09T18:34:11.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.772 7f67fa1a8700 1 -- 172.21.15.79:0/2452765369 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f67d8029100 msgr2=0x7f67d802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:11.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.772 7f67fa1a8700 1 --2- 172.21.15.79:0/2452765369 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f67d8029100 0x7f67d802b650 crc :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.772 7f67fa1a8700 1 -- 172.21.15.79:0/2452765369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67f40b2e30 msgr2=0x7f67f41b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:11.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.772 7f67fa1a8700 1 --2- 172.21.15.79:0/2452765369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67f40b2e30 0x7f67f41b4660 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f67f40a6360 tx=0x7f67ec00bf00).stop 2021-04-09T18:34:11.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.772 7f67fa1a8700 1 -- 172.21.15.79:0/2452765369 shutdown_connections 2021-04-09T18:34:11.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.772 7f67fa1a8700 1 --2- 172.21.15.79:0/2452765369 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f67d8029100 0x7f67d802b650 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.772 7f67fa1a8700 1 --2- 172.21.15.79:0/2452765369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67f40b2e30 0x7f67f41b4660 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.772 7f67fa1a8700 1 --2- 172.21.15.79:0/2452765369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67f41a4130 0x7f67f41a4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.772 7f67fa1a8700 1 --2- 172.21.15.79:0/2452765369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67f40b23b0 0x7f67f40b2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.772 7f67fa1a8700 1 -- 172.21.15.79:0/2452765369 >> 172.21.15.79:0/2452765369 conn(0x7f67f41a0df0 msgr2=0x7f67f40d8110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:11.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.772 7f67fa1a8700 1 -- 172.21.15.79:0/2452765369 shutdown_connections 2021-04-09T18:34:11.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.772 7f67fa1a8700 1 -- 172.21.15.79:0/2452765369 wait complete. 2021-04-09T18:34:11.792 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:34:11.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f5807337700 1 Processor -- start 2021-04-09T18:34:11.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f5807337700 1 -- start start 2021-04-09T18:34:11.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f5807337700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f58000f5580 0x7f58000f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f5807337700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58000e9b40 0x7f580009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f5807337700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f58001c6e30 0x7f58001c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f5807337700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58000e9f90 con 0x7f58001c6e30 2021-04-09T18:34:11.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f5807337700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58000e59b0 con 0x7f58000f5580 2021-04-09T18:34:11.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f5807337700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58000fbb80 con 0x7f58000e9b40 2021-04-09T18:34:11.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f58058dc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f58001c6e30 0x7f58001c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f58058dc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f58001c6e30 0x7f58001c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33510/0 (socket says 172.21.15.79:33510) 2021-04-09T18:34:11.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f58058dc700 1 -- 172.21.15.79:0/3389039827 learned_addr learned my addr 172.21.15.79:0/3389039827 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:11.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f58048da700 1 --2- 172.21.15.79:0/3389039827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58000e9b40 0x7f580009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f58050db700 1 --2- 172.21.15.79:0/3389039827 >> v2:172.21.15.89:3300/0 conn(0x7f58000f5580 0x7f58000f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f58058dc700 1 -- 172.21.15.79:0/3389039827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58000e9b40 msgr2=0x7f580009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:11.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f58058dc700 1 --2- 172.21.15.79:0/3389039827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58000e9b40 0x7f580009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f58058dc700 1 -- 172.21.15.79:0/3389039827 >> v2:172.21.15.89:3300/0 conn(0x7f58000f5580 msgr2=0x7f58000f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:11.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f58058dc700 1 --2- 172.21.15.79:0/3389039827 >> v2:172.21.15.89:3300/0 conn(0x7f58000f5580 0x7f58000f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f58058dc700 1 -- 172.21.15.79:0/3389039827 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58000e56b0 con 0x7f58001c6e30 2021-04-09T18:34:11.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f58058dc700 1 --2- 172.21.15.79:0/3389039827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58001c6e30 0x7f58001c9290 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f57f80032b0 tx=0x7f57f800b3c0).ready entity=mon.0 client_cookie=36b57b7baea6e143 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:11.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f57f7fff700 1 -- 172.21.15.79:0/3389039827 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f58000e56b0 con 0x7f58001c6e30 2021-04-09T18:34:11.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f57f7fff700 1 -- 172.21.15.79:0/3389039827 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f800bc20 con 0x7f58001c6e30 2021-04-09T18:34:11.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f57f7fff700 1 -- 172.21.15.79:0/3389039827 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f57f8002020 con 0x7f58001c6e30 2021-04-09T18:34:11.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f5807337700 1 -- 172.21.15.79:0/3389039827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58001c6e30 msgr2=0x7f58001c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:11.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.892 7f5807337700 1 --2- 172.21.15.79:0/3389039827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58001c6e30 0x7f58001c9290 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f57f80032b0 tx=0x7f57f800b3c0).stop 2021-04-09T18:34:11.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.896 7f5807337700 1 -- 172.21.15.79:0/3389039827 shutdown_connections 2021-04-09T18:34:11.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.896 7f5807337700 1 --2- 172.21.15.79:0/3389039827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58001c6e30 0x7f58001c9290 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.896 7f5807337700 1 --2- 172.21.15.79:0/3389039827 >> v2:172.21.15.89:3300/0 conn(0x7f58000f5580 0x7f58000f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.896 7f5807337700 1 --2- 172.21.15.79:0/3389039827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58000e9b40 0x7f580009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.896 7f5807337700 1 -- 172.21.15.79:0/3389039827 >> 172.21.15.79:0/3389039827 conn(0x7f58000e6040 msgr2=0x7f58000e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:11.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.896 7f5807337700 1 -- 172.21.15.79:0/3389039827 shutdown_connections 2021-04-09T18:34:11.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.896 7f5807337700 1 -- 172.21.15.79:0/3389039827 wait complete. 2021-04-09T18:34:11.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.896 7f5807337700 1 Processor -- start 2021-04-09T18:34:11.912 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.896 7f5807337700 1 -- start start 2021-04-09T18:34:11.912 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.896 7f5807337700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f580009a0e0 0x7f58000c4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.912 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.896 7f5807337700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58000ba0f0 0x7f580009ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.912 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.896 7f5807337700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58000ba540 0x7f58000d4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.913 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.896 7f5807337700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580009a830 con 0x7f58000ba540 2021-04-09T18:34:11.913 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.896 7f5807337700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580009a530 con 0x7f58000ba0f0 2021-04-09T18:34:11.913 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.896 7f5807337700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58000c7e00 con 0x7f580009a0e0 2021-04-09T18:34:11.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.896 7f58058dc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58000ba540 0x7f58000d4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.896 7f58058dc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58000ba540 0x7f58000d4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33516/0 (socket says 172.21.15.79:33516) 2021-04-09T18:34:11.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.896 7f58058dc700 1 -- 172.21.15.79:0/2888088057 learned_addr learned my addr 172.21.15.79:0/2888088057 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:11.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.896 7f58048da700 1 --2- 172.21.15.79:0/2888088057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58000ba0f0 0x7f580009ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.896 7f58050db700 1 --2- 172.21.15.79:0/2888088057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f580009a0e0 0x7f58000c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.900 7f58058dc700 1 -- 172.21.15.79:0/2888088057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f580009a0e0 msgr2=0x7f58000c4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:11.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.900 7f58058dc700 1 --2- 172.21.15.79:0/2888088057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f580009a0e0 0x7f58000c4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.900 7f58058dc700 1 -- 172.21.15.79:0/2888088057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58000ba0f0 msgr2=0x7f580009ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:11.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.900 7f58058dc700 1 --2- 172.21.15.79:0/2888088057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58000ba0f0 0x7f580009ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:11.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.900 7f58058dc700 1 -- 172.21.15.79:0/2888088057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58000baa50 con 0x7f58000ba540 2021-04-09T18:34:11.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.900 7f58048da700 1 --2- 172.21.15.79:0/2888088057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58000ba0f0 0x7f580009ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:11.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.900 7f58058dc700 1 --2- 172.21.15.79:0/2888088057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58000ba540 0x7f58000d4c10 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f58000d82d0 tx=0x7f57f8006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:11.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.900 7f57f5ffb700 1 -- 172.21.15.79:0/2888088057 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f58000baa50 con 0x7f58000ba540 2021-04-09T18:34:11.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.900 7f57f5ffb700 1 -- 172.21.15.79:0/2888088057 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f801b670 con 0x7f58000ba540 2021-04-09T18:34:11.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.900 7f57f5ffb700 1 -- 172.21.15.79:0/2888088057 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f57f801ba40 con 0x7f58000ba540 2021-04-09T18:34:11.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.900 7f5807337700 1 -- 172.21.15.79:0/2888088057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f580009b160 con 0x7f58000ba540 2021-04-09T18:34:11.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.900 7f5807337700 1 -- 172.21.15.79:0/2888088057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58000d53d0 con 0x7f58000ba540 2021-04-09T18:34:11.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.900 7f57f5ffb700 1 -- 172.21.15.79:0/2888088057 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f57f8019040 con 0x7f58000ba540 2021-04-09T18:34:11.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.900 7f57f5ffb700 1 --2- 172.21.15.79:0/2888088057 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f57e00290a0 0x7f57e002b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:11.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.900 7f57f5ffb700 1 -- 172.21.15.79:0/2888088057 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f57f8018040 con 0x7f58000ba540 2021-04-09T18:34:11.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.900 7f58050db700 1 --2- 172.21.15.79:0/2888088057 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f57e00290a0 0x7f57e002b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:11.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.900 7f58050db700 1 --2- 172.21.15.79:0/2888088057 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f57e00290a0 0x7f57e002b5f0 crc :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:11.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.908 7f5807337700 1 -- 172.21.15.79:0/2888088057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5800088d30 con 0x7f58000ba540 2021-04-09T18:34:11.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:11.912 7f57f5ffb700 1 -- 172.21.15.79:0/2888088057 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f57f800ba10 con 0x7f58000ba540 2021-04-09T18:34:12.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.072 7f5807337700 1 -- 172.21.15.79:0/2888088057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f58000e39a0 con 0x7f58000ba540 2021-04-09T18:34:12.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.080 7f57f5ffb700 1 -- 172.21.15.79:0/2888088057 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v32) v1 ==== 184+0+0 (secure 0 0 0) 0x7f57f801b460 con 0x7f58000ba540 2021-04-09T18:34:12.084 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.2 2021-04-09T18:34:12.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.080 7f5807337700 1 -- 172.21.15.79:0/2888088057 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f57e00290a0 msgr2=0x7f57e002b5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:12.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.080 7f5807337700 1 --2- 172.21.15.79:0/2888088057 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f57e00290a0 0x7f57e002b5f0 crc :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.080 7f5807337700 1 -- 172.21.15.79:0/2888088057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58000ba540 msgr2=0x7f58000d4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:12.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.080 7f5807337700 1 --2- 172.21.15.79:0/2888088057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58000ba540 0x7f58000d4c10 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f58000d82d0 tx=0x7f57f8006c10).stop 2021-04-09T18:34:12.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.084 7f5807337700 1 -- 172.21.15.79:0/2888088057 shutdown_connections 2021-04-09T18:34:12.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.084 7f5807337700 1 --2- 172.21.15.79:0/2888088057 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f57e00290a0 0x7f57e002b5f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.084 7f5807337700 1 --2- 172.21.15.79:0/2888088057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58000ba540 0x7f58000d4c10 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.084 7f5807337700 1 --2- 172.21.15.79:0/2888088057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f580009a0e0 0x7f58000c4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.084 7f5807337700 1 --2- 172.21.15.79:0/2888088057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58000ba0f0 0x7f580009ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.084 7f5807337700 1 -- 172.21.15.79:0/2888088057 >> 172.21.15.79:0/2888088057 conn(0x7f58000b42c0 msgr2=0x7f58000b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:12.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.084 7f5807337700 1 -- 172.21.15.79:0/2888088057 shutdown_connections 2021-04-09T18:34:12.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.084 7f5807337700 1 -- 172.21.15.79:0/2888088057 wait complete. 2021-04-09T18:34:12.099 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:34:12.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.184 7f42492ff700 1 Processor -- start 2021-04-09T18:34:12.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.184 7f42492ff700 1 -- start start 2021-04-09T18:34:12.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f42492ff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42440e9ae0 0x7f424409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:12.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f42492ff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f42441c8010 0x7f42441ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:12.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f42492ff700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42440fbb20 con 0x7f42440f5520 2021-04-09T18:34:12.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f42492ff700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42441c3dc0 con 0x7f42441c8010 2021-04-09T18:34:12.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f42492ff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42440e9f30 con 0x7f42440e9ae0 2021-04-09T18:34:12.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f4243806700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f42441c8010 0x7f42441ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:12.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f4243005700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f42440f5520 0x7f42440f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:56932/0 (socket says 172.21.15.79:56932) 2021-04-09T18:34:12.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f4243005700 1 -- 172.21.15.79:0/3227334135 learned_addr learned my addr 172.21.15.79:0/3227334135 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:12.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f4242804700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42440e9ae0 0x7f424409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:12.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f4243806700 1 -- 172.21.15.79:0/3227334135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42440e9ae0 msgr2=0x7f424409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:12.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f4243806700 1 --2- 172.21.15.79:0/3227334135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42440e9ae0 0x7f424409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f4243806700 1 -- 172.21.15.79:0/3227334135 >> v1:172.21.15.89:6789/0 conn(0x7f42440f5520 legacy=0x7f42440f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:12.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f4243806700 1 -- 172.21.15.79:0/3227334135 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42440e56d0 con 0x7f42441c8010 2021-04-09T18:34:12.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f4243806700 1 --2- 172.21.15.79:0/3227334135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42441c8010 0x7f42441ca470 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f423c0032b0 tx=0x7f423c00b3c0).ready entity=mon.1 client_cookie=7d6bfecc049bd3dd server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:12.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f4242003700 1 -- 172.21.15.79:0/3227334135 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f42440e56d0 con 0x7f42441c8010 2021-04-09T18:34:12.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f4242003700 1 -- 172.21.15.79:0/3227334135 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c00bc20 con 0x7f42441c8010 2021-04-09T18:34:12.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f4242003700 1 -- 172.21.15.79:0/3227334135 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f423c002020 con 0x7f42441c8010 2021-04-09T18:34:12.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f42492ff700 1 -- 172.21.15.79:0/3227334135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42441c8010 msgr2=0x7f42441ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:12.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f42492ff700 1 --2- 172.21.15.79:0/3227334135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42441c8010 0x7f42441ca470 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f423c0032b0 tx=0x7f423c00b3c0).stop 2021-04-09T18:34:12.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f42492ff700 1 -- 172.21.15.79:0/3227334135 shutdown_connections 2021-04-09T18:34:12.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.188 7f42492ff700 1 --2- 172.21.15.79:0/3227334135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42441c8010 0x7f42441ca470 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.192 7f42492ff700 1 --2- 172.21.15.79:0/3227334135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42440e9ae0 0x7f424409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.192 7f42492ff700 1 -- 172.21.15.79:0/3227334135 >> 172.21.15.79:0/3227334135 conn(0x7f42440e5fe0 msgr2=0x7f42440e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:12.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.192 7f42492ff700 1 -- 172.21.15.79:0/3227334135 shutdown_connections 2021-04-09T18:34:12.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.192 7f42492ff700 1 -- 172.21.15.79:0/3227334135 wait complete. 2021-04-09T18:34:12.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f42492ff700 1 Processor -- start 2021-04-09T18:34:12.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f42492ff700 1 -- start start 2021-04-09T18:34:12.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f42492ff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42440c0810 0x7f42440974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:12.208 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f42492ff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42440aebf0 0x7f42440bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:12.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f42492ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42441acff0 0x7f42441ad440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:12.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f42492ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42440e8af0 con 0x7f42441acff0 2021-04-09T18:34:12.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f42492ff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42440c13f0 con 0x7f42440c0810 2021-04-09T18:34:12.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f42492ff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42440c16f0 con 0x7f42440aebf0 2021-04-09T18:34:12.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f4243806700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42441acff0 0x7f42441ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:12.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f4242804700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42440aebf0 0x7f42440bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:12.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f4243806700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42441acff0 0x7f42441ad440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33530/0 (socket says 172.21.15.79:33530) 2021-04-09T18:34:12.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f4243806700 1 -- 172.21.15.79:0/2854498301 learned_addr learned my addr 172.21.15.79:0/2854498301 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:12.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f4243005700 1 --2- 172.21.15.79:0/2854498301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42440c0810 0x7f42440974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:12.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f4243806700 1 -- 172.21.15.79:0/2854498301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42440aebf0 msgr2=0x7f42440bfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:12.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f4243806700 1 --2- 172.21.15.79:0/2854498301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42440aebf0 0x7f42440bfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f4243806700 1 -- 172.21.15.79:0/2854498301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42440c0810 msgr2=0x7f42440974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:12.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f4243806700 1 --2- 172.21.15.79:0/2854498301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42440c0810 0x7f42440974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.211 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f4243806700 1 -- 172.21.15.79:0/2854498301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4244097af0 con 0x7f42441acff0 2021-04-09T18:34:12.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f4243806700 1 --2- 172.21.15.79:0/2854498301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42441acff0 0x7f42441ad440 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f4244096170 tx=0x7f423c006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:12.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f422bfff700 1 -- 172.21.15.79:0/2854498301 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4244097af0 con 0x7f42441acff0 2021-04-09T18:34:12.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f422bfff700 1 -- 172.21.15.79:0/2854498301 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c01f030 con 0x7f42441acff0 2021-04-09T18:34:12.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f42492ff700 1 -- 172.21.15.79:0/2854498301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42440c04e0 con 0x7f42441acff0 2021-04-09T18:34:12.212 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f422bfff700 1 -- 172.21.15.79:0/2854498301 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f423c002020 con 0x7f42441acff0 2021-04-09T18:34:12.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.196 7f42492ff700 1 -- 172.21.15.79:0/2854498301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42440c2c90 con 0x7f42441acff0 2021-04-09T18:34:12.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.200 7f422bfff700 1 -- 172.21.15.79:0/2854498301 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f423c02a060 con 0x7f42441acff0 2021-04-09T18:34:12.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.200 7f422bfff700 1 --2- 172.21.15.79:0/2854498301 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4224029100 0x7f422402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:12.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.200 7f422bfff700 1 -- 172.21.15.79:0/2854498301 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f423c03b620 con 0x7f42441acff0 2021-04-09T18:34:12.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.200 7f4243005700 1 --2- 172.21.15.79:0/2854498301 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4224029100 0x7f422402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:12.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.200 7f42492ff700 1 -- 172.21.15.79:0/2854498301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42440e39e0 con 0x7f42441acff0 2021-04-09T18:34:12.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.200 7f4243005700 1 --2- 172.21.15.79:0/2854498301 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4224029100 0x7f422402b650 crc :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:12.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.204 7f422bfff700 1 -- 172.21.15.79:0/2854498301 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f423c00ba10 con 0x7f42441acff0 2021-04-09T18:34:12.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.372 7f42492ff700 1 -- 172.21.15.79:0/2854498301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42440f5b20 con 0x7f42441acff0 2021-04-09T18:34:12.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.372 7f422bfff700 1 -- 172.21.15.79:0/2854498301 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+2098 (secure 0 0 0) 0x7f423c01b430 con 0x7f42441acff0 2021-04-09T18:34:12.380 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 61 2021-04-09T18:34:12.380 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:12.381 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":61,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7155,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/1349682878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1349682878},{"type":"v1","addr":"172.21.15.79:6833","nonce":1349682878}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":59}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:34:09.512814","modified":"2021-04-09 18:34:11.526918","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7147":{"gid":7147,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/57205751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":57205751},{"type":"v1","addr":"172.21.15.89:6835","nonce":57205751}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-04-09T18:34:12.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.376 7f42492ff700 1 -- 172.21.15.79:0/2854498301 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4224029100 msgr2=0x7f422402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:12.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.376 7f42492ff700 1 --2- 172.21.15.79:0/2854498301 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4224029100 0x7f422402b650 crc :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.376 7f42492ff700 1 -- 172.21.15.79:0/2854498301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42441acff0 msgr2=0x7f42441ad440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:12.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.376 7f42492ff700 1 --2- 172.21.15.79:0/2854498301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42441acff0 0x7f42441ad440 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f4244096170 tx=0x7f423c006c10).stop 2021-04-09T18:34:12.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.376 7f42492ff700 1 -- 172.21.15.79:0/2854498301 shutdown_connections 2021-04-09T18:34:12.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.376 7f42492ff700 1 --2- 172.21.15.79:0/2854498301 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4224029100 0x7f422402b650 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.376 7f42492ff700 1 --2- 172.21.15.79:0/2854498301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42440c0810 0x7f42440974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.376 7f42492ff700 1 --2- 172.21.15.79:0/2854498301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42441acff0 0x7f42441ad440 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.376 7f42492ff700 1 --2- 172.21.15.79:0/2854498301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42440aebf0 0x7f42440bfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.376 7f42492ff700 1 -- 172.21.15.79:0/2854498301 >> 172.21.15.79:0/2854498301 conn(0x7f4244098d30 msgr2=0x7f42440957e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:12.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.376 7f42492ff700 1 -- 172.21.15.79:0/2854498301 shutdown_connections 2021-04-09T18:34:12.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.376 7f42492ff700 1 -- 172.21.15.79:0/2854498301 wait complete. 2021-04-09T18:34:12.594 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:34:09.512814', 'modified': '2021-04-09 18:34:11.526918', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 97, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7147}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7147': {'gid': 7147, 'name': 'b', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6835/57205751', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 57205751}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 57205751}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:34:12.595 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:34:12.595 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2021-04-09T18:34:12.689 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:34:12.689 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:34:12.689 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2021-04-09T18:34:12.690 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 7147, 2021-04-09T18:34:12.690 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2021-04-09T18:34:12.690 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2021-04-09T18:34:12.690 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 2.1580182529999998, 2021-04-09T18:34:12.691 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 61, 2021-04-09T18:34:12.691 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 98, 2021-04-09T18:34:12.691 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 98, 2021-04-09T18:34:12.691 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 6.7297534189999997 2021-04-09T18:34:12.691 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:34:12.696 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 7147, "want_state": "up:active", "state": "up:active", "rank_uptime": 2.1580182529999998, "mdsmap_epoch": 61, "osdmap_epoch": 98, "osdmap_epoch_barrier": 98, "uptime": 6.7297534189999997 } 2021-04-09T18:34:12.696 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:34:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.792 7f3a58058700 1 Processor -- start 2021-04-09T18:34:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.792 7f3a58058700 1 -- start start 2021-04-09T18:34:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a58058700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a500f5510 0x7f3a500f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a58058700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3a500e9ad0 0x7f3a5009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a58058700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a500fbb10 con 0x7f3a501c2da0 2021-04-09T18:34:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a58058700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a500e9f20 con 0x7f3a500f5510 2021-04-09T18:34:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a58058700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a500e59c0 con 0x7f3a500e9ad0 2021-04-09T18:34:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a55dfc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a500f5510 0x7f3a500f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a565fd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3a501c2da0 0x7f3a501c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56476/0 (socket says 172.21.15.79:56476) 2021-04-09T18:34:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a565fd700 1 -- 172.21.15.79:0/804845482 learned_addr learned my addr 172.21.15.79:0/804845482 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a555fb700 1 --2- 172.21.15.79:0/804845482 >> v2:172.21.15.89:3300/0 conn(0x7f3a500e9ad0 0x7f3a5009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a54dfa700 1 -- 172.21.15.79:0/804845482 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943441734 0 0) 0x7f3a48001450 con 0x7f3a501c2da0 2021-04-09T18:34:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a54dfa700 1 -- 172.21.15.79:0/804845482 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a3c003240 con 0x7f3a501c2da0 2021-04-09T18:34:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a55dfc700 1 -- 172.21.15.79:0/804845482 >> v2:172.21.15.89:3300/0 conn(0x7f3a500e9ad0 msgr2=0x7f3a5009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a55dfc700 1 --2- 172.21.15.79:0/804845482 >> v2:172.21.15.89:3300/0 conn(0x7f3a500e9ad0 0x7f3a5009f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a55dfc700 1 -- 172.21.15.79:0/804845482 >> v1:172.21.15.79:6789/0 conn(0x7f3a501c2da0 legacy=0x7f3a501c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a54dfa700 1 -- 172.21.15.79:0/804845482 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1409973271 0 0) 0x7f3a480019d0 con 0x7f3a501c2da0 2021-04-09T18:34:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a55dfc700 1 -- 172.21.15.79:0/804845482 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a500e56c0 con 0x7f3a500f5510 2021-04-09T18:34:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a55dfc700 1 --2- 172.21.15.79:0/804845482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500f5510 0x7f3a500f64a0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f3a48002170 tx=0x7f3a4c00bd10).ready entity=mon.0 client_cookie=69b31994b3de1717 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a54dfa700 1 -- 172.21.15.79:0/804845482 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a500e56c0 con 0x7f3a500f5510 2021-04-09T18:34:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a54dfa700 1 -- 172.21.15.79:0/804845482 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4c009710 con 0x7f3a500f5510 2021-04-09T18:34:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a54dfa700 1 -- 172.21.15.79:0/804845482 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a48001f30 con 0x7f3a500f5510 2021-04-09T18:34:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a58058700 1 -- 172.21.15.79:0/804845482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500f5510 msgr2=0x7f3a500f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a58058700 1 --2- 172.21.15.79:0/804845482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500f5510 0x7f3a500f64a0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f3a48002170 tx=0x7f3a4c00bd10).stop 2021-04-09T18:34:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a58058700 1 -- 172.21.15.79:0/804845482 shutdown_connections 2021-04-09T18:34:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a58058700 1 --2- 172.21.15.79:0/804845482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500f5510 0x7f3a500f64a0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a58058700 1 --2- 172.21.15.79:0/804845482 >> v2:172.21.15.89:3300/0 conn(0x7f3a500e9ad0 0x7f3a5009f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a58058700 1 -- 172.21.15.79:0/804845482 >> 172.21.15.79:0/804845482 conn(0x7f3a500e5fd0 msgr2=0x7f3a500e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a58058700 1 -- 172.21.15.79:0/804845482 shutdown_connections 2021-04-09T18:34:12.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.796 7f3a58058700 1 -- 172.21.15.79:0/804845482 wait complete. 2021-04-09T18:34:12.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.800 7f3a58058700 1 Processor -- start 2021-04-09T18:34:12.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.800 7f3a58058700 1 -- start start 2021-04-09T18:34:12.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a58058700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a500c0970 0x7f3a500983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:12.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a58058700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500af9a0 0x7f3a5019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:12.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a58058700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a500afdf0 0x7f3a500d5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:12.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a58058700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a500c0240 con 0x7f3a500af9a0 2021-04-09T18:34:12.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a58058700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a500c0540 con 0x7f3a500c0970 2021-04-09T18:34:12.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a58058700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a500bff00 con 0x7f3a500afdf0 2021-04-09T18:34:12.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a555fb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500af9a0 0x7f3a5019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:12.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a555fb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500af9a0 0x7f3a5019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33542/0 (socket says 172.21.15.79:33542) 2021-04-09T18:34:12.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a555fb700 1 -- 172.21.15.79:0/3075557945 learned_addr learned my addr 172.21.15.79:0/3075557945 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:12.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a565fd700 1 --2- 172.21.15.79:0/3075557945 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a500afdf0 0x7f3a500d5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:12.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a55dfc700 1 --2- 172.21.15.79:0/3075557945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a500c0970 0x7f3a500983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:12.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a555fb700 1 -- 172.21.15.79:0/3075557945 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a500afdf0 msgr2=0x7f3a500d5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:12.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a555fb700 1 --2- 172.21.15.79:0/3075557945 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a500afdf0 0x7f3a500d5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a555fb700 1 -- 172.21.15.79:0/3075557945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a500c0970 msgr2=0x7f3a500983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:12.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a555fb700 1 --2- 172.21.15.79:0/3075557945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a500c0970 0x7f3a500983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a555fb700 1 -- 172.21.15.79:0/3075557945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5019e210 con 0x7f3a500af9a0 2021-04-09T18:34:12.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a555fb700 1 --2- 172.21.15.79:0/3075557945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500af9a0 0x7f3a5019dbe0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f3a500c00b0 tx=0x7f3a4000c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:12.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a467fc700 1 -- 172.21.15.79:0/3075557945 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a5019e210 con 0x7f3a500af9a0 2021-04-09T18:34:12.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a467fc700 1 -- 172.21.15.79:0/3075557945 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4000cad0 con 0x7f3a500af9a0 2021-04-09T18:34:12.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a467fc700 1 -- 172.21.15.79:0/3075557945 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a4000f040 con 0x7f3a500af9a0 2021-04-09T18:34:12.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a58058700 1 -- 172.21.15.79:0/3075557945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a500d5750 con 0x7f3a500af9a0 2021-04-09T18:34:12.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a58058700 1 -- 172.21.15.79:0/3075557945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5019e6d0 con 0x7f3a500af9a0 2021-04-09T18:34:12.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.804 7f3a467fc700 1 -- 172.21.15.79:0/3075557945 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3a40011070 con 0x7f3a500af9a0 2021-04-09T18:34:12.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.808 7f3a467fc700 1 --2- 172.21.15.79:0/3075557945 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a38029100 0x7f3a3802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:12.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.808 7f3a467fc700 1 -- 172.21.15.79:0/3075557945 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f3a40010040 con 0x7f3a500af9a0 2021-04-09T18:34:12.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.808 7f3a55dfc700 1 --2- 172.21.15.79:0/3075557945 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a38029100 0x7f3a3802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:12.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.808 7f3a55dfc700 1 --2- 172.21.15.79:0/3075557945 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a38029100 0x7f3a3802b650 crc :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:12.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.808 7f3a58058700 1 -- 172.21.15.79:0/3075557945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a500e39d0 con 0x7f3a500af9a0 2021-04-09T18:34:12.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.812 7f3a467fc700 1 -- 172.21.15.79:0/3075557945 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3a4000c6d0 con 0x7f3a500af9a0 2021-04-09T18:34:12.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.976 7f3a58058700 1 -- 172.21.15.79:0/3075557945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a500f5b10 con 0x7f3a500af9a0 2021-04-09T18:34:12.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.976 7f3a467fc700 1 -- 172.21.15.79:0/3075557945 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+14348 (secure 0 0 0) 0x7f3a40000bf0 con 0x7f3a500af9a0 2021-04-09T18:34:12.983 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:12.983 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":98,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:34:10.009667","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:34:07.761734","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2021-04-09 18:34:08.596089","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6835/2412239832":"2021-04-10 18:34:09.999325","172.21.15.89:6834/2412239832":"2021-04-10 18:34:09.999325"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:34:12.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.980 7f3a58058700 1 -- 172.21.15.79:0/3075557945 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a38029100 msgr2=0x7f3a3802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:12.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.980 7f3a58058700 1 --2- 172.21.15.79:0/3075557945 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a38029100 0x7f3a3802b650 crc :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.980 7f3a58058700 1 -- 172.21.15.79:0/3075557945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500af9a0 msgr2=0x7f3a5019dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:12.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.980 7f3a58058700 1 --2- 172.21.15.79:0/3075557945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500af9a0 0x7f3a5019dbe0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f3a500c00b0 tx=0x7f3a4000c150).stop 2021-04-09T18:34:12.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.980 7f3a58058700 1 -- 172.21.15.79:0/3075557945 shutdown_connections 2021-04-09T18:34:12.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.980 7f3a58058700 1 --2- 172.21.15.79:0/3075557945 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3a38029100 0x7f3a3802b650 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.980 7f3a58058700 1 --2- 172.21.15.79:0/3075557945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a500c0970 0x7f3a500983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.980 7f3a58058700 1 --2- 172.21.15.79:0/3075557945 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a500afdf0 0x7f3a500d5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.980 7f3a58058700 1 --2- 172.21.15.79:0/3075557945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500af9a0 0x7f3a5019dbe0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:12.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.980 7f3a58058700 1 -- 172.21.15.79:0/3075557945 >> 172.21.15.79:0/3075557945 conn(0x7f3a50098f80 msgr2=0x7f3a5009a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:12.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.980 7f3a58058700 1 -- 172.21.15.79:0/3075557945 shutdown_connections 2021-04-09T18:34:12.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:12.980 7f3a58058700 1 -- 172.21.15.79:0/3075557945 wait complete. 2021-04-09T18:34:12.996 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:34:07.761734', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:34:08.596089', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:34:12.997 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:34:13.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.096 7f1b4fee6700 1 Processor -- start 2021-04-09T18:34:13.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.096 7f1b4fee6700 1 -- start start 2021-04-09T18:34:13.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.096 7f1b4fee6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1b480f5550 0x7f1b480f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.096 7f1b4fee6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b481c8040 0x7f1b481ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.096 7f1b4fee6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b480fbb50 con 0x7f1b480e9b10 2021-04-09T18:34:13.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.096 7f1b4fee6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b480e9f60 con 0x7f1b480f5550 2021-04-09T18:34:13.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.096 7f1b4fee6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b481c3df0 con 0x7f1b481c8040 2021-04-09T18:34:13.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.096 7f1b4e48b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b481c8040 0x7f1b481ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.096 7f1b4d489700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1b480e9b10 0x7f1b4809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:56962/0 (socket says 172.21.15.79:56962) 2021-04-09T18:34:13.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.096 7f1b4dc8a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1b480f5550 0x7f1b480f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.096 7f1b4e48b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b481c8040 0x7f1b481ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:58780/0 (socket says 172.21.15.79:58780) 2021-04-09T18:34:13.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.096 7f1b4d489700 1 -- 172.21.15.79:0/1048063062 learned_addr learned my addr 172.21.15.79:0/1048063062 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:13.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.096 7f1b4e48b700 1 -- 172.21.15.79:0/1048063062 >> v2:172.21.15.89:3300/0 conn(0x7f1b480f5550 msgr2=0x7f1b480f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:13.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.096 7f1b4e48b700 1 --2- 172.21.15.79:0/1048063062 >> v2:172.21.15.89:3300/0 conn(0x7f1b480f5550 0x7f1b480f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.096 7f1b4e48b700 1 -- 172.21.15.79:0/1048063062 >> v1:172.21.15.89:6789/0 conn(0x7f1b480e9b10 legacy=0x7f1b4809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.100 7f1b4e48b700 1 -- 172.21.15.79:0/1048063062 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4809f910 con 0x7f1b481c8040 2021-04-09T18:34:13.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.100 7f1b4e48b700 1 --2- 172.21.15.79:0/1048063062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b481c8040 0x7f1b481ca4a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f1b400032b0 tx=0x7f1b4000b0e0).ready entity=mon.2 client_cookie=efc351fac16ceba1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:13.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.100 7f1b4cc88700 1 -- 172.21.15.79:0/1048063062 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1b4809f910 con 0x7f1b481c8040 2021-04-09T18:34:13.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.100 7f1b4cc88700 1 -- 172.21.15.79:0/1048063062 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4000bab0 con 0x7f1b481c8040 2021-04-09T18:34:13.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.100 7f1b4cc88700 1 -- 172.21.15.79:0/1048063062 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1b40002020 con 0x7f1b481c8040 2021-04-09T18:34:13.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.100 7f1b4fee6700 1 -- 172.21.15.79:0/1048063062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b481c8040 msgr2=0x7f1b481ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.100 7f1b4fee6700 1 --2- 172.21.15.79:0/1048063062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b481c8040 0x7f1b481ca4a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f1b400032b0 tx=0x7f1b4000b0e0).stop 2021-04-09T18:34:13.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.100 7f1b4fee6700 1 -- 172.21.15.79:0/1048063062 shutdown_connections 2021-04-09T18:34:13.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.100 7f1b4fee6700 1 --2- 172.21.15.79:0/1048063062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b481c8040 0x7f1b481ca4a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.100 7f1b4fee6700 1 --2- 172.21.15.79:0/1048063062 >> v2:172.21.15.89:3300/0 conn(0x7f1b480f5550 0x7f1b480f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.100 7f1b4fee6700 1 -- 172.21.15.79:0/1048063062 >> 172.21.15.79:0/1048063062 conn(0x7f1b480e6010 msgr2=0x7f1b480e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:13.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.100 7f1b4fee6700 1 -- 172.21.15.79:0/1048063062 shutdown_connections 2021-04-09T18:34:13.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.100 7f1b4fee6700 1 -- 172.21.15.79:0/1048063062 wait complete. 2021-04-09T18:34:13.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4fee6700 1 Processor -- start 2021-04-09T18:34:13.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4fee6700 1 -- start start 2021-04-09T18:34:13.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4fee6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b48094d80 0x7f1b480b97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4fee6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4809a250 0x7f1b480b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4fee6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b480cf8c0 0x7f1b480cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4fee6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b48088590 con 0x7f1b480cf8c0 2021-04-09T18:34:13.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4fee6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4809b350 con 0x7f1b48094d80 2021-04-09T18:34:13.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4fee6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b480d0340 con 0x7f1b4809a250 2021-04-09T18:34:13.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4e48b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b480cf8c0 0x7f1b480cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4e48b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b480cf8c0 0x7f1b480cfd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33556/0 (socket says 172.21.15.79:33556) 2021-04-09T18:34:13.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4e48b700 1 -- 172.21.15.79:0/139046506 learned_addr learned my addr 172.21.15.79:0/139046506 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:13.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4d489700 1 --2- 172.21.15.79:0/139046506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4809a250 0x7f1b480b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4dc8a700 1 --2- 172.21.15.79:0/139046506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b48094d80 0x7f1b480b97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4e48b700 1 -- 172.21.15.79:0/139046506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4809a250 msgr2=0x7f1b480b77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4e48b700 1 --2- 172.21.15.79:0/139046506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4809a250 0x7f1b480b77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4e48b700 1 -- 172.21.15.79:0/139046506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b48094d80 msgr2=0x7f1b480b97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4e48b700 1 --2- 172.21.15.79:0/139046506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b48094d80 0x7f1b480b97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4e48b700 1 -- 172.21.15.79:0/139046506 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b481a5030 con 0x7f1b480cf8c0 2021-04-09T18:34:13.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4e48b700 1 --2- 172.21.15.79:0/139046506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b480cf8c0 0x7f1b480cfd10 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f1b48093ec0 tx=0x7f1b40006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:13.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b3e7fc700 1 -- 172.21.15.79:0/139046506 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1b481a5030 con 0x7f1b480cf8c0 2021-04-09T18:34:13.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b3e7fc700 1 -- 172.21.15.79:0/139046506 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4001f020 con 0x7f1b480cf8c0 2021-04-09T18:34:13.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4fee6700 1 -- 172.21.15.79:0/139046506 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b480b7dd0 con 0x7f1b480cf8c0 2021-04-09T18:34:13.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b3e7fc700 1 -- 172.21.15.79:0/139046506 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1b4001b830 con 0x7f1b480cf8c0 2021-04-09T18:34:13.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.104 7f1b4fee6700 1 -- 172.21.15.79:0/139046506 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b48090a60 con 0x7f1b480cf8c0 2021-04-09T18:34:13.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.108 7f1b3e7fc700 1 -- 172.21.15.79:0/139046506 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1b40009ce0 con 0x7f1b480cf8c0 2021-04-09T18:34:13.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.108 7f1b3e7fc700 1 --2- 172.21.15.79:0/139046506 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1b30029100 0x7f1b3002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.108 7f1b3e7fc700 1 -- 172.21.15.79:0/139046506 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f1b4003be60 con 0x7f1b480cf8c0 2021-04-09T18:34:13.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.108 7f1b4dc8a700 1 --2- 172.21.15.79:0/139046506 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1b30029100 0x7f1b3002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.108 7f1b4dc8a700 1 --2- 172.21.15.79:0/139046506 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1b30029100 0x7f1b3002b650 crc :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:13.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.108 7f1b4fee6700 1 -- 172.21.15.79:0/139046506 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b480e39f0 con 0x7f1b480cf8c0 2021-04-09T18:34:13.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.116 7f1b3e7fc700 1 -- 172.21.15.79:0/139046506 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1b4000b8a0 con 0x7f1b480cf8c0 2021-04-09T18:34:13.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.272 7f1b4fee6700 1 -- 172.21.15.79:0/139046506 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f1b480f5b50 con 0x7f1b480cf8c0 2021-04-09T18:34:13.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.272 7f1b3e7fc700 1 -- 172.21.15.79:0/139046506 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v98) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1b4001b430 con 0x7f1b480cf8c0 2021-04-09T18:34:13.276 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:34:13.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.272 7f1b4fee6700 1 -- 172.21.15.79:0/139046506 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1b30029100 msgr2=0x7f1b3002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.272 7f1b4fee6700 1 --2- 172.21.15.79:0/139046506 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1b30029100 0x7f1b3002b650 crc :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.272 7f1b4fee6700 1 -- 172.21.15.79:0/139046506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b480cf8c0 msgr2=0x7f1b480cfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.272 7f1b4fee6700 1 --2- 172.21.15.79:0/139046506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b480cf8c0 0x7f1b480cfd10 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f1b48093ec0 tx=0x7f1b40006c10).stop 2021-04-09T18:34:13.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.272 7f1b4fee6700 1 -- 172.21.15.79:0/139046506 shutdown_connections 2021-04-09T18:34:13.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.272 7f1b4fee6700 1 --2- 172.21.15.79:0/139046506 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1b30029100 0x7f1b3002b650 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.272 7f1b4fee6700 1 --2- 172.21.15.79:0/139046506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b48094d80 0x7f1b480b97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.272 7f1b4fee6700 1 --2- 172.21.15.79:0/139046506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b480cf8c0 0x7f1b480cfd10 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.272 7f1b4fee6700 1 --2- 172.21.15.79:0/139046506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4809a250 0x7f1b480b77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.272 7f1b4fee6700 1 -- 172.21.15.79:0/139046506 >> 172.21.15.79:0/139046506 conn(0x7f1b480d3cb0 msgr2=0x7f1b480d77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:13.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.272 7f1b4fee6700 1 -- 172.21.15.79:0/139046506 shutdown_connections 2021-04-09T18:34:13.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.272 7f1b4fee6700 1 -- 172.21.15.79:0/139046506 wait complete. 2021-04-09T18:34:13.288 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:34:13.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.372 7f7d0c4e8700 1 Processor -- start 2021-04-09T18:34:13.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.372 7f7d0c4e8700 1 -- start start 2021-04-09T18:34:13.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0c4e8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7d040f5550 0x7f7d040f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0c4e8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d040e9b10 0x7f7d0409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0c4e8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d040fbb50 con 0x7f7d041c2de0 2021-04-09T18:34:13.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0c4e8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d040e9f60 con 0x7f7d040f5550 2021-04-09T18:34:13.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0c4e8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d040e5a00 con 0x7f7d040e9b10 2021-04-09T18:34:13.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0a28c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7d040f5550 0x7f7d040f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0a28c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7d040f5550 0x7f7d040f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33562/0 (socket says 172.21.15.79:33562) 2021-04-09T18:34:13.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0a28c700 1 -- 172.21.15.79:0/3245026357 learned_addr learned my addr 172.21.15.79:0/3245026357 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:13.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d09a8b700 1 --2- 172.21.15.79:0/3245026357 >> v2:172.21.15.89:3300/0 conn(0x7f7d040e9b10 0x7f7d0409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0a28c700 1 -- 172.21.15.79:0/3245026357 >> v2:172.21.15.89:3300/0 conn(0x7f7d040e9b10 msgr2=0x7f7d0409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:13.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0a28c700 1 --2- 172.21.15.79:0/3245026357 >> v2:172.21.15.89:3300/0 conn(0x7f7d040e9b10 0x7f7d0409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0a28c700 1 -- 172.21.15.79:0/3245026357 >> v1:172.21.15.89:6789/0 conn(0x7f7d041c2de0 legacy=0x7f7d041c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0a28c700 1 -- 172.21.15.79:0/3245026357 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d040e5700 con 0x7f7d040f5550 2021-04-09T18:34:13.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0a28c700 1 --2- 172.21.15.79:0/3245026357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d040f5550 0x7f7d040f64e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f7cf40032b0 tx=0x7f7cf400b3c0).ready entity=mon.0 client_cookie=14414f684683c423 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:13.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0928a700 1 -- 172.21.15.79:0/3245026357 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7d040e5700 con 0x7f7d040f5550 2021-04-09T18:34:13.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0928a700 1 -- 172.21.15.79:0/3245026357 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf400bc20 con 0x7f7d040f5550 2021-04-09T18:34:13.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0928a700 1 -- 172.21.15.79:0/3245026357 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7cf4002020 con 0x7f7d040f5550 2021-04-09T18:34:13.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0c4e8700 1 -- 172.21.15.79:0/3245026357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d040f5550 msgr2=0x7f7d040f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0c4e8700 1 --2- 172.21.15.79:0/3245026357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d040f5550 0x7f7d040f64e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f7cf40032b0 tx=0x7f7cf400b3c0).stop 2021-04-09T18:34:13.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0c4e8700 1 -- 172.21.15.79:0/3245026357 shutdown_connections 2021-04-09T18:34:13.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0c4e8700 1 --2- 172.21.15.79:0/3245026357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d040f5550 0x7f7d040f64e0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0c4e8700 1 --2- 172.21.15.79:0/3245026357 >> v2:172.21.15.89:3300/0 conn(0x7f7d040e9b10 0x7f7d0409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0c4e8700 1 -- 172.21.15.79:0/3245026357 >> 172.21.15.79:0/3245026357 conn(0x7f7d040e6010 msgr2=0x7f7d040e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:13.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0c4e8700 1 -- 172.21.15.79:0/3245026357 shutdown_connections 2021-04-09T18:34:13.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.376 7f7d0c4e8700 1 -- 172.21.15.79:0/3245026357 wait complete. 2021-04-09T18:34:13.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d0c4e8700 1 Processor -- start 2021-04-09T18:34:13.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d0c4e8700 1 -- start start 2021-04-09T18:34:13.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d0c4e8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d040afc90 0x7f7d04098530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d0c4e8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d040b00e0 0x7f7d04098b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d0c4e8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d041ad200 0x7f7d041ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d0c4e8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d04096710 con 0x7f7d040b00e0 2021-04-09T18:34:13.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d0c4e8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d04096d10 con 0x7f7d041ad200 2021-04-09T18:34:13.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d0c4e8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d040c07d0 con 0x7f7d040afc90 2021-04-09T18:34:13.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d09a8b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d040b00e0 0x7f7d04098b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d09a8b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d040b00e0 0x7f7d04098b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33570/0 (socket says 172.21.15.79:33570) 2021-04-09T18:34:13.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d09a8b700 1 -- 172.21.15.79:0/3906691382 learned_addr learned my addr 172.21.15.79:0/3906691382 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:13.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d0a28c700 1 --2- 172.21.15.79:0/3906691382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d040afc90 0x7f7d04098530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d0aa8d700 1 --2- 172.21.15.79:0/3906691382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d041ad200 0x7f7d041ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d09a8b700 1 -- 172.21.15.79:0/3906691382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d040afc90 msgr2=0x7f7d04098530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d09a8b700 1 --2- 172.21.15.79:0/3906691382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d040afc90 0x7f7d04098530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d09a8b700 1 -- 172.21.15.79:0/3906691382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d041ad200 msgr2=0x7f7d041ad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d09a8b700 1 --2- 172.21.15.79:0/3906691382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d041ad200 0x7f7d041ad650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d09a8b700 1 -- 172.21.15.79:0/3906691382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d04099190 con 0x7f7d040b00e0 2021-04-09T18:34:13.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d0aa8d700 1 --2- 172.21.15.79:0/3906691382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d041ad200 0x7f7d041ad650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:13.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d09a8b700 1 --2- 172.21.15.79:0/3906691382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d040b00e0 0x7f7d04098b60 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7f7d040874d0 tx=0x7f7d0000c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:13.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7cfaffd700 1 -- 172.21.15.79:0/3906691382 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7d04099190 con 0x7f7d040b00e0 2021-04-09T18:34:13.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7cfaffd700 1 -- 172.21.15.79:0/3906691382 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0000cb90 con 0x7f7d040b00e0 2021-04-09T18:34:13.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d0c4e8700 1 -- 172.21.15.79:0/3906691382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d040c0af0 con 0x7f7d040b00e0 2021-04-09T18:34:13.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7cfaffd700 1 -- 172.21.15.79:0/3906691382 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7d0000f040 con 0x7f7d040b00e0 2021-04-09T18:34:13.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.380 7f7d0c4e8700 1 -- 172.21.15.79:0/3906691382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d041ade10 con 0x7f7d040b00e0 2021-04-09T18:34:13.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.384 7f7cfaffd700 1 -- 172.21.15.79:0/3906691382 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7d00011070 con 0x7f7d040b00e0 2021-04-09T18:34:13.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.384 7f7cfaffd700 1 --2- 172.21.15.79:0/3906691382 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7ce4029100 0x7f7ce402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.384 7f7cfaffd700 1 -- 172.21.15.79:0/3906691382 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f7d00010040 con 0x7f7d040b00e0 2021-04-09T18:34:13.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.384 7f7d0a28c700 1 --2- 172.21.15.79:0/3906691382 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7ce4029100 0x7f7ce402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.384 7f7d0a28c700 1 --2- 172.21.15.79:0/3906691382 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7ce4029100 0x7f7ce402b650 crc :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:13.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.388 7f7d0c4e8700 1 -- 172.21.15.79:0/3906691382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d040e39f0 con 0x7f7d040b00e0 2021-04-09T18:34:13.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.396 7f7cfaffd700 1 -- 172.21.15.79:0/3906691382 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7d040e5cd0 con 0x7f7d040b00e0 2021-04-09T18:34:13.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.556 7f7d0c4e8700 1 -- 172.21.15.79:0/3906691382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f7d040f5b50 con 0x7f7d040b00e0 2021-04-09T18:34:13.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.556 7f7cfaffd700 1 -- 172.21.15.79:0/3906691382 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v98) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7d0000c790 con 0x7f7d040b00e0 2021-04-09T18:34:13.564 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:34:13.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.560 7f7d0c4e8700 1 -- 172.21.15.79:0/3906691382 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7ce4029100 msgr2=0x7f7ce402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.560 7f7d0c4e8700 1 --2- 172.21.15.79:0/3906691382 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7ce4029100 0x7f7ce402b650 crc :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.560 7f7d0c4e8700 1 -- 172.21.15.79:0/3906691382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d040b00e0 msgr2=0x7f7d04098b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.560 7f7d0c4e8700 1 --2- 172.21.15.79:0/3906691382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d040b00e0 0x7f7d04098b60 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7f7d040874d0 tx=0x7f7d0000c150).stop 2021-04-09T18:34:13.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.560 7f7d0c4e8700 1 -- 172.21.15.79:0/3906691382 shutdown_connections 2021-04-09T18:34:13.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.560 7f7d0c4e8700 1 --2- 172.21.15.79:0/3906691382 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7ce4029100 0x7f7ce402b650 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.560 7f7d0c4e8700 1 --2- 172.21.15.79:0/3906691382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d041ad200 0x7f7d041ad650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.560 7f7d0c4e8700 1 --2- 172.21.15.79:0/3906691382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d040afc90 0x7f7d04098530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.560 7f7d0c4e8700 1 --2- 172.21.15.79:0/3906691382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d040b00e0 0x7f7d04098b60 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.560 7f7d0c4e8700 1 -- 172.21.15.79:0/3906691382 >> 172.21.15.79:0/3906691382 conn(0x7f7d0409a1c0 msgr2=0x7f7d040d8300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:13.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.560 7f7d0c4e8700 1 -- 172.21.15.79:0/3906691382 shutdown_connections 2021-04-09T18:34:13.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.560 7f7d0c4e8700 1 -- 172.21.15.79:0/3906691382 wait complete. 2021-04-09T18:34:13.575 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:34:13.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.664 7f1b52fea700 1 Processor -- start 2021-04-09T18:34:13.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.664 7f1b52fea700 1 -- start start 2021-04-09T18:34:13.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.664 7f1b52fea700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b4c0e9b10 0x7f1b4c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.664 7f1b52fea700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4c0fbb50 con 0x7f1b4c0f5550 2021-04-09T18:34:13.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.664 7f1b52fea700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4c0e5700 con 0x7f1b4c1c8040 2021-04-09T18:34:13.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.664 7f1b52fea700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4c1c3df0 con 0x7f1b4c0e9b10 2021-04-09T18:34:13.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.664 7f1b4bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b4c0e9b10 0x7f1b4c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.664 7f1b4bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b4c0e9b10 0x7f1b4c09f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33576/0 (socket says 172.21.15.79:33576) 2021-04-09T18:34:13.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.668 7f1b4bfff700 1 -- 172.21.15.79:0/3057866718 learned_addr learned my addr 172.21.15.79:0/3057866718 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:13.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.668 7f1b4bfff700 1 -- 172.21.15.79:0/3057866718 >> v1:172.21.15.89:6789/0 conn(0x7f1b4c1c8040 legacy=0x7f1b4c1ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:13.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.668 7f1b4bfff700 1 -- 172.21.15.79:0/3057866718 >> v1:172.21.15.79:6789/0 conn(0x7f1b4c0f5550 legacy=0x7f1b4c0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.668 7f1b4bfff700 1 -- 172.21.15.79:0/3057866718 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c0e4360 con 0x7f1b4c0e9b10 2021-04-09T18:34:13.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.668 7f1b4bfff700 1 --2- 172.21.15.79:0/3057866718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4c0e9b10 0x7f1b4c09f110 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f1b3c0032b0 tx=0x7f1b3c00b3c0).ready entity=mon.0 client_cookie=7e4bd1c7ce45c59b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:13.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.668 7f1b4b7fe700 1 -- 172.21.15.79:0/3057866718 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1b4c0e4360 con 0x7f1b4c0e9b10 2021-04-09T18:34:13.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.668 7f1b4b7fe700 1 -- 172.21.15.79:0/3057866718 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3c00bca0 con 0x7f1b4c0e9b10 2021-04-09T18:34:13.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.668 7f1b4b7fe700 1 -- 172.21.15.79:0/3057866718 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1b3c002020 con 0x7f1b4c0e9b10 2021-04-09T18:34:13.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.668 7f1b52fea700 1 -- 172.21.15.79:0/3057866718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4c0e9b10 msgr2=0x7f1b4c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.668 7f1b52fea700 1 --2- 172.21.15.79:0/3057866718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4c0e9b10 0x7f1b4c09f110 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f1b3c0032b0 tx=0x7f1b3c00b3c0).stop 2021-04-09T18:34:13.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.668 7f1b52fea700 1 -- 172.21.15.79:0/3057866718 shutdown_connections 2021-04-09T18:34:13.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.668 7f1b52fea700 1 --2- 172.21.15.79:0/3057866718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4c0e9b10 0x7f1b4c09f110 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.668 7f1b52fea700 1 -- 172.21.15.79:0/3057866718 >> 172.21.15.79:0/3057866718 conn(0x7f1b4c0e6010 msgr2=0x7f1b4c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:13.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.668 7f1b52fea700 1 -- 172.21.15.79:0/3057866718 shutdown_connections 2021-04-09T18:34:13.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.668 7f1b52fea700 1 -- 172.21.15.79:0/3057866718 wait complete. 2021-04-09T18:34:13.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b52fea700 1 Processor -- start 2021-04-09T18:34:13.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b52fea700 1 -- start start 2021-04-09T18:34:13.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b52fea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4c0a8570 0x7f1b4c0cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b52fea700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4c0a89c0 0x7f1b4c09a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b52fea700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b4c0aa7e0 0x7f1b4c0aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b52fea700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c0e9f60 con 0x7f1b4c0a8570 2021-04-09T18:34:13.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b52fea700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c0a6cf0 con 0x7f1b4c0aa7e0 2021-04-09T18:34:13.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b52fea700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c0ab260 con 0x7f1b4c0a89c0 2021-04-09T18:34:13.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b50d8e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4c0a8570 0x7f1b4c0cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b50d8e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4c0a8570 0x7f1b4c0cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33580/0 (socket says 172.21.15.79:33580) 2021-04-09T18:34:13.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b50d8e700 1 -- 172.21.15.79:0/226311065 learned_addr learned my addr 172.21.15.79:0/226311065 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:13.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b4bfff700 1 --2- 172.21.15.79:0/226311065 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4c0a89c0 0x7f1b4c09a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b5158f700 1 --2- 172.21.15.79:0/226311065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b4c0aa7e0 0x7f1b4c0aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b50d8e700 1 -- 172.21.15.79:0/226311065 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4c0a89c0 msgr2=0x7f1b4c09a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b50d8e700 1 --2- 172.21.15.79:0/226311065 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4c0a89c0 0x7f1b4c09a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b50d8e700 1 -- 172.21.15.79:0/226311065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b4c0aa7e0 msgr2=0x7f1b4c0aac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b50d8e700 1 --2- 172.21.15.79:0/226311065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b4c0aa7e0 0x7f1b4c0aac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b50d8e700 1 -- 172.21.15.79:0/226311065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c0ccd60 con 0x7f1b4c0a8570 2021-04-09T18:34:13.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b4bfff700 1 --2- 172.21.15.79:0/226311065 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4c0a89c0 0x7f1b4c09a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:13.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b50d8e700 1 --2- 172.21.15.79:0/226311065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4c0a8570 0x7f1b4c0cc730 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f1b4c0d7fd0 tx=0x7f1b3400cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:13.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b497fa700 1 -- 172.21.15.79:0/226311065 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1b4c0ccd60 con 0x7f1b4c0a8570 2021-04-09T18:34:13.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b497fa700 1 -- 172.21.15.79:0/226311065 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b34010510 con 0x7f1b4c0a8570 2021-04-09T18:34:13.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b497fa700 1 -- 172.21.15.79:0/226311065 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1b340106f0 con 0x7f1b4c0a8570 2021-04-09T18:34:13.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b52fea700 1 -- 172.21.15.79:0/226311065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4c09acb0 con 0x7f1b4c0a8570 2021-04-09T18:34:13.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b52fea700 1 -- 172.21.15.79:0/226311065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4c0a9710 con 0x7f1b4c0a8570 2021-04-09T18:34:13.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b497fa700 1 -- 172.21.15.79:0/226311065 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1b34019020 con 0x7f1b4c0a8570 2021-04-09T18:34:13.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b497fa700 1 --2- 172.21.15.79:0/226311065 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1b24029100 0x7f1b2402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b497fa700 1 -- 172.21.15.79:0/226311065 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f1b34038e70 con 0x7f1b4c0a8570 2021-04-09T18:34:13.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.672 7f1b4bfff700 1 --2- 172.21.15.79:0/226311065 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1b24029100 0x7f1b2402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.676 7f1b4bfff700 1 --2- 172.21.15.79:0/226311065 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1b24029100 0x7f1b2402b650 crc :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:13.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.680 7f1b52fea700 1 -- 172.21.15.79:0/226311065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4c0e39f0 con 0x7f1b4c0a8570 2021-04-09T18:34:13.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.684 7f1b497fa700 1 -- 172.21.15.79:0/226311065 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1b340553e0 con 0x7f1b4c0a8570 2021-04-09T18:34:13.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.840 7f1b52fea700 1 -- 172.21.15.79:0/226311065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f1b4c0ba310 con 0x7f1b4c0a8570 2021-04-09T18:34:13.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.844 7f1b497fa700 1 -- 172.21.15.79:0/226311065 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v98) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1b34010300 con 0x7f1b4c0a8570 2021-04-09T18:34:13.848 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:34:13.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.844 7f1b52fea700 1 -- 172.21.15.79:0/226311065 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1b24029100 msgr2=0x7f1b2402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.844 7f1b52fea700 1 --2- 172.21.15.79:0/226311065 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1b24029100 0x7f1b2402b650 crc :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.844 7f1b52fea700 1 -- 172.21.15.79:0/226311065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4c0a8570 msgr2=0x7f1b4c0cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.844 7f1b52fea700 1 --2- 172.21.15.79:0/226311065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4c0a8570 0x7f1b4c0cc730 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f1b4c0d7fd0 tx=0x7f1b3400cae0).stop 2021-04-09T18:34:13.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.844 7f1b52fea700 1 -- 172.21.15.79:0/226311065 shutdown_connections 2021-04-09T18:34:13.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.844 7f1b52fea700 1 --2- 172.21.15.79:0/226311065 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1b24029100 0x7f1b2402b650 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.844 7f1b52fea700 1 --2- 172.21.15.79:0/226311065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b4c0aa7e0 0x7f1b4c0aac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.844 7f1b52fea700 1 --2- 172.21.15.79:0/226311065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4c0a8570 0x7f1b4c0cc730 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.844 7f1b52fea700 1 --2- 172.21.15.79:0/226311065 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4c0a89c0 0x7f1b4c09a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.844 7f1b52fea700 1 -- 172.21.15.79:0/226311065 >> 172.21.15.79:0/226311065 conn(0x7f1b4c095cd0 msgr2=0x7f1b4c0abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:13.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.844 7f1b52fea700 1 -- 172.21.15.79:0/226311065 shutdown_connections 2021-04-09T18:34:13.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.844 7f1b52fea700 1 -- 172.21.15.79:0/226311065 wait complete. 2021-04-09T18:34:13.860 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:34:13.860 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:34:13.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08d38de700 1 Processor -- start 2021-04-09T18:34:13.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08d38de700 1 -- start start 2021-04-09T18:34:13.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08d38de700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08cc0f5510 0x7f08cc0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08d38de700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f08cc0e9ad0 0x7f08cc09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08d38de700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08cc0fbb10 con 0x7f08cc1c2da0 2021-04-09T18:34:13.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08d38de700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08cc0e9f20 con 0x7f08cc0e9ad0 2021-04-09T18:34:13.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08d38de700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0e59c0 con 0x7f08cc0f5510 2021-04-09T18:34:13.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08d1e83700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f08cc1c2da0 0x7f08cc1c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56532/0 (socket says 172.21.15.79:56532) 2021-04-09T18:34:13.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08d1e83700 1 -- 172.21.15.79:0/981485480 learned_addr learned my addr 172.21.15.79:0/981485480 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:13.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08d1682700 1 --2- 172.21.15.79:0/981485480 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08cc0f5510 0x7f08cc0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08d0e81700 1 --2- 172.21.15.79:0/981485480 >> v2:172.21.15.89:3300/0 conn(0x7f08cc0e9ad0 0x7f08cc09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08c3fff700 1 -- 172.21.15.79:0/981485480 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819612258 0 0) 0x7f08c4001450 con 0x7f08cc1c2da0 2021-04-09T18:34:13.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08c3fff700 1 -- 172.21.15.79:0/981485480 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08b8003240 con 0x7f08cc1c2da0 2021-04-09T18:34:13.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08c3fff700 1 -- 172.21.15.79:0/981485480 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 495777427 0 0) 0x7f08c40019d0 con 0x7f08cc1c2da0 2021-04-09T18:34:13.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08c3fff700 1 -- 172.21.15.79:0/981485480 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08cc0f5510 msgr2=0x7f08cc0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:13.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08c3fff700 1 --2- 172.21.15.79:0/981485480 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08cc0f5510 0x7f08cc0f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08c3fff700 1 -- 172.21.15.79:0/981485480 >> v2:172.21.15.89:3300/0 conn(0x7f08cc0e9ad0 msgr2=0x7f08cc09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08c3fff700 1 --2- 172.21.15.79:0/981485480 >> v2:172.21.15.89:3300/0 conn(0x7f08cc0e9ad0 0x7f08cc09f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08c3fff700 1 -- 172.21.15.79:0/981485480 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc0e56c0 con 0x7f08cc1c2da0 2021-04-09T18:34:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08c3fff700 1 -- 172.21.15.79:0/981485480 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f08c4001f30 con 0x7f08cc1c2da0 2021-04-09T18:34:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08c3fff700 1 -- 172.21.15.79:0/981485480 >> v1:172.21.15.79:6789/0 conn(0x7f08cc1c2da0 legacy=0x7f08cc1c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08c3fff700 1 --2- 172.21.15.79:0/981485480 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08b80038c0 0x7f08b8003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08c3fff700 1 --2- 172.21.15.79:0/981485480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08b80045a0 0x7f08b80049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08c3fff700 1 --2- 172.21.15.79:0/981485480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08b8005020 0x7f08b804f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08c3fff700 1 -- 172.21.15.79:0/981485480 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0e9f20 con 0x7f08b8005020 2021-04-09T18:34:13.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.948 7f08c3fff700 1 -- 172.21.15.79:0/981485480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0e59c0 con 0x7f08b80045a0 2021-04-09T18:34:13.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08c3fff700 1 -- 172.21.15.79:0/981485480 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b804ffa0 con 0x7f08b80038c0 2021-04-09T18:34:13.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08d1e83700 1 --2- 172.21.15.79:0/981485480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08b8005020 0x7f08b804f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08d0e81700 1 --2- 172.21.15.79:0/981485480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08b80045a0 0x7f08b80049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08d1682700 1 --2- 172.21.15.79:0/981485480 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08b80038c0 0x7f08b8003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08d1e83700 1 -- 172.21.15.79:0/981485480 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08b80038c0 msgr2=0x7f08b8003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:13.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08d1e83700 1 --2- 172.21.15.79:0/981485480 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08b80038c0 0x7f08b8003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08d1e83700 1 -- 172.21.15.79:0/981485480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08b80045a0 msgr2=0x7f08b80049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:13.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08d1e83700 1 --2- 172.21.15.79:0/981485480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08b80045a0 0x7f08b80049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08d1e83700 1 -- 172.21.15.79:0/981485480 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b8050290 con 0x7f08b8005020 2021-04-09T18:34:13.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08d0e81700 1 --2- 172.21.15.79:0/981485480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08b80045a0 0x7f08b80049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:13.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08d1e83700 1 --2- 172.21.15.79:0/981485480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08b8005020 0x7f08b804f800 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f08c4001340 tx=0x7f08c4005740).ready entity=mon.0 client_cookie=4236293a5ac1e347 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:13.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08c3fff700 1 -- 172.21.15.79:0/981485480 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08b8050290 con 0x7f08b8005020 2021-04-09T18:34:13.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08c3fff700 1 -- 172.21.15.79:0/981485480 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c4005b80 con 0x7f08b8005020 2021-04-09T18:34:13.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08c3fff700 1 -- 172.21.15.79:0/981485480 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08cc0e56c0 con 0x7f08b8005020 2021-04-09T18:34:13.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08d38de700 1 -- 172.21.15.79:0/981485480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08b8005020 msgr2=0x7f08b804f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08d38de700 1 --2- 172.21.15.79:0/981485480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08b8005020 0x7f08b804f800 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f08c4001340 tx=0x7f08c4005740).stop 2021-04-09T18:34:13.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08d1e83700 1 -- 172.21.15.79:0/981485480 reap_dead start 2021-04-09T18:34:13.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08d38de700 1 -- 172.21.15.79:0/981485480 shutdown_connections 2021-04-09T18:34:13.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08d38de700 1 -- 172.21.15.79:0/981485480 >> 172.21.15.79:0/981485480 conn(0x7f08cc0e5fd0 msgr2=0x7f08cc0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:13.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08d38de700 1 -- 172.21.15.79:0/981485480 shutdown_connections 2021-04-09T18:34:13.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.952 7f08d38de700 1 -- 172.21.15.79:0/981485480 wait complete. 2021-04-09T18:34:13.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.956 7f08d38de700 1 Processor -- start 2021-04-09T18:34:13.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.956 7f08d38de700 1 -- start start 2021-04-09T18:34:13.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08d38de700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08cc0bee60 0x7f08cc0bb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08d38de700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08cc0d66e0 0x7f08cc0bf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08d38de700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08cc0be1c0 0x7f08cc0965b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08d38de700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0bf460 con 0x7f08cc0be1c0 2021-04-09T18:34:13.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08d38de700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc1a0f10 con 0x7f08cc0d66e0 2021-04-09T18:34:13.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08d38de700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0bfd90 con 0x7f08cc0bee60 2021-04-09T18:34:13.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08d1e83700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08cc0be1c0 0x7f08cc0965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08d1e83700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08cc0be1c0 0x7f08cc0965b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33604/0 (socket says 172.21.15.79:33604) 2021-04-09T18:34:13.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08d1e83700 1 -- 172.21.15.79:0/3413514432 learned_addr learned my addr 172.21.15.79:0/3413514432 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:13.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08d1682700 1 --2- 172.21.15.79:0/3413514432 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08cc0bee60 0x7f08cc0bb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08d0e81700 1 --2- 172.21.15.79:0/3413514432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08cc0d66e0 0x7f08cc0bf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08d1e83700 1 -- 172.21.15.79:0/3413514432 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08cc0bee60 msgr2=0x7f08cc0bb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08d1e83700 1 --2- 172.21.15.79:0/3413514432 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08cc0bee60 0x7f08cc0bb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08d1e83700 1 -- 172.21.15.79:0/3413514432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08cc0d66e0 msgr2=0x7f08cc0bf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:13.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08d1e83700 1 --2- 172.21.15.79:0/3413514432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08cc0d66e0 0x7f08cc0bf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:13.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08d1e83700 1 -- 172.21.15.79:0/3413514432 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc1c0740 con 0x7f08cc0be1c0 2021-04-09T18:34:13.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08d1e83700 1 --2- 172.21.15.79:0/3413514432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08cc0be1c0 0x7f08cc0965b0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f08cc0d80c0 tx=0x7f08c400c040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:13.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08c1ffb700 1 -- 172.21.15.79:0/3413514432 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08cc1c0740 con 0x7f08cc0be1c0 2021-04-09T18:34:13.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08c1ffb700 1 -- 172.21.15.79:0/3413514432 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c4008be0 con 0x7f08cc0be1c0 2021-04-09T18:34:13.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08d38de700 1 -- 172.21.15.79:0/3413514432 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08cc1c0940 con 0x7f08cc0be1c0 2021-04-09T18:34:13.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08c1ffb700 1 -- 172.21.15.79:0/3413514432 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08c4008520 con 0x7f08cc0be1c0 2021-04-09T18:34:13.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08d38de700 1 -- 172.21.15.79:0/3413514432 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08cc0be7a0 con 0x7f08cc0be1c0 2021-04-09T18:34:13.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08c1ffb700 1 -- 172.21.15.79:0/3413514432 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f08c400d6c0 con 0x7f08cc0be1c0 2021-04-09T18:34:13.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08c1ffb700 1 --2- 172.21.15.79:0/3413514432 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f08ac029100 0x7f08ac02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:13.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08c1ffb700 1 -- 172.21.15.79:0/3413514432 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f08c403b4a0 con 0x7f08cc0be1c0 2021-04-09T18:34:13.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.960 7f08d1682700 1 --2- 172.21.15.79:0/3413514432 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f08ac029100 0x7f08ac02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:13.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.964 7f08d1682700 1 --2- 172.21.15.79:0/3413514432 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f08ac029100 0x7f08ac02b650 crc :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:13.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.976 7f08d38de700 1 -- 172.21.15.79:0/3413514432 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08cc1acd60 con 0x7f08cc0be1c0 2021-04-09T18:34:13.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:13.984 7f08c1ffb700 1 -- 172.21.15.79:0/3413514432 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f08c4008120 con 0x7f08cc0be1c0 2021-04-09T18:34:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:14.148 7f08d38de700 1 -- 172.21.15.79:0/3413514432 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08cc0e39d0 con 0x7f08cc0be1c0 2021-04-09T18:34:14.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:14.148 7f08c1ffb700 1 -- 172.21.15.79:0/3413514432 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+2098 (secure 0 0 0) 0x7f08c4005970 con 0x7f08cc0be1c0 2021-04-09T18:34:14.154 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 61 2021-04-09T18:34:14.154 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:14.155 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":61,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7155,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/1349682878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1349682878},{"type":"v1","addr":"172.21.15.79:6833","nonce":1349682878}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":59}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:34:09.512814","modified":"2021-04-09 18:34:11.526918","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7147":{"gid":7147,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/57205751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":57205751},{"type":"v1","addr":"172.21.15.89:6835","nonce":57205751}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-04-09T18:34:14.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:14.152 7f08d38de700 1 -- 172.21.15.79:0/3413514432 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f08ac029100 msgr2=0x7f08ac02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:14.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:14.152 7f08d38de700 1 --2- 172.21.15.79:0/3413514432 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f08ac029100 0x7f08ac02b650 crc :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:14.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:14.152 7f08d38de700 1 -- 172.21.15.79:0/3413514432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08cc0be1c0 msgr2=0x7f08cc0965b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:14.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:14.152 7f08d38de700 1 --2- 172.21.15.79:0/3413514432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08cc0be1c0 0x7f08cc0965b0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f08cc0d80c0 tx=0x7f08c400c040).stop 2021-04-09T18:34:14.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:14.152 7f08d38de700 1 -- 172.21.15.79:0/3413514432 shutdown_connections 2021-04-09T18:34:14.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:14.152 7f08d38de700 1 --2- 172.21.15.79:0/3413514432 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f08ac029100 0x7f08ac02b650 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:14.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:14.152 7f08d38de700 1 --2- 172.21.15.79:0/3413514432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08cc0be1c0 0x7f08cc0965b0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:14.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:14.152 7f08d38de700 1 --2- 172.21.15.79:0/3413514432 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08cc0bee60 0x7f08cc0bb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:14.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:14.152 7f08d38de700 1 --2- 172.21.15.79:0/3413514432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08cc0d66e0 0x7f08cc0bf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:14.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:14.152 7f08d38de700 1 -- 172.21.15.79:0/3413514432 >> 172.21.15.79:0/3413514432 conn(0x7f08cc09abf0 msgr2=0x7f08cc098a70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:14.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:14.152 7f08d38de700 1 -- 172.21.15.79:0/3413514432 shutdown_connections 2021-04-09T18:34:14.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:14.152 7f08d38de700 1 -- 172.21.15.79:0/3413514432 wait complete. 2021-04-09T18:34:14.301 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:34:14.303 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:34:14.306 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:34:14.308 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:34:14.311 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:34:14.368 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:34:09.512814', 'modified': '2021-04-09 18:34:11.526918', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 97, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7147}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7147': {'gid': 7147, 'name': 'b', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6835/57205751', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 57205751}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 57205751}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:34:14.369 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:34:14.370 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2021-04-09T18:34:14.461 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:34:14.462 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:34:14.462 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2021-04-09T18:34:14.463 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 7147, 2021-04-09T18:34:14.463 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2021-04-09T18:34:14.463 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2021-04-09T18:34:14.463 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 3.930499266, 2021-04-09T18:34:14.464 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 61, 2021-04-09T18:34:14.464 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 98, 2021-04-09T18:34:14.464 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 98, 2021-04-09T18:34:14.464 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 8.5022343320000004 2021-04-09T18:34:14.464 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:34:14.468 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 7147, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.930499266, "mdsmap_epoch": 61, "osdmap_epoch": 98, "osdmap_epoch_barrier": 98, "uptime": 8.5022343320000004 } 2021-04-09T18:34:14.468 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:34:14.469 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-04-09T18:34:14.469 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi090.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-04-09T18:34:14.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:14.470 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:34:14.478 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:34:14.536 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:34:14.537 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:34:14.592 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:34:14.593 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:34:14.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:14.594 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:34:14.644 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:34:14.644 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:34:14.687 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:34:14.702 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:34:14.703 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:34:14.763 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:2021-04-09 18:34:14.759 7f0c021a30c0 -1 init, newargv = 0x5644f6309c00 newargc=9ceph-fuse[13957]: starting ceph client 2021-04-09T18:34:14.763 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr: 2021-04-09T18:34:14.765 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:34:14.766 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:34:14.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:14.767 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:34:14.772 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13957]: starting fuse 2021-04-09T18:34:14.777 INFO:teuthology.orchestra.run.smithi090.stdout:49 2021-04-09T18:34:14.777 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:34:14.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:14.778 DEBUG:teuthology.orchestra.run.smithi090:> sudo python3 -c ' 2021-04-09T18:34:14.778 DEBUG:teuthology.orchestra.run.smithi090:> import glob 2021-04-09T18:34:14.779 DEBUG:teuthology.orchestra.run.smithi090:> import re 2021-04-09T18:34:14.779 DEBUG:teuthology.orchestra.run.smithi090:> import os 2021-04-09T18:34:14.779 DEBUG:teuthology.orchestra.run.smithi090:> import subprocess 2021-04-09T18:34:14.780 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:34:14.780 DEBUG:teuthology.orchestra.run.smithi090:> def find_socket(client_name): 2021-04-09T18:34:14.781 DEBUG:teuthology.orchestra.run.smithi090:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-04-09T18:34:14.781 DEBUG:teuthology.orchestra.run.smithi090:> files = glob.glob(asok_path) 2021-04-09T18:34:14.781 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:34:14.782 DEBUG:teuthology.orchestra.run.smithi090:> # Given a non-glob path, it better be there 2021-04-09T18:34:14.782 DEBUG:teuthology.orchestra.run.smithi090:> if "*" not in asok_path: 2021-04-09T18:34:14.782 DEBUG:teuthology.orchestra.run.smithi090:> assert(len(files) == 1) 2021-04-09T18:34:14.783 DEBUG:teuthology.orchestra.run.smithi090:> return files[0] 2021-04-09T18:34:14.783 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:34:14.784 DEBUG:teuthology.orchestra.run.smithi090:> for f in files: 2021-04-09T18:34:14.784 DEBUG:teuthology.orchestra.run.smithi090:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:34:14.784 DEBUG:teuthology.orchestra.run.smithi090:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:34:14.785 DEBUG:teuthology.orchestra.run.smithi090:> return f 2021-04-09T18:34:14.785 DEBUG:teuthology.orchestra.run.smithi090:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:34:14.786 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:34:14.786 DEBUG:teuthology.orchestra.run.smithi090:> print(find_socket("client.0")) 2021-04-09T18:34:14.786 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:34:14.861 INFO:teuthology.orchestra.run.smithi090.stdout:/var/run/ceph/ceph-client.0.13957.asok 2021-04-09T18:34:14.866 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13957.asok 2021-04-09T18:34:14.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:14.867 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13957.asok status 2021-04-09T18:34:14.991 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2021-04-09T18:34:14.991 INFO:teuthology.orchestra.run.smithi090.stdout: "metadata": { 2021-04-09T18:34:14.992 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:34:14.992 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:34:14.992 INFO:teuthology.orchestra.run.smithi090.stdout: "entity_id": "0", 2021-04-09T18:34:14.992 INFO:teuthology.orchestra.run.smithi090.stdout: "hostname": "smithi090", 2021-04-09T18:34:14.992 INFO:teuthology.orchestra.run.smithi090.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-04-09T18:34:14.993 INFO:teuthology.orchestra.run.smithi090.stdout: "pid": "13957", 2021-04-09T18:34:14.993 INFO:teuthology.orchestra.run.smithi090.stdout: "root": "/" 2021-04-09T18:34:14.993 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:34:14.994 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_count": 0, 2021-04-09T18:34:14.994 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_pinned_count": 0, 2021-04-09T18:34:14.994 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 7302, 2021-04-09T18:34:14.994 INFO:teuthology.orchestra.run.smithi090.stdout: "inst": { 2021-04-09T18:34:14.995 INFO:teuthology.orchestra.run.smithi090.stdout: "name": { 2021-04-09T18:34:14.995 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "client", 2021-04-09T18:34:14.995 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 7302 2021-04-09T18:34:14.995 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:34:14.996 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:34:14.996 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:34:14.996 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:34:14.997 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 4278316785 2021-04-09T18:34:14.997 INFO:teuthology.orchestra.run.smithi090.stdout: } 2021-04-09T18:34:14.997 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:34:14.997 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:34:14.998 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:34:14.998 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:34:14.998 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 4278316785 2021-04-09T18:34:14.998 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:34:14.998 INFO:teuthology.orchestra.run.smithi090.stdout: "inst_str": "client.7302 172.21.15.90:0/4278316785", 2021-04-09T18:34:14.999 INFO:teuthology.orchestra.run.smithi090.stdout: "addr_str": "172.21.15.90:0/4278316785", 2021-04-09T18:34:14.999 INFO:teuthology.orchestra.run.smithi090.stdout: "inode_count": 1, 2021-04-09T18:34:14.999 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_epoch": 61, 2021-04-09T18:34:14.999 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch": 98, 2021-04-09T18:34:15.000 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:34:15.000 INFO:teuthology.orchestra.run.smithi090.stdout: "blacklisted": false, 2021-04-09T18:34:15.000 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs" 2021-04-09T18:34:15.000 INFO:teuthology.orchestra.run.smithi090.stdout:} 2021-04-09T18:34:15.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:15.003 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:34:15.003 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:34:15.011 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:34:15.012 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:34:15.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:15.013 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:34:15.071 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:34:15.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.168 7f3a09466700 1 Processor -- start 2021-04-09T18:34:15.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.168 7f3a09466700 1 -- start start 2021-04-09T18:34:15.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.168 7f3a09466700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a040f5510 0x7f3a040f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:15.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.168 7f3a09466700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a040e9ad0 0x7f3a0409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:15.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.168 7f3a09466700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3a041c2da0 0x7f3a041c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:15.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.168 7f3a09466700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a040e9f20 con 0x7f3a040e9ad0 2021-04-09T18:34:15.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.168 7f3a09466700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a040e59c0 con 0x7f3a041c2da0 2021-04-09T18:34:15.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.168 7f3a09466700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a040fbb10 con 0x7f3a040f5510 2021-04-09T18:34:15.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.168 7f3a02804700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a040e9ad0 0x7f3a0409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:15.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.168 7f3a02804700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a040e9ad0 0x7f3a0409f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33608/0 (socket says 172.21.15.79:33608) 2021-04-09T18:34:15.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.168 7f3a02804700 1 -- 172.21.15.79:0/2266552578 learned_addr learned my addr 172.21.15.79:0/2266552578 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:15.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.168 7f3a03005700 1 --2- 172.21.15.79:0/2266552578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a040f5510 0x7f3a040f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:15.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.168 7f3a03806700 1 --2- 172.21.15.79:0/2266552578 >> v2:172.21.15.89:3300/0 conn(0x7f3a041c2da0 0x7f3a041c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:15.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.172 7f3a02804700 1 -- 172.21.15.79:0/2266552578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a040f5510 msgr2=0x7f3a040f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:15.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.172 7f3a02804700 1 --2- 172.21.15.79:0/2266552578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a040f5510 0x7f3a040f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.172 7f3a02804700 1 -- 172.21.15.79:0/2266552578 >> v2:172.21.15.89:3300/0 conn(0x7f3a041c2da0 msgr2=0x7f3a041c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:15.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.172 7f3a02804700 1 --2- 172.21.15.79:0/2266552578 >> v2:172.21.15.89:3300/0 conn(0x7f3a041c2da0 0x7f3a041c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.172 7f3a02804700 1 -- 172.21.15.79:0/2266552578 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a040e56c0 con 0x7f3a040e9ad0 2021-04-09T18:34:15.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.172 7f3a02804700 1 --2- 172.21.15.79:0/2266552578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a040e9ad0 0x7f3a0409f100 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7f39f4002f30 tx=0x7f39f400bd70).ready entity=mon.0 client_cookie=61f98b50846e2383 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:15.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.172 7f3a02003700 1 -- 172.21.15.79:0/2266552578 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a040e56c0 con 0x7f3a040e9ad0 2021-04-09T18:34:15.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.172 7f3a02003700 1 -- 172.21.15.79:0/2266552578 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f40098b0 con 0x7f3a040e9ad0 2021-04-09T18:34:15.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.172 7f3a02003700 1 -- 172.21.15.79:0/2266552578 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f39f4009c80 con 0x7f3a040e9ad0 2021-04-09T18:34:15.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.172 7f3a09466700 1 -- 172.21.15.79:0/2266552578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a040e9ad0 msgr2=0x7f3a0409f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:15.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.172 7f3a09466700 1 --2- 172.21.15.79:0/2266552578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a040e9ad0 0x7f3a0409f100 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7f39f4002f30 tx=0x7f39f400bd70).stop 2021-04-09T18:34:15.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.172 7f3a09466700 1 -- 172.21.15.79:0/2266552578 shutdown_connections 2021-04-09T18:34:15.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.172 7f3a09466700 1 --2- 172.21.15.79:0/2266552578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a040f5510 0x7f3a040f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.172 7f3a09466700 1 --2- 172.21.15.79:0/2266552578 >> v2:172.21.15.89:3300/0 conn(0x7f3a041c2da0 0x7f3a041c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.172 7f3a09466700 1 --2- 172.21.15.79:0/2266552578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a040e9ad0 0x7f3a0409f100 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.172 7f3a09466700 1 -- 172.21.15.79:0/2266552578 >> 172.21.15.79:0/2266552578 conn(0x7f3a040e5fd0 msgr2=0x7f3a040e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:15.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.172 7f3a09466700 1 -- 172.21.15.79:0/2266552578 shutdown_connections 2021-04-09T18:34:15.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.172 7f3a09466700 1 -- 172.21.15.79:0/2266552578 wait complete. 2021-04-09T18:34:15.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a09466700 1 Processor -- start 2021-04-09T18:34:15.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a09466700 1 -- start start 2021-04-09T18:34:15.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a09466700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a040ba730 0x7f3a040c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:15.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a09466700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a040c3810 0x7f3a040d78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:15.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a09466700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a040d7f00 0x7f3a040bfea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:15.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a09466700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a040c1940 con 0x7f3a040c3810 2021-04-09T18:34:15.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a09466700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a040c1c40 con 0x7f3a040d7f00 2021-04-09T18:34:15.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a09466700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a041b0de0 con 0x7f3a040ba730 2021-04-09T18:34:15.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a02804700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a040c3810 0x7f3a040d78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:15.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a02804700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a040c3810 0x7f3a040d78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33616/0 (socket says 172.21.15.79:33616) 2021-04-09T18:34:15.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a02804700 1 -- 172.21.15.79:0/892537070 learned_addr learned my addr 172.21.15.79:0/892537070 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:15.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a03005700 1 --2- 172.21.15.79:0/892537070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a040ba730 0x7f3a040c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:15.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a03806700 1 --2- 172.21.15.79:0/892537070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a040d7f00 0x7f3a040bfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:15.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a03005700 1 -- 172.21.15.79:0/892537070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a040d7f00 msgr2=0x7f3a040bfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:15.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a03005700 1 --2- 172.21.15.79:0/892537070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a040d7f00 0x7f3a040bfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a03005700 1 -- 172.21.15.79:0/892537070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a040c3810 msgr2=0x7f3a040d78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:15.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a03005700 1 --2- 172.21.15.79:0/892537070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a040c3810 0x7f3a040d78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a03005700 1 -- 172.21.15.79:0/892537070 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a040bab80 con 0x7f3a040ba730 2021-04-09T18:34:15.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a03806700 1 --2- 172.21.15.79:0/892537070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a040d7f00 0x7f3a040bfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:15.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a02804700 1 --2- 172.21.15.79:0/892537070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a040c3810 0x7f3a040d78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:15.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.176 7f3a03005700 1 --2- 172.21.15.79:0/892537070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a040ba730 0x7f3a040c31e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f3a040bb630 tx=0x7f39ec00ef20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:15.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.180 7f39fbfff700 1 -- 172.21.15.79:0/892537070 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a040bab80 con 0x7f3a040ba730 2021-04-09T18:34:15.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.180 7f39fbfff700 1 -- 172.21.15.79:0/892537070 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec00cb50 con 0x7f3a040ba730 2021-04-09T18:34:15.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.180 7f39fbfff700 1 -- 172.21.15.79:0/892537070 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f39ec00f040 con 0x7f3a040ba730 2021-04-09T18:34:15.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.180 7f3a09466700 1 -- 172.21.15.79:0/892537070 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a040c11d0 con 0x7f3a040ba730 2021-04-09T18:34:15.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.180 7f3a09466700 1 -- 172.21.15.79:0/892537070 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a040c04d0 con 0x7f3a040ba730 2021-04-09T18:34:15.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.180 7f39fbfff700 1 -- 172.21.15.79:0/892537070 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f39ec011070 con 0x7f3a040ba730 2021-04-09T18:34:15.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.180 7f39fbfff700 1 --2- 172.21.15.79:0/892537070 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f39e8029100 0x7f39e802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:15.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.180 7f39fbfff700 1 -- 172.21.15.79:0/892537070 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f39ec010040 con 0x7f3a040ba730 2021-04-09T18:34:15.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.180 7f3a02804700 1 --2- 172.21.15.79:0/892537070 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f39e8029100 0x7f39e802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:15.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.180 7f3a02804700 1 --2- 172.21.15.79:0/892537070 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f39e8029100 0x7f39e802b650 crc :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:15.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.184 7f3a09466700 1 -- 172.21.15.79:0/892537070 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a040e39d0 con 0x7f3a040ba730 2021-04-09T18:34:15.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.192 7f39fbfff700 1 -- 172.21.15.79:0/892537070 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f39ec00c750 con 0x7f3a040ba730 2021-04-09T18:34:15.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.360 7f3a09466700 1 -- 172.21.15.79:0/892537070 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a040f5b10 con 0x7f3a040ba730 2021-04-09T18:34:15.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.364 7f39fbfff700 1 -- 172.21.15.79:0/892537070 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+14348 (secure 0 0 0) 0x7f3a04107f40 con 0x7f3a040ba730 2021-04-09T18:34:15.368 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:15.369 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":98,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:34:10.009667","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:34:07.761734","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2021-04-09 18:34:08.596089","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6835/2412239832":"2021-04-10 18:34:09.999325","172.21.15.89:6834/2412239832":"2021-04-10 18:34:09.999325"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:34:15.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.364 7f3a09466700 1 -- 172.21.15.79:0/892537070 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f39e8029100 msgr2=0x7f39e802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:15.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.364 7f3a09466700 1 --2- 172.21.15.79:0/892537070 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f39e8029100 0x7f39e802b650 crc :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.364 7f3a09466700 1 -- 172.21.15.79:0/892537070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a040ba730 msgr2=0x7f3a040c31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:15.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.364 7f3a09466700 1 --2- 172.21.15.79:0/892537070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a040ba730 0x7f3a040c31e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f3a040bb630 tx=0x7f39ec00ef20).stop 2021-04-09T18:34:15.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.364 7f3a09466700 1 -- 172.21.15.79:0/892537070 shutdown_connections 2021-04-09T18:34:15.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.364 7f3a09466700 1 --2- 172.21.15.79:0/892537070 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f39e8029100 0x7f39e802b650 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.364 7f3a09466700 1 --2- 172.21.15.79:0/892537070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a040d7f00 0x7f3a040bfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.364 7f3a09466700 1 --2- 172.21.15.79:0/892537070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a040ba730 0x7f3a040c31e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.364 7f3a09466700 1 --2- 172.21.15.79:0/892537070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a040c3810 0x7f3a040d78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.364 7f3a09466700 1 -- 172.21.15.79:0/892537070 >> 172.21.15.79:0/892537070 conn(0x7f3a040bb0a0 msgr2=0x7f3a040af850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:15.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.364 7f3a09466700 1 -- 172.21.15.79:0/892537070 shutdown_connections 2021-04-09T18:34:15.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.364 7f3a09466700 1 -- 172.21.15.79:0/892537070 wait complete. 2021-04-09T18:34:15.386 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:34:07.761734', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:34:08.596089', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:34:15.387 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:34:15.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.480 7f1b6dbf8700 1 Processor -- start 2021-04-09T18:34:15.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.480 7f1b6dbf8700 1 -- start start 2021-04-09T18:34:15.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.480 7f1b6dbf8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b680e9b10 0x7f1b6809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:15.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.480 7f1b6dbf8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b681c8040 0x7f1b681ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:15.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.480 7f1b6dbf8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b680fbb50 con 0x7f1b680f5550 2021-04-09T18:34:15.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.480 7f1b6dbf8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b681c3df0 con 0x7f1b680e9b10 2021-04-09T18:34:15.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.480 7f1b6dbf8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b680e9f60 con 0x7f1b681c8040 2021-04-09T18:34:15.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.480 7f1b66ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b680e9b10 0x7f1b6809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:15.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.480 7f1b66ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b680e9b10 0x7f1b6809f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33622/0 (socket says 172.21.15.79:33622) 2021-04-09T18:34:15.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.480 7f1b66ffd700 1 -- 172.21.15.79:0/1296959179 learned_addr learned my addr 172.21.15.79:0/1296959179 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:15.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.484 7f1b67fff700 1 --2- 172.21.15.79:0/1296959179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b681c8040 0x7f1b681ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:15.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.484 7f1b66ffd700 1 -- 172.21.15.79:0/1296959179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b681c8040 msgr2=0x7f1b681ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:15.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.484 7f1b66ffd700 1 --2- 172.21.15.79:0/1296959179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b681c8040 0x7f1b681ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.484 7f1b66ffd700 1 -- 172.21.15.79:0/1296959179 >> v1:172.21.15.79:6789/0 conn(0x7f1b680f5550 legacy=0x7f1b680f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:15.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.484 7f1b667fc700 1 -- 172.21.15.79:0/1296959179 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262571870 0 0) 0x7f1b500010d0 con 0x7f1b680f5550 2021-04-09T18:34:15.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.484 7f1b66ffd700 1 -- 172.21.15.79:0/1296959179 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b680e5700 con 0x7f1b680e9b10 2021-04-09T18:34:15.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.484 7f1b66ffd700 1 --2- 172.21.15.79:0/1296959179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b680e9b10 0x7f1b6809f110 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7f1b680f6f30 tx=0x7f1b6000b3c0).ready entity=mon.0 client_cookie=b17f60867d397da3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:15.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.484 7f1b667fc700 1 -- 172.21.15.79:0/1296959179 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1b680e5700 con 0x7f1b680e9b10 2021-04-09T18:34:15.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.484 7f1b667fc700 1 -- 172.21.15.79:0/1296959179 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6000bbe0 con 0x7f1b680e9b10 2021-04-09T18:34:15.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.484 7f1b667fc700 1 -- 172.21.15.79:0/1296959179 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1b60002020 con 0x7f1b680e9b10 2021-04-09T18:34:15.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.484 7f1b6dbf8700 1 -- 172.21.15.79:0/1296959179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b680e9b10 msgr2=0x7f1b6809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:15.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.484 7f1b6dbf8700 1 --2- 172.21.15.79:0/1296959179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b680e9b10 0x7f1b6809f110 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7f1b680f6f30 tx=0x7f1b6000b3c0).stop 2021-04-09T18:34:15.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.484 7f1b6dbf8700 1 -- 172.21.15.79:0/1296959179 shutdown_connections 2021-04-09T18:34:15.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.484 7f1b6dbf8700 1 --2- 172.21.15.79:0/1296959179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b681c8040 0x7f1b681ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.484 7f1b6dbf8700 1 --2- 172.21.15.79:0/1296959179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b680e9b10 0x7f1b6809f110 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.484 7f1b6dbf8700 1 -- 172.21.15.79:0/1296959179 >> 172.21.15.79:0/1296959179 conn(0x7f1b680e6010 msgr2=0x7f1b680e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:15.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.484 7f1b6dbf8700 1 -- 172.21.15.79:0/1296959179 shutdown_connections 2021-04-09T18:34:15.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.484 7f1b6dbf8700 1 -- 172.21.15.79:0/1296959179 wait complete. 2021-04-09T18:34:15.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b6dbf8700 1 Processor -- start 2021-04-09T18:34:15.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b6dbf8700 1 -- start start 2021-04-09T18:34:15.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b6dbf8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b68090230 0x7f1b681aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:15.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b6dbf8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b68090680 0x7f1b681ab450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:15.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b6dbf8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b681a6ac0 0x7f1b681a6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:15.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b6dbf8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b680e1ac0 con 0x7f1b68090230 2021-04-09T18:34:15.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b6dbf8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b68091870 con 0x7f1b68090680 2021-04-09T18:34:15.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b6dbf8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b68091b70 con 0x7f1b681a6ac0 2021-04-09T18:34:15.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b677fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b68090230 0x7f1b681aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:15.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b677fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b68090230 0x7f1b681aae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33630/0 (socket says 172.21.15.79:33630) 2021-04-09T18:34:15.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b67fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b681a6ac0 0x7f1b681a6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:15.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b677fe700 1 -- 172.21.15.79:0/1741373300 learned_addr learned my addr 172.21.15.79:0/1741373300 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:15.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b66ffd700 1 --2- 172.21.15.79:0/1741373300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b68090680 0x7f1b681ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:15.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b677fe700 1 -- 172.21.15.79:0/1741373300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b681a6ac0 msgr2=0x7f1b681a6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:15.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b677fe700 1 --2- 172.21.15.79:0/1741373300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b681a6ac0 0x7f1b681a6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b677fe700 1 -- 172.21.15.79:0/1741373300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b68090680 msgr2=0x7f1b681ab450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:15.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b677fe700 1 --2- 172.21.15.79:0/1741373300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b68090680 0x7f1b681ab450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b677fe700 1 -- 172.21.15.79:0/1741373300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b681aba80 con 0x7f1b68090230 2021-04-09T18:34:15.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b677fe700 1 --2- 172.21.15.79:0/1741373300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b68090230 0x7f1b681aae20 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7f1b680954e0 tx=0x7f1b5000cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:15.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b5ffff700 1 -- 172.21.15.79:0/1741373300 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1b681aba80 con 0x7f1b68090230 2021-04-09T18:34:15.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b5ffff700 1 -- 172.21.15.79:0/1741373300 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b50010510 con 0x7f1b68090230 2021-04-09T18:34:15.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b6dbf8700 1 -- 172.21.15.79:0/1741373300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b68091400 con 0x7f1b68090230 2021-04-09T18:34:15.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b5ffff700 1 -- 172.21.15.79:0/1741373300 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1b500106f0 con 0x7f1b68090230 2021-04-09T18:34:15.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b6dbf8700 1 -- 172.21.15.79:0/1741373300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b681a7540 con 0x7f1b68090230 2021-04-09T18:34:15.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b5ffff700 1 -- 172.21.15.79:0/1741373300 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1b50019020 con 0x7f1b68090230 2021-04-09T18:34:15.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.488 7f1b5ffff700 1 --2- 172.21.15.79:0/1741373300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1b4c029100 0x7f1b4c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:15.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.492 7f1b5ffff700 1 -- 172.21.15.79:0/1741373300 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f1b50038f00 con 0x7f1b68090230 2021-04-09T18:34:15.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.492 7f1b66ffd700 1 --2- 172.21.15.79:0/1741373300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1b4c029100 0x7f1b4c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:15.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.492 7f1b66ffd700 1 --2- 172.21.15.79:0/1741373300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1b4c029100 0x7f1b4c02b650 crc :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:15.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.496 7f1b6dbf8700 1 -- 172.21.15.79:0/1741373300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b680e39f0 con 0x7f1b68090230 2021-04-09T18:34:15.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.504 7f1b5ffff700 1 -- 172.21.15.79:0/1741373300 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1b50010300 con 0x7f1b68090230 2021-04-09T18:34:15.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.664 7f1b6dbf8700 1 -- 172.21.15.79:0/1741373300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f1b680a1c90 con 0x7f1b68090230 2021-04-09T18:34:15.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.664 7f1b5ffff700 1 -- 172.21.15.79:0/1741373300 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v98) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1b68107f80 con 0x7f1b68090230 2021-04-09T18:34:15.670 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:34:15.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.668 7f1b6dbf8700 1 -- 172.21.15.79:0/1741373300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1b4c029100 msgr2=0x7f1b4c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:15.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.668 7f1b6dbf8700 1 --2- 172.21.15.79:0/1741373300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1b4c029100 0x7f1b4c02b650 crc :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.668 7f1b6dbf8700 1 -- 172.21.15.79:0/1741373300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b68090230 msgr2=0x7f1b681aae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:15.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.668 7f1b6dbf8700 1 --2- 172.21.15.79:0/1741373300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b68090230 0x7f1b681aae20 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7f1b680954e0 tx=0x7f1b5000cab0).stop 2021-04-09T18:34:15.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.668 7f1b6dbf8700 1 -- 172.21.15.79:0/1741373300 shutdown_connections 2021-04-09T18:34:15.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.668 7f1b6dbf8700 1 --2- 172.21.15.79:0/1741373300 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1b4c029100 0x7f1b4c02b650 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.668 7f1b6dbf8700 1 --2- 172.21.15.79:0/1741373300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b681a6ac0 0x7f1b681a6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.668 7f1b6dbf8700 1 --2- 172.21.15.79:0/1741373300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b68090230 0x7f1b681aae20 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.668 7f1b6dbf8700 1 --2- 172.21.15.79:0/1741373300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b68090680 0x7f1b681ab450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.668 7f1b6dbf8700 1 -- 172.21.15.79:0/1741373300 >> 172.21.15.79:0/1741373300 conn(0x7f1b68095520 msgr2=0x7f1b680949b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:15.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.668 7f1b6dbf8700 1 -- 172.21.15.79:0/1741373300 shutdown_connections 2021-04-09T18:34:15.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.668 7f1b6dbf8700 1 -- 172.21.15.79:0/1741373300 wait complete. 2021-04-09T18:34:15.681 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:34:15.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.768 7fcb4e1b0700 1 Processor -- start 2021-04-09T18:34:15.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.768 7fcb4e1b0700 1 -- start start 2021-04-09T18:34:15.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb4e1b0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb480f5550 0x7fcb480f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:15.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb4e1b0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb481c8040 0x7fcb481ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:15.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb4e1b0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb480fbb50 con 0x7fcb480e9b10 2021-04-09T18:34:15.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb4e1b0700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb480e9f60 con 0x7fcb481c8040 2021-04-09T18:34:15.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb4e1b0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb481c3df0 con 0x7fcb480f5550 2021-04-09T18:34:15.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb47fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb481c8040 0x7fcb481ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:15.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb47fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb481c8040 0x7fcb481ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33640/0 (socket says 172.21.15.79:33640) 2021-04-09T18:34:15.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb47fff700 1 -- 172.21.15.79:0/2637841817 learned_addr learned my addr 172.21.15.79:0/2637841817 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:15.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb477fe700 1 --2- 172.21.15.79:0/2637841817 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb480f5550 0x7fcb480f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:15.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb467fc700 1 -- 172.21.15.79:0/2637841817 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052786295 0 0) 0x7fcb3c0010d0 con 0x7fcb480e9b10 2021-04-09T18:34:15.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb47fff700 1 -- 172.21.15.79:0/2637841817 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb480f5550 msgr2=0x7fcb480f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:15.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb47fff700 1 --2- 172.21.15.79:0/2637841817 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb480f5550 0x7fcb480f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb47fff700 1 -- 172.21.15.79:0/2637841817 >> v1:172.21.15.89:6789/0 conn(0x7fcb480e9b10 legacy=0x7fcb4809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:15.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb47fff700 1 -- 172.21.15.79:0/2637841817 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4809f910 con 0x7fcb481c8040 2021-04-09T18:34:15.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb47fff700 1 --2- 172.21.15.79:0/2637841817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb481c8040 0x7fcb481ca4a0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fcb400032b0 tx=0x7fcb4000b3c0).ready entity=mon.0 client_cookie=a65cad14835e3d43 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:15.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb467fc700 1 -- 172.21.15.79:0/2637841817 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcb4809f910 con 0x7fcb481c8040 2021-04-09T18:34:15.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb467fc700 1 -- 172.21.15.79:0/2637841817 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4000bc20 con 0x7fcb481c8040 2021-04-09T18:34:15.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb467fc700 1 -- 172.21.15.79:0/2637841817 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcb40002020 con 0x7fcb481c8040 2021-04-09T18:34:15.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb4e1b0700 1 -- 172.21.15.79:0/2637841817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb481c8040 msgr2=0x7fcb481ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:15.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb4e1b0700 1 --2- 172.21.15.79:0/2637841817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb481c8040 0x7fcb481ca4a0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fcb400032b0 tx=0x7fcb4000b3c0).stop 2021-04-09T18:34:15.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb4e1b0700 1 -- 172.21.15.79:0/2637841817 shutdown_connections 2021-04-09T18:34:15.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb4e1b0700 1 --2- 172.21.15.79:0/2637841817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb481c8040 0x7fcb481ca4a0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb4e1b0700 1 --2- 172.21.15.79:0/2637841817 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb480f5550 0x7fcb480f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb4e1b0700 1 -- 172.21.15.79:0/2637841817 >> 172.21.15.79:0/2637841817 conn(0x7fcb480e6010 msgr2=0x7fcb480e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:15.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb4e1b0700 1 -- 172.21.15.79:0/2637841817 shutdown_connections 2021-04-09T18:34:15.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.772 7fcb4e1b0700 1 -- 172.21.15.79:0/2637841817 wait complete. 2021-04-09T18:34:15.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.776 7fcb4e1b0700 1 Processor -- start 2021-04-09T18:34:15.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.776 7fcb4e1b0700 1 -- start start 2021-04-09T18:34:15.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.776 7fcb4e1b0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb480bd2e0 0x7fcb480bba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:15.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.776 7fcb4e1b0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb480cfc40 0x7fcb480d0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:15.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.776 7fcb4e1b0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb4809a8d0 0x7fcb4809ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:15.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.776 7fcb4e1b0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb48088590 con 0x7fcb480bd2e0 2021-04-09T18:34:15.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.776 7fcb4e1b0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4809a5d0 con 0x7fcb480cfc40 2021-04-09T18:34:15.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.776 7fcb4e1b0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb480a46a0 con 0x7fcb4809a8d0 2021-04-09T18:34:15.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.780 7fcb477fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb480bd2e0 0x7fcb480bba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:15.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.780 7fcb477fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb480bd2e0 0x7fcb480bba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33644/0 (socket says 172.21.15.79:33644) 2021-04-09T18:34:15.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.780 7fcb477fe700 1 -- 172.21.15.79:0/105465153 learned_addr learned my addr 172.21.15.79:0/105465153 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:15.795 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.780 7fcb47fff700 1 --2- 172.21.15.79:0/105465153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb4809a8d0 0x7fcb4809ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:15.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.780 7fcb46ffd700 1 --2- 172.21.15.79:0/105465153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb480cfc40 0x7fcb480d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:15.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.780 7fcb477fe700 1 -- 172.21.15.79:0/105465153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb4809a8d0 msgr2=0x7fcb4809ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:15.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.780 7fcb477fe700 1 --2- 172.21.15.79:0/105465153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb4809a8d0 0x7fcb4809ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.780 7fcb477fe700 1 -- 172.21.15.79:0/105465153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb480cfc40 msgr2=0x7fcb480d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:15.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.780 7fcb477fe700 1 --2- 172.21.15.79:0/105465153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb480cfc40 0x7fcb480d0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.780 7fcb477fe700 1 -- 172.21.15.79:0/105465153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb480bd730 con 0x7fcb480bd2e0 2021-04-09T18:34:15.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.780 7fcb477fe700 1 --2- 172.21.15.79:0/105465153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb480bd2e0 0x7fcb480bba70 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7fcb480941f0 tx=0x7fcb3800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:15.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.780 7fcb2ffff700 1 -- 172.21.15.79:0/105465153 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcb480bd730 con 0x7fcb480bd2e0 2021-04-09T18:34:15.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.780 7fcb2ffff700 1 -- 172.21.15.79:0/105465153 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3800cd60 con 0x7fcb480bd2e0 2021-04-09T18:34:15.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.780 7fcb4e1b0700 1 -- 172.21.15.79:0/105465153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4809a1c0 con 0x7fcb480bd2e0 2021-04-09T18:34:15.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.780 7fcb2ffff700 1 -- 172.21.15.79:0/105465153 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcb3800f040 con 0x7fcb480bd2e0 2021-04-09T18:34:15.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.780 7fcb4e1b0700 1 -- 172.21.15.79:0/105465153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb480d8010 con 0x7fcb480bd2e0 2021-04-09T18:34:15.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.780 7fcb2ffff700 1 -- 172.21.15.79:0/105465153 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fcb38011070 con 0x7fcb480bd2e0 2021-04-09T18:34:15.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.780 7fcb2ffff700 1 --2- 172.21.15.79:0/105465153 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcb28029100 0x7fcb2802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:15.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.780 7fcb2ffff700 1 -- 172.21.15.79:0/105465153 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fcb38010040 con 0x7fcb480bd2e0 2021-04-09T18:34:15.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.780 7fcb46ffd700 1 --2- 172.21.15.79:0/105465153 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcb28029100 0x7fcb2802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:15.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.784 7fcb46ffd700 1 --2- 172.21.15.79:0/105465153 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcb28029100 0x7fcb2802b650 crc :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:15.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.784 7fcb4e1b0700 1 -- 172.21.15.79:0/105465153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb480e39f0 con 0x7fcb480bd2e0 2021-04-09T18:34:15.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.788 7fcb2ffff700 1 -- 172.21.15.79:0/105465153 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fcb38000bf0 con 0x7fcb480bd2e0 2021-04-09T18:34:15.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.940 7fcb4e1b0700 1 -- 172.21.15.79:0/105465153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fcb480f5b50 con 0x7fcb480bd2e0 2021-04-09T18:34:15.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.940 7fcb2ffff700 1 -- 172.21.15.79:0/105465153 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v98) v1 ==== 104+0+10 (secure 0 0 0) 0x7fcb3800c960 con 0x7fcb480bd2e0 2021-04-09T18:34:15.946 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:34:15.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.944 7fcb4e1b0700 1 -- 172.21.15.79:0/105465153 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcb28029100 msgr2=0x7fcb2802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:15.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.944 7fcb4e1b0700 1 --2- 172.21.15.79:0/105465153 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcb28029100 0x7fcb2802b650 crc :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.944 7fcb4e1b0700 1 -- 172.21.15.79:0/105465153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb480bd2e0 msgr2=0x7fcb480bba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:15.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.944 7fcb4e1b0700 1 --2- 172.21.15.79:0/105465153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb480bd2e0 0x7fcb480bba70 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7fcb480941f0 tx=0x7fcb3800c430).stop 2021-04-09T18:34:15.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.944 7fcb4e1b0700 1 -- 172.21.15.79:0/105465153 shutdown_connections 2021-04-09T18:34:15.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.944 7fcb4e1b0700 1 --2- 172.21.15.79:0/105465153 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fcb28029100 0x7fcb2802b650 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.944 7fcb4e1b0700 1 --2- 172.21.15.79:0/105465153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb4809a8d0 0x7fcb4809ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.944 7fcb4e1b0700 1 --2- 172.21.15.79:0/105465153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb480bd2e0 0x7fcb480bba70 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.944 7fcb4e1b0700 1 --2- 172.21.15.79:0/105465153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb480cfc40 0x7fcb480d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:15.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.944 7fcb4e1b0700 1 -- 172.21.15.79:0/105465153 >> 172.21.15.79:0/105465153 conn(0x7fcb480d8420 msgr2=0x7fcb480d77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:15.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.944 7fcb4e1b0700 1 -- 172.21.15.79:0/105465153 shutdown_connections 2021-04-09T18:34:15.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:15.944 7fcb4e1b0700 1 -- 172.21.15.79:0/105465153 wait complete. 2021-04-09T18:34:15.958 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:34:16.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.048 7ffb7a58a700 1 Processor -- start 2021-04-09T18:34:16.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.048 7ffb7a58a700 1 -- start start 2021-04-09T18:34:16.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.048 7ffb7a58a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb740f5550 0x7ffb740f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:16.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.048 7ffb7a58a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb741c8040 0x7ffb741ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:16.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.048 7ffb7a58a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb740fbb50 con 0x7ffb740e9b10 2021-04-09T18:34:16.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.048 7ffb7a58a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb740e9f60 con 0x7ffb740f5550 2021-04-09T18:34:16.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.048 7ffb7a58a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb741c3df0 con 0x7ffb741c8040 2021-04-09T18:34:16.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.048 7ffb73fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb740f5550 0x7ffb740f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:16.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.048 7ffb737fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ffb740e9b10 0x7ffb7409f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56594/0 (socket says 172.21.15.79:56594) 2021-04-09T18:34:16.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.048 7ffb737fe700 1 -- 172.21.15.79:0/2784993834 learned_addr learned my addr 172.21.15.79:0/2784993834 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:16.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.052 7ffb78b2f700 1 --2- 172.21.15.79:0/2784993834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb741c8040 0x7ffb741ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:16.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.052 7ffb73fff700 1 -- 172.21.15.79:0/2784993834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb741c8040 msgr2=0x7ffb741ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:16.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.052 7ffb73fff700 1 --2- 172.21.15.79:0/2784993834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb741c8040 0x7ffb741ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:16.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.052 7ffb72ffd700 1 -- 172.21.15.79:0/2784993834 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763395145 0 0) 0x7ffb5c0010d0 con 0x7ffb740e9b10 2021-04-09T18:34:16.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.052 7ffb73fff700 1 -- 172.21.15.79:0/2784993834 >> v1:172.21.15.79:6789/0 conn(0x7ffb740e9b10 legacy=0x7ffb7409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:16.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.052 7ffb73fff700 1 -- 172.21.15.79:0/2784993834 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7409f910 con 0x7ffb740f5550 2021-04-09T18:34:16.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.052 7ffb73fff700 1 --2- 172.21.15.79:0/2784993834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740f5550 0x7ffb740f64e0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7ffb740f6f30 tx=0x7ffb6400b3c0).ready entity=mon.0 client_cookie=ee13ca01721aef47 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:16.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.052 7ffb72ffd700 1 -- 172.21.15.79:0/2784993834 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffb7409f910 con 0x7ffb740f5550 2021-04-09T18:34:16.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.052 7ffb72ffd700 1 -- 172.21.15.79:0/2784993834 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6400bbe0 con 0x7ffb740f5550 2021-04-09T18:34:16.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.052 7ffb72ffd700 1 -- 172.21.15.79:0/2784993834 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffb64002020 con 0x7ffb740f5550 2021-04-09T18:34:16.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.052 7ffb7a58a700 1 -- 172.21.15.79:0/2784993834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740f5550 msgr2=0x7ffb740f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:16.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.052 7ffb7a58a700 1 --2- 172.21.15.79:0/2784993834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740f5550 0x7ffb740f64e0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7ffb740f6f30 tx=0x7ffb6400b3c0).stop 2021-04-09T18:34:16.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.052 7ffb7a58a700 1 -- 172.21.15.79:0/2784993834 shutdown_connections 2021-04-09T18:34:16.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.052 7ffb7a58a700 1 --2- 172.21.15.79:0/2784993834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740f5550 0x7ffb740f64e0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:16.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.052 7ffb7a58a700 1 --2- 172.21.15.79:0/2784993834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb741c8040 0x7ffb741ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:16.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.052 7ffb7a58a700 1 -- 172.21.15.79:0/2784993834 >> 172.21.15.79:0/2784993834 conn(0x7ffb740e6010 msgr2=0x7ffb740e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:16.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.052 7ffb7a58a700 1 -- 172.21.15.79:0/2784993834 shutdown_connections 2021-04-09T18:34:16.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.052 7ffb7a58a700 1 -- 172.21.15.79:0/2784993834 wait complete. 2021-04-09T18:34:16.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb7a58a700 1 Processor -- start 2021-04-09T18:34:16.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb7a58a700 1 -- start start 2021-04-09T18:34:16.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb7a58a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb741a54f0 0x7ffb740d62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:16.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb7a58a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740d2820 0x7ffb740d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:16.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb7a58a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb741a8af0 0x7ffb741a8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:16.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb7a58a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb740e1ac0 con 0x7ffb740d2820 2021-04-09T18:34:16.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb7a58a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb740bbe40 con 0x7ffb741a54f0 2021-04-09T18:34:16.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb7a58a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb740bc140 con 0x7ffb741a8af0 2021-04-09T18:34:16.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb73fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb741a54f0 0x7ffb740d62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:16.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb737fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740d2820 0x7ffb740d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:16.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb78b2f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb741a8af0 0x7ffb741a8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:16.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb78b2f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb741a8af0 0x7ffb741a8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:58886/0 (socket says 172.21.15.79:58886) 2021-04-09T18:34:16.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb73fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb741a54f0 0x7ffb740d62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:50230/0 (socket says 172.21.15.79:50230) 2021-04-09T18:34:16.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb78b2f700 1 -- 172.21.15.79:0/4164169099 learned_addr learned my addr 172.21.15.79:0/4164169099 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:16.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb737fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740d2820 0x7ffb740d2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33660/0 (socket says 172.21.15.79:33660) 2021-04-09T18:34:16.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb737fe700 1 -- 172.21.15.79:0/4164169099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb741a8af0 msgr2=0x7ffb741a8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:16.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb737fe700 1 --2- 172.21.15.79:0/4164169099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb741a8af0 0x7ffb741a8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:16.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb737fe700 1 -- 172.21.15.79:0/4164169099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb741a54f0 msgr2=0x7ffb740d62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:16.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb737fe700 1 --2- 172.21.15.79:0/4164169099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb741a54f0 0x7ffb740d62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:16.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb737fe700 1 -- 172.21.15.79:0/4164169099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb740bba70 con 0x7ffb740d2820 2021-04-09T18:34:16.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb737fe700 1 --2- 172.21.15.79:0/4164169099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740d2820 0x7ffb740d2c70 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7ffb740d4ac0 tx=0x7ffb5c00cb00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:16.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb70ff9700 1 -- 172.21.15.79:0/4164169099 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffb740bba70 con 0x7ffb740d2820 2021-04-09T18:34:16.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb70ff9700 1 -- 172.21.15.79:0/4164169099 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5c0072e0 con 0x7ffb740d2820 2021-04-09T18:34:16.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb7a58a700 1 -- 172.21.15.79:0/4164169099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb741a9570 con 0x7ffb740d2820 2021-04-09T18:34:16.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb70ff9700 1 -- 172.21.15.79:0/4164169099 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffb5c0057e0 con 0x7ffb740d2820 2021-04-09T18:34:16.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.056 7ffb7a58a700 1 -- 172.21.15.79:0/4164169099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb740bd6e0 con 0x7ffb740d2820 2021-04-09T18:34:16.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.060 7ffb70ff9700 1 -- 172.21.15.79:0/4164169099 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ffb5c0059e0 con 0x7ffb740d2820 2021-04-09T18:34:16.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.060 7ffb70ff9700 1 --2- 172.21.15.79:0/4164169099 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffb58029100 0x7ffb5802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:16.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.060 7ffb70ff9700 1 -- 172.21.15.79:0/4164169099 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7ffb5c038e10 con 0x7ffb740d2820 2021-04-09T18:34:16.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.060 7ffb73fff700 1 --2- 172.21.15.79:0/4164169099 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffb58029100 0x7ffb5802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:16.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.060 7ffb73fff700 1 --2- 172.21.15.79:0/4164169099 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffb58029100 0x7ffb5802b650 crc :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:16.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.064 7ffb7a58a700 1 -- 172.21.15.79:0/4164169099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb740e39f0 con 0x7ffb740d2820 2021-04-09T18:34:16.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.068 7ffb70ff9700 1 -- 172.21.15.79:0/4164169099 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ffb740e5cd0 con 0x7ffb740d2820 2021-04-09T18:34:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.224 7ffb7a58a700 1 -- 172.21.15.79:0/4164169099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7ffb740a1c90 con 0x7ffb740d2820 2021-04-09T18:34:16.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.224 7ffb70ff9700 1 -- 172.21.15.79:0/4164169099 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v98) v1 ==== 100+0+10 (secure 0 0 0) 0x7ffb5c0070d0 con 0x7ffb740d2820 2021-04-09T18:34:16.230 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:34:16.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.228 7ffb7a58a700 1 -- 172.21.15.79:0/4164169099 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffb58029100 msgr2=0x7ffb5802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:16.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.228 7ffb7a58a700 1 --2- 172.21.15.79:0/4164169099 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffb58029100 0x7ffb5802b650 crc :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:16.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.228 7ffb7a58a700 1 -- 172.21.15.79:0/4164169099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740d2820 msgr2=0x7ffb740d2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:16.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.228 7ffb7a58a700 1 --2- 172.21.15.79:0/4164169099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740d2820 0x7ffb740d2c70 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7ffb740d4ac0 tx=0x7ffb5c00cb00).stop 2021-04-09T18:34:16.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.228 7ffb7a58a700 1 -- 172.21.15.79:0/4164169099 shutdown_connections 2021-04-09T18:34:16.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.228 7ffb7a58a700 1 --2- 172.21.15.79:0/4164169099 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffb58029100 0x7ffb5802b650 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:16.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.228 7ffb7a58a700 1 --2- 172.21.15.79:0/4164169099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb741a54f0 0x7ffb740d62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:16.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.228 7ffb7a58a700 1 --2- 172.21.15.79:0/4164169099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb741a8af0 0x7ffb741a8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:16.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.228 7ffb7a58a700 1 --2- 172.21.15.79:0/4164169099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740d2820 0x7ffb740d2c70 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:16.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.228 7ffb7a58a700 1 -- 172.21.15.79:0/4164169099 >> 172.21.15.79:0/4164169099 conn(0x7ffb74094a10 msgr2=0x7ffb740d4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:16.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.228 7ffb7a58a700 1 -- 172.21.15.79:0/4164169099 shutdown_connections 2021-04-09T18:34:16.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.228 7ffb7a58a700 1 -- 172.21.15.79:0/4164169099 wait complete. 2021-04-09T18:34:16.243 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:34:16.243 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:34:16.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.332 7fa221e76700 1 Processor -- start 2021-04-09T18:34:16.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.332 7fa221e76700 1 -- start start 2021-04-09T18:34:16.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.332 7fa221e76700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa21c0f5510 0x7fa21c0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:16.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.332 7fa221e76700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa21c0fbb10 con 0x7fa21c1c8000 2021-04-09T18:34:16.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.332 7fa221e76700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa21c09f900 con 0x7fa21c0e9ad0 2021-04-09T18:34:16.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.332 7fa221e76700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa21c0e9f20 con 0x7fa21c0f5510 2021-04-09T18:34:16.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.332 7fa21b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa21c0f5510 0x7fa21c0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:16.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.332 7fa21b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa21c0f5510 0x7fa21c0f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33664/0 (socket says 172.21.15.79:33664) 2021-04-09T18:34:16.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.332 7fa21b7fe700 1 -- 172.21.15.79:0/1446123771 learned_addr learned my addr 172.21.15.79:0/1446123771 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:16.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.332 7fa21bfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa21c1c8000 0x7fa21c1ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56610/0 (socket says 172.21.15.79:56610) 2021-04-09T18:34:16.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.332 7fa21b7fe700 1 -- 172.21.15.79:0/1446123771 >> v1:172.21.15.89:6789/0 conn(0x7fa21c0e9ad0 legacy=0x7fa21c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:16.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.332 7fa21b7fe700 1 -- 172.21.15.79:0/1446123771 >> v1:172.21.15.79:6789/0 conn(0x7fa21c1c8000 legacy=0x7fa21c1ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:16.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.332 7fa21b7fe700 1 -- 172.21.15.79:0/1446123771 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c0e56c0 con 0x7fa21c0f5510 2021-04-09T18:34:16.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.332 7fa21b7fe700 1 --2- 172.21.15.79:0/1446123771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa21c0f5510 0x7fa21c0f64a0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7fa20c0032b0 tx=0x7fa20c00b3c0).ready entity=mon.0 client_cookie=666c2e1876dd8de3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:16.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.332 7fa21a7fc700 1 -- 172.21.15.79:0/1446123771 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa21c0e56c0 con 0x7fa21c0f5510 2021-04-09T18:34:16.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.332 7fa21a7fc700 1 -- 172.21.15.79:0/1446123771 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c00bca0 con 0x7fa21c0f5510 2021-04-09T18:34:16.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.332 7fa21a7fc700 1 -- 172.21.15.79:0/1446123771 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa20c002020 con 0x7fa21c0f5510 2021-04-09T18:34:16.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.332 7fa221e76700 1 -- 172.21.15.79:0/1446123771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa21c0f5510 msgr2=0x7fa21c0f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:16.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.332 7fa221e76700 1 --2- 172.21.15.79:0/1446123771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa21c0f5510 0x7fa21c0f64a0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7fa20c0032b0 tx=0x7fa20c00b3c0).stop 2021-04-09T18:34:16.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.336 7fa221e76700 1 -- 172.21.15.79:0/1446123771 shutdown_connections 2021-04-09T18:34:16.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.336 7fa221e76700 1 --2- 172.21.15.79:0/1446123771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa21c0f5510 0x7fa21c0f64a0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:16.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.336 7fa221e76700 1 -- 172.21.15.79:0/1446123771 >> 172.21.15.79:0/1446123771 conn(0x7fa21c0e5fd0 msgr2=0x7fa21c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:16.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.336 7fa221e76700 1 -- 172.21.15.79:0/1446123771 shutdown_connections 2021-04-09T18:34:16.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.336 7fa221e76700 1 -- 172.21.15.79:0/1446123771 wait complete. 2021-04-09T18:34:16.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.340 7fa221e76700 1 Processor -- start 2021-04-09T18:34:16.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.340 7fa221e76700 1 -- start start 2021-04-09T18:34:16.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.340 7fa221e76700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa21c1d4ab0 0x7fa21c1c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:16.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.340 7fa221e76700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa21c0d7ac0 0x7fa21c0d44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:16.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.340 7fa221e76700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa21c0d4b20 0x7fa21c0ba0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:16.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.340 7fa221e76700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c1c3db0 con 0x7fa21c0d4b20 2021-04-09T18:34:16.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.340 7fa221e76700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c1d4f00 con 0x7fa21c1d4ab0 2021-04-09T18:34:16.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.340 7fa221e76700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c0bb360 con 0x7fa21c0d7ac0 2021-04-09T18:34:16.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.340 7fa21bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa21c0d4b20 0x7fa21c0ba0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:16.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.340 7fa21bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa21c0d4b20 0x7fa21c0ba0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33674/0 (socket says 172.21.15.79:33674) 2021-04-09T18:34:16.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.340 7fa21bfff700 1 -- 172.21.15.79:0/1789791733 learned_addr learned my addr 172.21.15.79:0/1789791733 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:16.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.340 7fa21b7fe700 1 --2- 172.21.15.79:0/1789791733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa21c1d4ab0 0x7fa21c1c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:16.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.340 7fa21affd700 1 --2- 172.21.15.79:0/1789791733 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa21c0d7ac0 0x7fa21c0d44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:16.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.344 7fa21bfff700 1 -- 172.21.15.79:0/1789791733 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa21c0d7ac0 msgr2=0x7fa21c0d44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:16.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.344 7fa21bfff700 1 --2- 172.21.15.79:0/1789791733 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa21c0d7ac0 0x7fa21c0d44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:16.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.344 7fa21bfff700 1 -- 172.21.15.79:0/1789791733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa21c1d4ab0 msgr2=0x7fa21c1c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:16.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.344 7fa21bfff700 1 --2- 172.21.15.79:0/1789791733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa21c1d4ab0 0x7fa21c1c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:16.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.344 7fa21bfff700 1 -- 172.21.15.79:0/1789791733 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c0bc460 con 0x7fa21c0d4b20 2021-04-09T18:34:16.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.344 7fa21bfff700 1 --2- 172.21.15.79:0/1789791733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa21c0d4b20 0x7fa21c0ba0d0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7fa21c0d8b60 tx=0x7fa21400cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:16.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.344 7fa203fff700 1 -- 172.21.15.79:0/1789791733 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa21c0bc460 con 0x7fa21c0d4b20 2021-04-09T18:34:16.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.344 7fa203fff700 1 -- 172.21.15.79:0/1789791733 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2140072e0 con 0x7fa21c0d4b20 2021-04-09T18:34:16.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.344 7fa221e76700 1 -- 172.21.15.79:0/1789791733 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa21c095420 con 0x7fa21c0d4b20 2021-04-09T18:34:16.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.344 7fa203fff700 1 -- 172.21.15.79:0/1789791733 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa214005720 con 0x7fa21c0d4b20 2021-04-09T18:34:16.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.344 7fa221e76700 1 -- 172.21.15.79:0/1789791733 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa21c1c6c50 con 0x7fa21c0d4b20 2021-04-09T18:34:16.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.344 7fa203fff700 1 -- 172.21.15.79:0/1789791733 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa214005920 con 0x7fa21c0d4b20 2021-04-09T18:34:16.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.344 7fa203fff700 1 --2- 172.21.15.79:0/1789791733 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa1fc029100 0x7fa1fc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:16.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.344 7fa203fff700 1 -- 172.21.15.79:0/1789791733 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fa214038ed0 con 0x7fa21c0d4b20 2021-04-09T18:34:16.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.344 7fa21b7fe700 1 --2- 172.21.15.79:0/1789791733 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa1fc029100 0x7fa1fc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:16.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.344 7fa21b7fe700 1 --2- 172.21.15.79:0/1789791733 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa1fc029100 0x7fa1fc02b650 crc :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:16.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.344 7fa221e76700 1 -- 172.21.15.79:0/1789791733 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa21c0e39d0 con 0x7fa21c0d4b20 2021-04-09T18:34:16.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.356 7fa203fff700 1 -- 172.21.15.79:0/1789791733 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa214000bf0 con 0x7fa21c0d4b20 2021-04-09T18:34:16.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.528 7fa221e76700 1 -- 172.21.15.79:0/1789791733 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa21c0a1cb0 con 0x7fa21c0d4b20 2021-04-09T18:34:16.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.528 7fa203fff700 1 -- 172.21.15.79:0/1789791733 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+2098 (secure 0 0 0) 0x7fa2140070d0 con 0x7fa21c0d4b20 2021-04-09T18:34:16.532 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:16.533 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":61,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7155,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/1349682878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1349682878},{"type":"v1","addr":"172.21.15.79:6833","nonce":1349682878}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":59}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:34:09.512814","modified":"2021-04-09 18:34:11.526918","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7147":{"gid":7147,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/57205751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":57205751},{"type":"v1","addr":"172.21.15.89:6835","nonce":57205751}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-04-09T18:34:16.533 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 61 2021-04-09T18:34:16.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.528 7fa221e76700 1 -- 172.21.15.79:0/1789791733 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa1fc029100 msgr2=0x7fa1fc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:16.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.528 7fa221e76700 1 --2- 172.21.15.79:0/1789791733 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa1fc029100 0x7fa1fc02b650 crc :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:16.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.528 7fa221e76700 1 -- 172.21.15.79:0/1789791733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa21c0d4b20 msgr2=0x7fa21c0ba0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:16.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.528 7fa221e76700 1 --2- 172.21.15.79:0/1789791733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa21c0d4b20 0x7fa21c0ba0d0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7fa21c0d8b60 tx=0x7fa21400cae0).stop 2021-04-09T18:34:16.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.528 7fa221e76700 1 -- 172.21.15.79:0/1789791733 shutdown_connections 2021-04-09T18:34:16.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.528 7fa221e76700 1 --2- 172.21.15.79:0/1789791733 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa1fc029100 0x7fa1fc02b650 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:16.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.528 7fa221e76700 1 --2- 172.21.15.79:0/1789791733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa21c1d4ab0 0x7fa21c1c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:16.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.528 7fa221e76700 1 --2- 172.21.15.79:0/1789791733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa21c0d4b20 0x7fa21c0ba0d0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:16.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.528 7fa221e76700 1 --2- 172.21.15.79:0/1789791733 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa21c0d7ac0 0x7fa21c0d44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:16.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.528 7fa221e76700 1 -- 172.21.15.79:0/1789791733 >> 172.21.15.79:0/1789791733 conn(0x7fa21c0bd320 msgr2=0x7fa21c0ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:16.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.528 7fa221e76700 1 -- 172.21.15.79:0/1789791733 shutdown_connections 2021-04-09T18:34:16.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:16.528 7fa221e76700 1 -- 172.21.15.79:0/1789791733 wait complete. 2021-04-09T18:34:16.747 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:34:09.512814', 'modified': '2021-04-09 18:34:11.526918', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 97, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7147}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7147': {'gid': 7147, 'name': 'b', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6835/57205751', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 57205751}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 57205751}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:34:16.748 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:34:16.748 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2021-04-09T18:34:16.860 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:34:16.860 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:34:16.860 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2021-04-09T18:34:16.861 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 7147, 2021-04-09T18:34:16.861 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2021-04-09T18:34:16.861 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2021-04-09T18:34:16.861 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 6.3232372950000002, 2021-04-09T18:34:16.861 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 61, 2021-04-09T18:34:16.862 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 98, 2021-04-09T18:34:16.862 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 98, 2021-04-09T18:34:16.862 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 10.894972895 2021-04-09T18:34:16.862 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:34:16.863 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 7147, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.3232372950000002, "mdsmap_epoch": 61, "osdmap_epoch": 98, "osdmap_epoch_barrier": 98, "uptime": 10.894972895 } 2021-04-09T18:34:16.864 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:34:16.864 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-04-09T18:34:16.865 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi136.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-04-09T18:34:16.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:16.866 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:34:16.884 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:34:16.948 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:34:16.949 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:34:17.011 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:34:17.012 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:34:17.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:17.013 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:34:17.061 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:34:17.061 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:34:17.104 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:34:17.119 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:34:17.119 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:34:17.175 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:34:17.176 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:34:17.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:17.177 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:34:17.179 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:2021-04-09 18:34:17.172 7f3a28b240c0 -1 init, newargv = 0x55bbfc379b10 newargc=9 2021-04-09T18:34:17.179 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13530]: starting ceph client 2021-04-09T18:34:17.188 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13530]: starting fuse 2021-04-09T18:34:18.287 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:34:18.304 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:34:18.305 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:34:18.360 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:34:18.361 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:34:18.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:18.363 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:34:18.413 INFO:teuthology.orchestra.run.smithi136.stdout:49 2021-04-09T18:34:18.413 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:34:18.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:18.415 DEBUG:teuthology.orchestra.run.smithi136:> sudo python3 -c ' 2021-04-09T18:34:18.415 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2021-04-09T18:34:18.416 DEBUG:teuthology.orchestra.run.smithi136:> import re 2021-04-09T18:34:18.416 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-04-09T18:34:18.416 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2021-04-09T18:34:18.417 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:34:18.417 DEBUG:teuthology.orchestra.run.smithi136:> def find_socket(client_name): 2021-04-09T18:34:18.418 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-04-09T18:34:18.418 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2021-04-09T18:34:18.418 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:34:18.419 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2021-04-09T18:34:18.419 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2021-04-09T18:34:18.420 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2021-04-09T18:34:18.420 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2021-04-09T18:34:18.421 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:34:18.421 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2021-04-09T18:34:18.421 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:34:18.422 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:34:18.422 DEBUG:teuthology.orchestra.run.smithi136:> return f 2021-04-09T18:34:18.422 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:34:18.423 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:34:18.424 DEBUG:teuthology.orchestra.run.smithi136:> print(find_socket("client.1")) 2021-04-09T18:34:18.424 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-04-09T18:34:18.502 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.1.13530.asok 2021-04-09T18:34:18.507 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13530.asok 2021-04-09T18:34:18.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:18.508 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13530.asok status 2021-04-09T18:34:18.579 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2021-04-09T18:34:18.580 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2021-04-09T18:34:18.580 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:34:18.580 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:34:18.580 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "1", 2021-04-09T18:34:18.581 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2021-04-09T18:34:18.581 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-04-09T18:34:18.581 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "13530", 2021-04-09T18:34:18.581 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2021-04-09T18:34:18.581 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:34:18.582 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2021-04-09T18:34:18.582 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2021-04-09T18:34:18.582 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 7327, 2021-04-09T18:34:18.582 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2021-04-09T18:34:18.582 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2021-04-09T18:34:18.583 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2021-04-09T18:34:18.583 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 7327 2021-04-09T18:34:18.583 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:34:18.583 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-04-09T18:34:18.584 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-04-09T18:34:18.584 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-04-09T18:34:18.584 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 1522945842 2021-04-09T18:34:18.584 INFO:teuthology.orchestra.run.smithi136.stdout: } 2021-04-09T18:34:18.584 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:34:18.585 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-04-09T18:34:18.585 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-04-09T18:34:18.585 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-04-09T18:34:18.585 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 1522945842 2021-04-09T18:34:18.585 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:34:18.586 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.7327 172.21.15.136:0/1522945842", 2021-04-09T18:34:18.586 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "172.21.15.136:0/1522945842", 2021-04-09T18:34:18.586 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2021-04-09T18:34:18.586 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 61, 2021-04-09T18:34:18.586 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 98, 2021-04-09T18:34:18.587 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:34:18.587 INFO:teuthology.orchestra.run.smithi136.stdout: "blacklisted": false, 2021-04-09T18:34:18.587 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2021-04-09T18:34:18.587 INFO:teuthology.orchestra.run.smithi136.stdout:} 2021-04-09T18:34:18.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:18.589 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:34:18.589 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:34:18.597 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-04-09T18:34:18.598 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-04-09T18:34:18.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:18.599 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:34:18.662 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-04-09T18:34:18.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e0cd7d700 1 Processor -- start 2021-04-09T18:34:18.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e0cd7d700 1 -- start start 2021-04-09T18:34:18.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e0cd7d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0e080f5520 0x7f0e080f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:18.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e0cd7d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e081c8010 0x7f0e081ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:18.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e0cd7d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e080fbb20 con 0x7f0e080e9ae0 2021-04-09T18:34:18.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e0cd7d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e080e9f30 con 0x7f0e080f5520 2021-04-09T18:34:18.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e0cd7d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e081c3dc0 con 0x7f0e081c8010 2021-04-09T18:34:18.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e06aef700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0e080f5520 0x7f0e080f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:18.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e062ee700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0e080e9ae0 0x7f0e0809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56622/0 (socket says 172.21.15.79:56622) 2021-04-09T18:34:18.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e06aef700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0e080f5520 0x7f0e080f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33678/0 (socket says 172.21.15.79:33678) 2021-04-09T18:34:18.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e062ee700 1 -- 172.21.15.79:0/3503509487 learned_addr learned my addr 172.21.15.79:0/3503509487 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:18.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e072f0700 1 --2- 172.21.15.79:0/3503509487 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e081c8010 0x7f0e081ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:18.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e06aef700 1 -- 172.21.15.79:0/3503509487 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e081c8010 msgr2=0x7f0e081ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:18.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e06aef700 1 --2- 172.21.15.79:0/3503509487 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e081c8010 0x7f0e081ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:18.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e06aef700 1 -- 172.21.15.79:0/3503509487 >> v1:172.21.15.79:6789/0 conn(0x7f0e080e9ae0 legacy=0x7f0e0809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:18.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e05aed700 1 -- 172.21.15.79:0/3503509487 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446969555 0 0) 0x7f0df00010d0 con 0x7f0e080e9ae0 2021-04-09T18:34:18.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e06aef700 1 -- 172.21.15.79:0/3503509487 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0809f910 con 0x7f0e080f5520 2021-04-09T18:34:18.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e06aef700 1 --2- 172.21.15.79:0/3503509487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e080f5520 0x7f0e080f64b0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f0e080f6f00 tx=0x7f0e0000b3c0).ready entity=mon.0 client_cookie=b83ed49d68fc2db server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:18.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e05aed700 1 -- 172.21.15.79:0/3503509487 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e0809f910 con 0x7f0e080f5520 2021-04-09T18:34:18.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e05aed700 1 -- 172.21.15.79:0/3503509487 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0000bbe0 con 0x7f0e080f5520 2021-04-09T18:34:18.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e05aed700 1 -- 172.21.15.79:0/3503509487 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e00002020 con 0x7f0e080f5520 2021-04-09T18:34:18.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e0cd7d700 1 -- 172.21.15.79:0/3503509487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e080f5520 msgr2=0x7f0e080f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:18.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.760 7f0e0cd7d700 1 --2- 172.21.15.79:0/3503509487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e080f5520 0x7f0e080f64b0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f0e080f6f00 tx=0x7f0e0000b3c0).stop 2021-04-09T18:34:18.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.764 7f0e0cd7d700 1 -- 172.21.15.79:0/3503509487 shutdown_connections 2021-04-09T18:34:18.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.764 7f0e0cd7d700 1 --2- 172.21.15.79:0/3503509487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e080f5520 0x7f0e080f64b0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:18.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.764 7f0e0cd7d700 1 --2- 172.21.15.79:0/3503509487 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e081c8010 0x7f0e081ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:18.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.764 7f0e0cd7d700 1 -- 172.21.15.79:0/3503509487 >> 172.21.15.79:0/3503509487 conn(0x7f0e080e5fe0 msgr2=0x7f0e080e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:18.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.764 7f0e0cd7d700 1 -- 172.21.15.79:0/3503509487 shutdown_connections 2021-04-09T18:34:18.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.764 7f0e0cd7d700 1 -- 172.21.15.79:0/3503509487 wait complete. 2021-04-09T18:34:18.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.764 7f0e0cd7d700 1 Processor -- start 2021-04-09T18:34:18.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.764 7f0e0cd7d700 1 -- start start 2021-04-09T18:34:18.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0e0cd7d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e080c0510 0x7f0e0809aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:18.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0e0cd7d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e08090b50 0x7f0e0809a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:18.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0e0cd7d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e08090fa0 0x7f0e080d68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:18.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0e0cd7d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e080bf4c0 con 0x7f0e08090b50 2021-04-09T18:34:18.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0e0cd7d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e080bdf40 con 0x7f0e080c0510 2021-04-09T18:34:18.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0e0cd7d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e080c0960 con 0x7f0e08090fa0 2021-04-09T18:34:18.780 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0e062ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e08090b50 0x7f0e0809a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0e062ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e08090b50 0x7f0e0809a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33686/0 (socket says 172.21.15.79:33686) 2021-04-09T18:34:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0e062ee700 1 -- 172.21.15.79:0/2669556996 learned_addr learned my addr 172.21.15.79:0/2669556996 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0e06aef700 1 --2- 172.21.15.79:0/2669556996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e080c0510 0x7f0e0809aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0e072f0700 1 --2- 172.21.15.79:0/2669556996 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e08090fa0 0x7f0e080d68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:18.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0e062ee700 1 -- 172.21.15.79:0/2669556996 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e08090fa0 msgr2=0x7f0e080d68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:18.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0e062ee700 1 --2- 172.21.15.79:0/2669556996 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e08090fa0 0x7f0e080d68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:18.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0e062ee700 1 -- 172.21.15.79:0/2669556996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e080c0510 msgr2=0x7f0e0809aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:18.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0e062ee700 1 --2- 172.21.15.79:0/2669556996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e080c0510 0x7f0e0809aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:18.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0e062ee700 1 -- 172.21.15.79:0/2669556996 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0809a720 con 0x7f0e08090b50 2021-04-09T18:34:18.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0e062ee700 1 --2- 172.21.15.79:0/2669556996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e08090b50 0x7f0e0809a0f0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f0e080874d0 tx=0x7f0df000cac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:18.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0dff7fe700 1 -- 172.21.15.79:0/2669556996 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e0809a720 con 0x7f0e08090b50 2021-04-09T18:34:18.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0dff7fe700 1 -- 172.21.15.79:0/2669556996 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df0007320 con 0x7f0e08090b50 2021-04-09T18:34:18.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0e0cd7d700 1 -- 172.21.15.79:0/2669556996 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e080d6ef0 con 0x7f0e08090b50 2021-04-09T18:34:18.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0dff7fe700 1 -- 172.21.15.79:0/2669556996 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0df00057e0 con 0x7f0e08090b50 2021-04-09T18:34:18.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0e0cd7d700 1 -- 172.21.15.79:0/2669556996 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e080991b0 con 0x7f0e08090b50 2021-04-09T18:34:18.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0dff7fe700 1 -- 172.21.15.79:0/2669556996 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0df001a020 con 0x7f0e08090b50 2021-04-09T18:34:18.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0dff7fe700 1 --2- 172.21.15.79:0/2669556996 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0dec029100 0x7f0dec02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:18.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0dff7fe700 1 -- 172.21.15.79:0/2669556996 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f0df00391d0 con 0x7f0e08090b50 2021-04-09T18:34:18.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.768 7f0e06aef700 1 --2- 172.21.15.79:0/2669556996 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0dec029100 0x7f0dec02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:18.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.772 7f0e06aef700 1 --2- 172.21.15.79:0/2669556996 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0dec029100 0x7f0dec02b650 crc :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:18.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.772 7f0e0cd7d700 1 -- 172.21.15.79:0/2669556996 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e080e39e0 con 0x7f0e08090b50 2021-04-09T18:34:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.780 7f0dff7fe700 1 -- 172.21.15.79:0/2669556996 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0df0007110 con 0x7f0e08090b50 2021-04-09T18:34:18.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.944 7f0e0cd7d700 1 -- 172.21.15.79:0/2669556996 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f0e080a1cc0 con 0x7f0e08090b50 2021-04-09T18:34:18.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.944 7f0dff7fe700 1 -- 172.21.15.79:0/2669556996 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1574 (secure 0 0 0) 0x7f0df0000bf0 con 0x7f0e08090b50 2021-04-09T18:34:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:18.948 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:34:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "stats": { 2021-04-09T18:34:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "total_bytes": 773094113280, 2021-04-09T18:34:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "total_avail_bytes": 764494200832, 2021-04-09T18:34:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_bytes": 9977856, 2021-04-09T18:34:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_raw_bytes": 8599912448, 2021-04-09T18:34:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_raw_ratio": 0.011124017648398876, 2021-04-09T18:34:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "num_osds": 8, 2021-04-09T18:34:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "num_per_pool_osds": 8 2021-04-09T18:34:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "stats_by_class": { 2021-04-09T18:34:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "ssd": { 2021-04-09T18:34:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "total_bytes": 773094113280, 2021-04-09T18:34:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "total_avail_bytes": 764494200832, 2021-04-09T18:34:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_bytes": 9977856, 2021-04-09T18:34:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_raw_bytes": 8599912448, 2021-04-09T18:34:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_raw_ratio": 0.011124017648398876 2021-04-09T18:34:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:34:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd", 2021-04-09T18:34:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 1, 2021-04-09T18:34:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "stats": { 2021-04-09T18:34:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "stored": 0, 2021-04-09T18:34:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "objects": 0, 2021-04-09T18:34:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "kb_used": 0, 2021-04-09T18:34:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "bytes_used": 0, 2021-04-09T18:34:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "percent_used": 0, 2021-04-09T18:34:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "max_avail": 362919624704 2021-04-09T18:34:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cephfs_metadata", 2021-04-09T18:34:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 18, 2021-04-09T18:34:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "stats": { 2021-04-09T18:34:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "stored": 3915, 2021-04-09T18:34:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "objects": 22, 2021-04-09T18:34:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "kb_used": 64, 2021-04-09T18:34:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "bytes_used": 65536, 2021-04-09T18:34:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "percent_used": 9.0289958620815014e-08, 2021-04-09T18:34:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "max_avail": 362919624704 2021-04-09T18:34:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cephfs_data", 2021-04-09T18:34:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 19, 2021-04-09T18:34:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "stats": { 2021-04-09T18:34:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "stored": 0, 2021-04-09T18:34:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "objects": 0, 2021-04-09T18:34:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "kb_used": 0, 2021-04-09T18:34:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "bytes_used": 0, 2021-04-09T18:34:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "percent_used": 0, 2021-04-09T18:34:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "max_avail": 362919624704 2021-04-09T18:34:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:18.962 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:34:18.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.944 7f0e0cd7d700 1 -- 172.21.15.79:0/2669556996 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0dec029100 msgr2=0x7f0dec02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:18.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.944 7f0e0cd7d700 1 --2- 172.21.15.79:0/2669556996 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0dec029100 0x7f0dec02b650 crc :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:18.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.944 7f0e0cd7d700 1 -- 172.21.15.79:0/2669556996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e08090b50 msgr2=0x7f0e0809a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:18.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.944 7f0e0cd7d700 1 --2- 172.21.15.79:0/2669556996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e08090b50 0x7f0e0809a0f0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f0e080874d0 tx=0x7f0df000cac0).stop 2021-04-09T18:34:18.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.944 7f0e0cd7d700 1 -- 172.21.15.79:0/2669556996 shutdown_connections 2021-04-09T18:34:18.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.944 7f0e0cd7d700 1 --2- 172.21.15.79:0/2669556996 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0dec029100 0x7f0dec02b650 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:18.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.944 7f0e0cd7d700 1 --2- 172.21.15.79:0/2669556996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e080c0510 0x7f0e0809aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:18.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.944 7f0e0cd7d700 1 --2- 172.21.15.79:0/2669556996 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e08090fa0 0x7f0e080d68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:18.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.944 7f0e0cd7d700 1 --2- 172.21.15.79:0/2669556996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e08090b50 0x7f0e0809a0f0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:18.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.944 7f0e0cd7d700 1 -- 172.21.15.79:0/2669556996 >> 172.21.15.79:0/2669556996 conn(0x7f0e08091480 msgr2=0x7f0e080ac750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:18.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.944 7f0e0cd7d700 1 -- 172.21.15.79:0/2669556996 shutdown_connections 2021-04-09T18:34:18.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:18.944 7f0e0cd7d700 1 -- 172.21.15.79:0/2669556996 wait complete. 2021-04-09T18:34:18.967 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data size -f json-pretty 2021-04-09T18:34:19.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.068 7f8bae4ed700 1 Processor -- start 2021-04-09T18:34:19.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.068 7f8bae4ed700 1 -- start start 2021-04-09T18:34:19.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.068 7f8bae4ed700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba80f5550 0x7f8ba80f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:19.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.068 7f8bae4ed700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8ba80e9b10 0x7f8ba809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:19.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.068 7f8bae4ed700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ba80fbb50 con 0x7f8ba81c2de0 2021-04-09T18:34:19.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.068 7f8bae4ed700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba80e9f60 con 0x7f8ba80e9b10 2021-04-09T18:34:19.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.068 7f8bae4ed700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba80e5a00 con 0x7f8ba80f5550 2021-04-09T18:34:19.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.068 7f8ba7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba80f5550 0x7f8ba80f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:19.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.068 7f8ba77fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8ba80e9b10 0x7f8ba809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:19.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.068 7f8ba77fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8ba80e9b10 0x7f8ba809f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:50266/0 (socket says 172.21.15.79:50266) 2021-04-09T18:34:19.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.068 7f8ba7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba80f5550 0x7f8ba80f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:58920/0 (socket says 172.21.15.79:58920) 2021-04-09T18:34:19.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.068 7f8ba77fe700 1 -- 172.21.15.79:0/3271314735 learned_addr learned my addr 172.21.15.79:0/3271314735 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:19.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.068 7f8baca92700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8ba81c2de0 0x7f8ba81c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:57108/0 (socket says 172.21.15.79:57108) 2021-04-09T18:34:19.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.068 7f8ba77fe700 1 -- 172.21.15.79:0/3271314735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba80f5550 msgr2=0x7f8ba80f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:19.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.068 7f8ba77fe700 1 --2- 172.21.15.79:0/3271314735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba80f5550 0x7f8ba80f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:19.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.068 7f8ba77fe700 1 -- 172.21.15.79:0/3271314735 >> v1:172.21.15.89:6789/0 conn(0x7f8ba81c2de0 legacy=0x7f8ba81c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:19.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.068 7f8ba77fe700 1 -- 172.21.15.79:0/3271314735 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba80e5700 con 0x7f8ba80e9b10 2021-04-09T18:34:19.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.072 7f8ba77fe700 1 --2- 172.21.15.79:0/3271314735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ba80e9b10 0x7f8ba809f110 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f8ba0001340 tx=0x7f8ba0001040).ready entity=mon.1 client_cookie=60f497d230660466 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:19.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.072 7f8ba6ffd700 1 -- 172.21.15.79:0/3271314735 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8ba80e5700 con 0x7f8ba80e9b10 2021-04-09T18:34:19.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.072 7f8ba6ffd700 1 -- 172.21.15.79:0/3271314735 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b90009770 con 0x7f8ba80e9b10 2021-04-09T18:34:19.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.072 7f8ba6ffd700 1 -- 172.21.15.79:0/3271314735 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b90009b80 con 0x7f8ba80e9b10 2021-04-09T18:34:19.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.072 7f8bae4ed700 1 -- 172.21.15.79:0/3271314735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ba80e9b10 msgr2=0x7f8ba809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:19.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.072 7f8bae4ed700 1 --2- 172.21.15.79:0/3271314735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ba80e9b10 0x7f8ba809f110 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f8ba0001340 tx=0x7f8ba0001040).stop 2021-04-09T18:34:19.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.072 7f8bae4ed700 1 -- 172.21.15.79:0/3271314735 shutdown_connections 2021-04-09T18:34:19.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.072 7f8bae4ed700 1 --2- 172.21.15.79:0/3271314735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba80f5550 0x7f8ba80f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:19.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.072 7f8bae4ed700 1 --2- 172.21.15.79:0/3271314735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ba80e9b10 0x7f8ba809f110 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:19.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.072 7f8bae4ed700 1 -- 172.21.15.79:0/3271314735 >> 172.21.15.79:0/3271314735 conn(0x7f8ba80e6010 msgr2=0x7f8ba80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:19.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.072 7f8bae4ed700 1 -- 172.21.15.79:0/3271314735 shutdown_connections 2021-04-09T18:34:19.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.072 7f8bae4ed700 1 -- 172.21.15.79:0/3271314735 wait complete. 2021-04-09T18:34:19.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8bae4ed700 1 Processor -- start 2021-04-09T18:34:19.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8bae4ed700 1 -- start start 2021-04-09T18:34:19.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8bae4ed700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba81a4870 0x7f8ba80ced70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:19.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8bae4ed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba81a4cc0 0x7f8ba8094180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:19.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8bae4ed700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ba80cf3a0 0x7f8ba80947b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:19.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8bae4ed700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba80d5270 con 0x7f8ba81a4cc0 2021-04-09T18:34:19.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8bae4ed700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba80d5570 con 0x7f8ba80cf3a0 2021-04-09T18:34:19.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8bae4ed700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba80d6af0 con 0x7f8ba81a4870 2021-04-09T18:34:19.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8ba77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba81a4cc0 0x7f8ba8094180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:19.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8ba77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba81a4cc0 0x7f8ba8094180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33702/0 (socket says 172.21.15.79:33702) 2021-04-09T18:34:19.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8ba77fe700 1 -- 172.21.15.79:0/159383608 learned_addr learned my addr 172.21.15.79:0/159383608 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:19.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8baca92700 1 --2- 172.21.15.79:0/159383608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ba80cf3a0 0x7f8ba80947b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:19.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8ba7fff700 1 --2- 172.21.15.79:0/159383608 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba81a4870 0x7f8ba80ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:19.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8ba77fe700 1 -- 172.21.15.79:0/159383608 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba81a4870 msgr2=0x7f8ba80ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:19.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8ba77fe700 1 --2- 172.21.15.79:0/159383608 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba81a4870 0x7f8ba80ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:19.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8ba77fe700 1 -- 172.21.15.79:0/159383608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ba80cf3a0 msgr2=0x7f8ba80947b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:19.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8ba77fe700 1 --2- 172.21.15.79:0/159383608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ba80cf3a0 0x7f8ba80947b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:19.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8ba77fe700 1 -- 172.21.15.79:0/159383608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba80b9160 con 0x7f8ba81a4cc0 2021-04-09T18:34:19.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8ba77fe700 1 --2- 172.21.15.79:0/159383608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba81a4cc0 0x7f8ba8094180 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f8ba80d2f00 tx=0x7f8b90006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:19.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8ba4ff9700 1 -- 172.21.15.79:0/159383608 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8ba80b9160 con 0x7f8ba81a4cc0 2021-04-09T18:34:19.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8ba4ff9700 1 -- 172.21.15.79:0/159383608 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b90011d60 con 0x7f8ba81a4cc0 2021-04-09T18:34:19.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8bae4ed700 1 -- 172.21.15.79:0/159383608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba8094de0 con 0x7f8ba81a4cc0 2021-04-09T18:34:19.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8ba4ff9700 1 -- 172.21.15.79:0/159383608 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b9001d630 con 0x7f8ba81a4cc0 2021-04-09T18:34:19.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.076 7f8bae4ed700 1 -- 172.21.15.79:0/159383608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba8099440 con 0x7f8ba81a4cc0 2021-04-09T18:34:19.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.080 7f8ba4ff9700 1 -- 172.21.15.79:0/159383608 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8b9001c3e0 con 0x7f8ba81a4cc0 2021-04-09T18:34:19.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.080 7f8ba4ff9700 1 --2- 172.21.15.79:0/159383608 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b8c0290a0 0x7f8b8c02b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:19.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.080 7f8ba4ff9700 1 -- 172.21.15.79:0/159383608 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f8b9003bc70 con 0x7f8ba81a4cc0 2021-04-09T18:34:19.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.080 7f8ba7fff700 1 --2- 172.21.15.79:0/159383608 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b8c0290a0 0x7f8b8c02b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:19.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.080 7f8ba7fff700 1 --2- 172.21.15.79:0/159383608 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b8c0290a0 0x7f8b8c02b5f0 crc :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:19.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.084 7f8bae4ed700 1 -- 172.21.15.79:0/159383608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba80e39f0 con 0x7f8ba81a4cc0 2021-04-09T18:34:19.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.088 7f8ba4ff9700 1 -- 172.21.15.79:0/159383608 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8b90009560 con 0x7f8ba81a4cc0 2021-04-09T18:34:19.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.240 7f8bae4ed700 1 -- 172.21.15.79:0/159383608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "size", "prefix": "osd pool get", "pool": "cephfs_data", "format": "json-pretty"} v 0) v1 -- 0x7f8ba80f5b50 con 0x7f8ba81a4cc0 2021-04-09T18:34:19.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.240 7f8ba4ff9700 1 -- 172.21.15.79:0/159383608 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "size", "prefix": "osd pool get", "pool": "cephfs_data", "format": "json-pretty"}]=0 v98) v1 ==== 123+0+64 (secure 0 0 0) 0x7f8b90011b50 con 0x7f8ba81a4cc0 2021-04-09T18:34:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:19.247 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:34:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": "cephfs_data", 2021-04-09T18:34:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_id": 19, 2021-04-09T18:34:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2 2021-04-09T18:34:19.248 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:34:19.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.244 7f8bae4ed700 1 -- 172.21.15.79:0/159383608 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b8c0290a0 msgr2=0x7f8b8c02b5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:19.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.244 7f8bae4ed700 1 --2- 172.21.15.79:0/159383608 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b8c0290a0 0x7f8b8c02b5f0 crc :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:19.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.244 7f8bae4ed700 1 -- 172.21.15.79:0/159383608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba81a4cc0 msgr2=0x7f8ba8094180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:19.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.244 7f8bae4ed700 1 --2- 172.21.15.79:0/159383608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba81a4cc0 0x7f8ba8094180 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f8ba80d2f00 tx=0x7f8b90006890).stop 2021-04-09T18:34:19.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.244 7f8bae4ed700 1 -- 172.21.15.79:0/159383608 shutdown_connections 2021-04-09T18:34:19.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.244 7f8bae4ed700 1 --2- 172.21.15.79:0/159383608 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b8c0290a0 0x7f8b8c02b5f0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:19.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.244 7f8bae4ed700 1 --2- 172.21.15.79:0/159383608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ba80cf3a0 0x7f8ba80947b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:19.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.244 7f8bae4ed700 1 --2- 172.21.15.79:0/159383608 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ba81a4870 0x7f8ba80ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:19.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.244 7f8bae4ed700 1 --2- 172.21.15.79:0/159383608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba81a4cc0 0x7f8ba8094180 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:19.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.244 7f8bae4ed700 1 -- 172.21.15.79:0/159383608 >> 172.21.15.79:0/159383608 conn(0x7f8ba8093630 msgr2=0x7f8ba80d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:19.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.244 7f8bae4ed700 1 -- 172.21.15.79:0/159383608 shutdown_connections 2021-04-09T18:34:19.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.244 7f8bae4ed700 1 -- 172.21.15.79:0/159383608 wait complete. 2021-04-09T18:34:19.258 DEBUG:teuthology.orchestra.run.smithi090:> cd /home/ubuntu/cephtest/mnt.0 && sudo df . 2021-04-09T18:34:19.289 INFO:teuthology.orchestra.run.smithi090.stdout:Filesystem 1K-blocks Used Available Use% Mounted on 2021-04-09T18:34:19.289 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-fuse 354410496 0 354410496 0% /home/ubuntu/cephtest/mnt.0 2021-04-09T18:34:19.290 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:34:19.291 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:34:19.308 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:34:19.328 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:34:19.353 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:34:19.371 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:34:19.391 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:34:19.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:19.392 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:34:19.393 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:34:19.401 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:34:19.402 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:34:19.403 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi090.front.sepia.ceph.com... 2021-04-09T18:34:19.403 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:34:19.404 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:34:19.479 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[13957]: fuse finished with error 0 and tester_r 0 2021-04-09T18:34:19.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:19.480 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:34:19.481 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:34:19.528 INFO:teuthology.orchestra.run.smithi090.stdout:ext2/ext3 2021-04-09T18:34:19.530 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:34:19.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:34:19.562 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:34:19.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:19.609 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:34:19.609 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:34:19.617 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-04-09T18:34:19.618 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-04-09T18:34:19.618 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2021-04-09T18:34:19.619 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:34:19.619 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:34:19.687 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13530]: fuse finished with error 0 and tester_r 0 2021-04-09T18:34:19.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:19.689 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:34:19.689 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:34:19.737 INFO:teuthology.orchestra.run.smithi136.stdout:ext2/ext3 2021-04-09T18:34:19.738 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:34:19.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:34:19.774 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:34:19.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:19.822 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:34:19.822 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:34:19.829 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:34:19.830 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:34:19.831 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:34:19.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:34:19.832 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:34:19.881 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:34:19.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.972 7f03717b6700 1 Processor -- start 2021-04-09T18:34:19.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.972 7f03717b6700 1 -- start start 2021-04-09T18:34:19.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.972 7f03717b6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f036c0e9ae0 0x7f036c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:19.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.972 7f03717b6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f036c1c8010 0x7f036c1ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:19.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.972 7f03717b6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f036c0fbb20 con 0x7f036c0f5520 2021-04-09T18:34:19.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.972 7f03717b6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036c1c3dc0 con 0x7f036c1c8010 2021-04-09T18:34:19.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.972 7f03717b6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036c0e9f30 con 0x7f036c0e9ae0 2021-04-09T18:34:19.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.976 7f036bd51700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f036c1c8010 0x7f036c1ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:19.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.976 7f036bd51700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f036c1c8010 0x7f036c1ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33710/0 (socket says 172.21.15.79:33710) 2021-04-09T18:34:19.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.976 7f036bd51700 1 -- 172.21.15.79:0/486389570 learned_addr learned my addr 172.21.15.79:0/486389570 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:19.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.976 7f036ad4f700 1 --2- 172.21.15.79:0/486389570 >> v2:172.21.15.89:3300/0 conn(0x7f036c0e9ae0 0x7f036c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:19.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.976 7f036bd51700 1 -- 172.21.15.79:0/486389570 >> v2:172.21.15.89:3300/0 conn(0x7f036c0e9ae0 msgr2=0x7f036c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:19.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.976 7f036bd51700 1 --2- 172.21.15.79:0/486389570 >> v2:172.21.15.89:3300/0 conn(0x7f036c0e9ae0 0x7f036c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:19.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.976 7f036bd51700 1 -- 172.21.15.79:0/486389570 >> v1:172.21.15.89:6789/0 conn(0x7f036c0f5520 legacy=0x7f036c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:19.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.976 7f036bd51700 1 -- 172.21.15.79:0/486389570 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c0e56d0 con 0x7f036c1c8010 2021-04-09T18:34:19.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.976 7f036bd51700 1 --2- 172.21.15.79:0/486389570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f036c1c8010 0x7f036c1ca470 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f03640032b0 tx=0x7f036400b3c0).ready entity=mon.0 client_cookie=946cbd068c2b5b2b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:19.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.976 7f036a54e700 1 -- 172.21.15.79:0/486389570 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f036c0e56d0 con 0x7f036c1c8010 2021-04-09T18:34:19.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.976 7f036a54e700 1 -- 172.21.15.79:0/486389570 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036400bc20 con 0x7f036c1c8010 2021-04-09T18:34:19.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.976 7f036a54e700 1 -- 172.21.15.79:0/486389570 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0364002020 con 0x7f036c1c8010 2021-04-09T18:34:19.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.976 7f03717b6700 1 -- 172.21.15.79:0/486389570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f036c1c8010 msgr2=0x7f036c1ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:19.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.976 7f03717b6700 1 --2- 172.21.15.79:0/486389570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f036c1c8010 0x7f036c1ca470 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f03640032b0 tx=0x7f036400b3c0).stop 2021-04-09T18:34:19.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.976 7f03717b6700 1 -- 172.21.15.79:0/486389570 shutdown_connections 2021-04-09T18:34:19.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.976 7f03717b6700 1 --2- 172.21.15.79:0/486389570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f036c1c8010 0x7f036c1ca470 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:19.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.976 7f03717b6700 1 --2- 172.21.15.79:0/486389570 >> v2:172.21.15.89:3300/0 conn(0x7f036c0e9ae0 0x7f036c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:19.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.976 7f03717b6700 1 -- 172.21.15.79:0/486389570 >> 172.21.15.79:0/486389570 conn(0x7f036c0e5fe0 msgr2=0x7f036c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:19.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.976 7f03717b6700 1 -- 172.21.15.79:0/486389570 shutdown_connections 2021-04-09T18:34:19.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.976 7f03717b6700 1 -- 172.21.15.79:0/486389570 wait complete. 2021-04-09T18:34:19.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.980 7f03717b6700 1 Processor -- start 2021-04-09T18:34:19.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.980 7f03717b6700 1 -- start start 2021-04-09T18:34:19.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f03717b6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036c1aad80 0x7f036c19dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:19.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f03717b6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f036c19e4c0 0x7f036c0afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:19.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f03717b6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f036c0b0030 0x7f036c0d5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:19.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f03717b6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c0bf5c0 con 0x7f036c0b0030 2021-04-09T18:34:19.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f03717b6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c0bf8c0 con 0x7f036c19e4c0 2021-04-09T18:34:19.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f03717b6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036c0bf150 con 0x7f036c1aad80 2021-04-09T18:34:19.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f036bd51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f036c0b0030 0x7f036c0d5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:19.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f036bd51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f036c0b0030 0x7f036c0d5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33714/0 (socket says 172.21.15.79:33714) 2021-04-09T18:34:19.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f036bd51700 1 -- 172.21.15.79:0/2616755504 learned_addr learned my addr 172.21.15.79:0/2616755504 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:19.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f036b550700 1 --2- 172.21.15.79:0/2616755504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036c1aad80 0x7f036c19dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f036ad4f700 1 --2- 172.21.15.79:0/2616755504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f036c19e4c0 0x7f036c0afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f036bd51700 1 -- 172.21.15.79:0/2616755504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036c1aad80 msgr2=0x7f036c19dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f036bd51700 1 --2- 172.21.15.79:0/2616755504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036c1aad80 0x7f036c19dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f036bd51700 1 -- 172.21.15.79:0/2616755504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f036c19e4c0 msgr2=0x7f036c0afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f036bd51700 1 --2- 172.21.15.79:0/2616755504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f036c19e4c0 0x7f036c0afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:19.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f036bd51700 1 -- 172.21.15.79:0/2616755504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c19e0e0 con 0x7f036c0b0030 2021-04-09T18:34:19.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f036bd51700 1 --2- 172.21.15.79:0/2616755504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f036c0b0030 0x7f036c0d5080 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f036c096700 tx=0x7f0364006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:19.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f0353fff700 1 -- 172.21.15.79:0/2616755504 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f036c19e0e0 con 0x7f036c0b0030 2021-04-09T18:34:19.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f0353fff700 1 -- 172.21.15.79:0/2616755504 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036401a5d0 con 0x7f036c0b0030 2021-04-09T18:34:19.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f03717b6700 1 -- 172.21.15.79:0/2616755504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f036c0d56b0 con 0x7f036c0b0030 2021-04-09T18:34:20.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f0353fff700 1 -- 172.21.15.79:0/2616755504 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0364020020 con 0x7f036c0b0030 2021-04-09T18:34:20.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f03717b6700 1 -- 172.21.15.79:0/2616755504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f036c0d59d0 con 0x7f036c0b0030 2021-04-09T18:34:20.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f0353fff700 1 -- 172.21.15.79:0/2616755504 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0364019040 con 0x7f036c0b0030 2021-04-09T18:34:20.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f0353fff700 1 --2- 172.21.15.79:0/2616755504 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f034c029100 0x7f034c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:20.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.984 7f0353fff700 1 -- 172.21.15.79:0/2616755504 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f0364018040 con 0x7f036c0b0030 2021-04-09T18:34:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.988 7f036b550700 1 --2- 172.21.15.79:0/2616755504 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f034c029100 0x7f034c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:19.988 7f036b550700 1 --2- 172.21.15.79:0/2616755504 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f034c029100 0x7f034c02b650 crc :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:20.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.004 7f03717b6700 1 -- 172.21.15.79:0/2616755504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f036c0e39e0 con 0x7f036c0b0030 2021-04-09T18:34:20.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.008 7f0353fff700 1 -- 172.21.15.79:0/2616755504 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f036401a3c0 con 0x7f036c0b0030 2021-04-09T18:34:20.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.172 7f03717b6700 1 -- 172.21.15.79:0/2616755504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f036c0a1cc0 con 0x7f036c0b0030 2021-04-09T18:34:20.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.176 7f0353fff700 1 -- 172.21.15.79:0/2616755504 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v98) v1 ==== 81+0+30899 (secure 0 0 0) 0x7f036400ba10 con 0x7f036c0b0030 2021-04-09T18:34:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:20.181 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:34:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 98, 2021-04-09T18:34:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:34:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:34:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:34:10.009667", 2021-04-09T18:34:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:34:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:34:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:34:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:34:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:34:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:34:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:34:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:34:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:34:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:34:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:34:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:34:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:34:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:34:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:34:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 19, 2021-04-09T18:34:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:34:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:34:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:34:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:34:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:34:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:34:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:34:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:34:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:34:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:34:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:34:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:34:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:34:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:34:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:34:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:34:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:34:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:34:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:34:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:34:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:34:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:34:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:34:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:34:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:34:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:34:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:34:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:34:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:34:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:34:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:34:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:34:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:34:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:34:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:34:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:34:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:34:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:34:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:34:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:34:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:34:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:34:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:34:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:34:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:34:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:34:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:34:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:34:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:34:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:34:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:34:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:34:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:34:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:34:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:34:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:34:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:34:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:34:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:34:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:34:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:34:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:34:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:34:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:34:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:34:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:34:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:34:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:34:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:34:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 18, 2021-04-09T18:34:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2021-04-09T18:34:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:34:07.761734", 2021-04-09T18:34:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:34:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:34:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:34:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:34:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:34:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:34:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:34:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:34:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:34:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:34:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:34:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:34:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:34:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:34:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:34:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:34:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:34:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:34:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:34:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:34:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "96", 2021-04-09T18:34:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:34:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:34:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:34:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:34:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:34:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:34:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:34:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:34:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:34:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:34:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:34:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:34:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:34:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:34:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:34:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:34:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:34:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:34:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:34:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:34:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:34:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:34:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:34:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:34:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:34:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:34:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:34:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:34:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:34:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:34:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:34:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:34:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:34:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:34:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:34:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:34:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:34:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2021-04-09T18:34:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2021-04-09T18:34:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2021-04-09T18:34:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2021-04-09T18:34:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:34:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:34:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2021-04-09T18:34:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 19, 2021-04-09T18:34:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2021-04-09T18:34:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:34:08.596089", 2021-04-09T18:34:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:34:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:34:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:34:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:34:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:34:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:34:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:34:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:34:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:34:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:34:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:34:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:34:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:34:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:34:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:34:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:34:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:34:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:34:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:34:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:34:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "97", 2021-04-09T18:34:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:34:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:34:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:34:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:34:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:34:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:34:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:34:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:34:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:34:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:34:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:34:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:34:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:34:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:34:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:34:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:34:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:34:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:34:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:34:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:34:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:34:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:34:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:34:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:34:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:34:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:34:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:34:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:34:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:34:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:34:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:34:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:34:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:34:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:34:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:34:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:34:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:34:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:34:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:34:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:34:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2021-04-09T18:34:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:34:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:34:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:34:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:34:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 94, 2021-04-09T18:34:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:34:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:34:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:34:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:34:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:34:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:34:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:34:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:34:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:34:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:34:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:34:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:34:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:34:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:34:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 95, 2021-04-09T18:34:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:34:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:34:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:34:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:34:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:34:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:34:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:34:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:34:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:34:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:34:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:34:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:34:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:34:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:34:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 95, 2021-04-09T18:34:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:34:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:34:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.271 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.271 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:34:20.271 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:20.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.272 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.272 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:34:20.272 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:20.273 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.273 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.273 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:20.273 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.274 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.274 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:34:20.274 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:20.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.275 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.275 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:34:20.275 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:20.276 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.276 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.276 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:20.276 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.277 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.277 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:34:20.277 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:20.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.278 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.278 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:34:20.278 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:20.278 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.279 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.279 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:34:20.279 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:34:20.280 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:34:20.280 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:34:20.280 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:20.280 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:20.280 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:20.281 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.281 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:34:20.281 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:34:20.282 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:20.282 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:20.282 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:20.282 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:20.282 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:20.283 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:20.283 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:20.283 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 95, 2021-04-09T18:34:20.283 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:20.283 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:20.284 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:20.284 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.284 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.284 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:34:20.285 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:20.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.285 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.285 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:34:20.286 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:20.286 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.286 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.286 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:20.287 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.287 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.287 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:34:20.288 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:20.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.288 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.288 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:34:20.289 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:20.289 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.289 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.289 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:20.290 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.290 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.290 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:34:20.290 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:20.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.291 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.291 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:34:20.291 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:20.292 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.292 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.292 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:20.292 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.293 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.293 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:34:20.293 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:20.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.294 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.294 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:34:20.294 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:20.295 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.295 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.295 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:34:20.295 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:34:20.296 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:34:20.296 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:34:20.296 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:20.296 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:20.296 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:20.297 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.297 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:34:20.297 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:34:20.298 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:20.298 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:20.298 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:20.298 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:20.298 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:20.299 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:20.299 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:20.299 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 95, 2021-04-09T18:34:20.299 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:20.299 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:20.300 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:20.300 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.300 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.300 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:34:20.301 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:20.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.301 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.302 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:34:20.302 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:20.302 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.302 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.303 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:20.303 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.303 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.304 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:34:20.304 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:20.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.305 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.305 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:34:20.305 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:20.305 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.305 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.306 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:20.306 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.307 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.307 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:34:20.307 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:20.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.308 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.308 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:34:20.308 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:20.308 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.308 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.309 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:20.309 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.309 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.310 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:34:20.310 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:20.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.310 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.311 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:34:20.311 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:20.311 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.311 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.312 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:34:20.312 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:34:20.313 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:34:20.313 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:34:20.313 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:20.313 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:20.313 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:20.314 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.314 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:34:20.314 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:34:20.315 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:20.315 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:20.315 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:20.315 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:20.315 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:20.316 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:20.316 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:20.316 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 95, 2021-04-09T18:34:20.316 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:20.317 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:20.317 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:20.317 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.317 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.318 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:34:20.318 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:20.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.318 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.319 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:34:20.319 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:20.319 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.319 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.320 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:20.320 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.320 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.320 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:34:20.321 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:20.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.321 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.321 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:34:20.322 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:20.322 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.322 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.322 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:20.323 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.323 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.323 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:34:20.324 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:20.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.324 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.324 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:34:20.325 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:20.325 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.325 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.325 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:20.326 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.326 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.326 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:34:20.326 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:20.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.327 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.327 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:34:20.328 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:20.328 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.328 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.329 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:34:20.329 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:34:20.330 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:34:20.330 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:34:20.330 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:20.330 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:20.331 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:20.331 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.331 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:34:20.332 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:34:20.332 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:20.332 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:20.332 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:20.332 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:20.333 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:20.333 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:20.333 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:20.333 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 86, 2021-04-09T18:34:20.333 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:20.334 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:20.334 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:20.334 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.334 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.335 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:34:20.335 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:20.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.335 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.336 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:34:20.336 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:20.336 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.336 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.337 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:20.337 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.337 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.338 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:34:20.338 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:20.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.338 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.339 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:34:20.339 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:20.339 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.339 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:34:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:34:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:34:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:34:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:34:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:34:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:34:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:34:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:34:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:34:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 95, 2021-04-09T18:34:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.351 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.351 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:34:20.351 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:20.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.352 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.352 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:34:20.352 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:20.352 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:34:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:34:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:34:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:34:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:34:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:34:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:34:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:34:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:34:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:34:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:34:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:34:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.365 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:34:20.365 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:20.365 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:20.365 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:34:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:34:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:34:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:34:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:34:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:34:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:34:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:34:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:34:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:34:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:34:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:34:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": { 2021-04-09T18:34:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6835/2412239832": "2021-04-10 18:34:09.999325", 2021-04-09T18:34:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6834/2412239832": "2021-04-10 18:34:09.999325" 2021-04-09T18:34:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:34:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:34:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:34:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:34:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:34:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:34:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:34:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:34:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:34:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:34:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:34:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:34:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:34:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:34:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:34:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:34:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:34:20.385 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:34:20.385 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:34:20.385 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:20.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:20.385 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:34:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:34:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:34:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:34:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:34:20.386 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:34:20.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.176 7f03717b6700 1 -- 172.21.15.79:0/2616755504 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f034c029100 msgr2=0x7f034c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:20.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.176 7f03717b6700 1 --2- 172.21.15.79:0/2616755504 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f034c029100 0x7f034c02b650 crc :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:20.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.176 7f03717b6700 1 -- 172.21.15.79:0/2616755504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f036c0b0030 msgr2=0x7f036c0d5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:20.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.176 7f03717b6700 1 --2- 172.21.15.79:0/2616755504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f036c0b0030 0x7f036c0d5080 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f036c096700 tx=0x7f0364006c10).stop 2021-04-09T18:34:20.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.176 7f03717b6700 1 -- 172.21.15.79:0/2616755504 shutdown_connections 2021-04-09T18:34:20.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.176 7f03717b6700 1 --2- 172.21.15.79:0/2616755504 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f034c029100 0x7f034c02b650 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:20.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.176 7f03717b6700 1 --2- 172.21.15.79:0/2616755504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f036c0b0030 0x7f036c0d5080 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:20.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.176 7f03717b6700 1 --2- 172.21.15.79:0/2616755504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036c1aad80 0x7f036c19dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:20.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.176 7f03717b6700 1 --2- 172.21.15.79:0/2616755504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f036c19e4c0 0x7f036c0afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:20.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.176 7f03717b6700 1 -- 172.21.15.79:0/2616755504 >> 172.21.15.79:0/2616755504 conn(0x7f036c0d8440 msgr2=0x7f036c09a260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:20.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.180 7f03717b6700 1 -- 172.21.15.79:0/2616755504 shutdown_connections 2021-04-09T18:34:20.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.180 7f03717b6700 1 -- 172.21.15.79:0/2616755504 wait complete. 2021-04-09T18:34:20.392 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:34:20.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f1664c3a700 1 Processor -- start 2021-04-09T18:34:20.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f1664c3a700 1 -- start start 2021-04-09T18:34:20.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f1664c3a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f16600e9ae0 0x7f166009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:20.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f1664c3a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f16601c8010 0x7f16601ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:20.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f1664c3a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16600fbb20 con 0x7f16600f5520 2021-04-09T18:34:20.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f1664c3a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16601c3dc0 con 0x7f16600e9ae0 2021-04-09T18:34:20.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f1664c3a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16600e9f30 con 0x7f16601c8010 2021-04-09T18:34:20.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f165dfe5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f16600e9ae0 0x7f166009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:20.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f165dfe5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f16600e9ae0 0x7f166009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33722/0 (socket says 172.21.15.79:33722) 2021-04-09T18:34:20.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f165dfe5700 1 -- 172.21.15.79:0/1201487288 learned_addr learned my addr 172.21.15.79:0/1201487288 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:20.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f165efe7700 1 --2- 172.21.15.79:0/1201487288 >> v2:172.21.15.89:3300/0 conn(0x7f16601c8010 0x7f16601ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:20.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f165dfe5700 1 -- 172.21.15.79:0/1201487288 >> v2:172.21.15.89:3300/0 conn(0x7f16601c8010 msgr2=0x7f16601ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:20.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f165dfe5700 1 --2- 172.21.15.79:0/1201487288 >> v2:172.21.15.89:3300/0 conn(0x7f16601c8010 0x7f16601ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:20.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f165dfe5700 1 -- 172.21.15.79:0/1201487288 >> v1:172.21.15.89:6789/0 conn(0x7f16600f5520 legacy=0x7f16600f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:20.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f165dfe5700 1 -- 172.21.15.79:0/1201487288 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16600e56d0 con 0x7f16600e9ae0 2021-04-09T18:34:20.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f165dfe5700 1 --2- 172.21.15.79:0/1201487288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16600e9ae0 0x7f166009f110 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f1654002f30 tx=0x7f165400bd70).ready entity=mon.0 client_cookie=10bcb377e6629b82 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:20.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f165d7e4700 1 -- 172.21.15.79:0/1201487288 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f16600e56d0 con 0x7f16600e9ae0 2021-04-09T18:34:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f165d7e4700 1 -- 172.21.15.79:0/1201487288 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1654009950 con 0x7f16600e9ae0 2021-04-09T18:34:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f165d7e4700 1 -- 172.21.15.79:0/1201487288 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1654009d20 con 0x7f16600e9ae0 2021-04-09T18:34:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f1664c3a700 1 -- 172.21.15.79:0/1201487288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16600e9ae0 msgr2=0x7f166009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:20.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.492 7f1664c3a700 1 --2- 172.21.15.79:0/1201487288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16600e9ae0 0x7f166009f110 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f1654002f30 tx=0x7f165400bd70).stop 2021-04-09T18:34:20.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.496 7f1664c3a700 1 -- 172.21.15.79:0/1201487288 shutdown_connections 2021-04-09T18:34:20.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.496 7f1664c3a700 1 --2- 172.21.15.79:0/1201487288 >> v2:172.21.15.89:3300/0 conn(0x7f16601c8010 0x7f16601ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:20.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.496 7f1664c3a700 1 --2- 172.21.15.79:0/1201487288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16600e9ae0 0x7f166009f110 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:20.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.496 7f1664c3a700 1 -- 172.21.15.79:0/1201487288 >> 172.21.15.79:0/1201487288 conn(0x7f16600e5fe0 msgr2=0x7f16600e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:20.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.496 7f1664c3a700 1 -- 172.21.15.79:0/1201487288 shutdown_connections 2021-04-09T18:34:20.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.496 7f1664c3a700 1 -- 172.21.15.79:0/1201487288 wait complete. 2021-04-09T18:34:20.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f1664c3a700 1 Processor -- start 2021-04-09T18:34:20.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f1664c3a700 1 -- start start 2021-04-09T18:34:20.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f1664c3a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16600ac060 0x7f16600ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:20.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f1664c3a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16600bac90 0x7f16600d4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:20.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f1664c3a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16600bb0e0 0x7f16600d5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:20.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f1664c3a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16600ac7b0 con 0x7f16600bac90 2021-04-09T18:34:20.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f1664c3a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16600ac4b0 con 0x7f16600bb0e0 2021-04-09T18:34:20.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f1664c3a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16600acab0 con 0x7f16600ac060 2021-04-09T18:34:20.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f165dfe5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16600bac90 0x7f16600d4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:20.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f165dfe5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16600bac90 0x7f16600d4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33728/0 (socket says 172.21.15.79:33728) 2021-04-09T18:34:20.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f165dfe5700 1 -- 172.21.15.79:0/1303246325 learned_addr learned my addr 172.21.15.79:0/1303246325 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:20.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f165efe7700 1 --2- 172.21.15.79:0/1303246325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16600bb0e0 0x7f16600d5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:20.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f165e7e6700 1 --2- 172.21.15.79:0/1303246325 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16600ac060 0x7f16600ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:20.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f165dfe5700 1 -- 172.21.15.79:0/1303246325 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16600ac060 msgr2=0x7f16600ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:20.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f165dfe5700 1 --2- 172.21.15.79:0/1303246325 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16600ac060 0x7f16600ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:20.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f165dfe5700 1 -- 172.21.15.79:0/1303246325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16600bb0e0 msgr2=0x7f16600d5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:20.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f165dfe5700 1 --2- 172.21.15.79:0/1303246325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16600bb0e0 0x7f16600d5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:20.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f165dfe5700 1 -- 172.21.15.79:0/1303246325 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16600ae660 con 0x7f16600bac90 2021-04-09T18:34:20.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f165dfe5700 1 --2- 172.21.15.79:0/1303246325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16600bac90 0x7f16600d4a30 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f16600874d0 tx=0x7f1654006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:20.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f164effd700 1 -- 172.21.15.79:0/1303246325 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f16600ae660 con 0x7f16600bac90 2021-04-09T18:34:20.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f164effd700 1 -- 172.21.15.79:0/1303246325 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1654011d60 con 0x7f16600bac90 2021-04-09T18:34:20.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f164effd700 1 -- 172.21.15.79:0/1303246325 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f165401d630 con 0x7f16600bac90 2021-04-09T18:34:20.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f1664c3a700 1 -- 172.21.15.79:0/1303246325 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16600d5060 con 0x7f16600bac90 2021-04-09T18:34:20.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.500 7f1664c3a700 1 -- 172.21.15.79:0/1303246325 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16600d6190 con 0x7f16600bac90 2021-04-09T18:34:20.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.504 7f164effd700 1 -- 172.21.15.79:0/1303246325 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1654026450 con 0x7f16600bac90 2021-04-09T18:34:20.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.504 7f164effd700 1 --2- 172.21.15.79:0/1303246325 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1644029100 0x7f164402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:20.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.504 7f164effd700 1 -- 172.21.15.79:0/1303246325 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f165403b270 con 0x7f16600bac90 2021-04-09T18:34:20.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.504 7f165e7e6700 1 --2- 172.21.15.79:0/1303246325 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1644029100 0x7f164402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:20.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.504 7f165e7e6700 1 --2- 172.21.15.79:0/1303246325 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1644029100 0x7f164402b650 crc :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:20.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.508 7f1664c3a700 1 -- 172.21.15.79:0/1303246325 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16600e39e0 con 0x7f16600bac90 2021-04-09T18:34:20.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.512 7f164effd700 1 -- 172.21.15.79:0/1303246325 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1654011b50 con 0x7f16600bac90 2021-04-09T18:34:20.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.680 7f1664c3a700 1 -- 172.21.15.79:0/1303246325 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16600f5b20 con 0x7f16600bac90 2021-04-09T18:34:20.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.680 7f164effd700 1 -- 172.21.15.79:0/1303246325 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+2098 (secure 0 0 0) 0x7f1654009740 con 0x7f16600bac90 2021-04-09T18:34:20.684 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 61 2021-04-09T18:34:20.684 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:20.685 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":61,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7155,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/1349682878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1349682878},{"type":"v1","addr":"172.21.15.79:6833","nonce":1349682878}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":59}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:34:09.512814","modified":"2021-04-09 18:34:11.526918","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7147":{"gid":7147,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/57205751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":57205751},{"type":"v1","addr":"172.21.15.89:6835","nonce":57205751}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-04-09T18:34:20.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.680 7f1664c3a700 1 -- 172.21.15.79:0/1303246325 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1644029100 msgr2=0x7f164402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:20.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.680 7f1664c3a700 1 --2- 172.21.15.79:0/1303246325 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1644029100 0x7f164402b650 crc :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:20.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.680 7f1664c3a700 1 -- 172.21.15.79:0/1303246325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16600bac90 msgr2=0x7f16600d4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:20.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.680 7f1664c3a700 1 --2- 172.21.15.79:0/1303246325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16600bac90 0x7f16600d4a30 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f16600874d0 tx=0x7f1654006890).stop 2021-04-09T18:34:20.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.680 7f1664c3a700 1 -- 172.21.15.79:0/1303246325 shutdown_connections 2021-04-09T18:34:20.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.680 7f1664c3a700 1 --2- 172.21.15.79:0/1303246325 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1644029100 0x7f164402b650 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:20.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.680 7f1664c3a700 1 --2- 172.21.15.79:0/1303246325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16600bb0e0 0x7f16600d5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:20.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.680 7f1664c3a700 1 --2- 172.21.15.79:0/1303246325 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16600ac060 0x7f16600ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:20.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.680 7f1664c3a700 1 --2- 172.21.15.79:0/1303246325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16600bac90 0x7f16600d4a30 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:20.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.680 7f1664c3a700 1 -- 172.21.15.79:0/1303246325 >> 172.21.15.79:0/1303246325 conn(0x7f1660098ad0 msgr2=0x7f1660095580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:20.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.680 7f1664c3a700 1 -- 172.21.15.79:0/1303246325 shutdown_connections 2021-04-09T18:34:20.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.680 7f1664c3a700 1 -- 172.21.15.79:0/1303246325 wait complete. 2021-04-09T18:34:20.697 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-04-09T18:34:20.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.784 7fe36a096700 1 Processor -- start 2021-04-09T18:34:20.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.784 7fe36a096700 1 -- start start 2021-04-09T18:34:20.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.784 7fe36a096700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe3640f5520 0x7fe3640f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:20.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.784 7fe36a096700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe3641c8010 0x7fe3641ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:20.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.784 7fe36a096700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3640fbb20 con 0x7fe3640e9ae0 2021-04-09T18:34:20.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.784 7fe36a096700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3640e9f30 con 0x7fe3641c8010 2021-04-09T18:34:20.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.784 7fe36a096700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3641c3dc0 con 0x7fe3640f5520 2021-04-09T18:34:20.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe363fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe3641c8010 0x7fe3641ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:20.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe362ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe3640e9ae0 0x7fe36409f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56678/0 (socket says 172.21.15.79:56678) 2021-04-09T18:34:20.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe362ffd700 1 -- 172.21.15.79:0/3867053287 learned_addr learned my addr 172.21.15.79:0/3867053287 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:20.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe3637fe700 1 --2- 172.21.15.79:0/3867053287 >> v2:172.21.15.89:3300/0 conn(0x7fe3640f5520 0x7fe3640f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:20.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe363fff700 1 -- 172.21.15.79:0/3867053287 >> v2:172.21.15.89:3300/0 conn(0x7fe3640f5520 msgr2=0x7fe3640f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:20.799 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe363fff700 1 --2- 172.21.15.79:0/3867053287 >> v2:172.21.15.89:3300/0 conn(0x7fe3640f5520 0x7fe3640f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:20.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe363fff700 1 -- 172.21.15.79:0/3867053287 >> v1:172.21.15.79:6789/0 conn(0x7fe3640e9ae0 legacy=0x7fe36409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:20.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe3627fc700 1 -- 172.21.15.79:0/3867053287 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555689302 0 0) 0x7fe3540010d0 con 0x7fe3640e9ae0 2021-04-09T18:34:20.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe363fff700 1 -- 172.21.15.79:0/3867053287 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36409f910 con 0x7fe3641c8010 2021-04-09T18:34:20.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe3637fe700 1 --2- 172.21.15.79:0/3867053287 >> v2:172.21.15.89:3300/0 conn(0x7fe3640f5520 0x7fe3640f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:20.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe363fff700 1 --2- 172.21.15.79:0/3867053287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3641c8010 0x7fe3641ca470 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7fe35c0032b0 tx=0x7fe35c00b3c0).ready entity=mon.0 client_cookie=bcd6e8ae0f335cd6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:20.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe3627fc700 1 -- 172.21.15.79:0/3867053287 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe36409f910 con 0x7fe3641c8010 2021-04-09T18:34:20.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe3627fc700 1 -- 172.21.15.79:0/3867053287 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35c00bc20 con 0x7fe3641c8010 2021-04-09T18:34:20.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe3627fc700 1 -- 172.21.15.79:0/3867053287 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe35c002020 con 0x7fe3641c8010 2021-04-09T18:34:20.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe36a096700 1 -- 172.21.15.79:0/3867053287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3641c8010 msgr2=0x7fe3641ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:20.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe36a096700 1 --2- 172.21.15.79:0/3867053287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3641c8010 0x7fe3641ca470 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7fe35c0032b0 tx=0x7fe35c00b3c0).stop 2021-04-09T18:34:20.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe36a096700 1 -- 172.21.15.79:0/3867053287 shutdown_connections 2021-04-09T18:34:20.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe36a096700 1 --2- 172.21.15.79:0/3867053287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3641c8010 0x7fe3641ca470 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:20.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe36a096700 1 --2- 172.21.15.79:0/3867053287 >> v2:172.21.15.89:3300/0 conn(0x7fe3640f5520 0x7fe3640f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:20.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe36a096700 1 -- 172.21.15.79:0/3867053287 >> 172.21.15.79:0/3867053287 conn(0x7fe3640e5fe0 msgr2=0x7fe3640e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:20.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe36a096700 1 -- 172.21.15.79:0/3867053287 shutdown_connections 2021-04-09T18:34:20.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.788 7fe36a096700 1 -- 172.21.15.79:0/3867053287 wait complete. 2021-04-09T18:34:20.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe36a096700 1 Processor -- start 2021-04-09T18:34:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe36a096700 1 -- start start 2021-04-09T18:34:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe36a096700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3640baf50 0x7fe3640d5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe36a096700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3640ae080 0x7fe3640ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe36a096700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3640b0980 0x7fe3640b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe36a096700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe364097890 con 0x7fe3640b0980 2021-04-09T18:34:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe36a096700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640aecf0 con 0x7fe3640baf50 2021-04-09T18:34:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe36a096700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640d65e0 con 0x7fe3640ae080 2021-04-09T18:34:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe363fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3640b0980 0x7fe3640b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:20.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe363fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3640b0980 0x7fe3640b0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33742/0 (socket says 172.21.15.79:33742) 2021-04-09T18:34:20.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe363fff700 1 -- 172.21.15.79:0/4104416126 learned_addr learned my addr 172.21.15.79:0/4104416126 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:20.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe362ffd700 1 --2- 172.21.15.79:0/4104416126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3640ae080 0x7fe3640ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:20.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe3637fe700 1 --2- 172.21.15.79:0/4104416126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3640baf50 0x7fe3640d5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:20.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe363fff700 1 -- 172.21.15.79:0/4104416126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3640ae080 msgr2=0x7fe3640ae4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:20.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe363fff700 1 --2- 172.21.15.79:0/4104416126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3640ae080 0x7fe3640ae4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:20.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe363fff700 1 -- 172.21.15.79:0/4104416126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3640baf50 msgr2=0x7fe3640d5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:20.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe363fff700 1 --2- 172.21.15.79:0/4104416126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3640baf50 0x7fe3640d5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:20.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe363fff700 1 -- 172.21.15.79:0/4104416126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3640973f0 con 0x7fe3640b0980 2021-04-09T18:34:20.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe363fff700 1 --2- 172.21.15.79:0/4104416126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3640b0980 0x7fe3640b0dd0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7fe35c0032b0 tx=0x7fe35c006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:20.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe35bfff700 1 -- 172.21.15.79:0/4104416126 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe3640973f0 con 0x7fe3640b0980 2021-04-09T18:34:20.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe35bfff700 1 -- 172.21.15.79:0/4104416126 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35c01f020 con 0x7fe3640b0980 2021-04-09T18:34:20.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe36a096700 1 -- 172.21.15.79:0/4104416126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe364097b90 con 0x7fe3640b0980 2021-04-09T18:34:20.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.792 7fe35bfff700 1 -- 172.21.15.79:0/4104416126 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe35c01b830 con 0x7fe3640b0980 2021-04-09T18:34:20.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.796 7fe36a096700 1 -- 172.21.15.79:0/4104416126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3640b1400 con 0x7fe3640b0980 2021-04-09T18:34:20.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.796 7fe35bfff700 1 -- 172.21.15.79:0/4104416126 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe35c00b0e0 con 0x7fe3640b0980 2021-04-09T18:34:20.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.796 7fe35bfff700 1 --2- 172.21.15.79:0/4104416126 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe348029100 0x7fe34802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:20.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.796 7fe35bfff700 1 -- 172.21.15.79:0/4104416126 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fe35c03b7b0 con 0x7fe3640b0980 2021-04-09T18:34:20.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.796 7fe3637fe700 1 --2- 172.21.15.79:0/4104416126 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe348029100 0x7fe34802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:20.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.796 7fe3637fe700 1 --2- 172.21.15.79:0/4104416126 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe348029100 0x7fe34802b650 crc :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:20.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.800 7fe36a096700 1 -- 172.21.15.79:0/4104416126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3640e39e0 con 0x7fe3640b0980 2021-04-09T18:34:20.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.808 7fe35bfff700 1 -- 172.21.15.79:0/4104416126 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe35c01b430 con 0x7fe3640b0980 2021-04-09T18:34:20.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:20.980 7fe36a096700 1 -- 172.21.15.79:0/4104416126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe3640f5b20 con 0x7fe3640b0980 2021-04-09T18:34:21.446 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:34:21.440 7fbcd0516700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:34:21.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.452 7fe35bfff700 1 -- 172.21.15.79:0/4104416126 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v62) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe35c00ba10 con 0x7fe3640b0980 2021-04-09T18:34:21.481 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2021-04-09T18:34:21.499 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-04-09T18:34:21.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.500 7fe36a096700 1 -- 172.21.15.79:0/4104416126 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe348029100 msgr2=0x7fe34802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.500 7fe36a096700 1 --2- 172.21.15.79:0/4104416126 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe348029100 0x7fe34802b650 crc :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.500 7fe36a096700 1 -- 172.21.15.79:0/4104416126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3640b0980 msgr2=0x7fe3640b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.500 7fe36a096700 1 --2- 172.21.15.79:0/4104416126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3640b0980 0x7fe3640b0dd0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7fe35c0032b0 tx=0x7fe35c006c10).stop 2021-04-09T18:34:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.500 7fe36a096700 1 -- 172.21.15.79:0/4104416126 shutdown_connections 2021-04-09T18:34:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.500 7fe36a096700 1 --2- 172.21.15.79:0/4104416126 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe348029100 0x7fe34802b650 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.500 7fe36a096700 1 --2- 172.21.15.79:0/4104416126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3640baf50 0x7fe3640d5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.500 7fe36a096700 1 --2- 172.21.15.79:0/4104416126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3640b0980 0x7fe3640b0dd0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.500 7fe36a096700 1 --2- 172.21.15.79:0/4104416126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3640ae080 0x7fe3640ae4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.500 7fe36a096700 1 -- 172.21.15.79:0/4104416126 >> 172.21.15.79:0/4104416126 conn(0x7fe3641a13b0 msgr2=0x7fe3640955c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:21.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.500 7fe36a096700 1 -- 172.21.15.79:0/4104416126 shutdown_connections 2021-04-09T18:34:21.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.500 7fe36a096700 1 -- 172.21.15.79:0/4104416126 wait complete. 2021-04-09T18:34:21.517 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:34:21.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.608 7f86ca7e7700 1 Processor -- start 2021-04-09T18:34:21.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.608 7f86ca7e7700 1 -- start start 2021-04-09T18:34:21.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.608 7f86ca7e7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86c40f5520 0x7f86c40f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:21.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.608 7f86ca7e7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f86c40e9ae0 0x7f86c409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:21.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.608 7f86ca7e7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c40fbb20 con 0x7f86c41c2db0 2021-04-09T18:34:21.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.608 7f86ca7e7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c40e9f30 con 0x7f86c40e9ae0 2021-04-09T18:34:21.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.608 7f86ca7e7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40e59d0 con 0x7f86c40f5520 2021-04-09T18:34:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.608 7f86c37fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f86c40e9ae0 0x7f86c409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.608 7f86c8d8c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f86c41c2db0 0x7f86c41c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56694/0 (socket says 172.21.15.79:56694) 2021-04-09T18:34:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.608 7f86c8d8c700 1 -- 172.21.15.79:0/1783486795 learned_addr learned my addr 172.21.15.79:0/1783486795 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.608 7f86c3fff700 1 --2- 172.21.15.79:0/1783486795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86c40f5520 0x7f86c40f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.612 7f86c37fe700 1 -- 172.21.15.79:0/1783486795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86c40f5520 msgr2=0x7f86c40f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.612 7f86c37fe700 1 --2- 172.21.15.79:0/1783486795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86c40f5520 0x7f86c40f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.612 7f86c37fe700 1 -- 172.21.15.79:0/1783486795 >> v1:172.21.15.79:6789/0 conn(0x7f86c41c2db0 legacy=0x7f86c41c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.612 7f86c37fe700 1 -- 172.21.15.79:0/1783486795 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c40e56d0 con 0x7f86c40e9ae0 2021-04-09T18:34:21.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.612 7f86c37fe700 1 --2- 172.21.15.79:0/1783486795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86c40e9ae0 0x7f86c409f110 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f86b8002f30 tx=0x7f86b800bd40).ready entity=mon.0 client_cookie=2519b0a05ecf979a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.612 7f86c2ffd700 1 -- 172.21.15.79:0/1783486795 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f86c40e56d0 con 0x7f86c40e9ae0 2021-04-09T18:34:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.612 7f86c2ffd700 1 -- 172.21.15.79:0/1783486795 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b8009850 con 0x7f86c40e9ae0 2021-04-09T18:34:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.612 7f86c2ffd700 1 -- 172.21.15.79:0/1783486795 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f86b8009c60 con 0x7f86c40e9ae0 2021-04-09T18:34:21.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.612 7f86ca7e7700 1 -- 172.21.15.79:0/1783486795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86c40e9ae0 msgr2=0x7f86c409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:21.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.612 7f86ca7e7700 1 --2- 172.21.15.79:0/1783486795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86c40e9ae0 0x7f86c409f110 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f86b8002f30 tx=0x7f86b800bd40).stop 2021-04-09T18:34:21.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.612 7f86ca7e7700 1 -- 172.21.15.79:0/1783486795 shutdown_connections 2021-04-09T18:34:21.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.612 7f86ca7e7700 1 --2- 172.21.15.79:0/1783486795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86c40f5520 0x7f86c40f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.612 7f86ca7e7700 1 --2- 172.21.15.79:0/1783486795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86c40e9ae0 0x7f86c409f110 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.612 7f86ca7e7700 1 -- 172.21.15.79:0/1783486795 >> 172.21.15.79:0/1783486795 conn(0x7f86c40e5fe0 msgr2=0x7f86c40e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:21.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.612 7f86ca7e7700 1 -- 172.21.15.79:0/1783486795 shutdown_connections 2021-04-09T18:34:21.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.612 7f86ca7e7700 1 -- 172.21.15.79:0/1783486795 wait complete. 2021-04-09T18:34:21.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.616 7f86ca7e7700 1 Processor -- start 2021-04-09T18:34:21.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.616 7f86ca7e7700 1 -- start start 2021-04-09T18:34:21.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.616 7f86ca7e7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86c4097330 0x7f86c40ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:21.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.616 7f86ca7e7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86c40d6010 0x7f86c419bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:21.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.616 7f86ca7e7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86c419c2f0 0x7f86c40d4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:21.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.616 7f86ca7e7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c4097970 con 0x7f86c4097330 2021-04-09T18:34:21.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.616 7f86ca7e7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40d6460 con 0x7f86c40d6010 2021-04-09T18:34:21.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.616 7f86ca7e7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c4097c70 con 0x7f86c419c2f0 2021-04-09T18:34:21.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.616 7f86c3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86c4097330 0x7f86c40ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:21.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.616 7f86c3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86c4097330 0x7f86c40ae0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33758/0 (socket says 172.21.15.79:33758) 2021-04-09T18:34:21.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.616 7f86c3fff700 1 -- 172.21.15.79:0/69755312 learned_addr learned my addr 172.21.15.79:0/69755312 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:21.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.616 7f86c8d8c700 1 --2- 172.21.15.79:0/69755312 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86c419c2f0 0x7f86c40d4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:21.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.616 7f86c37fe700 1 --2- 172.21.15.79:0/69755312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86c40d6010 0x7f86c419bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:21.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.620 7f86c3fff700 1 -- 172.21.15.79:0/69755312 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86c419c2f0 msgr2=0x7f86c40d4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:21.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.620 7f86c3fff700 1 --2- 172.21.15.79:0/69755312 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86c419c2f0 0x7f86c40d4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.620 7f86c3fff700 1 -- 172.21.15.79:0/69755312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86c40d6010 msgr2=0x7f86c419bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:21.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.620 7f86c3fff700 1 --2- 172.21.15.79:0/69755312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86c40d6010 0x7f86c419bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.620 7f86c3fff700 1 -- 172.21.15.79:0/69755312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c40aed20 con 0x7f86c4097330 2021-04-09T18:34:21.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.620 7f86c3fff700 1 --2- 172.21.15.79:0/69755312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86c4097330 0x7f86c40ae0e0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f86c40960c0 tx=0x7f86b400c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:21.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.620 7f86c0ff9700 1 -- 172.21.15.79:0/69755312 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f86c40aed20 con 0x7f86c4097330 2021-04-09T18:34:21.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.620 7f86c0ff9700 1 -- 172.21.15.79:0/69755312 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b400cd60 con 0x7f86c4097330 2021-04-09T18:34:21.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.620 7f86ca7e7700 1 -- 172.21.15.79:0/69755312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c40ae710 con 0x7f86c4097330 2021-04-09T18:34:21.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.620 7f86c0ff9700 1 -- 172.21.15.79:0/69755312 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f86b400f040 con 0x7f86c4097330 2021-04-09T18:34:21.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.620 7f86ca7e7700 1 -- 172.21.15.79:0/69755312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c40d5190 con 0x7f86c4097330 2021-04-09T18:34:21.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.620 7f86c0ff9700 1 -- 172.21.15.79:0/69755312 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f86b4011070 con 0x7f86c4097330 2021-04-09T18:34:21.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.620 7f86c0ff9700 1 --2- 172.21.15.79:0/69755312 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f86a4029100 0x7f86a402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:21.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.620 7f86c0ff9700 1 -- 172.21.15.79:0/69755312 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6096+0+0 (secure 0 0 0) 0x7f86b4010040 con 0x7f86c4097330 2021-04-09T18:34:21.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.620 7f86c37fe700 1 --2- 172.21.15.79:0/69755312 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f86a4029100 0x7f86a402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:21.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.620 7f86ca7e7700 1 -- 172.21.15.79:0/69755312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c40e39e0 con 0x7f86c4097330 2021-04-09T18:34:21.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.620 7f86c37fe700 1 --2- 172.21.15.79:0/69755312 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f86a4029100 0x7f86a402b650 crc :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:21.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.628 7f86c0ff9700 1 -- 172.21.15.79:0/69755312 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f86b400c960 con 0x7f86c4097330 2021-04-09T18:34:21.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.792 7f86ca7e7700 1 -- 172.21.15.79:0/69755312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86c40f5b20 con 0x7f86c4097330 2021-04-09T18:34:21.798 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.792 7f86c0ff9700 1 -- 172.21.15.79:0/69755312 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+1758 (secure 0 0 0) 0x7f86b4000bf0 con 0x7f86c4097330 2021-04-09T18:34:21.798 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 62 2021-04-09T18:34:21.798 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:21.799 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":62,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7155,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/1349682878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1349682878},{"type":"v1","addr":"172.21.15.79:6833","nonce":1349682878}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:34:09.512814","modified":"2021-04-09 18:34:21.444202","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-04-09T18:34:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.796 7f86ca7e7700 1 -- 172.21.15.79:0/69755312 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f86a4029100 msgr2=0x7f86a402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.796 7f86ca7e7700 1 --2- 172.21.15.79:0/69755312 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f86a4029100 0x7f86a402b650 crc :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.796 7f86ca7e7700 1 -- 172.21.15.79:0/69755312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86c4097330 msgr2=0x7f86c40ae0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.796 7f86ca7e7700 1 --2- 172.21.15.79:0/69755312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86c4097330 0x7f86c40ae0e0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f86c40960c0 tx=0x7f86b400c430).stop 2021-04-09T18:34:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.796 7f86ca7e7700 1 -- 172.21.15.79:0/69755312 shutdown_connections 2021-04-09T18:34:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.796 7f86ca7e7700 1 --2- 172.21.15.79:0/69755312 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f86a4029100 0x7f86a402b650 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.796 7f86ca7e7700 1 --2- 172.21.15.79:0/69755312 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86c419c2f0 0x7f86c40d4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.796 7f86ca7e7700 1 --2- 172.21.15.79:0/69755312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86c4097330 0x7f86c40ae0e0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.796 7f86ca7e7700 1 --2- 172.21.15.79:0/69755312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86c40d6010 0x7f86c419bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.796 7f86ca7e7700 1 -- 172.21.15.79:0/69755312 >> 172.21.15.79:0/69755312 conn(0x7f86c40afcf0 msgr2=0x7f86c409a600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:21.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.796 7f86ca7e7700 1 -- 172.21.15.79:0/69755312 shutdown_connections 2021-04-09T18:34:21.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.796 7f86ca7e7700 1 -- 172.21.15.79:0/69755312 wait complete. 2021-04-09T18:34:21.810 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-04-09T18:34:21.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.896 7faf35ba6700 1 Processor -- start 2021-04-09T18:34:21.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.896 7faf35ba6700 1 -- start start 2021-04-09T18:34:21.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.896 7faf35ba6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf300f5520 0x7faf300f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:21.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.896 7faf35ba6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faf300e9ae0 0x7faf3009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:21.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.896 7faf35ba6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf301c2db0 0x7faf301c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:21.912 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.896 7faf35ba6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf300e9f30 con 0x7faf300e9ae0 2021-04-09T18:34:21.912 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.896 7faf35ba6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf300e59d0 con 0x7faf301c2db0 2021-04-09T18:34:21.912 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.896 7faf35ba6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf300fbb20 con 0x7faf300f5520 2021-04-09T18:34:21.912 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf2effd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faf300e9ae0 0x7faf3009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf2effd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faf300e9ae0 0x7faf3009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33766/0 (socket says 172.21.15.79:33766) 2021-04-09T18:34:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf2effd700 1 -- 172.21.15.79:0/288204072 learned_addr learned my addr 172.21.15.79:0/288204072 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf2ffff700 1 --2- 172.21.15.79:0/288204072 >> v2:172.21.15.89:3300/0 conn(0x7faf301c2db0 0x7faf301c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf2f7fe700 1 --2- 172.21.15.79:0/288204072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf300f5520 0x7faf300f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:21.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf2effd700 1 -- 172.21.15.79:0/288204072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf300f5520 msgr2=0x7faf300f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:21.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf2effd700 1 --2- 172.21.15.79:0/288204072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf300f5520 0x7faf300f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf2effd700 1 -- 172.21.15.79:0/288204072 >> v2:172.21.15.89:3300/0 conn(0x7faf301c2db0 msgr2=0x7faf301c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:21.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf2effd700 1 --2- 172.21.15.79:0/288204072 >> v2:172.21.15.89:3300/0 conn(0x7faf301c2db0 0x7faf301c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf2effd700 1 -- 172.21.15.79:0/288204072 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf300e56d0 con 0x7faf300e9ae0 2021-04-09T18:34:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf2effd700 1 --2- 172.21.15.79:0/288204072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf300e9ae0 0x7faf3009f110 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7faf20002f30 tx=0x7faf2000bd70).ready entity=mon.0 client_cookie=94f9b6aad8aab2c9 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf2e7fc700 1 -- 172.21.15.79:0/288204072 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf300e56d0 con 0x7faf300e9ae0 2021-04-09T18:34:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf2e7fc700 1 -- 172.21.15.79:0/288204072 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf200098b0 con 0x7faf300e9ae0 2021-04-09T18:34:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf2e7fc700 1 -- 172.21.15.79:0/288204072 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf20009c80 con 0x7faf300e9ae0 2021-04-09T18:34:21.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf35ba6700 1 -- 172.21.15.79:0/288204072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf300e9ae0 msgr2=0x7faf3009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf35ba6700 1 --2- 172.21.15.79:0/288204072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf300e9ae0 0x7faf3009f110 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7faf20002f30 tx=0x7faf2000bd70).stop 2021-04-09T18:34:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf35ba6700 1 -- 172.21.15.79:0/288204072 shutdown_connections 2021-04-09T18:34:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf35ba6700 1 --2- 172.21.15.79:0/288204072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf300f5520 0x7faf300f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf35ba6700 1 --2- 172.21.15.79:0/288204072 >> v2:172.21.15.89:3300/0 conn(0x7faf301c2db0 0x7faf301c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf35ba6700 1 --2- 172.21.15.79:0/288204072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf300e9ae0 0x7faf3009f110 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf35ba6700 1 -- 172.21.15.79:0/288204072 >> 172.21.15.79:0/288204072 conn(0x7faf300e5fe0 msgr2=0x7faf300e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:21.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf35ba6700 1 -- 172.21.15.79:0/288204072 shutdown_connections 2021-04-09T18:34:21.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.900 7faf35ba6700 1 -- 172.21.15.79:0/288204072 wait complete. 2021-04-09T18:34:21.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf35ba6700 1 Processor -- start 2021-04-09T18:34:21.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf35ba6700 1 -- start start 2021-04-09T18:34:21.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf35ba6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf30092830 0x7faf300aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:21.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf35ba6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf300d0780 0x7faf300d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:21.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf35ba6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf301aad50 0x7faf301ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:21.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf35ba6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf300d4230 con 0x7faf30092830 2021-04-09T18:34:21.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf35ba6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf30090040 con 0x7faf301aad50 2021-04-09T18:34:21.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf35ba6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf300d4530 con 0x7faf300d0780 2021-04-09T18:34:21.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf2f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf30092830 0x7faf300aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:21.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf2f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf30092830 0x7faf300aca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33768/0 (socket says 172.21.15.79:33768) 2021-04-09T18:34:21.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf2f7fe700 1 -- 172.21.15.79:0/1843853877 learned_addr learned my addr 172.21.15.79:0/1843853877 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:21.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf2ffff700 1 --2- 172.21.15.79:0/1843853877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf301aad50 0x7faf301ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:21.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf2effd700 1 --2- 172.21.15.79:0/1843853877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf300d0780 0x7faf300d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:21.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf2f7fe700 1 -- 172.21.15.79:0/1843853877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf300d0780 msgr2=0x7faf300d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:21.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf2f7fe700 1 --2- 172.21.15.79:0/1843853877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf300d0780 0x7faf300d0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf2f7fe700 1 -- 172.21.15.79:0/1843853877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf301aad50 msgr2=0x7faf301ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:21.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf2f7fe700 1 --2- 172.21.15.79:0/1843853877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf301aad50 0x7faf301ab1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:21.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf2f7fe700 1 -- 172.21.15.79:0/1843853877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf300ad040 con 0x7faf30092830 2021-04-09T18:34:21.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf2f7fe700 1 --2- 172.21.15.79:0/1843853877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf30092830 0x7faf300aca10 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7faf30094bb0 tx=0x7faf2400df60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:21.922 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf17fff700 1 -- 172.21.15.79:0/1843853877 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf300ad040 con 0x7faf30092830 2021-04-09T18:34:21.922 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf35ba6700 1 -- 172.21.15.79:0/1843853877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf301ab7d0 con 0x7faf30092830 2021-04-09T18:34:21.922 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf17fff700 1 -- 172.21.15.79:0/1843853877 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf240099e0 con 0x7faf30092830 2021-04-09T18:34:21.922 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf17fff700 1 -- 172.21.15.79:0/1843853877 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf2400f040 con 0x7faf30092830 2021-04-09T18:34:21.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.904 7faf35ba6700 1 -- 172.21.15.79:0/1843853877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf300d3dc0 con 0x7faf30092830 2021-04-09T18:34:21.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.908 7faf17fff700 1 -- 172.21.15.79:0/1843853877 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7faf24013480 con 0x7faf30092830 2021-04-09T18:34:21.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.908 7faf17fff700 1 --2- 172.21.15.79:0/1843853877 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf10029100 0x7faf1002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:21.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.908 7faf17fff700 1 -- 172.21.15.79:0/1843853877 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6096+0+0 (secure 0 0 0) 0x7faf24010070 con 0x7faf30092830 2021-04-09T18:34:21.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.908 7faf2effd700 1 --2- 172.21.15.79:0/1843853877 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf10029100 0x7faf1002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:21.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.908 7faf2effd700 1 --2- 172.21.15.79:0/1843853877 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf10029100 0x7faf1002b650 crc :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:21.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.912 7faf35ba6700 1 -- 172.21.15.79:0/1843853877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf300e39e0 con 0x7faf30092830 2021-04-09T18:34:21.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:21.920 7faf17fff700 1 -- 172.21.15.79:0/1843853877 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7faf240095e0 con 0x7faf30092830 2021-04-09T18:34:22.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.092 7faf35ba6700 1 -- 172.21.15.79:0/1843853877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7faf300f5b20 con 0x7faf30092830 2021-04-09T18:34:22.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.460 7faf17fff700 1 -- 172.21.15.79:0/1843853877 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v63) v1 ==== 104+0+0 (secure 0 0 0) 0x7faf24000bf0 con 0x7faf30092830 2021-04-09T18:34:22.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.512 7faf35ba6700 1 -- 172.21.15.79:0/1843853877 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf10029100 msgr2=0x7faf1002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:22.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.512 7faf35ba6700 1 --2- 172.21.15.79:0/1843853877 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf10029100 0x7faf1002b650 crc :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:22.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.512 7faf35ba6700 1 -- 172.21.15.79:0/1843853877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf30092830 msgr2=0x7faf300aca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:22.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.512 7faf35ba6700 1 --2- 172.21.15.79:0/1843853877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf30092830 0x7faf300aca10 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7faf30094bb0 tx=0x7faf2400df60).stop 2021-04-09T18:34:22.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.512 7faf35ba6700 1 -- 172.21.15.79:0/1843853877 shutdown_connections 2021-04-09T18:34:22.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.512 7faf35ba6700 1 --2- 172.21.15.79:0/1843853877 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf10029100 0x7faf1002b650 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:22.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.512 7faf35ba6700 1 --2- 172.21.15.79:0/1843853877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf301aad50 0x7faf301ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:22.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.512 7faf35ba6700 1 --2- 172.21.15.79:0/1843853877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf30092830 0x7faf300aca10 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:22.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.512 7faf35ba6700 1 --2- 172.21.15.79:0/1843853877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf300d0780 0x7faf300d0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:22.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.512 7faf35ba6700 1 -- 172.21.15.79:0/1843853877 >> 172.21.15.79:0/1843853877 conn(0x7faf3008fae0 msgr2=0x7faf30093c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:22.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.512 7faf35ba6700 1 -- 172.21.15.79:0/1843853877 shutdown_connections 2021-04-09T18:34:22.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.512 7faf35ba6700 1 -- 172.21.15.79:0/1843853877 wait complete. 2021-04-09T18:34:22.536 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-04-09T18:34:22.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.640 7f1dcb638700 1 Processor -- start 2021-04-09T18:34:22.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.640 7f1dcb638700 1 -- start start 2021-04-09T18:34:22.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.640 7f1dcb638700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dc40e9b00 0x7f1dc409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:22.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.640 7f1dcb638700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1dc41c8030 0x7f1dc41ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:22.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.640 7f1dcb638700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc40fbb40 con 0x7f1dc40f5540 2021-04-09T18:34:22.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.640 7f1dcb638700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc41c3de0 con 0x7f1dc41c8030 2021-04-09T18:34:22.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.640 7f1dcb638700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc40e9f50 con 0x7f1dc40e9b00 2021-04-09T18:34:22.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.640 7f1dc93dc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1dc40f5540 0x7f1dc40f64d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56718/0 (socket says 172.21.15.79:56718) 2021-04-09T18:34:22.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.640 7f1dc93dc700 1 -- 172.21.15.79:0/196090986 learned_addr learned my addr 172.21.15.79:0/196090986 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:22.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.640 7f1dc8bdb700 1 --2- 172.21.15.79:0/196090986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dc40e9b00 0x7f1dc409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:22.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.640 7f1dc9bdd700 1 --2- 172.21.15.79:0/196090986 >> v2:172.21.15.89:3300/0 conn(0x7f1dc41c8030 0x7f1dc41ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:22.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.640 7f1db7fff700 1 -- 172.21.15.79:0/196090986 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611164437 0 0) 0x7f1dc00010d0 con 0x7f1dc40f5540 2021-04-09T18:34:22.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.640 7f1db7fff700 1 -- 172.21.15.79:0/196090986 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1db0003240 con 0x7f1dc40f5540 2021-04-09T18:34:22.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.640 7f1dc8bdb700 1 -- 172.21.15.79:0/196090986 >> v2:172.21.15.89:3300/0 conn(0x7f1dc41c8030 msgr2=0x7f1dc41ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:22.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.640 7f1dc8bdb700 1 --2- 172.21.15.79:0/196090986 >> v2:172.21.15.89:3300/0 conn(0x7f1dc41c8030 0x7f1dc41ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:22.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.640 7f1dc8bdb700 1 -- 172.21.15.79:0/196090986 >> v1:172.21.15.79:6789/0 conn(0x7f1dc40f5540 legacy=0x7f1dc40f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:22.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.640 7f1dc8bdb700 1 -- 172.21.15.79:0/196090986 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc40e56f0 con 0x7f1dc40e9b00 2021-04-09T18:34:22.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.644 7f1dc8bdb700 1 --2- 172.21.15.79:0/196090986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dc40e9b00 0x7f1dc409f100 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f1db80032b0 tx=0x7f1db800b0e0).ready entity=mon.2 client_cookie=408625974c046b6e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:22.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.644 7f1db7fff700 1 -- 172.21.15.79:0/196090986 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1dc40e56f0 con 0x7f1dc40e9b00 2021-04-09T18:34:22.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.644 7f1db7fff700 1 -- 172.21.15.79:0/196090986 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db800bab0 con 0x7f1dc40e9b00 2021-04-09T18:34:22.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.644 7f1db7fff700 1 -- 172.21.15.79:0/196090986 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1db8002020 con 0x7f1dc40e9b00 2021-04-09T18:34:22.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.644 7f1dcb638700 1 -- 172.21.15.79:0/196090986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dc40e9b00 msgr2=0x7f1dc409f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:22.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.644 7f1dcb638700 1 --2- 172.21.15.79:0/196090986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dc40e9b00 0x7f1dc409f100 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f1db80032b0 tx=0x7f1db800b0e0).stop 2021-04-09T18:34:22.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.644 7f1dcb638700 1 -- 172.21.15.79:0/196090986 shutdown_connections 2021-04-09T18:34:22.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.644 7f1dcb638700 1 --2- 172.21.15.79:0/196090986 >> v2:172.21.15.89:3300/0 conn(0x7f1dc41c8030 0x7f1dc41ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:22.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.644 7f1dcb638700 1 --2- 172.21.15.79:0/196090986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dc40e9b00 0x7f1dc409f100 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:22.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.644 7f1dcb638700 1 -- 172.21.15.79:0/196090986 >> 172.21.15.79:0/196090986 conn(0x7f1dc40e6000 msgr2=0x7f1dc40e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:22.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.644 7f1dcb638700 1 -- 172.21.15.79:0/196090986 shutdown_connections 2021-04-09T18:34:22.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.644 7f1dcb638700 1 -- 172.21.15.79:0/196090986 wait complete. 2021-04-09T18:34:22.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.644 7f1dcb638700 1 Processor -- start 2021-04-09T18:34:22.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.644 7f1dcb638700 1 -- start start 2021-04-09T18:34:22.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1dcb638700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dc40a7ab0 0x7f1dc4094dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:22.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1dcb638700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dc40d7170 0x7f1dc4091dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:22.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1dcb638700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dc40d0120 0x7f1dc40d0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:22.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1dcb638700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc4094ad0 con 0x7f1dc40a7ab0 2021-04-09T18:34:22.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1dcb638700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc40a8620 con 0x7f1dc40d7170 2021-04-09T18:34:22.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1dcb638700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc40a7f00 con 0x7f1dc40d0120 2021-04-09T18:34:22.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1dc93dc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dc40a7ab0 0x7f1dc4094dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:22.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1dc93dc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dc40a7ab0 0x7f1dc4094dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33784/0 (socket says 172.21.15.79:33784) 2021-04-09T18:34:22.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1dc93dc700 1 -- 172.21.15.79:0/3923697182 learned_addr learned my addr 172.21.15.79:0/3923697182 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:22.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1dc9bdd700 1 --2- 172.21.15.79:0/3923697182 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dc40d0120 0x7f1dc40d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:22.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1dc8bdb700 1 --2- 172.21.15.79:0/3923697182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dc40d7170 0x7f1dc4091dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:22.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1dc93dc700 1 -- 172.21.15.79:0/3923697182 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dc40d0120 msgr2=0x7f1dc40d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:22.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1dc93dc700 1 --2- 172.21.15.79:0/3923697182 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dc40d0120 0x7f1dc40d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:22.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1dc93dc700 1 -- 172.21.15.79:0/3923697182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dc40d7170 msgr2=0x7f1dc4091dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:22.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1dc93dc700 1 --2- 172.21.15.79:0/3923697182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dc40d7170 0x7f1dc4091dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:22.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1dc93dc700 1 -- 172.21.15.79:0/3923697182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc40923f0 con 0x7f1dc40a7ab0 2021-04-09T18:34:22.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1dc9bdd700 1 --2- 172.21.15.79:0/3923697182 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dc40d0120 0x7f1dc40d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:22.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1dc93dc700 1 --2- 172.21.15.79:0/3923697182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dc40a7ab0 0x7f1dc4094dd0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f1dc0000b80 tx=0x7f1dc000cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:22.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1db5ffb700 1 -- 172.21.15.79:0/3923697182 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1dc40923f0 con 0x7f1dc40a7ab0 2021-04-09T18:34:22.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1db5ffb700 1 -- 172.21.15.79:0/3923697182 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc0007320 con 0x7f1dc40a7ab0 2021-04-09T18:34:22.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1db5ffb700 1 -- 172.21.15.79:0/3923697182 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1dc00057e0 con 0x7f1dc40a7ab0 2021-04-09T18:34:22.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1dcb638700 1 -- 172.21.15.79:0/3923697182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc40d75c0 con 0x7f1dc40a7ab0 2021-04-09T18:34:22.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1dcb638700 1 -- 172.21.15.79:0/3923697182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc409a680 con 0x7f1dc40a7ab0 2021-04-09T18:34:22.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1db5ffb700 1 -- 172.21.15.79:0/3923697182 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1dc001a060 con 0x7f1dc40a7ab0 2021-04-09T18:34:22.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1db5ffb700 1 --2- 172.21.15.79:0/3923697182 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1da4029100 0x7f1da402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:22.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.648 7f1db5ffb700 1 -- 172.21.15.79:0/3923697182 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6096+0+0 (secure 0 0 0) 0x7f1dc0038cd0 con 0x7f1dc40a7ab0 2021-04-09T18:34:22.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.652 7f1dc8bdb700 1 --2- 172.21.15.79:0/3923697182 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1da4029100 0x7f1da402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:22.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.652 7f1dc8bdb700 1 --2- 172.21.15.79:0/3923697182 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1da4029100 0x7f1da402b650 crc :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:22.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.656 7f1dcb638700 1 -- 172.21.15.79:0/3923697182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc40e39e0 con 0x7f1dc40a7ab0 2021-04-09T18:34:22.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.664 7f1db5ffb700 1 -- 172.21.15.79:0/3923697182 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1dc0007110 con 0x7f1dc40a7ab0 2021-04-09T18:34:22.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:22.832 7f1dcb638700 1 -- 172.21.15.79:0/3923697182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1dc40a1c80 con 0x7f1dc40a7ab0 2021-04-09T18:34:23.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.468 7f1db5ffb700 1 -- 172.21.15.79:0/3923697182 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v100) v1 ==== 185+0+0 (secure 0 0 0) 0x7f1dc4107f70 con 0x7f1dc40a7ab0 2021-04-09T18:34:23.502 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2021-04-09T18:34:23.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.504 7f1dcb638700 1 -- 172.21.15.79:0/3923697182 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1da4029100 msgr2=0x7f1da402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:23.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.504 7f1dcb638700 1 --2- 172.21.15.79:0/3923697182 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1da4029100 0x7f1da402b650 crc :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:23.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.504 7f1dcb638700 1 -- 172.21.15.79:0/3923697182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dc40a7ab0 msgr2=0x7f1dc4094dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:23.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.504 7f1dcb638700 1 --2- 172.21.15.79:0/3923697182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dc40a7ab0 0x7f1dc4094dd0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f1dc0000b80 tx=0x7f1dc000cab0).stop 2021-04-09T18:34:23.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.504 7f1dcb638700 1 -- 172.21.15.79:0/3923697182 shutdown_connections 2021-04-09T18:34:23.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.504 7f1dcb638700 1 --2- 172.21.15.79:0/3923697182 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1da4029100 0x7f1da402b650 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:23.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.504 7f1dcb638700 1 --2- 172.21.15.79:0/3923697182 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dc40d0120 0x7f1dc40d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:23.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.504 7f1dcb638700 1 --2- 172.21.15.79:0/3923697182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dc40a7ab0 0x7f1dc4094dd0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:23.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.504 7f1dcb638700 1 --2- 172.21.15.79:0/3923697182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dc40d7170 0x7f1dc4091dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:23.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.504 7f1dcb638700 1 -- 172.21.15.79:0/3923697182 >> 172.21.15.79:0/3923697182 conn(0x7f1dc40bcdd0 msgr2=0x7f1dc40937c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:23.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.504 7f1dcb638700 1 -- 172.21.15.79:0/3923697182 shutdown_connections 2021-04-09T18:34:23.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.504 7f1dcb638700 1 -- 172.21.15.79:0/3923697182 wait complete. 2021-04-09T18:34:23.521 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-04-09T18:34:23.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb2062f700 1 Processor -- start 2021-04-09T18:34:23.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb2062f700 1 -- start start 2021-04-09T18:34:23.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb2062f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb180e9b00 0x7fdb1809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:23.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb2062f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdb181c8030 0x7fdb181ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:23.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb2062f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb180fbb40 con 0x7fdb180f5540 2021-04-09T18:34:23.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb2062f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb181c3de0 con 0x7fdb181c8030 2021-04-09T18:34:23.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb2062f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb180e9f50 con 0x7fdb180e9b00 2021-04-09T18:34:23.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb1e3d3700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdb180f5540 0x7fdb180f64d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56734/0 (socket says 172.21.15.79:56734) 2021-04-09T18:34:23.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb1e3d3700 1 -- 172.21.15.79:0/3500956379 learned_addr learned my addr 172.21.15.79:0/3500956379 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:23.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb1ebd4700 1 --2- 172.21.15.79:0/3500956379 >> v2:172.21.15.89:3300/0 conn(0x7fdb181c8030 0x7fdb181ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:23.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb1dbd2700 1 --2- 172.21.15.79:0/3500956379 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb180e9b00 0x7fdb1809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:23.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb1d3d1700 1 -- 172.21.15.79:0/3500956379 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249542078 0 0) 0x7fdb0c0010d0 con 0x7fdb180f5540 2021-04-09T18:34:23.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb1d3d1700 1 -- 172.21.15.79:0/3500956379 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb04003240 con 0x7fdb180f5540 2021-04-09T18:34:23.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb1ebd4700 1 -- 172.21.15.79:0/3500956379 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb180e9b00 msgr2=0x7fdb1809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:23.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb1ebd4700 1 --2- 172.21.15.79:0/3500956379 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb180e9b00 0x7fdb1809f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:23.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb1ebd4700 1 -- 172.21.15.79:0/3500956379 >> v1:172.21.15.79:6789/0 conn(0x7fdb180f5540 legacy=0x7fdb180f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:23.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb1ebd4700 1 -- 172.21.15.79:0/3500956379 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb180e56f0 con 0x7fdb181c8030 2021-04-09T18:34:23.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb1ebd4700 1 --2- 172.21.15.79:0/3500956379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb181c8030 0x7fdb181ca490 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fdb100032b0 tx=0x7fdb1000b3c0).ready entity=mon.1 client_cookie=49f17809703ae1b1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:23.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb1d3d1700 1 -- 172.21.15.79:0/3500956379 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb180e56f0 con 0x7fdb181c8030 2021-04-09T18:34:23.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb1d3d1700 1 -- 172.21.15.79:0/3500956379 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1000bc20 con 0x7fdb181c8030 2021-04-09T18:34:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb1d3d1700 1 -- 172.21.15.79:0/3500956379 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb10002020 con 0x7fdb181c8030 2021-04-09T18:34:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb2062f700 1 -- 172.21.15.79:0/3500956379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb181c8030 msgr2=0x7fdb181ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.624 7fdb2062f700 1 --2- 172.21.15.79:0/3500956379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb181c8030 0x7fdb181ca490 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fdb100032b0 tx=0x7fdb1000b3c0).stop 2021-04-09T18:34:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.628 7fdb2062f700 1 -- 172.21.15.79:0/3500956379 shutdown_connections 2021-04-09T18:34:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.628 7fdb2062f700 1 --2- 172.21.15.79:0/3500956379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb181c8030 0x7fdb181ca490 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.628 7fdb2062f700 1 --2- 172.21.15.79:0/3500956379 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb180e9b00 0x7fdb1809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.628 7fdb2062f700 1 -- 172.21.15.79:0/3500956379 >> 172.21.15.79:0/3500956379 conn(0x7fdb180e6000 msgr2=0x7fdb180e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.628 7fdb2062f700 1 -- 172.21.15.79:0/3500956379 shutdown_connections 2021-04-09T18:34:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.628 7fdb2062f700 1 -- 172.21.15.79:0/3500956379 wait complete. 2021-04-09T18:34:23.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.628 7fdb2062f700 1 Processor -- start 2021-04-09T18:34:23.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.628 7fdb2062f700 1 -- start start 2021-04-09T18:34:23.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.628 7fdb2062f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb180a58a0 0x7fdb1808f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:23.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.628 7fdb2062f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb1808fb90 0x7fdb181a64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:23.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.628 7fdb2062f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb1808ffe0 0x7fdb180b97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:23.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.628 7fdb2062f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb18088570 con 0x7fdb1808ffe0 2021-04-09T18:34:23.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.628 7fdb2062f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb18092790 con 0x7fdb180a58a0 2021-04-09T18:34:23.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.628 7fdb2062f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb18092a90 con 0x7fdb1808fb90 2021-04-09T18:34:23.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.632 7fdb1ebd4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb1808ffe0 0x7fdb180b97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:23.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.632 7fdb1ebd4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb1808ffe0 0x7fdb180b97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33798/0 (socket says 172.21.15.79:33798) 2021-04-09T18:34:23.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.632 7fdb1ebd4700 1 -- 172.21.15.79:0/3030039363 learned_addr learned my addr 172.21.15.79:0/3030039363 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:23.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.632 7fdb1dbd2700 1 --2- 172.21.15.79:0/3030039363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb1808fb90 0x7fdb181a64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:23.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.632 7fdb1e3d3700 1 --2- 172.21.15.79:0/3030039363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb180a58a0 0x7fdb1808f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:23.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.632 7fdb1ebd4700 1 -- 172.21.15.79:0/3030039363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb1808fb90 msgr2=0x7fdb181a64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:23.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.632 7fdb1ebd4700 1 --2- 172.21.15.79:0/3030039363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb1808fb90 0x7fdb181a64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:23.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.632 7fdb1ebd4700 1 -- 172.21.15.79:0/3030039363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb180a58a0 msgr2=0x7fdb1808f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:23.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.632 7fdb1ebd4700 1 --2- 172.21.15.79:0/3030039363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb180a58a0 0x7fdb1808f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:23.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.632 7fdb1ebd4700 1 -- 172.21.15.79:0/3030039363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb180bac40 con 0x7fdb1808ffe0 2021-04-09T18:34:23.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.632 7fdb1ebd4700 1 --2- 172.21.15.79:0/3030039363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb1808ffe0 0x7fdb180b97b0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7fdb180d4f40 tx=0x7fdb10006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:23.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.632 7fdb0affd700 1 -- 172.21.15.79:0/3030039363 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb180bac40 con 0x7fdb1808ffe0 2021-04-09T18:34:23.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.632 7fdb2062f700 1 -- 172.21.15.79:0/3030039363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1808f860 con 0x7fdb1808ffe0 2021-04-09T18:34:23.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.632 7fdb0affd700 1 -- 172.21.15.79:0/3030039363 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1001f030 con 0x7fdb1808ffe0 2021-04-09T18:34:23.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.632 7fdb0affd700 1 -- 172.21.15.79:0/3030039363 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb10002020 con 0x7fdb1808ffe0 2021-04-09T18:34:23.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.632 7fdb2062f700 1 -- 172.21.15.79:0/3030039363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb180a5cf0 con 0x7fdb1808ffe0 2021-04-09T18:34:23.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.632 7fdb0affd700 1 -- 172.21.15.79:0/3030039363 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fdb1002a060 con 0x7fdb1808ffe0 2021-04-09T18:34:23.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.632 7fdb0affd700 1 --2- 172.21.15.79:0/3030039363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb00029100 0x7fdb0002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:23.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.632 7fdb0affd700 1 -- 172.21.15.79:0/3030039363 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5658+0+0 (secure 0 0 0) 0x7fdb1003b4c0 con 0x7fdb1808ffe0 2021-04-09T18:34:23.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.632 7fdb1e3d3700 1 --2- 172.21.15.79:0/3030039363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb00029100 0x7fdb0002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:23.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.636 7fdb1e3d3700 1 --2- 172.21.15.79:0/3030039363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb00029100 0x7fdb0002b650 crc :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:23.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.636 7fdb2062f700 1 -- 172.21.15.79:0/3030039363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb180e39e0 con 0x7fdb1808ffe0 2021-04-09T18:34:23.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.644 7fdb0affd700 1 -- 172.21.15.79:0/3030039363 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fdb1000ba10 con 0x7fdb1808ffe0 2021-04-09T18:34:23.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:23.812 7fdb2062f700 1 -- 172.21.15.79:0/3030039363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdb180f5b40 con 0x7fdb1808ffe0 2021-04-09T18:34:24.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.476 7fdb0affd700 1 -- 172.21.15.79:0/3030039363 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v101) v1 ==== 173+0+0 (secure 0 0 0) 0x7fdb1001b430 con 0x7fdb1808ffe0 2021-04-09T18:34:24.483 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2021-04-09T18:34:24.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.484 7fdb2062f700 1 -- 172.21.15.79:0/3030039363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb00029100 msgr2=0x7fdb0002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:24.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.484 7fdb2062f700 1 --2- 172.21.15.79:0/3030039363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb00029100 0x7fdb0002b650 crc :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:24.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.484 7fdb2062f700 1 -- 172.21.15.79:0/3030039363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb1808ffe0 msgr2=0x7fdb180b97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:24.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.484 7fdb2062f700 1 --2- 172.21.15.79:0/3030039363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb1808ffe0 0x7fdb180b97b0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7fdb180d4f40 tx=0x7fdb10006c10).stop 2021-04-09T18:34:24.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.484 7fdb2062f700 1 -- 172.21.15.79:0/3030039363 shutdown_connections 2021-04-09T18:34:24.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.484 7fdb2062f700 1 --2- 172.21.15.79:0/3030039363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdb00029100 0x7fdb0002b650 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:24.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.484 7fdb2062f700 1 --2- 172.21.15.79:0/3030039363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb180a58a0 0x7fdb1808f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:24.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.484 7fdb2062f700 1 --2- 172.21.15.79:0/3030039363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb1808ffe0 0x7fdb180b97b0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:24.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.484 7fdb2062f700 1 --2- 172.21.15.79:0/3030039363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb1808fb90 0x7fdb181a64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:24.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.484 7fdb2062f700 1 -- 172.21.15.79:0/3030039363 >> 172.21.15.79:0/3030039363 conn(0x7fdb180946e0 msgr2=0x7fdb18095e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:24.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.484 7fdb2062f700 1 -- 172.21.15.79:0/3030039363 shutdown_connections 2021-04-09T18:34:24.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.484 7fdb2062f700 1 -- 172.21.15.79:0/3030039363 wait complete. 2021-04-09T18:34:24.500 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-04-09T18:34:24.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.588 7ff607ec8700 1 Processor -- start 2021-04-09T18:34:24.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.588 7ff607ec8700 1 -- start start 2021-04-09T18:34:24.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff607ec8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff6000f5520 0x7ff6000f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:24.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff607ec8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6000e9ae0 0x7ff60009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:24.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff607ec8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6000fbb20 con 0x7ff6001c2db0 2021-04-09T18:34:24.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff607ec8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6000e9f30 con 0x7ff6000f5520 2021-04-09T18:34:24.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff607ec8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000e59d0 con 0x7ff6000e9ae0 2021-04-09T18:34:24.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff60646d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff6001c2db0 0x7ff6001c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56750/0 (socket says 172.21.15.79:56750) 2021-04-09T18:34:24.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff605c6c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff6000f5520 0x7ff6000f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:24.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff60646d700 1 -- 172.21.15.79:0/2896281766 learned_addr learned my addr 172.21.15.79:0/2896281766 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:24.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff60546b700 1 --2- 172.21.15.79:0/2896281766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6000e9ae0 0x7ff60009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:24.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff605c6c700 1 -- 172.21.15.79:0/2896281766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6000e9ae0 msgr2=0x7ff60009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:24.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff605c6c700 1 --2- 172.21.15.79:0/2896281766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6000e9ae0 0x7ff60009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:24.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff605c6c700 1 -- 172.21.15.79:0/2896281766 >> v1:172.21.15.79:6789/0 conn(0x7ff6001c2db0 legacy=0x7ff6001c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:24.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff605c6c700 1 -- 172.21.15.79:0/2896281766 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6000e56d0 con 0x7ff6000f5520 2021-04-09T18:34:24.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff604c6a700 1 -- 172.21.15.79:0/2896281766 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261014761 0 0) 0x7ff5f8001450 con 0x7ff6001c2db0 2021-04-09T18:34:24.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff605c6c700 1 --2- 172.21.15.79:0/2896281766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6000f5520 0x7ff6000f64b0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7ff5fc002f30 tx=0x7ff5fc00bd40).ready entity=mon.0 client_cookie=3bc62f0f315f4998 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:24.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff604c6a700 1 -- 172.21.15.79:0/2896281766 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff6000e56d0 con 0x7ff6000f5520 2021-04-09T18:34:24.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff604c6a700 1 -- 172.21.15.79:0/2896281766 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc009850 con 0x7ff6000f5520 2021-04-09T18:34:24.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff604c6a700 1 -- 172.21.15.79:0/2896281766 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff5fc009c20 con 0x7ff6000f5520 2021-04-09T18:34:24.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff607ec8700 1 -- 172.21.15.79:0/2896281766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6000f5520 msgr2=0x7ff6000f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:24.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff607ec8700 1 --2- 172.21.15.79:0/2896281766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6000f5520 0x7ff6000f64b0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7ff5fc002f30 tx=0x7ff5fc00bd40).stop 2021-04-09T18:34:24.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff607ec8700 1 -- 172.21.15.79:0/2896281766 shutdown_connections 2021-04-09T18:34:24.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff607ec8700 1 --2- 172.21.15.79:0/2896281766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6000f5520 0x7ff6000f64b0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:24.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff607ec8700 1 --2- 172.21.15.79:0/2896281766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6000e9ae0 0x7ff60009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:24.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff607ec8700 1 -- 172.21.15.79:0/2896281766 >> 172.21.15.79:0/2896281766 conn(0x7ff6000e5fe0 msgr2=0x7ff6000e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:24.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff607ec8700 1 -- 172.21.15.79:0/2896281766 shutdown_connections 2021-04-09T18:34:24.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.592 7ff607ec8700 1 -- 172.21.15.79:0/2896281766 wait complete. 2021-04-09T18:34:24.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.596 7ff607ec8700 1 Processor -- start 2021-04-09T18:34:24.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.596 7ff607ec8700 1 -- start start 2021-04-09T18:34:24.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.596 7ff607ec8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6000aa820 0x7ff6000ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:24.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.596 7ff607ec8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6000d0ef0 0x7ff6000d1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:24.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.596 7ff607ec8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6000d4c10 0x7ff6000d5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:24.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.596 7ff607ec8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000ab050 con 0x7ff6000aa820 2021-04-09T18:34:24.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.596 7ff607ec8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000ab350 con 0x7ff6000d0ef0 2021-04-09T18:34:24.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.596 7ff607ec8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000aac70 con 0x7ff6000d4c10 2021-04-09T18:34:24.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.596 7ff605c6c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6000aa820 0x7ff6000ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:24.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.596 7ff605c6c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6000aa820 0x7ff6000ae0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33812/0 (socket says 172.21.15.79:33812) 2021-04-09T18:34:24.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.596 7ff605c6c700 1 -- 172.21.15.79:0/3523498890 learned_addr learned my addr 172.21.15.79:0/3523498890 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:24.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.600 7ff60646d700 1 --2- 172.21.15.79:0/3523498890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6000d4c10 0x7ff6000d5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:24.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.600 7ff60546b700 1 --2- 172.21.15.79:0/3523498890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6000d0ef0 0x7ff6000d1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:24.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.600 7ff605c6c700 1 -- 172.21.15.79:0/3523498890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6000d4c10 msgr2=0x7ff6000d5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:24.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.600 7ff605c6c700 1 --2- 172.21.15.79:0/3523498890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6000d4c10 0x7ff6000d5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:24.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.600 7ff605c6c700 1 -- 172.21.15.79:0/3523498890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6000d0ef0 msgr2=0x7ff6000d1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:24.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.600 7ff605c6c700 1 --2- 172.21.15.79:0/3523498890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6000d0ef0 0x7ff6000d1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:24.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.600 7ff605c6c700 1 -- 172.21.15.79:0/3523498890 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6000adca0 con 0x7ff6000aa820 2021-04-09T18:34:24.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.600 7ff60646d700 1 --2- 172.21.15.79:0/3523498890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6000d4c10 0x7ff6000d5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:24.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.600 7ff605c6c700 1 --2- 172.21.15.79:0/3523498890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6000aa820 0x7ff6000ae0f0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7ff6000874f0 tx=0x7ff5fc006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:24.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.600 7ff5f67fc700 1 -- 172.21.15.79:0/3523498890 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff6000adca0 con 0x7ff6000aa820 2021-04-09T18:34:24.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.600 7ff5f67fc700 1 -- 172.21.15.79:0/3523498890 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc011c10 con 0x7ff6000aa820 2021-04-09T18:34:24.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.600 7ff607ec8700 1 -- 172.21.15.79:0/3523498890 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6000d5690 con 0x7ff6000aa820 2021-04-09T18:34:24.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.600 7ff5f67fc700 1 -- 172.21.15.79:0/3523498890 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff5fc01d440 con 0x7ff6000aa820 2021-04-09T18:34:24.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.600 7ff607ec8700 1 -- 172.21.15.79:0/3523498890 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6000ac8f0 con 0x7ff6000aa820 2021-04-09T18:34:24.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.600 7ff5f67fc700 1 -- 172.21.15.79:0/3523498890 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff5fc026450 con 0x7ff6000aa820 2021-04-09T18:34:24.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.600 7ff5f67fc700 1 --2- 172.21.15.79:0/3523498890 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff5e8029100 0x7ff5e802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:24.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.600 7ff5f67fc700 1 -- 172.21.15.79:0/3523498890 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5276+0+0 (secure 0 0 0) 0x7ff5fc03a910 con 0x7ff6000aa820 2021-04-09T18:34:24.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.600 7ff60546b700 1 --2- 172.21.15.79:0/3523498890 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff5e8029100 0x7ff5e802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:24.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.600 7ff60546b700 1 --2- 172.21.15.79:0/3523498890 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff5e8029100 0x7ff5e802b650 crc :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:24.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.604 7ff607ec8700 1 -- 172.21.15.79:0/3523498890 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6000e39e0 con 0x7ff6000aa820 2021-04-09T18:34:24.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.612 7ff5f67fc700 1 -- 172.21.15.79:0/3523498890 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff5fc009640 con 0x7ff6000aa820 2021-04-09T18:34:24.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.800 7ff607ec8700 1 -- 172.21.15.79:0/3523498890 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff6000f5b20 con 0x7ff6000aa820 2021-04-09T18:34:24.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.808 7ff5f67fc700 1 -- 172.21.15.79:0/3523498890 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff5fc011a00 con 0x7ff6000aa820 2021-04-09T18:34:24.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.808 7ff607ec8700 1 -- 172.21.15.79:0/3523498890 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff5e8029100 msgr2=0x7ff5e802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:24.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.808 7ff607ec8700 1 --2- 172.21.15.79:0/3523498890 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff5e8029100 0x7ff5e802b650 crc :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:24.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.808 7ff607ec8700 1 -- 172.21.15.79:0/3523498890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6000aa820 msgr2=0x7ff6000ae0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:24.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.808 7ff607ec8700 1 --2- 172.21.15.79:0/3523498890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6000aa820 0x7ff6000ae0f0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7ff6000874f0 tx=0x7ff5fc006890).stop 2021-04-09T18:34:24.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.812 7ff607ec8700 1 -- 172.21.15.79:0/3523498890 shutdown_connections 2021-04-09T18:34:24.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.812 7ff607ec8700 1 --2- 172.21.15.79:0/3523498890 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff5e8029100 0x7ff5e802b650 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:24.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.812 7ff607ec8700 1 --2- 172.21.15.79:0/3523498890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6000d4c10 0x7ff6000d5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:24.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.812 7ff607ec8700 1 --2- 172.21.15.79:0/3523498890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6000aa820 0x7ff6000ae0f0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:24.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.812 7ff607ec8700 1 --2- 172.21.15.79:0/3523498890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6000d0ef0 0x7ff6000d1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:24.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.812 7ff607ec8700 1 -- 172.21.15.79:0/3523498890 >> 172.21.15.79:0/3523498890 conn(0x7ff6000d8c30 msgr2=0x7ff6000ba080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:24.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.812 7ff607ec8700 1 -- 172.21.15.79:0/3523498890 shutdown_connections 2021-04-09T18:34:24.820 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.812 7ff607ec8700 1 -- 172.21.15.79:0/3523498890 wait complete. 2021-04-09T18:34:24.826 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2021-04-09T18:34:24.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.912 7f428aa9f700 1 Processor -- start 2021-04-09T18:34:24.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.912 7f428aa9f700 1 -- start start 2021-04-09T18:34:24.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f428aa9f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f42840f5520 0x7f42840f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:24.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f428aa9f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f42840e9ae0 0x7f428409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:24.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f428aa9f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42840fbb20 con 0x7f42841c2db0 2021-04-09T18:34:24.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f428aa9f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42840e9f30 con 0x7f42840e9ae0 2021-04-09T18:34:24.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f428aa9f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42840e59d0 con 0x7f42840f5520 2021-04-09T18:34:24.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f4283fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f42840e9ae0 0x7f428409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:24.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f4283fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f42840e9ae0 0x7f428409f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33820/0 (socket says 172.21.15.79:33820) 2021-04-09T18:34:24.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f4283fff700 1 -- 172.21.15.79:0/831753741 learned_addr learned my addr 172.21.15.79:0/831753741 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:24.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f4288843700 1 --2- 172.21.15.79:0/831753741 >> v2:172.21.15.89:3300/0 conn(0x7f42840f5520 0x7f42840f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:24.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f4283fff700 1 -- 172.21.15.79:0/831753741 >> v2:172.21.15.89:3300/0 conn(0x7f42840f5520 msgr2=0x7f42840f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:24.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f4283fff700 1 --2- 172.21.15.79:0/831753741 >> v2:172.21.15.89:3300/0 conn(0x7f42840f5520 0x7f42840f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:24.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f4283fff700 1 -- 172.21.15.79:0/831753741 >> v1:172.21.15.89:6789/0 conn(0x7f42841c2db0 legacy=0x7f42841c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:24.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f4283fff700 1 -- 172.21.15.79:0/831753741 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42840e56d0 con 0x7f42840e9ae0 2021-04-09T18:34:24.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f4283fff700 1 --2- 172.21.15.79:0/831753741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42840e9ae0 0x7f428409f110 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f4278002f30 tx=0x7f427800bd70).ready entity=mon.0 client_cookie=2d5122f99e5a7a67 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:24.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f42837fe700 1 -- 172.21.15.79:0/831753741 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f42840e56d0 con 0x7f42840e9ae0 2021-04-09T18:34:24.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f42837fe700 1 -- 172.21.15.79:0/831753741 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4278009900 con 0x7f42840e9ae0 2021-04-09T18:34:24.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f42837fe700 1 -- 172.21.15.79:0/831753741 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4278009cd0 con 0x7f42840e9ae0 2021-04-09T18:34:24.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f428aa9f700 1 -- 172.21.15.79:0/831753741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42840e9ae0 msgr2=0x7f428409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:24.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f428aa9f700 1 --2- 172.21.15.79:0/831753741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42840e9ae0 0x7f428409f110 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f4278002f30 tx=0x7f427800bd70).stop 2021-04-09T18:34:24.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f428aa9f700 1 -- 172.21.15.79:0/831753741 shutdown_connections 2021-04-09T18:34:24.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f428aa9f700 1 --2- 172.21.15.79:0/831753741 >> v2:172.21.15.89:3300/0 conn(0x7f42840f5520 0x7f42840f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:24.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f428aa9f700 1 --2- 172.21.15.79:0/831753741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42840e9ae0 0x7f428409f110 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:24.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f428aa9f700 1 -- 172.21.15.79:0/831753741 >> 172.21.15.79:0/831753741 conn(0x7f42840e5fe0 msgr2=0x7f42840e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:24.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f428aa9f700 1 -- 172.21.15.79:0/831753741 shutdown_connections 2021-04-09T18:34:24.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.916 7f428aa9f700 1 -- 172.21.15.79:0/831753741 wait complete. 2021-04-09T18:34:24.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.920 7f428aa9f700 1 Processor -- start 2021-04-09T18:34:24.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.920 7f428aa9f700 1 -- start start 2021-04-09T18:34:24.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f428aa9f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42840d4f10 0x7f42840d67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:24.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f428aa9f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42840d00a0 0x7f4284093ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:24.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f428aa9f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4284094510 0x7f42840ce690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:24.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f428aa9f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4284099cf0 con 0x7f4284094510 2021-04-09T18:34:24.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f428aa9f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4284099ff0 con 0x7f42840d00a0 2021-04-09T18:34:24.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f428aa9f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42840d04f0 con 0x7f42840d4f10 2021-04-09T18:34:24.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f4289044700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4284094510 0x7f42840ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:24.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f4289044700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4284094510 0x7f42840ce690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33824/0 (socket says 172.21.15.79:33824) 2021-04-09T18:34:24.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f4289044700 1 -- 172.21.15.79:0/3505466482 learned_addr learned my addr 172.21.15.79:0/3505466482 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:24.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f4283fff700 1 --2- 172.21.15.79:0/3505466482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42840d00a0 0x7f4284093ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:24.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f4288843700 1 --2- 172.21.15.79:0/3505466482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42840d4f10 0x7f42840d67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:24.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f4289044700 1 -- 172.21.15.79:0/3505466482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42840d4f10 msgr2=0x7f42840d67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:24.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f4289044700 1 --2- 172.21.15.79:0/3505466482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42840d4f10 0x7f42840d67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:24.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f4289044700 1 -- 172.21.15.79:0/3505466482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42840d00a0 msgr2=0x7f4284093ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:24.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f4289044700 1 --2- 172.21.15.79:0/3505466482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42840d00a0 0x7f4284093ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:24.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f4289044700 1 -- 172.21.15.79:0/3505466482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42840cecc0 con 0x7f4284094510 2021-04-09T18:34:24.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f4288843700 1 --2- 172.21.15.79:0/3505466482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42840d4f10 0x7f42840d67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:24.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f4289044700 1 --2- 172.21.15.79:0/3505466482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4284094510 0x7f42840ce690 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f42840cf5b0 tx=0x7f427c00bee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:24.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f42817fa700 1 -- 172.21.15.79:0/3505466482 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f42840cecc0 con 0x7f4284094510 2021-04-09T18:34:24.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f42817fa700 1 -- 172.21.15.79:0/3505466482 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427c00cad0 con 0x7f4284094510 2021-04-09T18:34:24.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f428aa9f700 1 -- 172.21.15.79:0/3505466482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42840cefe0 con 0x7f4284094510 2021-04-09T18:34:24.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f42817fa700 1 -- 172.21.15.79:0/3505466482 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f427c014410 con 0x7f4284094510 2021-04-09T18:34:24.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f428aa9f700 1 -- 172.21.15.79:0/3505466482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428408f250 con 0x7f4284094510 2021-04-09T18:34:24.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f42817fa700 1 -- 172.21.15.79:0/3505466482 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f427c014610 con 0x7f4284094510 2021-04-09T18:34:24.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f42817fa700 1 --2- 172.21.15.79:0/3505466482 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4264029100 0x7f426402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:24.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f42817fa700 1 -- 172.21.15.79:0/3505466482 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f427c039050 con 0x7f4284094510 2021-04-09T18:34:24.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f4288843700 1 --2- 172.21.15.79:0/3505466482 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4264029100 0x7f426402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:24.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.924 7f4288843700 1 --2- 172.21.15.79:0/3505466482 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4264029100 0x7f426402b650 crc :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:24.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.928 7f428aa9f700 1 -- 172.21.15.79:0/3505466482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42840e39e0 con 0x7f4284094510 2021-04-09T18:34:24.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:24.932 7f42817fa700 1 -- 172.21.15.79:0/3505466482 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f427c00c6d0 con 0x7f4284094510 2021-04-09T18:34:25.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.092 7f428aa9f700 1 -- 172.21.15.79:0/3505466482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7f42840f5b20 con 0x7f4284094510 2021-04-09T18:34:25.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.476 7f42817fa700 1 -- 172.21.15.79:0/3505466482 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v251) v1 ==== 127+0+0 (secure 0 0 0) 0x7f42840f76c0 con 0x7f4284094510 2021-04-09T18:34:25.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.512 7f428aa9f700 1 -- 172.21.15.79:0/3505466482 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4264029100 msgr2=0x7f426402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:25.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.512 7f428aa9f700 1 --2- 172.21.15.79:0/3505466482 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4264029100 0x7f426402b650 crc :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:25.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.512 7f428aa9f700 1 -- 172.21.15.79:0/3505466482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4284094510 msgr2=0x7f42840ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:25.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.512 7f428aa9f700 1 --2- 172.21.15.79:0/3505466482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4284094510 0x7f42840ce690 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f42840cf5b0 tx=0x7f427c00bee0).stop 2021-04-09T18:34:25.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.512 7f428aa9f700 1 -- 172.21.15.79:0/3505466482 shutdown_connections 2021-04-09T18:34:25.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.512 7f428aa9f700 1 --2- 172.21.15.79:0/3505466482 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4264029100 0x7f426402b650 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:25.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.512 7f428aa9f700 1 --2- 172.21.15.79:0/3505466482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4284094510 0x7f42840ce690 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:25.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.512 7f428aa9f700 1 --2- 172.21.15.79:0/3505466482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42840d4f10 0x7f42840d67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:25.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.512 7f428aa9f700 1 --2- 172.21.15.79:0/3505466482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42840d00a0 0x7f4284093ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:25.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.512 7f428aa9f700 1 -- 172.21.15.79:0/3505466482 >> 172.21.15.79:0/3505466482 conn(0x7f4284092d20 msgr2=0x7f42840baec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:25.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.512 7f428aa9f700 1 -- 172.21.15.79:0/3505466482 shutdown_connections 2021-04-09T18:34:25.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.512 7f428aa9f700 1 -- 172.21.15.79:0/3505466482 wait complete. 2021-04-09T18:34:25.534 INFO:tasks.cephfs_test_runner:test_filtered_df (tasks.cephfs.test_misc.TestMisc) ... ok 2021-04-09T18:34:25.534 INFO:tasks.cephfs_test_runner:Starting test: test_fs_new (tasks.cephfs.test_misc.TestMisc) 2021-04-09T18:34:25.535 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2021-04-09T18:34:25.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.628 7f429ef66700 1 Processor -- start 2021-04-09T18:34:25.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.628 7f429ef66700 1 -- start start 2021-04-09T18:34:25.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f429ef66700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42981c9020 0x7f42981cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:25.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f429ef66700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42980fbb20 con 0x7f42980e9ae0 2021-04-09T18:34:25.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f429ef66700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429809f910 con 0x7f42980f5520 2021-04-09T18:34:25.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f429ef66700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42981c3dc0 con 0x7f42981c9020 2021-04-09T18:34:25.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f4297fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f42980e9ae0 0x7f429809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56776/0 (socket says 172.21.15.79:56776) 2021-04-09T18:34:25.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f4297fff700 1 -- 172.21.15.79:0/60990755 learned_addr learned my addr 172.21.15.79:0/60990755 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:25.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f429d50b700 1 --2- 172.21.15.79:0/60990755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42981c9020 0x7f42981cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:25.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f42977fe700 1 -- 172.21.15.79:0/60990755 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394061523 0 0) 0x7f42800010d0 con 0x7f42980e9ae0 2021-04-09T18:34:25.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f42977fe700 1 -- 172.21.15.79:0/60990755 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4284003240 con 0x7f42980e9ae0 2021-04-09T18:34:25.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f42977fe700 1 -- 172.21.15.79:0/60990755 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4179165649 0 0) 0x7f42880010d0 con 0x7f42980f5520 2021-04-09T18:34:25.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f429d50b700 1 -- 172.21.15.79:0/60990755 >> v1:172.21.15.89:6789/0 conn(0x7f42980f5520 legacy=0x7f42980f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:25.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f429d50b700 1 -- 172.21.15.79:0/60990755 >> v1:172.21.15.79:6789/0 conn(0x7f42980e9ae0 legacy=0x7f429809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:25.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f429d50b700 1 -- 172.21.15.79:0/60990755 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42980e56d0 con 0x7f42981c9020 2021-04-09T18:34:25.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f429d50b700 1 --2- 172.21.15.79:0/60990755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42981c9020 0x7f42981cb480 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f42900032b0 tx=0x7f429000b0e0).ready entity=mon.2 client_cookie=a35f8fbc202f751d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:25.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f42977fe700 1 -- 172.21.15.79:0/60990755 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f42980e56d0 con 0x7f42981c9020 2021-04-09T18:34:25.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f42977fe700 1 -- 172.21.15.79:0/60990755 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429000baf0 con 0x7f42981c9020 2021-04-09T18:34:25.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f42977fe700 1 -- 172.21.15.79:0/60990755 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4290002020 con 0x7f42981c9020 2021-04-09T18:34:25.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f429ef66700 1 -- 172.21.15.79:0/60990755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42981c9020 msgr2=0x7f42981cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:25.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f429ef66700 1 --2- 172.21.15.79:0/60990755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42981c9020 0x7f42981cb480 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f42900032b0 tx=0x7f429000b0e0).stop 2021-04-09T18:34:25.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f429ef66700 1 -- 172.21.15.79:0/60990755 shutdown_connections 2021-04-09T18:34:25.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f429ef66700 1 --2- 172.21.15.79:0/60990755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42981c9020 0x7f42981cb480 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:25.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.632 7f429ef66700 1 -- 172.21.15.79:0/60990755 >> 172.21.15.79:0/60990755 conn(0x7f42980e5fe0 msgr2=0x7f42980e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:25.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.636 7f429ef66700 1 -- 172.21.15.79:0/60990755 shutdown_connections 2021-04-09T18:34:25.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.636 7f429ef66700 1 -- 172.21.15.79:0/60990755 wait complete. 2021-04-09T18:34:25.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.636 7f429ef66700 1 Processor -- start 2021-04-09T18:34:25.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.636 7f429ef66700 1 -- start start 2021-04-09T18:34:25.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f429ef66700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4298098a30 0x7f42980a2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:25.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f429ef66700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42980bdf90 0x7f42980be3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:25.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f429ef66700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42980d4f80 0x7f42980d53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:25.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f429ef66700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42980e9f30 con 0x7f42980d4f80 2021-04-09T18:34:25.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f429ef66700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42980bf960 con 0x7f4298098a30 2021-04-09T18:34:25.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f429ef66700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42980d5a00 con 0x7f42980bdf90 2021-04-09T18:34:25.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f429d50b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42980d4f80 0x7f42980d53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:25.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f429d50b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42980d4f80 0x7f42980d53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33840/0 (socket says 172.21.15.79:33840) 2021-04-09T18:34:25.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f429d50b700 1 -- 172.21.15.79:0/2849899814 learned_addr learned my addr 172.21.15.79:0/2849899814 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:25.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f429cd0a700 1 --2- 172.21.15.79:0/2849899814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4298098a30 0x7f42980a2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:25.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f4297fff700 1 --2- 172.21.15.79:0/2849899814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42980bdf90 0x7f42980be3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:25.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f429d50b700 1 -- 172.21.15.79:0/2849899814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42980bdf90 msgr2=0x7f42980be3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:25.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f429d50b700 1 --2- 172.21.15.79:0/2849899814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42980bdf90 0x7f42980be3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:25.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f429d50b700 1 -- 172.21.15.79:0/2849899814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4298098a30 msgr2=0x7f42980a2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:25.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f429d50b700 1 --2- 172.21.15.79:0/2849899814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4298098a30 0x7f42980a2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:25.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f429d50b700 1 -- 172.21.15.79:0/2849899814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42980a3260 con 0x7f42980d4f80 2021-04-09T18:34:25.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f429d50b700 1 --2- 172.21.15.79:0/2849899814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42980d4f80 0x7f42980d53d0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f429809ac10 tx=0x7f4290006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:25.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f42957fa700 1 -- 172.21.15.79:0/2849899814 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f42980a3260 con 0x7f42980d4f80 2021-04-09T18:34:25.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f42957fa700 1 -- 172.21.15.79:0/2849899814 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429001f030 con 0x7f42980d4f80 2021-04-09T18:34:25.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f429ef66700 1 -- 172.21.15.79:0/2849899814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42980bf4c0 con 0x7f42980d4f80 2021-04-09T18:34:25.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f42957fa700 1 -- 172.21.15.79:0/2849899814 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4290002020 con 0x7f42980d4f80 2021-04-09T18:34:25.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f429ef66700 1 -- 172.21.15.79:0/2849899814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42980bf1f0 con 0x7f42980d4f80 2021-04-09T18:34:25.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.640 7f42957fa700 1 -- 172.21.15.79:0/2849899814 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4290021020 con 0x7f42980d4f80 2021-04-09T18:34:25.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.644 7f42957fa700 1 --2- 172.21.15.79:0/2849899814 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f427c029100 0x7f427c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:25.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.644 7f42957fa700 1 -- 172.21.15.79:0/2849899814 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f429003b330 con 0x7f42980d4f80 2021-04-09T18:34:25.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.644 7f429cd0a700 1 --2- 172.21.15.79:0/2849899814 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f427c029100 0x7f427c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:25.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.644 7f429cd0a700 1 --2- 172.21.15.79:0/2849899814 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f427c029100 0x7f427c02b650 crc :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:25.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.644 7f429ef66700 1 -- 172.21.15.79:0/2849899814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42980e39e0 con 0x7f42980d4f80 2021-04-09T18:34:25.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.648 7f42957fa700 1 -- 172.21.15.79:0/2849899814 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f429000b8e0 con 0x7f42980d4f80 2021-04-09T18:34:25.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:25.812 7f429ef66700 1 -- 172.21.15.79:0/2849899814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7f42980f5b20 con 0x7f42980d4f80 2021-04-09T18:34:26.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.484 7f42957fa700 1 -- 172.21.15.79:0/2849899814 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v252) v1 ==== 125+0+0 (secure 0 0 0) 0x7f429001b430 con 0x7f42980d4f80 2021-04-09T18:34:26.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.532 7f429ef66700 1 -- 172.21.15.79:0/2849899814 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f427c029100 msgr2=0x7f427c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:26.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.532 7f429ef66700 1 --2- 172.21.15.79:0/2849899814 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f427c029100 0x7f427c02b650 crc :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:26.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.532 7f429ef66700 1 -- 172.21.15.79:0/2849899814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42980d4f80 msgr2=0x7f42980d53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:26.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.532 7f429ef66700 1 --2- 172.21.15.79:0/2849899814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42980d4f80 0x7f42980d53d0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f429809ac10 tx=0x7f4290006c10).stop 2021-04-09T18:34:26.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.532 7f429ef66700 1 -- 172.21.15.79:0/2849899814 shutdown_connections 2021-04-09T18:34:26.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.532 7f429ef66700 1 --2- 172.21.15.79:0/2849899814 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f427c029100 0x7f427c02b650 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:26.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.532 7f429ef66700 1 --2- 172.21.15.79:0/2849899814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4298098a30 0x7f42980a2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:26.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.532 7f429ef66700 1 --2- 172.21.15.79:0/2849899814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42980d4f80 0x7f42980d53d0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:26.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.532 7f429ef66700 1 --2- 172.21.15.79:0/2849899814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42980bdf90 0x7f42980be3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:26.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.532 7f429ef66700 1 -- 172.21.15.79:0/2849899814 >> 172.21.15.79:0/2849899814 conn(0x7f429809ac50 msgr2=0x7f42980d8360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:26.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.532 7f429ef66700 1 -- 172.21.15.79:0/2849899814 shutdown_connections 2021-04-09T18:34:26.540 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.532 7f429ef66700 1 -- 172.21.15.79:0/2849899814 wait complete. 2021-04-09T18:34:26.550 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-04-09T18:34:26.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.644 7fe5ba483700 1 Processor -- start 2021-04-09T18:34:26.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.644 7fe5ba483700 1 -- start start 2021-04-09T18:34:26.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.644 7fe5ba483700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b40e9b10 0x7fe5b409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:26.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.644 7fe5ba483700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe5b41c8040 0x7fe5b41ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:26.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.644 7fe5ba483700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b40fbb50 con 0x7fe5b40f5550 2021-04-09T18:34:26.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.644 7fe5ba483700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b41c3df0 con 0x7fe5b41c8040 2021-04-09T18:34:26.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.644 7fe5ba483700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b40e9f60 con 0x7fe5b40e9b10 2021-04-09T18:34:26.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.648 7fe5b8a28700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe5b41c8040 0x7fe5b41ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:26.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.648 7fe5b37fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b40e9b10 0x7fe5b409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:26.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.648 7fe5b3fff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe5b40f5550 0x7fe5b40f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:57260/0 (socket says 172.21.15.79:57260) 2021-04-09T18:34:26.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.648 7fe5b3fff700 1 -- 172.21.15.79:0/1099361666 learned_addr learned my addr 172.21.15.79:0/1099361666 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:26.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.648 7fe5b37fe700 1 -- 172.21.15.79:0/1099361666 >> v2:172.21.15.89:3300/0 conn(0x7fe5b41c8040 msgr2=0x7fe5b41ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:26.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.648 7fe5b37fe700 1 --2- 172.21.15.79:0/1099361666 >> v2:172.21.15.89:3300/0 conn(0x7fe5b41c8040 0x7fe5b41ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:26.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.648 7fe5b37fe700 1 -- 172.21.15.79:0/1099361666 >> v1:172.21.15.89:6789/0 conn(0x7fe5b40f5550 legacy=0x7fe5b40f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:26.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.648 7fe5b37fe700 1 -- 172.21.15.79:0/1099361666 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b40e5700 con 0x7fe5b40e9b10 2021-04-09T18:34:26.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.648 7fe5b37fe700 1 --2- 172.21.15.79:0/1099361666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b40e9b10 0x7fe5b409f110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fe5a4002f30 tx=0x7fe5a400bcc0).ready entity=mon.2 client_cookie=9a46594398060373 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:26.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.648 7fe5b2ffd700 1 -- 172.21.15.79:0/1099361666 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe5b40e5700 con 0x7fe5b40e9b10 2021-04-09T18:34:26.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.648 7fe5b2ffd700 1 -- 172.21.15.79:0/1099361666 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a4009800 con 0x7fe5b40e9b10 2021-04-09T18:34:26.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.648 7fe5b2ffd700 1 -- 172.21.15.79:0/1099361666 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe5a4009c10 con 0x7fe5b40e9b10 2021-04-09T18:34:26.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.648 7fe5ba483700 1 -- 172.21.15.79:0/1099361666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b40e9b10 msgr2=0x7fe5b409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:26.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.648 7fe5ba483700 1 --2- 172.21.15.79:0/1099361666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b40e9b10 0x7fe5b409f110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fe5a4002f30 tx=0x7fe5a400bcc0).stop 2021-04-09T18:34:26.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.648 7fe5ba483700 1 -- 172.21.15.79:0/1099361666 shutdown_connections 2021-04-09T18:34:26.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.648 7fe5ba483700 1 --2- 172.21.15.79:0/1099361666 >> v2:172.21.15.89:3300/0 conn(0x7fe5b41c8040 0x7fe5b41ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:26.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.648 7fe5ba483700 1 --2- 172.21.15.79:0/1099361666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b40e9b10 0x7fe5b409f110 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:26.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.648 7fe5ba483700 1 -- 172.21.15.79:0/1099361666 >> 172.21.15.79:0/1099361666 conn(0x7fe5b40e6010 msgr2=0x7fe5b40e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:26.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.648 7fe5ba483700 1 -- 172.21.15.79:0/1099361666 shutdown_connections 2021-04-09T18:34:26.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.648 7fe5ba483700 1 -- 172.21.15.79:0/1099361666 wait complete. 2021-04-09T18:34:26.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5ba483700 1 Processor -- start 2021-04-09T18:34:26.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5ba483700 1 -- start start 2021-04-09T18:34:26.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5ba483700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5b40b9950 0x7fe5b40ba480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:26.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5ba483700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5b40baab0 0x7fe5b40c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:26.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5ba483700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b40ca2a0 0x7fe5b4096760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:26.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5ba483700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b40ba180 con 0x7fe5b40b9950 2021-04-09T18:34:26.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5ba483700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b40b9da0 con 0x7fe5b40baab0 2021-04-09T18:34:26.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5ba483700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b4096480 con 0x7fe5b40ca2a0 2021-04-09T18:34:26.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5b3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5b40b9950 0x7fe5b40ba480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:26.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5b3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5b40b9950 0x7fe5b40ba480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33854/0 (socket says 172.21.15.79:33854) 2021-04-09T18:34:26.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5b37fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5b40baab0 0x7fe5b40c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:26.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5b3fff700 1 -- 172.21.15.79:0/2771854403 learned_addr learned my addr 172.21.15.79:0/2771854403 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:26.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5b8a28700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b40ca2a0 0x7fe5b4096760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:26.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5b37fe700 1 -- 172.21.15.79:0/2771854403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b40ca2a0 msgr2=0x7fe5b4096760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:26.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5b37fe700 1 --2- 172.21.15.79:0/2771854403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b40ca2a0 0x7fe5b4096760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:26.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5b37fe700 1 -- 172.21.15.79:0/2771854403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5b40b9950 msgr2=0x7fe5b40ba480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:26.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5b37fe700 1 --2- 172.21.15.79:0/2771854403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5b40b9950 0x7fe5b40ba480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:26.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5b37fe700 1 -- 172.21.15.79:0/2771854403 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b40ca6f0 con 0x7fe5b40baab0 2021-04-09T18:34:26.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5b3fff700 1 --2- 172.21.15.79:0/2771854403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5b40b9950 0x7fe5b40ba480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:26.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5b8a28700 1 --2- 172.21.15.79:0/2771854403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b40ca2a0 0x7fe5b4096760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:26.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5b37fe700 1 --2- 172.21.15.79:0/2771854403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5b40baab0 0x7fe5b40c9c70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fe5b40874d0 tx=0x7fe5a4006890).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:26.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5b0ff9700 1 -- 172.21.15.79:0/2771854403 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe5b40ca6f0 con 0x7fe5b40baab0 2021-04-09T18:34:26.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5ba483700 1 -- 172.21.15.79:0/2771854403 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b40ca950 con 0x7fe5b40baab0 2021-04-09T18:34:26.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5b0ff9700 1 -- 172.21.15.79:0/2771854403 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a4011c50 con 0x7fe5b40baab0 2021-04-09T18:34:26.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5b0ff9700 1 -- 172.21.15.79:0/2771854403 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe5a401d630 con 0x7fe5b40baab0 2021-04-09T18:34:26.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.652 7fe5ba483700 1 -- 172.21.15.79:0/2771854403 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b4096f20 con 0x7fe5b40baab0 2021-04-09T18:34:26.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.656 7fe5b0ff9700 1 -- 172.21.15.79:0/2771854403 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe5a4026450 con 0x7fe5b40baab0 2021-04-09T18:34:26.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.656 7fe5b0ff9700 1 --2- 172.21.15.79:0/2771854403 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe58c029100 0x7fe58c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:26.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.656 7fe5b0ff9700 1 -- 172.21.15.79:0/2771854403 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5276+0+0 (secure 0 0 0) 0x7fe5a403aab0 con 0x7fe5b40baab0 2021-04-09T18:34:26.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.656 7fe5b3fff700 1 --2- 172.21.15.79:0/2771854403 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe58c029100 0x7fe58c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:26.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.656 7fe5b3fff700 1 --2- 172.21.15.79:0/2771854403 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe58c029100 0x7fe58c02b650 crc :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:26.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.660 7fe5ba483700 1 -- 172.21.15.79:0/2771854403 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b40e39f0 con 0x7fe5b40baab0 2021-04-09T18:34:26.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.668 7fe5b0ff9700 1 -- 172.21.15.79:0/2771854403 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe5a40095f0 con 0x7fe5b40baab0 2021-04-09T18:34:26.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.856 7fe5ba483700 1 -- 172.21.15.79:0/2771854403 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe5b40a1c90 con 0x7fe5b40baab0 2021-04-09T18:34:26.871 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.864 7fe5b0ff9700 1 -- 172.21.15.79:0/2771854403 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe5a4011a40 con 0x7fe5b40baab0 2021-04-09T18:34:26.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.876 7fe5ba483700 1 -- 172.21.15.79:0/2771854403 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe58c029100 msgr2=0x7fe58c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:26.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.876 7fe5ba483700 1 --2- 172.21.15.79:0/2771854403 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe58c029100 0x7fe58c02b650 crc :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:26.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.876 7fe5ba483700 1 -- 172.21.15.79:0/2771854403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5b40baab0 msgr2=0x7fe5b40c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:26.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.876 7fe5ba483700 1 --2- 172.21.15.79:0/2771854403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5b40baab0 0x7fe5b40c9c70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fe5b40874d0 tx=0x7fe5a4006890).stop 2021-04-09T18:34:26.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.876 7fe5ba483700 1 -- 172.21.15.79:0/2771854403 shutdown_connections 2021-04-09T18:34:26.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.876 7fe5ba483700 1 --2- 172.21.15.79:0/2771854403 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe58c029100 0x7fe58c02b650 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:26.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.876 7fe5ba483700 1 --2- 172.21.15.79:0/2771854403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b40ca2a0 0x7fe5b4096760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:26.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.876 7fe5ba483700 1 --2- 172.21.15.79:0/2771854403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5b40b9950 0x7fe5b40ba480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:26.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.876 7fe5ba483700 1 --2- 172.21.15.79:0/2771854403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5b40baab0 0x7fe5b40c9c70 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:26.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.876 7fe5ba483700 1 -- 172.21.15.79:0/2771854403 >> 172.21.15.79:0/2771854403 conn(0x7fe5b409aba0 msgr2=0x7fe5b409a220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:26.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.876 7fe5ba483700 1 -- 172.21.15.79:0/2771854403 shutdown_connections 2021-04-09T18:34:26.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:26.876 7fe5ba483700 1 -- 172.21.15.79:0/2771854403 wait complete. 2021-04-09T18:34:26.890 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:34:26.891 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:34:26.903 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:34:26.920 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:34:26.939 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:34:26.958 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:34:26.977 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:34:26.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:26.978 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:34:26.978 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:34:26.988 INFO:teuthology.orchestra.run.smithi090.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-04-09T18:34:26.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:34:26.989 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-04-09T18:34:26.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:26.990 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:34:26.991 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:34:27.008 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-04-09T18:34:27.009 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:34:27.010 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-04-09T18:34:27.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:27.012 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:34:27.013 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:34:27.025 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:34:27.026 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:34:27.027 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:34:27.028 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:34:27.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.124 7f3358679700 1 Processor -- start 2021-04-09T18:34:27.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f3358679700 1 -- start start 2021-04-09T18:34:27.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f3358679700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f33500f5510 0x7f33500f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f3358679700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f33501c8000 0x7f33501ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f3358679700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33500fbb10 con 0x7f33500e9ad0 2021-04-09T18:34:27.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f3358679700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33500e9f20 con 0x7f33500f5510 2021-04-09T18:34:27.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f3358679700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33501c3db0 con 0x7f33501c8000 2021-04-09T18:34:27.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f335641d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f33500f5510 0x7f33500f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f335641d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f33500f5510 0x7f33500f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33860/0 (socket says 172.21.15.79:33860) 2021-04-09T18:34:27.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f335641d700 1 -- 172.21.15.79:0/446440825 learned_addr learned my addr 172.21.15.79:0/446440825 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:27.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f3356c1e700 1 --2- 172.21.15.79:0/446440825 >> v2:172.21.15.89:3300/0 conn(0x7f33501c8000 0x7f33501ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f335641d700 1 -- 172.21.15.79:0/446440825 >> v2:172.21.15.89:3300/0 conn(0x7f33501c8000 msgr2=0x7f33501ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:27.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f335641d700 1 --2- 172.21.15.79:0/446440825 >> v2:172.21.15.89:3300/0 conn(0x7f33501c8000 0x7f33501ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f335641d700 1 -- 172.21.15.79:0/446440825 >> v1:172.21.15.89:6789/0 conn(0x7f33500e9ad0 legacy=0x7f335009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:27.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f335641d700 1 -- 172.21.15.79:0/446440825 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335009f900 con 0x7f33500f5510 2021-04-09T18:34:27.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f335541b700 1 -- 172.21.15.79:0/446440825 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926250748 0 0) 0x7f33400010d0 con 0x7f33500e9ad0 2021-04-09T18:34:27.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f335641d700 1 --2- 172.21.15.79:0/446440825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33500f5510 0x7f33500f64a0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f334c0032b0 tx=0x7f334c00b3c0).ready entity=mon.0 client_cookie=f32e8e5a1e50ff98 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:27.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f335541b700 1 -- 172.21.15.79:0/446440825 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f335009f900 con 0x7f33500f5510 2021-04-09T18:34:27.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f335541b700 1 -- 172.21.15.79:0/446440825 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c00bc20 con 0x7f33500f5510 2021-04-09T18:34:27.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f335541b700 1 -- 172.21.15.79:0/446440825 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f334c002020 con 0x7f33500f5510 2021-04-09T18:34:27.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f3358679700 1 -- 172.21.15.79:0/446440825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33500f5510 msgr2=0x7f33500f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:27.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.128 7f3358679700 1 --2- 172.21.15.79:0/446440825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33500f5510 0x7f33500f64a0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f334c0032b0 tx=0x7f334c00b3c0).stop 2021-04-09T18:34:27.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.132 7f3358679700 1 -- 172.21.15.79:0/446440825 shutdown_connections 2021-04-09T18:34:27.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.132 7f3358679700 1 --2- 172.21.15.79:0/446440825 >> v2:172.21.15.89:3300/0 conn(0x7f33501c8000 0x7f33501ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.132 7f3358679700 1 --2- 172.21.15.79:0/446440825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33500f5510 0x7f33500f64a0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.132 7f3358679700 1 -- 172.21.15.79:0/446440825 >> 172.21.15.79:0/446440825 conn(0x7f33500e5fd0 msgr2=0x7f33500e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:27.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.132 7f3358679700 1 -- 172.21.15.79:0/446440825 shutdown_connections 2021-04-09T18:34:27.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.132 7f3358679700 1 -- 172.21.15.79:0/446440825 wait complete. 2021-04-09T18:34:27.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.136 7f3358679700 1 Processor -- start 2021-04-09T18:34:27.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.136 7f3358679700 1 -- start start 2021-04-09T18:34:27.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.136 7f3358679700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3350098d00 0x7f3350096c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.136 7f3358679700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33500bb0a0 0x7f33500bdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.136 7f3358679700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33500be2d0 0x7f33500c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.136 7f3358679700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3350097450 con 0x7f33500bb0a0 2021-04-09T18:34:27.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.136 7f3358679700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3350097750 con 0x7f33500be2d0 2021-04-09T18:34:27.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.136 7f3358679700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33500bb4f0 con 0x7f3350098d00 2021-04-09T18:34:27.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.136 7f3355c1c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33500bb0a0 0x7f33500bdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.136 7f3355c1c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33500bb0a0 0x7f33500bdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33868/0 (socket says 172.21.15.79:33868) 2021-04-09T18:34:27.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.136 7f3355c1c700 1 -- 172.21.15.79:0/1844877925 learned_addr learned my addr 172.21.15.79:0/1844877925 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:27.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.136 7f335641d700 1 --2- 172.21.15.79:0/1844877925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3350098d00 0x7f3350096c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.136 7f3356c1e700 1 --2- 172.21.15.79:0/1844877925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33500be2d0 0x7f33500c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.136 7f3355c1c700 1 -- 172.21.15.79:0/1844877925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3350098d00 msgr2=0x7f3350096c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:27.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.136 7f3355c1c700 1 --2- 172.21.15.79:0/1844877925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3350098d00 0x7f3350096c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.136 7f3355c1c700 1 -- 172.21.15.79:0/1844877925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33500be2d0 msgr2=0x7f33500c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:27.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.136 7f3355c1c700 1 --2- 172.21.15.79:0/1844877925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33500be2d0 0x7f33500c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.136 7f3355c1c700 1 -- 172.21.15.79:0/1844877925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3350096810 con 0x7f33500bb0a0 2021-04-09T18:34:27.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.136 7f3355c1c700 1 --2- 172.21.15.79:0/1844877925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33500bb0a0 0x7f33500bdca0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f3340000e90 tx=0x7f334000cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:27.151 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.136 7f3346ffd700 1 -- 172.21.15.79:0/1844877925 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3350096810 con 0x7f33500bb0a0 2021-04-09T18:34:27.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.140 7f3346ffd700 1 -- 172.21.15.79:0/1844877925 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3340010510 con 0x7f33500bb0a0 2021-04-09T18:34:27.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.140 7f3358679700 1 -- 172.21.15.79:0/1844877925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33500be720 con 0x7f33500bb0a0 2021-04-09T18:34:27.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.140 7f3346ffd700 1 -- 172.21.15.79:0/1844877925 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33400106f0 con 0x7f33500bb0a0 2021-04-09T18:34:27.152 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.140 7f3358679700 1 -- 172.21.15.79:0/1844877925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33500c4e80 con 0x7f33500bb0a0 2021-04-09T18:34:27.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.140 7f3346ffd700 1 -- 172.21.15.79:0/1844877925 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3340019020 con 0x7f33500bb0a0 2021-04-09T18:34:27.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.140 7f3346ffd700 1 --2- 172.21.15.79:0/1844877925 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3338029100 0x7f333802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.140 7f3346ffd700 1 -- 172.21.15.79:0/1844877925 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f3340038bc0 con 0x7f33500bb0a0 2021-04-09T18:34:27.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.140 7f335641d700 1 --2- 172.21.15.79:0/1844877925 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3338029100 0x7f333802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.140 7f335641d700 1 --2- 172.21.15.79:0/1844877925 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3338029100 0x7f333802b650 crc :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:27.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.156 7f3358679700 1 -- 172.21.15.79:0/1844877925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33500e39d0 con 0x7f33500bb0a0 2021-04-09T18:34:27.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.164 7f3346ffd700 1 -- 172.21.15.79:0/1844877925 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3340000bf0 con 0x7f33500bb0a0 2021-04-09T18:34:27.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.332 7f3358679700 1 -- 172.21.15.79:0/1844877925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f33500a1cb0 con 0x7f33500bb0a0 2021-04-09T18:34:27.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.336 7f3346ffd700 1 -- 172.21.15.79:0/1844877925 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v101) v1 ==== 81+0+26070 (secure 0 0 0) 0x7f3340010300 con 0x7f33500bb0a0 2021-04-09T18:34:27.341 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:27.341 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:34:27.341 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 101, 2021-04-09T18:34:27.342 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:34:27.342 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:34:27.342 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:34:24.465002", 2021-04-09T18:34:27.342 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:34:27.343 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:34:27.343 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:34:27.343 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:34:27.343 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:34:27.343 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:34:27.344 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:34:27.344 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:34:27.344 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:34:27.344 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:34:27.345 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:34:27.345 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:34:27.345 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:34:27.345 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:34:27.345 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:34:27.346 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 19, 2021-04-09T18:34:27.346 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:34:27.346 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:34:27.346 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:34:27.346 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:34:27.347 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:34:27.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.347 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:34:27.347 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:34:27.348 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:34:27.348 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:34:27.348 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:34:27.348 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:34:27.348 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:34:27.349 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:34:27.349 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:34:27.349 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:34:27.349 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:34:27.350 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:34:27.350 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:34:27.350 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:34:27.350 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:34:27.350 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:34:27.351 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:34:27.351 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:34:27.351 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:34:27.351 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:34:27.351 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:34:27.352 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:34:27.352 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:34:27.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.352 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:34:27.353 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:34:27.353 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:34:27.353 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:34:27.353 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:34:27.353 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:34:27.354 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:34:27.354 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:34:27.354 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:34:27.354 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:34:27.354 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:34:27.355 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:34:27.355 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:34:27.355 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:34:27.355 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:34:27.356 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:34:27.356 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:34:27.356 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:34:27.356 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:34:27.356 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:34:27.357 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:34:27.357 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:34:27.357 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:34:27.357 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:34:27.357 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:34:27.358 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:34:27.358 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:34:27.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.358 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:34:27.359 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:34:27.359 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:34:27.359 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:34:27.359 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:34:27.360 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:34:27.360 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:34:27.360 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:34:27.360 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:34:27.360 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:34:27.361 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:34:27.361 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:34:27.361 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:34:27.361 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:34:27.361 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.362 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.362 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:34:27.362 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:34:27.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.363 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:34:27.363 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:34:27.363 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:27.363 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:27.363 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:27.364 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:27.364 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:27.364 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:27.364 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:27.365 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 94, 2021-04-09T18:34:27.365 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:27.365 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:27.365 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:27.365 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.366 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.366 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:34:27.366 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:27.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.367 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.367 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:34:27.367 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:27.368 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.368 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.368 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:27.368 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.369 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.369 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:34:27.369 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:27.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.370 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.370 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:34:27.370 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:27.371 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.371 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.371 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:27.372 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.372 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.372 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:34:27.372 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:27.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.373 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.373 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:34:27.373 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:27.374 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.374 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.374 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:27.375 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.375 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.375 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:34:27.375 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:27.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.376 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.376 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:34:27.376 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:34:27.377 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.377 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.377 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:34:27.378 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:34:27.378 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:34:27.378 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:34:27.378 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:27.378 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:27.379 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:27.379 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.380 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:34:27.380 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:34:27.380 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:27.380 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:27.380 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:27.381 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:27.381 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:27.381 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:27.381 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:27.381 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 95, 2021-04-09T18:34:27.382 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:27.382 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:27.382 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:27.382 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.383 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.383 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:34:27.383 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:27.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.384 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.384 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:34:27.384 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:27.384 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.385 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.385 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:27.385 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.386 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.386 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:34:27.386 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:27.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.387 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.387 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:34:27.387 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:27.387 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.388 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.388 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:27.388 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.389 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.389 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:34:27.389 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:27.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.390 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.390 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:34:27.390 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:27.391 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.391 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.391 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:27.392 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.392 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.392 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:34:27.393 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:27.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.393 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.393 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:34:27.394 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:34:27.394 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.394 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.395 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:34:27.395 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:34:27.395 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:34:27.395 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:34:27.396 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:27.396 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:27.396 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:27.396 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.397 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:34:27.397 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:34:27.397 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:27.398 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:27.398 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:27.398 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:27.398 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:27.399 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:27.399 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:27.399 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 95, 2021-04-09T18:34:27.399 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:27.400 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:27.400 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:27.400 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.400 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.401 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:34:27.401 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:27.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.401 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.402 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:34:27.402 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:27.402 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.402 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.403 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:27.403 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.403 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.404 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:34:27.404 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:27.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.404 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.405 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:34:27.405 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:27.405 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.405 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.406 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:27.406 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.406 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.407 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:34:27.407 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:27.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.407 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.408 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:34:27.408 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:27.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.408 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.409 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:27.409 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.409 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.410 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:34:27.410 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:27.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.410 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.411 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:34:27.411 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:34:27.411 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.411 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.412 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:34:27.412 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:34:27.412 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:34:27.412 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:34:27.413 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:27.413 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:27.413 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:27.413 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.414 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:34:27.414 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:34:27.414 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:27.415 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:27.415 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:27.415 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:27.415 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:27.415 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:27.416 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:27.416 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 95, 2021-04-09T18:34:27.416 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:27.416 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:27.417 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:27.417 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.417 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.417 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:34:27.418 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:27.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.418 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.418 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:34:27.419 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:27.419 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.419 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.419 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:27.420 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.420 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.420 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:34:27.421 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:27.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.421 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.421 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:34:27.422 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:27.422 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.422 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.422 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:27.423 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.423 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.423 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:34:27.424 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:27.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.424 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.424 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:34:27.425 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:27.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.425 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.425 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:27.426 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.426 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.426 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:34:27.426 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:27.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.427 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.427 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:34:27.428 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:34:27.428 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.428 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.428 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:34:27.429 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:34:27.429 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:34:27.429 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:34:27.429 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:27.429 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:27.430 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:27.430 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.431 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:34:27.431 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:34:27.431 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:27.431 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:27.431 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:27.432 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:27.432 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:27.432 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:27.432 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:27.433 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 95, 2021-04-09T18:34:27.433 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:27.433 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:27.433 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:27.433 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.434 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.434 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:34:27.434 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:27.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.435 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.435 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:34:27.435 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:27.436 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.436 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.436 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:27.436 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.437 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.437 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:34:27.437 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:27.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.438 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.438 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:34:27.438 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:27.438 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.439 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.439 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:27.439 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.440 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.440 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:34:27.440 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:27.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.441 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.441 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:34:27.441 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:27.441 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.442 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.442 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:27.442 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.443 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.443 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:34:27.443 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:27.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.444 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.444 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:34:27.444 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:34:27.444 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.445 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.445 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:34:27.445 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:34:27.445 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:34:27.446 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:34:27.446 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:27.446 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:27.446 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:27.447 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.447 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:34:27.447 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:34:27.448 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:27.448 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:27.448 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:27.448 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:27.448 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:27.449 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:27.449 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:27.449 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 95, 2021-04-09T18:34:27.449 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:27.450 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:27.450 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:27.450 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.450 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.451 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:34:27.451 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:27.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.451 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.452 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:34:27.452 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:27.452 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.452 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.453 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:27.453 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.453 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.454 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:34:27.454 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:27.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.454 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.455 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:34:27.455 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:27.455 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.455 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.456 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:27.456 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.456 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.457 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:34:27.457 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:27.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.457 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.458 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:34:27.458 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:27.458 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.458 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.459 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:27.459 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.459 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.460 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:34:27.460 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:27.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.460 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.461 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:34:27.461 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:34:27.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.461 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.462 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:34:27.462 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:34:27.462 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:34:27.462 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:34:27.463 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:27.463 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:27.463 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:27.463 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.464 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:34:27.464 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:34:27.464 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:27.465 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:27.465 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:27.465 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:27.465 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:27.465 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:27.466 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:27.466 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 86, 2021-04-09T18:34:27.466 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:27.466 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:27.466 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:27.467 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.467 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.467 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:34:27.468 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:27.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.468 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.468 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:34:27.469 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:27.469 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.469 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.469 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:27.470 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.470 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.470 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:34:27.471 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:27.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.471 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.471 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:34:27.472 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:27.472 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.472 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.473 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:27.473 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.473 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.473 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:34:27.474 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:27.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.474 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.475 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:34:27.475 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:27.475 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.475 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.476 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:27.476 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.476 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.476 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:34:27.477 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:27.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.477 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.478 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:34:27.478 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:34:27.478 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.478 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.479 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:34:27.479 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:34:27.479 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:34:27.479 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:34:27.479 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:27.480 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:27.480 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:27.480 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.481 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:34:27.481 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:34:27.481 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:34:27.481 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:34:27.482 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:34:27.482 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:34:27.482 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:34:27.482 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:34:27.482 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:34:27.483 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 95, 2021-04-09T18:34:27.483 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:34:27.483 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:34:27.483 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:34:27.483 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.484 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.484 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:34:27.484 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:27.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.485 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.485 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:34:27.485 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:27.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.486 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.486 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:34:27.486 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.487 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.487 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:34:27.487 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:27.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.488 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.488 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:34:27.488 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:27.489 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.489 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.489 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:34:27.489 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.490 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.490 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:34:27.490 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:27.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.491 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.491 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:34:27.491 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:27.492 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.492 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.492 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:34:27.492 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:34:27.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.493 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:34:27.493 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:34:27.493 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:27.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.494 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:34:27.494 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:34:27.494 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:34:27.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.495 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.495 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:34:27.495 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:34:27.496 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:34:27.496 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:34:27.496 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:34:27.496 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:34:27.496 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:34:27.497 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:27.497 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.497 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:34:27.497 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:34:27.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.498 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:34:27.498 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:27.498 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:27.498 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:27.499 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:27.499 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:27.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.499 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:34:27.500 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:27.500 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:27.500 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:27.500 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:27.500 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:27.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.501 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:34:27.501 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:27.501 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:27.502 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:27.502 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:27.502 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:27.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.503 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:34:27.503 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:27.503 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:27.503 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:27.504 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:27.504 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:27.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.504 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:34:27.505 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:27.505 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:27.505 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:27.505 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:27.505 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:27.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.506 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:34:27.506 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:27.506 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:27.507 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:27.507 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:27.507 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:27.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.508 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:34:27.508 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:27.508 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:27.508 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:27.509 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:27.509 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:27.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:27.510 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:34:27.510 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:34:27.510 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:34:27.510 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:34:27.510 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:34:27.511 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:34:27.511 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.511 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:34:27.511 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:34:27.511 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:34:27.512 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:34:27.512 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:34:27.512 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": { 2021-04-09T18:34:27.512 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6835/57205751": "2021-04-10 18:34:20.984067", 2021-04-09T18:34:27.512 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6834/57205751": "2021-04-10 18:34:20.984067", 2021-04-09T18:34:27.513 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6835/2412239832": "2021-04-10 18:34:09.999325", 2021-04-09T18:34:27.513 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6834/2412239832": "2021-04-10 18:34:09.999325" 2021-04-09T18:34:27.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.513 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:34:27.514 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:34:27.514 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:34:27.514 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:34:27.514 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:34:27.514 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:34:27.515 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:34:27.515 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:34:27.515 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:34:27.515 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:34:27.515 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:34:27.516 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:34:27.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.516 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:34:27.516 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:34:27.517 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:34:27.517 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:34:27.517 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:34:27.517 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:34:27.517 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:34:27.518 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:27.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:27.518 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:34:27.518 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:34:27.518 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:34:27.519 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:34:27.519 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:34:27.519 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:34:27.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.340 7f3358679700 1 -- 172.21.15.79:0/1844877925 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3338029100 msgr2=0x7f333802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:27.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.340 7f3358679700 1 --2- 172.21.15.79:0/1844877925 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3338029100 0x7f333802b650 crc :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.340 7f3358679700 1 -- 172.21.15.79:0/1844877925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33500bb0a0 msgr2=0x7f33500bdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:27.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.340 7f3358679700 1 --2- 172.21.15.79:0/1844877925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33500bb0a0 0x7f33500bdca0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f3340000e90 tx=0x7f334000cab0).stop 2021-04-09T18:34:27.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.340 7f3358679700 1 -- 172.21.15.79:0/1844877925 shutdown_connections 2021-04-09T18:34:27.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.340 7f3358679700 1 --2- 172.21.15.79:0/1844877925 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3338029100 0x7f333802b650 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.340 7f3358679700 1 --2- 172.21.15.79:0/1844877925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33500be2d0 0x7f33500c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.340 7f3358679700 1 --2- 172.21.15.79:0/1844877925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3350098d00 0x7f3350096c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.340 7f3358679700 1 --2- 172.21.15.79:0/1844877925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33500bb0a0 0x7f33500bdca0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.340 7f3358679700 1 -- 172.21.15.79:0/1844877925 >> 172.21.15.79:0/1844877925 conn(0x7f335009acd0 msgr2=0x7f335009a230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:27.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.340 7f3358679700 1 -- 172.21.15.79:0/1844877925 shutdown_connections 2021-04-09T18:34:27.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.340 7f3358679700 1 -- 172.21.15.79:0/1844877925 wait complete. 2021-04-09T18:34:27.524 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:34:27.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.620 7ffb75119700 1 Processor -- start 2021-04-09T18:34:27.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.620 7ffb75119700 1 -- start start 2021-04-09T18:34:27.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb75119700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ffb700f5510 0x7ffb700f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb75119700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb700e9ad0 0x7ffb7009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb75119700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb700fbb10 con 0x7ffb701c2da0 2021-04-09T18:34:27.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb75119700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb700e9f20 con 0x7ffb700e9ad0 2021-04-09T18:34:27.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb75119700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb700e59c0 con 0x7ffb700f5510 2021-04-09T18:34:27.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb6e59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb700e9ad0 0x7ffb7009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb6e59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb700e9ad0 0x7ffb7009f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33878/0 (socket says 172.21.15.79:33878) 2021-04-09T18:34:27.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb6e59c700 1 -- 172.21.15.79:0/1328385118 learned_addr learned my addr 172.21.15.79:0/1328385118 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:27.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb6ed9d700 1 --2- 172.21.15.79:0/1328385118 >> v2:172.21.15.89:3300/0 conn(0x7ffb700f5510 0x7ffb700f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb6e59c700 1 -- 172.21.15.79:0/1328385118 >> v2:172.21.15.89:3300/0 conn(0x7ffb700f5510 msgr2=0x7ffb700f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:27.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb6e59c700 1 --2- 172.21.15.79:0/1328385118 >> v2:172.21.15.89:3300/0 conn(0x7ffb700f5510 0x7ffb700f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb6e59c700 1 -- 172.21.15.79:0/1328385118 >> v1:172.21.15.89:6789/0 conn(0x7ffb701c2da0 legacy=0x7ffb701c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:27.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb6e59c700 1 -- 172.21.15.79:0/1328385118 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb700e56c0 con 0x7ffb700e9ad0 2021-04-09T18:34:27.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb6e59c700 1 --2- 172.21.15.79:0/1328385118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb700e9ad0 0x7ffb7009f100 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7ffb64002f30 tx=0x7ffb6400bd70).ready entity=mon.0 client_cookie=693f69fcdf92ce56 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:27.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb6dd9b700 1 -- 172.21.15.79:0/1328385118 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffb700e56c0 con 0x7ffb700e9ad0 2021-04-09T18:34:27.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb6dd9b700 1 -- 172.21.15.79:0/1328385118 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb64009950 con 0x7ffb700e9ad0 2021-04-09T18:34:27.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb6dd9b700 1 -- 172.21.15.79:0/1328385118 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffb64009d20 con 0x7ffb700e9ad0 2021-04-09T18:34:27.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb75119700 1 -- 172.21.15.79:0/1328385118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb700e9ad0 msgr2=0x7ffb7009f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:27.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb75119700 1 --2- 172.21.15.79:0/1328385118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb700e9ad0 0x7ffb7009f100 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7ffb64002f30 tx=0x7ffb6400bd70).stop 2021-04-09T18:34:27.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb75119700 1 -- 172.21.15.79:0/1328385118 shutdown_connections 2021-04-09T18:34:27.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb75119700 1 --2- 172.21.15.79:0/1328385118 >> v2:172.21.15.89:3300/0 conn(0x7ffb700f5510 0x7ffb700f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb75119700 1 --2- 172.21.15.79:0/1328385118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb700e9ad0 0x7ffb7009f100 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb75119700 1 -- 172.21.15.79:0/1328385118 >> 172.21.15.79:0/1328385118 conn(0x7ffb700e5fd0 msgr2=0x7ffb700e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:27.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb75119700 1 -- 172.21.15.79:0/1328385118 shutdown_connections 2021-04-09T18:34:27.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.624 7ffb75119700 1 -- 172.21.15.79:0/1328385118 wait complete. 2021-04-09T18:34:27.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.628 7ffb75119700 1 Processor -- start 2021-04-09T18:34:27.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.628 7ffb75119700 1 -- start start 2021-04-09T18:34:27.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb75119700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb700ac1c0 0x7ffb700d6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb75119700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb700bad30 0x7ffb700ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb75119700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb700bb180 0x7ffb700d4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb75119700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700885b0 con 0x7ffb700bad30 2021-04-09T18:34:27.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb75119700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700ac910 con 0x7ffb700bb180 2021-04-09T18:34:27.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb75119700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700ac610 con 0x7ffb700ac1c0 2021-04-09T18:34:27.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb6e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb700bad30 0x7ffb700ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb6e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb700bad30 0x7ffb700ae1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33884/0 (socket says 172.21.15.79:33884) 2021-04-09T18:34:27.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb6e59c700 1 -- 172.21.15.79:0/1233228109 learned_addr learned my addr 172.21.15.79:0/1233228109 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:27.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb6ed9d700 1 --2- 172.21.15.79:0/1233228109 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb700ac1c0 0x7ffb700d6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb6f59e700 1 --2- 172.21.15.79:0/1233228109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb700bb180 0x7ffb700d4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb6e59c700 1 -- 172.21.15.79:0/1233228109 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb700ac1c0 msgr2=0x7ffb700d6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:27.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb6e59c700 1 --2- 172.21.15.79:0/1233228109 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb700ac1c0 0x7ffb700d6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb6e59c700 1 -- 172.21.15.79:0/1233228109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb700bb180 msgr2=0x7ffb700d4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:27.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb6e59c700 1 --2- 172.21.15.79:0/1233228109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb700bb180 0x7ffb700d4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb6e59c700 1 -- 172.21.15.79:0/1233228109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb70098d80 con 0x7ffb700bad30 2021-04-09T18:34:27.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb6ed9d700 1 --2- 172.21.15.79:0/1233228109 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb700ac1c0 0x7ffb700d6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:27.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb6e59c700 1 --2- 172.21.15.79:0/1233228109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb700bad30 0x7ffb700ae1b0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7ffb700c0d60 tx=0x7ffb64006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:27.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb5f7fe700 1 -- 172.21.15.79:0/1233228109 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffb70098d80 con 0x7ffb700bad30 2021-04-09T18:34:27.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb75119700 1 -- 172.21.15.79:0/1233228109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb700ae7e0 con 0x7ffb700bad30 2021-04-09T18:34:27.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb5f7fe700 1 -- 172.21.15.79:0/1233228109 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb64011e00 con 0x7ffb700bad30 2021-04-09T18:34:27.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb5f7fe700 1 -- 172.21.15.79:0/1233228109 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffb6401d630 con 0x7ffb700bad30 2021-04-09T18:34:27.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb75119700 1 -- 172.21.15.79:0/1233228109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb700d4e20 con 0x7ffb700bad30 2021-04-09T18:34:27.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb75119700 1 -- 172.21.15.79:0/1233228109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb700e39d0 con 0x7ffb700bad30 2021-04-09T18:34:27.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb5f7fe700 1 -- 172.21.15.79:0/1233228109 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ffb64026450 con 0x7ffb700bad30 2021-04-09T18:34:27.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.632 7ffb5f7fe700 1 --2- 172.21.15.79:0/1233228109 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffb54029100 0x7ffb5402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.636 7ffb5f7fe700 1 -- 172.21.15.79:0/1233228109 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5276+0+0 (secure 0 0 0) 0x7ffb6403af90 con 0x7ffb700bad30 2021-04-09T18:34:27.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.636 7ffb6ed9d700 1 --2- 172.21.15.79:0/1233228109 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffb54029100 0x7ffb5402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.636 7ffb6ed9d700 1 --2- 172.21.15.79:0/1233228109 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffb54029100 0x7ffb5402b650 crc :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:27.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.640 7ffb5f7fe700 1 -- 172.21.15.79:0/1233228109 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ffb64009740 con 0x7ffb700bad30 2021-04-09T18:34:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.804 7ffb75119700 1 -- 172.21.15.79:0/1233228109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb700f5b10 con 0x7ffb700bad30 2021-04-09T18:34:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.804 7ffb5f7fe700 1 -- 172.21.15.79:0/1233228109 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+1177 (secure 0 0 0) 0x7ffb64011bf0 con 0x7ffb700bad30 2021-04-09T18:34:27.811 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:27.811 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":64,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7155,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/1349682878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1349682878},{"type":"v1","addr":"172.21.15.79:6833","nonce":1349682878}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":59},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1000197747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1000197747},{"type":"v1","addr":"172.21.15.89:6835","nonce":1000197747}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":64}],"filesystems":[]} 2021-04-09T18:34:27.812 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 64 2021-04-09T18:34:27.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.808 7ffb75119700 1 -- 172.21.15.79:0/1233228109 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffb54029100 msgr2=0x7ffb5402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:27.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.808 7ffb75119700 1 --2- 172.21.15.79:0/1233228109 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffb54029100 0x7ffb5402b650 crc :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.808 7ffb75119700 1 -- 172.21.15.79:0/1233228109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb700bad30 msgr2=0x7ffb700ae1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:27.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.808 7ffb75119700 1 --2- 172.21.15.79:0/1233228109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb700bad30 0x7ffb700ae1b0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7ffb700c0d60 tx=0x7ffb64006890).stop 2021-04-09T18:34:27.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.808 7ffb75119700 1 -- 172.21.15.79:0/1233228109 shutdown_connections 2021-04-09T18:34:27.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.808 7ffb75119700 1 --2- 172.21.15.79:0/1233228109 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffb54029100 0x7ffb5402b650 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.808 7ffb75119700 1 --2- 172.21.15.79:0/1233228109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb700bb180 0x7ffb700d4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.808 7ffb75119700 1 --2- 172.21.15.79:0/1233228109 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb700ac1c0 0x7ffb700d6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.808 7ffb75119700 1 --2- 172.21.15.79:0/1233228109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb700bad30 0x7ffb700ae1b0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.808 7ffb75119700 1 -- 172.21.15.79:0/1233228109 >> 172.21.15.79:0/1233228109 conn(0x7ffb700afc50 msgr2=0x7ffb700af050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:27.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.808 7ffb75119700 1 -- 172.21.15.79:0/1233228109 shutdown_connections 2021-04-09T18:34:27.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.808 7ffb75119700 1 -- 172.21.15.79:0/1233228109 wait complete. 2021-04-09T18:34:27.823 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:34:27.922 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f1771eae700 1 Processor -- start 2021-04-09T18:34:27.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f1771eae700 1 -- start start 2021-04-09T18:34:27.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f1771eae700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f176c0e9ad0 0x7f176c09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f1771eae700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f176c1c8000 0x7f176c1ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f1771eae700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176c0fbb10 con 0x7f176c0f5510 2021-04-09T18:34:27.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f1771eae700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c1c3db0 con 0x7f176c1c8000 2021-04-09T18:34:27.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f1771eae700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0e9f20 con 0x7f176c0e9ad0 2021-04-09T18:34:27.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f176c0f5510 0x7f176c0f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56830/0 (socket says 172.21.15.79:56830) 2021-04-09T18:34:27.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176b7fe700 1 -- 172.21.15.79:0/1115633380 learned_addr learned my addr 172.21.15.79:0/1115633380 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:27.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176bfff700 1 --2- 172.21.15.79:0/1115633380 >> v2:172.21.15.89:3300/0 conn(0x7f176c1c8000 0x7f176c1ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176affd700 1 --2- 172.21.15.79:0/1115633380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f176c0e9ad0 0x7f176c09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176a7fc700 1 -- 172.21.15.79:0/1115633380 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167010257 0 0) 0x7f175c0010d0 con 0x7f176c0f5510 2021-04-09T18:34:27.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176a7fc700 1 -- 172.21.15.79:0/1115633380 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1758003240 con 0x7f176c0f5510 2021-04-09T18:34:27.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176a7fc700 1 -- 172.21.15.79:0/1115633380 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2837597280 0 0) 0x7f175c001650 con 0x7f176c0f5510 2021-04-09T18:34:27.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176a7fc700 1 -- 172.21.15.79:0/1115633380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f176c0e9ad0 msgr2=0x7f176c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:27.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176a7fc700 1 --2- 172.21.15.79:0/1115633380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f176c0e9ad0 0x7f176c09f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176a7fc700 1 -- 172.21.15.79:0/1115633380 >> v2:172.21.15.89:3300/0 conn(0x7f176c1c8000 msgr2=0x7f176c1ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:27.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176a7fc700 1 --2- 172.21.15.79:0/1115633380 >> v2:172.21.15.89:3300/0 conn(0x7f176c1c8000 0x7f176c1ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176a7fc700 1 -- 172.21.15.79:0/1115633380 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c0e56c0 con 0x7f176c0f5510 2021-04-09T18:34:27.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176a7fc700 1 -- 172.21.15.79:0/1115633380 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f175c001bb0 con 0x7f176c0f5510 2021-04-09T18:34:27.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176a7fc700 1 -- 172.21.15.79:0/1115633380 >> v1:172.21.15.79:6789/0 conn(0x7f176c0f5510 legacy=0x7f176c0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:27.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176a7fc700 1 --2- 172.21.15.79:0/1115633380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17580038c0 0x7f1758003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176a7fc700 1 --2- 172.21.15.79:0/1115633380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17580045a0 0x7f1758004a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176a7fc700 1 --2- 172.21.15.79:0/1115633380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f175804d7f0 0x7f175804fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176a7fc700 1 -- 172.21.15.79:0/1115633380 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c1c3db0 con 0x7f17580045a0 2021-04-09T18:34:27.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176a7fc700 1 -- 172.21.15.79:0/1115633380 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0e9f20 con 0x7f17580038c0 2021-04-09T18:34:27.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176a7fc700 1 -- 172.21.15.79:0/1115633380 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1758050280 con 0x7f175804d7f0 2021-04-09T18:34:27.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176bfff700 1 --2- 172.21.15.79:0/1115633380 >> v2:172.21.15.89:3300/0 conn(0x7f176c1c8000 0x7f176c1ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:27.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176affd700 1 --2- 172.21.15.79:0/1115633380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f176c0e9ad0 0x7f176c09f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:27.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176affd700 1 --2- 172.21.15.79:0/1115633380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17580045a0 0x7f1758004a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176b7fe700 1 --2- 172.21.15.79:0/1115633380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17580038c0 0x7f1758003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176bfff700 1 --2- 172.21.15.79:0/1115633380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f175804d7f0 0x7f175804fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176affd700 1 -- 172.21.15.79:0/1115633380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f175804d7f0 msgr2=0x7f175804fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:27.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176affd700 1 --2- 172.21.15.79:0/1115633380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f175804d7f0 0x7f175804fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176affd700 1 -- 172.21.15.79:0/1115633380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17580038c0 msgr2=0x7f1758003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:27.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176affd700 1 --2- 172.21.15.79:0/1115633380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17580038c0 0x7f1758003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.912 7f176affd700 1 -- 172.21.15.79:0/1115633380 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17580504f0 con 0x7f17580045a0 2021-04-09T18:34:27.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.916 7f176affd700 1 --2- 172.21.15.79:0/1115633380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17580045a0 0x7f1758004a30 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f175400c000 tx=0x7f175400e4b0).ready entity=mon.0 client_cookie=a4ec672725217ca2 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:27.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.916 7f176a7fc700 1 -- 172.21.15.79:0/1115633380 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f17580504f0 con 0x7f17580045a0 2021-04-09T18:34:27.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.916 7f176a7fc700 1 -- 172.21.15.79:0/1115633380 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175400ec50 con 0x7f17580045a0 2021-04-09T18:34:27.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.916 7f176a7fc700 1 -- 172.21.15.79:0/1115633380 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f175400f040 con 0x7f17580045a0 2021-04-09T18:34:27.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.916 7f1771eae700 1 -- 172.21.15.79:0/1115633380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17580045a0 msgr2=0x7f1758004a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:27.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.916 7f1771eae700 1 --2- 172.21.15.79:0/1115633380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17580045a0 0x7f1758004a30 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f175400c000 tx=0x7f175400e4b0).stop 2021-04-09T18:34:27.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.916 7f176bfff700 1 -- 172.21.15.79:0/1115633380 reap_dead start 2021-04-09T18:34:27.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.916 7f1771eae700 1 -- 172.21.15.79:0/1115633380 shutdown_connections 2021-04-09T18:34:27.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.916 7f1771eae700 1 -- 172.21.15.79:0/1115633380 >> 172.21.15.79:0/1115633380 conn(0x7f176c0e5fd0 msgr2=0x7f176c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:27.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.916 7f1771eae700 1 -- 172.21.15.79:0/1115633380 shutdown_connections 2021-04-09T18:34:27.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.916 7f1771eae700 1 -- 172.21.15.79:0/1115633380 wait complete. 2021-04-09T18:34:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.916 7f1771eae700 1 Processor -- start 2021-04-09T18:34:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f1771eae700 1 -- start start 2021-04-09T18:34:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f1771eae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f176c0a2f80 0x7f176c0d50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f1771eae700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f176c0d56f0 0x7f176c0c1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f1771eae700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f176c0c1bc0 0x7f176c0c2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f1771eae700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0bf930 con 0x7f176c0a2f80 2021-04-09T18:34:27.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f1771eae700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0a33d0 con 0x7f176c0c1bc0 2021-04-09T18:34:27.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f1771eae700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0bfc30 con 0x7f176c0d56f0 2021-04-09T18:34:27.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f176b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f176c0a2f80 0x7f176c0d50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f176b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f176c0a2f80 0x7f176c0d50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33900/0 (socket says 172.21.15.79:33900) 2021-04-09T18:34:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f176b7fe700 1 -- 172.21.15.79:0/27492099 learned_addr learned my addr 172.21.15.79:0/27492099 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f176affd700 1 --2- 172.21.15.79:0/27492099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f176c0d56f0 0x7f176c0c1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f176bfff700 1 --2- 172.21.15.79:0/27492099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f176c0c1bc0 0x7f176c0c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f176b7fe700 1 -- 172.21.15.79:0/27492099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f176c0d56f0 msgr2=0x7f176c0c1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:27.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f176b7fe700 1 --2- 172.21.15.79:0/27492099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f176c0d56f0 0x7f176c0c1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f176b7fe700 1 -- 172.21.15.79:0/27492099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f176c0c1bc0 msgr2=0x7f176c0c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:27.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f176b7fe700 1 --2- 172.21.15.79:0/27492099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f176c0c1bc0 0x7f176c0c2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:27.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f176b7fe700 1 -- 172.21.15.79:0/27492099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c099480 con 0x7f176c0a2f80 2021-04-09T18:34:27.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f176b7fe700 1 --2- 172.21.15.79:0/27492099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f176c0a2f80 0x7f176c0d50c0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f176c087760 tx=0x7f175c007410).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:27.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f1763fff700 1 -- 172.21.15.79:0/27492099 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f176c099480 con 0x7f176c0a2f80 2021-04-09T18:34:27.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f1763fff700 1 -- 172.21.15.79:0/27492099 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c00fbc0 con 0x7f176c0a2f80 2021-04-09T18:34:27.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f1763fff700 1 -- 172.21.15.79:0/27492099 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f175c010040 con 0x7f176c0a2f80 2021-04-09T18:34:27.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f1771eae700 1 -- 172.21.15.79:0/27492099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176c0a79d0 con 0x7f176c0a2f80 2021-04-09T18:34:27.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f1771eae700 1 -- 172.21.15.79:0/27492099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176c0bf0b0 con 0x7f176c0a2f80 2021-04-09T18:34:27.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.920 7f1763fff700 1 -- 172.21.15.79:0/27492099 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f175c012070 con 0x7f176c0a2f80 2021-04-09T18:34:27.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.924 7f1763fff700 1 --2- 172.21.15.79:0/27492099 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1750029100 0x7f175002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:27.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.924 7f1763fff700 1 -- 172.21.15.79:0/27492099 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f175c011040 con 0x7f176c0a2f80 2021-04-09T18:34:27.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.924 7f176affd700 1 --2- 172.21.15.79:0/27492099 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1750029100 0x7f175002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:27.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.924 7f176affd700 1 --2- 172.21.15.79:0/27492099 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1750029100 0x7f175002b650 crc :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:27.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.928 7f1771eae700 1 -- 172.21.15.79:0/27492099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176c0e39d0 con 0x7f176c0a2f80 2021-04-09T18:34:27.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:27.932 7f1763fff700 1 -- 172.21.15.79:0/27492099 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f175c000bf0 con 0x7f176c0a2f80 2021-04-09T18:34:28.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.096 7f1771eae700 1 -- 172.21.15.79:0/27492099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f176c0f5b10 con 0x7f176c0a2f80 2021-04-09T18:34:28.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.096 7f1763fff700 1 -- 172.21.15.79:0/27492099 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+1177 (secure 0 0 0) 0x7f175c00f7c0 con 0x7f176c0a2f80 2021-04-09T18:34:28.103 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:28.104 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":64,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7155,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/1349682878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1349682878},{"type":"v1","addr":"172.21.15.79:6833","nonce":1349682878}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":59},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1000197747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1000197747},{"type":"v1","addr":"172.21.15.89:6835","nonce":1000197747}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":64}],"filesystems":[]} 2021-04-09T18:34:28.104 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 64 2021-04-09T18:34:28.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.100 7f1771eae700 1 -- 172.21.15.79:0/27492099 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1750029100 msgr2=0x7f175002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:28.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.100 7f1771eae700 1 --2- 172.21.15.79:0/27492099 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1750029100 0x7f175002b650 crc :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.100 7f1771eae700 1 -- 172.21.15.79:0/27492099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f176c0a2f80 msgr2=0x7f176c0d50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:28.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.100 7f1771eae700 1 --2- 172.21.15.79:0/27492099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f176c0a2f80 0x7f176c0d50c0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f176c087760 tx=0x7f175c007410).stop 2021-04-09T18:34:28.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.100 7f1771eae700 1 -- 172.21.15.79:0/27492099 shutdown_connections 2021-04-09T18:34:28.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.100 7f1771eae700 1 --2- 172.21.15.79:0/27492099 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1750029100 0x7f175002b650 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.100 7f1771eae700 1 --2- 172.21.15.79:0/27492099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f176c0c1bc0 0x7f176c0c2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.100 7f1771eae700 1 --2- 172.21.15.79:0/27492099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f176c0a2f80 0x7f176c0d50c0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.100 7f1771eae700 1 --2- 172.21.15.79:0/27492099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f176c0d56f0 0x7f176c0c1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.100 7f1771eae700 1 -- 172.21.15.79:0/27492099 >> 172.21.15.79:0/27492099 conn(0x7f176c095ce0 msgr2=0x7f176c0d8470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:28.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.100 7f1771eae700 1 -- 172.21.15.79:0/27492099 shutdown_connections 2021-04-09T18:34:28.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.100 7f1771eae700 1 -- 172.21.15.79:0/27492099 wait complete. 2021-04-09T18:34:28.115 INFO:tasks.ceph.mds.a:Restarting daemon 2021-04-09T18:34:28.115 INFO:tasks.ceph.mds.a:Stopping old one... 2021-04-09T18:34:28.116 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-04-09T18:34:28.116 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:34:28.117 INFO:tasks.ceph.mds.b:Restarting daemon 2021-04-09T18:34:28.117 INFO:tasks.ceph.mds.b:Stopping old one... 2021-04-09T18:34:28.117 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-04-09T18:34:28.118 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:34:28.125 INFO:tasks.ceph.mds.a:Stopped 2021-04-09T18:34:28.125 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-04-09T18:34:28.133 INFO:tasks.ceph.mds.b:Stopped 2021-04-09T18:34:28.133 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-04-09T18:34:28.168 INFO:tasks.ceph.mds.a:Started 2021-04-09T18:34:28.169 DEBUG:teuthology.parallel:result is None 2021-04-09T18:34:28.176 INFO:tasks.ceph.mds.b:Started 2021-04-09T18:34:28.177 DEBUG:teuthology.parallel:result is None 2021-04-09T18:34:28.177 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-04-09T18:34:28.240 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2021-04-09T18:34:28.253 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2021-04-09T18:34:28.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.276 7f626be8e700 1 Processor -- start 2021-04-09T18:34:28.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.276 7f626be8e700 1 -- start start 2021-04-09T18:34:28.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.276 7f626be8e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f62640f5520 0x7f62640f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:28.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.276 7f626be8e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f62641c8010 0x7f62641ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:28.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.276 7f626be8e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62640fbb20 con 0x7f62640e9ae0 2021-04-09T18:34:28.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.276 7f626be8e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62640e9f30 con 0x7f62640f5520 2021-04-09T18:34:28.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.276 7f626be8e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62641c3dc0 con 0x7f62641c8010 2021-04-09T18:34:28.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.276 7f6269c32700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f62640f5520 0x7f62640f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:28.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.276 7f6269431700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f62640e9ae0 0x7f626409f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56864/0 (socket says 172.21.15.79:56864) 2021-04-09T18:34:28.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.276 7f6269431700 1 -- 172.21.15.79:0/879708970 learned_addr learned my addr 172.21.15.79:0/879708970 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:28.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.276 7f626a433700 1 --2- 172.21.15.79:0/879708970 >> v2:172.21.15.89:3300/0 conn(0x7f62641c8010 0x7f62641ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:28.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.276 7f6268c30700 1 -- 172.21.15.79:0/879708970 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176233084 0 0) 0x7f62580010d0 con 0x7f62640e9ae0 2021-04-09T18:34:28.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.276 7f6268c30700 1 -- 172.21.15.79:0/879708970 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6250003240 con 0x7f62640e9ae0 2021-04-09T18:34:28.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.280 7f6269c32700 1 -- 172.21.15.79:0/879708970 >> v2:172.21.15.89:3300/0 conn(0x7f62641c8010 msgr2=0x7f62641ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:28.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.280 7f6269c32700 1 --2- 172.21.15.79:0/879708970 >> v2:172.21.15.89:3300/0 conn(0x7f62641c8010 0x7f62641ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.280 7f6269c32700 1 -- 172.21.15.79:0/879708970 >> v1:172.21.15.79:6789/0 conn(0x7f62640e9ae0 legacy=0x7f626409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:28.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.280 7f6269c32700 1 -- 172.21.15.79:0/879708970 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626409f910 con 0x7f62640f5520 2021-04-09T18:34:28.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.280 7f6269c32700 1 --2- 172.21.15.79:0/879708970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62640f5520 0x7f62640f64b0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f6260002f30 tx=0x7f626000bd10).ready entity=mon.0 client_cookie=793811aabb416104 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:28.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.280 7f6268c30700 1 -- 172.21.15.79:0/879708970 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f626409f910 con 0x7f62640f5520 2021-04-09T18:34:28.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.280 7f6268c30700 1 -- 172.21.15.79:0/879708970 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62600098a0 con 0x7f62640f5520 2021-04-09T18:34:28.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.280 7f6268c30700 1 -- 172.21.15.79:0/879708970 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6260009c70 con 0x7f62640f5520 2021-04-09T18:34:28.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.280 7f626be8e700 1 -- 172.21.15.79:0/879708970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62640f5520 msgr2=0x7f62640f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:28.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.280 7f626be8e700 1 --2- 172.21.15.79:0/879708970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62640f5520 0x7f62640f64b0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f6260002f30 tx=0x7f626000bd10).stop 2021-04-09T18:34:28.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.280 7f626be8e700 1 -- 172.21.15.79:0/879708970 shutdown_connections 2021-04-09T18:34:28.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.280 7f626be8e700 1 --2- 172.21.15.79:0/879708970 >> v2:172.21.15.89:3300/0 conn(0x7f62641c8010 0x7f62641ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.280 7f626be8e700 1 --2- 172.21.15.79:0/879708970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62640f5520 0x7f62640f64b0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.280 7f626be8e700 1 -- 172.21.15.79:0/879708970 >> 172.21.15.79:0/879708970 conn(0x7f62640e5fe0 msgr2=0x7f62640e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:28.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.280 7f626be8e700 1 -- 172.21.15.79:0/879708970 shutdown_connections 2021-04-09T18:34:28.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.280 7f626be8e700 1 -- 172.21.15.79:0/879708970 wait complete. 2021-04-09T18:34:28.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f626be8e700 1 Processor -- start 2021-04-09T18:34:28.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f626be8e700 1 -- start start 2021-04-09T18:34:28.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f626be8e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62640d1ad0 0x7f6264090ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:28.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f626be8e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62640d8180 0x7f62640d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:28.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f626be8e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62640d85d0 0x7f6264094e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:28.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f626be8e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62640d1f20 con 0x7f62640d8180 2021-04-09T18:34:28.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f626be8e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62640b9ef0 con 0x7f62640d1ad0 2021-04-09T18:34:28.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f626be8e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62640d14c0 con 0x7f62640d85d0 2021-04-09T18:34:28.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f6269431700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62640d8180 0x7f62640d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:28.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f6269431700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62640d8180 0x7f62640d0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33928/0 (socket says 172.21.15.79:33928) 2021-04-09T18:34:28.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f6269431700 1 -- 172.21.15.79:0/437013311 learned_addr learned my addr 172.21.15.79:0/437013311 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:28.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f6269c32700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62640d1ad0 0x7f6264090ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:28.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f626a433700 1 --2- 172.21.15.79:0/437013311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62640d85d0 0x7f6264094e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:28.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f6269431700 1 -- 172.21.15.79:0/437013311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62640d85d0 msgr2=0x7f6264094e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:28.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f6269431700 1 --2- 172.21.15.79:0/437013311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62640d85d0 0x7f6264094e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f6269431700 1 -- 172.21.15.79:0/437013311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62640d1ad0 msgr2=0x7f6264090ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:28.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f6269431700 1 --2- 172.21.15.79:0/437013311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62640d1ad0 0x7f6264090ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f6269431700 1 -- 172.21.15.79:0/437013311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62640d16f0 con 0x7f62640d8180 2021-04-09T18:34:28.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f6269c32700 1 --2- 172.21.15.79:0/437013311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62640d1ad0 0x7f6264090ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:28.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f6269431700 1 --2- 172.21.15.79:0/437013311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62640d8180 0x7f62640d0e90 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f6264094b10 tx=0x7f625800cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:28.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f62567fc700 1 -- 172.21.15.79:0/437013311 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6258007320 con 0x7f62640d8180 2021-04-09T18:34:28.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f62567fc700 1 -- 172.21.15.79:0/437013311 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62580055f0 con 0x7f62640d8180 2021-04-09T18:34:28.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f626be8e700 1 -- 172.21.15.79:0/437013311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6264095480 con 0x7f62640d8180 2021-04-09T18:34:28.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f62567fc700 1 -- 172.21.15.79:0/437013311 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f62580059c0 con 0x7f62640d8180 2021-04-09T18:34:28.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.284 7f626be8e700 1 -- 172.21.15.79:0/437013311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6264091600 con 0x7f62640d8180 2021-04-09T18:34:28.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.288 7f62567fc700 1 -- 172.21.15.79:0/437013311 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f625801a060 con 0x7f62640d8180 2021-04-09T18:34:28.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.288 7f62567fc700 1 --2- 172.21.15.79:0/437013311 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f624c029100 0x7f624c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:28.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.288 7f62567fc700 1 -- 172.21.15.79:0/437013311 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f6258038e40 con 0x7f62640d8180 2021-04-09T18:34:28.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.288 7f6269c32700 1 --2- 172.21.15.79:0/437013311 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f624c029100 0x7f624c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:28.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.288 7f6269c32700 1 --2- 172.21.15.79:0/437013311 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f624c029100 0x7f624c02b650 crc :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:28.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.292 7f626be8e700 1 -- 172.21.15.79:0/437013311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62640e39e0 con 0x7f62640d8180 2021-04-09T18:34:28.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.296 7f62567fc700 1 -- 172.21.15.79:0/437013311 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6258007110 con 0x7f62640d8180 2021-04-09T18:34:28.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.472 7f626be8e700 1 -- 172.21.15.79:0/437013311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f62640a1cc0 con 0x7f62640d8180 2021-04-09T18:34:28.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.488 7f62567fc700 1 -- 172.21.15.79:0/437013311 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v102) v1 ==== 97+0+0 (secure 0 0 0) 0x7f62640e5ca0 con 0x7f62640d8180 2021-04-09T18:34:28.510 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blacklist entries 2021-04-09T18:34:28.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.508 7f626be8e700 1 -- 172.21.15.79:0/437013311 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f624c029100 msgr2=0x7f624c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:28.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.508 7f626be8e700 1 --2- 172.21.15.79:0/437013311 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f624c029100 0x7f624c02b650 crc :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.508 7f626be8e700 1 -- 172.21.15.79:0/437013311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62640d8180 msgr2=0x7f62640d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:28.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.508 7f626be8e700 1 --2- 172.21.15.79:0/437013311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62640d8180 0x7f62640d0e90 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f6264094b10 tx=0x7f625800cab0).stop 2021-04-09T18:34:28.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.508 7f626be8e700 1 -- 172.21.15.79:0/437013311 shutdown_connections 2021-04-09T18:34:28.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.508 7f626be8e700 1 --2- 172.21.15.79:0/437013311 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f624c029100 0x7f624c02b650 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.508 7f626be8e700 1 --2- 172.21.15.79:0/437013311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62640d1ad0 0x7f6264090ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.508 7f626be8e700 1 --2- 172.21.15.79:0/437013311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62640d85d0 0x7f6264094e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.508 7f626be8e700 1 --2- 172.21.15.79:0/437013311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62640d8180 0x7f62640d0e90 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.508 7f626be8e700 1 -- 172.21.15.79:0/437013311 >> 172.21.15.79:0/437013311 conn(0x7f626409b270 msgr2=0x7f62640bcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:28.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.508 7f626be8e700 1 -- 172.21.15.79:0/437013311 shutdown_connections 2021-04-09T18:34:28.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.508 7f626be8e700 1 -- 172.21.15.79:0/437013311 wait complete. 2021-04-09T18:34:28.528 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-04-09T18:34:28.528 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-04-09T18:34:28.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.620 7fda40eb7700 1 Processor -- start 2021-04-09T18:34:28.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.620 7fda40eb7700 1 -- start start 2021-04-09T18:34:28.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.620 7fda40eb7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fda3c0f5520 0x7fda3c0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:28.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.620 7fda40eb7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fda3c1c8010 0x7fda3c1ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:28.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.620 7fda40eb7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda3c0fbb20 con 0x7fda3c0e9ae0 2021-04-09T18:34:28.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.620 7fda40eb7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda3c0e9f30 con 0x7fda3c1c8010 2021-04-09T18:34:28.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.620 7fda40eb7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda3c1c3dc0 con 0x7fda3c0f5520 2021-04-09T18:34:28.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.620 7fda3a2ee700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fda3c0e9ae0 0x7fda3c09f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56878/0 (socket says 172.21.15.79:56878) 2021-04-09T18:34:28.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.620 7fda3a2ee700 1 -- 172.21.15.79:0/3388977014 learned_addr learned my addr 172.21.15.79:0/3388977014 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:28.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.620 7fda3b2f0700 1 --2- 172.21.15.79:0/3388977014 >> v2:172.21.15.79:3300/0 conn(0x7fda3c1c8010 0x7fda3c1ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:28.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.620 7fda3aaef700 1 --2- 172.21.15.79:0/3388977014 >> v2:172.21.15.89:3300/0 conn(0x7fda3c0f5520 0x7fda3c0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:28.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.620 7fda39aed700 1 -- 172.21.15.79:0/3388977014 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1528436776 0 0) 0x7fda240010d0 con 0x7fda3c0e9ae0 2021-04-09T18:34:28.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.620 7fda39aed700 1 -- 172.21.15.79:0/3388977014 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda28003240 con 0x7fda3c0e9ae0 2021-04-09T18:34:28.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.624 7fda3b2f0700 1 -- 172.21.15.79:0/3388977014 >> v2:172.21.15.89:3300/0 conn(0x7fda3c0f5520 msgr2=0x7fda3c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:28.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.624 7fda3b2f0700 1 --2- 172.21.15.79:0/3388977014 >> v2:172.21.15.89:3300/0 conn(0x7fda3c0f5520 0x7fda3c0f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.624 7fda3b2f0700 1 -- 172.21.15.79:0/3388977014 >> v1:172.21.15.79:6789/0 conn(0x7fda3c0e9ae0 legacy=0x7fda3c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:28.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.624 7fda3b2f0700 1 -- 172.21.15.79:0/3388977014 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3c09f910 con 0x7fda3c1c8010 2021-04-09T18:34:28.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.624 7fda3b2f0700 1 --2- 172.21.15.79:0/3388977014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda3c1c8010 0x7fda3c1ca470 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7fda34002f30 tx=0x7fda3400bd10).ready entity=mon.0 client_cookie=78683c6225099fba server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:28.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.624 7fda39aed700 1 -- 172.21.15.79:0/3388977014 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fda3c09f910 con 0x7fda3c1c8010 2021-04-09T18:34:28.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.624 7fda39aed700 1 -- 172.21.15.79:0/3388977014 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda340098a0 con 0x7fda3c1c8010 2021-04-09T18:34:28.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.624 7fda39aed700 1 -- 172.21.15.79:0/3388977014 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fda34009c70 con 0x7fda3c1c8010 2021-04-09T18:34:28.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.624 7fda40eb7700 1 -- 172.21.15.79:0/3388977014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda3c1c8010 msgr2=0x7fda3c1ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:28.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.624 7fda40eb7700 1 --2- 172.21.15.79:0/3388977014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda3c1c8010 0x7fda3c1ca470 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7fda34002f30 tx=0x7fda3400bd10).stop 2021-04-09T18:34:28.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.624 7fda40eb7700 1 -- 172.21.15.79:0/3388977014 shutdown_connections 2021-04-09T18:34:28.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.624 7fda40eb7700 1 --2- 172.21.15.79:0/3388977014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda3c1c8010 0x7fda3c1ca470 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.624 7fda40eb7700 1 --2- 172.21.15.79:0/3388977014 >> v2:172.21.15.89:3300/0 conn(0x7fda3c0f5520 0x7fda3c0f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.624 7fda40eb7700 1 -- 172.21.15.79:0/3388977014 >> 172.21.15.79:0/3388977014 conn(0x7fda3c0e5fe0 msgr2=0x7fda3c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:28.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.624 7fda40eb7700 1 -- 172.21.15.79:0/3388977014 shutdown_connections 2021-04-09T18:34:28.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.624 7fda40eb7700 1 -- 172.21.15.79:0/3388977014 wait complete. 2021-04-09T18:34:28.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda40eb7700 1 Processor -- start 2021-04-09T18:34:28.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda40eb7700 1 -- start start 2021-04-09T18:34:28.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda40eb7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda3c1a8480 0x7fda3c0945b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:28.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda40eb7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda3c0d4d80 0x7fda3c0911a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:28.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda40eb7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda3c0d0a70 0x7fda3c0d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:28.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda40eb7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c08f900 con 0x7fda3c0d4d80 2021-04-09T18:34:28.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda40eb7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c08fc00 con 0x7fda3c1a8480 2021-04-09T18:34:28.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda40eb7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c0954a0 con 0x7fda3c0d0a70 2021-04-09T18:34:28.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda3a2ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda3c0d4d80 0x7fda3c0911a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:28.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda3a2ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda3c0d4d80 0x7fda3c0911a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33942/0 (socket says 172.21.15.79:33942) 2021-04-09T18:34:28.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda3a2ee700 1 -- 172.21.15.79:0/40755839 learned_addr learned my addr 172.21.15.79:0/40755839 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:28.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda3aaef700 1 --2- 172.21.15.79:0/40755839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda3c1a8480 0x7fda3c0945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:28.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda3b2f0700 1 --2- 172.21.15.79:0/40755839 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda3c0d0a70 0x7fda3c0d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:28.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda3a2ee700 1 -- 172.21.15.79:0/40755839 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda3c0d0a70 msgr2=0x7fda3c0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:28.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda3a2ee700 1 --2- 172.21.15.79:0/40755839 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda3c0d0a70 0x7fda3c0d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda3a2ee700 1 -- 172.21.15.79:0/40755839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda3c1a8480 msgr2=0x7fda3c0945b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:28.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda3a2ee700 1 --2- 172.21.15.79:0/40755839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda3c1a8480 0x7fda3c0945b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda3a2ee700 1 -- 172.21.15.79:0/40755839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3c094be0 con 0x7fda3c0d4d80 2021-04-09T18:34:28.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda3a2ee700 1 --2- 172.21.15.79:0/40755839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda3c0d4d80 0x7fda3c0911a0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7fda3c0d3b20 tx=0x7fda2400cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:28.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda337fe700 1 -- 172.21.15.79:0/40755839 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fda3c094be0 con 0x7fda3c0d4d80 2021-04-09T18:34:28.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda337fe700 1 -- 172.21.15.79:0/40755839 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda24007320 con 0x7fda3c0d4d80 2021-04-09T18:34:28.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda40eb7700 1 -- 172.21.15.79:0/40755839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda3c094f30 con 0x7fda3c0d4d80 2021-04-09T18:34:28.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.628 7fda337fe700 1 -- 172.21.15.79:0/40755839 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fda240057e0 con 0x7fda3c0d4d80 2021-04-09T18:34:28.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.632 7fda40eb7700 1 -- 172.21.15.79:0/40755839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda3c091960 con 0x7fda3c0d4d80 2021-04-09T18:34:28.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.632 7fda337fe700 1 -- 172.21.15.79:0/40755839 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fda2401a060 con 0x7fda3c0d4d80 2021-04-09T18:34:28.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.632 7fda337fe700 1 --2- 172.21.15.79:0/40755839 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fda20029100 0x7fda2002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:28.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.632 7fda337fe700 1 -- 172.21.15.79:0/40755839 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fda24038aa0 con 0x7fda3c0d4d80 2021-04-09T18:34:28.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.632 7fda3aaef700 1 --2- 172.21.15.79:0/40755839 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fda20029100 0x7fda2002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:28.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.632 7fda3aaef700 1 --2- 172.21.15.79:0/40755839 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fda20029100 0x7fda2002b650 crc :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:28.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.636 7fda40eb7700 1 -- 172.21.15.79:0/40755839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda3c0e39e0 con 0x7fda3c0d4d80 2021-04-09T18:34:28.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.644 7fda337fe700 1 -- 172.21.15.79:0/40755839 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fda3c0e5ca0 con 0x7fda3c0d4d80 2021-04-09T18:34:28.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.812 7fda40eb7700 1 -- 172.21.15.79:0/40755839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fda3c0f5b20 con 0x7fda3c0d4d80 2021-04-09T18:34:28.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.812 7fda337fe700 1 -- 172.21.15.79:0/40755839 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v32) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fda24007110 con 0x7fda3c0d4d80 2021-04-09T18:34:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:28.818 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:34:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2021-04-09T18:34:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2021-04-09T18:34:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgovEoMhAAbDfArG3lSFAdk80rS/4iEQ==", 2021-04-09T18:34:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:34:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2021-04-09T18:34:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgN4sfOBAAPjvDX11uLM+vgdFpdP49Kw==", 2021-04-09T18:34:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:34:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2021-04-09T18:34:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQALnHBgro0COxAAgbe5jxAZH9bD7zDLbtdkhQ==", 2021-04-09T18:34:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2021-04-09T18:34:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAPnHBghZ/oARAAhkN+fnZJiskmHnvvs+G8NA==", 2021-04-09T18:34:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2021-04-09T18:34:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQASnHBgWT2FBxAACrSTbwbF18k9aPeYNohelw==", 2021-04-09T18:34:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2021-04-09T18:34:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAVnHBgPHy6CxAAFq+yki4AZe5ybodgTO/4/Q==", 2021-04-09T18:34:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2021-04-09T18:34:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAanHBgfbs4NhAAQzxM9dDML4RgQP8yamkuVw==", 2021-04-09T18:34:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2021-04-09T18:34:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAdnHBgi0WLOhAA4OBguOCjtmzqulUjTJ+GhQ==", 2021-04-09T18:34:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2021-04-09T18:34:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAhnHBgCs+PAxAAOm0wSMe/1Bu9vfTrpmrLkg==", 2021-04-09T18:34:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2021-04-09T18:34:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAknHBgH1S3CBAAUcdUIW7O6wH482l1yZBKBw==", 2021-04-09T18:34:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2021-04-09T18:34:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgxEq9BxAAap2nrjhcrf2aHzygtMclVw==", 2021-04-09T18:34:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:34:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:34:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:34:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2021-04-09T18:34:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBguJFeDRAAWL4NV4tsYRAqcwJ26kjm2Q==", 2021-04-09T18:34:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:34:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:34:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:34:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2021-04-09T18:34:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgN9X5EhAA3DBPdlRHVBHXJNH9nRFW0A==", 2021-04-09T18:34:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:34:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:34:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:34:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2021-04-09T18:34:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgHOSVDBAAMMqd8paqBSTQRgR7n4EXGQ==", 2021-04-09T18:34:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:34:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:34:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:34:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2021-04-09T18:34:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgmHJhLxAAyhBrx08J7ZFKu34MYC2Wyg==", 2021-04-09T18:34:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:34:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:34:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2021-04-09T18:34:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgNCCXKhAA/bKOzzjVHldj6RpMGu0c8g==", 2021-04-09T18:34:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:34:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:34:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:34:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:34:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:28.851 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:34:28.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.816 7fda40eb7700 1 -- 172.21.15.79:0/40755839 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fda20029100 msgr2=0x7fda2002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:28.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.816 7fda40eb7700 1 --2- 172.21.15.79:0/40755839 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fda20029100 0x7fda2002b650 crc :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.816 7fda40eb7700 1 -- 172.21.15.79:0/40755839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda3c0d4d80 msgr2=0x7fda3c0911a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:28.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.816 7fda40eb7700 1 --2- 172.21.15.79:0/40755839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda3c0d4d80 0x7fda3c0911a0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7fda3c0d3b20 tx=0x7fda2400cab0).stop 2021-04-09T18:34:28.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.816 7fda40eb7700 1 -- 172.21.15.79:0/40755839 shutdown_connections 2021-04-09T18:34:28.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.816 7fda40eb7700 1 --2- 172.21.15.79:0/40755839 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fda20029100 0x7fda2002b650 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.816 7fda40eb7700 1 --2- 172.21.15.79:0/40755839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda3c1a8480 0x7fda3c0945b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.816 7fda40eb7700 1 --2- 172.21.15.79:0/40755839 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda3c0d0a70 0x7fda3c0d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.816 7fda40eb7700 1 --2- 172.21.15.79:0/40755839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda3c0d4d80 0x7fda3c0911a0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.816 7fda40eb7700 1 -- 172.21.15.79:0/40755839 >> 172.21.15.79:0/40755839 conn(0x7fda3c0933f0 msgr2=0x7fda3c0d8820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:28.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.816 7fda40eb7700 1 -- 172.21.15.79:0/40755839 shutdown_connections 2021-04-09T18:34:28.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.816 7fda40eb7700 1 -- 172.21.15.79:0/40755839 wait complete. 2021-04-09T18:34:28.856 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:34:28.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.947 7f2458c7c700 1 Processor -- start 2021-04-09T18:34:28.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.947 7f2458c7c700 1 -- start start 2021-04-09T18:34:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f2458c7c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f24540e9ad0 0x7f245409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f2458c7c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24540fbb10 con 0x7f24540f5510 2021-04-09T18:34:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f2458c7c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24540e56c0 con 0x7f24541c8000 2021-04-09T18:34:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f2458c7c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24541c3db0 con 0x7f24540e9ad0 2021-04-09T18:34:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f2451fe5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f24540e9ad0 0x7f245409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f24527e6700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f24540f5510 0x7f24540f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56894/0 (socket says 172.21.15.79:56894) 2021-04-09T18:34:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f24527e6700 1 -- 172.21.15.79:0/649534981 learned_addr learned my addr 172.21.15.79:0/649534981 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f2451fe5700 1 -- 172.21.15.79:0/649534981 >> v1:172.21.15.89:6789/0 conn(0x7f24541c8000 legacy=0x7f24541ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f2451fe5700 1 -- 172.21.15.79:0/649534981 >> v1:172.21.15.79:6789/0 conn(0x7f24540f5510 legacy=0x7f24540f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f2451fe5700 1 -- 172.21.15.79:0/649534981 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24540e4320 con 0x7f24540e9ad0 2021-04-09T18:34:28.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f2451fe5700 1 --2- 172.21.15.79:0/649534981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24540e9ad0 0x7f245409f100 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f2444002f30 tx=0x7f244400bcc0).ready entity=mon.0 client_cookie=1b226b63f4e79464 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:28.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f24517e4700 1 -- 172.21.15.79:0/649534981 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f24540e4320 con 0x7f24540e9ad0 2021-04-09T18:34:28.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f24517e4700 1 -- 172.21.15.79:0/649534981 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2444009800 con 0x7f24540e9ad0 2021-04-09T18:34:28.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f24517e4700 1 -- 172.21.15.79:0/649534981 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2444009c10 con 0x7f24540e9ad0 2021-04-09T18:34:28.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f2458c7c700 1 -- 172.21.15.79:0/649534981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24540e9ad0 msgr2=0x7f245409f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:28.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f2458c7c700 1 --2- 172.21.15.79:0/649534981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24540e9ad0 0x7f245409f100 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f2444002f30 tx=0x7f244400bcc0).stop 2021-04-09T18:34:28.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f2458c7c700 1 -- 172.21.15.79:0/649534981 shutdown_connections 2021-04-09T18:34:28.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f2458c7c700 1 --2- 172.21.15.79:0/649534981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24540e9ad0 0x7f245409f100 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f2458c7c700 1 -- 172.21.15.79:0/649534981 >> 172.21.15.79:0/649534981 conn(0x7f24540e5fd0 msgr2=0x7f24540e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:28.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f2458c7c700 1 -- 172.21.15.79:0/649534981 shutdown_connections 2021-04-09T18:34:28.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.951 7f2458c7c700 1 -- 172.21.15.79:0/649534981 wait complete. 2021-04-09T18:34:28.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.955 7f2458c7c700 1 Processor -- start 2021-04-09T18:34:28.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.955 7f2458c7c700 1 -- start start 2021-04-09T18:34:28.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.955 7f2458c7c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24540bcc80 0x7f24540d3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:28.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.955 7f2458c7c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24540bd0d0 0x7f245409a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:28.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.955 7f2458c7c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f245409aef0 0x7f24541d9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:28.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.955 7f2458c7c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24540e9f20 con 0x7f24540bcc80 2021-04-09T18:34:28.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.955 7f2458c7c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24540a4530 con 0x7f245409aef0 2021-04-09T18:34:28.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.955 7f2458c7c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2454099340 con 0x7f24540bd0d0 2021-04-09T18:34:28.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.955 7f24527e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24540bcc80 0x7f24540d3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:28.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.955 7f24527e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24540bcc80 0x7f24540d3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33954/0 (socket says 172.21.15.79:33954) 2021-04-09T18:34:28.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.955 7f24527e6700 1 -- 172.21.15.79:0/2708771360 learned_addr learned my addr 172.21.15.79:0/2708771360 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:28.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.955 7f2451fe5700 1 --2- 172.21.15.79:0/2708771360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24540bd0d0 0x7f245409a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:28.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.955 7f2452fe7700 1 --2- 172.21.15.79:0/2708771360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f245409aef0 0x7f24541d9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:28.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.955 7f24527e6700 1 -- 172.21.15.79:0/2708771360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24540bd0d0 msgr2=0x7f245409a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:28.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.955 7f24527e6700 1 --2- 172.21.15.79:0/2708771360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24540bd0d0 0x7f245409a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.955 7f24527e6700 1 -- 172.21.15.79:0/2708771360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f245409aef0 msgr2=0x7f24541d9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:28.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.955 7f24527e6700 1 --2- 172.21.15.79:0/2708771360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f245409aef0 0x7f24541d9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:28.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.955 7f24527e6700 1 -- 172.21.15.79:0/2708771360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24540a40e0 con 0x7f24540bcc80 2021-04-09T18:34:28.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.955 7f2452fe7700 1 --2- 172.21.15.79:0/2708771360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f245409aef0 0x7f24541d9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:28.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.959 7f24527e6700 1 --2- 172.21.15.79:0/2708771360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24540bcc80 0x7f24540d3b70 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f24540d4660 tx=0x7f244c00cec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:28.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.959 7f244affd700 1 -- 172.21.15.79:0/2708771360 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f24540a40e0 con 0x7f24540bcc80 2021-04-09T18:34:28.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.959 7f244affd700 1 -- 172.21.15.79:0/2708771360 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c005b80 con 0x7f24540bcc80 2021-04-09T18:34:28.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.959 7f244affd700 1 -- 172.21.15.79:0/2708771360 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f244c007110 con 0x7f24540bcc80 2021-04-09T18:34:28.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.959 7f2458c7c700 1 -- 172.21.15.79:0/2708771360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24540c6650 con 0x7f24540bcc80 2021-04-09T18:34:28.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.959 7f2458c7c700 1 -- 172.21.15.79:0/2708771360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245409b4d0 con 0x7f24540bcc80 2021-04-09T18:34:28.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.959 7f244affd700 1 -- 172.21.15.79:0/2708771360 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f244c01a020 con 0x7f24540bcc80 2021-04-09T18:34:28.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.959 7f244affd700 1 --2- 172.21.15.79:0/2708771360 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f242c029100 0x7f242c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:28.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.959 7f244affd700 1 -- 172.21.15.79:0/2708771360 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f244c039240 con 0x7f24540bcc80 2021-04-09T18:34:28.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.959 7f2451fe5700 1 --2- 172.21.15.79:0/2708771360 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f242c029100 0x7f242c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:28.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.959 7f2451fe5700 1 --2- 172.21.15.79:0/2708771360 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f242c029100 0x7f242c02b650 crc :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:28.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.963 7f2458c7c700 1 -- 172.21.15.79:0/2708771360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24540e39d0 con 0x7f24540bcc80 2021-04-09T18:34:28.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:28.971 7f244affd700 1 -- 172.21.15.79:0/2708771360 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f244c005970 con 0x7f24540bcc80 2021-04-09T18:34:29.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.131 7f2458c7c700 1 -- 172.21.15.79:0/2708771360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24540a1cb0 con 0x7f24540bcc80 2021-04-09T18:34:29.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.135 7f244affd700 1 -- 172.21.15.79:0/2708771360 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+11379 (secure 0 0 0) 0x7f2454107f40 con 0x7f24540bcc80 2021-04-09T18:34:29.141 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:29.142 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":102,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:34:28.486542","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:34:29.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.139 7f2458c7c700 1 -- 172.21.15.79:0/2708771360 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f242c029100 msgr2=0x7f242c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:29.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.139 7f2458c7c700 1 --2- 172.21.15.79:0/2708771360 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f242c029100 0x7f242c02b650 crc :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.139 7f2458c7c700 1 -- 172.21.15.79:0/2708771360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24540bcc80 msgr2=0x7f24540d3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:29.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.139 7f2458c7c700 1 --2- 172.21.15.79:0/2708771360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24540bcc80 0x7f24540d3b70 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f24540d4660 tx=0x7f244c00cec0).stop 2021-04-09T18:34:29.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.139 7f2458c7c700 1 -- 172.21.15.79:0/2708771360 shutdown_connections 2021-04-09T18:34:29.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.139 7f2458c7c700 1 --2- 172.21.15.79:0/2708771360 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f242c029100 0x7f242c02b650 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.139 7f2458c7c700 1 --2- 172.21.15.79:0/2708771360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f245409aef0 0x7f24541d9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.139 7f2458c7c700 1 --2- 172.21.15.79:0/2708771360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24540bcc80 0x7f24540d3b70 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.139 7f2458c7c700 1 --2- 172.21.15.79:0/2708771360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24540bd0d0 0x7f245409a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.139 7f2458c7c700 1 -- 172.21.15.79:0/2708771360 >> 172.21.15.79:0/2708771360 conn(0x7f2454097840 msgr2=0x7f24541c6090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:29.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.139 7f2458c7c700 1 -- 172.21.15.79:0/2708771360 shutdown_connections 2021-04-09T18:34:29.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.139 7f2458c7c700 1 -- 172.21.15.79:0/2708771360 wait complete. 2021-04-09T18:34:29.155 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-04-09T18:34:29.155 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:34:29.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.255 7f83d0210700 1 Processor -- start 2021-04-09T18:34:29.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.255 7f83d0210700 1 -- start start 2021-04-09T18:34:29.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.255 7f83d0210700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c80f5550 0x7f83c80f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:29.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.255 7f83d0210700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c80fbb50 con 0x7f83c80e9b10 2021-04-09T18:34:29.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.255 7f83d0210700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c809f910 con 0x7f83c81c8040 2021-04-09T18:34:29.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.255 7f83d0210700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c80e9f60 con 0x7f83c80f5550 2021-04-09T18:34:29.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.255 7f83cd7b3700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f83c80e9b10 0x7f83c809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56908/0 (socket says 172.21.15.79:56908) 2021-04-09T18:34:29.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.255 7f83cd7b3700 1 -- 172.21.15.79:0/288620041 learned_addr learned my addr 172.21.15.79:0/288620041 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:29.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.255 7f83cdfb4700 1 --2- 172.21.15.79:0/288620041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c80f5550 0x7f83c80f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:29.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.259 7f83ccfb2700 1 -- 172.21.15.79:0/288620041 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326919358 0 0) 0x7f83b80010d0 con 0x7f83c80e9b10 2021-04-09T18:34:29.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.259 7f83ccfb2700 1 -- 172.21.15.79:0/288620041 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83b4003240 con 0x7f83c80e9b10 2021-04-09T18:34:29.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.259 7f83ccfb2700 1 -- 172.21.15.79:0/288620041 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987958558 0 0) 0x7f83c0001450 con 0x7f83c81c8040 2021-04-09T18:34:29.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.259 7f83ccfb2700 1 -- 172.21.15.79:0/288620041 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83b4003620 con 0x7f83c81c8040 2021-04-09T18:34:29.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.259 7f83ccfb2700 1 -- 172.21.15.79:0/288620041 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1836797176 0 0) 0x7f83b8001650 con 0x7f83c80e9b10 2021-04-09T18:34:29.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.259 7f83cdfb4700 1 -- 172.21.15.79:0/288620041 >> v1:172.21.15.89:6789/0 conn(0x7f83c81c8040 legacy=0x7f83c81ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:29.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.259 7f83cdfb4700 1 -- 172.21.15.79:0/288620041 >> v1:172.21.15.79:6789/0 conn(0x7f83c80e9b10 legacy=0x7f83c809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:29.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.259 7f83cdfb4700 1 -- 172.21.15.79:0/288620041 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c80e5700 con 0x7f83c80f5550 2021-04-09T18:34:29.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.259 7f83cdfb4700 1 --2- 172.21.15.79:0/288620041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c80f5550 0x7f83c80f64e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f83b8001980 tx=0x7f83c400bcf0).ready entity=mon.2 client_cookie=c73becd54189e54 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:29.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.259 7f83ccfb2700 1 -- 172.21.15.79:0/288620041 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83c80e5700 con 0x7f83c80f5550 2021-04-09T18:34:29.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.259 7f83ccfb2700 1 -- 172.21.15.79:0/288620041 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c4009790 con 0x7f83c80f5550 2021-04-09T18:34:29.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.259 7f83ccfb2700 1 -- 172.21.15.79:0/288620041 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83b8001bb0 con 0x7f83c80f5550 2021-04-09T18:34:29.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.259 7f83d0210700 1 -- 172.21.15.79:0/288620041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c80f5550 msgr2=0x7f83c80f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:29.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.259 7f83d0210700 1 --2- 172.21.15.79:0/288620041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c80f5550 0x7f83c80f64e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f83b8001980 tx=0x7f83c400bcf0).stop 2021-04-09T18:34:29.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.259 7f83d0210700 1 -- 172.21.15.79:0/288620041 shutdown_connections 2021-04-09T18:34:29.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.259 7f83d0210700 1 --2- 172.21.15.79:0/288620041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c80f5550 0x7f83c80f64e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.259 7f83d0210700 1 -- 172.21.15.79:0/288620041 >> 172.21.15.79:0/288620041 conn(0x7f83c80e6010 msgr2=0x7f83c80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:29.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.259 7f83d0210700 1 -- 172.21.15.79:0/288620041 shutdown_connections 2021-04-09T18:34:29.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.259 7f83d0210700 1 -- 172.21.15.79:0/288620041 wait complete. 2021-04-09T18:34:29.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.263 7f83d0210700 1 Processor -- start 2021-04-09T18:34:29.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.263 7f83d0210700 1 -- start start 2021-04-09T18:34:29.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.263 7f83d0210700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c80d5190 0x7f83c80d55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:29.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.263 7f83d0210700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c81aafc0 0x7f83c81ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:29.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.263 7f83d0210700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c80d6030 0x7f83c80d6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:29.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.263 7f83d0210700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c81c3df0 con 0x7f83c81aafc0 2021-04-09T18:34:29.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.263 7f83d0210700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c819be60 con 0x7f83c80d6030 2021-04-09T18:34:29.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.263 7f83d0210700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c819c160 con 0x7f83c80d5190 2021-04-09T18:34:29.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.263 7f83cd7b3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c81aafc0 0x7f83c81ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:29.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.263 7f83cd7b3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c81aafc0 0x7f83c81ab410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33968/0 (socket says 172.21.15.79:33968) 2021-04-09T18:34:29.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.263 7f83cd7b3700 1 -- 172.21.15.79:0/3254931256 learned_addr learned my addr 172.21.15.79:0/3254931256 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:29.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.263 7f83cdfb4700 1 --2- 172.21.15.79:0/3254931256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c80d5190 0x7f83c80d55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:29.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.263 7f83ce7b5700 1 --2- 172.21.15.79:0/3254931256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c80d6030 0x7f83c80d6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:29.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.263 7f83cd7b3700 1 -- 172.21.15.79:0/3254931256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c80d5190 msgr2=0x7f83c80d55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:29.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.263 7f83cd7b3700 1 --2- 172.21.15.79:0/3254931256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c80d5190 0x7f83c80d55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.263 7f83cd7b3700 1 -- 172.21.15.79:0/3254931256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c80d6030 msgr2=0x7f83c80d6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:29.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.263 7f83cd7b3700 1 --2- 172.21.15.79:0/3254931256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c80d6030 0x7f83c80d6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.263 7f83cd7b3700 1 -- 172.21.15.79:0/3254931256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c80995f0 con 0x7f83c81aafc0 2021-04-09T18:34:29.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.267 7f83cd7b3700 1 --2- 172.21.15.79:0/3254931256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c81aafc0 0x7f83c81ab410 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f83b8001320 tx=0x7f83b800cb50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:29.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.267 7f83be7fc700 1 -- 172.21.15.79:0/3254931256 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83c80995f0 con 0x7f83c81aafc0 2021-04-09T18:34:29.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.267 7f83be7fc700 1 -- 172.21.15.79:0/3254931256 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b80047e0 con 0x7f83c81aafc0 2021-04-09T18:34:29.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.267 7f83d0210700 1 -- 172.21.15.79:0/3254931256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c819d9d0 con 0x7f83c81aafc0 2021-04-09T18:34:29.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.267 7f83be7fc700 1 -- 172.21.15.79:0/3254931256 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83b8017020 con 0x7f83c81aafc0 2021-04-09T18:34:29.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.267 7f83d0210700 1 -- 172.21.15.79:0/3254931256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c80d6c40 con 0x7f83c81aafc0 2021-04-09T18:34:29.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.267 7f83be7fc700 1 -- 172.21.15.79:0/3254931256 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f83b8004bb0 con 0x7f83c81aafc0 2021-04-09T18:34:29.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.267 7f83be7fc700 1 --2- 172.21.15.79:0/3254931256 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f83b0029100 0x7f83b002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:29.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.267 7f83be7fc700 1 -- 172.21.15.79:0/3254931256 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f83b803af30 con 0x7f83c81aafc0 2021-04-09T18:34:29.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.267 7f83cdfb4700 1 --2- 172.21.15.79:0/3254931256 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f83b0029100 0x7f83b002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:29.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.267 7f83cdfb4700 1 --2- 172.21.15.79:0/3254931256 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f83b0029100 0x7f83b002b650 crc :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:29.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.271 7f83d0210700 1 -- 172.21.15.79:0/3254931256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c80e39f0 con 0x7f83c81aafc0 2021-04-09T18:34:29.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.275 7f83be7fc700 1 -- 172.21.15.79:0/3254931256 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f83b80045d0 con 0x7f83c81aafc0 2021-04-09T18:34:29.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.431 7f83d0210700 1 -- 172.21.15.79:0/3254931256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f83c80a1c90 con 0x7f83c81aafc0 2021-04-09T18:34:29.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.431 7f83be7fc700 1 -- 172.21.15.79:0/3254931256 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v102) v1 ==== 92+0+10 (secure 0 0 0) 0x7f83b8000bf0 con 0x7f83c81aafc0 2021-04-09T18:34:29.437 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:34:29.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.435 7f83d0210700 1 -- 172.21.15.79:0/3254931256 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f83b0029100 msgr2=0x7f83b002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:29.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.435 7f83d0210700 1 --2- 172.21.15.79:0/3254931256 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f83b0029100 0x7f83b002b650 crc :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.435 7f83d0210700 1 -- 172.21.15.79:0/3254931256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c81aafc0 msgr2=0x7f83c81ab410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:29.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.435 7f83d0210700 1 --2- 172.21.15.79:0/3254931256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c81aafc0 0x7f83c81ab410 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f83b8001320 tx=0x7f83b800cb50).stop 2021-04-09T18:34:29.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.435 7f83d0210700 1 -- 172.21.15.79:0/3254931256 shutdown_connections 2021-04-09T18:34:29.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.435 7f83d0210700 1 --2- 172.21.15.79:0/3254931256 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f83b0029100 0x7f83b002b650 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.435 7f83d0210700 1 --2- 172.21.15.79:0/3254931256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c80d6030 0x7f83c80d6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.435 7f83d0210700 1 --2- 172.21.15.79:0/3254931256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c80d5190 0x7f83c80d55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.435 7f83d0210700 1 --2- 172.21.15.79:0/3254931256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c81aafc0 0x7f83c81ab410 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.435 7f83d0210700 1 -- 172.21.15.79:0/3254931256 >> 172.21.15.79:0/3254931256 conn(0x7f83c80baa40 msgr2=0x7f83c80d8470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:29.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.435 7f83d0210700 1 -- 172.21.15.79:0/3254931256 shutdown_connections 2021-04-09T18:34:29.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.435 7f83d0210700 1 -- 172.21.15.79:0/3254931256 wait complete. 2021-04-09T18:34:29.449 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-04-09T18:34:29.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.539 7f422bdd7700 1 Processor -- start 2021-04-09T18:34:29.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.539 7f422bdd7700 1 -- start start 2021-04-09T18:34:29.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.539 7f422bdd7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f42241c9020 0x7f42241cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:29.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.539 7f422bdd7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42240fbb20 con 0x7f42240e9ae0 2021-04-09T18:34:29.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.539 7f422bdd7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422409f910 con 0x7f42240f5520 2021-04-09T18:34:29.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.539 7f422bdd7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42241c3dc0 con 0x7f42241c9020 2021-04-09T18:34:29.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.539 7f422937a700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f42240e9ae0 0x7f422409f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56920/0 (socket says 172.21.15.79:56920) 2021-04-09T18:34:29.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.539 7f422937a700 1 -- 172.21.15.79:0/3760356062 learned_addr learned my addr 172.21.15.79:0/3760356062 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:29.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.539 7f422a37c700 1 --2- 172.21.15.79:0/3760356062 >> v2:172.21.15.89:3300/0 conn(0x7f42241c9020 0x7f42241cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:29.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.539 7f4228b79700 1 -- 172.21.15.79:0/3760356062 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019812059 0 0) 0x7f42140010d0 con 0x7f42240e9ae0 2021-04-09T18:34:29.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.539 7f4228b79700 1 -- 172.21.15.79:0/3760356062 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4210003240 con 0x7f42240e9ae0 2021-04-09T18:34:29.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.539 7f422a37c700 1 -- 172.21.15.79:0/3760356062 >> v1:172.21.15.89:6789/0 conn(0x7f42240f5520 legacy=0x7f42240f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:29.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.539 7f422a37c700 1 -- 172.21.15.79:0/3760356062 >> v1:172.21.15.79:6789/0 conn(0x7f42240e9ae0 legacy=0x7f422409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:29.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.539 7f422a37c700 1 -- 172.21.15.79:0/3760356062 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42240e56d0 con 0x7f42241c9020 2021-04-09T18:34:29.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.539 7f422a37c700 1 --2- 172.21.15.79:0/3760356062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42241c9020 0x7f42241cb480 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f421c0032b0 tx=0x7f421c00b0e0).ready entity=mon.1 client_cookie=5380ab9bfb03cb58 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:29.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.539 7f4228b79700 1 -- 172.21.15.79:0/3760356062 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f42240e56d0 con 0x7f42241c9020 2021-04-09T18:34:29.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.539 7f4228b79700 1 -- 172.21.15.79:0/3760356062 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c00bab0 con 0x7f42241c9020 2021-04-09T18:34:29.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.539 7f4228b79700 1 -- 172.21.15.79:0/3760356062 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f421c002020 con 0x7f42241c9020 2021-04-09T18:34:29.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.539 7f422bdd7700 1 -- 172.21.15.79:0/3760356062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42241c9020 msgr2=0x7f42241cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:29.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.539 7f422bdd7700 1 --2- 172.21.15.79:0/3760356062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42241c9020 0x7f42241cb480 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f421c0032b0 tx=0x7f421c00b0e0).stop 2021-04-09T18:34:29.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.543 7f422bdd7700 1 -- 172.21.15.79:0/3760356062 shutdown_connections 2021-04-09T18:34:29.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.543 7f422bdd7700 1 --2- 172.21.15.79:0/3760356062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42241c9020 0x7f42241cb480 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.543 7f422bdd7700 1 -- 172.21.15.79:0/3760356062 >> 172.21.15.79:0/3760356062 conn(0x7f42240e5fe0 msgr2=0x7f42240e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:29.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.543 7f422bdd7700 1 -- 172.21.15.79:0/3760356062 shutdown_connections 2021-04-09T18:34:29.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.543 7f422bdd7700 1 -- 172.21.15.79:0/3760356062 wait complete. 2021-04-09T18:34:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f422bdd7700 1 Processor -- start 2021-04-09T18:34:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f422bdd7700 1 -- start start 2021-04-09T18:34:29.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f422bdd7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4224099280 0x7f42240a3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:29.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f422bdd7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42240a2710 0x7f42240c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:29.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f422bdd7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42240a2b60 0x7f42240d5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:29.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f422bdd7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42240e9f30 con 0x7f42240a2b60 2021-04-09T18:34:29.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f422bdd7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422419bce0 con 0x7f4224099280 2021-04-09T18:34:29.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f422bdd7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422419bfe0 con 0x7f42240a2710 2021-04-09T18:34:29.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f422a37c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42240a2b60 0x7f42240d5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:29.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f422a37c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42240a2b60 0x7f42240d5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33984/0 (socket says 172.21.15.79:33984) 2021-04-09T18:34:29.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f422a37c700 1 -- 172.21.15.79:0/3524536708 learned_addr learned my addr 172.21.15.79:0/3524536708 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:29.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f422937a700 1 --2- 172.21.15.79:0/3524536708 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42240a2710 0x7f42240c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:29.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f4229b7b700 1 --2- 172.21.15.79:0/3524536708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4224099280 0x7f42240a3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:29.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f422a37c700 1 -- 172.21.15.79:0/3524536708 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42240a2710 msgr2=0x7f42240c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:29.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f422a37c700 1 --2- 172.21.15.79:0/3524536708 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42240a2710 0x7f42240c3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f422a37c700 1 -- 172.21.15.79:0/3524536708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4224099280 msgr2=0x7f42240a3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f422a37c700 1 --2- 172.21.15.79:0/3524536708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4224099280 0x7f42240a3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f422a37c700 1 -- 172.21.15.79:0/3524536708 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422419d900 con 0x7f42240a2b60 2021-04-09T18:34:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f422a37c700 1 --2- 172.21.15.79:0/3524536708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42240a2b60 0x7f42240d5330 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f42240d82e0 tx=0x7f421c006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:29.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f421a7fc700 1 -- 172.21.15.79:0/3524536708 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f422419d900 con 0x7f42240a2b60 2021-04-09T18:34:29.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f421a7fc700 1 -- 172.21.15.79:0/3524536708 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c01b5e0 con 0x7f42240a2b60 2021-04-09T18:34:29.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f422bdd7700 1 -- 172.21.15.79:0/3524536708 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42240c45f0 con 0x7f42240a2b60 2021-04-09T18:34:29.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f421a7fc700 1 -- 172.21.15.79:0/3524536708 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f421c017040 con 0x7f42240a2b60 2021-04-09T18:34:29.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.547 7f422bdd7700 1 -- 172.21.15.79:0/3524536708 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42240d5af0 con 0x7f42240a2b60 2021-04-09T18:34:29.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.551 7f421a7fc700 1 -- 172.21.15.79:0/3524536708 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f421c01b9b0 con 0x7f42240a2b60 2021-04-09T18:34:29.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.551 7f421a7fc700 1 --2- 172.21.15.79:0/3524536708 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f420c02b310 0x7f420c02d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:29.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.551 7f421a7fc700 1 -- 172.21.15.79:0/3524536708 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f421c018030 con 0x7f42240a2b60 2021-04-09T18:34:29.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.551 7f4229b7b700 1 --2- 172.21.15.79:0/3524536708 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f420c02b310 0x7f420c02d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:29.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.551 7f422bdd7700 1 -- 172.21.15.79:0/3524536708 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42240e39e0 con 0x7f42240a2b60 2021-04-09T18:34:29.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.551 7f4229b7b700 1 --2- 172.21.15.79:0/3524536708 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f420c02b310 0x7f420c02d860 crc :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:29.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.555 7f421a7fc700 1 -- 172.21.15.79:0/3524536708 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f42240f76c0 con 0x7f42240a2b60 2021-04-09T18:34:29.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.707 7f422bdd7700 1 -- 172.21.15.79:0/3524536708 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f42240a1cc0 con 0x7f42240a2b60 2021-04-09T18:34:29.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.707 7f421a7fc700 1 -- 172.21.15.79:0/3524536708 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v102) v1 ==== 84+0+64 (secure 0 0 0) 0x7f421c01b3d0 con 0x7f42240a2b60 2021-04-09T18:34:29.716 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:29.716 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2021-04-09T18:34:29.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:29.717 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2021-04-09T18:34:29.717 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": "rbd" 2021-04-09T18:34:29.718 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:29.718 INFO:teuthology.orchestra.run.smithi079.stdout:] 2021-04-09T18:34:29.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.711 7f422bdd7700 1 -- 172.21.15.79:0/3524536708 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f420c02b310 msgr2=0x7f420c02d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:29.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.711 7f422bdd7700 1 --2- 172.21.15.79:0/3524536708 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f420c02b310 0x7f420c02d860 crc :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.711 7f422bdd7700 1 -- 172.21.15.79:0/3524536708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42240a2b60 msgr2=0x7f42240d5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:29.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.711 7f422bdd7700 1 --2- 172.21.15.79:0/3524536708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42240a2b60 0x7f42240d5330 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f42240d82e0 tx=0x7f421c006c10).stop 2021-04-09T18:34:29.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.711 7f422bdd7700 1 -- 172.21.15.79:0/3524536708 shutdown_connections 2021-04-09T18:34:29.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.711 7f422bdd7700 1 --2- 172.21.15.79:0/3524536708 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f420c02b310 0x7f420c02d860 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.711 7f422bdd7700 1 --2- 172.21.15.79:0/3524536708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4224099280 0x7f42240a3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.711 7f422bdd7700 1 --2- 172.21.15.79:0/3524536708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42240a2b60 0x7f42240d5330 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.711 7f422bdd7700 1 --2- 172.21.15.79:0/3524536708 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42240a2710 0x7f42240c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.711 7f422bdd7700 1 -- 172.21.15.79:0/3524536708 >> 172.21.15.79:0/3524536708 conn(0x7f422409b060 msgr2=0x7f422409a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:29.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.711 7f422bdd7700 1 -- 172.21.15.79:0/3524536708 shutdown_connections 2021-04-09T18:34:29.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.711 7f422bdd7700 1 -- 172.21.15.79:0/3524536708 wait complete. 2021-04-09T18:34:29.729 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-04-09T18:34:29.729 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-04-09T18:34:29.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.819 7f395259c700 1 Processor -- start 2021-04-09T18:34:29.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.819 7f395259c700 1 -- start start 2021-04-09T18:34:29.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.819 7f395259c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f394c0e9b10 0x7f394c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:29.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.819 7f395259c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c1c8040 0x7f394c1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:29.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.819 7f395259c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394c0fbb50 con 0x7f394c0f5550 2021-04-09T18:34:29.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.819 7f395259c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394c1c3df0 con 0x7f394c0e9b10 2021-04-09T18:34:29.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.819 7f395259c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0e9f60 con 0x7f394c1c8040 2021-04-09T18:34:29.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f3950b41700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c1c8040 0x7f394c1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f394bfff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f394c0f5550 0x7f394c0f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:57402/0 (socket says 172.21.15.79:57402) 2021-04-09T18:34:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f394b7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f394c0e9b10 0x7f394c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f394bfff700 1 -- 172.21.15.79:0/1521581100 learned_addr learned my addr 172.21.15.79:0/1521581100 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f3950b41700 1 -- 172.21.15.79:0/1521581100 >> v2:172.21.15.89:3300/0 conn(0x7f394c0e9b10 msgr2=0x7f394c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f3950b41700 1 --2- 172.21.15.79:0/1521581100 >> v2:172.21.15.89:3300/0 conn(0x7f394c0e9b10 0x7f394c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f3950b41700 1 -- 172.21.15.79:0/1521581100 >> v1:172.21.15.89:6789/0 conn(0x7f394c0f5550 legacy=0x7f394c0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:29.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f3950b41700 1 -- 172.21.15.79:0/1521581100 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c0e5700 con 0x7f394c1c8040 2021-04-09T18:34:29.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f394b7fe700 1 --2- 172.21.15.79:0/1521581100 >> v2:172.21.15.89:3300/0 conn(0x7f394c0e9b10 0x7f394c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f3950b41700 1 --2- 172.21.15.79:0/1521581100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c1c8040 0x7f394c1ca4a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f3944002f30 tx=0x7f394400bcc0).ready entity=mon.2 client_cookie=6697a36140718e84 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f394affd700 1 -- 172.21.15.79:0/1521581100 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f394c0e5700 con 0x7f394c1c8040 2021-04-09T18:34:29.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f394affd700 1 -- 172.21.15.79:0/1521581100 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3944009800 con 0x7f394c1c8040 2021-04-09T18:34:29.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f394affd700 1 -- 172.21.15.79:0/1521581100 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3944009bd0 con 0x7f394c1c8040 2021-04-09T18:34:29.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f395259c700 1 -- 172.21.15.79:0/1521581100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c1c8040 msgr2=0x7f394c1ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:29.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f395259c700 1 --2- 172.21.15.79:0/1521581100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c1c8040 0x7f394c1ca4a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f3944002f30 tx=0x7f394400bcc0).stop 2021-04-09T18:34:29.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f395259c700 1 -- 172.21.15.79:0/1521581100 shutdown_connections 2021-04-09T18:34:29.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f395259c700 1 --2- 172.21.15.79:0/1521581100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c1c8040 0x7f394c1ca4a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f395259c700 1 --2- 172.21.15.79:0/1521581100 >> v2:172.21.15.89:3300/0 conn(0x7f394c0e9b10 0x7f394c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f395259c700 1 -- 172.21.15.79:0/1521581100 >> 172.21.15.79:0/1521581100 conn(0x7f394c0e6010 msgr2=0x7f394c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:29.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f395259c700 1 -- 172.21.15.79:0/1521581100 shutdown_connections 2021-04-09T18:34:29.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.823 7f395259c700 1 -- 172.21.15.79:0/1521581100 wait complete. 2021-04-09T18:34:29.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f395259c700 1 Processor -- start 2021-04-09T18:34:29.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f395259c700 1 -- start start 2021-04-09T18:34:29.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f395259c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c0baab0 0x7f394c08f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:29.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f395259c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c0a5800 0x7f394c08fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:29.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f395259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c1a65b0 0x7f394c1a6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:29.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f395259c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c088590 con 0x7f394c1a65b0 2021-04-09T18:34:29.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f395259c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0926b0 con 0x7f394c0a5800 2021-04-09T18:34:29.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f395259c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c08f6a0 con 0x7f394c0baab0 2021-04-09T18:34:29.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f3950b41700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c1a65b0 0x7f394c1a6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:29.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f3950b41700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c1a65b0 0x7f394c1a6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33998/0 (socket says 172.21.15.79:33998) 2021-04-09T18:34:29.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f3950b41700 1 -- 172.21.15.79:0/3622436142 learned_addr learned my addr 172.21.15.79:0/3622436142 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:29.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f394b7fe700 1 --2- 172.21.15.79:0/3622436142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c0a5800 0x7f394c08fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:29.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f394bfff700 1 --2- 172.21.15.79:0/3622436142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c0baab0 0x7f394c08f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:29.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f394b7fe700 1 -- 172.21.15.79:0/3622436142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c0baab0 msgr2=0x7f394c08f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:29.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f394b7fe700 1 --2- 172.21.15.79:0/3622436142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c0baab0 0x7f394c08f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f394b7fe700 1 -- 172.21.15.79:0/3622436142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c1a65b0 msgr2=0x7f394c1a6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:29.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f394b7fe700 1 --2- 172.21.15.79:0/3622436142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c1a65b0 0x7f394c1a6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:29.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f394b7fe700 1 -- 172.21.15.79:0/3622436142 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c092240 con 0x7f394c0a5800 2021-04-09T18:34:29.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f3950b41700 1 --2- 172.21.15.79:0/3622436142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c1a65b0 0x7f394c1a6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:29.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f394b7fe700 1 --2- 172.21.15.79:0/3622436142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c0a5800 0x7f394c08fa10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f394c0d2890 tx=0x7f393400c430).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:29.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f3948ff9700 1 -- 172.21.15.79:0/3622436142 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f394c092240 con 0x7f394c0a5800 2021-04-09T18:34:29.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f3948ff9700 1 -- 172.21.15.79:0/3622436142 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393400cd60 con 0x7f394c0a5800 2021-04-09T18:34:29.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f395259c700 1 -- 172.21.15.79:0/3622436142 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f394c0929b0 con 0x7f394c0a5800 2021-04-09T18:34:29.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f3948ff9700 1 -- 172.21.15.79:0/3622436142 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f393400f040 con 0x7f394c0a5800 2021-04-09T18:34:29.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.827 7f395259c700 1 -- 172.21.15.79:0/3622436142 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394c0901d0 con 0x7f394c0a5800 2021-04-09T18:34:29.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.831 7f3948ff9700 1 -- 172.21.15.79:0/3622436142 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3934011070 con 0x7f394c0a5800 2021-04-09T18:34:29.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.831 7f3948ff9700 1 --2- 172.21.15.79:0/3622436142 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3930029100 0x7f393002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:29.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.831 7f3948ff9700 1 -- 172.21.15.79:0/3622436142 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f3934010040 con 0x7f394c0a5800 2021-04-09T18:34:29.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.831 7f394bfff700 1 --2- 172.21.15.79:0/3622436142 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3930029100 0x7f393002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:29.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.831 7f394bfff700 1 --2- 172.21.15.79:0/3622436142 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3930029100 0x7f393002b650 crc :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:29.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.835 7f395259c700 1 -- 172.21.15.79:0/3622436142 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394c0e39f0 con 0x7f394c0a5800 2021-04-09T18:34:29.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:29.843 7f3948ff9700 1 -- 172.21.15.79:0/3622436142 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f393400c960 con 0x7f394c0a5800 2021-04-09T18:34:30.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.007 7f395259c700 1 -- 172.21.15.79:0/3622436142 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f394c0f5b50 con 0x7f394c0a5800 2021-04-09T18:34:30.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.503 7f3948ff9700 1 -- 172.21.15.79:0/3622436142 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v103) v1 ==== 133+0+0 (secure 0 0 0) 0x7f3934000bf0 con 0x7f394c0a5800 2021-04-09T18:34:30.525 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2021-04-09T18:34:30.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.523 7f395259c700 1 -- 172.21.15.79:0/3622436142 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3930029100 msgr2=0x7f393002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:30.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.523 7f395259c700 1 --2- 172.21.15.79:0/3622436142 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3930029100 0x7f393002b650 crc :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:30.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.523 7f395259c700 1 -- 172.21.15.79:0/3622436142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c0a5800 msgr2=0x7f394c08fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:30.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.523 7f395259c700 1 --2- 172.21.15.79:0/3622436142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c0a5800 0x7f394c08fa10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f394c0d2890 tx=0x7f393400c430).stop 2021-04-09T18:34:30.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.523 7f395259c700 1 -- 172.21.15.79:0/3622436142 shutdown_connections 2021-04-09T18:34:30.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.523 7f395259c700 1 --2- 172.21.15.79:0/3622436142 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f3930029100 0x7f393002b650 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:30.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.523 7f395259c700 1 --2- 172.21.15.79:0/3622436142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c1a65b0 0x7f394c1a6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:30.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.523 7f395259c700 1 --2- 172.21.15.79:0/3622436142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c0baab0 0x7f394c08f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:30.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.523 7f395259c700 1 --2- 172.21.15.79:0/3622436142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c0a5800 0x7f394c08fa10 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:30.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.523 7f395259c700 1 -- 172.21.15.79:0/3622436142 >> 172.21.15.79:0/3622436142 conn(0x7f394c0946c0 msgr2=0x7f394c095d70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:30.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.523 7f395259c700 1 -- 172.21.15.79:0/3622436142 shutdown_connections 2021-04-09T18:34:30.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.523 7f395259c700 1 -- 172.21.15.79:0/3622436142 wait complete. 2021-04-09T18:34:30.543 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-04-09T18:34:30.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.639 7feb2ca6e700 1 Processor -- start 2021-04-09T18:34:30.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.639 7feb2ca6e700 1 -- start start 2021-04-09T18:34:30.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.639 7feb2ca6e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feb280f5550 0x7feb280f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:30.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.639 7feb2ca6e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feb280e9b10 0x7feb2809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:30.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.639 7feb2ca6e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb280fbb50 con 0x7feb281c2de0 2021-04-09T18:34:30.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.639 7feb2ca6e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb280e9f60 con 0x7feb280f5550 2021-04-09T18:34:30.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.639 7feb2ca6e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb280e5a00 con 0x7feb280e9b10 2021-04-09T18:34:30.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.639 7feb267e6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feb280f5550 0x7feb280f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:30.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.639 7feb267e6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feb280f5550 0x7feb280f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34004/0 (socket says 172.21.15.79:34004) 2021-04-09T18:34:30.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.639 7feb267e6700 1 -- 172.21.15.79:0/3645427028 learned_addr learned my addr 172.21.15.79:0/3645427028 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:30.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.643 7feb25fe5700 1 --2- 172.21.15.79:0/3645427028 >> v2:172.21.15.89:3300/0 conn(0x7feb280e9b10 0x7feb2809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:30.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.643 7feb267e6700 1 -- 172.21.15.79:0/3645427028 >> v2:172.21.15.89:3300/0 conn(0x7feb280e9b10 msgr2=0x7feb2809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:30.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.643 7feb267e6700 1 --2- 172.21.15.79:0/3645427028 >> v2:172.21.15.89:3300/0 conn(0x7feb280e9b10 0x7feb2809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:30.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.643 7feb267e6700 1 -- 172.21.15.79:0/3645427028 >> v1:172.21.15.89:6789/0 conn(0x7feb281c2de0 legacy=0x7feb281c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:30.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.643 7feb267e6700 1 -- 172.21.15.79:0/3645427028 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb280e5700 con 0x7feb280f5550 2021-04-09T18:34:30.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.643 7feb267e6700 1 --2- 172.21.15.79:0/3645427028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb280f5550 0x7feb280f64e0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7feb18002f30 tx=0x7feb1800bd70).ready entity=mon.0 client_cookie=ac4a548256bdf324 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:30.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.643 7feb257e4700 1 -- 172.21.15.79:0/3645427028 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feb280e5700 con 0x7feb280f5550 2021-04-09T18:34:30.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.643 7feb257e4700 1 -- 172.21.15.79:0/3645427028 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb18009950 con 0x7feb280f5550 2021-04-09T18:34:30.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.643 7feb257e4700 1 -- 172.21.15.79:0/3645427028 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feb18009d20 con 0x7feb280f5550 2021-04-09T18:34:30.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.643 7feb2ca6e700 1 -- 172.21.15.79:0/3645427028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb280f5550 msgr2=0x7feb280f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:30.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.643 7feb2ca6e700 1 --2- 172.21.15.79:0/3645427028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb280f5550 0x7feb280f64e0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7feb18002f30 tx=0x7feb1800bd70).stop 2021-04-09T18:34:30.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.643 7feb2ca6e700 1 -- 172.21.15.79:0/3645427028 shutdown_connections 2021-04-09T18:34:30.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.643 7feb2ca6e700 1 --2- 172.21.15.79:0/3645427028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb280f5550 0x7feb280f64e0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:30.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.643 7feb2ca6e700 1 --2- 172.21.15.79:0/3645427028 >> v2:172.21.15.89:3300/0 conn(0x7feb280e9b10 0x7feb2809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:30.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.643 7feb2ca6e700 1 -- 172.21.15.79:0/3645427028 >> 172.21.15.79:0/3645427028 conn(0x7feb280e6010 msgr2=0x7feb280e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:30.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.643 7feb2ca6e700 1 -- 172.21.15.79:0/3645427028 shutdown_connections 2021-04-09T18:34:30.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.643 7feb2ca6e700 1 -- 172.21.15.79:0/3645427028 wait complete. 2021-04-09T18:34:30.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.647 7feb2ca6e700 1 Processor -- start 2021-04-09T18:34:30.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.647 7feb2ca6e700 1 -- start start 2021-04-09T18:34:30.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.647 7feb2ca6e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb280d4be0 0x7feb280b9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:30.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.647 7feb2ca6e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb280d6030 0x7feb280d6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:30.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.647 7feb2ca6e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb280cec50 0x7feb280cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:30.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.647 7feb2ca6e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb280d5d30 con 0x7feb280d6030 2021-04-09T18:34:30.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.647 7feb2ca6e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb280bb4e0 con 0x7feb280cec50 2021-04-09T18:34:30.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.647 7feb2ca6e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb280bb060 con 0x7feb280d4be0 2021-04-09T18:34:30.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.647 7feb25fe5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb280d6030 0x7feb280d6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:30.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.647 7feb267e6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb280d4be0 0x7feb280b9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:30.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.647 7feb25fe5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb280d6030 0x7feb280d6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34012/0 (socket says 172.21.15.79:34012) 2021-04-09T18:34:30.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.647 7feb25fe5700 1 -- 172.21.15.79:0/3788473635 learned_addr learned my addr 172.21.15.79:0/3788473635 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:30.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.647 7feb26fe7700 1 --2- 172.21.15.79:0/3788473635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb280cec50 0x7feb280cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:30.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.651 7feb25fe5700 1 -- 172.21.15.79:0/3788473635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb280d4be0 msgr2=0x7feb280b9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:30.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.651 7feb25fe5700 1 --2- 172.21.15.79:0/3788473635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb280d4be0 0x7feb280b9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:30.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.651 7feb25fe5700 1 -- 172.21.15.79:0/3788473635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb280cec50 msgr2=0x7feb280cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:30.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.651 7feb25fe5700 1 --2- 172.21.15.79:0/3788473635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb280cec50 0x7feb280cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:30.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.651 7feb25fe5700 1 -- 172.21.15.79:0/3788473635 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb280cf6d0 con 0x7feb280d6030 2021-04-09T18:34:30.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.651 7feb26fe7700 1 --2- 172.21.15.79:0/3788473635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb280cec50 0x7feb280cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:30.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.651 7feb25fe5700 1 --2- 172.21.15.79:0/3788473635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb280d6030 0x7feb280d6480 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7feb280d5cb0 tx=0x7feb1c00be50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:30.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.651 7feb16ffd700 1 -- 172.21.15.79:0/3788473635 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feb280cf6d0 con 0x7feb280d6030 2021-04-09T18:34:30.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.651 7feb16ffd700 1 -- 172.21.15.79:0/3788473635 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1c0099e0 con 0x7feb280d6030 2021-04-09T18:34:30.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.651 7feb2ca6e700 1 -- 172.21.15.79:0/3788473635 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb280d58c0 con 0x7feb280d6030 2021-04-09T18:34:30.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.651 7feb16ffd700 1 -- 172.21.15.79:0/3788473635 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feb1c00f040 con 0x7feb280d6030 2021-04-09T18:34:30.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.651 7feb2ca6e700 1 -- 172.21.15.79:0/3788473635 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb280d5030 con 0x7feb280d6030 2021-04-09T18:34:30.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.651 7feb16ffd700 1 -- 172.21.15.79:0/3788473635 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7feb1c013480 con 0x7feb280d6030 2021-04-09T18:34:30.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.651 7feb16ffd700 1 --2- 172.21.15.79:0/3788473635 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7feb0c029100 0x7feb0c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:30.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.651 7feb16ffd700 1 -- 172.21.15.79:0/3788473635 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5458+0+0 (secure 0 0 0) 0x7feb1c010070 con 0x7feb280d6030 2021-04-09T18:34:30.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.651 7feb267e6700 1 --2- 172.21.15.79:0/3788473635 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7feb0c029100 0x7feb0c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:30.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.651 7feb267e6700 1 --2- 172.21.15.79:0/3788473635 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7feb0c029100 0x7feb0c02b650 crc :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:30.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.655 7feb2ca6e700 1 -- 172.21.15.79:0/3788473635 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb280e39f0 con 0x7feb280d6030 2021-04-09T18:34:30.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.663 7feb16ffd700 1 -- 172.21.15.79:0/3788473635 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7feb1c0095e0 con 0x7feb280d6030 2021-04-09T18:34:30.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:30.823 7feb2ca6e700 1 -- 172.21.15.79:0/3788473635 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7feb280a1c90 con 0x7feb280d6030 2021-04-09T18:34:31.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.503 7feb16ffd700 1 -- 172.21.15.79:0/3788473635 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v104) v1 ==== 125+0+0 (secure 0 0 0) 0x7feb1c000bf0 con 0x7feb280d6030 2021-04-09T18:34:31.544 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2021-04-09T18:34:31.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.543 7feb2ca6e700 1 -- 172.21.15.79:0/3788473635 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7feb0c029100 msgr2=0x7feb0c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:31.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.543 7feb2ca6e700 1 --2- 172.21.15.79:0/3788473635 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7feb0c029100 0x7feb0c02b650 crc :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:31.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.543 7feb2ca6e700 1 -- 172.21.15.79:0/3788473635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb280d6030 msgr2=0x7feb280d6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:31.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.543 7feb2ca6e700 1 --2- 172.21.15.79:0/3788473635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb280d6030 0x7feb280d6480 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7feb280d5cb0 tx=0x7feb1c00be50).stop 2021-04-09T18:34:31.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.543 7feb2ca6e700 1 -- 172.21.15.79:0/3788473635 shutdown_connections 2021-04-09T18:34:31.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.543 7feb2ca6e700 1 --2- 172.21.15.79:0/3788473635 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7feb0c029100 0x7feb0c02b650 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:31.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.543 7feb2ca6e700 1 --2- 172.21.15.79:0/3788473635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb280cec50 0x7feb280cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:31.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.543 7feb2ca6e700 1 --2- 172.21.15.79:0/3788473635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb280d4be0 0x7feb280b9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:31.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.543 7feb2ca6e700 1 --2- 172.21.15.79:0/3788473635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb280d6030 0x7feb280d6480 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:31.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.543 7feb2ca6e700 1 -- 172.21.15.79:0/3788473635 >> 172.21.15.79:0/3788473635 conn(0x7feb280bc400 msgr2=0x7feb28093cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:31.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.543 7feb2ca6e700 1 -- 172.21.15.79:0/3788473635 shutdown_connections 2021-04-09T18:34:31.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.543 7feb2ca6e700 1 -- 172.21.15.79:0/3788473635 wait complete. 2021-04-09T18:34:31.562 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-04-09T18:34:31.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.651 7fe1ac52b700 1 Processor -- start 2021-04-09T18:34:31.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.651 7fe1ac52b700 1 -- start start 2021-04-09T18:34:31.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.651 7fe1ac52b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe1a40f5550 0x7fe1a40f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:31.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.651 7fe1ac52b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1a41c8040 0x7fe1a41ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:31.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.651 7fe1ac52b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a40fbb50 con 0x7fe1a40e9b10 2021-04-09T18:34:31.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.651 7fe1ac52b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a40e9f60 con 0x7fe1a40f5550 2021-04-09T18:34:31.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.651 7fe1ac52b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a41c3df0 con 0x7fe1a41c8040 2021-04-09T18:34:31.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.651 7fe1a9ace700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe1a40e9b10 0x7fe1a409f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56964/0 (socket says 172.21.15.79:56964) 2021-04-09T18:34:31.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.651 7fe1a9ace700 1 -- 172.21.15.79:0/819263249 learned_addr learned my addr 172.21.15.79:0/819263249 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:31.666 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1aaad0700 1 --2- 172.21.15.79:0/819263249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1a41c8040 0x7fe1a41ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:31.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1aa2cf700 1 --2- 172.21.15.79:0/819263249 >> v2:172.21.15.89:3300/0 conn(0x7fe1a40f5550 0x7fe1a40f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:31.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1a92cd700 1 -- 172.21.15.79:0/819263249 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2472405395 0 0) 0x7fe1a00010d0 con 0x7fe1a40e9b10 2021-04-09T18:34:31.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1a92cd700 1 -- 172.21.15.79:0/819263249 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe190003240 con 0x7fe1a40e9b10 2021-04-09T18:34:31.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1aa2cf700 1 -- 172.21.15.79:0/819263249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1a41c8040 msgr2=0x7fe1a41ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:31.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1aa2cf700 1 --2- 172.21.15.79:0/819263249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1a41c8040 0x7fe1a41ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:31.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1aa2cf700 1 -- 172.21.15.79:0/819263249 >> v1:172.21.15.79:6789/0 conn(0x7fe1a40e9b10 legacy=0x7fe1a409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:31.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1a92cd700 1 -- 172.21.15.79:0/819263249 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4224593486 0 0) 0x7fe1a0001650 con 0x7fe1a40e9b10 2021-04-09T18:34:31.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1aa2cf700 1 -- 172.21.15.79:0/819263249 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a409f910 con 0x7fe1a40f5550 2021-04-09T18:34:31.668 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1aaad0700 1 --2- 172.21.15.79:0/819263249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1a41c8040 0x7fe1a41ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:31.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1aa2cf700 1 --2- 172.21.15.79:0/819263249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1a40f5550 0x7fe1a40f64e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fe1a0001df0 tx=0x7fe19800bd70).ready entity=mon.1 client_cookie=35942de45051ebcf server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:31.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1a92cd700 1 -- 172.21.15.79:0/819263249 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1a409f910 con 0x7fe1a40f5550 2021-04-09T18:34:31.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1a92cd700 1 -- 172.21.15.79:0/819263249 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe198009710 con 0x7fe1a40f5550 2021-04-09T18:34:31.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1a92cd700 1 -- 172.21.15.79:0/819263249 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1a0001bb0 con 0x7fe1a40f5550 2021-04-09T18:34:31.669 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1ac52b700 1 -- 172.21.15.79:0/819263249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1a40f5550 msgr2=0x7fe1a40f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:31.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1ac52b700 1 --2- 172.21.15.79:0/819263249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1a40f5550 0x7fe1a40f64e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fe1a0001df0 tx=0x7fe19800bd70).stop 2021-04-09T18:34:31.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1ac52b700 1 -- 172.21.15.79:0/819263249 shutdown_connections 2021-04-09T18:34:31.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1ac52b700 1 --2- 172.21.15.79:0/819263249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1a40f5550 0x7fe1a40f64e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:31.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1ac52b700 1 --2- 172.21.15.79:0/819263249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1a41c8040 0x7fe1a41ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:31.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1ac52b700 1 -- 172.21.15.79:0/819263249 >> 172.21.15.79:0/819263249 conn(0x7fe1a40e6010 msgr2=0x7fe1a40e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:31.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1ac52b700 1 -- 172.21.15.79:0/819263249 shutdown_connections 2021-04-09T18:34:31.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.655 7fe1ac52b700 1 -- 172.21.15.79:0/819263249 wait complete. 2021-04-09T18:34:31.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1ac52b700 1 Processor -- start 2021-04-09T18:34:31.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1ac52b700 1 -- start start 2021-04-09T18:34:31.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1ac52b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a40d6f10 0x7fe1a40d7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:31.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1ac52b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1a41ada60 0x7fe1a41adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:31.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1ac52b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1a41a1cc0 0x7fe1a41a2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:31.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1ac52b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a41a0420 con 0x7fe1a40d6f10 2021-04-09T18:34:31.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1ac52b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a41a0720 con 0x7fe1a41ada60 2021-04-09T18:34:31.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1ac52b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a419fcb0 con 0x7fe1a41a1cc0 2021-04-09T18:34:31.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1aa2cf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a40d6f10 0x7fe1a40d7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:31.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1aa2cf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a40d6f10 0x7fe1a40d7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34026/0 (socket says 172.21.15.79:34026) 2021-04-09T18:34:31.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1aa2cf700 1 -- 172.21.15.79:0/906600475 learned_addr learned my addr 172.21.15.79:0/906600475 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:31.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1aaad0700 1 --2- 172.21.15.79:0/906600475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1a41a1cc0 0x7fe1a41a2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:31.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1a9ace700 1 --2- 172.21.15.79:0/906600475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1a41ada60 0x7fe1a41adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:31.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1aa2cf700 1 -- 172.21.15.79:0/906600475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1a41a1cc0 msgr2=0x7fe1a41a2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:31.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1aa2cf700 1 --2- 172.21.15.79:0/906600475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1a41a1cc0 0x7fe1a41a2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:31.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1aa2cf700 1 -- 172.21.15.79:0/906600475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1a41ada60 msgr2=0x7fe1a41adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:31.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1aa2cf700 1 --2- 172.21.15.79:0/906600475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1a41ada60 0x7fe1a41adeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:31.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1aa2cf700 1 -- 172.21.15.79:0/906600475 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a4096710 con 0x7fe1a40d6f10 2021-04-09T18:34:31.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1aaad0700 1 --2- 172.21.15.79:0/906600475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1a41a1cc0 0x7fe1a41a2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:31.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1a9ace700 1 --2- 172.21.15.79:0/906600475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1a41ada60 0x7fe1a41adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:31.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1aa2cf700 1 --2- 172.21.15.79:0/906600475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a40d6f10 0x7fe1a40d7360 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7fe1a40d81a0 tx=0x7fe198006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:31.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe196ffd700 1 -- 172.21.15.79:0/906600475 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1a4096710 con 0x7fe1a40d6f10 2021-04-09T18:34:31.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe196ffd700 1 -- 172.21.15.79:0/906600475 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe198011c70 con 0x7fe1a40d6f10 2021-04-09T18:34:31.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1ac52b700 1 -- 172.21.15.79:0/906600475 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a41ae4e0 con 0x7fe1a40d6f10 2021-04-09T18:34:31.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe196ffd700 1 -- 172.21.15.79:0/906600475 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe198017040 con 0x7fe1a40d6f10 2021-04-09T18:34:31.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.659 7fe1ac52b700 1 -- 172.21.15.79:0/906600475 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a41a2740 con 0x7fe1a40d6f10 2021-04-09T18:34:31.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.663 7fe196ffd700 1 -- 172.21.15.79:0/906600475 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe1980273b0 con 0x7fe1a40d6f10 2021-04-09T18:34:31.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.663 7fe196ffd700 1 --2- 172.21.15.79:0/906600475 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe18c029100 0x7fe18c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:31.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.663 7fe196ffd700 1 -- 172.21.15.79:0/906600475 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe198018070 con 0x7fe1a40d6f10 2021-04-09T18:34:31.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.663 7fe1a9ace700 1 --2- 172.21.15.79:0/906600475 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe18c029100 0x7fe18c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:31.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.663 7fe1a9ace700 1 --2- 172.21.15.79:0/906600475 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe18c029100 0x7fe18c02b650 crc :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:31.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.667 7fe1ac52b700 1 -- 172.21.15.79:0/906600475 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a40e39f0 con 0x7fe1a40d6f10 2021-04-09T18:34:31.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.675 7fe196ffd700 1 -- 172.21.15.79:0/906600475 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe198009500 con 0x7fe1a40d6f10 2021-04-09T18:34:31.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.835 7fe1ac52b700 1 -- 172.21.15.79:0/906600475 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7fe1a40f5b50 con 0x7fe1a40d6f10 2021-04-09T18:34:31.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.843 7fe196ffd700 1 -- 172.21.15.79:0/906600475 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 20 and data pool 21 v65) v1 ==== 189+0+0 (secure 0 0 0) 0x7fe198011a60 con 0x7fe1a40d6f10 2021-04-09T18:34:31.849 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 20 and data pool 21 2021-04-09T18:34:31.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.847 7fe1ac52b700 1 -- 172.21.15.79:0/906600475 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe18c029100 msgr2=0x7fe18c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:31.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.847 7fe1ac52b700 1 --2- 172.21.15.79:0/906600475 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe18c029100 0x7fe18c02b650 crc :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:31.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.847 7fe1ac52b700 1 -- 172.21.15.79:0/906600475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a40d6f10 msgr2=0x7fe1a40d7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:31.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.847 7fe1ac52b700 1 --2- 172.21.15.79:0/906600475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a40d6f10 0x7fe1a40d7360 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7fe1a40d81a0 tx=0x7fe198006890).stop 2021-04-09T18:34:31.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.847 7fe1ac52b700 1 -- 172.21.15.79:0/906600475 shutdown_connections 2021-04-09T18:34:31.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.847 7fe1ac52b700 1 --2- 172.21.15.79:0/906600475 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe18c029100 0x7fe18c02b650 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:31.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.847 7fe1ac52b700 1 --2- 172.21.15.79:0/906600475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1a41a1cc0 0x7fe1a41a2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:31.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.847 7fe1ac52b700 1 --2- 172.21.15.79:0/906600475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a40d6f10 0x7fe1a40d7360 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:31.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.847 7fe1ac52b700 1 --2- 172.21.15.79:0/906600475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1a41ada60 0x7fe1a41adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:31.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.847 7fe1ac52b700 1 -- 172.21.15.79:0/906600475 >> 172.21.15.79:0/906600475 conn(0x7fe1a40a2750 msgr2=0x7fe1a4099ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:31.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.847 7fe1ac52b700 1 -- 172.21.15.79:0/906600475 shutdown_connections 2021-04-09T18:34:31.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.847 7fe1ac52b700 1 -- 172.21.15.79:0/906600475 wait complete. 2021-04-09T18:34:31.864 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:34:31.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.947 7f567c383700 1 Processor -- start 2021-04-09T18:34:31.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.947 7f567c383700 1 -- start start 2021-04-09T18:34:31.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.947 7f567c383700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56740e9ae0 0x7f567409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:31.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.947 7f567c383700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56740fbb20 con 0x7f56740f5520 2021-04-09T18:34:31.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.947 7f567c383700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56740e56d0 con 0x7f56741c8010 2021-04-09T18:34:31.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.947 7f567c383700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56741c3dc0 con 0x7f56740e9ae0 2021-04-09T18:34:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f567a127700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f56740f5520 0x7f56740f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56974/0 (socket says 172.21.15.79:56974) 2021-04-09T18:34:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f567a127700 1 -- 172.21.15.79:0/2998565104 learned_addr learned my addr 172.21.15.79:0/2998565104 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679926700 1 --2- 172.21.15.79:0/2998565104 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56740e9ae0 0x7f567409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679125700 1 -- 172.21.15.79:0/2998565104 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699518126 0 0) 0x7f56700010d0 con 0x7f56740f5520 2021-04-09T18:34:31.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679125700 1 -- 172.21.15.79:0/2998565104 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5660003240 con 0x7f56740f5520 2021-04-09T18:34:31.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679125700 1 -- 172.21.15.79:0/2998565104 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3675207444 0 0) 0x7f5670001650 con 0x7f56740f5520 2021-04-09T18:34:31.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679125700 1 -- 172.21.15.79:0/2998565104 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56740e9ae0 msgr2=0x7f567409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:31.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679125700 1 --2- 172.21.15.79:0/2998565104 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56740e9ae0 0x7f567409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:31.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679125700 1 -- 172.21.15.79:0/2998565104 >> v1:172.21.15.89:6789/0 conn(0x7f56741c8010 legacy=0x7f56741ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:31.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679125700 1 -- 172.21.15.79:0/2998565104 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56740e4330 con 0x7f56740f5520 2021-04-09T18:34:31.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679125700 1 -- 172.21.15.79:0/2998565104 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f5670001bb0 con 0x7f56740f5520 2021-04-09T18:34:31.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679125700 1 -- 172.21.15.79:0/2998565104 >> v1:172.21.15.79:6789/0 conn(0x7f56740f5520 legacy=0x7f56740f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:31.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679125700 1 --2- 172.21.15.79:0/2998565104 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56600038f0 0x7f5660003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:31.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679125700 1 --2- 172.21.15.79:0/2998565104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56600045a0 0x7f56600049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:31.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679125700 1 --2- 172.21.15.79:0/2998565104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5660005070 0x7f566000b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:31.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679125700 1 -- 172.21.15.79:0/2998565104 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56741c3dc0 con 0x7f56600045a0 2021-04-09T18:34:31.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679125700 1 -- 172.21.15.79:0/2998565104 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566000bf60 con 0x7f5660005070 2021-04-09T18:34:31.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679926700 1 --2- 172.21.15.79:0/2998565104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56600045a0 0x7f56600049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:31.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679125700 1 -- 172.21.15.79:0/2998565104 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5660050170 con 0x7f56600038f0 2021-04-09T18:34:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f567a127700 1 --2- 172.21.15.79:0/2998565104 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56600038f0 0x7f5660003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f567a928700 1 --2- 172.21.15.79:0/2998565104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5660005070 0x7f566000b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679926700 1 -- 172.21.15.79:0/2998565104 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56600038f0 msgr2=0x7f5660003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:31.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679926700 1 --2- 172.21.15.79:0/2998565104 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56600038f0 0x7f5660003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:31.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679926700 1 -- 172.21.15.79:0/2998565104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5660005070 msgr2=0x7f566000b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:31.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679926700 1 --2- 172.21.15.79:0/2998565104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5660005070 0x7f566000b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:31.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679926700 1 -- 172.21.15.79:0/2998565104 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5660050460 con 0x7f56600045a0 2021-04-09T18:34:31.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f567a928700 1 --2- 172.21.15.79:0/2998565104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5660005070 0x7f566000b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:31.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679926700 1 --2- 172.21.15.79:0/2998565104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56600045a0 0x7f56600049f0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f566400c000 tx=0x7f566400e1d0).ready entity=mon.0 client_cookie=fc2288148da1a830 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:31.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679125700 1 -- 172.21.15.79:0/2998565104 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5660050460 con 0x7f56600045a0 2021-04-09T18:34:31.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679125700 1 -- 172.21.15.79:0/2998565104 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566400ec90 con 0x7f56600045a0 2021-04-09T18:34:31.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f5679125700 1 -- 172.21.15.79:0/2998565104 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f566400f040 con 0x7f56600045a0 2021-04-09T18:34:31.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f567c383700 1 -- 172.21.15.79:0/2998565104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56600045a0 msgr2=0x7f56600049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:31.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f567c383700 1 --2- 172.21.15.79:0/2998565104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56600045a0 0x7f56600049f0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f566400c000 tx=0x7f566400e1d0).stop 2021-04-09T18:34:31.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f567a928700 1 -- 172.21.15.79:0/2998565104 reap_dead start 2021-04-09T18:34:31.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f567c383700 1 -- 172.21.15.79:0/2998565104 shutdown_connections 2021-04-09T18:34:31.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f567c383700 1 -- 172.21.15.79:0/2998565104 >> 172.21.15.79:0/2998565104 conn(0x7f56740e5fe0 msgr2=0x7f56740e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:31.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f567c383700 1 -- 172.21.15.79:0/2998565104 shutdown_connections 2021-04-09T18:34:31.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.951 7f567c383700 1 -- 172.21.15.79:0/2998565104 wait complete. 2021-04-09T18:34:31.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.955 7f567c383700 1 Processor -- start 2021-04-09T18:34:31.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.955 7f567c383700 1 -- start start 2021-04-09T18:34:31.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.955 7f567c383700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56740b47a0 0x7f5674097930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:31.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.955 7f567c383700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5674097f60 0x7f56740c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:31.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.955 7f567c383700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56740c4d00 0x7f56740bd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:31.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.955 7f567c383700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5670001150 con 0x7f5674097f60 2021-04-09T18:34:31.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.955 7f567c383700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56740e9f30 con 0x7f56740c4d00 2021-04-09T18:34:31.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.955 7f567c383700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5674099310 con 0x7f56740b47a0 2021-04-09T18:34:31.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.955 7f5679926700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5674097f60 0x7f56740c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:31.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.955 7f5679926700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5674097f60 0x7f56740c46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34046/0 (socket says 172.21.15.79:34046) 2021-04-09T18:34:31.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.955 7f5679926700 1 -- 172.21.15.79:0/518544433 learned_addr learned my addr 172.21.15.79:0/518544433 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:31.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.955 7f567a928700 1 --2- 172.21.15.79:0/518544433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56740c4d00 0x7f56740bd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:31.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.955 7f567a127700 1 --2- 172.21.15.79:0/518544433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56740b47a0 0x7f5674097930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:31.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.959 7f5679926700 1 -- 172.21.15.79:0/518544433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56740b47a0 msgr2=0x7f5674097930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:31.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.959 7f5679926700 1 --2- 172.21.15.79:0/518544433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56740b47a0 0x7f5674097930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:31.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.959 7f5679926700 1 -- 172.21.15.79:0/518544433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56740c4d00 msgr2=0x7f56740bd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:31.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.959 7f5679926700 1 --2- 172.21.15.79:0/518544433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56740c4d00 0x7f56740bd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:31.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.959 7f5679926700 1 -- 172.21.15.79:0/518544433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5674098ba0 con 0x7f5674097f60 2021-04-09T18:34:31.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.959 7f567a928700 1 --2- 172.21.15.79:0/518544433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56740c4d00 0x7f56740bd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:31.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.959 7f5679926700 1 --2- 172.21.15.79:0/518544433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5674097f60 0x7f56740c46d0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f56740bfe30 tx=0x7f566400a040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:31.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.959 7f566affd700 1 -- 172.21.15.79:0/518544433 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5674098ba0 con 0x7f5674097f60 2021-04-09T18:34:31.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.959 7f566affd700 1 -- 172.21.15.79:0/518544433 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5664021030 con 0x7f5674097f60 2021-04-09T18:34:31.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.959 7f567c383700 1 -- 172.21.15.79:0/518544433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56740b4bf0 con 0x7f5674097f60 2021-04-09T18:34:31.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.959 7f566affd700 1 -- 172.21.15.79:0/518544433 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f566401c5f0 con 0x7f5674097f60 2021-04-09T18:34:31.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.959 7f567c383700 1 -- 172.21.15.79:0/518544433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5674098ec0 con 0x7f5674097f60 2021-04-09T18:34:31.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.959 7f566affd700 1 -- 172.21.15.79:0/518544433 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5664023020 con 0x7f5674097f60 2021-04-09T18:34:31.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.959 7f566affd700 1 --2- 172.21.15.79:0/518544433 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f565c029100 0x7f565c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:31.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.959 7f566affd700 1 -- 172.21.15.79:0/518544433 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f5664010040 con 0x7f5674097f60 2021-04-09T18:34:31.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.959 7f567a127700 1 --2- 172.21.15.79:0/518544433 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f565c029100 0x7f565c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:31.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.959 7f567a127700 1 --2- 172.21.15.79:0/518544433 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f565c029100 0x7f565c02b650 crc :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:31.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.963 7f567c383700 1 -- 172.21.15.79:0/518544433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56740e39e0 con 0x7f5674097f60 2021-04-09T18:34:31.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:31.971 7f566affd700 1 -- 172.21.15.79:0/518544433 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f566400e890 con 0x7f5674097f60 2021-04-09T18:34:32.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.131 7f567c383700 1 -- 172.21.15.79:0/518544433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56740f5b20 con 0x7f5674097f60 2021-04-09T18:34:32.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.131 7f566affd700 1 -- 172.21.15.79:0/518544433 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+14251 (secure 0 0 0) 0x7f5664012db0 con 0x7f5674097f60 2021-04-09T18:34:32.139 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:32.139 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":105,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:34:31.841327","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:34:30.061943","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2021-04-09 18:34:30.884154","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:34:32.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.135 7f567c383700 1 -- 172.21.15.79:0/518544433 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f565c029100 msgr2=0x7f565c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.135 7f567c383700 1 --2- 172.21.15.79:0/518544433 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f565c029100 0x7f565c02b650 crc :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.135 7f567c383700 1 -- 172.21.15.79:0/518544433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5674097f60 msgr2=0x7f56740c46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.135 7f567c383700 1 --2- 172.21.15.79:0/518544433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5674097f60 0x7f56740c46d0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f56740bfe30 tx=0x7f566400a040).stop 2021-04-09T18:34:32.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.135 7f567c383700 1 -- 172.21.15.79:0/518544433 shutdown_connections 2021-04-09T18:34:32.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.135 7f567c383700 1 --2- 172.21.15.79:0/518544433 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f565c029100 0x7f565c02b650 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.135 7f567c383700 1 --2- 172.21.15.79:0/518544433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56740c4d00 0x7f56740bd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.135 7f567c383700 1 --2- 172.21.15.79:0/518544433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56740b47a0 0x7f5674097930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.135 7f567c383700 1 --2- 172.21.15.79:0/518544433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5674097f60 0x7f56740c46d0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.135 7f567c383700 1 -- 172.21.15.79:0/518544433 >> 172.21.15.79:0/518544433 conn(0x7f56740a78b0 msgr2=0x7f56740c03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:32.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.135 7f567c383700 1 -- 172.21.15.79:0/518544433 shutdown_connections 2021-04-09T18:34:32.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.135 7f567c383700 1 -- 172.21.15.79:0/518544433 wait complete. 2021-04-09T18:34:32.152 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:34:32.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.243 7f6aa5c99700 1 Processor -- start 2021-04-09T18:34:32.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.243 7f6aa5c99700 1 -- start start 2021-04-09T18:34:32.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.243 7f6aa5c99700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6aa00e9ad0 0x7f6aa009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:32.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6aa5c99700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa00fbb10 con 0x7f6aa01c8000 2021-04-09T18:34:32.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6aa5c99700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa00e56c0 con 0x7f6aa00f5510 2021-04-09T18:34:32.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6aa5c99700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa01c3db0 con 0x7f6aa00e9ad0 2021-04-09T18:34:32.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6a9ffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6aa01c8000 0x7f6aa01ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56998/0 (socket says 172.21.15.79:56998) 2021-04-09T18:34:32.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6a9ffff700 1 -- 172.21.15.79:0/1740624343 learned_addr learned my addr 172.21.15.79:0/1740624343 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:32.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6a9effd700 1 --2- 172.21.15.79:0/1740624343 >> v2:172.21.15.89:3300/0 conn(0x7f6aa00e9ad0 0x7f6aa009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:32.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6a9e7fc700 1 -- 172.21.15.79:0/1740624343 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925563731 0 0) 0x7f6a980010d0 con 0x7f6aa01c8000 2021-04-09T18:34:32.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6a9e7fc700 1 -- 172.21.15.79:0/1740624343 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a88003240 con 0x7f6aa01c8000 2021-04-09T18:34:32.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6a9effd700 1 -- 172.21.15.79:0/1740624343 >> v1:172.21.15.89:6789/0 conn(0x7f6aa00f5510 legacy=0x7f6aa00f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6a9effd700 1 -- 172.21.15.79:0/1740624343 >> v1:172.21.15.79:6789/0 conn(0x7f6aa01c8000 legacy=0x7f6aa01ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6a9effd700 1 -- 172.21.15.79:0/1740624343 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa00e4320 con 0x7f6aa00e9ad0 2021-04-09T18:34:32.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6a9effd700 1 --2- 172.21.15.79:0/1740624343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aa00e9ad0 0x7f6aa009f100 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f6a940032b0 tx=0x7f6a9400b0e0).ready entity=mon.1 client_cookie=cf693b5dcdcfa86a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:32.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6a9e7fc700 1 -- 172.21.15.79:0/1740624343 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6aa00e4320 con 0x7f6aa00e9ad0 2021-04-09T18:34:32.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6a9e7fc700 1 -- 172.21.15.79:0/1740624343 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9400bab0 con 0x7f6aa00e9ad0 2021-04-09T18:34:32.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6a9e7fc700 1 -- 172.21.15.79:0/1740624343 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6a94002020 con 0x7f6aa00e9ad0 2021-04-09T18:34:32.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6aa5c99700 1 -- 172.21.15.79:0/1740624343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aa00e9ad0 msgr2=0x7f6aa009f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6aa5c99700 1 --2- 172.21.15.79:0/1740624343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aa00e9ad0 0x7f6aa009f100 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f6a940032b0 tx=0x7f6a9400b0e0).stop 2021-04-09T18:34:32.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6aa5c99700 1 -- 172.21.15.79:0/1740624343 shutdown_connections 2021-04-09T18:34:32.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6aa5c99700 1 --2- 172.21.15.79:0/1740624343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aa00e9ad0 0x7f6aa009f100 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6aa5c99700 1 -- 172.21.15.79:0/1740624343 >> 172.21.15.79:0/1740624343 conn(0x7f6aa00e5fd0 msgr2=0x7f6aa00e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:32.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6aa5c99700 1 -- 172.21.15.79:0/1740624343 shutdown_connections 2021-04-09T18:34:32.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.247 7f6aa5c99700 1 -- 172.21.15.79:0/1740624343 wait complete. 2021-04-09T18:34:32.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.251 7f6aa5c99700 1 Processor -- start 2021-04-09T18:34:32.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.251 7f6aa5c99700 1 -- start start 2021-04-09T18:34:32.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.251 7f6aa5c99700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6aa019b9d0 0x7f6aa00b96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:32.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.251 7f6aa5c99700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa0098d50 0x7f6aa00991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:32.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.251 7f6aa5c99700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aa01ad6d0 0x7f6aa01adb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:32.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.251 7f6aa5c99700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa00e9f20 con 0x7f6aa0098d50 2021-04-09T18:34:32.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.251 7f6aa5c99700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa0098a50 con 0x7f6aa01ad6d0 2021-04-09T18:34:32.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.251 7f6aa5c99700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa00a35d0 con 0x7f6aa019b9d0 2021-04-09T18:34:32.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.251 7f6a9effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa0098d50 0x7f6aa00991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:32.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.251 7f6a9effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa0098d50 0x7f6aa00991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34060/0 (socket says 172.21.15.79:34060) 2021-04-09T18:34:32.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.251 7f6a9effd700 1 -- 172.21.15.79:0/2628081414 learned_addr learned my addr 172.21.15.79:0/2628081414 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:32.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.251 7f6a9ffff700 1 --2- 172.21.15.79:0/2628081414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aa01ad6d0 0x7f6aa01adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.251 7f6a9f7fe700 1 --2- 172.21.15.79:0/2628081414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6aa019b9d0 0x7f6aa00b96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.255 7f6a9effd700 1 -- 172.21.15.79:0/2628081414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6aa019b9d0 msgr2=0x7f6aa00b96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.255 7f6a9effd700 1 --2- 172.21.15.79:0/2628081414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6aa019b9d0 0x7f6aa00b96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.255 7f6a9effd700 1 -- 172.21.15.79:0/2628081414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aa01ad6d0 msgr2=0x7f6aa01adb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.255 7f6a9effd700 1 --2- 172.21.15.79:0/2628081414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aa01ad6d0 0x7f6aa01adb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.255 7f6a9effd700 1 -- 172.21.15.79:0/2628081414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa00b9cf0 con 0x7f6aa0098d50 2021-04-09T18:34:32.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.255 7f6a9effd700 1 --2- 172.21.15.79:0/2628081414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa0098d50 0x7f6aa00991a0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f6aa0096ad0 tx=0x7f6a94006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:32.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.255 7f6a87fff700 1 -- 172.21.15.79:0/2628081414 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6aa00b9cf0 con 0x7f6aa0098d50 2021-04-09T18:34:32.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.255 7f6a87fff700 1 -- 172.21.15.79:0/2628081414 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9401f020 con 0x7f6aa0098d50 2021-04-09T18:34:32.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.255 7f6aa5c99700 1 -- 172.21.15.79:0/2628081414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa00985e0 con 0x7f6aa0098d50 2021-04-09T18:34:32.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.255 7f6a87fff700 1 -- 172.21.15.79:0/2628081414 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6a9401b830 con 0x7f6aa0098d50 2021-04-09T18:34:32.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.255 7f6aa5c99700 1 -- 172.21.15.79:0/2628081414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa019bfb0 con 0x7f6aa0098d50 2021-04-09T18:34:32.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.255 7f6a87fff700 1 -- 172.21.15.79:0/2628081414 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6a94009ce0 con 0x7f6aa0098d50 2021-04-09T18:34:32.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.255 7f6a87fff700 1 --2- 172.21.15.79:0/2628081414 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6a80029100 0x7f6a8002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:32.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.255 7f6a87fff700 1 -- 172.21.15.79:0/2628081414 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f6a9403bad0 con 0x7f6aa0098d50 2021-04-09T18:34:32.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.255 7f6a9f7fe700 1 --2- 172.21.15.79:0/2628081414 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6a80029100 0x7f6a8002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:32.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.255 7f6a9f7fe700 1 --2- 172.21.15.79:0/2628081414 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6a80029100 0x7f6a8002b650 crc :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:32.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.259 7f6aa5c99700 1 -- 172.21.15.79:0/2628081414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa00e39d0 con 0x7f6aa0098d50 2021-04-09T18:34:32.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.267 7f6a87fff700 1 -- 172.21.15.79:0/2628081414 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6a9401b430 con 0x7f6aa0098d50 2021-04-09T18:34:32.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.439 7f6aa5c99700 1 -- 172.21.15.79:0/2628081414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6aa00a1cb0 con 0x7f6aa0098d50 2021-04-09T18:34:32.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.439 7f6a87fff700 1 -- 172.21.15.79:0/2628081414 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+14371 (secure 0 0 0) 0x7f6a94035840 con 0x7f6aa0098d50 2021-04-09T18:34:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:32.448 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":107,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:34:32.295460","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:34:30.061943","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2021-04-09 18:34:30.884154","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.79:6833/1349682878":"2021-04-10 18:34:32.282358","172.21.15.79:6832/1349682878":"2021-04-10 18:34:32.282358"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:34:32.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.443 7f6aa5c99700 1 -- 172.21.15.79:0/2628081414 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6a80029100 msgr2=0x7f6a8002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.443 7f6aa5c99700 1 --2- 172.21.15.79:0/2628081414 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6a80029100 0x7f6a8002b650 crc :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.443 7f6aa5c99700 1 -- 172.21.15.79:0/2628081414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa0098d50 msgr2=0x7f6aa00991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.443 7f6aa5c99700 1 --2- 172.21.15.79:0/2628081414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa0098d50 0x7f6aa00991a0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f6aa0096ad0 tx=0x7f6a94006c10).stop 2021-04-09T18:34:32.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.443 7f6aa5c99700 1 -- 172.21.15.79:0/2628081414 shutdown_connections 2021-04-09T18:34:32.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.443 7f6aa5c99700 1 --2- 172.21.15.79:0/2628081414 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6a80029100 0x7f6a8002b650 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.443 7f6aa5c99700 1 --2- 172.21.15.79:0/2628081414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aa01ad6d0 0x7f6aa01adb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.443 7f6aa5c99700 1 --2- 172.21.15.79:0/2628081414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6aa019b9d0 0x7f6aa00b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.443 7f6aa5c99700 1 --2- 172.21.15.79:0/2628081414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa0098d50 0x7f6aa00991a0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.443 7f6aa5c99700 1 -- 172.21.15.79:0/2628081414 >> 172.21.15.79:0/2628081414 conn(0x7f6aa00ba870 msgr2=0x7f6aa00d85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:32.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.443 7f6aa5c99700 1 -- 172.21.15.79:0/2628081414 shutdown_connections 2021-04-09T18:34:32.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.443 7f6aa5c99700 1 -- 172.21.15.79:0/2628081414 wait complete. 2021-04-09T18:34:32.461 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-04-09T18:34:32.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.555 7f4d5740d700 1 Processor -- start 2021-04-09T18:34:32.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d5740d700 1 -- start start 2021-04-09T18:34:32.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d5740d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4d501c9050 0x7f4d501cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:32.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d5740d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d500fbb50 con 0x7f4d500f5550 2021-04-09T18:34:32.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d5740d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5009f910 con 0x7f4d500e9b10 2021-04-09T18:34:32.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d5740d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d501c3df0 con 0x7f4d501c9050 2021-04-09T18:34:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d551b1700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4d500f5550 0x7f4d500f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57008/0 (socket says 172.21.15.79:57008) 2021-04-09T18:34:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d551b1700 1 -- 172.21.15.79:0/922533187 learned_addr learned my addr 172.21.15.79:0/922533187 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d559b2700 1 --2- 172.21.15.79:0/922533187 >> v2:172.21.15.89:3300/0 conn(0x7f4d501c9050 0x7f4d501cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d43fff700 1 -- 172.21.15.79:0/922533187 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943398499 0 0) 0x7f4d4c0010d0 con 0x7f4d500f5550 2021-04-09T18:34:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d43fff700 1 -- 172.21.15.79:0/922533187 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d3c003240 con 0x7f4d500f5550 2021-04-09T18:34:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d43fff700 1 -- 172.21.15.79:0/922533187 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1725098382 0 0) 0x7f4d44001450 con 0x7f4d500e9b10 2021-04-09T18:34:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d43fff700 1 -- 172.21.15.79:0/922533187 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d3c004680 con 0x7f4d500e9b10 2021-04-09T18:34:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d43fff700 1 -- 172.21.15.79:0/922533187 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3853110366 0 0) 0x7f4d4c001650 con 0x7f4d500f5550 2021-04-09T18:34:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d559b2700 1 -- 172.21.15.79:0/922533187 >> v1:172.21.15.89:6789/0 conn(0x7f4d500e9b10 legacy=0x7f4d5009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d559b2700 1 -- 172.21.15.79:0/922533187 >> v1:172.21.15.79:6789/0 conn(0x7f4d500f5550 legacy=0x7f4d500f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d559b2700 1 -- 172.21.15.79:0/922533187 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d500e5700 con 0x7f4d501c9050 2021-04-09T18:34:32.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d559b2700 1 --2- 172.21.15.79:0/922533187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d501c9050 0x7f4d501cb4b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f4d4c001980 tx=0x7f4d4800bcc0).ready entity=mon.1 client_cookie=24061c6a0a4f1ce4 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:32.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d43fff700 1 -- 172.21.15.79:0/922533187 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d500e5700 con 0x7f4d501c9050 2021-04-09T18:34:32.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d43fff700 1 -- 172.21.15.79:0/922533187 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d480096c0 con 0x7f4d501c9050 2021-04-09T18:34:32.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d43fff700 1 -- 172.21.15.79:0/922533187 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d4c001bb0 con 0x7f4d501c9050 2021-04-09T18:34:32.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d5740d700 1 -- 172.21.15.79:0/922533187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d501c9050 msgr2=0x7f4d501cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.559 7f4d5740d700 1 --2- 172.21.15.79:0/922533187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d501c9050 0x7f4d501cb4b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f4d4c001980 tx=0x7f4d4800bcc0).stop 2021-04-09T18:34:32.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.563 7f4d5740d700 1 -- 172.21.15.79:0/922533187 shutdown_connections 2021-04-09T18:34:32.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.563 7f4d5740d700 1 --2- 172.21.15.79:0/922533187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d501c9050 0x7f4d501cb4b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.563 7f4d5740d700 1 -- 172.21.15.79:0/922533187 >> 172.21.15.79:0/922533187 conn(0x7f4d500e6010 msgr2=0x7f4d500e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:32.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.563 7f4d5740d700 1 -- 172.21.15.79:0/922533187 shutdown_connections 2021-04-09T18:34:32.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.563 7f4d5740d700 1 -- 172.21.15.79:0/922533187 wait complete. 2021-04-09T18:34:32.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.563 7f4d5740d700 1 Processor -- start 2021-04-09T18:34:32.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.563 7f4d5740d700 1 -- start start 2021-04-09T18:34:32.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d5740d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d50097780 0x7f4d50098d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:32.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d5740d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d501b18b0 0x7f4d501b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:32.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d5740d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d501b2330 0x7f4d501ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:32.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d5740d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d500e9f60 con 0x7f4d501b18b0 2021-04-09T18:34:32.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d5740d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d500a35f0 con 0x7f4d50097780 2021-04-09T18:34:32.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d5740d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d500a7cf0 con 0x7f4d501b2330 2021-04-09T18:34:32.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d549b0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d501b18b0 0x7f4d501b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:32.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d549b0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d501b18b0 0x7f4d501b1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34074/0 (socket says 172.21.15.79:34074) 2021-04-09T18:34:32.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d549b0700 1 -- 172.21.15.79:0/522140284 learned_addr learned my addr 172.21.15.79:0/522140284 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:32.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d551b1700 1 --2- 172.21.15.79:0/522140284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d50097780 0x7f4d50098d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:32.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d559b2700 1 --2- 172.21.15.79:0/522140284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d501b2330 0x7f4d501ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:32.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d549b0700 1 -- 172.21.15.79:0/522140284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d501b2330 msgr2=0x7f4d501ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d549b0700 1 --2- 172.21.15.79:0/522140284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d501b2330 0x7f4d501ad7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d549b0700 1 -- 172.21.15.79:0/522140284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d50097780 msgr2=0x7f4d50098d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d549b0700 1 --2- 172.21.15.79:0/522140284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d50097780 0x7f4d50098d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d549b0700 1 -- 172.21.15.79:0/522140284 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d50096f50 con 0x7f4d501b18b0 2021-04-09T18:34:32.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d549b0700 1 --2- 172.21.15.79:0/522140284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d501b18b0 0x7f4d501b1d00 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7f4d44000f00 tx=0x7f4d4400ce30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:32.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d41ffb700 1 -- 172.21.15.79:0/522140284 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d50096f50 con 0x7f4d501b18b0 2021-04-09T18:34:32.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d41ffb700 1 -- 172.21.15.79:0/522140284 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4400a650 con 0x7f4d501b18b0 2021-04-09T18:34:32.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d41ffb700 1 -- 172.21.15.79:0/522140284 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d4400a830 con 0x7f4d501b18b0 2021-04-09T18:34:32.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d5740d700 1 -- 172.21.15.79:0/522140284 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d501b2780 con 0x7f4d501b18b0 2021-04-09T18:34:32.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d5740d700 1 -- 172.21.15.79:0/522140284 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d501adf70 con 0x7f4d501b18b0 2021-04-09T18:34:32.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d41ffb700 1 -- 172.21.15.79:0/522140284 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4d44019020 con 0x7f4d501b18b0 2021-04-09T18:34:32.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d41ffb700 1 --2- 172.21.15.79:0/522140284 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d30029100 0x7f4d3002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:32.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.567 7f4d41ffb700 1 -- 172.21.15.79:0/522140284 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f4d44039130 con 0x7f4d501b18b0 2021-04-09T18:34:32.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.571 7f4d551b1700 1 --2- 172.21.15.79:0/522140284 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d30029100 0x7f4d3002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:32.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.571 7f4d551b1700 1 --2- 172.21.15.79:0/522140284 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d30029100 0x7f4d3002b650 crc :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:32.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.571 7f4d5740d700 1 -- 172.21.15.79:0/522140284 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d500e39f0 con 0x7f4d501b18b0 2021-04-09T18:34:32.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.579 7f4d41ffb700 1 -- 172.21.15.79:0/522140284 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4d4400a440 con 0x7f4d501b18b0 2021-04-09T18:34:32.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.747 7f4d5740d700 1 -- 172.21.15.79:0/522140284 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f4d500a1c90 con 0x7f4d501b18b0 2021-04-09T18:34:32.846 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:34:32.843 7fbcd0516700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:34:32.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.851 7f4d41ffb700 1 -- 172.21.15.79:0/522140284 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v66) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4d500e5cd0 con 0x7f4d501b18b0 2021-04-09T18:34:32.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.867 7f4d5740d700 1 -- 172.21.15.79:0/522140284 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d30029100 msgr2=0x7f4d3002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.867 7f4d5740d700 1 --2- 172.21.15.79:0/522140284 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d30029100 0x7f4d3002b650 crc :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.867 7f4d5740d700 1 -- 172.21.15.79:0/522140284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d501b18b0 msgr2=0x7f4d501b1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.867 7f4d5740d700 1 --2- 172.21.15.79:0/522140284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d501b18b0 0x7f4d501b1d00 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7f4d44000f00 tx=0x7f4d4400ce30).stop 2021-04-09T18:34:32.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.871 7f4d5740d700 1 -- 172.21.15.79:0/522140284 shutdown_connections 2021-04-09T18:34:32.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.871 7f4d5740d700 1 --2- 172.21.15.79:0/522140284 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d30029100 0x7f4d3002b650 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.871 7f4d5740d700 1 --2- 172.21.15.79:0/522140284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d50097780 0x7f4d50098d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.871 7f4d5740d700 1 --2- 172.21.15.79:0/522140284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d501b2330 0x7f4d501ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.871 7f4d5740d700 1 --2- 172.21.15.79:0/522140284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d501b18b0 0x7f4d501b1d00 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.871 7f4d5740d700 1 -- 172.21.15.79:0/522140284 >> 172.21.15.79:0/522140284 conn(0x7f4d500ba7b0 msgr2=0x7f4d500d8510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:32.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.871 7f4d5740d700 1 -- 172.21.15.79:0/522140284 shutdown_connections 2021-04-09T18:34:32.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.871 7f4d5740d700 1 -- 172.21.15.79:0/522140284 wait complete. 2021-04-09T18:34:32.888 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:34:32.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.967 7f4959e10700 1 Processor -- start 2021-04-09T18:34:32.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.967 7f4959e10700 1 -- start start 2021-04-09T18:34:32.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.967 7f4959e10700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49541c9010 0x7f49541cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:32.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.967 7f4959e10700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49540fbb10 con 0x7f49540e9ad0 2021-04-09T18:34:32.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.967 7f4959e10700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f495409f900 con 0x7f49540f5510 2021-04-09T18:34:32.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.967 7f4959e10700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49541c3db0 con 0x7f49541c9010 2021-04-09T18:34:32.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.967 7f4952ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f49540e9ad0 0x7f495409f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57034/0 (socket says 172.21.15.79:57034) 2021-04-09T18:34:32.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.967 7f4952ffd700 1 -- 172.21.15.79:0/336935737 learned_addr learned my addr 172.21.15.79:0/336935737 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:32.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.967 7f4953fff700 1 --2- 172.21.15.79:0/336935737 >> v2:172.21.15.89:3300/0 conn(0x7f49541c9010 0x7f49541cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:32.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.967 7f4953fff700 1 -- 172.21.15.79:0/336935737 >> v1:172.21.15.89:6789/0 conn(0x7f49540f5510 legacy=0x7f49540f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.967 7f4953fff700 1 -- 172.21.15.79:0/336935737 >> v1:172.21.15.79:6789/0 conn(0x7f49540e9ad0 legacy=0x7f495409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.967 7f49527fc700 1 -- 172.21.15.79:0/336935737 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807706062 0 0) 0x7f493c0010d0 con 0x7f49540e9ad0 2021-04-09T18:34:32.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.967 7f4953fff700 1 -- 172.21.15.79:0/336935737 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49540e56c0 con 0x7f49541c9010 2021-04-09T18:34:32.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.967 7f4953fff700 1 --2- 172.21.15.79:0/336935737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49541c9010 0x7f49541cb470 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f494c0032b0 tx=0x7f494c00b0e0).ready entity=mon.1 client_cookie=4ca4d0dbfe8648cf server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:32.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.967 7f49527fc700 1 -- 172.21.15.79:0/336935737 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f49540e56c0 con 0x7f49541c9010 2021-04-09T18:34:32.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.967 7f49527fc700 1 -- 172.21.15.79:0/336935737 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494c00bab0 con 0x7f49541c9010 2021-04-09T18:34:32.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.967 7f4959e10700 1 -- 172.21.15.79:0/336935737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49541c9010 msgr2=0x7f49541cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.967 7f4959e10700 1 --2- 172.21.15.79:0/336935737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49541c9010 0x7f49541cb470 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f494c0032b0 tx=0x7f494c00b0e0).stop 2021-04-09T18:34:32.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.971 7f4959e10700 1 -- 172.21.15.79:0/336935737 shutdown_connections 2021-04-09T18:34:32.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.971 7f4959e10700 1 --2- 172.21.15.79:0/336935737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49541c9010 0x7f49541cb470 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.971 7f4959e10700 1 -- 172.21.15.79:0/336935737 >> 172.21.15.79:0/336935737 conn(0x7f49540e5fd0 msgr2=0x7f49540e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:32.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.971 7f4959e10700 1 -- 172.21.15.79:0/336935737 shutdown_connections 2021-04-09T18:34:32.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.971 7f4959e10700 1 -- 172.21.15.79:0/336935737 wait complete. 2021-04-09T18:34:32.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.971 7f4959e10700 1 Processor -- start 2021-04-09T18:34:32.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.971 7f4959e10700 1 -- start start 2021-04-09T18:34:32.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.971 7f4959e10700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49540c0070 0x7f49540c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:32.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.971 7f4959e10700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49540c1110 0x7f49541d2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:32.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.971 7f4959e10700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49541d30a0 0x7f49540939b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:32.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.971 7f4959e10700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49540e9f20 con 0x7f49540c0070 2021-04-09T18:34:32.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.971 7f4959e10700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49540c07e0 con 0x7f49541d30a0 2021-04-09T18:34:32.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.971 7f4959e10700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49540c04c0 con 0x7f49540c1110 2021-04-09T18:34:32.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.971 7f49537fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49540c0070 0x7f49540c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:32.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.971 7f49537fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49540c0070 0x7f49540c0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34096/0 (socket says 172.21.15.79:34096) 2021-04-09T18:34:32.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.971 7f49537fe700 1 -- 172.21.15.79:0/3299461458 learned_addr learned my addr 172.21.15.79:0/3299461458 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:32.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.971 7f4952ffd700 1 --2- 172.21.15.79:0/3299461458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49540c1110 0x7f49541d2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:32.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.971 7f4953fff700 1 --2- 172.21.15.79:0/3299461458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49541d30a0 0x7f49540939b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:32.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.975 7f49537fe700 1 -- 172.21.15.79:0/3299461458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49540c1110 msgr2=0x7f49541d2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.975 7f49537fe700 1 --2- 172.21.15.79:0/3299461458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49540c1110 0x7f49541d2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.975 7f49537fe700 1 -- 172.21.15.79:0/3299461458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49541d30a0 msgr2=0x7f49540939b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:32.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.975 7f49537fe700 1 --2- 172.21.15.79:0/3299461458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49541d30a0 0x7f49540939b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:32.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.975 7f49537fe700 1 -- 172.21.15.79:0/3299461458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49541d6b40 con 0x7f49540c0070 2021-04-09T18:34:32.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.975 7f4953fff700 1 --2- 172.21.15.79:0/3299461458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49541d30a0 0x7f49540939b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:32.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.975 7f49537fe700 1 --2- 172.21.15.79:0/3299461458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49540c0070 0x7f49540c0ae0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f49540d7b20 tx=0x7f494400cb10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:32.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.975 7f494bfff700 1 -- 172.21.15.79:0/3299461458 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f49541d6b40 con 0x7f49540c0070 2021-04-09T18:34:32.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.975 7f494bfff700 1 -- 172.21.15.79:0/3299461458 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494400e4a0 con 0x7f49540c0070 2021-04-09T18:34:32.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.975 7f4959e10700 1 -- 172.21.15.79:0/3299461458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4954093fe0 con 0x7f49540c0070 2021-04-09T18:34:32.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.975 7f494bfff700 1 -- 172.21.15.79:0/3299461458 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f494400e870 con 0x7f49540c0070 2021-04-09T18:34:32.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.975 7f4959e10700 1 -- 172.21.15.79:0/3299461458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49540944e0 con 0x7f49540c0070 2021-04-09T18:34:32.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.975 7f494bfff700 1 -- 172.21.15.79:0/3299461458 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f494401a020 con 0x7f49540c0070 2021-04-09T18:34:32.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.975 7f494bfff700 1 --2- 172.21.15.79:0/3299461458 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4938029100 0x7f493802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:32.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.975 7f494bfff700 1 -- 172.21.15.79:0/3299461458 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f4944039320 con 0x7f49540c0070 2021-04-09T18:34:32.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.975 7f4952ffd700 1 --2- 172.21.15.79:0/3299461458 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4938029100 0x7f493802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:32.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.975 7f4952ffd700 1 --2- 172.21.15.79:0/3299461458 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4938029100 0x7f493802b650 crc :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:32.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.983 7f4959e10700 1 -- 172.21.15.79:0/3299461458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49540e39d0 con 0x7f49540c0070 2021-04-09T18:34:32.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:32.987 7f494bfff700 1 -- 172.21.15.79:0/3299461458 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f494400e290 con 0x7f49540c0070 2021-04-09T18:34:33.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.151 7f4959e10700 1 -- 172.21.15.79:0/3299461458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49540a1cb0 con 0x7f49540c0070 2021-04-09T18:34:33.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.155 7f494bfff700 1 -- 172.21.15.79:0/3299461458 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2106 (secure 0 0 0) 0x7f4944000bf0 con 0x7f49540c0070 2021-04-09T18:34:33.161 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:33.161 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":67,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7456,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/128870944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":128870944},{"type":"v1","addr":"172.21.15.89:6835","nonce":128870944}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":66}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:34:31.841744","modified":"2021-04-09 18:34:32.857003","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7452":{"gid":7452,"name":"a","rank":0,"incarnation":67,"state":"up:creating","state_seq":2,"addr":"172.21.15.79:6833/1381942487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1381942487},{"type":"v1","addr":"172.21.15.79:6833","nonce":1381942487}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-04-09T18:34:33.162 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 67 2021-04-09T18:34:33.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.159 7f4959e10700 1 -- 172.21.15.79:0/3299461458 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4938029100 msgr2=0x7f493802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:33.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.159 7f4959e10700 1 --2- 172.21.15.79:0/3299461458 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4938029100 0x7f493802b650 crc :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.159 7f4959e10700 1 -- 172.21.15.79:0/3299461458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49540c0070 msgr2=0x7f49540c0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:33.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.159 7f4959e10700 1 --2- 172.21.15.79:0/3299461458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49540c0070 0x7f49540c0ae0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f49540d7b20 tx=0x7f494400cb10).stop 2021-04-09T18:34:33.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.159 7f4959e10700 1 -- 172.21.15.79:0/3299461458 shutdown_connections 2021-04-09T18:34:33.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.159 7f4959e10700 1 --2- 172.21.15.79:0/3299461458 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4938029100 0x7f493802b650 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.159 7f4959e10700 1 --2- 172.21.15.79:0/3299461458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49541d30a0 0x7f49540939b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.159 7f4959e10700 1 --2- 172.21.15.79:0/3299461458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49540c0070 0x7f49540c0ae0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.159 7f4959e10700 1 --2- 172.21.15.79:0/3299461458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49540c1110 0x7f49541d2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.159 7f4959e10700 1 -- 172.21.15.79:0/3299461458 >> 172.21.15.79:0/3299461458 conn(0x7f495409b160 msgr2=0x7f4954097460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:33.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.159 7f4959e10700 1 -- 172.21.15.79:0/3299461458 shutdown_connections 2021-04-09T18:34:33.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.159 7f4959e10700 1 -- 172.21.15.79:0/3299461458 wait complete. 2021-04-09T18:34:33.174 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:34:33.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.259 7fd7cfae6700 1 Processor -- start 2021-04-09T18:34:33.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.259 7fd7cfae6700 1 -- start start 2021-04-09T18:34:33.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.259 7fd7cfae6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd7c81c9010 0x7fd7c81cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:33.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.259 7fd7cfae6700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c80fbb10 con 0x7fd7c80f5510 2021-04-09T18:34:33.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.259 7fd7cfae6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c809f900 con 0x7fd7c80e9ad0 2021-04-09T18:34:33.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.259 7fd7cfae6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c81c3db0 con 0x7fd7c81c9010 2021-04-09T18:34:33.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.259 7fd7cd88a700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd7c80f5510 0x7fd7c80f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57048/0 (socket says 172.21.15.79:57048) 2021-04-09T18:34:33.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.259 7fd7cd88a700 1 -- 172.21.15.79:0/1266242343 learned_addr learned my addr 172.21.15.79:0/1266242343 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:33.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.259 7fd7ce08b700 1 --2- 172.21.15.79:0/1266242343 >> v2:172.21.15.89:3300/0 conn(0x7fd7c81c9010 0x7fd7c81cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:33.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.263 7fd7cc888700 1 -- 172.21.15.79:0/1266242343 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799222302 0 0) 0x7fd7c40010d0 con 0x7fd7c80f5510 2021-04-09T18:34:33.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.263 7fd7cc888700 1 -- 172.21.15.79:0/1266242343 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7b4003240 con 0x7fd7c80f5510 2021-04-09T18:34:33.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.263 7fd7ce08b700 1 -- 172.21.15.79:0/1266242343 >> v1:172.21.15.89:6789/0 conn(0x7fd7c80e9ad0 legacy=0x7fd7c809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:33.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.263 7fd7cc888700 1 -- 172.21.15.79:0/1266242343 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436539000 0 0) 0x7fd7b80010d0 con 0x7fd7c80e9ad0 2021-04-09T18:34:33.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.263 7fd7ce08b700 1 -- 172.21.15.79:0/1266242343 >> v1:172.21.15.79:6789/0 conn(0x7fd7c80f5510 legacy=0x7fd7c80f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:33.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.263 7fd7ce08b700 1 -- 172.21.15.79:0/1266242343 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c80e56c0 con 0x7fd7c81c9010 2021-04-09T18:34:33.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.263 7fd7ce08b700 1 --2- 172.21.15.79:0/1266242343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c81c9010 0x7fd7c81cb470 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fd7c4001df0 tx=0x7fd7c000b0e0).ready entity=mon.1 client_cookie=4d951666379001a9 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:33.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.263 7fd7cc888700 1 -- 172.21.15.79:0/1266242343 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd7c80e56c0 con 0x7fd7c81c9010 2021-04-09T18:34:33.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.263 7fd7cc888700 1 -- 172.21.15.79:0/1266242343 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c000b9b0 con 0x7fd7c81c9010 2021-04-09T18:34:33.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.263 7fd7cc888700 1 -- 172.21.15.79:0/1266242343 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd7c0002020 con 0x7fd7c81c9010 2021-04-09T18:34:33.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.263 7fd7cfae6700 1 -- 172.21.15.79:0/1266242343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c81c9010 msgr2=0x7fd7c81cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:33.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.263 7fd7cfae6700 1 --2- 172.21.15.79:0/1266242343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c81c9010 0x7fd7c81cb470 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fd7c4001df0 tx=0x7fd7c000b0e0).stop 2021-04-09T18:34:33.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.263 7fd7cfae6700 1 -- 172.21.15.79:0/1266242343 shutdown_connections 2021-04-09T18:34:33.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.263 7fd7cfae6700 1 --2- 172.21.15.79:0/1266242343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c81c9010 0x7fd7c81cb470 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.263 7fd7cfae6700 1 -- 172.21.15.79:0/1266242343 >> 172.21.15.79:0/1266242343 conn(0x7fd7c80e5fd0 msgr2=0x7fd7c80e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:33.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.263 7fd7cfae6700 1 -- 172.21.15.79:0/1266242343 shutdown_connections 2021-04-09T18:34:33.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.263 7fd7cfae6700 1 -- 172.21.15.79:0/1266242343 wait complete. 2021-04-09T18:34:33.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7cfae6700 1 Processor -- start 2021-04-09T18:34:33.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7cfae6700 1 -- start start 2021-04-09T18:34:33.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7cfae6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c8091410 0x7fd7c80981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:33.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7cfae6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7c80d82f0 0x7fd7c80d8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:33.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7cfae6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c80ce180 0x7fd7c80ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:33.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7cfae6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c80e9f20 con 0x7fd7c80ce180 2021-04-09T18:34:33.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7cfae6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c809a5a0 con 0x7fd7c8091410 2021-04-09T18:34:33.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7cfae6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c8099e30 con 0x7fd7c80d82f0 2021-04-09T18:34:33.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7ce08b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c80ce180 0x7fd7c80ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:33.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7ce08b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c80ce180 0x7fd7c80ce5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34110/0 (socket says 172.21.15.79:34110) 2021-04-09T18:34:33.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7ce08b700 1 -- 172.21.15.79:0/2154904405 learned_addr learned my addr 172.21.15.79:0/2154904405 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:33.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7cd88a700 1 --2- 172.21.15.79:0/2154904405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c8091410 0x7fd7c80981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:33.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7cd089700 1 --2- 172.21.15.79:0/2154904405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7c80d82f0 0x7fd7c80d8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:33.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7ce08b700 1 -- 172.21.15.79:0/2154904405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7c80d82f0 msgr2=0x7fd7c80d8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:33.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7ce08b700 1 --2- 172.21.15.79:0/2154904405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7c80d82f0 0x7fd7c80d8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7ce08b700 1 -- 172.21.15.79:0/2154904405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c8091410 msgr2=0x7fd7c80981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:33.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7ce08b700 1 --2- 172.21.15.79:0/2154904405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c8091410 0x7fd7c80981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7ce08b700 1 -- 172.21.15.79:0/2154904405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c8098810 con 0x7fd7c80ce180 2021-04-09T18:34:33.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7cd88a700 1 --2- 172.21.15.79:0/2154904405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c8091410 0x7fd7c80981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:34:33.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7cd089700 1 --2- 172.21.15.79:0/2154904405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7c80d82f0 0x7fd7c80d8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:34:33.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7ce08b700 1 --2- 172.21.15.79:0/2154904405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c80ce180 0x7fd7c80ce5d0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7fd7c80ba820 tx=0x7fd7c0006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:33.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.267 7fd7be7fc700 1 -- 172.21.15.79:0/2154904405 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd7c8098810 con 0x7fd7c80ce180 2021-04-09T18:34:33.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.271 7fd7be7fc700 1 -- 172.21.15.79:0/2154904405 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c0005a50 con 0x7fd7c80ce180 2021-04-09T18:34:33.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.271 7fd7cfae6700 1 -- 172.21.15.79:0/2154904405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c809a8a0 con 0x7fd7c80ce180 2021-04-09T18:34:33.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.271 7fd7be7fc700 1 -- 172.21.15.79:0/2154904405 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd7c0021020 con 0x7fd7c80ce180 2021-04-09T18:34:33.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.271 7fd7cfae6700 1 -- 172.21.15.79:0/2154904405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c80d8d70 con 0x7fd7c80ce180 2021-04-09T18:34:33.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.271 7fd7be7fc700 1 -- 172.21.15.79:0/2154904405 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd7c0019030 con 0x7fd7c80ce180 2021-04-09T18:34:33.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.271 7fd7be7fc700 1 --2- 172.21.15.79:0/2154904405 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd7b0029100 0x7fd7b002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:33.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.271 7fd7be7fc700 1 -- 172.21.15.79:0/2154904405 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fd7c0018040 con 0x7fd7c80ce180 2021-04-09T18:34:33.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.271 7fd7cd88a700 1 --2- 172.21.15.79:0/2154904405 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd7b0029100 0x7fd7b002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:33.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.271 7fd7cd88a700 1 --2- 172.21.15.79:0/2154904405 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd7b0029100 0x7fd7b002b650 crc :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:33.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.271 7fd7cfae6700 1 -- 172.21.15.79:0/2154904405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c80e39d0 con 0x7fd7c80ce180 2021-04-09T18:34:33.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.279 7fd7be7fc700 1 -- 172.21.15.79:0/2154904405 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd7c80f76b0 con 0x7fd7c80ce180 2021-04-09T18:34:33.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.443 7fd7cfae6700 1 -- 172.21.15.79:0/2154904405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7c80a1cb0 con 0x7fd7c80ce180 2021-04-09T18:34:33.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.443 7fd7be7fc700 1 -- 172.21.15.79:0/2154904405 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+14358 (secure 0 0 0) 0x7fd7c0011df0 con 0x7fd7c80ce180 2021-04-09T18:34:33.451 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:33.451 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":108,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:34:33.298795","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:34:30.061943","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2021-04-09 18:34:30.884154","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.79:6833/1349682878":"2021-04-10 18:34:32.282358","172.21.15.79:6832/1349682878":"2021-04-10 18:34:32.282358"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:34:33.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.447 7fd7cfae6700 1 -- 172.21.15.79:0/2154904405 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd7b0029100 msgr2=0x7fd7b002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:33.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.447 7fd7cfae6700 1 --2- 172.21.15.79:0/2154904405 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd7b0029100 0x7fd7b002b650 crc :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.447 7fd7cfae6700 1 -- 172.21.15.79:0/2154904405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c80ce180 msgr2=0x7fd7c80ce5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:33.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.447 7fd7cfae6700 1 --2- 172.21.15.79:0/2154904405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c80ce180 0x7fd7c80ce5d0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7fd7c80ba820 tx=0x7fd7c0006c10).stop 2021-04-09T18:34:33.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.447 7fd7cfae6700 1 -- 172.21.15.79:0/2154904405 shutdown_connections 2021-04-09T18:34:33.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.447 7fd7cfae6700 1 --2- 172.21.15.79:0/2154904405 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd7b0029100 0x7fd7b002b650 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.447 7fd7cfae6700 1 --2- 172.21.15.79:0/2154904405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c8091410 0x7fd7c80981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.447 7fd7cfae6700 1 --2- 172.21.15.79:0/2154904405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c80ce180 0x7fd7c80ce5d0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.447 7fd7cfae6700 1 --2- 172.21.15.79:0/2154904405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7c80d82f0 0x7fd7c80d8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.447 7fd7cfae6700 1 -- 172.21.15.79:0/2154904405 >> 172.21.15.79:0/2154904405 conn(0x7fd7c809b2a0 msgr2=0x7fd7c808e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:33.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.447 7fd7cfae6700 1 -- 172.21.15.79:0/2154904405 shutdown_connections 2021-04-09T18:34:33.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.447 7fd7cfae6700 1 -- 172.21.15.79:0/2154904405 wait complete. 2021-04-09T18:34:33.464 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:34:33.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.559 7fa3400ac700 1 Processor -- start 2021-04-09T18:34:33.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.559 7fa3400ac700 1 -- start start 2021-04-09T18:34:33.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.559 7fa3400ac700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa3380f5580 0x7fa3380f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:33.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.559 7fa3400ac700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3380fbb80 con 0x7fa3380e9b40 2021-04-09T18:34:33.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.559 7fa3400ac700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33809f910 con 0x7fa3381c7e40 2021-04-09T18:34:33.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.559 7fa3400ac700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3380e9f90 con 0x7fa3380f5580 2021-04-09T18:34:33.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.559 7fa33d64f700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa3380e9b40 0x7fa33809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57060/0 (socket says 172.21.15.79:57060) 2021-04-09T18:34:33.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.559 7fa33d64f700 1 -- 172.21.15.79:0/2962252809 learned_addr learned my addr 172.21.15.79:0/2962252809 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:33.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.559 7fa33de50700 1 --2- 172.21.15.79:0/2962252809 >> v2:172.21.15.89:3300/0 conn(0x7fa3380f5580 0x7fa3380f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:33.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.559 7fa33ce4e700 1 -- 172.21.15.79:0/2962252809 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250077100 0 0) 0x7fa3200010d0 con 0x7fa3380e9b40 2021-04-09T18:34:33.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.559 7fa33ce4e700 1 -- 172.21.15.79:0/2962252809 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa324003240 con 0x7fa3380e9b40 2021-04-09T18:34:33.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.559 7fa33de50700 1 -- 172.21.15.79:0/2962252809 >> v1:172.21.15.89:6789/0 conn(0x7fa3381c7e40 legacy=0x7fa3381ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:33.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.559 7fa33de50700 1 -- 172.21.15.79:0/2962252809 >> v1:172.21.15.79:6789/0 conn(0x7fa3380e9b40 legacy=0x7fa33809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:33.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.559 7fa33de50700 1 -- 172.21.15.79:0/2962252809 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3380e56b0 con 0x7fa3380f5580 2021-04-09T18:34:33.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.559 7fa33de50700 1 --2- 172.21.15.79:0/2962252809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3380f5580 0x7fa3380f6510 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fa3280032b0 tx=0x7fa32800b0e0).ready entity=mon.1 client_cookie=71733fd8c4fe3c58 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:33.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.559 7fa33ce4e700 1 -- 172.21.15.79:0/2962252809 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa3380e56b0 con 0x7fa3380f5580 2021-04-09T18:34:33.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.559 7fa33ce4e700 1 -- 172.21.15.79:0/2962252809 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32800bab0 con 0x7fa3380f5580 2021-04-09T18:34:33.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.559 7fa33ce4e700 1 -- 172.21.15.79:0/2962252809 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa328002020 con 0x7fa3380f5580 2021-04-09T18:34:33.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.559 7fa3400ac700 1 -- 172.21.15.79:0/2962252809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3380f5580 msgr2=0x7fa3380f6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:33.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.559 7fa3400ac700 1 --2- 172.21.15.79:0/2962252809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3380f5580 0x7fa3380f6510 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fa3280032b0 tx=0x7fa32800b0e0).stop 2021-04-09T18:34:33.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.563 7fa3400ac700 1 -- 172.21.15.79:0/2962252809 shutdown_connections 2021-04-09T18:34:33.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.563 7fa3400ac700 1 --2- 172.21.15.79:0/2962252809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3380f5580 0x7fa3380f6510 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.563 7fa3400ac700 1 -- 172.21.15.79:0/2962252809 >> 172.21.15.79:0/2962252809 conn(0x7fa3380e6040 msgr2=0x7fa3380e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:33.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.563 7fa3400ac700 1 -- 172.21.15.79:0/2962252809 shutdown_connections 2021-04-09T18:34:33.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.563 7fa3400ac700 1 -- 172.21.15.79:0/2962252809 wait complete. 2021-04-09T18:34:33.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.563 7fa3400ac700 1 Processor -- start 2021-04-09T18:34:33.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.563 7fa3400ac700 1 -- start start 2021-04-09T18:34:33.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.563 7fa3400ac700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa338098820 0x7fa338098e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:33.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.563 7fa3400ac700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3381a0630 0x7fa338097110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:33.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.563 7fa3400ac700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa338097740 0x7fa3380d5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:33.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.563 7fa3400ac700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa338098520 con 0x7fa338097740 2021-04-09T18:34:33.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.563 7fa3400ac700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380980b0 con 0x7fa3381a0630 2021-04-09T18:34:33.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.563 7fa3400ac700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3381a0a80 con 0x7fa338098820 2021-04-09T18:34:33.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.563 7fa33e651700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa338097740 0x7fa3380d5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:33.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.563 7fa33e651700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa338097740 0x7fa3380d5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34128/0 (socket says 172.21.15.79:34128) 2021-04-09T18:34:33.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.563 7fa33e651700 1 -- 172.21.15.79:0/4081875205 learned_addr learned my addr 172.21.15.79:0/4081875205 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:33.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.563 7fa33de50700 1 --2- 172.21.15.79:0/4081875205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa338098820 0x7fa338098e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:33.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.563 7fa33d64f700 1 --2- 172.21.15.79:0/4081875205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3381a0630 0x7fa338097110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:33.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.567 7fa33e651700 1 -- 172.21.15.79:0/4081875205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa338098820 msgr2=0x7fa338098e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:33.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.567 7fa33e651700 1 --2- 172.21.15.79:0/4081875205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa338098820 0x7fa338098e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.567 7fa33e651700 1 -- 172.21.15.79:0/4081875205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3381a0630 msgr2=0x7fa338097110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:33.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.567 7fa33e651700 1 --2- 172.21.15.79:0/4081875205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3381a0630 0x7fa338097110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.567 7fa33e651700 1 -- 172.21.15.79:0/4081875205 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3381a0c80 con 0x7fa338097740 2021-04-09T18:34:33.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.567 7fa33e651700 1 --2- 172.21.15.79:0/4081875205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa338097740 0x7fa3380d5010 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fa330000b80 tx=0x7fa33000cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:33.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.567 7fa3367fc700 1 -- 172.21.15.79:0/4081875205 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa3381a0c80 con 0x7fa338097740 2021-04-09T18:34:33.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.567 7fa3367fc700 1 -- 172.21.15.79:0/4081875205 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa330007240 con 0x7fa338097740 2021-04-09T18:34:33.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.567 7fa3400ac700 1 -- 172.21.15.79:0/4081875205 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3380d5640 con 0x7fa338097740 2021-04-09T18:34:33.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.567 7fa3367fc700 1 -- 172.21.15.79:0/4081875205 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa3300066e0 con 0x7fa338097740 2021-04-09T18:34:33.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.567 7fa3400ac700 1 -- 172.21.15.79:0/4081875205 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3380b19d0 con 0x7fa338097740 2021-04-09T18:34:33.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.567 7fa3367fc700 1 -- 172.21.15.79:0/4081875205 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa3300068e0 con 0x7fa338097740 2021-04-09T18:34:33.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.567 7fa3367fc700 1 --2- 172.21.15.79:0/4081875205 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa31c029100 0x7fa31c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:33.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.567 7fa3367fc700 1 -- 172.21.15.79:0/4081875205 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fa330038d40 con 0x7fa338097740 2021-04-09T18:34:33.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.567 7fa33de50700 1 --2- 172.21.15.79:0/4081875205 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa31c029100 0x7fa31c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:33.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.567 7fa33de50700 1 --2- 172.21.15.79:0/4081875205 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa31c029100 0x7fa31c02b650 crc :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:33.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.575 7fa3400ac700 1 -- 172.21.15.79:0/4081875205 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa338088d30 con 0x7fa338097740 2021-04-09T18:34:33.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.583 7fa3367fc700 1 -- 172.21.15.79:0/4081875205 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa330000bf0 con 0x7fa338097740 2021-04-09T18:34:33.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.747 7fa3400ac700 1 -- 172.21.15.79:0/4081875205 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fa3380e39a0 con 0x7fa338097740 2021-04-09T18:34:33.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.751 7fa3367fc700 1 -- 172.21.15.79:0/4081875205 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v33) v1 ==== 184+0+0 (secure 0 0 0) 0x7fa330007030 con 0x7fa338097740 2021-04-09T18:34:33.758 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2021-04-09T18:34:33.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.755 7fa3400ac700 1 -- 172.21.15.79:0/4081875205 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa31c029100 msgr2=0x7fa31c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:33.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.755 7fa3400ac700 1 --2- 172.21.15.79:0/4081875205 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa31c029100 0x7fa31c02b650 crc :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.755 7fa3400ac700 1 -- 172.21.15.79:0/4081875205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa338097740 msgr2=0x7fa3380d5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:33.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.755 7fa3400ac700 1 --2- 172.21.15.79:0/4081875205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa338097740 0x7fa3380d5010 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fa330000b80 tx=0x7fa33000cab0).stop 2021-04-09T18:34:33.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.755 7fa3400ac700 1 -- 172.21.15.79:0/4081875205 shutdown_connections 2021-04-09T18:34:33.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.755 7fa3400ac700 1 --2- 172.21.15.79:0/4081875205 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa31c029100 0x7fa31c02b650 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.755 7fa3400ac700 1 --2- 172.21.15.79:0/4081875205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa338097740 0x7fa3380d5010 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.755 7fa3400ac700 1 --2- 172.21.15.79:0/4081875205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa338098820 0x7fa338098e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.755 7fa3400ac700 1 --2- 172.21.15.79:0/4081875205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3381a0630 0x7fa338097110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.755 7fa3400ac700 1 -- 172.21.15.79:0/4081875205 >> 172.21.15.79:0/4081875205 conn(0x7fa3380a40a0 msgr2=0x7fa3380d83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:33.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.755 7fa3400ac700 1 -- 172.21.15.79:0/4081875205 shutdown_connections 2021-04-09T18:34:33.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.755 7fa3400ac700 1 -- 172.21.15.79:0/4081875205 wait complete. 2021-04-09T18:34:33.772 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:34:33.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.867 7f70b2072700 1 Processor -- start 2021-04-09T18:34:33.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.867 7f70b2072700 1 -- start start 2021-04-09T18:34:33.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70b2072700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70ac0e9b40 0x7f70ac09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:33.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70b2072700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f70ac1c7e40 0x7f70ac1ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:33.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70b2072700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ac0fbb80 con 0x7f70ac0f5580 2021-04-09T18:34:33.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70b2072700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ac0e9f90 con 0x7f70ac1c7e40 2021-04-09T18:34:33.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70b2072700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac0e59b0 con 0x7f70ac0e9b40 2021-04-09T18:34:33.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70aaffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70ac0e9b40 0x7f70ac09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:33.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70abfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f70ac1c7e40 0x7f70ac1ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:33.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70ab7fe700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f70ac0f5580 0x7f70ac0f6510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:57544/0 (socket says 172.21.15.79:57544) 2021-04-09T18:34:33.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70ab7fe700 1 -- 172.21.15.79:0/1484705214 learned_addr learned my addr 172.21.15.79:0/1484705214 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:33.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70aaffd700 1 -- 172.21.15.79:0/1484705214 >> v2:172.21.15.89:3300/0 conn(0x7f70ac1c7e40 msgr2=0x7f70ac1ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:33.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70aaffd700 1 --2- 172.21.15.79:0/1484705214 >> v2:172.21.15.89:3300/0 conn(0x7f70ac1c7e40 0x7f70ac1ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70aaffd700 1 -- 172.21.15.79:0/1484705214 >> v1:172.21.15.89:6789/0 conn(0x7f70ac0f5580 legacy=0x7f70ac0f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:33.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70aaffd700 1 -- 172.21.15.79:0/1484705214 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac0e56b0 con 0x7f70ac0e9b40 2021-04-09T18:34:33.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70abfff700 1 --2- 172.21.15.79:0/1484705214 >> v2:172.21.15.89:3300/0 conn(0x7f70ac1c7e40 0x7f70ac1ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:33.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70aaffd700 1 --2- 172.21.15.79:0/1484705214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70ac0e9b40 0x7f70ac09f110 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f70a0002f30 tx=0x7f70a000bcc0).ready entity=mon.2 client_cookie=8cca4860358467b5 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:33.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70aa7fc700 1 -- 172.21.15.79:0/1484705214 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f70ac0e56b0 con 0x7f70ac0e9b40 2021-04-09T18:34:33.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70aa7fc700 1 -- 172.21.15.79:0/1484705214 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a0009800 con 0x7f70ac0e9b40 2021-04-09T18:34:33.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70aa7fc700 1 -- 172.21.15.79:0/1484705214 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f70a0009bd0 con 0x7f70ac0e9b40 2021-04-09T18:34:33.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70b2072700 1 -- 172.21.15.79:0/1484705214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70ac0e9b40 msgr2=0x7f70ac09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:33.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70b2072700 1 --2- 172.21.15.79:0/1484705214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70ac0e9b40 0x7f70ac09f110 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f70a0002f30 tx=0x7f70a000bcc0).stop 2021-04-09T18:34:33.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70b2072700 1 -- 172.21.15.79:0/1484705214 shutdown_connections 2021-04-09T18:34:33.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70b2072700 1 --2- 172.21.15.79:0/1484705214 >> v2:172.21.15.89:3300/0 conn(0x7f70ac1c7e40 0x7f70ac1ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70b2072700 1 --2- 172.21.15.79:0/1484705214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70ac0e9b40 0x7f70ac09f110 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70b2072700 1 -- 172.21.15.79:0/1484705214 >> 172.21.15.79:0/1484705214 conn(0x7f70ac0e6040 msgr2=0x7f70ac0e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:33.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.871 7f70b2072700 1 -- 172.21.15.79:0/1484705214 shutdown_connections 2021-04-09T18:34:33.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.875 7f70b2072700 1 -- 172.21.15.79:0/1484705214 wait complete. 2021-04-09T18:34:33.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.875 7f70b2072700 1 Processor -- start 2021-04-09T18:34:33.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.875 7f70b2072700 1 -- start start 2021-04-09T18:34:33.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f70b2072700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70ac0b9b30 0x7f70ac0d7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:33.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f70b2072700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70ac0ce0f0 0x7f70ac0d3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:33.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f70b2072700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70ac0ce540 0x7f70ac0d3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:33.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f70b2072700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac0d3140 con 0x7f70ac0b9b30 2021-04-09T18:34:33.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f70b2072700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac0d5b50 con 0x7f70ac0ce0f0 2021-04-09T18:34:33.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f70b2072700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac0d40a0 con 0x7f70ac0ce540 2021-04-09T18:34:33.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f70ab7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70ac0b9b30 0x7f70ac0d7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:33.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f70ab7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70ac0b9b30 0x7f70ac0d7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34138/0 (socket says 172.21.15.79:34138) 2021-04-09T18:34:33.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f70ab7fe700 1 -- 172.21.15.79:0/3889284340 learned_addr learned my addr 172.21.15.79:0/3889284340 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:33.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f70abfff700 1 --2- 172.21.15.79:0/3889284340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70ac0ce540 0x7f70ac0d3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:33.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f70aaffd700 1 --2- 172.21.15.79:0/3889284340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70ac0ce0f0 0x7f70ac0d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:33.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f70ab7fe700 1 -- 172.21.15.79:0/3889284340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70ac0ce540 msgr2=0x7f70ac0d3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:33.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f70ab7fe700 1 --2- 172.21.15.79:0/3889284340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70ac0ce540 0x7f70ac0d3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f70ab7fe700 1 -- 172.21.15.79:0/3889284340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70ac0ce0f0 msgr2=0x7f70ac0d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:33.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f70ab7fe700 1 --2- 172.21.15.79:0/3889284340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70ac0ce0f0 0x7f70ac0d3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:33.898 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f70ab7fe700 1 -- 172.21.15.79:0/3889284340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac0d2cd0 con 0x7f70ac0b9b30 2021-04-09T18:34:33.898 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f70ab7fe700 1 --2- 172.21.15.79:0/3889284340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70ac0b9b30 0x7f70ac0d7350 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f70ac0bb600 tx=0x7f709c00cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:33.898 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f7093fff700 1 -- 172.21.15.79:0/3889284340 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f70ac0d2cd0 con 0x7f70ac0b9b30 2021-04-09T18:34:33.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f7093fff700 1 -- 172.21.15.79:0/3889284340 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709c007320 con 0x7f70ac0b9b30 2021-04-09T18:34:33.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f70b2072700 1 -- 172.21.15.79:0/3889284340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70ac0d2470 con 0x7f70ac0b9b30 2021-04-09T18:34:33.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f7093fff700 1 -- 172.21.15.79:0/3889284340 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f709c0057e0 con 0x7f70ac0b9b30 2021-04-09T18:34:33.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f70b2072700 1 -- 172.21.15.79:0/3889284340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ac094b50 con 0x7f70ac0b9b30 2021-04-09T18:34:33.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f7093fff700 1 -- 172.21.15.79:0/3889284340 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f709c01a060 con 0x7f70ac0b9b30 2021-04-09T18:34:33.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f7093fff700 1 --2- 172.21.15.79:0/3889284340 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f708c029100 0x7f708c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:33.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f7093fff700 1 -- 172.21.15.79:0/3889284340 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f709c038d20 con 0x7f70ac0b9b30 2021-04-09T18:34:33.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.879 7f70aaffd700 1 --2- 172.21.15.79:0/3889284340 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f708c029100 0x7f708c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:33.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.883 7f70aaffd700 1 --2- 172.21.15.79:0/3889284340 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f708c029100 0x7f708c02b650 crc :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:33.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.883 7f70b2072700 1 -- 172.21.15.79:0/3889284340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70ac088d30 con 0x7f70ac0b9b30 2021-04-09T18:34:33.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:33.887 7f7093fff700 1 -- 172.21.15.79:0/3889284340 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f709c007110 con 0x7f70ac0b9b30 2021-04-09T18:34:34.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.055 7f70b2072700 1 -- 172.21.15.79:0/3889284340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f70ac0e39a0 con 0x7f70ac0b9b30 2021-04-09T18:34:34.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.063 7f7093fff700 1 -- 172.21.15.79:0/3889284340 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v34) v1 ==== 184+0+0 (secure 0 0 0) 0x7f709c000bf0 con 0x7f70ac0b9b30 2021-04-09T18:34:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.1 2021-04-09T18:34:34.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.063 7f70b2072700 1 -- 172.21.15.79:0/3889284340 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f708c029100 msgr2=0x7f708c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:34.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.063 7f70b2072700 1 --2- 172.21.15.79:0/3889284340 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f708c029100 0x7f708c02b650 crc :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.063 7f70b2072700 1 -- 172.21.15.79:0/3889284340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70ac0b9b30 msgr2=0x7f70ac0d7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:34.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.063 7f70b2072700 1 --2- 172.21.15.79:0/3889284340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70ac0b9b30 0x7f70ac0d7350 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f70ac0bb600 tx=0x7f709c00cae0).stop 2021-04-09T18:34:34.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.063 7f70b2072700 1 -- 172.21.15.79:0/3889284340 shutdown_connections 2021-04-09T18:34:34.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.063 7f70b2072700 1 --2- 172.21.15.79:0/3889284340 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f708c029100 0x7f708c02b650 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.063 7f70b2072700 1 --2- 172.21.15.79:0/3889284340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70ac0ce540 0x7f70ac0d3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.063 7f70b2072700 1 --2- 172.21.15.79:0/3889284340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70ac0b9b30 0x7f70ac0d7350 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.063 7f70b2072700 1 --2- 172.21.15.79:0/3889284340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70ac0ce0f0 0x7f70ac0d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.063 7f70b2072700 1 -- 172.21.15.79:0/3889284340 >> 172.21.15.79:0/3889284340 conn(0x7f70ac093a10 msgr2=0x7f70ac0ba5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:34.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.063 7f70b2072700 1 -- 172.21.15.79:0/3889284340 shutdown_connections 2021-04-09T18:34:34.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.063 7f70b2072700 1 -- 172.21.15.79:0/3889284340 wait complete. 2021-04-09T18:34:34.081 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:34:34.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc58d96b700 1 Processor -- start 2021-04-09T18:34:34.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc58d96b700 1 -- start start 2021-04-09T18:34:34.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc58d96b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5880f5580 0x7fc5880f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:34.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc58d96b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc5881c7e40 0x7fc5881ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:34.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc58d96b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5880fbb80 con 0x7fc5880e9b40 2021-04-09T18:34:34.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc58d96b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5880e9f90 con 0x7fc5881c7e40 2021-04-09T18:34:34.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc58d96b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5880e59b0 con 0x7fc5880f5580 2021-04-09T18:34:34.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc587d51700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc5881c7e40 0x7fc5881ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:34.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc587d51700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc5881c7e40 0x7fc5881ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34150/0 (socket says 172.21.15.79:34150) 2021-04-09T18:34:34.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc587d51700 1 -- 172.21.15.79:0/2861216348 learned_addr learned my addr 172.21.15.79:0/2861216348 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:34.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc587550700 1 --2- 172.21.15.79:0/2861216348 >> v2:172.21.15.89:3300/0 conn(0x7fc5880f5580 0x7fc5880f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:34.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc58654e700 1 -- 172.21.15.79:0/2861216348 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440608987 0 0) 0x7fc5780010d0 con 0x7fc5880e9b40 2021-04-09T18:34:34.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc587d51700 1 -- 172.21.15.79:0/2861216348 >> v2:172.21.15.89:3300/0 conn(0x7fc5880f5580 msgr2=0x7fc5880f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:34.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc587d51700 1 --2- 172.21.15.79:0/2861216348 >> v2:172.21.15.89:3300/0 conn(0x7fc5880f5580 0x7fc5880f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc587d51700 1 -- 172.21.15.79:0/2861216348 >> v1:172.21.15.89:6789/0 conn(0x7fc5880e9b40 legacy=0x7fc58809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:34.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc587d51700 1 -- 172.21.15.79:0/2861216348 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58809f910 con 0x7fc5881c7e40 2021-04-09T18:34:34.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc587d51700 1 --2- 172.21.15.79:0/2861216348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5881c7e40 0x7fc5881ca2a0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fc5800032b0 tx=0x7fc58000b3c0).ready entity=mon.0 client_cookie=83481b04d8ad6f01 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:34.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc58654e700 1 -- 172.21.15.79:0/2861216348 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc58809f910 con 0x7fc5881c7e40 2021-04-09T18:34:34.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc58654e700 1 -- 172.21.15.79:0/2861216348 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58000bc20 con 0x7fc5881c7e40 2021-04-09T18:34:34.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc58654e700 1 -- 172.21.15.79:0/2861216348 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc580002020 con 0x7fc5881c7e40 2021-04-09T18:34:34.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc58d96b700 1 -- 172.21.15.79:0/2861216348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5881c7e40 msgr2=0x7fc5881ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:34.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc58d96b700 1 --2- 172.21.15.79:0/2861216348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5881c7e40 0x7fc5881ca2a0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fc5800032b0 tx=0x7fc58000b3c0).stop 2021-04-09T18:34:34.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc58d96b700 1 -- 172.21.15.79:0/2861216348 shutdown_connections 2021-04-09T18:34:34.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc58d96b700 1 --2- 172.21.15.79:0/2861216348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5881c7e40 0x7fc5881ca2a0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc58d96b700 1 --2- 172.21.15.79:0/2861216348 >> v2:172.21.15.89:3300/0 conn(0x7fc5880f5580 0x7fc5880f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc58d96b700 1 -- 172.21.15.79:0/2861216348 >> 172.21.15.79:0/2861216348 conn(0x7fc5880e6040 msgr2=0x7fc5880e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:34.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc58d96b700 1 -- 172.21.15.79:0/2861216348 shutdown_connections 2021-04-09T18:34:34.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.179 7fc58d96b700 1 -- 172.21.15.79:0/2861216348 wait complete. 2021-04-09T18:34:34.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.183 7fc58d96b700 1 Processor -- start 2021-04-09T18:34:34.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.183 7fc58d96b700 1 -- start start 2021-04-09T18:34:34.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.183 7fc58d96b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5880c3b10 0x7fc58819fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:34.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.183 7fc58d96b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc588099aa0 0x7fc5880c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:34.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.183 7fc58d96b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5880a5480 0x7fc5880a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:34.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.183 7fc58d96b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5881a0630 con 0x7fc588099aa0 2021-04-09T18:34:34.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.183 7fc58d96b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5881a0930 con 0x7fc5880c3b10 2021-04-09T18:34:34.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.183 7fc58d96b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880c4640 con 0x7fc5880a5480 2021-04-09T18:34:34.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.183 7fc586d4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc588099aa0 0x7fc5880c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:34.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.183 7fc586d4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc588099aa0 0x7fc5880c6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34154/0 (socket says 172.21.15.79:34154) 2021-04-09T18:34:34.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.183 7fc586d4f700 1 -- 172.21.15.79:0/356818327 learned_addr learned my addr 172.21.15.79:0/356818327 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:34.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.183 7fc587d51700 1 --2- 172.21.15.79:0/356818327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5880a5480 0x7fc5880a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:34.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.183 7fc587550700 1 --2- 172.21.15.79:0/356818327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5880c3b10 0x7fc58819fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:34.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.187 7fc586d4f700 1 -- 172.21.15.79:0/356818327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5880a5480 msgr2=0x7fc5880a58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:34.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.187 7fc586d4f700 1 --2- 172.21.15.79:0/356818327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5880a5480 0x7fc5880a58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.187 7fc586d4f700 1 -- 172.21.15.79:0/356818327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5880c3b10 msgr2=0x7fc58819fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:34.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.187 7fc586d4f700 1 --2- 172.21.15.79:0/356818327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5880c3b10 0x7fc58819fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.187 7fc586d4f700 1 -- 172.21.15.79:0/356818327 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc588099ef0 con 0x7fc588099aa0 2021-04-09T18:34:34.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.187 7fc586d4f700 1 --2- 172.21.15.79:0/356818327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc588099aa0 0x7fc5880c6ae0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7fc58809aad0 tx=0x7fc57800cad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:34.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.187 7fc57ffff700 1 -- 172.21.15.79:0/356818327 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc588099ef0 con 0x7fc588099aa0 2021-04-09T18:34:34.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.187 7fc57ffff700 1 -- 172.21.15.79:0/356818327 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc578010510 con 0x7fc588099aa0 2021-04-09T18:34:34.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.187 7fc57ffff700 1 -- 172.21.15.79:0/356818327 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc5780106f0 con 0x7fc588099aa0 2021-04-09T18:34:34.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.187 7fc58d96b700 1 -- 172.21.15.79:0/356818327 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5880c7110 con 0x7fc588099aa0 2021-04-09T18:34:34.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.187 7fc58d96b700 1 -- 172.21.15.79:0/356818327 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5880a3440 con 0x7fc588099aa0 2021-04-09T18:34:34.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.187 7fc57ffff700 1 -- 172.21.15.79:0/356818327 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc578019020 con 0x7fc588099aa0 2021-04-09T18:34:34.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.187 7fc57ffff700 1 --2- 172.21.15.79:0/356818327 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc56c029100 0x7fc56c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:34.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.187 7fc57ffff700 1 -- 172.21.15.79:0/356818327 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fc578038eb0 con 0x7fc588099aa0 2021-04-09T18:34:34.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.187 7fc587550700 1 --2- 172.21.15.79:0/356818327 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc56c029100 0x7fc56c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:34.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.187 7fc587550700 1 --2- 172.21.15.79:0/356818327 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc56c029100 0x7fc56c02b650 crc :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:34.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.195 7fc58d96b700 1 -- 172.21.15.79:0/356818327 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc588088d30 con 0x7fc588099aa0 2021-04-09T18:34:34.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.203 7fc57ffff700 1 -- 172.21.15.79:0/356818327 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc578010300 con 0x7fc588099aa0 2021-04-09T18:34:34.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.367 7fc58d96b700 1 -- 172.21.15.79:0/356818327 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fc5880e39a0 con 0x7fc588099aa0 2021-04-09T18:34:34.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.375 7fc57ffff700 1 -- 172.21.15.79:0/356818327 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v35) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc578000bf0 con 0x7fc588099aa0 2021-04-09T18:34:34.380 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.2 2021-04-09T18:34:34.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.379 7fc58d96b700 1 -- 172.21.15.79:0/356818327 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc56c029100 msgr2=0x7fc56c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:34.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.379 7fc58d96b700 1 --2- 172.21.15.79:0/356818327 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc56c029100 0x7fc56c02b650 crc :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.379 7fc58d96b700 1 -- 172.21.15.79:0/356818327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc588099aa0 msgr2=0x7fc5880c6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:34.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.379 7fc58d96b700 1 --2- 172.21.15.79:0/356818327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc588099aa0 0x7fc5880c6ae0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7fc58809aad0 tx=0x7fc57800cad0).stop 2021-04-09T18:34:34.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.379 7fc58d96b700 1 -- 172.21.15.79:0/356818327 shutdown_connections 2021-04-09T18:34:34.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.379 7fc58d96b700 1 --2- 172.21.15.79:0/356818327 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc56c029100 0x7fc56c02b650 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.379 7fc58d96b700 1 --2- 172.21.15.79:0/356818327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5880c3b10 0x7fc58819fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.379 7fc58d96b700 1 --2- 172.21.15.79:0/356818327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5880a5480 0x7fc5880a58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.379 7fc58d96b700 1 --2- 172.21.15.79:0/356818327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc588099aa0 0x7fc5880c6ae0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.379 7fc58d96b700 1 -- 172.21.15.79:0/356818327 >> 172.21.15.79:0/356818327 conn(0x7fc5880a42c0 msgr2=0x7fc588098eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:34.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.379 7fc58d96b700 1 -- 172.21.15.79:0/356818327 shutdown_connections 2021-04-09T18:34:34.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.379 7fc58d96b700 1 -- 172.21.15.79:0/356818327 wait complete. 2021-04-09T18:34:34.397 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:34:34.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.487 7f27e2d68700 1 Processor -- start 2021-04-09T18:34:34.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.487 7f27e2d68700 1 -- start start 2021-04-09T18:34:34.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.487 7f27e2d68700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27dc0e9ad0 0x7f27dc09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:34.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.487 7f27e2d68700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27dc1c8000 0x7f27dc1ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:34.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.487 7f27e2d68700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27dc0fbb10 con 0x7f27dc0f5510 2021-04-09T18:34:34.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.487 7f27e2d68700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27dc1c3db0 con 0x7f27dc1c8000 2021-04-09T18:34:34.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.487 7f27e2d68700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc0e9f20 con 0x7f27dc0e9ad0 2021-04-09T18:34:34.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27e0b0c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f27dc0f5510 0x7f27dc0f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57102/0 (socket says 172.21.15.79:57102) 2021-04-09T18:34:34.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27e0b0c700 1 -- 172.21.15.79:0/2860984989 learned_addr learned my addr 172.21.15.79:0/2860984989 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:34.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27e130d700 1 --2- 172.21.15.79:0/2860984989 >> v2:172.21.15.79:3300/0 conn(0x7f27dc1c8000 0x7f27dc1ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:34.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27dbfff700 1 --2- 172.21.15.79:0/2860984989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27dc0e9ad0 0x7f27dc09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:34.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27db7fe700 1 -- 172.21.15.79:0/2860984989 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1401906258 0 0) 0x7f27cc0010d0 con 0x7f27dc0f5510 2021-04-09T18:34:34.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27db7fe700 1 -- 172.21.15.79:0/2860984989 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27c4003240 con 0x7f27dc0f5510 2021-04-09T18:34:34.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27e130d700 1 -- 172.21.15.79:0/2860984989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27dc0e9ad0 msgr2=0x7f27dc09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:34.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27e130d700 1 --2- 172.21.15.79:0/2860984989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27dc0e9ad0 0x7f27dc09f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27e130d700 1 -- 172.21.15.79:0/2860984989 >> v1:172.21.15.79:6789/0 conn(0x7f27dc0f5510 legacy=0x7f27dc0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:34.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27e130d700 1 -- 172.21.15.79:0/2860984989 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc0e56c0 con 0x7f27dc1c8000 2021-04-09T18:34:34.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27e130d700 1 --2- 172.21.15.79:0/2860984989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27dc1c8000 0x7f27dc1ca460 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f27d40032b0 tx=0x7f27d400b3c0).ready entity=mon.0 client_cookie=fc6a38e151d3aabc server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:34.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27db7fe700 1 -- 172.21.15.79:0/2860984989 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f27dc0e56c0 con 0x7f27dc1c8000 2021-04-09T18:34:34.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27db7fe700 1 -- 172.21.15.79:0/2860984989 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d400bc20 con 0x7f27dc1c8000 2021-04-09T18:34:34.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27db7fe700 1 -- 172.21.15.79:0/2860984989 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f27d4002020 con 0x7f27dc1c8000 2021-04-09T18:34:34.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27e2d68700 1 -- 172.21.15.79:0/2860984989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27dc1c8000 msgr2=0x7f27dc1ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:34.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27e2d68700 1 --2- 172.21.15.79:0/2860984989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27dc1c8000 0x7f27dc1ca460 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f27d40032b0 tx=0x7f27d400b3c0).stop 2021-04-09T18:34:34.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27e2d68700 1 -- 172.21.15.79:0/2860984989 shutdown_connections 2021-04-09T18:34:34.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27e2d68700 1 --2- 172.21.15.79:0/2860984989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27dc1c8000 0x7f27dc1ca460 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27e2d68700 1 --2- 172.21.15.79:0/2860984989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27dc0e9ad0 0x7f27dc09f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27e2d68700 1 -- 172.21.15.79:0/2860984989 >> 172.21.15.79:0/2860984989 conn(0x7f27dc0e5fd0 msgr2=0x7f27dc0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:34.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27e2d68700 1 -- 172.21.15.79:0/2860984989 shutdown_connections 2021-04-09T18:34:34.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.491 7f27e2d68700 1 -- 172.21.15.79:0/2860984989 wait complete. 2021-04-09T18:34:34.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.495 7f27e2d68700 1 Processor -- start 2021-04-09T18:34:34.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.495 7f27e2d68700 1 -- start start 2021-04-09T18:34:34.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27e2d68700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27dc0d4cd0 0x7f27dc08ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:34.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27e2d68700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27dc0944b0 0x7f27dc0cf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:34.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27e2d68700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27dc094900 0x7f27dc08f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:34.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27e2d68700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc0d5dd0 con 0x7f27dc0944b0 2021-04-09T18:34:34.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27e2d68700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc0d5660 con 0x7f27dc0d4cd0 2021-04-09T18:34:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27e2d68700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc0ad0e0 con 0x7f27dc094900 2021-04-09T18:34:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27dbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27dc0944b0 0x7f27dc0cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27dbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27dc0944b0 0x7f27dc0cf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34166/0 (socket says 172.21.15.79:34166) 2021-04-09T18:34:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27dbfff700 1 -- 172.21.15.79:0/14550792 learned_addr learned my addr 172.21.15.79:0/14550792 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:34.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27e0b0c700 1 --2- 172.21.15.79:0/14550792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27dc0d4cd0 0x7f27dc08ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:34.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27e130d700 1 --2- 172.21.15.79:0/14550792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27dc094900 0x7f27dc08f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:34.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27dbfff700 1 -- 172.21.15.79:0/14550792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27dc094900 msgr2=0x7f27dc08f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:34.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27dbfff700 1 --2- 172.21.15.79:0/14550792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27dc094900 0x7f27dc08f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27dbfff700 1 -- 172.21.15.79:0/14550792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27dc0d4cd0 msgr2=0x7f27dc08ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:34.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27dbfff700 1 --2- 172.21.15.79:0/14550792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27dc0d4cd0 0x7f27dc08ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27dbfff700 1 -- 172.21.15.79:0/14550792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc0d60d0 con 0x7f27dc0944b0 2021-04-09T18:34:34.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27dbfff700 1 --2- 172.21.15.79:0/14550792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27dc0944b0 0x7f27dc0cf120 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f27dc0ad2e0 tx=0x7f27d000c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:34.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27d97fa700 1 -- 172.21.15.79:0/14550792 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f27dc0d60d0 con 0x7f27dc0944b0 2021-04-09T18:34:34.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27d97fa700 1 -- 172.21.15.79:0/14550792 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d000cbb0 con 0x7f27dc0944b0 2021-04-09T18:34:34.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27e2d68700 1 -- 172.21.15.79:0/14550792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27dc08f2c0 con 0x7f27dc0944b0 2021-04-09T18:34:34.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27d97fa700 1 -- 172.21.15.79:0/14550792 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f27d000f040 con 0x7f27dc0944b0 2021-04-09T18:34:34.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27e2d68700 1 -- 172.21.15.79:0/14550792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27dc0d5120 con 0x7f27dc0944b0 2021-04-09T18:34:34.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27d97fa700 1 -- 172.21.15.79:0/14550792 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f27d0011070 con 0x7f27dc0944b0 2021-04-09T18:34:34.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27d97fa700 1 --2- 172.21.15.79:0/14550792 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f27bc029100 0x7f27bc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:34.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27d97fa700 1 -- 172.21.15.79:0/14550792 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f27d0010040 con 0x7f27dc0944b0 2021-04-09T18:34:34.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.499 7f27e0b0c700 1 --2- 172.21.15.79:0/14550792 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f27bc029100 0x7f27bc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:34.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.503 7f27e0b0c700 1 --2- 172.21.15.79:0/14550792 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f27bc029100 0x7f27bc02b650 crc :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:34.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.503 7f27e2d68700 1 -- 172.21.15.79:0/14550792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27dc0e39d0 con 0x7f27dc0944b0 2021-04-09T18:34:34.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.511 7f27d97fa700 1 -- 172.21.15.79:0/14550792 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f27d0000bf0 con 0x7f27dc0944b0 2021-04-09T18:34:34.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.675 7f27e2d68700 1 -- 172.21.15.79:0/14550792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27dc0f5b10 con 0x7f27dc0944b0 2021-04-09T18:34:34.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.675 7f27d97fa700 1 -- 172.21.15.79:0/14550792 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+2104 (secure 0 0 0) 0x7f27d000c7b0 con 0x7f27dc0944b0 2021-04-09T18:34:34.683 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 68 2021-04-09T18:34:34.683 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:34.684 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":68,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7456,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/128870944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":128870944},{"type":"v1","addr":"172.21.15.89:6835","nonce":128870944}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":66}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:34:31.841744","modified":"2021-04-09 18:34:33.860013","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7452":{"gid":7452,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/1381942487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1381942487},{"type":"v1","addr":"172.21.15.79:6833","nonce":1381942487}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-04-09T18:34:34.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.679 7f27e2d68700 1 -- 172.21.15.79:0/14550792 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f27bc029100 msgr2=0x7f27bc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:34.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.679 7f27e2d68700 1 --2- 172.21.15.79:0/14550792 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f27bc029100 0x7f27bc02b650 crc :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.679 7f27e2d68700 1 -- 172.21.15.79:0/14550792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27dc0944b0 msgr2=0x7f27dc0cf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:34.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.679 7f27e2d68700 1 --2- 172.21.15.79:0/14550792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27dc0944b0 0x7f27dc0cf120 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f27dc0ad2e0 tx=0x7f27d000c150).stop 2021-04-09T18:34:34.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.679 7f27e2d68700 1 -- 172.21.15.79:0/14550792 shutdown_connections 2021-04-09T18:34:34.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.679 7f27e2d68700 1 --2- 172.21.15.79:0/14550792 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f27bc029100 0x7f27bc02b650 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.679 7f27e2d68700 1 --2- 172.21.15.79:0/14550792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27dc0d4cd0 0x7f27dc08ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.679 7f27e2d68700 1 --2- 172.21.15.79:0/14550792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27dc094900 0x7f27dc08f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.687 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.679 7f27e2d68700 1 --2- 172.21.15.79:0/14550792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27dc0944b0 0x7f27dc0cf120 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:34.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.679 7f27e2d68700 1 -- 172.21.15.79:0/14550792 >> 172.21.15.79:0/14550792 conn(0x7f27dc0934b0 msgr2=0x7f27dc0d6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:34.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.679 7f27e2d68700 1 -- 172.21.15.79:0/14550792 shutdown_connections 2021-04-09T18:34:34.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:34.679 7f27e2d68700 1 -- 172.21.15.79:0/14550792 wait complete. 2021-04-09T18:34:34.896 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:34:31.841744', 'modified': '2021-04-09 18:34:33.860013', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 106, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7452}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7452': {'gid': 7452, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6833/1381942487', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 1381942487}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 1381942487}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:34:34.897 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:34:34.898 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2021-04-09T18:34:34.988 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:34:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:34:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2021-04-09T18:34:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 7452, 2021-04-09T18:34:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2021-04-09T18:34:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2021-04-09T18:34:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 2.1262997850000001, 2021-04-09T18:34:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 68, 2021-04-09T18:34:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 108, 2021-04-09T18:34:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 108, 2021-04-09T18:34:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 6.7465765930000003 2021-04-09T18:34:34.991 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:34:34.995 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 7452, "want_state": "up:active", "state": "up:active", "rank_uptime": 2.1262997850000001, "mdsmap_epoch": 68, "osdmap_epoch": 108, "osdmap_epoch_barrier": 108, "uptime": 6.7465765930000003 } 2021-04-09T18:34:34.996 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:34:35.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.087 7fc6648b1700 1 Processor -- start 2021-04-09T18:34:35.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.087 7fc6648b1700 1 -- start start 2021-04-09T18:34:35.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.087 7fc6648b1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6600f5510 0x7fc6600f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.087 7fc6648b1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6600e9ad0 0x7fc66009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.087 7fc6648b1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6600fbb10 con 0x7fc6601c2da0 2021-04-09T18:34:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.087 7fc6648b1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6600e9f20 con 0x7fc6600f5510 2021-04-09T18:34:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.087 7fc6648b1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6600e59c0 con 0x7fc6600e9ad0 2021-04-09T18:34:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.087 7fc65e5a4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6600f5510 0x7fc6600f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.087 7fc65e5a4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6600f5510 0x7fc6600f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34174/0 (socket says 172.21.15.79:34174) 2021-04-09T18:34:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.087 7fc65e5a4700 1 -- 172.21.15.79:0/2598733696 learned_addr learned my addr 172.21.15.79:0/2598733696 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.087 7fc65dda3700 1 --2- 172.21.15.79:0/2598733696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6600e9ad0 0x7fc66009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.091 7fc65e5a4700 1 -- 172.21.15.79:0/2598733696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6600e9ad0 msgr2=0x7fc66009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.091 7fc65e5a4700 1 --2- 172.21.15.79:0/2598733696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6600e9ad0 0x7fc66009f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.091 7fc65e5a4700 1 -- 172.21.15.79:0/2598733696 >> v1:172.21.15.79:6789/0 conn(0x7fc6601c2da0 legacy=0x7fc6601c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.091 7fc65e5a4700 1 -- 172.21.15.79:0/2598733696 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6600e56c0 con 0x7fc6600f5510 2021-04-09T18:34:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.091 7fc65e5a4700 1 --2- 172.21.15.79:0/2598733696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6600f5510 0x7fc6600f64a0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7fc650002f30 tx=0x7fc65000bda0).ready entity=mon.0 client_cookie=d0121e156aa7ead server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.091 7fc65d5a2700 1 -- 172.21.15.79:0/2598733696 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc6600e56c0 con 0x7fc6600f5510 2021-04-09T18:34:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.091 7fc65d5a2700 1 -- 172.21.15.79:0/2598733696 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6500099d0 con 0x7fc6600f5510 2021-04-09T18:34:35.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.091 7fc65d5a2700 1 -- 172.21.15.79:0/2598733696 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc650009da0 con 0x7fc6600f5510 2021-04-09T18:34:35.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.091 7fc6648b1700 1 -- 172.21.15.79:0/2598733696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6600f5510 msgr2=0x7fc6600f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.091 7fc6648b1700 1 --2- 172.21.15.79:0/2598733696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6600f5510 0x7fc6600f64a0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7fc650002f30 tx=0x7fc65000bda0).stop 2021-04-09T18:34:35.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.091 7fc6648b1700 1 -- 172.21.15.79:0/2598733696 shutdown_connections 2021-04-09T18:34:35.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.091 7fc6648b1700 1 --2- 172.21.15.79:0/2598733696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6600f5510 0x7fc6600f64a0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.091 7fc6648b1700 1 --2- 172.21.15.79:0/2598733696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6600e9ad0 0x7fc66009f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.091 7fc6648b1700 1 -- 172.21.15.79:0/2598733696 >> 172.21.15.79:0/2598733696 conn(0x7fc6600e5fd0 msgr2=0x7fc6600e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:35.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.091 7fc6648b1700 1 -- 172.21.15.79:0/2598733696 shutdown_connections 2021-04-09T18:34:35.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.091 7fc6648b1700 1 -- 172.21.15.79:0/2598733696 wait complete. 2021-04-09T18:34:35.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc6648b1700 1 Processor -- start 2021-04-09T18:34:35.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc6648b1700 1 -- start start 2021-04-09T18:34:35.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc6648b1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6601a7df0 0x7fc6600b8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc6648b1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc660093f60 0x7fc6600943b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc6648b1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc660099af0 0x7fc660099f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc6648b1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6600d5360 con 0x7fc6601a7df0 2021-04-09T18:34:35.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc6648b1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6600d5660 con 0x7fc660099af0 2021-04-09T18:34:35.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc6648b1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6600d4f90 con 0x7fc660093f60 2021-04-09T18:34:35.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc65e5a4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6601a7df0 0x7fc6600b8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc65e5a4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6601a7df0 0x7fc6600b8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34180/0 (socket says 172.21.15.79:34180) 2021-04-09T18:34:35.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc65e5a4700 1 -- 172.21.15.79:0/2858493367 learned_addr learned my addr 172.21.15.79:0/2858493367 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:35.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc65eda5700 1 --2- 172.21.15.79:0/2858493367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc660099af0 0x7fc660099f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc65dda3700 1 --2- 172.21.15.79:0/2858493367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc660093f60 0x7fc6600943b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc65e5a4700 1 -- 172.21.15.79:0/2858493367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc660093f60 msgr2=0x7fc6600943b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.117 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc65e5a4700 1 --2- 172.21.15.79:0/2858493367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc660093f60 0x7fc6600943b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc65e5a4700 1 -- 172.21.15.79:0/2858493367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc660099af0 msgr2=0x7fc660099f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.118 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc65e5a4700 1 --2- 172.21.15.79:0/2858493367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc660099af0 0x7fc660099f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc65e5a4700 1 -- 172.21.15.79:0/2858493367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6600d6be0 con 0x7fc6601a7df0 2021-04-09T18:34:35.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc65e5a4700 1 --2- 172.21.15.79:0/2858493367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6601a7df0 0x7fc6600b8fc0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7fc6600bab20 tx=0x7fc650006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:35.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc64effd700 1 -- 172.21.15.79:0/2858493367 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc6600d6be0 con 0x7fc6601a7df0 2021-04-09T18:34:35.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc64effd700 1 -- 172.21.15.79:0/2858493367 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc650011ce0 con 0x7fc6601a7df0 2021-04-09T18:34:35.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc6648b1700 1 -- 172.21.15.79:0/2858493367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc660094e50 con 0x7fc6601a7df0 2021-04-09T18:34:35.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc64effd700 1 -- 172.21.15.79:0/2858493367 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc65001d630 con 0x7fc6601a7df0 2021-04-09T18:34:35.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.095 7fc6648b1700 1 -- 172.21.15.79:0/2858493367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc660099630 con 0x7fc6601a7df0 2021-04-09T18:34:35.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.099 7fc64effd700 1 -- 172.21.15.79:0/2858493367 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc650026450 con 0x7fc6601a7df0 2021-04-09T18:34:35.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.099 7fc64effd700 1 --2- 172.21.15.79:0/2858493367 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc644029100 0x7fc64402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.099 7fc64effd700 1 -- 172.21.15.79:0/2858493367 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fc65003b270 con 0x7fc6601a7df0 2021-04-09T18:34:35.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.099 7fc65dda3700 1 --2- 172.21.15.79:0/2858493367 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc644029100 0x7fc64402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.123 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.099 7fc65dda3700 1 --2- 172.21.15.79:0/2858493367 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc644029100 0x7fc64402b650 crc :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:35.124 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.103 7fc6648b1700 1 -- 172.21.15.79:0/2858493367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6600e39d0 con 0x7fc6601a7df0 2021-04-09T18:34:35.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.111 7fc64effd700 1 -- 172.21.15.79:0/2858493367 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc650011ad0 con 0x7fc6601a7df0 2021-04-09T18:34:35.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.271 7fc6648b1700 1 -- 172.21.15.79:0/2858493367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6600f5b10 con 0x7fc6601a7df0 2021-04-09T18:34:35.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.275 7fc64effd700 1 -- 172.21.15.79:0/2858493367 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+14358 (secure 0 0 0) 0x7fc6500097c0 con 0x7fc6601a7df0 2021-04-09T18:34:35.280 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:35.281 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":108,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:34:33.298795","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:34:30.061943","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2021-04-09 18:34:30.884154","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.79:6833/1349682878":"2021-04-10 18:34:32.282358","172.21.15.79:6832/1349682878":"2021-04-10 18:34:32.282358"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:34:35.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.275 7fc6648b1700 1 -- 172.21.15.79:0/2858493367 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc644029100 msgr2=0x7fc64402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.275 7fc6648b1700 1 --2- 172.21.15.79:0/2858493367 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc644029100 0x7fc64402b650 crc :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.275 7fc6648b1700 1 -- 172.21.15.79:0/2858493367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6601a7df0 msgr2=0x7fc6600b8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.275 7fc6648b1700 1 --2- 172.21.15.79:0/2858493367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6601a7df0 0x7fc6600b8fc0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7fc6600bab20 tx=0x7fc650006890).stop 2021-04-09T18:34:35.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.279 7fc6648b1700 1 -- 172.21.15.79:0/2858493367 shutdown_connections 2021-04-09T18:34:35.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.279 7fc6648b1700 1 --2- 172.21.15.79:0/2858493367 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc644029100 0x7fc64402b650 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.279 7fc6648b1700 1 --2- 172.21.15.79:0/2858493367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc660099af0 0x7fc660099f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.279 7fc6648b1700 1 --2- 172.21.15.79:0/2858493367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6601a7df0 0x7fc6600b8fc0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.279 7fc6648b1700 1 --2- 172.21.15.79:0/2858493367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc660093f60 0x7fc6600943b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.279 7fc6648b1700 1 -- 172.21.15.79:0/2858493367 >> 172.21.15.79:0/2858493367 conn(0x7fc660093780 msgr2=0x7fc6600d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:35.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.279 7fc6648b1700 1 -- 172.21.15.79:0/2858493367 shutdown_connections 2021-04-09T18:34:35.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.279 7fc6648b1700 1 -- 172.21.15.79:0/2858493367 wait complete. 2021-04-09T18:34:35.298 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:34:30.061943', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:34:30.884154', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:34:35.299 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:34:35.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.387 7f0ce6294700 1 Processor -- start 2021-04-09T18:34:35.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.387 7f0ce6294700 1 -- start start 2021-04-09T18:34:35.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.387 7f0ce6294700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ce00e9b10 0x7f0ce009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.387 7f0ce6294700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0ce01c8040 0x7f0ce01ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.387 7f0ce6294700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce00fbb50 con 0x7f0ce00f5550 2021-04-09T18:34:35.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.387 7f0ce6294700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce01c3df0 con 0x7f0ce01c8040 2021-04-09T18:34:35.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.387 7f0ce6294700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00e9f60 con 0x7f0ce00e9b10 2021-04-09T18:34:35.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0cdffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0ce00f5550 0x7f0ce00f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57130/0 (socket says 172.21.15.79:57130) 2021-04-09T18:34:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0cdffff700 1 -- 172.21.15.79:0/617952511 learned_addr learned my addr 172.21.15.79:0/617952511 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0cdf7fe700 1 --2- 172.21.15.79:0/617952511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ce00e9b10 0x7f0ce009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0ce4839700 1 --2- 172.21.15.79:0/617952511 >> v2:172.21.15.89:3300/0 conn(0x7f0ce01c8040 0x7f0ce01ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0cdeffd700 1 -- 172.21.15.79:0/617952511 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266748758 0 0) 0x7f0cc80010d0 con 0x7f0ce00f5550 2021-04-09T18:34:35.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0cdeffd700 1 -- 172.21.15.79:0/617952511 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cc0003240 con 0x7f0ce00f5550 2021-04-09T18:34:35.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0ce4839700 1 -- 172.21.15.79:0/617952511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ce00e9b10 msgr2=0x7f0ce009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:35.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0ce4839700 1 --2- 172.21.15.79:0/617952511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ce00e9b10 0x7f0ce009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0ce4839700 1 -- 172.21.15.79:0/617952511 >> v1:172.21.15.79:6789/0 conn(0x7f0ce00f5550 legacy=0x7f0ce00f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0ce4839700 1 -- 172.21.15.79:0/617952511 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce00e5700 con 0x7f0ce01c8040 2021-04-09T18:34:35.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0ce4839700 1 --2- 172.21.15.79:0/617952511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ce01c8040 0x7f0ce01ca4a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f0cd80032b0 tx=0x7f0cd800b3c0).ready entity=mon.1 client_cookie=32dcd2533375fc76 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:35.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0cdeffd700 1 -- 172.21.15.79:0/617952511 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ce00e5700 con 0x7f0ce01c8040 2021-04-09T18:34:35.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0cdeffd700 1 -- 172.21.15.79:0/617952511 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd800bc20 con 0x7f0ce01c8040 2021-04-09T18:34:35.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0cdeffd700 1 -- 172.21.15.79:0/617952511 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0cd8002020 con 0x7f0ce01c8040 2021-04-09T18:34:35.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0ce6294700 1 -- 172.21.15.79:0/617952511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ce01c8040 msgr2=0x7f0ce01ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0ce6294700 1 --2- 172.21.15.79:0/617952511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ce01c8040 0x7f0ce01ca4a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f0cd80032b0 tx=0x7f0cd800b3c0).stop 2021-04-09T18:34:35.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0ce6294700 1 -- 172.21.15.79:0/617952511 shutdown_connections 2021-04-09T18:34:35.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0ce6294700 1 --2- 172.21.15.79:0/617952511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ce01c8040 0x7f0ce01ca4a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0ce6294700 1 --2- 172.21.15.79:0/617952511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ce00e9b10 0x7f0ce009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0ce6294700 1 -- 172.21.15.79:0/617952511 >> 172.21.15.79:0/617952511 conn(0x7f0ce00e6010 msgr2=0x7f0ce00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:35.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0ce6294700 1 -- 172.21.15.79:0/617952511 shutdown_connections 2021-04-09T18:34:35.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.391 7f0ce6294700 1 -- 172.21.15.79:0/617952511 wait complete. 2021-04-09T18:34:35.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0ce6294700 1 Processor -- start 2021-04-09T18:34:35.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0ce6294700 1 -- start start 2021-04-09T18:34:35.411 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0ce6294700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ce00bbb00 0x7f0ce01a8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.411 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0ce6294700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ce00bbf50 0x7f0ce00ba3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.411 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0ce6294700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce00baa20 0x7f0ce00d1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.412 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0ce6294700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce0088590 con 0x7f0ce00baa20 2021-04-09T18:34:35.412 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0ce6294700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00ba0f0 con 0x7f0ce00bbf50 2021-04-09T18:34:35.412 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0ce6294700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00b9c80 con 0x7f0ce00bbb00 2021-04-09T18:34:35.412 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0ce4839700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce00baa20 0x7f0ce00d1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.412 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0ce4839700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce00baa20 0x7f0ce00d1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34198/0 (socket says 172.21.15.79:34198) 2021-04-09T18:34:35.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0ce4839700 1 -- 172.21.15.79:0/1951136758 learned_addr learned my addr 172.21.15.79:0/1951136758 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:35.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0cdf7fe700 1 --2- 172.21.15.79:0/1951136758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ce00bbf50 0x7f0ce00ba3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0cdffff700 1 --2- 172.21.15.79:0/1951136758 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ce00bbb00 0x7f0ce01a8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0ce4839700 1 -- 172.21.15.79:0/1951136758 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ce00bbb00 msgr2=0x7f0ce01a8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0ce4839700 1 --2- 172.21.15.79:0/1951136758 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ce00bbb00 0x7f0ce01a8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0ce4839700 1 -- 172.21.15.79:0/1951136758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ce00bbf50 msgr2=0x7f0ce00ba3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0ce4839700 1 --2- 172.21.15.79:0/1951136758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ce00bbf50 0x7f0ce00ba3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0ce4839700 1 -- 172.21.15.79:0/1951136758 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce01a8b90 con 0x7f0ce00baa20 2021-04-09T18:34:35.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0ce4839700 1 --2- 172.21.15.79:0/1951136758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce00baa20 0x7f0ce00d1cf0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f0ce00874d0 tx=0x7f0cd8006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:35.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0cdcff9700 1 -- 172.21.15.79:0/1951136758 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ce01a8b90 con 0x7f0ce00baa20 2021-04-09T18:34:35.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0cdcff9700 1 -- 172.21.15.79:0/1951136758 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd801f030 con 0x7f0ce00baa20 2021-04-09T18:34:35.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0ce6294700 1 -- 172.21.15.79:0/1951136758 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce00d2320 con 0x7f0ce00baa20 2021-04-09T18:34:35.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0cdcff9700 1 -- 172.21.15.79:0/1951136758 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0cd8002020 con 0x7f0ce00baa20 2021-04-09T18:34:35.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.395 7f0ce6294700 1 -- 172.21.15.79:0/1951136758 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce00bc560 con 0x7f0ce00baa20 2021-04-09T18:34:35.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.399 7f0cdcff9700 1 -- 172.21.15.79:0/1951136758 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0cd802a060 con 0x7f0ce00baa20 2021-04-09T18:34:35.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.399 7f0cdcff9700 1 --2- 172.21.15.79:0/1951136758 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0cb8029100 0x7f0cb802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.399 7f0cdcff9700 1 -- 172.21.15.79:0/1951136758 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f0cd803b620 con 0x7f0ce00baa20 2021-04-09T18:34:35.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.399 7f0cdffff700 1 --2- 172.21.15.79:0/1951136758 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0cb8029100 0x7f0cb802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.399 7f0cdffff700 1 --2- 172.21.15.79:0/1951136758 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0cb8029100 0x7f0cb802b650 crc :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:35.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.403 7f0ce6294700 1 -- 172.21.15.79:0/1951136758 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce00e39f0 con 0x7f0ce00baa20 2021-04-09T18:34:35.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.411 7f0cdcff9700 1 -- 172.21.15.79:0/1951136758 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0cd800ba10 con 0x7f0ce00baa20 2021-04-09T18:34:35.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.571 7f0ce6294700 1 -- 172.21.15.79:0/1951136758 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f0ce00f5b50 con 0x7f0ce00baa20 2021-04-09T18:34:35.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.575 7f0cdcff9700 1 -- 172.21.15.79:0/1951136758 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v108) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0cd801b430 con 0x7f0ce00baa20 2021-04-09T18:34:35.580 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:34:35.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.575 7f0ce6294700 1 -- 172.21.15.79:0/1951136758 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0cb8029100 msgr2=0x7f0cb802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.575 7f0ce6294700 1 --2- 172.21.15.79:0/1951136758 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0cb8029100 0x7f0cb802b650 crc :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.575 7f0ce6294700 1 -- 172.21.15.79:0/1951136758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce00baa20 msgr2=0x7f0ce00d1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.575 7f0ce6294700 1 --2- 172.21.15.79:0/1951136758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce00baa20 0x7f0ce00d1cf0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f0ce00874d0 tx=0x7f0cd8006c10).stop 2021-04-09T18:34:35.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.575 7f0ce6294700 1 -- 172.21.15.79:0/1951136758 shutdown_connections 2021-04-09T18:34:35.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.575 7f0ce6294700 1 --2- 172.21.15.79:0/1951136758 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0cb8029100 0x7f0cb802b650 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.575 7f0ce6294700 1 --2- 172.21.15.79:0/1951136758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce00baa20 0x7f0ce00d1cf0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.575 7f0ce6294700 1 --2- 172.21.15.79:0/1951136758 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ce00bbb00 0x7f0ce01a8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.575 7f0ce6294700 1 --2- 172.21.15.79:0/1951136758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ce00bbf50 0x7f0ce00ba3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.575 7f0ce6294700 1 -- 172.21.15.79:0/1951136758 >> 172.21.15.79:0/1951136758 conn(0x7f0ce00951c0 msgr2=0x7f0ce0094660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:35.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.575 7f0ce6294700 1 -- 172.21.15.79:0/1951136758 shutdown_connections 2021-04-09T18:34:35.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.575 7f0ce6294700 1 -- 172.21.15.79:0/1951136758 wait complete. 2021-04-09T18:34:35.593 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:34:35.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f575b757700 1 Processor -- start 2021-04-09T18:34:35.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f575b757700 1 -- start start 2021-04-09T18:34:35.693 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f575b757700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f57540e9b10 0x7f575409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f575b757700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57541c8040 0x7f57541ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.694 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f575b757700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57540fbb50 con 0x7f57540f5550 2021-04-09T18:34:35.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f575b757700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57541c3df0 con 0x7f57540e9b10 2021-04-09T18:34:35.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f575b757700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57540e9f60 con 0x7f57541c8040 2021-04-09T18:34:35.695 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f5759cfc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57541c8040 0x7f57541ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f5758cfa700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f57540e9b10 0x7f575409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.696 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f5758cfa700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f57540e9b10 0x7f575409f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:50778/0 (socket says 172.21.15.79:50778) 2021-04-09T18:34:35.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f5759cfc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57541c8040 0x7f57541ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:59434/0 (socket says 172.21.15.79:59434) 2021-04-09T18:34:35.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f5758cfa700 1 -- 172.21.15.79:0/3503506755 learned_addr learned my addr 172.21.15.79:0/3503506755 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:35.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f57594fb700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f57540f5550 0x7f57540f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:57614/0 (socket says 172.21.15.79:57614) 2021-04-09T18:34:35.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f5758cfa700 1 -- 172.21.15.79:0/3503506755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57541c8040 msgr2=0x7f57541ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:35.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f5758cfa700 1 --2- 172.21.15.79:0/3503506755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57541c8040 0x7f57541ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f5758cfa700 1 -- 172.21.15.79:0/3503506755 >> v1:172.21.15.89:6789/0 conn(0x7f57540f5550 legacy=0x7f57540f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f5758cfa700 1 -- 172.21.15.79:0/3503506755 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57540e5700 con 0x7f57540e9b10 2021-04-09T18:34:35.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f5759cfc700 1 --2- 172.21.15.79:0/3503506755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57541c8040 0x7f57541ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:35.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f5758cfa700 1 --2- 172.21.15.79:0/3503506755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57540e9b10 0x7f575409f110 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f57540f6f30 tx=0x7f574800b3c0).ready entity=mon.1 client_cookie=aa0390e4f82fccc7 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:35.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f5747fff700 1 -- 172.21.15.79:0/3503506755 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f57540e5700 con 0x7f57540e9b10 2021-04-09T18:34:35.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f5747fff700 1 -- 172.21.15.79:0/3503506755 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574800bbe0 con 0x7f57540e9b10 2021-04-09T18:34:35.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f5747fff700 1 -- 172.21.15.79:0/3503506755 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5748002020 con 0x7f57540e9b10 2021-04-09T18:34:35.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f575b757700 1 -- 172.21.15.79:0/3503506755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57540e9b10 msgr2=0x7f575409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f575b757700 1 --2- 172.21.15.79:0/3503506755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57540e9b10 0x7f575409f110 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f57540f6f30 tx=0x7f574800b3c0).stop 2021-04-09T18:34:35.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f575b757700 1 -- 172.21.15.79:0/3503506755 shutdown_connections 2021-04-09T18:34:35.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f575b757700 1 --2- 172.21.15.79:0/3503506755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57541c8040 0x7f57541ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f575b757700 1 --2- 172.21.15.79:0/3503506755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57540e9b10 0x7f575409f110 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f575b757700 1 -- 172.21.15.79:0/3503506755 >> 172.21.15.79:0/3503506755 conn(0x7f57540e6010 msgr2=0x7f57540e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:35.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f575b757700 1 -- 172.21.15.79:0/3503506755 shutdown_connections 2021-04-09T18:34:35.705 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.683 7f575b757700 1 -- 172.21.15.79:0/3503506755 wait complete. 2021-04-09T18:34:35.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f575b757700 1 Processor -- start 2021-04-09T18:34:35.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f575b757700 1 -- start start 2021-04-09T18:34:35.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f575b757700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57540afaf0 0x7f57541ad570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f575b757700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57540aff40 0x7f57541adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f575b757700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57541b1750 0x7f57541b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f575b757700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57540e1ac0 con 0x7f57540aff40 2021-04-09T18:34:35.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f575b757700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5754096d60 con 0x7f57541b1750 2021-04-09T18:34:35.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f575b757700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57540969d0 con 0x7f57540afaf0 2021-04-09T18:34:35.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f5758cfa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57540aff40 0x7f57541adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f5758cfa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57540aff40 0x7f57541adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34208/0 (socket says 172.21.15.79:34208) 2021-04-09T18:34:35.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f5758cfa700 1 -- 172.21.15.79:0/1112228755 learned_addr learned my addr 172.21.15.79:0/1112228755 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:35.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f5759cfc700 1 --2- 172.21.15.79:0/1112228755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57541b1750 0x7f57541b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f57594fb700 1 --2- 172.21.15.79:0/1112228755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57540afaf0 0x7f57541ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f5758cfa700 1 -- 172.21.15.79:0/1112228755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57540afaf0 msgr2=0x7f57541ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f5758cfa700 1 --2- 172.21.15.79:0/1112228755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57540afaf0 0x7f57541ad570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f5758cfa700 1 -- 172.21.15.79:0/1112228755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57541b1750 msgr2=0x7f57541b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f5758cfa700 1 --2- 172.21.15.79:0/1112228755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57541b1750 0x7f57541b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f5758cfa700 1 -- 172.21.15.79:0/1112228755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57540beda0 con 0x7f57540aff40 2021-04-09T18:34:35.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f57594fb700 1 --2- 172.21.15.79:0/1112228755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57540afaf0 0x7f57541ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:35.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f5758cfa700 1 --2- 172.21.15.79:0/1112228755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57540aff40 0x7f57541adba0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f5754096ce0 tx=0x7f5748006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:35.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f5745ffb700 1 -- 172.21.15.79:0/1112228755 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f57540beda0 con 0x7f57540aff40 2021-04-09T18:34:35.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f5745ffb700 1 -- 172.21.15.79:0/1112228755 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574801b670 con 0x7f57540aff40 2021-04-09T18:34:35.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f575b757700 1 -- 172.21.15.79:0/1112228755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57540c0ba0 con 0x7f57540aff40 2021-04-09T18:34:35.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f5745ffb700 1 -- 172.21.15.79:0/1112228755 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f574801ba40 con 0x7f57540aff40 2021-04-09T18:34:35.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.687 7f575b757700 1 -- 172.21.15.79:0/1112228755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57541b2360 con 0x7f57540aff40 2021-04-09T18:34:35.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.691 7f5745ffb700 1 -- 172.21.15.79:0/1112228755 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5748019040 con 0x7f57540aff40 2021-04-09T18:34:35.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.691 7f5745ffb700 1 --2- 172.21.15.79:0/1112228755 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5734029100 0x7f573402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.691 7f5745ffb700 1 -- 172.21.15.79:0/1112228755 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f5748018040 con 0x7f57540aff40 2021-04-09T18:34:35.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.691 7f57594fb700 1 --2- 172.21.15.79:0/1112228755 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5734029100 0x7f573402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.691 7f57594fb700 1 --2- 172.21.15.79:0/1112228755 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5734029100 0x7f573402b650 crc :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:35.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.695 7f575b757700 1 -- 172.21.15.79:0/1112228755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57540e39f0 con 0x7f57540aff40 2021-04-09T18:34:35.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.703 7f5745ffb700 1 -- 172.21.15.79:0/1112228755 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f574800b9d0 con 0x7f57540aff40 2021-04-09T18:34:35.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.859 7f575b757700 1 -- 172.21.15.79:0/1112228755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f57540a1c90 con 0x7f57540aff40 2021-04-09T18:34:35.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.859 7f5745ffb700 1 -- 172.21.15.79:0/1112228755 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v108) v1 ==== 104+0+10 (secure 0 0 0) 0x7f574801b460 con 0x7f57540aff40 2021-04-09T18:34:35.864 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:34:35.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.859 7f575b757700 1 -- 172.21.15.79:0/1112228755 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5734029100 msgr2=0x7f573402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.859 7f575b757700 1 --2- 172.21.15.79:0/1112228755 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5734029100 0x7f573402b650 crc :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.859 7f575b757700 1 -- 172.21.15.79:0/1112228755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57540aff40 msgr2=0x7f57541adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.859 7f575b757700 1 --2- 172.21.15.79:0/1112228755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57540aff40 0x7f57541adba0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f5754096ce0 tx=0x7f5748006c10).stop 2021-04-09T18:34:35.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.859 7f575b757700 1 -- 172.21.15.79:0/1112228755 shutdown_connections 2021-04-09T18:34:35.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.859 7f575b757700 1 --2- 172.21.15.79:0/1112228755 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5734029100 0x7f573402b650 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.859 7f575b757700 1 --2- 172.21.15.79:0/1112228755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57541b1750 0x7f57541b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.859 7f575b757700 1 --2- 172.21.15.79:0/1112228755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57540afaf0 0x7f57541ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.859 7f575b757700 1 --2- 172.21.15.79:0/1112228755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57540aff40 0x7f57541adba0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.859 7f575b757700 1 -- 172.21.15.79:0/1112228755 >> 172.21.15.79:0/1112228755 conn(0x7f575409aea0 msgr2=0x7f575409a400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:35.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.859 7f575b757700 1 -- 172.21.15.79:0/1112228755 shutdown_connections 2021-04-09T18:34:35.870 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.859 7f575b757700 1 -- 172.21.15.79:0/1112228755 wait complete. 2021-04-09T18:34:35.876 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:34:35.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.967 7f5600aaf700 1 Processor -- start 2021-04-09T18:34:35.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.967 7f5600aaf700 1 -- start start 2021-04-09T18:34:35.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.967 7f5600aaf700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f55fc0f5550 0x7f55fc0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.967 7f5600aaf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55fc1c8040 0x7f55fc1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.967 7f5600aaf700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55fc0fbb50 con 0x7f55fc0e9b10 2021-04-09T18:34:35.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.967 7f5600aaf700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55fc0e9f60 con 0x7f55fc0f5550 2021-04-09T18:34:35.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.967 7f5600aaf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc1c3df0 con 0x7f55fc1c8040 2021-04-09T18:34:35.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.967 7f55fafe7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55fc1c8040 0x7f55fc1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.967 7f55fa7e6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f55fc0f5550 0x7f55fc0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.967 7f55f9fe5700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f55fc0e9b10 0x7f55fc09f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:57630/0 (socket says 172.21.15.79:57630) 2021-04-09T18:34:35.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.967 7f55f9fe5700 1 -- 172.21.15.79:0/3843091331 learned_addr learned my addr 172.21.15.79:0/3843091331 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:35.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.967 7f55f97e4700 1 -- 172.21.15.79:0/3843091331 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3044353450 0 0) 0x7f55f00010d0 con 0x7f55fc0e9b10 2021-04-09T18:34:35.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.967 7f55f97e4700 1 -- 172.21.15.79:0/3843091331 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e4003240 con 0x7f55fc0e9b10 2021-04-09T18:34:35.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.967 7f55fa7e6700 1 -- 172.21.15.79:0/3843091331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55fc1c8040 msgr2=0x7f55fc1ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:35.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.967 7f55fa7e6700 1 --2- 172.21.15.79:0/3843091331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55fc1c8040 0x7f55fc1ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.971 7f55fa7e6700 1 -- 172.21.15.79:0/3843091331 >> v1:172.21.15.89:6789/0 conn(0x7f55fc0e9b10 legacy=0x7f55fc09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.971 7f55fa7e6700 1 -- 172.21.15.79:0/3843091331 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc09f910 con 0x7f55fc0f5550 2021-04-09T18:34:35.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.971 7f55fafe7700 1 --2- 172.21.15.79:0/3843091331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55fc1c8040 0x7f55fc1ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:35.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.971 7f55fa7e6700 1 --2- 172.21.15.79:0/3843091331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55fc0f5550 0x7f55fc0f64e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f55fc0f6f30 tx=0x7f55ec00bd70).ready entity=mon.1 client_cookie=4d54139be057d503 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:35.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.971 7f55f97e4700 1 -- 172.21.15.79:0/3843091331 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f55fc09f910 con 0x7f55fc0f5550 2021-04-09T18:34:35.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.971 7f55f97e4700 1 -- 172.21.15.79:0/3843091331 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec009810 con 0x7f55fc0f5550 2021-04-09T18:34:35.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.971 7f55f97e4700 1 -- 172.21.15.79:0/3843091331 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f55ec009be0 con 0x7f55fc0f5550 2021-04-09T18:34:35.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.971 7f5600aaf700 1 -- 172.21.15.79:0/3843091331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55fc0f5550 msgr2=0x7f55fc0f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.971 7f5600aaf700 1 --2- 172.21.15.79:0/3843091331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55fc0f5550 0x7f55fc0f64e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f55fc0f6f30 tx=0x7f55ec00bd70).stop 2021-04-09T18:34:35.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.971 7f5600aaf700 1 -- 172.21.15.79:0/3843091331 shutdown_connections 2021-04-09T18:34:35.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.971 7f5600aaf700 1 --2- 172.21.15.79:0/3843091331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55fc1c8040 0x7f55fc1ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.971 7f5600aaf700 1 --2- 172.21.15.79:0/3843091331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55fc0f5550 0x7f55fc0f64e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.971 7f5600aaf700 1 -- 172.21.15.79:0/3843091331 >> 172.21.15.79:0/3843091331 conn(0x7f55fc0e6010 msgr2=0x7f55fc0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:35.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.971 7f5600aaf700 1 -- 172.21.15.79:0/3843091331 shutdown_connections 2021-04-09T18:34:35.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.971 7f5600aaf700 1 -- 172.21.15.79:0/3843091331 wait complete. 2021-04-09T18:34:35.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.971 7f5600aaf700 1 Processor -- start 2021-04-09T18:34:35.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.971 7f5600aaf700 1 -- start start 2021-04-09T18:34:35.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f5600aaf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc0d1580 0x7f55fc0d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f5600aaf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55fc0bcc80 0x7f55fc0bd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f5600aaf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55fc0d2d80 0x7f55fc0d31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f5600aaf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0e1ac0 con 0x7f55fc0d1580 2021-04-09T18:34:35.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f5600aaf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0bc980 con 0x7f55fc0d2d80 2021-04-09T18:34:35.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f5600aaf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0bc510 con 0x7f55fc0bcc80 2021-04-09T18:34:35.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f55fa7e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc0d1580 0x7f55fc0d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f55fafe7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55fc0d2d80 0x7f55fc0d31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f55fa7e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc0d1580 0x7f55fc0d19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34224/0 (socket says 172.21.15.79:34224) 2021-04-09T18:34:35.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f55fa7e6700 1 -- 172.21.15.79:0/2401698738 learned_addr learned my addr 172.21.15.79:0/2401698738 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:35.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f55f9fe5700 1 --2- 172.21.15.79:0/2401698738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55fc0bcc80 0x7f55fc0bd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f55fa7e6700 1 -- 172.21.15.79:0/2401698738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55fc0bcc80 msgr2=0x7f55fc0bd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f55fa7e6700 1 --2- 172.21.15.79:0/2401698738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55fc0bcc80 0x7f55fc0bd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f55fa7e6700 1 -- 172.21.15.79:0/2401698738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55fc0d2d80 msgr2=0x7f55fc0d31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:35.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f55fa7e6700 1 --2- 172.21.15.79:0/2401698738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55fc0d2d80 0x7f55fc0d31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:35.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f55fa7e6700 1 -- 172.21.15.79:0/2401698738 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc0bd700 con 0x7f55fc0d1580 2021-04-09T18:34:35.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f55fafe7700 1 --2- 172.21.15.79:0/2401698738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55fc0d2d80 0x7f55fc0d31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:35.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f55f9fe5700 1 --2- 172.21.15.79:0/2401698738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55fc0bcc80 0x7f55fc0bd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:35.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f55fa7e6700 1 --2- 172.21.15.79:0/2401698738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc0d1580 0x7f55fc0d19d0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7f55fc0f6f30 tx=0x7f55ec006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:35.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f55eaffd700 1 -- 172.21.15.79:0/2401698738 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f55fc0bd700 con 0x7f55fc0d1580 2021-04-09T18:34:35.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f55eaffd700 1 -- 172.21.15.79:0/2401698738 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec018580 con 0x7f55fc0d1580 2021-04-09T18:34:35.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f5600aaf700 1 -- 172.21.15.79:0/2401698738 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55fc0d2590 con 0x7f55fc0d1580 2021-04-09T18:34:35.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f55eaffd700 1 -- 172.21.15.79:0/2401698738 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f55ec018760 con 0x7f55fc0d1580 2021-04-09T18:34:35.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f5600aaf700 1 -- 172.21.15.79:0/2401698738 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55fc0bbc00 con 0x7f55fc0d1580 2021-04-09T18:34:35.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.975 7f55eaffd700 1 -- 172.21.15.79:0/2401698738 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f55ec018960 con 0x7f55fc0d1580 2021-04-09T18:34:35.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.979 7f55eaffd700 1 --2- 172.21.15.79:0/2401698738 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f55e0029100 0x7f55e002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:35.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.979 7f55eaffd700 1 -- 172.21.15.79:0/2401698738 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f55ec03a490 con 0x7f55fc0d1580 2021-04-09T18:34:35.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.979 7f55f9fe5700 1 --2- 172.21.15.79:0/2401698738 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f55e0029100 0x7f55e002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:35.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.979 7f55f9fe5700 1 --2- 172.21.15.79:0/2401698738 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f55e0029100 0x7f55e002b650 crc :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:35.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.983 7f5600aaf700 1 -- 172.21.15.79:0/2401698738 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55fc0e39f0 con 0x7f55fc0d1580 2021-04-09T18:34:35.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:35.991 7f55eaffd700 1 -- 172.21.15.79:0/2401698738 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f55ec009600 con 0x7f55fc0d1580 2021-04-09T18:34:36.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.143 7f5600aaf700 1 -- 172.21.15.79:0/2401698738 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f55fc0a1c90 con 0x7f55fc0d1580 2021-04-09T18:34:36.150 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.143 7f55eaffd700 1 -- 172.21.15.79:0/2401698738 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v108) v1 ==== 100+0+10 (secure 0 0 0) 0x7f55ec018370 con 0x7f55fc0d1580 2021-04-09T18:34:36.151 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:34:36.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.147 7f5600aaf700 1 -- 172.21.15.79:0/2401698738 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f55e0029100 msgr2=0x7f55e002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:36.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.147 7f5600aaf700 1 --2- 172.21.15.79:0/2401698738 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f55e0029100 0x7f55e002b650 crc :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:36.153 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.147 7f5600aaf700 1 -- 172.21.15.79:0/2401698738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc0d1580 msgr2=0x7f55fc0d19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:36.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.147 7f5600aaf700 1 --2- 172.21.15.79:0/2401698738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc0d1580 0x7f55fc0d19d0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7f55fc0f6f30 tx=0x7f55ec006890).stop 2021-04-09T18:34:36.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.147 7f5600aaf700 1 -- 172.21.15.79:0/2401698738 shutdown_connections 2021-04-09T18:34:36.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.147 7f5600aaf700 1 --2- 172.21.15.79:0/2401698738 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f55e0029100 0x7f55e002b650 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:36.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.147 7f5600aaf700 1 --2- 172.21.15.79:0/2401698738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55fc0d2d80 0x7f55fc0d31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:36.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.147 7f5600aaf700 1 --2- 172.21.15.79:0/2401698738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc0d1580 0x7f55fc0d19d0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:36.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.147 7f5600aaf700 1 --2- 172.21.15.79:0/2401698738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55fc0bcc80 0x7f55fc0bd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:36.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.147 7f5600aaf700 1 -- 172.21.15.79:0/2401698738 >> 172.21.15.79:0/2401698738 conn(0x7f55fc093880 msgr2=0x7f55fc09a630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:36.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.147 7f5600aaf700 1 -- 172.21.15.79:0/2401698738 shutdown_connections 2021-04-09T18:34:36.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.147 7f5600aaf700 1 -- 172.21.15.79:0/2401698738 wait complete. 2021-04-09T18:34:36.168 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:34:36.169 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:34:36.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.255 7fa1194f1700 1 Processor -- start 2021-04-09T18:34:36.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.255 7fa1194f1700 1 -- start start 2021-04-09T18:34:36.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa1194f1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa1140f5520 0x7fa1140f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:36.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa1194f1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa1140e9ae0 0x7fa11409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:36.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa1194f1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1141c2db0 0x7fa1141c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:36.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa1194f1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1140e9f30 con 0x7fa1140f5520 2021-04-09T18:34:36.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa1194f1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1140e59d0 con 0x7fa1140e9ae0 2021-04-09T18:34:36.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa1194f1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1140fbb20 con 0x7fa1141c2db0 2021-04-09T18:34:36.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa113247700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa1140f5520 0x7fa1140f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:36.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa113247700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa1140f5520 0x7fa1140f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34232/0 (socket says 172.21.15.79:34232) 2021-04-09T18:34:36.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa113247700 1 -- 172.21.15.79:0/3904230496 learned_addr learned my addr 172.21.15.79:0/3904230496 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:36.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa113a48700 1 --2- 172.21.15.79:0/3904230496 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1141c2db0 0x7fa1141c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:36.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa112a46700 1 --2- 172.21.15.79:0/3904230496 >> v2:172.21.15.89:3300/0 conn(0x7fa1140e9ae0 0x7fa11409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:36.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa113247700 1 -- 172.21.15.79:0/3904230496 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1141c2db0 msgr2=0x7fa1141c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:36.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa113247700 1 --2- 172.21.15.79:0/3904230496 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1141c2db0 0x7fa1141c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:36.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa113247700 1 -- 172.21.15.79:0/3904230496 >> v2:172.21.15.89:3300/0 conn(0x7fa1140e9ae0 msgr2=0x7fa11409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:36.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa113247700 1 --2- 172.21.15.79:0/3904230496 >> v2:172.21.15.89:3300/0 conn(0x7fa1140e9ae0 0x7fa11409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:36.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa113247700 1 -- 172.21.15.79:0/3904230496 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1140e56d0 con 0x7fa1140f5520 2021-04-09T18:34:36.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa113247700 1 --2- 172.21.15.79:0/3904230496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1140f5520 0x7fa1140f64b0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7fa114125440 tx=0x7fa10400bda0).ready entity=mon.0 client_cookie=422366af3bc88606 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:36.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa112245700 1 -- 172.21.15.79:0/3904230496 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa1140e56d0 con 0x7fa1140f5520 2021-04-09T18:34:36.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa112245700 1 -- 172.21.15.79:0/3904230496 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa104009940 con 0x7fa1140f5520 2021-04-09T18:34:36.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa112245700 1 -- 172.21.15.79:0/3904230496 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa104009d10 con 0x7fa1140f5520 2021-04-09T18:34:36.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa1194f1700 1 -- 172.21.15.79:0/3904230496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1140f5520 msgr2=0x7fa1140f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:36.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa1194f1700 1 --2- 172.21.15.79:0/3904230496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1140f5520 0x7fa1140f64b0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7fa114125440 tx=0x7fa10400bda0).stop 2021-04-09T18:34:36.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa1194f1700 1 -- 172.21.15.79:0/3904230496 shutdown_connections 2021-04-09T18:34:36.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa1194f1700 1 --2- 172.21.15.79:0/3904230496 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1141c2db0 0x7fa1141c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:36.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa1194f1700 1 --2- 172.21.15.79:0/3904230496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1140f5520 0x7fa1140f64b0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:36.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa1194f1700 1 --2- 172.21.15.79:0/3904230496 >> v2:172.21.15.89:3300/0 conn(0x7fa1140e9ae0 0x7fa11409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:36.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa1194f1700 1 -- 172.21.15.79:0/3904230496 >> 172.21.15.79:0/3904230496 conn(0x7fa1140e5fe0 msgr2=0x7fa1140e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:36.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa1194f1700 1 -- 172.21.15.79:0/3904230496 shutdown_connections 2021-04-09T18:34:36.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.259 7fa1194f1700 1 -- 172.21.15.79:0/3904230496 wait complete. 2021-04-09T18:34:36.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.263 7fa1194f1700 1 Processor -- start 2021-04-09T18:34:36.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.263 7fa1194f1700 1 -- start start 2021-04-09T18:34:36.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.263 7fa1194f1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1140973a0 0x7fa1140d60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:36.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa1194f1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa114097df0 0x7fa114098240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:36.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa1194f1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa11419dd90 0x7fa11419e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:36.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa1194f1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa114097af0 con 0x7fa11419dd90 2021-04-09T18:34:36.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa1194f1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1140977f0 con 0x7fa1140973a0 2021-04-09T18:34:36.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa1194f1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1140d66f0 con 0x7fa114097df0 2021-04-09T18:34:36.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa113a48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa11419dd90 0x7fa11419e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:36.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa113a48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa11419dd90 0x7fa11419e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34240/0 (socket says 172.21.15.79:34240) 2021-04-09T18:34:36.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa112a46700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa114097df0 0x7fa114098240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:36.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa113247700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1140973a0 0x7fa1140d60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:36.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa113a48700 1 -- 172.21.15.79:0/3359774954 learned_addr learned my addr 172.21.15.79:0/3359774954 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:36.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa113a48700 1 -- 172.21.15.79:0/3359774954 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa114097df0 msgr2=0x7fa114098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:36.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa113a48700 1 --2- 172.21.15.79:0/3359774954 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa114097df0 0x7fa114098240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:36.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa113a48700 1 -- 172.21.15.79:0/3359774954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1140973a0 msgr2=0x7fa1140d60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:36.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa113a48700 1 --2- 172.21.15.79:0/3359774954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1140973a0 0x7fa1140d60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:36.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa113a48700 1 -- 172.21.15.79:0/3359774954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1140d4bb0 con 0x7fa11419dd90 2021-04-09T18:34:36.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa113a48700 1 --2- 172.21.15.79:0/3359774954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa11419dd90 0x7fa11419e1e0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7fa114097a70 tx=0x7fa10c00c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:36.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa0fbfff700 1 -- 172.21.15.79:0/3359774954 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa1140d4bb0 con 0x7fa11419dd90 2021-04-09T18:34:36.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa0fbfff700 1 -- 172.21.15.79:0/3359774954 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c00cb70 con 0x7fa11419dd90 2021-04-09T18:34:36.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa0fbfff700 1 -- 172.21.15.79:0/3359774954 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa10c00f040 con 0x7fa11419dd90 2021-04-09T18:34:36.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa1194f1700 1 -- 172.21.15.79:0/3359774954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1140d4ed0 con 0x7fa11419dd90 2021-04-09T18:34:36.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa1194f1700 1 -- 172.21.15.79:0/3359774954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1140d53e0 con 0x7fa11419dd90 2021-04-09T18:34:36.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa0fbfff700 1 -- 172.21.15.79:0/3359774954 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa10c022060 con 0x7fa11419dd90 2021-04-09T18:34:36.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa0fbfff700 1 --2- 172.21.15.79:0/3359774954 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa0f4029100 0x7fa0f402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:36.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa0fbfff700 1 -- 172.21.15.79:0/3359774954 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fa10c010040 con 0x7fa11419dd90 2021-04-09T18:34:36.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.267 7fa113247700 1 --2- 172.21.15.79:0/3359774954 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa0f4029100 0x7fa0f402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:36.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.271 7fa113247700 1 --2- 172.21.15.79:0/3359774954 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa0f4029100 0x7fa0f402b650 crc :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:36.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.271 7fa1194f1700 1 -- 172.21.15.79:0/3359774954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1140e39e0 con 0x7fa11419dd90 2021-04-09T18:34:36.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.279 7fa0fbfff700 1 -- 172.21.15.79:0/3359774954 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa10c00c960 con 0x7fa11419dd90 2021-04-09T18:34:36.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.447 7fa1194f1700 1 -- 172.21.15.79:0/3359774954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1140f5b20 con 0x7fa11419dd90 2021-04-09T18:34:36.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.447 7fa0fbfff700 1 -- 172.21.15.79:0/3359774954 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+2104 (secure 0 0 0) 0x7fa1140f76c0 con 0x7fa11419dd90 2021-04-09T18:34:36.457 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 68 2021-04-09T18:34:36.457 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:36.457 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":68,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7456,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/128870944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":128870944},{"type":"v1","addr":"172.21.15.89:6835","nonce":128870944}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":66}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:34:31.841744","modified":"2021-04-09 18:34:33.860013","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7452":{"gid":7452,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/1381942487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1381942487},{"type":"v1","addr":"172.21.15.79:6833","nonce":1381942487}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-04-09T18:34:36.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.455 7fa1194f1700 1 -- 172.21.15.79:0/3359774954 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa0f4029100 msgr2=0x7fa0f402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:36.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.455 7fa1194f1700 1 --2- 172.21.15.79:0/3359774954 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa0f4029100 0x7fa0f402b650 crc :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:36.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.455 7fa1194f1700 1 -- 172.21.15.79:0/3359774954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa11419dd90 msgr2=0x7fa11419e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:36.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.455 7fa1194f1700 1 --2- 172.21.15.79:0/3359774954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa11419dd90 0x7fa11419e1e0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7fa114097a70 tx=0x7fa10c00c430).stop 2021-04-09T18:34:36.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.455 7fa1194f1700 1 -- 172.21.15.79:0/3359774954 shutdown_connections 2021-04-09T18:34:36.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.455 7fa1194f1700 1 --2- 172.21.15.79:0/3359774954 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa0f4029100 0x7fa0f402b650 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:36.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.455 7fa1194f1700 1 --2- 172.21.15.79:0/3359774954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1140973a0 0x7fa1140d60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:36.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.455 7fa1194f1700 1 --2- 172.21.15.79:0/3359774954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa11419dd90 0x7fa11419e1e0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:36.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.455 7fa1194f1700 1 --2- 172.21.15.79:0/3359774954 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa114097df0 0x7fa114098240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:36.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.455 7fa1194f1700 1 -- 172.21.15.79:0/3359774954 >> 172.21.15.79:0/3359774954 conn(0x7fa1140afe20 msgr2=0x7fa1140a6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:36.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.455 7fa1194f1700 1 -- 172.21.15.79:0/3359774954 shutdown_connections 2021-04-09T18:34:36.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:36.455 7fa1194f1700 1 -- 172.21.15.79:0/3359774954 wait complete. 2021-04-09T18:34:36.671 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:34:31.841744', 'modified': '2021-04-09 18:34:33.860013', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 106, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7452}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7452': {'gid': 7452, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6833/1381942487', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 1381942487}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 1381942487}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:34:36.671 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:34:36.672 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2021-04-09T18:34:36.769 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:34:36.770 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:34:36.770 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2021-04-09T18:34:36.770 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 7452, 2021-04-09T18:34:36.770 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2021-04-09T18:34:36.771 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2021-04-09T18:34:36.771 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 3.9074341320000001, 2021-04-09T18:34:36.771 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 68, 2021-04-09T18:34:36.771 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 108, 2021-04-09T18:34:36.772 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 108, 2021-04-09T18:34:36.772 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 8.5277140950000003 2021-04-09T18:34:36.772 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:34:36.776 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 7452, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.9074341320000001, "mdsmap_epoch": 68, "osdmap_epoch": 108, "osdmap_epoch_barrier": 108, "uptime": 8.5277140950000003 } 2021-04-09T18:34:36.777 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:34:36.777 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-04-09T18:34:36.777 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi090.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-04-09T18:34:36.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:36.778 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:34:36.787 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:34:36.845 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:34:36.846 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:34:36.900 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:34:36.901 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:34:36.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:36.902 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:34:36.952 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:34:36.952 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:34:36.995 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:34:37.010 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:34:37.010 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:34:37.067 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:34:37.068 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:34:37.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:37.069 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:34:37.070 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:2021-04-09 18:34:37.063 7fd0b79fa0c0 -1 init, newargv = 0x559f1c7d0870 newargc=9ceph-fuse[14038]: starting ceph client 2021-04-09T18:34:37.071 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr: 2021-04-09T18:34:37.077 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[14038]: starting fuse 2021-04-09T18:34:37.082 INFO:teuthology.orchestra.run.smithi090.stdout:49 2021-04-09T18:34:37.083 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:34:37.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:37.084 DEBUG:teuthology.orchestra.run.smithi090:> sudo python3 -c ' 2021-04-09T18:34:37.084 DEBUG:teuthology.orchestra.run.smithi090:> import glob 2021-04-09T18:34:37.085 DEBUG:teuthology.orchestra.run.smithi090:> import re 2021-04-09T18:34:37.086 DEBUG:teuthology.orchestra.run.smithi090:> import os 2021-04-09T18:34:37.086 DEBUG:teuthology.orchestra.run.smithi090:> import subprocess 2021-04-09T18:34:37.087 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:34:37.087 DEBUG:teuthology.orchestra.run.smithi090:> def find_socket(client_name): 2021-04-09T18:34:37.088 DEBUG:teuthology.orchestra.run.smithi090:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-04-09T18:34:37.088 DEBUG:teuthology.orchestra.run.smithi090:> files = glob.glob(asok_path) 2021-04-09T18:34:37.089 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:34:37.089 DEBUG:teuthology.orchestra.run.smithi090:> # Given a non-glob path, it better be there 2021-04-09T18:34:37.089 DEBUG:teuthology.orchestra.run.smithi090:> if "*" not in asok_path: 2021-04-09T18:34:37.090 DEBUG:teuthology.orchestra.run.smithi090:> assert(len(files) == 1) 2021-04-09T18:34:37.090 DEBUG:teuthology.orchestra.run.smithi090:> return files[0] 2021-04-09T18:34:37.090 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:34:37.091 DEBUG:teuthology.orchestra.run.smithi090:> for f in files: 2021-04-09T18:34:37.091 DEBUG:teuthology.orchestra.run.smithi090:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:34:37.092 DEBUG:teuthology.orchestra.run.smithi090:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:34:37.092 DEBUG:teuthology.orchestra.run.smithi090:> return f 2021-04-09T18:34:37.092 DEBUG:teuthology.orchestra.run.smithi090:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:34:37.093 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:34:37.093 DEBUG:teuthology.orchestra.run.smithi090:> print(find_socket("client.0")) 2021-04-09T18:34:37.094 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:34:37.176 INFO:teuthology.orchestra.run.smithi090.stdout:/var/run/ceph/ceph-client.0.14038.asok 2021-04-09T18:34:37.180 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14038.asok 2021-04-09T18:34:37.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:37.182 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14038.asok status 2021-04-09T18:34:37.256 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2021-04-09T18:34:37.257 INFO:teuthology.orchestra.run.smithi090.stdout: "metadata": { 2021-04-09T18:34:37.257 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:34:37.257 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:34:37.257 INFO:teuthology.orchestra.run.smithi090.stdout: "entity_id": "0", 2021-04-09T18:34:37.258 INFO:teuthology.orchestra.run.smithi090.stdout: "hostname": "smithi090", 2021-04-09T18:34:37.258 INFO:teuthology.orchestra.run.smithi090.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-04-09T18:34:37.258 INFO:teuthology.orchestra.run.smithi090.stdout: "pid": "14038", 2021-04-09T18:34:37.258 INFO:teuthology.orchestra.run.smithi090.stdout: "root": "/" 2021-04-09T18:34:37.259 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:34:37.259 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_count": 0, 2021-04-09T18:34:37.259 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_pinned_count": 0, 2021-04-09T18:34:37.260 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 6629, 2021-04-09T18:34:37.260 INFO:teuthology.orchestra.run.smithi090.stdout: "inst": { 2021-04-09T18:34:37.260 INFO:teuthology.orchestra.run.smithi090.stdout: "name": { 2021-04-09T18:34:37.260 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "client", 2021-04-09T18:34:37.260 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6629 2021-04-09T18:34:37.261 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:34:37.261 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:34:37.261 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:34:37.261 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:34:37.261 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 1912408386 2021-04-09T18:34:37.262 INFO:teuthology.orchestra.run.smithi090.stdout: } 2021-04-09T18:34:37.262 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:34:37.262 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:34:37.262 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:34:37.263 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:34:37.263 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 1912408386 2021-04-09T18:34:37.263 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:34:37.263 INFO:teuthology.orchestra.run.smithi090.stdout: "inst_str": "client.6629 172.21.15.90:0/1912408386", 2021-04-09T18:34:37.264 INFO:teuthology.orchestra.run.smithi090.stdout: "addr_str": "172.21.15.90:0/1912408386", 2021-04-09T18:34:37.264 INFO:teuthology.orchestra.run.smithi090.stdout: "inode_count": 1, 2021-04-09T18:34:37.264 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_epoch": 68, 2021-04-09T18:34:37.264 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch": 108, 2021-04-09T18:34:37.265 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:34:37.265 INFO:teuthology.orchestra.run.smithi090.stdout: "blacklisted": false, 2021-04-09T18:34:37.265 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs" 2021-04-09T18:34:37.266 INFO:teuthology.orchestra.run.smithi090.stdout:} 2021-04-09T18:34:37.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:37.267 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:34:37.268 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:34:37.274 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:34:37.276 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:34:37.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:37.276 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:34:37.334 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:34:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae7ded9700 1 Processor -- start 2021-04-09T18:34:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae7ded9700 1 -- start start 2021-04-09T18:34:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae7ded9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae780f5510 0x7fae780f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae7ded9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fae780e9ad0 0x7fae7809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae7ded9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fae781c2da0 0x7fae781c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae7ded9700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae780e9f20 con 0x7fae780e9ad0 2021-04-09T18:34:37.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae7ded9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae780e59c0 con 0x7fae781c2da0 2021-04-09T18:34:37.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae7ded9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae780fbb10 con 0x7fae780f5510 2021-04-09T18:34:37.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae76ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fae780e9ad0 0x7fae7809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:37.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae76ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fae780e9ad0 0x7fae7809f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34246/0 (socket says 172.21.15.79:34246) 2021-04-09T18:34:37.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae76ffd700 1 -- 172.21.15.79:0/2722785602 learned_addr learned my addr 172.21.15.79:0/2722785602 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:37.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae777fe700 1 --2- 172.21.15.79:0/2722785602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae780f5510 0x7fae780f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:37.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae77fff700 1 --2- 172.21.15.79:0/2722785602 >> v2:172.21.15.89:3300/0 conn(0x7fae781c2da0 0x7fae781c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:37.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae76ffd700 1 -- 172.21.15.79:0/2722785602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae780f5510 msgr2=0x7fae780f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:37.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae76ffd700 1 --2- 172.21.15.79:0/2722785602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae780f5510 0x7fae780f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae76ffd700 1 -- 172.21.15.79:0/2722785602 >> v2:172.21.15.89:3300/0 conn(0x7fae781c2da0 msgr2=0x7fae781c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae76ffd700 1 --2- 172.21.15.79:0/2722785602 >> v2:172.21.15.89:3300/0 conn(0x7fae781c2da0 0x7fae781c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae76ffd700 1 -- 172.21.15.79:0/2722785602 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae780e56c0 con 0x7fae780e9ad0 2021-04-09T18:34:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae76ffd700 1 --2- 172.21.15.79:0/2722785602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae780e9ad0 0x7fae7809f100 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7fae6c002f30 tx=0x7fae6c00bd70).ready entity=mon.0 client_cookie=12eba6440e3330b7 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae767fc700 1 -- 172.21.15.79:0/2722785602 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fae780e56c0 con 0x7fae780e9ad0 2021-04-09T18:34:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae767fc700 1 -- 172.21.15.79:0/2722785602 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c0098b0 con 0x7fae780e9ad0 2021-04-09T18:34:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae767fc700 1 -- 172.21.15.79:0/2722785602 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fae6c009c80 con 0x7fae780e9ad0 2021-04-09T18:34:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae7ded9700 1 -- 172.21.15.79:0/2722785602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae780e9ad0 msgr2=0x7fae7809f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.427 7fae7ded9700 1 --2- 172.21.15.79:0/2722785602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae780e9ad0 0x7fae7809f100 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7fae6c002f30 tx=0x7fae6c00bd70).stop 2021-04-09T18:34:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.431 7fae7ded9700 1 -- 172.21.15.79:0/2722785602 shutdown_connections 2021-04-09T18:34:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.431 7fae7ded9700 1 --2- 172.21.15.79:0/2722785602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae780f5510 0x7fae780f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.431 7fae7ded9700 1 --2- 172.21.15.79:0/2722785602 >> v2:172.21.15.89:3300/0 conn(0x7fae781c2da0 0x7fae781c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.431 7fae7ded9700 1 --2- 172.21.15.79:0/2722785602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae780e9ad0 0x7fae7809f100 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.431 7fae7ded9700 1 -- 172.21.15.79:0/2722785602 >> 172.21.15.79:0/2722785602 conn(0x7fae780e5fd0 msgr2=0x7fae780e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.431 7fae7ded9700 1 -- 172.21.15.79:0/2722785602 shutdown_connections 2021-04-09T18:34:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.431 7fae7ded9700 1 -- 172.21.15.79:0/2722785602 wait complete. 2021-04-09T18:34:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.431 7fae7ded9700 1 Processor -- start 2021-04-09T18:34:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.431 7fae7ded9700 1 -- start start 2021-04-09T18:34:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae7ded9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae781ab550 0x7fae780ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae7ded9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae780ace50 0x7fae780af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae7ded9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae781a1f20 0x7fae780d49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae7ded9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae780adec0 con 0x7fae780ace50 2021-04-09T18:34:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae7ded9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae780ad2a0 con 0x7fae781a1f20 2021-04-09T18:34:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae7ded9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae780ae1c0 con 0x7fae781ab550 2021-04-09T18:34:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae76ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae780ace50 0x7fae780af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae76ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae780ace50 0x7fae780af7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34250/0 (socket says 172.21.15.79:34250) 2021-04-09T18:34:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae76ffd700 1 -- 172.21.15.79:0/1718827746 learned_addr learned my addr 172.21.15.79:0/1718827746 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:37.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae777fe700 1 --2- 172.21.15.79:0/1718827746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae781ab550 0x7fae780ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:37.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae77fff700 1 --2- 172.21.15.79:0/1718827746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae781a1f20 0x7fae780d49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:37.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae76ffd700 1 -- 172.21.15.79:0/1718827746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae781ab550 msgr2=0x7fae780ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:37.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae76ffd700 1 --2- 172.21.15.79:0/1718827746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae781ab550 0x7fae780ad5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae76ffd700 1 -- 172.21.15.79:0/1718827746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae781a1f20 msgr2=0x7fae780d49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:37.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae76ffd700 1 --2- 172.21.15.79:0/1718827746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae781a1f20 0x7fae780d49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae76ffd700 1 -- 172.21.15.79:0/1718827746 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae781a28a0 con 0x7fae780ace50 2021-04-09T18:34:37.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae76ffd700 1 --2- 172.21.15.79:0/1718827746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae780ace50 0x7fae780af7b0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7fae78094e10 tx=0x7fae6c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:37.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae5ffff700 1 -- 172.21.15.79:0/1718827746 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fae781a28a0 con 0x7fae780ace50 2021-04-09T18:34:37.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae7ded9700 1 -- 172.21.15.79:0/1718827746 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae781a2370 con 0x7fae780ace50 2021-04-09T18:34:37.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae5ffff700 1 -- 172.21.15.79:0/1718827746 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c018580 con 0x7fae780ace50 2021-04-09T18:34:37.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae5ffff700 1 -- 172.21.15.79:0/1718827746 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fae6c018950 con 0x7fae780ace50 2021-04-09T18:34:37.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae7ded9700 1 -- 172.21.15.79:0/1718827746 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae780d5010 con 0x7fae780ace50 2021-04-09T18:34:37.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.435 7fae5ffff700 1 -- 172.21.15.79:0/1718827746 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fae6c028060 con 0x7fae780ace50 2021-04-09T18:34:37.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.439 7fae5ffff700 1 --2- 172.21.15.79:0/1718827746 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fae58029100 0x7fae5802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:37.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.439 7fae5ffff700 1 -- 172.21.15.79:0/1718827746 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fae6c03c4f0 con 0x7fae780ace50 2021-04-09T18:34:37.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.439 7fae777fe700 1 --2- 172.21.15.79:0/1718827746 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fae58029100 0x7fae5802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:37.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.439 7fae777fe700 1 --2- 172.21.15.79:0/1718827746 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fae58029100 0x7fae5802b650 crc :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:37.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.439 7fae7ded9700 1 -- 172.21.15.79:0/1718827746 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae780e39d0 con 0x7fae780ace50 2021-04-09T18:34:37.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.447 7fae5ffff700 1 -- 172.21.15.79:0/1718827746 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fae6c0096a0 con 0x7fae780ace50 2021-04-09T18:34:37.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.607 7fae7ded9700 1 -- 172.21.15.79:0/1718827746 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae780f5b10 con 0x7fae780ace50 2021-04-09T18:34:37.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.607 7fae5ffff700 1 -- 172.21.15.79:0/1718827746 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+14358 (secure 0 0 0) 0x7fae6c018370 con 0x7fae780ace50 2021-04-09T18:34:37.615 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:37.616 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":108,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:34:33.298795","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:34:30.061943","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2021-04-09 18:34:30.884154","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.79:6833/1349682878":"2021-04-10 18:34:32.282358","172.21.15.79:6832/1349682878":"2021-04-10 18:34:32.282358"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:34:37.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.611 7fae7ded9700 1 -- 172.21.15.79:0/1718827746 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fae58029100 msgr2=0x7fae5802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:37.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.611 7fae7ded9700 1 --2- 172.21.15.79:0/1718827746 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fae58029100 0x7fae5802b650 crc :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.611 7fae7ded9700 1 -- 172.21.15.79:0/1718827746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae780ace50 msgr2=0x7fae780af7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:37.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.611 7fae7ded9700 1 --2- 172.21.15.79:0/1718827746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae780ace50 0x7fae780af7b0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7fae78094e10 tx=0x7fae6c006890).stop 2021-04-09T18:34:37.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.611 7fae7ded9700 1 -- 172.21.15.79:0/1718827746 shutdown_connections 2021-04-09T18:34:37.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.611 7fae7ded9700 1 --2- 172.21.15.79:0/1718827746 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fae58029100 0x7fae5802b650 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.611 7fae7ded9700 1 --2- 172.21.15.79:0/1718827746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae781a1f20 0x7fae780d49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.611 7fae7ded9700 1 --2- 172.21.15.79:0/1718827746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae781ab550 0x7fae780ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.611 7fae7ded9700 1 --2- 172.21.15.79:0/1718827746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae780ace50 0x7fae780af7b0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.611 7fae7ded9700 1 -- 172.21.15.79:0/1718827746 >> 172.21.15.79:0/1718827746 conn(0x7fae780bb1a0 msgr2=0x7fae78099430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:37.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.611 7fae7ded9700 1 -- 172.21.15.79:0/1718827746 shutdown_connections 2021-04-09T18:34:37.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.611 7fae7ded9700 1 -- 172.21.15.79:0/1718827746 wait complete. 2021-04-09T18:34:37.628 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:34:30.061943', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:34:30.884154', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:34:37.629 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:34:37.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.715 7ff3230f6700 1 Processor -- start 2021-04-09T18:34:37.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.715 7ff3230f6700 1 -- start start 2021-04-09T18:34:37.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.715 7ff3230f6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff31c0f5550 0x7ff31c0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:37.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.715 7ff3230f6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff31c0e9b10 0x7ff31c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:37.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.715 7ff3230f6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff31c1c2de0 0x7ff31c1c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.715 7ff3230f6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff31c0e9f60 con 0x7ff31c0f5550 2021-04-09T18:34:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.715 7ff3230f6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff31c0e5a00 con 0x7ff31c0e9b10 2021-04-09T18:34:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.715 7ff3230f6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c0fbb50 con 0x7ff31c1c2de0 2021-04-09T18:34:37.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff320e9a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff31c0f5550 0x7ff31c0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:37.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff320e9a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff31c0f5550 0x7ff31c0f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34258/0 (socket says 172.21.15.79:34258) 2021-04-09T18:34:37.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff320e9a700 1 -- 172.21.15.79:0/554454704 learned_addr learned my addr 172.21.15.79:0/554454704 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:37.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff32169b700 1 --2- 172.21.15.79:0/554454704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff31c1c2de0 0x7ff31c1c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:37.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff31bfff700 1 --2- 172.21.15.79:0/554454704 >> v2:172.21.15.89:3300/0 conn(0x7ff31c0e9b10 0x7ff31c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:37.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff320e9a700 1 -- 172.21.15.79:0/554454704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff31c1c2de0 msgr2=0x7ff31c1c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:37.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff320e9a700 1 --2- 172.21.15.79:0/554454704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff31c1c2de0 0x7ff31c1c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff320e9a700 1 -- 172.21.15.79:0/554454704 >> v2:172.21.15.89:3300/0 conn(0x7ff31c0e9b10 msgr2=0x7ff31c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:37.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff320e9a700 1 --2- 172.21.15.79:0/554454704 >> v2:172.21.15.89:3300/0 conn(0x7ff31c0e9b10 0x7ff31c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff320e9a700 1 -- 172.21.15.79:0/554454704 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c0e5700 con 0x7ff31c0f5550 2021-04-09T18:34:37.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff320e9a700 1 --2- 172.21.15.79:0/554454704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff31c0f5550 0x7ff31c0f64e0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7ff31c125470 tx=0x7ff30400bda0).ready entity=mon.0 client_cookie=ee3342b615f83114 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:37.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff31b7fe700 1 -- 172.21.15.79:0/554454704 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff31c0e5700 con 0x7ff31c0f5550 2021-04-09T18:34:37.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff31b7fe700 1 -- 172.21.15.79:0/554454704 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff304009940 con 0x7ff31c0f5550 2021-04-09T18:34:37.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff31b7fe700 1 -- 172.21.15.79:0/554454704 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff304009d10 con 0x7ff31c0f5550 2021-04-09T18:34:37.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff3230f6700 1 -- 172.21.15.79:0/554454704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff31c0f5550 msgr2=0x7ff31c0f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:37.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff3230f6700 1 --2- 172.21.15.79:0/554454704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff31c0f5550 0x7ff31c0f64e0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7ff31c125470 tx=0x7ff30400bda0).stop 2021-04-09T18:34:37.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff3230f6700 1 -- 172.21.15.79:0/554454704 shutdown_connections 2021-04-09T18:34:37.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff3230f6700 1 --2- 172.21.15.79:0/554454704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff31c1c2de0 0x7ff31c1c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff3230f6700 1 --2- 172.21.15.79:0/554454704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff31c0f5550 0x7ff31c0f64e0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff3230f6700 1 --2- 172.21.15.79:0/554454704 >> v2:172.21.15.89:3300/0 conn(0x7ff31c0e9b10 0x7ff31c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff3230f6700 1 -- 172.21.15.79:0/554454704 >> 172.21.15.79:0/554454704 conn(0x7ff31c0e6010 msgr2=0x7ff31c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:37.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff3230f6700 1 -- 172.21.15.79:0/554454704 shutdown_connections 2021-04-09T18:34:37.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.719 7ff3230f6700 1 -- 172.21.15.79:0/554454704 wait complete. 2021-04-09T18:34:37.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff3230f6700 1 Processor -- start 2021-04-09T18:34:37.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff3230f6700 1 -- start start 2021-04-09T18:34:37.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff3230f6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff31c0c49e0 0x7ff31c1b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:37.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff3230f6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff31c0972c0 0x7ff31c097710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:37.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff3230f6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff31c097d40 0x7ff31c0d4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:37.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff3230f6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c0af900 con 0x7ff31c0c49e0 2021-04-09T18:34:37.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff3230f6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c0afc00 con 0x7ff31c097d40 2021-04-09T18:34:37.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff3230f6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c0af490 con 0x7ff31c0972c0 2021-04-09T18:34:37.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff320e9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff31c0c49e0 0x7ff31c1b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:37.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff320e9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff31c0c49e0 0x7ff31c1b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34264/0 (socket says 172.21.15.79:34264) 2021-04-09T18:34:37.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff320e9a700 1 -- 172.21.15.79:0/1031748146 learned_addr learned my addr 172.21.15.79:0/1031748146 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:37.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff31bfff700 1 --2- 172.21.15.79:0/1031748146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff31c0972c0 0x7ff31c097710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:37.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff32169b700 1 --2- 172.21.15.79:0/1031748146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff31c097d40 0x7ff31c0d4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:37.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff320e9a700 1 -- 172.21.15.79:0/1031748146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff31c0972c0 msgr2=0x7ff31c097710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:37.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff320e9a700 1 --2- 172.21.15.79:0/1031748146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff31c0972c0 0x7ff31c097710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff320e9a700 1 -- 172.21.15.79:0/1031748146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff31c097d40 msgr2=0x7ff31c0d4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:37.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff320e9a700 1 --2- 172.21.15.79:0/1031748146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff31c097d40 0x7ff31c0d4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff320e9a700 1 -- 172.21.15.79:0/1031748146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c0d4e60 con 0x7ff31c0c49e0 2021-04-09T18:34:37.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff31bfff700 1 --2- 172.21.15.79:0/1031748146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff31c0972c0 0x7ff31c097710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:37.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff320e9a700 1 --2- 172.21.15.79:0/1031748146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff31c0c49e0 0x7ff31c1b1250 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7ff31c0afe00 tx=0x7ff304006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:37.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff3197fa700 1 -- 172.21.15.79:0/1031748146 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff31c0d4e60 con 0x7ff31c0c49e0 2021-04-09T18:34:37.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff3197fa700 1 -- 172.21.15.79:0/1031748146 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff304011d30 con 0x7ff31c0c49e0 2021-04-09T18:34:37.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff3230f6700 1 -- 172.21.15.79:0/1031748146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31c0d50c0 con 0x7ff31c0c49e0 2021-04-09T18:34:37.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff3197fa700 1 -- 172.21.15.79:0/1031748146 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff30401d640 con 0x7ff31c0c49e0 2021-04-09T18:34:37.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.723 7ff3230f6700 1 -- 172.21.15.79:0/1031748146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31c0d55d0 con 0x7ff31c0c49e0 2021-04-09T18:34:37.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.727 7ff3197fa700 1 -- 172.21.15.79:0/1031748146 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff3040253a0 con 0x7ff31c0c49e0 2021-04-09T18:34:37.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.727 7ff3197fa700 1 --2- 172.21.15.79:0/1031748146 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff300029100 0x7ff30002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:37.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.727 7ff3197fa700 1 -- 172.21.15.79:0/1031748146 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6010+0+0 (secure 0 0 0) 0x7ff30403b470 con 0x7ff31c0c49e0 2021-04-09T18:34:37.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.727 7ff31bfff700 1 --2- 172.21.15.79:0/1031748146 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff300029100 0x7ff30002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:37.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.727 7ff31bfff700 1 --2- 172.21.15.79:0/1031748146 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff300029100 0x7ff30002b650 crc :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:37.753 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.731 7ff3230f6700 1 -- 172.21.15.79:0/1031748146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31c0e39f0 con 0x7ff31c0c49e0 2021-04-09T18:34:37.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.739 7ff3197fa700 1 -- 172.21.15.79:0/1031748146 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff304011b20 con 0x7ff31c0c49e0 2021-04-09T18:34:37.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.895 7ff3230f6700 1 -- 172.21.15.79:0/1031748146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7ff31c0f5b50 con 0x7ff31c0c49e0 2021-04-09T18:34:37.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.895 7ff3197fa700 1 -- 172.21.15.79:0/1031748146 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v108) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff304009730 con 0x7ff31c0c49e0 2021-04-09T18:34:37.900 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:34:37.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.895 7ff3230f6700 1 -- 172.21.15.79:0/1031748146 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff300029100 msgr2=0x7ff30002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:37.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.895 7ff3230f6700 1 --2- 172.21.15.79:0/1031748146 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff300029100 0x7ff30002b650 crc :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.895 7ff3230f6700 1 -- 172.21.15.79:0/1031748146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff31c0c49e0 msgr2=0x7ff31c1b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:37.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.895 7ff3230f6700 1 --2- 172.21.15.79:0/1031748146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff31c0c49e0 0x7ff31c1b1250 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7ff31c0afe00 tx=0x7ff304006890).stop 2021-04-09T18:34:37.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.899 7ff3230f6700 1 -- 172.21.15.79:0/1031748146 shutdown_connections 2021-04-09T18:34:37.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.899 7ff3230f6700 1 --2- 172.21.15.79:0/1031748146 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff300029100 0x7ff30002b650 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.899 7ff3230f6700 1 --2- 172.21.15.79:0/1031748146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff31c097d40 0x7ff31c0d4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.899 7ff3230f6700 1 --2- 172.21.15.79:0/1031748146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff31c0c49e0 0x7ff31c1b1250 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.899 7ff3230f6700 1 --2- 172.21.15.79:0/1031748146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff31c0972c0 0x7ff31c097710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:37.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.899 7ff3230f6700 1 -- 172.21.15.79:0/1031748146 >> 172.21.15.79:0/1031748146 conn(0x7ff31c09af00 msgr2=0x7ff31c095fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:37.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.899 7ff3230f6700 1 -- 172.21.15.79:0/1031748146 shutdown_connections 2021-04-09T18:34:37.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:37.899 7ff3230f6700 1 -- 172.21.15.79:0/1031748146 wait complete. 2021-04-09T18:34:37.913 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:34:38.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.003 7f22271ad700 1 Processor -- start 2021-04-09T18:34:38.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.003 7f22271ad700 1 -- start start 2021-04-09T18:34:38.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.003 7f22271ad700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22200e9b10 0x7f222009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:38.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.003 7f22271ad700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22200fbb50 con 0x7f22200f5550 2021-04-09T18:34:38.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.003 7f22271ad700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22200e5700 con 0x7f22201c8040 2021-04-09T18:34:38.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.003 7f22271ad700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22201c3df0 con 0x7f22200e9b10 2021-04-09T18:34:38.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.003 7f221ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22200e9b10 0x7f222009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:38.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.003 7f221ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22200e9b10 0x7f222009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34274/0 (socket says 172.21.15.79:34274) 2021-04-09T18:34:38.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.003 7f221ffff700 1 -- 172.21.15.79:0/135609808 learned_addr learned my addr 172.21.15.79:0/135609808 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:38.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.003 7f2224f51700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f22200f5550 0x7f22200f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57214/0 (socket says 172.21.15.79:57214) 2021-04-09T18:34:38.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.007 7f221ffff700 1 -- 172.21.15.79:0/135609808 >> v1:172.21.15.89:6789/0 conn(0x7f22201c8040 legacy=0x7f22201ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.007 7f221ffff700 1 -- 172.21.15.79:0/135609808 >> v1:172.21.15.79:6789/0 conn(0x7f22200f5550 legacy=0x7f22200f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.007 7f221ffff700 1 -- 172.21.15.79:0/135609808 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22200e4360 con 0x7f22200e9b10 2021-04-09T18:34:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.007 7f221ffff700 1 --2- 172.21.15.79:0/135609808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22200e9b10 0x7f222009f110 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f2214002f30 tx=0x7f221400bd20).ready entity=mon.0 client_cookie=543f089c9ba2b4c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.007 7f221f7fe700 1 -- 172.21.15.79:0/135609808 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f22200e4360 con 0x7f22200e9b10 2021-04-09T18:34:38.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.007 7f221f7fe700 1 -- 172.21.15.79:0/135609808 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2214009a20 con 0x7f22200e9b10 2021-04-09T18:34:38.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.007 7f221f7fe700 1 -- 172.21.15.79:0/135609808 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2214009df0 con 0x7f22200e9b10 2021-04-09T18:34:38.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.007 7f22271ad700 1 -- 172.21.15.79:0/135609808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22200e9b10 msgr2=0x7f222009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:38.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.007 7f22271ad700 1 --2- 172.21.15.79:0/135609808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22200e9b10 0x7f222009f110 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f2214002f30 tx=0x7f221400bd20).stop 2021-04-09T18:34:38.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.007 7f22271ad700 1 -- 172.21.15.79:0/135609808 shutdown_connections 2021-04-09T18:34:38.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.007 7f22271ad700 1 --2- 172.21.15.79:0/135609808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22200e9b10 0x7f222009f110 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.007 7f22271ad700 1 -- 172.21.15.79:0/135609808 >> 172.21.15.79:0/135609808 conn(0x7f22200e6010 msgr2=0x7f22200e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:38.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.007 7f22271ad700 1 -- 172.21.15.79:0/135609808 shutdown_connections 2021-04-09T18:34:38.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.007 7f22271ad700 1 -- 172.21.15.79:0/135609808 wait complete. 2021-04-09T18:34:38.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.011 7f22271ad700 1 Processor -- start 2021-04-09T18:34:38.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.011 7f22271ad700 1 -- start start 2021-04-09T18:34:38.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.011 7f22271ad700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22200b0360 0x7f22201d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.011 7f22271ad700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22201d1160 0x7f2220093b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.011 7f22271ad700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2220094130 0x7f22200bbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.011 7f22271ad700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22200e9f60 con 0x7f22201d1160 2021-04-09T18:34:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.011 7f22271ad700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22200b0ad0 con 0x7f22200b0360 2021-04-09T18:34:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.011 7f22271ad700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22200b07b0 con 0x7f2220094130 2021-04-09T18:34:38.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.011 7f221ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22201d1160 0x7f2220093b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:38.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.011 7f221ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22201d1160 0x7f2220093b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34280/0 (socket says 172.21.15.79:34280) 2021-04-09T18:34:38.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.011 7f221ffff700 1 -- 172.21.15.79:0/236907183 learned_addr learned my addr 172.21.15.79:0/236907183 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:38.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.011 7f2224f51700 1 --2- 172.21.15.79:0/236907183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22200b0360 0x7f22201d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:38.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.011 7f2225752700 1 --2- 172.21.15.79:0/236907183 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2220094130 0x7f22200bbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:38.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.011 7f221ffff700 1 -- 172.21.15.79:0/236907183 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2220094130 msgr2=0x7f22200bbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:38.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.015 7f221ffff700 1 --2- 172.21.15.79:0/236907183 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2220094130 0x7f22200bbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.015 7f221ffff700 1 -- 172.21.15.79:0/236907183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22200b0360 msgr2=0x7f22201d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:38.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.015 7f221ffff700 1 --2- 172.21.15.79:0/236907183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22200b0360 0x7f22201d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.015 7f221ffff700 1 -- 172.21.15.79:0/236907183 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22200bc3c0 con 0x7f22201d1160 2021-04-09T18:34:38.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.015 7f2224f51700 1 --2- 172.21.15.79:0/236907183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22200b0360 0x7f22201d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:38.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.015 7f221ffff700 1 --2- 172.21.15.79:0/236907183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22201d1160 0x7f2220093b00 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f22200bb250 tx=0x7f2214006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:38.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.015 7f221d7fa700 1 -- 172.21.15.79:0/236907183 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f22200bc3c0 con 0x7f22201d1160 2021-04-09T18:34:38.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.015 7f221d7fa700 1 -- 172.21.15.79:0/236907183 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221401d440 con 0x7f22201d1160 2021-04-09T18:34:38.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.015 7f22271ad700 1 -- 172.21.15.79:0/236907183 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22200bc680 con 0x7f22201d1160 2021-04-09T18:34:38.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.015 7f221d7fa700 1 -- 172.21.15.79:0/236907183 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f221401d810 con 0x7f22201d1160 2021-04-09T18:34:38.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.015 7f22271ad700 1 -- 172.21.15.79:0/236907183 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22200bc990 con 0x7f22201d1160 2021-04-09T18:34:38.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.015 7f221d7fa700 1 -- 172.21.15.79:0/236907183 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2214026450 con 0x7f22201d1160 2021-04-09T18:34:38.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.015 7f221d7fa700 1 --2- 172.21.15.79:0/236907183 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f22000290a0 0x7f220002b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:38.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.015 7f221d7fa700 1 -- 172.21.15.79:0/236907183 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f221403b270 con 0x7f22201d1160 2021-04-09T18:34:38.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.015 7f2224f51700 1 --2- 172.21.15.79:0/236907183 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f22000290a0 0x7f220002b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:38.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.015 7f2224f51700 1 --2- 172.21.15.79:0/236907183 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f22000290a0 0x7f220002b5f0 crc :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:38.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.015 7f22271ad700 1 -- 172.21.15.79:0/236907183 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22200e39f0 con 0x7f22201d1160 2021-04-09T18:34:38.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.023 7f221d7fa700 1 -- 172.21.15.79:0/236907183 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2214009810 con 0x7f22201d1160 2021-04-09T18:34:38.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.175 7f22271ad700 1 -- 172.21.15.79:0/236907183 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f22200a1c90 con 0x7f22201d1160 2021-04-09T18:34:38.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.175 7f221d7fa700 1 -- 172.21.15.79:0/236907183 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v108) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2214011dc0 con 0x7f22201d1160 2021-04-09T18:34:38.183 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:34:38.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.179 7f22271ad700 1 -- 172.21.15.79:0/236907183 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f22000290a0 msgr2=0x7f220002b5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:38.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.179 7f22271ad700 1 --2- 172.21.15.79:0/236907183 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f22000290a0 0x7f220002b5f0 crc :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.179 7f22271ad700 1 -- 172.21.15.79:0/236907183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22201d1160 msgr2=0x7f2220093b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:38.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.179 7f22271ad700 1 --2- 172.21.15.79:0/236907183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22201d1160 0x7f2220093b00 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f22200bb250 tx=0x7f2214006890).stop 2021-04-09T18:34:38.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.179 7f22271ad700 1 -- 172.21.15.79:0/236907183 shutdown_connections 2021-04-09T18:34:38.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.179 7f22271ad700 1 --2- 172.21.15.79:0/236907183 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f22000290a0 0x7f220002b5f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.179 7f22271ad700 1 --2- 172.21.15.79:0/236907183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22200b0360 0x7f22201d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.179 7f22271ad700 1 --2- 172.21.15.79:0/236907183 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2220094130 0x7f22200bbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.179 7f22271ad700 1 --2- 172.21.15.79:0/236907183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22201d1160 0x7f2220093b00 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.179 7f22271ad700 1 -- 172.21.15.79:0/236907183 >> 172.21.15.79:0/236907183 conn(0x7f2220098230 msgr2=0x7f22200ac9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:38.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.179 7f22271ad700 1 -- 172.21.15.79:0/236907183 shutdown_connections 2021-04-09T18:34:38.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.179 7f22271ad700 1 -- 172.21.15.79:0/236907183 wait complete. 2021-04-09T18:34:38.194 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:34:38.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.291 7f327d928700 1 Processor -- start 2021-04-09T18:34:38.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.291 7f327d928700 1 -- start start 2021-04-09T18:34:38.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.291 7f327d928700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f32780f5550 0x7f32780f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:38.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.291 7f327d928700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f32781c8040 0x7f32781ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:38.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.291 7f327d928700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32780fbb50 con 0x7f32780e9b10 2021-04-09T18:34:38.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.291 7f327d928700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32780e9f60 con 0x7f32780f5550 2021-04-09T18:34:38.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.291 7f327d928700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32781c3df0 con 0x7f32781c8040 2021-04-09T18:34:38.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.291 7f3277550700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f32780f5550 0x7f32780f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:38.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.291 7f3277550700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f32780f5550 0x7f32780f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34288/0 (socket says 172.21.15.79:34288) 2021-04-09T18:34:38.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.291 7f3277550700 1 -- 172.21.15.79:0/1622613201 learned_addr learned my addr 172.21.15.79:0/1622613201 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:38.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.291 7f3277d51700 1 --2- 172.21.15.79:0/1622613201 >> v2:172.21.15.89:3300/0 conn(0x7f32781c8040 0x7f32781ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:38.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.291 7f3277550700 1 -- 172.21.15.79:0/1622613201 >> v2:172.21.15.89:3300/0 conn(0x7f32781c8040 msgr2=0x7f32781ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:38.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.291 7f3277550700 1 --2- 172.21.15.79:0/1622613201 >> v2:172.21.15.89:3300/0 conn(0x7f32781c8040 0x7f32781ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.291 7f3277550700 1 -- 172.21.15.79:0/1622613201 >> v1:172.21.15.89:6789/0 conn(0x7f32780e9b10 legacy=0x7f327809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:38.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.291 7f3277550700 1 -- 172.21.15.79:0/1622613201 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327809f910 con 0x7f32780f5550 2021-04-09T18:34:38.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.291 7f3277550700 1 --2- 172.21.15.79:0/1622613201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32780f5550 0x7f32780f64e0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f32680032b0 tx=0x7f326800b3c0).ready entity=mon.0 client_cookie=b70925c316fa7c4e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:38.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.291 7f327654e700 1 -- 172.21.15.79:0/1622613201 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f327809f910 con 0x7f32780f5550 2021-04-09T18:34:38.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.295 7f327654e700 1 -- 172.21.15.79:0/1622613201 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326800bc20 con 0x7f32780f5550 2021-04-09T18:34:38.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.295 7f327654e700 1 -- 172.21.15.79:0/1622613201 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3268002020 con 0x7f32780f5550 2021-04-09T18:34:38.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.295 7f327d928700 1 -- 172.21.15.79:0/1622613201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32780f5550 msgr2=0x7f32780f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:38.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.295 7f327d928700 1 --2- 172.21.15.79:0/1622613201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32780f5550 0x7f32780f64e0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f32680032b0 tx=0x7f326800b3c0).stop 2021-04-09T18:34:38.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.295 7f327d928700 1 -- 172.21.15.79:0/1622613201 shutdown_connections 2021-04-09T18:34:38.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.295 7f327d928700 1 --2- 172.21.15.79:0/1622613201 >> v2:172.21.15.89:3300/0 conn(0x7f32781c8040 0x7f32781ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.295 7f327d928700 1 --2- 172.21.15.79:0/1622613201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32780f5550 0x7f32780f64e0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.295 7f327d928700 1 -- 172.21.15.79:0/1622613201 >> 172.21.15.79:0/1622613201 conn(0x7f32780e6010 msgr2=0x7f32780e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:38.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.295 7f327d928700 1 -- 172.21.15.79:0/1622613201 shutdown_connections 2021-04-09T18:34:38.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.295 7f327d928700 1 -- 172.21.15.79:0/1622613201 wait complete. 2021-04-09T18:34:38.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f327d928700 1 Processor -- start 2021-04-09T18:34:38.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f327d928700 1 -- start start 2021-04-09T18:34:38.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f327d928700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f327809a8e0 0x7f32780d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:38.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f327d928700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32780d6ca0 0x7f32780d70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:38.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f327d928700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32780a8a60 0x7f32780a8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:38.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f327d928700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327809b030 con 0x7f32780d6ca0 2021-04-09T18:34:38.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f327d928700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327809ad30 con 0x7f32780a8a60 2021-04-09T18:34:38.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f327d928700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327809a4c0 con 0x7f327809a8e0 2021-04-09T18:34:38.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f3276d4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32780d6ca0 0x7f32780d70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:38.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f3276d4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32780d6ca0 0x7f32780d70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34292/0 (socket says 172.21.15.79:34292) 2021-04-09T18:34:38.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f3276d4f700 1 -- 172.21.15.79:0/2111977136 learned_addr learned my addr 172.21.15.79:0/2111977136 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:38.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f3277550700 1 --2- 172.21.15.79:0/2111977136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f327809a8e0 0x7f32780d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:38.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f3277d51700 1 --2- 172.21.15.79:0/2111977136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32780a8a60 0x7f32780a8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:38.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f3276d4f700 1 -- 172.21.15.79:0/2111977136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f327809a8e0 msgr2=0x7f32780d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:38.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f3276d4f700 1 --2- 172.21.15.79:0/2111977136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f327809a8e0 0x7f32780d0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f3276d4f700 1 -- 172.21.15.79:0/2111977136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32780a8a60 msgr2=0x7f32780a8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:38.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f3276d4f700 1 --2- 172.21.15.79:0/2111977136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32780a8a60 0x7f32780a8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f3276d4f700 1 -- 172.21.15.79:0/2111977136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32781a8720 con 0x7f32780d6ca0 2021-04-09T18:34:38.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f3276d4f700 1 --2- 172.21.15.79:0/2111977136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32780d6ca0 0x7f32780d70f0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f32780ba440 tx=0x7f326000cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:38.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f326ffff700 1 -- 172.21.15.79:0/2111977136 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f32781a8720 con 0x7f32780d6ca0 2021-04-09T18:34:38.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f326ffff700 1 -- 172.21.15.79:0/2111977136 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3260010510 con 0x7f32780d6ca0 2021-04-09T18:34:38.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f327d928700 1 -- 172.21.15.79:0/2111977136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32780adf50 con 0x7f32780d6ca0 2021-04-09T18:34:38.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f326ffff700 1 -- 172.21.15.79:0/2111977136 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f32600106f0 con 0x7f32780d6ca0 2021-04-09T18:34:38.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f327d928700 1 -- 172.21.15.79:0/2111977136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32780d7720 con 0x7f32780d6ca0 2021-04-09T18:34:38.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f326ffff700 1 -- 172.21.15.79:0/2111977136 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3260019020 con 0x7f32780d6ca0 2021-04-09T18:34:38.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f326ffff700 1 --2- 172.21.15.79:0/2111977136 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f325c029100 0x7f325c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:38.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.299 7f326ffff700 1 -- 172.21.15.79:0/2111977136 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f3260038e60 con 0x7f32780d6ca0 2021-04-09T18:34:38.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.303 7f3277550700 1 --2- 172.21.15.79:0/2111977136 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f325c029100 0x7f325c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:38.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.303 7f3277550700 1 --2- 172.21.15.79:0/2111977136 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f325c029100 0x7f325c02b650 crc :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:38.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.307 7f327d928700 1 -- 172.21.15.79:0/2111977136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32780e39f0 con 0x7f32780d6ca0 2021-04-09T18:34:38.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.315 7f326ffff700 1 -- 172.21.15.79:0/2111977136 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3260010300 con 0x7f32780d6ca0 2021-04-09T18:34:38.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.467 7f327d928700 1 -- 172.21.15.79:0/2111977136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f32780a1c90 con 0x7f32780d6ca0 2021-04-09T18:34:38.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.467 7f326ffff700 1 -- 172.21.15.79:0/2111977136 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v108) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3260000bf0 con 0x7f32780d6ca0 2021-04-09T18:34:38.473 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:34:38.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.471 7f327d928700 1 -- 172.21.15.79:0/2111977136 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f325c029100 msgr2=0x7f325c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:38.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.471 7f327d928700 1 --2- 172.21.15.79:0/2111977136 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f325c029100 0x7f325c02b650 crc :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.471 7f327d928700 1 -- 172.21.15.79:0/2111977136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32780d6ca0 msgr2=0x7f32780d70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:38.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.471 7f327d928700 1 --2- 172.21.15.79:0/2111977136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32780d6ca0 0x7f32780d70f0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f32780ba440 tx=0x7f326000cae0).stop 2021-04-09T18:34:38.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.471 7f327d928700 1 -- 172.21.15.79:0/2111977136 shutdown_connections 2021-04-09T18:34:38.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.471 7f327d928700 1 --2- 172.21.15.79:0/2111977136 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f325c029100 0x7f325c02b650 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.471 7f327d928700 1 --2- 172.21.15.79:0/2111977136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32780a8a60 0x7f32780a8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.471 7f327d928700 1 --2- 172.21.15.79:0/2111977136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f327809a8e0 0x7f32780d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.471 7f327d928700 1 --2- 172.21.15.79:0/2111977136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32780d6ca0 0x7f32780d70f0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.471 7f327d928700 1 -- 172.21.15.79:0/2111977136 >> 172.21.15.79:0/2111977136 conn(0x7f32780d85c0 msgr2=0x7f3278093730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:38.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.471 7f327d928700 1 -- 172.21.15.79:0/2111977136 shutdown_connections 2021-04-09T18:34:38.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.471 7f327d928700 1 -- 172.21.15.79:0/2111977136 wait complete. 2021-04-09T18:34:38.485 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:34:38.486 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:34:38.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff9471700 1 Processor -- start 2021-04-09T18:34:38.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff9471700 1 -- start start 2021-04-09T18:34:38.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff9471700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0ff40f5520 0x7f0ff40f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:38.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff9471700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ff40e9ae0 0x7f0ff409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:38.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff9471700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff40fbb20 con 0x7f0ff41c2db0 2021-04-09T18:34:38.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff9471700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff40e9f30 con 0x7f0ff40f5520 2021-04-09T18:34:38.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff9471700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40e59d0 con 0x7f0ff40e9ae0 2021-04-09T18:34:38.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff3005700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0ff40f5520 0x7f0ff40f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:38.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff3806700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0ff41c2db0 0x7f0ff41c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57246/0 (socket says 172.21.15.79:57246) 2021-04-09T18:34:38.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff3806700 1 -- 172.21.15.79:0/2415009635 learned_addr learned my addr 172.21.15.79:0/2415009635 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:38.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff2804700 1 --2- 172.21.15.79:0/2415009635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ff40e9ae0 0x7f0ff409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:38.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff2003700 1 -- 172.21.15.79:0/2415009635 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1626903468 0 0) 0x7f0fec001450 con 0x7f0ff41c2db0 2021-04-09T18:34:38.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff2003700 1 -- 172.21.15.79:0/2415009635 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fdc003240 con 0x7f0ff41c2db0 2021-04-09T18:34:38.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff3005700 1 -- 172.21.15.79:0/2415009635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ff40e9ae0 msgr2=0x7f0ff409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:38.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff3005700 1 --2- 172.21.15.79:0/2415009635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ff40e9ae0 0x7f0ff409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff3005700 1 -- 172.21.15.79:0/2415009635 >> v1:172.21.15.79:6789/0 conn(0x7f0ff41c2db0 legacy=0x7f0ff41c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:38.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff3005700 1 -- 172.21.15.79:0/2415009635 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff40e56d0 con 0x7f0ff40f5520 2021-04-09T18:34:38.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff2804700 1 --2- 172.21.15.79:0/2415009635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ff40e9ae0 0x7f0ff409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:38.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff3005700 1 --2- 172.21.15.79:0/2415009635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ff40f5520 0x7f0ff40f64b0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f0fe4002f30 tx=0x7f0fe400bd40).ready entity=mon.0 client_cookie=b8e252c141c9039 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:38.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff2003700 1 -- 172.21.15.79:0/2415009635 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ff40e56d0 con 0x7f0ff40f5520 2021-04-09T18:34:38.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff2003700 1 -- 172.21.15.79:0/2415009635 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe4009850 con 0x7f0ff40f5520 2021-04-09T18:34:38.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff2003700 1 -- 172.21.15.79:0/2415009635 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0fe4009c20 con 0x7f0ff40f5520 2021-04-09T18:34:38.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff9471700 1 -- 172.21.15.79:0/2415009635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ff40f5520 msgr2=0x7f0ff40f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:38.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.575 7f0ff9471700 1 --2- 172.21.15.79:0/2415009635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ff40f5520 0x7f0ff40f64b0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f0fe4002f30 tx=0x7f0fe400bd40).stop 2021-04-09T18:34:38.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.579 7f0ff9471700 1 -- 172.21.15.79:0/2415009635 shutdown_connections 2021-04-09T18:34:38.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.579 7f0ff9471700 1 --2- 172.21.15.79:0/2415009635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ff40f5520 0x7f0ff40f64b0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.579 7f0ff9471700 1 --2- 172.21.15.79:0/2415009635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ff40e9ae0 0x7f0ff409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.579 7f0ff9471700 1 -- 172.21.15.79:0/2415009635 >> 172.21.15.79:0/2415009635 conn(0x7f0ff40e5fe0 msgr2=0x7f0ff40e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:38.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.579 7f0ff9471700 1 -- 172.21.15.79:0/2415009635 shutdown_connections 2021-04-09T18:34:38.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.579 7f0ff9471700 1 -- 172.21.15.79:0/2415009635 wait complete. 2021-04-09T18:34:38.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff9471700 1 Processor -- start 2021-04-09T18:34:38.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff9471700 1 -- start start 2021-04-09T18:34:38.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff9471700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ff4099ae0 0x7f0ff4099f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:38.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff9471700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff4094310 0x7f0ff4094760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:38.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff9471700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ff40ce8b0 0x7f0ff40ced00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:38.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff9471700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40d5670 con 0x7f0ff40ce8b0 2021-04-09T18:34:38.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff9471700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40d5970 con 0x7f0ff4094310 2021-04-09T18:34:38.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff9471700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40d5200 con 0x7f0ff4099ae0 2021-04-09T18:34:38.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff3806700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ff40ce8b0 0x7f0ff40ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:38.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff3806700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ff40ce8b0 0x7f0ff40ced00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34308/0 (socket says 172.21.15.79:34308) 2021-04-09T18:34:38.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff3806700 1 -- 172.21.15.79:0/100128682 learned_addr learned my addr 172.21.15.79:0/100128682 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:38.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff3005700 1 --2- 172.21.15.79:0/100128682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ff4099ae0 0x7f0ff4099f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:38.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff2804700 1 --2- 172.21.15.79:0/100128682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff4094310 0x7f0ff4094760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:38.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff3806700 1 -- 172.21.15.79:0/100128682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ff4099ae0 msgr2=0x7f0ff4099f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:38.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff3806700 1 --2- 172.21.15.79:0/100128682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ff4099ae0 0x7f0ff4099f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff3806700 1 -- 172.21.15.79:0/100128682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff4094310 msgr2=0x7f0ff4094760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:38.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff3806700 1 --2- 172.21.15.79:0/100128682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff4094310 0x7f0ff4094760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff3806700 1 -- 172.21.15.79:0/100128682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff4094d90 con 0x7f0ff40ce8b0 2021-04-09T18:34:38.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff3806700 1 --2- 172.21.15.79:0/100128682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ff40ce8b0 0x7f0ff40ced00 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f0ff40b9a40 tx=0x7f0fec00ce90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:38.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0fdbfff700 1 -- 172.21.15.79:0/100128682 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ff4094d90 con 0x7f0ff40ce8b0 2021-04-09T18:34:38.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0fdbfff700 1 -- 172.21.15.79:0/100128682 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec005b80 con 0x7f0ff40ce8b0 2021-04-09T18:34:38.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0fdbfff700 1 -- 172.21.15.79:0/100128682 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0fec004880 con 0x7f0ff40ce8b0 2021-04-09T18:34:38.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff9471700 1 -- 172.21.15.79:0/100128682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff40b9010 con 0x7f0ff40ce8b0 2021-04-09T18:34:38.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0ff9471700 1 -- 172.21.15.79:0/100128682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff40cf4c0 con 0x7f0ff40ce8b0 2021-04-09T18:34:38.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.583 7f0fdbfff700 1 -- 172.21.15.79:0/100128682 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0fec004a80 con 0x7f0ff40ce8b0 2021-04-09T18:34:38.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.587 7f0fdbfff700 1 --2- 172.21.15.79:0/100128682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0fd4029100 0x7f0fd402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:38.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.587 7f0fdbfff700 1 -- 172.21.15.79:0/100128682 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f0fec039250 con 0x7f0ff40ce8b0 2021-04-09T18:34:38.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.587 7f0ff3005700 1 --2- 172.21.15.79:0/100128682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0fd4029100 0x7f0fd402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:38.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.587 7f0ff3005700 1 --2- 172.21.15.79:0/100128682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0fd4029100 0x7f0fd402b650 crc :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:38.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.587 7f0ff9471700 1 -- 172.21.15.79:0/100128682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff40e39e0 con 0x7f0ff40ce8b0 2021-04-09T18:34:38.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.595 7f0fdbfff700 1 -- 172.21.15.79:0/100128682 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0fec005970 con 0x7f0ff40ce8b0 2021-04-09T18:34:38.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.759 7f0ff9471700 1 -- 172.21.15.79:0/100128682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ff40f5b20 con 0x7f0ff40ce8b0 2021-04-09T18:34:38.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.759 7f0fdbfff700 1 -- 172.21.15.79:0/100128682 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+2104 (secure 0 0 0) 0x7f0fec000f70 con 0x7f0ff40ce8b0 2021-04-09T18:34:38.767 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:38.767 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":68,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7456,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/128870944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":128870944},{"type":"v1","addr":"172.21.15.89:6835","nonce":128870944}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":66}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:34:31.841744","modified":"2021-04-09 18:34:33.860013","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7452":{"gid":7452,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/1381942487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1381942487},{"type":"v1","addr":"172.21.15.79:6833","nonce":1381942487}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-04-09T18:34:38.768 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 68 2021-04-09T18:34:38.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.763 7f0ff9471700 1 -- 172.21.15.79:0/100128682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0fd4029100 msgr2=0x7f0fd402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:38.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.763 7f0ff9471700 1 --2- 172.21.15.79:0/100128682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0fd4029100 0x7f0fd402b650 crc :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.763 7f0ff9471700 1 -- 172.21.15.79:0/100128682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ff40ce8b0 msgr2=0x7f0ff40ced00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:38.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.763 7f0ff9471700 1 --2- 172.21.15.79:0/100128682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ff40ce8b0 0x7f0ff40ced00 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f0ff40b9a40 tx=0x7f0fec00ce90).stop 2021-04-09T18:34:38.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.763 7f0ff9471700 1 -- 172.21.15.79:0/100128682 shutdown_connections 2021-04-09T18:34:38.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.763 7f0ff9471700 1 --2- 172.21.15.79:0/100128682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0fd4029100 0x7f0fd402b650 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.763 7f0ff9471700 1 --2- 172.21.15.79:0/100128682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ff40ce8b0 0x7f0ff40ced00 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.763 7f0ff9471700 1 --2- 172.21.15.79:0/100128682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ff4099ae0 0x7f0ff4099f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.763 7f0ff9471700 1 --2- 172.21.15.79:0/100128682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff4094310 0x7f0ff4094760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:38.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.763 7f0ff9471700 1 -- 172.21.15.79:0/100128682 >> 172.21.15.79:0/100128682 conn(0x7f0ff4093690 msgr2=0x7f0ff40d30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:38.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.763 7f0ff9471700 1 -- 172.21.15.79:0/100128682 shutdown_connections 2021-04-09T18:34:38.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:38.763 7f0ff9471700 1 -- 172.21.15.79:0/100128682 wait complete. 2021-04-09T18:34:38.982 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:34:31.841744', 'modified': '2021-04-09 18:34:33.860013', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 106, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7452}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7452': {'gid': 7452, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6833/1381942487', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 1381942487}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 1381942487}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:34:38.982 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:34:38.983 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2021-04-09T18:34:39.076 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:34:39.077 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:34:39.077 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2021-04-09T18:34:39.077 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 7452, 2021-04-09T18:34:39.077 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2021-04-09T18:34:39.077 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2021-04-09T18:34:39.078 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 6.2142434700000004, 2021-04-09T18:34:39.078 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 68, 2021-04-09T18:34:39.078 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 108, 2021-04-09T18:34:39.078 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 108, 2021-04-09T18:34:39.079 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 10.834527855999999 2021-04-09T18:34:39.079 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:34:39.083 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 7452, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.2142434700000004, "mdsmap_epoch": 68, "osdmap_epoch": 108, "osdmap_epoch_barrier": 108, "uptime": 10.834527855999999 } 2021-04-09T18:34:39.084 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:34:39.084 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-04-09T18:34:39.084 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi136.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-04-09T18:34:39.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:39.085 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:34:39.093 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:34:39.147 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:34:39.148 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:34:39.205 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:34:39.206 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:34:39.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:39.208 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:34:39.257 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:34:39.258 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:34:39.301 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:34:39.318 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:34:39.319 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:34:39.376 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:34:39.378 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:34:39.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:39.380 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:34:39.383 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:2021-04-09 18:34:39.372 7fa7df2c80c0 -1 init, newargv = 0x558a0bd08910 newargc=9 2021-04-09T18:34:39.384 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13614]: starting ceph client 2021-04-09T18:34:39.388 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13614]: starting fuse 2021-04-09T18:34:39.393 INFO:teuthology.orchestra.run.smithi136.stdout:49 2021-04-09T18:34:39.394 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:34:39.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:39.395 DEBUG:teuthology.orchestra.run.smithi136:> sudo python3 -c ' 2021-04-09T18:34:39.395 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2021-04-09T18:34:39.396 DEBUG:teuthology.orchestra.run.smithi136:> import re 2021-04-09T18:34:39.396 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-04-09T18:34:39.396 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2021-04-09T18:34:39.397 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:34:39.397 DEBUG:teuthology.orchestra.run.smithi136:> def find_socket(client_name): 2021-04-09T18:34:39.397 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-04-09T18:34:39.398 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2021-04-09T18:34:39.398 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:34:39.399 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2021-04-09T18:34:39.399 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2021-04-09T18:34:39.400 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2021-04-09T18:34:39.400 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2021-04-09T18:34:39.400 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:34:39.401 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2021-04-09T18:34:39.401 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:34:39.401 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:34:39.402 DEBUG:teuthology.orchestra.run.smithi136:> return f 2021-04-09T18:34:39.402 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:34:39.403 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:34:39.403 DEBUG:teuthology.orchestra.run.smithi136:> print(find_socket("client.1")) 2021-04-09T18:34:39.403 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-04-09T18:34:39.479 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.1.13614.asok 2021-04-09T18:34:39.484 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13614.asok 2021-04-09T18:34:39.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:39.485 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13614.asok status 2021-04-09T18:34:39.558 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2021-04-09T18:34:39.558 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2021-04-09T18:34:39.558 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:34:39.559 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:34:39.559 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "1", 2021-04-09T18:34:39.559 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2021-04-09T18:34:39.559 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-04-09T18:34:39.560 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "13614", 2021-04-09T18:34:39.560 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2021-04-09T18:34:39.560 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:34:39.560 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2021-04-09T18:34:39.560 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2021-04-09T18:34:39.561 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 7641, 2021-04-09T18:34:39.561 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2021-04-09T18:34:39.561 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2021-04-09T18:34:39.561 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2021-04-09T18:34:39.562 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 7641 2021-04-09T18:34:39.562 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:34:39.562 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-04-09T18:34:39.562 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-04-09T18:34:39.562 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-04-09T18:34:39.563 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 1980503729 2021-04-09T18:34:39.563 INFO:teuthology.orchestra.run.smithi136.stdout: } 2021-04-09T18:34:39.563 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:34:39.563 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-04-09T18:34:39.564 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-04-09T18:34:39.564 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-04-09T18:34:39.564 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 1980503729 2021-04-09T18:34:39.565 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:34:39.565 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.7641 172.21.15.136:0/1980503729", 2021-04-09T18:34:39.565 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "172.21.15.136:0/1980503729", 2021-04-09T18:34:39.565 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2021-04-09T18:34:39.566 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 68, 2021-04-09T18:34:39.566 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 108, 2021-04-09T18:34:39.566 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:34:39.566 INFO:teuthology.orchestra.run.smithi136.stdout: "blacklisted": false, 2021-04-09T18:34:39.567 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2021-04-09T18:34:39.567 INFO:teuthology.orchestra.run.smithi136.stdout:} 2021-04-09T18:34:39.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:39.569 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:34:39.569 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:34:39.577 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-04-09T18:34:39.578 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-04-09T18:34:39.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:39.579 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:34:39.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:39.637 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:34:39.637 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:34:39.646 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:34:39.647 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:34:39.647 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi090.front.sepia.ceph.com... 2021-04-09T18:34:39.648 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:34:39.649 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:34:39.735 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[14038]: fuse finished with error 0 and tester_r 0 2021-04-09T18:34:39.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:39.738 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:34:39.739 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:34:39.746 INFO:teuthology.orchestra.run.smithi090.stdout:ext2/ext3 2021-04-09T18:34:39.748 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:34:39.748 INFO:teuthology.orchestra.run:waiting for 900 2021-04-09T18:34:44.417 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:34:44.419 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:34:44.422 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:34:44.425 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:34:44.427 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:34:45.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:34:45.851 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:34:45.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:45.860 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:34:45.861 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:34:45.869 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-04-09T18:34:45.871 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-04-09T18:34:45.871 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2021-04-09T18:34:45.873 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:34:45.874 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:34:45.951 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13614]: fuse finished with error 0 and tester_r 0 2021-04-09T18:34:45.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:34:45.953 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:34:45.954 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:34:46.020 INFO:teuthology.orchestra.run.smithi136.stdout:ext2/ext3 2021-04-09T18:34:46.021 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:34:46.021 INFO:teuthology.orchestra.run:waiting for 900 2021-04-09T18:34:46.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:34:46.023 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:34:46.069 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-04-09T18:34:46.069 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:34:46.070 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-04-09T18:34:46.070 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:34:46.083 INFO:tasks.ceph.mds.a:Stopped 2021-04-09T18:34:46.083 DEBUG:teuthology.parallel:result is None 2021-04-09T18:34:46.085 INFO:tasks.ceph.mds.b:Stopped 2021-04-09T18:34:46.085 DEBUG:teuthology.parallel:result is None 2021-04-09T18:34:46.086 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2021-04-09T18:34:46.087 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2021-04-09T18:34:46.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.215 7fbfdb67b700 1 Processor -- start 2021-04-09T18:34:46.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.215 7fbfdb67b700 1 -- start start 2021-04-09T18:34:46.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.215 7fbfdb67b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbfd40f5520 0x7fbfd40f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:46.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.215 7fbfdb67b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd41c8010 0x7fbfd41ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:46.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.215 7fbfdb67b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd40fbb20 con 0x7fbfd40e9ae0 2021-04-09T18:34:46.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.215 7fbfdb67b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd40e9f30 con 0x7fbfd40f5520 2021-04-09T18:34:46.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.215 7fbfdb67b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd41c3dc0 con 0x7fbfd41c8010 2021-04-09T18:34:46.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.215 7fbfd941f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbfd40f5520 0x7fbfd40f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:46.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.215 7fbfd8c1e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbfd40e9ae0 0x7fbfd409f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57260/0 (socket says 172.21.15.79:57260) 2021-04-09T18:34:46.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.215 7fbfd8c1e700 1 -- 172.21.15.79:0/105011635 learned_addr learned my addr 172.21.15.79:0/105011635 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:46.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fbfd9c20700 1 --2- 172.21.15.79:0/105011635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd41c8010 0x7fbfd41ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:46.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fbfd941f700 1 -- 172.21.15.79:0/105011635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd41c8010 msgr2=0x7fbfd41ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:46.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fbfd941f700 1 --2- 172.21.15.79:0/105011635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd41c8010 0x7fbfd41ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:46.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fbfd941f700 1 -- 172.21.15.79:0/105011635 >> v1:172.21.15.79:6789/0 conn(0x7fbfd40e9ae0 legacy=0x7fbfd409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:46.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fbfd3fff700 1 -- 172.21.15.79:0/105011635 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221854259 0 0) 0x7fbfc8001450 con 0x7fbfd40e9ae0 2021-04-09T18:34:46.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fbfd941f700 1 -- 172.21.15.79:0/105011635 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd409f910 con 0x7fbfd40f5520 2021-04-09T18:34:46.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fbfd9c20700 1 --2- 172.21.15.79:0/105011635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd41c8010 0x7fbfd41ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:46.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fbfd941f700 1 --2- 172.21.15.79:0/105011635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfd40f5520 0x7fbfd40f64b0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7fbfd40f6f00 tx=0x7fbfc400bd70).ready entity=mon.0 client_cookie=94687d8dde7658d2 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:46.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fbfd3fff700 1 -- 172.21.15.79:0/105011635 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbfd409f910 con 0x7fbfd40f5520 2021-04-09T18:34:46.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fbfd3fff700 1 -- 172.21.15.79:0/105011635 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc4009810 con 0x7fbfd40f5520 2021-04-09T18:34:46.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fbfd3fff700 1 -- 172.21.15.79:0/105011635 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbfc4009be0 con 0x7fbfd40f5520 2021-04-09T18:34:46.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fbfdb67b700 1 -- 172.21.15.79:0/105011635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfd40f5520 msgr2=0x7fbfd40f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:46.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fbfdb67b700 1 --2- 172.21.15.79:0/105011635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfd40f5520 0x7fbfd40f64b0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7fbfd40f6f00 tx=0x7fbfc400bd70).stop 2021-04-09T18:34:46.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fbfdb67b700 1 -- 172.21.15.79:0/105011635 shutdown_connections 2021-04-09T18:34:46.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fbfdb67b700 1 --2- 172.21.15.79:0/105011635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfd40f5520 0x7fbfd40f64b0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:46.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fbfdb67b700 1 --2- 172.21.15.79:0/105011635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd41c8010 0x7fbfd41ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:46.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fbfdb67b700 1 -- 172.21.15.79:0/105011635 >> 172.21.15.79:0/105011635 conn(0x7fbfd40e5fe0 msgr2=0x7fbfd40e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:46.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fbfdb67b700 1 -- 172.21.15.79:0/105011635 shutdown_connections 2021-04-09T18:34:46.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fbfdb67b700 1 -- 172.21.15.79:0/105011635 wait complete. 2021-04-09T18:34:46.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfdb67b700 1 Processor -- start 2021-04-09T18:34:46.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfdb67b700 1 -- start start 2021-04-09T18:34:46.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfdb67b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd40d5070 0x7fbfd40d54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:46.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfdb67b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfd40956e0 0x7fbfd4095b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:46.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfdb67b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfd4096160 0x7fbfd40c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:46.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfdb67b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4097030 con 0x7fbfd40956e0 2021-04-09T18:34:46.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfdb67b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40c19c0 con 0x7fbfd4096160 2021-04-09T18:34:46.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfdb67b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40c3b10 con 0x7fbfd40d5070 2021-04-09T18:34:46.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfd8c1e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfd40956e0 0x7fbfd4095b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:46.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfd8c1e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfd40956e0 0x7fbfd4095b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34334/0 (socket says 172.21.15.79:34334) 2021-04-09T18:34:46.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfd8c1e700 1 -- 172.21.15.79:0/1546033007 learned_addr learned my addr 172.21.15.79:0/1546033007 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:46.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfd941f700 1 --2- 172.21.15.79:0/1546033007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd40d5070 0x7fbfd40d54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:46.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfd9c20700 1 --2- 172.21.15.79:0/1546033007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfd4096160 0x7fbfd40c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:46.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfd8c1e700 1 -- 172.21.15.79:0/1546033007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd40d5070 msgr2=0x7fbfd40d54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:46.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfd8c1e700 1 --2- 172.21.15.79:0/1546033007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd40d5070 0x7fbfd40d54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:46.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfd8c1e700 1 -- 172.21.15.79:0/1546033007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfd4096160 msgr2=0x7fbfd40c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:46.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfd8c1e700 1 --2- 172.21.15.79:0/1546033007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfd4096160 0x7fbfd40c34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:46.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfd8c1e700 1 -- 172.21.15.79:0/1546033007 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd40c3d40 con 0x7fbfd40956e0 2021-04-09T18:34:46.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfd8c1e700 1 --2- 172.21.15.79:0/1546033007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfd40956e0 0x7fbfd4095b30 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7fbfd40c1bc0 tx=0x7fbfc800cee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:46.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfd1ffb700 1 -- 172.21.15.79:0/1546033007 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbfd40c3d40 con 0x7fbfd40956e0 2021-04-09T18:34:46.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfd1ffb700 1 -- 172.21.15.79:0/1546033007 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc8005b80 con 0x7fbfd40956e0 2021-04-09T18:34:46.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfdb67b700 1 -- 172.21.15.79:0/1546033007 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd40c3fa0 con 0x7fbfd40956e0 2021-04-09T18:34:46.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfd1ffb700 1 -- 172.21.15.79:0/1546033007 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbfc8007110 con 0x7fbfd40956e0 2021-04-09T18:34:46.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfdb67b700 1 -- 172.21.15.79:0/1546033007 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd40c44d0 con 0x7fbfd40956e0 2021-04-09T18:34:46.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb69b18c700 1 Processor -- start 2021-04-09T18:34:46.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb69b18c700 1 -- start start 2021-04-09T18:34:46.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb69b18c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6940e9ae0 0x7fb69409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:46.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb69b18c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6940fbb20 con 0x7fb6941c8010 2021-04-09T18:34:46.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb69b18c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6940e56d0 con 0x7fb6940f5520 2021-04-09T18:34:46.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb69b18c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6941c3dc0 con 0x7fb6940e9ae0 2021-04-09T18:34:46.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb699731700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb6941c8010 0x7fb6941ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57266/0 (socket says 172.21.15.79:57266) 2021-04-09T18:34:46.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb699731700 1 -- 172.21.15.79:0/2154643706 learned_addr learned my addr 172.21.15.79:0/2154643706 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:46.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb693fff700 1 --2- 172.21.15.79:0/2154643706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6940e9ae0 0x7fb69409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:46.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb6937fe700 1 -- 172.21.15.79:0/2154643706 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798011974 0 0) 0x7fb68c001450 con 0x7fb6941c8010 2021-04-09T18:34:46.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb6937fe700 1 -- 172.21.15.79:0/2154643706 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb67c003240 con 0x7fb6941c8010 2021-04-09T18:34:46.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb6937fe700 1 -- 172.21.15.79:0/2154643706 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3547858402 0 0) 0x7fb68c0019d0 con 0x7fb6941c8010 2021-04-09T18:34:46.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb6937fe700 1 -- 172.21.15.79:0/2154643706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6940e9ae0 msgr2=0x7fb69409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:46.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb6937fe700 1 --2- 172.21.15.79:0/2154643706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6940e9ae0 0x7fb69409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:46.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb6937fe700 1 -- 172.21.15.79:0/2154643706 >> v1:172.21.15.89:6789/0 conn(0x7fb6940f5520 legacy=0x7fb6940f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:46.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb6937fe700 1 -- 172.21.15.79:0/2154643706 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6940e4330 con 0x7fb6941c8010 2021-04-09T18:34:46.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb6937fe700 1 -- 172.21.15.79:0/2154643706 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7fb68c001f30 con 0x7fb6941c8010 2021-04-09T18:34:46.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb6937fe700 1 -- 172.21.15.79:0/2154643706 >> v1:172.21.15.79:6789/0 conn(0x7fb6941c8010 legacy=0x7fb6941ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:46.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb6937fe700 1 --2- 172.21.15.79:0/2154643706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb67c0038f0 0x7fb67c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:46.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb6937fe700 1 --2- 172.21.15.79:0/2154643706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb67c0045a0 0x7fb67c0049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:46.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb6937fe700 1 --2- 172.21.15.79:0/2154643706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb67c0097e0 0x7fb67c00bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:46.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb6937fe700 1 -- 172.21.15.79:0/2154643706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6941c3dc0 con 0x7fb67c0038f0 2021-04-09T18:34:46.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb6937fe700 1 -- 172.21.15.79:0/2154643706 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c0051f0 con 0x7fb67c0045a0 2021-04-09T18:34:46.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb698f30700 1 --2- 172.21.15.79:0/2154643706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb67c0038f0 0x7fb67c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:46.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb6937fe700 1 -- 172.21.15.79:0/2154643706 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c0053f0 con 0x7fb67c0097e0 2021-04-09T18:34:46.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb699731700 1 --2- 172.21.15.79:0/2154643706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb67c0097e0 0x7fb67c00bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:46.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb693fff700 1 --2- 172.21.15.79:0/2154643706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb67c0045a0 0x7fb67c0049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:46.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb698f30700 1 -- 172.21.15.79:0/2154643706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb67c0097e0 msgr2=0x7fb67c00bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:46.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb698f30700 1 --2- 172.21.15.79:0/2154643706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb67c0097e0 0x7fb67c00bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:46.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb698f30700 1 -- 172.21.15.79:0/2154643706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb67c0045a0 msgr2=0x7fb67c0049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:46.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb698f30700 1 --2- 172.21.15.79:0/2154643706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb67c0045a0 0x7fb67c0049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:46.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb698f30700 1 -- 172.21.15.79:0/2154643706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c050390 con 0x7fb67c0038f0 2021-04-09T18:34:46.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb699731700 1 --2- 172.21.15.79:0/2154643706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb67c0097e0 0x7fb67c00bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:46.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfd1ffb700 1 -- 172.21.15.79:0/1546033007 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fbfc801a020 con 0x7fbfd40956e0 2021-04-09T18:34:46.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb698f30700 1 --2- 172.21.15.79:0/2154643706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb67c0038f0 0x7fb67c003d80 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7fb684000fe0 tx=0x7fb68400c3c0).ready entity=mon.0 client_cookie=ae8547822620f1c8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:46.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb6937fe700 1 -- 172.21.15.79:0/2154643706 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb67c050390 con 0x7fb67c0038f0 2021-04-09T18:34:46.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb6937fe700 1 -- 172.21.15.79:0/2154643706 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb684007e10 con 0x7fb67c0038f0 2021-04-09T18:34:46.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb6937fe700 1 -- 172.21.15.79:0/2154643706 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb68400cc00 con 0x7fb67c0038f0 2021-04-09T18:34:46.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb69b18c700 1 -- 172.21.15.79:0/2154643706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb67c0038f0 msgr2=0x7fb67c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:46.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb69b18c700 1 --2- 172.21.15.79:0/2154643706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb67c0038f0 0x7fb67c003d80 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7fb684000fe0 tx=0x7fb68400c3c0).stop 2021-04-09T18:34:46.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.219 7fb699731700 1 -- 172.21.15.79:0/2154643706 reap_dead start 2021-04-09T18:34:46.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fb69b18c700 1 -- 172.21.15.79:0/2154643706 shutdown_connections 2021-04-09T18:34:46.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fb69b18c700 1 -- 172.21.15.79:0/2154643706 >> 172.21.15.79:0/2154643706 conn(0x7fb6940e5fe0 msgr2=0x7fb6940e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:46.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fb69b18c700 1 -- 172.21.15.79:0/2154643706 shutdown_connections 2021-04-09T18:34:46.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fb69b18c700 1 -- 172.21.15.79:0/2154643706 wait complete. 2021-04-09T18:34:46.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfd1ffb700 1 --2- 172.21.15.79:0/1546033007 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbfb4029100 0x7fbfb402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:46.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfd1ffb700 1 -- 172.21.15.79:0/1546033007 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fbfc8039580 con 0x7fbfd40956e0 2021-04-09T18:34:46.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.223 7fbfd941f700 1 --2- 172.21.15.79:0/1546033007 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbfb4029100 0x7fbfb402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:46.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb69b18c700 1 Processor -- start 2021-04-09T18:34:46.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb69b18c700 1 -- start start 2021-04-09T18:34:46.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fbfd941f700 1 --2- 172.21.15.79:0/1546033007 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbfb4029100 0x7fbfb402b650 crc :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:46.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb69b18c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb69419de10 0x7fb6940bb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:46.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb69b18c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6940d5cd0 0x7fb6940d4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:46.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb69b18c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6940d6120 0x7fb6940d5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:46.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb69b18c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c0014d0 con 0x7fb6940d5cd0 2021-04-09T18:34:46.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb69b18c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940e9f30 con 0x7fb69419de10 2021-04-09T18:34:46.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb69b18c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940c13e0 con 0x7fb6940d6120 2021-04-09T18:34:46.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb693fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6940d5cd0 0x7fb6940d4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:46.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb693fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6940d5cd0 0x7fb6940d4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34342/0 (socket says 172.21.15.79:34342) 2021-04-09T18:34:46.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb693fff700 1 -- 172.21.15.79:0/903692229 learned_addr learned my addr 172.21.15.79:0/903692229 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:46.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb699731700 1 --2- 172.21.15.79:0/903692229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6940d6120 0x7fb6940d5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:46.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb698f30700 1 --2- 172.21.15.79:0/903692229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb69419de10 0x7fb6940bb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:46.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb693fff700 1 -- 172.21.15.79:0/903692229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6940d6120 msgr2=0x7fb6940d5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:46.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb693fff700 1 --2- 172.21.15.79:0/903692229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6940d6120 0x7fb6940d5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:46.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb693fff700 1 -- 172.21.15.79:0/903692229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb69419de10 msgr2=0x7fb6940bb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:46.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb693fff700 1 --2- 172.21.15.79:0/903692229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb69419de10 0x7fb6940bb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:46.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb693fff700 1 -- 172.21.15.79:0/903692229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69419e260 con 0x7fb6940d5cd0 2021-04-09T18:34:46.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb693fff700 1 --2- 172.21.15.79:0/903692229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6940d5cd0 0x7fb6940d4c00 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7fb6940b07e0 tx=0x7fb68800e4b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:46.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb6917fa700 1 -- 172.21.15.79:0/903692229 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb68800f040 con 0x7fb6940d5cd0 2021-04-09T18:34:46.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb6917fa700 1 -- 172.21.15.79:0/903692229 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68800ea40 con 0x7fb6940d5cd0 2021-04-09T18:34:46.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb69b18c700 1 -- 172.21.15.79:0/903692229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6940c4010 con 0x7fb6940d5cd0 2021-04-09T18:34:46.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb6917fa700 1 -- 172.21.15.79:0/903692229 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb68800ee10 con 0x7fb6940d5cd0 2021-04-09T18:34:46.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb69b18c700 1 -- 172.21.15.79:0/903692229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6940d6630 con 0x7fb6940d5cd0 2021-04-09T18:34:46.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb6917fa700 1 -- 172.21.15.79:0/903692229 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb688014470 con 0x7fb6940d5cd0 2021-04-09T18:34:46.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.227 7fb6917fa700 1 --2- 172.21.15.79:0/903692229 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb674029100 0x7fb67402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:46.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.231 7fb6917fa700 1 -- 172.21.15.79:0/903692229 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fb688039c30 con 0x7fb6940d5cd0 2021-04-09T18:34:46.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.231 7fb698f30700 1 --2- 172.21.15.79:0/903692229 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb674029100 0x7fb67402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:46.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.231 7fb698f30700 1 --2- 172.21.15.79:0/903692229 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb674029100 0x7fb67402b650 crc :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:46.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.231 7fbfdb67b700 1 -- 172.21.15.79:0/1546033007 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd40e39e0 con 0x7fbfd40956e0 2021-04-09T18:34:46.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.231 7fb69b18c700 1 -- 172.21.15.79:0/903692229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6940e39e0 con 0x7fb6940d5cd0 2021-04-09T18:34:46.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.235 7fbfd1ffb700 1 -- 172.21.15.79:0/1546033007 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fbfc8005970 con 0x7fbfd40956e0 2021-04-09T18:34:46.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.243 7fb6917fa700 1 -- 172.21.15.79:0/903692229 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb688000bf0 con 0x7fb6940d5cd0 2021-04-09T18:34:46.410 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.403 7fbfdb67b700 1 -- 172.21.15.79:0/1546033007 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fbfd40f5b20 con 0x7fbfd40956e0 2021-04-09T18:34:46.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:46.415 7fb69b18c700 1 -- 172.21.15.79:0/903692229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7fb6940f5b20 con 0x7fb6940d5cd0 2021-04-09T18:34:47.160 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:34:47.155 7fbcd0516700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:34:47.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.163 7fbfd1ffb700 1 -- 172.21.15.79:0/1546033007 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 7456 v69) v1 ==== 95+0+0 (secure 0 0 0) 0x7fbfc8000f70 con 0x7fbfd40956e0 2021-04-09T18:34:47.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.163 7fb6917fa700 1 -- 172.21.15.79:0/903692229 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7452 v69) v1 ==== 95+0+0 (secure 0 0 0) 0x7fb688010da0 con 0x7fb6940d5cd0 2021-04-09T18:34:47.175 INFO:teuthology.orchestra.run.smithi079.stderr:failed mds gid 7456 2021-04-09T18:34:47.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.175 7fbfdb67b700 1 -- 172.21.15.79:0/1546033007 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbfb4029100 msgr2=0x7fbfb402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:47.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.175 7fbfdb67b700 1 --2- 172.21.15.79:0/1546033007 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbfb4029100 0x7fbfb402b650 crc :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:47.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.175 7fbfdb67b700 1 -- 172.21.15.79:0/1546033007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfd40956e0 msgr2=0x7fbfd4095b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:47.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.175 7fbfdb67b700 1 --2- 172.21.15.79:0/1546033007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfd40956e0 0x7fbfd4095b30 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7fbfd40c1bc0 tx=0x7fbfc800cee0).stop 2021-04-09T18:34:47.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.175 7fbfdb67b700 1 -- 172.21.15.79:0/1546033007 shutdown_connections 2021-04-09T18:34:47.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.175 7fbfdb67b700 1 --2- 172.21.15.79:0/1546033007 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbfb4029100 0x7fbfb402b650 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:47.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.175 7fbfdb67b700 1 --2- 172.21.15.79:0/1546033007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfd4096160 0x7fbfd40c34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:47.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.175 7fbfdb67b700 1 --2- 172.21.15.79:0/1546033007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd40d5070 0x7fbfd40d54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:47.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.175 7fbfdb67b700 1 --2- 172.21.15.79:0/1546033007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfd40956e0 0x7fbfd4095b30 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:47.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.175 7fbfdb67b700 1 -- 172.21.15.79:0/1546033007 >> 172.21.15.79:0/1546033007 conn(0x7fbfd40bb070 msgr2=0x7fbfd40d8390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:47.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.175 7fbfdb67b700 1 -- 172.21.15.79:0/1546033007 shutdown_connections 2021-04-09T18:34:47.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.175 7fbfdb67b700 1 -- 172.21.15.79:0/1546033007 wait complete. 2021-04-09T18:34:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:failed mds gid 7452 2021-04-09T18:34:47.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.183 7fb69b18c700 1 -- 172.21.15.79:0/903692229 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb674029100 msgr2=0x7fb67402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:47.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.183 7fb69b18c700 1 --2- 172.21.15.79:0/903692229 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb674029100 0x7fb67402b650 crc :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.183 7fb69b18c700 1 -- 172.21.15.79:0/903692229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6940d5cd0 msgr2=0x7fb6940d4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.183 7fb69b18c700 1 --2- 172.21.15.79:0/903692229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6940d5cd0 0x7fb6940d4c00 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7fb6940b07e0 tx=0x7fb68800e4b0).stop 2021-04-09T18:34:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.183 7fb69b18c700 1 -- 172.21.15.79:0/903692229 shutdown_connections 2021-04-09T18:34:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.183 7fb69b18c700 1 --2- 172.21.15.79:0/903692229 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb674029100 0x7fb67402b650 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:47.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.183 7fb69b18c700 1 --2- 172.21.15.79:0/903692229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb69419de10 0x7fb6940bb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:47.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.183 7fb69b18c700 1 --2- 172.21.15.79:0/903692229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6940d6120 0x7fb6940d5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:47.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.183 7fb69b18c700 1 --2- 172.21.15.79:0/903692229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6940d5cd0 0x7fb6940d4c00 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:47.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.183 7fb69b18c700 1 -- 172.21.15.79:0/903692229 >> 172.21.15.79:0/903692229 conn(0x7fb69409ad60 msgr2=0x7fb6940c0460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:47.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.183 7fb69b18c700 1 -- 172.21.15.79:0/903692229 shutdown_connections 2021-04-09T18:34:47.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.183 7fb69b18c700 1 -- 172.21.15.79:0/903692229 wait complete. 2021-04-09T18:34:47.194 DEBUG:teuthology.parallel:result is '' 2021-04-09T18:34:47.208 DEBUG:teuthology.parallel:result is '' 2021-04-09T18:34:47.208 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-04-09T18:34:47.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.347 7fa4c4e22700 1 Processor -- start 2021-04-09T18:34:47.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.347 7fa4c4e22700 1 -- start start 2021-04-09T18:34:47.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4c4e22700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa4c00f5520 0x7fa4c00f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:47.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4c4e22700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa4c00e9ae0 0x7fa4c009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:47.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4c4e22700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4c01c2db0 0x7fa4c01c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:47.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4c4e22700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c00e9f30 con 0x7fa4c00f5520 2021-04-09T18:34:47.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4c4e22700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c00e59d0 con 0x7fa4c00e9ae0 2021-04-09T18:34:47.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4c4e22700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c00fbb20 con 0x7fa4c01c2db0 2021-04-09T18:34:47.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4beaef700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa4c00f5520 0x7fa4c00f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:47.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4beaef700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa4c00f5520 0x7fa4c00f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34348/0 (socket says 172.21.15.79:34348) 2021-04-09T18:34:47.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4beaef700 1 -- 172.21.15.79:0/2412418556 learned_addr learned my addr 172.21.15.79:0/2412418556 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:47.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4bf2f0700 1 --2- 172.21.15.79:0/2412418556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4c01c2db0 0x7fa4c01c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:47.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4be2ee700 1 --2- 172.21.15.79:0/2412418556 >> v2:172.21.15.89:3300/0 conn(0x7fa4c00e9ae0 0x7fa4c009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:47.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4beaef700 1 -- 172.21.15.79:0/2412418556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4c01c2db0 msgr2=0x7fa4c01c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:47.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4beaef700 1 --2- 172.21.15.79:0/2412418556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4c01c2db0 0x7fa4c01c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:47.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4beaef700 1 -- 172.21.15.79:0/2412418556 >> v2:172.21.15.89:3300/0 conn(0x7fa4c00e9ae0 msgr2=0x7fa4c009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:47.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4beaef700 1 --2- 172.21.15.79:0/2412418556 >> v2:172.21.15.89:3300/0 conn(0x7fa4c00e9ae0 0x7fa4c009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:47.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4beaef700 1 -- 172.21.15.79:0/2412418556 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c00e56d0 con 0x7fa4c00f5520 2021-04-09T18:34:47.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4beaef700 1 --2- 172.21.15.79:0/2412418556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00f5520 0x7fa4c00f64b0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7fa4c0125440 tx=0x7fa4b000bda0).ready entity=mon.0 client_cookie=3a3c65bdbd86e55 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:47.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4bdaed700 1 -- 172.21.15.79:0/2412418556 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa4c00e56d0 con 0x7fa4c00f5520 2021-04-09T18:34:47.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4bdaed700 1 -- 172.21.15.79:0/2412418556 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b0009940 con 0x7fa4c00f5520 2021-04-09T18:34:47.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4bdaed700 1 -- 172.21.15.79:0/2412418556 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa4b0009d10 con 0x7fa4c00f5520 2021-04-09T18:34:47.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4c4e22700 1 -- 172.21.15.79:0/2412418556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00f5520 msgr2=0x7fa4c00f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:47.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.351 7fa4c4e22700 1 --2- 172.21.15.79:0/2412418556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00f5520 0x7fa4c00f64b0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7fa4c0125440 tx=0x7fa4b000bda0).stop 2021-04-09T18:34:47.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.355 7fa4c4e22700 1 -- 172.21.15.79:0/2412418556 shutdown_connections 2021-04-09T18:34:47.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.355 7fa4c4e22700 1 --2- 172.21.15.79:0/2412418556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4c01c2db0 0x7fa4c01c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:47.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.355 7fa4c4e22700 1 --2- 172.21.15.79:0/2412418556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00f5520 0x7fa4c00f64b0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:47.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.355 7fa4c4e22700 1 --2- 172.21.15.79:0/2412418556 >> v2:172.21.15.89:3300/0 conn(0x7fa4c00e9ae0 0x7fa4c009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:47.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.355 7fa4c4e22700 1 -- 172.21.15.79:0/2412418556 >> 172.21.15.79:0/2412418556 conn(0x7fa4c00e5fe0 msgr2=0x7fa4c00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:47.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.355 7fa4c4e22700 1 -- 172.21.15.79:0/2412418556 shutdown_connections 2021-04-09T18:34:47.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.355 7fa4c4e22700 1 -- 172.21.15.79:0/2412418556 wait complete. 2021-04-09T18:34:47.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.359 7fa4c4e22700 1 Processor -- start 2021-04-09T18:34:47.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.359 7fa4c4e22700 1 -- start start 2021-04-09T18:34:47.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.359 7fa4c4e22700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00a66c0 0x7fa4c00baed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:47.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.359 7fa4c4e22700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4c00c0e70 0x7fa4c00ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:47.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.359 7fa4c4e22700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4c00c16a0 0x7fa4c00c1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:47.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.359 7fa4c4e22700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c00e1ad0 con 0x7fa4c00a66c0 2021-04-09T18:34:47.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.359 7fa4c4e22700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c0097d80 con 0x7fa4c00c0e70 2021-04-09T18:34:47.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.359 7fa4c4e22700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c0098080 con 0x7fa4c00c16a0 2021-04-09T18:34:47.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.359 7fa4beaef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00a66c0 0x7fa4c00baed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:47.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.359 7fa4beaef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00a66c0 0x7fa4c00baed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34354/0 (socket says 172.21.15.79:34354) 2021-04-09T18:34:47.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.359 7fa4beaef700 1 -- 172.21.15.79:0/3654018251 learned_addr learned my addr 172.21.15.79:0/3654018251 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:47.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.359 7fa4be2ee700 1 --2- 172.21.15.79:0/3654018251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4c00c0e70 0x7fa4c00ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:47.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.359 7fa4bf2f0700 1 --2- 172.21.15.79:0/3654018251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4c00c16a0 0x7fa4c00c1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:47.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.359 7fa4beaef700 1 -- 172.21.15.79:0/3654018251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4c00c16a0 msgr2=0x7fa4c00c1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:47.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.359 7fa4beaef700 1 --2- 172.21.15.79:0/3654018251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4c00c16a0 0x7fa4c00c1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:47.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.359 7fa4beaef700 1 -- 172.21.15.79:0/3654018251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4c00c0e70 msgr2=0x7fa4c00ae1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:47.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.359 7fa4beaef700 1 --2- 172.21.15.79:0/3654018251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4c00c0e70 0x7fa4c00ae1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:47.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.359 7fa4beaef700 1 -- 172.21.15.79:0/3654018251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c00c12c0 con 0x7fa4c00a66c0 2021-04-09T18:34:47.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.359 7fa4beaef700 1 --2- 172.21.15.79:0/3654018251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00a66c0 0x7fa4c00baed0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7fa4c0097d00 tx=0x7fa4b0006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:47.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.359 7fa4af7fe700 1 -- 172.21.15.79:0/3654018251 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa4c00c12c0 con 0x7fa4c00a66c0 2021-04-09T18:34:47.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.363 7fa4af7fe700 1 -- 172.21.15.79:0/3654018251 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b0011d30 con 0x7fa4c00a66c0 2021-04-09T18:34:47.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.363 7fa4af7fe700 1 -- 172.21.15.79:0/3654018251 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa4b001d640 con 0x7fa4c00a66c0 2021-04-09T18:34:47.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.363 7fa4c4e22700 1 -- 172.21.15.79:0/3654018251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c0097610 con 0x7fa4c00a66c0 2021-04-09T18:34:47.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.363 7fa4c4e22700 1 -- 172.21.15.79:0/3654018251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c00ae7f0 con 0x7fa4c00a66c0 2021-04-09T18:34:47.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.363 7fa4af7fe700 1 -- 172.21.15.79:0/3654018251 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa4b0026450 con 0x7fa4c00a66c0 2021-04-09T18:34:47.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.363 7fa4af7fe700 1 --2- 172.21.15.79:0/3654018251 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa4a4029100 0x7fa4a402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:47.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.363 7fa4af7fe700 1 -- 172.21.15.79:0/3654018251 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6096+0+0 (secure 0 0 0) 0x7fa4b003af80 con 0x7fa4c00a66c0 2021-04-09T18:34:47.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.363 7fa4be2ee700 1 --2- 172.21.15.79:0/3654018251 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa4a4029100 0x7fa4a402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:47.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.363 7fa4be2ee700 1 --2- 172.21.15.79:0/3654018251 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa4a4029100 0x7fa4a402b650 crc :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:47.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.379 7fa4c4e22700 1 -- 172.21.15.79:0/3654018251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c00e39e0 con 0x7fa4c00a66c0 2021-04-09T18:34:47.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.383 7fa4af7fe700 1 -- 172.21.15.79:0/3654018251 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa4b0009730 con 0x7fa4c00a66c0 2021-04-09T18:34:47.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:47.551 7fa4c4e22700 1 -- 172.21.15.79:0/3654018251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa4c00f5b20 con 0x7fa4c00a66c0 2021-04-09T18:34:48.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.171 7fa4af7fe700 1 -- 172.21.15.79:0/3654018251 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v70) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa4b0011b20 con 0x7fa4c00a66c0 2021-04-09T18:34:48.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.219 7fa4c4e22700 1 -- 172.21.15.79:0/3654018251 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa4a4029100 msgr2=0x7fa4a402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:48.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.219 7fa4c4e22700 1 --2- 172.21.15.79:0/3654018251 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa4a4029100 0x7fa4a402b650 crc :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:48.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.219 7fa4c4e22700 1 -- 172.21.15.79:0/3654018251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00a66c0 msgr2=0x7fa4c00baed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:48.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.219 7fa4c4e22700 1 --2- 172.21.15.79:0/3654018251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00a66c0 0x7fa4c00baed0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7fa4c0097d00 tx=0x7fa4b0006890).stop 2021-04-09T18:34:48.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.219 7fa4c4e22700 1 -- 172.21.15.79:0/3654018251 shutdown_connections 2021-04-09T18:34:48.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.219 7fa4c4e22700 1 --2- 172.21.15.79:0/3654018251 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa4a4029100 0x7fa4a402b650 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:48.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.219 7fa4c4e22700 1 --2- 172.21.15.79:0/3654018251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4c00c16a0 0x7fa4c00c1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:48.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.219 7fa4c4e22700 1 --2- 172.21.15.79:0/3654018251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c00a66c0 0x7fa4c00baed0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:48.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.219 7fa4c4e22700 1 --2- 172.21.15.79:0/3654018251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4c00c0e70 0x7fa4c00ae1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:48.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.219 7fa4c4e22700 1 -- 172.21.15.79:0/3654018251 >> 172.21.15.79:0/3654018251 conn(0x7fa4c00afef0 msgr2=0x7fa4c00a6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:48.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.223 7fa4c4e22700 1 -- 172.21.15.79:0/3654018251 shutdown_connections 2021-04-09T18:34:48.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.223 7fa4c4e22700 1 -- 172.21.15.79:0/3654018251 wait complete. 2021-04-09T18:34:48.245 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-04-09T18:34:48.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.339 7f6b04dff700 1 Processor -- start 2021-04-09T18:34:48.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.339 7f6b04dff700 1 -- start start 2021-04-09T18:34:48.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.339 7f6b04dff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6b000f5550 0x7f6b000f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:48.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.339 7f6b04dff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6b000e9b10 0x7f6b0009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:48.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.339 7f6b04dff700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b000fbb50 con 0x7f6b001c2de0 2021-04-09T18:34:48.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.339 7f6b04dff700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b000e9f60 con 0x7f6b000e9b10 2021-04-09T18:34:48.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.339 7f6b04dff700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b000e5a00 con 0x7f6b000f5550 2021-04-09T18:34:48.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.339 7f6afe2ee700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6b000e9b10 0x7f6b0009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:48.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.339 7f6aff2f0700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6b001c2de0 0x7f6b001c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57308/0 (socket says 172.21.15.79:57308) 2021-04-09T18:34:48.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.339 7f6aff2f0700 1 -- 172.21.15.79:0/3019041281 learned_addr learned my addr 172.21.15.79:0/3019041281 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:48.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.339 7f6afeaef700 1 --2- 172.21.15.79:0/3019041281 >> v2:172.21.15.89:3300/0 conn(0x7f6b000f5550 0x7f6b000f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:48.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.339 7f6afe2ee700 1 -- 172.21.15.79:0/3019041281 >> v2:172.21.15.89:3300/0 conn(0x7f6b000f5550 msgr2=0x7f6b000f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:48.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.339 7f6afe2ee700 1 --2- 172.21.15.79:0/3019041281 >> v2:172.21.15.89:3300/0 conn(0x7f6b000f5550 0x7f6b000f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:48.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.339 7f6afe2ee700 1 -- 172.21.15.79:0/3019041281 >> v1:172.21.15.79:6789/0 conn(0x7f6b001c2de0 legacy=0x7f6b001c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:48.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.339 7f6afe2ee700 1 -- 172.21.15.79:0/3019041281 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b000e5700 con 0x7f6b000e9b10 2021-04-09T18:34:48.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.339 7f6afdaed700 1 -- 172.21.15.79:0/3019041281 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372316541 0 0) 0x7f6af8001450 con 0x7f6b001c2de0 2021-04-09T18:34:48.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.339 7f6afe2ee700 1 --2- 172.21.15.79:0/3019041281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b000e9b10 0x7f6b0009f110 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f6af4002f30 tx=0x7f6af400bd10).ready entity=mon.0 client_cookie=48f7b06856df8781 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:48.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.343 7f6afdaed700 1 -- 172.21.15.79:0/3019041281 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6b000e5700 con 0x7f6b000e9b10 2021-04-09T18:34:48.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.343 7f6afdaed700 1 -- 172.21.15.79:0/3019041281 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af40098a0 con 0x7f6b000e9b10 2021-04-09T18:34:48.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.343 7f6afdaed700 1 -- 172.21.15.79:0/3019041281 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6af4009c70 con 0x7f6b000e9b10 2021-04-09T18:34:48.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.343 7f6b04dff700 1 -- 172.21.15.79:0/3019041281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b000e9b10 msgr2=0x7f6b0009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:48.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.343 7f6b04dff700 1 --2- 172.21.15.79:0/3019041281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b000e9b10 0x7f6b0009f110 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f6af4002f30 tx=0x7f6af400bd10).stop 2021-04-09T18:34:48.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.343 7f6b04dff700 1 -- 172.21.15.79:0/3019041281 shutdown_connections 2021-04-09T18:34:48.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.343 7f6b04dff700 1 --2- 172.21.15.79:0/3019041281 >> v2:172.21.15.89:3300/0 conn(0x7f6b000f5550 0x7f6b000f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:48.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.343 7f6b04dff700 1 --2- 172.21.15.79:0/3019041281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b000e9b10 0x7f6b0009f110 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:48.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.343 7f6b04dff700 1 -- 172.21.15.79:0/3019041281 >> 172.21.15.79:0/3019041281 conn(0x7f6b000e6010 msgr2=0x7f6b000e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:48.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.343 7f6b04dff700 1 -- 172.21.15.79:0/3019041281 shutdown_connections 2021-04-09T18:34:48.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.343 7f6b04dff700 1 -- 172.21.15.79:0/3019041281 wait complete. 2021-04-09T18:34:48.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.347 7f6b04dff700 1 Processor -- start 2021-04-09T18:34:48.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.347 7f6b04dff700 1 -- start start 2021-04-09T18:34:48.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.347 7f6b04dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b0019bc90 0x7f6b000d6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:48.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.347 7f6b04dff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b000d4e90 0x7f6b000bad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:48.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.347 7f6b04dff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b0019de30 0x7f6b0019e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:48.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.347 7f6b04dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b000e8b20 con 0x7f6b0019bc90 2021-04-09T18:34:48.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.347 7f6b04dff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0019c590 con 0x7f6b0019de30 2021-04-09T18:34:48.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.347 7f6b04dff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0019c890 con 0x7f6b000d4e90 2021-04-09T18:34:48.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.347 7f6afeaef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b0019bc90 0x7f6b000d6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:48.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.347 7f6afeaef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b0019bc90 0x7f6b000d6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34370/0 (socket says 172.21.15.79:34370) 2021-04-09T18:34:48.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.347 7f6afeaef700 1 -- 172.21.15.79:0/1204466874 learned_addr learned my addr 172.21.15.79:0/1204466874 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:48.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.347 7f6afe2ee700 1 --2- 172.21.15.79:0/1204466874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b000d4e90 0x7f6b000bad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:48.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.347 7f6aff2f0700 1 --2- 172.21.15.79:0/1204466874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b0019de30 0x7f6b0019e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:48.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.347 7f6afeaef700 1 -- 172.21.15.79:0/1204466874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b000d4e90 msgr2=0x7f6b000bad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:48.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.347 7f6afeaef700 1 --2- 172.21.15.79:0/1204466874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b000d4e90 0x7f6b000bad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.347 7f6afeaef700 1 -- 172.21.15.79:0/1204466874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b0019de30 msgr2=0x7f6b0019e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.347 7f6afeaef700 1 --2- 172.21.15.79:0/1204466874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b0019de30 0x7f6b0019e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.347 7f6afeaef700 1 -- 172.21.15.79:0/1204466874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0019c0e0 con 0x7f6b0019bc90 2021-04-09T18:34:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.347 7f6afeaef700 1 --2- 172.21.15.79:0/1204466874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b0019bc90 0x7f6b000d6150 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f6b00087490 tx=0x7f6af000df60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:48.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.351 7f6aef7fe700 1 -- 172.21.15.79:0/1204466874 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6b0019c0e0 con 0x7f6b0019bc90 2021-04-09T18:34:48.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.351 7f6aef7fe700 1 -- 172.21.15.79:0/1204466874 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af00099e0 con 0x7f6b0019bc90 2021-04-09T18:34:48.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.351 7f6b04dff700 1 -- 172.21.15.79:0/1204466874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b000bb370 con 0x7f6b0019bc90 2021-04-09T18:34:48.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.351 7f6aef7fe700 1 -- 172.21.15.79:0/1204466874 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6af000f040 con 0x7f6b0019bc90 2021-04-09T18:34:48.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.351 7f6b04dff700 1 -- 172.21.15.79:0/1204466874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b000d52e0 con 0x7f6b0019bc90 2021-04-09T18:34:48.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.351 7f6aef7fe700 1 -- 172.21.15.79:0/1204466874 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6af0013480 con 0x7f6b0019bc90 2021-04-09T18:34:48.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.351 7f6aef7fe700 1 --2- 172.21.15.79:0/1204466874 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6ae4029100 0x7f6ae402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:48.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.351 7f6aef7fe700 1 -- 172.21.15.79:0/1204466874 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6096+0+0 (secure 0 0 0) 0x7f6af0010070 con 0x7f6b0019bc90 2021-04-09T18:34:48.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.351 7f6afe2ee700 1 --2- 172.21.15.79:0/1204466874 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6ae4029100 0x7f6ae402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:48.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.351 7f6afe2ee700 1 --2- 172.21.15.79:0/1204466874 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6ae4029100 0x7f6ae402b650 crc :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:48.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.351 7f6b04dff700 1 -- 172.21.15.79:0/1204466874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b000e39f0 con 0x7f6b0019bc90 2021-04-09T18:34:48.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.355 7f6aef7fe700 1 -- 172.21.15.79:0/1204466874 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6af0000bf0 con 0x7f6b0019bc90 2021-04-09T18:34:48.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:48.523 7f6b04dff700 1 -- 172.21.15.79:0/1204466874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6b000f5b50 con 0x7f6b0019bc90 2021-04-09T18:34:49.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.179 7f6aef7fe700 1 -- 172.21.15.79:0/1204466874 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v111) v1 ==== 185+0+0 (secure 0 0 0) 0x7f6af00095e0 con 0x7f6b0019bc90 2021-04-09T18:34:49.192 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2021-04-09T18:34:49.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.191 7f6b04dff700 1 -- 172.21.15.79:0/1204466874 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6ae4029100 msgr2=0x7f6ae402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:49.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.191 7f6b04dff700 1 --2- 172.21.15.79:0/1204466874 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6ae4029100 0x7f6ae402b650 crc :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:49.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.191 7f6b04dff700 1 -- 172.21.15.79:0/1204466874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b0019bc90 msgr2=0x7f6b000d6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:49.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.191 7f6b04dff700 1 --2- 172.21.15.79:0/1204466874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b0019bc90 0x7f6b000d6150 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f6b00087490 tx=0x7f6af000df60).stop 2021-04-09T18:34:49.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.191 7f6b04dff700 1 -- 172.21.15.79:0/1204466874 shutdown_connections 2021-04-09T18:34:49.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.191 7f6b04dff700 1 --2- 172.21.15.79:0/1204466874 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6ae4029100 0x7f6ae402b650 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:49.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.191 7f6b04dff700 1 --2- 172.21.15.79:0/1204466874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b0019de30 0x7f6b0019e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:49.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.191 7f6b04dff700 1 --2- 172.21.15.79:0/1204466874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b0019bc90 0x7f6b000d6150 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:49.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.191 7f6b04dff700 1 --2- 172.21.15.79:0/1204466874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b000d4e90 0x7f6b000bad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:49.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.191 7f6b04dff700 1 -- 172.21.15.79:0/1204466874 >> 172.21.15.79:0/1204466874 conn(0x7f6b0009a9b0 msgr2=0x7f6b000a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:49.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.191 7f6b04dff700 1 -- 172.21.15.79:0/1204466874 shutdown_connections 2021-04-09T18:34:49.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.191 7f6b04dff700 1 -- 172.21.15.79:0/1204466874 wait complete. 2021-04-09T18:34:49.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-04-09T18:34:49.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.307 7fb71241f700 1 Processor -- start 2021-04-09T18:34:49.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.307 7fb71241f700 1 -- start start 2021-04-09T18:34:49.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.307 7fb71241f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb70c0f5550 0x7fb70c0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:49.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.307 7fb71241f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70c0fbb50 con 0x7fb70c0e9b10 2021-04-09T18:34:49.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.307 7fb71241f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70c09f910 con 0x7fb70c1c8040 2021-04-09T18:34:49.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.307 7fb71241f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c0e9f60 con 0x7fb70c0f5550 2021-04-09T18:34:49.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.307 7fb70b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb70c0e9b10 0x7fb70c09f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57318/0 (socket says 172.21.15.79:57318) 2021-04-09T18:34:49.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.307 7fb70b7fe700 1 -- 172.21.15.79:0/2776876476 learned_addr learned my addr 172.21.15.79:0/2776876476 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:49.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.307 7fb70bfff700 1 --2- 172.21.15.79:0/2776876476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb70c0f5550 0x7fb70c0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:49.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.307 7fb70affd700 1 -- 172.21.15.79:0/2776876476 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349153677 0 0) 0x7fb700001450 con 0x7fb70c0e9b10 2021-04-09T18:34:49.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.311 7fb70affd700 1 -- 172.21.15.79:0/2776876476 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6f4003240 con 0x7fb70c0e9b10 2021-04-09T18:34:49.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.311 7fb70affd700 1 -- 172.21.15.79:0/2776876476 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622881322 0 0) 0x7fb7040010d0 con 0x7fb70c1c8040 2021-04-09T18:34:49.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.311 7fb70affd700 1 -- 172.21.15.79:0/2776876476 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6f4003620 con 0x7fb70c1c8040 2021-04-09T18:34:49.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.311 7fb70bfff700 1 -- 172.21.15.79:0/2776876476 >> v1:172.21.15.89:6789/0 conn(0x7fb70c1c8040 legacy=0x7fb70c1ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:49.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.311 7fb70bfff700 1 -- 172.21.15.79:0/2776876476 >> v1:172.21.15.79:6789/0 conn(0x7fb70c0e9b10 legacy=0x7fb70c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:49.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.311 7fb70bfff700 1 -- 172.21.15.79:0/2776876476 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70c0e5700 con 0x7fb70c0f5550 2021-04-09T18:34:49.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.311 7fb70bfff700 1 --2- 172.21.15.79:0/2776876476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb70c0f5550 0x7fb70c0f64e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fb6fc002f30 tx=0x7fb6fc00bcf0).ready entity=mon.2 client_cookie=99bd9b4df74a37ca server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:49.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.311 7fb70affd700 1 -- 172.21.15.79:0/2776876476 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb70c0e5700 con 0x7fb70c0f5550 2021-04-09T18:34:49.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.311 7fb70affd700 1 -- 172.21.15.79:0/2776876476 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc009920 con 0x7fb70c0f5550 2021-04-09T18:34:49.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.311 7fb70affd700 1 -- 172.21.15.79:0/2776876476 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb6fc009cf0 con 0x7fb70c0f5550 2021-04-09T18:34:49.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.311 7fb71241f700 1 -- 172.21.15.79:0/2776876476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb70c0f5550 msgr2=0x7fb70c0f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:49.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.311 7fb71241f700 1 --2- 172.21.15.79:0/2776876476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb70c0f5550 0x7fb70c0f64e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fb6fc002f30 tx=0x7fb6fc00bcf0).stop 2021-04-09T18:34:49.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.311 7fb71241f700 1 -- 172.21.15.79:0/2776876476 shutdown_connections 2021-04-09T18:34:49.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.311 7fb71241f700 1 --2- 172.21.15.79:0/2776876476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb70c0f5550 0x7fb70c0f64e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:49.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.311 7fb71241f700 1 -- 172.21.15.79:0/2776876476 >> 172.21.15.79:0/2776876476 conn(0x7fb70c0e6010 msgr2=0x7fb70c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:49.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.311 7fb71241f700 1 -- 172.21.15.79:0/2776876476 shutdown_connections 2021-04-09T18:34:49.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.311 7fb71241f700 1 -- 172.21.15.79:0/2776876476 wait complete. 2021-04-09T18:34:49.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb71241f700 1 Processor -- start 2021-04-09T18:34:49.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb71241f700 1 -- start start 2021-04-09T18:34:49.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb71241f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb70c08f4e0 0x7fb70c0ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:49.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb71241f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb70c0d0920 0x7fb70c0d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:49.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb71241f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb70c090170 0x7fb70c0905c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:49.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb71241f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c1c3df0 con 0x7fb70c0d0920 2021-04-09T18:34:49.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb71241f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c08f1e0 con 0x7fb70c08f4e0 2021-04-09T18:34:49.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb71241f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c08f930 con 0x7fb70c090170 2021-04-09T18:34:49.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb70b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb70c0d0920 0x7fb70c0d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:49.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb70b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb70c0d0920 0x7fb70c0d0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34384/0 (socket says 172.21.15.79:34384) 2021-04-09T18:34:49.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb70b7fe700 1 -- 172.21.15.79:0/2168332760 learned_addr learned my addr 172.21.15.79:0/2168332760 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:49.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb70bfff700 1 --2- 172.21.15.79:0/2168332760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb70c08f4e0 0x7fb70c0ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:49.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb7109c4700 1 --2- 172.21.15.79:0/2168332760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb70c090170 0x7fb70c0905c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:49.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb70b7fe700 1 -- 172.21.15.79:0/2168332760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb70c090170 msgr2=0x7fb70c0905c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb70b7fe700 1 --2- 172.21.15.79:0/2168332760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb70c090170 0x7fb70c0905c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb70b7fe700 1 -- 172.21.15.79:0/2168332760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb70c08f4e0 msgr2=0x7fb70c0ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb70b7fe700 1 --2- 172.21.15.79:0/2168332760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb70c08f4e0 0x7fb70c0ace40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb70b7fe700 1 -- 172.21.15.79:0/2168332760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70c08e9b0 con 0x7fb70c0d0920 2021-04-09T18:34:49.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb70bfff700 1 --2- 172.21.15.79:0/2168332760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb70c08f4e0 0x7fb70c0ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:49.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb70b7fe700 1 --2- 172.21.15.79:0/2168332760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb70c0d0920 0x7fb70c0d0d70 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7fb70c0b9b60 tx=0x7fb70000cec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:49.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb708ff9700 1 -- 172.21.15.79:0/2168332760 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb70c08e9b0 con 0x7fb70c0d0920 2021-04-09T18:34:49.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb708ff9700 1 -- 172.21.15.79:0/2168332760 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb700005b80 con 0x7fb70c0d0920 2021-04-09T18:34:49.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb708ff9700 1 -- 172.21.15.79:0/2168332760 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb700007110 con 0x7fb70c0d0920 2021-04-09T18:34:49.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb71241f700 1 -- 172.21.15.79:0/2168332760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70c08ed70 con 0x7fb70c0d0920 2021-04-09T18:34:49.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.315 7fb71241f700 1 -- 172.21.15.79:0/2168332760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb70c08e690 con 0x7fb70c0d0920 2021-04-09T18:34:49.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.319 7fb708ff9700 1 -- 172.21.15.79:0/2168332760 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb70001a060 con 0x7fb70c0d0920 2021-04-09T18:34:49.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.319 7fb708ff9700 1 --2- 172.21.15.79:0/2168332760 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb6ec029100 0x7fb6ec02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:49.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.319 7fb708ff9700 1 -- 172.21.15.79:0/2168332760 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5658+0+0 (secure 0 0 0) 0x7fb700038ed0 con 0x7fb70c0d0920 2021-04-09T18:34:49.346 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.319 7fb70bfff700 1 --2- 172.21.15.79:0/2168332760 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb6ec029100 0x7fb6ec02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:49.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.319 7fb70bfff700 1 --2- 172.21.15.79:0/2168332760 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb6ec029100 0x7fb6ec02b650 crc :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:49.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.323 7fb71241f700 1 -- 172.21.15.79:0/2168332760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb70c0e39f0 con 0x7fb70c0d0920 2021-04-09T18:34:49.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.327 7fb708ff9700 1 -- 172.21.15.79:0/2168332760 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb700005970 con 0x7fb70c0d0920 2021-04-09T18:34:49.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:49.487 7fb71241f700 1 -- 172.21.15.79:0/2168332760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7fb70c0a1c90 con 0x7fb70c0d0920 2021-04-09T18:34:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:50.183 7fb708ff9700 1 -- 172.21.15.79:0/2168332760 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v112) v1 ==== 133+0+0 (secure 0 0 0) 0x7fb70c0e5cd0 con 0x7fb70c0d0920 2021-04-09T18:34:50.209 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2021-04-09T18:34:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:50.207 7fb71241f700 1 -- 172.21.15.79:0/2168332760 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb6ec029100 msgr2=0x7fb6ec02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:50.207 7fb71241f700 1 --2- 172.21.15.79:0/2168332760 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb6ec029100 0x7fb6ec02b650 crc :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:50.207 7fb71241f700 1 -- 172.21.15.79:0/2168332760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb70c0d0920 msgr2=0x7fb70c0d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:50.213 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:50.207 7fb71241f700 1 --2- 172.21.15.79:0/2168332760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb70c0d0920 0x7fb70c0d0d70 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7fb70c0b9b60 tx=0x7fb70000cec0).stop 2021-04-09T18:34:50.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:50.207 7fb71241f700 1 -- 172.21.15.79:0/2168332760 shutdown_connections 2021-04-09T18:34:50.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:50.207 7fb71241f700 1 --2- 172.21.15.79:0/2168332760 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb6ec029100 0x7fb6ec02b650 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:50.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:50.207 7fb71241f700 1 --2- 172.21.15.79:0/2168332760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb70c08f4e0 0x7fb70c0ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:50.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:50.207 7fb71241f700 1 --2- 172.21.15.79:0/2168332760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb70c090170 0x7fb70c0905c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:50.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:50.207 7fb71241f700 1 --2- 172.21.15.79:0/2168332760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb70c0d0920 0x7fb70c0d0d70 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:50.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:50.207 7fb71241f700 1 -- 172.21.15.79:0/2168332760 >> 172.21.15.79:0/2168332760 conn(0x7fb70c08fbd0 msgr2=0x7fb70c0bad30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:50.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:50.207 7fb71241f700 1 -- 172.21.15.79:0/2168332760 shutdown_connections 2021-04-09T18:34:50.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:50.207 7fb71241f700 1 -- 172.21.15.79:0/2168332760 wait complete. 2021-04-09T18:34:50.226 DEBUG:teuthology.orchestra.run.smithi090:> sudo rados -p cephfs_metadata put key /etc/fstab 2021-04-09T18:34:50.272 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.267 7f6fcac3fbc0 1 Processor -- start 2021-04-09T18:34:50.272 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.267 7f6fcac3fbc0 1 -- start start 2021-04-09T18:34:50.275 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.267 7f6fcac3fbc0 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f6928a1b10 0x55f6928a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:50.275 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.267 7f6fcac3fbc0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6928a2590 0x55f6928acf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:50.275 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.267 7f6fcac3fbc0 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6928ad620 0x55f6928adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:50.275 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.267 7f6fcac3fbc0 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f69278ac00 con 0x55f6928ad620 2021-04-09T18:34:50.276 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.267 7f6fcac3fbc0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6927ba0b0 con 0x55f6928a2590 2021-04-09T18:34:50.276 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.267 7f6fcac3fbc0 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f6928ae440 con 0x55f6928a1b10 2021-04-09T18:34:50.276 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.267 7f6fbb0fa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6928a2590 0x55f6928acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:50.276 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.267 7f6fbb8fb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f6928a1b10 0x55f6928a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:50.277 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.267 7f6fbb0fa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6928a2590 0x55f6928acf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.90:51848/0 (socket says 172.21.15.90:51848) 2021-04-09T18:34:50.277 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.267 7f6fbb0fa700 1 -- 172.21.15.90:0/713403896 learned_addr learned my addr 172.21.15.90:0/713403896 (peer_addr_for_me v2:172.21.15.90:0/0) 2021-04-09T18:34:50.277 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.267 7f6fbc0fc700 1 --2- 172.21.15.90:0/713403896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6928ad620 0x55f6928adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:50.277 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.267 7f6fbb0fa700 1 -- 172.21.15.90:0/713403896 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f6928a1b10 msgr2=0x55f6928a1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:50.277 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.267 7f6fbb0fa700 1 --2- 172.21.15.90:0/713403896 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f6928a1b10 0x55f6928a1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:50.278 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.267 7f6fbb0fa700 1 -- 172.21.15.90:0/713403896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6928ad620 msgr2=0x55f6928adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:50.278 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.267 7f6fbb0fa700 1 --2- 172.21.15.90:0/713403896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6928ad620 0x55f6928adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:50.278 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.267 7f6fbb0fa700 1 -- 172.21.15.90:0/713403896 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6928ae670 con 0x55f6928a2590 2021-04-09T18:34:50.278 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.267 7f6fbb0fa700 1 --2- 172.21.15.90:0/713403896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6928a2590 0x55f6928acf50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f6fb0002f30 tx=0x7f6fb0005420).ready entity=mon.1 client_cookie=2f4e3452b1620b2b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:50.278 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fb98f7700 1 -- 172.21.15.90:0/713403896 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55f6928ae670 con 0x55f6928a2590 2021-04-09T18:34:50.279 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fb98f7700 1 -- 172.21.15.90:0/713403896 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb00127f0 con 0x55f6928a2590 2021-04-09T18:34:50.279 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fb98f7700 1 -- 172.21.15.90:0/713403896 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6fb0012bc0 con 0x55f6928a2590 2021-04-09T18:34:50.279 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fcac3fbc0 1 -- 172.21.15.90:0/713403896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6928a2590 msgr2=0x55f6928acf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:50.279 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fcac3fbc0 1 --2- 172.21.15.90:0/713403896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6928a2590 0x55f6928acf50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f6fb0002f30 tx=0x7f6fb0005420).stop 2021-04-09T18:34:50.283 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fcac3fbc0 1 -- 172.21.15.90:0/713403896 shutdown_connections 2021-04-09T18:34:50.284 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fcac3fbc0 1 --2- 172.21.15.90:0/713403896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6928ad620 0x55f6928adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:50.284 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fcac3fbc0 1 --2- 172.21.15.90:0/713403896 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f6928a1b10 0x55f6928a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:50.284 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fcac3fbc0 1 --2- 172.21.15.90:0/713403896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6928a2590 0x55f6928acf50 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:50.284 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fcac3fbc0 1 -- 172.21.15.90:0/713403896 >> 172.21.15.90:0/713403896 conn(0x55f6928a6d30 msgr2=0x55f6928a44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:50.284 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fcac3fbc0 1 -- 172.21.15.90:0/713403896 shutdown_connections 2021-04-09T18:34:50.285 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fcac3fbc0 1 -- 172.21.15.90:0/713403896 wait complete. 2021-04-09T18:34:50.285 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fcac3fbc0 1 Processor -- start 2021-04-09T18:34:50.285 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fcac3fbc0 1 -- start start 2021-04-09T18:34:50.286 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fcac3fbc0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6928ad100 0x55f6928aa590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:50.286 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fcac3fbc0 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6928aabc0 0x55f692965770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:50.286 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fcac3fbc0 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f692965da0 0x55f692968200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:50.286 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fcac3fbc0 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f692968830 con 0x55f6928aabc0 2021-04-09T18:34:50.286 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fcac3fbc0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6929689e0 con 0x55f6928ad100 2021-04-09T18:34:50.287 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fcac3fbc0 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f692968b90 con 0x55f692965da0 2021-04-09T18:34:50.287 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fbb8fb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6928ad100 0x55f6928aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:50.287 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fbb8fb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6928ad100 0x55f6928aa590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.90:51852/0 (socket says 172.21.15.90:51852) 2021-04-09T18:34:50.287 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fbb8fb700 1 -- 172.21.15.90:0/77509865 learned_addr learned my addr 172.21.15.90:0/77509865 (peer_addr_for_me v2:172.21.15.90:0/0) 2021-04-09T18:34:50.287 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fbb0fa700 1 --2- 172.21.15.90:0/77509865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6928aabc0 0x55f692965770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:50.288 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.271 7f6fbc0fc700 1 --2- 172.21.15.90:0/77509865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f692965da0 0x55f692968200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:50.288 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fbb8fb700 1 -- 172.21.15.90:0/77509865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f692965da0 msgr2=0x55f692968200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:50.288 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fbb8fb700 1 --2- 172.21.15.90:0/77509865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f692965da0 0x55f692968200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:50.288 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fbb8fb700 1 -- 172.21.15.90:0/77509865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6928aabc0 msgr2=0x55f692965770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:50.289 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fbb8fb700 1 --2- 172.21.15.90:0/77509865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6928aabc0 0x55f692965770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:50.289 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fbb8fb700 1 -- 172.21.15.90:0/77509865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f692968d40 con 0x55f6928ad100 2021-04-09T18:34:50.289 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fbc0fc700 1 --2- 172.21.15.90:0/77509865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f692965da0 0x55f692968200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:50.289 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fbb0fa700 1 --2- 172.21.15.90:0/77509865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6928aabc0 0x55f692965770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:50.289 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fbb8fb700 1 --2- 172.21.15.90:0/77509865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6928ad100 0x55f6928aa590 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f6fac00c000 tx=0x7f6fac00cbd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:50.290 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fb90f6700 1 -- 172.21.15.90:0/77509865 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55f692968d40 con 0x55f6928ad100 2021-04-09T18:34:50.290 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fb90f6700 1 -- 172.21.15.90:0/77509865 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac009070 con 0x55f6928ad100 2021-04-09T18:34:50.290 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fcac3fbc0 1 -- 172.21.15.90:0/77509865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f692969060 con 0x55f6928ad100 2021-04-09T18:34:50.290 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fb90f6700 1 -- 172.21.15.90:0/77509865 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6fac010890 con 0x55f6928ad100 2021-04-09T18:34:50.290 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fcac3fbc0 1 -- 172.21.15.90:0/77509865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f692969660 con 0x55f6928ad100 2021-04-09T18:34:50.291 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fb90f6700 1 -- 172.21.15.90:0/77509865 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6fac018020 con 0x55f6928ad100 2021-04-09T18:34:50.291 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fb90f6700 1 --2- 172.21.15.90:0/77509865 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6fa8027e20 0x7f6fa802a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:50.291 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fb90f6700 1 -- 172.21.15.90:0/77509865 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6012+0+0 (secure 0 0 0) 0x7f6fac038560 con 0x55f6928ad100 2021-04-09T18:34:50.291 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fcac3fbc0 1 --2- 172.21.15.90:0/77509865 >> [v2:172.21.15.89:6826/14212,v1:172.21.15.89:6827/14212] conn(0x55f69296a6d0 0x55f69296cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:50.292 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fcac3fbc0 1 -- 172.21.15.90:0/77509865 --> [v2:172.21.15.89:6826/14212,v1:172.21.15.89:6827/14212] -- osd_op(unknown.0.0:1 22.0 22:0620e6f9:::key:head [writefull 0~617] snapc 0=[] ondisk+write+known_if_redirected e112) v8 -- 0x55f6927e2ce0 con 0x55f69296a6d0 2021-04-09T18:34:50.292 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fbb0fa700 1 --2- 172.21.15.90:0/77509865 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6fa8027e20 0x7f6fa802a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:50.292 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fbc0fc700 1 --2- 172.21.15.90:0/77509865 >> [v2:172.21.15.89:6826/14212,v1:172.21.15.89:6827/14212] conn(0x55f69296a6d0 0x55f69296cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:50.292 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fbb0fa700 1 --2- 172.21.15.90:0/77509865 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6fa8027e20 0x7f6fa802a370 crc :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:50.293 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:50.275 7f6fbc0fc700 1 --2- 172.21.15.90:0/77509865 >> [v2:172.21.15.89:6826/14212,v1:172.21.15.89:6827/14212] conn(0x55f69296a6d0 0x55f69296cb30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:51.205 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:51.199 7f6fbc0fc700 1 -- 172.21.15.90:0/77509865 <== osd.4 v2:172.21.15.89:6826/14212 1 ==== osd_op_reply(1 key [writefull 0~617] v113'1 uv1 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7f6fb4012330 con 0x55f69296a6d0 2021-04-09T18:34:51.206 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:51.199 7f6fcac3fbc0 1 -- 172.21.15.90:0/77509865 >> [v2:172.21.15.89:6826/14212,v1:172.21.15.89:6827/14212] conn(0x55f69296a6d0 msgr2=0x55f69296cb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:51.206 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:51.199 7f6fcac3fbc0 1 --2- 172.21.15.90:0/77509865 >> [v2:172.21.15.89:6826/14212,v1:172.21.15.89:6827/14212] conn(0x55f69296a6d0 0x55f69296cb30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:51.206 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:51.199 7f6fcac3fbc0 1 -- 172.21.15.90:0/77509865 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6fa8027e20 msgr2=0x7f6fa802a370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:51.206 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:51.199 7f6fcac3fbc0 1 --2- 172.21.15.90:0/77509865 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6fa8027e20 0x7f6fa802a370 crc :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:51.207 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:51.199 7f6fcac3fbc0 1 -- 172.21.15.90:0/77509865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6928ad100 msgr2=0x55f6928aa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:51.207 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:51.199 7f6fcac3fbc0 1 --2- 172.21.15.90:0/77509865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6928ad100 0x55f6928aa590 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f6fac00c000 tx=0x7f6fac00cbd0).stop 2021-04-09T18:34:51.207 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:51.199 7f6fbc0fc700 1 -- 172.21.15.90:0/77509865 reap_dead start 2021-04-09T18:34:51.207 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:51.199 7f6fcac3fbc0 1 -- 172.21.15.90:0/77509865 shutdown_connections 2021-04-09T18:34:51.208 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:51.199 7f6fcac3fbc0 1 -- 172.21.15.90:0/77509865 >> 172.21.15.90:0/77509865 conn(0x55f6928a0030 msgr2=0x55f6928a4470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:51.208 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:51.199 7f6fcac3fbc0 1 -- 172.21.15.90:0/77509865 shutdown_connections 2021-04-09T18:34:51.208 INFO:teuthology.orchestra.run.smithi090.stderr:2021-04-09 18:34:51.199 7f6fcac3fbc0 1 -- 172.21.15.90:0/77509865 wait complete. 2021-04-09T18:34:51.211 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-04-09T18:34:51.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.295 7fa950a49700 1 Processor -- start 2021-04-09T18:34:51.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.295 7fa950a49700 1 -- start start 2021-04-09T18:34:51.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa950a49700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa94c0e9ad0 0x7fa94c09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:51.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa950a49700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa94c1c8000 0x7fa94c1ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:51.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa950a49700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94c0fbb10 con 0x7fa94c0f5510 2021-04-09T18:34:51.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa950a49700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94c1c3db0 con 0x7fa94c0e9ad0 2021-04-09T18:34:51.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa950a49700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94c0e9f20 con 0x7fa94c1c8000 2021-04-09T18:34:51.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa941fe5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa94c0e9ad0 0x7fa94c09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:51.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa941fe5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa94c0e9ad0 0x7fa94c09f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34392/0 (socket says 172.21.15.79:34392) 2021-04-09T18:34:51.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa941fe5700 1 -- 172.21.15.79:0/135737970 learned_addr learned my addr 172.21.15.79:0/135737970 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:51.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa94afe7700 1 --2- 172.21.15.79:0/135737970 >> v2:172.21.15.89:3300/0 conn(0x7fa94c1c8000 0x7fa94c1ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:51.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa941fe5700 1 -- 172.21.15.79:0/135737970 >> v2:172.21.15.89:3300/0 conn(0x7fa94c1c8000 msgr2=0x7fa94c1ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:51.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa941fe5700 1 --2- 172.21.15.79:0/135737970 >> v2:172.21.15.89:3300/0 conn(0x7fa94c1c8000 0x7fa94c1ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:51.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa949fe5700 1 -- 172.21.15.79:0/135737970 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300584183 0 0) 0x7fa93c001450 con 0x7fa94c0f5510 2021-04-09T18:34:51.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa941fe5700 1 -- 172.21.15.79:0/135737970 >> v1:172.21.15.89:6789/0 conn(0x7fa94c0f5510 legacy=0x7fa94c0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:51.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa941fe5700 1 -- 172.21.15.79:0/135737970 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c0e56c0 con 0x7fa94c0e9ad0 2021-04-09T18:34:51.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa941fe5700 1 --2- 172.21.15.79:0/135737970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa94c0e9ad0 0x7fa94c09f100 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fa934002f30 tx=0x7fa93400bd70).ready entity=mon.0 client_cookie=401faf51bfe0aa6e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:51.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa949fe5700 1 -- 172.21.15.79:0/135737970 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa94c0e56c0 con 0x7fa94c0e9ad0 2021-04-09T18:34:51.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa949fe5700 1 -- 172.21.15.79:0/135737970 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa934009950 con 0x7fa94c0e9ad0 2021-04-09T18:34:51.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa949fe5700 1 -- 172.21.15.79:0/135737970 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa934009d20 con 0x7fa94c0e9ad0 2021-04-09T18:34:51.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa950a49700 1 -- 172.21.15.79:0/135737970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa94c0e9ad0 msgr2=0x7fa94c09f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:51.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa950a49700 1 --2- 172.21.15.79:0/135737970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa94c0e9ad0 0x7fa94c09f100 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fa934002f30 tx=0x7fa93400bd70).stop 2021-04-09T18:34:51.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa950a49700 1 -- 172.21.15.79:0/135737970 shutdown_connections 2021-04-09T18:34:51.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa950a49700 1 --2- 172.21.15.79:0/135737970 >> v2:172.21.15.89:3300/0 conn(0x7fa94c1c8000 0x7fa94c1ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:51.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa950a49700 1 --2- 172.21.15.79:0/135737970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa94c0e9ad0 0x7fa94c09f100 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:51.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa950a49700 1 -- 172.21.15.79:0/135737970 >> 172.21.15.79:0/135737970 conn(0x7fa94c0e5fd0 msgr2=0x7fa94c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:51.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa950a49700 1 -- 172.21.15.79:0/135737970 shutdown_connections 2021-04-09T18:34:51.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.299 7fa950a49700 1 -- 172.21.15.79:0/135737970 wait complete. 2021-04-09T18:34:51.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.303 7fa950a49700 1 Processor -- start 2021-04-09T18:34:51.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.303 7fa950a49700 1 -- start start 2021-04-09T18:34:51.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa950a49700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa94c0d4e80 0x7fa94c091190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:51.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa950a49700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa94c0d8770 0x7fa94c0ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:51.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa950a49700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa94c0d8bc0 0x7fa94c099660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:51.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa950a49700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c0d5620 con 0x7fa94c0d4e80 2021-04-09T18:34:51.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa950a49700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c0d5920 con 0x7fa94c0d8bc0 2021-04-09T18:34:51.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa950a49700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c0d52d0 con 0x7fa94c0d8770 2021-04-09T18:34:51.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa94a7e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa94c0d4e80 0x7fa94c091190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:51.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa94a7e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa94c0d4e80 0x7fa94c091190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34396/0 (socket says 172.21.15.79:34396) 2021-04-09T18:34:51.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa94a7e6700 1 -- 172.21.15.79:0/4294745115 learned_addr learned my addr 172.21.15.79:0/4294745115 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:51.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa941fe5700 1 --2- 172.21.15.79:0/4294745115 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa94c0d8770 0x7fa94c0ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:51.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa94afe7700 1 --2- 172.21.15.79:0/4294745115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa94c0d8bc0 0x7fa94c099660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:51.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa94a7e6700 1 -- 172.21.15.79:0/4294745115 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa94c0d8770 msgr2=0x7fa94c0ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:51.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa94a7e6700 1 --2- 172.21.15.79:0/4294745115 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa94c0d8770 0x7fa94c0ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:51.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa94a7e6700 1 -- 172.21.15.79:0/4294745115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa94c0d8bc0 msgr2=0x7fa94c099660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:51.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa94a7e6700 1 --2- 172.21.15.79:0/4294745115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa94c0d8bc0 0x7fa94c099660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:51.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa94a7e6700 1 -- 172.21.15.79:0/4294745115 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c0b9560 con 0x7fa94c0d4e80 2021-04-09T18:34:51.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa94afe7700 1 --2- 172.21.15.79:0/4294745115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa94c0d8bc0 0x7fa94c099660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:34:51.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa94a7e6700 1 --2- 172.21.15.79:0/4294745115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa94c0d4e80 0x7fa94c091190 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7fa94c0d2960 tx=0x7fa93c00ce00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:51.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa9437fe700 1 -- 172.21.15.79:0/4294745115 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa94c0b9560 con 0x7fa94c0d4e80 2021-04-09T18:34:51.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa9437fe700 1 -- 172.21.15.79:0/4294745115 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c00a7d0 con 0x7fa94c0d4e80 2021-04-09T18:34:51.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa9437fe700 1 -- 172.21.15.79:0/4294745115 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa93c00a9b0 con 0x7fa94c0d4e80 2021-04-09T18:34:51.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa950a49700 1 -- 172.21.15.79:0/4294745115 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94c0b8eb0 con 0x7fa94c0d4e80 2021-04-09T18:34:51.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa950a49700 1 -- 172.21.15.79:0/4294745115 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94c0baaf0 con 0x7fa94c0d4e80 2021-04-09T18:34:51.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.307 7fa9437fe700 1 -- 172.21.15.79:0/4294745115 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa93c019020 con 0x7fa94c0d4e80 2021-04-09T18:34:51.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.311 7fa9437fe700 1 --2- 172.21.15.79:0/4294745115 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa930029100 0x7fa93002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:51.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.311 7fa9437fe700 1 -- 172.21.15.79:0/4294745115 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6012+0+0 (secure 0 0 0) 0x7fa93c0392b0 con 0x7fa94c0d4e80 2021-04-09T18:34:51.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.311 7fa941fe5700 1 --2- 172.21.15.79:0/4294745115 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa930029100 0x7fa93002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:51.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.311 7fa941fe5700 1 --2- 172.21.15.79:0/4294745115 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa930029100 0x7fa93002b650 crc :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:51.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.311 7fa950a49700 1 -- 172.21.15.79:0/4294745115 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa94c0e39d0 con 0x7fa94c0d4e80 2021-04-09T18:34:51.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.319 7fa9437fe700 1 -- 172.21.15.79:0/4294745115 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa93c00a5c0 con 0x7fa94c0d4e80 2021-04-09T18:34:51.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.491 7fa950a49700 1 -- 172.21.15.79:0/4294745115 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fa94c0f5b10 con 0x7fa94c0d4e80 2021-04-09T18:34:51.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.491 7fa9437fe700 1 -- 172.21.15.79:0/4294745115 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1228 (secure 0 0 0) 0x7fa94c107f40 con 0x7fa94c0d4e80 2021-04-09T18:34:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:51.497 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:34:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: "stats": { 2021-04-09T18:34:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "total_bytes": 773094113280, 2021-04-09T18:34:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "total_avail_bytes": 764492972032, 2021-04-09T18:34:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_bytes": 11206656, 2021-04-09T18:34:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_raw_bytes": 8601141248, 2021-04-09T18:34:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_raw_ratio": 0.011125607416033745, 2021-04-09T18:34:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: "num_osds": 8, 2021-04-09T18:34:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: "num_per_pool_osds": 8 2021-04-09T18:34:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "stats_by_class": { 2021-04-09T18:34:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "ssd": { 2021-04-09T18:34:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "total_bytes": 773094113280, 2021-04-09T18:34:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "total_avail_bytes": 764492972032, 2021-04-09T18:34:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_bytes": 11206656, 2021-04-09T18:34:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_raw_bytes": 8601141248, 2021-04-09T18:34:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_raw_ratio": 0.011125607416033745 2021-04-09T18:34:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:34:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd", 2021-04-09T18:34:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 1, 2021-04-09T18:34:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "stats": { 2021-04-09T18:34:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "stored": 0, 2021-04-09T18:34:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "objects": 0, 2021-04-09T18:34:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: "kb_used": 0, 2021-04-09T18:34:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: "bytes_used": 0, 2021-04-09T18:34:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: "percent_used": 0, 2021-04-09T18:34:51.505 INFO:teuthology.orchestra.run.smithi079.stdout: "max_avail": 362919067648 2021-04-09T18:34:51.505 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:51.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:51.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:51.506 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cephfs_data", 2021-04-09T18:34:51.507 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 21, 2021-04-09T18:34:51.507 INFO:teuthology.orchestra.run.smithi079.stdout: "stats": { 2021-04-09T18:34:51.508 INFO:teuthology.orchestra.run.smithi079.stdout: "stored": 0, 2021-04-09T18:34:51.508 INFO:teuthology.orchestra.run.smithi079.stdout: "objects": 0, 2021-04-09T18:34:51.508 INFO:teuthology.orchestra.run.smithi079.stdout: "kb_used": 0, 2021-04-09T18:34:51.509 INFO:teuthology.orchestra.run.smithi079.stdout: "bytes_used": 0, 2021-04-09T18:34:51.509 INFO:teuthology.orchestra.run.smithi079.stdout: "percent_used": 0, 2021-04-09T18:34:51.510 INFO:teuthology.orchestra.run.smithi079.stdout: "max_avail": 362919067648 2021-04-09T18:34:51.510 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:51.510 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:51.511 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:51.511 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:34:51.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.491 7fa950a49700 1 -- 172.21.15.79:0/4294745115 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa930029100 msgr2=0x7fa93002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:51.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.491 7fa950a49700 1 --2- 172.21.15.79:0/4294745115 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa930029100 0x7fa93002b650 crc :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:51.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.491 7fa950a49700 1 -- 172.21.15.79:0/4294745115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa94c0d4e80 msgr2=0x7fa94c091190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:51.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.491 7fa950a49700 1 --2- 172.21.15.79:0/4294745115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa94c0d4e80 0x7fa94c091190 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7fa94c0d2960 tx=0x7fa93c00ce00).stop 2021-04-09T18:34:51.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.491 7fa950a49700 1 -- 172.21.15.79:0/4294745115 shutdown_connections 2021-04-09T18:34:51.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.491 7fa950a49700 1 --2- 172.21.15.79:0/4294745115 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa930029100 0x7fa93002b650 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:51.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.491 7fa950a49700 1 --2- 172.21.15.79:0/4294745115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa94c0d8bc0 0x7fa94c099660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:51.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.491 7fa950a49700 1 --2- 172.21.15.79:0/4294745115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa94c0d4e80 0x7fa94c091190 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:51.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.491 7fa950a49700 1 --2- 172.21.15.79:0/4294745115 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa94c0d8770 0x7fa94c0ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:51.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.491 7fa950a49700 1 -- 172.21.15.79:0/4294745115 >> 172.21.15.79:0/4294745115 conn(0x7fa94c0933f0 msgr2=0x7fa94c0d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:51.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.491 7fa950a49700 1 -- 172.21.15.79:0/4294745115 shutdown_connections 2021-04-09T18:34:51.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:51.491 7fa950a49700 1 -- 172.21.15.79:0/4294745115 wait complete. 2021-04-09T18:34:51.518 DEBUG:tasks.ceph_test_case:wait_until_true: waiting... 2021-04-09T18:34:56.518 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-04-09T18:34:56.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3d3328700 1 Processor -- start 2021-04-09T18:34:56.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3d3328700 1 -- start start 2021-04-09T18:34:56.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3d3328700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd3cc0e9ae0 0x7fd3cc09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:56.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3d3328700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3cc0fbb20 con 0x7fd3cc0f5520 2021-04-09T18:34:56.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3d3328700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3cc0e56d0 con 0x7fd3cc1c8010 2021-04-09T18:34:56.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3d3328700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3cc1c3dc0 con 0x7fd3cc0e9ae0 2021-04-09T18:34:56.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3d10cc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd3cc0f5520 0x7fd3cc0f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57346/0 (socket says 172.21.15.79:57346) 2021-04-09T18:34:56.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3d10cc700 1 -- 172.21.15.79:0/2269324179 learned_addr learned my addr 172.21.15.79:0/2269324179 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:56.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3d08cb700 1 --2- 172.21.15.79:0/2269324179 >> v2:172.21.15.89:3300/0 conn(0x7fd3cc0e9ae0 0x7fd3cc09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:56.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3c3fff700 1 -- 172.21.15.79:0/2269324179 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901289905 0 0) 0x7fd3c80010d0 con 0x7fd3cc0f5520 2021-04-09T18:34:56.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3c3fff700 1 -- 172.21.15.79:0/2269324179 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3b8003240 con 0x7fd3cc0f5520 2021-04-09T18:34:56.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3c3fff700 1 -- 172.21.15.79:0/2269324179 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2556369377 0 0) 0x7fd3c8001650 con 0x7fd3cc0f5520 2021-04-09T18:34:56.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3c3fff700 1 -- 172.21.15.79:0/2269324179 >> v2:172.21.15.89:3300/0 conn(0x7fd3cc0e9ae0 msgr2=0x7fd3cc09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:56.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3c3fff700 1 --2- 172.21.15.79:0/2269324179 >> v2:172.21.15.89:3300/0 conn(0x7fd3cc0e9ae0 0x7fd3cc09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:56.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3c3fff700 1 -- 172.21.15.79:0/2269324179 >> v1:172.21.15.89:6789/0 conn(0x7fd3cc1c8010 legacy=0x7fd3cc1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:56.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3c3fff700 1 -- 172.21.15.79:0/2269324179 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc0e4330 con 0x7fd3cc0f5520 2021-04-09T18:34:56.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3c3fff700 1 -- 172.21.15.79:0/2269324179 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7fd3c8001bb0 con 0x7fd3cc0f5520 2021-04-09T18:34:56.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3c3fff700 1 -- 172.21.15.79:0/2269324179 >> v1:172.21.15.79:6789/0 conn(0x7fd3cc0f5520 legacy=0x7fd3cc0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:56.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3c3fff700 1 --2- 172.21.15.79:0/2269324179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b80038c0 0x7fd3b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:56.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3c3fff700 1 --2- 172.21.15.79:0/2269324179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b80045a0 0x7fd3b8004a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:56.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3c3fff700 1 --2- 172.21.15.79:0/2269324179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80097e0 0x7fd3b800bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:56.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3c3fff700 1 -- 172.21.15.79:0/2269324179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc1c3dc0 con 0x7fd3b80038c0 2021-04-09T18:34:56.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3c3fff700 1 -- 172.21.15.79:0/2269324179 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b800c270 con 0x7fd3b80045a0 2021-04-09T18:34:56.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3c3fff700 1 -- 172.21.15.79:0/2269324179 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b800c420 con 0x7fd3b80097e0 2021-04-09T18:34:56.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3d10cc700 1 --2- 172.21.15.79:0/2269324179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b80038c0 0x7fd3b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:56.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3d08cb700 1 --2- 172.21.15.79:0/2269324179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b80045a0 0x7fd3b8004a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:56.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3d18cd700 1 --2- 172.21.15.79:0/2269324179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80097e0 0x7fd3b800bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:56.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3d10cc700 1 -- 172.21.15.79:0/2269324179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80097e0 msgr2=0x7fd3b800bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:56.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3d10cc700 1 --2- 172.21.15.79:0/2269324179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80097e0 0x7fd3b800bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:56.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3d10cc700 1 -- 172.21.15.79:0/2269324179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b80045a0 msgr2=0x7fd3b8004a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:56.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3d10cc700 1 --2- 172.21.15.79:0/2269324179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b80045a0 0x7fd3b8004a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:56.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3d18cd700 1 -- 172.21.15.79:0/2269324179 reap_dead start 2021-04-09T18:34:56.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.615 7fd3d10cc700 1 -- 172.21.15.79:0/2269324179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b80506a0 con 0x7fd3b80038c0 2021-04-09T18:34:56.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.619 7fd3d10cc700 1 --2- 172.21.15.79:0/2269324179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b80038c0 0x7fd3b8003d90 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7fd3c8001000 tx=0x7fd3c8005290).ready entity=mon.0 client_cookie=d890d14e34fb1ad3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:56.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.619 7fd3c3fff700 1 -- 172.21.15.79:0/2269324179 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd3b80506a0 con 0x7fd3b80038c0 2021-04-09T18:34:56.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.619 7fd3c3fff700 1 -- 172.21.15.79:0/2269324179 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c80053d0 con 0x7fd3b80038c0 2021-04-09T18:34:56.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.619 7fd3c3fff700 1 -- 172.21.15.79:0/2269324179 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd3cc0e4330 con 0x7fd3b80038c0 2021-04-09T18:34:56.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.619 7fd3d3328700 1 -- 172.21.15.79:0/2269324179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b80038c0 msgr2=0x7fd3b8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:56.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.619 7fd3d3328700 1 --2- 172.21.15.79:0/2269324179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b80038c0 0x7fd3b8003d90 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7fd3c8001000 tx=0x7fd3c8005290).stop 2021-04-09T18:34:56.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.619 7fd3d3328700 1 -- 172.21.15.79:0/2269324179 shutdown_connections 2021-04-09T18:34:56.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.619 7fd3d3328700 1 --2- 172.21.15.79:0/2269324179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b80038c0 0x7fd3b8003d90 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:56.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.619 7fd3d3328700 1 -- 172.21.15.79:0/2269324179 >> 172.21.15.79:0/2269324179 conn(0x7fd3cc0e5fe0 msgr2=0x7fd3cc0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:56.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.619 7fd3d3328700 1 -- 172.21.15.79:0/2269324179 shutdown_connections 2021-04-09T18:34:56.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.619 7fd3d3328700 1 -- 172.21.15.79:0/2269324179 wait complete. 2021-04-09T18:34:56.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3d3328700 1 Processor -- start 2021-04-09T18:34:56.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3d3328700 1 -- start start 2021-04-09T18:34:56.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3d3328700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3cc0b43d0 0x7fd3cc0b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:56.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3d3328700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3cc0bb130 0x7fd3cc0b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:56.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3d3328700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3cc0b37b0 0x7fd3cc0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:56.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3d3328700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0e9f30 con 0x7fd3cc0bb130 2021-04-09T18:34:56.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3d3328700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0b18e0 con 0x7fd3cc0b37b0 2021-04-09T18:34:56.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3d3328700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0b1be0 con 0x7fd3cc0b43d0 2021-04-09T18:34:56.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3d08cb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3cc0bb130 0x7fd3cc0b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:56.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3d08cb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3cc0bb130 0x7fd3cc0b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34420/0 (socket says 172.21.15.79:34420) 2021-04-09T18:34:56.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3d08cb700 1 -- 172.21.15.79:0/3993889551 learned_addr learned my addr 172.21.15.79:0/3993889551 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:56.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3d10cc700 1 --2- 172.21.15.79:0/3993889551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3cc0b43d0 0x7fd3cc0b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:56.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3d18cd700 1 --2- 172.21.15.79:0/3993889551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3cc0b37b0 0x7fd3cc0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:56.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3d08cb700 1 -- 172.21.15.79:0/3993889551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3cc0b43d0 msgr2=0x7fd3cc0b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:56.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3d08cb700 1 --2- 172.21.15.79:0/3993889551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3cc0b43d0 0x7fd3cc0b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:56.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3d08cb700 1 -- 172.21.15.79:0/3993889551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3cc0b37b0 msgr2=0x7fd3cc0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:56.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3d08cb700 1 --2- 172.21.15.79:0/3993889551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3cc0b37b0 0x7fd3cc0b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:56.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3d08cb700 1 -- 172.21.15.79:0/3993889551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc0bb580 con 0x7fd3cc0bb130 2021-04-09T18:34:56.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3d08cb700 1 --2- 172.21.15.79:0/3993889551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3cc0bb130 0x7fd3cc0b3180 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7fd3cc0c0d70 tx=0x7fd3bc00f520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:56.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3c1ffb700 1 -- 172.21.15.79:0/3993889551 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd3cc0bb580 con 0x7fd3cc0bb130 2021-04-09T18:34:56.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3c1ffb700 1 -- 172.21.15.79:0/3993889551 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc00fab0 con 0x7fd3cc0bb130 2021-04-09T18:34:56.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3d3328700 1 -- 172.21.15.79:0/3993889551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3cc1aed10 con 0x7fd3cc0bb130 2021-04-09T18:34:56.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.623 7fd3c1ffb700 1 -- 172.21.15.79:0/3993889551 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd3bc00f040 con 0x7fd3cc0bb130 2021-04-09T18:34:56.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.627 7fd3d3328700 1 -- 172.21.15.79:0/3993889551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3cc1af240 con 0x7fd3cc0bb130 2021-04-09T18:34:56.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.627 7fd3c1ffb700 1 -- 172.21.15.79:0/3993889551 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd3bc00fc90 con 0x7fd3cc0bb130 2021-04-09T18:34:56.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.627 7fd3c1ffb700 1 --2- 172.21.15.79:0/3993889551 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3ac029100 0x7fd3ac02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:56.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.627 7fd3c1ffb700 1 -- 172.21.15.79:0/3993889551 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6012+0+0 (secure 0 0 0) 0x7fd3bc010040 con 0x7fd3cc0bb130 2021-04-09T18:34:56.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.627 7fd3d10cc700 1 --2- 172.21.15.79:0/3993889551 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3ac029100 0x7fd3ac02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:56.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.627 7fd3d10cc700 1 --2- 172.21.15.79:0/3993889551 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3ac029100 0x7fd3ac02b650 crc :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:56.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.643 7fd3d3328700 1 -- 172.21.15.79:0/3993889551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3cc0e39e0 con 0x7fd3cc0bb130 2021-04-09T18:34:56.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.651 7fd3c1ffb700 1 -- 172.21.15.79:0/3993889551 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd3bc011dc0 con 0x7fd3cc0bb130 2021-04-09T18:34:56.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.811 7fd3d3328700 1 -- 172.21.15.79:0/3993889551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fd3cc0f5b20 con 0x7fd3cc0bb130 2021-04-09T18:34:56.819 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.815 7fd3c1ffb700 1 -- 172.21.15.79:0/3993889551 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1572 (secure 0 0 0) 0x7fd3bc000bf0 con 0x7fd3cc0bb130 2021-04-09T18:34:56.819 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:34:56.820 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:34:56.820 INFO:teuthology.orchestra.run.smithi079.stdout: "stats": { 2021-04-09T18:34:56.820 INFO:teuthology.orchestra.run.smithi079.stdout: "total_bytes": 773094113280, 2021-04-09T18:34:56.821 INFO:teuthology.orchestra.run.smithi079.stdout: "total_avail_bytes": 764492627968, 2021-04-09T18:34:56.821 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_bytes": 11550720, 2021-04-09T18:34:56.821 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_raw_bytes": 8601485312, 2021-04-09T18:34:56.821 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_raw_ratio": 0.011126051656901836, 2021-04-09T18:34:56.822 INFO:teuthology.orchestra.run.smithi079.stdout: "num_osds": 8, 2021-04-09T18:34:56.822 INFO:teuthology.orchestra.run.smithi079.stdout: "num_per_pool_osds": 8 2021-04-09T18:34:56.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:56.822 INFO:teuthology.orchestra.run.smithi079.stdout: "stats_by_class": { 2021-04-09T18:34:56.823 INFO:teuthology.orchestra.run.smithi079.stdout: "ssd": { 2021-04-09T18:34:56.823 INFO:teuthology.orchestra.run.smithi079.stdout: "total_bytes": 773094113280, 2021-04-09T18:34:56.823 INFO:teuthology.orchestra.run.smithi079.stdout: "total_avail_bytes": 764492627968, 2021-04-09T18:34:56.823 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_bytes": 11550720, 2021-04-09T18:34:56.824 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_raw_bytes": 8601485312, 2021-04-09T18:34:56.824 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_raw_ratio": 0.011126051656901836 2021-04-09T18:34:56.824 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:56.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:56.824 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:34:56.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:56.825 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd", 2021-04-09T18:34:56.825 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 1, 2021-04-09T18:34:56.825 INFO:teuthology.orchestra.run.smithi079.stdout: "stats": { 2021-04-09T18:34:56.826 INFO:teuthology.orchestra.run.smithi079.stdout: "stored": 0, 2021-04-09T18:34:56.826 INFO:teuthology.orchestra.run.smithi079.stdout: "objects": 0, 2021-04-09T18:34:56.826 INFO:teuthology.orchestra.run.smithi079.stdout: "kb_used": 0, 2021-04-09T18:34:56.826 INFO:teuthology.orchestra.run.smithi079.stdout: "bytes_used": 0, 2021-04-09T18:34:56.826 INFO:teuthology.orchestra.run.smithi079.stdout: "percent_used": 0, 2021-04-09T18:34:56.827 INFO:teuthology.orchestra.run.smithi079.stdout: "max_avail": 362918903808 2021-04-09T18:34:56.827 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:56.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:56.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:56.828 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cephfs_data", 2021-04-09T18:34:56.828 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 21, 2021-04-09T18:34:56.828 INFO:teuthology.orchestra.run.smithi079.stdout: "stats": { 2021-04-09T18:34:56.829 INFO:teuthology.orchestra.run.smithi079.stdout: "stored": 0, 2021-04-09T18:34:56.829 INFO:teuthology.orchestra.run.smithi079.stdout: "objects": 0, 2021-04-09T18:34:56.829 INFO:teuthology.orchestra.run.smithi079.stdout: "kb_used": 0, 2021-04-09T18:34:56.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bytes_used": 0, 2021-04-09T18:34:56.830 INFO:teuthology.orchestra.run.smithi079.stdout: "percent_used": 0, 2021-04-09T18:34:56.830 INFO:teuthology.orchestra.run.smithi079.stdout: "max_avail": 362918903808 2021-04-09T18:34:56.831 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:56.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:34:56.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:34:56.832 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cephfs_metadata", 2021-04-09T18:34:56.832 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 22, 2021-04-09T18:34:56.832 INFO:teuthology.orchestra.run.smithi079.stdout: "stats": { 2021-04-09T18:34:56.832 INFO:teuthology.orchestra.run.smithi079.stdout: "stored": 617, 2021-04-09T18:34:56.832 INFO:teuthology.orchestra.run.smithi079.stdout: "objects": 1, 2021-04-09T18:34:56.833 INFO:teuthology.orchestra.run.smithi079.stdout: "kb_used": 8, 2021-04-09T18:34:56.833 INFO:teuthology.orchestra.run.smithi079.stdout: "bytes_used": 8192, 2021-04-09T18:34:56.833 INFO:teuthology.orchestra.run.smithi079.stdout: "percent_used": 1.1286267920240789e-08, 2021-04-09T18:34:56.834 INFO:teuthology.orchestra.run.smithi079.stdout: "max_avail": 362918903808 2021-04-09T18:34:56.834 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:56.834 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:34:56.834 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:34:56.835 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:34:56.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.815 7fd3d3328700 1 -- 172.21.15.79:0/3993889551 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3ac029100 msgr2=0x7fd3ac02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:56.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.815 7fd3d3328700 1 --2- 172.21.15.79:0/3993889551 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3ac029100 0x7fd3ac02b650 crc :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:56.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.815 7fd3d3328700 1 -- 172.21.15.79:0/3993889551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3cc0bb130 msgr2=0x7fd3cc0b3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:56.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.815 7fd3d3328700 1 --2- 172.21.15.79:0/3993889551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3cc0bb130 0x7fd3cc0b3180 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7fd3cc0c0d70 tx=0x7fd3bc00f520).stop 2021-04-09T18:34:56.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.815 7fd3d3328700 1 -- 172.21.15.79:0/3993889551 shutdown_connections 2021-04-09T18:34:56.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.815 7fd3d3328700 1 --2- 172.21.15.79:0/3993889551 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd3ac029100 0x7fd3ac02b650 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:56.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.815 7fd3d3328700 1 --2- 172.21.15.79:0/3993889551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3cc0b37b0 0x7fd3cc0b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:56.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.815 7fd3d3328700 1 --2- 172.21.15.79:0/3993889551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3cc0b43d0 0x7fd3cc0b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:56.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.815 7fd3d3328700 1 --2- 172.21.15.79:0/3993889551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3cc0bb130 0x7fd3cc0b3180 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:56.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.815 7fd3d3328700 1 -- 172.21.15.79:0/3993889551 >> 172.21.15.79:0/3993889551 conn(0x7fd3cc09a080 msgr2=0x7fd3cc09a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:56.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.815 7fd3d3328700 1 -- 172.21.15.79:0/3993889551 shutdown_connections 2021-04-09T18:34:56.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.815 7fd3d3328700 1 -- 172.21.15.79:0/3993889551 wait complete. 2021-04-09T18:34:56.843 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s 2021-04-09T18:34:56.844 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-04-09T18:34:56.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.931 7fef12741700 1 Processor -- start 2021-04-09T18:34:56.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.931 7fef12741700 1 -- start start 2021-04-09T18:34:56.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.931 7fef12741700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef0c0f5550 0x7fef0c0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:56.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.931 7fef12741700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fef0c1c8040 0x7fef0c1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:56.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.931 7fef12741700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef0c0fbb50 con 0x7fef0c0e9b10 2021-04-09T18:34:56.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.931 7fef12741700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef0c0e9f60 con 0x7fef0c1c8040 2021-04-09T18:34:56.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.931 7fef12741700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c1c3df0 con 0x7fef0c0f5550 2021-04-09T18:34:56.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.931 7fef10ce6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fef0c1c8040 0x7fef0c1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:56.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.931 7fef0b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fef0c0e9b10 0x7fef0c09f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57366/0 (socket says 172.21.15.79:57366) 2021-04-09T18:34:56.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.931 7fef0b7fe700 1 -- 172.21.15.79:0/2961449018 learned_addr learned my addr 172.21.15.79:0/2961449018 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:56.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.931 7fef0bfff700 1 --2- 172.21.15.79:0/2961449018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef0c0f5550 0x7fef0c0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:56.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.931 7fef10ce6700 1 -- 172.21.15.79:0/2961449018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef0c0f5550 msgr2=0x7fef0c0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:56.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.935 7fef10ce6700 1 --2- 172.21.15.79:0/2961449018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef0c0f5550 0x7fef0c0f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:56.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.935 7fef10ce6700 1 -- 172.21.15.79:0/2961449018 >> v1:172.21.15.79:6789/0 conn(0x7fef0c0e9b10 legacy=0x7fef0c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:56.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.935 7fef10ce6700 1 -- 172.21.15.79:0/2961449018 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0c09f910 con 0x7fef0c1c8040 2021-04-09T18:34:56.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.935 7fef10ce6700 1 --2- 172.21.15.79:0/2961449018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef0c1c8040 0x7fef0c1ca4a0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7fef040032b0 tx=0x7fef0400b3c0).ready entity=mon.0 client_cookie=b406bd1a7cb9ff03 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:56.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.935 7fef0affd700 1 -- 172.21.15.79:0/2961449018 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef0c09f910 con 0x7fef0c1c8040 2021-04-09T18:34:56.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.935 7fef0affd700 1 -- 172.21.15.79:0/2961449018 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0400bc20 con 0x7fef0c1c8040 2021-04-09T18:34:56.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.935 7fef0affd700 1 -- 172.21.15.79:0/2961449018 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef04002020 con 0x7fef0c1c8040 2021-04-09T18:34:56.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.935 7fef12741700 1 -- 172.21.15.79:0/2961449018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef0c1c8040 msgr2=0x7fef0c1ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:56.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.935 7fef12741700 1 --2- 172.21.15.79:0/2961449018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef0c1c8040 0x7fef0c1ca4a0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7fef040032b0 tx=0x7fef0400b3c0).stop 2021-04-09T18:34:56.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.935 7fef12741700 1 -- 172.21.15.79:0/2961449018 shutdown_connections 2021-04-09T18:34:56.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.935 7fef12741700 1 --2- 172.21.15.79:0/2961449018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef0c1c8040 0x7fef0c1ca4a0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:56.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.935 7fef12741700 1 --2- 172.21.15.79:0/2961449018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef0c0f5550 0x7fef0c0f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:56.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.935 7fef12741700 1 -- 172.21.15.79:0/2961449018 >> 172.21.15.79:0/2961449018 conn(0x7fef0c0e6010 msgr2=0x7fef0c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:56.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.935 7fef12741700 1 -- 172.21.15.79:0/2961449018 shutdown_connections 2021-04-09T18:34:56.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.935 7fef12741700 1 -- 172.21.15.79:0/2961449018 wait complete. 2021-04-09T18:34:56.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef12741700 1 Processor -- start 2021-04-09T18:34:56.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef12741700 1 -- start start 2021-04-09T18:34:56.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef12741700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef0c09aee0 0x7fef0c0d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:56.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef12741700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef0c09a260 0x7fef0c09a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:56.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef12741700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef0c0bcd80 0x7fef0c0bd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:56.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef12741700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c088590 con 0x7fef0c09a260 2021-04-09T18:34:56.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef12741700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c09b330 con 0x7fef0c0bcd80 2021-04-09T18:34:56.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef12741700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c0d7470 con 0x7fef0c09aee0 2021-04-09T18:34:56.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef0b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef0c09a260 0x7fef0c09a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:56.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef0b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef0c09a260 0x7fef0c09a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34434/0 (socket says 172.21.15.79:34434) 2021-04-09T18:34:56.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef0bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef0c09aee0 0x7fef0c0d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:56.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef0b7fe700 1 -- 172.21.15.79:0/2455086605 learned_addr learned my addr 172.21.15.79:0/2455086605 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:56.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef10ce6700 1 --2- 172.21.15.79:0/2455086605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef0c0bcd80 0x7fef0c0bd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:56.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef0bfff700 1 -- 172.21.15.79:0/2455086605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef0c0bcd80 msgr2=0x7fef0c0bd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:56.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef0bfff700 1 --2- 172.21.15.79:0/2455086605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef0c0bcd80 0x7fef0c0bd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:56.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef0bfff700 1 -- 172.21.15.79:0/2455086605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef0c09a260 msgr2=0x7fef0c09a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:56.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef0bfff700 1 --2- 172.21.15.79:0/2455086605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef0c09a260 0x7fef0c09a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:56.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef0bfff700 1 -- 172.21.15.79:0/2455086605 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0c0b92f0 con 0x7fef0c09aee0 2021-04-09T18:34:56.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef0b7fe700 1 --2- 172.21.15.79:0/2455086605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef0c09a260 0x7fef0c09a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:56.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef0bfff700 1 --2- 172.21.15.79:0/2455086605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef0c09aee0 0x7fef0c0d10a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fef0c0bd800 tx=0x7feefc00dce0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:56.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef08ff9700 1 -- 172.21.15.79:0/2455086605 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef0c0b92f0 con 0x7fef0c09aee0 2021-04-09T18:34:56.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef08ff9700 1 -- 172.21.15.79:0/2455086605 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feefc009990 con 0x7fef0c09aee0 2021-04-09T18:34:56.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef08ff9700 1 -- 172.21.15.79:0/2455086605 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feefc00f040 con 0x7fef0c09aee0 2021-04-09T18:34:56.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef12741700 1 -- 172.21.15.79:0/2455086605 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef0c0b9610 con 0x7fef0c09aee0 2021-04-09T18:34:56.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.939 7fef12741700 1 -- 172.21.15.79:0/2455086605 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0c0b9b20 con 0x7fef0c09aee0 2021-04-09T18:34:56.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.943 7fef08ff9700 1 -- 172.21.15.79:0/2455086605 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7feefc013480 con 0x7fef0c09aee0 2021-04-09T18:34:56.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.943 7fef08ff9700 1 --2- 172.21.15.79:0/2455086605 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7feef0029100 0x7feef002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:56.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.943 7fef08ff9700 1 -- 172.21.15.79:0/2455086605 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6012+0+0 (secure 0 0 0) 0x7feefc010070 con 0x7fef0c09aee0 2021-04-09T18:34:56.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.943 7fef0b7fe700 1 --2- 172.21.15.79:0/2455086605 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7feef0029100 0x7feef002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:56.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.943 7fef0b7fe700 1 --2- 172.21.15.79:0/2455086605 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7feef0029100 0x7feef002b650 crc :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:56.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.947 7fef12741700 1 -- 172.21.15.79:0/2455086605 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef0c0e39f0 con 0x7fef0c09aee0 2021-04-09T18:34:56.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:56.955 7fef08ff9700 1 -- 172.21.15.79:0/2455086605 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7feefc009590 con 0x7fef0c09aee0 2021-04-09T18:34:57.122 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.115 7fef12741700 1 -- 172.21.15.79:0/2455086605 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7fef0c0f5b50 con 0x7fef0c09aee0 2021-04-09T18:34:57.125 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.119 7fef08ff9700 1 -- 172.21.15.79:0/2455086605 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=-22 pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. v70) v1 ==== 209+0+0 (secure 0 0 0) 0x7feefc000bf0 con 0x7fef0c09aee0 2021-04-09T18:34:57.126 INFO:teuthology.orchestra.run.smithi079.stderr:Error EINVAL: pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. 2021-04-09T18:34:57.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.123 7fef12741700 1 -- 172.21.15.79:0/2455086605 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7feef0029100 msgr2=0x7feef002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:57.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.123 7fef12741700 1 --2- 172.21.15.79:0/2455086605 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7feef0029100 0x7feef002b650 crc :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:57.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.123 7fef12741700 1 -- 172.21.15.79:0/2455086605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef0c09aee0 msgr2=0x7fef0c0d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:57.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.123 7fef12741700 1 --2- 172.21.15.79:0/2455086605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef0c09aee0 0x7fef0c0d10a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fef0c0bd800 tx=0x7feefc00dce0).stop 2021-04-09T18:34:57.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.123 7fef12741700 1 -- 172.21.15.79:0/2455086605 shutdown_connections 2021-04-09T18:34:57.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.123 7fef12741700 1 --2- 172.21.15.79:0/2455086605 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7feef0029100 0x7feef002b650 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:57.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.123 7fef12741700 1 --2- 172.21.15.79:0/2455086605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef0c0bcd80 0x7fef0c0bd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:57.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.123 7fef12741700 1 --2- 172.21.15.79:0/2455086605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef0c09aee0 0x7fef0c0d10a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:57.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.123 7fef12741700 1 --2- 172.21.15.79:0/2455086605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef0c09a260 0x7fef0c09a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:57.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.123 7fef12741700 1 -- 172.21.15.79:0/2455086605 >> 172.21.15.79:0/2455086605 conn(0x7fef0c0d84a0 msgr2=0x7fef0c0d7870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:57.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.123 7fef12741700 1 -- 172.21.15.79:0/2455086605 shutdown_connections 2021-04-09T18:34:57.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.123 7fef12741700 1 -- 172.21.15.79:0/2455086605 wait complete. 2021-04-09T18:34:57.139 DEBUG:teuthology.orchestra.run:got remote process result: 22 2021-04-09T18:34:57.141 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-04-09T18:34:57.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.235 7f64854a7700 1 Processor -- start 2021-04-09T18:34:57.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f64854a7700 1 -- start start 2021-04-09T18:34:57.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f64854a7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f64800e9b10 0x7f648009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:57.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f64854a7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64801c8040 0x7f64801ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:57.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f64854a7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64800fbb50 con 0x7f64800f5550 2021-04-09T18:34:57.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f64854a7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64801c3df0 con 0x7f64800e9b10 2021-04-09T18:34:57.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f64854a7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64800e9f60 con 0x7f64801c8040 2021-04-09T18:34:57.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f647f247700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f64800f5550 0x7f64800f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57380/0 (socket says 172.21.15.79:57380) 2021-04-09T18:34:57.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f647f247700 1 -- 172.21.15.79:0/3801362555 learned_addr learned my addr 172.21.15.79:0/3801362555 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:57.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f647ea46700 1 --2- 172.21.15.79:0/3801362555 >> v2:172.21.15.89:3300/0 conn(0x7f64800e9b10 0x7f648009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:57.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f647fa48700 1 --2- 172.21.15.79:0/3801362555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64801c8040 0x7f64801ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:57.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f647e245700 1 -- 172.21.15.79:0/3801362555 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538548007 0 0) 0x7f6470001450 con 0x7f64800f5550 2021-04-09T18:34:57.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f647e245700 1 -- 172.21.15.79:0/3801362555 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f646c003240 con 0x7f64800f5550 2021-04-09T18:34:57.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f647ea46700 1 -- 172.21.15.79:0/3801362555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64801c8040 msgr2=0x7f64801ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:57.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f647ea46700 1 --2- 172.21.15.79:0/3801362555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64801c8040 0x7f64801ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:57.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f647ea46700 1 -- 172.21.15.79:0/3801362555 >> v1:172.21.15.79:6789/0 conn(0x7f64800f5550 legacy=0x7f64800f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:57.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f647ea46700 1 -- 172.21.15.79:0/3801362555 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64800e5700 con 0x7f64800e9b10 2021-04-09T18:34:57.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f647ea46700 1 --2- 172.21.15.79:0/3801362555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64800e9b10 0x7f648009f110 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f64800f6f30 tx=0x7f646800bd70).ready entity=mon.1 client_cookie=c9a8254155ae6720 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:57.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f647e245700 1 -- 172.21.15.79:0/3801362555 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f64800e5700 con 0x7f64800e9b10 2021-04-09T18:34:57.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f647e245700 1 -- 172.21.15.79:0/3801362555 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6468009810 con 0x7f64800e9b10 2021-04-09T18:34:57.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f647e245700 1 -- 172.21.15.79:0/3801362555 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6468009be0 con 0x7f64800e9b10 2021-04-09T18:34:57.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f64854a7700 1 -- 172.21.15.79:0/3801362555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64800e9b10 msgr2=0x7f648009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f64854a7700 1 --2- 172.21.15.79:0/3801362555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64800e9b10 0x7f648009f110 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f64800f6f30 tx=0x7f646800bd70).stop 2021-04-09T18:34:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f64854a7700 1 -- 172.21.15.79:0/3801362555 shutdown_connections 2021-04-09T18:34:57.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f64854a7700 1 --2- 172.21.15.79:0/3801362555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64801c8040 0x7f64801ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:57.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f64854a7700 1 --2- 172.21.15.79:0/3801362555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64800e9b10 0x7f648009f110 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:57.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f64854a7700 1 -- 172.21.15.79:0/3801362555 >> 172.21.15.79:0/3801362555 conn(0x7f64800e6010 msgr2=0x7f64800e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:57.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f64854a7700 1 -- 172.21.15.79:0/3801362555 shutdown_connections 2021-04-09T18:34:57.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.239 7f64854a7700 1 -- 172.21.15.79:0/3801362555 wait complete. 2021-04-09T18:34:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.243 7f64854a7700 1 Processor -- start 2021-04-09T18:34:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.243 7f64854a7700 1 -- start start 2021-04-09T18:34:57.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.243 7f64854a7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64800baa00 0x7f6480090080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:57.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.243 7f64854a7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64801aaba0 0x7f64801aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:57.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.243 7f64854a7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64801ab620 0x7f64801a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:57.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.243 7f64854a7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64800e1ac0 con 0x7f64800baa00 2021-04-09T18:34:57.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.243 7f64854a7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64800b8fd0 con 0x7f64801aaba0 2021-04-09T18:34:57.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.243 7f64854a7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64800b92d0 con 0x7f64801ab620 2021-04-09T18:34:57.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.243 7f647f247700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64800baa00 0x7f6480090080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:57.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.243 7f647f247700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64800baa00 0x7f6480090080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34444/0 (socket says 172.21.15.79:34444) 2021-04-09T18:34:57.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.243 7f647f247700 1 -- 172.21.15.79:0/131478759 learned_addr learned my addr 172.21.15.79:0/131478759 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:57.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.243 7f647fa48700 1 --2- 172.21.15.79:0/131478759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64801ab620 0x7f64801a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:57.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.243 7f647ea46700 1 --2- 172.21.15.79:0/131478759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64801aaba0 0x7f64801aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:57.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.247 7f647f247700 1 -- 172.21.15.79:0/131478759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64801ab620 msgr2=0x7f64801a6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:57.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.247 7f647f247700 1 --2- 172.21.15.79:0/131478759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64801ab620 0x7f64801a6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:57.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.247 7f647f247700 1 -- 172.21.15.79:0/131478759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64801aaba0 msgr2=0x7f64801aaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:57.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.247 7f647f247700 1 --2- 172.21.15.79:0/131478759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64801aaba0 0x7f64801aaff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:57.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.247 7f647f247700 1 -- 172.21.15.79:0/131478759 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64801aba70 con 0x7f64800baa00 2021-04-09T18:34:57.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.247 7f647f247700 1 --2- 172.21.15.79:0/131478759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64800baa00 0x7f6480090080 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f64800d31d0 tx=0x7f647000cec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:57.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.247 7f6477fff700 1 -- 172.21.15.79:0/131478759 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f64801aba70 con 0x7f64800baa00 2021-04-09T18:34:57.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.247 7f6477fff700 1 -- 172.21.15.79:0/131478759 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6470005b80 con 0x7f64800baa00 2021-04-09T18:34:57.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.247 7f6477fff700 1 -- 172.21.15.79:0/131478759 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6470007110 con 0x7f64800baa00 2021-04-09T18:34:57.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.247 7f64854a7700 1 -- 172.21.15.79:0/131478759 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64800906b0 con 0x7f64800baa00 2021-04-09T18:34:57.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.247 7f64854a7700 1 -- 172.21.15.79:0/131478759 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6480092ef0 con 0x7f64800baa00 2021-04-09T18:34:57.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.247 7f6477fff700 1 -- 172.21.15.79:0/131478759 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f647001a060 con 0x7f64800baa00 2021-04-09T18:34:57.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.247 7f6477fff700 1 --2- 172.21.15.79:0/131478759 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6464029100 0x7f646402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:57.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.247 7f6477fff700 1 -- 172.21.15.79:0/131478759 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6012+0+0 (secure 0 0 0) 0x7f6470039040 con 0x7f64800baa00 2021-04-09T18:34:57.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.247 7f647ea46700 1 --2- 172.21.15.79:0/131478759 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6464029100 0x7f646402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:57.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.247 7f647ea46700 1 --2- 172.21.15.79:0/131478759 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6464029100 0x7f646402b650 crc :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:57.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.251 7f64854a7700 1 -- 172.21.15.79:0/131478759 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64800e39f0 con 0x7f64800baa00 2021-04-09T18:34:57.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.259 7f6477fff700 1 -- 172.21.15.79:0/131478759 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6470005970 con 0x7f64800baa00 2021-04-09T18:34:57.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.419 7f64854a7700 1 -- 172.21.15.79:0/131478759 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f64800a1c90 con 0x7f64800baa00 2021-04-09T18:34:57.426 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:34:57.419 7fbccdd11700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:34:57.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.427 7f6477fff700 1 -- 172.21.15.79:0/131478759 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 22 and data pool 21 v71) v1 ==== 189+0+0 (secure 0 0 0) 0x7f6480107f80 con 0x7f64800baa00 2021-04-09T18:34:57.440 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 22 and data pool 21 2021-04-09T18:34:57.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.439 7f64854a7700 1 -- 172.21.15.79:0/131478759 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6464029100 msgr2=0x7f646402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:57.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.439 7f64854a7700 1 --2- 172.21.15.79:0/131478759 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6464029100 0x7f646402b650 crc :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:57.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.439 7f64854a7700 1 -- 172.21.15.79:0/131478759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64800baa00 msgr2=0x7f6480090080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:57.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.439 7f64854a7700 1 --2- 172.21.15.79:0/131478759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64800baa00 0x7f6480090080 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f64800d31d0 tx=0x7f647000cec0).stop 2021-04-09T18:34:57.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.439 7f64854a7700 1 -- 172.21.15.79:0/131478759 shutdown_connections 2021-04-09T18:34:57.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.439 7f64854a7700 1 --2- 172.21.15.79:0/131478759 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6464029100 0x7f646402b650 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:57.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.439 7f64854a7700 1 --2- 172.21.15.79:0/131478759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64801ab620 0x7f64801a6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:57.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.439 7f64854a7700 1 --2- 172.21.15.79:0/131478759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64800baa00 0x7f6480090080 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:57.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.439 7f64854a7700 1 --2- 172.21.15.79:0/131478759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64801aaba0 0x7f64801aaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:57.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.439 7f64854a7700 1 -- 172.21.15.79:0/131478759 >> 172.21.15.79:0/131478759 conn(0x7f64800d3620 msgr2=0x7f64800d3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:57.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.439 7f64854a7700 1 -- 172.21.15.79:0/131478759 shutdown_connections 2021-04-09T18:34:57.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.439 7f64854a7700 1 -- 172.21.15.79:0/131478759 wait complete. 2021-04-09T18:34:57.455 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-04-09T18:34:57.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.547 7fc760804700 1 Processor -- start 2021-04-09T18:34:57.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.547 7fc760804700 1 -- start start 2021-04-09T18:34:57.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.547 7fc760804700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc75c0e9ae0 0x7fc75c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:57.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.547 7fc760804700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc75c1c8010 0x7fc75c1ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:57.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.547 7fc760804700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75c0fbb20 con 0x7fc75c0f5520 2021-04-09T18:34:57.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.547 7fc760804700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc75c1c3dc0 con 0x7fc75c0e9ae0 2021-04-09T18:34:57.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.547 7fc760804700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0e9f30 con 0x7fc75c1c8010 2021-04-09T18:34:57.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc75a5a4700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc75c0f5520 0x7fc75c0f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57392/0 (socket says 172.21.15.79:57392) 2021-04-09T18:34:57.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc75a5a4700 1 -- 172.21.15.79:0/1861347595 learned_addr learned my addr 172.21.15.79:0/1861347595 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:57.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc759da3700 1 --2- 172.21.15.79:0/1861347595 >> v2:172.21.15.89:3300/0 conn(0x7fc75c0e9ae0 0x7fc75c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:57.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc75ada5700 1 --2- 172.21.15.79:0/1861347595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc75c1c8010 0x7fc75c1ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:57.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc7595a2700 1 -- 172.21.15.79:0/1861347595 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3540692956 0 0) 0x7fc7440010d0 con 0x7fc75c0f5520 2021-04-09T18:34:57.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc7595a2700 1 -- 172.21.15.79:0/1861347595 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc748003240 con 0x7fc75c0f5520 2021-04-09T18:34:57.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc75ada5700 1 -- 172.21.15.79:0/1861347595 >> v2:172.21.15.89:3300/0 conn(0x7fc75c0e9ae0 msgr2=0x7fc75c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:57.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc75ada5700 1 --2- 172.21.15.79:0/1861347595 >> v2:172.21.15.89:3300/0 conn(0x7fc75c0e9ae0 0x7fc75c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:57.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc75ada5700 1 -- 172.21.15.79:0/1861347595 >> v1:172.21.15.79:6789/0 conn(0x7fc75c0f5520 legacy=0x7fc75c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:57.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc7595a2700 1 -- 172.21.15.79:0/1861347595 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1486756652 0 0) 0x7fc744001650 con 0x7fc75c0f5520 2021-04-09T18:34:57.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc75ada5700 1 -- 172.21.15.79:0/1861347595 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c0e56d0 con 0x7fc75c1c8010 2021-04-09T18:34:57.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc759da3700 1 --2- 172.21.15.79:0/1861347595 >> v2:172.21.15.89:3300/0 conn(0x7fc75c0e9ae0 0x7fc75c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:57.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc75ada5700 1 --2- 172.21.15.79:0/1861347595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc75c1c8010 0x7fc75c1ca470 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fc744001df0 tx=0x7fc75400b0e0).ready entity=mon.2 client_cookie=4086b4661541a045 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:57.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc7595a2700 1 -- 172.21.15.79:0/1861347595 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc75c0e56d0 con 0x7fc75c1c8010 2021-04-09T18:34:57.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc7595a2700 1 -- 172.21.15.79:0/1861347595 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75400b9b0 con 0x7fc75c1c8010 2021-04-09T18:34:57.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc7595a2700 1 -- 172.21.15.79:0/1861347595 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc754002020 con 0x7fc75c1c8010 2021-04-09T18:34:57.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc760804700 1 -- 172.21.15.79:0/1861347595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc75c1c8010 msgr2=0x7fc75c1ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:57.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc760804700 1 --2- 172.21.15.79:0/1861347595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc75c1c8010 0x7fc75c1ca470 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fc744001df0 tx=0x7fc75400b0e0).stop 2021-04-09T18:34:57.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc760804700 1 -- 172.21.15.79:0/1861347595 shutdown_connections 2021-04-09T18:34:57.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc760804700 1 --2- 172.21.15.79:0/1861347595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc75c1c8010 0x7fc75c1ca470 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:57.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc760804700 1 --2- 172.21.15.79:0/1861347595 >> v2:172.21.15.89:3300/0 conn(0x7fc75c0e9ae0 0x7fc75c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:57.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc760804700 1 -- 172.21.15.79:0/1861347595 >> 172.21.15.79:0/1861347595 conn(0x7fc75c0e5fe0 msgr2=0x7fc75c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:57.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc760804700 1 -- 172.21.15.79:0/1861347595 shutdown_connections 2021-04-09T18:34:57.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.551 7fc760804700 1 -- 172.21.15.79:0/1861347595 wait complete. 2021-04-09T18:34:57.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.555 7fc760804700 1 Processor -- start 2021-04-09T18:34:57.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.555 7fc760804700 1 -- start start 2021-04-09T18:34:57.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.555 7fc760804700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc75c0bfeb0 0x7fc75c19b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:57.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.555 7fc760804700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc75c1ad310 0x7fc75c098570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:57.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.555 7fc760804700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc75c098ba0 0x7fc75c19c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:57.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.555 7fc760804700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c098270 con 0x7fc75c098ba0 2021-04-09T18:34:57.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.555 7fc760804700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c19c010 con 0x7fc75c1ad310 2021-04-09T18:34:57.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.555 7fc760804700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c097e00 con 0x7fc75c0bfeb0 2021-04-09T18:34:57.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc75ada5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc75c098ba0 0x7fc75c19c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:57.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc75ada5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc75c098ba0 0x7fc75c19c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34458/0 (socket says 172.21.15.79:34458) 2021-04-09T18:34:57.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc75ada5700 1 -- 172.21.15.79:0/3609645128 learned_addr learned my addr 172.21.15.79:0/3609645128 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:57.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc759da3700 1 --2- 172.21.15.79:0/3609645128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc75c1ad310 0x7fc75c098570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:57.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc75a5a4700 1 --2- 172.21.15.79:0/3609645128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc75c0bfeb0 0x7fc75c19b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:57.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc75ada5700 1 -- 172.21.15.79:0/3609645128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc75c0bfeb0 msgr2=0x7fc75c19b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:57.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc75ada5700 1 --2- 172.21.15.79:0/3609645128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc75c0bfeb0 0x7fc75c19b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:57.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc75ada5700 1 -- 172.21.15.79:0/3609645128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc75c1ad310 msgr2=0x7fc75c098570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:57.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc75ada5700 1 --2- 172.21.15.79:0/3609645128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc75c1ad310 0x7fc75c098570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:57.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc75ada5700 1 -- 172.21.15.79:0/3609645128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c0c0300 con 0x7fc75c098ba0 2021-04-09T18:34:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc75ada5700 1 --2- 172.21.15.79:0/3609645128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc75c098ba0 0x7fc75c19c330 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7fc744001df0 tx=0x7fc754006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc752ffd700 1 -- 172.21.15.79:0/3609645128 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc75c0c0300 con 0x7fc75c098ba0 2021-04-09T18:34:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc752ffd700 1 -- 172.21.15.79:0/3609645128 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75401f020 con 0x7fc75c098ba0 2021-04-09T18:34:57.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc760804700 1 -- 172.21.15.79:0/3609645128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75c1ad760 con 0x7fc75c098ba0 2021-04-09T18:34:57.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc752ffd700 1 -- 172.21.15.79:0/3609645128 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc744001bb0 con 0x7fc75c098ba0 2021-04-09T18:34:57.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc760804700 1 -- 172.21.15.79:0/3609645128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75c1adb30 con 0x7fc75c098ba0 2021-04-09T18:34:57.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc752ffd700 1 -- 172.21.15.79:0/3609645128 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc75402a060 con 0x7fc75c098ba0 2021-04-09T18:34:57.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc752ffd700 1 --2- 172.21.15.79:0/3609645128 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc740029100 0x7fc74002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:57.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc752ffd700 1 -- 172.21.15.79:0/3609645128 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6096+0+0 (secure 0 0 0) 0x7fc754003020 con 0x7fc75c098ba0 2021-04-09T18:34:57.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc75a5a4700 1 --2- 172.21.15.79:0/3609645128 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc740029100 0x7fc74002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:57.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.559 7fc75a5a4700 1 --2- 172.21.15.79:0/3609645128 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc740029100 0x7fc74002b650 crc :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:57.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.563 7fc760804700 1 -- 172.21.15.79:0/3609645128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75c0e39e0 con 0x7fc75c098ba0 2021-04-09T18:34:57.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.571 7fc752ffd700 1 -- 172.21.15.79:0/3609645128 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc75400b9b0 con 0x7fc75c098ba0 2021-04-09T18:34:57.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:57.743 7fc760804700 1 -- 172.21.15.79:0/3609645128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc75c0f5b20 con 0x7fc75c098ba0 2021-04-09T18:34:58.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.431 7fc752ffd700 1 -- 172.21.15.79:0/3609645128 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v72) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc75c0f76c0 con 0x7fc75c098ba0 2021-04-09T18:34:58.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.463 7fc760804700 1 -- 172.21.15.79:0/3609645128 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc740029100 msgr2=0x7fc74002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:58.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.463 7fc760804700 1 --2- 172.21.15.79:0/3609645128 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc740029100 0x7fc74002b650 crc :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:58.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.463 7fc760804700 1 -- 172.21.15.79:0/3609645128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc75c098ba0 msgr2=0x7fc75c19c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:58.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.463 7fc760804700 1 --2- 172.21.15.79:0/3609645128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc75c098ba0 0x7fc75c19c330 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7fc744001df0 tx=0x7fc754006c10).stop 2021-04-09T18:34:58.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.463 7fc760804700 1 -- 172.21.15.79:0/3609645128 shutdown_connections 2021-04-09T18:34:58.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.463 7fc760804700 1 --2- 172.21.15.79:0/3609645128 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc740029100 0x7fc74002b650 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:58.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.463 7fc760804700 1 --2- 172.21.15.79:0/3609645128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc75c098ba0 0x7fc75c19c330 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:58.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.463 7fc760804700 1 --2- 172.21.15.79:0/3609645128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc75c0bfeb0 0x7fc75c19b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:58.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.463 7fc760804700 1 --2- 172.21.15.79:0/3609645128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc75c1ad310 0x7fc75c098570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:58.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.463 7fc760804700 1 -- 172.21.15.79:0/3609645128 >> 172.21.15.79:0/3609645128 conn(0x7fc75c099fb0 msgr2=0x7fc75c09a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:58.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.463 7fc760804700 1 -- 172.21.15.79:0/3609645128 shutdown_connections 2021-04-09T18:34:58.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.463 7fc760804700 1 -- 172.21.15.79:0/3609645128 wait complete. 2021-04-09T18:34:58.489 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-04-09T18:34:58.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb33b6c9700 1 Processor -- start 2021-04-09T18:34:58.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb33b6c9700 1 -- start start 2021-04-09T18:34:58.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb33b6c9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb3340e9b10 0x7fb33409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:58.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb33b6c9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3341c8040 0x7fb3341ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:58.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb33b6c9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3340fbb50 con 0x7fb3340f5550 2021-04-09T18:34:58.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb33b6c9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3341c3df0 con 0x7fb3340e9b10 2021-04-09T18:34:58.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb33b6c9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3340e9f60 con 0x7fb3341c8040 2021-04-09T18:34:58.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb339c6e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3341c8040 0x7fb3341ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:58.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb338c6c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb3340e9b10 0x7fb33409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:58.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb338c6c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb3340e9b10 0x7fb33409f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:51040/0 (socket says 172.21.15.79:51040) 2021-04-09T18:34:58.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb33946d700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb3340f5550 0x7fb3340f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:57876/0 (socket says 172.21.15.79:57876) 2021-04-09T18:34:58.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb339c6e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3341c8040 0x7fb3341ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:59696/0 (socket says 172.21.15.79:59696) 2021-04-09T18:34:58.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb338c6c700 1 -- 172.21.15.79:0/3237398758 learned_addr learned my addr 172.21.15.79:0/3237398758 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:58.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb339c6e700 1 -- 172.21.15.79:0/3237398758 >> v2:172.21.15.89:3300/0 conn(0x7fb3340e9b10 msgr2=0x7fb33409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:58.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb339c6e700 1 --2- 172.21.15.79:0/3237398758 >> v2:172.21.15.89:3300/0 conn(0x7fb3340e9b10 0x7fb33409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:58.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb339c6e700 1 -- 172.21.15.79:0/3237398758 >> v1:172.21.15.89:6789/0 conn(0x7fb3340f5550 legacy=0x7fb3340f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:58.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb339c6e700 1 -- 172.21.15.79:0/3237398758 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3340e5700 con 0x7fb3341c8040 2021-04-09T18:34:58.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb338c6c700 1 --2- 172.21.15.79:0/3237398758 >> v2:172.21.15.89:3300/0 conn(0x7fb3340e9b10 0x7fb33409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:58.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb339c6e700 1 --2- 172.21.15.79:0/3237398758 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3341c8040 0x7fb3341ca4a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fb328001340 tx=0x7fb328001040).ready entity=mon.2 client_cookie=9cefc5bf8f82d606 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:58.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb327fff700 1 -- 172.21.15.79:0/3237398758 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb3340e5700 con 0x7fb3341c8040 2021-04-09T18:34:58.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb327fff700 1 -- 172.21.15.79:0/3237398758 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32c00b920 con 0x7fb3341c8040 2021-04-09T18:34:58.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb327fff700 1 -- 172.21.15.79:0/3237398758 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb32c002020 con 0x7fb3341c8040 2021-04-09T18:34:58.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb33b6c9700 1 -- 172.21.15.79:0/3237398758 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3341c8040 msgr2=0x7fb3341ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:58.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.591 7fb33b6c9700 1 --2- 172.21.15.79:0/3237398758 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3341c8040 0x7fb3341ca4a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fb328001340 tx=0x7fb328001040).stop 2021-04-09T18:34:58.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.595 7fb33b6c9700 1 -- 172.21.15.79:0/3237398758 shutdown_connections 2021-04-09T18:34:58.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.595 7fb33b6c9700 1 --2- 172.21.15.79:0/3237398758 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3341c8040 0x7fb3341ca4a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:58.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.595 7fb33b6c9700 1 --2- 172.21.15.79:0/3237398758 >> v2:172.21.15.89:3300/0 conn(0x7fb3340e9b10 0x7fb33409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:58.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.595 7fb33b6c9700 1 -- 172.21.15.79:0/3237398758 >> 172.21.15.79:0/3237398758 conn(0x7fb3340e6010 msgr2=0x7fb3340e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:58.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.595 7fb33b6c9700 1 -- 172.21.15.79:0/3237398758 shutdown_connections 2021-04-09T18:34:58.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.595 7fb33b6c9700 1 -- 172.21.15.79:0/3237398758 wait complete. 2021-04-09T18:34:58.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.595 7fb33b6c9700 1 Processor -- start 2021-04-09T18:34:58.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.595 7fb33b6c9700 1 -- start start 2021-04-09T18:34:58.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.595 7fb33b6c9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3340aa0f0 0x7fb3341aa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:58.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.595 7fb33b6c9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3340aa540 0x7fb3341aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:58.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.595 7fb33b6c9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3341a6450 0x7fb3341a68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:58.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.595 7fb33b6c9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3340ab620 con 0x7fb3340aa540 2021-04-09T18:34:58.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.595 7fb33b6c9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3340acd90 con 0x7fb3341a6450 2021-04-09T18:34:58.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.595 7fb33b6c9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3340ab1b0 con 0x7fb3340aa0f0 2021-04-09T18:34:58.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.595 7fb338c6c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3340aa540 0x7fb3341aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:58.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.595 7fb338c6c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3340aa540 0x7fb3341aadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34470/0 (socket says 172.21.15.79:34470) 2021-04-09T18:34:58.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.595 7fb338c6c700 1 -- 172.21.15.79:0/2889599110 learned_addr learned my addr 172.21.15.79:0/2889599110 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:58.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.595 7fb33946d700 1 --2- 172.21.15.79:0/2889599110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3340aa0f0 0x7fb3341aa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:58.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.595 7fb339c6e700 1 --2- 172.21.15.79:0/2889599110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3341a6450 0x7fb3341a68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:58.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.599 7fb338c6c700 1 -- 172.21.15.79:0/2889599110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3340aa0f0 msgr2=0x7fb3341aa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:58.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.599 7fb338c6c700 1 --2- 172.21.15.79:0/2889599110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3340aa0f0 0x7fb3341aa7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:58.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.599 7fb338c6c700 1 -- 172.21.15.79:0/2889599110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3341a6450 msgr2=0x7fb3341a68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:58.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.599 7fb338c6c700 1 --2- 172.21.15.79:0/2889599110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3341a6450 0x7fb3341a68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:58.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.599 7fb338c6c700 1 -- 172.21.15.79:0/2889599110 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3341ab420 con 0x7fb3340aa540 2021-04-09T18:34:58.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.599 7fb338c6c700 1 --2- 172.21.15.79:0/2889599110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3340aa540 0x7fb3341aadf0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7fb3340ab8a0 tx=0x7fb33000c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:58.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.599 7fb325ffb700 1 -- 172.21.15.79:0/2889599110 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb3341ab420 con 0x7fb3340aa540 2021-04-09T18:34:58.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.599 7fb325ffb700 1 -- 172.21.15.79:0/2889599110 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33000cbd0 con 0x7fb3340aa540 2021-04-09T18:34:58.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.599 7fb33b6c9700 1 -- 172.21.15.79:0/2889599110 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3341a6ed0 con 0x7fb3340aa540 2021-04-09T18:34:58.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.599 7fb325ffb700 1 -- 172.21.15.79:0/2889599110 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb33000f040 con 0x7fb3340aa540 2021-04-09T18:34:58.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.599 7fb33b6c9700 1 -- 172.21.15.79:0/2889599110 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3341a7220 con 0x7fb3340aa540 2021-04-09T18:34:58.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.599 7fb325ffb700 1 -- 172.21.15.79:0/2889599110 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb330011070 con 0x7fb3340aa540 2021-04-09T18:34:58.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.599 7fb325ffb700 1 --2- 172.21.15.79:0/2889599110 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb314029100 0x7fb31402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:58.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.599 7fb325ffb700 1 -- 172.21.15.79:0/2889599110 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6096+0+0 (secure 0 0 0) 0x7fb330010040 con 0x7fb3340aa540 2021-04-09T18:34:58.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.599 7fb33946d700 1 --2- 172.21.15.79:0/2889599110 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb314029100 0x7fb31402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:58.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.603 7fb33946d700 1 --2- 172.21.15.79:0/2889599110 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb314029100 0x7fb31402b650 crc :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:58.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.603 7fb33b6c9700 1 -- 172.21.15.79:0/2889599110 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3340e39f0 con 0x7fb3340aa540 2021-04-09T18:34:58.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.611 7fb325ffb700 1 -- 172.21.15.79:0/2889599110 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb33000c9c0 con 0x7fb3340aa540 2021-04-09T18:34:58.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:58.771 7fb33b6c9700 1 -- 172.21.15.79:0/2889599110 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb3340f5b50 con 0x7fb3340aa540 2021-04-09T18:34:59.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.435 7fb325ffb700 1 -- 172.21.15.79:0/2889599110 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v116) v1 ==== 185+0+0 (secure 0 0 0) 0x7fb330000bf0 con 0x7fb3340aa540 2021-04-09T18:34:59.443 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2021-04-09T18:34:59.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.443 7fb33b6c9700 1 -- 172.21.15.79:0/2889599110 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb314029100 msgr2=0x7fb31402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:59.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.443 7fb33b6c9700 1 --2- 172.21.15.79:0/2889599110 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb314029100 0x7fb31402b650 crc :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:59.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.443 7fb33b6c9700 1 -- 172.21.15.79:0/2889599110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3340aa540 msgr2=0x7fb3341aadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:59.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.443 7fb33b6c9700 1 --2- 172.21.15.79:0/2889599110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3340aa540 0x7fb3341aadf0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7fb3340ab8a0 tx=0x7fb33000c430).stop 2021-04-09T18:34:59.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.443 7fb33b6c9700 1 -- 172.21.15.79:0/2889599110 shutdown_connections 2021-04-09T18:34:59.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.443 7fb33b6c9700 1 --2- 172.21.15.79:0/2889599110 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb314029100 0x7fb31402b650 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:59.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.443 7fb33b6c9700 1 --2- 172.21.15.79:0/2889599110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3341a6450 0x7fb3341a68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:59.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.443 7fb33b6c9700 1 --2- 172.21.15.79:0/2889599110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3340aa0f0 0x7fb3341aa7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:59.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.443 7fb33b6c9700 1 --2- 172.21.15.79:0/2889599110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3340aa540 0x7fb3341aadf0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:59.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.443 7fb33b6c9700 1 -- 172.21.15.79:0/2889599110 >> 172.21.15.79:0/2889599110 conn(0x7fb3340baad0 msgr2=0x7fb3340ab930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:59.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.443 7fb33b6c9700 1 -- 172.21.15.79:0/2889599110 shutdown_connections 2021-04-09T18:34:59.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.443 7fb33b6c9700 1 -- 172.21.15.79:0/2889599110 wait complete. 2021-04-09T18:34:59.460 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-04-09T18:34:59.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.559 7fd2564f5700 1 Processor -- start 2021-04-09T18:34:59.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.559 7fd2564f5700 1 -- start start 2021-04-09T18:34:59.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.559 7fd2564f5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2500f5550 0x7fd2500f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:59.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.559 7fd2564f5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd2501c8040 0x7fd2501ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:59.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.559 7fd2564f5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2500fbb50 con 0x7fd2500e9b10 2021-04-09T18:34:59.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.559 7fd2564f5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2500e9f60 con 0x7fd2501c8040 2021-04-09T18:34:59.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.559 7fd2564f5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2501c3df0 con 0x7fd2500f5550 2021-04-09T18:34:59.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.559 7fd24f7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd2500e9b10 0x7fd25009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57420/0 (socket says 172.21.15.79:57420) 2021-04-09T18:34:59.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.559 7fd24f7fe700 1 -- 172.21.15.79:0/3660581506 learned_addr learned my addr 172.21.15.79:0/3660581506 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:34:59.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.559 7fd254a9a700 1 --2- 172.21.15.79:0/3660581506 >> v2:172.21.15.89:3300/0 conn(0x7fd2501c8040 0x7fd2501ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:59.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.559 7fd24ffff700 1 --2- 172.21.15.79:0/3660581506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2500f5550 0x7fd2500f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:59.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.559 7fd24effd700 1 -- 172.21.15.79:0/3660581506 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293845568 0 0) 0x7fd2380010d0 con 0x7fd2500e9b10 2021-04-09T18:34:59.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.559 7fd24effd700 1 -- 172.21.15.79:0/3660581506 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd23c003240 con 0x7fd2500e9b10 2021-04-09T18:34:59.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.559 7fd24ffff700 1 -- 172.21.15.79:0/3660581506 >> v2:172.21.15.89:3300/0 conn(0x7fd2501c8040 msgr2=0x7fd2501ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:34:59.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.559 7fd24ffff700 1 --2- 172.21.15.79:0/3660581506 >> v2:172.21.15.89:3300/0 conn(0x7fd2501c8040 0x7fd2501ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:59.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.559 7fd24ffff700 1 -- 172.21.15.79:0/3660581506 >> v1:172.21.15.79:6789/0 conn(0x7fd2500e9b10 legacy=0x7fd25009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:59.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.559 7fd24ffff700 1 -- 172.21.15.79:0/3660581506 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25009f910 con 0x7fd2500f5550 2021-04-09T18:34:59.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.563 7fd24ffff700 1 --2- 172.21.15.79:0/3660581506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2500f5550 0x7fd2500f64e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fd240002f30 tx=0x7fd24000bcc0).ready entity=mon.2 client_cookie=95adb13b25e9962 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:59.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.563 7fd24effd700 1 -- 172.21.15.79:0/3660581506 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd25009f910 con 0x7fd2500f5550 2021-04-09T18:34:59.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.563 7fd24effd700 1 -- 172.21.15.79:0/3660581506 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd240009800 con 0x7fd2500f5550 2021-04-09T18:34:59.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.563 7fd24effd700 1 -- 172.21.15.79:0/3660581506 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd240009bd0 con 0x7fd2500f5550 2021-04-09T18:34:59.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.563 7fd2564f5700 1 -- 172.21.15.79:0/3660581506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2500f5550 msgr2=0x7fd2500f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:59.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.563 7fd2564f5700 1 --2- 172.21.15.79:0/3660581506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2500f5550 0x7fd2500f64e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fd240002f30 tx=0x7fd24000bcc0).stop 2021-04-09T18:34:59.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.563 7fd2564f5700 1 -- 172.21.15.79:0/3660581506 shutdown_connections 2021-04-09T18:34:59.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.563 7fd2564f5700 1 --2- 172.21.15.79:0/3660581506 >> v2:172.21.15.89:3300/0 conn(0x7fd2501c8040 0x7fd2501ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:59.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.563 7fd2564f5700 1 --2- 172.21.15.79:0/3660581506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2500f5550 0x7fd2500f64e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:59.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.563 7fd2564f5700 1 -- 172.21.15.79:0/3660581506 >> 172.21.15.79:0/3660581506 conn(0x7fd2500e6010 msgr2=0x7fd2500e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:34:59.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.563 7fd2564f5700 1 -- 172.21.15.79:0/3660581506 shutdown_connections 2021-04-09T18:34:59.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.563 7fd2564f5700 1 -- 172.21.15.79:0/3660581506 wait complete. 2021-04-09T18:34:59.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd2564f5700 1 Processor -- start 2021-04-09T18:34:59.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd2564f5700 1 -- start start 2021-04-09T18:34:59.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd2564f5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2500cf8b0 0x7fd2500cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:59.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd2564f5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2501a73f0 0x7fd2501a7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:59.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd2564f5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2500d6760 0x7fd2500d6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:59.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd2564f5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25009ace0 con 0x7fd2500d6760 2021-04-09T18:34:59.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd2564f5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2501a7e70 con 0x7fd2500cf8b0 2021-04-09T18:34:59.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd2564f5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2501a50b0 con 0x7fd2501a73f0 2021-04-09T18:34:59.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd254a9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2500d6760 0x7fd2500d6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd254a9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2500d6760 0x7fd2500d6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34486/0 (socket says 172.21.15.79:34486) 2021-04-09T18:34:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd254a9a700 1 -- 172.21.15.79:0/1890840251 learned_addr learned my addr 172.21.15.79:0/1890840251 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:34:59.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd24ffff700 1 --2- 172.21.15.79:0/1890840251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2500cf8b0 0x7fd2500cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:59.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd24f7fe700 1 --2- 172.21.15.79:0/1890840251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2501a73f0 0x7fd2501a7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:59.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd254a9a700 1 -- 172.21.15.79:0/1890840251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2501a73f0 msgr2=0x7fd2501a7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:59.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd254a9a700 1 --2- 172.21.15.79:0/1890840251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2501a73f0 0x7fd2501a7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:59.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd254a9a700 1 -- 172.21.15.79:0/1890840251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2500cf8b0 msgr2=0x7fd2500cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:34:59.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd254a9a700 1 --2- 172.21.15.79:0/1890840251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2500cf8b0 0x7fd2500cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:34:59.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd254a9a700 1 -- 172.21.15.79:0/1890840251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25009afe0 con 0x7fd2500d6760 2021-04-09T18:34:59.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd24ffff700 1 --2- 172.21.15.79:0/1890840251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2500cf8b0 0x7fd2500cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:34:59.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd254a9a700 1 --2- 172.21.15.79:0/1890840251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2500d6760 0x7fd2500d6bb0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7fd24800c000 tx=0x7fd24800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:59.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd24cff9700 1 -- 172.21.15.79:0/1890840251 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd25009afe0 con 0x7fd2500d6760 2021-04-09T18:34:59.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd24cff9700 1 -- 172.21.15.79:0/1890840251 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24800cb70 con 0x7fd2500d6760 2021-04-09T18:34:59.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd24cff9700 1 -- 172.21.15.79:0/1890840251 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd24800f040 con 0x7fd2500d6760 2021-04-09T18:34:59.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd2564f5700 1 -- 172.21.15.79:0/1890840251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2500d71e0 con 0x7fd2500d6760 2021-04-09T18:34:59.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.567 7fd2564f5700 1 -- 172.21.15.79:0/1890840251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd250094640 con 0x7fd2500d6760 2021-04-09T18:34:59.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.571 7fd24cff9700 1 -- 172.21.15.79:0/1890840251 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd248022060 con 0x7fd2500d6760 2021-04-09T18:34:59.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.571 7fd24cff9700 1 --2- 172.21.15.79:0/1890840251 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd234029100 0x7fd23402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:34:59.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.571 7fd24cff9700 1 -- 172.21.15.79:0/1890840251 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5658+0+0 (secure 0 0 0) 0x7fd248010040 con 0x7fd2500d6760 2021-04-09T18:34:59.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.571 7fd24ffff700 1 --2- 172.21.15.79:0/1890840251 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd234029100 0x7fd23402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:34:59.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.571 7fd24ffff700 1 --2- 172.21.15.79:0/1890840251 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd234029100 0x7fd23402b650 crc :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:34:59.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.575 7fd2564f5700 1 -- 172.21.15.79:0/1890840251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2500e39f0 con 0x7fd2500d6760 2021-04-09T18:34:59.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.579 7fd24cff9700 1 -- 172.21.15.79:0/1890840251 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd2500f76f0 con 0x7fd2500d6760 2021-04-09T18:34:59.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:34:59.735 7fd2564f5700 1 -- 172.21.15.79:0/1890840251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7fd2500f5b50 con 0x7fd2500d6760 2021-04-09T18:35:00.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.451 7fd24cff9700 1 -- 172.21.15.79:0/1890840251 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v117) v1 ==== 133+0+0 (secure 0 0 0) 0x7fd24800c960 con 0x7fd2500d6760 2021-04-09T18:35:00.457 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2021-04-09T18:35:00.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.455 7fd2564f5700 1 -- 172.21.15.79:0/1890840251 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd234029100 msgr2=0x7fd23402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:00.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.455 7fd2564f5700 1 --2- 172.21.15.79:0/1890840251 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd234029100 0x7fd23402b650 crc :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:00.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.455 7fd2564f5700 1 -- 172.21.15.79:0/1890840251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2500d6760 msgr2=0x7fd2500d6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:00.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.455 7fd2564f5700 1 --2- 172.21.15.79:0/1890840251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2500d6760 0x7fd2500d6bb0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7fd24800c000 tx=0x7fd24800c430).stop 2021-04-09T18:35:00.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.455 7fd2564f5700 1 -- 172.21.15.79:0/1890840251 shutdown_connections 2021-04-09T18:35:00.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.455 7fd2564f5700 1 --2- 172.21.15.79:0/1890840251 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd234029100 0x7fd23402b650 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:00.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.455 7fd2564f5700 1 --2- 172.21.15.79:0/1890840251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2500cf8b0 0x7fd2500cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:00.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.455 7fd2564f5700 1 --2- 172.21.15.79:0/1890840251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2500d6760 0x7fd2500d6bb0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:00.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.455 7fd2564f5700 1 --2- 172.21.15.79:0/1890840251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2501a73f0 0x7fd2501a7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:00.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.455 7fd2564f5700 1 -- 172.21.15.79:0/1890840251 >> 172.21.15.79:0/1890840251 conn(0x7fd250093d50 msgr2=0x7fd2500d87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:00.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.455 7fd2564f5700 1 -- 172.21.15.79:0/1890840251 shutdown_connections 2021-04-09T18:35:00.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.459 7fd2564f5700 1 -- 172.21.15.79:0/1890840251 wait complete. 2021-04-09T18:35:00.473 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-04-09T18:35:00.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.567 7f27a211d700 1 Processor -- start 2021-04-09T18:35:00.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.567 7f27a211d700 1 -- start start 2021-04-09T18:35:00.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.567 7f27a211d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f279c0e9b10 0x7f279c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:00.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.567 7f27a211d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f279c1c8040 0x7f279c1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:00.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.567 7f27a211d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f279c0fbb50 con 0x7f279c0f5550 2021-04-09T18:35:00.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.567 7f27a211d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f279c1c3df0 con 0x7f279c0e9b10 2021-04-09T18:35:00.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.567 7f27a211d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0e9f60 con 0x7f279c1c8040 2021-04-09T18:35:00.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.567 7f279affd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f279c0e9b10 0x7f279c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:00.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.567 7f279affd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f279c0e9b10 0x7f279c09f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34494/0 (socket says 172.21.15.79:34494) 2021-04-09T18:35:00.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.567 7f279affd700 1 -- 172.21.15.79:0/1400252412 learned_addr learned my addr 172.21.15.79:0/1400252412 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:00.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.567 7f279bfff700 1 --2- 172.21.15.79:0/1400252412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f279c1c8040 0x7f279c1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:00.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.567 7f279affd700 1 -- 172.21.15.79:0/1400252412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f279c1c8040 msgr2=0x7f279c1ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.567 7f279affd700 1 --2- 172.21.15.79:0/1400252412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f279c1c8040 0x7f279c1ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.567 7f279affd700 1 -- 172.21.15.79:0/1400252412 >> v1:172.21.15.89:6789/0 conn(0x7f279c0f5550 legacy=0x7f279c0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.567 7f279affd700 1 -- 172.21.15.79:0/1400252412 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c0e5700 con 0x7f279c0e9b10 2021-04-09T18:35:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.567 7f279bfff700 1 --2- 172.21.15.79:0/1400252412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f279c1c8040 0x7f279c1ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.567 7f279affd700 1 --2- 172.21.15.79:0/1400252412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f279c0e9b10 0x7f279c09f110 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f279c0f6f30 tx=0x7f278400bdd0).ready entity=mon.0 client_cookie=3b0aa58783ccc85 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.567 7f279a7fc700 1 -- 172.21.15.79:0/1400252412 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f279c0e5700 con 0x7f279c0e9b10 2021-04-09T18:35:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.571 7f279a7fc700 1 -- 172.21.15.79:0/1400252412 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2784009990 con 0x7f279c0e9b10 2021-04-09T18:35:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.571 7f27a211d700 1 -- 172.21.15.79:0/1400252412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f279c0e9b10 msgr2=0x7f279c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.571 7f279a7fc700 1 -- 172.21.15.79:0/1400252412 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2784009d60 con 0x7f279c0e9b10 2021-04-09T18:35:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.571 7f27a211d700 1 --2- 172.21.15.79:0/1400252412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f279c0e9b10 0x7f279c09f110 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f279c0f6f30 tx=0x7f278400bdd0).stop 2021-04-09T18:35:00.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.571 7f27a211d700 1 -- 172.21.15.79:0/1400252412 shutdown_connections 2021-04-09T18:35:00.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.571 7f27a211d700 1 --2- 172.21.15.79:0/1400252412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f279c1c8040 0x7f279c1ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:00.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.571 7f27a211d700 1 --2- 172.21.15.79:0/1400252412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f279c0e9b10 0x7f279c09f110 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:00.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.571 7f27a211d700 1 -- 172.21.15.79:0/1400252412 >> 172.21.15.79:0/1400252412 conn(0x7f279c0e6010 msgr2=0x7f279c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:00.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.571 7f27a211d700 1 -- 172.21.15.79:0/1400252412 shutdown_connections 2021-04-09T18:35:00.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.571 7f27a211d700 1 -- 172.21.15.79:0/1400252412 wait complete. 2021-04-09T18:35:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.571 7f27a211d700 1 Processor -- start 2021-04-09T18:35:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.571 7f27a211d700 1 -- start start 2021-04-09T18:35:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f27a211d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f279c096060 0x7f279c0d0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f27a211d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f279c0964b0 0x7f279c1a5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f27a211d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f279c0d0a50 0x7f279c1a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f27a211d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0e5700 con 0x7f279c096060 2021-04-09T18:35:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f27a211d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0d7100 con 0x7f279c0964b0 2021-04-09T18:35:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f27a211d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0d7400 con 0x7f279c0d0a50 2021-04-09T18:35:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f279b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f279c096060 0x7f279c0d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f279b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f279c096060 0x7f279c0d0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34498/0 (socket says 172.21.15.79:34498) 2021-04-09T18:35:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f279b7fe700 1 -- 172.21.15.79:0/741220953 learned_addr learned my addr 172.21.15.79:0/741220953 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f279bfff700 1 --2- 172.21.15.79:0/741220953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f279c0d0a50 0x7f279c1a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f279affd700 1 --2- 172.21.15.79:0/741220953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f279c0964b0 0x7f279c1a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f279b7fe700 1 -- 172.21.15.79:0/741220953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f279c0d0a50 msgr2=0x7f279c1a5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f279b7fe700 1 --2- 172.21.15.79:0/741220953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f279c0d0a50 0x7f279c1a5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f279b7fe700 1 -- 172.21.15.79:0/741220953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f279c0964b0 msgr2=0x7f279c1a5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f279b7fe700 1 --2- 172.21.15.79:0/741220953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f279c0964b0 0x7f279c1a5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f279b7fe700 1 -- 172.21.15.79:0/741220953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c0969a0 con 0x7f279c096060 2021-04-09T18:35:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f279affd700 1 --2- 172.21.15.79:0/741220953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f279c0964b0 0x7f279c1a5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f279b7fe700 1 --2- 172.21.15.79:0/741220953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f279c096060 0x7f279c0d0420 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f278c000b80 tx=0x7f278c00ca80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f2793fff700 1 -- 172.21.15.79:0/741220953 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f279c0969a0 con 0x7f279c096060 2021-04-09T18:35:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f2793fff700 1 -- 172.21.15.79:0/741220953 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278c00e4a0 con 0x7f279c096060 2021-04-09T18:35:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f2793fff700 1 -- 172.21.15.79:0/741220953 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f278c00e870 con 0x7f279c096060 2021-04-09T18:35:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f27a211d700 1 -- 172.21.15.79:0/741220953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279c1a5fa0 con 0x7f279c096060 2021-04-09T18:35:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f27a211d700 1 -- 172.21.15.79:0/741220953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279c1a8930 con 0x7f279c096060 2021-04-09T18:35:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f2793fff700 1 -- 172.21.15.79:0/741220953 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f278c00ea70 con 0x7f279c096060 2021-04-09T18:35:00.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f2793fff700 1 --2- 172.21.15.79:0/741220953 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2780029100 0x7f278002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:00.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.575 7f2793fff700 1 -- 172.21.15.79:0/741220953 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6012+0+0 (secure 0 0 0) 0x7f278c038cb0 con 0x7f279c096060 2021-04-09T18:35:00.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.579 7f279affd700 1 --2- 172.21.15.79:0/741220953 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2780029100 0x7f278002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:00.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.579 7f279affd700 1 --2- 172.21.15.79:0/741220953 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2780029100 0x7f278002b650 crc :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:00.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.583 7f27a211d700 1 -- 172.21.15.79:0/741220953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279c0e39f0 con 0x7f279c096060 2021-04-09T18:35:00.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.591 7f2793fff700 1 -- 172.21.15.79:0/741220953 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f278c000bf0 con 0x7f279c096060 2021-04-09T18:35:00.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.755 7f27a211d700 1 -- 172.21.15.79:0/741220953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f279c0a1c90 con 0x7f279c096060 2021-04-09T18:35:00.764 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:35:00.759 7fbccdd11700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:35:00.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.767 7f2793fff700 1 -- 172.21.15.79:0/741220953 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 23 and data pool 21 v73) v1 ==== 174+0+0 (secure 0 0 0) 0x7f278c00e290 con 0x7f279c096060 2021-04-09T18:35:00.778 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 23 and data pool 21 2021-04-09T18:35:00.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.775 7f27a211d700 1 -- 172.21.15.79:0/741220953 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2780029100 msgr2=0x7f278002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:00.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.775 7f27a211d700 1 --2- 172.21.15.79:0/741220953 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2780029100 0x7f278002b650 crc :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:00.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.775 7f27a211d700 1 -- 172.21.15.79:0/741220953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f279c096060 msgr2=0x7f279c0d0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:00.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.775 7f27a211d700 1 --2- 172.21.15.79:0/741220953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f279c096060 0x7f279c0d0420 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f278c000b80 tx=0x7f278c00ca80).stop 2021-04-09T18:35:00.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.775 7f27a211d700 1 -- 172.21.15.79:0/741220953 shutdown_connections 2021-04-09T18:35:00.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.775 7f27a211d700 1 --2- 172.21.15.79:0/741220953 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2780029100 0x7f278002b650 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:00.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.775 7f27a211d700 1 --2- 172.21.15.79:0/741220953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f279c0d0a50 0x7f279c1a5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:00.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.775 7f27a211d700 1 --2- 172.21.15.79:0/741220953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f279c096060 0x7f279c0d0420 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:00.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.775 7f27a211d700 1 --2- 172.21.15.79:0/741220953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f279c0964b0 0x7f279c1a5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:00.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.775 7f27a211d700 1 -- 172.21.15.79:0/741220953 >> 172.21.15.79:0/741220953 conn(0x7f279c0952d0 msgr2=0x7f279c0948c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:00.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.775 7f27a211d700 1 -- 172.21.15.79:0/741220953 shutdown_connections 2021-04-09T18:35:00.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:00.775 7f27a211d700 1 -- 172.21.15.79:0/741220953 wait complete. 2021-04-09T18:35:00.792 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:35:00.793 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:00.805 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:00.820 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:00.839 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:00.858 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:00.878 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:35:00.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:00.880 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:00.881 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:00.891 INFO:teuthology.orchestra.run.smithi090.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-04-09T18:35:00.892 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:35:00.893 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-04-09T18:35:00.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:35:00.894 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:00.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:00.940 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:00.941 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:00.948 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-04-09T18:35:00.949 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:35:00.950 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-04-09T18:35:00.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:35:00.951 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:00.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:00.997 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:00.998 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:35:01.005 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:35:01.006 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:35:01.007 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:35:01.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:35:01.008 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:35:01.057 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:35:01.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.151 7f19c7f5f700 1 Processor -- start 2021-04-09T18:35:01.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.151 7f19c7f5f700 1 -- start start 2021-04-09T18:35:01.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.151 7f19c7f5f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c00f5510 0x7f19c00f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:01.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.151 7f19c7f5f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f19c01c8000 0x7f19c01ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:01.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.151 7f19c7f5f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c00fbb10 con 0x7f19c00e9ad0 2021-04-09T18:35:01.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.151 7f19c7f5f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c00e9f20 con 0x7f19c01c8000 2021-04-09T18:35:01.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.151 7f19c7f5f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c01c3db0 con 0x7f19c00f5510 2021-04-09T18:35:01.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.151 7f19c6504700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f19c01c8000 0x7f19c01ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:01.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.151 7f19c6504700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f19c01c8000 0x7f19c01ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:51078/0 (socket says 172.21.15.79:51078) 2021-04-09T18:35:01.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.151 7f19c6504700 1 -- 172.21.15.79:0/384576987 learned_addr learned my addr 172.21.15.79:0/384576987 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:01.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.151 7f19c5d03700 1 --2- 172.21.15.79:0/384576987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c00f5510 0x7f19c00f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:01.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.151 7f19c6504700 1 -- 172.21.15.79:0/384576987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c00f5510 msgr2=0x7f19c00f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:01.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.151 7f19c6504700 1 --2- 172.21.15.79:0/384576987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c00f5510 0x7f19c00f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:01.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.151 7f19c6504700 1 -- 172.21.15.79:0/384576987 >> v1:172.21.15.89:6789/0 conn(0x7f19c00e9ad0 legacy=0x7f19c009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:01.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.151 7f19c4d01700 1 -- 172.21.15.79:0/384576987 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766405856 0 0) 0x7f19b00010d0 con 0x7f19c00e9ad0 2021-04-09T18:35:01.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.151 7f19c6504700 1 -- 172.21.15.79:0/384576987 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c009f900 con 0x7f19c01c8000 2021-04-09T18:35:01.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.155 7f19c6504700 1 --2- 172.21.15.79:0/384576987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19c01c8000 0x7f19c01ca460 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f19b80032b0 tx=0x7f19b800b3c0).ready entity=mon.1 client_cookie=ea144ba58c975095 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:01.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.155 7f19c4d01700 1 -- 172.21.15.79:0/384576987 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f19c009f900 con 0x7f19c01c8000 2021-04-09T18:35:01.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.155 7f19c4d01700 1 -- 172.21.15.79:0/384576987 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b800bc20 con 0x7f19c01c8000 2021-04-09T18:35:01.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.155 7f19c4d01700 1 -- 172.21.15.79:0/384576987 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f19b8002020 con 0x7f19c01c8000 2021-04-09T18:35:01.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.155 7f19c7f5f700 1 -- 172.21.15.79:0/384576987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19c01c8000 msgr2=0x7f19c01ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:01.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.155 7f19c7f5f700 1 --2- 172.21.15.79:0/384576987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19c01c8000 0x7f19c01ca460 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f19b80032b0 tx=0x7f19b800b3c0).stop 2021-04-09T18:35:01.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.155 7f19c7f5f700 1 -- 172.21.15.79:0/384576987 shutdown_connections 2021-04-09T18:35:01.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.155 7f19c7f5f700 1 --2- 172.21.15.79:0/384576987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19c01c8000 0x7f19c01ca460 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:01.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.155 7f19c7f5f700 1 --2- 172.21.15.79:0/384576987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c00f5510 0x7f19c00f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:01.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.155 7f19c7f5f700 1 -- 172.21.15.79:0/384576987 >> 172.21.15.79:0/384576987 conn(0x7f19c00e5fd0 msgr2=0x7f19c00e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:01.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.155 7f19c7f5f700 1 -- 172.21.15.79:0/384576987 shutdown_connections 2021-04-09T18:35:01.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.155 7f19c7f5f700 1 -- 172.21.15.79:0/384576987 wait complete. 2021-04-09T18:35:01.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.159 7f19c7f5f700 1 Processor -- start 2021-04-09T18:35:01.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.159 7f19c7f5f700 1 -- start start 2021-04-09T18:35:01.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.159 7f19c7f5f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c009a6b0 0x7f19c00cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:01.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.159 7f19c7f5f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19c00acee0 0x7f19c008f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:01.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.159 7f19c7f5f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19c00ad330 0x7f19c008fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:01.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.159 7f19c7f5f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c009ae20 con 0x7f19c00acee0 2021-04-09T18:35:01.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.159 7f19c7f5f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c009ab00 con 0x7f19c00ad330 2021-04-09T18:35:01.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.159 7f19c7f5f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c009b120 con 0x7f19c009a6b0 2021-04-09T18:35:01.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.159 7f19c5502700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19c00acee0 0x7f19c008f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:01.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.159 7f19c5502700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19c00acee0 0x7f19c008f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34512/0 (socket says 172.21.15.79:34512) 2021-04-09T18:35:01.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.159 7f19c5502700 1 -- 172.21.15.79:0/2169627705 learned_addr learned my addr 172.21.15.79:0/2169627705 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:01.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.159 7f19c5d03700 1 --2- 172.21.15.79:0/2169627705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c009a6b0 0x7f19c00cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:01.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.159 7f19c6504700 1 --2- 172.21.15.79:0/2169627705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19c00ad330 0x7f19c008fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:01.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.159 7f19c5502700 1 -- 172.21.15.79:0/2169627705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c009a6b0 msgr2=0x7f19c00cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:01.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.159 7f19c5502700 1 --2- 172.21.15.79:0/2169627705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c009a6b0 0x7f19c00cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:01.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.159 7f19c5502700 1 -- 172.21.15.79:0/2169627705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19c00ad330 msgr2=0x7f19c008fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:01.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.159 7f19c5502700 1 --2- 172.21.15.79:0/2169627705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19c00ad330 0x7f19c008fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:01.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.159 7f19c5502700 1 -- 172.21.15.79:0/2169627705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c0090450 con 0x7f19c00acee0 2021-04-09T18:35:01.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.159 7f19c6504700 1 --2- 172.21.15.79:0/2169627705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19c00ad330 0x7f19c008fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:01.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.163 7f19c5502700 1 --2- 172.21.15.79:0/2169627705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19c00acee0 0x7f19c008f7f0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f19c0093ec0 tx=0x7f19b000cad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:01.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.163 7f19b67fc700 1 -- 172.21.15.79:0/2169627705 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f19c0090450 con 0x7f19c00acee0 2021-04-09T18:35:01.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.163 7f19b67fc700 1 -- 172.21.15.79:0/2169627705 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b0010510 con 0x7f19c00acee0 2021-04-09T18:35:01.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.163 7f19c7f5f700 1 -- 172.21.15.79:0/2169627705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c00d0120 con 0x7f19c00acee0 2021-04-09T18:35:01.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.163 7f19b67fc700 1 -- 172.21.15.79:0/2169627705 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f19b00106f0 con 0x7f19c00acee0 2021-04-09T18:35:01.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.163 7f19c7f5f700 1 -- 172.21.15.79:0/2169627705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c009a250 con 0x7f19c00acee0 2021-04-09T18:35:01.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.163 7f19b67fc700 1 -- 172.21.15.79:0/2169627705 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f19b0019020 con 0x7f19c00acee0 2021-04-09T18:35:01.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.163 7f19b67fc700 1 --2- 172.21.15.79:0/2169627705 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f19a8029100 0x7f19a802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:01.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.163 7f19b67fc700 1 -- 172.21.15.79:0/2169627705 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6096+0+0 (secure 0 0 0) 0x7f19b0038f10 con 0x7f19c00acee0 2021-04-09T18:35:01.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.163 7f19c5d03700 1 --2- 172.21.15.79:0/2169627705 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f19a8029100 0x7f19a802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:01.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.163 7f19c7f5f700 1 -- 172.21.15.79:0/2169627705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c00ad780 con 0x7f19c00acee0 2021-04-09T18:35:01.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.163 7f19c5d03700 1 --2- 172.21.15.79:0/2169627705 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f19a8029100 0x7f19a802b650 crc :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:01.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.171 7f19b67fc700 1 -- 172.21.15.79:0/2169627705 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f19b0000bf0 con 0x7f19c00acee0 2021-04-09T18:35:01.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.343 7f19c7f5f700 1 -- 172.21.15.79:0/2169627705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f19c00e39d0 con 0x7f19c00acee0 2021-04-09T18:35:01.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.347 7f19b67fc700 1 -- 172.21.15.79:0/2169627705 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v118) v1 ==== 81+0+31063 (secure 0 0 0) 0x7f19b0010300 con 0x7f19c00acee0 2021-04-09T18:35:01.352 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:01.353 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:35:01.353 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 118, 2021-04-09T18:35:01.353 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:35:01.353 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:35:01.354 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:35:00.762280", 2021-04-09T18:35:01.354 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:35:01.354 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:35:01.354 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:35:01.355 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:35:01.355 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:35:01.355 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:35:01.355 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:35:01.356 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:35:01.356 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:35:01.356 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:35:01.356 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:35:01.356 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:35:01.357 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:35:01.357 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:35:01.357 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:35:01.357 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 23, 2021-04-09T18:35:01.357 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:35:01.358 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:35:01.358 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:35:01.358 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:35:01.358 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:35:01.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.359 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:35:01.359 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:35:01.359 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:35:01.359 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:35:01.360 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:35:01.360 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:35:01.360 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:35:01.360 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:35:01.360 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:35:01.361 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:35:01.361 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:35:01.361 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:35:01.361 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:35:01.362 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:35:01.362 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:35:01.362 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:35:01.362 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:35:01.362 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:35:01.363 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:35:01.363 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:35:01.363 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:35:01.364 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:35:01.364 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:35:01.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.364 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:35:01.364 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:35:01.365 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:35:01.365 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:35:01.365 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:35:01.365 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:35:01.365 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:35:01.366 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:35:01.366 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:35:01.366 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:35:01.366 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:35:01.367 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:35:01.367 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:35:01.367 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:35:01.367 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:35:01.367 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:35:01.368 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:35:01.368 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:35:01.368 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:35:01.368 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:35:01.368 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:35:01.369 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:35:01.369 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:35:01.369 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:35:01.369 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:35:01.370 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:35:01.370 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:35:01.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.370 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:35:01.370 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:35:01.371 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:35:01.371 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:35:01.371 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:35:01.371 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:35:01.371 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:35:01.372 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:35:01.372 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:35:01.372 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:35:01.372 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:35:01.372 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:35:01.373 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:35:01.373 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:35:01.373 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.374 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 21, 2021-04-09T18:35:01.374 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2021-04-09T18:35:01.374 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:34:30.884154", 2021-04-09T18:35:01.374 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:35:01.375 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:35:01.375 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:35:01.375 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:35:01.375 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:35:01.375 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:35:01.376 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:35:01.376 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:35:01.376 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:35:01.376 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:35:01.376 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:35:01.377 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:35:01.377 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:35:01.377 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:35:01.377 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:35:01.378 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:35:01.378 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:35:01.378 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:35:01.378 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:35:01.378 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:35:01.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.379 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "118", 2021-04-09T18:35:01.379 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:35:01.379 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:35:01.379 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:35:01.380 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:35:01.380 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:35:01.380 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:35:01.380 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:35:01.380 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:35:01.381 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:35:01.381 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:35:01.381 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:35:01.381 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:35:01.381 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:35:01.382 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:35:01.382 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:35:01.382 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:35:01.382 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:35:01.383 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:35:01.383 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:35:01.383 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:35:01.383 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:35:01.383 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:35:01.384 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:35:01.384 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:35:01.384 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:35:01.384 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:35:01.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.385 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:35:01.385 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:35:01.385 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:35:01.385 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:35:01.385 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:35:01.386 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:35:01.386 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:35:01.386 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:35:01.386 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:35:01.386 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:35:01.387 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:35:01.387 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:35:01.387 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:35:01.387 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:35:01.388 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2021-04-09T18:35:01.388 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.388 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.389 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 23, 2021-04-09T18:35:01.389 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2021-04-09T18:35:01.389 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:34:59.795110", 2021-04-09T18:35:01.389 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 32769, 2021-04-09T18:35:01.389 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,creating", 2021-04-09T18:35:01.390 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:35:01.390 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:35:01.390 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:35:01.390 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:35:01.390 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:35:01.391 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:35:01.391 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:35:01.391 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:35:01.391 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:35:01.392 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:35:01.392 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:35:01.392 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:35:01.392 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:35:01.392 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:35:01.393 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:35:01.393 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:35:01.393 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:35:01.393 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:35:01.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.394 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "118", 2021-04-09T18:35:01.394 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:35:01.394 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:35:01.394 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:35:01.394 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:35:01.395 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:35:01.395 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:35:01.395 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:35:01.395 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:35:01.396 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:35:01.396 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:35:01.396 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:35:01.396 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:35:01.396 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:35:01.397 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:35:01.397 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:35:01.398 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:35:01.398 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:35:01.398 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:35:01.398 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:35:01.399 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:35:01.399 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:35:01.399 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:35:01.399 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:35:01.400 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:35:01.400 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:35:01.400 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:35:01.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.400 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:35:01.401 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:35:01.401 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:35:01.401 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:35:01.402 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:35:01.402 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:35:01.402 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:35:01.402 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:35:01.402 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:35:01.403 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:35:01.403 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:35:01.403 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2021-04-09T18:35:01.403 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2021-04-09T18:35:01.404 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2021-04-09T18:35:01.404 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2021-04-09T18:35:01.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.404 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:35:01.404 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:35:01.405 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2021-04-09T18:35:01.405 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.405 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.405 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.406 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:35:01.406 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:35:01.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.406 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:35:01.407 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:35:01.407 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:01.407 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:01.407 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:01.408 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:01.408 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:01.408 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:01.408 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:01.408 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 117, 2021-04-09T18:35:01.409 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:01.409 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:01.409 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:01.409 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.410 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.410 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:35:01.410 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:01.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.411 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.411 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:35:01.411 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:01.412 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.412 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.412 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:01.412 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.413 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.413 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:35:01.413 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:01.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.414 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.414 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:35:01.414 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:01.414 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.415 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.415 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:01.415 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.416 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.416 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:35:01.416 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:01.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.417 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.417 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:35:01.418 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:01.418 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.418 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.418 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:01.419 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.419 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.420 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:35:01.420 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:01.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.421 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.421 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:35:01.421 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:01.421 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.421 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.422 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:35:01.422 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:35:01.422 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:35:01.422 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:35:01.423 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:01.423 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:01.423 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:01.423 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.424 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:35:01.424 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:35:01.425 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:01.425 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:01.425 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:01.425 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:01.425 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:01.426 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:01.427 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:01.427 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 112, 2021-04-09T18:35:01.427 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:01.428 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:01.428 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:01.429 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.429 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.430 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:35:01.430 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:01.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.431 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.432 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:35:01.432 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:01.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.433 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.434 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:01.434 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.435 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.436 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:35:01.436 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:01.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.437 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.438 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:35:01.438 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:01.438 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.439 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.440 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:01.440 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.441 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.441 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:35:01.442 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:01.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.443 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.444 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:35:01.444 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:01.444 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.445 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.446 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:01.446 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.447 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.447 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:35:01.447 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:01.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.448 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.448 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:35:01.449 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:01.449 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.449 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.450 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:35:01.450 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:35:01.450 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:35:01.451 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:35:01.452 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:01.452 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:01.452 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:01.452 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.453 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:35:01.454 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:35:01.454 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:01.454 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:01.455 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:01.455 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:01.455 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:01.456 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:01.456 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:01.456 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 117, 2021-04-09T18:35:01.457 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:01.457 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:01.458 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:01.458 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.459 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.460 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:35:01.460 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:01.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.462 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.462 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:35:01.462 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:01.463 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.463 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.464 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:01.465 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.465 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.466 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:35:01.466 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:01.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.468 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.468 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:35:01.469 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:01.469 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.469 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.470 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:01.471 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.472 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.472 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:35:01.472 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:01.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.474 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.474 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:35:01.474 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:01.475 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.475 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.476 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:01.476 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.477 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.478 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:35:01.478 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:01.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.479 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.480 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:35:01.480 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:35:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:35:01.483 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:35:01.483 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:35:01.484 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:01.484 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:01.484 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:01.485 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.486 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:35:01.487 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:35:01.487 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:01.487 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:01.488 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:01.488 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:01.489 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:01.489 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:01.489 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:01.490 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 117, 2021-04-09T18:35:01.491 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:01.491 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:01.491 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:01.492 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.493 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.493 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:35:01.493 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:01.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.494 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.495 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:35:01.495 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:01.496 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.496 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.497 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:01.497 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.498 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.499 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:35:01.499 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:01.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.500 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.501 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:35:01.501 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:01.501 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.502 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.503 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:01.503 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.503 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.504 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:35:01.504 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:01.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.505 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.505 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:35:01.505 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:01.505 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.505 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.506 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:01.506 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.507 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.507 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:35:01.507 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:01.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.508 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.508 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:35:01.508 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:01.508 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.509 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.509 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:35:01.509 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:35:01.509 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:35:01.510 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:35:01.510 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:01.510 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:01.510 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:01.510 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.511 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:35:01.511 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:35:01.511 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:01.512 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:01.512 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:01.512 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:01.512 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:01.513 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:01.513 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:01.513 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 117, 2021-04-09T18:35:01.513 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:01.513 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:01.514 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:01.514 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.514 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.514 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:35:01.515 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:01.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.515 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.515 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:35:01.516 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:01.516 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.516 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.516 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:01.517 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.517 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.518 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:35:01.518 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:01.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.518 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.519 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:35:01.519 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:01.519 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.519 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.520 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:01.520 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.521 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.521 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:35:01.521 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:01.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.522 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.522 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:35:01.522 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:01.522 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.522 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.523 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:01.523 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.524 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.524 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:35:01.524 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:01.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.525 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.525 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:35:01.525 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:01.525 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.525 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.526 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:35:01.526 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:35:01.526 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:35:01.527 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:35:01.527 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:01.527 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:01.527 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:01.528 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.528 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:35:01.528 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:35:01.529 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:01.529 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:01.529 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:01.529 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:01.529 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:01.530 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:01.530 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:01.530 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 117, 2021-04-09T18:35:01.530 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:01.531 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:01.531 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:01.531 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.531 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.532 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:35:01.532 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:01.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.532 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.533 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:35:01.533 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:01.533 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.533 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.534 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:01.534 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.534 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.534 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:35:01.535 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:01.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.535 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.536 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:35:01.536 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:01.536 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.536 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.537 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:01.537 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.537 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.537 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:35:01.538 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:01.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.538 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.538 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:35:01.539 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:01.539 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.539 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.540 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:01.540 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.540 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.540 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:35:01.541 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:01.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.541 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.541 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:35:01.542 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:01.542 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.542 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.542 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:35:01.543 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:35:01.543 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:35:01.543 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:35:01.543 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:01.543 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:01.544 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:01.544 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.544 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:35:01.545 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:35:01.545 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:01.545 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:01.545 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:01.546 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:01.546 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:01.546 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:01.546 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:01.546 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 112, 2021-04-09T18:35:01.547 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:01.547 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:01.547 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:01.547 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.548 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.548 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:35:01.548 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:01.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.549 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.549 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:35:01.549 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:01.549 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.549 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.550 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:01.550 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.550 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.551 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:35:01.551 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:01.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.552 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.552 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:35:01.552 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:01.552 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.552 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.553 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:01.553 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.553 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.554 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:35:01.554 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:01.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.554 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.555 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:35:01.555 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:01.555 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.555 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.556 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:01.556 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.556 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.557 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:35:01.557 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:01.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.557 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.558 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:35:01.558 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:01.558 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.558 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.559 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:35:01.559 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:35:01.559 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:35:01.559 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:35:01.560 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:01.560 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:01.560 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:01.560 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.561 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:35:01.561 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:35:01.561 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:01.561 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:01.562 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:01.562 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:01.562 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:01.562 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:01.562 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:01.563 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 104, 2021-04-09T18:35:01.563 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:01.563 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:01.563 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:01.564 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.564 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.564 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:35:01.564 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:01.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.565 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.565 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:35:01.566 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:01.566 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.566 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.566 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:01.567 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.567 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.567 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:35:01.568 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:01.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.568 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.569 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:35:01.569 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:01.569 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.569 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.570 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:01.570 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.570 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.570 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:35:01.571 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:01.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.571 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:35:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.573 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:01.573 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:01.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.573 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:01.573 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:35:01.574 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:01.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.574 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:01.574 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:35:01.575 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:01.575 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.575 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.575 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:35:01.576 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:35:01.576 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:35:01.576 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:35:01.576 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:01.576 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:01.577 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:01.577 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:01.577 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.577 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:35:01.577 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:35:01.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.578 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:35:01.578 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:01.578 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:01.579 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:01.579 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:01.579 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:01.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.580 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:35:01.580 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:01.580 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:01.580 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:01.580 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:01.581 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:01.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.581 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:35:01.581 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:01.582 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:01.582 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:01.582 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:01.582 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:01.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.583 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:35:01.583 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:01.583 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:01.584 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:01.584 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:01.584 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:01.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.585 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:35:01.585 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:01.585 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:01.585 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:01.585 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:01.586 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:01.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.586 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:35:01.586 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:01.587 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:01.587 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:01.587 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:01.587 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:01.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.588 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:35:01.588 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:01.588 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:01.589 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:01.589 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:01.589 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:01.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:01.590 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:35:01.590 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:01.590 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:01.590 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:01.590 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:01.591 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:01.591 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.591 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:35:01.591 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:35:01.591 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:35:01.592 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:35:01.592 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:35:01.592 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": { 2021-04-09T18:35:01.592 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.79:6833/1381942487": "2021-04-10 18:34:46.418839", 2021-04-09T18:35:01.592 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.79:6832/1381942487": "2021-04-10 18:34:46.418839", 2021-04-09T18:35:01.593 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.79:6833/1349682878": "2021-04-10 18:34:32.282358", 2021-04-09T18:35:01.593 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.79:6832/1349682878": "2021-04-10 18:34:32.282358" 2021-04-09T18:35:01.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.593 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:35:01.593 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:35:01.594 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:35:01.594 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:35:01.594 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:35:01.594 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:35:01.594 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:35:01.595 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:35:01.595 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:35:01.595 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:35:01.595 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:35:01.596 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:35:01.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.596 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:35:01.596 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:35:01.596 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:35:01.597 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:35:01.597 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:35:01.597 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:35:01.597 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:35:01.597 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:01.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:01.598 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:35:01.598 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:35:01.598 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:35:01.598 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:35:01.599 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:35:01.599 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:35:01.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.347 7f19c7f5f700 1 -- 172.21.15.79:0/2169627705 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f19a8029100 msgr2=0x7f19a802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:01.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.347 7f19c7f5f700 1 --2- 172.21.15.79:0/2169627705 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f19a8029100 0x7f19a802b650 crc :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:01.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.347 7f19c7f5f700 1 -- 172.21.15.79:0/2169627705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19c00acee0 msgr2=0x7f19c008f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:01.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.347 7f19c7f5f700 1 --2- 172.21.15.79:0/2169627705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19c00acee0 0x7f19c008f7f0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f19c0093ec0 tx=0x7f19b000cad0).stop 2021-04-09T18:35:01.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.347 7f19c7f5f700 1 -- 172.21.15.79:0/2169627705 shutdown_connections 2021-04-09T18:35:01.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.347 7f19c7f5f700 1 --2- 172.21.15.79:0/2169627705 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f19a8029100 0x7f19a802b650 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:01.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.347 7f19c7f5f700 1 --2- 172.21.15.79:0/2169627705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19c00ad330 0x7f19c008fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:01.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.347 7f19c7f5f700 1 --2- 172.21.15.79:0/2169627705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19c009a6b0 0x7f19c00cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:01.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.347 7f19c7f5f700 1 --2- 172.21.15.79:0/2169627705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19c00acee0 0x7f19c008f7f0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:01.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.351 7f19c7f5f700 1 -- 172.21.15.79:0/2169627705 >> 172.21.15.79:0/2169627705 conn(0x7f19c0093f00 msgr2=0x7f19c00ba870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:01.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.351 7f19c7f5f700 1 -- 172.21.15.79:0/2169627705 shutdown_connections 2021-04-09T18:35:01.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.351 7f19c7f5f700 1 -- 172.21.15.79:0/2169627705 wait complete. 2021-04-09T18:35:01.604 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:35:01.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.695 7f1c9a066700 1 Processor -- start 2021-04-09T18:35:01.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.695 7f1c9a066700 1 -- start start 2021-04-09T18:35:01.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c9a066700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1c940f5510 0x7f1c940f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:01.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c9a066700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1c941c8000 0x7f1c941ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:01.710 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c9a066700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c940fbb10 con 0x7f1c940e9ad0 2021-04-09T18:35:01.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c9a066700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c940e9f20 con 0x7f1c940f5510 2021-04-09T18:35:01.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c9a066700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c941c3db0 con 0x7f1c941c8000 2021-04-09T18:35:01.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c937fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1c940f5510 0x7f1c940f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:01.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c92ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1c940e9ad0 0x7f1c9409f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57462/0 (socket says 172.21.15.79:57462) 2021-04-09T18:35:01.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c92ffd700 1 -- 172.21.15.79:0/2933960724 learned_addr learned my addr 172.21.15.79:0/2933960724 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:01.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c937fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1c940f5510 0x7f1c940f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34518/0 (socket says 172.21.15.79:34518) 2021-04-09T18:35:01.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c93fff700 1 --2- 172.21.15.79:0/2933960724 >> v2:172.21.15.89:3300/0 conn(0x7f1c941c8000 0x7f1c941ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:01.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c937fe700 1 -- 172.21.15.79:0/2933960724 >> v2:172.21.15.89:3300/0 conn(0x7f1c941c8000 msgr2=0x7f1c941ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:01.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c937fe700 1 --2- 172.21.15.79:0/2933960724 >> v2:172.21.15.89:3300/0 conn(0x7f1c941c8000 0x7f1c941ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:01.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c937fe700 1 -- 172.21.15.79:0/2933960724 >> v1:172.21.15.79:6789/0 conn(0x7f1c940e9ad0 legacy=0x7f1c9409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:01.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c937fe700 1 -- 172.21.15.79:0/2933960724 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9409f900 con 0x7f1c940f5510 2021-04-09T18:35:01.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c937fe700 1 --2- 172.21.15.79:0/2933960724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c940f5510 0x7f1c940f64a0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f1c84002f30 tx=0x7f1c8400bd10).ready entity=mon.0 client_cookie=d1f85eddca5a6e0a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:01.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c927fc700 1 -- 172.21.15.79:0/2933960724 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1c9409f900 con 0x7f1c940f5510 2021-04-09T18:35:01.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c927fc700 1 -- 172.21.15.79:0/2933960724 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c840098a0 con 0x7f1c940f5510 2021-04-09T18:35:01.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c927fc700 1 -- 172.21.15.79:0/2933960724 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1c84009cb0 con 0x7f1c940f5510 2021-04-09T18:35:01.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c9a066700 1 -- 172.21.15.79:0/2933960724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c940f5510 msgr2=0x7f1c940f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:01.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c9a066700 1 --2- 172.21.15.79:0/2933960724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c940f5510 0x7f1c940f64a0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f1c84002f30 tx=0x7f1c8400bd10).stop 2021-04-09T18:35:01.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c9a066700 1 -- 172.21.15.79:0/2933960724 shutdown_connections 2021-04-09T18:35:01.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c9a066700 1 --2- 172.21.15.79:0/2933960724 >> v2:172.21.15.89:3300/0 conn(0x7f1c941c8000 0x7f1c941ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:01.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c9a066700 1 --2- 172.21.15.79:0/2933960724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c940f5510 0x7f1c940f64a0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:01.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c9a066700 1 -- 172.21.15.79:0/2933960724 >> 172.21.15.79:0/2933960724 conn(0x7f1c940e5fd0 msgr2=0x7f1c940e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:01.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c9a066700 1 -- 172.21.15.79:0/2933960724 shutdown_connections 2021-04-09T18:35:01.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.699 7f1c9a066700 1 -- 172.21.15.79:0/2933960724 wait complete. 2021-04-09T18:35:01.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.703 7f1c9a066700 1 Processor -- start 2021-04-09T18:35:01.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.703 7f1c9a066700 1 -- start start 2021-04-09T18:35:01.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.703 7f1c9a066700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c940c06f0 0x7f1c940b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:01.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.703 7f1c9a066700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c941ad760 0x7f1c94097f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:01.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.703 7f1c9a066700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c941adbb0 0x7f1c94098580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:01.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.703 7f1c9a066700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c940969d0 con 0x7f1c940c06f0 2021-04-09T18:35:01.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.703 7f1c9a066700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c940b56f0 con 0x7f1c941ad760 2021-04-09T18:35:01.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.703 7f1c9a066700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c94098bb0 con 0x7f1c941adbb0 2021-04-09T18:35:01.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.707 7f1c937fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c940c06f0 0x7f1c940b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:01.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.707 7f1c937fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c940c06f0 0x7f1c940b50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34524/0 (socket says 172.21.15.79:34524) 2021-04-09T18:35:01.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.707 7f1c937fe700 1 -- 172.21.15.79:0/1267726658 learned_addr learned my addr 172.21.15.79:0/1267726658 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:01.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.707 7f1c93fff700 1 --2- 172.21.15.79:0/1267726658 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c941adbb0 0x7f1c94098580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:01.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.707 7f1c92ffd700 1 --2- 172.21.15.79:0/1267726658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c941ad760 0x7f1c94097f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:01.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.707 7f1c937fe700 1 -- 172.21.15.79:0/1267726658 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c941adbb0 msgr2=0x7f1c94098580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:01.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.707 7f1c937fe700 1 --2- 172.21.15.79:0/1267726658 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c941adbb0 0x7f1c94098580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.707 7f1c937fe700 1 -- 172.21.15.79:0/1267726658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c941ad760 msgr2=0x7f1c94097f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.707 7f1c937fe700 1 --2- 172.21.15.79:0/1267726658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c941ad760 0x7f1c94097f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.707 7f1c937fe700 1 -- 172.21.15.79:0/1267726658 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c94098de0 con 0x7f1c940c06f0 2021-04-09T18:35:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.707 7f1c937fe700 1 --2- 172.21.15.79:0/1267726658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c940c06f0 0x7f1c940b50c0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f1c84002f30 tx=0x7f1c84006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:01.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.707 7f1c7bfff700 1 -- 172.21.15.79:0/1267726658 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1c94098de0 con 0x7f1c940c06f0 2021-04-09T18:35:01.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.707 7f1c7bfff700 1 -- 172.21.15.79:0/1267726658 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c84011c50 con 0x7f1c940c06f0 2021-04-09T18:35:01.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.707 7f1c7bfff700 1 -- 172.21.15.79:0/1267726658 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1c8401d630 con 0x7f1c940c06f0 2021-04-09T18:35:01.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.707 7f1c9a066700 1 -- 172.21.15.79:0/1267726658 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c941b1450 con 0x7f1c940c06f0 2021-04-09T18:35:01.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.707 7f1c9a066700 1 -- 172.21.15.79:0/1267726658 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c941b18a0 con 0x7f1c940c06f0 2021-04-09T18:35:01.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.707 7f1c7bfff700 1 -- 172.21.15.79:0/1267726658 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1c84026450 con 0x7f1c940c06f0 2021-04-09T18:35:01.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.707 7f1c7bfff700 1 --2- 172.21.15.79:0/1267726658 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1c74029100 0x7f1c7402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:01.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.707 7f1c7bfff700 1 -- 172.21.15.79:0/1267726658 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6096+0+0 (secure 0 0 0) 0x7f1c8403af80 con 0x7f1c940c06f0 2021-04-09T18:35:01.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.707 7f1c92ffd700 1 --2- 172.21.15.79:0/1267726658 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1c74029100 0x7f1c7402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:01.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.711 7f1c92ffd700 1 --2- 172.21.15.79:0/1267726658 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1c74029100 0x7f1c7402b650 crc :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:01.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.711 7f1c9a066700 1 -- 172.21.15.79:0/1267726658 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c940e39d0 con 0x7f1c940c06f0 2021-04-09T18:35:01.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.719 7f1c7bfff700 1 -- 172.21.15.79:0/1267726658 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1c84009690 con 0x7f1c940c06f0 2021-04-09T18:35:01.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.891 7f1c9a066700 1 -- 172.21.15.79:0/1267726658 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c940bb4e0 con 0x7f1c940c06f0 2021-04-09T18:35:01.899 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.895 7f1c7bfff700 1 -- 172.21.15.79:0/1267726658 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+1421 (secure 0 0 0) 0x7f1c84011a40 con 0x7f1c940c06f0 2021-04-09T18:35:01.902 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 73 2021-04-09T18:35:01.902 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:01.903 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":73,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:35:00.762570","modified":"2021-04-09 18:35:00.762653","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[21],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2021-04-09T18:35:01.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.899 7f1c9a066700 1 -- 172.21.15.79:0/1267726658 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1c74029100 msgr2=0x7f1c7402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:01.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.899 7f1c9a066700 1 --2- 172.21.15.79:0/1267726658 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1c74029100 0x7f1c7402b650 crc :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:01.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.899 7f1c9a066700 1 -- 172.21.15.79:0/1267726658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c940c06f0 msgr2=0x7f1c940b50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:01.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.899 7f1c9a066700 1 --2- 172.21.15.79:0/1267726658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c940c06f0 0x7f1c940b50c0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f1c84002f30 tx=0x7f1c84006890).stop 2021-04-09T18:35:01.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.899 7f1c9a066700 1 -- 172.21.15.79:0/1267726658 shutdown_connections 2021-04-09T18:35:01.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.899 7f1c9a066700 1 --2- 172.21.15.79:0/1267726658 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1c74029100 0x7f1c7402b650 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:01.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.899 7f1c9a066700 1 --2- 172.21.15.79:0/1267726658 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c941adbb0 0x7f1c94098580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:01.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.899 7f1c9a066700 1 --2- 172.21.15.79:0/1267726658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c940c06f0 0x7f1c940b50c0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:01.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.899 7f1c9a066700 1 --2- 172.21.15.79:0/1267726658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c941ad760 0x7f1c94097f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:01.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.899 7f1c9a066700 1 -- 172.21.15.79:0/1267726658 >> 172.21.15.79:0/1267726658 conn(0x7f1c940d8270 msgr2=0x7f1c940d86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:01.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.899 7f1c9a066700 1 -- 172.21.15.79:0/1267726658 shutdown_connections 2021-04-09T18:35:01.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:01.899 7f1c9a066700 1 -- 172.21.15.79:0/1267726658 wait complete. 2021-04-09T18:35:01.918 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-04-09T18:35:02.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.007 7fc26bace700 1 Processor -- start 2021-04-09T18:35:02.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.007 7fc26bace700 1 -- start start 2021-04-09T18:35:02.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc26bace700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc2640f5520 0x7fc2640f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:02.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc26bace700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc2640e9ae0 0x7fc26409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:02.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc26bace700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2640fbb20 con 0x7fc2641c2db0 2021-04-09T18:35:02.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc26bace700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2640e9f30 con 0x7fc2640e9ae0 2021-04-09T18:35:02.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc26bace700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2640e59d0 con 0x7fc2640f5520 2021-04-09T18:35:02.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc269071700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc2640e9ae0 0x7fc26409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:02.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc269071700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc2640e9ae0 0x7fc26409f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34534/0 (socket says 172.21.15.79:34534) 2021-04-09T18:35:02.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc269071700 1 -- 172.21.15.79:0/775363380 learned_addr learned my addr 172.21.15.79:0/775363380 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:02.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc269872700 1 --2- 172.21.15.79:0/775363380 >> v2:172.21.15.89:3300/0 conn(0x7fc2640f5520 0x7fc2640f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:02.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc269071700 1 -- 172.21.15.79:0/775363380 >> v2:172.21.15.89:3300/0 conn(0x7fc2640f5520 msgr2=0x7fc2640f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:02.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc269071700 1 --2- 172.21.15.79:0/775363380 >> v2:172.21.15.89:3300/0 conn(0x7fc2640f5520 0x7fc2640f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:02.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc269071700 1 -- 172.21.15.79:0/775363380 >> v1:172.21.15.89:6789/0 conn(0x7fc2641c2db0 legacy=0x7fc2641c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:02.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc269071700 1 -- 172.21.15.79:0/775363380 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2640e56d0 con 0x7fc2640e9ae0 2021-04-09T18:35:02.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc269071700 1 --2- 172.21.15.79:0/775363380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2640e9ae0 0x7fc26409f110 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7fc254002f30 tx=0x7fc25400bd70).ready entity=mon.0 client_cookie=bc17ec3a9ccf482f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:02.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc268870700 1 -- 172.21.15.79:0/775363380 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc2640e56d0 con 0x7fc2640e9ae0 2021-04-09T18:35:02.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc268870700 1 -- 172.21.15.79:0/775363380 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc254009950 con 0x7fc2640e9ae0 2021-04-09T18:35:02.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc268870700 1 -- 172.21.15.79:0/775363380 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc254009d20 con 0x7fc2640e9ae0 2021-04-09T18:35:02.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc26bace700 1 -- 172.21.15.79:0/775363380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2640e9ae0 msgr2=0x7fc26409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:02.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc26bace700 1 --2- 172.21.15.79:0/775363380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2640e9ae0 0x7fc26409f110 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7fc254002f30 tx=0x7fc25400bd70).stop 2021-04-09T18:35:02.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc26bace700 1 -- 172.21.15.79:0/775363380 shutdown_connections 2021-04-09T18:35:02.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc26bace700 1 --2- 172.21.15.79:0/775363380 >> v2:172.21.15.89:3300/0 conn(0x7fc2640f5520 0x7fc2640f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:02.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc26bace700 1 --2- 172.21.15.79:0/775363380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2640e9ae0 0x7fc26409f110 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:02.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc26bace700 1 -- 172.21.15.79:0/775363380 >> 172.21.15.79:0/775363380 conn(0x7fc2640e5fe0 msgr2=0x7fc2640e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:02.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc26bace700 1 -- 172.21.15.79:0/775363380 shutdown_connections 2021-04-09T18:35:02.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.011 7fc26bace700 1 -- 172.21.15.79:0/775363380 wait complete. 2021-04-09T18:35:02.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.015 7fc26bace700 1 Processor -- start 2021-04-09T18:35:02.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.015 7fc26bace700 1 -- start start 2021-04-09T18:35:02.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.015 7fc26bace700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2640bb0d0 0x7fc2640abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:02.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.015 7fc26bace700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2640d6300 0x7fc2640bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:02.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.015 7fc26bace700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2640ac6a0 0x7fc2640acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:02.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.015 7fc26bace700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc264097f50 con 0x7fc2640bb0d0 2021-04-09T18:35:02.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.015 7fc26bace700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc264098250 con 0x7fc2640d6300 2021-04-09T18:35:02.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.015 7fc26bace700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640c04e0 con 0x7fc2640ac6a0 2021-04-09T18:35:02.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.015 7fc269872700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2640bb0d0 0x7fc2640abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:02.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.015 7fc269872700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2640bb0d0 0x7fc2640abed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34538/0 (socket says 172.21.15.79:34538) 2021-04-09T18:35:02.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.015 7fc269872700 1 -- 172.21.15.79:0/2210830232 learned_addr learned my addr 172.21.15.79:0/2210830232 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:02.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.015 7fc269071700 1 --2- 172.21.15.79:0/2210830232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2640d6300 0x7fc2640bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:02.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.015 7fc26a073700 1 --2- 172.21.15.79:0/2210830232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2640ac6a0 0x7fc2640acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:02.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.015 7fc269872700 1 -- 172.21.15.79:0/2210830232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2640ac6a0 msgr2=0x7fc2640acaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:02.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.015 7fc269872700 1 --2- 172.21.15.79:0/2210830232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2640ac6a0 0x7fc2640acaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:02.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.015 7fc269872700 1 -- 172.21.15.79:0/2210830232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2640d6300 msgr2=0x7fc2640bfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:02.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.015 7fc269872700 1 --2- 172.21.15.79:0/2210830232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2640d6300 0x7fc2640bfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:02.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.015 7fc269872700 1 -- 172.21.15.79:0/2210830232 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2640ad120 con 0x7fc2640bb0d0 2021-04-09T18:35:02.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.015 7fc269872700 1 --2- 172.21.15.79:0/2210830232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2640bb0d0 0x7fc2640abed0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7fc264097770 tx=0x7fc26000c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:02.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.019 7fc25a7fc700 1 -- 172.21.15.79:0/2210830232 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc2640ad120 con 0x7fc2640bb0d0 2021-04-09T18:35:02.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.019 7fc25a7fc700 1 -- 172.21.15.79:0/2210830232 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26000cd60 con 0x7fc2640bb0d0 2021-04-09T18:35:02.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.019 7fc25a7fc700 1 -- 172.21.15.79:0/2210830232 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc26000f040 con 0x7fc2640bb0d0 2021-04-09T18:35:02.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.019 7fc26bace700 1 -- 172.21.15.79:0/2210830232 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2640ad440 con 0x7fc2640bb0d0 2021-04-09T18:35:02.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.019 7fc26bace700 1 -- 172.21.15.79:0/2210830232 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2640cc310 con 0x7fc2640bb0d0 2021-04-09T18:35:02.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.019 7fc25a7fc700 1 -- 172.21.15.79:0/2210830232 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc260011070 con 0x7fc2640bb0d0 2021-04-09T18:35:02.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.019 7fc25a7fc700 1 --2- 172.21.15.79:0/2210830232 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc24c029100 0x7fc24c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:02.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.019 7fc25a7fc700 1 -- 172.21.15.79:0/2210830232 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6096+0+0 (secure 0 0 0) 0x7fc260010040 con 0x7fc2640bb0d0 2021-04-09T18:35:02.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.019 7fc269071700 1 --2- 172.21.15.79:0/2210830232 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc24c029100 0x7fc24c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:02.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.019 7fc269071700 1 --2- 172.21.15.79:0/2210830232 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc24c029100 0x7fc24c02b650 crc :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:02.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.023 7fc26bace700 1 -- 172.21.15.79:0/2210830232 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2640e39e0 con 0x7fc2640bb0d0 2021-04-09T18:35:02.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.027 7fc25a7fc700 1 -- 172.21.15.79:0/2210830232 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc260000bf0 con 0x7fc2640bb0d0 2021-04-09T18:35:02.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.183 7fc26bace700 1 -- 172.21.15.79:0/2210830232 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc2640f5b20 con 0x7fc2640bb0d0 2021-04-09T18:35:02.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.775 7fc25a7fc700 1 -- 172.21.15.79:0/2210830232 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v74) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc26000c960 con 0x7fc2640bb0d0 2021-04-09T18:35:02.804 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-04-09T18:35:02.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.803 7fc26bace700 1 -- 172.21.15.79:0/2210830232 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc24c029100 msgr2=0x7fc24c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:02.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.803 7fc26bace700 1 --2- 172.21.15.79:0/2210830232 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc24c029100 0x7fc24c02b650 crc :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:02.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.803 7fc26bace700 1 -- 172.21.15.79:0/2210830232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2640bb0d0 msgr2=0x7fc2640abed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:02.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.803 7fc26bace700 1 --2- 172.21.15.79:0/2210830232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2640bb0d0 0x7fc2640abed0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7fc264097770 tx=0x7fc26000c430).stop 2021-04-09T18:35:02.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.803 7fc26bace700 1 -- 172.21.15.79:0/2210830232 shutdown_connections 2021-04-09T18:35:02.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.803 7fc26bace700 1 --2- 172.21.15.79:0/2210830232 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc24c029100 0x7fc24c02b650 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:02.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.803 7fc26bace700 1 --2- 172.21.15.79:0/2210830232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2640ac6a0 0x7fc2640acaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:02.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.803 7fc26bace700 1 --2- 172.21.15.79:0/2210830232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2640bb0d0 0x7fc2640abed0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:02.810 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.803 7fc26bace700 1 --2- 172.21.15.79:0/2210830232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2640d6300 0x7fc2640bfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:02.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.803 7fc26bace700 1 -- 172.21.15.79:0/2210830232 >> 172.21.15.79:0/2210830232 conn(0x7fc2640afe00 msgr2=0x7fc26409a700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:02.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.803 7fc26bace700 1 -- 172.21.15.79:0/2210830232 shutdown_connections 2021-04-09T18:35:02.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.803 7fc26bace700 1 -- 172.21.15.79:0/2210830232 wait complete. 2021-04-09T18:35:02.826 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:35:02.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede65ac700 1 Processor -- start 2021-04-09T18:35:02.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede65ac700 1 -- start start 2021-04-09T18:35:02.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede65ac700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fede00e9ad0 0x7fede009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:02.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede65ac700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fede01c8000 0x7fede01ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:02.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede65ac700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede00fbb10 con 0x7fede00f5510 2021-04-09T18:35:02.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede65ac700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede01c3db0 con 0x7fede01c8000 2021-04-09T18:35:02.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede65ac700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede00e9f20 con 0x7fede00e9ad0 2021-04-09T18:35:02.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7feddffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fede00f5510 0x7fede00f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57488/0 (socket says 172.21.15.79:57488) 2021-04-09T18:35:02.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7feddffff700 1 -- 172.21.15.79:0/3348687342 learned_addr learned my addr 172.21.15.79:0/3348687342 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:02.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede4b51700 1 --2- 172.21.15.79:0/3348687342 >> v2:172.21.15.89:3300/0 conn(0x7fede01c8000 0x7fede01ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:02.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fedd7fff700 1 --2- 172.21.15.79:0/3348687342 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fede00e9ad0 0x7fede009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:02.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7feddf7fe700 1 -- 172.21.15.79:0/3348687342 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295522047 0 0) 0x7fedd00010d0 con 0x7fede00f5510 2021-04-09T18:35:02.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7feddf7fe700 1 -- 172.21.15.79:0/3348687342 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedcc003240 con 0x7fede00f5510 2021-04-09T18:35:02.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede4b51700 1 -- 172.21.15.79:0/3348687342 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fede00e9ad0 msgr2=0x7fede009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:02.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede4b51700 1 --2- 172.21.15.79:0/3348687342 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fede00e9ad0 0x7fede009f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:02.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede4b51700 1 -- 172.21.15.79:0/3348687342 >> v1:172.21.15.79:6789/0 conn(0x7fede00f5510 legacy=0x7fede00f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:02.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede4b51700 1 -- 172.21.15.79:0/3348687342 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede00e56c0 con 0x7fede01c8000 2021-04-09T18:35:02.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fedd7fff700 1 --2- 172.21.15.79:0/3348687342 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fede00e9ad0 0x7fede009f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:02.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede4b51700 1 --2- 172.21.15.79:0/3348687342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede01c8000 0x7fede01ca460 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fedd80032b0 tx=0x7fedd800b3c0).ready entity=mon.1 client_cookie=1ced3724bfca3f05 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:02.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7feddf7fe700 1 -- 172.21.15.79:0/3348687342 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fede00e56c0 con 0x7fede01c8000 2021-04-09T18:35:02.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7feddf7fe700 1 -- 172.21.15.79:0/3348687342 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd800bc20 con 0x7fede01c8000 2021-04-09T18:35:02.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7feddf7fe700 1 -- 172.21.15.79:0/3348687342 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fedd8002020 con 0x7fede01c8000 2021-04-09T18:35:02.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede65ac700 1 -- 172.21.15.79:0/3348687342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede01c8000 msgr2=0x7fede01ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:02.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede65ac700 1 --2- 172.21.15.79:0/3348687342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede01c8000 0x7fede01ca460 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fedd80032b0 tx=0x7fedd800b3c0).stop 2021-04-09T18:35:02.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede65ac700 1 -- 172.21.15.79:0/3348687342 shutdown_connections 2021-04-09T18:35:02.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede65ac700 1 --2- 172.21.15.79:0/3348687342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede01c8000 0x7fede01ca460 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:02.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede65ac700 1 --2- 172.21.15.79:0/3348687342 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fede00e9ad0 0x7fede009f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:02.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede65ac700 1 -- 172.21.15.79:0/3348687342 >> 172.21.15.79:0/3348687342 conn(0x7fede00e5fd0 msgr2=0x7fede00e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:02.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede65ac700 1 -- 172.21.15.79:0/3348687342 shutdown_connections 2021-04-09T18:35:02.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.919 7fede65ac700 1 -- 172.21.15.79:0/3348687342 wait complete. 2021-04-09T18:35:02.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.923 7fede65ac700 1 Processor -- start 2021-04-09T18:35:02.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.923 7fede65ac700 1 -- start start 2021-04-09T18:35:02.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.923 7fede65ac700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede00b9c60 0x7fede008f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:02.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.923 7fede65ac700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede0090000 0x7fede00d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:02.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.923 7fede65ac700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fede00d21e0 0x7fede01a8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:02.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.923 7fede65ac700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede00ba3b0 con 0x7fede0090000 2021-04-09T18:35:02.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.923 7fede65ac700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede00ba0b0 con 0x7fede00b9c60 2021-04-09T18:35:02.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.923 7fede65ac700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede0090450 con 0x7fede00d21e0 2021-04-09T18:35:02.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.927 7fedd7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede0090000 0x7fede00d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:02.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.927 7fedd7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede0090000 0x7fede00d1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34556/0 (socket says 172.21.15.79:34556) 2021-04-09T18:35:02.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.927 7feddffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede00b9c60 0x7fede008f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:02.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.927 7fedd7fff700 1 -- 172.21.15.79:0/3539610519 learned_addr learned my addr 172.21.15.79:0/3539610519 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:02.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.927 7fede4b51700 1 --2- 172.21.15.79:0/3539610519 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fede00d21e0 0x7fede01a8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:02.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.927 7fedd7fff700 1 -- 172.21.15.79:0/3539610519 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fede00d21e0 msgr2=0x7fede01a8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:02.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.927 7fedd7fff700 1 --2- 172.21.15.79:0/3539610519 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fede00d21e0 0x7fede01a8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:02.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.927 7fedd7fff700 1 -- 172.21.15.79:0/3539610519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede00b9c60 msgr2=0x7fede008f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:02.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.927 7fedd7fff700 1 --2- 172.21.15.79:0/3539610519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede00b9c60 0x7fede008f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:02.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.927 7fedd7fff700 1 -- 172.21.15.79:0/3539610519 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede008fc80 con 0x7fede0090000 2021-04-09T18:35:02.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.927 7fedd7fff700 1 --2- 172.21.15.79:0/3539610519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede0090000 0x7fede00d1bb0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7fedc800efc0 tx=0x7fedc800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:02.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.927 7feddd7fa700 1 -- 172.21.15.79:0/3539610519 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fede008fc80 con 0x7fede0090000 2021-04-09T18:35:02.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.927 7feddd7fa700 1 -- 172.21.15.79:0/3539610519 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc80123f0 con 0x7fede0090000 2021-04-09T18:35:02.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.927 7fede65ac700 1 -- 172.21.15.79:0/3539610519 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede01a8aa0 con 0x7fede0090000 2021-04-09T18:35:02.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.927 7feddd7fa700 1 -- 172.21.15.79:0/3539610519 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fedc800f040 con 0x7fede0090000 2021-04-09T18:35:02.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.927 7fede65ac700 1 -- 172.21.15.79:0/3539610519 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede01a8fd0 con 0x7fede0090000 2021-04-09T18:35:02.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.927 7feddd7fa700 1 -- 172.21.15.79:0/3539610519 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fedc8011070 con 0x7fede0090000 2021-04-09T18:35:02.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.927 7feddd7fa700 1 --2- 172.21.15.79:0/3539610519 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fedc4029100 0x7fedc402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:02.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.927 7feddd7fa700 1 -- 172.21.15.79:0/3539610519 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6096+0+0 (secure 0 0 0) 0x7fedc8010040 con 0x7fede0090000 2021-04-09T18:35:02.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.927 7feddffff700 1 --2- 172.21.15.79:0/3539610519 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fedc4029100 0x7fedc402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:02.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.931 7feddffff700 1 --2- 172.21.15.79:0/3539610519 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fedc4029100 0x7fedc402b650 crc :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:02.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.931 7fede65ac700 1 -- 172.21.15.79:0/3539610519 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede00e39d0 con 0x7fede0090000 2021-04-09T18:35:02.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:02.939 7feddd7fa700 1 -- 172.21.15.79:0/3539610519 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fedc8000bf0 con 0x7fede0090000 2021-04-09T18:35:03.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.111 7fede65ac700 1 -- 172.21.15.79:0/3539610519 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fede00f5b10 con 0x7fede0090000 2021-04-09T18:35:03.116 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.111 7feddd7fa700 1 -- 172.21.15.79:0/3539610519 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+1421 (secure 0 0 0) 0x7fedc800ca90 con 0x7fede0090000 2021-04-09T18:35:03.116 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:03.117 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":74,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":74,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:35:00.762570","modified":"2021-04-09 18:35:02.767940","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[21],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2021-04-09T18:35:03.117 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 74 2021-04-09T18:35:03.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.111 7fede65ac700 1 -- 172.21.15.79:0/3539610519 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fedc4029100 msgr2=0x7fedc402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:03.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.111 7fede65ac700 1 --2- 172.21.15.79:0/3539610519 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fedc4029100 0x7fedc402b650 crc :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:03.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.111 7fede65ac700 1 -- 172.21.15.79:0/3539610519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede0090000 msgr2=0x7fede00d1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:03.119 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.111 7fede65ac700 1 --2- 172.21.15.79:0/3539610519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede0090000 0x7fede00d1bb0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7fedc800efc0 tx=0x7fedc800c430).stop 2021-04-09T18:35:03.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.111 7fede65ac700 1 -- 172.21.15.79:0/3539610519 shutdown_connections 2021-04-09T18:35:03.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.111 7fede65ac700 1 --2- 172.21.15.79:0/3539610519 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fedc4029100 0x7fedc402b650 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:03.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.111 7fede65ac700 1 --2- 172.21.15.79:0/3539610519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede00b9c60 0x7fede008f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:03.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.111 7fede65ac700 1 --2- 172.21.15.79:0/3539610519 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fede00d21e0 0x7fede01a8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:03.120 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.111 7fede65ac700 1 --2- 172.21.15.79:0/3539610519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede0090000 0x7fede00d1bb0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:03.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.111 7fede65ac700 1 -- 172.21.15.79:0/3539610519 >> 172.21.15.79:0/3539610519 conn(0x7fede00ba800 msgr2=0x7fede00d3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:03.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.111 7fede65ac700 1 -- 172.21.15.79:0/3539610519 shutdown_connections 2021-04-09T18:35:03.121 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.115 7fede65ac700 1 -- 172.21.15.79:0/3539610519 wait complete. 2021-04-09T18:35:03.128 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-04-09T18:35:03.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.211 7f29efdb1700 1 Processor -- start 2021-04-09T18:35:03.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.211 7f29efdb1700 1 -- start start 2021-04-09T18:35:03.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.211 7f29efdb1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f29e80e9ae0 0x7f29e809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:03.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.211 7f29efdb1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f29e81c8010 0x7f29e81ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:03.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29efdb1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e80fbb20 con 0x7f29e80f5520 2021-04-09T18:35:03.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29efdb1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e81c3dc0 con 0x7f29e81c8010 2021-04-09T18:35:03.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29efdb1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e80e9f30 con 0x7f29e80e9ae0 2021-04-09T18:35:03.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29ee356700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f29e81c8010 0x7f29e81ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:03.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29edb55700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f29e80f5520 0x7f29e80f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57502/0 (socket says 172.21.15.79:57502) 2021-04-09T18:35:03.233 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29edb55700 1 -- 172.21.15.79:0/3239450556 learned_addr learned my addr 172.21.15.79:0/3239450556 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:03.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29ed354700 1 --2- 172.21.15.79:0/3239450556 >> v2:172.21.15.89:3300/0 conn(0x7f29e80e9ae0 0x7f29e809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:03.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29ee356700 1 -- 172.21.15.79:0/3239450556 >> v2:172.21.15.89:3300/0 conn(0x7f29e80e9ae0 msgr2=0x7f29e809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:03.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29ee356700 1 --2- 172.21.15.79:0/3239450556 >> v2:172.21.15.89:3300/0 conn(0x7f29e80e9ae0 0x7f29e809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:03.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29ee356700 1 -- 172.21.15.79:0/3239450556 >> v1:172.21.15.79:6789/0 conn(0x7f29e80f5520 legacy=0x7f29e80f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:03.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29ecb53700 1 -- 172.21.15.79:0/3239450556 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775616921 0 0) 0x7f29d00010d0 con 0x7f29e80f5520 2021-04-09T18:35:03.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29ee356700 1 -- 172.21.15.79:0/3239450556 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e80e56d0 con 0x7f29e81c8010 2021-04-09T18:35:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29ed354700 1 --2- 172.21.15.79:0/3239450556 >> v2:172.21.15.89:3300/0 conn(0x7f29e80e9ae0 0x7f29e809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29ee356700 1 --2- 172.21.15.79:0/3239450556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e81c8010 0x7f29e81ca470 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f29e0002f30 tx=0x7f29e000bd10).ready entity=mon.0 client_cookie=ce89254fe1c01d78 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:03.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29ecb53700 1 -- 172.21.15.79:0/3239450556 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f29e80e56d0 con 0x7f29e81c8010 2021-04-09T18:35:03.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29ecb53700 1 -- 172.21.15.79:0/3239450556 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e00098a0 con 0x7f29e81c8010 2021-04-09T18:35:03.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29ecb53700 1 -- 172.21.15.79:0/3239450556 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f29e0009c70 con 0x7f29e81c8010 2021-04-09T18:35:03.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29efdb1700 1 -- 172.21.15.79:0/3239450556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e81c8010 msgr2=0x7f29e81ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:03.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29efdb1700 1 --2- 172.21.15.79:0/3239450556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e81c8010 0x7f29e81ca470 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f29e0002f30 tx=0x7f29e000bd10).stop 2021-04-09T18:35:03.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29efdb1700 1 -- 172.21.15.79:0/3239450556 shutdown_connections 2021-04-09T18:35:03.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29efdb1700 1 --2- 172.21.15.79:0/3239450556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e81c8010 0x7f29e81ca470 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:03.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29efdb1700 1 --2- 172.21.15.79:0/3239450556 >> v2:172.21.15.89:3300/0 conn(0x7f29e80e9ae0 0x7f29e809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:03.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29efdb1700 1 -- 172.21.15.79:0/3239450556 >> 172.21.15.79:0/3239450556 conn(0x7f29e80e5fe0 msgr2=0x7f29e80e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:03.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29efdb1700 1 -- 172.21.15.79:0/3239450556 shutdown_connections 2021-04-09T18:35:03.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.215 7f29efdb1700 1 -- 172.21.15.79:0/3239450556 wait complete. 2021-04-09T18:35:03.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29efdb1700 1 Processor -- start 2021-04-09T18:35:03.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29efdb1700 1 -- start start 2021-04-09T18:35:03.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29efdb1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29e80afff0 0x7f29e81c0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:03.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29efdb1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29e81c06a0 0x7f29e81b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:03.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29efdb1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e80afa80 0x7f29e81b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:03.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29efdb1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e80c5140 con 0x7f29e80afa80 2021-04-09T18:35:03.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29efdb1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e80ad480 con 0x7f29e80afff0 2021-04-09T18:35:03.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29efdb1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e809b480 con 0x7f29e81c06a0 2021-04-09T18:35:03.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29ee356700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e80afa80 0x7f29e81b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:03.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29ee356700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e80afa80 0x7f29e81b1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34568/0 (socket says 172.21.15.79:34568) 2021-04-09T18:35:03.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29ee356700 1 -- 172.21.15.79:0/2172339438 learned_addr learned my addr 172.21.15.79:0/2172339438 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:03.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29edb55700 1 --2- 172.21.15.79:0/2172339438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29e80afff0 0x7f29e81c0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:03.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29ed354700 1 --2- 172.21.15.79:0/2172339438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29e81c06a0 0x7f29e81b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:03.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29ee356700 1 -- 172.21.15.79:0/2172339438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29e81c06a0 msgr2=0x7f29e81b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:03.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29ee356700 1 --2- 172.21.15.79:0/2172339438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29e81c06a0 0x7f29e81b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29ee356700 1 -- 172.21.15.79:0/2172339438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29e80afff0 msgr2=0x7f29e81c0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29ee356700 1 --2- 172.21.15.79:0/2172339438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29e80afff0 0x7f29e81c0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:03.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29ee356700 1 -- 172.21.15.79:0/2172339438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e81b2210 con 0x7f29e80afa80 2021-04-09T18:35:03.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29ee356700 1 --2- 172.21.15.79:0/2172339438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e80afa80 0x7f29e81b1be0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f29e80c1f40 tx=0x7f29e0006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:03.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29e67fc700 1 -- 172.21.15.79:0/2172339438 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f29e81b2210 con 0x7f29e80afa80 2021-04-09T18:35:03.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29efdb1700 1 -- 172.21.15.79:0/2172339438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e81b24d0 con 0x7f29e80afa80 2021-04-09T18:35:03.257 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29e67fc700 1 -- 172.21.15.79:0/2172339438 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e0011c40 con 0x7f29e80afa80 2021-04-09T18:35:03.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29efdb1700 1 -- 172.21.15.79:0/2172339438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e81ae1f0 con 0x7f29e80afa80 2021-04-09T18:35:03.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29e67fc700 1 -- 172.21.15.79:0/2172339438 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f29e81ae1f0 con 0x7f29e80afa80 2021-04-09T18:35:03.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29e67fc700 1 -- 172.21.15.79:0/2172339438 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f29e001d440 con 0x7f29e80afa80 2021-04-09T18:35:03.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29e67fc700 1 --2- 172.21.15.79:0/2172339438 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f29cc029100 0x7f29cc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:03.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.219 7f29e67fc700 1 -- 172.21.15.79:0/2172339438 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6096+0+0 (secure 0 0 0) 0x7f29e003b830 con 0x7f29e80afa80 2021-04-09T18:35:03.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.223 7f29edb55700 1 --2- 172.21.15.79:0/2172339438 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f29cc029100 0x7f29cc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:03.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.223 7f29edb55700 1 --2- 172.21.15.79:0/2172339438 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f29cc029100 0x7f29cc02b650 crc :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:03.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.227 7f29efdb1700 1 -- 172.21.15.79:0/2172339438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e80e39e0 con 0x7f29e80afa80 2021-04-09T18:35:03.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.235 7f29e67fc700 1 -- 172.21.15.79:0/2172339438 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f29e0009690 con 0x7f29e80afa80 2021-04-09T18:35:03.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.411 7f29efdb1700 1 -- 172.21.15.79:0/2172339438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f29e80bb530 con 0x7f29e80afa80 2021-04-09T18:35:03.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.775 7f29e67fc700 1 -- 172.21.15.79:0/2172339438 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v75) v1 ==== 104+0+0 (secure 0 0 0) 0x7f29e0011a30 con 0x7f29e80afa80 2021-04-09T18:35:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.831 7f29efdb1700 1 -- 172.21.15.79:0/2172339438 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f29cc029100 msgr2=0x7f29cc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.831 7f29efdb1700 1 --2- 172.21.15.79:0/2172339438 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f29cc029100 0x7f29cc02b650 crc :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.831 7f29efdb1700 1 -- 172.21.15.79:0/2172339438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e80afa80 msgr2=0x7f29e81b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:03.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.831 7f29efdb1700 1 --2- 172.21.15.79:0/2172339438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e80afa80 0x7f29e81b1be0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f29e80c1f40 tx=0x7f29e0006890).stop 2021-04-09T18:35:03.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.831 7f29efdb1700 1 -- 172.21.15.79:0/2172339438 shutdown_connections 2021-04-09T18:35:03.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.831 7f29efdb1700 1 --2- 172.21.15.79:0/2172339438 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f29cc029100 0x7f29cc02b650 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:03.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.831 7f29efdb1700 1 --2- 172.21.15.79:0/2172339438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29e80afff0 0x7f29e81c0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:03.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.831 7f29efdb1700 1 --2- 172.21.15.79:0/2172339438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29e80afa80 0x7f29e81b1be0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:03.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.831 7f29efdb1700 1 --2- 172.21.15.79:0/2172339438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29e81c06a0 0x7f29e81b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:03.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.831 7f29efdb1700 1 -- 172.21.15.79:0/2172339438 >> 172.21.15.79:0/2172339438 conn(0x7f29e80d8530 msgr2=0x7f29e80a24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:03.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.831 7f29efdb1700 1 -- 172.21.15.79:0/2172339438 shutdown_connections 2021-04-09T18:35:03.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.831 7f29efdb1700 1 -- 172.21.15.79:0/2172339438 wait complete. 2021-04-09T18:35:03.849 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-04-09T18:35:03.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.939 7f5ca5f6e700 1 Processor -- start 2021-04-09T18:35:03.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.939 7f5ca5f6e700 1 -- start start 2021-04-09T18:35:03.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5ca5f6e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5ca01c9040 0x7f5ca01cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:03.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5ca5f6e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca00fbb40 con 0x7f5ca00f5540 2021-04-09T18:35:03.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5ca5f6e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca009f900 con 0x7f5ca00e9b00 2021-04-09T18:35:03.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5ca5f6e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca01c3de0 con 0x7f5ca01c9040 2021-04-09T18:35:03.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5c9f7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5ca00f5540 0x7f5ca00f64d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57516/0 (socket says 172.21.15.79:57516) 2021-04-09T18:35:03.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5c9f7fe700 1 -- 172.21.15.79:0/255387520 learned_addr learned my addr 172.21.15.79:0/255387520 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:03.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5c9ffff700 1 --2- 172.21.15.79:0/255387520 >> v2:172.21.15.89:3300/0 conn(0x7f5ca01c9040 0x7f5ca01cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:03.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5c9e7fc700 1 -- 172.21.15.79:0/255387520 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2698900426 0 0) 0x7f5c90001450 con 0x7f5ca00f5540 2021-04-09T18:35:03.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5c9e7fc700 1 -- 172.21.15.79:0/255387520 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c8c003240 con 0x7f5ca00f5540 2021-04-09T18:35:03.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5c9ffff700 1 -- 172.21.15.79:0/255387520 >> v1:172.21.15.89:6789/0 conn(0x7f5ca00e9b00 legacy=0x7f5ca009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:03.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5c9ffff700 1 -- 172.21.15.79:0/255387520 >> v1:172.21.15.79:6789/0 conn(0x7f5ca00f5540 legacy=0x7f5ca00f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:03.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5c9ffff700 1 -- 172.21.15.79:0/255387520 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca00e56f0 con 0x7f5ca01c9040 2021-04-09T18:35:03.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5c9ffff700 1 --2- 172.21.15.79:0/255387520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ca01c9040 0x7f5ca01cb4a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f5c98002f30 tx=0x7f5c9800bcc0).ready entity=mon.1 client_cookie=ae6df7803172cb1c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:03.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5c9e7fc700 1 -- 172.21.15.79:0/255387520 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5ca00e56f0 con 0x7f5ca01c9040 2021-04-09T18:35:03.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5c9e7fc700 1 -- 172.21.15.79:0/255387520 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c98009800 con 0x7f5ca01c9040 2021-04-09T18:35:03.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5c9e7fc700 1 -- 172.21.15.79:0/255387520 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5c98009bd0 con 0x7f5ca01c9040 2021-04-09T18:35:03.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5ca5f6e700 1 -- 172.21.15.79:0/255387520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ca01c9040 msgr2=0x7f5ca01cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:03.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5ca5f6e700 1 --2- 172.21.15.79:0/255387520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ca01c9040 0x7f5ca01cb4a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f5c98002f30 tx=0x7f5c9800bcc0).stop 2021-04-09T18:35:03.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5ca5f6e700 1 -- 172.21.15.79:0/255387520 shutdown_connections 2021-04-09T18:35:03.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5ca5f6e700 1 --2- 172.21.15.79:0/255387520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ca01c9040 0x7f5ca01cb4a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:03.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.943 7f5ca5f6e700 1 -- 172.21.15.79:0/255387520 >> 172.21.15.79:0/255387520 conn(0x7f5ca00e6000 msgr2=0x7f5ca00e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:03.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.947 7f5ca5f6e700 1 -- 172.21.15.79:0/255387520 shutdown_connections 2021-04-09T18:35:03.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.947 7f5ca5f6e700 1 -- 172.21.15.79:0/255387520 wait complete. 2021-04-09T18:35:03.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.947 7f5ca5f6e700 1 Processor -- start 2021-04-09T18:35:03.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.947 7f5ca5f6e700 1 -- start start 2021-04-09T18:35:03.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5ca5f6e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ca00ad610 0x7f5ca00aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:03.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5ca5f6e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ca00ac3d0 0x7f5ca00d5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:03.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5ca5f6e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ca00ac820 0x7f5ca01af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:03.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5ca5f6e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca00e9f50 con 0x7f5ca00ad610 2021-04-09T18:35:03.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5ca5f6e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca00ae710 con 0x7f5ca00ac820 2021-04-09T18:35:03.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5ca5f6e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca00aea10 con 0x7f5ca00ac3d0 2021-04-09T18:35:03.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5c9f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ca00ad610 0x7f5ca00aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:03.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5c9f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ca00ad610 0x7f5ca00aff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34580/0 (socket says 172.21.15.79:34580) 2021-04-09T18:35:03.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5c9f7fe700 1 -- 172.21.15.79:0/3245537799 learned_addr learned my addr 172.21.15.79:0/3245537799 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:03.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5c9ffff700 1 --2- 172.21.15.79:0/3245537799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ca00ac820 0x7f5ca01af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:03.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5c9effd700 1 --2- 172.21.15.79:0/3245537799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ca00ac3d0 0x7f5ca00d5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:03.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5c9f7fe700 1 -- 172.21.15.79:0/3245537799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ca00ac3d0 msgr2=0x7f5ca00d5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:03.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5c9f7fe700 1 --2- 172.21.15.79:0/3245537799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ca00ac3d0 0x7f5ca00d5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:03.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5c9f7fe700 1 -- 172.21.15.79:0/3245537799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ca00ac820 msgr2=0x7f5ca01af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:03.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5c9f7fe700 1 --2- 172.21.15.79:0/3245537799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ca00ac820 0x7f5ca01af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:03.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5c9f7fe700 1 -- 172.21.15.79:0/3245537799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca00ada60 con 0x7f5ca00ad610 2021-04-09T18:35:03.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5c9effd700 1 --2- 172.21.15.79:0/3245537799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ca00ac3d0 0x7f5ca00d5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:03.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5c9f7fe700 1 --2- 172.21.15.79:0/3245537799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ca00ad610 0x7f5ca00aff90 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f5c90000f00 tx=0x7f5c9000ce60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:03.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5c97fff700 1 -- 172.21.15.79:0/3245537799 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5ca00ada60 con 0x7f5ca00ad610 2021-04-09T18:35:03.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5c97fff700 1 -- 172.21.15.79:0/3245537799 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c90005b80 con 0x7f5ca00ad610 2021-04-09T18:35:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5ca5f6e700 1 -- 172.21.15.79:0/3245537799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca00adfa0 con 0x7f5ca00ad610 2021-04-09T18:35:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5c97fff700 1 -- 172.21.15.79:0/3245537799 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5c90007110 con 0x7f5ca00ad610 2021-04-09T18:35:03.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5ca5f6e700 1 -- 172.21.15.79:0/3245537799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca00a4410 con 0x7f5ca00ad610 2021-04-09T18:35:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5c97fff700 1 -- 172.21.15.79:0/3245537799 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5c9001a060 con 0x7f5ca00ad610 2021-04-09T18:35:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5c97fff700 1 --2- 172.21.15.79:0/3245537799 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5c84029100 0x7f5c8402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:03.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.951 7f5c97fff700 1 -- 172.21.15.79:0/3245537799 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6096+0+0 (secure 0 0 0) 0x7f5c90039050 con 0x7f5ca00ad610 2021-04-09T18:35:03.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.955 7f5c9effd700 1 --2- 172.21.15.79:0/3245537799 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5c84029100 0x7f5c8402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:03.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.955 7f5c9effd700 1 --2- 172.21.15.79:0/3245537799 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5c84029100 0x7f5c8402b650 crc :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:03.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.955 7f5ca5f6e700 1 -- 172.21.15.79:0/3245537799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca00e39e0 con 0x7f5ca00ad610 2021-04-09T18:35:03.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:03.959 7f5c97fff700 1 -- 172.21.15.79:0/3245537799 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5ca0107f70 con 0x7f5ca00ad610 2021-04-09T18:35:04.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.127 7f5ca5f6e700 1 -- 172.21.15.79:0/3245537799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5ca00a1c80 con 0x7f5ca00ad610 2021-04-09T18:35:04.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.791 7f5c97fff700 1 -- 172.21.15.79:0/3245537799 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v120) v1 ==== 185+0+0 (secure 0 0 0) 0x7f5c90005970 con 0x7f5ca00ad610 2021-04-09T18:35:04.847 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2021-04-09T18:35:04.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.843 7f5ca5f6e700 1 -- 172.21.15.79:0/3245537799 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5c84029100 msgr2=0x7f5c8402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:04.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.843 7f5ca5f6e700 1 --2- 172.21.15.79:0/3245537799 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5c84029100 0x7f5c8402b650 crc :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:04.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.843 7f5ca5f6e700 1 -- 172.21.15.79:0/3245537799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ca00ad610 msgr2=0x7f5ca00aff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:04.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.843 7f5ca5f6e700 1 --2- 172.21.15.79:0/3245537799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ca00ad610 0x7f5ca00aff90 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f5c90000f00 tx=0x7f5c9000ce60).stop 2021-04-09T18:35:04.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.847 7f5ca5f6e700 1 -- 172.21.15.79:0/3245537799 shutdown_connections 2021-04-09T18:35:04.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.847 7f5ca5f6e700 1 --2- 172.21.15.79:0/3245537799 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5c84029100 0x7f5c8402b650 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:04.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.847 7f5ca5f6e700 1 --2- 172.21.15.79:0/3245537799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ca00ac820 0x7f5ca01af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:04.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.847 7f5ca5f6e700 1 --2- 172.21.15.79:0/3245537799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ca00ad610 0x7f5ca00aff90 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:04.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.847 7f5ca5f6e700 1 --2- 172.21.15.79:0/3245537799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ca00ac3d0 0x7f5ca00d5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:04.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.847 7f5ca5f6e700 1 -- 172.21.15.79:0/3245537799 >> 172.21.15.79:0/3245537799 conn(0x7f5ca00ba720 msgr2=0x7f5ca00d8430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:04.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.847 7f5ca5f6e700 1 -- 172.21.15.79:0/3245537799 shutdown_connections 2021-04-09T18:35:04.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.847 7f5ca5f6e700 1 -- 172.21.15.79:0/3245537799 wait complete. 2021-04-09T18:35:04.866 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-04-09T18:35:04.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa299f35700 1 Processor -- start 2021-04-09T18:35:04.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa299f35700 1 -- start start 2021-04-09T18:35:04.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa299f35700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2940e9b00 0x7fa29409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:04.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa299f35700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2941c8030 0x7fa2941ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:04.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa299f35700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2940fbb40 con 0x7fa2940f5540 2021-04-09T18:35:04.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa299f35700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2941c3de0 con 0x7fa2940e9b00 2021-04-09T18:35:04.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa299f35700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2940e9f50 con 0x7fa2941c8030 2021-04-09T18:35:04.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa292ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2940e9b00 0x7fa29409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:04.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa292ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2940e9b00 0x7fa29409f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34590/0 (socket says 172.21.15.79:34590) 2021-04-09T18:35:04.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa292ffd700 1 -- 172.21.15.79:0/2857273435 learned_addr learned my addr 172.21.15.79:0/2857273435 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:04.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa293fff700 1 --2- 172.21.15.79:0/2857273435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2941c8030 0x7fa2941ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:04.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa292ffd700 1 -- 172.21.15.79:0/2857273435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2941c8030 msgr2=0x7fa2941ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:04.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa292ffd700 1 --2- 172.21.15.79:0/2857273435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2941c8030 0x7fa2941ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:04.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa292ffd700 1 -- 172.21.15.79:0/2857273435 >> v1:172.21.15.89:6789/0 conn(0x7fa2940f5540 legacy=0x7fa2940f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:04.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa292ffd700 1 -- 172.21.15.79:0/2857273435 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2940e56f0 con 0x7fa2940e9b00 2021-04-09T18:35:04.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa292ffd700 1 --2- 172.21.15.79:0/2857273435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2940e9b00 0x7fa29409f100 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7fa2940f6f20 tx=0x7fa27c00bdd0).ready entity=mon.0 client_cookie=bf0e167e6f980d3b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:04.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa2927fc700 1 -- 172.21.15.79:0/2857273435 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa2940e56f0 con 0x7fa2940e9b00 2021-04-09T18:35:04.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa2927fc700 1 -- 172.21.15.79:0/2857273435 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27c009990 con 0x7fa2940e9b00 2021-04-09T18:35:04.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa2927fc700 1 -- 172.21.15.79:0/2857273435 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa27c009d60 con 0x7fa2940e9b00 2021-04-09T18:35:04.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa299f35700 1 -- 172.21.15.79:0/2857273435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2940e9b00 msgr2=0x7fa29409f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:04.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.955 7fa299f35700 1 --2- 172.21.15.79:0/2857273435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2940e9b00 0x7fa29409f100 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7fa2940f6f20 tx=0x7fa27c00bdd0).stop 2021-04-09T18:35:04.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.959 7fa299f35700 1 -- 172.21.15.79:0/2857273435 shutdown_connections 2021-04-09T18:35:04.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.959 7fa299f35700 1 --2- 172.21.15.79:0/2857273435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2941c8030 0x7fa2941ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:04.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.959 7fa299f35700 1 --2- 172.21.15.79:0/2857273435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2940e9b00 0x7fa29409f100 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:04.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.959 7fa299f35700 1 -- 172.21.15.79:0/2857273435 >> 172.21.15.79:0/2857273435 conn(0x7fa2940e6000 msgr2=0x7fa2940e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:04.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.959 7fa299f35700 1 -- 172.21.15.79:0/2857273435 shutdown_connections 2021-04-09T18:35:04.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.959 7fa299f35700 1 -- 172.21.15.79:0/2857273435 wait complete. 2021-04-09T18:35:04.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.959 7fa299f35700 1 Processor -- start 2021-04-09T18:35:04.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.959 7fa299f35700 1 -- start start 2021-04-09T18:35:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa299f35700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa294098bc0 0x7fa2940d5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa299f35700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa294099010 0x7fa2940c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:04.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa299f35700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2940d56a0 0x7fa2940c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:04.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa299f35700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2940b7ad0 con 0x7fa294099010 2021-04-09T18:35:04.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa299f35700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2941b1580 con 0x7fa2940d56a0 2021-04-09T18:35:04.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa299f35700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2940b7660 con 0x7fa294098bc0 2021-04-09T18:35:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa292ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa294099010 0x7fa2940c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa292ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa294099010 0x7fa2940c5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34596/0 (socket says 172.21.15.79:34596) 2021-04-09T18:35:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa292ffd700 1 -- 172.21.15.79:0/302421076 learned_addr learned my addr 172.21.15.79:0/302421076 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa2937fe700 1 --2- 172.21.15.79:0/302421076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa294098bc0 0x7fa2940d5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa293fff700 1 --2- 172.21.15.79:0/302421076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2940d56a0 0x7fa2940c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa292ffd700 1 -- 172.21.15.79:0/302421076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa294098bc0 msgr2=0x7fa2940d5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa292ffd700 1 --2- 172.21.15.79:0/302421076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa294098bc0 0x7fa2940d5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:04.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa292ffd700 1 -- 172.21.15.79:0/302421076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2940d56a0 msgr2=0x7fa2940c5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:04.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa292ffd700 1 --2- 172.21.15.79:0/302421076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2940d56a0 0x7fa2940c5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:04.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa292ffd700 1 -- 172.21.15.79:0/302421076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2940b7dd0 con 0x7fa294099010 2021-04-09T18:35:04.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa2937fe700 1 --2- 172.21.15.79:0/302421076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa294098bc0 0x7fa2940d5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:04.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa292ffd700 1 --2- 172.21.15.79:0/302421076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa294099010 0x7fa2940c5950 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7fa2940d81e0 tx=0x7fa27c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:04.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa28bfff700 1 -- 172.21.15.79:0/302421076 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa2940b7dd0 con 0x7fa294099010 2021-04-09T18:35:04.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa28bfff700 1 -- 172.21.15.79:0/302421076 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27c01d450 con 0x7fa294099010 2021-04-09T18:35:04.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa28bfff700 1 -- 172.21.15.79:0/302421076 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa27c01d820 con 0x7fa294099010 2021-04-09T18:35:04.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa299f35700 1 -- 172.21.15.79:0/302421076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2940997b0 con 0x7fa294099010 2021-04-09T18:35:04.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa299f35700 1 -- 172.21.15.79:0/302421076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2940c6740 con 0x7fa294099010 2021-04-09T18:35:04.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa28bfff700 1 -- 172.21.15.79:0/302421076 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa27c01da20 con 0x7fa294099010 2021-04-09T18:35:04.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa28bfff700 1 --2- 172.21.15.79:0/302421076 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa278029100 0x7fa27802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:04.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa28bfff700 1 -- 172.21.15.79:0/302421076 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5658+0+0 (secure 0 0 0) 0x7fa27c03c6e0 con 0x7fa294099010 2021-04-09T18:35:04.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa2937fe700 1 --2- 172.21.15.79:0/302421076 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa278029100 0x7fa27802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.963 7fa2937fe700 1 --2- 172.21.15.79:0/302421076 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa278029100 0x7fa27802b650 crc :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:04.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.967 7fa299f35700 1 -- 172.21.15.79:0/302421076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2940e39e0 con 0x7fa294099010 2021-04-09T18:35:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:04.971 7fa28bfff700 1 -- 172.21.15.79:0/302421076 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa27c011df0 con 0x7fa294099010 2021-04-09T18:35:05.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.131 7fa299f35700 1 -- 172.21.15.79:0/302421076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa2940a1c80 con 0x7fa294099010 2021-04-09T18:35:05.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.799 7fa28bfff700 1 -- 172.21.15.79:0/302421076 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v121) v1 ==== 173+0+0 (secure 0 0 0) 0x7fa27c009780 con 0x7fa294099010 2021-04-09T18:35:05.853 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2021-04-09T18:35:05.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.851 7fa299f35700 1 -- 172.21.15.79:0/302421076 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa278029100 msgr2=0x7fa27802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:05.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.851 7fa299f35700 1 --2- 172.21.15.79:0/302421076 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa278029100 0x7fa27802b650 crc :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:05.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.851 7fa299f35700 1 -- 172.21.15.79:0/302421076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa294099010 msgr2=0x7fa2940c5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:05.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.851 7fa299f35700 1 --2- 172.21.15.79:0/302421076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa294099010 0x7fa2940c5950 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7fa2940d81e0 tx=0x7fa27c006890).stop 2021-04-09T18:35:05.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.851 7fa299f35700 1 -- 172.21.15.79:0/302421076 shutdown_connections 2021-04-09T18:35:05.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.851 7fa299f35700 1 --2- 172.21.15.79:0/302421076 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa278029100 0x7fa27802b650 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:05.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.851 7fa299f35700 1 --2- 172.21.15.79:0/302421076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2940d56a0 0x7fa2940c5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:05.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.851 7fa299f35700 1 --2- 172.21.15.79:0/302421076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa294098bc0 0x7fa2940d5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:05.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.851 7fa299f35700 1 --2- 172.21.15.79:0/302421076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa294099010 0x7fa2940c5950 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:05.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.851 7fa299f35700 1 -- 172.21.15.79:0/302421076 >> 172.21.15.79:0/302421076 conn(0x7fa2940a2f20 msgr2=0x7fa2940a2480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:05.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.851 7fa299f35700 1 -- 172.21.15.79:0/302421076 shutdown_connections 2021-04-09T18:35:05.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.851 7fa299f35700 1 -- 172.21.15.79:0/302421076 wait complete. 2021-04-09T18:35:05.876 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-04-09T18:35:05.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.971 7ff253040700 1 Processor -- start 2021-04-09T18:35:05.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.971 7ff253040700 1 -- start start 2021-04-09T18:35:05.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff253040700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff24c0e9ae0 0x7ff24c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:05.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff253040700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff24c1c8010 0x7ff24c1ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:05.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff253040700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff24c0fbb20 con 0x7ff24c0f5520 2021-04-09T18:35:05.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff253040700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff24c1c3dc0 con 0x7ff24c1c8010 2021-04-09T18:35:05.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff253040700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff24c0e9f30 con 0x7ff24c0e9ae0 2021-04-09T18:35:05.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff2515e5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff24c1c8010 0x7ff24c1ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:05.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff2515e5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff24c1c8010 0x7ff24c1ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34602/0 (socket says 172.21.15.79:34602) 2021-04-09T18:35:05.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff2515e5700 1 -- 172.21.15.79:0/159506016 learned_addr learned my addr 172.21.15.79:0/159506016 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:05.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff24bfff700 1 --2- 172.21.15.79:0/159506016 >> v2:172.21.15.89:3300/0 conn(0x7ff24c0e9ae0 0x7ff24c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:05.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff2515e5700 1 -- 172.21.15.79:0/159506016 >> v2:172.21.15.89:3300/0 conn(0x7ff24c0e9ae0 msgr2=0x7ff24c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:05.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff2515e5700 1 --2- 172.21.15.79:0/159506016 >> v2:172.21.15.89:3300/0 conn(0x7ff24c0e9ae0 0x7ff24c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:05.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff2515e5700 1 -- 172.21.15.79:0/159506016 >> v1:172.21.15.89:6789/0 conn(0x7ff24c0f5520 legacy=0x7ff24c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:05.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff2515e5700 1 -- 172.21.15.79:0/159506016 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24c0e56d0 con 0x7ff24c1c8010 2021-04-09T18:35:05.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff2515e5700 1 --2- 172.21.15.79:0/159506016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff24c1c8010 0x7ff24c1ca470 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7ff244002f30 tx=0x7ff24400bd70).ready entity=mon.0 client_cookie=d0b0616b94d99220 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:05.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff24b7fe700 1 -- 172.21.15.79:0/159506016 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff24c0e56d0 con 0x7ff24c1c8010 2021-04-09T18:35:06.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff24b7fe700 1 -- 172.21.15.79:0/159506016 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff244009950 con 0x7ff24c1c8010 2021-04-09T18:35:06.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff24b7fe700 1 -- 172.21.15.79:0/159506016 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff244009d20 con 0x7ff24c1c8010 2021-04-09T18:35:06.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff253040700 1 -- 172.21.15.79:0/159506016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff24c1c8010 msgr2=0x7ff24c1ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:06.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff253040700 1 --2- 172.21.15.79:0/159506016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff24c1c8010 0x7ff24c1ca470 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7ff244002f30 tx=0x7ff24400bd70).stop 2021-04-09T18:35:06.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff253040700 1 -- 172.21.15.79:0/159506016 shutdown_connections 2021-04-09T18:35:06.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff253040700 1 --2- 172.21.15.79:0/159506016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff24c1c8010 0x7ff24c1ca470 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:06.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff253040700 1 --2- 172.21.15.79:0/159506016 >> v2:172.21.15.89:3300/0 conn(0x7ff24c0e9ae0 0x7ff24c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:06.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff253040700 1 -- 172.21.15.79:0/159506016 >> 172.21.15.79:0/159506016 conn(0x7ff24c0e5fe0 msgr2=0x7ff24c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:06.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff253040700 1 -- 172.21.15.79:0/159506016 shutdown_connections 2021-04-09T18:35:06.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.975 7ff253040700 1 -- 172.21.15.79:0/159506016 wait complete. 2021-04-09T18:35:06.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff253040700 1 Processor -- start 2021-04-09T18:35:06.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff253040700 1 -- start start 2021-04-09T18:35:06.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff253040700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff24c0c1970 0x7ff24c1af560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:06.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff253040700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff24c0b0c30 0x7ff24c0b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:06.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff253040700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24c0d4c40 0x7ff24c0d5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:06.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff253040700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c0b6b10 con 0x7ff24c0b0c30 2021-04-09T18:35:06.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff253040700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c0b6e10 con 0x7ff24c0d4c40 2021-04-09T18:35:06.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff253040700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c0b63a0 con 0x7ff24c0c1970 2021-04-09T18:35:06.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff24bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff24c0b0c30 0x7ff24c0b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:06.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff24bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff24c0b0c30 0x7ff24c0b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34610/0 (socket says 172.21.15.79:34610) 2021-04-09T18:35:06.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff24bfff700 1 -- 172.21.15.79:0/71407303 learned_addr learned my addr 172.21.15.79:0/71407303 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:06.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff2515e5700 1 --2- 172.21.15.79:0/71407303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24c0d4c40 0x7ff24c0d5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:06.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff250de4700 1 --2- 172.21.15.79:0/71407303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff24c0c1970 0x7ff24c1af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:06.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff24bfff700 1 -- 172.21.15.79:0/71407303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff24c0c1970 msgr2=0x7ff24c1af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:06.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff24bfff700 1 --2- 172.21.15.79:0/71407303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff24c0c1970 0x7ff24c1af560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:06.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff24bfff700 1 -- 172.21.15.79:0/71407303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24c0d4c40 msgr2=0x7ff24c0d5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:06.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff24bfff700 1 --2- 172.21.15.79:0/71407303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24c0d4c40 0x7ff24c0d5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:06.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff24bfff700 1 -- 172.21.15.79:0/71407303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24c0b16b0 con 0x7ff24c0b0c30 2021-04-09T18:35:06.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff2515e5700 1 --2- 172.21.15.79:0/71407303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24c0d4c40 0x7ff24c0d5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:06.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff24bfff700 1 --2- 172.21.15.79:0/71407303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff24c0b0c30 0x7ff24c0b1080 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7ff23400efc0 tx=0x7ff23400c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:06.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff2497fa700 1 -- 172.21.15.79:0/71407303 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff24c0b16b0 con 0x7ff24c0b0c30 2021-04-09T18:35:06.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff2497fa700 1 -- 172.21.15.79:0/71407303 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23400cca0 con 0x7ff24c0b0c30 2021-04-09T18:35:06.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff253040700 1 -- 172.21.15.79:0/71407303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff24c1afb90 con 0x7ff24c0b0c30 2021-04-09T18:35:06.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.979 7ff2497fa700 1 -- 172.21.15.79:0/71407303 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff23400f040 con 0x7ff24c0b0c30 2021-04-09T18:35:06.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.983 7ff253040700 1 -- 172.21.15.79:0/71407303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff24c0d56c0 con 0x7ff24c0b0c30 2021-04-09T18:35:06.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.983 7ff2497fa700 1 -- 172.21.15.79:0/71407303 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff234022060 con 0x7ff24c0b0c30 2021-04-09T18:35:06.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.983 7ff2497fa700 1 --2- 172.21.15.79:0/71407303 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff230029100 0x7ff23002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:06.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.983 7ff2497fa700 1 -- 172.21.15.79:0/71407303 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5276+0+0 (secure 0 0 0) 0x7ff234010040 con 0x7ff24c0b0c30 2021-04-09T18:35:06.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.983 7ff250de4700 1 --2- 172.21.15.79:0/71407303 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff230029100 0x7ff23002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:06.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.983 7ff250de4700 1 --2- 172.21.15.79:0/71407303 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff230029100 0x7ff23002b650 crc :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:06.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.987 7ff253040700 1 -- 172.21.15.79:0/71407303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff24c0e39e0 con 0x7ff24c0b0c30 2021-04-09T18:35:06.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:05.995 7ff2497fa700 1 -- 172.21.15.79:0/71407303 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff234000f70 con 0x7ff24c0b0c30 2021-04-09T18:35:06.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.183 7ff253040700 1 -- 172.21.15.79:0/71407303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff24c0bb3d0 con 0x7ff24c0b0c30 2021-04-09T18:35:06.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.191 7ff2497fa700 1 -- 172.21.15.79:0/71407303 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff23400ca90 con 0x7ff24c0b0c30 2021-04-09T18:35:06.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.195 7ff253040700 1 -- 172.21.15.79:0/71407303 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff230029100 msgr2=0x7ff23002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:06.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.195 7ff253040700 1 --2- 172.21.15.79:0/71407303 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff230029100 0x7ff23002b650 crc :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:06.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.195 7ff253040700 1 -- 172.21.15.79:0/71407303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff24c0b0c30 msgr2=0x7ff24c0b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:06.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.195 7ff253040700 1 --2- 172.21.15.79:0/71407303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff24c0b0c30 0x7ff24c0b1080 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7ff23400efc0 tx=0x7ff23400c430).stop 2021-04-09T18:35:06.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.195 7ff253040700 1 -- 172.21.15.79:0/71407303 shutdown_connections 2021-04-09T18:35:06.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.195 7ff253040700 1 --2- 172.21.15.79:0/71407303 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff230029100 0x7ff23002b650 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:06.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.195 7ff253040700 1 --2- 172.21.15.79:0/71407303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24c0d4c40 0x7ff24c0d5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:06.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.195 7ff253040700 1 --2- 172.21.15.79:0/71407303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff24c0c1970 0x7ff24c1af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:06.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.195 7ff253040700 1 --2- 172.21.15.79:0/71407303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff24c0b0c30 0x7ff24c0b1080 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:06.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.195 7ff253040700 1 -- 172.21.15.79:0/71407303 >> 172.21.15.79:0/71407303 conn(0x7ff24c0a24c0 msgr2=0x7ff24c0d8420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:06.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.195 7ff253040700 1 -- 172.21.15.79:0/71407303 shutdown_connections 2021-04-09T18:35:06.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.195 7ff253040700 1 -- 172.21.15.79:0/71407303 wait complete. 2021-04-09T18:35:06.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2021-04-09T18:35:06.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.299 7f4a70dff700 1 Processor -- start 2021-04-09T18:35:06.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.299 7f4a70dff700 1 -- start start 2021-04-09T18:35:06.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a70dff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4a6c0f5520 0x7f4a6c0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:06.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a70dff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a6c0e9ae0 0x7f4a6c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:06.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a70dff700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6c0fbb20 con 0x7f4a6c1c2db0 2021-04-09T18:35:06.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a70dff700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6c0e9f30 con 0x7f4a6c0f5520 2021-04-09T18:35:06.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a70dff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c0e59d0 con 0x7f4a6c0e9ae0 2021-04-09T18:35:06.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a6b2f0700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4a6c1c2db0 0x7f4a6c1c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57560/0 (socket says 172.21.15.79:57560) 2021-04-09T18:35:06.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a6b2f0700 1 -- 172.21.15.79:0/2745979369 learned_addr learned my addr 172.21.15.79:0/2745979369 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:06.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a6aaef700 1 --2- 172.21.15.79:0/2745979369 >> v2:172.21.15.89:3300/0 conn(0x7f4a6c0f5520 0x7f4a6c0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:06.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a6a2ee700 1 --2- 172.21.15.79:0/2745979369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a6c0e9ae0 0x7f4a6c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:06.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a69aed700 1 -- 172.21.15.79:0/2745979369 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382281078 0 0) 0x7f4a640010d0 con 0x7f4a6c1c2db0 2021-04-09T18:35:06.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a69aed700 1 -- 172.21.15.79:0/2745979369 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a58003240 con 0x7f4a6c1c2db0 2021-04-09T18:35:06.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a6a2ee700 1 -- 172.21.15.79:0/2745979369 >> v2:172.21.15.89:3300/0 conn(0x7f4a6c0f5520 msgr2=0x7f4a6c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:06.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a6a2ee700 1 --2- 172.21.15.79:0/2745979369 >> v2:172.21.15.89:3300/0 conn(0x7f4a6c0f5520 0x7f4a6c0f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:06.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a6a2ee700 1 -- 172.21.15.79:0/2745979369 >> v1:172.21.15.79:6789/0 conn(0x7f4a6c1c2db0 legacy=0x7f4a6c1c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:06.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a6a2ee700 1 -- 172.21.15.79:0/2745979369 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c0e56d0 con 0x7f4a6c0e9ae0 2021-04-09T18:35:06.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a6aaef700 1 --2- 172.21.15.79:0/2745979369 >> v2:172.21.15.89:3300/0 conn(0x7f4a6c0f5520 0x7f4a6c0f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:06.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a6a2ee700 1 --2- 172.21.15.79:0/2745979369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a6c0e9ae0 0x7f4a6c09f110 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f4a54002f30 tx=0x7f4a5400bcc0).ready entity=mon.2 client_cookie=e8c2191c9af898a0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:06.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a69aed700 1 -- 172.21.15.79:0/2745979369 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a6c0e56d0 con 0x7f4a6c0e9ae0 2021-04-09T18:35:06.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a69aed700 1 -- 172.21.15.79:0/2745979369 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a54009800 con 0x7f4a6c0e9ae0 2021-04-09T18:35:06.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a69aed700 1 -- 172.21.15.79:0/2745979369 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a54009bd0 con 0x7f4a6c0e9ae0 2021-04-09T18:35:06.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a70dff700 1 -- 172.21.15.79:0/2745979369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a6c0e9ae0 msgr2=0x7f4a6c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:06.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a70dff700 1 --2- 172.21.15.79:0/2745979369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a6c0e9ae0 0x7f4a6c09f110 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f4a54002f30 tx=0x7f4a5400bcc0).stop 2021-04-09T18:35:06.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a70dff700 1 -- 172.21.15.79:0/2745979369 shutdown_connections 2021-04-09T18:35:06.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a70dff700 1 --2- 172.21.15.79:0/2745979369 >> v2:172.21.15.89:3300/0 conn(0x7f4a6c0f5520 0x7f4a6c0f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:06.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a70dff700 1 --2- 172.21.15.79:0/2745979369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a6c0e9ae0 0x7f4a6c09f110 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:06.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a70dff700 1 -- 172.21.15.79:0/2745979369 >> 172.21.15.79:0/2745979369 conn(0x7f4a6c0e5fe0 msgr2=0x7f4a6c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:06.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a70dff700 1 -- 172.21.15.79:0/2745979369 shutdown_connections 2021-04-09T18:35:06.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.303 7f4a70dff700 1 -- 172.21.15.79:0/2745979369 wait complete. 2021-04-09T18:35:06.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.307 7f4a70dff700 1 Processor -- start 2021-04-09T18:35:06.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.307 7f4a70dff700 1 -- start start 2021-04-09T18:35:06.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.307 7f4a70dff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a6c0b8e20 0x7f4a6c0cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:06.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.307 7f4a70dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a6c0d0150 0x7f4a6c0d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:06.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.307 7f4a70dff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a6c0d0ef0 0x7f4a6c093f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:06.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.307 7f4a70dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c094fa0 con 0x7f4a6c0d0150 2021-04-09T18:35:06.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.307 7f4a70dff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c1aa000 con 0x7f4a6c0b8e20 2021-04-09T18:35:06.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.307 7f4a70dff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c09a250 con 0x7f4a6c0d0ef0 2021-04-09T18:35:06.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.307 7f4a6a2ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a6c0d0150 0x7f4a6c0d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:06.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.307 7f4a6a2ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a6c0d0150 0x7f4a6c0d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34622/0 (socket says 172.21.15.79:34622) 2021-04-09T18:35:06.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.307 7f4a6aaef700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a6c0b8e20 0x7f4a6c0cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:06.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.307 7f4a6b2f0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a6c0d0ef0 0x7f4a6c093f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:06.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.307 7f4a6a2ee700 1 -- 172.21.15.79:0/2835810363 learned_addr learned my addr 172.21.15.79:0/2835810363 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:06.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.311 7f4a6a2ee700 1 -- 172.21.15.79:0/2835810363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a6c0d0ef0 msgr2=0x7f4a6c093f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:06.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.311 7f4a6a2ee700 1 --2- 172.21.15.79:0/2835810363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a6c0d0ef0 0x7f4a6c093f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:06.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.311 7f4a6a2ee700 1 -- 172.21.15.79:0/2835810363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a6c0b8e20 msgr2=0x7f4a6c0cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:06.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.311 7f4a6a2ee700 1 --2- 172.21.15.79:0/2835810363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a6c0b8e20 0x7f4a6c0cfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:06.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.311 7f4a6a2ee700 1 -- 172.21.15.79:0/2835810363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c09a9c0 con 0x7f4a6c0d0150 2021-04-09T18:35:06.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.311 7f4a6a2ee700 1 --2- 172.21.15.79:0/2835810363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a6c0d0150 0x7f4a6c0d08c0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f4a6c0b9990 tx=0x7f4a54006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:06.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.311 7f4a637fe700 1 -- 172.21.15.79:0/2835810363 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a6c09a9c0 con 0x7f4a6c0d0150 2021-04-09T18:35:06.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.311 7f4a637fe700 1 -- 172.21.15.79:0/2835810363 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a54011c90 con 0x7f4a6c0d0150 2021-04-09T18:35:06.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.311 7f4a637fe700 1 -- 172.21.15.79:0/2835810363 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a5401d630 con 0x7f4a6c0d0150 2021-04-09T18:35:06.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.311 7f4a70dff700 1 -- 172.21.15.79:0/2835810363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6c0b9270 con 0x7f4a6c0d0150 2021-04-09T18:35:06.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.311 7f4a70dff700 1 -- 172.21.15.79:0/2835810363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6c099b80 con 0x7f4a6c0d0150 2021-04-09T18:35:06.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.311 7f4a637fe700 1 -- 172.21.15.79:0/2835810363 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4a54026450 con 0x7f4a6c0d0150 2021-04-09T18:35:06.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.311 7f4a637fe700 1 --2- 172.21.15.79:0/2835810363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a50029100 0x7f4a5002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:06.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.311 7f4a637fe700 1 -- 172.21.15.79:0/2835810363 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f4a5403a430 con 0x7f4a6c0d0150 2021-04-09T18:35:06.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.311 7f4a6aaef700 1 --2- 172.21.15.79:0/2835810363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a50029100 0x7f4a5002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:06.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.311 7f4a6aaef700 1 --2- 172.21.15.79:0/2835810363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a50029100 0x7f4a5002b650 crc :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:06.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.315 7f4a70dff700 1 -- 172.21.15.79:0/2835810363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6c0e39e0 con 0x7f4a6c0d0150 2021-04-09T18:35:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.323 7f4a637fe700 1 -- 172.21.15.79:0/2835810363 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4a54011a80 con 0x7f4a6c0d0150 2021-04-09T18:35:06.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.483 7f4a70dff700 1 -- 172.21.15.79:0/2835810363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7f4a6c0f5b20 con 0x7f4a6c0d0150 2021-04-09T18:35:06.811 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.807 7f4a637fe700 1 -- 172.21.15.79:0/2835810363 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v282) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4a540095f0 con 0x7f4a6c0d0150 2021-04-09T18:35:06.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.851 7f4a70dff700 1 -- 172.21.15.79:0/2835810363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a50029100 msgr2=0x7f4a5002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:06.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.851 7f4a70dff700 1 --2- 172.21.15.79:0/2835810363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a50029100 0x7f4a5002b650 crc :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:06.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.851 7f4a70dff700 1 -- 172.21.15.79:0/2835810363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a6c0d0150 msgr2=0x7f4a6c0d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:06.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.851 7f4a70dff700 1 --2- 172.21.15.79:0/2835810363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a6c0d0150 0x7f4a6c0d08c0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f4a6c0b9990 tx=0x7f4a54006890).stop 2021-04-09T18:35:06.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.851 7f4a70dff700 1 -- 172.21.15.79:0/2835810363 shutdown_connections 2021-04-09T18:35:06.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.851 7f4a70dff700 1 --2- 172.21.15.79:0/2835810363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4a50029100 0x7f4a5002b650 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:06.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.851 7f4a70dff700 1 --2- 172.21.15.79:0/2835810363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a6c0b8e20 0x7f4a6c0cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:06.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.851 7f4a70dff700 1 --2- 172.21.15.79:0/2835810363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a6c0d0ef0 0x7f4a6c093f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:06.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.851 7f4a70dff700 1 --2- 172.21.15.79:0/2835810363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a6c0d0150 0x7f4a6c0d08c0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:06.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.851 7f4a70dff700 1 -- 172.21.15.79:0/2835810363 >> 172.21.15.79:0/2835810363 conn(0x7f4a6c0baec0 msgr2=0x7f4a6c0d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:06.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.851 7f4a70dff700 1 -- 172.21.15.79:0/2835810363 shutdown_connections 2021-04-09T18:35:06.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.851 7f4a70dff700 1 -- 172.21.15.79:0/2835810363 wait complete. 2021-04-09T18:35:06.875 INFO:tasks.cephfs_test_runner:test_fs_new (tasks.cephfs.test_misc.TestMisc) ... ok 2021-04-09T18:35:06.876 INFO:tasks.cephfs_test_runner:Starting test: test_getattr_caps (tasks.cephfs.test_misc.TestMisc) 2021-04-09T18:35:06.877 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2021-04-09T18:35:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.971 7fe880a5b700 1 Processor -- start 2021-04-09T18:35:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.971 7fe880a5b700 1 -- start start 2021-04-09T18:35:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe880a5b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c0f5520 0x7fe87c0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe880a5b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe87c1c8010 0x7fe87c1ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe880a5b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe87c0fbb20 con 0x7fe87c0e9ae0 2021-04-09T18:35:06.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe880a5b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87c0e9f30 con 0x7fe87c1c8010 2021-04-09T18:35:06.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe880a5b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c1c3dc0 con 0x7fe87c0f5520 2021-04-09T18:35:06.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe879fe5700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe87c0e9ae0 0x7fe87c09f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57570/0 (socket says 172.21.15.79:57570) 2021-04-09T18:35:06.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe879fe5700 1 -- 172.21.15.79:0/281512302 learned_addr learned my addr 172.21.15.79:0/281512302 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:06.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe87afe7700 1 --2- 172.21.15.79:0/281512302 >> v2:172.21.15.89:3300/0 conn(0x7fe87c1c8010 0x7fe87c1ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:06.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe87a7e6700 1 --2- 172.21.15.79:0/281512302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c0f5520 0x7fe87c0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:06.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe8797e4700 1 -- 172.21.15.79:0/281512302 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189124993 0 0) 0x7fe8700010d0 con 0x7fe87c0e9ae0 2021-04-09T18:35:06.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe8797e4700 1 -- 172.21.15.79:0/281512302 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe864003240 con 0x7fe87c0e9ae0 2021-04-09T18:35:06.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe87a7e6700 1 -- 172.21.15.79:0/281512302 >> v2:172.21.15.89:3300/0 conn(0x7fe87c1c8010 msgr2=0x7fe87c1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:06.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe87a7e6700 1 --2- 172.21.15.79:0/281512302 >> v2:172.21.15.89:3300/0 conn(0x7fe87c1c8010 0x7fe87c1ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:06.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe87a7e6700 1 -- 172.21.15.79:0/281512302 >> v1:172.21.15.79:6789/0 conn(0x7fe87c0e9ae0 legacy=0x7fe87c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:06.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe87a7e6700 1 -- 172.21.15.79:0/281512302 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87c09f910 con 0x7fe87c0f5520 2021-04-09T18:35:06.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe87a7e6700 1 --2- 172.21.15.79:0/281512302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c0f5520 0x7fe87c0f64b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fe86c002f30 tx=0x7fe86c00bcc0).ready entity=mon.2 client_cookie=c2f5f2e43665b72 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:07.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe8797e4700 1 -- 172.21.15.79:0/281512302 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe87c09f910 con 0x7fe87c0f5520 2021-04-09T18:35:07.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe8797e4700 1 -- 172.21.15.79:0/281512302 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c009800 con 0x7fe87c0f5520 2021-04-09T18:35:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe8797e4700 1 -- 172.21.15.79:0/281512302 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe86c009bd0 con 0x7fe87c0f5520 2021-04-09T18:35:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe880a5b700 1 -- 172.21.15.79:0/281512302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c0f5520 msgr2=0x7fe87c0f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe880a5b700 1 --2- 172.21.15.79:0/281512302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c0f5520 0x7fe87c0f64b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fe86c002f30 tx=0x7fe86c00bcc0).stop 2021-04-09T18:35:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe880a5b700 1 -- 172.21.15.79:0/281512302 shutdown_connections 2021-04-09T18:35:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe880a5b700 1 --2- 172.21.15.79:0/281512302 >> v2:172.21.15.89:3300/0 conn(0x7fe87c1c8010 0x7fe87c1ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe880a5b700 1 --2- 172.21.15.79:0/281512302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c0f5520 0x7fe87c0f64b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:07.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe880a5b700 1 -- 172.21.15.79:0/281512302 >> 172.21.15.79:0/281512302 conn(0x7fe87c0e5fe0 msgr2=0x7fe87c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:07.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe880a5b700 1 -- 172.21.15.79:0/281512302 shutdown_connections 2021-04-09T18:35:07.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.975 7fe880a5b700 1 -- 172.21.15.79:0/281512302 wait complete. 2021-04-09T18:35:07.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.979 7fe880a5b700 1 Processor -- start 2021-04-09T18:35:07.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.979 7fe880a5b700 1 -- start start 2021-04-09T18:35:07.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.979 7fe880a5b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe87c095b50 0x7fe87c0d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:07.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.979 7fe880a5b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c095fa0 0x7fe87c0b9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:07.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.979 7fe880a5b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe87c0d22a0 0x7fe87c0ba2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:07.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.979 7fe880a5b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c0b86d0 con 0x7fe87c095b50 2021-04-09T18:35:07.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.979 7fe880a5b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c0bd820 con 0x7fe87c0d22a0 2021-04-09T18:35:07.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.979 7fe880a5b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c0aec50 con 0x7fe87c095fa0 2021-04-09T18:35:07.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe87a7e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe87c095b50 0x7fe87c0d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:07.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe87a7e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe87c095b50 0x7fe87c0d1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34636/0 (socket says 172.21.15.79:34636) 2021-04-09T18:35:07.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe879fe5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c095fa0 0x7fe87c0b9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe87a7e6700 1 -- 172.21.15.79:0/2310909286 learned_addr learned my addr 172.21.15.79:0/2310909286 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe87afe7700 1 --2- 172.21.15.79:0/2310909286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe87c0d22a0 0x7fe87c0ba2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe87a7e6700 1 -- 172.21.15.79:0/2310909286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c095fa0 msgr2=0x7fe87c0b9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe87a7e6700 1 --2- 172.21.15.79:0/2310909286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c095fa0 0x7fe87c0b9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe87a7e6700 1 -- 172.21.15.79:0/2310909286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe87c0d22a0 msgr2=0x7fe87c0ba2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe87a7e6700 1 --2- 172.21.15.79:0/2310909286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe87c0d22a0 0x7fe87c0ba2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe87a7e6700 1 -- 172.21.15.79:0/2310909286 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87c0ba8d0 con 0x7fe87c095b50 2021-04-09T18:35:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe879fe5700 1 --2- 172.21.15.79:0/2310909286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c095fa0 0x7fe87c0b9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:07.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe87a7e6700 1 --2- 172.21.15.79:0/2310909286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe87c095b50 0x7fe87c0d1c70 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7fe86c002f30 tx=0x7fe86c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:07.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe86affd700 1 -- 172.21.15.79:0/2310909286 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe87c0ba8d0 con 0x7fe87c095b50 2021-04-09T18:35:07.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe86affd700 1 -- 172.21.15.79:0/2310909286 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c0119e0 con 0x7fe87c095b50 2021-04-09T18:35:07.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe880a5b700 1 -- 172.21.15.79:0/2310909286 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe87c0bab90 con 0x7fe87c095b50 2021-04-09T18:35:07.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe86affd700 1 -- 172.21.15.79:0/2310909286 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe86c011db0 con 0x7fe87c095b50 2021-04-09T18:35:07.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe880a5b700 1 -- 172.21.15.79:0/2310909286 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87c1a85f0 con 0x7fe87c095b50 2021-04-09T18:35:07.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe86affd700 1 -- 172.21.15.79:0/2310909286 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe86c01c3e0 con 0x7fe87c095b50 2021-04-09T18:35:07.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe86affd700 1 --2- 172.21.15.79:0/2310909286 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe860029100 0x7fe86002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:07.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe86affd700 1 -- 172.21.15.79:0/2310909286 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5276+0+0 (secure 0 0 0) 0x7fe86c03b350 con 0x7fe87c095b50 2021-04-09T18:35:07.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.983 7fe879fe5700 1 --2- 172.21.15.79:0/2310909286 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe860029100 0x7fe86002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:07.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.987 7fe879fe5700 1 --2- 172.21.15.79:0/2310909286 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe860029100 0x7fe86002b650 crc :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:07.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.987 7fe880a5b700 1 -- 172.21.15.79:0/2310909286 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe87c0e39e0 con 0x7fe87c095b50 2021-04-09T18:35:07.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:06.995 7fe86affd700 1 -- 172.21.15.79:0/2310909286 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe86c0117d0 con 0x7fe87c095b50 2021-04-09T18:35:07.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.163 7fe880a5b700 1 -- 172.21.15.79:0/2310909286 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7fe87c0f5b20 con 0x7fe87c095b50 2021-04-09T18:35:07.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.807 7fe86affd700 1 -- 172.21.15.79:0/2310909286 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v283) v1 ==== 131+0+0 (secure 0 0 0) 0x7fe86c0095f0 con 0x7fe87c095b50 2021-04-09T18:35:07.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.831 7fe880a5b700 1 -- 172.21.15.79:0/2310909286 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe860029100 msgr2=0x7fe86002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:07.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.831 7fe880a5b700 1 --2- 172.21.15.79:0/2310909286 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe860029100 0x7fe86002b650 crc :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:07.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.831 7fe880a5b700 1 -- 172.21.15.79:0/2310909286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe87c095b50 msgr2=0x7fe87c0d1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:07.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.831 7fe880a5b700 1 --2- 172.21.15.79:0/2310909286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe87c095b50 0x7fe87c0d1c70 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7fe86c002f30 tx=0x7fe86c006890).stop 2021-04-09T18:35:07.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.831 7fe880a5b700 1 -- 172.21.15.79:0/2310909286 shutdown_connections 2021-04-09T18:35:07.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.831 7fe880a5b700 1 --2- 172.21.15.79:0/2310909286 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe860029100 0x7fe86002b650 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:07.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.831 7fe880a5b700 1 --2- 172.21.15.79:0/2310909286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe87c0d22a0 0x7fe87c0ba2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:07.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.831 7fe880a5b700 1 --2- 172.21.15.79:0/2310909286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe87c095b50 0x7fe87c0d1c70 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:07.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.831 7fe880a5b700 1 --2- 172.21.15.79:0/2310909286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe87c095fa0 0x7fe87c0b9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:07.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.831 7fe880a5b700 1 -- 172.21.15.79:0/2310909286 >> 172.21.15.79:0/2310909286 conn(0x7fe87c0d8a10 msgr2=0x7fe87c08fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:07.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.831 7fe880a5b700 1 -- 172.21.15.79:0/2310909286 shutdown_connections 2021-04-09T18:35:07.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.831 7fe880a5b700 1 -- 172.21.15.79:0/2310909286 wait complete. 2021-04-09T18:35:07.853 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-04-09T18:35:07.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9f8af700 1 Processor -- start 2021-04-09T18:35:07.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9f8af700 1 -- start start 2021-04-09T18:35:07.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9f8af700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c980e9b10 0x7f6c9809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:07.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9f8af700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6c981c8040 0x7f6c981ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:07.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9f8af700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c980fbb50 con 0x7f6c980f5550 2021-04-09T18:35:07.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9f8af700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c981c3df0 con 0x7f6c980e9b10 2021-04-09T18:35:07.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9f8af700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c980e9f60 con 0x7f6c981c8040 2021-04-09T18:35:07.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9d653700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6c980f5550 0x7f6c980f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57584/0 (socket says 172.21.15.79:57584) 2021-04-09T18:35:07.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9ce52700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c980e9b10 0x7f6c9809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:07.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9d653700 1 -- 172.21.15.79:0/1931756894 learned_addr learned my addr 172.21.15.79:0/1931756894 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:07.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9de54700 1 --2- 172.21.15.79:0/1931756894 >> v2:172.21.15.89:3300/0 conn(0x7f6c981c8040 0x7f6c981ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c97fff700 1 -- 172.21.15.79:0/1931756894 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168056256 0 0) 0x7f6c880010d0 con 0x7f6c980f5550 2021-04-09T18:35:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c97fff700 1 -- 172.21.15.79:0/1931756894 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c84003240 con 0x7f6c980f5550 2021-04-09T18:35:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9ce52700 1 -- 172.21.15.79:0/1931756894 >> v2:172.21.15.89:3300/0 conn(0x7f6c981c8040 msgr2=0x7f6c981ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9ce52700 1 --2- 172.21.15.79:0/1931756894 >> v2:172.21.15.89:3300/0 conn(0x7f6c981c8040 0x7f6c981ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:07.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9ce52700 1 -- 172.21.15.79:0/1931756894 >> v1:172.21.15.79:6789/0 conn(0x7f6c980f5550 legacy=0x7f6c980f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:07.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9ce52700 1 -- 172.21.15.79:0/1931756894 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c980e5700 con 0x7f6c980e9b10 2021-04-09T18:35:07.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9de54700 1 --2- 172.21.15.79:0/1931756894 >> v2:172.21.15.89:3300/0 conn(0x7f6c981c8040 0x7f6c981ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:07.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9ce52700 1 --2- 172.21.15.79:0/1931756894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c980e9b10 0x7f6c9809f110 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7f6c90002f30 tx=0x7f6c9000bd10).ready entity=mon.0 client_cookie=5d51874c31cea7ef server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:07.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c97fff700 1 -- 172.21.15.79:0/1931756894 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c980e5700 con 0x7f6c980e9b10 2021-04-09T18:35:07.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c97fff700 1 -- 172.21.15.79:0/1931756894 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c900098a0 con 0x7f6c980e9b10 2021-04-09T18:35:07.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c97fff700 1 -- 172.21.15.79:0/1931756894 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c90009c70 con 0x7f6c980e9b10 2021-04-09T18:35:07.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9f8af700 1 -- 172.21.15.79:0/1931756894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c980e9b10 msgr2=0x7f6c9809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:07.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9f8af700 1 --2- 172.21.15.79:0/1931756894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c980e9b10 0x7f6c9809f110 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7f6c90002f30 tx=0x7f6c9000bd10).stop 2021-04-09T18:35:07.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9f8af700 1 -- 172.21.15.79:0/1931756894 shutdown_connections 2021-04-09T18:35:07.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9f8af700 1 --2- 172.21.15.79:0/1931756894 >> v2:172.21.15.89:3300/0 conn(0x7f6c981c8040 0x7f6c981ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:07.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9f8af700 1 --2- 172.21.15.79:0/1931756894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c980e9b10 0x7f6c9809f110 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:07.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.947 7f6c9f8af700 1 -- 172.21.15.79:0/1931756894 >> 172.21.15.79:0/1931756894 conn(0x7f6c980e6010 msgr2=0x7f6c980e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:07.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.951 7f6c9f8af700 1 -- 172.21.15.79:0/1931756894 shutdown_connections 2021-04-09T18:35:07.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.951 7f6c9f8af700 1 -- 172.21.15.79:0/1931756894 wait complete. 2021-04-09T18:35:07.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.951 7f6c9f8af700 1 Processor -- start 2021-04-09T18:35:07.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.951 7f6c9f8af700 1 -- start start 2021-04-09T18:35:07.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.951 7f6c9f8af700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c98091830 0x7f6c9809a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:07.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.951 7f6c9f8af700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c980d0980 0x7f6c980d0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:07.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.951 7f6c9f8af700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c9808f7d0 0x7f6c9808fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:07.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.951 7f6c9f8af700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c98047500 con 0x7f6c98091830 2021-04-09T18:35:07.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.951 7f6c9f8af700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9809ad00 con 0x7f6c980d0980 2021-04-09T18:35:07.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.951 7f6c9f8af700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9809b000 con 0x7f6c9808f7d0 2021-04-09T18:35:07.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.951 7f6c9d653700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c98091830 0x7f6c9809a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:07.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.951 7f6c9d653700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c98091830 0x7f6c9809a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34648/0 (socket says 172.21.15.79:34648) 2021-04-09T18:35:07.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.951 7f6c9d653700 1 -- 172.21.15.79:0/664756331 learned_addr learned my addr 172.21.15.79:0/664756331 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:07.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.951 7f6c9de54700 1 --2- 172.21.15.79:0/664756331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c9808f7d0 0x7f6c9808fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:07.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.951 7f6c9ce52700 1 --2- 172.21.15.79:0/664756331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c980d0980 0x7f6c980d0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:07.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.951 7f6c9d653700 1 -- 172.21.15.79:0/664756331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c9808f7d0 msgr2=0x7f6c9808fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:07.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.951 7f6c9d653700 1 --2- 172.21.15.79:0/664756331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c9808f7d0 0x7f6c9808fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:07.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.951 7f6c9d653700 1 -- 172.21.15.79:0/664756331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c980d0980 msgr2=0x7f6c980d0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:07.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.951 7f6c9d653700 1 --2- 172.21.15.79:0/664756331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c980d0980 0x7f6c980d0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:07.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.955 7f6c9d653700 1 -- 172.21.15.79:0/664756331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9809b240 con 0x7f6c98091830 2021-04-09T18:35:07.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.955 7f6c9d653700 1 --2- 172.21.15.79:0/664756331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c98091830 0x7f6c9809a560 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f6c98093f20 tx=0x7f6c8800cb10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:07.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.955 7f6c95ffb700 1 -- 172.21.15.79:0/664756331 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c9809b240 con 0x7f6c98091830 2021-04-09T18:35:07.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.955 7f6c95ffb700 1 -- 172.21.15.79:0/664756331 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c880072e0 con 0x7f6c98091830 2021-04-09T18:35:07.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.955 7f6c95ffb700 1 -- 172.21.15.79:0/664756331 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c880057e0 con 0x7f6c98091830 2021-04-09T18:35:07.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.955 7f6c9f8af700 1 -- 172.21.15.79:0/664756331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c980999e0 con 0x7f6c98091830 2021-04-09T18:35:07.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.955 7f6c9f8af700 1 -- 172.21.15.79:0/664756331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c98090250 con 0x7f6c98091830 2021-04-09T18:35:07.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.955 7f6c95ffb700 1 -- 172.21.15.79:0/664756331 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6c880059e0 con 0x7f6c98091830 2021-04-09T18:35:07.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.955 7f6c95ffb700 1 --2- 172.21.15.79:0/664756331 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6c7c029100 0x7f6c7c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:07.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.955 7f6c95ffb700 1 -- 172.21.15.79:0/664756331 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f6c88038be0 con 0x7f6c98091830 2021-04-09T18:35:07.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.955 7f6c9ce52700 1 --2- 172.21.15.79:0/664756331 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6c7c029100 0x7f6c7c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:07.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.955 7f6c9ce52700 1 --2- 172.21.15.79:0/664756331 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6c7c029100 0x7f6c7c02b650 crc :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:07.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.959 7f6c9f8af700 1 -- 172.21.15.79:0/664756331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c980e39f0 con 0x7f6c98091830 2021-04-09T18:35:07.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:07.967 7f6c95ffb700 1 -- 172.21.15.79:0/664756331 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6c880070d0 con 0x7f6c98091830 2021-04-09T18:35:08.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.151 7f6c9f8af700 1 -- 172.21.15.79:0/664756331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6c980f5b50 con 0x7f6c98091830 2021-04-09T18:35:08.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.155 7f6c95ffb700 1 -- 172.21.15.79:0/664756331 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6c98107f80 con 0x7f6c98091830 2021-04-09T18:35:08.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.159 7f6c9f8af700 1 -- 172.21.15.79:0/664756331 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6c7c029100 msgr2=0x7f6c7c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:08.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.159 7f6c9f8af700 1 --2- 172.21.15.79:0/664756331 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6c7c029100 0x7f6c7c02b650 crc :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:08.166 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.159 7f6c9f8af700 1 -- 172.21.15.79:0/664756331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c98091830 msgr2=0x7f6c9809a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:08.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.159 7f6c9f8af700 1 --2- 172.21.15.79:0/664756331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c98091830 0x7f6c9809a560 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f6c98093f20 tx=0x7f6c8800cb10).stop 2021-04-09T18:35:08.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.159 7f6c9f8af700 1 -- 172.21.15.79:0/664756331 shutdown_connections 2021-04-09T18:35:08.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.159 7f6c9f8af700 1 --2- 172.21.15.79:0/664756331 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6c7c029100 0x7f6c7c02b650 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:08.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.159 7f6c9f8af700 1 --2- 172.21.15.79:0/664756331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c9808f7d0 0x7f6c9808fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:08.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.159 7f6c9f8af700 1 --2- 172.21.15.79:0/664756331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c98091830 0x7f6c9809a560 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:08.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.159 7f6c9f8af700 1 --2- 172.21.15.79:0/664756331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c980d0980 0x7f6c980d0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:08.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.159 7f6c9f8af700 1 -- 172.21.15.79:0/664756331 >> 172.21.15.79:0/664756331 conn(0x7f6c98093f60 msgr2=0x7f6c980b9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:08.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.159 7f6c9f8af700 1 -- 172.21.15.79:0/664756331 shutdown_connections 2021-04-09T18:35:08.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.159 7f6c9f8af700 1 -- 172.21.15.79:0/664756331 wait complete. 2021-04-09T18:35:08.177 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:35:08.178 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:08.191 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:08.211 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:08.229 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:08.248 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:08.267 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:35:08.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:08.268 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:08.269 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:08.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:35:08.276 INFO:teuthology.orchestra.run.smithi090.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-04-09T18:35:08.276 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-04-09T18:35:08.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:08.277 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:08.277 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:08.306 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-04-09T18:35:08.306 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:35:08.307 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-04-09T18:35:08.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:08.308 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:08.309 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:35:08.335 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:35:08.336 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:35:08.343 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:35:08.344 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:35:08.474 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.451 7faf4c6ed700 1 Processor -- start 2021-04-09T18:35:08.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.451 7faf4c6ed700 1 -- start start 2021-04-09T18:35:08.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf4c6ed700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf440e9ad0 0x7faf4409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:08.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf4c6ed700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf440fbb10 con 0x7faf440f5510 2021-04-09T18:35:08.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf4c6ed700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf440e56c0 con 0x7faf441c8000 2021-04-09T18:35:08.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf4c6ed700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf441c3db0 con 0x7faf440e9ad0 2021-04-09T18:35:08.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf4a491700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7faf440f5510 0x7faf440f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57598/0 (socket says 172.21.15.79:57598) 2021-04-09T18:35:08.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf4a491700 1 -- 172.21.15.79:0/3274224822 learned_addr learned my addr 172.21.15.79:0/3274224822 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:08.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf49c90700 1 --2- 172.21.15.79:0/3274224822 >> v2:172.21.15.89:3300/0 conn(0x7faf440e9ad0 0x7faf4409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:08.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf4948f700 1 -- 172.21.15.79:0/3274224822 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029672621 0 0) 0x7faf400010d0 con 0x7faf440f5510 2021-04-09T18:35:08.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf4948f700 1 -- 172.21.15.79:0/3274224822 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf30003240 con 0x7faf440f5510 2021-04-09T18:35:08.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf49c90700 1 -- 172.21.15.79:0/3274224822 >> v1:172.21.15.89:6789/0 conn(0x7faf441c8000 legacy=0x7faf441ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:08.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf4948f700 1 -- 172.21.15.79:0/3274224822 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093298018 0 0) 0x7faf3c001450 con 0x7faf441c8000 2021-04-09T18:35:08.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf49c90700 1 -- 172.21.15.79:0/3274224822 >> v1:172.21.15.79:6789/0 conn(0x7faf440f5510 legacy=0x7faf440f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:08.482 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf49c90700 1 -- 172.21.15.79:0/3274224822 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf440e4320 con 0x7faf440e9ad0 2021-04-09T18:35:08.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf49c90700 1 --2- 172.21.15.79:0/3274224822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf440e9ad0 0x7faf4409f100 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7faf34002f30 tx=0x7faf3400bcc0).ready entity=mon.1 client_cookie=b034bcbe6bd6cc80 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:08.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf4948f700 1 -- 172.21.15.79:0/3274224822 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf440e4320 con 0x7faf440e9ad0 2021-04-09T18:35:08.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf4948f700 1 -- 172.21.15.79:0/3274224822 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf34009800 con 0x7faf440e9ad0 2021-04-09T18:35:08.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf4948f700 1 -- 172.21.15.79:0/3274224822 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf34009bd0 con 0x7faf440e9ad0 2021-04-09T18:35:08.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf4c6ed700 1 -- 172.21.15.79:0/3274224822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf440e9ad0 msgr2=0x7faf4409f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:08.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf4c6ed700 1 --2- 172.21.15.79:0/3274224822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf440e9ad0 0x7faf4409f100 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7faf34002f30 tx=0x7faf3400bcc0).stop 2021-04-09T18:35:08.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf4c6ed700 1 -- 172.21.15.79:0/3274224822 shutdown_connections 2021-04-09T18:35:08.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf4c6ed700 1 --2- 172.21.15.79:0/3274224822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf440e9ad0 0x7faf4409f100 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:08.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.455 7faf4c6ed700 1 -- 172.21.15.79:0/3274224822 >> 172.21.15.79:0/3274224822 conn(0x7faf440e5fd0 msgr2=0x7faf440e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:08.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.459 7faf4c6ed700 1 -- 172.21.15.79:0/3274224822 shutdown_connections 2021-04-09T18:35:08.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.459 7faf4c6ed700 1 -- 172.21.15.79:0/3274224822 wait complete. 2021-04-09T18:35:08.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.459 7faf4c6ed700 1 Processor -- start 2021-04-09T18:35:08.485 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf4c6ed700 1 -- start start 2021-04-09T18:35:08.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf4c6ed700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf440992f0 0x7faf440c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:08.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf4c6ed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf4419d700 0x7faf440a30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:08.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf4c6ed700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf440a2740 0x7faf440d4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:08.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf4c6ed700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf440e9f20 con 0x7faf4419d700 2021-04-09T18:35:08.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf4c6ed700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4419bc40 con 0x7faf440a2740 2021-04-09T18:35:08.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf4c6ed700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4419bf40 con 0x7faf440992f0 2021-04-09T18:35:08.487 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf49c90700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf4419d700 0x7faf440a30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:08.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf49c90700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf4419d700 0x7faf440a30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34662/0 (socket says 172.21.15.79:34662) 2021-04-09T18:35:08.488 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf49c90700 1 -- 172.21.15.79:0/2265755618 learned_addr learned my addr 172.21.15.79:0/2265755618 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:08.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf4a491700 1 --2- 172.21.15.79:0/2265755618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf440992f0 0x7faf440c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:08.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf4ac92700 1 --2- 172.21.15.79:0/2265755618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf440a2740 0x7faf440d4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:08.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf49c90700 1 -- 172.21.15.79:0/2265755618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf440992f0 msgr2=0x7faf440c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:08.490 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf49c90700 1 --2- 172.21.15.79:0/2265755618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf440992f0 0x7faf440c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:08.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf49c90700 1 -- 172.21.15.79:0/2265755618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf440a2740 msgr2=0x7faf440d4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:08.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf49c90700 1 --2- 172.21.15.79:0/2265755618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf440a2740 0x7faf440d4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:08.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf49c90700 1 -- 172.21.15.79:0/2265755618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf440a2b90 con 0x7faf4419d700 2021-04-09T18:35:08.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf4a491700 1 --2- 172.21.15.79:0/2265755618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf440992f0 0x7faf440c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:08.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf49c90700 1 --2- 172.21.15.79:0/2265755618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf4419d700 0x7faf440a30f0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7faf4419bbc0 tx=0x7faf34006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:08.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf3affd700 1 -- 172.21.15.79:0/2265755618 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf440a2b90 con 0x7faf4419d700 2021-04-09T18:35:08.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf3affd700 1 -- 172.21.15.79:0/2265755618 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf34009e20 con 0x7faf4419d700 2021-04-09T18:35:08.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf4c6ed700 1 -- 172.21.15.79:0/2265755618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf440d5380 con 0x7faf4419d700 2021-04-09T18:35:08.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf3affd700 1 -- 172.21.15.79:0/2265755618 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf3401f070 con 0x7faf4419d700 2021-04-09T18:35:08.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.463 7faf4c6ed700 1 -- 172.21.15.79:0/2265755618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf440d58e0 con 0x7faf4419d700 2021-04-09T18:35:08.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.467 7faf3affd700 1 -- 172.21.15.79:0/2265755618 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7faf34018870 con 0x7faf4419d700 2021-04-09T18:35:08.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.467 7faf3affd700 1 --2- 172.21.15.79:0/2265755618 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf2c029100 0x7faf2c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:08.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.467 7faf3affd700 1 -- 172.21.15.79:0/2265755618 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5276+0+0 (secure 0 0 0) 0x7faf3403d240 con 0x7faf4419d700 2021-04-09T18:35:08.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.467 7faf4a491700 1 --2- 172.21.15.79:0/2265755618 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf2c029100 0x7faf2c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:08.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.467 7faf4a491700 1 --2- 172.21.15.79:0/2265755618 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf2c029100 0x7faf2c02b650 crc :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:08.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.467 7faf4c6ed700 1 -- 172.21.15.79:0/2265755618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf440e39d0 con 0x7faf4419d700 2021-04-09T18:35:08.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.471 7faf3affd700 1 -- 172.21.15.79:0/2265755618 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7faf340095f0 con 0x7faf4419d700 2021-04-09T18:35:08.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.635 7faf4c6ed700 1 -- 172.21.15.79:0/2265755618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7faf440a1cb0 con 0x7faf4419d700 2021-04-09T18:35:08.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.635 7faf3affd700 1 -- 172.21.15.79:0/2265755618 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v121) v1 ==== 81+0+26082 (secure 0 0 0) 0x7faf34018470 con 0x7faf4419d700 2021-04-09T18:35:08.643 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:08.644 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:35:08.644 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 121, 2021-04-09T18:35:08.644 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:35:08.644 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:35:08.645 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:35:05.792158", 2021-04-09T18:35:08.645 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:35:08.645 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:35:08.645 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:35:08.646 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:35:08.646 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:35:08.646 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:35:08.646 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:35:08.646 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:35:08.647 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:35:08.647 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:35:08.647 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:35:08.647 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:35:08.648 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:35:08.648 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:35:08.648 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:35:08.649 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 23, 2021-04-09T18:35:08.649 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:35:08.649 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:35:08.649 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:35:08.650 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:35:08.650 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:35:08.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.650 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:35:08.650 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:35:08.651 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:35:08.651 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:35:08.651 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:35:08.651 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:35:08.652 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:35:08.652 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:35:08.652 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:35:08.653 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:35:08.653 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:35:08.653 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:35:08.654 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:35:08.654 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:35:08.655 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:35:08.655 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:35:08.655 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:35:08.656 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:35:08.656 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:35:08.657 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:35:08.657 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:35:08.658 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:35:08.658 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:35:08.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.659 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:35:08.659 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:35:08.660 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:35:08.660 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:35:08.660 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:35:08.661 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:35:08.661 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:35:08.662 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:35:08.662 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:35:08.662 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:35:08.663 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:35:08.663 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:35:08.663 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:35:08.664 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:35:08.664 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:35:08.665 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:35:08.665 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:35:08.665 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:35:08.666 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:35:08.666 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:35:08.667 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:35:08.667 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:35:08.667 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:35:08.668 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:35:08.668 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:35:08.668 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:35:08.669 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:35:08.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.669 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:35:08.670 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:35:08.670 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:35:08.671 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:35:08.671 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:35:08.671 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:35:08.672 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:35:08.672 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:35:08.673 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:35:08.673 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:35:08.673 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:35:08.674 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:35:08.674 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:35:08.675 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:35:08.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.676 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:35:08.676 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:35:08.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.676 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:35:08.677 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:35:08.677 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:08.678 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:08.678 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:08.678 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:08.679 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:08.679 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:08.680 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:08.680 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 117, 2021-04-09T18:35:08.680 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:08.680 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:08.681 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:08.681 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.682 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.682 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:35:08.682 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:08.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.683 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.684 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:35:08.684 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:08.684 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.685 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.685 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:08.686 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.687 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.691 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:35:08.691 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:08.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.692 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.692 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:35:08.693 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:08.693 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.693 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.694 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:08.694 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.695 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.695 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:35:08.696 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:08.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.697 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.698 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:35:08.698 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:08.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.699 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.700 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:08.700 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.701 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.701 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:35:08.701 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:08.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.702 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.703 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:35:08.703 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:08.703 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.704 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.704 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:35:08.704 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:35:08.704 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:35:08.705 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:35:08.705 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:08.705 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:08.705 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:08.705 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.706 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:35:08.706 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:35:08.706 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:08.707 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:08.707 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:08.707 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:08.707 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:08.708 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:08.708 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:08.708 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 112, 2021-04-09T18:35:08.708 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:08.708 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:08.709 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:08.709 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.709 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.709 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:35:08.710 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:08.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.711 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.711 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:35:08.711 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:08.711 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.712 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.712 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:08.712 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.713 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.713 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:35:08.713 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:08.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.714 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.714 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:35:08.714 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:08.715 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.715 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.715 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:08.715 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.716 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.716 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:35:08.716 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:08.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.717 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.717 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:35:08.717 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:08.718 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.718 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.718 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:08.718 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.719 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.719 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:35:08.719 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:08.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.720 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.720 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:35:08.720 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:08.721 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.721 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.721 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:35:08.721 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:35:08.722 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:35:08.722 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:35:08.722 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:08.722 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:08.722 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:08.723 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.723 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:35:08.724 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:35:08.724 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:08.724 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:08.724 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:08.724 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:08.725 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:08.725 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:08.725 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:08.725 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 117, 2021-04-09T18:35:08.725 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:08.726 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:08.726 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:08.726 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.726 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.727 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:35:08.727 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:08.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.728 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.728 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:35:08.728 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:08.728 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.729 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.729 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:08.729 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.730 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.730 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:35:08.730 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:08.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.731 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.731 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:35:08.731 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:08.731 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.732 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.732 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:08.732 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.733 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.733 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:35:08.733 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:08.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.734 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.734 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:35:08.734 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:08.734 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.735 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.735 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:08.735 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.736 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.736 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:35:08.736 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:08.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.737 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.737 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:35:08.737 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:08.738 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.738 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.738 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:35:08.738 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:35:08.739 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:35:08.739 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:35:08.739 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:08.739 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:08.739 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:08.740 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.740 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:35:08.741 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:35:08.741 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:08.741 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:08.741 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:08.741 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:08.742 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:08.742 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:08.742 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:08.742 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 117, 2021-04-09T18:35:08.742 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:08.743 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:08.743 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:08.743 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.744 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.744 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:35:08.744 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:08.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.745 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.745 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:35:08.746 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:08.746 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.747 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.747 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:08.748 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.749 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.749 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:35:08.749 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:08.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.751 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.751 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:35:08.751 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:08.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.752 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.753 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:08.753 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.753 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.753 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:35:08.754 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:08.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.754 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.755 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:35:08.755 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:08.755 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.755 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.756 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:08.756 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.756 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.756 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:35:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:35:08.758 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:08.758 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.759 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.759 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:35:08.759 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:35:08.760 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:35:08.760 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:35:08.760 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:08.760 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:08.760 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:08.761 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.761 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:35:08.761 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:35:08.762 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:08.762 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:08.762 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:08.762 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:08.762 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:08.763 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:08.763 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:08.763 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 117, 2021-04-09T18:35:08.763 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:35:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.766 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:35:08.766 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:08.766 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.766 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.767 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:08.767 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.767 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.768 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:35:08.768 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:08.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.768 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.769 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:35:08.769 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:08.769 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.769 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.770 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:08.770 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.770 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:35:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.772 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:35:08.772 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:08.772 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.772 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.773 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:08.773 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:35:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:35:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:35:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:35:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:35:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:35:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.778 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:35:08.778 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:35:08.778 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 117, 2021-04-09T18:35:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:35:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:08.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.782 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.782 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:35:08.782 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:08.783 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.783 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.783 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:08.784 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.784 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.784 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:35:08.784 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:35:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:08.786 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.786 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.786 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:08.786 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.787 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.787 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:35:08.787 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:08.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.788 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.788 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:35:08.788 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:08.789 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.789 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.789 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:08.789 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.790 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.790 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:35:08.790 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:08.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.791 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.791 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:35:08.791 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:08.791 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.792 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.792 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:35:08.792 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:35:08.792 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:35:08.793 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:35:08.793 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:08.793 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:08.793 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:08.793 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.794 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:35:08.794 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:35:08.794 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:08.795 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:08.795 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:08.795 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:08.795 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:08.796 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:08.796 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:08.796 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 112, 2021-04-09T18:35:08.796 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:08.796 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:08.797 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:08.797 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.797 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.797 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:35:08.798 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:08.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.798 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.799 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:35:08.799 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:08.799 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.799 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.800 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:08.800 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.800 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.800 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:35:08.801 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:08.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.801 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.801 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:35:08.802 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:08.802 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.802 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.802 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:08.803 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.803 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.803 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:35:08.804 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:08.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.804 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.804 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:35:08.805 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:08.805 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.805 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.805 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:08.806 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.806 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.806 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:35:08.806 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:08.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.807 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.807 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:35:08.807 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:08.808 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.808 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.808 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:35:08.809 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:35:08.809 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:35:08.809 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:35:08.809 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:08.809 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:08.810 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:08.810 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.810 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:35:08.811 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:35:08.811 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:08.811 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:08.811 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:08.812 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:08.812 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:08.812 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:08.812 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:08.812 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 104, 2021-04-09T18:35:08.813 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:08.813 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:08.813 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:08.813 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.814 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.814 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:35:08.814 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:08.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.815 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.815 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:35:08.815 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:08.815 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.815 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.816 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:08.816 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.817 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.817 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:35:08.817 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:08.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.818 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.818 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:35:08.818 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:08.818 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.818 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.819 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:08.819 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.819 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.820 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:35:08.820 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:08.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.820 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.821 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:35:08.821 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:08.821 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.821 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.822 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:08.822 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:08.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.822 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:08.823 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:35:08.823 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:08.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.823 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:08.824 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:35:08.824 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:08.824 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.824 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.825 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:35:08.825 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:35:08.825 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:35:08.825 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:35:08.826 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:08.826 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:08.826 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:08.826 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:08.826 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.827 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:35:08.827 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:35:08.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.827 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:35:08.827 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:08.828 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:08.828 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:08.828 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:08.828 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:08.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.829 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:35:08.829 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:08.829 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:08.830 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:08.830 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:08.830 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:08.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.831 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:35:08.831 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:08.831 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:08.831 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:08.831 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:08.832 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:08.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.832 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:35:08.833 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:08.833 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:08.833 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:08.833 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:08.833 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:08.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.834 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:35:08.834 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:08.834 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:08.835 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:08.835 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:08.835 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:08.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.836 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:35:08.836 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:08.836 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:08.836 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:08.837 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:08.837 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:08.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.837 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:35:08.838 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:08.838 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:08.838 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:08.838 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:08.838 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:08.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:08.839 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:35:08.839 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:08.839 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:08.840 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:08.840 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:08.840 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:08.840 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.841 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:35:08.841 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:35:08.841 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:35:08.841 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:35:08.841 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:35:08.842 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": { 2021-04-09T18:35:08.842 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.79:6833/1381942487": "2021-04-10 18:34:46.418839", 2021-04-09T18:35:08.842 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.79:6832/1381942487": "2021-04-10 18:34:46.418839", 2021-04-09T18:35:08.842 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.79:6833/1349682878": "2021-04-10 18:34:32.282358", 2021-04-09T18:35:08.843 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.79:6832/1349682878": "2021-04-10 18:34:32.282358" 2021-04-09T18:35:08.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.843 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:35:08.843 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:35:08.843 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:35:08.844 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:35:08.844 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:35:08.844 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:35:08.844 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:35:08.844 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:35:08.845 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:35:08.845 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:35:08.845 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:35:08.845 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:35:08.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.846 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:35:08.846 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:35:08.846 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:35:08.846 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:35:08.846 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:35:08.847 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:35:08.847 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:35:08.847 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:08.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:08.847 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:35:08.848 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:35:08.848 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:35:08.848 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:35:08.848 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:35:08.848 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:35:08.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.639 7faf4c6ed700 1 -- 172.21.15.79:0/2265755618 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf2c029100 msgr2=0x7faf2c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:08.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.639 7faf4c6ed700 1 --2- 172.21.15.79:0/2265755618 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf2c029100 0x7faf2c02b650 crc :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:08.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.639 7faf4c6ed700 1 -- 172.21.15.79:0/2265755618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf4419d700 msgr2=0x7faf440a30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:08.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.639 7faf4c6ed700 1 --2- 172.21.15.79:0/2265755618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf4419d700 0x7faf440a30f0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7faf4419bbc0 tx=0x7faf34006890).stop 2021-04-09T18:35:08.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.639 7faf4c6ed700 1 -- 172.21.15.79:0/2265755618 shutdown_connections 2021-04-09T18:35:08.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.639 7faf4c6ed700 1 --2- 172.21.15.79:0/2265755618 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf2c029100 0x7faf2c02b650 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:08.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.639 7faf4c6ed700 1 --2- 172.21.15.79:0/2265755618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf440a2740 0x7faf440d4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:08.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.639 7faf4c6ed700 1 --2- 172.21.15.79:0/2265755618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf440992f0 0x7faf440c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:08.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.639 7faf4c6ed700 1 --2- 172.21.15.79:0/2265755618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf4419d700 0x7faf440a30f0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:08.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.639 7faf4c6ed700 1 -- 172.21.15.79:0/2265755618 >> 172.21.15.79:0/2265755618 conn(0x7faf4409b0a0 msgr2=0x7faf4409a600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:08.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.639 7faf4c6ed700 1 -- 172.21.15.79:0/2265755618 shutdown_connections 2021-04-09T18:35:08.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.639 7faf4c6ed700 1 -- 172.21.15.79:0/2265755618 wait complete. 2021-04-09T18:35:08.854 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:35:08.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.943 7f2190190700 1 Processor -- start 2021-04-09T18:35:08.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.943 7f2190190700 1 -- start start 2021-04-09T18:35:08.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.943 7f2190190700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21880f5520 0x7f21880f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:08.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.943 7f2190190700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f21880e9ae0 0x7f218809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:08.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.943 7f2190190700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21880fbb20 con 0x7f21881c2db0 2021-04-09T18:35:08.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.943 7f2190190700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21880e9f30 con 0x7f21880e9ae0 2021-04-09T18:35:08.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.943 7f2190190700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21880e59d0 con 0x7f21880f5520 2021-04-09T18:35:08.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.943 7f218e735700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f21881c2db0 0x7f21881c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57614/0 (socket says 172.21.15.79:57614) 2021-04-09T18:35:08.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.943 7f218e735700 1 -- 172.21.15.79:0/2024550969 learned_addr learned my addr 172.21.15.79:0/2024550969 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:08.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.943 7f218d733700 1 --2- 172.21.15.79:0/2024550969 >> v2:172.21.15.89:3300/0 conn(0x7f21880e9ae0 0x7f218809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:08.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.943 7f218df34700 1 --2- 172.21.15.79:0/2024550969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21880f5520 0x7f21880f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:08.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.943 7f218cf32700 1 -- 172.21.15.79:0/2024550969 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382053151 0 0) 0x7f2180001450 con 0x7f21881c2db0 2021-04-09T18:35:08.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.943 7f218cf32700 1 -- 172.21.15.79:0/2024550969 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2174003240 con 0x7f21881c2db0 2021-04-09T18:35:08.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.947 7f218d733700 1 -- 172.21.15.79:0/2024550969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21880f5520 msgr2=0x7f21880f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:08.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.947 7f218d733700 1 --2- 172.21.15.79:0/2024550969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21880f5520 0x7f21880f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:08.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.947 7f218d733700 1 -- 172.21.15.79:0/2024550969 >> v1:172.21.15.79:6789/0 conn(0x7f21881c2db0 legacy=0x7f21881c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:08.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.947 7f218d733700 1 -- 172.21.15.79:0/2024550969 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21880e56d0 con 0x7f21880e9ae0 2021-04-09T18:35:08.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.947 7f218df34700 1 --2- 172.21.15.79:0/2024550969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21880f5520 0x7f21880f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:08.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.947 7f218d733700 1 --2- 172.21.15.79:0/2024550969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21880e9ae0 0x7f218809f110 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f2178002f30 tx=0x7f217800bd40).ready entity=mon.1 client_cookie=e54b0f66b097a476 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:08.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.947 7f218cf32700 1 -- 172.21.15.79:0/2024550969 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f21880e56d0 con 0x7f21880e9ae0 2021-04-09T18:35:08.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.947 7f218cf32700 1 -- 172.21.15.79:0/2024550969 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2178009850 con 0x7f21880e9ae0 2021-04-09T18:35:08.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.947 7f218cf32700 1 -- 172.21.15.79:0/2024550969 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2178009c20 con 0x7f21880e9ae0 2021-04-09T18:35:08.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.947 7f2190190700 1 -- 172.21.15.79:0/2024550969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21880e9ae0 msgr2=0x7f218809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:08.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.947 7f2190190700 1 --2- 172.21.15.79:0/2024550969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21880e9ae0 0x7f218809f110 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f2178002f30 tx=0x7f217800bd40).stop 2021-04-09T18:35:08.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.947 7f2190190700 1 -- 172.21.15.79:0/2024550969 shutdown_connections 2021-04-09T18:35:08.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.947 7f2190190700 1 --2- 172.21.15.79:0/2024550969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21880f5520 0x7f21880f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:08.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.947 7f2190190700 1 --2- 172.21.15.79:0/2024550969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21880e9ae0 0x7f218809f110 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:08.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.947 7f2190190700 1 -- 172.21.15.79:0/2024550969 >> 172.21.15.79:0/2024550969 conn(0x7f21880e5fe0 msgr2=0x7f21880e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:08.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.947 7f2190190700 1 -- 172.21.15.79:0/2024550969 shutdown_connections 2021-04-09T18:35:08.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.947 7f2190190700 1 -- 172.21.15.79:0/2024550969 wait complete. 2021-04-09T18:35:08.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f2190190700 1 Processor -- start 2021-04-09T18:35:08.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f2190190700 1 -- start start 2021-04-09T18:35:08.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f2190190700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2188094f90 0x7f21880d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:08.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f2190190700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21880d12c0 0x7f21880a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:08.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f2190190700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21880953e0 0x7f21880a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:08.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f2190190700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21880aac10 con 0x7f21880d12c0 2021-04-09T18:35:08.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f2190190700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21880aaf10 con 0x7f2188094f90 2021-04-09T18:35:08.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f2190190700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21880ba3a0 con 0x7f21880953e0 2021-04-09T18:35:08.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f218d733700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21880d12c0 0x7f21880a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:08.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f218d733700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21880d12c0 0x7f21880a97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34676/0 (socket says 172.21.15.79:34676) 2021-04-09T18:35:08.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f218d733700 1 -- 172.21.15.79:0/3694318459 learned_addr learned my addr 172.21.15.79:0/3694318459 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:08.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f218e735700 1 --2- 172.21.15.79:0/3694318459 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21880953e0 0x7f21880a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:08.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f218df34700 1 --2- 172.21.15.79:0/3694318459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2188094f90 0x7f21880d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:08.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f218d733700 1 -- 172.21.15.79:0/3694318459 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21880953e0 msgr2=0x7f21880a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:08.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f218d733700 1 --2- 172.21.15.79:0/3694318459 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21880953e0 0x7f21880a9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:08.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f218d733700 1 -- 172.21.15.79:0/3694318459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2188094f90 msgr2=0x7f21880d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:08.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f218d733700 1 --2- 172.21.15.79:0/3694318459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2188094f90 0x7f21880d0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:08.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f218d733700 1 -- 172.21.15.79:0/3694318459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2188095a30 con 0x7f21880d12c0 2021-04-09T18:35:08.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f218d733700 1 --2- 172.21.15.79:0/3694318459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21880d12c0 0x7f21880a97c0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f21880d3d20 tx=0x7f2178006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:08.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f21867fc700 1 -- 172.21.15.79:0/3694318459 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2188095a30 con 0x7f21880d12c0 2021-04-09T18:35:08.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f21867fc700 1 -- 172.21.15.79:0/3694318459 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2178011ce0 con 0x7f21880d12c0 2021-04-09T18:35:08.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f2190190700 1 -- 172.21.15.79:0/3694318459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21880ac4b0 con 0x7f21880d12c0 2021-04-09T18:35:08.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f21867fc700 1 -- 172.21.15.79:0/3694318459 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f217801d630 con 0x7f21880d12c0 2021-04-09T18:35:08.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.951 7f2190190700 1 -- 172.21.15.79:0/3694318459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21880ac930 con 0x7f21880d12c0 2021-04-09T18:35:08.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.955 7f21867fc700 1 -- 172.21.15.79:0/3694318459 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f217801c3e0 con 0x7f21880d12c0 2021-04-09T18:35:08.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.955 7f21867fc700 1 --2- 172.21.15.79:0/3694318459 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f216c029100 0x7f216c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:08.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.955 7f21867fc700 1 -- 172.21.15.79:0/3694318459 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f217803ac70 con 0x7f21880d12c0 2021-04-09T18:35:08.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.955 7f218df34700 1 --2- 172.21.15.79:0/3694318459 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f216c029100 0x7f216c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:08.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.955 7f218df34700 1 --2- 172.21.15.79:0/3694318459 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f216c029100 0x7f216c02b650 crc :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:08.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.959 7f2190190700 1 -- 172.21.15.79:0/3694318459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21880e39e0 con 0x7f21880d12c0 2021-04-09T18:35:08.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:08.963 7f21867fc700 1 -- 172.21.15.79:0/3694318459 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2178009640 con 0x7f21880d12c0 2021-04-09T18:35:09.138 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.131 7f2190190700 1 -- 172.21.15.79:0/3694318459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21880f5b20 con 0x7f21880d12c0 2021-04-09T18:35:09.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.135 7f21867fc700 1 -- 172.21.15.79:0/3694318459 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+504 (secure 0 0 0) 0x7f2178011ad0 con 0x7f21880d12c0 2021-04-09T18:35:09.139 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 75 2021-04-09T18:35:09.140 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:09.140 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":75,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2021-04-09T18:35:09.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.135 7f2190190700 1 -- 172.21.15.79:0/3694318459 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f216c029100 msgr2=0x7f216c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:09.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.135 7f2190190700 1 --2- 172.21.15.79:0/3694318459 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f216c029100 0x7f216c02b650 crc :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.135 7f2190190700 1 -- 172.21.15.79:0/3694318459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21880d12c0 msgr2=0x7f21880a97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:09.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.135 7f2190190700 1 --2- 172.21.15.79:0/3694318459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21880d12c0 0x7f21880a97c0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f21880d3d20 tx=0x7f2178006890).stop 2021-04-09T18:35:09.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.135 7f2190190700 1 -- 172.21.15.79:0/3694318459 shutdown_connections 2021-04-09T18:35:09.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.135 7f2190190700 1 --2- 172.21.15.79:0/3694318459 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f216c029100 0x7f216c02b650 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.135 7f2190190700 1 --2- 172.21.15.79:0/3694318459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2188094f90 0x7f21880d0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.135 7f2190190700 1 --2- 172.21.15.79:0/3694318459 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21880953e0 0x7f21880a9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.135 7f2190190700 1 --2- 172.21.15.79:0/3694318459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21880d12c0 0x7f21880a97c0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.135 7f2190190700 1 -- 172.21.15.79:0/3694318459 >> 172.21.15.79:0/3694318459 conn(0x7f2188094990 msgr2=0x7f21880d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:09.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.135 7f2190190700 1 -- 172.21.15.79:0/3694318459 shutdown_connections 2021-04-09T18:35:09.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.135 7f2190190700 1 -- 172.21.15.79:0/3694318459 wait complete. 2021-04-09T18:35:09.152 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:35:09.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.243 7f6b3ac40700 1 Processor -- start 2021-04-09T18:35:09.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.243 7f6b3ac40700 1 -- start start 2021-04-09T18:35:09.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.243 7f6b3ac40700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6b340e9ad0 0x7f6b3409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:09.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.243 7f6b3ac40700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b340fbb10 con 0x7f6b340f5510 2021-04-09T18:35:09.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.243 7f6b3ac40700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b340e56c0 con 0x7f6b341c8000 2021-04-09T18:35:09.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.243 7f6b3ac40700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b341c3db0 con 0x7f6b340e9ad0 2021-04-09T18:35:09.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.243 7f6b33fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6b340e9ad0 0x7f6b3409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:09.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.243 7f6b389e4700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6b340f5510 0x7f6b340f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57624/0 (socket says 172.21.15.79:57624) 2021-04-09T18:35:09.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.243 7f6b389e4700 1 -- 172.21.15.79:0/469019956 learned_addr learned my addr 172.21.15.79:0/469019956 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:09.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.243 7f6b33fff700 1 -- 172.21.15.79:0/469019956 >> v1:172.21.15.89:6789/0 conn(0x7f6b341c8000 legacy=0x7f6b341ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:09.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.243 7f6b33fff700 1 -- 172.21.15.79:0/469019956 >> v1:172.21.15.79:6789/0 conn(0x7f6b340f5510 legacy=0x7f6b340f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:09.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.243 7f6b33fff700 1 -- 172.21.15.79:0/469019956 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b340e4320 con 0x7f6b340e9ad0 2021-04-09T18:35:09.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.247 7f6b33fff700 1 --2- 172.21.15.79:0/469019956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b340e9ad0 0x7f6b3409f100 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f6b1c002f30 tx=0x7f6b1c00bcc0).ready entity=mon.0 client_cookie=cb5d79ef9e6e2ed2 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:09.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.247 7f6b337fe700 1 -- 172.21.15.79:0/469019956 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6b340e4320 con 0x7f6b340e9ad0 2021-04-09T18:35:09.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.247 7f6b337fe700 1 -- 172.21.15.79:0/469019956 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c009800 con 0x7f6b340e9ad0 2021-04-09T18:35:09.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.247 7f6b337fe700 1 -- 172.21.15.79:0/469019956 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6b1c009bd0 con 0x7f6b340e9ad0 2021-04-09T18:35:09.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.247 7f6b3ac40700 1 -- 172.21.15.79:0/469019956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b340e9ad0 msgr2=0x7f6b3409f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:09.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.247 7f6b3ac40700 1 --2- 172.21.15.79:0/469019956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b340e9ad0 0x7f6b3409f100 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f6b1c002f30 tx=0x7f6b1c00bcc0).stop 2021-04-09T18:35:09.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.247 7f6b3ac40700 1 -- 172.21.15.79:0/469019956 shutdown_connections 2021-04-09T18:35:09.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.247 7f6b3ac40700 1 --2- 172.21.15.79:0/469019956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b340e9ad0 0x7f6b3409f100 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.247 7f6b3ac40700 1 -- 172.21.15.79:0/469019956 >> 172.21.15.79:0/469019956 conn(0x7f6b340e5fd0 msgr2=0x7f6b340e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:09.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.247 7f6b3ac40700 1 -- 172.21.15.79:0/469019956 shutdown_connections 2021-04-09T18:35:09.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.247 7f6b3ac40700 1 -- 172.21.15.79:0/469019956 wait complete. 2021-04-09T18:35:09.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b3ac40700 1 Processor -- start 2021-04-09T18:35:09.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b3ac40700 1 -- start start 2021-04-09T18:35:09.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b3ac40700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b340bfea0 0x7f6b34095d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:09.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b3ac40700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b34096360 0x7f6b340c1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:09.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b3ac40700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b340c1650 0x7f6b341d2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:09.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b3ac40700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b340e9f20 con 0x7f6b34096360 2021-04-09T18:35:09.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b3ac40700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b340c0d20 con 0x7f6b340c1650 2021-04-09T18:35:09.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b3ac40700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b341d4b50 con 0x7f6b340bfea0 2021-04-09T18:35:09.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b33fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b34096360 0x7f6b340c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:09.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b33fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b34096360 0x7f6b340c1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34688/0 (socket says 172.21.15.79:34688) 2021-04-09T18:35:09.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b33fff700 1 -- 172.21.15.79:0/2558197835 learned_addr learned my addr 172.21.15.79:0/2558197835 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:09.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b389e4700 1 --2- 172.21.15.79:0/2558197835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b340bfea0 0x7f6b34095d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:09.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b391e5700 1 --2- 172.21.15.79:0/2558197835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b340c1650 0x7f6b341d2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:09.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b33fff700 1 -- 172.21.15.79:0/2558197835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b340bfea0 msgr2=0x7f6b34095d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:09.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b33fff700 1 --2- 172.21.15.79:0/2558197835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b340bfea0 0x7f6b34095d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b33fff700 1 -- 172.21.15.79:0/2558197835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b340c1650 msgr2=0x7f6b341d2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:09.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b33fff700 1 --2- 172.21.15.79:0/2558197835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b340c1650 0x7f6b341d2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b33fff700 1 -- 172.21.15.79:0/2558197835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b34093c90 con 0x7f6b34096360 2021-04-09T18:35:09.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b33fff700 1 --2- 172.21.15.79:0/2558197835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b34096360 0x7f6b340c1020 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f6b340874c0 tx=0x7f6b1c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:09.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b317fa700 1 -- 172.21.15.79:0/2558197835 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6b34093c90 con 0x7f6b34096360 2021-04-09T18:35:09.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b317fa700 1 -- 172.21.15.79:0/2558197835 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c01c470 con 0x7f6b34096360 2021-04-09T18:35:09.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b3ac40700 1 -- 172.21.15.79:0/2558197835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b341d3440 con 0x7f6b34096360 2021-04-09T18:35:09.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b317fa700 1 -- 172.21.15.79:0/2558197835 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6b1c021020 con 0x7f6b34096360 2021-04-09T18:35:09.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.251 7f6b3ac40700 1 -- 172.21.15.79:0/2558197835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b341d6e80 con 0x7f6b34096360 2021-04-09T18:35:09.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.255 7f6b317fa700 1 -- 172.21.15.79:0/2558197835 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6b1c01c840 con 0x7f6b34096360 2021-04-09T18:35:09.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.255 7f6b317fa700 1 --2- 172.21.15.79:0/2558197835 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6b18029100 0x7f6b1802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:09.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.255 7f6b317fa700 1 -- 172.21.15.79:0/2558197835 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f6b1c018030 con 0x7f6b34096360 2021-04-09T18:35:09.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.255 7f6b389e4700 1 --2- 172.21.15.79:0/2558197835 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6b18029100 0x7f6b1802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:09.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.255 7f6b389e4700 1 --2- 172.21.15.79:0/2558197835 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6b18029100 0x7f6b1802b650 crc :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:09.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.259 7f6b3ac40700 1 -- 172.21.15.79:0/2558197835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b340e39d0 con 0x7f6b34096360 2021-04-09T18:35:09.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.267 7f6b317fa700 1 -- 172.21.15.79:0/2558197835 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6b1c0095f0 con 0x7f6b34096360 2021-04-09T18:35:09.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.435 7f6b3ac40700 1 -- 172.21.15.79:0/2558197835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b340a1cb0 con 0x7f6b34096360 2021-04-09T18:35:09.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.439 7f6b317fa700 1 -- 172.21.15.79:0/2558197835 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+504 (secure 0 0 0) 0x7f6b1c00e7f0 con 0x7f6b34096360 2021-04-09T18:35:09.445 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 75 2021-04-09T18:35:09.446 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:09.446 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":75,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2021-04-09T18:35:09.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.443 7f6b3ac40700 1 -- 172.21.15.79:0/2558197835 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6b18029100 msgr2=0x7f6b1802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:09.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.443 7f6b3ac40700 1 --2- 172.21.15.79:0/2558197835 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6b18029100 0x7f6b1802b650 crc :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.443 7f6b3ac40700 1 -- 172.21.15.79:0/2558197835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b34096360 msgr2=0x7f6b340c1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:09.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.443 7f6b3ac40700 1 --2- 172.21.15.79:0/2558197835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b34096360 0x7f6b340c1020 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f6b340874c0 tx=0x7f6b1c006890).stop 2021-04-09T18:35:09.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.443 7f6b3ac40700 1 -- 172.21.15.79:0/2558197835 shutdown_connections 2021-04-09T18:35:09.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.443 7f6b3ac40700 1 --2- 172.21.15.79:0/2558197835 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6b18029100 0x7f6b1802b650 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.443 7f6b3ac40700 1 --2- 172.21.15.79:0/2558197835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b340c1650 0x7f6b341d2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.443 7f6b3ac40700 1 --2- 172.21.15.79:0/2558197835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b340bfea0 0x7f6b34095d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.443 7f6b3ac40700 1 --2- 172.21.15.79:0/2558197835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b34096360 0x7f6b340c1020 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.443 7f6b3ac40700 1 -- 172.21.15.79:0/2558197835 >> 172.21.15.79:0/2558197835 conn(0x7f6b3409acc0 msgr2=0x7f6b340ba5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:09.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.443 7f6b3ac40700 1 -- 172.21.15.79:0/2558197835 shutdown_connections 2021-04-09T18:35:09.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.443 7f6b3ac40700 1 -- 172.21.15.79:0/2558197835 wait complete. 2021-04-09T18:35:09.458 INFO:tasks.ceph.mds.a:Restarting daemon 2021-04-09T18:35:09.459 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-04-09T18:35:09.460 INFO:tasks.ceph.mds.b:Restarting daemon 2021-04-09T18:35:09.460 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-04-09T18:35:09.462 INFO:tasks.ceph.mds.a:Started 2021-04-09T18:35:09.462 DEBUG:teuthology.parallel:result is None 2021-04-09T18:35:09.463 INFO:tasks.ceph.mds.b:Started 2021-04-09T18:35:09.464 DEBUG:teuthology.parallel:result is None 2021-04-09T18:35:09.464 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-04-09T18:35:09.528 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2021-04-09T18:35:09.539 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2021-04-09T18:35:09.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.555 7f4f2d04b700 1 Processor -- start 2021-04-09T18:35:09.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.555 7f4f2d04b700 1 -- start start 2021-04-09T18:35:09.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.555 7f4f2d04b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f280f5520 0x7f4f280f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:09.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.555 7f4f2d04b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4f280e9ae0 0x7f4f2809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:09.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.555 7f4f2d04b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f280fbb20 con 0x7f4f281c2db0 2021-04-09T18:35:09.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.555 7f4f2d04b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f280e9f30 con 0x7f4f280e9ae0 2021-04-09T18:35:09.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.555 7f4f2d04b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280e59d0 con 0x7f4f280f5520 2021-04-09T18:35:09.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.555 7f4f26d9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f280f5520 0x7f4f280f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:09.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.555 7f4f26d9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f280f5520 0x7f4f280f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:59936/0 (socket says 172.21.15.79:59936) 2021-04-09T18:35:09.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.555 7f4f26d9d700 1 -- 172.21.15.79:0/1526497860 learned_addr learned my addr 172.21.15.79:0/1526497860 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:09.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.555 7f4f2659c700 1 --2- 172.21.15.79:0/1526497860 >> v2:172.21.15.89:3300/0 conn(0x7f4f280e9ae0 0x7f4f2809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:09.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.555 7f4f26d9d700 1 -- 172.21.15.79:0/1526497860 >> v2:172.21.15.89:3300/0 conn(0x7f4f280e9ae0 msgr2=0x7f4f2809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:09.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.555 7f4f26d9d700 1 --2- 172.21.15.79:0/1526497860 >> v2:172.21.15.89:3300/0 conn(0x7f4f280e9ae0 0x7f4f2809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.555 7f4f26d9d700 1 -- 172.21.15.79:0/1526497860 >> v1:172.21.15.89:6789/0 conn(0x7f4f281c2db0 legacy=0x7f4f281c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:09.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.555 7f4f26d9d700 1 -- 172.21.15.79:0/1526497860 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f280e56d0 con 0x7f4f280f5520 2021-04-09T18:35:09.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.555 7f4f2659c700 1 --2- 172.21.15.79:0/1526497860 >> v2:172.21.15.89:3300/0 conn(0x7f4f280e9ae0 0x7f4f2809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:09.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.559 7f4f26d9d700 1 --2- 172.21.15.79:0/1526497860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f280f5520 0x7f4f280f64b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f4f10002f30 tx=0x7f4f1000bd20).ready entity=mon.2 client_cookie=599542e0c65fda87 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:09.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.559 7f4f25d9b700 1 -- 172.21.15.79:0/1526497860 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4f280e56d0 con 0x7f4f280f5520 2021-04-09T18:35:09.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.559 7f4f25d9b700 1 -- 172.21.15.79:0/1526497860 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f10009980 con 0x7f4f280f5520 2021-04-09T18:35:09.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.559 7f4f25d9b700 1 -- 172.21.15.79:0/1526497860 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4f10009d50 con 0x7f4f280f5520 2021-04-09T18:35:09.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.559 7f4f2d04b700 1 -- 172.21.15.79:0/1526497860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f280f5520 msgr2=0x7f4f280f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:09.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.559 7f4f2d04b700 1 --2- 172.21.15.79:0/1526497860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f280f5520 0x7f4f280f64b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f4f10002f30 tx=0x7f4f1000bd20).stop 2021-04-09T18:35:09.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.559 7f4f2d04b700 1 -- 172.21.15.79:0/1526497860 shutdown_connections 2021-04-09T18:35:09.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.559 7f4f2d04b700 1 --2- 172.21.15.79:0/1526497860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f280f5520 0x7f4f280f64b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.559 7f4f2d04b700 1 --2- 172.21.15.79:0/1526497860 >> v2:172.21.15.89:3300/0 conn(0x7f4f280e9ae0 0x7f4f2809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.559 7f4f2d04b700 1 -- 172.21.15.79:0/1526497860 >> 172.21.15.79:0/1526497860 conn(0x7f4f280e5fe0 msgr2=0x7f4f280e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:09.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.559 7f4f2d04b700 1 -- 172.21.15.79:0/1526497860 shutdown_connections 2021-04-09T18:35:09.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.559 7f4f2d04b700 1 -- 172.21.15.79:0/1526497860 wait complete. 2021-04-09T18:35:09.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f2d04b700 1 Processor -- start 2021-04-09T18:35:09.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f2d04b700 1 -- start start 2021-04-09T18:35:09.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f2d04b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f2809a890 0x7f4f280d0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:09.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f2d04b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f28099bd0 0x7f4f280ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:09.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f2d04b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f2809a020 0x7f4f280cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:09.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f2d04b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2809a590 con 0x7f4f2809a890 2021-04-09T18:35:09.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f2d04b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2809ace0 con 0x7f4f2809a020 2021-04-09T18:35:09.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f2d04b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f28093b10 con 0x7f4f28099bd0 2021-04-09T18:35:09.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f26d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f2809a890 0x7f4f280d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:09.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f26d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f2809a890 0x7f4f280d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34714/0 (socket says 172.21.15.79:34714) 2021-04-09T18:35:09.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f26d9d700 1 -- 172.21.15.79:0/3917263761 learned_addr learned my addr 172.21.15.79:0/3917263761 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:09.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f2659c700 1 --2- 172.21.15.79:0/3917263761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f28099bd0 0x7f4f280ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:09.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f2759e700 1 --2- 172.21.15.79:0/3917263761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f2809a020 0x7f4f280cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:09.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f26d9d700 1 -- 172.21.15.79:0/3917263761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f28099bd0 msgr2=0x7f4f280ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:09.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f26d9d700 1 --2- 172.21.15.79:0/3917263761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f28099bd0 0x7f4f280ce9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f26d9d700 1 -- 172.21.15.79:0/3917263761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f2809a020 msgr2=0x7f4f280cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:09.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f26d9d700 1 --2- 172.21.15.79:0/3917263761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f2809a020 0x7f4f280cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f26d9d700 1 -- 172.21.15.79:0/3917263761 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f280995e0 con 0x7f4f2809a890 2021-04-09T18:35:09.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f26d9d700 1 --2- 172.21.15.79:0/3917263761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f2809a890 0x7f4f280d0400 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f4f280b9b10 tx=0x7f4f10006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:09.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f1f7fe700 1 -- 172.21.15.79:0/3917263761 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4f280995e0 con 0x7f4f2809a890 2021-04-09T18:35:09.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f1f7fe700 1 -- 172.21.15.79:0/3917263761 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f10011c50 con 0x7f4f2809a890 2021-04-09T18:35:09.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f2d04b700 1 -- 172.21.15.79:0/3917263761 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f280b9100 con 0x7f4f2809a890 2021-04-09T18:35:09.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f1f7fe700 1 -- 172.21.15.79:0/3917263761 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4f1001d630 con 0x7f4f2809a890 2021-04-09T18:35:09.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f2d04b700 1 -- 172.21.15.79:0/3917263761 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f280cf790 con 0x7f4f2809a890 2021-04-09T18:35:09.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f1f7fe700 1 -- 172.21.15.79:0/3917263761 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4f10026450 con 0x7f4f2809a890 2021-04-09T18:35:09.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f1f7fe700 1 --2- 172.21.15.79:0/3917263761 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4f0c029100 0x7f4f0c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:09.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.563 7f4f1f7fe700 1 -- 172.21.15.79:0/3917263761 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f4f1003af90 con 0x7f4f2809a890 2021-04-09T18:35:09.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.567 7f4f2659c700 1 --2- 172.21.15.79:0/3917263761 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4f0c029100 0x7f4f0c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:09.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.567 7f4f2659c700 1 --2- 172.21.15.79:0/3917263761 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4f0c029100 0x7f4f0c02b650 crc :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:09.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.571 7f4f2d04b700 1 -- 172.21.15.79:0/3917263761 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f280e39e0 con 0x7f4f2809a890 2021-04-09T18:35:09.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.579 7f4f1f7fe700 1 -- 172.21.15.79:0/3917263761 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4f10011a40 con 0x7f4f2809a890 2021-04-09T18:35:09.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.755 7f4f2d04b700 1 -- 172.21.15.79:0/3917263761 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f4f280f5b20 con 0x7f4f2809a890 2021-04-09T18:35:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.819 7f4f1f7fe700 1 -- 172.21.15.79:0/3917263761 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v122) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4f10009770 con 0x7f4f2809a890 2021-04-09T18:35:09.824 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blacklist entries 2021-04-09T18:35:09.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.823 7f4f2d04b700 1 -- 172.21.15.79:0/3917263761 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4f0c029100 msgr2=0x7f4f0c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.823 7f4f2d04b700 1 --2- 172.21.15.79:0/3917263761 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4f0c029100 0x7f4f0c02b650 crc :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.823 7f4f2d04b700 1 -- 172.21.15.79:0/3917263761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f2809a890 msgr2=0x7f4f280d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.823 7f4f2d04b700 1 --2- 172.21.15.79:0/3917263761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f2809a890 0x7f4f280d0400 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f4f280b9b10 tx=0x7f4f10006890).stop 2021-04-09T18:35:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.823 7f4f2d04b700 1 -- 172.21.15.79:0/3917263761 shutdown_connections 2021-04-09T18:35:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.823 7f4f2d04b700 1 --2- 172.21.15.79:0/3917263761 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4f0c029100 0x7f4f0c02b650 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.823 7f4f2d04b700 1 --2- 172.21.15.79:0/3917263761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f2809a020 0x7f4f280cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.823 7f4f2d04b700 1 --2- 172.21.15.79:0/3917263761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f2809a890 0x7f4f280d0400 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.823 7f4f2d04b700 1 --2- 172.21.15.79:0/3917263761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f28099bd0 0x7f4f280ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.823 7f4f2d04b700 1 -- 172.21.15.79:0/3917263761 >> 172.21.15.79:0/3917263761 conn(0x7f4f280bb040 msgr2=0x7f4f280d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.823 7f4f2d04b700 1 -- 172.21.15.79:0/3917263761 shutdown_connections 2021-04-09T18:35:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.823 7f4f2d04b700 1 -- 172.21.15.79:0/3917263761 wait complete. 2021-04-09T18:35:09.841 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-04-09T18:35:09.842 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-04-09T18:35:09.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.927 7fd2b60c4700 1 Processor -- start 2021-04-09T18:35:09.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.927 7fd2b60c4700 1 -- start start 2021-04-09T18:35:09.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2b60c4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2b00f5510 0x7fd2b00f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:09.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2b60c4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd2b00e9ad0 0x7fd2b009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:09.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2b60c4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b00fbb10 con 0x7fd2b01c2da0 2021-04-09T18:35:09.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2b60c4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b00e9f20 con 0x7fd2b00e9ad0 2021-04-09T18:35:09.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2b60c4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00e59c0 con 0x7fd2b00f5510 2021-04-09T18:35:09.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2aeffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd2b00e9ad0 0x7fd2b009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:09.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2aeffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd2b00e9ad0 0x7fd2b009f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34724/0 (socket says 172.21.15.79:34724) 2021-04-09T18:35:09.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2aeffd700 1 -- 172.21.15.79:0/2040528299 learned_addr learned my addr 172.21.15.79:0/2040528299 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:09.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2af7fe700 1 --2- 172.21.15.79:0/2040528299 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2b00f5510 0x7fd2b00f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:09.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2aeffd700 1 -- 172.21.15.79:0/2040528299 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2b00f5510 msgr2=0x7fd2b00f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:09.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2ae7fc700 1 -- 172.21.15.79:0/2040528299 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925022386 0 0) 0x7fd2a8001450 con 0x7fd2b01c2da0 2021-04-09T18:35:09.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2aeffd700 1 --2- 172.21.15.79:0/2040528299 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2b00f5510 0x7fd2b00f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2aeffd700 1 -- 172.21.15.79:0/2040528299 >> v1:172.21.15.89:6789/0 conn(0x7fd2b01c2da0 legacy=0x7fd2b01c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:09.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2aeffd700 1 -- 172.21.15.79:0/2040528299 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b00e56c0 con 0x7fd2b00e9ad0 2021-04-09T18:35:09.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2aeffd700 1 --2- 172.21.15.79:0/2040528299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2b00e9ad0 0x7fd2b009f100 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7fd2a4002f30 tx=0x7fd2a400bda0).ready entity=mon.0 client_cookie=912dd70c6c4def93 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:09.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2ae7fc700 1 -- 172.21.15.79:0/2040528299 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd2b00e56c0 con 0x7fd2b00e9ad0 2021-04-09T18:35:09.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2ae7fc700 1 -- 172.21.15.79:0/2040528299 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a40099d0 con 0x7fd2b00e9ad0 2021-04-09T18:35:09.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2ae7fc700 1 -- 172.21.15.79:0/2040528299 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd2a4009da0 con 0x7fd2b00e9ad0 2021-04-09T18:35:09.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2b60c4700 1 -- 172.21.15.79:0/2040528299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2b00e9ad0 msgr2=0x7fd2b009f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:09.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2b60c4700 1 --2- 172.21.15.79:0/2040528299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2b00e9ad0 0x7fd2b009f100 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7fd2a4002f30 tx=0x7fd2a400bda0).stop 2021-04-09T18:35:09.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2b60c4700 1 -- 172.21.15.79:0/2040528299 shutdown_connections 2021-04-09T18:35:09.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2b60c4700 1 --2- 172.21.15.79:0/2040528299 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2b00f5510 0x7fd2b00f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2b60c4700 1 --2- 172.21.15.79:0/2040528299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2b00e9ad0 0x7fd2b009f100 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2b60c4700 1 -- 172.21.15.79:0/2040528299 >> 172.21.15.79:0/2040528299 conn(0x7fd2b00e5fd0 msgr2=0x7fd2b00e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:09.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2b60c4700 1 -- 172.21.15.79:0/2040528299 shutdown_connections 2021-04-09T18:35:09.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.931 7fd2b60c4700 1 -- 172.21.15.79:0/2040528299 wait complete. 2021-04-09T18:35:09.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.935 7fd2b60c4700 1 Processor -- start 2021-04-09T18:35:09.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.935 7fd2b60c4700 1 -- start start 2021-04-09T18:35:09.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd2b60c4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2b00d8a50 0x7fd2b01a9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:09.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd2b60c4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2b0093e60 0x7fd2b00942b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:09.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd2b60c4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2b0099990 0x7fd2b0099de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:09.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd2b60c4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00d5200 con 0x7fd2b00d8a50 2021-04-09T18:35:09.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd2b60c4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00d5500 con 0x7fd2b0093e60 2021-04-09T18:35:09.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd2b60c4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00d8ea0 con 0x7fd2b0099990 2021-04-09T18:35:09.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd2af7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2b00d8a50 0x7fd2b01a9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:09.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd2af7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2b00d8a50 0x7fd2b01a9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34728/0 (socket says 172.21.15.79:34728) 2021-04-09T18:35:09.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd2af7fe700 1 -- 172.21.15.79:0/1030573682 learned_addr learned my addr 172.21.15.79:0/1030573682 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:09.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd2aeffd700 1 --2- 172.21.15.79:0/1030573682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2b0093e60 0x7fd2b00942b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:09.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd2affff700 1 --2- 172.21.15.79:0/1030573682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2b0099990 0x7fd2b0099de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:09.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd2af7fe700 1 -- 172.21.15.79:0/1030573682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2b0099990 msgr2=0x7fd2b0099de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:09.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd2af7fe700 1 --2- 172.21.15.79:0/1030573682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2b0099990 0x7fd2b0099de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd2af7fe700 1 -- 172.21.15.79:0/1030573682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2b0093e60 msgr2=0x7fd2b00942b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd2af7fe700 1 --2- 172.21.15.79:0/1030573682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2b0093e60 0x7fd2b00942b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd2af7fe700 1 -- 172.21.15.79:0/1030573682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b00d4e30 con 0x7fd2b00d8a50 2021-04-09T18:35:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd2af7fe700 1 --2- 172.21.15.79:0/1030573682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2b00d8a50 0x7fd2b01a9e50 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fd2b00d5180 tx=0x7fd2a000c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:09.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd297fff700 1 -- 172.21.15.79:0/1030573682 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd2b00d4e30 con 0x7fd2b00d8a50 2021-04-09T18:35:09.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd297fff700 1 -- 172.21.15.79:0/1030573682 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a000cd60 con 0x7fd2b00d8a50 2021-04-09T18:35:09.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd2b60c4700 1 -- 172.21.15.79:0/1030573682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b0094c30 con 0x7fd2b00d8a50 2021-04-09T18:35:09.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd297fff700 1 -- 172.21.15.79:0/1030573682 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd2a000f040 con 0x7fd2b00d8a50 2021-04-09T18:35:09.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.939 7fd2b60c4700 1 -- 172.21.15.79:0/1030573682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b00d6c30 con 0x7fd2b00d8a50 2021-04-09T18:35:09.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.943 7fd297fff700 1 -- 172.21.15.79:0/1030573682 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd2a0011070 con 0x7fd2b00d8a50 2021-04-09T18:35:09.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.943 7fd297fff700 1 --2- 172.21.15.79:0/1030573682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd290029100 0x7fd29002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:09.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.943 7fd297fff700 1 -- 172.21.15.79:0/1030573682 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fd2a0010040 con 0x7fd2b00d8a50 2021-04-09T18:35:09.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.943 7fd2b60c4700 1 -- 172.21.15.79:0/1030573682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b00e39d0 con 0x7fd2b00d8a50 2021-04-09T18:35:09.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.943 7fd2aeffd700 1 --2- 172.21.15.79:0/1030573682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd290029100 0x7fd29002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:09.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.943 7fd2aeffd700 1 --2- 172.21.15.79:0/1030573682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd290029100 0x7fd29002b650 crc :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:09.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:09.947 7fd297fff700 1 -- 172.21.15.79:0/1030573682 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd2a000c960 con 0x7fd2b00d8a50 2021-04-09T18:35:10.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.107 7fd2b60c4700 1 -- 172.21.15.79:0/1030573682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd2b00f5b10 con 0x7fd2b00d8a50 2021-04-09T18:35:10.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.107 7fd297fff700 1 -- 172.21.15.79:0/1030573682 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v35) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fd2a0000bf0 con 0x7fd2b00d8a50 2021-04-09T18:35:10.114 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:10.115 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:35:10.115 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2021-04-09T18:35:10.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:10.116 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2021-04-09T18:35:10.116 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgovEoMhAAbDfArG3lSFAdk80rS/4iEQ==", 2021-04-09T18:35:10.117 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:10.117 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:35:10.117 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:10.118 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:10.118 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:10.119 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:10.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:10.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:10.120 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2021-04-09T18:35:10.120 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgN4sfOBAAPjvDX11uLM+vgdFpdP49Kw==", 2021-04-09T18:35:10.121 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:10.121 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:35:10.121 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:10.122 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:10.122 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:10.122 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:10.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:10.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:10.123 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2021-04-09T18:35:10.123 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQALnHBgro0COxAAgbe5jxAZH9bD7zDLbtdkhQ==", 2021-04-09T18:35:10.123 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:10.123 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:10.124 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:10.124 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:10.124 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:10.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:10.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:10.125 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2021-04-09T18:35:10.125 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAPnHBghZ/oARAAhkN+fnZJiskmHnvvs+G8NA==", 2021-04-09T18:35:10.125 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:10.125 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:10.126 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:10.126 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:10.126 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:10.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:10.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:10.127 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2021-04-09T18:35:10.127 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQASnHBgWT2FBxAACrSTbwbF18k9aPeYNohelw==", 2021-04-09T18:35:10.127 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:10.127 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:10.128 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:10.128 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:10.128 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:10.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:10.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:10.129 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2021-04-09T18:35:10.129 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAVnHBgPHy6CxAAFq+yki4AZe5ybodgTO/4/Q==", 2021-04-09T18:35:10.129 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:10.130 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:10.130 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:10.130 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:10.130 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:10.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:10.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:10.131 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2021-04-09T18:35:10.131 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAanHBgfbs4NhAAQzxM9dDML4RgQP8yamkuVw==", 2021-04-09T18:35:10.131 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:10.132 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:10.132 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:10.132 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:10.132 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:10.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:10.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:10.133 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2021-04-09T18:35:10.133 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAdnHBgi0WLOhAA4OBguOCjtmzqulUjTJ+GhQ==", 2021-04-09T18:35:10.133 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:10.134 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:10.134 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:10.134 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:10.134 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:10.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:10.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:10.135 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2021-04-09T18:35:10.135 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAhnHBgCs+PAxAAOm0wSMe/1Bu9vfTrpmrLkg==", 2021-04-09T18:35:10.135 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:10.136 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:10.136 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:10.136 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:10.136 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:10.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:10.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:10.137 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2021-04-09T18:35:10.137 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAknHBgH1S3CBAAUcdUIW7O6wH482l1yZBKBw==", 2021-04-09T18:35:10.137 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:10.138 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:10.138 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:10.138 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:10.138 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:10.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:10.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:10.139 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2021-04-09T18:35:10.139 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgxEq9BxAAap2nrjhcrf2aHzygtMclVw==", 2021-04-09T18:35:10.139 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:10.140 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:35:10.140 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:35:10.140 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:35:10.140 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:10.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:10.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:10.141 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2021-04-09T18:35:10.141 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBguJFeDRAAWL4NV4tsYRAqcwJ26kjm2Q==", 2021-04-09T18:35:10.142 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:10.142 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:35:10.142 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:35:10.142 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:35:10.142 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:10.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:10.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:10.143 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2021-04-09T18:35:10.143 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgN9X5EhAA3DBPdlRHVBHXJNH9nRFW0A==", 2021-04-09T18:35:10.144 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:10.144 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:35:10.144 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:35:10.144 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:35:10.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:10.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:10.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:10.145 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2021-04-09T18:35:10.145 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgHOSVDBAAMMqd8paqBSTQRgR7n4EXGQ==", 2021-04-09T18:35:10.146 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:10.146 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:35:10.146 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:10.146 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:10.146 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:10.147 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:10.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:10.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:10.147 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2021-04-09T18:35:10.148 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgmHJhLxAAyhBrx08J7ZFKu34MYC2Wyg==", 2021-04-09T18:35:10.148 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:10.148 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:35:10.148 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:35:10.149 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:10.149 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:10.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:10.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:10.149 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2021-04-09T18:35:10.150 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgNCCXKhAA/bKOzzjVHldj6RpMGu0c8g==", 2021-04-09T18:35:10.150 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:10.150 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:35:10.150 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:35:10.151 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:10.151 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:10.151 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:10.151 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:10.152 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:35:10.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.111 7fd2b60c4700 1 -- 172.21.15.79:0/1030573682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd290029100 msgr2=0x7fd29002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:10.154 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.111 7fd2b60c4700 1 --2- 172.21.15.79:0/1030573682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd290029100 0x7fd29002b650 crc :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.111 7fd2b60c4700 1 -- 172.21.15.79:0/1030573682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2b00d8a50 msgr2=0x7fd2b01a9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.111 7fd2b60c4700 1 --2- 172.21.15.79:0/1030573682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2b00d8a50 0x7fd2b01a9e50 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fd2b00d5180 tx=0x7fd2a000c430).stop 2021-04-09T18:35:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.111 7fd2b60c4700 1 -- 172.21.15.79:0/1030573682 shutdown_connections 2021-04-09T18:35:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.111 7fd2b60c4700 1 --2- 172.21.15.79:0/1030573682 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd290029100 0x7fd29002b650 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.111 7fd2b60c4700 1 --2- 172.21.15.79:0/1030573682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2b0099990 0x7fd2b0099de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.111 7fd2b60c4700 1 --2- 172.21.15.79:0/1030573682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2b00d8a50 0x7fd2b01a9e50 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.111 7fd2b60c4700 1 --2- 172.21.15.79:0/1030573682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2b0093e60 0x7fd2b00942b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.111 7fd2b60c4700 1 -- 172.21.15.79:0/1030573682 >> 172.21.15.79:0/1030573682 conn(0x7fd2b00d73c0 msgr2=0x7fd2b0092d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:10.156 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.111 7fd2b60c4700 1 -- 172.21.15.79:0/1030573682 shutdown_connections 2021-04-09T18:35:10.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.111 7fd2b60c4700 1 -- 172.21.15.79:0/1030573682 wait complete. 2021-04-09T18:35:10.157 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:35:10.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd48e603700 1 Processor -- start 2021-04-09T18:35:10.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd48e603700 1 -- start start 2021-04-09T18:35:10.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd48e603700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd4880f5510 0x7fd4880f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:10.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd48e603700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd4881c8000 0x7fd4881ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:10.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd48e603700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4880fbb10 con 0x7fd4880e9ad0 2021-04-09T18:35:10.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd48e603700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4880e9f20 con 0x7fd4880f5510 2021-04-09T18:35:10.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd48e603700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4881c3db0 con 0x7fd4881c8000 2021-04-09T18:35:10.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd487fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd4880f5510 0x7fd4880f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:10.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd487fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd4880f5510 0x7fd4880f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34736/0 (socket says 172.21.15.79:34736) 2021-04-09T18:35:10.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd487fff700 1 -- 172.21.15.79:0/1483466457 learned_addr learned my addr 172.21.15.79:0/1483466457 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:10.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd48cba8700 1 --2- 172.21.15.79:0/1483466457 >> v2:172.21.15.89:3300/0 conn(0x7fd4881c8000 0x7fd4881ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:10.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd487fff700 1 -- 172.21.15.79:0/1483466457 >> v2:172.21.15.89:3300/0 conn(0x7fd4881c8000 msgr2=0x7fd4881ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:10.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd487fff700 1 --2- 172.21.15.79:0/1483466457 >> v2:172.21.15.89:3300/0 conn(0x7fd4881c8000 0x7fd4881ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd487fff700 1 -- 172.21.15.79:0/1483466457 >> v1:172.21.15.89:6789/0 conn(0x7fd4880e9ad0 legacy=0x7fd48809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:10.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd487fff700 1 -- 172.21.15.79:0/1483466457 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48809f900 con 0x7fd4880f5510 2021-04-09T18:35:10.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd487fff700 1 --2- 172.21.15.79:0/1483466457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4880f5510 0x7fd4880f64a0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7fd478002f30 tx=0x7fd47800bd70).ready entity=mon.0 client_cookie=6997a1219d4a6cbd server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:10.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd486ffd700 1 -- 172.21.15.79:0/1483466457 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd48809f900 con 0x7fd4880f5510 2021-04-09T18:35:10.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd486ffd700 1 -- 172.21.15.79:0/1483466457 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd478009950 con 0x7fd4880f5510 2021-04-09T18:35:10.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd486ffd700 1 -- 172.21.15.79:0/1483466457 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd478009d20 con 0x7fd4880f5510 2021-04-09T18:35:10.268 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd48e603700 1 -- 172.21.15.79:0/1483466457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4880f5510 msgr2=0x7fd4880f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:10.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.247 7fd48e603700 1 --2- 172.21.15.79:0/1483466457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4880f5510 0x7fd4880f64a0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7fd478002f30 tx=0x7fd47800bd70).stop 2021-04-09T18:35:10.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.251 7fd48e603700 1 -- 172.21.15.79:0/1483466457 shutdown_connections 2021-04-09T18:35:10.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.251 7fd48e603700 1 --2- 172.21.15.79:0/1483466457 >> v2:172.21.15.89:3300/0 conn(0x7fd4881c8000 0x7fd4881ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.251 7fd48e603700 1 --2- 172.21.15.79:0/1483466457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4880f5510 0x7fd4880f64a0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.251 7fd48e603700 1 -- 172.21.15.79:0/1483466457 >> 172.21.15.79:0/1483466457 conn(0x7fd4880e5fd0 msgr2=0x7fd4880e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:10.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.251 7fd48e603700 1 -- 172.21.15.79:0/1483466457 shutdown_connections 2021-04-09T18:35:10.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.251 7fd48e603700 1 -- 172.21.15.79:0/1483466457 wait complete. 2021-04-09T18:35:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.251 7fd48e603700 1 Processor -- start 2021-04-09T18:35:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.251 7fd48e603700 1 -- start start 2021-04-09T18:35:10.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd48e603700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd488096200 0x7fd4880a68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd48e603700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4880b9910 0x7fd4880d7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd48e603700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4880d7ba0 0x7fd4881b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:10.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd48e603700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880a9a30 con 0x7fd488096200 2021-04-09T18:35:10.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd48e603700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880a9d30 con 0x7fd4880d7ba0 2021-04-09T18:35:10.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd48e603700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd488096650 con 0x7fd4880b9910 2021-04-09T18:35:10.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd487fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd488096200 0x7fd4880a68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:10.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd487fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd488096200 0x7fd4880a68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34742/0 (socket says 172.21.15.79:34742) 2021-04-09T18:35:10.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd48cba8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4880d7ba0 0x7fd4881b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:10.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd487fff700 1 -- 172.21.15.79:0/921233543 learned_addr learned my addr 172.21.15.79:0/921233543 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:10.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd4877fe700 1 --2- 172.21.15.79:0/921233543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4880b9910 0x7fd4880d7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd487fff700 1 -- 172.21.15.79:0/921233543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4880b9910 msgr2=0x7fd4880d7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd487fff700 1 --2- 172.21.15.79:0/921233543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4880b9910 0x7fd4880d7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd487fff700 1 -- 172.21.15.79:0/921233543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4880d7ba0 msgr2=0x7fd4881b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd487fff700 1 --2- 172.21.15.79:0/921233543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4880d7ba0 0x7fd4881b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd487fff700 1 -- 172.21.15.79:0/921233543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4880a6ef0 con 0x7fd488096200 2021-04-09T18:35:10.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd48cba8700 1 --2- 172.21.15.79:0/921233543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4880d7ba0 0x7fd4881b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:10.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd487fff700 1 --2- 172.21.15.79:0/921233543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd488096200 0x7fd4880a68c0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7fd4880d81d0 tx=0x7fd478006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:10.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd484ff9700 1 -- 172.21.15.79:0/921233543 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd4880a6ef0 con 0x7fd488096200 2021-04-09T18:35:10.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd484ff9700 1 -- 172.21.15.79:0/921233543 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd478011c40 con 0x7fd488096200 2021-04-09T18:35:10.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd484ff9700 1 -- 172.21.15.79:0/921233543 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd47801d630 con 0x7fd488096200 2021-04-09T18:35:10.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd48e603700 1 -- 172.21.15.79:0/921233543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4880a95e0 con 0x7fd488096200 2021-04-09T18:35:10.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.255 7fd48e603700 1 -- 172.21.15.79:0/921233543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4880b9d60 con 0x7fd488096200 2021-04-09T18:35:10.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.259 7fd484ff9700 1 -- 172.21.15.79:0/921233543 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd478026450 con 0x7fd488096200 2021-04-09T18:35:10.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.259 7fd484ff9700 1 --2- 172.21.15.79:0/921233543 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd468029100 0x7fd46802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:10.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.259 7fd484ff9700 1 -- 172.21.15.79:0/921233543 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fd47803aee0 con 0x7fd488096200 2021-04-09T18:35:10.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.259 7fd4877fe700 1 --2- 172.21.15.79:0/921233543 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd468029100 0x7fd46802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:10.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.259 7fd4877fe700 1 --2- 172.21.15.79:0/921233543 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd468029100 0x7fd46802b650 crc :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:10.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.259 7fd48e603700 1 -- 172.21.15.79:0/921233543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4880e39d0 con 0x7fd488096200 2021-04-09T18:35:10.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.263 7fd484ff9700 1 -- 172.21.15.79:0/921233543 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd478009740 con 0x7fd488096200 2021-04-09T18:35:10.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.427 7fd48e603700 1 -- 172.21.15.79:0/921233543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4880a1cb0 con 0x7fd488096200 2021-04-09T18:35:10.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.427 7fd484ff9700 1 -- 172.21.15.79:0/921233543 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+11387 (secure 0 0 0) 0x7fd478011a30 con 0x7fd488096200 2021-04-09T18:35:10.436 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:10.437 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":122,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:35:09.816510","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:35:10.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.431 7fd48e603700 1 -- 172.21.15.79:0/921233543 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd468029100 msgr2=0x7fd46802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:10.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.431 7fd48e603700 1 --2- 172.21.15.79:0/921233543 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd468029100 0x7fd46802b650 crc :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.431 7fd48e603700 1 -- 172.21.15.79:0/921233543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd488096200 msgr2=0x7fd4880a68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:10.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.431 7fd48e603700 1 --2- 172.21.15.79:0/921233543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd488096200 0x7fd4880a68c0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7fd4880d81d0 tx=0x7fd478006890).stop 2021-04-09T18:35:10.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.431 7fd48e603700 1 -- 172.21.15.79:0/921233543 shutdown_connections 2021-04-09T18:35:10.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.431 7fd48e603700 1 --2- 172.21.15.79:0/921233543 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd468029100 0x7fd46802b650 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.440 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.431 7fd48e603700 1 --2- 172.21.15.79:0/921233543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4880d7ba0 0x7fd4881b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.431 7fd48e603700 1 --2- 172.21.15.79:0/921233543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd488096200 0x7fd4880a68c0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.431 7fd48e603700 1 --2- 172.21.15.79:0/921233543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4880b9910 0x7fd4880d7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.441 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.431 7fd48e603700 1 -- 172.21.15.79:0/921233543 >> 172.21.15.79:0/921233543 conn(0x7fd48809a600 msgr2=0x7fd4880aed10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:10.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.431 7fd48e603700 1 -- 172.21.15.79:0/921233543 shutdown_connections 2021-04-09T18:35:10.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.431 7fd48e603700 1 -- 172.21.15.79:0/921233543 wait complete. 2021-04-09T18:35:10.450 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-04-09T18:35:10.450 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:35:10.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.539 7f867da45700 1 Processor -- start 2021-04-09T18:35:10.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.539 7f867da45700 1 -- start start 2021-04-09T18:35:10.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.539 7f867da45700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86780f5550 0x7f86780f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:10.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.539 7f867da45700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f86780e9b10 0x7f867809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:10.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.539 7f867da45700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86780fbb50 con 0x7f86781c2de0 2021-04-09T18:35:10.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.539 7f867da45700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86780e9f60 con 0x7f86780e9b10 2021-04-09T18:35:10.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.539 7f867da45700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86780e5a00 con 0x7f86780f5550 2021-04-09T18:35:10.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f8677d51700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f86781c2de0 0x7f86781c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57696/0 (socket says 172.21.15.79:57696) 2021-04-09T18:35:10.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f8677d51700 1 -- 172.21.15.79:0/2319197665 learned_addr learned my addr 172.21.15.79:0/2319197665 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:10.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f8676d4f700 1 --2- 172.21.15.79:0/2319197665 >> v2:172.21.15.89:3300/0 conn(0x7f86780e9b10 0x7f867809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:10.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f8677550700 1 --2- 172.21.15.79:0/2319197665 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86780f5550 0x7f86780f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:10.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f867654e700 1 -- 172.21.15.79:0/2319197665 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420354194 0 0) 0x7f8670001450 con 0x7f86781c2de0 2021-04-09T18:35:10.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f867654e700 1 -- 172.21.15.79:0/2319197665 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8664003240 con 0x7f86781c2de0 2021-04-09T18:35:10.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f8676d4f700 1 -- 172.21.15.79:0/2319197665 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86780f5550 msgr2=0x7f86780f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:10.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f8676d4f700 1 --2- 172.21.15.79:0/2319197665 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86780f5550 0x7f86780f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f8676d4f700 1 -- 172.21.15.79:0/2319197665 >> v1:172.21.15.79:6789/0 conn(0x7f86781c2de0 legacy=0x7f86781c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:10.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f8676d4f700 1 -- 172.21.15.79:0/2319197665 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86780e5700 con 0x7f86780e9b10 2021-04-09T18:35:10.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f8676d4f700 1 --2- 172.21.15.79:0/2319197665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86780e9b10 0x7f867809f110 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f8668002f30 tx=0x7f866800bd40).ready entity=mon.1 client_cookie=56789421b2a99720 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:10.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f867654e700 1 -- 172.21.15.79:0/2319197665 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f86780e5700 con 0x7f86780e9b10 2021-04-09T18:35:10.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f867654e700 1 -- 172.21.15.79:0/2319197665 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8668009850 con 0x7f86780e9b10 2021-04-09T18:35:10.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f867654e700 1 -- 172.21.15.79:0/2319197665 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8668009c20 con 0x7f86780e9b10 2021-04-09T18:35:10.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f867da45700 1 -- 172.21.15.79:0/2319197665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86780e9b10 msgr2=0x7f867809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:10.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f867da45700 1 --2- 172.21.15.79:0/2319197665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86780e9b10 0x7f867809f110 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f8668002f30 tx=0x7f866800bd40).stop 2021-04-09T18:35:10.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f867da45700 1 -- 172.21.15.79:0/2319197665 shutdown_connections 2021-04-09T18:35:10.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f867da45700 1 --2- 172.21.15.79:0/2319197665 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86780f5550 0x7f86780f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f867da45700 1 --2- 172.21.15.79:0/2319197665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86780e9b10 0x7f867809f110 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f867da45700 1 -- 172.21.15.79:0/2319197665 >> 172.21.15.79:0/2319197665 conn(0x7f86780e6010 msgr2=0x7f86780e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:10.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f867da45700 1 -- 172.21.15.79:0/2319197665 shutdown_connections 2021-04-09T18:35:10.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.543 7f867da45700 1 -- 172.21.15.79:0/2319197665 wait complete. 2021-04-09T18:35:10.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f867da45700 1 Processor -- start 2021-04-09T18:35:10.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f867da45700 1 -- start start 2021-04-09T18:35:10.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f867da45700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86780973c0 0x7f867808e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:10.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f867da45700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86780ba0c0 0x7f86780d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:10.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f867da45700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86780d1520 0x7f867808efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:10.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f867da45700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8678097a30 con 0x7f86780d1520 2021-04-09T18:35:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f867da45700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8678097d30 con 0x7f86780973c0 2021-04-09T18:35:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f867da45700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86780ba510 con 0x7f86780ba0c0 2021-04-09T18:35:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f8677d51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86780d1520 0x7f867808efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:10.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f8677d51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86780d1520 0x7f867808efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34760/0 (socket says 172.21.15.79:34760) 2021-04-09T18:35:10.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f8677d51700 1 -- 172.21.15.79:0/682511592 learned_addr learned my addr 172.21.15.79:0/682511592 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:10.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f8676d4f700 1 --2- 172.21.15.79:0/682511592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86780ba0c0 0x7f86780d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:10.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f8677550700 1 --2- 172.21.15.79:0/682511592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86780973c0 0x7f867808e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:10.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f8677d51700 1 -- 172.21.15.79:0/682511592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86780ba0c0 msgr2=0x7f86780d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:10.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f8677d51700 1 --2- 172.21.15.79:0/682511592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86780ba0c0 0x7f86780d0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f8677d51700 1 -- 172.21.15.79:0/682511592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86780973c0 msgr2=0x7f867808e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:10.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f8677d51700 1 --2- 172.21.15.79:0/682511592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86780973c0 0x7f867808e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f8677d51700 1 -- 172.21.15.79:0/682511592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867808ec80 con 0x7f86780d1520 2021-04-09T18:35:10.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f8676d4f700 1 --2- 172.21.15.79:0/682511592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86780ba0c0 0x7f86780d0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:10.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f8677550700 1 --2- 172.21.15.79:0/682511592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86780973c0 0x7f867808e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:10.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f8677d51700 1 --2- 172.21.15.79:0/682511592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86780d1520 0x7f867808efb0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f86780979b0 tx=0x7f867000cec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:10.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f866ffff700 1 -- 172.21.15.79:0/682511592 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f867808ec80 con 0x7f86780d1520 2021-04-09T18:35:10.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f866ffff700 1 -- 172.21.15.79:0/682511592 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8670005b80 con 0x7f86780d1520 2021-04-09T18:35:10.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f866ffff700 1 -- 172.21.15.79:0/682511592 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8670007110 con 0x7f86780d1520 2021-04-09T18:35:10.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f867da45700 1 -- 172.21.15.79:0/682511592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867808f5e0 con 0x7f86780d1520 2021-04-09T18:35:10.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.547 7f867da45700 1 -- 172.21.15.79:0/682511592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86780992d0 con 0x7f86780d1520 2021-04-09T18:35:10.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.551 7f866ffff700 1 -- 172.21.15.79:0/682511592 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f867001a060 con 0x7f86780d1520 2021-04-09T18:35:10.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.551 7f866ffff700 1 --2- 172.21.15.79:0/682511592 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f865c029100 0x7f865c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:10.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.551 7f866ffff700 1 -- 172.21.15.79:0/682511592 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f8670038bb0 con 0x7f86780d1520 2021-04-09T18:35:10.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.551 7f8677550700 1 --2- 172.21.15.79:0/682511592 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f865c029100 0x7f865c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:10.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.551 7f8677550700 1 --2- 172.21.15.79:0/682511592 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f865c029100 0x7f865c02b650 crc :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:10.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.555 7f867da45700 1 -- 172.21.15.79:0/682511592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86780e39f0 con 0x7f86780d1520 2021-04-09T18:35:10.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.563 7f866ffff700 1 -- 172.21.15.79:0/682511592 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8670005970 con 0x7f86780d1520 2021-04-09T18:35:10.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.727 7f867da45700 1 -- 172.21.15.79:0/682511592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f86780f5b50 con 0x7f86780d1520 2021-04-09T18:35:10.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.727 7f866ffff700 1 -- 172.21.15.79:0/682511592 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v122) v1 ==== 92+0+10 (secure 0 0 0) 0x7f86780f76f0 con 0x7f86780d1520 2021-04-09T18:35:10.734 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:35:10.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.731 7f867da45700 1 -- 172.21.15.79:0/682511592 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f865c029100 msgr2=0x7f865c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:10.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.731 7f867da45700 1 --2- 172.21.15.79:0/682511592 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f865c029100 0x7f865c02b650 crc :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.731 7f867da45700 1 -- 172.21.15.79:0/682511592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86780d1520 msgr2=0x7f867808efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:10.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.731 7f867da45700 1 --2- 172.21.15.79:0/682511592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86780d1520 0x7f867808efb0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f86780979b0 tx=0x7f867000cec0).stop 2021-04-09T18:35:10.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.731 7f867da45700 1 -- 172.21.15.79:0/682511592 shutdown_connections 2021-04-09T18:35:10.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.731 7f867da45700 1 --2- 172.21.15.79:0/682511592 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f865c029100 0x7f865c02b650 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.731 7f867da45700 1 --2- 172.21.15.79:0/682511592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86780973c0 0x7f867808e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.731 7f867da45700 1 --2- 172.21.15.79:0/682511592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86780d1520 0x7f867808efb0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.731 7f867da45700 1 --2- 172.21.15.79:0/682511592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86780ba0c0 0x7f86780d0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.731 7f867da45700 1 -- 172.21.15.79:0/682511592 >> 172.21.15.79:0/682511592 conn(0x7f86780d8b60 msgr2=0x7f86780d4140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:10.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.731 7f867da45700 1 -- 172.21.15.79:0/682511592 shutdown_connections 2021-04-09T18:35:10.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.731 7f867da45700 1 -- 172.21.15.79:0/682511592 wait complete. 2021-04-09T18:35:10.747 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-04-09T18:35:10.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.835 7fea1880a700 1 Processor -- start 2021-04-09T18:35:10.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea1880a700 1 -- start start 2021-04-09T18:35:10.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea1880a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea140e9ad0 0x7fea1409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:10.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea1880a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fea141c8000 0x7fea141ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:10.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea1880a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea140fbb10 con 0x7fea140f5510 2021-04-09T18:35:10.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea1880a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea141c3db0 con 0x7fea141c8000 2021-04-09T18:35:10.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea1880a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea140e9f20 con 0x7fea140e9ad0 2021-04-09T18:35:10.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea12da5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fea141c8000 0x7fea141ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:10.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea12da5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fea141c8000 0x7fea141ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34768/0 (socket says 172.21.15.79:34768) 2021-04-09T18:35:10.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea12da5700 1 -- 172.21.15.79:0/1667870341 learned_addr learned my addr 172.21.15.79:0/1667870341 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea125a4700 1 --1- 172.21.15.79:0/1667870341 >> v1:172.21.15.89:6789/0 conn(0x7fea140f5510 0x7fea140f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:58176/0 (socket says 172.21.15.79:58176) 2021-04-09T18:35:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea11da3700 1 --2- 172.21.15.79:0/1667870341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea140e9ad0 0x7fea1409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:10.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea115a2700 1 -- 172.21.15.79:0/1667870341 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799228083 0 0) 0x7fea080010d0 con 0x7fea140f5510 2021-04-09T18:35:10.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea12da5700 1 -- 172.21.15.79:0/1667870341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea140e9ad0 msgr2=0x7fea1409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:10.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea12da5700 1 --2- 172.21.15.79:0/1667870341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea140e9ad0 0x7fea1409f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea12da5700 1 -- 172.21.15.79:0/1667870341 >> v1:172.21.15.89:6789/0 conn(0x7fea140f5510 legacy=0x7fea140f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:10.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea12da5700 1 -- 172.21.15.79:0/1667870341 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea140e56c0 con 0x7fea141c8000 2021-04-09T18:35:10.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea11da3700 1 --2- 172.21.15.79:0/1667870341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea140e9ad0 0x7fea1409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:10.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea12da5700 1 --2- 172.21.15.79:0/1667870341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea141c8000 0x7fea141ca460 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7fea0c0032b0 tx=0x7fea0c00b3c0).ready entity=mon.0 client_cookie=17e9f6e422f8a5bc server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:10.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea115a2700 1 -- 172.21.15.79:0/1667870341 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fea140e56c0 con 0x7fea141c8000 2021-04-09T18:35:10.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea115a2700 1 -- 172.21.15.79:0/1667870341 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c00bc20 con 0x7fea141c8000 2021-04-09T18:35:10.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea115a2700 1 -- 172.21.15.79:0/1667870341 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fea0c002020 con 0x7fea141c8000 2021-04-09T18:35:10.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea1880a700 1 -- 172.21.15.79:0/1667870341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea141c8000 msgr2=0x7fea141ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:10.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea1880a700 1 --2- 172.21.15.79:0/1667870341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea141c8000 0x7fea141ca460 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7fea0c0032b0 tx=0x7fea0c00b3c0).stop 2021-04-09T18:35:10.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea1880a700 1 -- 172.21.15.79:0/1667870341 shutdown_connections 2021-04-09T18:35:10.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea1880a700 1 --2- 172.21.15.79:0/1667870341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea141c8000 0x7fea141ca460 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea1880a700 1 --2- 172.21.15.79:0/1667870341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea140e9ad0 0x7fea1409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea1880a700 1 -- 172.21.15.79:0/1667870341 >> 172.21.15.79:0/1667870341 conn(0x7fea140e5fd0 msgr2=0x7fea140e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:10.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea1880a700 1 -- 172.21.15.79:0/1667870341 shutdown_connections 2021-04-09T18:35:10.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.839 7fea1880a700 1 -- 172.21.15.79:0/1667870341 wait complete. 2021-04-09T18:35:10.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea1880a700 1 Processor -- start 2021-04-09T18:35:10.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea1880a700 1 -- start start 2021-04-09T18:35:10.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea1880a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea1409aec0 0x7fea140a9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:10.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea1880a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea140b96c0 0x7fea1409a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:10.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea1880a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea140cfba0 0x7fea140cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:10.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea1880a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1409abc0 con 0x7fea140cfba0 2021-04-09T18:35:10.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea1880a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea14094400 con 0x7fea140b96c0 2021-04-09T18:35:10.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea1880a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea14099c30 con 0x7fea1409aec0 2021-04-09T18:35:10.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea12da5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea140cfba0 0x7fea140cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:10.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea12da5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea140cfba0 0x7fea140cfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34772/0 (socket says 172.21.15.79:34772) 2021-04-09T18:35:10.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea12da5700 1 -- 172.21.15.79:0/1792701567 learned_addr learned my addr 172.21.15.79:0/1792701567 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:10.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea11da3700 1 --2- 172.21.15.79:0/1792701567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea140b96c0 0x7fea1409a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:10.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea125a4700 1 --2- 172.21.15.79:0/1792701567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea1409aec0 0x7fea140a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:10.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea12da5700 1 -- 172.21.15.79:0/1792701567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea1409aec0 msgr2=0x7fea140a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:10.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea12da5700 1 --2- 172.21.15.79:0/1792701567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea1409aec0 0x7fea140a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea12da5700 1 -- 172.21.15.79:0/1792701567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea140b96c0 msgr2=0x7fea1409a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:10.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea12da5700 1 --2- 172.21.15.79:0/1792701567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea140b96c0 0x7fea1409a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:10.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea12da5700 1 -- 172.21.15.79:0/1792701567 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea140accc0 con 0x7fea140cfba0 2021-04-09T18:35:10.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea125a4700 1 --2- 172.21.15.79:0/1792701567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea1409aec0 0x7fea140a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:10.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea11da3700 1 --2- 172.21.15.79:0/1792701567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea140b96c0 0x7fea1409a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:10.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea12da5700 1 --2- 172.21.15.79:0/1792701567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea140cfba0 0x7fea140cfff0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7fea140d0810 tx=0x7fea0c006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:10.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea02ffd700 1 -- 172.21.15.79:0/1792701567 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fea140accc0 con 0x7fea140cfba0 2021-04-09T18:35:10.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea02ffd700 1 -- 172.21.15.79:0/1792701567 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c00bc20 con 0x7fea140cfba0 2021-04-09T18:35:10.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea1880a700 1 -- 172.21.15.79:0/1792701567 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1409a720 con 0x7fea140cfba0 2021-04-09T18:35:10.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea02ffd700 1 -- 172.21.15.79:0/1792701567 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fea0c020020 con 0x7fea140cfba0 2021-04-09T18:35:10.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.843 7fea1880a700 1 -- 172.21.15.79:0/1792701567 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea140b7c60 con 0x7fea140cfba0 2021-04-09T18:35:10.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.847 7fea02ffd700 1 -- 172.21.15.79:0/1792701567 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fea0c019040 con 0x7fea140cfba0 2021-04-09T18:35:10.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.847 7fea02ffd700 1 --2- 172.21.15.79:0/1792701567 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe9f8029100 0x7fe9f802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:10.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.847 7fea02ffd700 1 -- 172.21.15.79:0/1792701567 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fea0c003020 con 0x7fea140cfba0 2021-04-09T18:35:10.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.847 7fea125a4700 1 --2- 172.21.15.79:0/1792701567 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe9f8029100 0x7fe9f802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:10.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.847 7fea125a4700 1 --2- 172.21.15.79:0/1792701567 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe9f8029100 0x7fe9f802b650 crc :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:10.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.851 7fea1880a700 1 -- 172.21.15.79:0/1792701567 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea140e39d0 con 0x7fea140cfba0 2021-04-09T18:35:10.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:10.859 7fea02ffd700 1 -- 172.21.15.79:0/1792701567 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fea0c00ba10 con 0x7fea140cfba0 2021-04-09T18:35:11.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.007 7fea1880a700 1 -- 172.21.15.79:0/1792701567 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fea140f5b10 con 0x7fea140cfba0 2021-04-09T18:35:11.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.007 7fea02ffd700 1 -- 172.21.15.79:0/1792701567 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v122) v1 ==== 84+0+64 (secure 0 0 0) 0x7fea0c033050 con 0x7fea140cfba0 2021-04-09T18:35:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:11.015 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2021-04-09T18:35:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2021-04-09T18:35:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": "rbd" 2021-04-09T18:35:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:11.017 INFO:teuthology.orchestra.run.smithi079.stdout:] 2021-04-09T18:35:11.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.011 7fea1880a700 1 -- 172.21.15.79:0/1792701567 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe9f8029100 msgr2=0x7fe9f802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:11.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.011 7fea1880a700 1 --2- 172.21.15.79:0/1792701567 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe9f8029100 0x7fe9f802b650 crc :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:11.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.011 7fea1880a700 1 -- 172.21.15.79:0/1792701567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea140cfba0 msgr2=0x7fea140cfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:11.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.011 7fea1880a700 1 --2- 172.21.15.79:0/1792701567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea140cfba0 0x7fea140cfff0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7fea140d0810 tx=0x7fea0c006c10).stop 2021-04-09T18:35:11.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.011 7fea1880a700 1 -- 172.21.15.79:0/1792701567 shutdown_connections 2021-04-09T18:35:11.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.011 7fea1880a700 1 --2- 172.21.15.79:0/1792701567 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe9f8029100 0x7fe9f802b650 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:11.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.011 7fea1880a700 1 --2- 172.21.15.79:0/1792701567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea140cfba0 0x7fea140cfff0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:11.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.011 7fea1880a700 1 --2- 172.21.15.79:0/1792701567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea1409aec0 0x7fea140a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:11.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.011 7fea1880a700 1 --2- 172.21.15.79:0/1792701567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea140b96c0 0x7fea1409a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:11.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.011 7fea1880a700 1 -- 172.21.15.79:0/1792701567 >> 172.21.15.79:0/1792701567 conn(0x7fea14093d40 msgr2=0x7fea140d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:11.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.011 7fea1880a700 1 -- 172.21.15.79:0/1792701567 shutdown_connections 2021-04-09T18:35:11.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.011 7fea1880a700 1 -- 172.21.15.79:0/1792701567 wait complete. 2021-04-09T18:35:11.027 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-04-09T18:35:11.028 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-04-09T18:35:11.129 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.115 7f33c2f71700 1 Processor -- start 2021-04-09T18:35:11.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.115 7f33c2f71700 1 -- start start 2021-04-09T18:35:11.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c2f71700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f33bc0f5550 0x7f33bc0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:11.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c2f71700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33bc1c8040 0x7f33bc1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:11.130 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c2f71700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33bc0fbb50 con 0x7f33bc0e9b10 2021-04-09T18:35:11.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c2f71700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33bc0e9f60 con 0x7f33bc0f5550 2021-04-09T18:35:11.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c2f71700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc1c3df0 con 0x7f33bc1c8040 2021-04-09T18:35:11.131 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c0d15700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f33bc0f5550 0x7f33bc0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:11.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c0d15700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f33bc0f5550 0x7f33bc0f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:51352/0 (socket says 172.21.15.79:51352) 2021-04-09T18:35:11.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c1516700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33bc1c8040 0x7f33bc1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:11.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c0d15700 1 -- 172.21.15.79:0/1742178197 learned_addr learned my addr 172.21.15.79:0/1742178197 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:11.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c0d15700 1 -- 172.21.15.79:0/1742178197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33bc1c8040 msgr2=0x7f33bc1ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:11.132 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c0d15700 1 --2- 172.21.15.79:0/1742178197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33bc1c8040 0x7f33bc1ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:11.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c0d15700 1 -- 172.21.15.79:0/1742178197 >> v1:172.21.15.89:6789/0 conn(0x7f33bc0e9b10 legacy=0x7f33bc09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:11.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c0d15700 1 -- 172.21.15.79:0/1742178197 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33bc09f910 con 0x7f33bc0f5550 2021-04-09T18:35:11.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c1516700 1 --2- 172.21.15.79:0/1742178197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33bc1c8040 0x7f33bc1ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:11.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c0d15700 1 --2- 172.21.15.79:0/1742178197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33bc0f5550 0x7f33bc0f64e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f33bc0f6f30 tx=0x7f33ac00bdd0).ready entity=mon.1 client_cookie=1dc9129d80a65a3b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:11.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33bb7fe700 1 -- 172.21.15.79:0/1742178197 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33bc09f910 con 0x7f33bc0f5550 2021-04-09T18:35:11.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33bb7fe700 1 -- 172.21.15.79:0/1742178197 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac009990 con 0x7f33bc0f5550 2021-04-09T18:35:11.134 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33bb7fe700 1 -- 172.21.15.79:0/1742178197 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33ac009d60 con 0x7f33bc0f5550 2021-04-09T18:35:11.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c2f71700 1 -- 172.21.15.79:0/1742178197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33bc0f5550 msgr2=0x7f33bc0f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:11.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c2f71700 1 --2- 172.21.15.79:0/1742178197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33bc0f5550 0x7f33bc0f64e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f33bc0f6f30 tx=0x7f33ac00bdd0).stop 2021-04-09T18:35:11.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c2f71700 1 -- 172.21.15.79:0/1742178197 shutdown_connections 2021-04-09T18:35:11.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c2f71700 1 --2- 172.21.15.79:0/1742178197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33bc1c8040 0x7f33bc1ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:11.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c2f71700 1 --2- 172.21.15.79:0/1742178197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33bc0f5550 0x7f33bc0f64e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:11.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c2f71700 1 -- 172.21.15.79:0/1742178197 >> 172.21.15.79:0/1742178197 conn(0x7f33bc0e6010 msgr2=0x7f33bc0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:11.136 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c2f71700 1 -- 172.21.15.79:0/1742178197 shutdown_connections 2021-04-09T18:35:11.137 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.119 7f33c2f71700 1 -- 172.21.15.79:0/1742178197 wait complete. 2021-04-09T18:35:11.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.123 7f33c2f71700 1 Processor -- start 2021-04-09T18:35:11.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.123 7f33c2f71700 1 -- start start 2021-04-09T18:35:11.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33c2f71700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33bc094fe0 0x7f33bc0d0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:11.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33c2f71700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33bc095430 0x7f33bc0bbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:11.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33c2f71700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33bc0d0950 0x7f33bc0bc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:11.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33c2f71700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc0e1ac0 con 0x7f33bc095430 2021-04-09T18:35:11.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33c2f71700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc0d6650 con 0x7f33bc094fe0 2021-04-09T18:35:11.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33c2f71700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc0d6950 con 0x7f33bc0d0950 2021-04-09T18:35:11.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33bbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33bc095430 0x7f33bc0bbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:11.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33bbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33bc095430 0x7f33bc0bbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34786/0 (socket says 172.21.15.79:34786) 2021-04-09T18:35:11.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33bbfff700 1 -- 172.21.15.79:0/1140887706 learned_addr learned my addr 172.21.15.79:0/1140887706 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:11.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33c1516700 1 --2- 172.21.15.79:0/1140887706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33bc0d0950 0x7f33bc0bc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:11.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33c0d15700 1 --2- 172.21.15.79:0/1140887706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33bc094fe0 0x7f33bc0d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:11.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33bbfff700 1 -- 172.21.15.79:0/1140887706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33bc0d0950 msgr2=0x7f33bc0bc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:11.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33bbfff700 1 --2- 172.21.15.79:0/1140887706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33bc0d0950 0x7f33bc0bc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:11.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33bbfff700 1 -- 172.21.15.79:0/1140887706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33bc094fe0 msgr2=0x7f33bc0d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:11.144 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33bbfff700 1 --2- 172.21.15.79:0/1140887706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33bc094fe0 0x7f33bc0d0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:11.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33bbfff700 1 -- 172.21.15.79:0/1140887706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33bc0d5d90 con 0x7f33bc095430 2021-04-09T18:35:11.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33c0d15700 1 --2- 172.21.15.79:0/1140887706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33bc094fe0 0x7f33bc0d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:11.145 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33bbfff700 1 --2- 172.21.15.79:0/1140887706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33bc095430 0x7f33bc0bbcc0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f33bc0933b0 tx=0x7f33b000cb10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:11.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33b97fa700 1 -- 172.21.15.79:0/1140887706 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33bc0d5d90 con 0x7f33bc095430 2021-04-09T18:35:11.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33b97fa700 1 -- 172.21.15.79:0/1140887706 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b0010510 con 0x7f33bc095430 2021-04-09T18:35:11.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33c2f71700 1 -- 172.21.15.79:0/1140887706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33bc0d61e0 con 0x7f33bc095430 2021-04-09T18:35:11.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33b97fa700 1 -- 172.21.15.79:0/1140887706 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33b00106f0 con 0x7f33bc095430 2021-04-09T18:35:11.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33c2f71700 1 -- 172.21.15.79:0/1140887706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33bc095940 con 0x7f33bc095430 2021-04-09T18:35:11.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.127 7f33b97fa700 1 -- 172.21.15.79:0/1140887706 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f33b0019020 con 0x7f33bc095430 2021-04-09T18:35:11.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.131 7f33b97fa700 1 --2- 172.21.15.79:0/1140887706 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f339c029100 0x7f339c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:11.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.131 7f33b97fa700 1 -- 172.21.15.79:0/1140887706 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f33b0038a90 con 0x7f33bc095430 2021-04-09T18:35:11.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.131 7f33c0d15700 1 --2- 172.21.15.79:0/1140887706 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f339c029100 0x7f339c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:11.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.131 7f33c2f71700 1 -- 172.21.15.79:0/1140887706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33bc0e39f0 con 0x7f33bc095430 2021-04-09T18:35:11.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.131 7f33c0d15700 1 --2- 172.21.15.79:0/1140887706 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f339c029100 0x7f339c02b650 crc :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:11.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.135 7f33b97fa700 1 -- 172.21.15.79:0/1140887706 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f33b0010300 con 0x7f33bc095430 2021-04-09T18:35:11.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.287 7f33c2f71700 1 -- 172.21.15.79:0/1140887706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f33bc0a1c90 con 0x7f33bc095430 2021-04-09T18:35:11.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.839 7f33b97fa700 1 -- 172.21.15.79:0/1140887706 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v123) v1 ==== 133+0+0 (secure 0 0 0) 0x7f33b0000bf0 con 0x7f33bc095430 2021-04-09T18:35:11.858 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2021-04-09T18:35:11.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.855 7f33c2f71700 1 -- 172.21.15.79:0/1140887706 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f339c029100 msgr2=0x7f339c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:11.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.855 7f33c2f71700 1 --2- 172.21.15.79:0/1140887706 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f339c029100 0x7f339c02b650 crc :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:11.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.855 7f33c2f71700 1 -- 172.21.15.79:0/1140887706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33bc095430 msgr2=0x7f33bc0bbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:11.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.855 7f33c2f71700 1 --2- 172.21.15.79:0/1140887706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33bc095430 0x7f33bc0bbcc0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f33bc0933b0 tx=0x7f33b000cb10).stop 2021-04-09T18:35:11.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.855 7f33c2f71700 1 -- 172.21.15.79:0/1140887706 shutdown_connections 2021-04-09T18:35:11.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.855 7f33c2f71700 1 --2- 172.21.15.79:0/1140887706 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f339c029100 0x7f339c02b650 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:11.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.855 7f33c2f71700 1 --2- 172.21.15.79:0/1140887706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33bc094fe0 0x7f33bc0d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:11.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.855 7f33c2f71700 1 --2- 172.21.15.79:0/1140887706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33bc0d0950 0x7f33bc0bc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:11.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.855 7f33c2f71700 1 --2- 172.21.15.79:0/1140887706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33bc095430 0x7f33bc0bbcc0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:11.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.855 7f33c2f71700 1 -- 172.21.15.79:0/1140887706 >> 172.21.15.79:0/1140887706 conn(0x7f33bc092710 msgr2=0x7f33bc0d8030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:11.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.855 7f33c2f71700 1 -- 172.21.15.79:0/1140887706 shutdown_connections 2021-04-09T18:35:11.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.855 7f33c2f71700 1 -- 172.21.15.79:0/1140887706 wait complete. 2021-04-09T18:35:11.875 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-04-09T18:35:11.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.975 7ffba109b700 1 Processor -- start 2021-04-09T18:35:11.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.975 7ffba109b700 1 -- start start 2021-04-09T18:35:11.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.975 7ffba109b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0f5550 0x7ffb9c0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:11.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.975 7ffba109b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb9c0e9b10 0x7ffb9c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:11.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.975 7ffba109b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb9c0fbb50 con 0x7ffb9c1c2de0 2021-04-09T18:35:11.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.975 7ffba109b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb9c0e9f60 con 0x7ffb9c0e9b10 2021-04-09T18:35:11.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.975 7ffba109b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c0e5a00 con 0x7ffb9c0f5550 2021-04-09T18:35:11.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.975 7ffb9a59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb9c0e9b10 0x7ffb9c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:11.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.975 7ffb9a59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb9c0e9b10 0x7ffb9c09f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34796/0 (socket says 172.21.15.79:34796) 2021-04-09T18:35:11.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.975 7ffb9a59c700 1 -- 172.21.15.79:0/2291495255 learned_addr learned my addr 172.21.15.79:0/2291495255 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:11.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.975 7ffb9ad9d700 1 --2- 172.21.15.79:0/2291495255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0f5550 0x7ffb9c0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:11.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.975 7ffb9a59c700 1 -- 172.21.15.79:0/2291495255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0f5550 msgr2=0x7ffb9c0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:11.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.975 7ffb9a59c700 1 --2- 172.21.15.79:0/2291495255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0f5550 0x7ffb9c0f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:11.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.975 7ffb9a59c700 1 -- 172.21.15.79:0/2291495255 >> v1:172.21.15.89:6789/0 conn(0x7ffb9c1c2de0 legacy=0x7ffb9c1c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:11.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.979 7ffb9a59c700 1 -- 172.21.15.79:0/2291495255 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9c0e5700 con 0x7ffb9c0e9b10 2021-04-09T18:35:11.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.979 7ffb9a59c700 1 --2- 172.21.15.79:0/2291495255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c0e9b10 0x7ffb9c09f110 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7ffb900032b0 tx=0x7ffb9000b3c0).ready entity=mon.0 client_cookie=5138ca2409dc3451 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:11.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.979 7ffb99d9b700 1 -- 172.21.15.79:0/2291495255 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffb9c0e5700 con 0x7ffb9c0e9b10 2021-04-09T18:35:11.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.979 7ffb99d9b700 1 -- 172.21.15.79:0/2291495255 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9000bc20 con 0x7ffb9c0e9b10 2021-04-09T18:35:11.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.979 7ffb99d9b700 1 -- 172.21.15.79:0/2291495255 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffb90002020 con 0x7ffb9c0e9b10 2021-04-09T18:35:11.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.979 7ffba109b700 1 -- 172.21.15.79:0/2291495255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c0e9b10 msgr2=0x7ffb9c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:11.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.979 7ffba109b700 1 --2- 172.21.15.79:0/2291495255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c0e9b10 0x7ffb9c09f110 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7ffb900032b0 tx=0x7ffb9000b3c0).stop 2021-04-09T18:35:11.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.979 7ffba109b700 1 -- 172.21.15.79:0/2291495255 shutdown_connections 2021-04-09T18:35:11.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.979 7ffba109b700 1 --2- 172.21.15.79:0/2291495255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0f5550 0x7ffb9c0f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:11.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.979 7ffba109b700 1 --2- 172.21.15.79:0/2291495255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c0e9b10 0x7ffb9c09f110 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:11.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.979 7ffba109b700 1 -- 172.21.15.79:0/2291495255 >> 172.21.15.79:0/2291495255 conn(0x7ffb9c0e6010 msgr2=0x7ffb9c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:11.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.979 7ffba109b700 1 -- 172.21.15.79:0/2291495255 shutdown_connections 2021-04-09T18:35:11.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.979 7ffba109b700 1 -- 172.21.15.79:0/2291495255 wait complete. 2021-04-09T18:35:11.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffba109b700 1 Processor -- start 2021-04-09T18:35:11.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffba109b700 1 -- start start 2021-04-09T18:35:11.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffba109b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb9c1aa120 0x7ffb9c1aa570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:11.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffba109b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0cecb0 0x7ffb9c0cf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:11.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffba109b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c094270 0x7ffb9c0946c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:11.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffba109b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c0e1ac0 con 0x7ffb9c094270 2021-04-09T18:35:11.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffba109b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c0d5ac0 con 0x7ffb9c1aa120 2021-04-09T18:35:11.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffba109b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c0d5dc0 con 0x7ffb9c0cecb0 2021-04-09T18:35:11.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffb9b59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c094270 0x7ffb9c0946c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:11.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffb9ad9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb9c1aa120 0x7ffb9c1aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:11.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffb9ad9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb9c1aa120 0x7ffb9c1aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:51372/0 (socket says 172.21.15.79:51372) 2021-04-09T18:35:11.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffb9b59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c094270 0x7ffb9c0946c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34802/0 (socket says 172.21.15.79:34802) 2021-04-09T18:35:11.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffb9ad9d700 1 -- 172.21.15.79:0/2043232308 learned_addr learned my addr 172.21.15.79:0/2043232308 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:11.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffb9a59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0cecb0 0x7ffb9c0cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:11.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffb9a59c700 1 -- 172.21.15.79:0/2043232308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb9c1aa120 msgr2=0x7ffb9c1aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:11.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffb9a59c700 1 --2- 172.21.15.79:0/2043232308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb9c1aa120 0x7ffb9c1aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:11.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffb9a59c700 1 -- 172.21.15.79:0/2043232308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c094270 msgr2=0x7ffb9c0946c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:11.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffb9a59c700 1 --2- 172.21.15.79:0/2043232308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c094270 0x7ffb9c0946c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:11.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffb9a59c700 1 -- 172.21.15.79:0/2043232308 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9c08f2f0 con 0x7ffb9c0cecb0 2021-04-09T18:35:12.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffb9b59e700 1 --2- 172.21.15.79:0/2043232308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c094270 0x7ffb9c0946c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:12.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffb9ad9d700 1 --2- 172.21.15.79:0/2043232308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb9c1aa120 0x7ffb9c1aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:12.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffb9a59c700 1 --2- 172.21.15.79:0/2043232308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0cecb0 0x7ffb9c0cf100 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7ffb9c0874d0 tx=0x7ffb90006c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:12.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffb8b7fe700 1 -- 172.21.15.79:0/2043232308 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffb9c08f2f0 con 0x7ffb9c0cecb0 2021-04-09T18:35:12.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffb8b7fe700 1 -- 172.21.15.79:0/2043232308 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb90019040 con 0x7ffb9c0cecb0 2021-04-09T18:35:12.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffba109b700 1 -- 172.21.15.79:0/2043232308 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb9c0d5350 con 0x7ffb9c0cecb0 2021-04-09T18:35:12.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffb8b7fe700 1 -- 172.21.15.79:0/2043232308 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffb90010990 con 0x7ffb9c0cecb0 2021-04-09T18:35:12.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.983 7ffba109b700 1 -- 172.21.15.79:0/2043232308 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb9c094cf0 con 0x7ffb9c0cecb0 2021-04-09T18:35:12.001 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.987 7ffb8b7fe700 1 -- 172.21.15.79:0/2043232308 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ffb90010b90 con 0x7ffb9c0cecb0 2021-04-09T18:35:12.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.987 7ffb8b7fe700 1 --2- 172.21.15.79:0/2043232308 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffb80029100 0x7ffb8002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:12.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.987 7ffb8b7fe700 1 -- 172.21.15.79:0/2043232308 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5458+0+0 (secure 0 0 0) 0x7ffb90003020 con 0x7ffb9c0cecb0 2021-04-09T18:35:12.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.987 7ffb9ad9d700 1 --2- 172.21.15.79:0/2043232308 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffb80029100 0x7ffb8002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:12.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.987 7ffb9ad9d700 1 --2- 172.21.15.79:0/2043232308 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffb80029100 0x7ffb8002b650 crc :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:12.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.991 7ffba109b700 1 -- 172.21.15.79:0/2043232308 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb9c0e39f0 con 0x7ffb9c0cecb0 2021-04-09T18:35:12.004 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:11.999 7ffb8b7fe700 1 -- 172.21.15.79:0/2043232308 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ffb900103a0 con 0x7ffb9c0cecb0 2021-04-09T18:35:12.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.163 7ffba109b700 1 -- 172.21.15.79:0/2043232308 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7ffb9c0f5b50 con 0x7ffb9c0cecb0 2021-04-09T18:35:12.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.843 7ffb8b7fe700 1 -- 172.21.15.79:0/2043232308 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v124) v1 ==== 125+0+0 (secure 0 0 0) 0x7ffb9000ba10 con 0x7ffb9c0cecb0 2021-04-09T18:35:12.885 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2021-04-09T18:35:12.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.883 7ffba109b700 1 -- 172.21.15.79:0/2043232308 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffb80029100 msgr2=0x7ffb8002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:12.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.883 7ffba109b700 1 --2- 172.21.15.79:0/2043232308 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffb80029100 0x7ffb8002b650 crc :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:12.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.883 7ffba109b700 1 -- 172.21.15.79:0/2043232308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0cecb0 msgr2=0x7ffb9c0cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:12.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.883 7ffba109b700 1 --2- 172.21.15.79:0/2043232308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0cecb0 0x7ffb9c0cf100 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7ffb9c0874d0 tx=0x7ffb90006c10).stop 2021-04-09T18:35:12.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.883 7ffba109b700 1 -- 172.21.15.79:0/2043232308 shutdown_connections 2021-04-09T18:35:12.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.883 7ffba109b700 1 --2- 172.21.15.79:0/2043232308 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ffb80029100 0x7ffb8002b650 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:12.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.883 7ffba109b700 1 --2- 172.21.15.79:0/2043232308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb9c1aa120 0x7ffb9c1aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:12.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.883 7ffba109b700 1 --2- 172.21.15.79:0/2043232308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c094270 0x7ffb9c0946c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:12.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.883 7ffba109b700 1 --2- 172.21.15.79:0/2043232308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0cecb0 0x7ffb9c0cf100 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:12.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.883 7ffba109b700 1 -- 172.21.15.79:0/2043232308 >> 172.21.15.79:0/2043232308 conn(0x7ffb9c093b10 msgr2=0x7ffb9c0d8880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:12.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.883 7ffba109b700 1 -- 172.21.15.79:0/2043232308 shutdown_connections 2021-04-09T18:35:12.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.883 7ffba109b700 1 -- 172.21.15.79:0/2043232308 wait complete. 2021-04-09T18:35:12.903 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-04-09T18:35:13.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.995 7f07907ee700 1 Processor -- start 2021-04-09T18:35:13.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.995 7f07907ee700 1 -- start start 2021-04-09T18:35:13.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.995 7f07907ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07880f5550 0x7f07880f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.995 7f07907ee700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f07880e9b10 0x7f078809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.995 7f07907ee700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f07881c2de0 0x7f07881c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.995 7f07907ee700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07880e9f60 con 0x7f07881c2de0 2021-04-09T18:35:13.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.995 7f07907ee700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07880e5a00 con 0x7f07880e9b10 2021-04-09T18:35:13.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.995 7f07907ee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07880fbb50 con 0x7f07880f5550 2021-04-09T18:35:13.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.995 7f078ed93700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f07881c2de0 0x7f07881c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.995 7f078ed93700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f07881c2de0 0x7f07881c3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34810/0 (socket says 172.21.15.79:34810) 2021-04-09T18:35:13.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.995 7f078ed93700 1 -- 172.21.15.79:0/1222667831 learned_addr learned my addr 172.21.15.79:0/1222667831 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:13.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.995 7f078e592700 1 --2- 172.21.15.79:0/1222667831 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07880f5550 0x7f07880f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.995 7f078dd91700 1 --2- 172.21.15.79:0/1222667831 >> v2:172.21.15.89:3300/0 conn(0x7f07880e9b10 0x7f078809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.999 7f078ed93700 1 -- 172.21.15.79:0/1222667831 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07880f5550 msgr2=0x7f07880f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:13.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.999 7f078ed93700 1 --2- 172.21.15.79:0/1222667831 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07880f5550 0x7f07880f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.999 7f078ed93700 1 -- 172.21.15.79:0/1222667831 >> v2:172.21.15.89:3300/0 conn(0x7f07880e9b10 msgr2=0x7f078809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:13.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.999 7f078ed93700 1 --2- 172.21.15.79:0/1222667831 >> v2:172.21.15.89:3300/0 conn(0x7f07880e9b10 0x7f078809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.999 7f078ed93700 1 -- 172.21.15.79:0/1222667831 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07880e5700 con 0x7f07881c2de0 2021-04-09T18:35:13.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.999 7f078ed93700 1 --2- 172.21.15.79:0/1222667831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07881c2de0 0x7f07881c3230 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f07800032b0 tx=0x7f078000b3c0).ready entity=mon.0 client_cookie=45cc1ec920c30f4b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:13.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.999 7f078d590700 1 -- 172.21.15.79:0/1222667831 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f07880e5700 con 0x7f07881c2de0 2021-04-09T18:35:13.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.999 7f078d590700 1 -- 172.21.15.79:0/1222667831 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078000bc20 con 0x7f07881c2de0 2021-04-09T18:35:13.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.999 7f078d590700 1 -- 172.21.15.79:0/1222667831 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0780002020 con 0x7f07881c2de0 2021-04-09T18:35:13.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.999 7f07907ee700 1 -- 172.21.15.79:0/1222667831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07881c2de0 msgr2=0x7f07881c3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.999 7f07907ee700 1 --2- 172.21.15.79:0/1222667831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07881c2de0 0x7f07881c3230 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f07800032b0 tx=0x7f078000b3c0).stop 2021-04-09T18:35:13.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.999 7f07907ee700 1 -- 172.21.15.79:0/1222667831 shutdown_connections 2021-04-09T18:35:13.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.999 7f07907ee700 1 --2- 172.21.15.79:0/1222667831 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07880f5550 0x7f07880f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.999 7f07907ee700 1 --2- 172.21.15.79:0/1222667831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07881c2de0 0x7f07881c3230 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.999 7f07907ee700 1 --2- 172.21.15.79:0/1222667831 >> v2:172.21.15.89:3300/0 conn(0x7f07880e9b10 0x7f078809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.999 7f07907ee700 1 -- 172.21.15.79:0/1222667831 >> 172.21.15.79:0/1222667831 conn(0x7f07880e6010 msgr2=0x7f07880e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:13.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.999 7f07907ee700 1 -- 172.21.15.79:0/1222667831 shutdown_connections 2021-04-09T18:35:13.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:12.999 7f07907ee700 1 -- 172.21.15.79:0/1222667831 wait complete. 2021-04-09T18:35:13.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.003 7f07907ee700 1 Processor -- start 2021-04-09T18:35:13.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.003 7f07907ee700 1 -- start start 2021-04-09T18:35:13.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.003 7f07907ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07880d62e0 0x7f07880ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.003 7f07907ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07880ac540 0x7f07880bad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.003 7f07907ee700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07880d4af0 0x7f07880d4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.003 7f07907ee700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07880acc90 con 0x7f07880d62e0 2021-04-09T18:35:13.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.003 7f07907ee700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07880ac990 con 0x7f07880d4af0 2021-04-09T18:35:13.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.003 7f07907ee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07880acf90 con 0x7f07880ac540 2021-04-09T18:35:13.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.003 7f078e592700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07880d62e0 0x7f07880ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.003 7f078e592700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07880d62e0 0x7f07880ae530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34814/0 (socket says 172.21.15.79:34814) 2021-04-09T18:35:13.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.003 7f078e592700 1 -- 172.21.15.79:0/2342948001 learned_addr learned my addr 172.21.15.79:0/2342948001 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:13.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.003 7f078ed93700 1 --2- 172.21.15.79:0/2342948001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07880d4af0 0x7f07880d4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.003 7f078dd91700 1 --2- 172.21.15.79:0/2342948001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07880ac540 0x7f07880bad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.003 7f078e592700 1 -- 172.21.15.79:0/2342948001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07880ac540 msgr2=0x7f07880bad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.003 7f078e592700 1 --2- 172.21.15.79:0/2342948001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07880ac540 0x7f07880bad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.003 7f078e592700 1 -- 172.21.15.79:0/2342948001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07880d4af0 msgr2=0x7f07880d4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.003 7f078e592700 1 --2- 172.21.15.79:0/2342948001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07880d4af0 0x7f07880d4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.003 7f078e592700 1 -- 172.21.15.79:0/2342948001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07880aeb60 con 0x7f07880d62e0 2021-04-09T18:35:13.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.003 7f078e592700 1 --2- 172.21.15.79:0/2342948001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07880d62e0 0x7f07880ae530 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f078809a300 tx=0x7f078400c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:13.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.007 7f077effd700 1 -- 172.21.15.79:0/2342948001 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f07880aeb60 con 0x7f07880d62e0 2021-04-09T18:35:13.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.007 7f077effd700 1 -- 172.21.15.79:0/2342948001 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078400cb90 con 0x7f07880d62e0 2021-04-09T18:35:13.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.007 7f07907ee700 1 -- 172.21.15.79:0/2342948001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07880abf30 con 0x7f07880d62e0 2021-04-09T18:35:13.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.007 7f077effd700 1 -- 172.21.15.79:0/2342948001 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f078400f040 con 0x7f07880d62e0 2021-04-09T18:35:13.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.007 7f07907ee700 1 -- 172.21.15.79:0/2342948001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07880bb330 con 0x7f07880d62e0 2021-04-09T18:35:13.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.007 7f077effd700 1 -- 172.21.15.79:0/2342948001 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0784011070 con 0x7f07880d62e0 2021-04-09T18:35:13.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.007 7f077effd700 1 --2- 172.21.15.79:0/2342948001 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0770029100 0x7f077002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.007 7f077effd700 1 -- 172.21.15.79:0/2342948001 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f0784010040 con 0x7f07880d62e0 2021-04-09T18:35:13.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.007 7f078dd91700 1 --2- 172.21.15.79:0/2342948001 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0770029100 0x7f077002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.007 7f07907ee700 1 -- 172.21.15.79:0/2342948001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07880e39f0 con 0x7f07880d62e0 2021-04-09T18:35:13.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.007 7f078dd91700 1 --2- 172.21.15.79:0/2342948001 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0770029100 0x7f077002b650 crc :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:13.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.011 7f077effd700 1 -- 172.21.15.79:0/2342948001 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0784000bf0 con 0x7f07880d62e0 2021-04-09T18:35:13.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.175 7f07907ee700 1 -- 172.21.15.79:0/2342948001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f07880f5b50 con 0x7f07880d62e0 2021-04-09T18:35:13.181 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:35:13.175 7fbccdd11700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:35:13.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.183 7f077effd700 1 -- 172.21.15.79:0/2342948001 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 24 and data pool 25 v76) v1 ==== 189+0+0 (secure 0 0 0) 0x7f078400c790 con 0x7f07880d62e0 2021-04-09T18:35:13.196 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 24 and data pool 25 2021-04-09T18:35:13.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.195 7f07907ee700 1 -- 172.21.15.79:0/2342948001 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0770029100 msgr2=0x7f077002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.195 7f07907ee700 1 --2- 172.21.15.79:0/2342948001 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0770029100 0x7f077002b650 crc :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.195 7f07907ee700 1 -- 172.21.15.79:0/2342948001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07880d62e0 msgr2=0x7f07880ae530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.195 7f07907ee700 1 --2- 172.21.15.79:0/2342948001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07880d62e0 0x7f07880ae530 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f078809a300 tx=0x7f078400c150).stop 2021-04-09T18:35:13.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.195 7f07907ee700 1 -- 172.21.15.79:0/2342948001 shutdown_connections 2021-04-09T18:35:13.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.195 7f07907ee700 1 --2- 172.21.15.79:0/2342948001 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0770029100 0x7f077002b650 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.195 7f07907ee700 1 --2- 172.21.15.79:0/2342948001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07880d4af0 0x7f07880d4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.195 7f07907ee700 1 --2- 172.21.15.79:0/2342948001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07880d62e0 0x7f07880ae530 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.195 7f07907ee700 1 --2- 172.21.15.79:0/2342948001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07880ac540 0x7f07880bad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.195 7f07907ee700 1 -- 172.21.15.79:0/2342948001 >> 172.21.15.79:0/2342948001 conn(0x7f07880a6e50 msgr2=0x7f078809a340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:13.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.195 7f07907ee700 1 -- 172.21.15.79:0/2342948001 shutdown_connections 2021-04-09T18:35:13.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.195 7f07907ee700 1 -- 172.21.15.79:0/2342948001 wait complete. 2021-04-09T18:35:13.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:35:13.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.295 7f8722202700 1 Processor -- start 2021-04-09T18:35:13.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.295 7f8722202700 1 -- start start 2021-04-09T18:35:13.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.295 7f8722202700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f871c0f5510 0x7f871c0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.295 7f8722202700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f871c0fbb10 con 0x7f871c0e9ad0 2021-04-09T18:35:13.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.295 7f8722202700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f871c09f900 con 0x7f871c1c8000 2021-04-09T18:35:13.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.295 7f8722202700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871c0e9f20 con 0x7f871c0f5510 2021-04-09T18:35:13.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.295 7f871affd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f871c0e9ad0 0x7f871c09f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57762/0 (socket says 172.21.15.79:57762) 2021-04-09T18:35:13.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.295 7f871affd700 1 -- 172.21.15.79:0/1984406511 learned_addr learned my addr 172.21.15.79:0/1984406511 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:13.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.295 7f871b7fe700 1 --2- 172.21.15.79:0/1984406511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f871c0f5510 0x7f871c0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.295 7f871a7fc700 1 -- 172.21.15.79:0/1984406511 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415246267 0 0) 0x7f87100010d0 con 0x7f871c0e9ad0 2021-04-09T18:35:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.295 7f871a7fc700 1 -- 172.21.15.79:0/1984406511 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8704003240 con 0x7f871c0e9ad0 2021-04-09T18:35:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.295 7f871a7fc700 1 -- 172.21.15.79:0/1984406511 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558299815 0 0) 0x7f8714001450 con 0x7f871c1c8000 2021-04-09T18:35:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.295 7f871a7fc700 1 -- 172.21.15.79:0/1984406511 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8704003620 con 0x7f871c1c8000 2021-04-09T18:35:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.295 7f871a7fc700 1 -- 172.21.15.79:0/1984406511 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1478168088 0 0) 0x7f8710001650 con 0x7f871c0e9ad0 2021-04-09T18:35:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.295 7f871a7fc700 1 -- 172.21.15.79:0/1984406511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f871c0f5510 msgr2=0x7f871c0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.295 7f871a7fc700 1 --2- 172.21.15.79:0/1984406511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f871c0f5510 0x7f871c0f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.295 7f871a7fc700 1 -- 172.21.15.79:0/1984406511 >> v1:172.21.15.89:6789/0 conn(0x7f871c1c8000 legacy=0x7f871c1ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871a7fc700 1 -- 172.21.15.79:0/1984406511 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871c0e56c0 con 0x7f871c0e9ad0 2021-04-09T18:35:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871a7fc700 1 -- 172.21.15.79:0/1984406511 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f8710001bb0 con 0x7f871c0e9ad0 2021-04-09T18:35:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871a7fc700 1 -- 172.21.15.79:0/1984406511 >> v1:172.21.15.79:6789/0 conn(0x7f871c0e9ad0 legacy=0x7f871c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871a7fc700 1 --2- 172.21.15.79:0/1984406511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8704003d40 0x7f87040045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871a7fc700 1 --2- 172.21.15.79:0/1984406511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8704004bd0 0x7f87040097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871a7fc700 1 --2- 172.21.15.79:0/1984406511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8704005020 0x7f870400be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871a7fc700 1 -- 172.21.15.79:0/1984406511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c0e9f20 con 0x7f8704003d40 2021-04-09T18:35:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871a7fc700 1 -- 172.21.15.79:0/1984406511 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8704050460 con 0x7f8704004bd0 2021-04-09T18:35:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871a7fc700 1 -- 172.21.15.79:0/1984406511 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8704050610 con 0x7f8704005020 2021-04-09T18:35:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871b7fe700 1 --2- 172.21.15.79:0/1984406511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8704003d40 0x7f87040045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871affd700 1 --2- 172.21.15.79:0/1984406511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8704004bd0 0x7f87040097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871bfff700 1 --2- 172.21.15.79:0/1984406511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8704005020 0x7f870400be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871b7fe700 1 -- 172.21.15.79:0/1984406511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8704005020 msgr2=0x7f870400be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871b7fe700 1 --2- 172.21.15.79:0/1984406511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8704005020 0x7f870400be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871b7fe700 1 -- 172.21.15.79:0/1984406511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8704004bd0 msgr2=0x7f87040097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:13.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871b7fe700 1 --2- 172.21.15.79:0/1984406511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8704004bd0 0x7f87040097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871b7fe700 1 -- 172.21.15.79:0/1984406511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8704050820 con 0x7f8704003d40 2021-04-09T18:35:13.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871affd700 1 --2- 172.21.15.79:0/1984406511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8704004bd0 0x7f87040097e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:13.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871bfff700 1 --2- 172.21.15.79:0/1984406511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8704005020 0x7f870400be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871b7fe700 1 --2- 172.21.15.79:0/1984406511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8704003d40 0x7f87040045a0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f870c00c000 tx=0x7f870c00e1d0).ready entity=mon.0 client_cookie=9ced5c22d2c4f7a1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871a7fc700 1 -- 172.21.15.79:0/1984406511 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8704050820 con 0x7f8704003d40 2021-04-09T18:35:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871a7fc700 1 -- 172.21.15.79:0/1984406511 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c00ec90 con 0x7f8704003d40 2021-04-09T18:35:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871a7fc700 1 -- 172.21.15.79:0/1984406511 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f870c00f040 con 0x7f8704003d40 2021-04-09T18:35:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f8722202700 1 -- 172.21.15.79:0/1984406511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8704003d40 msgr2=0x7f87040045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f8722202700 1 --2- 172.21.15.79:0/1984406511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8704003d40 0x7f87040045a0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f870c00c000 tx=0x7f870c00e1d0).stop 2021-04-09T18:35:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f871bfff700 1 -- 172.21.15.79:0/1984406511 reap_dead start 2021-04-09T18:35:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f8722202700 1 -- 172.21.15.79:0/1984406511 shutdown_connections 2021-04-09T18:35:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f8722202700 1 -- 172.21.15.79:0/1984406511 >> 172.21.15.79:0/1984406511 conn(0x7f871c0e5fd0 msgr2=0x7f871c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f8722202700 1 -- 172.21.15.79:0/1984406511 shutdown_connections 2021-04-09T18:35:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.299 7f8722202700 1 -- 172.21.15.79:0/1984406511 wait complete. 2021-04-09T18:35:13.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.303 7f8722202700 1 Processor -- start 2021-04-09T18:35:13.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.303 7f8722202700 1 -- start start 2021-04-09T18:35:13.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.303 7f8722202700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f871c19d7b0 0x7f871c1ab070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.303 7f8722202700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f871c0d5440 0x7f871c0980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f8722202700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f871c0d5890 0x7f871c0986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f8722202700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c1c3db0 con 0x7f871c19d7b0 2021-04-09T18:35:13.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f8722202700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c19d4e0 con 0x7f871c0d5440 2021-04-09T18:35:13.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f8722202700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871c19bf40 con 0x7f871c0d5890 2021-04-09T18:35:13.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f871b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f871c19d7b0 0x7f871c1ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f871b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f871c19d7b0 0x7f871c1ab070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34832/0 (socket says 172.21.15.79:34832) 2021-04-09T18:35:13.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f871b7fe700 1 -- 172.21.15.79:0/1810888749 learned_addr learned my addr 172.21.15.79:0/1810888749 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:13.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f871affd700 1 --2- 172.21.15.79:0/1810888749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f871c0d5440 0x7f871c0980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f871bfff700 1 --2- 172.21.15.79:0/1810888749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f871c0d5890 0x7f871c0986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f871b7fe700 1 -- 172.21.15.79:0/1810888749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f871c0d5890 msgr2=0x7f871c0986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f871b7fe700 1 --2- 172.21.15.79:0/1810888749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f871c0d5890 0x7f871c0986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f871b7fe700 1 -- 172.21.15.79:0/1810888749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f871c0d5440 msgr2=0x7f871c0980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f871b7fe700 1 --2- 172.21.15.79:0/1810888749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f871c0d5440 0x7f871c0980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f871b7fe700 1 -- 172.21.15.79:0/1810888749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871c099540 con 0x7f871c19d7b0 2021-04-09T18:35:13.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f871b7fe700 1 --2- 172.21.15.79:0/1810888749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f871c19d7b0 0x7f871c1ab070 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f871c19bbc0 tx=0x7f870c00a040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:13.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f8703fff700 1 -- 172.21.15.79:0/1810888749 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f871c099540 con 0x7f871c19d7b0 2021-04-09T18:35:13.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f8703fff700 1 -- 172.21.15.79:0/1810888749 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c021030 con 0x7f871c19d7b0 2021-04-09T18:35:13.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f8703fff700 1 -- 172.21.15.79:0/1810888749 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f870c01c7e0 con 0x7f871c19d7b0 2021-04-09T18:35:13.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f8722202700 1 -- 172.21.15.79:0/1810888749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871c099810 con 0x7f871c19d7b0 2021-04-09T18:35:13.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f8722202700 1 -- 172.21.15.79:0/1810888749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871c098d00 con 0x7f871c19d7b0 2021-04-09T18:35:13.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f8703fff700 1 -- 172.21.15.79:0/1810888749 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f870c023020 con 0x7f871c19d7b0 2021-04-09T18:35:13.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f8703fff700 1 --2- 172.21.15.79:0/1810888749 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f86fc029100 0x7f86fc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f8703fff700 1 -- 172.21.15.79:0/1810888749 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f870c010040 con 0x7f871c19d7b0 2021-04-09T18:35:13.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f871affd700 1 --2- 172.21.15.79:0/1810888749 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f86fc029100 0x7f86fc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.307 7f871affd700 1 --2- 172.21.15.79:0/1810888749 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f86fc029100 0x7f86fc02b650 crc :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:13.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.311 7f8722202700 1 -- 172.21.15.79:0/1810888749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871c1ac310 con 0x7f871c19d7b0 2021-04-09T18:35:13.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.315 7f8703fff700 1 -- 172.21.15.79:0/1810888749 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f870c012d20 con 0x7f871c19d7b0 2021-04-09T18:35:13.484 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.479 7f8722202700 1 -- 172.21.15.79:0/1810888749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f871c0e39d0 con 0x7f871c19d7b0 2021-04-09T18:35:13.486 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.479 7f8703fff700 1 -- 172.21.15.79:0/1810888749 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+14253 (secure 0 0 0) 0x7f870c000bf0 con 0x7f871c19d7b0 2021-04-09T18:35:13.487 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:13.487 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":125,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:35:13.180103","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:35:11.346312","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2021-04-09 18:35:12.219337","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:35:13.491 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.483 7f8722202700 1 -- 172.21.15.79:0/1810888749 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f86fc029100 msgr2=0x7f86fc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.492 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.483 7f8722202700 1 --2- 172.21.15.79:0/1810888749 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f86fc029100 0x7f86fc02b650 crc :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.483 7f8722202700 1 -- 172.21.15.79:0/1810888749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f871c19d7b0 msgr2=0x7f871c1ab070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.493 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.483 7f8722202700 1 --2- 172.21.15.79:0/1810888749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f871c19d7b0 0x7f871c1ab070 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f871c19bbc0 tx=0x7f870c00a040).stop 2021-04-09T18:35:13.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.483 7f8722202700 1 -- 172.21.15.79:0/1810888749 shutdown_connections 2021-04-09T18:35:13.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.483 7f8722202700 1 --2- 172.21.15.79:0/1810888749 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f86fc029100 0x7f86fc02b650 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.483 7f8722202700 1 --2- 172.21.15.79:0/1810888749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f871c0d5890 0x7f871c0986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.483 7f8722202700 1 --2- 172.21.15.79:0/1810888749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f871c19d7b0 0x7f871c1ab070 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.483 7f8722202700 1 --2- 172.21.15.79:0/1810888749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f871c0d5440 0x7f871c0980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.483 7f8722202700 1 -- 172.21.15.79:0/1810888749 >> 172.21.15.79:0/1810888749 conn(0x7f871c0baba0 msgr2=0x7f871c0963a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:13.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.483 7f8722202700 1 -- 172.21.15.79:0/1810888749 shutdown_connections 2021-04-09T18:35:13.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.483 7f8722202700 1 -- 172.21.15.79:0/1810888749 wait complete. 2021-04-09T18:35:13.500 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:35:13.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.607 7f4bd5e10700 1 Processor -- start 2021-04-09T18:35:13.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.607 7f4bd5e10700 1 -- start start 2021-04-09T18:35:13.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bd5e10700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4bd00e9ae0 0x7f4bd009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bd5e10700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4bd01c8010 0x7f4bd01ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bd5e10700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd00fbb20 con 0x7f4bd00f5520 2021-04-09T18:35:13.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bd5e10700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd01c3dc0 con 0x7f4bd00e9ae0 2021-04-09T18:35:13.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bd5e10700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd00e9f30 con 0x7f4bd01c8010 2021-04-09T18:35:13.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bceffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4bd00e9ae0 0x7f4bd009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bceffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4bd00e9ae0 0x7f4bd009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34842/0 (socket says 172.21.15.79:34842) 2021-04-09T18:35:13.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bceffd700 1 -- 172.21.15.79:0/234167570 learned_addr learned my addr 172.21.15.79:0/234167570 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:13.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bcffff700 1 --2- 172.21.15.79:0/234167570 >> v2:172.21.15.89:3300/0 conn(0x7f4bd01c8010 0x7f4bd01ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bceffd700 1 -- 172.21.15.79:0/234167570 >> v2:172.21.15.89:3300/0 conn(0x7f4bd01c8010 msgr2=0x7f4bd01ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:13.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bceffd700 1 --2- 172.21.15.79:0/234167570 >> v2:172.21.15.89:3300/0 conn(0x7f4bd01c8010 0x7f4bd01ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.629 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bceffd700 1 -- 172.21.15.79:0/234167570 >> v1:172.21.15.89:6789/0 conn(0x7f4bd00f5520 legacy=0x7f4bd00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.630 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bceffd700 1 -- 172.21.15.79:0/234167570 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd00e56d0 con 0x7f4bd00e9ae0 2021-04-09T18:35:13.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bcffff700 1 --2- 172.21.15.79:0/234167570 >> v2:172.21.15.89:3300/0 conn(0x7f4bd01c8010 0x7f4bd01ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:13.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bceffd700 1 --2- 172.21.15.79:0/234167570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bd00e9ae0 0x7f4bd009f110 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f4bb8002f30 tx=0x7f4bb800bd70).ready entity=mon.0 client_cookie=4c15a98e94084355 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:13.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bce7fc700 1 -- 172.21.15.79:0/234167570 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4bd00e56d0 con 0x7f4bd00e9ae0 2021-04-09T18:35:13.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bce7fc700 1 -- 172.21.15.79:0/234167570 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb8009950 con 0x7f4bd00e9ae0 2021-04-09T18:35:13.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bce7fc700 1 -- 172.21.15.79:0/234167570 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4bb8009d20 con 0x7f4bd00e9ae0 2021-04-09T18:35:13.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bd5e10700 1 -- 172.21.15.79:0/234167570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bd00e9ae0 msgr2=0x7f4bd009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bd5e10700 1 --2- 172.21.15.79:0/234167570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bd00e9ae0 0x7f4bd009f110 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f4bb8002f30 tx=0x7f4bb800bd70).stop 2021-04-09T18:35:13.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bd5e10700 1 -- 172.21.15.79:0/234167570 shutdown_connections 2021-04-09T18:35:13.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bd5e10700 1 --2- 172.21.15.79:0/234167570 >> v2:172.21.15.89:3300/0 conn(0x7f4bd01c8010 0x7f4bd01ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bd5e10700 1 --2- 172.21.15.79:0/234167570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bd00e9ae0 0x7f4bd009f110 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bd5e10700 1 -- 172.21.15.79:0/234167570 >> 172.21.15.79:0/234167570 conn(0x7f4bd00e5fe0 msgr2=0x7f4bd00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:13.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bd5e10700 1 -- 172.21.15.79:0/234167570 shutdown_connections 2021-04-09T18:35:13.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.611 7f4bd5e10700 1 -- 172.21.15.79:0/234167570 wait complete. 2021-04-09T18:35:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bd5e10700 1 Processor -- start 2021-04-09T18:35:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bd5e10700 1 -- start start 2021-04-09T18:35:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bd5e10700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bd00c1290 0x7f4bd00d4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bd5e10700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bd00c1e80 0x7f4bd01ab750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bd5e10700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bd01abd80 0x7f4bd01aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bd5e10700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd00e8af0 con 0x7f4bd00c1290 2021-04-09T18:35:13.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bd5e10700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd00c36a0 con 0x7f4bd00c1e80 2021-04-09T18:35:13.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bd5e10700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd01aca10 con 0x7f4bd01abd80 2021-04-09T18:35:13.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bcf7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bd00c1290 0x7f4bd00d4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bcf7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bd00c1290 0x7f4bd00d4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34848/0 (socket says 172.21.15.79:34848) 2021-04-09T18:35:13.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bcf7fe700 1 -- 172.21.15.79:0/761516627 learned_addr learned my addr 172.21.15.79:0/761516627 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:13.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bceffd700 1 --2- 172.21.15.79:0/761516627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bd00c1e80 0x7f4bd01ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bcffff700 1 --2- 172.21.15.79:0/761516627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bd01abd80 0x7f4bd01aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bcf7fe700 1 -- 172.21.15.79:0/761516627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bd01abd80 msgr2=0x7f4bd01aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bcf7fe700 1 --2- 172.21.15.79:0/761516627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bd01abd80 0x7f4bd01aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bcf7fe700 1 -- 172.21.15.79:0/761516627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bd00c1e80 msgr2=0x7f4bd01ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bcf7fe700 1 --2- 172.21.15.79:0/761516627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bd00c1e80 0x7f4bd01ab750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bcf7fe700 1 -- 172.21.15.79:0/761516627 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd00d5590 con 0x7f4bd00c1290 2021-04-09T18:35:13.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bceffd700 1 --2- 172.21.15.79:0/761516627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bd00c1e80 0x7f4bd01ab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:13.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bcf7fe700 1 --2- 172.21.15.79:0/761516627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bd00c1290 0x7f4bd00d4f60 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f4bd00b10a0 tx=0x7f4bc000cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:13.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bc7fff700 1 -- 172.21.15.79:0/761516627 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4bd00d5590 con 0x7f4bd00c1290 2021-04-09T18:35:13.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bc7fff700 1 -- 172.21.15.79:0/761516627 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc0010510 con 0x7f4bd00c1290 2021-04-09T18:35:13.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bc7fff700 1 -- 172.21.15.79:0/761516627 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4bc00106f0 con 0x7f4bd00c1290 2021-04-09T18:35:13.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bd5e10700 1 -- 172.21.15.79:0/761516627 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd00c4c40 con 0x7f4bd00c1290 2021-04-09T18:35:13.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.615 7f4bd5e10700 1 -- 172.21.15.79:0/761516627 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd00c1870 con 0x7f4bd00c1290 2021-04-09T18:35:13.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.619 7f4bc7fff700 1 -- 172.21.15.79:0/761516627 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4bc0019020 con 0x7f4bd00c1290 2021-04-09T18:35:13.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.619 7f4bc7fff700 1 --2- 172.21.15.79:0/761516627 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4bb4029100 0x7f4bb402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.619 7f4bc7fff700 1 -- 172.21.15.79:0/761516627 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f4bc0038e10 con 0x7f4bd00c1290 2021-04-09T18:35:13.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.619 7f4bceffd700 1 --2- 172.21.15.79:0/761516627 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4bb4029100 0x7f4bb402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.619 7f4bceffd700 1 --2- 172.21.15.79:0/761516627 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4bb4029100 0x7f4bb402b650 crc :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:13.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.623 7f4bd5e10700 1 -- 172.21.15.79:0/761516627 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd00c25f0 con 0x7f4bd00c1290 2021-04-09T18:35:13.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.627 7f4bc7fff700 1 -- 172.21.15.79:0/761516627 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4bc0010300 con 0x7f4bd00c1290 2021-04-09T18:35:13.796 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.791 7f4bd5e10700 1 -- 172.21.15.79:0/761516627 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bd00e39e0 con 0x7f4bd00c1290 2021-04-09T18:35:13.797 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.791 7f4bc7fff700 1 -- 172.21.15.79:0/761516627 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+14253 (secure 0 0 0) 0x7f4bc0000bf0 con 0x7f4bd00c1290 2021-04-09T18:35:13.799 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:13.799 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":125,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:35:13.180103","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:35:11.346312","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2021-04-09 18:35:12.219337","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:35:13.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.795 7f4bd5e10700 1 -- 172.21.15.79:0/761516627 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4bb4029100 msgr2=0x7f4bb402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.795 7f4bd5e10700 1 --2- 172.21.15.79:0/761516627 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4bb4029100 0x7f4bb402b650 crc :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.795 7f4bd5e10700 1 -- 172.21.15.79:0/761516627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bd00c1290 msgr2=0x7f4bd00d4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.802 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.795 7f4bd5e10700 1 --2- 172.21.15.79:0/761516627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bd00c1290 0x7f4bd00d4f60 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f4bd00b10a0 tx=0x7f4bc000cab0).stop 2021-04-09T18:35:13.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.795 7f4bd5e10700 1 -- 172.21.15.79:0/761516627 shutdown_connections 2021-04-09T18:35:13.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.795 7f4bd5e10700 1 --2- 172.21.15.79:0/761516627 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4bb4029100 0x7f4bb402b650 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.803 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.795 7f4bd5e10700 1 --2- 172.21.15.79:0/761516627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bd01abd80 0x7f4bd01aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.795 7f4bd5e10700 1 --2- 172.21.15.79:0/761516627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bd00c1290 0x7f4bd00d4f60 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.795 7f4bd5e10700 1 --2- 172.21.15.79:0/761516627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bd00c1e80 0x7f4bd01ab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.795 7f4bd5e10700 1 -- 172.21.15.79:0/761516627 >> 172.21.15.79:0/761516627 conn(0x7f4bd00a3bf0 msgr2=0x7f4bd0099e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:13.804 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.795 7f4bd5e10700 1 -- 172.21.15.79:0/761516627 shutdown_connections 2021-04-09T18:35:13.805 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.795 7f4bd5e10700 1 -- 172.21.15.79:0/761516627 wait complete. 2021-04-09T18:35:13.812 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-04-09T18:35:13.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.903 7f3966788700 1 Processor -- start 2021-04-09T18:35:13.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.903 7f3966788700 1 -- start start 2021-04-09T18:35:13.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.903 7f3966788700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39600f5550 0x7f39600f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.903 7f3966788700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39600fbb50 con 0x7f39600e9b10 2021-04-09T18:35:13.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.903 7f3966788700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396009f910 con 0x7f39601c8040 2021-04-09T18:35:13.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.903 7f3966788700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39600e9f60 con 0x7f39600f5550 2021-04-09T18:35:13.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.903 7f395f7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f39600e9b10 0x7f396009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57798/0 (socket says 172.21.15.79:57798) 2021-04-09T18:35:13.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.903 7f395f7fe700 1 -- 172.21.15.79:0/1922065039 learned_addr learned my addr 172.21.15.79:0/1922065039 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:13.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.903 7f395ffff700 1 --2- 172.21.15.79:0/1922065039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39600f5550 0x7f39600f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.907 7f395effd700 1 -- 172.21.15.79:0/1922065039 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804920177 0 0) 0x7f3950001450 con 0x7f39600e9b10 2021-04-09T18:35:13.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.907 7f395effd700 1 -- 172.21.15.79:0/1922065039 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3940003240 con 0x7f39600e9b10 2021-04-09T18:35:13.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.907 7f395ffff700 1 -- 172.21.15.79:0/1922065039 >> v1:172.21.15.89:6789/0 conn(0x7f39601c8040 legacy=0x7f39601ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.907 7f395ffff700 1 -- 172.21.15.79:0/1922065039 >> v1:172.21.15.79:6789/0 conn(0x7f39600e9b10 legacy=0x7f396009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.907 7f395ffff700 1 -- 172.21.15.79:0/1922065039 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39600e5700 con 0x7f39600f5550 2021-04-09T18:35:13.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.907 7f395ffff700 1 --2- 172.21.15.79:0/1922065039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39600f5550 0x7f39600f64e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f3948002f30 tx=0x7f394800bcf0).ready entity=mon.2 client_cookie=c5298620bda6c19f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:13.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.907 7f395effd700 1 -- 172.21.15.79:0/1922065039 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f39600e5700 con 0x7f39600f5550 2021-04-09T18:35:13.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.907 7f395effd700 1 -- 172.21.15.79:0/1922065039 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3948009920 con 0x7f39600f5550 2021-04-09T18:35:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.907 7f395effd700 1 -- 172.21.15.79:0/1922065039 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3948009cf0 con 0x7f39600f5550 2021-04-09T18:35:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.907 7f3966788700 1 -- 172.21.15.79:0/1922065039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39600f5550 msgr2=0x7f39600f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.907 7f3966788700 1 --2- 172.21.15.79:0/1922065039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39600f5550 0x7f39600f64e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f3948002f30 tx=0x7f394800bcf0).stop 2021-04-09T18:35:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.907 7f3966788700 1 -- 172.21.15.79:0/1922065039 shutdown_connections 2021-04-09T18:35:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.907 7f3966788700 1 --2- 172.21.15.79:0/1922065039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39600f5550 0x7f39600f64e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.907 7f3966788700 1 -- 172.21.15.79:0/1922065039 >> 172.21.15.79:0/1922065039 conn(0x7f39600e6010 msgr2=0x7f39600e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:13.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.907 7f3966788700 1 -- 172.21.15.79:0/1922065039 shutdown_connections 2021-04-09T18:35:13.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.907 7f3966788700 1 -- 172.21.15.79:0/1922065039 wait complete. 2021-04-09T18:35:13.920 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f3966788700 1 Processor -- start 2021-04-09T18:35:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f3966788700 1 -- start start 2021-04-09T18:35:13.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f3966788700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39601ab090 0x7f396019d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f3966788700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3960099260 0x7f39600d5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f3966788700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39600d5790 0x7f39600af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f3966788700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39601c3df0 con 0x7f39601ab090 2021-04-09T18:35:13.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f3966788700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396019bf40 con 0x7f3960099260 2021-04-09T18:35:13.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f3966788700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396019db10 con 0x7f39600d5790 2021-04-09T18:35:13.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f395ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39601ab090 0x7f396019d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f395ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39601ab090 0x7f396019d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34862/0 (socket says 172.21.15.79:34862) 2021-04-09T18:35:13.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f395ffff700 1 -- 172.21.15.79:0/3210336861 learned_addr learned my addr 172.21.15.79:0/3210336861 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:13.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f395f7fe700 1 --2- 172.21.15.79:0/3210336861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3960099260 0x7f39600d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f3964d2d700 1 --2- 172.21.15.79:0/3210336861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39600d5790 0x7f39600af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f395ffff700 1 -- 172.21.15.79:0/3210336861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39600d5790 msgr2=0x7f39600af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f395ffff700 1 --2- 172.21.15.79:0/3210336861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39600d5790 0x7f39600af990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f395ffff700 1 -- 172.21.15.79:0/3210336861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3960099260 msgr2=0x7f39600d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:13.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f395ffff700 1 --2- 172.21.15.79:0/3210336861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3960099260 0x7f39600d5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:13.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f395ffff700 1 -- 172.21.15.79:0/3210336861 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39600affc0 con 0x7f39601ab090 2021-04-09T18:35:13.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f395ffff700 1 --2- 172.21.15.79:0/3210336861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39601ab090 0x7f396019d4e0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f396019ecf0 tx=0x7f3948006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:13.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f395cff9700 1 -- 172.21.15.79:0/3210336861 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f39600affc0 con 0x7f39601ab090 2021-04-09T18:35:13.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f3966788700 1 -- 172.21.15.79:0/3210336861 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39600b0220 con 0x7f39601ab090 2021-04-09T18:35:13.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f3966788700 1 -- 172.21.15.79:0/3210336861 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39600b0730 con 0x7f39601ab090 2021-04-09T18:35:13.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f395cff9700 1 -- 172.21.15.79:0/3210336861 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394801d450 con 0x7f39601ab090 2021-04-09T18:35:13.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f395cff9700 1 -- 172.21.15.79:0/3210336861 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3948022020 con 0x7f39601ab090 2021-04-09T18:35:13.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f395cff9700 1 -- 172.21.15.79:0/3210336861 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f394801d820 con 0x7f39601ab090 2021-04-09T18:35:13.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f395cff9700 1 --2- 172.21.15.79:0/3210336861 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f393802b310 0x7f393802d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:13.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.911 7f395cff9700 1 -- 172.21.15.79:0/3210336861 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f394803c690 con 0x7f39601ab090 2021-04-09T18:35:13.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.915 7f395f7fe700 1 --2- 172.21.15.79:0/3210336861 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f393802b310 0x7f393802d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:13.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.915 7f395f7fe700 1 --2- 172.21.15.79:0/3210336861 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f393802b310 0x7f393802d860 crc :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:13.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.919 7f3966788700 1 -- 172.21.15.79:0/3210336861 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39601ac2d0 con 0x7f39601ab090 2021-04-09T18:35:13.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:13.923 7f395cff9700 1 -- 172.21.15.79:0/3210336861 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3948009710 con 0x7f39601ab090 2021-04-09T18:35:14.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.091 7f3966788700 1 -- 172.21.15.79:0/3210336861 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f39600e39f0 con 0x7f39601ab090 2021-04-09T18:35:14.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.191 7f395cff9700 1 -- 172.21.15.79:0/3210336861 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v77) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3948023d60 con 0x7f39601ab090 2021-04-09T18:35:14.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.207 7f3966788700 1 -- 172.21.15.79:0/3210336861 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f393802b310 msgr2=0x7f393802d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:14.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.207 7f3966788700 1 --2- 172.21.15.79:0/3210336861 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f393802b310 0x7f393802d860 crc :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.211 7f3966788700 1 -- 172.21.15.79:0/3210336861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39601ab090 msgr2=0x7f396019d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:14.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.211 7f3966788700 1 --2- 172.21.15.79:0/3210336861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39601ab090 0x7f396019d4e0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f396019ecf0 tx=0x7f3948006890).stop 2021-04-09T18:35:14.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.211 7f3966788700 1 -- 172.21.15.79:0/3210336861 shutdown_connections 2021-04-09T18:35:14.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.211 7f3966788700 1 --2- 172.21.15.79:0/3210336861 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f393802b310 0x7f393802d860 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.211 7f3966788700 1 --2- 172.21.15.79:0/3210336861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39600d5790 0x7f39600af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.211 7f3966788700 1 --2- 172.21.15.79:0/3210336861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39601ab090 0x7f396019d4e0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.219 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.211 7f3966788700 1 --2- 172.21.15.79:0/3210336861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3960099260 0x7f39600d5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.211 7f3966788700 1 -- 172.21.15.79:0/3210336861 >> 172.21.15.79:0/3210336861 conn(0x7f396009b0a0 msgr2=0x7f396009a720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:14.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.211 7f3966788700 1 -- 172.21.15.79:0/3210336861 shutdown_connections 2021-04-09T18:35:14.220 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.211 7f3966788700 1 -- 172.21.15.79:0/3210336861 wait complete. 2021-04-09T18:35:14.229 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:35:14.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8378f3e700 1 Processor -- start 2021-04-09T18:35:14.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8378f3e700 1 -- start start 2021-04-09T18:35:14.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8378f3e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f83740f5510 0x7f83740f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:14.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8378f3e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83740e9ad0 0x7f837409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:14.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8378f3e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83741c2da0 0x7f83741c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:14.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8378f3e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83740e9f20 con 0x7f83741c2da0 2021-04-09T18:35:14.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8378f3e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83740e59c0 con 0x7f83740f5510 2021-04-09T18:35:14.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8378f3e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83740fbb10 con 0x7f83740e9ad0 2021-04-09T18:35:14.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f83732f0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83741c2da0 0x7f83741c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:14.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f83732f0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83741c2da0 0x7f83741c31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34884/0 (socket says 172.21.15.79:34884) 2021-04-09T18:35:14.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f83722ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83740e9ad0 0x7f837409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:14.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f83732f0700 1 -- 172.21.15.79:0/3747667 learned_addr learned my addr 172.21.15.79:0/3747667 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:14.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8372aef700 1 --2- 172.21.15.79:0/3747667 >> v2:172.21.15.89:3300/0 conn(0x7f83740f5510 0x7f83740f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:14.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f83732f0700 1 -- 172.21.15.79:0/3747667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83740e9ad0 msgr2=0x7f837409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:14.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f83732f0700 1 --2- 172.21.15.79:0/3747667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83740e9ad0 0x7f837409f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f83732f0700 1 -- 172.21.15.79:0/3747667 >> v2:172.21.15.89:3300/0 conn(0x7f83740f5510 msgr2=0x7f83740f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:14.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f83732f0700 1 --2- 172.21.15.79:0/3747667 >> v2:172.21.15.89:3300/0 conn(0x7f83740f5510 0x7f83740f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f83732f0700 1 -- 172.21.15.79:0/3747667 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83740e56c0 con 0x7f83741c2da0 2021-04-09T18:35:14.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f83732f0700 1 --2- 172.21.15.79:0/3747667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83741c2da0 0x7f83741c31f0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f836c0032b0 tx=0x7f836c00b3c0).ready entity=mon.0 client_cookie=e444a8309ded2bcd server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:14.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8371aed700 1 -- 172.21.15.79:0/3747667 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83740e56c0 con 0x7f83741c2da0 2021-04-09T18:35:14.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8371aed700 1 -- 172.21.15.79:0/3747667 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c00bc20 con 0x7f83741c2da0 2021-04-09T18:35:14.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8371aed700 1 -- 172.21.15.79:0/3747667 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f836c002020 con 0x7f83741c2da0 2021-04-09T18:35:14.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8378f3e700 1 -- 172.21.15.79:0/3747667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83741c2da0 msgr2=0x7f83741c31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:14.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8378f3e700 1 --2- 172.21.15.79:0/3747667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83741c2da0 0x7f83741c31f0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f836c0032b0 tx=0x7f836c00b3c0).stop 2021-04-09T18:35:14.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8378f3e700 1 -- 172.21.15.79:0/3747667 shutdown_connections 2021-04-09T18:35:14.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8378f3e700 1 --2- 172.21.15.79:0/3747667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83741c2da0 0x7f83741c31f0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8378f3e700 1 --2- 172.21.15.79:0/3747667 >> v2:172.21.15.89:3300/0 conn(0x7f83740f5510 0x7f83740f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8378f3e700 1 --2- 172.21.15.79:0/3747667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83740e9ad0 0x7f837409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8378f3e700 1 -- 172.21.15.79:0/3747667 >> 172.21.15.79:0/3747667 conn(0x7f83740e5fd0 msgr2=0x7f83740e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:14.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8378f3e700 1 -- 172.21.15.79:0/3747667 shutdown_connections 2021-04-09T18:35:14.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.311 7f8378f3e700 1 -- 172.21.15.79:0/3747667 wait complete. 2021-04-09T18:35:14.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f8378f3e700 1 Processor -- start 2021-04-09T18:35:14.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f8378f3e700 1 -- start start 2021-04-09T18:35:14.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f8378f3e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83740d5980 0x7f83740bacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:14.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f8378f3e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83740ae080 0x7f837419bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:14.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f8378f3e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83740ae4d0 0x7f837419c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:14.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f8378f3e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83740973a0 con 0x7f83740ae080 2021-04-09T18:35:14.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f8378f3e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83740976a0 con 0x7f83740ae4d0 2021-04-09T18:35:14.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f8378f3e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83741aebc0 con 0x7f83740d5980 2021-04-09T18:35:14.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f83722ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83740ae080 0x7f837419bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:14.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f83722ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83740ae080 0x7f837419bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34888/0 (socket says 172.21.15.79:34888) 2021-04-09T18:35:14.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f83722ee700 1 -- 172.21.15.79:0/709886789 learned_addr learned my addr 172.21.15.79:0/709886789 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:14.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f8372aef700 1 --2- 172.21.15.79:0/709886789 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83740d5980 0x7f83740bacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:14.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f83732f0700 1 --2- 172.21.15.79:0/709886789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83740ae4d0 0x7f837419c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:14.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f83722ee700 1 -- 172.21.15.79:0/709886789 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83740d5980 msgr2=0x7f83740bacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:14.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f83722ee700 1 --2- 172.21.15.79:0/709886789 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83740d5980 0x7f83740bacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f83722ee700 1 -- 172.21.15.79:0/709886789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83740ae4d0 msgr2=0x7f837419c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:14.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f83722ee700 1 --2- 172.21.15.79:0/709886789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83740ae4d0 0x7f837419c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f83722ee700 1 -- 172.21.15.79:0/709886789 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83740d65a0 con 0x7f83740ae080 2021-04-09T18:35:14.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f83722ee700 1 --2- 172.21.15.79:0/709886789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83740ae080 0x7f837419bbe0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f8374097320 tx=0x7f836800c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:14.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f83637fe700 1 -- 172.21.15.79:0/709886789 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83740d65a0 con 0x7f83740ae080 2021-04-09T18:35:14.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f83637fe700 1 -- 172.21.15.79:0/709886789 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836800cc10 con 0x7f83740ae080 2021-04-09T18:35:14.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f8378f3e700 1 -- 172.21.15.79:0/709886789 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83740aec60 con 0x7f83740ae080 2021-04-09T18:35:14.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f83637fe700 1 -- 172.21.15.79:0/709886789 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f836800f040 con 0x7f83740ae080 2021-04-09T18:35:14.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f8378f3e700 1 -- 172.21.15.79:0/709886789 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83740bb2e0 con 0x7f83740ae080 2021-04-09T18:35:14.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.319 7f83637fe700 1 -- 172.21.15.79:0/709886789 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8368011070 con 0x7f83740ae080 2021-04-09T18:35:14.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.323 7f83637fe700 1 --2- 172.21.15.79:0/709886789 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8358029100 0x7f835802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:14.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.323 7f83637fe700 1 -- 172.21.15.79:0/709886789 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f8368010040 con 0x7f83740ae080 2021-04-09T18:35:14.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.323 7f8372aef700 1 --2- 172.21.15.79:0/709886789 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8358029100 0x7f835802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:14.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.323 7f8372aef700 1 --2- 172.21.15.79:0/709886789 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8358029100 0x7f835802b650 crc :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:14.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.323 7f8378f3e700 1 -- 172.21.15.79:0/709886789 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83740e39d0 con 0x7f83740ae080 2021-04-09T18:35:14.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.331 7f83637fe700 1 -- 172.21.15.79:0/709886789 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f836800c810 con 0x7f83740ae080 2021-04-09T18:35:14.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.495 7f8378f3e700 1 -- 172.21.15.79:0/709886789 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83740f5b10 con 0x7f83740ae080 2021-04-09T18:35:14.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.495 7f83637fe700 1 -- 172.21.15.79:0/709886789 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f8368000bf0 con 0x7f83740ae080 2021-04-09T18:35:14.503 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:14.503 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":78,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7842,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1552365531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1552365531},{"type":"v1","addr":"172.21.15.89:6835","nonce":1552365531}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":77}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:35:13.180244","modified":"2021-04-09 18:35:14.195993","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7833},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7833":{"gid":7833,"name":"a","rank":0,"incarnation":78,"state":"up:creating","state_seq":2,"addr":"172.21.15.79:6833/4102869700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4102869700},{"type":"v1","addr":"172.21.15.79:6833","nonce":4102869700}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-04-09T18:35:14.504 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 78 2021-04-09T18:35:14.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.499 7f8378f3e700 1 -- 172.21.15.79:0/709886789 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8358029100 msgr2=0x7f835802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:14.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.499 7f8378f3e700 1 --2- 172.21.15.79:0/709886789 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8358029100 0x7f835802b650 crc :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.499 7f8378f3e700 1 -- 172.21.15.79:0/709886789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83740ae080 msgr2=0x7f837419bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:14.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.499 7f8378f3e700 1 --2- 172.21.15.79:0/709886789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83740ae080 0x7f837419bbe0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f8374097320 tx=0x7f836800c150).stop 2021-04-09T18:35:14.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.499 7f8378f3e700 1 -- 172.21.15.79:0/709886789 shutdown_connections 2021-04-09T18:35:14.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.499 7f8378f3e700 1 --2- 172.21.15.79:0/709886789 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8358029100 0x7f835802b650 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.499 7f8378f3e700 1 --2- 172.21.15.79:0/709886789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83740ae4d0 0x7f837419c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.499 7f8378f3e700 1 --2- 172.21.15.79:0/709886789 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83740d5980 0x7f83740bacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.499 7f8378f3e700 1 --2- 172.21.15.79:0/709886789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83740ae080 0x7f837419bbe0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.499 7f8378f3e700 1 -- 172.21.15.79:0/709886789 >> 172.21.15.79:0/709886789 conn(0x7f8374098b10 msgr2=0x7f8374095530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:14.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.499 7f8378f3e700 1 -- 172.21.15.79:0/709886789 shutdown_connections 2021-04-09T18:35:14.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.499 7f8378f3e700 1 -- 172.21.15.79:0/709886789 wait complete. 2021-04-09T18:35:14.516 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:35:14.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.599 7f43e3646700 1 Processor -- start 2021-04-09T18:35:14.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.599 7f43e3646700 1 -- start start 2021-04-09T18:35:14.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.599 7f43e3646700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f43dc0e9ad0 0x7f43dc09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:14.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.599 7f43e3646700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43dc1c8000 0x7f43dc1ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:14.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.599 7f43e3646700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43dc0fbb10 con 0x7f43dc0f5510 2021-04-09T18:35:14.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.599 7f43e3646700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43dc1c3db0 con 0x7f43dc0e9ad0 2021-04-09T18:35:14.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.599 7f43e3646700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0e9f20 con 0x7f43dc1c8000 2021-04-09T18:35:14.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.599 7f43e13ea700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f43dc0f5510 0x7f43dc0f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57836/0 (socket says 172.21.15.79:57836) 2021-04-09T18:35:14.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.599 7f43e13ea700 1 -- 172.21.15.79:0/4156540676 learned_addr learned my addr 172.21.15.79:0/4156540676 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:14.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.599 7f43e0be9700 1 --2- 172.21.15.79:0/4156540676 >> v2:172.21.15.89:3300/0 conn(0x7f43dc0e9ad0 0x7f43dc09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:14.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.599 7f43e1beb700 1 --2- 172.21.15.79:0/4156540676 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43dc1c8000 0x7f43dc1ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:14.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.599 7f43d3fff700 1 -- 172.21.15.79:0/4156540676 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933407943 0 0) 0x7f43d40010d0 con 0x7f43dc0f5510 2021-04-09T18:35:14.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.599 7f43d3fff700 1 -- 172.21.15.79:0/4156540676 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43c4003240 con 0x7f43dc0f5510 2021-04-09T18:35:14.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.603 7f43e0be9700 1 -- 172.21.15.79:0/4156540676 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43dc1c8000 msgr2=0x7f43dc1ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:14.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.603 7f43e0be9700 1 --2- 172.21.15.79:0/4156540676 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43dc1c8000 0x7f43dc1ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.603 7f43e0be9700 1 -- 172.21.15.79:0/4156540676 >> v1:172.21.15.79:6789/0 conn(0x7f43dc0f5510 legacy=0x7f43dc0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:14.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.603 7f43d3fff700 1 -- 172.21.15.79:0/4156540676 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 216457876 0 0) 0x7f43d4001650 con 0x7f43dc0f5510 2021-04-09T18:35:14.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.603 7f43e0be9700 1 -- 172.21.15.79:0/4156540676 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc0e56c0 con 0x7f43dc0e9ad0 2021-04-09T18:35:14.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.603 7f43e0be9700 1 --2- 172.21.15.79:0/4156540676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43dc0e9ad0 0x7f43dc09f100 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f43d4001df0 tx=0x7f43d800b3c0).ready entity=mon.1 client_cookie=8920240195b98522 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:14.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.603 7f43d3fff700 1 -- 172.21.15.79:0/4156540676 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f43dc0e56c0 con 0x7f43dc0e9ad0 2021-04-09T18:35:14.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.603 7f43d3fff700 1 -- 172.21.15.79:0/4156540676 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d800bae0 con 0x7f43dc0e9ad0 2021-04-09T18:35:14.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.603 7f43d3fff700 1 -- 172.21.15.79:0/4156540676 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f43d8002020 con 0x7f43dc0e9ad0 2021-04-09T18:35:14.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.603 7f43e3646700 1 -- 172.21.15.79:0/4156540676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43dc0e9ad0 msgr2=0x7f43dc09f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:14.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.603 7f43e3646700 1 --2- 172.21.15.79:0/4156540676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43dc0e9ad0 0x7f43dc09f100 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f43d4001df0 tx=0x7f43d800b3c0).stop 2021-04-09T18:35:14.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.603 7f43e3646700 1 -- 172.21.15.79:0/4156540676 shutdown_connections 2021-04-09T18:35:14.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.603 7f43e3646700 1 --2- 172.21.15.79:0/4156540676 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43dc1c8000 0x7f43dc1ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.603 7f43e3646700 1 --2- 172.21.15.79:0/4156540676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43dc0e9ad0 0x7f43dc09f100 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.603 7f43e3646700 1 -- 172.21.15.79:0/4156540676 >> 172.21.15.79:0/4156540676 conn(0x7f43dc0e5fd0 msgr2=0x7f43dc0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:14.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.603 7f43e3646700 1 -- 172.21.15.79:0/4156540676 shutdown_connections 2021-04-09T18:35:14.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.603 7f43e3646700 1 -- 172.21.15.79:0/4156540676 wait complete. 2021-04-09T18:35:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e3646700 1 Processor -- start 2021-04-09T18:35:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e3646700 1 -- start start 2021-04-09T18:35:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e3646700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43dc0bc1e0 0x7f43dc0be480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e3646700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43dc0bba90 0x7f43dc1ad510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e3646700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43dc0983f0 0x7f43dc098840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e3646700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0980f0 con 0x7f43dc0983f0 2021-04-09T18:35:14.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e3646700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0979a0 con 0x7f43dc0bba90 2021-04-09T18:35:14.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e3646700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0bbee0 con 0x7f43dc0bc1e0 2021-04-09T18:35:14.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e1beb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43dc0983f0 0x7f43dc098840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:14.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e1beb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43dc0983f0 0x7f43dc098840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34904/0 (socket says 172.21.15.79:34904) 2021-04-09T18:35:14.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e1beb700 1 -- 172.21.15.79:0/27404893 learned_addr learned my addr 172.21.15.79:0/27404893 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:14.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e0be9700 1 --2- 172.21.15.79:0/27404893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43dc0bba90 0x7f43dc1ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:14.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e13ea700 1 --2- 172.21.15.79:0/27404893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43dc0bc1e0 0x7f43dc0be480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:14.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e1beb700 1 -- 172.21.15.79:0/27404893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43dc0bc1e0 msgr2=0x7f43dc0be480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:14.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e1beb700 1 --2- 172.21.15.79:0/27404893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43dc0bc1e0 0x7f43dc0be480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e1beb700 1 -- 172.21.15.79:0/27404893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43dc0bba90 msgr2=0x7f43dc1ad510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:14.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e1beb700 1 --2- 172.21.15.79:0/27404893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43dc0bba90 0x7f43dc1ad510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e1beb700 1 -- 172.21.15.79:0/27404893 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc098e70 con 0x7f43dc0983f0 2021-04-09T18:35:14.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e1beb700 1 --2- 172.21.15.79:0/27404893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43dc0983f0 0x7f43dc098840 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f43cc00c000 tx=0x7f43cc00bf00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:14.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43d1ffb700 1 -- 172.21.15.79:0/27404893 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f43dc098e70 con 0x7f43dc0983f0 2021-04-09T18:35:14.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43d1ffb700 1 -- 172.21.15.79:0/27404893 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc00cac0 con 0x7f43dc0983f0 2021-04-09T18:35:14.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e3646700 1 -- 172.21.15.79:0/27404893 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43dc1adb40 con 0x7f43dc0983f0 2021-04-09T18:35:14.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43d1ffb700 1 -- 172.21.15.79:0/27404893 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f43cc00f040 con 0x7f43dc0983f0 2021-04-09T18:35:14.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.607 7f43e3646700 1 -- 172.21.15.79:0/27404893 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43dc0af5e0 con 0x7f43dc0983f0 2021-04-09T18:35:14.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.611 7f43d1ffb700 1 -- 172.21.15.79:0/27404893 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f43cc011070 con 0x7f43dc0983f0 2021-04-09T18:35:14.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.611 7f43d1ffb700 1 --2- 172.21.15.79:0/27404893 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f43bc029100 0x7f43bc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:14.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.611 7f43d1ffb700 1 -- 172.21.15.79:0/27404893 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f43cc010040 con 0x7f43dc0983f0 2021-04-09T18:35:14.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.611 7f43e13ea700 1 --2- 172.21.15.79:0/27404893 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f43bc029100 0x7f43bc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:14.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.611 7f43e13ea700 1 --2- 172.21.15.79:0/27404893 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f43bc029100 0x7f43bc02b650 crc :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:14.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.615 7f43e3646700 1 -- 172.21.15.79:0/27404893 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43dc0e39d0 con 0x7f43dc0983f0 2021-04-09T18:35:14.628 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.623 7f43d1ffb700 1 -- 172.21.15.79:0/27404893 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f43cc00c6c0 con 0x7f43dc0983f0 2021-04-09T18:35:14.656 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:35:14.659 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:35:14.661 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:35:14.663 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:35:14.666 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:35:14.807 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.803 7f43e3646700 1 -- 172.21.15.79:0/27404893 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43dc0a1cb0 con 0x7f43dc0983f0 2021-04-09T18:35:14.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.803 7f43d1ffb700 1 -- 172.21.15.79:0/27404893 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+14240 (secure 0 0 0) 0x7f43dc0f76b0 con 0x7f43dc0983f0 2021-04-09T18:35:14.811 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:14.811 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":126,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:35:14.182279","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:35:11.346312","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2021-04-09 18:35:12.219337","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:35:14.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.807 7f43e3646700 1 -- 172.21.15.79:0/27404893 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f43bc029100 msgr2=0x7f43bc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:14.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.807 7f43e3646700 1 --2- 172.21.15.79:0/27404893 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f43bc029100 0x7f43bc02b650 crc :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.807 7f43e3646700 1 -- 172.21.15.79:0/27404893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43dc0983f0 msgr2=0x7f43dc098840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:14.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.807 7f43e3646700 1 --2- 172.21.15.79:0/27404893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43dc0983f0 0x7f43dc098840 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f43cc00c000 tx=0x7f43cc00bf00).stop 2021-04-09T18:35:14.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.807 7f43e3646700 1 -- 172.21.15.79:0/27404893 shutdown_connections 2021-04-09T18:35:14.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.807 7f43e3646700 1 --2- 172.21.15.79:0/27404893 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f43bc029100 0x7f43bc02b650 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.807 7f43e3646700 1 --2- 172.21.15.79:0/27404893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43dc0983f0 0x7f43dc098840 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.807 7f43e3646700 1 --2- 172.21.15.79:0/27404893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43dc0bc1e0 0x7f43dc0be480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.807 7f43e3646700 1 --2- 172.21.15.79:0/27404893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43dc0bba90 0x7f43dc1ad510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.807 7f43e3646700 1 -- 172.21.15.79:0/27404893 >> 172.21.15.79:0/27404893 conn(0x7f43dc09ad30 msgr2=0x7f43dc09a290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:14.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.807 7f43e3646700 1 -- 172.21.15.79:0/27404893 shutdown_connections 2021-04-09T18:35:14.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.807 7f43e3646700 1 -- 172.21.15.79:0/27404893 wait complete. 2021-04-09T18:35:14.829 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:35:14.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.967 7fa487237700 1 Processor -- start 2021-04-09T18:35:14.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.967 7fa487237700 1 -- start start 2021-04-09T18:35:14.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.967 7fa487237700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa4801c8e50 0x7fa4801cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:14.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.967 7fa487237700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4800fbb80 con 0x7fa4800e9b40 2021-04-09T18:35:14.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.967 7fa487237700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48009f910 con 0x7fa4800f5580 2021-04-09T18:35:14.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.967 7fa487237700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4800e9f90 con 0x7fa4801c8e50 2021-04-09T18:35:14.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.967 7fa4857dc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa4801c8e50 0x7fa4801cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:14.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.967 7fa4857dc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa4801c8e50 0x7fa4801cb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34912/0 (socket says 172.21.15.79:34912) 2021-04-09T18:35:14.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.967 7fa4857dc700 1 -- 172.21.15.79:0/1417312522 learned_addr learned my addr 172.21.15.79:0/1417312522 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:14.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.967 7fa47ffff700 1 --1- 172.21.15.79:0/1417312522 >> v1:172.21.15.79:6789/0 conn(0x7fa4800e9b40 0x7fa48009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57850/0 (socket says 172.21.15.79:57850) 2021-04-09T18:35:14.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.967 7fa4857dc700 1 -- 172.21.15.79:0/1417312522 >> v1:172.21.15.89:6789/0 conn(0x7fa4800f5580 legacy=0x7fa4800f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:14.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.967 7fa4857dc700 1 -- 172.21.15.79:0/1417312522 >> v1:172.21.15.79:6789/0 conn(0x7fa4800e9b40 legacy=0x7fa48009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:14.979 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.967 7fa47f7fe700 1 -- 172.21.15.79:0/1417312522 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867294065 0 0) 0x7fa478001450 con 0x7fa4800f5580 2021-04-09T18:35:14.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.967 7fa4857dc700 1 -- 172.21.15.79:0/1417312522 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4800e56b0 con 0x7fa4801c8e50 2021-04-09T18:35:14.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.967 7fa4857dc700 1 --2- 172.21.15.79:0/1417312522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4801c8e50 0x7fa4801cb2b0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7fa468001340 tx=0x7fa468001040).ready entity=mon.0 client_cookie=e898114c8cd2e655 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:14.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.967 7fa47f7fe700 1 -- 172.21.15.79:0/1417312522 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa4800e56b0 con 0x7fa4801c8e50 2021-04-09T18:35:14.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.967 7fa47f7fe700 1 -- 172.21.15.79:0/1417312522 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa470009720 con 0x7fa4801c8e50 2021-04-09T18:35:14.980 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.967 7fa47f7fe700 1 -- 172.21.15.79:0/1417312522 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa470009af0 con 0x7fa4801c8e50 2021-04-09T18:35:14.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.967 7fa487237700 1 -- 172.21.15.79:0/1417312522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4801c8e50 msgr2=0x7fa4801cb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:14.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.967 7fa487237700 1 --2- 172.21.15.79:0/1417312522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4801c8e50 0x7fa4801cb2b0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7fa468001340 tx=0x7fa468001040).stop 2021-04-09T18:35:14.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa487237700 1 -- 172.21.15.79:0/1417312522 shutdown_connections 2021-04-09T18:35:14.981 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa487237700 1 --2- 172.21.15.79:0/1417312522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4801c8e50 0x7fa4801cb2b0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa487237700 1 -- 172.21.15.79:0/1417312522 >> 172.21.15.79:0/1417312522 conn(0x7fa4800e6040 msgr2=0x7fa4800e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:14.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa487237700 1 -- 172.21.15.79:0/1417312522 shutdown_connections 2021-04-09T18:35:14.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa487237700 1 -- 172.21.15.79:0/1417312522 wait complete. 2021-04-09T18:35:14.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa487237700 1 Processor -- start 2021-04-09T18:35:14.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa487237700 1 -- start start 2021-04-09T18:35:14.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa487237700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4801c3830 0x7fa4801c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:14.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa487237700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4800d50c0 0x7fa4800d5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:14.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa487237700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4801d4890 0x7fa4801d4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:14.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa487237700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa480088820 con 0x7fa4801d4890 2021-04-09T18:35:14.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa487237700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4801c0df0 con 0x7fa4800d50c0 2021-04-09T18:35:14.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa487237700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4801c10f0 con 0x7fa4801c3830 2021-04-09T18:35:14.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa4857dc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4801d4890 0x7fa4801d4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:14.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa4857dc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4801d4890 0x7fa4801d4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34916/0 (socket says 172.21.15.79:34916) 2021-04-09T18:35:14.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa4857dc700 1 -- 172.21.15.79:0/1501114464 learned_addr learned my addr 172.21.15.79:0/1501114464 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:14.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa47ffff700 1 --2- 172.21.15.79:0/1501114464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4800d50c0 0x7fa4800d5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:14.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa484fdb700 1 --2- 172.21.15.79:0/1501114464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4801c3830 0x7fa4801c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:14.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa4857dc700 1 -- 172.21.15.79:0/1501114464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4801c3830 msgr2=0x7fa4801c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:14.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa4857dc700 1 --2- 172.21.15.79:0/1501114464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4801c3830 0x7fa4801c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa4857dc700 1 -- 172.21.15.79:0/1501114464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4800d50c0 msgr2=0x7fa4800d5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:14.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa4857dc700 1 --2- 172.21.15.79:0/1501114464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4800d50c0 0x7fa4800d5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:14.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.971 7fa4857dc700 1 -- 172.21.15.79:0/1501114464 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4801c4770 con 0x7fa4801d4890 2021-04-09T18:35:14.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.975 7fa4857dc700 1 --2- 172.21.15.79:0/1501114464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4801d4890 0x7fa4801d4ce0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7fa4800d5c40 tx=0x7fa470006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:14.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.975 7fa47d7fa700 1 -- 172.21.15.79:0/1501114464 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa4801c4770 con 0x7fa4801d4890 2021-04-09T18:35:14.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.975 7fa47d7fa700 1 -- 172.21.15.79:0/1501114464 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa470011c80 con 0x7fa4801d4890 2021-04-09T18:35:14.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.975 7fa47d7fa700 1 -- 172.21.15.79:0/1501114464 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa470022020 con 0x7fa4801d4890 2021-04-09T18:35:14.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.975 7fa487237700 1 -- 172.21.15.79:0/1501114464 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4801c5140 con 0x7fa4801d4890 2021-04-09T18:35:14.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.975 7fa487237700 1 -- 172.21.15.79:0/1501114464 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4801d5310 con 0x7fa4801d4890 2021-04-09T18:35:14.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.975 7fa47d7fa700 1 -- 172.21.15.79:0/1501114464 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa47001d640 con 0x7fa4801d4890 2021-04-09T18:35:14.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.975 7fa47d7fa700 1 --2- 172.21.15.79:0/1501114464 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa464029100 0x7fa46402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:14.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.975 7fa47d7fa700 1 -- 172.21.15.79:0/1501114464 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fa47003c690 con 0x7fa4801d4890 2021-04-09T18:35:14.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.975 7fa484fdb700 1 --2- 172.21.15.79:0/1501114464 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa464029100 0x7fa46402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:14.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.975 7fa484fdb700 1 --2- 172.21.15.79:0/1501114464 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa464029100 0x7fa46402b650 crc :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:14.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.983 7fa487237700 1 -- 172.21.15.79:0/1501114464 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa480088d30 con 0x7fa4801d4890 2021-04-09T18:35:14.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:14.991 7fa47d7fa700 1 -- 172.21.15.79:0/1501114464 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa470009510 con 0x7fa4801d4890 2021-04-09T18:35:15.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.155 7fa487237700 1 -- 172.21.15.79:0/1501114464 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fa4800e39a0 con 0x7fa4801d4890 2021-04-09T18:35:15.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.163 7fa47d7fa700 1 -- 172.21.15.79:0/1501114464 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v36) v1 ==== 184+0+0 (secure 0 0 0) 0x7fa470011a70 con 0x7fa4801d4890 2021-04-09T18:35:15.169 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2021-04-09T18:35:15.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.167 7fa487237700 1 -- 172.21.15.79:0/1501114464 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa464029100 msgr2=0x7fa46402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:15.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.167 7fa487237700 1 --2- 172.21.15.79:0/1501114464 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa464029100 0x7fa46402b650 crc :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.167 7fa487237700 1 -- 172.21.15.79:0/1501114464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4801d4890 msgr2=0x7fa4801d4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:15.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.167 7fa487237700 1 --2- 172.21.15.79:0/1501114464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4801d4890 0x7fa4801d4ce0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7fa4800d5c40 tx=0x7fa470006890).stop 2021-04-09T18:35:15.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.167 7fa487237700 1 -- 172.21.15.79:0/1501114464 shutdown_connections 2021-04-09T18:35:15.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.167 7fa487237700 1 --2- 172.21.15.79:0/1501114464 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa464029100 0x7fa46402b650 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.167 7fa487237700 1 --2- 172.21.15.79:0/1501114464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4801d4890 0x7fa4801d4ce0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.167 7fa487237700 1 --2- 172.21.15.79:0/1501114464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4801c3830 0x7fa4801c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.167 7fa487237700 1 --2- 172.21.15.79:0/1501114464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4800d50c0 0x7fa4800d5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.167 7fa487237700 1 -- 172.21.15.79:0/1501114464 >> 172.21.15.79:0/1501114464 conn(0x7fa4800ba740 msgr2=0x7fa4800a2620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:15.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.167 7fa487237700 1 -- 172.21.15.79:0/1501114464 shutdown_connections 2021-04-09T18:35:15.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.167 7fa487237700 1 -- 172.21.15.79:0/1501114464 wait complete. 2021-04-09T18:35:15.183 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:35:15.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.283 7f83e054a700 1 Processor -- start 2021-04-09T18:35:15.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.283 7f83e054a700 1 -- start start 2021-04-09T18:35:15.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.283 7f83e054a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83d80f5580 0x7f83d80f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:15.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.283 7f83e054a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83d80e9b40 0x7f83d809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:15.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.283 7f83e054a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d80fbb80 con 0x7f83d81c6e30 2021-04-09T18:35:15.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.283 7f83e054a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d80e9f90 con 0x7f83d80f5580 2021-04-09T18:35:15.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.283 7f83e054a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d80e59b0 con 0x7f83d80e9b40 2021-04-09T18:35:15.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.283 7f83de2ee700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83d80f5580 0x7f83d80f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:15.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.283 7f83de2ee700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83d80f5580 0x7f83d80f6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34922/0 (socket says 172.21.15.79:34922) 2021-04-09T18:35:15.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.283 7f83de2ee700 1 -- 172.21.15.79:0/1512703003 learned_addr learned my addr 172.21.15.79:0/1512703003 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:15.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.283 7f83ddaed700 1 --2- 172.21.15.79:0/1512703003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83d80e9b40 0x7f83d809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:15.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.283 7f83de2ee700 1 -- 172.21.15.79:0/1512703003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83d80e9b40 msgr2=0x7f83d809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:15.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.283 7f83de2ee700 1 --2- 172.21.15.79:0/1512703003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83d80e9b40 0x7f83d809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.283 7f83de2ee700 1 -- 172.21.15.79:0/1512703003 >> v1:172.21.15.89:6789/0 conn(0x7f83d81c6e30 legacy=0x7f83d81c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:15.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.287 7f83de2ee700 1 -- 172.21.15.79:0/1512703003 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d80e56b0 con 0x7f83d80f5580 2021-04-09T18:35:15.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.287 7f83de2ee700 1 --2- 172.21.15.79:0/1512703003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83d80f5580 0x7f83d80f6510 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f83d4002f30 tx=0x7f83d400bda0).ready entity=mon.0 client_cookie=8b622b7906a1d67e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:15.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.287 7f83dd2ec700 1 -- 172.21.15.79:0/1512703003 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83d80e56b0 con 0x7f83d80f5580 2021-04-09T18:35:15.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.287 7f83dd2ec700 1 -- 172.21.15.79:0/1512703003 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d40099d0 con 0x7f83d80f5580 2021-04-09T18:35:15.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.287 7f83dd2ec700 1 -- 172.21.15.79:0/1512703003 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83d4009da0 con 0x7f83d80f5580 2021-04-09T18:35:15.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.287 7f83e054a700 1 -- 172.21.15.79:0/1512703003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83d80f5580 msgr2=0x7f83d80f6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:15.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.287 7f83e054a700 1 --2- 172.21.15.79:0/1512703003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83d80f5580 0x7f83d80f6510 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f83d4002f30 tx=0x7f83d400bda0).stop 2021-04-09T18:35:15.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.287 7f83e054a700 1 -- 172.21.15.79:0/1512703003 shutdown_connections 2021-04-09T18:35:15.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.287 7f83e054a700 1 --2- 172.21.15.79:0/1512703003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83d80f5580 0x7f83d80f6510 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.287 7f83e054a700 1 --2- 172.21.15.79:0/1512703003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83d80e9b40 0x7f83d809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.287 7f83e054a700 1 -- 172.21.15.79:0/1512703003 >> 172.21.15.79:0/1512703003 conn(0x7f83d80e6040 msgr2=0x7f83d80e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:15.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.287 7f83e054a700 1 -- 172.21.15.79:0/1512703003 shutdown_connections 2021-04-09T18:35:15.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.287 7f83e054a700 1 -- 172.21.15.79:0/1512703003 wait complete. 2021-04-09T18:35:15.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83e054a700 1 Processor -- start 2021-04-09T18:35:15.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83e054a700 1 -- start start 2021-04-09T18:35:15.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83e054a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83d80d61b0 0x7f83d80b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:15.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83e054a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83d80c36a0 0x7f83d80c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:15.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83e054a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83d80c3af0 0x7f83d8099b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:15.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83e054a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d80d6920 con 0x7f83d80c36a0 2021-04-09T18:35:15.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83e054a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d80d6600 con 0x7f83d80c3af0 2021-04-09T18:35:15.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83e054a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d80b2470 con 0x7f83d80d61b0 2021-04-09T18:35:15.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83ddaed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83d80c36a0 0x7f83d80c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:15.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83de2ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83d80d61b0 0x7f83d80b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:15.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83ddaed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83d80c36a0 0x7f83d80c6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34930/0 (socket says 172.21.15.79:34930) 2021-04-09T18:35:15.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83ddaed700 1 -- 172.21.15.79:0/3078583990 learned_addr learned my addr 172.21.15.79:0/3078583990 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83deaef700 1 --2- 172.21.15.79:0/3078583990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83d80c3af0 0x7f83d8099b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83ddaed700 1 -- 172.21.15.79:0/3078583990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83d80d61b0 msgr2=0x7f83d80b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83ddaed700 1 --2- 172.21.15.79:0/3078583990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83d80d61b0 0x7f83d80b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83ddaed700 1 -- 172.21.15.79:0/3078583990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83d80c3af0 msgr2=0x7f83d8099b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:15.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83ddaed700 1 --2- 172.21.15.79:0/3078583990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83d80c3af0 0x7f83d8099b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83ddaed700 1 -- 172.21.15.79:0/3078583990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d80d6c20 con 0x7f83d80c36a0 2021-04-09T18:35:15.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83ddaed700 1 --2- 172.21.15.79:0/3078583990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83d80c36a0 0x7f83d80c6730 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7f83d80b2620 tx=0x7f83c800c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:15.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83ceffd700 1 -- 172.21.15.79:0/3078583990 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83d80d6c20 con 0x7f83d80c36a0 2021-04-09T18:35:15.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83e054a700 1 -- 172.21.15.79:0/3078583990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d80c6d60 con 0x7f83d80c36a0 2021-04-09T18:35:15.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83ceffd700 1 -- 172.21.15.79:0/3078583990 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c800cb50 con 0x7f83d80c36a0 2021-04-09T18:35:15.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83ceffd700 1 -- 172.21.15.79:0/3078583990 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83c800f040 con 0x7f83d80c36a0 2021-04-09T18:35:15.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.291 7f83e054a700 1 -- 172.21.15.79:0/3078583990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d809a370 con 0x7f83d80c36a0 2021-04-09T18:35:15.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.295 7f83ceffd700 1 -- 172.21.15.79:0/3078583990 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f83c8011070 con 0x7f83d80c36a0 2021-04-09T18:35:15.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.295 7f83ceffd700 1 --2- 172.21.15.79:0/3078583990 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f83c0029100 0x7f83c002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.295 7f83ceffd700 1 -- 172.21.15.79:0/3078583990 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f83c8010040 con 0x7f83d80c36a0 2021-04-09T18:35:15.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.295 7f83de2ee700 1 --2- 172.21.15.79:0/3078583990 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f83c0029100 0x7f83c002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:15.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.295 7f83de2ee700 1 --2- 172.21.15.79:0/3078583990 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f83c0029100 0x7f83c002b650 crc :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:15.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.299 7f83e054a700 1 -- 172.21.15.79:0/3078583990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d8088d30 con 0x7f83d80c36a0 2021-04-09T18:35:15.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.303 7f83ceffd700 1 -- 172.21.15.79:0/3078583990 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f83d80e5c80 con 0x7f83d80c36a0 2021-04-09T18:35:15.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.459 7f83e054a700 1 -- 172.21.15.79:0/3078583990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f83d80e39a0 con 0x7f83d80c36a0 2021-04-09T18:35:15.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.467 7f83ceffd700 1 -- 172.21.15.79:0/3078583990 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v37) v1 ==== 184+0+0 (secure 0 0 0) 0x7f83c800c750 con 0x7f83d80c36a0 2021-04-09T18:35:15.472 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.1 2021-04-09T18:35:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.467 7f83e054a700 1 -- 172.21.15.79:0/3078583990 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f83c0029100 msgr2=0x7f83c002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.467 7f83e054a700 1 --2- 172.21.15.79:0/3078583990 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f83c0029100 0x7f83c002b650 crc :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.467 7f83e054a700 1 -- 172.21.15.79:0/3078583990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83d80c36a0 msgr2=0x7f83d80c6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:15.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.467 7f83e054a700 1 --2- 172.21.15.79:0/3078583990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83d80c36a0 0x7f83d80c6730 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7f83d80b2620 tx=0x7f83c800c150).stop 2021-04-09T18:35:15.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.467 7f83e054a700 1 -- 172.21.15.79:0/3078583990 shutdown_connections 2021-04-09T18:35:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.467 7f83e054a700 1 --2- 172.21.15.79:0/3078583990 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f83c0029100 0x7f83c002b650 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.467 7f83e054a700 1 --2- 172.21.15.79:0/3078583990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83d80c3af0 0x7f83d8099b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.467 7f83e054a700 1 --2- 172.21.15.79:0/3078583990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83d80d61b0 0x7f83d80b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.467 7f83e054a700 1 --2- 172.21.15.79:0/3078583990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83d80c36a0 0x7f83d80c6730 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.467 7f83e054a700 1 -- 172.21.15.79:0/3078583990 >> 172.21.15.79:0/3078583990 conn(0x7f83d81a4c00 msgr2=0x7f83d8098f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:15.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.467 7f83e054a700 1 -- 172.21.15.79:0/3078583990 shutdown_connections 2021-04-09T18:35:15.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.467 7f83e054a700 1 -- 172.21.15.79:0/3078583990 wait complete. 2021-04-09T18:35:15.486 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:35:15.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.583 7fde80a2e700 1 Processor -- start 2021-04-09T18:35:15.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.583 7fde80a2e700 1 -- start start 2021-04-09T18:35:15.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.583 7fde80a2e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde7c0e9b40 0x7fde7c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:15.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.583 7fde80a2e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fde7c1c7e40 0x7fde7c1ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:15.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.583 7fde80a2e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde7c0fbb80 con 0x7fde7c0f5580 2021-04-09T18:35:15.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.583 7fde80a2e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7c0e9f90 con 0x7fde7c1c7e40 2021-04-09T18:35:15.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.583 7fde80a2e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0e59b0 con 0x7fde7c0e9b40 2021-04-09T18:35:15.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.583 7fde7ada5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fde7c1c7e40 0x7fde7c1ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:15.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.583 7fde7ada5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fde7c1c7e40 0x7fde7c1ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34940/0 (socket says 172.21.15.79:34940) 2021-04-09T18:35:15.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.583 7fde7ada5700 1 -- 172.21.15.79:0/4208686886 learned_addr learned my addr 172.21.15.79:0/4208686886 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:15.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.583 7fde79da3700 1 --2- 172.21.15.79:0/4208686886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde7c0e9b40 0x7fde7c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:15.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.587 7fde7ada5700 1 -- 172.21.15.79:0/4208686886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde7c0e9b40 msgr2=0x7fde7c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:15.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.587 7fde7ada5700 1 --2- 172.21.15.79:0/4208686886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde7c0e9b40 0x7fde7c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.598 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.587 7fde7ada5700 1 -- 172.21.15.79:0/4208686886 >> v1:172.21.15.89:6789/0 conn(0x7fde7c0f5580 legacy=0x7fde7c0f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:15.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.587 7fde7ada5700 1 -- 172.21.15.79:0/4208686886 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c0e56b0 con 0x7fde7c1c7e40 2021-04-09T18:35:15.599 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.587 7fde7ada5700 1 --2- 172.21.15.79:0/4208686886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde7c1c7e40 0x7fde7c1ca2a0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7fde74002f30 tx=0x7fde7400bda0).ready entity=mon.0 client_cookie=3aa1193b627b7d23 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:15.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.587 7fde795a2700 1 -- 172.21.15.79:0/4208686886 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fde7c0e56b0 con 0x7fde7c1c7e40 2021-04-09T18:35:15.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.587 7fde795a2700 1 -- 172.21.15.79:0/4208686886 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde740099d0 con 0x7fde7c1c7e40 2021-04-09T18:35:15.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.587 7fde795a2700 1 -- 172.21.15.79:0/4208686886 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fde74009da0 con 0x7fde7c1c7e40 2021-04-09T18:35:15.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.587 7fde80a2e700 1 -- 172.21.15.79:0/4208686886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde7c1c7e40 msgr2=0x7fde7c1ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:15.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.587 7fde80a2e700 1 --2- 172.21.15.79:0/4208686886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde7c1c7e40 0x7fde7c1ca2a0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7fde74002f30 tx=0x7fde7400bda0).stop 2021-04-09T18:35:15.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.587 7fde80a2e700 1 -- 172.21.15.79:0/4208686886 shutdown_connections 2021-04-09T18:35:15.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.587 7fde80a2e700 1 --2- 172.21.15.79:0/4208686886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde7c1c7e40 0x7fde7c1ca2a0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.587 7fde80a2e700 1 --2- 172.21.15.79:0/4208686886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde7c0e9b40 0x7fde7c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.587 7fde80a2e700 1 -- 172.21.15.79:0/4208686886 >> 172.21.15.79:0/4208686886 conn(0x7fde7c0e6040 msgr2=0x7fde7c0e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:15.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.587 7fde80a2e700 1 -- 172.21.15.79:0/4208686886 shutdown_connections 2021-04-09T18:35:15.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.587 7fde80a2e700 1 -- 172.21.15.79:0/4208686886 wait complete. 2021-04-09T18:35:15.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde80a2e700 1 Processor -- start 2021-04-09T18:35:15.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde80a2e700 1 -- start start 2021-04-09T18:35:15.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde80a2e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde7c0c4c50 0x7fde7c0b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:15.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde80a2e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde7c1b0af0 0x7fde7c0ba7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:15.608 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde80a2e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde7c1b0f40 0x7fde7c0a2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:15.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde80a2e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0ba4e0 con 0x7fde7c1b0af0 2021-04-09T18:35:15.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde80a2e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0ba090 con 0x7fde7c1b0f40 2021-04-09T18:35:15.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde80a2e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0bae10 con 0x7fde7c0c4c50 2021-04-09T18:35:15.609 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde79da3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde7c1b0af0 0x7fde7c0ba7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:15.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde79da3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde7c1b0af0 0x7fde7c0ba7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34944/0 (socket says 172.21.15.79:34944) 2021-04-09T18:35:15.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde79da3700 1 -- 172.21.15.79:0/482762534 learned_addr learned my addr 172.21.15.79:0/482762534 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:15.610 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde7ada5700 1 --2- 172.21.15.79:0/482762534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde7c1b0f40 0x7fde7c0a2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:15.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde7a5a4700 1 --2- 172.21.15.79:0/482762534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde7c0c4c50 0x7fde7c0b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:15.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde79da3700 1 -- 172.21.15.79:0/482762534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde7c0c4c50 msgr2=0x7fde7c0b91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:15.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde79da3700 1 --2- 172.21.15.79:0/482762534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde7c0c4c50 0x7fde7c0b91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde79da3700 1 -- 172.21.15.79:0/482762534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde7c1b0f40 msgr2=0x7fde7c0a2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:15.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde79da3700 1 --2- 172.21.15.79:0/482762534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde7c1b0f40 0x7fde7c0a2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde79da3700 1 -- 172.21.15.79:0/482762534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c0bb040 con 0x7fde7c1b0af0 2021-04-09T18:35:15.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde7a5a4700 1 --2- 172.21.15.79:0/482762534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde7c0c4c50 0x7fde7c0b91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:15.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde79da3700 1 --2- 172.21.15.79:0/482762534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde7c1b0af0 0x7fde7c0ba7e0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7fde6c00c000 tx=0x7fde6c00c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:15.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde72ffd700 1 -- 172.21.15.79:0/482762534 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fde7c0bb040 con 0x7fde7c1b0af0 2021-04-09T18:35:15.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde72ffd700 1 -- 172.21.15.79:0/482762534 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6c00cca0 con 0x7fde7c1b0af0 2021-04-09T18:35:15.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde80a2e700 1 -- 172.21.15.79:0/482762534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7c0a3500 con 0x7fde7c1b0af0 2021-04-09T18:35:15.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde72ffd700 1 -- 172.21.15.79:0/482762534 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fde6c00f040 con 0x7fde7c1b0af0 2021-04-09T18:35:15.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.591 7fde80a2e700 1 -- 172.21.15.79:0/482762534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7c0a3a30 con 0x7fde7c1b0af0 2021-04-09T18:35:15.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.595 7fde72ffd700 1 -- 172.21.15.79:0/482762534 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fde6c022060 con 0x7fde7c1b0af0 2021-04-09T18:35:15.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.595 7fde72ffd700 1 --2- 172.21.15.79:0/482762534 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fde54029100 0x7fde5402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:15.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.595 7fde72ffd700 1 -- 172.21.15.79:0/482762534 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fde6c010040 con 0x7fde7c1b0af0 2021-04-09T18:35:15.615 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.595 7fde7a5a4700 1 --2- 172.21.15.79:0/482762534 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fde54029100 0x7fde5402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:15.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.595 7fde7a5a4700 1 --2- 172.21.15.79:0/482762534 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fde54029100 0x7fde5402b650 crc :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:15.616 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.599 7fde80a2e700 1 -- 172.21.15.79:0/482762534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7c088d30 con 0x7fde7c1b0af0 2021-04-09T18:35:15.617 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.607 7fde72ffd700 1 -- 172.21.15.79:0/482762534 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fde6c00ca90 con 0x7fde7c1b0af0 2021-04-09T18:35:15.779 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.775 7fde80a2e700 1 -- 172.21.15.79:0/482762534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fde7c0e39a0 con 0x7fde7c1b0af0 2021-04-09T18:35:15.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.779 7fde72ffd700 1 -- 172.21.15.79:0/482762534 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v38) v1 ==== 184+0+0 (secure 0 0 0) 0x7fde6c000f70 con 0x7fde7c1b0af0 2021-04-09T18:35:15.786 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.2 2021-04-09T18:35:15.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.783 7fde80a2e700 1 -- 172.21.15.79:0/482762534 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fde54029100 msgr2=0x7fde5402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:15.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.783 7fde80a2e700 1 --2- 172.21.15.79:0/482762534 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fde54029100 0x7fde5402b650 crc :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.783 7fde80a2e700 1 -- 172.21.15.79:0/482762534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde7c1b0af0 msgr2=0x7fde7c0ba7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:15.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.783 7fde80a2e700 1 --2- 172.21.15.79:0/482762534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde7c1b0af0 0x7fde7c0ba7e0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7fde6c00c000 tx=0x7fde6c00c430).stop 2021-04-09T18:35:15.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.783 7fde80a2e700 1 -- 172.21.15.79:0/482762534 shutdown_connections 2021-04-09T18:35:15.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.783 7fde80a2e700 1 --2- 172.21.15.79:0/482762534 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fde54029100 0x7fde5402b650 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.783 7fde80a2e700 1 --2- 172.21.15.79:0/482762534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde7c1b0f40 0x7fde7c0a2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.792 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.783 7fde80a2e700 1 --2- 172.21.15.79:0/482762534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde7c0c4c50 0x7fde7c0b91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.783 7fde80a2e700 1 --2- 172.21.15.79:0/482762534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde7c1b0af0 0x7fde7c0ba7e0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.783 7fde80a2e700 1 -- 172.21.15.79:0/482762534 >> 172.21.15.79:0/482762534 conn(0x7fde7c0d8510 msgr2=0x7fde7c0d7270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:15.793 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.783 7fde80a2e700 1 -- 172.21.15.79:0/482762534 shutdown_connections 2021-04-09T18:35:15.794 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.783 7fde80a2e700 1 -- 172.21.15.79:0/482762534 wait complete. 2021-04-09T18:35:15.801 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:35:15.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.887 7fd91b427700 1 Processor -- start 2021-04-09T18:35:15.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.887 7fd91b427700 1 -- start start 2021-04-09T18:35:15.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd91b427700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9141c9010 0x7fd9141cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:15.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd91b427700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9140fbb10 con 0x7fd9140f5510 2021-04-09T18:35:15.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd91b427700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91409f900 con 0x7fd9140e9ad0 2021-04-09T18:35:15.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd91b427700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9141c3db0 con 0x7fd9141c9010 2021-04-09T18:35:15.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd9191cb700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd9140f5510 0x7fd9140f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57892/0 (socket says 172.21.15.79:57892) 2021-04-09T18:35:15.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd9191cb700 1 -- 172.21.15.79:0/2670912049 learned_addr learned my addr 172.21.15.79:0/2670912049 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:15.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd9199cc700 1 --2- 172.21.15.79:0/2670912049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9141c9010 0x7fd9141cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:15.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd90bfff700 1 -- 172.21.15.79:0/2670912049 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751443719 0 0) 0x7fd9100010d0 con 0x7fd9140f5510 2021-04-09T18:35:15.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd90bfff700 1 -- 172.21.15.79:0/2670912049 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd900003240 con 0x7fd9140f5510 2021-04-09T18:35:15.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd90bfff700 1 -- 172.21.15.79:0/2670912049 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491471622 0 0) 0x7fd9040010d0 con 0x7fd9140e9ad0 2021-04-09T18:35:15.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd90bfff700 1 -- 172.21.15.79:0/2670912049 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd900003620 con 0x7fd9140e9ad0 2021-04-09T18:35:15.912 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd90bfff700 1 -- 172.21.15.79:0/2670912049 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2058827768 0 0) 0x7fd910001650 con 0x7fd9140f5510 2021-04-09T18:35:15.912 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd90bfff700 1 -- 172.21.15.79:0/2670912049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9141c9010 msgr2=0x7fd9141cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:15.912 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd90bfff700 1 --2- 172.21.15.79:0/2670912049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9141c9010 0x7fd9141cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.913 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd90bfff700 1 -- 172.21.15.79:0/2670912049 >> v1:172.21.15.89:6789/0 conn(0x7fd9140e9ad0 legacy=0x7fd91409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:15.913 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd90bfff700 1 -- 172.21.15.79:0/2670912049 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9140e56c0 con 0x7fd9140f5510 2021-04-09T18:35:15.913 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd90bfff700 1 -- 172.21.15.79:0/2670912049 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7fd910001bb0 con 0x7fd9140f5510 2021-04-09T18:35:15.913 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd90bfff700 1 -- 172.21.15.79:0/2670912049 >> v1:172.21.15.79:6789/0 conn(0x7fd9140f5510 legacy=0x7fd9140f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:15.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd90bfff700 1 --2- 172.21.15.79:0/2670912049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd900003d40 0x7fd9000045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:15.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd90bfff700 1 --2- 172.21.15.79:0/2670912049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd900004bd0 0x7fd9000097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:15.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd90bfff700 1 --2- 172.21.15.79:0/2670912049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd900005020 0x7fd90000be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:15.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd90bfff700 1 -- 172.21.15.79:0/2670912049 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9141c3db0 con 0x7fd900005020 2021-04-09T18:35:15.914 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd90bfff700 1 -- 172.21.15.79:0/2670912049 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd900050460 con 0x7fd900003d40 2021-04-09T18:35:15.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd90bfff700 1 -- 172.21.15.79:0/2670912049 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd900050610 con 0x7fd900004bd0 2021-04-09T18:35:15.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd9199cc700 1 --2- 172.21.15.79:0/2670912049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd900005020 0x7fd90000be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:15.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd9191cb700 1 --2- 172.21.15.79:0/2670912049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd900003d40 0x7fd9000045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:15.915 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd9189ca700 1 --2- 172.21.15.79:0/2670912049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd900004bd0 0x7fd9000097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:15.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd9199cc700 1 -- 172.21.15.79:0/2670912049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd900004bd0 msgr2=0x7fd9000097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:15.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd9199cc700 1 --2- 172.21.15.79:0/2670912049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd900004bd0 0x7fd9000097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd9199cc700 1 -- 172.21.15.79:0/2670912049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd900003d40 msgr2=0x7fd9000045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:15.916 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd9199cc700 1 --2- 172.21.15.79:0/2670912049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd900003d40 0x7fd9000045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd9199cc700 1 -- 172.21.15.79:0/2670912049 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd900050880 con 0x7fd900005020 2021-04-09T18:35:15.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd9191cb700 1 --2- 172.21.15.79:0/2670912049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd900003d40 0x7fd9000045a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:15.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd9199cc700 1 --2- 172.21.15.79:0/2670912049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd900005020 0x7fd90000be20 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7fd90c00c000 tx=0x7fd90c00e4b0).ready entity=mon.0 client_cookie=e9823d1424eaa570 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:15.917 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd90bfff700 1 -- 172.21.15.79:0/2670912049 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd900050880 con 0x7fd900005020 2021-04-09T18:35:15.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd90bfff700 1 -- 172.21.15.79:0/2670912049 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c00eda0 con 0x7fd900005020 2021-04-09T18:35:15.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd90bfff700 1 -- 172.21.15.79:0/2670912049 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd90c00f040 con 0x7fd900005020 2021-04-09T18:35:15.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd91b427700 1 -- 172.21.15.79:0/2670912049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd900005020 msgr2=0x7fd90000be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:15.918 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd91b427700 1 --2- 172.21.15.79:0/2670912049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd900005020 0x7fd90000be20 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7fd90c00c000 tx=0x7fd90c00e4b0).stop 2021-04-09T18:35:15.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.891 7fd9199cc700 1 -- 172.21.15.79:0/2670912049 reap_dead start 2021-04-09T18:35:15.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.895 7fd91b427700 1 -- 172.21.15.79:0/2670912049 shutdown_connections 2021-04-09T18:35:15.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.895 7fd91b427700 1 -- 172.21.15.79:0/2670912049 >> 172.21.15.79:0/2670912049 conn(0x7fd9140e5fd0 msgr2=0x7fd9140e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:15.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.895 7fd91b427700 1 -- 172.21.15.79:0/2670912049 shutdown_connections 2021-04-09T18:35:15.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.895 7fd91b427700 1 -- 172.21.15.79:0/2670912049 wait complete. 2021-04-09T18:35:15.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd91b427700 1 Processor -- start 2021-04-09T18:35:15.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd91b427700 1 -- start start 2021-04-09T18:35:15.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd91b427700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd91409a1b0 0x7fd9140d6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:15.923 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd91b427700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9140d5160 0x7fd9140d55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd91b427700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9140aee70 0x7fd9140af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd91b427700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9140e9f20 con 0x7fd9140d5160 2021-04-09T18:35:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd91b427700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91409b100 con 0x7fd91409a1b0 2021-04-09T18:35:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd91b427700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91409a600 con 0x7fd9140aee70 2021-04-09T18:35:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd9189ca700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9140d5160 0x7fd9140d55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd9189ca700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9140d5160 0x7fd9140d55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34962/0 (socket says 172.21.15.79:34962) 2021-04-09T18:35:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd9189ca700 1 -- 172.21.15.79:0/975963580 learned_addr learned my addr 172.21.15.79:0/975963580 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd9199cc700 1 --2- 172.21.15.79:0/975963580 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9140aee70 0x7fd9140af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd9191cb700 1 --2- 172.21.15.79:0/975963580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd91409a1b0 0x7fd9140d6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd9189ca700 1 -- 172.21.15.79:0/975963580 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9140aee70 msgr2=0x7fd9140af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd9189ca700 1 --2- 172.21.15.79:0/975963580 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9140aee70 0x7fd9140af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd9189ca700 1 -- 172.21.15.79:0/975963580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd91409a1b0 msgr2=0x7fd9140d6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd9189ca700 1 --2- 172.21.15.79:0/975963580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd91409a1b0 0x7fd9140d6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd9189ca700 1 -- 172.21.15.79:0/975963580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91409a990 con 0x7fd9140d5160 2021-04-09T18:35:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd9189ca700 1 --2- 172.21.15.79:0/975963580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9140d5160 0x7fd9140d55b0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7fd91409b080 tx=0x7fd90400fd50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd909ffb700 1 -- 172.21.15.79:0/975963580 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd91409a990 con 0x7fd9140d5160 2021-04-09T18:35:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd909ffb700 1 -- 172.21.15.79:0/975963580 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90400d9a0 con 0x7fd9140d5160 2021-04-09T18:35:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd909ffb700 1 -- 172.21.15.79:0/975963580 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd904010040 con 0x7fd9140d5160 2021-04-09T18:35:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd91b427700 1 -- 172.21.15.79:0/975963580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91409b400 con 0x7fd9140d5160 2021-04-09T18:35:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd91b427700 1 -- 172.21.15.79:0/975963580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9140d6890 con 0x7fd9140d5160 2021-04-09T18:35:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.899 7fd909ffb700 1 -- 172.21.15.79:0/975963580 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd904012070 con 0x7fd9140d5160 2021-04-09T18:35:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.903 7fd909ffb700 1 --2- 172.21.15.79:0/975963580 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd8f4029100 0x7fd8f402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.903 7fd909ffb700 1 -- 172.21.15.79:0/975963580 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fd904011040 con 0x7fd9140d5160 2021-04-09T18:35:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.903 7fd9191cb700 1 --2- 172.21.15.79:0/975963580 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd8f4029100 0x7fd8f402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.903 7fd91b427700 1 -- 172.21.15.79:0/975963580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9140e39d0 con 0x7fd9140d5160 2021-04-09T18:35:15.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.903 7fd9191cb700 1 --2- 172.21.15.79:0/975963580 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd8f4029100 0x7fd8f402b650 crc :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:15.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:15.907 7fd909ffb700 1 -- 172.21.15.79:0/975963580 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd90400d5a0 con 0x7fd9140d5160 2021-04-09T18:35:16.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.071 7fd91b427700 1 -- 172.21.15.79:0/975963580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9140a1cb0 con 0x7fd9140d5160 2021-04-09T18:35:16.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.071 7fd909ffb700 1 -- 172.21.15.79:0/975963580 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+2105 (secure 0 0 0) 0x7fd9140e5c90 con 0x7fd9140d5160 2021-04-09T18:35:16.080 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 79 2021-04-09T18:35:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:16.081 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":79,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7842,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1552365531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1552365531},{"type":"v1","addr":"172.21.15.89:6835","nonce":1552365531}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":77}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:35:13.180244","modified":"2021-04-09 18:35:15.198467","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7833},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7833":{"gid":7833,"name":"a","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/4102869700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4102869700},{"type":"v1","addr":"172.21.15.79:6833","nonce":4102869700}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-04-09T18:35:16.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.075 7fd91b427700 1 -- 172.21.15.79:0/975963580 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd8f4029100 msgr2=0x7fd8f402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:16.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.075 7fd91b427700 1 --2- 172.21.15.79:0/975963580 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd8f4029100 0x7fd8f402b650 crc :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:16.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.075 7fd91b427700 1 -- 172.21.15.79:0/975963580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9140d5160 msgr2=0x7fd9140d55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:16.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.075 7fd91b427700 1 --2- 172.21.15.79:0/975963580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9140d5160 0x7fd9140d55b0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7fd91409b080 tx=0x7fd90400fd50).stop 2021-04-09T18:35:16.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.075 7fd91b427700 1 -- 172.21.15.79:0/975963580 shutdown_connections 2021-04-09T18:35:16.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.075 7fd91b427700 1 --2- 172.21.15.79:0/975963580 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd8f4029100 0x7fd8f402b650 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:16.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.075 7fd91b427700 1 --2- 172.21.15.79:0/975963580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd91409a1b0 0x7fd9140d6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:16.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.075 7fd91b427700 1 --2- 172.21.15.79:0/975963580 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9140aee70 0x7fd9140af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:16.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.075 7fd91b427700 1 --2- 172.21.15.79:0/975963580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9140d5160 0x7fd9140d55b0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:16.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.075 7fd91b427700 1 -- 172.21.15.79:0/975963580 >> 172.21.15.79:0/975963580 conn(0x7fd9140978b0 msgr2=0x7fd9140baad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:16.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.075 7fd91b427700 1 -- 172.21.15.79:0/975963580 shutdown_connections 2021-04-09T18:35:16.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.075 7fd91b427700 1 -- 172.21.15.79:0/975963580 wait complete. 2021-04-09T18:35:16.293 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 79, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:35:13.180244', 'modified': '2021-04-09 18:35:15.198467', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7833}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7833': {'gid': 7833, 'name': 'a', 'rank': 0, 'incarnation': 78, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6833/4102869700', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 4102869700}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 4102869700}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:35:16.293 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:35:16.294 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2021-04-09T18:35:16.396 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:35:16.396 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:35:16.397 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2021-04-09T18:35:16.397 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 7833, 2021-04-09T18:35:16.398 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2021-04-09T18:35:16.398 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2021-04-09T18:35:16.399 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 2.193975322, 2021-04-09T18:35:16.399 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 79, 2021-04-09T18:35:16.399 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 126, 2021-04-09T18:35:16.400 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 126, 2021-04-09T18:35:16.400 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 6.8668538359999998 2021-04-09T18:35:16.401 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:35:16.403 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 7833, "want_state": "up:active", "state": "up:active", "rank_uptime": 2.193975322, "mdsmap_epoch": 79, "osdmap_epoch": 126, "osdmap_epoch_barrier": 126, "uptime": 6.8668538359999998 } 2021-04-09T18:35:16.404 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:35:16.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd8797700 1 Processor -- start 2021-04-09T18:35:16.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd8797700 1 -- start start 2021-04-09T18:35:16.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd8797700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fddd00f5520 0x7fddd00f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:16.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd8797700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddd01c8010 0x7fddd01ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:16.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd8797700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd00fbb20 con 0x7fddd00e9ae0 2021-04-09T18:35:16.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd8797700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd00e9f30 con 0x7fddd00f5520 2021-04-09T18:35:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd8797700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd01c3dc0 con 0x7fddd01c8010 2021-04-09T18:35:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5d3a700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fddd00e9ae0 0x7fddd009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57912/0 (socket says 172.21.15.79:57912) 2021-04-09T18:35:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5d3a700 1 -- 172.21.15.79:0/2330057470 learned_addr learned my addr 172.21.15.79:0/2330057470 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd653b700 1 --2- 172.21.15.79:0/2330057470 >> v2:172.21.15.89:3300/0 conn(0x7fddd00f5520 0x7fddd00f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd6d3c700 1 --2- 172.21.15.79:0/2330057470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddd01c8010 0x7fddd01ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:16.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5539700 1 -- 172.21.15.79:0/2330057470 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627611014 0 0) 0x7fddc00010d0 con 0x7fddd00e9ae0 2021-04-09T18:35:16.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5539700 1 -- 172.21.15.79:0/2330057470 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddbc003240 con 0x7fddd00e9ae0 2021-04-09T18:35:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5539700 1 -- 172.21.15.79:0/2330057470 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3525097227 0 0) 0x7fddc0001650 con 0x7fddd00e9ae0 2021-04-09T18:35:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5539700 1 -- 172.21.15.79:0/2330057470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddd01c8010 msgr2=0x7fddd01ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:16.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5539700 1 --2- 172.21.15.79:0/2330057470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddd01c8010 0x7fddd01ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:16.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5539700 1 -- 172.21.15.79:0/2330057470 >> v2:172.21.15.89:3300/0 conn(0x7fddd00f5520 msgr2=0x7fddd00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:16.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5539700 1 --2- 172.21.15.79:0/2330057470 >> v2:172.21.15.89:3300/0 conn(0x7fddd00f5520 0x7fddd00f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:16.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5539700 1 -- 172.21.15.79:0/2330057470 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd009f910 con 0x7fddd00e9ae0 2021-04-09T18:35:16.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5539700 1 -- 172.21.15.79:0/2330057470 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7fddc0001bb0 con 0x7fddd00e9ae0 2021-04-09T18:35:16.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd653b700 1 --2- 172.21.15.79:0/2330057470 >> v2:172.21.15.89:3300/0 conn(0x7fddd00f5520 0x7fddd00f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:16.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5539700 1 -- 172.21.15.79:0/2330057470 >> v1:172.21.15.79:6789/0 conn(0x7fddd00e9ae0 legacy=0x7fddd009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:16.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5539700 1 --2- 172.21.15.79:0/2330057470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddbc0038f0 0x7fddbc003d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:16.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5539700 1 --2- 172.21.15.79:0/2330057470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddbc0045a0 0x7fddbc0049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:16.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5539700 1 --2- 172.21.15.79:0/2330057470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddbc005070 0x7fddbc04f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:16.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5539700 1 -- 172.21.15.79:0/2330057470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00e9f30 con 0x7fddbc0045a0 2021-04-09T18:35:16.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5539700 1 -- 172.21.15.79:0/2330057470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd01c3dc0 con 0x7fddbc005070 2021-04-09T18:35:16.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5539700 1 -- 172.21.15.79:0/2330057470 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc04ffa0 con 0x7fddbc0038f0 2021-04-09T18:35:16.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5d3a700 1 --2- 172.21.15.79:0/2330057470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddbc0045a0 0x7fddbc0049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:16.519 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd653b700 1 --2- 172.21.15.79:0/2330057470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddbc0038f0 0x7fddbc003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:16.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd6d3c700 1 --2- 172.21.15.79:0/2330057470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddbc005070 0x7fddbc04f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:16.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5d3a700 1 -- 172.21.15.79:0/2330057470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddbc0038f0 msgr2=0x7fddbc003d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:16.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5d3a700 1 --2- 172.21.15.79:0/2330057470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddbc0038f0 0x7fddbc003d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:16.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5d3a700 1 -- 172.21.15.79:0/2330057470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddbc005070 msgr2=0x7fddbc04f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:16.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5d3a700 1 --2- 172.21.15.79:0/2330057470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddbc005070 0x7fddbc04f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:16.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5d3a700 1 -- 172.21.15.79:0/2330057470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc050290 con 0x7fddbc0045a0 2021-04-09T18:35:16.522 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5d3a700 1 --2- 172.21.15.79:0/2330057470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddbc0045a0 0x7fddbc0049f0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7fddc0004640 tx=0x7fddc0005050).ready entity=mon.0 client_cookie=30de5318e4ca85a7 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:16.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5539700 1 -- 172.21.15.79:0/2330057470 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fddbc050290 con 0x7fddbc0045a0 2021-04-09T18:35:16.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5539700 1 -- 172.21.15.79:0/2330057470 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc0008170 con 0x7fddbc0045a0 2021-04-09T18:35:16.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd5539700 1 -- 172.21.15.79:0/2330057470 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fddd009f910 con 0x7fddbc0045a0 2021-04-09T18:35:16.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd8797700 1 -- 172.21.15.79:0/2330057470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddbc0045a0 msgr2=0x7fddbc0049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:16.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd8797700 1 --2- 172.21.15.79:0/2330057470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddbc0045a0 0x7fddbc0049f0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7fddc0004640 tx=0x7fddc0005050).stop 2021-04-09T18:35:16.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.495 7fddd6d3c700 1 -- 172.21.15.79:0/2330057470 reap_dead start 2021-04-09T18:35:16.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.499 7fddd8797700 1 -- 172.21.15.79:0/2330057470 shutdown_connections 2021-04-09T18:35:16.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.499 7fddd8797700 1 -- 172.21.15.79:0/2330057470 >> 172.21.15.79:0/2330057470 conn(0x7fddd00e5fe0 msgr2=0x7fddd00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:16.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.499 7fddd8797700 1 -- 172.21.15.79:0/2330057470 shutdown_connections 2021-04-09T18:35:16.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.499 7fddd8797700 1 -- 172.21.15.79:0/2330057470 wait complete. 2021-04-09T18:35:16.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd8797700 1 Processor -- start 2021-04-09T18:35:16.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd8797700 1 -- start start 2021-04-09T18:35:16.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd8797700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddd00d8af0 0x7fddd019d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:16.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd8797700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddd00c3720 0x7fddd00d5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:16.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd8797700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddd00c3b70 0x7fddd01abca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:16.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd8797700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00d7270 con 0x7fddd00c3b70 2021-04-09T18:35:16.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd8797700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00d8f40 con 0x7fddd00d8af0 2021-04-09T18:35:16.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd8797700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00d7570 con 0x7fddd00c3720 2021-04-09T18:35:16.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd6d3c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddd00c3b70 0x7fddd01abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:16.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd6d3c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddd00c3b70 0x7fddd01abca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34984/0 (socket says 172.21.15.79:34984) 2021-04-09T18:35:16.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd6d3c700 1 -- 172.21.15.79:0/135413272 learned_addr learned my addr 172.21.15.79:0/135413272 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:16.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd653b700 1 --2- 172.21.15.79:0/135413272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddd00d8af0 0x7fddd019d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:16.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd5d3a700 1 --2- 172.21.15.79:0/135413272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddd00c3720 0x7fddd00d5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:16.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd6d3c700 1 -- 172.21.15.79:0/135413272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddd00c3720 msgr2=0x7fddd00d5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:16.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd6d3c700 1 --2- 172.21.15.79:0/135413272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddd00c3720 0x7fddd00d5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:16.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd6d3c700 1 -- 172.21.15.79:0/135413272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddd00d8af0 msgr2=0x7fddd019d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:16.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd6d3c700 1 --2- 172.21.15.79:0/135413272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddd00d8af0 0x7fddd019d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:16.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd6d3c700 1 -- 172.21.15.79:0/135413272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd00c41b0 con 0x7fddd00c3b70 2021-04-09T18:35:16.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd6d3c700 1 --2- 172.21.15.79:0/135413272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddd00c3b70 0x7fddd01abca0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7fddd00d70e0 tx=0x7fddc800a040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:16.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddc6ffd700 1 -- 172.21.15.79:0/135413272 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fddd00c41b0 con 0x7fddd00c3b70 2021-04-09T18:35:16.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddc6ffd700 1 -- 172.21.15.79:0/135413272 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc800f810 con 0x7fddd00c3b70 2021-04-09T18:35:16.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd8797700 1 -- 172.21.15.79:0/135413272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd00d5680 con 0x7fddd00c3b70 2021-04-09T18:35:16.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddc6ffd700 1 -- 172.21.15.79:0/135413272 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fddc800f040 con 0x7fddd00c3b70 2021-04-09T18:35:16.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.503 7fddd8797700 1 -- 172.21.15.79:0/135413272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd01ac2d0 con 0x7fddd00c3b70 2021-04-09T18:35:16.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.507 7fddc6ffd700 1 -- 172.21.15.79:0/135413272 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fddc8024060 con 0x7fddd00c3b70 2021-04-09T18:35:16.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.507 7fddc6ffd700 1 --2- 172.21.15.79:0/135413272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fddb8029100 0x7fddb802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:16.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.507 7fddc6ffd700 1 -- 172.21.15.79:0/135413272 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fddc8010040 con 0x7fddd00c3b70 2021-04-09T18:35:16.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.507 7fddd653b700 1 --2- 172.21.15.79:0/135413272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fddb8029100 0x7fddb802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:16.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.507 7fddd653b700 1 --2- 172.21.15.79:0/135413272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fddb8029100 0x7fddb802b650 crc :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:16.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.507 7fddd8797700 1 -- 172.21.15.79:0/135413272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd00e39e0 con 0x7fddd00c3b70 2021-04-09T18:35:16.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.515 7fddc6ffd700 1 -- 172.21.15.79:0/135413272 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fddd00f76c0 con 0x7fddd00c3b70 2021-04-09T18:35:16.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.675 7fddd8797700 1 -- 172.21.15.79:0/135413272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fddd00a1cc0 con 0x7fddd00c3b70 2021-04-09T18:35:16.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.675 7fddc6ffd700 1 -- 172.21.15.79:0/135413272 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+14240 (secure 0 0 0) 0x7fddc800f600 con 0x7fddd00c3b70 2021-04-09T18:35:16.952 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:16.953 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":126,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:35:14.182279","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:35:11.346312","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2021-04-09 18:35:12.219337","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:35:16.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.679 7fddd8797700 1 -- 172.21.15.79:0/135413272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fddb8029100 msgr2=0x7fddb802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:16.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.679 7fddd8797700 1 --2- 172.21.15.79:0/135413272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fddb8029100 0x7fddb802b650 crc :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:16.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.679 7fddd8797700 1 -- 172.21.15.79:0/135413272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddd00c3b70 msgr2=0x7fddd01abca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:16.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.679 7fddd8797700 1 --2- 172.21.15.79:0/135413272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddd00c3b70 0x7fddd01abca0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7fddd00d70e0 tx=0x7fddc800a040).stop 2021-04-09T18:35:16.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.679 7fddd8797700 1 -- 172.21.15.79:0/135413272 shutdown_connections 2021-04-09T18:35:16.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.679 7fddd8797700 1 --2- 172.21.15.79:0/135413272 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fddb8029100 0x7fddb802b650 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:16.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.679 7fddd8797700 1 --2- 172.21.15.79:0/135413272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddd00d8af0 0x7fddd019d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:16.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.679 7fddd8797700 1 --2- 172.21.15.79:0/135413272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddd00c3b70 0x7fddd01abca0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:16.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.679 7fddd8797700 1 --2- 172.21.15.79:0/135413272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fddd00c3720 0x7fddd00d5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:16.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.679 7fddd8797700 1 -- 172.21.15.79:0/135413272 >> 172.21.15.79:0/135413272 conn(0x7fddd0099260 msgr2=0x7fddd009a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:16.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.679 7fddd8797700 1 -- 172.21.15.79:0/135413272 shutdown_connections 2021-04-09T18:35:16.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:16.679 7fddd8797700 1 -- 172.21.15.79:0/135413272 wait complete. 2021-04-09T18:35:16.962 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:35:11.346312', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:35:12.219337', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:35:16.963 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:35:17.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.059 7f538c568700 1 Processor -- start 2021-04-09T18:35:17.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.059 7f538c568700 1 -- start start 2021-04-09T18:35:17.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.059 7f538c568700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f53840e9b10 0x7f538409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.059 7f538c568700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53840fbb50 con 0x7f53840f5550 2021-04-09T18:35:17.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.059 7f538c568700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53840e5700 con 0x7f53841c8040 2021-04-09T18:35:17.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.059 7f538c568700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53841c3df0 con 0x7f53840e9b10 2021-04-09T18:35:17.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.059 7f5389b0b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f53840e9b10 0x7f538409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.059 7f5389b0b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f53840e9b10 0x7f538409f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34992/0 (socket says 172.21.15.79:34992) 2021-04-09T18:35:17.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.059 7f538a30c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f53840f5550 0x7f53840f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57932/0 (socket says 172.21.15.79:57932) 2021-04-09T18:35:17.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.059 7f5389b0b700 1 -- 172.21.15.79:0/4200944493 learned_addr learned my addr 172.21.15.79:0/4200944493 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:17.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.059 7f5389b0b700 1 -- 172.21.15.79:0/4200944493 >> v1:172.21.15.89:6789/0 conn(0x7f53841c8040 legacy=0x7f53841ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.059 7f5389b0b700 1 -- 172.21.15.79:0/4200944493 >> v1:172.21.15.79:6789/0 conn(0x7f53840f5550 legacy=0x7f53840f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.059 7f538930a700 1 -- 172.21.15.79:0/4200944493 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167607842 0 0) 0x7f53740010d0 con 0x7f53840f5550 2021-04-09T18:35:17.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.059 7f5389b0b700 1 -- 172.21.15.79:0/4200944493 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53840e4360 con 0x7f53840e9b10 2021-04-09T18:35:17.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.063 7f5389b0b700 1 --2- 172.21.15.79:0/4200944493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53840e9b10 0x7f538409f110 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f5378002f30 tx=0x7f537800bd20).ready entity=mon.0 client_cookie=13e4119af4efbddc server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:17.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.063 7f538930a700 1 -- 172.21.15.79:0/4200944493 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f53840e4360 con 0x7f53840e9b10 2021-04-09T18:35:17.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.063 7f538930a700 1 -- 172.21.15.79:0/4200944493 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5378009a20 con 0x7f53840e9b10 2021-04-09T18:35:17.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.063 7f538930a700 1 -- 172.21.15.79:0/4200944493 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5378009df0 con 0x7f53840e9b10 2021-04-09T18:35:17.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.063 7f538c568700 1 -- 172.21.15.79:0/4200944493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53840e9b10 msgr2=0x7f538409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.063 7f538c568700 1 --2- 172.21.15.79:0/4200944493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53840e9b10 0x7f538409f110 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f5378002f30 tx=0x7f537800bd20).stop 2021-04-09T18:35:17.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.063 7f538c568700 1 -- 172.21.15.79:0/4200944493 shutdown_connections 2021-04-09T18:35:17.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.063 7f538c568700 1 --2- 172.21.15.79:0/4200944493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53840e9b10 0x7f538409f110 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.063 7f538c568700 1 -- 172.21.15.79:0/4200944493 >> 172.21.15.79:0/4200944493 conn(0x7f53840e6010 msgr2=0x7f53840e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:17.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.063 7f538c568700 1 -- 172.21.15.79:0/4200944493 shutdown_connections 2021-04-09T18:35:17.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.063 7f538c568700 1 -- 172.21.15.79:0/4200944493 wait complete. 2021-04-09T18:35:17.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538c568700 1 Processor -- start 2021-04-09T18:35:17.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538c568700 1 -- start start 2021-04-09T18:35:17.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538c568700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f538419d400 0x7f5384098db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538c568700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53840d52e0 0x7f53840a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538c568700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53840a2ac0 0x7f5384097ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538c568700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53840e9f60 con 0x7f538419d400 2021-04-09T18:35:17.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538c568700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538419bb60 con 0x7f53840a2ac0 2021-04-09T18:35:17.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538c568700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53840a7a50 con 0x7f53840d52e0 2021-04-09T18:35:17.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538a30c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f538419d400 0x7f5384098db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538a30c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f538419d400 0x7f5384098db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34996/0 (socket says 172.21.15.79:34996) 2021-04-09T18:35:17.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538a30c700 1 -- 172.21.15.79:0/1766596673 learned_addr learned my addr 172.21.15.79:0/1766596673 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:17.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f5389b0b700 1 --2- 172.21.15.79:0/1766596673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53840d52e0 0x7f53840a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538ab0d700 1 --2- 172.21.15.79:0/1766596673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53840a2ac0 0x7f5384097ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538a30c700 1 -- 172.21.15.79:0/1766596673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53840d52e0 msgr2=0x7f53840a2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538a30c700 1 --2- 172.21.15.79:0/1766596673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53840d52e0 0x7f53840a2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538a30c700 1 -- 172.21.15.79:0/1766596673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53840a2ac0 msgr2=0x7f5384097ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538a30c700 1 --2- 172.21.15.79:0/1766596673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53840a2ac0 0x7f5384097ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538a30c700 1 -- 172.21.15.79:0/1766596673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53840993e0 con 0x7f538419d400 2021-04-09T18:35:17.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f5389b0b700 1 --2- 172.21.15.79:0/1766596673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53840d52e0 0x7f53840a2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:35:17.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538ab0d700 1 --2- 172.21.15.79:0/1766596673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53840a2ac0 0x7f5384097ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:35:17.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538a30c700 1 --2- 172.21.15.79:0/1766596673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f538419d400 0x7f5384098db0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f53840d8250 tx=0x7f537400cb30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:17.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f5382ffd700 1 -- 172.21.15.79:0/1766596673 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f53840993e0 con 0x7f538419d400 2021-04-09T18:35:17.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f5382ffd700 1 -- 172.21.15.79:0/1766596673 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5374007320 con 0x7f538419d400 2021-04-09T18:35:17.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538c568700 1 -- 172.21.15.79:0/1766596673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538419d850 con 0x7f538419d400 2021-04-09T18:35:17.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f5382ffd700 1 -- 172.21.15.79:0/1766596673 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5374005720 con 0x7f538419d400 2021-04-09T18:35:17.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.067 7f538c568700 1 -- 172.21.15.79:0/1766596673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53841ae610 con 0x7f538419d400 2021-04-09T18:35:17.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.071 7f5382ffd700 1 -- 172.21.15.79:0/1766596673 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f537401a020 con 0x7f538419d400 2021-04-09T18:35:17.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.071 7f5382ffd700 1 --2- 172.21.15.79:0/1766596673 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5364029100 0x7f536402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.071 7f5382ffd700 1 -- 172.21.15.79:0/1766596673 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f5374039300 con 0x7f538419d400 2021-04-09T18:35:17.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.071 7f5389b0b700 1 --2- 172.21.15.79:0/1766596673 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5364029100 0x7f536402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.071 7f5389b0b700 1 --2- 172.21.15.79:0/1766596673 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5364029100 0x7f536402b650 crc :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:17.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.075 7f538c568700 1 -- 172.21.15.79:0/1766596673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53840a3550 con 0x7f538419d400 2021-04-09T18:35:17.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.079 7f5382ffd700 1 -- 172.21.15.79:0/1766596673 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5374007110 con 0x7f538419d400 2021-04-09T18:35:17.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.239 7f538c568700 1 -- 172.21.15.79:0/1766596673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f53840e39f0 con 0x7f538419d400 2021-04-09T18:35:17.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.239 7f5382ffd700 1 -- 172.21.15.79:0/1766596673 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v126) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5374000bf0 con 0x7f538419d400 2021-04-09T18:35:17.245 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:35:17.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.239 7f538c568700 1 -- 172.21.15.79:0/1766596673 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5364029100 msgr2=0x7f536402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.239 7f538c568700 1 --2- 172.21.15.79:0/1766596673 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5364029100 0x7f536402b650 crc :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.239 7f538c568700 1 -- 172.21.15.79:0/1766596673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f538419d400 msgr2=0x7f5384098db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.239 7f538c568700 1 --2- 172.21.15.79:0/1766596673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f538419d400 0x7f5384098db0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f53840d8250 tx=0x7f537400cb30).stop 2021-04-09T18:35:17.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.243 7f538c568700 1 -- 172.21.15.79:0/1766596673 shutdown_connections 2021-04-09T18:35:17.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.243 7f538c568700 1 --2- 172.21.15.79:0/1766596673 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5364029100 0x7f536402b650 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.243 7f538c568700 1 --2- 172.21.15.79:0/1766596673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53840a2ac0 0x7f5384097ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.243 7f538c568700 1 --2- 172.21.15.79:0/1766596673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f538419d400 0x7f5384098db0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.243 7f538c568700 1 --2- 172.21.15.79:0/1766596673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53840d52e0 0x7f53840a2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.243 7f538c568700 1 -- 172.21.15.79:0/1766596673 >> 172.21.15.79:0/1766596673 conn(0x7f53840ba7b0 msgr2=0x7f5384095fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:17.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.243 7f538c568700 1 -- 172.21.15.79:0/1766596673 shutdown_connections 2021-04-09T18:35:17.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.243 7f538c568700 1 -- 172.21.15.79:0/1766596673 wait complete. 2021-04-09T18:35:17.263 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:35:17.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.347 7f27bb2e9700 1 Processor -- start 2021-04-09T18:35:17.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.347 7f27bb2e9700 1 -- start start 2021-04-09T18:35:17.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.347 7f27bb2e9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b40e9b10 0x7f27b409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.347 7f27bb2e9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f27b41c8040 0x7f27b41ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.347 7f27bb2e9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b40fbb50 con 0x7f27b40f5550 2021-04-09T18:35:17.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.347 7f27bb2e9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b41c3df0 con 0x7f27b41c8040 2021-04-09T18:35:17.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.347 7f27bb2e9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b40e9f60 con 0x7f27b40e9b10 2021-04-09T18:35:17.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27b888c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b40e9b10 0x7f27b409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27b988e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f27b41c8040 0x7f27b41ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27b988e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f27b41c8040 0x7f27b41ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:51582/0 (socket says 172.21.15.79:51582) 2021-04-09T18:35:17.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27b888c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b40e9b10 0x7f27b409f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:60232/0 (socket says 172.21.15.79:60232) 2021-04-09T18:35:17.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27b988e700 1 -- 172.21.15.79:0/3306266629 learned_addr learned my addr 172.21.15.79:0/3306266629 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:17.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27b908d700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f27b40f5550 0x7f27b40f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:58418/0 (socket says 172.21.15.79:58418) 2021-04-09T18:35:17.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27abfff700 1 -- 172.21.15.79:0/3306266629 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870225039 0 0) 0x7f27b0001450 con 0x7f27b40f5550 2021-04-09T18:35:17.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27abfff700 1 -- 172.21.15.79:0/3306266629 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27a0003240 con 0x7f27b40f5550 2021-04-09T18:35:17.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27b988e700 1 -- 172.21.15.79:0/3306266629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b40e9b10 msgr2=0x7f27b409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:17.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27b988e700 1 --2- 172.21.15.79:0/3306266629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b40e9b10 0x7f27b409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27b988e700 1 -- 172.21.15.79:0/3306266629 >> v1:172.21.15.89:6789/0 conn(0x7f27b40f5550 legacy=0x7f27b40f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27b988e700 1 -- 172.21.15.79:0/3306266629 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b40e5700 con 0x7f27b41c8040 2021-04-09T18:35:17.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27b888c700 1 --2- 172.21.15.79:0/3306266629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b40e9b10 0x7f27b409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:17.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27b988e700 1 --2- 172.21.15.79:0/3306266629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27b41c8040 0x7f27b41ca4a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f27ac002f30 tx=0x7f27ac00bda0).ready entity=mon.1 client_cookie=bdf347ef662529c3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:17.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27abfff700 1 -- 172.21.15.79:0/3306266629 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f27b40e5700 con 0x7f27b41c8040 2021-04-09T18:35:17.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27abfff700 1 -- 172.21.15.79:0/3306266629 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac0099d0 con 0x7f27b41c8040 2021-04-09T18:35:17.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27abfff700 1 -- 172.21.15.79:0/3306266629 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f27ac009da0 con 0x7f27b41c8040 2021-04-09T18:35:17.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27bb2e9700 1 -- 172.21.15.79:0/3306266629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27b41c8040 msgr2=0x7f27b41ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27bb2e9700 1 --2- 172.21.15.79:0/3306266629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27b41c8040 0x7f27b41ca4a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f27ac002f30 tx=0x7f27ac00bda0).stop 2021-04-09T18:35:17.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27bb2e9700 1 -- 172.21.15.79:0/3306266629 shutdown_connections 2021-04-09T18:35:17.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27bb2e9700 1 --2- 172.21.15.79:0/3306266629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27b41c8040 0x7f27b41ca4a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27bb2e9700 1 --2- 172.21.15.79:0/3306266629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b40e9b10 0x7f27b409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27bb2e9700 1 -- 172.21.15.79:0/3306266629 >> 172.21.15.79:0/3306266629 conn(0x7f27b40e6010 msgr2=0x7f27b40e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:17.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27bb2e9700 1 -- 172.21.15.79:0/3306266629 shutdown_connections 2021-04-09T18:35:17.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.351 7f27bb2e9700 1 -- 172.21.15.79:0/3306266629 wait complete. 2021-04-09T18:35:17.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27bb2e9700 1 Processor -- start 2021-04-09T18:35:17.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27bb2e9700 1 -- start start 2021-04-09T18:35:17.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27bb2e9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b40aebc0 0x7f27b40c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27bb2e9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27b40a68a0 0x7f27b41b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27bb2e9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27b40a6cf0 0x7f27b41b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27bb2e9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b4088590 con 0x7f27b40a6cf0 2021-04-09T18:35:17.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27bb2e9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b40c11e0 con 0x7f27b40a68a0 2021-04-09T18:35:17.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27bb2e9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b40c14e0 con 0x7f27b40aebc0 2021-04-09T18:35:17.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27b988e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27b40a6cf0 0x7f27b41b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27b988e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27b40a6cf0 0x7f27b41b17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35014/0 (socket says 172.21.15.79:35014) 2021-04-09T18:35:17.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27b988e700 1 -- 172.21.15.79:0/909220558 learned_addr learned my addr 172.21.15.79:0/909220558 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:17.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27b888c700 1 --2- 172.21.15.79:0/909220558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27b40a68a0 0x7f27b41b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27b908d700 1 --2- 172.21.15.79:0/909220558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b40aebc0 0x7f27b40c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27b988e700 1 -- 172.21.15.79:0/909220558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b40aebc0 msgr2=0x7f27b40c2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27b988e700 1 --2- 172.21.15.79:0/909220558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b40aebc0 0x7f27b40c2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27b988e700 1 -- 172.21.15.79:0/909220558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27b40a68a0 msgr2=0x7f27b41b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27b988e700 1 --2- 172.21.15.79:0/909220558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27b40a68a0 0x7f27b41b1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27b988e700 1 -- 172.21.15.79:0/909220558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b40abc90 con 0x7f27b40a6cf0 2021-04-09T18:35:17.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27b988e700 1 --2- 172.21.15.79:0/909220558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27b40a6cf0 0x7f27b41b17b0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f27b4099d40 tx=0x7f27ac006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:17.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27a9ffb700 1 -- 172.21.15.79:0/909220558 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f27b40abc90 con 0x7f27b40a6cf0 2021-04-09T18:35:17.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27a9ffb700 1 -- 172.21.15.79:0/909220558 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac011c60 con 0x7f27b40a6cf0 2021-04-09T18:35:17.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27a9ffb700 1 -- 172.21.15.79:0/909220558 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f27ac01d630 con 0x7f27b40a6cf0 2021-04-09T18:35:17.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27bb2e9700 1 -- 172.21.15.79:0/909220558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b41b1de0 con 0x7f27b40a6cf0 2021-04-09T18:35:17.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.355 7f27bb2e9700 1 -- 172.21.15.79:0/909220558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b41ad210 con 0x7f27b40a6cf0 2021-04-09T18:35:17.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.359 7f27a9ffb700 1 -- 172.21.15.79:0/909220558 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f27ac01d830 con 0x7f27b40a6cf0 2021-04-09T18:35:17.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.359 7f27a9ffb700 1 --2- 172.21.15.79:0/909220558 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2794029100 0x7f279402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.359 7f27a9ffb700 1 -- 172.21.15.79:0/909220558 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f27ac03af70 con 0x7f27b40a6cf0 2021-04-09T18:35:17.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.359 7f27b908d700 1 --2- 172.21.15.79:0/909220558 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2794029100 0x7f279402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.359 7f27b908d700 1 --2- 172.21.15.79:0/909220558 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2794029100 0x7f279402b650 crc :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:17.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.363 7f27bb2e9700 1 -- 172.21.15.79:0/909220558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b40e39f0 con 0x7f27b40a6cf0 2021-04-09T18:35:17.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.367 7f27a9ffb700 1 -- 172.21.15.79:0/909220558 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f27ac0573e0 con 0x7f27b40a6cf0 2021-04-09T18:35:17.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.523 7f27bb2e9700 1 -- 172.21.15.79:0/909220558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f27b40f5b50 con 0x7f27b40a6cf0 2021-04-09T18:35:17.529 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.523 7f27a9ffb700 1 -- 172.21.15.79:0/909220558 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v126) v1 ==== 104+0+10 (secure 0 0 0) 0x7f27ac0097c0 con 0x7f27b40a6cf0 2021-04-09T18:35:17.529 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:35:17.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.527 7f27bb2e9700 1 -- 172.21.15.79:0/909220558 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2794029100 msgr2=0x7f279402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.527 7f27bb2e9700 1 --2- 172.21.15.79:0/909220558 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2794029100 0x7f279402b650 crc :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.527 7f27bb2e9700 1 -- 172.21.15.79:0/909220558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27b40a6cf0 msgr2=0x7f27b41b17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.527 7f27bb2e9700 1 --2- 172.21.15.79:0/909220558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27b40a6cf0 0x7f27b41b17b0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f27b4099d40 tx=0x7f27ac006890).stop 2021-04-09T18:35:17.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.527 7f27bb2e9700 1 -- 172.21.15.79:0/909220558 shutdown_connections 2021-04-09T18:35:17.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.527 7f27bb2e9700 1 --2- 172.21.15.79:0/909220558 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2794029100 0x7f279402b650 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.527 7f27bb2e9700 1 --2- 172.21.15.79:0/909220558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27b40a6cf0 0x7f27b41b17b0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.527 7f27bb2e9700 1 --2- 172.21.15.79:0/909220558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27b40aebc0 0x7f27b40c2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.527 7f27bb2e9700 1 --2- 172.21.15.79:0/909220558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27b40a68a0 0x7f27b41b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.527 7f27bb2e9700 1 -- 172.21.15.79:0/909220558 >> 172.21.15.79:0/909220558 conn(0x7f27b4099580 msgr2=0x7f27b4095870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:17.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.527 7f27bb2e9700 1 -- 172.21.15.79:0/909220558 shutdown_connections 2021-04-09T18:35:17.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.527 7f27bb2e9700 1 -- 172.21.15.79:0/909220558 wait complete. 2021-04-09T18:35:17.541 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:35:17.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.627 7fba801ac700 1 Processor -- start 2021-04-09T18:35:17.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.627 7fba801ac700 1 -- start start 2021-04-09T18:35:17.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.627 7fba801ac700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fba780e9b10 0x7fba7809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.627 7fba801ac700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba781c8040 0x7fba781ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.627 7fba801ac700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba780fbb50 con 0x7fba780f5550 2021-04-09T18:35:17.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.627 7fba801ac700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba781c3df0 con 0x7fba780e9b10 2021-04-09T18:35:17.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.627 7fba801ac700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba780e9f60 con 0x7fba781c8040 2021-04-09T18:35:17.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.627 7fba7d74f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fba780e9b10 0x7fba7809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.627 7fba7df50700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fba780f5550 0x7fba780f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57960/0 (socket says 172.21.15.79:57960) 2021-04-09T18:35:17.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.627 7fba7df50700 1 -- 172.21.15.79:0/623676297 learned_addr learned my addr 172.21.15.79:0/623676297 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:17.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.627 7fba7e751700 1 --2- 172.21.15.79:0/623676297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba781c8040 0x7fba781ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.631 7fba7d74f700 1 -- 172.21.15.79:0/623676297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba781c8040 msgr2=0x7fba781ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:17.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.631 7fba7d74f700 1 --2- 172.21.15.79:0/623676297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba781c8040 0x7fba781ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.631 7fba7d74f700 1 -- 172.21.15.79:0/623676297 >> v1:172.21.15.79:6789/0 conn(0x7fba780f5550 legacy=0x7fba780f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.631 7fba7d74f700 1 -- 172.21.15.79:0/623676297 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba780e5700 con 0x7fba780e9b10 2021-04-09T18:35:17.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.631 7fba7e751700 1 --2- 172.21.15.79:0/623676297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba781c8040 0x7fba781ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:35:17.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.631 7fba7d74f700 1 --2- 172.21.15.79:0/623676297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba780e9b10 0x7fba7809f110 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7fba780f6f30 tx=0x7fba6000bd70).ready entity=mon.0 client_cookie=6c2cef42436da648 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:17.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.631 7fba7cf4e700 1 -- 172.21.15.79:0/623676297 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba780e5700 con 0x7fba780e9b10 2021-04-09T18:35:17.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.631 7fba7cf4e700 1 -- 172.21.15.79:0/623676297 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba60009810 con 0x7fba780e9b10 2021-04-09T18:35:17.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.631 7fba7cf4e700 1 -- 172.21.15.79:0/623676297 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba60009be0 con 0x7fba780e9b10 2021-04-09T18:35:17.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.631 7fba801ac700 1 -- 172.21.15.79:0/623676297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba780e9b10 msgr2=0x7fba7809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.631 7fba801ac700 1 --2- 172.21.15.79:0/623676297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba780e9b10 0x7fba7809f110 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7fba780f6f30 tx=0x7fba6000bd70).stop 2021-04-09T18:35:17.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.631 7fba801ac700 1 -- 172.21.15.79:0/623676297 shutdown_connections 2021-04-09T18:35:17.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.631 7fba801ac700 1 --2- 172.21.15.79:0/623676297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba781c8040 0x7fba781ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.631 7fba801ac700 1 --2- 172.21.15.79:0/623676297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba780e9b10 0x7fba7809f110 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.631 7fba801ac700 1 -- 172.21.15.79:0/623676297 >> 172.21.15.79:0/623676297 conn(0x7fba780e6010 msgr2=0x7fba780e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:17.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.631 7fba801ac700 1 -- 172.21.15.79:0/623676297 shutdown_connections 2021-04-09T18:35:17.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.631 7fba801ac700 1 -- 172.21.15.79:0/623676297 wait complete. 2021-04-09T18:35:17.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba801ac700 1 Processor -- start 2021-04-09T18:35:17.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba801ac700 1 -- start start 2021-04-09T18:35:17.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba801ac700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba780a6270 0x7fba780906d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba801ac700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba780babe0 0x7fba780a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba801ac700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba781a6520 0x7fba781a6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba801ac700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba780e5700 con 0x7fba780a6270 2021-04-09T18:35:17.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba801ac700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba780b9340 con 0x7fba781a6520 2021-04-09T18:35:17.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba801ac700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba780b9640 con 0x7fba780babe0 2021-04-09T18:35:17.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba7df50700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba780a6270 0x7fba780906d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba7df50700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba780a6270 0x7fba780906d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35024/0 (socket says 172.21.15.79:35024) 2021-04-09T18:35:17.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba7d74f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba780babe0 0x7fba780a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba7df50700 1 -- 172.21.15.79:0/3927489019 learned_addr learned my addr 172.21.15.79:0/3927489019 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:17.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba7e751700 1 --2- 172.21.15.79:0/3927489019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba781a6520 0x7fba781a6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba7df50700 1 -- 172.21.15.79:0/3927489019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba780babe0 msgr2=0x7fba780a58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba7df50700 1 --2- 172.21.15.79:0/3927489019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba780babe0 0x7fba780a58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba7df50700 1 -- 172.21.15.79:0/3927489019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba781a6520 msgr2=0x7fba781a6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba7df50700 1 --2- 172.21.15.79:0/3927489019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba781a6520 0x7fba781a6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba7df50700 1 -- 172.21.15.79:0/3927489019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba78092dd0 con 0x7fba780a6270 2021-04-09T18:35:17.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba7d74f700 1 --2- 172.21.15.79:0/3927489019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba780babe0 0x7fba780a58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:17.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba7df50700 1 --2- 172.21.15.79:0/3927489019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba780a6270 0x7fba780906d0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7fba70000b80 tx=0x7fba7000cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:17.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba767fc700 1 -- 172.21.15.79:0/3927489019 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba78092dd0 con 0x7fba780a6270 2021-04-09T18:35:17.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba767fc700 1 -- 172.21.15.79:0/3927489019 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba70007320 con 0x7fba780a6270 2021-04-09T18:35:17.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba801ac700 1 -- 172.21.15.79:0/3927489019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba780b8f70 con 0x7fba780a6270 2021-04-09T18:35:17.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba767fc700 1 -- 172.21.15.79:0/3927489019 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba700057e0 con 0x7fba780a6270 2021-04-09T18:35:17.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba801ac700 1 -- 172.21.15.79:0/3927489019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba780a5f00 con 0x7fba780a6270 2021-04-09T18:35:17.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.635 7fba767fc700 1 -- 172.21.15.79:0/3927489019 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fba7001a020 con 0x7fba780a6270 2021-04-09T18:35:17.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.639 7fba767fc700 1 --2- 172.21.15.79:0/3927489019 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fba5c029100 0x7fba5c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.639 7fba767fc700 1 -- 172.21.15.79:0/3927489019 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fba70039140 con 0x7fba780a6270 2021-04-09T18:35:17.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.639 7fba7d74f700 1 --2- 172.21.15.79:0/3927489019 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fba5c029100 0x7fba5c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.639 7fba7d74f700 1 --2- 172.21.15.79:0/3927489019 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fba5c029100 0x7fba5c02b650 crc :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:17.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.643 7fba801ac700 1 -- 172.21.15.79:0/3927489019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba780e39f0 con 0x7fba780a6270 2021-04-09T18:35:17.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.651 7fba767fc700 1 -- 172.21.15.79:0/3927489019 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fba70000bf0 con 0x7fba780a6270 2021-04-09T18:35:17.808 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.803 7fba801ac700 1 -- 172.21.15.79:0/3927489019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fba780a1c90 con 0x7fba780a6270 2021-04-09T18:35:17.809 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.803 7fba767fc700 1 -- 172.21.15.79:0/3927489019 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v126) v1 ==== 100+0+10 (secure 0 0 0) 0x7fba70007110 con 0x7fba780a6270 2021-04-09T18:35:17.810 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:35:17.812 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.807 7fba801ac700 1 -- 172.21.15.79:0/3927489019 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fba5c029100 msgr2=0x7fba5c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.807 7fba801ac700 1 --2- 172.21.15.79:0/3927489019 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fba5c029100 0x7fba5c02b650 crc :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.807 7fba801ac700 1 -- 172.21.15.79:0/3927489019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba780a6270 msgr2=0x7fba780906d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.807 7fba801ac700 1 --2- 172.21.15.79:0/3927489019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba780a6270 0x7fba780906d0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7fba70000b80 tx=0x7fba7000cab0).stop 2021-04-09T18:35:17.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.807 7fba801ac700 1 -- 172.21.15.79:0/3927489019 shutdown_connections 2021-04-09T18:35:17.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.807 7fba801ac700 1 --2- 172.21.15.79:0/3927489019 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fba5c029100 0x7fba5c02b650 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.807 7fba801ac700 1 --2- 172.21.15.79:0/3927489019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba781a6520 0x7fba781a6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.815 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.807 7fba801ac700 1 --2- 172.21.15.79:0/3927489019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba780a6270 0x7fba780906d0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.807 7fba801ac700 1 --2- 172.21.15.79:0/3927489019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba780babe0 0x7fba780a58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.807 7fba801ac700 1 -- 172.21.15.79:0/3927489019 >> 172.21.15.79:0/3927489019 conn(0x7fba780955a0 msgr2=0x7fba780949b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:17.816 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.807 7fba801ac700 1 -- 172.21.15.79:0/3927489019 shutdown_connections 2021-04-09T18:35:17.817 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.807 7fba801ac700 1 -- 172.21.15.79:0/3927489019 wait complete. 2021-04-09T18:35:17.821 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:35:17.822 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:35:17.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23d30fb700 1 Processor -- start 2021-04-09T18:35:17.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23d30fb700 1 -- start start 2021-04-09T18:35:17.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23d30fb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc0e9ae0 0x7f23cc09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23d30fb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23cc1c8010 0x7f23cc1ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23d30fb700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23cc0fbb20 con 0x7f23cc0f5520 2021-04-09T18:35:17.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23d30fb700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23cc1c3dc0 con 0x7f23cc1c8010 2021-04-09T18:35:17.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23d30fb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc0e9f30 con 0x7f23cc0e9ae0 2021-04-09T18:35:17.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23d0e9f700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f23cc0f5520 0x7f23cc0f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57974/0 (socket says 172.21.15.79:57974) 2021-04-09T18:35:17.931 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23d16a0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23cc1c8010 0x7f23cc1ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23d0e9f700 1 -- 172.21.15.79:0/1412282328 learned_addr learned my addr 172.21.15.79:0/1412282328 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:17.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23cbfff700 1 --2- 172.21.15.79:0/1412282328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc0e9ae0 0x7f23cc09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23cb7fe700 1 -- 172.21.15.79:0/1412282328 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100127784 0 0) 0x7f23b40010d0 con 0x7f23cc0f5520 2021-04-09T18:35:17.932 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23cb7fe700 1 -- 172.21.15.79:0/1412282328 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23b8003240 con 0x7f23cc0f5520 2021-04-09T18:35:17.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23d16a0700 1 -- 172.21.15.79:0/1412282328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc0e9ae0 msgr2=0x7f23cc09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:17.933 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23d16a0700 1 --2- 172.21.15.79:0/1412282328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc0e9ae0 0x7f23cc09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23d16a0700 1 -- 172.21.15.79:0/1412282328 >> v1:172.21.15.79:6789/0 conn(0x7f23cc0f5520 legacy=0x7f23cc0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23d16a0700 1 -- 172.21.15.79:0/1412282328 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc0e56d0 con 0x7f23cc1c8010 2021-04-09T18:35:17.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23d16a0700 1 --2- 172.21.15.79:0/1412282328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23cc1c8010 0x7f23cc1ca470 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f23c40032b0 tx=0x7f23c400b3c0).ready entity=mon.0 client_cookie=c1cf592f20962be0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:17.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23cb7fe700 1 -- 172.21.15.79:0/1412282328 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f23cc0e56d0 con 0x7f23cc1c8010 2021-04-09T18:35:17.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23cb7fe700 1 -- 172.21.15.79:0/1412282328 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c400bc20 con 0x7f23cc1c8010 2021-04-09T18:35:17.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.915 7f23cb7fe700 1 -- 172.21.15.79:0/1412282328 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f23c4002020 con 0x7f23cc1c8010 2021-04-09T18:35:17.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.919 7f23d30fb700 1 -- 172.21.15.79:0/1412282328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23cc1c8010 msgr2=0x7f23cc1ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.919 7f23d30fb700 1 --2- 172.21.15.79:0/1412282328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23cc1c8010 0x7f23cc1ca470 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f23c40032b0 tx=0x7f23c400b3c0).stop 2021-04-09T18:35:17.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.919 7f23d30fb700 1 -- 172.21.15.79:0/1412282328 shutdown_connections 2021-04-09T18:35:17.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.919 7f23d30fb700 1 --2- 172.21.15.79:0/1412282328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23cc1c8010 0x7f23cc1ca470 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.919 7f23d30fb700 1 --2- 172.21.15.79:0/1412282328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc0e9ae0 0x7f23cc09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.919 7f23d30fb700 1 -- 172.21.15.79:0/1412282328 >> 172.21.15.79:0/1412282328 conn(0x7f23cc0e5fe0 msgr2=0x7f23cc0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:17.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.919 7f23d30fb700 1 -- 172.21.15.79:0/1412282328 shutdown_connections 2021-04-09T18:35:17.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.919 7f23d30fb700 1 -- 172.21.15.79:0/1412282328 wait complete. 2021-04-09T18:35:17.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d30fb700 1 Processor -- start 2021-04-09T18:35:17.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d30fb700 1 -- start start 2021-04-09T18:35:17.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d30fb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23cc0bc0b0 0x7f23cc08ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d30fb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23cc094c70 0x7f23cc0d0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d30fb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc0950c0 0x7f23cc0bcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.938 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d30fb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc0bc800 con 0x7f23cc0bc0b0 2021-04-09T18:35:17.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d30fb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc0bc500 con 0x7f23cc094c70 2021-04-09T18:35:17.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d30fb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc0bbce0 con 0x7f23cc0950c0 2021-04-09T18:35:17.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d0e9f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23cc0bc0b0 0x7f23cc08ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d0e9f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23cc0bc0b0 0x7f23cc08ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35038/0 (socket says 172.21.15.79:35038) 2021-04-09T18:35:17.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d0e9f700 1 -- 172.21.15.79:0/310766150 learned_addr learned my addr 172.21.15.79:0/310766150 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:17.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d16a0700 1 --2- 172.21.15.79:0/310766150 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc0950c0 0x7f23cc0bcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23cbfff700 1 --2- 172.21.15.79:0/310766150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23cc094c70 0x7f23cc0d0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d0e9f700 1 -- 172.21.15.79:0/310766150 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc0950c0 msgr2=0x7f23cc0bcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d0e9f700 1 --2- 172.21.15.79:0/310766150 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc0950c0 0x7f23cc0bcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d0e9f700 1 -- 172.21.15.79:0/310766150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23cc094c70 msgr2=0x7f23cc0d0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:17.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d0e9f700 1 --2- 172.21.15.79:0/310766150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23cc094c70 0x7f23cc0d0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:17.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d0e9f700 1 -- 172.21.15.79:0/310766150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc0956f0 con 0x7f23cc0bc0b0 2021-04-09T18:35:17.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23cbfff700 1 --2- 172.21.15.79:0/310766150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23cc094c70 0x7f23cc0d0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:35:17.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d16a0700 1 --2- 172.21.15.79:0/310766150 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc0950c0 0x7f23cc0bcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:35:17.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d0e9f700 1 --2- 172.21.15.79:0/310766150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23cc0bc0b0 0x7f23cc08ecd0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f23cc0d3c60 tx=0x7f23b400cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:17.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23c97fa700 1 -- 172.21.15.79:0/310766150 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f23cc0956f0 con 0x7f23cc0bc0b0 2021-04-09T18:35:17.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23c97fa700 1 -- 172.21.15.79:0/310766150 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b4007320 con 0x7f23cc0bc0b0 2021-04-09T18:35:17.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23c97fa700 1 -- 172.21.15.79:0/310766150 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f23b40057e0 con 0x7f23cc0bc0b0 2021-04-09T18:35:17.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d30fb700 1 -- 172.21.15.79:0/310766150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23cc0d11d0 con 0x7f23cc0bc0b0 2021-04-09T18:35:17.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23d30fb700 1 -- 172.21.15.79:0/310766150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23cc0bd130 con 0x7f23cc0bc0b0 2021-04-09T18:35:17.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.923 7f23c97fa700 1 -- 172.21.15.79:0/310766150 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f23b401a060 con 0x7f23cc0bc0b0 2021-04-09T18:35:17.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.927 7f23c97fa700 1 --2- 172.21.15.79:0/310766150 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f23b0029100 0x7f23b002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:17.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.927 7f23c97fa700 1 -- 172.21.15.79:0/310766150 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f23b4038c60 con 0x7f23cc0bc0b0 2021-04-09T18:35:17.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.927 7f23cbfff700 1 --2- 172.21.15.79:0/310766150 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f23b0029100 0x7f23b002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:17.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.927 7f23cbfff700 1 --2- 172.21.15.79:0/310766150 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f23b0029100 0x7f23b002b650 crc :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:17.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.931 7f23d30fb700 1 -- 172.21.15.79:0/310766150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23cc0e39e0 con 0x7f23cc0bc0b0 2021-04-09T18:35:17.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:17.935 7f23c97fa700 1 -- 172.21.15.79:0/310766150 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f23b4007110 con 0x7f23cc0bc0b0 2021-04-09T18:35:18.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:18.099 7f23d30fb700 1 -- 172.21.15.79:0/310766150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23cc0f5b20 con 0x7f23cc0bc0b0 2021-04-09T18:35:18.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:18.099 7f23c97fa700 1 -- 172.21.15.79:0/310766150 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+2105 (secure 0 0 0) 0x7f23cc107f50 con 0x7f23cc0bc0b0 2021-04-09T18:35:18.110 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:18.110 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":79,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7842,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1552365531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1552365531},{"type":"v1","addr":"172.21.15.89:6835","nonce":1552365531}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":77}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:35:13.180244","modified":"2021-04-09 18:35:15.198467","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7833},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7833":{"gid":7833,"name":"a","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/4102869700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4102869700},{"type":"v1","addr":"172.21.15.79:6833","nonce":4102869700}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-04-09T18:35:18.111 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 79 2021-04-09T18:35:18.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:18.103 7f23d30fb700 1 -- 172.21.15.79:0/310766150 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f23b0029100 msgr2=0x7f23b002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:18.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:18.103 7f23d30fb700 1 --2- 172.21.15.79:0/310766150 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f23b0029100 0x7f23b002b650 crc :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:18.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:18.103 7f23d30fb700 1 -- 172.21.15.79:0/310766150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23cc0bc0b0 msgr2=0x7f23cc08ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:18.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:18.103 7f23d30fb700 1 --2- 172.21.15.79:0/310766150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23cc0bc0b0 0x7f23cc08ecd0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f23cc0d3c60 tx=0x7f23b400cae0).stop 2021-04-09T18:35:18.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:18.103 7f23d30fb700 1 -- 172.21.15.79:0/310766150 shutdown_connections 2021-04-09T18:35:18.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:18.103 7f23d30fb700 1 --2- 172.21.15.79:0/310766150 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f23b0029100 0x7f23b002b650 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:18.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:18.103 7f23d30fb700 1 --2- 172.21.15.79:0/310766150 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc0950c0 0x7f23cc0bcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:18.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:18.103 7f23d30fb700 1 --2- 172.21.15.79:0/310766150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23cc0bc0b0 0x7f23cc08ecd0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:18.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:18.103 7f23d30fb700 1 --2- 172.21.15.79:0/310766150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23cc094c70 0x7f23cc0d0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:18.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:18.103 7f23d30fb700 1 -- 172.21.15.79:0/310766150 >> 172.21.15.79:0/310766150 conn(0x7f23cc0a5050 msgr2=0x7f23cc0a46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:18.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:18.103 7f23d30fb700 1 -- 172.21.15.79:0/310766150 shutdown_connections 2021-04-09T18:35:18.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:18.103 7f23d30fb700 1 -- 172.21.15.79:0/310766150 wait complete. 2021-04-09T18:35:18.321 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 79, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:35:13.180244', 'modified': '2021-04-09 18:35:15.198467', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7833}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7833': {'gid': 7833, 'name': 'a', 'rank': 0, 'incarnation': 78, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6833/4102869700', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 4102869700}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 4102869700}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:35:18.322 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:35:18.323 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2021-04-09T18:35:18.414 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:35:18.414 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:35:18.415 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2021-04-09T18:35:18.415 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 7833, 2021-04-09T18:35:18.415 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2021-04-09T18:35:18.416 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2021-04-09T18:35:18.416 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 4.2118473910000001, 2021-04-09T18:35:18.416 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 79, 2021-04-09T18:35:18.416 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 126, 2021-04-09T18:35:18.417 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 126, 2021-04-09T18:35:18.417 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 8.8847255119999993 2021-04-09T18:35:18.417 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:35:18.424 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 7833, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.2118473910000001, "mdsmap_epoch": 79, "osdmap_epoch": 126, "osdmap_epoch_barrier": 126, "uptime": 8.8847255119999993 } 2021-04-09T18:35:18.425 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:35:18.425 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-04-09T18:35:18.426 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi090.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-04-09T18:35:18.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:18.427 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:18.435 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:35:18.493 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:35:18.494 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:35:18.548 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:35:18.549 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:35:18.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:18.551 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:35:18.600 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:35:18.600 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:18.643 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:35:18.660 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:35:18.661 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:35:18.716 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:35:18.719 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:35:18.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:18.720 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:35:18.721 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:2021-04-09 18:35:18.714 7f8f27b690c0 -1 init, newargv = 0x5597ea93e9b0 newargc=9 2021-04-09T18:35:18.722 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[14153]: starting ceph client 2021-04-09T18:35:18.729 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[14153]: starting fuse 2021-04-09T18:35:18.735 INFO:teuthology.orchestra.run.smithi090.stdout:49 2021-04-09T18:35:18.736 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:35:18.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:18.739 DEBUG:teuthology.orchestra.run.smithi090:> sudo python3 -c ' 2021-04-09T18:35:18.739 DEBUG:teuthology.orchestra.run.smithi090:> import glob 2021-04-09T18:35:18.740 DEBUG:teuthology.orchestra.run.smithi090:> import re 2021-04-09T18:35:18.740 DEBUG:teuthology.orchestra.run.smithi090:> import os 2021-04-09T18:35:18.740 DEBUG:teuthology.orchestra.run.smithi090:> import subprocess 2021-04-09T18:35:18.741 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:35:18.741 DEBUG:teuthology.orchestra.run.smithi090:> def find_socket(client_name): 2021-04-09T18:35:18.742 DEBUG:teuthology.orchestra.run.smithi090:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-04-09T18:35:18.742 DEBUG:teuthology.orchestra.run.smithi090:> files = glob.glob(asok_path) 2021-04-09T18:35:18.742 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:35:18.743 DEBUG:teuthology.orchestra.run.smithi090:> # Given a non-glob path, it better be there 2021-04-09T18:35:18.743 DEBUG:teuthology.orchestra.run.smithi090:> if "*" not in asok_path: 2021-04-09T18:35:18.744 DEBUG:teuthology.orchestra.run.smithi090:> assert(len(files) == 1) 2021-04-09T18:35:18.744 DEBUG:teuthology.orchestra.run.smithi090:> return files[0] 2021-04-09T18:35:18.744 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:35:18.745 DEBUG:teuthology.orchestra.run.smithi090:> for f in files: 2021-04-09T18:35:18.745 DEBUG:teuthology.orchestra.run.smithi090:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:35:18.746 DEBUG:teuthology.orchestra.run.smithi090:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:35:18.746 DEBUG:teuthology.orchestra.run.smithi090:> return f 2021-04-09T18:35:18.746 DEBUG:teuthology.orchestra.run.smithi090:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:35:18.747 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:35:18.747 DEBUG:teuthology.orchestra.run.smithi090:> print(find_socket("client.0")) 2021-04-09T18:35:18.748 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:35:18.822 INFO:teuthology.orchestra.run.smithi090.stdout:/var/run/ceph/ceph-client.0.14153.asok 2021-04-09T18:35:18.827 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14153.asok 2021-04-09T18:35:18.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:18.828 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14153.asok status 2021-04-09T18:35:18.902 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2021-04-09T18:35:18.903 INFO:teuthology.orchestra.run.smithi090.stdout: "metadata": { 2021-04-09T18:35:18.903 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:35:18.903 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:35:18.903 INFO:teuthology.orchestra.run.smithi090.stdout: "entity_id": "0", 2021-04-09T18:35:18.904 INFO:teuthology.orchestra.run.smithi090.stdout: "hostname": "smithi090", 2021-04-09T18:35:18.904 INFO:teuthology.orchestra.run.smithi090.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-04-09T18:35:18.904 INFO:teuthology.orchestra.run.smithi090.stdout: "pid": "14153", 2021-04-09T18:35:18.904 INFO:teuthology.orchestra.run.smithi090.stdout: "root": "/" 2021-04-09T18:35:18.905 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:35:18.905 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_count": 0, 2021-04-09T18:35:18.905 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_pinned_count": 0, 2021-04-09T18:35:18.905 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 7981, 2021-04-09T18:35:18.905 INFO:teuthology.orchestra.run.smithi090.stdout: "inst": { 2021-04-09T18:35:18.906 INFO:teuthology.orchestra.run.smithi090.stdout: "name": { 2021-04-09T18:35:18.906 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "client", 2021-04-09T18:35:18.906 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 7981 2021-04-09T18:35:18.906 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:35:18.907 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:35:18.907 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:35:18.907 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:35:18.907 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 109809118 2021-04-09T18:35:18.907 INFO:teuthology.orchestra.run.smithi090.stdout: } 2021-04-09T18:35:18.908 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:35:18.908 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:35:18.908 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:35:18.908 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:35:18.908 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 109809118 2021-04-09T18:35:18.909 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:35:18.909 INFO:teuthology.orchestra.run.smithi090.stdout: "inst_str": "client.7981 172.21.15.90:0/109809118", 2021-04-09T18:35:18.909 INFO:teuthology.orchestra.run.smithi090.stdout: "addr_str": "172.21.15.90:0/109809118", 2021-04-09T18:35:18.909 INFO:teuthology.orchestra.run.smithi090.stdout: "inode_count": 1, 2021-04-09T18:35:18.910 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_epoch": 79, 2021-04-09T18:35:18.910 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch": 126, 2021-04-09T18:35:18.910 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:35:18.910 INFO:teuthology.orchestra.run.smithi090.stdout: "blacklisted": false, 2021-04-09T18:35:18.910 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs" 2021-04-09T18:35:18.911 INFO:teuthology.orchestra.run.smithi090.stdout:} 2021-04-09T18:35:18.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:18.913 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:18.913 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:18.920 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:35:18.922 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:35:18.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:18.923 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:18.986 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:35:19.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.083 7fa5967cd700 1 Processor -- start 2021-04-09T18:35:19.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.083 7fa5967cd700 1 -- start start 2021-04-09T18:35:19.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.083 7fa5967cd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa5900f5520 0x7fa5900f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.083 7fa5967cd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5901c8010 0x7fa5901ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.083 7fa5967cd700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5900fbb20 con 0x7fa5900e9ae0 2021-04-09T18:35:19.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.083 7fa5967cd700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5900e9f30 con 0x7fa5900f5520 2021-04-09T18:35:19.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.083 7fa5967cd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5901c3dc0 con 0x7fa5901c8010 2021-04-09T18:35:19.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.083 7fa58f7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa5900e9ae0 0x7fa59009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57992/0 (socket says 172.21.15.79:57992) 2021-04-09T18:35:19.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.083 7fa58f7fe700 1 -- 172.21.15.79:0/3372248062 learned_addr learned my addr 172.21.15.79:0/3372248062 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:19.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.083 7fa58ffff700 1 --2- 172.21.15.79:0/3372248062 >> v2:172.21.15.89:3300/0 conn(0x7fa5900f5520 0x7fa5900f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.083 7fa594d72700 1 --2- 172.21.15.79:0/3372248062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5901c8010 0x7fa5901ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.083 7fa58effd700 1 -- 172.21.15.79:0/3372248062 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2180164600 0 0) 0x7fa5780010d0 con 0x7fa5900e9ae0 2021-04-09T18:35:19.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.083 7fa58effd700 1 -- 172.21.15.79:0/3372248062 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa57c003240 con 0x7fa5900e9ae0 2021-04-09T18:35:19.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.083 7fa594d72700 1 -- 172.21.15.79:0/3372248062 >> v2:172.21.15.89:3300/0 conn(0x7fa5900f5520 msgr2=0x7fa5900f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:19.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.083 7fa594d72700 1 --2- 172.21.15.79:0/3372248062 >> v2:172.21.15.89:3300/0 conn(0x7fa5900f5520 0x7fa5900f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.083 7fa594d72700 1 -- 172.21.15.79:0/3372248062 >> v1:172.21.15.79:6789/0 conn(0x7fa5900e9ae0 legacy=0x7fa59009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.083 7fa594d72700 1 -- 172.21.15.79:0/3372248062 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59009f910 con 0x7fa5901c8010 2021-04-09T18:35:19.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.083 7fa58ffff700 1 --2- 172.21.15.79:0/3372248062 >> v2:172.21.15.89:3300/0 conn(0x7fa5900f5520 0x7fa5900f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:19.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.087 7fa594d72700 1 --2- 172.21.15.79:0/3372248062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5901c8010 0x7fa5901ca470 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fa588002f30 tx=0x7fa58800bcc0).ready entity=mon.2 client_cookie=3e56a998ddd71478 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:19.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.087 7fa58effd700 1 -- 172.21.15.79:0/3372248062 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa59009f910 con 0x7fa5901c8010 2021-04-09T18:35:19.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.087 7fa58effd700 1 -- 172.21.15.79:0/3372248062 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa588009800 con 0x7fa5901c8010 2021-04-09T18:35:19.101 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.087 7fa58effd700 1 -- 172.21.15.79:0/3372248062 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa588009bd0 con 0x7fa5901c8010 2021-04-09T18:35:19.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.087 7fa5967cd700 1 -- 172.21.15.79:0/3372248062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5901c8010 msgr2=0x7fa5901ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.087 7fa5967cd700 1 --2- 172.21.15.79:0/3372248062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5901c8010 0x7fa5901ca470 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fa588002f30 tx=0x7fa58800bcc0).stop 2021-04-09T18:35:19.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.087 7fa5967cd700 1 -- 172.21.15.79:0/3372248062 shutdown_connections 2021-04-09T18:35:19.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.087 7fa5967cd700 1 --2- 172.21.15.79:0/3372248062 >> v2:172.21.15.89:3300/0 conn(0x7fa5900f5520 0x7fa5900f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.087 7fa5967cd700 1 --2- 172.21.15.79:0/3372248062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5901c8010 0x7fa5901ca470 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.087 7fa5967cd700 1 -- 172.21.15.79:0/3372248062 >> 172.21.15.79:0/3372248062 conn(0x7fa5900e5fe0 msgr2=0x7fa5900e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:19.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.087 7fa5967cd700 1 -- 172.21.15.79:0/3372248062 shutdown_connections 2021-04-09T18:35:19.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.087 7fa5967cd700 1 -- 172.21.15.79:0/3372248062 wait complete. 2021-04-09T18:35:19.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa5967cd700 1 Processor -- start 2021-04-09T18:35:19.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa5967cd700 1 -- start start 2021-04-09T18:35:19.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa5967cd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5900c46d0 0x7fa5900d4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa5967cd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5900d5430 0x7fa590097350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa5967cd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5900c4b20 0x7fa590097980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa5967cd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5900b72d0 con 0x7fa5900c4b20 2021-04-09T18:35:19.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa5967cd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5900b6e60 con 0x7fa5900d5430 2021-04-09T18:35:19.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa5967cd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5900b75d0 con 0x7fa5900c46d0 2021-04-09T18:35:19.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa594d72700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5900c4b20 0x7fa590097980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa594d72700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5900c4b20 0x7fa590097980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35056/0 (socket says 172.21.15.79:35056) 2021-04-09T18:35:19.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa594d72700 1 -- 172.21.15.79:0/209224703 learned_addr learned my addr 172.21.15.79:0/209224703 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:19.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa58ffff700 1 --2- 172.21.15.79:0/209224703 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5900c46d0 0x7fa5900d4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa58f7fe700 1 --2- 172.21.15.79:0/209224703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5900d5430 0x7fa590097350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.109 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa594d72700 1 -- 172.21.15.79:0/209224703 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5900c46d0 msgr2=0x7fa5900d4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa594d72700 1 --2- 172.21.15.79:0/209224703 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5900c46d0 0x7fa5900d4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.110 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa594d72700 1 -- 172.21.15.79:0/209224703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5900d5430 msgr2=0x7fa590097350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa594d72700 1 --2- 172.21.15.79:0/209224703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5900d5430 0x7fa590097350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa594d72700 1 -- 172.21.15.79:0/209224703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa590097fb0 con 0x7fa5900c4b20 2021-04-09T18:35:19.111 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa58ffff700 1 --2- 172.21.15.79:0/209224703 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5900c46d0 0x7fa5900d4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:19.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa594d72700 1 --2- 172.21.15.79:0/209224703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5900c4b20 0x7fa590097980 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7fa5900a25a0 tx=0x7fa588006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:19.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa58cff9700 1 -- 172.21.15.79:0/209224703 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa590097fb0 con 0x7fa5900c4b20 2021-04-09T18:35:19.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa58cff9700 1 -- 172.21.15.79:0/209224703 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa588011e20 con 0x7fa5900c4b20 2021-04-09T18:35:19.112 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa5967cd700 1 -- 172.21.15.79:0/209224703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5900b5bf0 con 0x7fa5900c4b20 2021-04-09T18:35:19.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.091 7fa58cff9700 1 -- 172.21.15.79:0/209224703 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa588018770 con 0x7fa5900c4b20 2021-04-09T18:35:19.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.095 7fa5967cd700 1 -- 172.21.15.79:0/209224703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa590098260 con 0x7fa5900c4b20 2021-04-09T18:35:19.113 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.095 7fa58cff9700 1 -- 172.21.15.79:0/209224703 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa588018970 con 0x7fa5900c4b20 2021-04-09T18:35:19.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.095 7fa58cff9700 1 --2- 172.21.15.79:0/209224703 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa574029100 0x7fa57402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.095 7fa58cff9700 1 -- 172.21.15.79:0/209224703 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fa58803bcd0 con 0x7fa5900c4b20 2021-04-09T18:35:19.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.095 7fa58ffff700 1 --2- 172.21.15.79:0/209224703 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa574029100 0x7fa57402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.114 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.095 7fa58ffff700 1 --2- 172.21.15.79:0/209224703 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa574029100 0x7fa57402b650 crc :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:19.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.099 7fa5967cd700 1 -- 172.21.15.79:0/209224703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5900e39e0 con 0x7fa5900c4b20 2021-04-09T18:35:19.115 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.103 7fa58cff9700 1 -- 172.21.15.79:0/209224703 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa588018370 con 0x7fa5900c4b20 2021-04-09T18:35:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.267 7fa5967cd700 1 -- 172.21.15.79:0/209224703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5900f5b20 con 0x7fa5900c4b20 2021-04-09T18:35:19.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.267 7fa58cff9700 1 -- 172.21.15.79:0/209224703 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+14240 (secure 0 0 0) 0x7fa5880095f0 con 0x7fa5900c4b20 2021-04-09T18:35:19.275 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:19.275 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":126,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:35:14.182279","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:35:11.346312","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2021-04-09 18:35:12.219337","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:35:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.271 7fa5967cd700 1 -- 172.21.15.79:0/209224703 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa574029100 msgr2=0x7fa57402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.271 7fa5967cd700 1 --2- 172.21.15.79:0/209224703 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa574029100 0x7fa57402b650 crc :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.271 7fa5967cd700 1 -- 172.21.15.79:0/209224703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5900c4b20 msgr2=0x7fa590097980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.271 7fa5967cd700 1 --2- 172.21.15.79:0/209224703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5900c4b20 0x7fa590097980 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7fa5900a25a0 tx=0x7fa588006890).stop 2021-04-09T18:35:19.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.271 7fa5967cd700 1 -- 172.21.15.79:0/209224703 shutdown_connections 2021-04-09T18:35:19.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.271 7fa5967cd700 1 --2- 172.21.15.79:0/209224703 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa574029100 0x7fa57402b650 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.271 7fa5967cd700 1 --2- 172.21.15.79:0/209224703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5900c4b20 0x7fa590097980 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.271 7fa5967cd700 1 --2- 172.21.15.79:0/209224703 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5900c46d0 0x7fa5900d4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.271 7fa5967cd700 1 --2- 172.21.15.79:0/209224703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5900d5430 0x7fa590097350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.271 7fa5967cd700 1 -- 172.21.15.79:0/209224703 >> 172.21.15.79:0/209224703 conn(0x7fa59009af90 msgr2=0x7fa5900d8040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:19.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.271 7fa5967cd700 1 -- 172.21.15.79:0/209224703 shutdown_connections 2021-04-09T18:35:19.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.271 7fa5967cd700 1 -- 172.21.15.79:0/209224703 wait complete. 2021-04-09T18:35:19.288 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:35:11.346312', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:35:12.219337', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:35:19.289 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:35:19.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.379 7fb2df9be700 1 Processor -- start 2021-04-09T18:35:19.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.379 7fb2df9be700 1 -- start start 2021-04-09T18:35:19.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2df9be700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d81c9050 0x7fb2d81cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2df9be700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d80fbb50 con 0x7fb2d80f5550 2021-04-09T18:35:19.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2df9be700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d809f910 con 0x7fb2d80e9b10 2021-04-09T18:35:19.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2df9be700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d81c3df0 con 0x7fb2d81c9050 2021-04-09T18:35:19.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2dd762700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb2d80f5550 0x7fb2d80f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58002/0 (socket says 172.21.15.79:58002) 2021-04-09T18:35:19.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2dd762700 1 -- 172.21.15.79:0/3726459698 learned_addr learned my addr 172.21.15.79:0/3726459698 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:19.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2ddf63700 1 --2- 172.21.15.79:0/3726459698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d81c9050 0x7fb2d81cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2cbfff700 1 -- 172.21.15.79:0/3726459698 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274038915 0 0) 0x7fb2d40010d0 con 0x7fb2d80f5550 2021-04-09T18:35:19.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2cbfff700 1 -- 172.21.15.79:0/3726459698 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2c4003240 con 0x7fb2d80f5550 2021-04-09T18:35:19.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2ddf63700 1 -- 172.21.15.79:0/3726459698 >> v1:172.21.15.89:6789/0 conn(0x7fb2d80e9b10 legacy=0x7fb2d809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2ddf63700 1 -- 172.21.15.79:0/3726459698 >> v1:172.21.15.79:6789/0 conn(0x7fb2d80f5550 legacy=0x7fb2d80f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2ddf63700 1 -- 172.21.15.79:0/3726459698 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d80e5700 con 0x7fb2d81c9050 2021-04-09T18:35:19.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2ddf63700 1 --2- 172.21.15.79:0/3726459698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d81c9050 0x7fb2d81cb4b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fb2d00032b0 tx=0x7fb2d000b0e0).ready entity=mon.2 client_cookie=eedddba19388e856 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:19.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2cbfff700 1 -- 172.21.15.79:0/3726459698 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb2d80e5700 con 0x7fb2d81c9050 2021-04-09T18:35:19.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2cbfff700 1 -- 172.21.15.79:0/3726459698 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d000baf0 con 0x7fb2d81c9050 2021-04-09T18:35:19.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2df9be700 1 -- 172.21.15.79:0/3726459698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d81c9050 msgr2=0x7fb2d81cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2cbfff700 1 -- 172.21.15.79:0/3726459698 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb2d0002020 con 0x7fb2d81c9050 2021-04-09T18:35:19.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2df9be700 1 --2- 172.21.15.79:0/3726459698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d81c9050 0x7fb2d81cb4b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fb2d00032b0 tx=0x7fb2d000b0e0).stop 2021-04-09T18:35:19.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2df9be700 1 -- 172.21.15.79:0/3726459698 shutdown_connections 2021-04-09T18:35:19.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2df9be700 1 --2- 172.21.15.79:0/3726459698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d81c9050 0x7fb2d81cb4b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2df9be700 1 -- 172.21.15.79:0/3726459698 >> 172.21.15.79:0/3726459698 conn(0x7fb2d80e6010 msgr2=0x7fb2d80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:19.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2df9be700 1 -- 172.21.15.79:0/3726459698 shutdown_connections 2021-04-09T18:35:19.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.383 7fb2df9be700 1 -- 172.21.15.79:0/3726459698 wait complete. 2021-04-09T18:35:19.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2df9be700 1 Processor -- start 2021-04-09T18:35:19.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2df9be700 1 -- start start 2021-04-09T18:35:19.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2df9be700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d80a4170 0x7fb2d819e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2df9be700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2d80b11a0 0x7fb2d81af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2df9be700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2d81c0020 0x7fb2d81c0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2df9be700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d8088590 con 0x7fb2d80b11a0 2021-04-09T18:35:19.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2df9be700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80e9f60 con 0x7fb2d81c0020 2021-04-09T18:35:19.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2df9be700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d819cb10 con 0x7fb2d80a4170 2021-04-09T18:35:19.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2dcf61700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2d80b11a0 0x7fb2d81af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2dcf61700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2d80b11a0 0x7fb2d81af500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35066/0 (socket says 172.21.15.79:35066) 2021-04-09T18:35:19.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2dcf61700 1 -- 172.21.15.79:0/1474961252 learned_addr learned my addr 172.21.15.79:0/1474961252 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:19.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2ddf63700 1 --2- 172.21.15.79:0/1474961252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2d81c0020 0x7fb2d81c0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2dd762700 1 --2- 172.21.15.79:0/1474961252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d80a4170 0x7fb2d819e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2dcf61700 1 -- 172.21.15.79:0/1474961252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d80a4170 msgr2=0x7fb2d819e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2dcf61700 1 --2- 172.21.15.79:0/1474961252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d80a4170 0x7fb2d819e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2dcf61700 1 -- 172.21.15.79:0/1474961252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2d81c0020 msgr2=0x7fb2d81c0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2dcf61700 1 --2- 172.21.15.79:0/1474961252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2d81c0020 0x7fb2d81c0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2dcf61700 1 -- 172.21.15.79:0/1474961252 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d80b15f0 con 0x7fb2d80b11a0 2021-04-09T18:35:19.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2ddf63700 1 --2- 172.21.15.79:0/1474961252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2d81c0020 0x7fb2d81c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:19.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2dcf61700 1 --2- 172.21.15.79:0/1474961252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2d80b11a0 0x7fb2d81af500 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7fb2cc000b80 tx=0x7fb2cc00cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:19.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2c9ffb700 1 -- 172.21.15.79:0/1474961252 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb2d80b15f0 con 0x7fb2d80b11a0 2021-04-09T18:35:19.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2c9ffb700 1 -- 172.21.15.79:0/1474961252 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2cc010510 con 0x7fb2d80b11a0 2021-04-09T18:35:19.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2df9be700 1 -- 172.21.15.79:0/1474961252 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d819c6a0 con 0x7fb2d80b11a0 2021-04-09T18:35:19.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2c9ffb700 1 -- 172.21.15.79:0/1474961252 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb2cc0106f0 con 0x7fb2d80b11a0 2021-04-09T18:35:19.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2df9be700 1 -- 172.21.15.79:0/1474961252 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d819ba10 con 0x7fb2d80b11a0 2021-04-09T18:35:19.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.387 7fb2c9ffb700 1 -- 172.21.15.79:0/1474961252 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb2cc019020 con 0x7fb2d80b11a0 2021-04-09T18:35:19.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.391 7fb2c9ffb700 1 --2- 172.21.15.79:0/1474961252 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb2b8029100 0x7fb2b802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.391 7fb2c9ffb700 1 -- 172.21.15.79:0/1474961252 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fb2cc038d60 con 0x7fb2d80b11a0 2021-04-09T18:35:19.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.391 7fb2dd762700 1 --2- 172.21.15.79:0/1474961252 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb2b8029100 0x7fb2b802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.391 7fb2dd762700 1 --2- 172.21.15.79:0/1474961252 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb2b8029100 0x7fb2b802b650 crc :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:19.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.395 7fb2df9be700 1 -- 172.21.15.79:0/1474961252 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d80e39f0 con 0x7fb2d80b11a0 2021-04-09T18:35:19.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.399 7fb2c9ffb700 1 -- 172.21.15.79:0/1474961252 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb2cc010300 con 0x7fb2d80b11a0 2021-04-09T18:35:19.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.555 7fb2df9be700 1 -- 172.21.15.79:0/1474961252 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fb2d80f5b50 con 0x7fb2d80b11a0 2021-04-09T18:35:19.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.555 7fb2c9ffb700 1 -- 172.21.15.79:0/1474961252 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v126) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb2cc000bf0 con 0x7fb2d80b11a0 2021-04-09T18:35:19.562 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:35:19.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.559 7fb2df9be700 1 -- 172.21.15.79:0/1474961252 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb2b8029100 msgr2=0x7fb2b802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.559 7fb2df9be700 1 --2- 172.21.15.79:0/1474961252 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb2b8029100 0x7fb2b802b650 crc :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.559 7fb2df9be700 1 -- 172.21.15.79:0/1474961252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2d80b11a0 msgr2=0x7fb2d81af500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.559 7fb2df9be700 1 --2- 172.21.15.79:0/1474961252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2d80b11a0 0x7fb2d81af500 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7fb2cc000b80 tx=0x7fb2cc00cab0).stop 2021-04-09T18:35:19.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.559 7fb2df9be700 1 -- 172.21.15.79:0/1474961252 shutdown_connections 2021-04-09T18:35:19.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.559 7fb2df9be700 1 --2- 172.21.15.79:0/1474961252 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb2b8029100 0x7fb2b802b650 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.559 7fb2df9be700 1 --2- 172.21.15.79:0/1474961252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2d81c0020 0x7fb2d81c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.559 7fb2df9be700 1 --2- 172.21.15.79:0/1474961252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d80a4170 0x7fb2d819e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.559 7fb2df9be700 1 --2- 172.21.15.79:0/1474961252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2d80b11a0 0x7fb2d81af500 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.559 7fb2df9be700 1 -- 172.21.15.79:0/1474961252 >> 172.21.15.79:0/1474961252 conn(0x7fb2d80a2750 msgr2=0x7fb2d80ac770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:19.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.559 7fb2df9be700 1 -- 172.21.15.79:0/1474961252 shutdown_connections 2021-04-09T18:35:19.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.559 7fb2df9be700 1 -- 172.21.15.79:0/1474961252 wait complete. 2021-04-09T18:35:19.577 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:35:19.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.663 7fc4a46ec700 1 Processor -- start 2021-04-09T18:35:19.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.663 7fc4a46ec700 1 -- start start 2021-04-09T18:35:19.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.663 7fc4a46ec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc49c0e9b10 0x7fc49c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.663 7fc4a46ec700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc49c1c8040 0x7fc49c1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.663 7fc4a46ec700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc49c0fbb50 con 0x7fc49c0f5550 2021-04-09T18:35:19.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.663 7fc4a46ec700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc49c1c3df0 con 0x7fc49c1c8040 2021-04-09T18:35:19.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.663 7fc4a46ec700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c0e9f60 con 0x7fc49c0e9b10 2021-04-09T18:35:19.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.663 7fc4a2c91700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc49c1c8040 0x7fc49c1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.663 7fc4a2c91700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc49c1c8040 0x7fc49c1ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35076/0 (socket says 172.21.15.79:35076) 2021-04-09T18:35:19.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.663 7fc4a2c91700 1 -- 172.21.15.79:0/1095875463 learned_addr learned my addr 172.21.15.79:0/1095875463 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:19.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.663 7fc4a1c8f700 1 --2- 172.21.15.79:0/1095875463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc49c0e9b10 0x7fc49c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.667 7fc4a148e700 1 -- 172.21.15.79:0/1095875463 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488515426 0 0) 0x7fc4980010d0 con 0x7fc49c0f5550 2021-04-09T18:35:19.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.667 7fc4a2c91700 1 -- 172.21.15.79:0/1095875463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc49c0e9b10 msgr2=0x7fc49c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:19.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.667 7fc4a2c91700 1 --2- 172.21.15.79:0/1095875463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc49c0e9b10 0x7fc49c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.667 7fc4a2c91700 1 -- 172.21.15.79:0/1095875463 >> v1:172.21.15.89:6789/0 conn(0x7fc49c0f5550 legacy=0x7fc49c0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.667 7fc4a2c91700 1 -- 172.21.15.79:0/1095875463 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c0e5700 con 0x7fc49c1c8040 2021-04-09T18:35:19.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.667 7fc4a2c91700 1 --2- 172.21.15.79:0/1095875463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc49c1c8040 0x7fc49c1ca4a0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7fc4940032b0 tx=0x7fc49400b3c0).ready entity=mon.0 client_cookie=c48b73f62ca9c134 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:19.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.667 7fc4a148e700 1 -- 172.21.15.79:0/1095875463 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc49c0e5700 con 0x7fc49c1c8040 2021-04-09T18:35:19.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.667 7fc4a148e700 1 -- 172.21.15.79:0/1095875463 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49400bc20 con 0x7fc49c1c8040 2021-04-09T18:35:19.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.667 7fc4a148e700 1 -- 172.21.15.79:0/1095875463 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc494002020 con 0x7fc49c1c8040 2021-04-09T18:35:19.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.667 7fc4a46ec700 1 -- 172.21.15.79:0/1095875463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc49c1c8040 msgr2=0x7fc49c1ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.667 7fc4a46ec700 1 --2- 172.21.15.79:0/1095875463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc49c1c8040 0x7fc49c1ca4a0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7fc4940032b0 tx=0x7fc49400b3c0).stop 2021-04-09T18:35:19.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.667 7fc4a46ec700 1 -- 172.21.15.79:0/1095875463 shutdown_connections 2021-04-09T18:35:19.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.667 7fc4a46ec700 1 --2- 172.21.15.79:0/1095875463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc49c1c8040 0x7fc49c1ca4a0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.667 7fc4a46ec700 1 --2- 172.21.15.79:0/1095875463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc49c0e9b10 0x7fc49c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.667 7fc4a46ec700 1 -- 172.21.15.79:0/1095875463 >> 172.21.15.79:0/1095875463 conn(0x7fc49c0e6010 msgr2=0x7fc49c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:19.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.667 7fc4a46ec700 1 -- 172.21.15.79:0/1095875463 shutdown_connections 2021-04-09T18:35:19.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.667 7fc4a46ec700 1 -- 172.21.15.79:0/1095875463 wait complete. 2021-04-09T18:35:19.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a46ec700 1 Processor -- start 2021-04-09T18:35:19.683 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a46ec700 1 -- start start 2021-04-09T18:35:19.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a46ec700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc49c0ba670 0x7fc49c0b7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a46ec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc49c0b8660 0x7fc49c1a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a46ec700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc49c1a53d0 0x7fc49c0d1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a46ec700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c0b8dd0 con 0x7fc49c0ba670 2021-04-09T18:35:19.684 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a46ec700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c0b90d0 con 0x7fc49c1a53d0 2021-04-09T18:35:19.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a46ec700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c0966d0 con 0x7fc49c0b8660 2021-04-09T18:35:19.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a2490700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc49c0ba670 0x7fc49c0b7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a2490700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc49c0ba670 0x7fc49c0b7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35080/0 (socket says 172.21.15.79:35080) 2021-04-09T18:35:19.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a2490700 1 -- 172.21.15.79:0/35452732 learned_addr learned my addr 172.21.15.79:0/35452732 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:19.685 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a1c8f700 1 --2- 172.21.15.79:0/35452732 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc49c0b8660 0x7fc49c1a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.686 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a2c91700 1 --2- 172.21.15.79:0/35452732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc49c1a53d0 0x7fc49c0d1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a2490700 1 -- 172.21.15.79:0/35452732 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc49c0b8660 msgr2=0x7fc49c1a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.688 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a2490700 1 --2- 172.21.15.79:0/35452732 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc49c0b8660 0x7fc49c1a4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a2490700 1 -- 172.21.15.79:0/35452732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc49c1a53d0 msgr2=0x7fc49c0d1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a2490700 1 --2- 172.21.15.79:0/35452732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc49c1a53d0 0x7fc49c0d1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a2490700 1 -- 172.21.15.79:0/35452732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c0b8080 con 0x7fc49c0ba670 2021-04-09T18:35:19.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a2490700 1 --2- 172.21.15.79:0/35452732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc49c0ba670 0x7fc49c0b7a50 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fc49c0d4c10 tx=0x7fc49800cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:19.689 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc492ffd700 1 -- 172.21.15.79:0/35452732 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc49c0b8080 con 0x7fc49c0ba670 2021-04-09T18:35:19.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc492ffd700 1 -- 172.21.15.79:0/35452732 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc498010510 con 0x7fc49c0ba670 2021-04-09T18:35:19.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc492ffd700 1 -- 172.21.15.79:0/35452732 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc4980106f0 con 0x7fc49c0ba670 2021-04-09T18:35:19.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a46ec700 1 -- 172.21.15.79:0/35452732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49c1a5820 con 0x7fc49c0ba670 2021-04-09T18:35:19.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.671 7fc4a46ec700 1 -- 172.21.15.79:0/35452732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49c0d1a90 con 0x7fc49c0ba670 2021-04-09T18:35:19.690 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.675 7fc492ffd700 1 -- 172.21.15.79:0/35452732 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc498019020 con 0x7fc49c0ba670 2021-04-09T18:35:19.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.675 7fc492ffd700 1 --2- 172.21.15.79:0/35452732 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc484029100 0x7fc48402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.675 7fc492ffd700 1 -- 172.21.15.79:0/35452732 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fc498038dd0 con 0x7fc49c0ba670 2021-04-09T18:35:19.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.675 7fc4a1c8f700 1 --2- 172.21.15.79:0/35452732 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc484029100 0x7fc48402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.691 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.675 7fc4a1c8f700 1 --2- 172.21.15.79:0/35452732 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc484029100 0x7fc48402b650 crc :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:19.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.679 7fc4a46ec700 1 -- 172.21.15.79:0/35452732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49c0e39f0 con 0x7fc49c0ba670 2021-04-09T18:35:19.692 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.683 7fc492ffd700 1 -- 172.21.15.79:0/35452732 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc498000bf0 con 0x7fc49c0ba670 2021-04-09T18:35:19.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.839 7fc4a46ec700 1 -- 172.21.15.79:0/35452732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fc49c0f5b50 con 0x7fc49c0ba670 2021-04-09T18:35:19.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.839 7fc492ffd700 1 -- 172.21.15.79:0/35452732 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v126) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc498010300 con 0x7fc49c0ba670 2021-04-09T18:35:19.847 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:35:19.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.843 7fc4a46ec700 1 -- 172.21.15.79:0/35452732 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc484029100 msgr2=0x7fc48402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.843 7fc4a46ec700 1 --2- 172.21.15.79:0/35452732 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc484029100 0x7fc48402b650 crc :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.843 7fc4a46ec700 1 -- 172.21.15.79:0/35452732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc49c0ba670 msgr2=0x7fc49c0b7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.843 7fc4a46ec700 1 --2- 172.21.15.79:0/35452732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc49c0ba670 0x7fc49c0b7a50 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fc49c0d4c10 tx=0x7fc49800cab0).stop 2021-04-09T18:35:19.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.843 7fc4a46ec700 1 -- 172.21.15.79:0/35452732 shutdown_connections 2021-04-09T18:35:19.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.843 7fc4a46ec700 1 --2- 172.21.15.79:0/35452732 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc484029100 0x7fc48402b650 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.843 7fc4a46ec700 1 --2- 172.21.15.79:0/35452732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc49c1a53d0 0x7fc49c0d1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.843 7fc4a46ec700 1 --2- 172.21.15.79:0/35452732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc49c0ba670 0x7fc49c0b7a50 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.843 7fc4a46ec700 1 --2- 172.21.15.79:0/35452732 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc49c0b8660 0x7fc49c1a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.843 7fc4a46ec700 1 -- 172.21.15.79:0/35452732 >> 172.21.15.79:0/35452732 conn(0x7fc49c094d30 msgr2=0x7fc49c0d3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:19.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.847 7fc4a46ec700 1 -- 172.21.15.79:0/35452732 shutdown_connections 2021-04-09T18:35:19.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.847 7fc4a46ec700 1 -- 172.21.15.79:0/35452732 wait complete. 2021-04-09T18:35:19.865 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:35:19.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.955 7f82197ab700 1 Processor -- start 2021-04-09T18:35:19.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.955 7f82197ab700 1 -- start start 2021-04-09T18:35:19.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82197ab700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82140e9b10 0x7f821409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82197ab700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f82141c8040 0x7f82141ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82197ab700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82140fbb50 con 0x7f82140f5550 2021-04-09T18:35:19.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82197ab700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82141c3df0 con 0x7f82141c8040 2021-04-09T18:35:19.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82197ab700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82140e9f60 con 0x7f82140e9b10 2021-04-09T18:35:19.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82134f5700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f82140f5550 0x7f82140f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58030/0 (socket says 172.21.15.79:58030) 2021-04-09T18:35:19.971 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82134f5700 1 -- 172.21.15.79:0/1662158445 learned_addr learned my addr 172.21.15.79:0/1662158445 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:19.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f8212cf4700 1 --2- 172.21.15.79:0/1662158445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82140e9b10 0x7f821409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f8213cf6700 1 --2- 172.21.15.79:0/1662158445 >> v2:172.21.15.89:3300/0 conn(0x7f82141c8040 0x7f82141ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82124f3700 1 -- 172.21.15.79:0/1662158445 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538532058 0 0) 0x7f82040010d0 con 0x7f82140f5550 2021-04-09T18:35:19.972 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82124f3700 1 -- 172.21.15.79:0/1662158445 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81fc003240 con 0x7f82140f5550 2021-04-09T18:35:19.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f8212cf4700 1 -- 172.21.15.79:0/1662158445 >> v2:172.21.15.89:3300/0 conn(0x7f82141c8040 msgr2=0x7f82141ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:19.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f8212cf4700 1 --2- 172.21.15.79:0/1662158445 >> v2:172.21.15.89:3300/0 conn(0x7f82141c8040 0x7f82141ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f8212cf4700 1 -- 172.21.15.79:0/1662158445 >> v1:172.21.15.79:6789/0 conn(0x7f82140f5550 legacy=0x7f82140f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.973 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82124f3700 1 -- 172.21.15.79:0/1662158445 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 415283280 0 0) 0x7f8204001650 con 0x7f82140f5550 2021-04-09T18:35:19.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f8212cf4700 1 -- 172.21.15.79:0/1662158445 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82140e5700 con 0x7f82140e9b10 2021-04-09T18:35:19.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f8212cf4700 1 --2- 172.21.15.79:0/1662158445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82140e9b10 0x7f821409f110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f8204001df0 tx=0x7f820800bcc0).ready entity=mon.2 client_cookie=377d0ec608b65373 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:19.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82124f3700 1 -- 172.21.15.79:0/1662158445 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f82140e5700 con 0x7f82140e9b10 2021-04-09T18:35:19.974 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82124f3700 1 -- 172.21.15.79:0/1662158445 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82080096c0 con 0x7f82140e9b10 2021-04-09T18:35:19.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82124f3700 1 -- 172.21.15.79:0/1662158445 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8204001bb0 con 0x7f82140e9b10 2021-04-09T18:35:19.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82197ab700 1 -- 172.21.15.79:0/1662158445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82140e9b10 msgr2=0x7f821409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.975 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82197ab700 1 --2- 172.21.15.79:0/1662158445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82140e9b10 0x7f821409f110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f8204001df0 tx=0x7f820800bcc0).stop 2021-04-09T18:35:19.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82197ab700 1 -- 172.21.15.79:0/1662158445 shutdown_connections 2021-04-09T18:35:19.976 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82197ab700 1 --2- 172.21.15.79:0/1662158445 >> v2:172.21.15.89:3300/0 conn(0x7f82141c8040 0x7f82141ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82197ab700 1 --2- 172.21.15.79:0/1662158445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82140e9b10 0x7f821409f110 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82197ab700 1 -- 172.21.15.79:0/1662158445 >> 172.21.15.79:0/1662158445 conn(0x7f82140e6010 msgr2=0x7f82140e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:19.977 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82197ab700 1 -- 172.21.15.79:0/1662158445 shutdown_connections 2021-04-09T18:35:19.978 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.959 7f82197ab700 1 -- 172.21.15.79:0/1662158445 wait complete. 2021-04-09T18:35:19.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.963 7f82197ab700 1 Processor -- start 2021-04-09T18:35:19.982 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.963 7f82197ab700 1 -- start start 2021-04-09T18:35:19.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f82197ab700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f821419e770 0x7f821419dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f82197ab700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82140c3710 0x7f82141a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.983 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f82197ab700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82140c3b60 0x7f82140d5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f82197ab700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82140e1ac0 con 0x7f821419e770 2021-04-09T18:35:19.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f82197ab700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82141a0250 con 0x7f82140c3710 2021-04-09T18:35:19.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f82197ab700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82140a51f0 con 0x7f82140c3b60 2021-04-09T18:35:19.984 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f82134f5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f821419e770 0x7f821419dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f82134f5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f821419e770 0x7f821419dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35094/0 (socket says 172.21.15.79:35094) 2021-04-09T18:35:19.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f82134f5700 1 -- 172.21.15.79:0/1755282696 learned_addr learned my addr 172.21.15.79:0/1755282696 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:19.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f8213cf6700 1 --2- 172.21.15.79:0/1755282696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82140c3b60 0x7f82140d5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.985 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f8212cf4700 1 --2- 172.21.15.79:0/1755282696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82140c3710 0x7f82141a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f82134f5700 1 -- 172.21.15.79:0/1755282696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82140c3b60 msgr2=0x7f82140d5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f82134f5700 1 --2- 172.21.15.79:0/1755282696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82140c3b60 0x7f82140d5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.986 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f82134f5700 1 -- 172.21.15.79:0/1755282696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82140c3710 msgr2=0x7f82141a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:19.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f82134f5700 1 --2- 172.21.15.79:0/1755282696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82140c3710 0x7f82141a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:19.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f82134f5700 1 -- 172.21.15.79:0/1755282696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821419e2e0 con 0x7f821419e770 2021-04-09T18:35:19.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f82134f5700 1 --2- 172.21.15.79:0/1755282696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f821419e770 0x7f821419dcb0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f8204001e30 tx=0x7f820400cb50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:19.987 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f81fbfff700 1 -- 172.21.15.79:0/1755282696 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f821419e2e0 con 0x7f821419e770 2021-04-09T18:35:19.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f81fbfff700 1 -- 172.21.15.79:0/1755282696 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8204007170 con 0x7f821419e770 2021-04-09T18:35:19.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f82197ab700 1 -- 172.21.15.79:0/1755282696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82141a0b80 con 0x7f821419e770 2021-04-09T18:35:19.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f81fbfff700 1 -- 172.21.15.79:0/1755282696 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f82040048e0 con 0x7f821419e770 2021-04-09T18:35:19.988 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f82197ab700 1 -- 172.21.15.79:0/1755282696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82140d5840 con 0x7f821419e770 2021-04-09T18:35:19.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f81fbfff700 1 -- 172.21.15.79:0/1755282696 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8204004ae0 con 0x7f821419e770 2021-04-09T18:35:19.989 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f81fbfff700 1 --2- 172.21.15.79:0/1755282696 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f81f4029100 0x7f81f402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:19.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f81fbfff700 1 -- 172.21.15.79:0/1755282696 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f82040393e0 con 0x7f821419e770 2021-04-09T18:35:19.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.967 7f8212cf4700 1 --2- 172.21.15.79:0/1755282696 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f81f4029100 0x7f81f402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:19.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.971 7f8212cf4700 1 --2- 172.21.15.79:0/1755282696 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f81f4029100 0x7f81f402b650 crc :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:19.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.971 7f82197ab700 1 -- 172.21.15.79:0/1755282696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82140e39f0 con 0x7f821419e770 2021-04-09T18:35:19.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:19.979 7f81fbfff700 1 -- 172.21.15.79:0/1755282696 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f82040046d0 con 0x7f821419e770 2021-04-09T18:35:20.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.135 7f82197ab700 1 -- 172.21.15.79:0/1755282696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f82140a1c90 con 0x7f821419e770 2021-04-09T18:35:20.143 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.139 7f81fbfff700 1 -- 172.21.15.79:0/1755282696 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v126) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8214107f80 con 0x7f821419e770 2021-04-09T18:35:20.144 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:35:20.146 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.139 7f82197ab700 1 -- 172.21.15.79:0/1755282696 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f81f4029100 msgr2=0x7f81f402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:20.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.139 7f82197ab700 1 --2- 172.21.15.79:0/1755282696 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f81f4029100 0x7f81f402b650 crc :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:20.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.139 7f82197ab700 1 -- 172.21.15.79:0/1755282696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f821419e770 msgr2=0x7f821419dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:20.147 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.139 7f82197ab700 1 --2- 172.21.15.79:0/1755282696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f821419e770 0x7f821419dcb0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f8204001e30 tx=0x7f820400cb50).stop 2021-04-09T18:35:20.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.139 7f82197ab700 1 -- 172.21.15.79:0/1755282696 shutdown_connections 2021-04-09T18:35:20.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.139 7f82197ab700 1 --2- 172.21.15.79:0/1755282696 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f81f4029100 0x7f81f402b650 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:20.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.139 7f82197ab700 1 --2- 172.21.15.79:0/1755282696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82140c3b60 0x7f82140d5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:20.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.139 7f82197ab700 1 --2- 172.21.15.79:0/1755282696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f821419e770 0x7f821419dcb0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:20.148 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.139 7f82197ab700 1 --2- 172.21.15.79:0/1755282696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82140c3710 0x7f82141a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:20.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.139 7f82197ab700 1 -- 172.21.15.79:0/1755282696 >> 172.21.15.79:0/1755282696 conn(0x7f821409a340 msgr2=0x7f82140d8380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:20.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.139 7f82197ab700 1 -- 172.21.15.79:0/1755282696 shutdown_connections 2021-04-09T18:35:20.149 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.139 7f82197ab700 1 -- 172.21.15.79:0/1755282696 wait complete. 2021-04-09T18:35:20.157 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:35:20.158 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:35:20.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.263 7fe56f207700 1 Processor -- start 2021-04-09T18:35:20.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.263 7fe56f207700 1 -- start start 2021-04-09T18:35:20.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe56f207700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe5680e9ae0 0x7fe56809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:20.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe56f207700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe5681c8010 0x7fe5681ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:20.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe56f207700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5680fbb20 con 0x7fe5680f5520 2021-04-09T18:35:20.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe56f207700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5681c3dc0 con 0x7fe5680e9ae0 2021-04-09T18:35:20.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe56f207700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5680e9f30 con 0x7fe5681c8010 2021-04-09T18:35:20.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe567fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe5680e9ae0 0x7fe56809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:20.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe56cfab700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe5680f5520 0x7fe5680f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58044/0 (socket says 172.21.15.79:58044) 2021-04-09T18:35:20.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe56cfab700 1 -- 172.21.15.79:0/2608125841 learned_addr learned my addr 172.21.15.79:0/2608125841 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:20.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe56d7ac700 1 --2- 172.21.15.79:0/2608125841 >> v2:172.21.15.89:3300/0 conn(0x7fe5681c8010 0x7fe5681ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:20.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe567fff700 1 -- 172.21.15.79:0/2608125841 >> v2:172.21.15.89:3300/0 conn(0x7fe5681c8010 msgr2=0x7fe5681ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:20.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe567fff700 1 --2- 172.21.15.79:0/2608125841 >> v2:172.21.15.89:3300/0 conn(0x7fe5681c8010 0x7fe5681ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:20.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe567fff700 1 -- 172.21.15.79:0/2608125841 >> v1:172.21.15.79:6789/0 conn(0x7fe5680f5520 legacy=0x7fe5680f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:20.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe5677fe700 1 -- 172.21.15.79:0/2608125841 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230790067 0 0) 0x7fe5580010d0 con 0x7fe5680f5520 2021-04-09T18:35:20.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe567fff700 1 -- 172.21.15.79:0/2608125841 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5680e56d0 con 0x7fe5680e9ae0 2021-04-09T18:35:20.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe567fff700 1 --2- 172.21.15.79:0/2608125841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5680e9ae0 0x7fe56809f110 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7fe55c002f30 tx=0x7fe55c00bd10).ready entity=mon.0 client_cookie=c6eba6399630d5a7 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:20.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe5677fe700 1 -- 172.21.15.79:0/2608125841 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe5680e56d0 con 0x7fe5680e9ae0 2021-04-09T18:35:20.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe5677fe700 1 -- 172.21.15.79:0/2608125841 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c0098a0 con 0x7fe5680e9ae0 2021-04-09T18:35:20.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe5677fe700 1 -- 172.21.15.79:0/2608125841 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe55c009c70 con 0x7fe5680e9ae0 2021-04-09T18:35:20.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe56f207700 1 -- 172.21.15.79:0/2608125841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5680e9ae0 msgr2=0x7fe56809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:20.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe56f207700 1 --2- 172.21.15.79:0/2608125841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5680e9ae0 0x7fe56809f110 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7fe55c002f30 tx=0x7fe55c00bd10).stop 2021-04-09T18:35:20.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe56f207700 1 -- 172.21.15.79:0/2608125841 shutdown_connections 2021-04-09T18:35:20.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe56f207700 1 --2- 172.21.15.79:0/2608125841 >> v2:172.21.15.89:3300/0 conn(0x7fe5681c8010 0x7fe5681ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:20.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe56f207700 1 --2- 172.21.15.79:0/2608125841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5680e9ae0 0x7fe56809f110 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:20.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe56f207700 1 -- 172.21.15.79:0/2608125841 >> 172.21.15.79:0/2608125841 conn(0x7fe5680e5fe0 msgr2=0x7fe5680e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:20.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe56f207700 1 -- 172.21.15.79:0/2608125841 shutdown_connections 2021-04-09T18:35:20.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.267 7fe56f207700 1 -- 172.21.15.79:0/2608125841 wait complete. 2021-04-09T18:35:20.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.271 7fe56f207700 1 Processor -- start 2021-04-09T18:35:20.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.271 7fe56f207700 1 -- start start 2021-04-09T18:35:20.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.271 7fe56f207700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5680b7a60 0x7fe5680960b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:20.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.271 7fe56f207700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5680ba2b0 0x7fe568091b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:20.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.271 7fe56f207700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe568092190 0x7fe5681a5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:20.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.271 7fe56f207700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5680ba700 con 0x7fe568092190 2021-04-09T18:35:20.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.271 7fe56f207700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5680925e0 con 0x7fe5680b7a60 2021-04-09T18:35:20.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.271 7fe56f207700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56808fe50 con 0x7fe5680ba2b0 2021-04-09T18:35:20.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.271 7fe56d7ac700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe568092190 0x7fe5681a5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:20.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.271 7fe56d7ac700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe568092190 0x7fe5681a5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35110/0 (socket says 172.21.15.79:35110) 2021-04-09T18:35:20.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.271 7fe56d7ac700 1 -- 172.21.15.79:0/2988386094 learned_addr learned my addr 172.21.15.79:0/2988386094 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:20.288 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.271 7fe56cfab700 1 --2- 172.21.15.79:0/2988386094 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5680b7a60 0x7fe5680960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:20.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.271 7fe567fff700 1 --2- 172.21.15.79:0/2988386094 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5680ba2b0 0x7fe568091b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:20.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.271 7fe56d7ac700 1 -- 172.21.15.79:0/2988386094 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5680ba2b0 msgr2=0x7fe568091b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:20.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.271 7fe56d7ac700 1 --2- 172.21.15.79:0/2988386094 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5680ba2b0 0x7fe568091b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:20.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.271 7fe56d7ac700 1 -- 172.21.15.79:0/2988386094 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5680b7a60 msgr2=0x7fe5680960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:20.289 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.271 7fe56d7ac700 1 --2- 172.21.15.79:0/2988386094 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5680b7a60 0x7fe5680960b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:20.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.271 7fe56d7ac700 1 -- 172.21.15.79:0/2988386094 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5681a64f0 con 0x7fe568092190 2021-04-09T18:35:20.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.275 7fe56d7ac700 1 --2- 172.21.15.79:0/2988386094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe568092190 0x7fe5681a5ec0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7fe560006de0 tx=0x7fe56000c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:20.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.275 7fe5657fa700 1 -- 172.21.15.79:0/2988386094 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe5681a64f0 con 0x7fe568092190 2021-04-09T18:35:20.290 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.275 7fe5657fa700 1 -- 172.21.15.79:0/2988386094 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56000cca0 con 0x7fe568092190 2021-04-09T18:35:20.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.275 7fe5657fa700 1 -- 172.21.15.79:0/2988386094 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe56000f040 con 0x7fe568092190 2021-04-09T18:35:20.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.275 7fe56f207700 1 -- 172.21.15.79:0/2988386094 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5681a6810 con 0x7fe568092190 2021-04-09T18:35:20.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.275 7fe56f207700 1 -- 172.21.15.79:0/2988386094 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5680b8010 con 0x7fe568092190 2021-04-09T18:35:20.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.275 7fe5657fa700 1 -- 172.21.15.79:0/2988386094 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe560022060 con 0x7fe568092190 2021-04-09T18:35:20.291 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.275 7fe5657fa700 1 --2- 172.21.15.79:0/2988386094 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe548029100 0x7fe54802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:20.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.275 7fe5657fa700 1 -- 172.21.15.79:0/2988386094 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fe560010040 con 0x7fe568092190 2021-04-09T18:35:20.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.275 7fe56cfab700 1 --2- 172.21.15.79:0/2988386094 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe548029100 0x7fe54802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:20.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.275 7fe56cfab700 1 --2- 172.21.15.79:0/2988386094 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe548029100 0x7fe54802b650 crc :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:20.292 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.279 7fe56f207700 1 -- 172.21.15.79:0/2988386094 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5680e39e0 con 0x7fe568092190 2021-04-09T18:35:20.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.287 7fe5657fa700 1 -- 172.21.15.79:0/2988386094 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe56000ca90 con 0x7fe568092190 2021-04-09T18:35:20.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.458 7fe56f207700 1 -- 172.21.15.79:0/2988386094 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5680f5b20 con 0x7fe568092190 2021-04-09T18:35:20.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.458 7fe5657fa700 1 -- 172.21.15.79:0/2988386094 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+2105 (secure 0 0 0) 0x7fe5680f76c0 con 0x7fe568092190 2021-04-09T18:35:20.468 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:20.468 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":79,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7842,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1552365531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1552365531},{"type":"v1","addr":"172.21.15.89:6835","nonce":1552365531}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":77}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:35:13.180244","modified":"2021-04-09 18:35:15.198467","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7833},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7833":{"gid":7833,"name":"a","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/4102869700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4102869700},{"type":"v1","addr":"172.21.15.79:6833","nonce":4102869700}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-04-09T18:35:20.468 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 79 2021-04-09T18:35:20.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.462 7fe56f207700 1 -- 172.21.15.79:0/2988386094 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe548029100 msgr2=0x7fe54802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:20.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.462 7fe56f207700 1 --2- 172.21.15.79:0/2988386094 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe548029100 0x7fe54802b650 crc :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:20.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.462 7fe56f207700 1 -- 172.21.15.79:0/2988386094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe568092190 msgr2=0x7fe5681a5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:20.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.462 7fe56f207700 1 --2- 172.21.15.79:0/2988386094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe568092190 0x7fe5681a5ec0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7fe560006de0 tx=0x7fe56000c430).stop 2021-04-09T18:35:20.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.462 7fe56f207700 1 -- 172.21.15.79:0/2988386094 shutdown_connections 2021-04-09T18:35:20.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.462 7fe56f207700 1 --2- 172.21.15.79:0/2988386094 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe548029100 0x7fe54802b650 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:20.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.462 7fe56f207700 1 --2- 172.21.15.79:0/2988386094 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5680b7a60 0x7fe5680960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:20.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.462 7fe56f207700 1 --2- 172.21.15.79:0/2988386094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe568092190 0x7fe5681a5ec0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:20.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.462 7fe56f207700 1 --2- 172.21.15.79:0/2988386094 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5680ba2b0 0x7fe568091b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:20.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.462 7fe56f207700 1 -- 172.21.15.79:0/2988386094 >> 172.21.15.79:0/2988386094 conn(0x7fe568094fb0 msgr2=0x7fe568092a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:20.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.462 7fe56f207700 1 -- 172.21.15.79:0/2988386094 shutdown_connections 2021-04-09T18:35:20.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:20.462 7fe56f207700 1 -- 172.21.15.79:0/2988386094 wait complete. 2021-04-09T18:35:20.682 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 79, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:35:13.180244', 'modified': '2021-04-09 18:35:15.198467', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7833}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7833': {'gid': 7833, 'name': 'a', 'rank': 0, 'incarnation': 78, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6833/4102869700', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 4102869700}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 4102869700}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:35:20.683 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:35:20.683 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2021-04-09T18:35:20.787 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:35:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:35:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2021-04-09T18:35:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 7833, 2021-04-09T18:35:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2021-04-09T18:35:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2021-04-09T18:35:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 6.5849665999999996, 2021-04-09T18:35:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 79, 2021-04-09T18:35:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 126, 2021-04-09T18:35:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 126, 2021-04-09T18:35:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 11.257853397 2021-04-09T18:35:20.789 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:35:20.793 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 7833, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.5849665999999996, "mdsmap_epoch": 79, "osdmap_epoch": 126, "osdmap_epoch_barrier": 126, "uptime": 11.257853397 } 2021-04-09T18:35:20.794 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:35:20.794 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-04-09T18:35:20.795 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi136.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-04-09T18:35:20.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:20.796 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:20.807 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:35:20.876 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:35:20.877 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:35:20.937 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:35:20.939 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:35:20.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:20.940 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:35:20.991 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:35:20.992 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:21.041 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:35:21.063 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:35:21.063 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:35:21.118 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:2021-04-09 18:35:21.111 7f3883d930c0 -1 init, newargv = 0x5586227087c0 newargc=9ceph-fuse[13705]: starting ceph client 2021-04-09T18:35:21.118 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr: 2021-04-09T18:35:21.124 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:35:21.125 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:35:21.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:21.128 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:35:21.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13705]: starting fuse 2021-04-09T18:35:21.183 INFO:teuthology.orchestra.run.smithi136.stdout:49 2021-04-09T18:35:21.184 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:35:21.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:21.185 DEBUG:teuthology.orchestra.run.smithi136:> sudo python3 -c ' 2021-04-09T18:35:21.185 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2021-04-09T18:35:21.186 DEBUG:teuthology.orchestra.run.smithi136:> import re 2021-04-09T18:35:21.186 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-04-09T18:35:21.187 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2021-04-09T18:35:21.188 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:35:21.188 DEBUG:teuthology.orchestra.run.smithi136:> def find_socket(client_name): 2021-04-09T18:35:21.189 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-04-09T18:35:21.189 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2021-04-09T18:35:21.190 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:35:21.190 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2021-04-09T18:35:21.191 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2021-04-09T18:35:21.191 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2021-04-09T18:35:21.192 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2021-04-09T18:35:21.192 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:35:21.193 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2021-04-09T18:35:21.194 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:35:21.194 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:35:21.195 DEBUG:teuthology.orchestra.run.smithi136:> return f 2021-04-09T18:35:21.195 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:35:21.197 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:35:21.197 DEBUG:teuthology.orchestra.run.smithi136:> print(find_socket("client.1")) 2021-04-09T18:35:21.198 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-04-09T18:35:21.279 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.1.13705.asok 2021-04-09T18:35:21.284 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13705.asok 2021-04-09T18:35:21.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:21.285 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13705.asok status 2021-04-09T18:35:21.411 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2021-04-09T18:35:21.411 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2021-04-09T18:35:21.412 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:35:21.412 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:35:21.412 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "1", 2021-04-09T18:35:21.412 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2021-04-09T18:35:21.413 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-04-09T18:35:21.413 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "13705", 2021-04-09T18:35:21.413 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2021-04-09T18:35:21.413 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:35:21.413 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2021-04-09T18:35:21.414 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2021-04-09T18:35:21.414 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 8017, 2021-04-09T18:35:21.414 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2021-04-09T18:35:21.414 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2021-04-09T18:35:21.415 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2021-04-09T18:35:21.415 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 8017 2021-04-09T18:35:21.415 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:35:21.415 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-04-09T18:35:21.415 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-04-09T18:35:21.416 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-04-09T18:35:21.416 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 1307122495 2021-04-09T18:35:21.416 INFO:teuthology.orchestra.run.smithi136.stdout: } 2021-04-09T18:35:21.416 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:35:21.416 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-04-09T18:35:21.417 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-04-09T18:35:21.417 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-04-09T18:35:21.417 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 1307122495 2021-04-09T18:35:21.417 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:35:21.418 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.8017 172.21.15.136:0/1307122495", 2021-04-09T18:35:21.418 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "172.21.15.136:0/1307122495", 2021-04-09T18:35:21.418 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2021-04-09T18:35:21.418 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 79, 2021-04-09T18:35:21.418 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 126, 2021-04-09T18:35:21.419 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:35:21.419 INFO:teuthology.orchestra.run.smithi136.stdout: "blacklisted": false, 2021-04-09T18:35:21.419 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2021-04-09T18:35:21.419 INFO:teuthology.orchestra.run.smithi136.stdout:} 2021-04-09T18:35:21.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:21.421 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:21.422 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:21.439 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-04-09T18:35:21.440 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-04-09T18:35:21.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:21.442 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:21.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:21.511 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:21.512 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:21.573 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-04-09T18:35:21.574 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-04-09T18:35:21.575 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2021-04-09T18:35:21.575 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:35:21.576 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:21.663 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13705]: fuse finished with error 0 and tester_r 0 2021-04-09T18:35:21.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:21.665 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:21.666 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:21.763 INFO:teuthology.orchestra.run.smithi136.stdout:ext2/ext3 2021-04-09T18:35:21.767 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:35:21.768 INFO:teuthology.orchestra.run:waiting for 900 2021-04-09T18:35:21.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:35:21.769 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:21.823 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-04-09T18:35:21.828 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-04-09T18:35:21.838 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-04-09T18:35:21.849 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-04-09T18:35:21.875 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-04-09T18:35:21.884 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2021-04-09T18:35:21.884 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2021-04-09T18:35:21.884 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-04-09T18:35:21.884 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2021-04-09T18:35:21.885 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.885 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2021-04-09T18:35:21.885 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.885 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2021-04-09T18:35:21.886 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.886 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2021-04-09T18:35:21.886 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2021-04-09T18:35:21.887 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.887 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2021-04-09T18:35:21.887 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2021-04-09T18:35:21.887 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.887 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2021-04-09T18:35:21.888 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2021-04-09T18:35:21.888 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.888 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2021-04-09T18:35:21.888 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.889 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2021-04-09T18:35:21.889 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2021-04-09T18:35:21.890 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2021-04-09T18:35:21.890 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2021-04-09T18:35:21.890 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2021-04-09T18:35:21.890 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2021-04-09T18:35:21.891 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2021-04-09T18:35:21.891 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-04-09T18:35:21.891 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2021-04-09T18:35:21.891 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.891 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-04-09T18:35:21.892 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.892 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2021-04-09T18:35:21.892 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.892 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2021-04-09T18:35:21.893 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.893 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2021-04-09T18:35:21.893 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2021-04-09T18:35:21.893 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2021-04-09T18:35:21.893 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.894 INFO:teuthology.orchestra.run.smithi079.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-04-09T18:35:21.894 INFO:teuthology.orchestra.run.smithi079.stdout: mon_client_directed_command_retry = 4 2021-04-09T18:35:21.894 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.79,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2021-04-09T18:35:21.894 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = fc927781-121d-4817-b30c-0c6f9e107f84 2021-04-09T18:35:21.895 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.895 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2021-04-09T18:35:21.895 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2021-04-09T18:35:21.895 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.895 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2021-04-09T18:35:21.896 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2021-04-09T18:35:21.896 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.896 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2021-04-09T18:35:21.897 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2021-04-09T18:35:21.897 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.897 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2021-04-09T18:35:21.898 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2021-04-09T18:35:21.898 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2021-04-09T18:35:21.898 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.898 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2021-04-09T18:35:21.898 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2021-04-09T18:35:21.899 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.900 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2021-04-09T18:35:21.900 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.901 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2021-04-09T18:35:21.901 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.902 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2021-04-09T18:35:21.902 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.902 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2021-04-09T18:35:21.903 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2021-04-09T18:35:21.903 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.904 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2021-04-09T18:35:21.904 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2021-04-09T18:35:21.904 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2021-04-09T18:35:21.905 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2021-04-09T18:35:21.905 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 20 2021-04-09T18:35:21.906 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 20 2021-04-09T18:35:21.906 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2021-04-09T18:35:21.907 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2021-04-09T18:35:21.907 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 10 2021-04-09T18:35:21.907 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2021-04-09T18:35:21.908 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2021-04-09T18:35:21.908 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2021-04-09T18:35:21.909 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2021-04-09T18:35:21.909 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2021-04-09T18:35:21.910 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2021-04-09T18:35:21.910 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.910 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2021-04-09T18:35:21.911 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2021-04-09T18:35:21.911 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2021-04-09T18:35:21.911 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2021-04-09T18:35:21.911 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2021-04-09T18:35:21.911 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:35:21.912 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:35:21.912 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.912 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2021-04-09T18:35:21.912 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2021-04-09T18:35:21.913 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2021-04-09T18:35:21.913 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2021-04-09T18:35:21.913 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2021-04-09T18:35:21.913 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2021-04-09T18:35:21.913 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2021-04-09T18:35:21.914 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:35:21.914 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2021-04-09T18:35:21.914 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2021-04-09T18:35:21.914 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:35:21.915 INFO:teuthology.orchestra.run.smithi079.stdout: mon op complaint time = 120 2021-04-09T18:35:21.915 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:21.915 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2021-04-09T18:35:21.915 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2021-04-09T18:35:21.916 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2021-04-09T18:35:21.916 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2021-04-09T18:35:21.916 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-04-09T18:35:21.916 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-04-09T18:35:21.916 INFO:teuthology.orchestra.run.smithi079.stdout: client mount timeout = 600 2021-04-09T18:35:21.917 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2021-04-09T18:35:21.917 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2021-04-09T18:35:21.917 INFO:teuthology.orchestra.run.smithi079.stdout: client debug getattr caps = true 2021-04-09T18:35:21.918 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2021-04-09T18:35:21.918 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2021-04-09T18:35:21.918 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2021-04-09T18:35:21.918 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2021-04-09T18:35:21.919 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2021-04-09T18:35:21.919 INFO:teuthology.orchestra.run.smithi079.stdout:[mds] 2021-04-09T18:35:21.919 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds = 20 2021-04-09T18:35:21.919 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2021-04-09T18:35:21.920 INFO:teuthology.orchestra.run.smithi079.stdout: mds bal frag = True 2021-04-09T18:35:21.920 INFO:teuthology.orchestra.run.smithi079.stdout: mds bal fragment size max = 10000 2021-04-09T18:35:21.920 INFO:teuthology.orchestra.run.smithi079.stdout: mds bal merge size = 5 2021-04-09T18:35:21.920 INFO:teuthology.orchestra.run.smithi079.stdout: mds bal split bits = 3 2021-04-09T18:35:21.920 INFO:teuthology.orchestra.run.smithi079.stdout: mds bal split size = 100 2021-04-09T18:35:21.921 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug frag = True 2021-04-09T18:35:21.921 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug scatterstat = True 2021-04-09T18:35:21.921 INFO:teuthology.orchestra.run.smithi079.stdout: mds op complaint time = 180 2021-04-09T18:35:21.921 INFO:teuthology.orchestra.run.smithi079.stdout: mds verify scatter = True 2021-04-09T18:35:21.922 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2021-04-09T18:35:21.925 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2021-04-09T18:35:21.926 INFO:teuthology.orchestra.run.smithi144.stdout: chdir = "" 2021-04-09T18:35:21.926 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-04-09T18:35:21.926 INFO:teuthology.orchestra.run.smithi144.stdout: auth supported = cephx 2021-04-09T18:35:21.926 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.927 INFO:teuthology.orchestra.run.smithi144.stdout: filestore xattr use omap = true 2021-04-09T18:35:21.927 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.927 INFO:teuthology.orchestra.run.smithi144.stdout: mon clock drift allowed = 1.000 2021-04-09T18:35:21.927 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.928 INFO:teuthology.orchestra.run.smithi144.stdout: osd crush chooseleaf type = 0 2021-04-09T18:35:21.928 INFO:teuthology.orchestra.run.smithi144.stdout: auth debug = true 2021-04-09T18:35:21.929 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.929 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on old message = true 2021-04-09T18:35:21.929 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on bug = true 2021-04-09T18:35:21.929 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.930 INFO:teuthology.orchestra.run.smithi144.stdout: mon max pg per osd = 10000 # >= luminous 2021-04-09T18:35:21.930 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn max object skew = 0 2021-04-09T18:35:21.930 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.930 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default size = 2 2021-04-09T18:35:21.931 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.931 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow primary affinity = true 2021-04-09T18:35:21.931 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow pg remap = true 2021-04-09T18:35:21.932 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on legacy crush tunables = false 2021-04-09T18:35:21.932 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on crush straw calc version zero = false 2021-04-09T18:35:21.932 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on no sortbitwise = false 2021-04-09T18:35:21.933 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on osd down out interval zero = false 2021-04-09T18:35:21.933 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on too few osds = false 2021-04-09T18:35:21.933 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-04-09T18:35:21.933 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_no_redundancy = false 2021-04-09T18:35:21.933 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.934 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-04-09T18:35:21.934 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.934 INFO:teuthology.orchestra.run.smithi144.stdout: osd default data pool replay window = 5 2021-04-09T18:35:21.935 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.935 INFO:teuthology.orchestra.run.smithi144.stdout: mon allow pool delete = true 2021-04-09T18:35:21.935 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.936 INFO:teuthology.orchestra.run.smithi144.stdout: mon cluster log file level = debug 2021-04-09T18:35:21.936 INFO:teuthology.orchestra.run.smithi144.stdout: debug asserts on shutdown = true 2021-04-09T18:35:21.937 INFO:teuthology.orchestra.run.smithi144.stdout: mon health detail to clog = false 2021-04-09T18:35:21.937 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.937 INFO:teuthology.orchestra.run.smithi144.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-04-09T18:35:21.938 INFO:teuthology.orchestra.run.smithi144.stdout: mon_client_directed_command_retry = 4 2021-04-09T18:35:21.938 INFO:teuthology.orchestra.run.smithi144.stdout: mon host = "172.21.15.79,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2021-04-09T18:35:21.939 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = fc927781-121d-4817-b30c-0c6f9e107f84 2021-04-09T18:35:21.939 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.939 INFO:teuthology.orchestra.run.smithi144.stdout:[osd] 2021-04-09T18:35:21.939 INFO:teuthology.orchestra.run.smithi144.stdout: osd journal size = 100 2021-04-09T18:35:21.940 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.940 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub load threshold = 5.0 2021-04-09T18:35:21.940 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub max interval = 600 2021-04-09T18:35:21.940 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.940 INFO:teuthology.orchestra.run.smithi144.stdout: osd recover clone overlap = true 2021-04-09T18:35:21.941 INFO:teuthology.orchestra.run.smithi144.stdout: osd recovery max chunk = 1048576 2021-04-09T18:35:21.941 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.941 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug shutdown = true 2021-04-09T18:35:21.941 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug op order = true 2021-04-09T18:35:21.941 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug verify stray on activate = true 2021-04-09T18:35:21.942 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.942 INFO:teuthology.orchestra.run.smithi144.stdout: osd open classes on start = true 2021-04-09T18:35:21.942 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug pg log writeout = true 2021-04-09T18:35:21.942 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.942 INFO:teuthology.orchestra.run.smithi144.stdout: osd deep scrub update digest min age = 30 2021-04-09T18:35:21.943 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.943 INFO:teuthology.orchestra.run.smithi144.stdout: osd map max advance = 10 2021-04-09T18:35:21.943 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.943 INFO:teuthology.orchestra.run.smithi144.stdout: journal zero on create = true 2021-04-09T18:35:21.944 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.944 INFO:teuthology.orchestra.run.smithi144.stdout: filestore ondisk finisher threads = 3 2021-04-09T18:35:21.944 INFO:teuthology.orchestra.run.smithi144.stdout: filestore apply finisher threads = 3 2021-04-09T18:35:21.944 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.944 INFO:teuthology.orchestra.run.smithi144.stdout: bdev debug aio = true 2021-04-09T18:35:21.945 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug misdirected ops = true 2021-04-09T18:35:21.945 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore block size = 96636764160 2021-04-09T18:35:21.945 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore fsck on mount = True 2021-04-09T18:35:21.945 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluefs = 20 2021-04-09T18:35:21.945 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluestore = 20 2021-04-09T18:35:21.946 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2021-04-09T18:35:21.946 INFO:teuthology.orchestra.run.smithi144.stdout: debug osd = 20 2021-04-09T18:35:21.946 INFO:teuthology.orchestra.run.smithi144.stdout: debug rocksdb = 10 2021-04-09T18:35:21.946 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull_ratio = 0.85 2021-04-09T18:35:21.947 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.9 2021-04-09T18:35:21.947 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.8 2021-04-09T18:35:21.947 INFO:teuthology.orchestra.run.smithi144.stdout: osd failsafe full ratio = 0.95 2021-04-09T18:35:21.947 INFO:teuthology.orchestra.run.smithi144.stdout: osd objectstore = bluestore 2021-04-09T18:35:21.948 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2021-04-09T18:35:21.948 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.948 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr] 2021-04-09T18:35:21.948 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2021-04-09T18:35:21.948 INFO:teuthology.orchestra.run.smithi144.stdout: debug mgr = 20 2021-04-09T18:35:21.949 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2021-04-09T18:35:21.949 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2021-04-09T18:35:21.949 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:35:21.949 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:35:21.949 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.950 INFO:teuthology.orchestra.run.smithi144.stdout:[mon] 2021-04-09T18:35:21.950 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2021-04-09T18:35:21.950 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2021-04-09T18:35:21.950 INFO:teuthology.orchestra.run.smithi144.stdout: debug paxos = 20 2021-04-09T18:35:21.951 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2021-04-09T18:35:21.951 INFO:teuthology.orchestra.run.smithi144.stdout: mon data avail warn = 5 2021-04-09T18:35:21.951 INFO:teuthology.orchestra.run.smithi144.stdout: mon mgr mkfs grace = 240 2021-04-09T18:35:21.951 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:35:21.951 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd reporter subtree level = osd 2021-04-09T18:35:21.952 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd prime pg temp = true 2021-04-09T18:35:21.952 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:35:21.952 INFO:teuthology.orchestra.run.smithi144.stdout: mon op complaint time = 120 2021-04-09T18:35:21.952 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:21.952 INFO:teuthology.orchestra.run.smithi144.stdout:[client] 2021-04-09T18:35:21.953 INFO:teuthology.orchestra.run.smithi144.stdout: rgw cache enabled = true 2021-04-09T18:35:21.953 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable ops log = true 2021-04-09T18:35:21.953 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable usage log = true 2021-04-09T18:35:21.953 INFO:teuthology.orchestra.run.smithi144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-04-09T18:35:21.953 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-04-09T18:35:21.954 INFO:teuthology.orchestra.run.smithi144.stdout: client mount timeout = 600 2021-04-09T18:35:21.954 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2021-04-09T18:35:21.954 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2021-04-09T18:35:21.954 INFO:teuthology.orchestra.run.smithi144.stdout: client debug getattr caps = true 2021-04-09T18:35:21.955 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.a] 2021-04-09T18:35:21.955 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.b] 2021-04-09T18:35:21.955 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.c] 2021-04-09T18:35:21.955 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2021-04-09T18:35:21.956 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2021-04-09T18:35:21.956 INFO:teuthology.orchestra.run.smithi144.stdout:[mds] 2021-04-09T18:35:21.956 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds = 20 2021-04-09T18:35:21.956 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2021-04-09T18:35:21.956 INFO:teuthology.orchestra.run.smithi144.stdout: mds bal frag = True 2021-04-09T18:35:21.957 INFO:teuthology.orchestra.run.smithi144.stdout: mds bal fragment size max = 10000 2021-04-09T18:35:21.957 INFO:teuthology.orchestra.run.smithi144.stdout: mds bal merge size = 5 2021-04-09T18:35:21.957 INFO:teuthology.orchestra.run.smithi144.stdout: mds bal split bits = 3 2021-04-09T18:35:21.957 INFO:teuthology.orchestra.run.smithi144.stdout: mds bal split size = 100 2021-04-09T18:35:21.957 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug frag = True 2021-04-09T18:35:21.958 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug scatterstat = True 2021-04-09T18:35:21.958 INFO:teuthology.orchestra.run.smithi144.stdout: mds op complaint time = 180 2021-04-09T18:35:21.958 INFO:teuthology.orchestra.run.smithi144.stdout: mds verify scatter = True 2021-04-09T18:35:21.958 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2021-04-09T18:35:21.958 INFO:teuthology.orchestra.run.smithi136.stdout:[global] 2021-04-09T18:35:21.959 INFO:teuthology.orchestra.run.smithi136.stdout: chdir = "" 2021-04-09T18:35:21.959 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-04-09T18:35:21.959 INFO:teuthology.orchestra.run.smithi136.stdout: auth supported = cephx 2021-04-09T18:35:21.959 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.960 INFO:teuthology.orchestra.run.smithi136.stdout: filestore xattr use omap = true 2021-04-09T18:35:21.960 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.960 INFO:teuthology.orchestra.run.smithi136.stdout: mon clock drift allowed = 1.000 2021-04-09T18:35:21.960 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.960 INFO:teuthology.orchestra.run.smithi136.stdout: osd crush chooseleaf type = 0 2021-04-09T18:35:21.961 INFO:teuthology.orchestra.run.smithi136.stdout: auth debug = true 2021-04-09T18:35:21.961 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.961 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on old message = true 2021-04-09T18:35:21.961 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on bug = true 2021-04-09T18:35:21.961 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.962 INFO:teuthology.orchestra.run.smithi136.stdout: mon max pg per osd = 10000 # >= luminous 2021-04-09T18:35:21.962 INFO:teuthology.orchestra.run.smithi136.stdout: mon pg warn max object skew = 0 2021-04-09T18:35:21.962 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.962 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default size = 2 2021-04-09T18:35:21.963 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.963 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow primary affinity = true 2021-04-09T18:35:21.963 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow pg remap = true 2021-04-09T18:35:21.963 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on legacy crush tunables = false 2021-04-09T18:35:21.963 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on crush straw calc version zero = false 2021-04-09T18:35:21.964 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on no sortbitwise = false 2021-04-09T18:35:21.964 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on osd down out interval zero = false 2021-04-09T18:35:21.964 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on too few osds = false 2021-04-09T18:35:21.964 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-04-09T18:35:21.964 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_no_redundancy = false 2021-04-09T18:35:21.965 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.965 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-04-09T18:35:21.965 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.965 INFO:teuthology.orchestra.run.smithi136.stdout: osd default data pool replay window = 5 2021-04-09T18:35:21.966 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.966 INFO:teuthology.orchestra.run.smithi136.stdout: mon allow pool delete = true 2021-04-09T18:35:21.966 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.966 INFO:teuthology.orchestra.run.smithi136.stdout: mon cluster log file level = debug 2021-04-09T18:35:21.966 INFO:teuthology.orchestra.run.smithi136.stdout: debug asserts on shutdown = true 2021-04-09T18:35:21.967 INFO:teuthology.orchestra.run.smithi136.stdout: mon health detail to clog = false 2021-04-09T18:35:21.967 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.967 INFO:teuthology.orchestra.run.smithi136.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-04-09T18:35:21.967 INFO:teuthology.orchestra.run.smithi136.stdout: mon_client_directed_command_retry = 4 2021-04-09T18:35:21.967 INFO:teuthology.orchestra.run.smithi136.stdout: mon host = "172.21.15.79,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2021-04-09T18:35:21.968 INFO:teuthology.orchestra.run.smithi136.stdout: fsid = fc927781-121d-4817-b30c-0c6f9e107f84 2021-04-09T18:35:21.968 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.968 INFO:teuthology.orchestra.run.smithi136.stdout:[osd] 2021-04-09T18:35:21.968 INFO:teuthology.orchestra.run.smithi136.stdout: osd journal size = 100 2021-04-09T18:35:21.968 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.969 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub load threshold = 5.0 2021-04-09T18:35:21.969 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub max interval = 600 2021-04-09T18:35:21.969 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.969 INFO:teuthology.orchestra.run.smithi136.stdout: osd recover clone overlap = true 2021-04-09T18:35:21.969 INFO:teuthology.orchestra.run.smithi136.stdout: osd recovery max chunk = 1048576 2021-04-09T18:35:21.970 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.970 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug shutdown = true 2021-04-09T18:35:21.970 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug op order = true 2021-04-09T18:35:21.970 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug verify stray on activate = true 2021-04-09T18:35:21.971 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.971 INFO:teuthology.orchestra.run.smithi136.stdout: osd open classes on start = true 2021-04-09T18:35:21.971 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug pg log writeout = true 2021-04-09T18:35:21.971 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.971 INFO:teuthology.orchestra.run.smithi136.stdout: osd deep scrub update digest min age = 30 2021-04-09T18:35:21.972 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.972 INFO:teuthology.orchestra.run.smithi136.stdout: osd map max advance = 10 2021-04-09T18:35:21.972 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.972 INFO:teuthology.orchestra.run.smithi136.stdout: journal zero on create = true 2021-04-09T18:35:21.973 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.973 INFO:teuthology.orchestra.run.smithi136.stdout: filestore ondisk finisher threads = 3 2021-04-09T18:35:21.973 INFO:teuthology.orchestra.run.smithi136.stdout: filestore apply finisher threads = 3 2021-04-09T18:35:21.973 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.973 INFO:teuthology.orchestra.run.smithi136.stdout: bdev debug aio = true 2021-04-09T18:35:21.974 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug misdirected ops = true 2021-04-09T18:35:21.974 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore block size = 96636764160 2021-04-09T18:35:21.974 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore fsck on mount = True 2021-04-09T18:35:21.974 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluefs = 20 2021-04-09T18:35:21.974 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluestore = 20 2021-04-09T18:35:21.975 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-04-09T18:35:21.975 INFO:teuthology.orchestra.run.smithi136.stdout: debug osd = 20 2021-04-09T18:35:21.975 INFO:teuthology.orchestra.run.smithi136.stdout: debug rocksdb = 10 2021-04-09T18:35:21.975 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd backfillfull_ratio = 0.85 2021-04-09T18:35:21.976 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd full ratio = 0.9 2021-04-09T18:35:21.976 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd nearfull ratio = 0.8 2021-04-09T18:35:21.976 INFO:teuthology.orchestra.run.smithi136.stdout: osd failsafe full ratio = 0.95 2021-04-09T18:35:21.976 INFO:teuthology.orchestra.run.smithi136.stdout: osd objectstore = bluestore 2021-04-09T18:35:21.977 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2021-04-09T18:35:21.977 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.977 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr] 2021-04-09T18:35:21.977 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-04-09T18:35:21.977 INFO:teuthology.orchestra.run.smithi136.stdout: debug mgr = 20 2021-04-09T18:35:21.978 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2021-04-09T18:35:21.978 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2021-04-09T18:35:21.978 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:35:21.978 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:35:21.978 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.979 INFO:teuthology.orchestra.run.smithi136.stdout:[mon] 2021-04-09T18:35:21.979 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-04-09T18:35:21.979 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2021-04-09T18:35:21.979 INFO:teuthology.orchestra.run.smithi136.stdout: debug paxos = 20 2021-04-09T18:35:21.979 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2021-04-09T18:35:21.980 INFO:teuthology.orchestra.run.smithi136.stdout: mon data avail warn = 5 2021-04-09T18:35:21.980 INFO:teuthology.orchestra.run.smithi136.stdout: mon mgr mkfs grace = 240 2021-04-09T18:35:21.980 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:35:21.980 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd reporter subtree level = osd 2021-04-09T18:35:21.981 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd prime pg temp = true 2021-04-09T18:35:21.981 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:35:21.981 INFO:teuthology.orchestra.run.smithi136.stdout: mon op complaint time = 120 2021-04-09T18:35:21.981 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:21.981 INFO:teuthology.orchestra.run.smithi136.stdout:[client] 2021-04-09T18:35:21.982 INFO:teuthology.orchestra.run.smithi136.stdout: rgw cache enabled = true 2021-04-09T18:35:21.982 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable ops log = true 2021-04-09T18:35:21.982 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable usage log = true 2021-04-09T18:35:21.982 INFO:teuthology.orchestra.run.smithi136.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-04-09T18:35:21.982 INFO:teuthology.orchestra.run.smithi136.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-04-09T18:35:21.983 INFO:teuthology.orchestra.run.smithi136.stdout: client mount timeout = 600 2021-04-09T18:35:21.983 INFO:teuthology.orchestra.run.smithi136.stdout: debug client = 20 2021-04-09T18:35:21.983 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-04-09T18:35:21.983 INFO:teuthology.orchestra.run.smithi136.stdout: client debug getattr caps = true 2021-04-09T18:35:21.984 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.a] 2021-04-09T18:35:21.984 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.b] 2021-04-09T18:35:21.984 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.c] 2021-04-09T18:35:21.984 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2021-04-09T18:35:21.984 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2021-04-09T18:35:21.985 INFO:teuthology.orchestra.run.smithi136.stdout:[mds] 2021-04-09T18:35:21.985 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds = 20 2021-04-09T18:35:21.985 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-04-09T18:35:21.985 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal frag = True 2021-04-09T18:35:21.986 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal fragment size max = 10000 2021-04-09T18:35:21.986 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal merge size = 5 2021-04-09T18:35:21.986 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal split bits = 3 2021-04-09T18:35:21.986 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal split size = 100 2021-04-09T18:35:21.986 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug frag = True 2021-04-09T18:35:21.987 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug scatterstat = True 2021-04-09T18:35:21.987 INFO:teuthology.orchestra.run.smithi136.stdout: mds op complaint time = 180 2021-04-09T18:35:21.987 INFO:teuthology.orchestra.run.smithi136.stdout: mds verify scatter = True 2021-04-09T18:35:21.987 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2021-04-09T18:35:21.988 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2021-04-09T18:35:21.988 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2021-04-09T18:35:21.988 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-04-09T18:35:21.988 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2021-04-09T18:35:21.989 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:21.989 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2021-04-09T18:35:21.989 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:21.989 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2021-04-09T18:35:21.989 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:21.990 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2021-04-09T18:35:21.990 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2021-04-09T18:35:21.990 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:21.990 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2021-04-09T18:35:21.990 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2021-04-09T18:35:21.991 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:21.991 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2021-04-09T18:35:21.991 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2021-04-09T18:35:21.991 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:21.992 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2021-04-09T18:35:21.992 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:21.992 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2021-04-09T18:35:21.992 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2021-04-09T18:35:21.992 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2021-04-09T18:35:21.993 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2021-04-09T18:35:21.993 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2021-04-09T18:35:21.993 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2021-04-09T18:35:21.993 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2021-04-09T18:35:21.993 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-04-09T18:35:21.994 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2021-04-09T18:35:21.994 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:21.994 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-04-09T18:35:21.994 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:21.994 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2021-04-09T18:35:21.995 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:21.995 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2021-04-09T18:35:21.995 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:21.995 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2021-04-09T18:35:21.996 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2021-04-09T18:35:21.996 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2021-04-09T18:35:21.996 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:21.996 INFO:teuthology.orchestra.run.smithi089.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-04-09T18:35:21.996 INFO:teuthology.orchestra.run.smithi089.stdout: mon_client_directed_command_retry = 4 2021-04-09T18:35:21.997 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = "172.21.15.79,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2021-04-09T18:35:21.997 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = fc927781-121d-4817-b30c-0c6f9e107f84 2021-04-09T18:35:21.997 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:21.997 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2021-04-09T18:35:21.998 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2021-04-09T18:35:21.998 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:21.998 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2021-04-09T18:35:21.998 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2021-04-09T18:35:21.999 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:21.999 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2021-04-09T18:35:21.999 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2021-04-09T18:35:21.999 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:21.999 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2021-04-09T18:35:22.000 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2021-04-09T18:35:22.000 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2021-04-09T18:35:22.000 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:22.000 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2021-04-09T18:35:22.001 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2021-04-09T18:35:22.001 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:22.001 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2021-04-09T18:35:22.001 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:22.001 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2021-04-09T18:35:22.002 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:22.002 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2021-04-09T18:35:22.002 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:22.002 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2021-04-09T18:35:22.002 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2021-04-09T18:35:22.003 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:22.003 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2021-04-09T18:35:22.003 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2021-04-09T18:35:22.003 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2021-04-09T18:35:22.003 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2021-04-09T18:35:22.004 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 20 2021-04-09T18:35:22.004 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 20 2021-04-09T18:35:22.004 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2021-04-09T18:35:22.004 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2021-04-09T18:35:22.005 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 10 2021-04-09T18:35:22.005 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2021-04-09T18:35:22.005 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2021-04-09T18:35:22.005 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2021-04-09T18:35:22.005 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 0.95 2021-04-09T18:35:22.006 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = bluestore 2021-04-09T18:35:22.006 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2021-04-09T18:35:22.006 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:22.006 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2021-04-09T18:35:22.006 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2021-04-09T18:35:22.007 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2021-04-09T18:35:22.007 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2021-04-09T18:35:22.007 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2021-04-09T18:35:22.007 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:35:22.008 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:35:22.008 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:22.008 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2021-04-09T18:35:22.008 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2021-04-09T18:35:22.008 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2021-04-09T18:35:22.009 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2021-04-09T18:35:22.009 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2021-04-09T18:35:22.009 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2021-04-09T18:35:22.009 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2021-04-09T18:35:22.009 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:35:22.010 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2021-04-09T18:35:22.010 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2021-04-09T18:35:22.010 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:35:22.010 INFO:teuthology.orchestra.run.smithi089.stdout: mon op complaint time = 120 2021-04-09T18:35:22.010 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:22.011 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2021-04-09T18:35:22.011 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2021-04-09T18:35:22.011 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2021-04-09T18:35:22.011 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2021-04-09T18:35:22.012 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-04-09T18:35:22.012 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-04-09T18:35:22.012 INFO:teuthology.orchestra.run.smithi089.stdout: client mount timeout = 600 2021-04-09T18:35:22.012 INFO:teuthology.orchestra.run.smithi089.stdout: debug client = 20 2021-04-09T18:35:22.012 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2021-04-09T18:35:22.013 INFO:teuthology.orchestra.run.smithi089.stdout: client debug getattr caps = true 2021-04-09T18:35:22.013 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2021-04-09T18:35:22.013 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.b] 2021-04-09T18:35:22.013 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.c] 2021-04-09T18:35:22.013 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2021-04-09T18:35:22.014 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2021-04-09T18:35:22.014 INFO:teuthology.orchestra.run.smithi089.stdout:[mds] 2021-04-09T18:35:22.014 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds = 20 2021-04-09T18:35:22.014 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2021-04-09T18:35:22.015 INFO:teuthology.orchestra.run.smithi089.stdout: mds bal frag = True 2021-04-09T18:35:22.015 INFO:teuthology.orchestra.run.smithi089.stdout: mds bal fragment size max = 10000 2021-04-09T18:35:22.015 INFO:teuthology.orchestra.run.smithi089.stdout: mds bal merge size = 5 2021-04-09T18:35:22.015 INFO:teuthology.orchestra.run.smithi089.stdout: mds bal split bits = 3 2021-04-09T18:35:22.015 INFO:teuthology.orchestra.run.smithi089.stdout: mds bal split size = 100 2021-04-09T18:35:22.016 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug frag = True 2021-04-09T18:35:22.016 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug scatterstat = True 2021-04-09T18:35:22.016 INFO:teuthology.orchestra.run.smithi089.stdout: mds op complaint time = 180 2021-04-09T18:35:22.016 INFO:teuthology.orchestra.run.smithi089.stdout: mds verify scatter = True 2021-04-09T18:35:22.016 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2021-04-09T18:35:22.017 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2021-04-09T18:35:22.017 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2021-04-09T18:35:22.017 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-04-09T18:35:22.017 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2021-04-09T18:35:22.018 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.018 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2021-04-09T18:35:22.018 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.018 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2021-04-09T18:35:22.018 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.019 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2021-04-09T18:35:22.019 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2021-04-09T18:35:22.019 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.019 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2021-04-09T18:35:22.019 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2021-04-09T18:35:22.020 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.020 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2021-04-09T18:35:22.020 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2021-04-09T18:35:22.020 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.021 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2021-04-09T18:35:22.021 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.021 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2021-04-09T18:35:22.021 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2021-04-09T18:35:22.021 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2021-04-09T18:35:22.022 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2021-04-09T18:35:22.022 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2021-04-09T18:35:22.022 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2021-04-09T18:35:22.022 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2021-04-09T18:35:22.022 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-04-09T18:35:22.023 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2021-04-09T18:35:22.023 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.023 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-04-09T18:35:22.023 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.023 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2021-04-09T18:35:22.024 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.024 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2021-04-09T18:35:22.024 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.024 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2021-04-09T18:35:22.024 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2021-04-09T18:35:22.025 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2021-04-09T18:35:22.025 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.025 INFO:teuthology.orchestra.run.smithi090.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-04-09T18:35:22.025 INFO:teuthology.orchestra.run.smithi090.stdout: mon_client_directed_command_retry = 4 2021-04-09T18:35:22.026 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.79,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2021-04-09T18:35:22.026 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = fc927781-121d-4817-b30c-0c6f9e107f84 2021-04-09T18:35:22.026 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.026 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2021-04-09T18:35:22.026 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2021-04-09T18:35:22.027 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.027 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2021-04-09T18:35:22.027 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2021-04-09T18:35:22.027 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.027 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2021-04-09T18:35:22.028 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2021-04-09T18:35:22.028 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.028 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2021-04-09T18:35:22.028 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2021-04-09T18:35:22.028 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2021-04-09T18:35:22.029 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.029 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2021-04-09T18:35:22.029 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2021-04-09T18:35:22.029 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.030 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2021-04-09T18:35:22.030 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.030 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2021-04-09T18:35:22.030 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.030 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2021-04-09T18:35:22.031 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.031 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2021-04-09T18:35:22.031 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2021-04-09T18:35:22.031 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.031 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2021-04-09T18:35:22.032 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2021-04-09T18:35:22.032 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2021-04-09T18:35:22.032 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2021-04-09T18:35:22.032 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 20 2021-04-09T18:35:22.033 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 20 2021-04-09T18:35:22.033 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2021-04-09T18:35:22.033 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2021-04-09T18:35:22.033 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 10 2021-04-09T18:35:22.033 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2021-04-09T18:35:22.034 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2021-04-09T18:35:22.034 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2021-04-09T18:35:22.034 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2021-04-09T18:35:22.034 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2021-04-09T18:35:22.034 INFO:teuthology.orchestra.run.smithi090.stdout: osd op complaint time = 180 2021-04-09T18:35:22.035 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.035 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2021-04-09T18:35:22.035 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2021-04-09T18:35:22.035 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2021-04-09T18:35:22.035 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2021-04-09T18:35:22.036 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2021-04-09T18:35:22.036 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:35:22.036 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:35:22.036 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.036 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2021-04-09T18:35:22.037 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2021-04-09T18:35:22.037 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2021-04-09T18:35:22.037 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2021-04-09T18:35:22.037 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2021-04-09T18:35:22.038 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2021-04-09T18:35:22.038 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2021-04-09T18:35:22.038 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:35:22.038 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2021-04-09T18:35:22.038 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2021-04-09T18:35:22.039 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:35:22.039 INFO:teuthology.orchestra.run.smithi090.stdout: mon op complaint time = 120 2021-04-09T18:35:22.039 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:22.039 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2021-04-09T18:35:22.039 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2021-04-09T18:35:22.040 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2021-04-09T18:35:22.040 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2021-04-09T18:35:22.040 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-04-09T18:35:22.040 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-04-09T18:35:22.040 INFO:teuthology.orchestra.run.smithi090.stdout: client mount timeout = 600 2021-04-09T18:35:22.041 INFO:teuthology.orchestra.run.smithi090.stdout: debug client = 20 2021-04-09T18:35:22.041 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2021-04-09T18:35:22.041 INFO:teuthology.orchestra.run.smithi090.stdout: client debug getattr caps = true 2021-04-09T18:35:22.041 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2021-04-09T18:35:22.042 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2021-04-09T18:35:22.042 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2021-04-09T18:35:22.042 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2021-04-09T18:35:22.042 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2021-04-09T18:35:22.042 INFO:teuthology.orchestra.run.smithi090.stdout:[mds] 2021-04-09T18:35:22.043 INFO:teuthology.orchestra.run.smithi090.stdout: debug mds = 20 2021-04-09T18:35:22.043 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2021-04-09T18:35:22.043 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal frag = True 2021-04-09T18:35:22.043 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal fragment size max = 10000 2021-04-09T18:35:22.043 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal merge size = 5 2021-04-09T18:35:22.044 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal split bits = 3 2021-04-09T18:35:22.044 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal split size = 100 2021-04-09T18:35:22.044 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug frag = True 2021-04-09T18:35:22.044 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug scatterstat = True 2021-04-09T18:35:22.044 INFO:teuthology.orchestra.run.smithi090.stdout: mds op complaint time = 180 2021-04-09T18:35:22.045 INFO:teuthology.orchestra.run.smithi090.stdout: mds verify scatter = True 2021-04-09T18:35:22.045 INFO:teuthology.orchestra.run.smithi090.stdout: osd op complaint time = 180 2021-04-09T18:35:22.045 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:35:22.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.142 7f54995f2700 1 Processor -- start 2021-04-09T18:35:22.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.142 7f54995f2700 1 -- start start 2021-04-09T18:35:22.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.142 7f54995f2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54940f5720 0x7f54940f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:22.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.142 7f54995f2700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54940fbd20 con 0x7f54940e9ce0 2021-04-09T18:35:22.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.142 7f54995f2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549409fa00 con 0x7f54941c8210 2021-04-09T18:35:22.159 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.142 7f54995f2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54940ea130 con 0x7f54940f5720 2021-04-09T18:35:22.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.142 7f5492a46700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f54940e9ce0 0x7f549409f200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58058/0 (socket says 172.21.15.79:58058) 2021-04-09T18:35:22.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.142 7f5492a46700 1 -- 172.21.15.79:0/4073313447 learned_addr learned my addr 172.21.15.79:0/4073313447 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:22.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.142 7f5493247700 1 --2- 172.21.15.79:0/4073313447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54940f5720 0x7f54940f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:22.160 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.142 7f5492245700 1 -- 172.21.15.79:0/4073313447 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975072826 0 0) 0x7f54880010d0 con 0x7f54940e9ce0 2021-04-09T18:35:22.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.146 7f5492245700 1 -- 172.21.15.79:0/4073313447 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f547c003240 con 0x7f54940e9ce0 2021-04-09T18:35:22.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.146 7f5492245700 1 -- 172.21.15.79:0/4073313447 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 909935616 0 0) 0x7f548c001450 con 0x7f54941c8210 2021-04-09T18:35:22.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.146 7f5492245700 1 -- 172.21.15.79:0/4073313447 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f547c003620 con 0x7f54941c8210 2021-04-09T18:35:22.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.146 7f5492245700 1 -- 172.21.15.79:0/4073313447 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3639050159 0 0) 0x7f5488001650 con 0x7f54940e9ce0 2021-04-09T18:35:22.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.146 7f5493247700 1 -- 172.21.15.79:0/4073313447 >> v1:172.21.15.89:6789/0 conn(0x7f54941c8210 legacy=0x7f54941ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:22.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.146 7f5493247700 1 -- 172.21.15.79:0/4073313447 >> v1:172.21.15.79:6789/0 conn(0x7f54940e9ce0 legacy=0x7f549409f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:22.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.146 7f5493247700 1 -- 172.21.15.79:0/4073313447 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54940e58d0 con 0x7f54940f5720 2021-04-09T18:35:22.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.146 7f5493247700 1 --2- 172.21.15.79:0/4073313447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54940f5720 0x7f54940f66b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f5488001980 tx=0x7f548400bcf0).ready entity=mon.2 client_cookie=3e8309f71fff244 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:22.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.146 7f5492245700 1 -- 172.21.15.79:0/4073313447 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f54940e58d0 con 0x7f54940f5720 2021-04-09T18:35:22.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.146 7f5492245700 1 -- 172.21.15.79:0/4073313447 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5484009790 con 0x7f54940f5720 2021-04-09T18:35:22.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.146 7f5492245700 1 -- 172.21.15.79:0/4073313447 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5488001bb0 con 0x7f54940f5720 2021-04-09T18:35:22.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.146 7f54995f2700 1 -- 172.21.15.79:0/4073313447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54940f5720 msgr2=0x7f54940f66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:22.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.146 7f54995f2700 1 --2- 172.21.15.79:0/4073313447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54940f5720 0x7f54940f66b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f5488001980 tx=0x7f548400bcf0).stop 2021-04-09T18:35:22.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.146 7f54995f2700 1 -- 172.21.15.79:0/4073313447 shutdown_connections 2021-04-09T18:35:22.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.146 7f54995f2700 1 --2- 172.21.15.79:0/4073313447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54940f5720 0x7f54940f66b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.146 7f54995f2700 1 -- 172.21.15.79:0/4073313447 >> 172.21.15.79:0/4073313447 conn(0x7f54940e61e0 msgr2=0x7f54940e94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:22.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.146 7f54995f2700 1 -- 172.21.15.79:0/4073313447 shutdown_connections 2021-04-09T18:35:22.164 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.146 7f54995f2700 1 -- 172.21.15.79:0/4073313447 wait complete. 2021-04-09T18:35:22.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.150 7f54995f2700 1 Processor -- start 2021-04-09T18:35:22.165 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.150 7f54995f2700 1 -- start start 2021-04-09T18:35:22.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f54995f2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54940c4670 0x7f54940d7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:22.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f54995f2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54940c4fd0 0x7f54941aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:22.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f54995f2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54940d7ca0 0x7f54941af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:22.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f54995f2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54941c3fc0 con 0x7f54940d7ca0 2021-04-09T18:35:22.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f54995f2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54940c55d0 con 0x7f54940c4670 2021-04-09T18:35:22.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f54995f2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54940c58d0 con 0x7f54940c4fd0 2021-04-09T18:35:22.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f5493a48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54940d7ca0 0x7f54941af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:22.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f5493a48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54940d7ca0 0x7f54941af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35126/0 (socket says 172.21.15.79:35126) 2021-04-09T18:35:22.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f5493a48700 1 -- 172.21.15.79:0/3031368076 learned_addr learned my addr 172.21.15.79:0/3031368076 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:22.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f5492a46700 1 --2- 172.21.15.79:0/3031368076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54940c4fd0 0x7f54941aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:22.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f5493247700 1 --2- 172.21.15.79:0/3031368076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54940c4670 0x7f54940d7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:22.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f5493a48700 1 -- 172.21.15.79:0/3031368076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54940c4fd0 msgr2=0x7f54941aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:22.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f5493a48700 1 --2- 172.21.15.79:0/3031368076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54940c4fd0 0x7f54941aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f5493a48700 1 -- 172.21.15.79:0/3031368076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54940c4670 msgr2=0x7f54940d7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:22.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f5493a48700 1 --2- 172.21.15.79:0/3031368076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54940c4670 0x7f54940d7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f5493a48700 1 -- 172.21.15.79:0/3031368076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54941af8f0 con 0x7f54940d7ca0 2021-04-09T18:35:22.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f5493a48700 1 --2- 172.21.15.79:0/3031368076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54940d7ca0 0x7f54941af2c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f549409b220 tx=0x7f548c00ce60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:22.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f547bfff700 1 -- 172.21.15.79:0/3031368076 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f54941af8f0 con 0x7f54940d7ca0 2021-04-09T18:35:22.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f547bfff700 1 -- 172.21.15.79:0/3031368076 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c00a730 con 0x7f54940d7ca0 2021-04-09T18:35:22.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f54995f2700 1 -- 172.21.15.79:0/3031368076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54940c6e70 con 0x7f54940d7ca0 2021-04-09T18:35:22.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f547bfff700 1 -- 172.21.15.79:0/3031368076 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f548c00a910 con 0x7f54940d7ca0 2021-04-09T18:35:22.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f54995f2700 1 -- 172.21.15.79:0/3031368076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54940c71c0 con 0x7f54940d7ca0 2021-04-09T18:35:22.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f547bfff700 1 -- 172.21.15.79:0/3031368076 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f548c019020 con 0x7f54940d7ca0 2021-04-09T18:35:22.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f547bfff700 1 --2- 172.21.15.79:0/3031368076 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5474029100 0x7f547402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:22.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.154 7f547bfff700 1 -- 172.21.15.79:0/3031368076 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f548c039180 con 0x7f54940d7ca0 2021-04-09T18:35:22.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.158 7f5493247700 1 --2- 172.21.15.79:0/3031368076 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5474029100 0x7f547402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:22.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.158 7f5493247700 1 --2- 172.21.15.79:0/3031368076 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5474029100 0x7f547402b650 crc :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:22.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.158 7f54995f2700 1 -- 172.21.15.79:0/3031368076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5494088e90 con 0x7f54940d7ca0 2021-04-09T18:35:22.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.162 7f547bfff700 1 -- 172.21.15.79:0/3031368076 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f548c00a520 con 0x7f54940d7ca0 2021-04-09T18:35:22.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.326 7f54995f2700 1 -- 172.21.15.79:0/3031368076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54940e3bc0 con 0x7f54940d7ca0 2021-04-09T18:35:22.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.326 7f547bfff700 1 -- 172.21.15.79:0/3031368076 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+14240 (secure 0 0 0) 0x7f548c000f70 con 0x7f54940d7ca0 2021-04-09T18:35:22.336 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:22.336 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":126,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:35:14.182279","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:35:11.346312","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2021-04-09 18:35:12.219337","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:35:22.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.330 7f54995f2700 1 -- 172.21.15.79:0/3031368076 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5474029100 msgr2=0x7f547402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:22.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.330 7f54995f2700 1 --2- 172.21.15.79:0/3031368076 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5474029100 0x7f547402b650 crc :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.330 7f54995f2700 1 -- 172.21.15.79:0/3031368076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54940d7ca0 msgr2=0x7f54941af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:22.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.330 7f54995f2700 1 --2- 172.21.15.79:0/3031368076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54940d7ca0 0x7f54941af2c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f549409b220 tx=0x7f548c00ce60).stop 2021-04-09T18:35:22.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.330 7f54995f2700 1 -- 172.21.15.79:0/3031368076 shutdown_connections 2021-04-09T18:35:22.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.330 7f54995f2700 1 --2- 172.21.15.79:0/3031368076 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f5474029100 0x7f547402b650 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.330 7f54995f2700 1 --2- 172.21.15.79:0/3031368076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54940c4670 0x7f54940d7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.330 7f54995f2700 1 --2- 172.21.15.79:0/3031368076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54940d7ca0 0x7f54941af2c0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.330 7f54995f2700 1 --2- 172.21.15.79:0/3031368076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54940c4fd0 0x7f54941aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.330 7f54995f2700 1 -- 172.21.15.79:0/3031368076 >> 172.21.15.79:0/3031368076 conn(0x7f54940af340 msgr2=0x7f5494099430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:22.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.330 7f54995f2700 1 -- 172.21.15.79:0/3031368076 shutdown_connections 2021-04-09T18:35:22.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.330 7f54995f2700 1 -- 172.21.15.79:0/3031368076 wait complete. 2021-04-09T18:35:22.348 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:35:11.346312', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:35:12.219337', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:35:22.349 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:35:22.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.434 7f56c9fbe700 1 Processor -- start 2021-04-09T18:35:22.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c9fbe700 1 -- start start 2021-04-09T18:35:22.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c9fbe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f56c40f5820 0x7f56c40f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:22.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c9fbe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f56c40e9de0 0x7f56c409f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:22.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c9fbe700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c40fbe20 con 0x7f56c41c30b0 2021-04-09T18:35:22.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c9fbe700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c40ea230 con 0x7f56c40f5820 2021-04-09T18:35:22.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c9fbe700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c40e5cd0 con 0x7f56c40e9de0 2021-04-09T18:35:22.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c37fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f56c40f5820 0x7f56c40f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:22.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c37fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f56c40f5820 0x7f56c40f67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35130/0 (socket says 172.21.15.79:35130) 2021-04-09T18:35:22.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c37fe700 1 -- 172.21.15.79:0/159332645 learned_addr learned my addr 172.21.15.79:0/159332645 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:22.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c2ffd700 1 --2- 172.21.15.79:0/159332645 >> v2:172.21.15.89:3300/0 conn(0x7f56c40e9de0 0x7f56c409f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:22.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c37fe700 1 -- 172.21.15.79:0/159332645 >> v2:172.21.15.89:3300/0 conn(0x7f56c40e9de0 msgr2=0x7f56c409f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:22.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c37fe700 1 --2- 172.21.15.79:0/159332645 >> v2:172.21.15.89:3300/0 conn(0x7f56c40e9de0 0x7f56c409f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c37fe700 1 -- 172.21.15.79:0/159332645 >> v1:172.21.15.79:6789/0 conn(0x7f56c41c30b0 legacy=0x7f56c41c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:22.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c27fc700 1 -- 172.21.15.79:0/159332645 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004991740 0 0) 0x7f56bc001450 con 0x7f56c41c30b0 2021-04-09T18:35:22.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c37fe700 1 -- 172.21.15.79:0/159332645 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c40e59d0 con 0x7f56c40f5820 2021-04-09T18:35:22.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c37fe700 1 --2- 172.21.15.79:0/159332645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56c40f5820 0x7f56c40f67b0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f56b4002f30 tx=0x7f56b400bd70).ready entity=mon.0 client_cookie=41150ee896b89210 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:22.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c27fc700 1 -- 172.21.15.79:0/159332645 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f56c40e59d0 con 0x7f56c40f5820 2021-04-09T18:35:22.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c27fc700 1 -- 172.21.15.79:0/159332645 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b4009950 con 0x7f56c40f5820 2021-04-09T18:35:22.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c27fc700 1 -- 172.21.15.79:0/159332645 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f56b4009d20 con 0x7f56c40f5820 2021-04-09T18:35:22.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c9fbe700 1 -- 172.21.15.79:0/159332645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56c40f5820 msgr2=0x7f56c40f67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:22.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c9fbe700 1 --2- 172.21.15.79:0/159332645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56c40f5820 0x7f56c40f67b0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f56b4002f30 tx=0x7f56b400bd70).stop 2021-04-09T18:35:22.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c9fbe700 1 -- 172.21.15.79:0/159332645 shutdown_connections 2021-04-09T18:35:22.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c9fbe700 1 --2- 172.21.15.79:0/159332645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56c40f5820 0x7f56c40f67b0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c9fbe700 1 --2- 172.21.15.79:0/159332645 >> v2:172.21.15.89:3300/0 conn(0x7f56c40e9de0 0x7f56c409f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c9fbe700 1 -- 172.21.15.79:0/159332645 >> 172.21.15.79:0/159332645 conn(0x7f56c40e62e0 msgr2=0x7f56c40e95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:22.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c9fbe700 1 -- 172.21.15.79:0/159332645 shutdown_connections 2021-04-09T18:35:22.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.438 7f56c9fbe700 1 -- 172.21.15.79:0/159332645 wait complete. 2021-04-09T18:35:22.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.442 7f56c9fbe700 1 Processor -- start 2021-04-09T18:35:22.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.442 7f56c9fbe700 1 -- start start 2021-04-09T18:35:22.460 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.442 7f56c9fbe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56c40aaa50 0x7f56c4090240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:22.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.442 7f56c9fbe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56c40b8e60 0x7f56c408f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:22.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.442 7f56c9fbe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56c40b98d0 0x7f56c40d1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:22.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.442 7f56c9fbe700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c40b95d0 con 0x7f56c40b98d0 2021-04-09T18:35:22.461 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.442 7f56c9fbe700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c40b92b0 con 0x7f56c40b8e60 2021-04-09T18:35:22.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.442 7f56c9fbe700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c408fe70 con 0x7f56c40aaa50 2021-04-09T18:35:22.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.442 7f56c3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56c40b98d0 0x7f56c40d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:22.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.442 7f56c37fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56c40aaa50 0x7f56c4090240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:22.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.442 7f56c3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56c40b98d0 0x7f56c40d1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35138/0 (socket says 172.21.15.79:35138) 2021-04-09T18:35:22.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.442 7f56c3fff700 1 -- 172.21.15.79:0/107806273 learned_addr learned my addr 172.21.15.79:0/107806273 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:22.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.442 7f56c2ffd700 1 --2- 172.21.15.79:0/107806273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56c40b8e60 0x7f56c408f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:22.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.442 7f56c3fff700 1 -- 172.21.15.79:0/107806273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56c40aaa50 msgr2=0x7f56c4090240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:22.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.442 7f56c3fff700 1 --2- 172.21.15.79:0/107806273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56c40aaa50 0x7f56c4090240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.442 7f56c3fff700 1 -- 172.21.15.79:0/107806273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56c40b8e60 msgr2=0x7f56c408f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:22.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.442 7f56c3fff700 1 --2- 172.21.15.79:0/107806273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56c40b8e60 0x7f56c408f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.442 7f56c3fff700 1 -- 172.21.15.79:0/107806273 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c40b9d20 con 0x7f56c40b98d0 2021-04-09T18:35:22.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.442 7f56c3fff700 1 --2- 172.21.15.79:0/107806273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56c40b98d0 0x7f56c40d1760 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f56c40b9550 tx=0x7f56bc00cee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:22.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.446 7f56bbfff700 1 -- 172.21.15.79:0/107806273 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f56c40b9d20 con 0x7f56c40b98d0 2021-04-09T18:35:22.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.446 7f56bbfff700 1 -- 172.21.15.79:0/107806273 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56bc006a80 con 0x7f56c40b98d0 2021-04-09T18:35:22.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.446 7f56c9fbe700 1 -- 172.21.15.79:0/107806273 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c40d1d90 con 0x7f56c40b98d0 2021-04-09T18:35:22.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.446 7f56bbfff700 1 -- 172.21.15.79:0/107806273 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f56bc003030 con 0x7f56c40b98d0 2021-04-09T18:35:22.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.446 7f56c9fbe700 1 -- 172.21.15.79:0/107806273 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c40ab000 con 0x7f56c40b98d0 2021-04-09T18:35:22.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.446 7f56bbfff700 1 -- 172.21.15.79:0/107806273 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f56bc007030 con 0x7f56c40b98d0 2021-04-09T18:35:22.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.446 7f56bbfff700 1 --2- 172.21.15.79:0/107806273 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f569c029100 0x7f569c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:22.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.446 7f56bbfff700 1 -- 172.21.15.79:0/107806273 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f56bc038ee0 con 0x7f56c40b98d0 2021-04-09T18:35:22.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.446 7f56c37fe700 1 --2- 172.21.15.79:0/107806273 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f569c029100 0x7f569c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:22.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.446 7f56c37fe700 1 --2- 172.21.15.79:0/107806273 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f569c029100 0x7f569c02b650 crc :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:22.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.450 7f56c9fbe700 1 -- 172.21.15.79:0/107806273 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c40e3cc0 con 0x7f56c40b98d0 2021-04-09T18:35:22.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.458 7f56bbfff700 1 -- 172.21.15.79:0/107806273 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f56bc000f70 con 0x7f56c40b98d0 2021-04-09T18:35:22.618 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.610 7f56c9fbe700 1 -- 172.21.15.79:0/107806273 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f56c40f5e20 con 0x7f56c40b98d0 2021-04-09T18:35:22.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.614 7f56bbfff700 1 -- 172.21.15.79:0/107806273 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v126) v1 ==== 92+0+10 (secure 0 0 0) 0x7f56bc006870 con 0x7f56c40b98d0 2021-04-09T18:35:22.620 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:35:22.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.614 7f56c9fbe700 1 -- 172.21.15.79:0/107806273 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f569c029100 msgr2=0x7f569c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:22.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.614 7f56c9fbe700 1 --2- 172.21.15.79:0/107806273 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f569c029100 0x7f569c02b650 crc :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.614 7f56c9fbe700 1 -- 172.21.15.79:0/107806273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56c40b98d0 msgr2=0x7f56c40d1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:22.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.614 7f56c9fbe700 1 --2- 172.21.15.79:0/107806273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56c40b98d0 0x7f56c40d1760 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f56c40b9550 tx=0x7f56bc00cee0).stop 2021-04-09T18:35:22.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.614 7f56c9fbe700 1 -- 172.21.15.79:0/107806273 shutdown_connections 2021-04-09T18:35:22.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.614 7f56c9fbe700 1 --2- 172.21.15.79:0/107806273 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f569c029100 0x7f569c02b650 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.614 7f56c9fbe700 1 --2- 172.21.15.79:0/107806273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56c40b98d0 0x7f56c40d1760 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.614 7f56c9fbe700 1 --2- 172.21.15.79:0/107806273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56c40aaa50 0x7f56c4090240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.614 7f56c9fbe700 1 --2- 172.21.15.79:0/107806273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56c40b8e60 0x7f56c408f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.614 7f56c9fbe700 1 -- 172.21.15.79:0/107806273 >> 172.21.15.79:0/107806273 conn(0x7f56c4092c40 msgr2=0x7f56c40d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:22.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.614 7f56c9fbe700 1 -- 172.21.15.79:0/107806273 shutdown_connections 2021-04-09T18:35:22.627 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.614 7f56c9fbe700 1 -- 172.21.15.79:0/107806273 wait complete. 2021-04-09T18:35:22.632 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:35:22.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.722 7f9b9c89d700 1 Processor -- start 2021-04-09T18:35:22.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.722 7f9b9c89d700 1 -- start start 2021-04-09T18:35:22.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.722 7f9b9c89d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b980e9de0 0x7f9b9809f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:22.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.722 7f9b9c89d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9b981c8310 0x7f9b981ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:22.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.722 7f9b9c89d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b980fbe20 con 0x7f9b980f5820 2021-04-09T18:35:22.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.722 7f9b9c89d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b981c40c0 con 0x7f9b981c8310 2021-04-09T18:35:22.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.722 7f9b9c89d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980ea230 con 0x7f9b980e9de0 2021-04-09T18:35:22.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.722 7f9b95da3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b980e9de0 0x7f9b9809f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:22.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.722 7f9b96da5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9b981c8310 0x7f9b981ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:22.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.722 7f9b95da3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b980e9de0 0x7f9b9809f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:60372/0 (socket says 172.21.15.79:60372) 2021-04-09T18:35:22.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.722 7f9b95da3700 1 -- 172.21.15.79:0/2806810912 learned_addr learned my addr 172.21.15.79:0/2806810912 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:22.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.722 7f9b965a4700 1 --1- 172.21.15.79:0/2806810912 >> v1:172.21.15.89:6789/0 conn(0x7f9b980f5820 0x7f9b980f67b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:58558/0 (socket says 172.21.15.79:58558) 2021-04-09T18:35:22.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.722 7f9b955a2700 1 -- 172.21.15.79:0/2806810912 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030435135 0 0) 0x7f9b800010d0 con 0x7f9b980f5820 2021-04-09T18:35:22.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.722 7f9b955a2700 1 -- 172.21.15.79:0/2806810912 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b78003240 con 0x7f9b980f5820 2021-04-09T18:35:22.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.722 7f9b96da5700 1 -- 172.21.15.79:0/2806810912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b980e9de0 msgr2=0x7f9b9809f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:22.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.722 7f9b96da5700 1 --2- 172.21.15.79:0/2806810912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b980e9de0 0x7f9b9809f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.722 7f9b96da5700 1 -- 172.21.15.79:0/2806810912 >> v1:172.21.15.89:6789/0 conn(0x7f9b980f5820 legacy=0x7f9b980f67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:22.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.722 7f9b96da5700 1 -- 172.21.15.79:0/2806810912 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b980e59d0 con 0x7f9b981c8310 2021-04-09T18:35:22.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.722 7f9b95da3700 1 --2- 172.21.15.79:0/2806810912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b980e9de0 0x7f9b9809f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:22.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.726 7f9b96da5700 1 --2- 172.21.15.79:0/2806810912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b981c8310 0x7f9b981ca770 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f9b90002f30 tx=0x7f9b9000bd40).ready entity=mon.1 client_cookie=5d8cd8b21d9b61a8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:22.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.726 7f9b955a2700 1 -- 172.21.15.79:0/2806810912 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b980e59d0 con 0x7f9b981c8310 2021-04-09T18:35:22.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.726 7f9b955a2700 1 -- 172.21.15.79:0/2806810912 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b90009850 con 0x7f9b981c8310 2021-04-09T18:35:22.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.726 7f9b955a2700 1 -- 172.21.15.79:0/2806810912 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b90009c20 con 0x7f9b981c8310 2021-04-09T18:35:22.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.726 7f9b9c89d700 1 -- 172.21.15.79:0/2806810912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b981c8310 msgr2=0x7f9b981ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:22.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.726 7f9b9c89d700 1 --2- 172.21.15.79:0/2806810912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b981c8310 0x7f9b981ca770 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f9b90002f30 tx=0x7f9b9000bd40).stop 2021-04-09T18:35:22.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.726 7f9b9c89d700 1 -- 172.21.15.79:0/2806810912 shutdown_connections 2021-04-09T18:35:22.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.726 7f9b9c89d700 1 --2- 172.21.15.79:0/2806810912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b981c8310 0x7f9b981ca770 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.726 7f9b9c89d700 1 --2- 172.21.15.79:0/2806810912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b980e9de0 0x7f9b9809f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.726 7f9b9c89d700 1 -- 172.21.15.79:0/2806810912 >> 172.21.15.79:0/2806810912 conn(0x7f9b980e62e0 msgr2=0x7f9b980e95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:22.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.726 7f9b9c89d700 1 -- 172.21.15.79:0/2806810912 shutdown_connections 2021-04-09T18:35:22.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.726 7f9b9c89d700 1 -- 172.21.15.79:0/2806810912 wait complete. 2021-04-09T18:35:22.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b9c89d700 1 Processor -- start 2021-04-09T18:35:22.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b9c89d700 1 -- start start 2021-04-09T18:35:22.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b9c89d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b980aeb90 0x7f9b980ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:22.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b9c89d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b981c0860 0x7f9b980d5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:22.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b9c89d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b980bae60 0x7f9b981aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:22.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b9c89d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980974c0 con 0x7f9b981c0860 2021-04-09T18:35:22.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b9c89d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980977c0 con 0x7f9b980aeb90 2021-04-09T18:35:22.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b9c89d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980d6700 con 0x7f9b980bae60 2021-04-09T18:35:22.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b95da3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b981c0860 0x7f9b980d5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:22.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b95da3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b981c0860 0x7f9b980d5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35152/0 (socket says 172.21.15.79:35152) 2021-04-09T18:35:22.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b95da3700 1 -- 172.21.15.79:0/3178004715 learned_addr learned my addr 172.21.15.79:0/3178004715 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:22.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b965a4700 1 --2- 172.21.15.79:0/3178004715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b980aeb90 0x7f9b980ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:22.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b96da5700 1 --2- 172.21.15.79:0/3178004715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b980bae60 0x7f9b981aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:22.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b95da3700 1 -- 172.21.15.79:0/3178004715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b980bae60 msgr2=0x7f9b981aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:22.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b95da3700 1 --2- 172.21.15.79:0/3178004715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b980bae60 0x7f9b981aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b95da3700 1 -- 172.21.15.79:0/3178004715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b980aeb90 msgr2=0x7f9b980ae200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:22.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b95da3700 1 --2- 172.21.15.79:0/3178004715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b980aeb90 0x7f9b980ae200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b95da3700 1 -- 172.21.15.79:0/3178004715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b98096240 con 0x7f9b981c0860 2021-04-09T18:35:22.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b95da3700 1 --2- 172.21.15.79:0/3178004715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b981c0860 0x7f9b980d5a90 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f9b98097440 tx=0x7f9b8800c650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:22.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b8effd700 1 -- 172.21.15.79:0/3178004715 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b98096240 con 0x7f9b981c0860 2021-04-09T18:35:22.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b8effd700 1 -- 172.21.15.79:0/3178004715 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b880123f0 con 0x7f9b981c0860 2021-04-09T18:35:22.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b9c89d700 1 -- 172.21.15.79:0/3178004715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b980d60c0 con 0x7f9b981c0860 2021-04-09T18:35:22.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b8effd700 1 -- 172.21.15.79:0/3178004715 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b8800f040 con 0x7f9b981c0860 2021-04-09T18:35:22.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.730 7f9b9c89d700 1 -- 172.21.15.79:0/3178004715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b980bb2b0 con 0x7f9b981c0860 2021-04-09T18:35:22.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.734 7f9b8effd700 1 -- 172.21.15.79:0/3178004715 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9b88022060 con 0x7f9b981c0860 2021-04-09T18:35:22.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.734 7f9b8effd700 1 --2- 172.21.15.79:0/3178004715 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9b70029100 0x7f9b7002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:22.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.734 7f9b8effd700 1 -- 172.21.15.79:0/3178004715 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f9b88010040 con 0x7f9b981c0860 2021-04-09T18:35:22.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.734 7f9b965a4700 1 --2- 172.21.15.79:0/3178004715 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9b70029100 0x7f9b7002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:22.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.734 7f9b965a4700 1 --2- 172.21.15.79:0/3178004715 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9b70029100 0x7f9b7002b650 crc :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:22.751 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.738 7f9b9c89d700 1 -- 172.21.15.79:0/3178004715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b980e3cc0 con 0x7f9b981c0860 2021-04-09T18:35:22.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.742 7f9b8effd700 1 -- 172.21.15.79:0/3178004715 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9b8800cca0 con 0x7f9b981c0860 2021-04-09T18:35:22.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.894 7f9b9c89d700 1 -- 172.21.15.79:0/3178004715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f9b980f5e20 con 0x7f9b981c0860 2021-04-09T18:35:22.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.898 7f9b8effd700 1 -- 172.21.15.79:0/3178004715 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v126) v1 ==== 104+0+10 (secure 0 0 0) 0x7f9b88000f70 con 0x7f9b981c0860 2021-04-09T18:35:22.903 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:35:22.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.898 7f9b9c89d700 1 -- 172.21.15.79:0/3178004715 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9b70029100 msgr2=0x7f9b7002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:22.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.898 7f9b9c89d700 1 --2- 172.21.15.79:0/3178004715 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9b70029100 0x7f9b7002b650 crc :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.898 7f9b9c89d700 1 -- 172.21.15.79:0/3178004715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b981c0860 msgr2=0x7f9b980d5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:22.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.898 7f9b9c89d700 1 --2- 172.21.15.79:0/3178004715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b981c0860 0x7f9b980d5a90 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f9b98097440 tx=0x7f9b8800c650).stop 2021-04-09T18:35:22.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.898 7f9b9c89d700 1 -- 172.21.15.79:0/3178004715 shutdown_connections 2021-04-09T18:35:22.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.898 7f9b9c89d700 1 --2- 172.21.15.79:0/3178004715 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9b70029100 0x7f9b7002b650 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.898 7f9b9c89d700 1 --2- 172.21.15.79:0/3178004715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b980aeb90 0x7f9b980ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.898 7f9b9c89d700 1 --2- 172.21.15.79:0/3178004715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b980bae60 0x7f9b981aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.898 7f9b9c89d700 1 --2- 172.21.15.79:0/3178004715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b981c0860 0x7f9b980d5a90 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:22.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.898 7f9b9c89d700 1 -- 172.21.15.79:0/3178004715 >> 172.21.15.79:0/3178004715 conn(0x7f9b981a14b0 msgr2=0x7f9b98095650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:22.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.898 7f9b9c89d700 1 -- 172.21.15.79:0/3178004715 shutdown_connections 2021-04-09T18:35:22.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.898 7f9b9c89d700 1 -- 172.21.15.79:0/3178004715 wait complete. 2021-04-09T18:35:22.915 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:35:23.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.998 7fbdc1005700 1 Processor -- start 2021-04-09T18:35:23.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.998 7fbdc1005700 1 -- start start 2021-04-09T18:35:23.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.998 7fbdc1005700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbdbc1c9320 0x7fbdbc1cb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:23.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.998 7fbdc1005700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdbc0fbe20 con 0x7fbdbc0e9de0 2021-04-09T18:35:23.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.998 7fbdc1005700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdbc09fa00 con 0x7fbdbc0f5820 2021-04-09T18:35:23.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:22.998 7fbdc1005700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdbc1c40c0 con 0x7fbdbc1c9320 2021-04-09T18:35:23.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdba59c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbdbc0e9de0 0x7fbdbc09f200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58102/0 (socket says 172.21.15.79:58102) 2021-04-09T18:35:23.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdba59c700 1 -- 172.21.15.79:0/4263188437 learned_addr learned my addr 172.21.15.79:0/4263188437 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:23.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdbb59e700 1 --2- 172.21.15.79:0/4263188437 >> v2:172.21.15.89:3300/0 conn(0x7fbdbc1c9320 0x7fbdbc1cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:23.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdb9d9b700 1 -- 172.21.15.79:0/4263188437 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480752447 0 0) 0x7fbda4001450 con 0x7fbdbc0e9de0 2021-04-09T18:35:23.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdb9d9b700 1 -- 172.21.15.79:0/4263188437 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbda8003240 con 0x7fbdbc0e9de0 2021-04-09T18:35:23.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdb9d9b700 1 -- 172.21.15.79:0/4263188437 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032371539 0 0) 0x7fbdac0010d0 con 0x7fbdbc0f5820 2021-04-09T18:35:23.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdb9d9b700 1 -- 172.21.15.79:0/4263188437 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbda8003620 con 0x7fbdbc0f5820 2021-04-09T18:35:23.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdb9d9b700 1 -- 172.21.15.79:0/4263188437 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 562766033 0 0) 0x7fbda40019d0 con 0x7fbdbc0e9de0 2021-04-09T18:35:23.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdb9d9b700 1 -- 172.21.15.79:0/4263188437 >> v2:172.21.15.89:3300/0 conn(0x7fbdbc1c9320 msgr2=0x7fbdbc1cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:23.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdb9d9b700 1 --2- 172.21.15.79:0/4263188437 >> v2:172.21.15.89:3300/0 conn(0x7fbdbc1c9320 0x7fbdbc1cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdb9d9b700 1 -- 172.21.15.79:0/4263188437 >> v1:172.21.15.89:6789/0 conn(0x7fbdbc0f5820 legacy=0x7fbdbc0f67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:23.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdb9d9b700 1 -- 172.21.15.79:0/4263188437 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc0e59d0 con 0x7fbdbc0e9de0 2021-04-09T18:35:23.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdb9d9b700 1 -- 172.21.15.79:0/4263188437 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7fbda4001f30 con 0x7fbdbc0e9de0 2021-04-09T18:35:23.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdb9d9b700 1 -- 172.21.15.79:0/4263188437 >> v1:172.21.15.79:6789/0 conn(0x7fbdbc0e9de0 legacy=0x7fbdbc09f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:23.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdb9d9b700 1 --2- 172.21.15.79:0/4263188437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbda8003d10 0x7fbda80045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:23.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdb9d9b700 1 --2- 172.21.15.79:0/4263188437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbda8004bd0 0x7fbda80097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:23.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdb9d9b700 1 --2- 172.21.15.79:0/4263188437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbda8005020 0x7fbda800be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:23.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdb9d9b700 1 -- 172.21.15.79:0/4263188437 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc1c40c0 con 0x7fbda8003d10 2021-04-09T18:35:23.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdb9d9b700 1 -- 172.21.15.79:0/4263188437 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80505b0 con 0x7fbda8004bd0 2021-04-09T18:35:23.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdb9d9b700 1 -- 172.21.15.79:0/4263188437 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80507b0 con 0x7fbda8005020 2021-04-09T18:35:23.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdba59c700 1 --2- 172.21.15.79:0/4263188437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbda8004bd0 0x7fbda80097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:23.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdbad9d700 1 --2- 172.21.15.79:0/4263188437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbda8003d10 0x7fbda80045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:23.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdbb59e700 1 --2- 172.21.15.79:0/4263188437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbda8005020 0x7fbda800be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:23.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdba59c700 1 -- 172.21.15.79:0/4263188437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbda8005020 msgr2=0x7fbda800be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:23.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdba59c700 1 --2- 172.21.15.79:0/4263188437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbda8005020 0x7fbda800be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdba59c700 1 -- 172.21.15.79:0/4263188437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbda8003d10 msgr2=0x7fbda80045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:23.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdba59c700 1 --2- 172.21.15.79:0/4263188437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbda8003d10 0x7fbda80045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdbb59e700 1 -- 172.21.15.79:0/4263188437 reap_dead start 2021-04-09T18:35:23.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdba59c700 1 -- 172.21.15.79:0/4263188437 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda8050aa0 con 0x7fbda8004bd0 2021-04-09T18:35:23.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdbad9d700 1 --2- 172.21.15.79:0/4263188437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbda8003d10 0x7fbda80045a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:23.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdba59c700 1 --2- 172.21.15.79:0/4263188437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbda8004bd0 0x7fbda80097e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fbda4001d00 tx=0x7fbda400ae30).ready entity=mon.1 client_cookie=a6c5328c9de13a5e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:23.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdb9d9b700 1 -- 172.21.15.79:0/4263188437 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbda8050aa0 con 0x7fbda8004bd0 2021-04-09T18:35:23.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdb9d9b700 1 -- 172.21.15.79:0/4263188437 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda4005b80 con 0x7fbda8004bd0 2021-04-09T18:35:23.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdb9d9b700 1 -- 172.21.15.79:0/4263188437 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbdbc0e59d0 con 0x7fbda8004bd0 2021-04-09T18:35:23.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdc1005700 1 -- 172.21.15.79:0/4263188437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbda8004bd0 msgr2=0x7fbda80097e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:23.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdc1005700 1 --2- 172.21.15.79:0/4263188437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbda8004bd0 0x7fbda80097e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fbda4001d00 tx=0x7fbda400ae30).stop 2021-04-09T18:35:23.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdc1005700 1 -- 172.21.15.79:0/4263188437 shutdown_connections 2021-04-09T18:35:23.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdc1005700 1 --2- 172.21.15.79:0/4263188437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbda8004bd0 0x7fbda80097e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.002 7fbdc1005700 1 -- 172.21.15.79:0/4263188437 >> 172.21.15.79:0/4263188437 conn(0x7fbdbc0e62e0 msgr2=0x7fbdbc0e95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:23.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.006 7fbdc1005700 1 -- 172.21.15.79:0/4263188437 shutdown_connections 2021-04-09T18:35:23.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.006 7fbdc1005700 1 -- 172.21.15.79:0/4263188437 wait complete. 2021-04-09T18:35:23.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdc1005700 1 Processor -- start 2021-04-09T18:35:23.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdc1005700 1 -- start start 2021-04-09T18:35:23.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdc1005700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdbc0d64c0 0x7fbdbc098c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:23.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdc1005700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbdbc099260 0x7fbdbc1b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:23.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdc1005700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdbc0d6910 0x7fbdbc1b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:23.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdc1005700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc0ea230 con 0x7fbdbc099260 2021-04-09T18:35:23.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdc1005700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc098840 con 0x7fbdbc0d6910 2021-04-09T18:35:23.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdc1005700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc0972c0 con 0x7fbdbc0d64c0 2021-04-09T18:35:23.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdba59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbdbc099260 0x7fbdbc1b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:23.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdba59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbdbc099260 0x7fbdbc1b18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35172/0 (socket says 172.21.15.79:35172) 2021-04-09T18:35:23.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdba59c700 1 -- 172.21.15.79:0/2589578752 learned_addr learned my addr 172.21.15.79:0/2589578752 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:23.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdbb59e700 1 --2- 172.21.15.79:0/2589578752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdbc0d6910 0x7fbdbc1b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:23.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdbad9d700 1 --2- 172.21.15.79:0/2589578752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdbc0d64c0 0x7fbdbc098c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:23.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdba59c700 1 -- 172.21.15.79:0/2589578752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdbc0d64c0 msgr2=0x7fbdbc098c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:23.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdba59c700 1 --2- 172.21.15.79:0/2589578752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdbc0d64c0 0x7fbdbc098c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdba59c700 1 -- 172.21.15.79:0/2589578752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdbc0d6910 msgr2=0x7fbdbc1b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:23.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdba59c700 1 --2- 172.21.15.79:0/2589578752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdbc0d6910 0x7fbdbc1b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdba59c700 1 -- 172.21.15.79:0/2589578752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc1a0e80 con 0x7fbdbc099260 2021-04-09T18:35:23.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdba59c700 1 --2- 172.21.15.79:0/2589578752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbdbc099260 0x7fbdbc1b18c0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7fbdbc0d5d70 tx=0x7fbda400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:23.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdb37fe700 1 -- 172.21.15.79:0/2589578752 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbdbc1a0e80 con 0x7fbdbc099260 2021-04-09T18:35:23.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdb37fe700 1 -- 172.21.15.79:0/2589578752 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda4004a90 con 0x7fbdbc099260 2021-04-09T18:35:23.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdc1005700 1 -- 172.21.15.79:0/2589578752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdbc096a60 con 0x7fbdbc099260 2021-04-09T18:35:23.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdb37fe700 1 -- 172.21.15.79:0/2589578752 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbda4007110 con 0x7fbdbc099260 2021-04-09T18:35:23.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.010 7fbdc1005700 1 -- 172.21.15.79:0/2589578752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdbc1b26b0 con 0x7fbdbc099260 2021-04-09T18:35:23.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.014 7fbdb37fe700 1 -- 172.21.15.79:0/2589578752 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fbda4027070 con 0x7fbdbc099260 2021-04-09T18:35:23.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.014 7fbdb37fe700 1 --2- 172.21.15.79:0/2589578752 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbda0029100 0x7fbda002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:23.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.014 7fbdb37fe700 1 -- 172.21.15.79:0/2589578752 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fbda403aee0 con 0x7fbdbc099260 2021-04-09T18:35:23.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.014 7fbdbad9d700 1 --2- 172.21.15.79:0/2589578752 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbda0029100 0x7fbda002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:23.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.014 7fbdbad9d700 1 --2- 172.21.15.79:0/2589578752 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbda0029100 0x7fbda002b650 crc :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:23.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.014 7fbdc1005700 1 -- 172.21.15.79:0/2589578752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdbc0e3cc0 con 0x7fbdbc099260 2021-04-09T18:35:23.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.018 7fbdb37fe700 1 -- 172.21.15.79:0/2589578752 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fbda4004880 con 0x7fbdbc099260 2021-04-09T18:35:23.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.170 7fbdc1005700 1 -- 172.21.15.79:0/2589578752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fbdbc0e1cc0 con 0x7fbdbc099260 2021-04-09T18:35:23.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.170 7fbdb37fe700 1 -- 172.21.15.79:0/2589578752 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v126) v1 ==== 100+0+10 (secure 0 0 0) 0x7fbda4005970 con 0x7fbdbc099260 2021-04-09T18:35:23.179 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:35:23.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.174 7fbdc1005700 1 -- 172.21.15.79:0/2589578752 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbda0029100 msgr2=0x7fbda002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:23.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.174 7fbdc1005700 1 --2- 172.21.15.79:0/2589578752 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbda0029100 0x7fbda002b650 crc :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.174 7fbdc1005700 1 -- 172.21.15.79:0/2589578752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbdbc099260 msgr2=0x7fbdbc1b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:23.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.174 7fbdc1005700 1 --2- 172.21.15.79:0/2589578752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbdbc099260 0x7fbdbc1b18c0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7fbdbc0d5d70 tx=0x7fbda400b040).stop 2021-04-09T18:35:23.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.174 7fbdc1005700 1 -- 172.21.15.79:0/2589578752 shutdown_connections 2021-04-09T18:35:23.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.174 7fbdc1005700 1 --2- 172.21.15.79:0/2589578752 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbda0029100 0x7fbda002b650 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.174 7fbdc1005700 1 --2- 172.21.15.79:0/2589578752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdbc0d6910 0x7fbdbc1b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.174 7fbdc1005700 1 --2- 172.21.15.79:0/2589578752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdbc0d64c0 0x7fbdbc098c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.174 7fbdc1005700 1 --2- 172.21.15.79:0/2589578752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbdbc099260 0x7fbdbc1b18c0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.174 7fbdc1005700 1 -- 172.21.15.79:0/2589578752 >> 172.21.15.79:0/2589578752 conn(0x7fbdbc09a590 msgr2=0x7fbdbc0d8560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:23.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.174 7fbdc1005700 1 -- 172.21.15.79:0/2589578752 shutdown_connections 2021-04-09T18:35:23.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.174 7fbdc1005700 1 -- 172.21.15.79:0/2589578752 wait complete. 2021-04-09T18:35:23.191 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:35:23.191 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:35:23.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc8a76700 1 Processor -- start 2021-04-09T18:35:23.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc8a76700 1 -- start start 2021-04-09T18:35:23.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc8a76700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4bc41c9210 0x7f4bc41cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:23.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc8a76700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc40fbd10 con 0x7f4bc40e9cd0 2021-04-09T18:35:23.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc8a76700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc409f9f0 con 0x7f4bc40f5710 2021-04-09T18:35:23.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc8a76700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc41c3fb0 con 0x7f4bc41c9210 2021-04-09T18:35:23.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc1fe5700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4bc40e9cd0 0x7f4bc409f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58122/0 (socket says 172.21.15.79:58122) 2021-04-09T18:35:23.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc1fe5700 1 -- 172.21.15.79:0/120943420 learned_addr learned my addr 172.21.15.79:0/120943420 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:23.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc2fe7700 1 --2- 172.21.15.79:0/120943420 >> v2:172.21.15.89:3300/0 conn(0x7f4bc41c9210 0x7f4bc41cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:23.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc17e4700 1 -- 172.21.15.79:0/120943420 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605216889 0 0) 0x7f4bb80010d0 con 0x7f4bc40e9cd0 2021-04-09T18:35:23.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc17e4700 1 -- 172.21.15.79:0/120943420 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bac003240 con 0x7f4bc40e9cd0 2021-04-09T18:35:23.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc17e4700 1 -- 172.21.15.79:0/120943420 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 923947716 0 0) 0x7f4bb8001650 con 0x7f4bc40e9cd0 2021-04-09T18:35:23.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc17e4700 1 -- 172.21.15.79:0/120943420 >> v2:172.21.15.89:3300/0 conn(0x7f4bc41c9210 msgr2=0x7f4bc41cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:23.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc17e4700 1 --2- 172.21.15.79:0/120943420 >> v2:172.21.15.89:3300/0 conn(0x7f4bc41c9210 0x7f4bc41cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc17e4700 1 -- 172.21.15.79:0/120943420 >> v1:172.21.15.89:6789/0 conn(0x7f4bc40f5710 legacy=0x7f4bc40f66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:23.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc17e4700 1 -- 172.21.15.79:0/120943420 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc40e58c0 con 0x7f4bc40e9cd0 2021-04-09T18:35:23.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc17e4700 1 -- 172.21.15.79:0/120943420 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f4bb8001bb0 con 0x7f4bc40e9cd0 2021-04-09T18:35:23.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc17e4700 1 -- 172.21.15.79:0/120943420 >> v1:172.21.15.79:6789/0 conn(0x7f4bc40e9cd0 legacy=0x7f4bc409f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:23.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc17e4700 1 --2- 172.21.15.79:0/120943420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bac0038c0 0x7f4bac003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:23.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc17e4700 1 --2- 172.21.15.79:0/120943420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0045a0 0x7f4bac004a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:23.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc17e4700 1 --2- 172.21.15.79:0/120943420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bac0097e0 0x7f4bac00bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:23.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc17e4700 1 -- 172.21.15.79:0/120943420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc41c3fb0 con 0x7f4bac0045a0 2021-04-09T18:35:23.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc17e4700 1 -- 172.21.15.79:0/120943420 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac00c270 con 0x7f4bac0097e0 2021-04-09T18:35:23.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc17e4700 1 -- 172.21.15.79:0/120943420 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac050430 con 0x7f4bac0038c0 2021-04-09T18:35:23.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc1fe5700 1 --2- 172.21.15.79:0/120943420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0045a0 0x7f4bac004a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:23.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc2fe7700 1 --2- 172.21.15.79:0/120943420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bac0097e0 0x7f4bac00bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:23.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc27e6700 1 --2- 172.21.15.79:0/120943420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bac0038c0 0x7f4bac003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:23.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc1fe5700 1 -- 172.21.15.79:0/120943420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bac0038c0 msgr2=0x7f4bac003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:23.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc1fe5700 1 --2- 172.21.15.79:0/120943420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bac0038c0 0x7f4bac003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc1fe5700 1 -- 172.21.15.79:0/120943420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bac0097e0 msgr2=0x7f4bac00bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:23.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc1fe5700 1 --2- 172.21.15.79:0/120943420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bac0097e0 0x7f4bac00bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc2fe7700 1 -- 172.21.15.79:0/120943420 reap_dead start 2021-04-09T18:35:23.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.278 7f4bc1fe5700 1 -- 172.21.15.79:0/120943420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac0506a0 con 0x7f4bac0045a0 2021-04-09T18:35:23.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.282 7f4bc1fe5700 1 --2- 172.21.15.79:0/120943420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0045a0 0x7f4bac004a10 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f4bb8001db0 tx=0x7f4bb8005290).ready entity=mon.0 client_cookie=b3f2a5212ea6644f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:23.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.282 7f4bc17e4700 1 -- 172.21.15.79:0/120943420 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4bac0506a0 con 0x7f4bac0045a0 2021-04-09T18:35:23.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.282 7f4bc17e4700 1 -- 172.21.15.79:0/120943420 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb80053d0 con 0x7f4bac0045a0 2021-04-09T18:35:23.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.282 7f4bc17e4700 1 -- 172.21.15.79:0/120943420 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4bc40e58c0 con 0x7f4bac0045a0 2021-04-09T18:35:23.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.282 7f4bc8a76700 1 -- 172.21.15.79:0/120943420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0045a0 msgr2=0x7f4bac004a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:23.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.282 7f4bc8a76700 1 --2- 172.21.15.79:0/120943420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0045a0 0x7f4bac004a10 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f4bb8001db0 tx=0x7f4bb8005290).stop 2021-04-09T18:35:23.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.282 7f4bc8a76700 1 -- 172.21.15.79:0/120943420 shutdown_connections 2021-04-09T18:35:23.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.282 7f4bc8a76700 1 --2- 172.21.15.79:0/120943420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0045a0 0x7f4bac004a10 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.282 7f4bc8a76700 1 -- 172.21.15.79:0/120943420 >> 172.21.15.79:0/120943420 conn(0x7f4bc40e61d0 msgr2=0x7f4bc40e94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:23.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.282 7f4bc8a76700 1 -- 172.21.15.79:0/120943420 shutdown_connections 2021-04-09T18:35:23.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.282 7f4bc8a76700 1 -- 172.21.15.79:0/120943420 wait complete. 2021-04-09T18:35:23.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc8a76700 1 Processor -- start 2021-04-09T18:35:23.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc8a76700 1 -- start start 2021-04-09T18:35:23.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc8a76700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bc419f460 0x7f4bc40d6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:23.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc8a76700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bc4096e60 0x7f4bc41a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:23.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc8a76700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bc41a0c00 0x7f4bc41ad500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:23.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc8a76700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc40ea120 con 0x7f4bc41a0c00 2021-04-09T18:35:23.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc8a76700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc41a02d0 con 0x7f4bc4096e60 2021-04-09T18:35:23.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc8a76700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc419fb60 con 0x7f4bc419f460 2021-04-09T18:35:23.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc2fe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bc41a0c00 0x7f4bc41ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:23.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc2fe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bc41a0c00 0x7f4bc41ad500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35194/0 (socket says 172.21.15.79:35194) 2021-04-09T18:35:23.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc2fe7700 1 -- 172.21.15.79:0/602188787 learned_addr learned my addr 172.21.15.79:0/602188787 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:23.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc27e6700 1 --2- 172.21.15.79:0/602188787 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bc419f460 0x7f4bc40d6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:23.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc1fe5700 1 --2- 172.21.15.79:0/602188787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bc4096e60 0x7f4bc41a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:23.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc2fe7700 1 -- 172.21.15.79:0/602188787 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bc419f460 msgr2=0x7f4bc40d6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:23.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc2fe7700 1 --2- 172.21.15.79:0/602188787 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bc419f460 0x7f4bc40d6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc2fe7700 1 -- 172.21.15.79:0/602188787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bc4096e60 msgr2=0x7f4bc41a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:23.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc2fe7700 1 --2- 172.21.15.79:0/602188787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bc4096e60 0x7f4bc41a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc2fe7700 1 -- 172.21.15.79:0/602188787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc40972b0 con 0x7f4bc41a0c00 2021-04-09T18:35:23.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc2fe7700 1 --2- 172.21.15.79:0/602188787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bc41a0c00 0x7f4bc41ad500 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f4bc409b780 tx=0x7f4bbc009270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:23.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bb2ffd700 1 -- 172.21.15.79:0/602188787 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4bc40972b0 con 0x7f4bc41a0c00 2021-04-09T18:35:23.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc8a76700 1 -- 172.21.15.79:0/602188787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc4097570 con 0x7f4bc41a0c00 2021-04-09T18:35:23.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bb2ffd700 1 -- 172.21.15.79:0/602188787 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bbc00fc30 con 0x7f4bc41a0c00 2021-04-09T18:35:23.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bb2ffd700 1 -- 172.21.15.79:0/602188787 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4bbc00f040 con 0x7f4bc41a0c00 2021-04-09T18:35:23.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.286 7f4bc8a76700 1 -- 172.21.15.79:0/602188787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc41adb30 con 0x7f4bc41a0c00 2021-04-09T18:35:23.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.290 7f4bb2ffd700 1 -- 172.21.15.79:0/602188787 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4bbc014440 con 0x7f4bc41a0c00 2021-04-09T18:35:23.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.290 7f4bb2ffd700 1 --2- 172.21.15.79:0/602188787 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4ba8029100 0x7f4ba802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:23.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.290 7f4bb2ffd700 1 -- 172.21.15.79:0/602188787 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f4bbc010040 con 0x7f4bc41a0c00 2021-04-09T18:35:23.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.290 7f4bc27e6700 1 --2- 172.21.15.79:0/602188787 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4ba8029100 0x7f4ba802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:23.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.290 7f4bc8a76700 1 -- 172.21.15.79:0/602188787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc4088e80 con 0x7f4bc41a0c00 2021-04-09T18:35:23.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.290 7f4bc27e6700 1 --2- 172.21.15.79:0/602188787 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4ba8029100 0x7f4ba802b650 crc :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:23.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.298 7f4bb2ffd700 1 -- 172.21.15.79:0/602188787 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4bc40f78b0 con 0x7f4bc41a0c00 2021-04-09T18:35:23.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.462 7f4bc8a76700 1 -- 172.21.15.79:0/602188787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bc40e3bb0 con 0x7f4bc41a0c00 2021-04-09T18:35:23.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.462 7f4bb2ffd700 1 -- 172.21.15.79:0/602188787 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+2105 (secure 0 0 0) 0x7f4bbc00fa20 con 0x7f4bc41a0c00 2021-04-09T18:35:23.471 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 79 2021-04-09T18:35:23.471 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:23.472 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":79,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7842,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1552365531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1552365531},{"type":"v1","addr":"172.21.15.89:6835","nonce":1552365531}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":77}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:35:13.180244","modified":"2021-04-09 18:35:15.198467","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7833},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7833":{"gid":7833,"name":"a","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/4102869700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4102869700},{"type":"v1","addr":"172.21.15.79:6833","nonce":4102869700}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-04-09T18:35:23.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.466 7f4bc8a76700 1 -- 172.21.15.79:0/602188787 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4ba8029100 msgr2=0x7f4ba802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:23.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.466 7f4bc8a76700 1 --2- 172.21.15.79:0/602188787 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4ba8029100 0x7f4ba802b650 crc :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.466 7f4bc8a76700 1 -- 172.21.15.79:0/602188787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bc41a0c00 msgr2=0x7f4bc41ad500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:23.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.466 7f4bc8a76700 1 --2- 172.21.15.79:0/602188787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bc41a0c00 0x7f4bc41ad500 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f4bc409b780 tx=0x7f4bbc009270).stop 2021-04-09T18:35:23.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.466 7f4bc8a76700 1 -- 172.21.15.79:0/602188787 shutdown_connections 2021-04-09T18:35:23.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.466 7f4bc8a76700 1 --2- 172.21.15.79:0/602188787 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4ba8029100 0x7f4ba802b650 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.466 7f4bc8a76700 1 --2- 172.21.15.79:0/602188787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bc41a0c00 0x7f4bc41ad500 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.466 7f4bc8a76700 1 --2- 172.21.15.79:0/602188787 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bc419f460 0x7f4bc40d6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.466 7f4bc8a76700 1 --2- 172.21.15.79:0/602188787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bc4096e60 0x7f4bc41a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:23.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.466 7f4bc8a76700 1 -- 172.21.15.79:0/602188787 >> 172.21.15.79:0/602188787 conn(0x7f4bc4097d00 msgr2=0x7f4bc40d8520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:23.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.466 7f4bc8a76700 1 -- 172.21.15.79:0/602188787 shutdown_connections 2021-04-09T18:35:23.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:23.466 7f4bc8a76700 1 -- 172.21.15.79:0/602188787 wait complete. 2021-04-09T18:35:23.685 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 79, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:35:13.180244', 'modified': '2021-04-09 18:35:15.198467', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7833}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7833': {'gid': 7833, 'name': 'a', 'rank': 0, 'incarnation': 78, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6833/4102869700', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 4102869700}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 4102869700}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:35:23.686 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:35:23.686 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2021-04-09T18:35:23.779 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:35:23.780 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:35:23.780 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2021-04-09T18:35:23.781 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 7833, 2021-04-09T18:35:23.781 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2021-04-09T18:35:23.782 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2021-04-09T18:35:23.782 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 9.5771597649999993, 2021-04-09T18:35:23.782 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 79, 2021-04-09T18:35:23.783 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 126, 2021-04-09T18:35:23.783 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 126, 2021-04-09T18:35:23.784 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 14.250038358999999 2021-04-09T18:35:23.784 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:35:23.786 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 7833, "want_state": "up:active", "state": "up:active", "rank_uptime": 9.5771597649999993, "mdsmap_epoch": 79, "osdmap_epoch": 126, "osdmap_epoch_barrier": 126, "uptime": 14.250038358999999 } 2021-04-09T18:35:23.787 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:35:23.788 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-04-09T18:35:23.789 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi136.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-04-09T18:35:23.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:23.791 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:23.801 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:35:23.862 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:35:23.863 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:35:23.921 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:35:23.921 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:35:23.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:23.923 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:35:23.973 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:35:23.973 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:24.016 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:35:24.032 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:35:24.033 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:35:24.089 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:35:24.090 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:35:24.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:24.091 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:35:24.092 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:2021-04-09 18:35:24.087 7f9b8976a0c0 -1 init, newargv = 0x55c8e6137940 newargc=9 2021-04-09T18:35:24.093 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13782]: starting ceph client 2021-04-09T18:35:24.101 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13782]: starting fuse 2021-04-09T18:35:25.198 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:35:25.215 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:35:25.216 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:35:25.273 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:35:25.274 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:35:25.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:25.275 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:35:25.325 INFO:teuthology.orchestra.run.smithi136.stdout:49 2021-04-09T18:35:25.325 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:35:25.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:25.326 DEBUG:teuthology.orchestra.run.smithi136:> sudo python3 -c ' 2021-04-09T18:35:25.327 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2021-04-09T18:35:25.327 DEBUG:teuthology.orchestra.run.smithi136:> import re 2021-04-09T18:35:25.328 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-04-09T18:35:25.328 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2021-04-09T18:35:25.329 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:35:25.329 DEBUG:teuthology.orchestra.run.smithi136:> def find_socket(client_name): 2021-04-09T18:35:25.330 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-04-09T18:35:25.330 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2021-04-09T18:35:25.330 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:35:25.331 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2021-04-09T18:35:25.331 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2021-04-09T18:35:25.332 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2021-04-09T18:35:25.332 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2021-04-09T18:35:25.333 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:35:25.333 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2021-04-09T18:35:25.334 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:35:25.334 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:35:25.335 DEBUG:teuthology.orchestra.run.smithi136:> return f 2021-04-09T18:35:25.335 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:35:25.335 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:35:25.336 DEBUG:teuthology.orchestra.run.smithi136:> print(find_socket("client.1")) 2021-04-09T18:35:25.336 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-04-09T18:35:25.414 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.1.13782.asok 2021-04-09T18:35:25.418 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13782.asok 2021-04-09T18:35:25.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:25.419 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13782.asok status 2021-04-09T18:35:25.496 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2021-04-09T18:35:25.496 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2021-04-09T18:35:25.497 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:35:25.497 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:35:25.497 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "1", 2021-04-09T18:35:25.498 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2021-04-09T18:35:25.498 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-04-09T18:35:25.498 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "13782", 2021-04-09T18:35:25.499 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2021-04-09T18:35:25.499 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:35:25.499 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2021-04-09T18:35:25.500 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2021-04-09T18:35:25.500 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 8059, 2021-04-09T18:35:25.500 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2021-04-09T18:35:25.501 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2021-04-09T18:35:25.501 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2021-04-09T18:35:25.501 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 8059 2021-04-09T18:35:25.502 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:35:25.502 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-04-09T18:35:25.502 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-04-09T18:35:25.503 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-04-09T18:35:25.503 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 1275119614 2021-04-09T18:35:25.503 INFO:teuthology.orchestra.run.smithi136.stdout: } 2021-04-09T18:35:25.504 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:35:25.504 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-04-09T18:35:25.504 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-04-09T18:35:25.505 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-04-09T18:35:25.505 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 1275119614 2021-04-09T18:35:25.505 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:35:25.505 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.8059 172.21.15.136:0/1275119614", 2021-04-09T18:35:25.506 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "172.21.15.136:0/1275119614", 2021-04-09T18:35:25.506 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2021-04-09T18:35:25.506 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 79, 2021-04-09T18:35:25.506 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 126, 2021-04-09T18:35:25.507 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:35:25.507 INFO:teuthology.orchestra.run.smithi136.stdout: "blacklisted": false, 2021-04-09T18:35:25.507 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2021-04-09T18:35:25.507 INFO:teuthology.orchestra.run.smithi136.stdout:} 2021-04-09T18:35:25.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:25.509 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:25.510 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:25.517 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-04-09T18:35:25.518 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-04-09T18:35:25.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:25.519 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:25.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:25.577 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:25.578 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:25.586 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:35:25.587 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:35:25.588 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-04-09T18:35:25.588 DEBUG:teuthology.orchestra.run.smithi090:> import time 2021-04-09T18:35:25.589 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:35:25.589 DEBUG:teuthology.orchestra.run.smithi090:> with open("/home/ubuntu/cephtest/mnt.0/testfile", '"'"'w'"'"') as f: 2021-04-09T18:35:25.589 DEBUG:teuthology.orchestra.run.smithi090:> f.write('"'"'content'"'"') 2021-04-09T18:35:25.590 DEBUG:teuthology.orchestra.run.smithi090:> f.flush() 2021-04-09T18:35:25.590 DEBUG:teuthology.orchestra.run.smithi090:> f.write('"'"'content2'"'"') 2021-04-09T18:35:25.590 DEBUG:teuthology.orchestra.run.smithi090:> while True: 2021-04-09T18:35:25.591 DEBUG:teuthology.orchestra.run.smithi090:> time.sleep(1) 2021-04-09T18:35:25.591 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:35:25.631 DEBUG:teuthology.orchestra.run.smithi090:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2021-04-09T18:35:25.652 INFO:teuthology.orchestra.run.smithi090.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/testfile': No such file or directory 2021-04-09T18:35:25.653 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-04-09T18:35:26.655 DEBUG:teuthology.orchestra.run.smithi090:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2021-04-09T18:35:26.673 INFO:teuthology.orchestra.run.smithi090.stdout:/home/ubuntu/cephtest/mnt.0/testfile 2021-04-09T18:35:26.675 DEBUG:tasks.cephfs.mount:File testfile became visible from 0 after 1s 2021-04-09T18:35:26.675 DEBUG:teuthology.orchestra.run.smithi136:> sudo ls /home/ubuntu/cephtest/mnt.1/testfile 2021-04-09T18:35:26.715 INFO:teuthology.orchestra.run.smithi136.stdout:/home/ubuntu/cephtest/mnt.1/testfile 2021-04-09T18:35:26.717 DEBUG:tasks.cephfs.mount:File testfile became visible from 1 after 0s 2021-04-09T18:35:26.717 DEBUG:teuthology.orchestra.run.smithi136:> cd /home/ubuntu/cephtest/mnt.1 && sudo cat testfile 2021-04-09T18:35:26.800 INFO:teuthology.orchestra.run.smithi136.stdout:content 2021-04-09T18:35:26.815 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:35:26.816 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:26.832 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:26.849 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:26.875 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:26.894 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:26.913 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:35:26.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:26.914 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:26.914 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:26.924 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:35:26.925 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:35:26.926 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi090.front.sepia.ceph.com... 2021-04-09T18:35:26.926 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:35:26.927 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:26.998 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[14153]: fuse finished with error 0 and tester_r 0 2021-04-09T18:35:27.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:27.001 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:27.001 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:27.049 INFO:teuthology.orchestra.run.smithi090.stdout:ext2/ext3 2021-04-09T18:35:27.050 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:35:27.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:35:27.122 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:27.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:27.131 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:27.131 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:27.139 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-04-09T18:35:27.140 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-04-09T18:35:27.141 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2021-04-09T18:35:27.141 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:35:27.141 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:27.239 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13782]: fuse finished with error 0 and tester_r 0 2021-04-09T18:35:27.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:27.241 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:27.242 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:27.249 INFO:teuthology.orchestra.run.smithi136.stdout:ext2/ext3 2021-04-09T18:35:27.251 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:35:27.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:35:27.285 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:27.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:27.338 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:27.338 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:35:27.345 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:35:27.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:35:27.348 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:35:27.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:35:27.350 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:35:27.397 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:35:27.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f8614cd2700 1 Processor -- start 2021-04-09T18:35:27.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f8614cd2700 1 -- start start 2021-04-09T18:35:27.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f8614cd2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f86100f5710 0x7f86100f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:27.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f8614cd2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86101c8200 0x7f86101ca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:27.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f8614cd2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86100fbd10 con 0x7f86100e9cd0 2021-04-09T18:35:27.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f8614cd2700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86100ea120 con 0x7f86100f5710 2021-04-09T18:35:27.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f8614cd2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86101c3fb0 con 0x7f86101c8200 2021-04-09T18:35:27.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f860e7e6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f86100f5710 0x7f86100f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:27.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f860e7e6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f86100f5710 0x7f86100f66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35198/0 (socket says 172.21.15.79:35198) 2021-04-09T18:35:27.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f860e7e6700 1 -- 172.21.15.79:0/1976551380 learned_addr learned my addr 172.21.15.79:0/1976551380 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:27.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f860efe7700 1 --2- 172.21.15.79:0/1976551380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86101c8200 0x7f86101ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:27.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f860e7e6700 1 -- 172.21.15.79:0/1976551380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86101c8200 msgr2=0x7f86101ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:27.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f860e7e6700 1 --2- 172.21.15.79:0/1976551380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86101c8200 0x7f86101ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:27.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f860e7e6700 1 -- 172.21.15.79:0/1976551380 >> v1:172.21.15.89:6789/0 conn(0x7f86100e9cd0 legacy=0x7f861009f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:27.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f860e7e6700 1 -- 172.21.15.79:0/1976551380 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861009f9f0 con 0x7f86100f5710 2021-04-09T18:35:27.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f860e7e6700 1 --2- 172.21.15.79:0/1976551380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86100f5710 0x7f86100f66a0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f86100f70f0 tx=0x7f85f800b3c0).ready entity=mon.0 client_cookie=4f53a6dc3c92278f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:27.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f860d7e4700 1 -- 172.21.15.79:0/1976551380 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f861009f9f0 con 0x7f86100f5710 2021-04-09T18:35:27.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f860d7e4700 1 -- 172.21.15.79:0/1976551380 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f800bbe0 con 0x7f86100f5710 2021-04-09T18:35:27.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f860d7e4700 1 -- 172.21.15.79:0/1976551380 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f85f8002020 con 0x7f86100f5710 2021-04-09T18:35:27.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f8614cd2700 1 -- 172.21.15.79:0/1976551380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86100f5710 msgr2=0x7f86100f66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:27.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f8614cd2700 1 --2- 172.21.15.79:0/1976551380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86100f5710 0x7f86100f66a0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f86100f70f0 tx=0x7f85f800b3c0).stop 2021-04-09T18:35:27.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f8614cd2700 1 -- 172.21.15.79:0/1976551380 shutdown_connections 2021-04-09T18:35:27.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f8614cd2700 1 --2- 172.21.15.79:0/1976551380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86101c8200 0x7f86101ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:27.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f8614cd2700 1 --2- 172.21.15.79:0/1976551380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86100f5710 0x7f86100f66a0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:27.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f8614cd2700 1 -- 172.21.15.79:0/1976551380 >> 172.21.15.79:0/1976551380 conn(0x7f86100e61d0 msgr2=0x7f86100e94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:27.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f8614cd2700 1 -- 172.21.15.79:0/1976551380 shutdown_connections 2021-04-09T18:35:27.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.490 7f8614cd2700 1 -- 172.21.15.79:0/1976551380 wait complete. 2021-04-09T18:35:27.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f8614cd2700 1 Processor -- start 2021-04-09T18:35:27.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f8614cd2700 1 -- start start 2021-04-09T18:35:27.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f8614cd2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86100b8f50 0x7f8610098d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:27.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f8614cd2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86100d0080 0x7f86100d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:27.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f8614cd2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86100ba110 0x7f86100ba560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:27.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f8614cd2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8610047740 con 0x7f86100b8f50 2021-04-09T18:35:27.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f8614cd2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86100b9e10 con 0x7f86100ba110 2021-04-09T18:35:27.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f8614cd2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86100993a0 con 0x7f86100d0080 2021-04-09T18:35:27.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f860e7e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86100b8f50 0x7f8610098d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:27.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f860e7e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86100b8f50 0x7f8610098d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35204/0 (socket says 172.21.15.79:35204) 2021-04-09T18:35:27.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f860e7e6700 1 -- 172.21.15.79:0/1592279772 learned_addr learned my addr 172.21.15.79:0/1592279772 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:27.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f860efe7700 1 --2- 172.21.15.79:0/1592279772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86100ba110 0x7f86100ba560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:27.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f860dfe5700 1 --2- 172.21.15.79:0/1592279772 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86100d0080 0x7f86100d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:27.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f860e7e6700 1 -- 172.21.15.79:0/1592279772 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86100d0080 msgr2=0x7f86100d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:27.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f860e7e6700 1 --2- 172.21.15.79:0/1592279772 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86100d0080 0x7f86100d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:27.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f860e7e6700 1 -- 172.21.15.79:0/1592279772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86100ba110 msgr2=0x7f86100ba560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:27.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f860e7e6700 1 --2- 172.21.15.79:0/1592279772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86100ba110 0x7f86100ba560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:27.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f860e7e6700 1 -- 172.21.15.79:0/1592279772 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86100b96a0 con 0x7f86100b8f50 2021-04-09T18:35:27.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f860e7e6700 1 --2- 172.21.15.79:0/1592279772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86100b8f50 0x7f8610098d70 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f86100d4090 tx=0x7f85f8006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:27.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f8606ffd700 1 -- 172.21.15.79:0/1592279772 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f86100b96a0 con 0x7f86100b8f50 2021-04-09T18:35:27.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f8606ffd700 1 -- 172.21.15.79:0/1592279772 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f801b670 con 0x7f86100b8f50 2021-04-09T18:35:27.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.494 7f8614cd2700 1 -- 172.21.15.79:0/1592279772 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86100b99c0 con 0x7f86100b8f50 2021-04-09T18:35:27.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.498 7f8606ffd700 1 -- 172.21.15.79:0/1592279772 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f85f801ba40 con 0x7f86100b8f50 2021-04-09T18:35:27.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.498 7f8614cd2700 1 -- 172.21.15.79:0/1592279772 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8610099730 con 0x7f86100b8f50 2021-04-09T18:35:27.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.498 7f8606ffd700 1 -- 172.21.15.79:0/1592279772 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f85f8019040 con 0x7f86100b8f50 2021-04-09T18:35:27.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.498 7f8606ffd700 1 --2- 172.21.15.79:0/1592279772 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f85f4029100 0x7f85f402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:27.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.498 7f8606ffd700 1 -- 172.21.15.79:0/1592279772 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f85f8018040 con 0x7f86100b8f50 2021-04-09T18:35:27.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.498 7f860dfe5700 1 --2- 172.21.15.79:0/1592279772 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f85f4029100 0x7f85f402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:27.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.498 7f860dfe5700 1 --2- 172.21.15.79:0/1592279772 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f85f4029100 0x7f85f402b650 crc :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:27.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.502 7f8614cd2700 1 -- 172.21.15.79:0/1592279772 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8610088e80 con 0x7f86100b8f50 2021-04-09T18:35:27.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.506 7f8606ffd700 1 -- 172.21.15.79:0/1592279772 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f85f800b9d0 con 0x7f86100b8f50 2021-04-09T18:35:27.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.670 7f8614cd2700 1 -- 172.21.15.79:0/1592279772 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f86100e3bb0 con 0x7f86100b8f50 2021-04-09T18:35:27.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.670 7f8606ffd700 1 -- 172.21.15.79:0/1592279772 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v126) v1 ==== 81+0+30766 (secure 0 0 0) 0x7f85f801b460 con 0x7f86100b8f50 2021-04-09T18:35:27.679 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:27.680 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:35:27.680 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 126, 2021-04-09T18:35:27.680 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:35:27.681 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:35:27.681 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:35:14.182279", 2021-04-09T18:35:27.682 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:35:27.682 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:35:27.683 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:35:27.683 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:35:27.684 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:35:27.684 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:35:27.684 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:35:27.685 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:35:27.685 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:35:27.686 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:35:27.686 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:35:27.687 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:35:27.687 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:35:27.687 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:35:27.688 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:35:27.688 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 25, 2021-04-09T18:35:27.689 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:35:27.689 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:35:27.690 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:35:27.690 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:35:27.690 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:35:27.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.691 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:35:27.692 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:35:27.692 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:35:27.692 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:35:27.693 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:35:27.693 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:35:27.694 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:35:27.694 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:35:27.695 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:35:27.695 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:35:27.695 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:35:27.696 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:35:27.696 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:35:27.697 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:35:27.697 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:35:27.697 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:35:27.698 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:35:27.698 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:35:27.699 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:35:27.699 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:35:27.700 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:35:27.700 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:35:27.700 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:35:27.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.701 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:35:27.702 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:35:27.702 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:35:27.702 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:35:27.703 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:35:27.703 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:35:27.704 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:35:27.704 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:35:27.704 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:35:27.705 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:35:27.705 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:35:27.706 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:35:27.706 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:35:27.707 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:35:27.707 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:35:27.707 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:35:27.708 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:35:27.708 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:35:27.709 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:35:27.709 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:35:27.709 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:35:27.710 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:35:27.710 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:35:27.711 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:35:27.711 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:35:27.711 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:35:27.712 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:35:27.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.713 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:35:27.713 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:35:27.714 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:35:27.714 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:35:27.714 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:35:27.715 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:35:27.715 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:35:27.716 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:35:27.716 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:35:27.716 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:35:27.717 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:35:27.717 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:35:27.718 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:35:27.718 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:35:27.718 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.720 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 24, 2021-04-09T18:35:27.720 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2021-04-09T18:35:27.721 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:35:11.346312", 2021-04-09T18:35:27.721 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:35:27.721 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:35:27.722 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:35:27.722 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:35:27.722 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:35:27.723 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:35:27.723 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:35:27.723 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:35:27.723 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:35:27.724 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:35:27.724 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:35:27.724 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:35:27.724 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:35:27.724 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:35:27.725 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:35:27.725 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:35:27.725 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:35:27.725 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:35:27.726 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:35:27.726 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:35:27.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.726 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "125", 2021-04-09T18:35:27.727 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:35:27.727 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:35:27.727 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:35:27.727 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:35:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:35:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:35:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:35:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:35:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:35:27.729 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:35:27.729 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:35:27.729 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:35:27.729 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:35:27.730 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:35:27.730 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:35:27.730 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:35:27.730 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:35:27.730 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:35:27.731 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:35:27.731 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:35:27.731 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:35:27.731 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:35:27.732 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:35:27.732 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:35:27.732 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:35:27.732 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:35:27.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.733 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:35:27.733 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:35:27.733 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:35:27.733 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:35:27.733 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:35:27.734 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:35:27.734 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:35:27.734 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:35:27.734 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:35:27.734 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:35:27.735 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:35:27.735 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2021-04-09T18:35:27.735 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2021-04-09T18:35:27.735 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2021-04-09T18:35:27.736 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2021-04-09T18:35:27.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.736 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:35:27.736 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:35:27.736 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2021-04-09T18:35:27.737 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.737 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.737 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 25, 2021-04-09T18:35:27.738 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2021-04-09T18:35:27.738 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:35:12.219337", 2021-04-09T18:35:27.738 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:35:27.738 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:35:27.738 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:35:27.739 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:35:27.739 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:35:27.739 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:35:27.739 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:35:27.739 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:35:27.740 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:35:27.740 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:35:27.740 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:35:27.740 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:35:27.741 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:35:27.741 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:35:27.741 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:35:27.741 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:35:27.741 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:35:27.742 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:35:27.742 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:35:27.742 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:35:27.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.742 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "126", 2021-04-09T18:35:27.743 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:35:27.743 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:35:27.743 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:35:27.743 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:35:27.743 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:35:27.744 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:35:27.744 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:35:27.744 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:35:27.744 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:35:27.744 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:35:27.745 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:35:27.745 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:35:27.745 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:35:27.745 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:35:27.746 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:35:27.746 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:35:27.746 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:35:27.746 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:35:27.746 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:35:27.747 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:35:27.747 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:35:27.747 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:35:27.747 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:35:27.747 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:35:27.748 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:35:27.748 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:35:27.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.748 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:35:27.748 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:35:27.749 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:35:27.749 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:35:27.749 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:35:27.749 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:35:27.749 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:35:27.750 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:35:27.750 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:35:27.750 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:35:27.750 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:35:27.750 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:35:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:35:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:35:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2021-04-09T18:35:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:35:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:35:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:35:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:35:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:27.754 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:27.754 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:27.754 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:27.754 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:27.754 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 124, 2021-04-09T18:35:27.755 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:27.755 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:27.755 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:27.755 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.756 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.756 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:35:27.756 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:27.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.757 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.757 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:35:27.757 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:27.757 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.758 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.758 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:27.758 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.759 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.759 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:35:27.759 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:27.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.760 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.760 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:35:27.760 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:27.760 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.761 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.761 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:27.761 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.762 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.762 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:35:27.762 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:27.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.763 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.763 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:35:27.763 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:27.763 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.764 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.764 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:27.764 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.765 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.765 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:35:27.765 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:27.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.766 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.766 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:35:27.766 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:27.766 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.767 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.767 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:35:27.767 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:35:27.767 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:35:27.768 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:35:27.768 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:27.768 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:27.768 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:27.769 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.769 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:35:27.769 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:35:27.770 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:27.770 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:27.770 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:27.770 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:27.770 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:27.771 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:27.771 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:27.771 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 123, 2021-04-09T18:35:27.771 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:27.772 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:27.772 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:27.772 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.772 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.773 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:35:27.773 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:27.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.773 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.774 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:35:27.774 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:27.774 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.774 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.775 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:27.775 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.775 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.775 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:35:27.776 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:27.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.776 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.776 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:35:27.777 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:27.777 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.777 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.778 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:27.778 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.778 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.778 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:35:27.779 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:27.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.779 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.779 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:35:27.780 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:27.780 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.780 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.780 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:27.781 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.781 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.781 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:35:27.781 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:27.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.782 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.782 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:35:27.783 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:27.783 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.783 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.783 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:35:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:35:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:35:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:35:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:27.785 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:27.785 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:27.785 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.786 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:35:27.786 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:35:27.786 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:27.786 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:27.786 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:27.787 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:27.787 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:27.787 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:27.787 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:27.787 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 124, 2021-04-09T18:35:27.788 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:27.788 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:27.788 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:27.788 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.789 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.789 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:35:27.789 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:27.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.790 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.790 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:35:27.790 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:27.790 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.791 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.791 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:27.791 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.792 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.792 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:35:27.792 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:27.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.793 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.793 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:35:27.793 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:27.793 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.793 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.794 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:27.794 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.794 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.795 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:35:27.795 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:27.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.796 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.796 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:35:27.796 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:27.796 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.796 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.797 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:27.797 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.797 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.798 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:35:27.798 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:27.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.798 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.799 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:35:27.799 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:27.799 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.799 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.800 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:35:27.800 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:35:27.800 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:35:27.800 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:35:27.801 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:27.801 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:27.801 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:27.801 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.802 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:35:27.802 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:35:27.802 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:27.803 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:27.803 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:27.803 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:27.803 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:27.804 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:27.804 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:27.804 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 124, 2021-04-09T18:35:27.804 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:27.804 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:27.805 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:27.805 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.805 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.805 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:35:27.806 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:27.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.806 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.807 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:35:27.807 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:27.807 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.807 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.808 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:27.808 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.808 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.808 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:35:27.809 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:27.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.809 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.809 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:35:27.810 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:27.810 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.810 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.811 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:27.811 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.811 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.811 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:35:27.812 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:27.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.812 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.812 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:35:27.813 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:27.813 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.813 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.813 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:27.814 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.814 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.814 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:35:27.814 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:27.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.815 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.815 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:35:27.816 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:27.816 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.816 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.816 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:35:27.817 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:35:27.817 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:35:27.817 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:35:27.817 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:27.817 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:27.818 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:27.818 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.818 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:35:27.819 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:35:27.819 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:27.819 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:27.819 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:27.820 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:27.820 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:27.820 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:27.820 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:27.820 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 117, 2021-04-09T18:35:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:35:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:35:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:35:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:35:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:35:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:35:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:35:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:35:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:35:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:35:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:35:27.834 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:35:27.834 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:27.834 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:27.834 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:27.834 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.835 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:35:27.835 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:35:27.836 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:27.836 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:27.836 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:27.836 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:27.836 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:27.837 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:27.837 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:27.837 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 123, 2021-04-09T18:35:27.837 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:27.837 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:27.838 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:27.838 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.838 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.838 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:35:27.839 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:27.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.839 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.839 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:35:27.840 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:27.840 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.840 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.840 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:27.841 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.841 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.841 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:35:27.842 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:27.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.842 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.842 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:35:27.843 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:27.843 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.843 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.843 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:27.844 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.844 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.844 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:35:27.844 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:27.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.845 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.845 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:35:27.845 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:27.846 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.846 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.846 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:27.846 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.847 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.847 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:35:27.847 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:27.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.848 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.848 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:35:27.848 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:27.849 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.849 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.849 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:35:27.849 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:35:27.850 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:35:27.850 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:35:27.850 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:27.850 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:27.850 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:27.851 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.851 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:35:27.852 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:35:27.852 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:27.852 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:27.852 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:27.852 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:27.853 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:27.853 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:27.853 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:27.853 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 124, 2021-04-09T18:35:27.853 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:27.854 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:27.854 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:27.854 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.854 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.855 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:35:27.855 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:27.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.855 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.856 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:35:27.856 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:27.856 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.856 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.857 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:27.857 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.857 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.857 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:35:27.858 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:27.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.858 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.859 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:35:27.859 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:27.859 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.859 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.860 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:27.860 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.860 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.860 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:35:27.861 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:27.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.861 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.862 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:35:27.862 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:27.862 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.862 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.863 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:27.863 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.863 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.864 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:35:27.864 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:27.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.865 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.865 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:35:27.865 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:27.865 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.865 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.866 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:35:27.866 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:35:27.866 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:35:27.867 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:35:27.867 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:27.867 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:27.867 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:27.867 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.868 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:35:27.868 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:35:27.869 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:27.869 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:27.869 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:27.869 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:27.869 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:27.870 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:27.870 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:27.870 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 124, 2021-04-09T18:35:27.870 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:27.871 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:27.871 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:27.871 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.872 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.872 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:35:27.872 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:27.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.873 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.873 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:35:27.873 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:27.873 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.874 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.874 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:27.874 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.875 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.875 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:35:27.875 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:27.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.876 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.876 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:35:27.876 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:27.877 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.877 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.877 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:27.877 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.878 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.878 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:35:27.878 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:27.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.879 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.879 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:35:27.879 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:27.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.880 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.880 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:27.880 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:27.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.881 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:27.881 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:35:27.881 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:27.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.882 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:27.882 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:35:27.882 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:27.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.883 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.883 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:35:27.883 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:35:27.884 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:35:27.884 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:35:27.884 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:27.884 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:27.884 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:27.885 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:27.885 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.885 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:35:27.885 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:35:27.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.886 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:35:27.886 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:27.886 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:27.887 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:27.887 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:27.887 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:27.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.888 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:35:27.888 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:27.888 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:27.888 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:27.889 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:27.889 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:27.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.890 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:35:27.890 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:27.890 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:27.890 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:27.890 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:27.891 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:27.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.891 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:35:27.892 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:27.892 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:27.892 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:27.892 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:27.892 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:27.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.893 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:35:27.893 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:27.894 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:27.894 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:27.894 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:27.894 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:27.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.895 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:35:27.895 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:27.895 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:27.896 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:27.896 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:27.896 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:27.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.897 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:35:27.897 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:27.897 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:27.898 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:27.898 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:27.898 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:27.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:27.899 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:35:27.899 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:27.899 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:27.899 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:27.899 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:27.900 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:27.900 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.900 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:35:27.900 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:35:27.900 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:35:27.901 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:35:27.901 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:35:27.901 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": {}, 2021-04-09T18:35:27.901 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:35:27.901 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:35:27.902 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:35:27.902 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:35:27.902 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:35:27.902 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:35:27.902 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:35:27.903 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:35:27.903 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:35:27.903 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:35:27.903 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:35:27.904 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:35:27.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.904 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:35:27.904 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:35:27.904 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:35:27.905 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:35:27.905 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:35:27.905 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:35:27.905 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:35:27.905 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:27.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:27.906 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:35:27.906 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:35:27.906 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:35:27.906 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:35:27.907 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:35:27.907 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:35:27.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.674 7f8614cd2700 1 -- 172.21.15.79:0/1592279772 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f85f4029100 msgr2=0x7f85f402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:27.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.674 7f8614cd2700 1 --2- 172.21.15.79:0/1592279772 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f85f4029100 0x7f85f402b650 crc :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:27.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.674 7f8614cd2700 1 -- 172.21.15.79:0/1592279772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86100b8f50 msgr2=0x7f8610098d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:27.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.674 7f8614cd2700 1 --2- 172.21.15.79:0/1592279772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86100b8f50 0x7f8610098d70 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f86100d4090 tx=0x7f85f8006c10).stop 2021-04-09T18:35:27.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.674 7f8614cd2700 1 -- 172.21.15.79:0/1592279772 shutdown_connections 2021-04-09T18:35:27.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.674 7f8614cd2700 1 --2- 172.21.15.79:0/1592279772 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f85f4029100 0x7f85f402b650 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:27.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.674 7f8614cd2700 1 --2- 172.21.15.79:0/1592279772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86100ba110 0x7f86100ba560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:27.910 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.674 7f8614cd2700 1 --2- 172.21.15.79:0/1592279772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86100b8f50 0x7f8610098d70 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:27.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.674 7f8614cd2700 1 --2- 172.21.15.79:0/1592279772 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86100d0080 0x7f86100d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:27.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.674 7f8614cd2700 1 -- 172.21.15.79:0/1592279772 >> 172.21.15.79:0/1592279772 conn(0x7f86100d8290 msgr2=0x7f86100d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:27.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.674 7f8614cd2700 1 -- 172.21.15.79:0/1592279772 shutdown_connections 2021-04-09T18:35:27.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:27.674 7f8614cd2700 1 -- 172.21.15.79:0/1592279772 wait complete. 2021-04-09T18:35:27.912 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:35:28.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.006 7f6c3037c700 1 Processor -- start 2021-04-09T18:35:28.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.006 7f6c3037c700 1 -- start start 2021-04-09T18:35:28.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c3037c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6c280e9ce0 0x7f6c2809f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:28.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c3037c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c281c8210 0x7f6c281ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:28.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c3037c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c280fbd20 con 0x7f6c280f5720 2021-04-09T18:35:28.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c3037c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c281c3fc0 con 0x7f6c280e9ce0 2021-04-09T18:35:28.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c3037c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c280ea130 con 0x7f6c281c8210 2021-04-09T18:35:28.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c2e120700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6c280f5720 0x7f6c280f66b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58152/0 (socket says 172.21.15.79:58152) 2021-04-09T18:35:28.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c2e120700 1 -- 172.21.15.79:0/242122472 learned_addr learned my addr 172.21.15.79:0/242122472 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:28.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c2e921700 1 --2- 172.21.15.79:0/242122472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c281c8210 0x7f6c281ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:28.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c2d91f700 1 --2- 172.21.15.79:0/242122472 >> v2:172.21.15.89:3300/0 conn(0x7f6c280e9ce0 0x7f6c2809f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:28.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c2d11e700 1 -- 172.21.15.79:0/242122472 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759222631 0 0) 0x7f6c240010d0 con 0x7f6c280f5720 2021-04-09T18:35:28.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c2d11e700 1 -- 172.21.15.79:0/242122472 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c14003240 con 0x7f6c280f5720 2021-04-09T18:35:28.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c2e921700 1 -- 172.21.15.79:0/242122472 >> v2:172.21.15.89:3300/0 conn(0x7f6c280e9ce0 msgr2=0x7f6c2809f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:28.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c2e921700 1 --2- 172.21.15.79:0/242122472 >> v2:172.21.15.89:3300/0 conn(0x7f6c280e9ce0 0x7f6c2809f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:28.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c2e921700 1 -- 172.21.15.79:0/242122472 >> v1:172.21.15.79:6789/0 conn(0x7f6c280f5720 legacy=0x7f6c280f66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:28.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c2e921700 1 -- 172.21.15.79:0/242122472 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c280e58d0 con 0x7f6c281c8210 2021-04-09T18:35:28.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c2e921700 1 --2- 172.21.15.79:0/242122472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c281c8210 0x7f6c281ca670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f6c200032b0 tx=0x7f6c2000b0e0).ready entity=mon.2 client_cookie=848dd8e6e700f9a3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:28.032 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c2d11e700 1 -- 172.21.15.79:0/242122472 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c280e58d0 con 0x7f6c281c8210 2021-04-09T18:35:28.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c2d11e700 1 -- 172.21.15.79:0/242122472 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2000bab0 con 0x7f6c281c8210 2021-04-09T18:35:28.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c2d11e700 1 -- 172.21.15.79:0/242122472 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c20002020 con 0x7f6c281c8210 2021-04-09T18:35:28.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c3037c700 1 -- 172.21.15.79:0/242122472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c281c8210 msgr2=0x7f6c281ca670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:28.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c3037c700 1 --2- 172.21.15.79:0/242122472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c281c8210 0x7f6c281ca670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f6c200032b0 tx=0x7f6c2000b0e0).stop 2021-04-09T18:35:28.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c3037c700 1 -- 172.21.15.79:0/242122472 shutdown_connections 2021-04-09T18:35:28.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c3037c700 1 --2- 172.21.15.79:0/242122472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c281c8210 0x7f6c281ca670 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:28.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c3037c700 1 --2- 172.21.15.79:0/242122472 >> v2:172.21.15.89:3300/0 conn(0x7f6c280e9ce0 0x7f6c2809f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:28.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c3037c700 1 -- 172.21.15.79:0/242122472 >> 172.21.15.79:0/242122472 conn(0x7f6c280e61e0 msgr2=0x7f6c280e94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:28.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c3037c700 1 -- 172.21.15.79:0/242122472 shutdown_connections 2021-04-09T18:35:28.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.010 7f6c3037c700 1 -- 172.21.15.79:0/242122472 wait complete. 2021-04-09T18:35:28.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.014 7f6c3037c700 1 Processor -- start 2021-04-09T18:35:28.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.014 7f6c3037c700 1 -- start start 2021-04-09T18:35:28.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.014 7f6c3037c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c280b9f00 0x7f6c280a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:28.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.014 7f6c3037c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c2819f000 0x7f6c280d50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:28.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.014 7f6c3037c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c280d56f0 0x7f6c280c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:28.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.014 7f6c3037c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c28088ba0 con 0x7f6c2819f000 2021-04-09T18:35:28.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.014 7f6c3037c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c28096280 con 0x7f6c280b9f00 2021-04-09T18:35:28.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.014 7f6c3037c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c28096580 con 0x7f6c280d56f0 2021-04-09T18:35:28.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.018 7f6c2d91f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c2819f000 0x7f6c280d50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:28.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.018 7f6c2d91f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c2819f000 0x7f6c280d50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35216/0 (socket says 172.21.15.79:35216) 2021-04-09T18:35:28.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.018 7f6c2d91f700 1 -- 172.21.15.79:0/3625363217 learned_addr learned my addr 172.21.15.79:0/3625363217 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:28.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.018 7f6c2e921700 1 --2- 172.21.15.79:0/3625363217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c280d56f0 0x7f6c280c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:28.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.018 7f6c2e120700 1 --2- 172.21.15.79:0/3625363217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c280b9f00 0x7f6c280a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:28.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.018 7f6c2d91f700 1 -- 172.21.15.79:0/3625363217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c280d56f0 msgr2=0x7f6c280c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:28.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.018 7f6c2d91f700 1 --2- 172.21.15.79:0/3625363217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c280d56f0 0x7f6c280c56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:28.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.018 7f6c2d91f700 1 -- 172.21.15.79:0/3625363217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c280b9f00 msgr2=0x7f6c280a6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:28.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.018 7f6c2d91f700 1 --2- 172.21.15.79:0/3625363217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c280b9f00 0x7f6c280a6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:28.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.018 7f6c2d91f700 1 -- 172.21.15.79:0/3625363217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c28097b00 con 0x7f6c2819f000 2021-04-09T18:35:28.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.018 7f6c2d91f700 1 --2- 172.21.15.79:0/3625363217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c2819f000 0x7f6c280d50c0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f6c280d8200 tx=0x7f6c1800c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:28.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.018 7f6c1effd700 1 -- 172.21.15.79:0/3625363217 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c28097b00 con 0x7f6c2819f000 2021-04-09T18:35:28.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.018 7f6c1effd700 1 -- 172.21.15.79:0/3625363217 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1800cc10 con 0x7f6c2819f000 2021-04-09T18:35:28.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.018 7f6c3037c700 1 -- 172.21.15.79:0/3625363217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c280ba7a0 con 0x7f6c2819f000 2021-04-09T18:35:28.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.018 7f6c1effd700 1 -- 172.21.15.79:0/3625363217 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c1800f040 con 0x7f6c2819f000 2021-04-09T18:35:28.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.018 7f6c3037c700 1 -- 172.21.15.79:0/3625363217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c280a70a0 con 0x7f6c2819f000 2021-04-09T18:35:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.018 7f6c1effd700 1 -- 172.21.15.79:0/3625363217 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6c18011070 con 0x7f6c2819f000 2021-04-09T18:35:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.018 7f6c1effd700 1 --2- 172.21.15.79:0/3625363217 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6c10029100 0x7f6c1002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.018 7f6c1effd700 1 -- 172.21.15.79:0/3625363217 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f6c18010040 con 0x7f6c2819f000 2021-04-09T18:35:28.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.018 7f6c2e120700 1 --2- 172.21.15.79:0/3625363217 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6c10029100 0x7f6c1002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:28.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.022 7f6c3037c700 1 -- 172.21.15.79:0/3625363217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c28088e90 con 0x7f6c2819f000 2021-04-09T18:35:28.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.022 7f6c2e120700 1 --2- 172.21.15.79:0/3625363217 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6c10029100 0x7f6c1002b650 crc :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:28.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.026 7f6c1effd700 1 -- 172.21.15.79:0/3625363217 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6c18000bf0 con 0x7f6c2819f000 2021-04-09T18:35:28.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.194 7f6c3037c700 1 -- 172.21.15.79:0/3625363217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c280e3bc0 con 0x7f6c2819f000 2021-04-09T18:35:28.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.194 7f6c1effd700 1 -- 172.21.15.79:0/3625363217 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+2105 (secure 0 0 0) 0x7f6c1800c810 con 0x7f6c2819f000 2021-04-09T18:35:28.201 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 79 2021-04-09T18:35:28.202 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:28.202 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":79,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7842,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1552365531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1552365531},{"type":"v1","addr":"172.21.15.89:6835","nonce":1552365531}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":77}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:35:13.180244","modified":"2021-04-09 18:35:15.198467","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7833},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7833":{"gid":7833,"name":"a","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6833/4102869700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":4102869700},{"type":"v1","addr":"172.21.15.79:6833","nonce":4102869700}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-04-09T18:35:28.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.198 7f6c3037c700 1 -- 172.21.15.79:0/3625363217 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6c10029100 msgr2=0x7f6c1002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:28.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.198 7f6c3037c700 1 --2- 172.21.15.79:0/3625363217 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6c10029100 0x7f6c1002b650 crc :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:28.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.198 7f6c3037c700 1 -- 172.21.15.79:0/3625363217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c2819f000 msgr2=0x7f6c280d50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:28.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.198 7f6c3037c700 1 --2- 172.21.15.79:0/3625363217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c2819f000 0x7f6c280d50c0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f6c280d8200 tx=0x7f6c1800c150).stop 2021-04-09T18:35:28.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.198 7f6c3037c700 1 -- 172.21.15.79:0/3625363217 shutdown_connections 2021-04-09T18:35:28.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.198 7f6c3037c700 1 --2- 172.21.15.79:0/3625363217 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6c10029100 0x7f6c1002b650 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:28.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.198 7f6c3037c700 1 --2- 172.21.15.79:0/3625363217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c280b9f00 0x7f6c280a6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:28.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.198 7f6c3037c700 1 --2- 172.21.15.79:0/3625363217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c280d56f0 0x7f6c280c56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:28.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.198 7f6c3037c700 1 --2- 172.21.15.79:0/3625363217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c2819f000 0x7f6c280d50c0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:28.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.198 7f6c3037c700 1 -- 172.21.15.79:0/3625363217 >> 172.21.15.79:0/3625363217 conn(0x7f6c280956b0 msgr2=0x7f6c280ae3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:28.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.198 7f6c3037c700 1 -- 172.21.15.79:0/3625363217 shutdown_connections 2021-04-09T18:35:28.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.198 7f6c3037c700 1 -- 172.21.15.79:0/3625363217 wait complete. 2021-04-09T18:35:28.213 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-04-09T18:35:28.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.298 7f4d7e544700 1 Processor -- start 2021-04-09T18:35:28.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.298 7f4d7e544700 1 -- start start 2021-04-09T18:35:28.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.298 7f4d7e544700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4d780e9ce0 0x7f4d7809f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:28.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.298 7f4d7e544700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d780fbd20 con 0x7f4d781c8210 2021-04-09T18:35:28.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.298 7f4d7e544700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d780e58d0 con 0x7f4d780f5720 2021-04-09T18:35:28.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.298 7f4d7e544700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d781c3fc0 con 0x7f4d780e9ce0 2021-04-09T18:35:28.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.298 7f4d7cae9700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4d781c8210 0x7f4d781ca670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58170/0 (socket says 172.21.15.79:58170) 2021-04-09T18:35:28.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.298 7f4d7cae9700 1 -- 172.21.15.79:0/4054535932 learned_addr learned my addr 172.21.15.79:0/4054535932 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:28.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.298 7f4d777fe700 1 --2- 172.21.15.79:0/4054535932 >> v2:172.21.15.89:3300/0 conn(0x7f4d780e9ce0 0x7f4d7809f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:28.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.298 7f4d76ffd700 1 -- 172.21.15.79:0/4054535932 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045535135 0 0) 0x7f4d600010d0 con 0x7f4d781c8210 2021-04-09T18:35:28.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.298 7f4d76ffd700 1 -- 172.21.15.79:0/4054535932 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d58003240 con 0x7f4d781c8210 2021-04-09T18:35:28.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.298 7f4d777fe700 1 -- 172.21.15.79:0/4054535932 >> v1:172.21.15.89:6789/0 conn(0x7f4d780f5720 legacy=0x7f4d780f66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:28.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.298 7f4d777fe700 1 -- 172.21.15.79:0/4054535932 >> v1:172.21.15.79:6789/0 conn(0x7f4d781c8210 legacy=0x7f4d781ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:28.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.298 7f4d777fe700 1 -- 172.21.15.79:0/4054535932 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d780e4530 con 0x7f4d780e9ce0 2021-04-09T18:35:28.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.298 7f4d777fe700 1 --2- 172.21.15.79:0/4054535932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d780e9ce0 0x7f4d7809f200 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f4d700032b0 tx=0x7f4d7000b0e0).ready entity=mon.1 client_cookie=8343bc6a9b014879 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:28.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.298 7f4d76ffd700 1 -- 172.21.15.79:0/4054535932 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d780e4530 con 0x7f4d780e9ce0 2021-04-09T18:35:28.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.298 7f4d76ffd700 1 -- 172.21.15.79:0/4054535932 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7000bab0 con 0x7f4d780e9ce0 2021-04-09T18:35:28.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.298 7f4d76ffd700 1 -- 172.21.15.79:0/4054535932 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d70002020 con 0x7f4d780e9ce0 2021-04-09T18:35:28.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.298 7f4d7e544700 1 -- 172.21.15.79:0/4054535932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d780e9ce0 msgr2=0x7f4d7809f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:28.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.298 7f4d7e544700 1 --2- 172.21.15.79:0/4054535932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d780e9ce0 0x7f4d7809f200 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f4d700032b0 tx=0x7f4d7000b0e0).stop 2021-04-09T18:35:28.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.302 7f4d7e544700 1 -- 172.21.15.79:0/4054535932 shutdown_connections 2021-04-09T18:35:28.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.302 7f4d7e544700 1 --2- 172.21.15.79:0/4054535932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d780e9ce0 0x7f4d7809f200 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:28.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.302 7f4d7e544700 1 -- 172.21.15.79:0/4054535932 >> 172.21.15.79:0/4054535932 conn(0x7f4d780e61e0 msgr2=0x7f4d780e94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:28.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.302 7f4d7e544700 1 -- 172.21.15.79:0/4054535932 shutdown_connections 2021-04-09T18:35:28.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.302 7f4d7e544700 1 -- 172.21.15.79:0/4054535932 wait complete. 2021-04-09T18:35:28.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.302 7f4d7e544700 1 Processor -- start 2021-04-09T18:35:28.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.302 7f4d7e544700 1 -- start start 2021-04-09T18:35:28.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d7e544700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d78097ba0 0x7f4d78096760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:28.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d7e544700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d780d6390 0x7f4d781a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:28.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d7e544700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d781a0bf0 0x7f4d780d5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:28.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d7e544700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d78047750 con 0x7f4d780d6390 2021-04-09T18:35:28.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d7e544700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d780ea130 con 0x7f4d781a0bf0 2021-04-09T18:35:28.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d7e544700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d780978a0 con 0x7f4d78097ba0 2021-04-09T18:35:28.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d777fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d780d6390 0x7f4d781a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:28.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d777fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d780d6390 0x7f4d781a05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35230/0 (socket says 172.21.15.79:35230) 2021-04-09T18:35:28.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d777fe700 1 -- 172.21.15.79:0/344701571 learned_addr learned my addr 172.21.15.79:0/344701571 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:28.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d7cae9700 1 --2- 172.21.15.79:0/344701571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d781a0bf0 0x7f4d780d5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:28.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d77fff700 1 --2- 172.21.15.79:0/344701571 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d78097ba0 0x7f4d78096760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:28.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d777fe700 1 -- 172.21.15.79:0/344701571 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d78097ba0 msgr2=0x7f4d78096760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:28.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d777fe700 1 --2- 172.21.15.79:0/344701571 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d78097ba0 0x7f4d78096760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:28.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d777fe700 1 -- 172.21.15.79:0/344701571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d781a0bf0 msgr2=0x7f4d780d5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:28.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d777fe700 1 --2- 172.21.15.79:0/344701571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d781a0bf0 0x7f4d780d5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:28.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d777fe700 1 -- 172.21.15.79:0/344701571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d78097130 con 0x7f4d780d6390 2021-04-09T18:35:28.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d777fe700 1 --2- 172.21.15.79:0/344701571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d780d6390 0x7f4d781a05c0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f4d780d82f0 tx=0x7f4d70006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:28.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d74ff9700 1 -- 172.21.15.79:0/344701571 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d78097130 con 0x7f4d780d6390 2021-04-09T18:35:28.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d74ff9700 1 -- 172.21.15.79:0/344701571 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7001f020 con 0x7f4d780d6390 2021-04-09T18:35:28.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d7e544700 1 -- 172.21.15.79:0/344701571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d78097450 con 0x7f4d780d6390 2021-04-09T18:35:28.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d74ff9700 1 -- 172.21.15.79:0/344701571 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d7001b830 con 0x7f4d780d6390 2021-04-09T18:35:28.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d7e544700 1 -- 172.21.15.79:0/344701571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d780d5a10 con 0x7f4d780d6390 2021-04-09T18:35:28.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d74ff9700 1 -- 172.21.15.79:0/344701571 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4d70009ce0 con 0x7f4d780d6390 2021-04-09T18:35:28.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d74ff9700 1 --2- 172.21.15.79:0/344701571 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d50029100 0x7f4d5002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:28.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d74ff9700 1 -- 172.21.15.79:0/344701571 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5924+0+0 (secure 0 0 0) 0x7f4d7003be10 con 0x7f4d780d6390 2021-04-09T18:35:28.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.306 7f4d77fff700 1 --2- 172.21.15.79:0/344701571 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d50029100 0x7f4d5002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:28.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.310 7f4d77fff700 1 --2- 172.21.15.79:0/344701571 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d50029100 0x7f4d5002b650 crc :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:28.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.310 7f4d7e544700 1 -- 172.21.15.79:0/344701571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d78088e90 con 0x7f4d780d6390 2021-04-09T18:35:28.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.318 7f4d74ff9700 1 -- 172.21.15.79:0/344701571 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4d7000b8a0 con 0x7f4d780d6390 2021-04-09T18:35:28.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:28.474 7f4d7e544700 1 -- 172.21.15.79:0/344701571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4d780e3bc0 con 0x7f4d780d6390 2021-04-09T18:35:29.181 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:35:29.174 7fbcd0516700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:35:29.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.178 7f4d74ff9700 1 -- 172.21.15.79:0/344701571 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v80) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4d7001b430 con 0x7f4d780d6390 2021-04-09T18:35:29.195 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-04-09T18:35:29.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.190 7f4d7e544700 1 -- 172.21.15.79:0/344701571 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d50029100 msgr2=0x7f4d5002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:29.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.190 7f4d7e544700 1 --2- 172.21.15.79:0/344701571 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d50029100 0x7f4d5002b650 crc :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.190 7f4d7e544700 1 -- 172.21.15.79:0/344701571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d780d6390 msgr2=0x7f4d781a05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.190 7f4d7e544700 1 --2- 172.21.15.79:0/344701571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d780d6390 0x7f4d781a05c0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f4d780d82f0 tx=0x7f4d70006c10).stop 2021-04-09T18:35:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.190 7f4d7e544700 1 -- 172.21.15.79:0/344701571 shutdown_connections 2021-04-09T18:35:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.190 7f4d7e544700 1 --2- 172.21.15.79:0/344701571 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d50029100 0x7f4d5002b650 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.190 7f4d7e544700 1 --2- 172.21.15.79:0/344701571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d781a0bf0 0x7f4d780d5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:29.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.190 7f4d7e544700 1 --2- 172.21.15.79:0/344701571 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d78097ba0 0x7f4d78096760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:29.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.194 7f4d7e544700 1 --2- 172.21.15.79:0/344701571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d780d6390 0x7f4d781a05c0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:29.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.194 7f4d7e544700 1 -- 172.21.15.79:0/344701571 >> 172.21.15.79:0/344701571 conn(0x7f4d78099ba0 msgr2=0x7f4d78099100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:29.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.194 7f4d7e544700 1 -- 172.21.15.79:0/344701571 shutdown_connections 2021-04-09T18:35:29.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.194 7f4d7e544700 1 -- 172.21.15.79:0/344701571 wait complete. 2021-04-09T18:35:29.218 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:35:29.224 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2021-04-09T18:35:29.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c3a5d8700 1 Processor -- start 2021-04-09T18:35:29.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c3a5d8700 1 -- start start 2021-04-09T18:35:29.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c3a5d8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7c340f5720 0x7f7c340f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:29.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c3a5d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c341c8210 0x7f7c341ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:29.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c3a5d8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c340fbd20 con 0x7f7c340e9ce0 2021-04-09T18:35:29.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c3a5d8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c340ea130 con 0x7f7c340f5720 2021-04-09T18:35:29.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c3a5d8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c341c3fc0 con 0x7f7c341c8210 2021-04-09T18:35:29.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c33fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7c340f5720 0x7f7c340f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:29.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c33fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7c340f5720 0x7f7c340f66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35250/0 (socket says 172.21.15.79:35250) 2021-04-09T18:35:29.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c33fff700 1 -- 172.21.15.79:0/266059740 learned_addr learned my addr 172.21.15.79:0/266059740 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:29.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c38b7d700 1 --2- 172.21.15.79:0/266059740 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c341c8210 0x7f7c341ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:29.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c33fff700 1 -- 172.21.15.79:0/266059740 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c341c8210 msgr2=0x7f7c341ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:29.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c33fff700 1 --2- 172.21.15.79:0/266059740 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c341c8210 0x7f7c341ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:29.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c33fff700 1 -- 172.21.15.79:0/266059740 >> v1:172.21.15.79:6789/0 conn(0x7f7c340e9ce0 legacy=0x7f7c3409f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:29.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c32ffd700 1 -- 172.21.15.79:0/266059740 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 468820614 0 0) 0x7f7c1c0010d0 con 0x7f7c340e9ce0 2021-04-09T18:35:29.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c33fff700 1 -- 172.21.15.79:0/266059740 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3409fa00 con 0x7f7c340f5720 2021-04-09T18:35:29.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c38b7d700 1 --2- 172.21.15.79:0/266059740 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c341c8210 0x7f7c341ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:35:29.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c33fff700 1 --2- 172.21.15.79:0/266059740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c340f5720 0x7f7c340f66b0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f7c340f7100 tx=0x7f7c2c00b3c0).ready entity=mon.0 client_cookie=766167739019c38f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:29.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c32ffd700 1 -- 172.21.15.79:0/266059740 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c3409fa00 con 0x7f7c340f5720 2021-04-09T18:35:29.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c32ffd700 1 -- 172.21.15.79:0/266059740 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c00bbe0 con 0x7f7c340f5720 2021-04-09T18:35:29.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c32ffd700 1 -- 172.21.15.79:0/266059740 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c2c002020 con 0x7f7c340f5720 2021-04-09T18:35:29.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c3a5d8700 1 -- 172.21.15.79:0/266059740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c340f5720 msgr2=0x7f7c340f66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:29.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.302 7f7c3a5d8700 1 --2- 172.21.15.79:0/266059740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c340f5720 0x7f7c340f66b0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f7c340f7100 tx=0x7f7c2c00b3c0).stop 2021-04-09T18:35:29.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.306 7f7c3a5d8700 1 -- 172.21.15.79:0/266059740 shutdown_connections 2021-04-09T18:35:29.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.306 7f7c3a5d8700 1 --2- 172.21.15.79:0/266059740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c340f5720 0x7f7c340f66b0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:29.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.306 7f7c3a5d8700 1 --2- 172.21.15.79:0/266059740 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c341c8210 0x7f7c341ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:29.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.306 7f7c3a5d8700 1 -- 172.21.15.79:0/266059740 >> 172.21.15.79:0/266059740 conn(0x7f7c340e61e0 msgr2=0x7f7c340e94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:29.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.306 7f7c3a5d8700 1 -- 172.21.15.79:0/266059740 shutdown_connections 2021-04-09T18:35:29.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.306 7f7c3a5d8700 1 -- 172.21.15.79:0/266059740 wait complete. 2021-04-09T18:35:29.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.306 7f7c3a5d8700 1 Processor -- start 2021-04-09T18:35:29.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.306 7f7c3a5d8700 1 -- start start 2021-04-09T18:35:29.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.306 7f7c3a5d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c341214f0 0x7f7c340d6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:29.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c3a5d8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c340ba490 0x7f7c34093b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:29.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c3a5d8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c3408ec40 0x7f7c3408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:29.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c3a5d8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c34047750 con 0x7f7c340ba490 2021-04-09T18:35:29.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c3a5d8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340d6750 con 0x7f7c3408ec40 2021-04-09T18:35:29.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c3a5d8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c34094130 con 0x7f7c341214f0 2021-04-09T18:35:29.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c337fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c340ba490 0x7f7c34093b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:29.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c337fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c340ba490 0x7f7c34093b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35256/0 (socket says 172.21.15.79:35256) 2021-04-09T18:35:29.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c337fe700 1 -- 172.21.15.79:0/642120819 learned_addr learned my addr 172.21.15.79:0/642120819 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:29.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c33fff700 1 --2- 172.21.15.79:0/642120819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c341214f0 0x7f7c340d6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:29.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c38b7d700 1 --2- 172.21.15.79:0/642120819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c3408ec40 0x7f7c3408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:29.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c337fe700 1 -- 172.21.15.79:0/642120819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c341214f0 msgr2=0x7f7c340d6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:29.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c337fe700 1 --2- 172.21.15.79:0/642120819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c341214f0 0x7f7c340d6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:29.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c337fe700 1 -- 172.21.15.79:0/642120819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c3408ec40 msgr2=0x7f7c3408f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:29.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c337fe700 1 --2- 172.21.15.79:0/642120819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c3408ec40 0x7f7c3408f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:29.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c337fe700 1 -- 172.21.15.79:0/642120819 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c340d6300 con 0x7f7c340ba490 2021-04-09T18:35:29.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c38b7d700 1 --2- 172.21.15.79:0/642120819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c3408ec40 0x7f7c3408f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:29.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c337fe700 1 --2- 172.21.15.79:0/642120819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c340ba490 0x7f7c34093b00 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f7c340d8430 tx=0x7f7c1c00cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:29.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c30ff9700 1 -- 172.21.15.79:0/642120819 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c340d6300 con 0x7f7c340ba490 2021-04-09T18:35:29.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c30ff9700 1 -- 172.21.15.79:0/642120819 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c010510 con 0x7f7c340ba490 2021-04-09T18:35:29.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c30ff9700 1 -- 172.21.15.79:0/642120819 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c1c0106f0 con 0x7f7c340ba490 2021-04-09T18:35:29.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c3a5d8700 1 -- 172.21.15.79:0/642120819 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c340d5ac0 con 0x7f7c340ba490 2021-04-09T18:35:29.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c3a5d8700 1 -- 172.21.15.79:0/642120819 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c340baa70 con 0x7f7c340ba490 2021-04-09T18:35:29.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c30ff9700 1 -- 172.21.15.79:0/642120819 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7c1c019020 con 0x7f7c340ba490 2021-04-09T18:35:29.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c30ff9700 1 --2- 172.21.15.79:0/642120819 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c18029100 0x7f7c1802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:29.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c30ff9700 1 -- 172.21.15.79:0/642120819 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f7c1c038e80 con 0x7f7c340ba490 2021-04-09T18:35:29.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.310 7f7c33fff700 1 --2- 172.21.15.79:0/642120819 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c18029100 0x7f7c1802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:29.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.314 7f7c33fff700 1 --2- 172.21.15.79:0/642120819 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c18029100 0x7f7c1802b650 crc :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:29.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.318 7f7c3a5d8700 1 -- 172.21.15.79:0/642120819 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c34088e90 con 0x7f7c340ba490 2021-04-09T18:35:29.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.322 7f7c30ff9700 1 -- 172.21.15.79:0/642120819 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7c340e5ea0 con 0x7f7c340ba490 2021-04-09T18:35:29.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.490 7f7c3a5d8700 1 -- 172.21.15.79:0/642120819 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c340e3bc0 con 0x7f7c340ba490 2021-04-09T18:35:29.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.490 7f7c30ff9700 1 -- 172.21.15.79:0/642120819 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+1761 (secure 0 0 0) 0x7f7c1c010300 con 0x7f7c340ba490 2021-04-09T18:35:29.500 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 80 2021-04-09T18:35:29.500 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:29.501 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":80,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7842,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1552365531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1552365531},{"type":"v1","addr":"172.21.15.89:6835","nonce":1552365531}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:35:13.180244","modified":"2021-04-09 18:35:29.179494","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":127,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-04-09T18:35:29.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.494 7f7c3a5d8700 1 -- 172.21.15.79:0/642120819 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c18029100 msgr2=0x7f7c1802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:29.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.494 7f7c3a5d8700 1 --2- 172.21.15.79:0/642120819 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c18029100 0x7f7c1802b650 crc :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:29.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.494 7f7c3a5d8700 1 -- 172.21.15.79:0/642120819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c340ba490 msgr2=0x7f7c34093b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.494 7f7c3a5d8700 1 --2- 172.21.15.79:0/642120819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c340ba490 0x7f7c34093b00 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f7c340d8430 tx=0x7f7c1c00cab0).stop 2021-04-09T18:35:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.494 7f7c3a5d8700 1 -- 172.21.15.79:0/642120819 shutdown_connections 2021-04-09T18:35:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.494 7f7c3a5d8700 1 --2- 172.21.15.79:0/642120819 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c18029100 0x7f7c1802b650 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.498 7f7c3a5d8700 1 --2- 172.21.15.79:0/642120819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c3408ec40 0x7f7c3408f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:29.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.498 7f7c3a5d8700 1 --2- 172.21.15.79:0/642120819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c341214f0 0x7f7c340d6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:29.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.498 7f7c3a5d8700 1 --2- 172.21.15.79:0/642120819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c340ba490 0x7f7c34093b00 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:29.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.498 7f7c3a5d8700 1 -- 172.21.15.79:0/642120819 >> 172.21.15.79:0/642120819 conn(0x7f7c340d5030 msgr2=0x7f7c340d4330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:29.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.498 7f7c3a5d8700 1 -- 172.21.15.79:0/642120819 shutdown_connections 2021-04-09T18:35:29.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.498 7f7c3a5d8700 1 -- 172.21.15.79:0/642120819 wait complete. 2021-04-09T18:35:29.513 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-04-09T18:35:29.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.646 7f118262b700 1 Processor -- start 2021-04-09T18:35:29.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.646 7f118262b700 1 -- start start 2021-04-09T18:35:29.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.646 7f118262b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f117c0f5700 0x7f117c0f6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:29.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.646 7f118262b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f117c0e9cc0 0x7f117c09f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:29.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.646 7f118262b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117c0fbd00 con 0x7f117c1c2f90 2021-04-09T18:35:29.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.646 7f118262b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117c0ea110 con 0x7f117c0f5700 2021-04-09T18:35:29.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.646 7f118262b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117c0e5bb0 con 0x7f117c0e9cc0 2021-04-09T18:35:29.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f1180bd0700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f117c1c2f90 0x7f117c1c33e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58210/0 (socket says 172.21.15.79:58210) 2021-04-09T18:35:29.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f1180bd0700 1 -- 172.21.15.79:0/2650141083 learned_addr learned my addr 172.21.15.79:0/2650141083 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:29.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f117bfff700 1 --2- 172.21.15.79:0/2650141083 >> v2:172.21.15.89:3300/0 conn(0x7f117c0f5700 0x7f117c0f6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:29.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f117b7fe700 1 --2- 172.21.15.79:0/2650141083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f117c0e9cc0 0x7f117c09f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:29.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f117affd700 1 -- 172.21.15.79:0/2650141083 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281589674 0 0) 0x7f1174001450 con 0x7f117c1c2f90 2021-04-09T18:35:29.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f117affd700 1 -- 172.21.15.79:0/2650141083 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1168003240 con 0x7f117c1c2f90 2021-04-09T18:35:29.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f117bfff700 1 -- 172.21.15.79:0/2650141083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f117c0e9cc0 msgr2=0x7f117c09f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:29.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f117bfff700 1 --2- 172.21.15.79:0/2650141083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f117c0e9cc0 0x7f117c09f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:29.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f117bfff700 1 -- 172.21.15.79:0/2650141083 >> v1:172.21.15.79:6789/0 conn(0x7f117c1c2f90 legacy=0x7f117c1c33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:29.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f117bfff700 1 -- 172.21.15.79:0/2650141083 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c0e58b0 con 0x7f117c0f5700 2021-04-09T18:35:29.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f117bfff700 1 --2- 172.21.15.79:0/2650141083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f117c0f5700 0x7f117c0f6690 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f116c002f30 tx=0x7f116c00bd40).ready entity=mon.1 client_cookie=f33ca88559c8d2ba server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:29.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f117affd700 1 -- 172.21.15.79:0/2650141083 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f117c0e58b0 con 0x7f117c0f5700 2021-04-09T18:35:29.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f117affd700 1 -- 172.21.15.79:0/2650141083 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c009850 con 0x7f117c0f5700 2021-04-09T18:35:29.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f117affd700 1 -- 172.21.15.79:0/2650141083 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f116c009c20 con 0x7f117c0f5700 2021-04-09T18:35:29.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f118262b700 1 -- 172.21.15.79:0/2650141083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f117c0f5700 msgr2=0x7f117c0f6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:29.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f118262b700 1 --2- 172.21.15.79:0/2650141083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f117c0f5700 0x7f117c0f6690 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f116c002f30 tx=0x7f116c00bd40).stop 2021-04-09T18:35:29.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f118262b700 1 -- 172.21.15.79:0/2650141083 shutdown_connections 2021-04-09T18:35:29.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f118262b700 1 --2- 172.21.15.79:0/2650141083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f117c0f5700 0x7f117c0f6690 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:29.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f118262b700 1 --2- 172.21.15.79:0/2650141083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f117c0e9cc0 0x7f117c09f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:29.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f118262b700 1 -- 172.21.15.79:0/2650141083 >> 172.21.15.79:0/2650141083 conn(0x7f117c0e61c0 msgr2=0x7f117c0e94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:29.665 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f118262b700 1 -- 172.21.15.79:0/2650141083 shutdown_connections 2021-04-09T18:35:29.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.650 7f118262b700 1 -- 172.21.15.79:0/2650141083 wait complete. 2021-04-09T18:35:29.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f118262b700 1 Processor -- start 2021-04-09T18:35:29.667 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f118262b700 1 -- start start 2021-04-09T18:35:29.670 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f118262b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f117c096280 0x7f117c0ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:29.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f118262b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f117c1b1340 0x7f117c0d4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:29.671 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f118262b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f117c1b1790 0x7f117c0d5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:29.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f118262b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c047750 con 0x7f117c096280 2021-04-09T18:35:29.672 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f118262b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c0c4610 con 0x7f117c1b1340 2021-04-09T18:35:29.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f118262b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117c0966d0 con 0x7f117c1b1790 2021-04-09T18:35:29.673 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f117bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f117c096280 0x7f117c0ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:29.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f117bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f117c096280 0x7f117c0ad190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35270/0 (socket says 172.21.15.79:35270) 2021-04-09T18:35:29.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f117bfff700 1 -- 172.21.15.79:0/3469675001 learned_addr learned my addr 172.21.15.79:0/3469675001 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:29.674 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f1180bd0700 1 --2- 172.21.15.79:0/3469675001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f117c1b1790 0x7f117c0d5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:29.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f117b7fe700 1 --2- 172.21.15.79:0/3469675001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f117c1b1340 0x7f117c0d4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:29.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f117bfff700 1 -- 172.21.15.79:0/3469675001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f117c1b1790 msgr2=0x7f117c0d5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:29.675 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f117bfff700 1 --2- 172.21.15.79:0/3469675001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f117c1b1790 0x7f117c0d5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:29.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f117bfff700 1 -- 172.21.15.79:0/3469675001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f117c1b1340 msgr2=0x7f117c0d4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:29.676 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f117bfff700 1 --2- 172.21.15.79:0/3469675001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f117c1b1340 0x7f117c0d4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:29.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f117bfff700 1 -- 172.21.15.79:0/3469675001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c0ad7c0 con 0x7f117c096280 2021-04-09T18:35:29.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f117bfff700 1 --2- 172.21.15.79:0/3469675001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f117c096280 0x7f117c0ad190 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f117c0d8170 tx=0x7f116c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:29.677 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f1178ff9700 1 -- 172.21.15.79:0/3469675001 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f117c0ad7c0 con 0x7f117c096280 2021-04-09T18:35:29.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f1178ff9700 1 -- 172.21.15.79:0/3469675001 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c011a10 con 0x7f117c096280 2021-04-09T18:35:29.678 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f1178ff9700 1 -- 172.21.15.79:0/3469675001 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f116c011de0 con 0x7f117c096280 2021-04-09T18:35:29.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f118262b700 1 -- 172.21.15.79:0/3469675001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117c09af90 con 0x7f117c096280 2021-04-09T18:35:29.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.654 7f118262b700 1 -- 172.21.15.79:0/3469675001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117c0d5840 con 0x7f117c096280 2021-04-09T18:35:29.679 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.658 7f1178ff9700 1 -- 172.21.15.79:0/3469675001 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f116c01d440 con 0x7f117c096280 2021-04-09T18:35:29.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.658 7f1178ff9700 1 --2- 172.21.15.79:0/3469675001 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1160029100 0x7f116002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:29.680 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.658 7f1178ff9700 1 -- 172.21.15.79:0/3469675001 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f116c03b490 con 0x7f117c096280 2021-04-09T18:35:29.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.658 7f117b7fe700 1 --2- 172.21.15.79:0/3469675001 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1160029100 0x7f116002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:29.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.658 7f117b7fe700 1 --2- 172.21.15.79:0/3469675001 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1160029100 0x7f116002b650 crc :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:29.681 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.662 7f118262b700 1 -- 172.21.15.79:0/3469675001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117c088e90 con 0x7f117c096280 2021-04-09T18:35:29.682 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.670 7f1178ff9700 1 -- 172.21.15.79:0/3469675001 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f116c009640 con 0x7f117c096280 2021-04-09T18:35:29.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:29.846 7f118262b700 1 -- 172.21.15.79:0/3469675001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f117c0e3ba0 con 0x7f117c096280 2021-04-09T18:35:30.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.194 7f1178ff9700 1 -- 172.21.15.79:0/3469675001 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v81) v1 ==== 104+0+0 (secure 0 0 0) 0x7f116c011800 con 0x7f117c096280 2021-04-09T18:35:30.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.214 7f118262b700 1 -- 172.21.15.79:0/3469675001 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1160029100 msgr2=0x7f116002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:30.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.214 7f118262b700 1 --2- 172.21.15.79:0/3469675001 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1160029100 0x7f116002b650 crc :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:30.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.214 7f118262b700 1 -- 172.21.15.79:0/3469675001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f117c096280 msgr2=0x7f117c0ad190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:30.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.214 7f118262b700 1 --2- 172.21.15.79:0/3469675001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f117c096280 0x7f117c0ad190 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f117c0d8170 tx=0x7f116c006890).stop 2021-04-09T18:35:30.223 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.214 7f118262b700 1 -- 172.21.15.79:0/3469675001 shutdown_connections 2021-04-09T18:35:30.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.214 7f118262b700 1 --2- 172.21.15.79:0/3469675001 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1160029100 0x7f116002b650 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:30.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.214 7f118262b700 1 --2- 172.21.15.79:0/3469675001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f117c1b1790 0x7f117c0d5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:30.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.214 7f118262b700 1 --2- 172.21.15.79:0/3469675001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f117c096280 0x7f117c0ad190 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:30.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.214 7f118262b700 1 --2- 172.21.15.79:0/3469675001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f117c1b1340 0x7f117c0d4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:30.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.214 7f118262b700 1 -- 172.21.15.79:0/3469675001 >> 172.21.15.79:0/3469675001 conn(0x7f117c0d83b0 msgr2=0x7f117c0d7110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:30.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.214 7f118262b700 1 -- 172.21.15.79:0/3469675001 shutdown_connections 2021-04-09T18:35:30.225 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.214 7f118262b700 1 -- 172.21.15.79:0/3469675001 wait complete. 2021-04-09T18:35:30.235 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-04-09T18:35:30.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc09e27700 1 Processor -- start 2021-04-09T18:35:30.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc09e27700 1 -- start start 2021-04-09T18:35:30.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc09e27700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdc040e9dc0 0x7fdc0409f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:30.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc09e27700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc041c82f0 0x7fdc041ca750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:30.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc09e27700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc040fbe00 con 0x7fdc040f5800 2021-04-09T18:35:30.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc09e27700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc041c40a0 con 0x7fdc040e9dc0 2021-04-09T18:35:30.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc09e27700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040ea210 con 0x7fdc041c82f0 2021-04-09T18:35:30.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc037fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdc040f5800 0x7fdc040f6790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58224/0 (socket says 172.21.15.79:58224) 2021-04-09T18:35:30.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc037fe700 1 -- 172.21.15.79:0/3168296631 learned_addr learned my addr 172.21.15.79:0/3168296631 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:30.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc02ffd700 1 --2- 172.21.15.79:0/3168296631 >> v2:172.21.15.89:3300/0 conn(0x7fdc040e9dc0 0x7fdc0409f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:30.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc03fff700 1 --2- 172.21.15.79:0/3168296631 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc041c82f0 0x7fdc041ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:30.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc027fc700 1 -- 172.21.15.79:0/3168296631 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1476333484 0 0) 0x7fdbf4001450 con 0x7fdc040f5800 2021-04-09T18:35:30.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc027fc700 1 -- 172.21.15.79:0/3168296631 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbf0003240 con 0x7fdc040f5800 2021-04-09T18:35:30.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc02ffd700 1 -- 172.21.15.79:0/3168296631 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc041c82f0 msgr2=0x7fdc041ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:30.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc027fc700 1 -- 172.21.15.79:0/3168296631 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 270821028 0 0) 0x7fdbf40019d0 con 0x7fdc040f5800 2021-04-09T18:35:30.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc02ffd700 1 --2- 172.21.15.79:0/3168296631 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc041c82f0 0x7fdc041ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:30.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc02ffd700 1 -- 172.21.15.79:0/3168296631 >> v1:172.21.15.79:6789/0 conn(0x7fdc040f5800 legacy=0x7fdc040f6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:30.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc02ffd700 1 -- 172.21.15.79:0/3168296631 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc040e59b0 con 0x7fdc040e9dc0 2021-04-09T18:35:30.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc02ffd700 1 --2- 172.21.15.79:0/3168296631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc040e9dc0 0x7fdc0409f200 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fdbf4002170 tx=0x7fdbec00bd70).ready entity=mon.1 client_cookie=8202edb6147f2983 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:30.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc027fc700 1 -- 172.21.15.79:0/3168296631 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdc040e59b0 con 0x7fdc040e9dc0 2021-04-09T18:35:30.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc027fc700 1 -- 172.21.15.79:0/3168296631 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec009710 con 0x7fdc040e9dc0 2021-04-09T18:35:30.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc027fc700 1 -- 172.21.15.79:0/3168296631 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdbf4001f30 con 0x7fdc040e9dc0 2021-04-09T18:35:30.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc09e27700 1 -- 172.21.15.79:0/3168296631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc040e9dc0 msgr2=0x7fdc0409f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:30.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.338 7fdc09e27700 1 --2- 172.21.15.79:0/3168296631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc040e9dc0 0x7fdc0409f200 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fdbf4002170 tx=0x7fdbec00bd70).stop 2021-04-09T18:35:30.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.342 7fdc09e27700 1 -- 172.21.15.79:0/3168296631 shutdown_connections 2021-04-09T18:35:30.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.342 7fdc09e27700 1 --2- 172.21.15.79:0/3168296631 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc041c82f0 0x7fdc041ca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:30.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.342 7fdc09e27700 1 --2- 172.21.15.79:0/3168296631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc040e9dc0 0x7fdc0409f200 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:30.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.342 7fdc09e27700 1 -- 172.21.15.79:0/3168296631 >> 172.21.15.79:0/3168296631 conn(0x7fdc040e62c0 msgr2=0x7fdc040e95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:30.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.342 7fdc09e27700 1 -- 172.21.15.79:0/3168296631 shutdown_connections 2021-04-09T18:35:30.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.342 7fdc09e27700 1 -- 172.21.15.79:0/3168296631 wait complete. 2021-04-09T18:35:30.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.342 7fdc09e27700 1 Processor -- start 2021-04-09T18:35:30.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.342 7fdc09e27700 1 -- start start 2021-04-09T18:35:30.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.342 7fdc09e27700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc040d6400 0x7fdc04098620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:30.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.342 7fdc09e27700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc040d6850 0x7fdc04098c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:30.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdc09e27700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc041ad7b0 0x7fdc041adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:30.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdc09e27700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040e18d0 con 0x7fdc041ad7b0 2021-04-09T18:35:30.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdc09e27700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc04096ef0 con 0x7fdc040d6850 2021-04-09T18:35:30.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdc09e27700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040c0eb0 con 0x7fdc040d6400 2021-04-09T18:35:30.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdc03fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc041ad7b0 0x7fdc041adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:30.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdc03fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc041ad7b0 0x7fdc041adc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35288/0 (socket says 172.21.15.79:35288) 2021-04-09T18:35:30.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdc03fff700 1 -- 172.21.15.79:0/2930316087 learned_addr learned my addr 172.21.15.79:0/2930316087 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:30.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdc02ffd700 1 --2- 172.21.15.79:0/2930316087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc040d6850 0x7fdc04098c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:30.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdc037fe700 1 --2- 172.21.15.79:0/2930316087 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc040d6400 0x7fdc04098620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:30.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdc03fff700 1 -- 172.21.15.79:0/2930316087 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc040d6400 msgr2=0x7fdc04098620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:30.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdc03fff700 1 --2- 172.21.15.79:0/2930316087 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc040d6400 0x7fdc04098620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:30.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdc03fff700 1 -- 172.21.15.79:0/2930316087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc040d6850 msgr2=0x7fdc04098c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:30.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdc03fff700 1 --2- 172.21.15.79:0/2930316087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc040d6850 0x7fdc04098c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:30.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdc03fff700 1 -- 172.21.15.79:0/2930316087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc041ae230 con 0x7fdc041ad7b0 2021-04-09T18:35:30.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdc03fff700 1 --2- 172.21.15.79:0/2930316087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc041ad7b0 0x7fdc041adc00 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7fdc04087770 tx=0x7fdbfc00bf00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:30.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdbfbfff700 1 -- 172.21.15.79:0/2930316087 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdc041ae230 con 0x7fdc041ad7b0 2021-04-09T18:35:30.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdbfbfff700 1 -- 172.21.15.79:0/2930316087 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbfc00cb20 con 0x7fdc041ad7b0 2021-04-09T18:35:30.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdc09e27700 1 -- 172.21.15.79:0/2930316087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc041ae4f0 con 0x7fdc041ad7b0 2021-04-09T18:35:30.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdbfbfff700 1 -- 172.21.15.79:0/2930316087 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdbfc00f040 con 0x7fdc041ad7b0 2021-04-09T18:35:30.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdc09e27700 1 -- 172.21.15.79:0/2930316087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc041b1700 con 0x7fdc041ad7b0 2021-04-09T18:35:30.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdbfbfff700 1 -- 172.21.15.79:0/2930316087 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fdbfc011070 con 0x7fdc041ad7b0 2021-04-09T18:35:30.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdbfbfff700 1 --2- 172.21.15.79:0/2930316087 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdbe8029100 0x7fdbe802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:30.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdbfbfff700 1 -- 172.21.15.79:0/2930316087 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fdbfc010040 con 0x7fdc041ad7b0 2021-04-09T18:35:30.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.346 7fdc037fe700 1 --2- 172.21.15.79:0/2930316087 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdbe8029100 0x7fdbe802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:30.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.350 7fdc037fe700 1 --2- 172.21.15.79:0/2930316087 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdbe8029100 0x7fdbe802b650 crc :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:30.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.354 7fdc09e27700 1 -- 172.21.15.79:0/2930316087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc040e3ca0 con 0x7fdc041ad7b0 2021-04-09T18:35:30.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.358 7fdbfbfff700 1 -- 172.21.15.79:0/2930316087 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fdbfc00c720 con 0x7fdc041ad7b0 2021-04-09T18:35:30.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:30.522 7fdc09e27700 1 -- 172.21.15.79:0/2930316087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdc04047680 con 0x7fdc041ad7b0 2021-04-09T18:35:31.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.198 7fdbfbfff700 1 -- 172.21.15.79:0/2930316087 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v128) v1 ==== 185+0+0 (secure 0 0 0) 0x7fdc040f79a0 con 0x7fdc041ad7b0 2021-04-09T18:35:31.243 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2021-04-09T18:35:31.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.242 7fdc09e27700 1 -- 172.21.15.79:0/2930316087 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdbe8029100 msgr2=0x7fdbe802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:31.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.242 7fdc09e27700 1 --2- 172.21.15.79:0/2930316087 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdbe8029100 0x7fdbe802b650 crc :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:31.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.242 7fdc09e27700 1 -- 172.21.15.79:0/2930316087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc041ad7b0 msgr2=0x7fdc041adc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:31.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.242 7fdc09e27700 1 --2- 172.21.15.79:0/2930316087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc041ad7b0 0x7fdc041adc00 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7fdc04087770 tx=0x7fdbfc00bf00).stop 2021-04-09T18:35:31.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.242 7fdc09e27700 1 -- 172.21.15.79:0/2930316087 shutdown_connections 2021-04-09T18:35:31.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.242 7fdc09e27700 1 --2- 172.21.15.79:0/2930316087 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdbe8029100 0x7fdbe802b650 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:31.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.242 7fdc09e27700 1 --2- 172.21.15.79:0/2930316087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc041ad7b0 0x7fdc041adc00 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:31.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.242 7fdc09e27700 1 --2- 172.21.15.79:0/2930316087 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc040d6400 0x7fdc04098620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:31.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.242 7fdc09e27700 1 --2- 172.21.15.79:0/2930316087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc040d6850 0x7fdc04098c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:31.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.242 7fdc09e27700 1 -- 172.21.15.79:0/2930316087 >> 172.21.15.79:0/2930316087 conn(0x7fdc0409af60 msgr2=0x7fdc0409a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:31.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.242 7fdc09e27700 1 -- 172.21.15.79:0/2930316087 shutdown_connections 2021-04-09T18:35:31.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.242 7fdc09e27700 1 -- 172.21.15.79:0/2930316087 wait complete. 2021-04-09T18:35:31.260 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-04-09T18:35:31.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.354 7f4884465700 1 Processor -- start 2021-04-09T18:35:31.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.354 7f4884465700 1 -- start start 2021-04-09T18:35:31.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.354 7f4884465700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c0f5800 0x7f487c0f6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:31.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.354 7f4884465700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f487c0e9dc0 0x7f487c09f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:31.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.354 7f4884465700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487c0fbe00 con 0x7f487c1c3090 2021-04-09T18:35:31.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.354 7f4884465700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487c0ea210 con 0x7f487c0e9dc0 2021-04-09T18:35:31.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.354 7f4884465700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0e5cb0 con 0x7f487c0f5800 2021-04-09T18:35:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4881a08700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f487c0e9dc0 0x7f487c09f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4882209700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c0f5800 0x7f487c0f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4882a0a700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f487c1c3090 0x7f487c1c34e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:58708/0 (socket says 172.21.15.79:58708) 2021-04-09T18:35:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4882a0a700 1 -- 172.21.15.79:0/1637574125 learned_addr learned my addr 172.21.15.79:0/1637574125 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4881207700 1 -- 172.21.15.79:0/1637574125 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765099696 0 0) 0x7f4874001450 con 0x7f487c1c3090 2021-04-09T18:35:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4882209700 1 -- 172.21.15.79:0/1637574125 >> v2:172.21.15.89:3300/0 conn(0x7f487c0e9dc0 msgr2=0x7f487c09f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4882209700 1 --2- 172.21.15.79:0/1637574125 >> v2:172.21.15.89:3300/0 conn(0x7f487c0e9dc0 0x7f487c09f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4882209700 1 -- 172.21.15.79:0/1637574125 >> v1:172.21.15.89:6789/0 conn(0x7f487c1c3090 legacy=0x7f487c1c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4882209700 1 -- 172.21.15.79:0/1637574125 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c0e59b0 con 0x7f487c0f5800 2021-04-09T18:35:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4881a08700 1 --2- 172.21.15.79:0/1637574125 >> v2:172.21.15.89:3300/0 conn(0x7f487c0e9dc0 0x7f487c09f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4882209700 1 --2- 172.21.15.79:0/1637574125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c0f5800 0x7f487c0f6790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f4878002f30 tx=0x7f487800bcc0).ready entity=mon.2 client_cookie=9538f85fc993505c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4881207700 1 -- 172.21.15.79:0/1637574125 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f487c0e59b0 con 0x7f487c0f5800 2021-04-09T18:35:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4881207700 1 -- 172.21.15.79:0/1637574125 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4878009800 con 0x7f487c0f5800 2021-04-09T18:35:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4881207700 1 -- 172.21.15.79:0/1637574125 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4878009bd0 con 0x7f487c0f5800 2021-04-09T18:35:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4884465700 1 -- 172.21.15.79:0/1637574125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c0f5800 msgr2=0x7f487c0f6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4884465700 1 --2- 172.21.15.79:0/1637574125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c0f5800 0x7f487c0f6790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f4878002f30 tx=0x7f487800bcc0).stop 2021-04-09T18:35:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4884465700 1 -- 172.21.15.79:0/1637574125 shutdown_connections 2021-04-09T18:35:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4884465700 1 --2- 172.21.15.79:0/1637574125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c0f5800 0x7f487c0f6790 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4884465700 1 --2- 172.21.15.79:0/1637574125 >> v2:172.21.15.89:3300/0 conn(0x7f487c0e9dc0 0x7f487c09f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4884465700 1 -- 172.21.15.79:0/1637574125 >> 172.21.15.79:0/1637574125 conn(0x7f487c0e62c0 msgr2=0x7f487c0e95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4884465700 1 -- 172.21.15.79:0/1637574125 shutdown_connections 2021-04-09T18:35:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.358 7f4884465700 1 -- 172.21.15.79:0/1637574125 wait complete. 2021-04-09T18:35:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.362 7f4884465700 1 Processor -- start 2021-04-09T18:35:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.362 7f4884465700 1 -- start start 2021-04-09T18:35:31.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.362 7f4884465700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c0acbc0 0x7f487c095910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:31.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4884465700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f487c096270 0x7f487c0d4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:31.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4884465700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f487c0d5560 0x7f487c0c0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:31.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4884465700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0b7760 con 0x7f487c0d5560 2021-04-09T18:35:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4884465700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0b72f0 con 0x7f487c096270 2021-04-09T18:35:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4884465700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0b7a60 con 0x7f487c0acbc0 2021-04-09T18:35:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4882a0a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f487c0d5560 0x7f487c0c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4882209700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c0acbc0 0x7f487c095910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4881a08700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f487c096270 0x7f487c0d4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4882a0a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f487c0d5560 0x7f487c0c0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35302/0 (socket says 172.21.15.79:35302) 2021-04-09T18:35:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4882a0a700 1 -- 172.21.15.79:0/3876729148 learned_addr learned my addr 172.21.15.79:0/3876729148 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4882a0a700 1 -- 172.21.15.79:0/3876729148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c0acbc0 msgr2=0x7f487c095910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4882a0a700 1 --2- 172.21.15.79:0/3876729148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c0acbc0 0x7f487c095910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4882a0a700 1 -- 172.21.15.79:0/3876729148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f487c096270 msgr2=0x7f487c0d4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4882a0a700 1 --2- 172.21.15.79:0/3876729148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f487c096270 0x7f487c0d4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:31.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4882a0a700 1 -- 172.21.15.79:0/3876729148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c095f40 con 0x7f487c0d5560 2021-04-09T18:35:31.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4881a08700 1 --2- 172.21.15.79:0/3876729148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f487c096270 0x7f487c0d4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:31.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4882a0a700 1 --2- 172.21.15.79:0/3876729148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f487c0d5560 0x7f487c0c0290 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f4874001210 tx=0x7f487400ceb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:31.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4872ffd700 1 -- 172.21.15.79:0/3876729148 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f487c095f40 con 0x7f487c0d5560 2021-04-09T18:35:31.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4872ffd700 1 -- 172.21.15.79:0/3876729148 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4874005b80 con 0x7f487c0d5560 2021-04-09T18:35:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4884465700 1 -- 172.21.15.79:0/3876729148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487c0c08c0 con 0x7f487c0d5560 2021-04-09T18:35:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4872ffd700 1 -- 172.21.15.79:0/3876729148 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4874004880 con 0x7f487c0d5560 2021-04-09T18:35:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4884465700 1 -- 172.21.15.79:0/3876729148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c0c0dc0 con 0x7f487c0d5560 2021-04-09T18:35:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4872ffd700 1 -- 172.21.15.79:0/3876729148 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4874004a80 con 0x7f487c0d5560 2021-04-09T18:35:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4872ffd700 1 --2- 172.21.15.79:0/3876729148 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4864029100 0x7f486402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4872ffd700 1 -- 172.21.15.79:0/3876729148 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5572+0+0 (secure 0 0 0) 0x7f4874039060 con 0x7f487c0d5560 2021-04-09T18:35:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.366 7f4882209700 1 --2- 172.21.15.79:0/3876729148 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4864029100 0x7f486402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.370 7f4882209700 1 --2- 172.21.15.79:0/3876729148 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4864029100 0x7f486402b650 crc :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:31.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.386 7f4884465700 1 -- 172.21.15.79:0/3876729148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487c0e3ca0 con 0x7f487c0d5560 2021-04-09T18:35:31.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.394 7f4872ffd700 1 -- 172.21.15.79:0/3876729148 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4874005970 con 0x7f487c0d5560 2021-04-09T18:35:31.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:31.562 7f4884465700 1 -- 172.21.15.79:0/3876729148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f487c0f5e00 con 0x7f487c0d5560 2021-04-09T18:35:32.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.214 7f4872ffd700 1 -- 172.21.15.79:0/3876729148 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v129) v1 ==== 173+0+0 (secure 0 0 0) 0x7f4874000f70 con 0x7f487c0d5560 2021-04-09T18:35:32.234 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2021-04-09T18:35:32.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.230 7f4884465700 1 -- 172.21.15.79:0/3876729148 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4864029100 msgr2=0x7f486402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:32.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.230 7f4884465700 1 --2- 172.21.15.79:0/3876729148 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4864029100 0x7f486402b650 crc :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:32.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.230 7f4884465700 1 -- 172.21.15.79:0/3876729148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f487c0d5560 msgr2=0x7f487c0c0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:32.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.230 7f4884465700 1 --2- 172.21.15.79:0/3876729148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f487c0d5560 0x7f487c0c0290 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f4874001210 tx=0x7f487400ceb0).stop 2021-04-09T18:35:32.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.230 7f4884465700 1 -- 172.21.15.79:0/3876729148 shutdown_connections 2021-04-09T18:35:32.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.230 7f4884465700 1 --2- 172.21.15.79:0/3876729148 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4864029100 0x7f486402b650 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:32.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.230 7f4884465700 1 --2- 172.21.15.79:0/3876729148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f487c0d5560 0x7f487c0c0290 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:32.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.230 7f4884465700 1 --2- 172.21.15.79:0/3876729148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c0acbc0 0x7f487c095910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:32.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.230 7f4884465700 1 --2- 172.21.15.79:0/3876729148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f487c096270 0x7f487c0d4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:32.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.230 7f4884465700 1 -- 172.21.15.79:0/3876729148 >> 172.21.15.79:0/3876729148 conn(0x7f487c09b090 msgr2=0x7f487c0d82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:32.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.230 7f4884465700 1 -- 172.21.15.79:0/3876729148 shutdown_connections 2021-04-09T18:35:32.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.230 7f4884465700 1 -- 172.21.15.79:0/3876729148 wait complete. 2021-04-09T18:35:32.251 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-04-09T18:35:32.254 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-04-09T18:35:32.258 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-04-09T18:35:32.260 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-04-09T18:35:32.263 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-04-09T18:35:32.281 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2021-04-09T18:35:32.281 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2021-04-09T18:35:32.282 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-04-09T18:35:32.282 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2021-04-09T18:35:32.282 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.283 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2021-04-09T18:35:32.283 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.283 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2021-04-09T18:35:32.283 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.284 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2021-04-09T18:35:32.284 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2021-04-09T18:35:32.284 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.284 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2021-04-09T18:35:32.284 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2021-04-09T18:35:32.285 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.285 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2021-04-09T18:35:32.285 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2021-04-09T18:35:32.285 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.286 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2021-04-09T18:35:32.286 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.286 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2021-04-09T18:35:32.286 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2021-04-09T18:35:32.286 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2021-04-09T18:35:32.287 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2021-04-09T18:35:32.287 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2021-04-09T18:35:32.287 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2021-04-09T18:35:32.288 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2021-04-09T18:35:32.288 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-04-09T18:35:32.288 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2021-04-09T18:35:32.288 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.288 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-04-09T18:35:32.289 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.289 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2021-04-09T18:35:32.289 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.289 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2021-04-09T18:35:32.289 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.290 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2021-04-09T18:35:32.290 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2021-04-09T18:35:32.290 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2021-04-09T18:35:32.290 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.291 INFO:teuthology.orchestra.run.smithi079.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-04-09T18:35:32.291 INFO:teuthology.orchestra.run.smithi079.stdout: mon_client_directed_command_retry = 4 2021-04-09T18:35:32.291 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.79,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2021-04-09T18:35:32.291 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = fc927781-121d-4817-b30c-0c6f9e107f84 2021-04-09T18:35:32.291 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.292 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2021-04-09T18:35:32.292 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2021-04-09T18:35:32.292 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.292 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2021-04-09T18:35:32.292 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2021-04-09T18:35:32.293 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.293 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2021-04-09T18:35:32.293 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2021-04-09T18:35:32.294 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.294 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2021-04-09T18:35:32.294 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2021-04-09T18:35:32.295 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2021-04-09T18:35:32.295 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.295 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2021-04-09T18:35:32.296 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2021-04-09T18:35:32.296 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.297 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2021-04-09T18:35:32.297 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.297 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2021-04-09T18:35:32.298 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.298 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2021-04-09T18:35:32.299 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.299 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2021-04-09T18:35:32.299 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2021-04-09T18:35:32.300 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.300 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2021-04-09T18:35:32.300 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2021-04-09T18:35:32.301 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2021-04-09T18:35:32.301 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2021-04-09T18:35:32.301 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 20 2021-04-09T18:35:32.302 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 20 2021-04-09T18:35:32.302 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2021-04-09T18:35:32.303 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2021-04-09T18:35:32.303 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 10 2021-04-09T18:35:32.303 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2021-04-09T18:35:32.304 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2021-04-09T18:35:32.304 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2021-04-09T18:35:32.304 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2021-04-09T18:35:32.304 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2021-04-09T18:35:32.304 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2021-04-09T18:35:32.305 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.305 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2021-04-09T18:35:32.305 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2021-04-09T18:35:32.305 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2021-04-09T18:35:32.306 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2021-04-09T18:35:32.306 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2021-04-09T18:35:32.306 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:35:32.306 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:35:32.307 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.307 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2021-04-09T18:35:32.307 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2021-04-09T18:35:32.307 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2021-04-09T18:35:32.308 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2021-04-09T18:35:32.308 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2021-04-09T18:35:32.308 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2021-04-09T18:35:32.308 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2021-04-09T18:35:32.309 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:35:32.309 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2021-04-09T18:35:32.309 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2021-04-09T18:35:32.309 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:35:32.310 INFO:teuthology.orchestra.run.smithi079.stdout: mon op complaint time = 120 2021-04-09T18:35:32.310 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:32.310 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2021-04-09T18:35:32.310 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2021-04-09T18:35:32.310 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2021-04-09T18:35:32.311 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2021-04-09T18:35:32.311 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-04-09T18:35:32.311 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-04-09T18:35:32.311 INFO:teuthology.orchestra.run.smithi079.stdout: client mount timeout = 600 2021-04-09T18:35:32.312 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2021-04-09T18:35:32.312 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2021-04-09T18:35:32.312 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2021-04-09T18:35:32.312 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2021-04-09T18:35:32.313 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2021-04-09T18:35:32.313 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2021-04-09T18:35:32.313 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2021-04-09T18:35:32.313 INFO:teuthology.orchestra.run.smithi079.stdout:[mds] 2021-04-09T18:35:32.314 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds = 20 2021-04-09T18:35:32.314 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2021-04-09T18:35:32.314 INFO:teuthology.orchestra.run.smithi079.stdout: mds bal frag = True 2021-04-09T18:35:32.314 INFO:teuthology.orchestra.run.smithi079.stdout: mds bal fragment size max = 10000 2021-04-09T18:35:32.315 INFO:teuthology.orchestra.run.smithi079.stdout: mds bal merge size = 5 2021-04-09T18:35:32.315 INFO:teuthology.orchestra.run.smithi079.stdout: mds bal split bits = 3 2021-04-09T18:35:32.315 INFO:teuthology.orchestra.run.smithi079.stdout: mds bal split size = 100 2021-04-09T18:35:32.315 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug frag = True 2021-04-09T18:35:32.316 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug scatterstat = True 2021-04-09T18:35:32.316 INFO:teuthology.orchestra.run.smithi079.stdout: mds op complaint time = 180 2021-04-09T18:35:32.316 INFO:teuthology.orchestra.run.smithi079.stdout: mds verify scatter = True 2021-04-09T18:35:32.316 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2021-04-09T18:35:32.321 INFO:teuthology.orchestra.run.smithi136.stdout:[global] 2021-04-09T18:35:32.321 INFO:teuthology.orchestra.run.smithi136.stdout: chdir = "" 2021-04-09T18:35:32.321 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-04-09T18:35:32.321 INFO:teuthology.orchestra.run.smithi136.stdout: auth supported = cephx 2021-04-09T18:35:32.322 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.322 INFO:teuthology.orchestra.run.smithi136.stdout: filestore xattr use omap = true 2021-04-09T18:35:32.322 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.322 INFO:teuthology.orchestra.run.smithi136.stdout: mon clock drift allowed = 1.000 2021-04-09T18:35:32.323 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.323 INFO:teuthology.orchestra.run.smithi136.stdout: osd crush chooseleaf type = 0 2021-04-09T18:35:32.323 INFO:teuthology.orchestra.run.smithi136.stdout: auth debug = true 2021-04-09T18:35:32.323 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.324 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on old message = true 2021-04-09T18:35:32.324 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on bug = true 2021-04-09T18:35:32.324 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.324 INFO:teuthology.orchestra.run.smithi136.stdout: mon max pg per osd = 10000 # >= luminous 2021-04-09T18:35:32.324 INFO:teuthology.orchestra.run.smithi136.stdout: mon pg warn max object skew = 0 2021-04-09T18:35:32.325 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.325 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default size = 2 2021-04-09T18:35:32.325 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.325 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow primary affinity = true 2021-04-09T18:35:32.326 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow pg remap = true 2021-04-09T18:35:32.326 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on legacy crush tunables = false 2021-04-09T18:35:32.326 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on crush straw calc version zero = false 2021-04-09T18:35:32.326 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on no sortbitwise = false 2021-04-09T18:35:32.326 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on osd down out interval zero = false 2021-04-09T18:35:32.327 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on too few osds = false 2021-04-09T18:35:32.327 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-04-09T18:35:32.327 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_no_redundancy = false 2021-04-09T18:35:32.327 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.328 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-04-09T18:35:32.328 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.328 INFO:teuthology.orchestra.run.smithi136.stdout: osd default data pool replay window = 5 2021-04-09T18:35:32.328 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.329 INFO:teuthology.orchestra.run.smithi136.stdout: mon allow pool delete = true 2021-04-09T18:35:32.329 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.329 INFO:teuthology.orchestra.run.smithi136.stdout: mon cluster log file level = debug 2021-04-09T18:35:32.329 INFO:teuthology.orchestra.run.smithi136.stdout: debug asserts on shutdown = true 2021-04-09T18:35:32.330 INFO:teuthology.orchestra.run.smithi136.stdout: mon health detail to clog = false 2021-04-09T18:35:32.330 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.330 INFO:teuthology.orchestra.run.smithi136.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-04-09T18:35:32.330 INFO:teuthology.orchestra.run.smithi136.stdout: mon_client_directed_command_retry = 4 2021-04-09T18:35:32.331 INFO:teuthology.orchestra.run.smithi136.stdout: mon host = "172.21.15.79,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2021-04-09T18:35:32.331 INFO:teuthology.orchestra.run.smithi136.stdout: fsid = fc927781-121d-4817-b30c-0c6f9e107f84 2021-04-09T18:35:32.331 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.331 INFO:teuthology.orchestra.run.smithi136.stdout:[osd] 2021-04-09T18:35:32.332 INFO:teuthology.orchestra.run.smithi136.stdout: osd journal size = 100 2021-04-09T18:35:32.332 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.332 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub load threshold = 5.0 2021-04-09T18:35:32.332 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub max interval = 600 2021-04-09T18:35:32.333 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.333 INFO:teuthology.orchestra.run.smithi136.stdout: osd recover clone overlap = true 2021-04-09T18:35:32.333 INFO:teuthology.orchestra.run.smithi136.stdout: osd recovery max chunk = 1048576 2021-04-09T18:35:32.333 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.333 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug shutdown = true 2021-04-09T18:35:32.334 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug op order = true 2021-04-09T18:35:32.334 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug verify stray on activate = true 2021-04-09T18:35:32.334 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.334 INFO:teuthology.orchestra.run.smithi136.stdout: osd open classes on start = true 2021-04-09T18:35:32.335 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug pg log writeout = true 2021-04-09T18:35:32.335 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.335 INFO:teuthology.orchestra.run.smithi136.stdout: osd deep scrub update digest min age = 30 2021-04-09T18:35:32.335 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.336 INFO:teuthology.orchestra.run.smithi136.stdout: osd map max advance = 10 2021-04-09T18:35:32.336 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.336 INFO:teuthology.orchestra.run.smithi136.stdout: journal zero on create = true 2021-04-09T18:35:32.336 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.337 INFO:teuthology.orchestra.run.smithi136.stdout: filestore ondisk finisher threads = 3 2021-04-09T18:35:32.337 INFO:teuthology.orchestra.run.smithi136.stdout: filestore apply finisher threads = 3 2021-04-09T18:35:32.337 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.337 INFO:teuthology.orchestra.run.smithi136.stdout: bdev debug aio = true 2021-04-09T18:35:32.338 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug misdirected ops = true 2021-04-09T18:35:32.338 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore block size = 96636764160 2021-04-09T18:35:32.338 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore fsck on mount = True 2021-04-09T18:35:32.338 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluefs = 20 2021-04-09T18:35:32.339 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluestore = 20 2021-04-09T18:35:32.339 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-04-09T18:35:32.339 INFO:teuthology.orchestra.run.smithi136.stdout: debug osd = 20 2021-04-09T18:35:32.339 INFO:teuthology.orchestra.run.smithi136.stdout: debug rocksdb = 10 2021-04-09T18:35:32.339 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd backfillfull_ratio = 0.85 2021-04-09T18:35:32.340 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd full ratio = 0.9 2021-04-09T18:35:32.340 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd nearfull ratio = 0.8 2021-04-09T18:35:32.340 INFO:teuthology.orchestra.run.smithi136.stdout: osd failsafe full ratio = 0.95 2021-04-09T18:35:32.340 INFO:teuthology.orchestra.run.smithi136.stdout: osd objectstore = bluestore 2021-04-09T18:35:32.341 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2021-04-09T18:35:32.341 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.341 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr] 2021-04-09T18:35:32.341 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-04-09T18:35:32.342 INFO:teuthology.orchestra.run.smithi136.stdout: debug mgr = 20 2021-04-09T18:35:32.342 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2021-04-09T18:35:32.342 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2021-04-09T18:35:32.342 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:35:32.343 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:35:32.343 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.343 INFO:teuthology.orchestra.run.smithi136.stdout:[mon] 2021-04-09T18:35:32.343 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-04-09T18:35:32.344 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2021-04-09T18:35:32.344 INFO:teuthology.orchestra.run.smithi136.stdout: debug paxos = 20 2021-04-09T18:35:32.344 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2021-04-09T18:35:32.344 INFO:teuthology.orchestra.run.smithi136.stdout: mon data avail warn = 5 2021-04-09T18:35:32.345 INFO:teuthology.orchestra.run.smithi136.stdout: mon mgr mkfs grace = 240 2021-04-09T18:35:32.345 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:35:32.345 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd reporter subtree level = osd 2021-04-09T18:35:32.345 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd prime pg temp = true 2021-04-09T18:35:32.346 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:35:32.346 INFO:teuthology.orchestra.run.smithi136.stdout: mon op complaint time = 120 2021-04-09T18:35:32.346 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-04-09T18:35:32.346 INFO:teuthology.orchestra.run.smithi136.stdout:[client] 2021-04-09T18:35:32.347 INFO:teuthology.orchestra.run.smithi136.stdout: rgw cache enabled = true 2021-04-09T18:35:32.347 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable ops log = true 2021-04-09T18:35:32.347 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable usage log = true 2021-04-09T18:35:32.347 INFO:teuthology.orchestra.run.smithi136.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-04-09T18:35:32.348 INFO:teuthology.orchestra.run.smithi136.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-04-09T18:35:32.348 INFO:teuthology.orchestra.run.smithi136.stdout: client mount timeout = 600 2021-04-09T18:35:32.348 INFO:teuthology.orchestra.run.smithi136.stdout: debug client = 20 2021-04-09T18:35:32.348 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-04-09T18:35:32.349 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.a] 2021-04-09T18:35:32.349 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.b] 2021-04-09T18:35:32.349 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.c] 2021-04-09T18:35:32.349 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2021-04-09T18:35:32.350 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2021-04-09T18:35:32.350 INFO:teuthology.orchestra.run.smithi136.stdout:[mds] 2021-04-09T18:35:32.350 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds = 20 2021-04-09T18:35:32.350 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2021-04-09T18:35:32.351 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal frag = True 2021-04-09T18:35:32.351 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal fragment size max = 10000 2021-04-09T18:35:32.351 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal merge size = 5 2021-04-09T18:35:32.351 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal split bits = 3 2021-04-09T18:35:32.352 INFO:teuthology.orchestra.run.smithi136.stdout: mds bal split size = 100 2021-04-09T18:35:32.352 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug frag = True 2021-04-09T18:35:32.352 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug scatterstat = True 2021-04-09T18:35:32.352 INFO:teuthology.orchestra.run.smithi136.stdout: mds op complaint time = 180 2021-04-09T18:35:32.353 INFO:teuthology.orchestra.run.smithi136.stdout: mds verify scatter = True 2021-04-09T18:35:32.353 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2021-04-09T18:35:32.353 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2021-04-09T18:35:32.354 INFO:teuthology.orchestra.run.smithi144.stdout: chdir = "" 2021-04-09T18:35:32.354 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-04-09T18:35:32.354 INFO:teuthology.orchestra.run.smithi144.stdout: auth supported = cephx 2021-04-09T18:35:32.354 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.355 INFO:teuthology.orchestra.run.smithi144.stdout: filestore xattr use omap = true 2021-04-09T18:35:32.355 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.355 INFO:teuthology.orchestra.run.smithi144.stdout: mon clock drift allowed = 1.000 2021-04-09T18:35:32.355 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.355 INFO:teuthology.orchestra.run.smithi144.stdout: osd crush chooseleaf type = 0 2021-04-09T18:35:32.356 INFO:teuthology.orchestra.run.smithi144.stdout: auth debug = true 2021-04-09T18:35:32.356 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.356 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on old message = true 2021-04-09T18:35:32.356 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on bug = true 2021-04-09T18:35:32.357 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.357 INFO:teuthology.orchestra.run.smithi144.stdout: mon max pg per osd = 10000 # >= luminous 2021-04-09T18:35:32.357 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn max object skew = 0 2021-04-09T18:35:32.357 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.358 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default size = 2 2021-04-09T18:35:32.358 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.358 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow primary affinity = true 2021-04-09T18:35:32.358 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow pg remap = true 2021-04-09T18:35:32.359 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on legacy crush tunables = false 2021-04-09T18:35:32.359 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on crush straw calc version zero = false 2021-04-09T18:35:32.359 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on no sortbitwise = false 2021-04-09T18:35:32.359 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on osd down out interval zero = false 2021-04-09T18:35:32.359 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on too few osds = false 2021-04-09T18:35:32.360 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-04-09T18:35:32.360 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_no_redundancy = false 2021-04-09T18:35:32.360 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.360 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-04-09T18:35:32.361 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.361 INFO:teuthology.orchestra.run.smithi144.stdout: osd default data pool replay window = 5 2021-04-09T18:35:32.361 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.361 INFO:teuthology.orchestra.run.smithi144.stdout: mon allow pool delete = true 2021-04-09T18:35:32.362 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.362 INFO:teuthology.orchestra.run.smithi144.stdout: mon cluster log file level = debug 2021-04-09T18:35:32.362 INFO:teuthology.orchestra.run.smithi144.stdout: debug asserts on shutdown = true 2021-04-09T18:35:32.362 INFO:teuthology.orchestra.run.smithi144.stdout: mon health detail to clog = false 2021-04-09T18:35:32.363 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.363 INFO:teuthology.orchestra.run.smithi144.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-04-09T18:35:32.363 INFO:teuthology.orchestra.run.smithi144.stdout: mon_client_directed_command_retry = 4 2021-04-09T18:35:32.363 INFO:teuthology.orchestra.run.smithi144.stdout: mon host = "172.21.15.79,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2021-04-09T18:35:32.363 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = fc927781-121d-4817-b30c-0c6f9e107f84 2021-04-09T18:35:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.364 INFO:teuthology.orchestra.run.smithi144.stdout:[osd] 2021-04-09T18:35:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: osd journal size = 100 2021-04-09T18:35:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub load threshold = 5.0 2021-04-09T18:35:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub max interval = 600 2021-04-09T18:35:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: osd recover clone overlap = true 2021-04-09T18:35:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: osd recovery max chunk = 1048576 2021-04-09T18:35:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug shutdown = true 2021-04-09T18:35:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug op order = true 2021-04-09T18:35:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug verify stray on activate = true 2021-04-09T18:35:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: osd open classes on start = true 2021-04-09T18:35:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug pg log writeout = true 2021-04-09T18:35:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: osd deep scrub update digest min age = 30 2021-04-09T18:35:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: osd map max advance = 10 2021-04-09T18:35:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: journal zero on create = true 2021-04-09T18:35:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: filestore ondisk finisher threads = 3 2021-04-09T18:35:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: filestore apply finisher threads = 3 2021-04-09T18:35:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: bdev debug aio = true 2021-04-09T18:35:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug misdirected ops = true 2021-04-09T18:35:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore block size = 96636764160 2021-04-09T18:35:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore fsck on mount = True 2021-04-09T18:35:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluefs = 20 2021-04-09T18:35:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluestore = 20 2021-04-09T18:35:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2021-04-09T18:35:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: debug osd = 20 2021-04-09T18:35:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: debug rocksdb = 10 2021-04-09T18:35:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull_ratio = 0.85 2021-04-09T18:35:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.9 2021-04-09T18:35:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.8 2021-04-09T18:35:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: osd failsafe full ratio = 0.95 2021-04-09T18:35:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: osd objectstore = bluestore 2021-04-09T18:35:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2021-04-09T18:35:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.373 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr] 2021-04-09T18:35:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2021-04-09T18:35:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: debug mgr = 20 2021-04-09T18:35:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2021-04-09T18:35:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2021-04-09T18:35:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:35:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:35:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.375 INFO:teuthology.orchestra.run.smithi144.stdout:[mon] 2021-04-09T18:35:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2021-04-09T18:35:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2021-04-09T18:35:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: debug paxos = 20 2021-04-09T18:35:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2021-04-09T18:35:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: mon data avail warn = 5 2021-04-09T18:35:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: mon mgr mkfs grace = 240 2021-04-09T18:35:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:35:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd reporter subtree level = osd 2021-04-09T18:35:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd prime pg temp = true 2021-04-09T18:35:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:35:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: mon op complaint time = 120 2021-04-09T18:35:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: 2021-04-09T18:35:32.378 INFO:teuthology.orchestra.run.smithi144.stdout:[client] 2021-04-09T18:35:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: rgw cache enabled = true 2021-04-09T18:35:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable ops log = true 2021-04-09T18:35:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable usage log = true 2021-04-09T18:35:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-04-09T18:35:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-04-09T18:35:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: client mount timeout = 600 2021-04-09T18:35:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2021-04-09T18:35:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2021-04-09T18:35:32.380 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.a] 2021-04-09T18:35:32.381 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.b] 2021-04-09T18:35:32.381 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.c] 2021-04-09T18:35:32.381 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2021-04-09T18:35:32.381 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2021-04-09T18:35:32.382 INFO:teuthology.orchestra.run.smithi144.stdout:[mds] 2021-04-09T18:35:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds = 20 2021-04-09T18:35:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2021-04-09T18:35:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: mds bal frag = True 2021-04-09T18:35:32.383 INFO:teuthology.orchestra.run.smithi144.stdout: mds bal fragment size max = 10000 2021-04-09T18:35:32.383 INFO:teuthology.orchestra.run.smithi144.stdout: mds bal merge size = 5 2021-04-09T18:35:32.383 INFO:teuthology.orchestra.run.smithi144.stdout: mds bal split bits = 3 2021-04-09T18:35:32.383 INFO:teuthology.orchestra.run.smithi144.stdout: mds bal split size = 100 2021-04-09T18:35:32.383 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug frag = True 2021-04-09T18:35:32.384 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug scatterstat = True 2021-04-09T18:35:32.384 INFO:teuthology.orchestra.run.smithi144.stdout: mds op complaint time = 180 2021-04-09T18:35:32.384 INFO:teuthology.orchestra.run.smithi144.stdout: mds verify scatter = True 2021-04-09T18:35:32.384 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2021-04-09T18:35:32.385 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2021-04-09T18:35:32.385 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2021-04-09T18:35:32.385 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-04-09T18:35:32.385 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2021-04-09T18:35:32.386 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.386 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2021-04-09T18:35:32.386 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.386 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2021-04-09T18:35:32.387 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.387 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2021-04-09T18:35:32.387 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2021-04-09T18:35:32.387 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.388 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2021-04-09T18:35:32.388 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2021-04-09T18:35:32.388 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.388 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2021-04-09T18:35:32.389 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2021-04-09T18:35:32.389 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.389 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2021-04-09T18:35:32.389 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.390 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2021-04-09T18:35:32.390 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2021-04-09T18:35:32.390 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2021-04-09T18:35:32.390 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2021-04-09T18:35:32.391 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2021-04-09T18:35:32.391 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2021-04-09T18:35:32.391 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2021-04-09T18:35:32.391 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-04-09T18:35:32.392 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2021-04-09T18:35:32.392 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.392 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-04-09T18:35:32.392 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.393 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2021-04-09T18:35:32.393 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.393 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2021-04-09T18:35:32.393 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.394 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2021-04-09T18:35:32.394 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2021-04-09T18:35:32.394 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2021-04-09T18:35:32.394 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.394 INFO:teuthology.orchestra.run.smithi090.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-04-09T18:35:32.395 INFO:teuthology.orchestra.run.smithi090.stdout: mon_client_directed_command_retry = 4 2021-04-09T18:35:32.395 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.79,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2021-04-09T18:35:32.395 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = fc927781-121d-4817-b30c-0c6f9e107f84 2021-04-09T18:35:32.395 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.396 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2021-04-09T18:35:32.396 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2021-04-09T18:35:32.396 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.396 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2021-04-09T18:35:32.397 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2021-04-09T18:35:32.397 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.397 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2021-04-09T18:35:32.397 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2021-04-09T18:35:32.398 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.398 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2021-04-09T18:35:32.398 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2021-04-09T18:35:32.398 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2021-04-09T18:35:32.399 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.399 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2021-04-09T18:35:32.399 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2021-04-09T18:35:32.399 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.400 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2021-04-09T18:35:32.400 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.400 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2021-04-09T18:35:32.400 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.400 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2021-04-09T18:35:32.401 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.401 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2021-04-09T18:35:32.401 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2021-04-09T18:35:32.401 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.402 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2021-04-09T18:35:32.402 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2021-04-09T18:35:32.402 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2021-04-09T18:35:32.402 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2021-04-09T18:35:32.403 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 20 2021-04-09T18:35:32.403 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 20 2021-04-09T18:35:32.403 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2021-04-09T18:35:32.403 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2021-04-09T18:35:32.404 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 10 2021-04-09T18:35:32.404 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2021-04-09T18:35:32.404 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2021-04-09T18:35:32.405 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2021-04-09T18:35:32.405 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2021-04-09T18:35:32.405 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2021-04-09T18:35:32.405 INFO:teuthology.orchestra.run.smithi090.stdout: osd op complaint time = 180 2021-04-09T18:35:32.405 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.406 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2021-04-09T18:35:32.406 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2021-04-09T18:35:32.406 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2021-04-09T18:35:32.406 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2021-04-09T18:35:32.407 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2021-04-09T18:35:32.407 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:35:32.407 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:35:32.407 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.408 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2021-04-09T18:35:32.408 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2021-04-09T18:35:32.408 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2021-04-09T18:35:32.408 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2021-04-09T18:35:32.409 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2021-04-09T18:35:32.409 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2021-04-09T18:35:32.409 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2021-04-09T18:35:32.409 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:35:32.409 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2021-04-09T18:35:32.410 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2021-04-09T18:35:32.410 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:35:32.410 INFO:teuthology.orchestra.run.smithi090.stdout: mon op complaint time = 120 2021-04-09T18:35:32.410 INFO:teuthology.orchestra.run.smithi090.stdout: 2021-04-09T18:35:32.411 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2021-04-09T18:35:32.411 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2021-04-09T18:35:32.411 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2021-04-09T18:35:32.411 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2021-04-09T18:35:32.412 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-04-09T18:35:32.412 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-04-09T18:35:32.412 INFO:teuthology.orchestra.run.smithi090.stdout: client mount timeout = 600 2021-04-09T18:35:32.412 INFO:teuthology.orchestra.run.smithi090.stdout: debug client = 20 2021-04-09T18:35:32.412 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2021-04-09T18:35:32.413 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2021-04-09T18:35:32.413 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2021-04-09T18:35:32.413 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2021-04-09T18:35:32.413 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2021-04-09T18:35:32.414 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2021-04-09T18:35:32.414 INFO:teuthology.orchestra.run.smithi090.stdout:[mds] 2021-04-09T18:35:32.414 INFO:teuthology.orchestra.run.smithi090.stdout: debug mds = 20 2021-04-09T18:35:32.414 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2021-04-09T18:35:32.415 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal frag = True 2021-04-09T18:35:32.415 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal fragment size max = 10000 2021-04-09T18:35:32.415 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal merge size = 5 2021-04-09T18:35:32.415 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal split bits = 3 2021-04-09T18:35:32.416 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal split size = 100 2021-04-09T18:35:32.416 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug frag = True 2021-04-09T18:35:32.416 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug scatterstat = True 2021-04-09T18:35:32.416 INFO:teuthology.orchestra.run.smithi090.stdout: mds op complaint time = 180 2021-04-09T18:35:32.416 INFO:teuthology.orchestra.run.smithi090.stdout: mds verify scatter = True 2021-04-09T18:35:32.417 INFO:teuthology.orchestra.run.smithi090.stdout: osd op complaint time = 180 2021-04-09T18:35:32.417 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2021-04-09T18:35:32.417 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2021-04-09T18:35:32.417 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-04-09T18:35:32.418 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2021-04-09T18:35:32.418 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.418 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2021-04-09T18:35:32.418 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.419 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2021-04-09T18:35:32.419 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.419 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2021-04-09T18:35:32.419 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2021-04-09T18:35:32.420 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.420 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2021-04-09T18:35:32.420 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2021-04-09T18:35:32.420 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.421 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2021-04-09T18:35:32.421 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2021-04-09T18:35:32.421 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.421 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2021-04-09T18:35:32.421 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.422 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2021-04-09T18:35:32.422 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2021-04-09T18:35:32.422 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2021-04-09T18:35:32.422 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2021-04-09T18:35:32.423 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2021-04-09T18:35:32.423 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2021-04-09T18:35:32.423 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2021-04-09T18:35:32.423 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-04-09T18:35:32.424 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2021-04-09T18:35:32.424 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.424 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-04-09T18:35:32.424 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.424 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2021-04-09T18:35:32.425 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.425 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2021-04-09T18:35:32.425 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.425 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2021-04-09T18:35:32.426 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2021-04-09T18:35:32.426 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2021-04-09T18:35:32.426 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.426 INFO:teuthology.orchestra.run.smithi089.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-04-09T18:35:32.427 INFO:teuthology.orchestra.run.smithi089.stdout: mon_client_directed_command_retry = 4 2021-04-09T18:35:32.427 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = "172.21.15.79,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2021-04-09T18:35:32.427 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = fc927781-121d-4817-b30c-0c6f9e107f84 2021-04-09T18:35:32.427 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.428 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2021-04-09T18:35:32.428 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2021-04-09T18:35:32.428 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.428 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2021-04-09T18:35:32.429 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2021-04-09T18:35:32.429 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.429 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2021-04-09T18:35:32.429 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2021-04-09T18:35:32.429 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.430 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2021-04-09T18:35:32.430 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2021-04-09T18:35:32.430 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2021-04-09T18:35:32.430 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.431 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2021-04-09T18:35:32.431 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2021-04-09T18:35:32.431 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.431 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2021-04-09T18:35:32.432 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.432 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2021-04-09T18:35:32.432 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.432 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2021-04-09T18:35:32.432 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.433 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2021-04-09T18:35:32.433 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2021-04-09T18:35:32.433 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.433 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2021-04-09T18:35:32.434 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2021-04-09T18:35:32.434 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2021-04-09T18:35:32.434 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2021-04-09T18:35:32.434 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 20 2021-04-09T18:35:32.434 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 20 2021-04-09T18:35:32.435 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2021-04-09T18:35:32.435 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2021-04-09T18:35:32.435 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 10 2021-04-09T18:35:32.435 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2021-04-09T18:35:32.436 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2021-04-09T18:35:32.436 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2021-04-09T18:35:32.436 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 0.95 2021-04-09T18:35:32.436 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = bluestore 2021-04-09T18:35:32.437 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2021-04-09T18:35:32.437 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.437 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2021-04-09T18:35:32.437 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2021-04-09T18:35:32.438 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2021-04-09T18:35:32.438 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2021-04-09T18:35:32.438 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2021-04-09T18:35:32.438 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:35:32.439 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:35:32.439 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.439 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2021-04-09T18:35:32.439 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2021-04-09T18:35:32.440 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2021-04-09T18:35:32.440 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2021-04-09T18:35:32.440 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2021-04-09T18:35:32.440 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2021-04-09T18:35:32.440 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2021-04-09T18:35:32.441 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:35:32.441 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2021-04-09T18:35:32.441 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2021-04-09T18:35:32.441 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:35:32.442 INFO:teuthology.orchestra.run.smithi089.stdout: mon op complaint time = 120 2021-04-09T18:35:32.442 INFO:teuthology.orchestra.run.smithi089.stdout: 2021-04-09T18:35:32.442 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2021-04-09T18:35:32.442 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2021-04-09T18:35:32.443 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2021-04-09T18:35:32.443 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2021-04-09T18:35:32.443 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-04-09T18:35:32.443 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-04-09T18:35:32.444 INFO:teuthology.orchestra.run.smithi089.stdout: client mount timeout = 600 2021-04-09T18:35:32.444 INFO:teuthology.orchestra.run.smithi089.stdout: debug client = 20 2021-04-09T18:35:32.444 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2021-04-09T18:35:32.444 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2021-04-09T18:35:32.445 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.b] 2021-04-09T18:35:32.445 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.c] 2021-04-09T18:35:32.445 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2021-04-09T18:35:32.445 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2021-04-09T18:35:32.445 INFO:teuthology.orchestra.run.smithi089.stdout:[mds] 2021-04-09T18:35:32.446 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds = 20 2021-04-09T18:35:32.446 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2021-04-09T18:35:32.446 INFO:teuthology.orchestra.run.smithi089.stdout: mds bal frag = True 2021-04-09T18:35:32.446 INFO:teuthology.orchestra.run.smithi089.stdout: mds bal fragment size max = 10000 2021-04-09T18:35:32.447 INFO:teuthology.orchestra.run.smithi089.stdout: mds bal merge size = 5 2021-04-09T18:35:32.447 INFO:teuthology.orchestra.run.smithi089.stdout: mds bal split bits = 3 2021-04-09T18:35:32.447 INFO:teuthology.orchestra.run.smithi089.stdout: mds bal split size = 100 2021-04-09T18:35:32.447 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug frag = True 2021-04-09T18:35:32.448 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug scatterstat = True 2021-04-09T18:35:32.448 INFO:teuthology.orchestra.run.smithi089.stdout: mds op complaint time = 180 2021-04-09T18:35:32.448 INFO:teuthology.orchestra.run.smithi089.stdout: mds verify scatter = True 2021-04-09T18:35:32.448 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2021-04-09T18:35:32.449 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-04-09T18:35:32.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.542 7f8b54544700 1 Processor -- start 2021-04-09T18:35:32.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.542 7f8b54544700 1 -- start start 2021-04-09T18:35:32.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.542 7f8b54544700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b4c0e9ae0 0x7f8b4c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:32.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.542 7f8b54544700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8b4c1c8010 0x7f8b4c1ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:32.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.542 7f8b54544700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4c0fbb20 con 0x7f8b4c0f5520 2021-04-09T18:35:32.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.542 7f8b54544700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4c1c3dc0 con 0x7f8b4c1c8010 2021-04-09T18:35:32.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.542 7f8b54544700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0e9f30 con 0x7f8b4c0e9ae0 2021-04-09T18:35:32.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.542 7f8b52ae9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8b4c1c8010 0x7f8b4c1ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:32.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.542 7f8b51ae7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b4c0e9ae0 0x7f8b4c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:32.559 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.546 7f8b522e8700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8b4c0f5520 0x7f8b4c0f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:58718/0 (socket says 172.21.15.79:58718) 2021-04-09T18:35:32.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.546 7f8b522e8700 1 -- 172.21.15.79:0/3896534245 learned_addr learned my addr 172.21.15.79:0/3896534245 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:32.560 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.546 7f8b51ae7700 1 -- 172.21.15.79:0/3896534245 >> v2:172.21.15.89:3300/0 conn(0x7f8b4c1c8010 msgr2=0x7f8b4c1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:32.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.546 7f8b51ae7700 1 --2- 172.21.15.79:0/3896534245 >> v2:172.21.15.89:3300/0 conn(0x7f8b4c1c8010 0x7f8b4c1ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:32.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.546 7f8b51ae7700 1 -- 172.21.15.79:0/3896534245 >> v1:172.21.15.89:6789/0 conn(0x7f8b4c0f5520 legacy=0x7f8b4c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:32.561 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.546 7f8b512e6700 1 -- 172.21.15.79:0/3896534245 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943670164 0 0) 0x7f8b440010d0 con 0x7f8b4c0f5520 2021-04-09T18:35:32.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.546 7f8b51ae7700 1 -- 172.21.15.79:0/3896534245 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c0e56d0 con 0x7f8b4c0e9ae0 2021-04-09T18:35:32.562 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.546 7f8b52ae9700 1 --2- 172.21.15.79:0/3896534245 >> v2:172.21.15.89:3300/0 conn(0x7f8b4c1c8010 0x7f8b4c1ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:32.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.546 7f8b51ae7700 1 --2- 172.21.15.79:0/3896534245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b4c0e9ae0 0x7f8b4c09f110 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f8b34002f30 tx=0x7f8b3400bcc0).ready entity=mon.2 client_cookie=8b5d8649a4c2c83e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:32.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.546 7f8b512e6700 1 -- 172.21.15.79:0/3896534245 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b4c0e56d0 con 0x7f8b4c0e9ae0 2021-04-09T18:35:32.563 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.546 7f8b512e6700 1 -- 172.21.15.79:0/3896534245 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b34009800 con 0x7f8b4c0e9ae0 2021-04-09T18:35:32.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.546 7f8b512e6700 1 -- 172.21.15.79:0/3896534245 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b34009bd0 con 0x7f8b4c0e9ae0 2021-04-09T18:35:32.564 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.546 7f8b54544700 1 -- 172.21.15.79:0/3896534245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b4c0e9ae0 msgr2=0x7f8b4c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:32.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.546 7f8b54544700 1 --2- 172.21.15.79:0/3896534245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b4c0e9ae0 0x7f8b4c09f110 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f8b34002f30 tx=0x7f8b3400bcc0).stop 2021-04-09T18:35:32.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.546 7f8b54544700 1 -- 172.21.15.79:0/3896534245 shutdown_connections 2021-04-09T18:35:32.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.546 7f8b54544700 1 --2- 172.21.15.79:0/3896534245 >> v2:172.21.15.89:3300/0 conn(0x7f8b4c1c8010 0x7f8b4c1ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:32.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.546 7f8b54544700 1 --2- 172.21.15.79:0/3896534245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b4c0e9ae0 0x7f8b4c09f110 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:32.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.546 7f8b54544700 1 -- 172.21.15.79:0/3896534245 >> 172.21.15.79:0/3896534245 conn(0x7f8b4c0e5fe0 msgr2=0x7f8b4c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:32.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.546 7f8b54544700 1 -- 172.21.15.79:0/3896534245 shutdown_connections 2021-04-09T18:35:32.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.546 7f8b54544700 1 -- 172.21.15.79:0/3896534245 wait complete. 2021-04-09T18:35:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b54544700 1 Processor -- start 2021-04-09T18:35:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b54544700 1 -- start start 2021-04-09T18:35:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b54544700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b4c0a48d0 0x7f8b4c1a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b54544700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b4c0bafe0 0x7f8b4c0d63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b54544700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b4c0af930 0x7f8b4c096710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:32.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b54544700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c19ede0 con 0x7f8b4c0af930 2021-04-09T18:35:32.575 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b54544700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c19f0e0 con 0x7f8b4c0bafe0 2021-04-09T18:35:32.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b54544700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0a4d20 con 0x7f8b4c0a48d0 2021-04-09T18:35:32.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b52ae9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b4c0af930 0x7f8b4c096710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:32.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b52ae9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b4c0af930 0x7f8b4c096710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35314/0 (socket says 172.21.15.79:35314) 2021-04-09T18:35:32.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b52ae9700 1 -- 172.21.15.79:0/1175791084 learned_addr learned my addr 172.21.15.79:0/1175791084 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:32.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b522e8700 1 --2- 172.21.15.79:0/1175791084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b4c0a48d0 0x7f8b4c1a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:32.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b51ae7700 1 --2- 172.21.15.79:0/1175791084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b4c0bafe0 0x7f8b4c0d63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:32.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b52ae9700 1 -- 172.21.15.79:0/1175791084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b4c0a48d0 msgr2=0x7f8b4c1a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:32.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b52ae9700 1 --2- 172.21.15.79:0/1175791084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b4c0a48d0 0x7f8b4c1a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:32.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b52ae9700 1 -- 172.21.15.79:0/1175791084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b4c0bafe0 msgr2=0x7f8b4c0d63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:32.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b52ae9700 1 --2- 172.21.15.79:0/1175791084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b4c0bafe0 0x7f8b4c0d63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:32.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b52ae9700 1 -- 172.21.15.79:0/1175791084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c0bb430 con 0x7f8b4c0af930 2021-04-09T18:35:32.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b52ae9700 1 --2- 172.21.15.79:0/1175791084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b4c0af930 0x7f8b4c096710 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f8b4c0d8140 tx=0x7f8b3c00c5a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:32.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b4affd700 1 -- 172.21.15.79:0/1175791084 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b4c0bb430 con 0x7f8b4c0af930 2021-04-09T18:35:32.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b54544700 1 -- 172.21.15.79:0/1175791084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4c0afd80 con 0x7f8b4c0af930 2021-04-09T18:35:32.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b4affd700 1 -- 172.21.15.79:0/1175791084 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c0123f0 con 0x7f8b4c0af930 2021-04-09T18:35:32.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b4affd700 1 -- 172.21.15.79:0/1175791084 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b3c00f040 con 0x7f8b4c0af930 2021-04-09T18:35:32.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.550 7f8b54544700 1 -- 172.21.15.79:0/1175791084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4c096ed0 con 0x7f8b4c0af930 2021-04-09T18:35:32.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.554 7f8b4affd700 1 -- 172.21.15.79:0/1175791084 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8b3c022060 con 0x7f8b4c0af930 2021-04-09T18:35:32.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.554 7f8b4affd700 1 --2- 172.21.15.79:0/1175791084 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b30029100 0x7f8b3002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:32.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.554 7f8b4affd700 1 -- 172.21.15.79:0/1175791084 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f8b3c010040 con 0x7f8b4c0af930 2021-04-09T18:35:32.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.554 7f8b522e8700 1 --2- 172.21.15.79:0/1175791084 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b30029100 0x7f8b3002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:32.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.554 7f8b522e8700 1 --2- 172.21.15.79:0/1175791084 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b30029100 0x7f8b3002b650 crc :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:32.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.558 7f8b54544700 1 -- 172.21.15.79:0/1175791084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4c0e39e0 con 0x7f8b4c0af930 2021-04-09T18:35:32.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.562 7f8b4affd700 1 -- 172.21.15.79:0/1175791084 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8b4c0f76c0 con 0x7f8b4c0af930 2021-04-09T18:35:32.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.746 7f8b54544700 1 -- 172.21.15.79:0/1175791084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8b4c0a1cc0 con 0x7f8b4c0af930 2021-04-09T18:35:32.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.750 7f8b4affd700 1 -- 172.21.15.79:0/1175791084 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8b3c00cc60 con 0x7f8b4c0af930 2021-04-09T18:35:32.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.758 7f8b54544700 1 -- 172.21.15.79:0/1175791084 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b30029100 msgr2=0x7f8b3002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:32.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.758 7f8b54544700 1 --2- 172.21.15.79:0/1175791084 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b30029100 0x7f8b3002b650 crc :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:32.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.758 7f8b54544700 1 -- 172.21.15.79:0/1175791084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b4c0af930 msgr2=0x7f8b4c096710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:32.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.758 7f8b54544700 1 --2- 172.21.15.79:0/1175791084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b4c0af930 0x7f8b4c096710 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f8b4c0d8140 tx=0x7f8b3c00c5a0).stop 2021-04-09T18:35:32.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.758 7f8b54544700 1 -- 172.21.15.79:0/1175791084 shutdown_connections 2021-04-09T18:35:32.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.758 7f8b54544700 1 --2- 172.21.15.79:0/1175791084 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b30029100 0x7f8b3002b650 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:32.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.758 7f8b54544700 1 --2- 172.21.15.79:0/1175791084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b4c0af930 0x7f8b4c096710 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:32.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.758 7f8b54544700 1 --2- 172.21.15.79:0/1175791084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b4c0a48d0 0x7f8b4c1a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:32.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.758 7f8b54544700 1 --2- 172.21.15.79:0/1175791084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b4c0bafe0 0x7f8b4c0d63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:32.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.758 7f8b54544700 1 -- 172.21.15.79:0/1175791084 >> 172.21.15.79:0/1175791084 conn(0x7f8b4c09abd0 msgr2=0x7f8b4c09a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:32.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.758 7f8b54544700 1 -- 172.21.15.79:0/1175791084 shutdown_connections 2021-04-09T18:35:32.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.758 7f8b54544700 1 -- 172.21.15.79:0/1175791084 wait complete. 2021-04-09T18:35:32.778 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2021-04-09T18:35:32.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.862 7fb9f6e7a700 1 Processor -- start 2021-04-09T18:35:32.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.862 7fb9f6e7a700 1 -- start start 2021-04-09T18:35:32.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.862 7fb9f6e7a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb9f00f5520 0x7fb9f00f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:32.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.862 7fb9f6e7a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9f00e9ae0 0x7fb9f009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:32.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.862 7fb9f6e7a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f00fbb20 con 0x7fb9f01c2db0 2021-04-09T18:35:32.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.862 7fb9f6e7a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f00e9f30 con 0x7fb9f00f5520 2021-04-09T18:35:32.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.862 7fb9f6e7a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f00e59d0 con 0x7fb9f00e9ae0 2021-04-09T18:35:32.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.862 7fb9f4c1e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb9f00f5520 0x7fb9f00f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:32.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.862 7fb9f541f700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb9f01c2db0 0x7fb9f01c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58264/0 (socket says 172.21.15.79:58264) 2021-04-09T18:35:32.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.862 7fb9f541f700 1 -- 172.21.15.79:0/1655349002 learned_addr learned my addr 172.21.15.79:0/1655349002 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:32.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.862 7fb9effff700 1 --2- 172.21.15.79:0/1655349002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9f00e9ae0 0x7fb9f009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:32.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.866 7fb9f4c1e700 1 -- 172.21.15.79:0/1655349002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9f00e9ae0 msgr2=0x7fb9f009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:32.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.866 7fb9f4c1e700 1 --2- 172.21.15.79:0/1655349002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9f00e9ae0 0x7fb9f009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:32.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.866 7fb9f4c1e700 1 -- 172.21.15.79:0/1655349002 >> v1:172.21.15.79:6789/0 conn(0x7fb9f01c2db0 legacy=0x7fb9f01c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:32.881 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.866 7fb9ef7fe700 1 -- 172.21.15.79:0/1655349002 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659732168 0 0) 0x7fb9e80010d0 con 0x7fb9f01c2db0 2021-04-09T18:35:32.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.866 7fb9f4c1e700 1 -- 172.21.15.79:0/1655349002 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f00e56d0 con 0x7fb9f00f5520 2021-04-09T18:35:32.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.866 7fb9effff700 1 --2- 172.21.15.79:0/1655349002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9f00e9ae0 0x7fb9f009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:32.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.866 7fb9f4c1e700 1 --2- 172.21.15.79:0/1655349002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9f00f5520 0x7fb9f00f64b0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7fb9e00032b0 tx=0x7fb9e000b3c0).ready entity=mon.0 client_cookie=781fbcfe76e4a087 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:32.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.866 7fb9ef7fe700 1 -- 172.21.15.79:0/1655349002 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb9f00e56d0 con 0x7fb9f00f5520 2021-04-09T18:35:32.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.866 7fb9ef7fe700 1 -- 172.21.15.79:0/1655349002 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e000bc20 con 0x7fb9f00f5520 2021-04-09T18:35:32.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.866 7fb9ef7fe700 1 -- 172.21.15.79:0/1655349002 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb9e0002020 con 0x7fb9f00f5520 2021-04-09T18:35:32.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.866 7fb9f6e7a700 1 -- 172.21.15.79:0/1655349002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9f00f5520 msgr2=0x7fb9f00f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:32.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.866 7fb9f6e7a700 1 --2- 172.21.15.79:0/1655349002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9f00f5520 0x7fb9f00f64b0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7fb9e00032b0 tx=0x7fb9e000b3c0).stop 2021-04-09T18:35:32.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.866 7fb9f6e7a700 1 -- 172.21.15.79:0/1655349002 shutdown_connections 2021-04-09T18:35:32.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.866 7fb9f6e7a700 1 --2- 172.21.15.79:0/1655349002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9f00f5520 0x7fb9f00f64b0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:32.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.866 7fb9f6e7a700 1 --2- 172.21.15.79:0/1655349002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9f00e9ae0 0x7fb9f009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:32.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.866 7fb9f6e7a700 1 -- 172.21.15.79:0/1655349002 >> 172.21.15.79:0/1655349002 conn(0x7fb9f00e5fe0 msgr2=0x7fb9f00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:32.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.866 7fb9f6e7a700 1 -- 172.21.15.79:0/1655349002 shutdown_connections 2021-04-09T18:35:32.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.866 7fb9f6e7a700 1 -- 172.21.15.79:0/1655349002 wait complete. 2021-04-09T18:35:32.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9f6e7a700 1 Processor -- start 2021-04-09T18:35:32.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9f6e7a700 1 -- start start 2021-04-09T18:35:32.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9f6e7a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9f00ae6f0 0x7fb9f019fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:32.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9f6e7a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9f01a0420 0x7fb9f01acee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:32.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9f6e7a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9f00aeb40 0x7fb9f01ad510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:32.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9f6e7a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f0096600 con 0x7fb9f00aeb40 2021-04-09T18:35:32.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9f6e7a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f0096900 con 0x7fb9f01a0420 2021-04-09T18:35:32.892 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9f6e7a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f00d65b0 con 0x7fb9f00ae6f0 2021-04-09T18:35:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9f541f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9f00aeb40 0x7fb9f01ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9f4c1e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9f00ae6f0 0x7fb9f019fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9f541f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9f00aeb40 0x7fb9f01ad510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35330/0 (socket says 172.21.15.79:35330) 2021-04-09T18:35:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9f541f700 1 -- 172.21.15.79:0/527918869 learned_addr learned my addr 172.21.15.79:0/527918869 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9effff700 1 --2- 172.21.15.79:0/527918869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9f01a0420 0x7fb9f01acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:32.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9f541f700 1 -- 172.21.15.79:0/527918869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9f00ae6f0 msgr2=0x7fb9f019fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:32.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9f541f700 1 --2- 172.21.15.79:0/527918869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9f00ae6f0 0x7fb9f019fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:32.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9f541f700 1 -- 172.21.15.79:0/527918869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9f01a0420 msgr2=0x7fb9f01acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:32.894 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9f541f700 1 --2- 172.21.15.79:0/527918869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9f01a0420 0x7fb9f01acee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:32.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9f541f700 1 -- 172.21.15.79:0/527918869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f0096230 con 0x7fb9f00aeb40 2021-04-09T18:35:32.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9f541f700 1 --2- 172.21.15.79:0/527918869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9f00aeb40 0x7fb9f01ad510 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7fb9f00d7cc0 tx=0x7fb9e800cb30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:32.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9ed7fa700 1 -- 172.21.15.79:0/527918869 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb9f0096230 con 0x7fb9f00aeb40 2021-04-09T18:35:32.895 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9ed7fa700 1 -- 172.21.15.79:0/527918869 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e8007320 con 0x7fb9f00aeb40 2021-04-09T18:35:32.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9f6e7a700 1 -- 172.21.15.79:0/527918869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f0097ea0 con 0x7fb9f00aeb40 2021-04-09T18:35:32.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9ed7fa700 1 -- 172.21.15.79:0/527918869 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb9e80057e0 con 0x7fb9f00aeb40 2021-04-09T18:35:32.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.870 7fb9f6e7a700 1 -- 172.21.15.79:0/527918869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f00d6000 con 0x7fb9f00aeb40 2021-04-09T18:35:32.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.874 7fb9ed7fa700 1 -- 172.21.15.79:0/527918869 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb9e801a060 con 0x7fb9f00aeb40 2021-04-09T18:35:32.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.874 7fb9ed7fa700 1 --2- 172.21.15.79:0/527918869 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb9d4029100 0x7fb9d402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:32.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.874 7fb9ed7fa700 1 -- 172.21.15.79:0/527918869 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5190+0+0 (secure 0 0 0) 0x7fb9e8038980 con 0x7fb9f00aeb40 2021-04-09T18:35:32.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.874 7fb9f4c1e700 1 --2- 172.21.15.79:0/527918869 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb9d4029100 0x7fb9d402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:32.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.874 7fb9f4c1e700 1 --2- 172.21.15.79:0/527918869 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb9d4029100 0x7fb9d402b650 crc :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:32.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.878 7fb9f6e7a700 1 -- 172.21.15.79:0/527918869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f00e39e0 con 0x7fb9f00aeb40 2021-04-09T18:35:32.898 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:32.886 7fb9ed7fa700 1 -- 172.21.15.79:0/527918869 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb9e8007110 con 0x7fb9f00aeb40 2021-04-09T18:35:33.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.042 7fb9f6e7a700 1 -- 172.21.15.79:0/527918869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7fb9f00f5b20 con 0x7fb9f00aeb40 2021-04-09T18:35:33.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.214 7fb9ed7fa700 1 -- 172.21.15.79:0/527918869 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v305) v1 ==== 128+0+0 (secure 0 0 0) 0x7fb9f00f76c0 con 0x7fb9f00aeb40 2021-04-09T18:35:33.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.262 7fb9f6e7a700 1 -- 172.21.15.79:0/527918869 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb9d4029100 msgr2=0x7fb9d402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:33.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.262 7fb9f6e7a700 1 --2- 172.21.15.79:0/527918869 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb9d4029100 0x7fb9d402b650 crc :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:33.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.262 7fb9f6e7a700 1 -- 172.21.15.79:0/527918869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9f00aeb40 msgr2=0x7fb9f01ad510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:33.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.262 7fb9f6e7a700 1 --2- 172.21.15.79:0/527918869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9f00aeb40 0x7fb9f01ad510 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7fb9f00d7cc0 tx=0x7fb9e800cb30).stop 2021-04-09T18:35:33.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.262 7fb9f6e7a700 1 -- 172.21.15.79:0/527918869 shutdown_connections 2021-04-09T18:35:33.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.262 7fb9f6e7a700 1 --2- 172.21.15.79:0/527918869 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb9d4029100 0x7fb9d402b650 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:33.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.262 7fb9f6e7a700 1 --2- 172.21.15.79:0/527918869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9f00aeb40 0x7fb9f01ad510 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:33.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.262 7fb9f6e7a700 1 --2- 172.21.15.79:0/527918869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9f00ae6f0 0x7fb9f019fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:33.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.262 7fb9f6e7a700 1 --2- 172.21.15.79:0/527918869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9f01a0420 0x7fb9f01acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:33.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.262 7fb9f6e7a700 1 -- 172.21.15.79:0/527918869 >> 172.21.15.79:0/527918869 conn(0x7fb9f01a16c0 msgr2=0x7fb9f01a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:33.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.262 7fb9f6e7a700 1 -- 172.21.15.79:0/527918869 shutdown_connections 2021-04-09T18:35:33.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.262 7fb9f6e7a700 1 -- 172.21.15.79:0/527918869 wait complete. 2021-04-09T18:35:33.287 INFO:tasks.cephfs_test_runner:test_getattr_caps (tasks.cephfs.test_misc.TestMisc) ... ok 2021-04-09T18:35:33.288 INFO:tasks.cephfs_test_runner:Starting test: test_root_rctime (tasks.cephfs.test_misc.TestMisc) 2021-04-09T18:35:33.288 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2021-04-09T18:35:33.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.378 7fa63727d700 1 Processor -- start 2021-04-09T18:35:33.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.378 7fa63727d700 1 -- start start 2021-04-09T18:35:33.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.378 7fa63727d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6300f5520 0x7fa6300f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:33.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.378 7fa63727d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa6301c8010 0x7fa6301ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:33.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.378 7fa63727d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6300fbb20 con 0x7fa6300e9ae0 2021-04-09T18:35:33.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.378 7fa63727d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6300e9f30 con 0x7fa6300f5520 2021-04-09T18:35:33.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.378 7fa63727d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6301c3dc0 con 0x7fa6301c8010 2021-04-09T18:35:33.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.378 7fa635021700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6300f5520 0x7fa6300f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:33.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.378 7fa634820700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa6300e9ae0 0x7fa63009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58278/0 (socket says 172.21.15.79:58278) 2021-04-09T18:35:33.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.378 7fa634820700 1 -- 172.21.15.79:0/1651339997 learned_addr learned my addr 172.21.15.79:0/1651339997 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:33.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.378 7fa635822700 1 --2- 172.21.15.79:0/1651339997 >> v2:172.21.15.89:3300/0 conn(0x7fa6301c8010 0x7fa6301ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:33.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.382 7fa635021700 1 -- 172.21.15.79:0/1651339997 >> v2:172.21.15.89:3300/0 conn(0x7fa6301c8010 msgr2=0x7fa6301ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:33.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.382 7fa635021700 1 --2- 172.21.15.79:0/1651339997 >> v2:172.21.15.89:3300/0 conn(0x7fa6301c8010 0x7fa6301ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:33.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.382 7fa635021700 1 -- 172.21.15.79:0/1651339997 >> v1:172.21.15.79:6789/0 conn(0x7fa6300e9ae0 legacy=0x7fa63009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:33.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.382 7fa62ffff700 1 -- 172.21.15.79:0/1651339997 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146112209 0 0) 0x7fa620001450 con 0x7fa6300e9ae0 2021-04-09T18:35:33.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.382 7fa635021700 1 -- 172.21.15.79:0/1651339997 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63009f910 con 0x7fa6300f5520 2021-04-09T18:35:33.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.382 7fa635021700 1 --2- 172.21.15.79:0/1651339997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6300f5520 0x7fa6300f64b0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7fa624002f30 tx=0x7fa62400bd10).ready entity=mon.0 client_cookie=b39c5afc6dc447ea server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:33.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.382 7fa62ffff700 1 -- 172.21.15.79:0/1651339997 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa63009f910 con 0x7fa6300f5520 2021-04-09T18:35:33.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.382 7fa62ffff700 1 -- 172.21.15.79:0/1651339997 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6240098a0 con 0x7fa6300f5520 2021-04-09T18:35:33.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.382 7fa62ffff700 1 -- 172.21.15.79:0/1651339997 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa624009c70 con 0x7fa6300f5520 2021-04-09T18:35:33.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.382 7fa63727d700 1 -- 172.21.15.79:0/1651339997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6300f5520 msgr2=0x7fa6300f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:33.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.382 7fa63727d700 1 --2- 172.21.15.79:0/1651339997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6300f5520 0x7fa6300f64b0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7fa624002f30 tx=0x7fa62400bd10).stop 2021-04-09T18:35:33.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.382 7fa63727d700 1 -- 172.21.15.79:0/1651339997 shutdown_connections 2021-04-09T18:35:33.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.382 7fa63727d700 1 --2- 172.21.15.79:0/1651339997 >> v2:172.21.15.89:3300/0 conn(0x7fa6301c8010 0x7fa6301ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:33.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.382 7fa63727d700 1 --2- 172.21.15.79:0/1651339997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6300f5520 0x7fa6300f64b0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:33.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.382 7fa63727d700 1 -- 172.21.15.79:0/1651339997 >> 172.21.15.79:0/1651339997 conn(0x7fa6300e5fe0 msgr2=0x7fa6300e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:33.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.382 7fa63727d700 1 -- 172.21.15.79:0/1651339997 shutdown_connections 2021-04-09T18:35:33.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.382 7fa63727d700 1 -- 172.21.15.79:0/1651339997 wait complete. 2021-04-09T18:35:33.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa63727d700 1 Processor -- start 2021-04-09T18:35:33.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa63727d700 1 -- start start 2021-04-09T18:35:33.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa63727d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6300904f0 0x7fa6300d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:33.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa63727d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa630090940 0x7fa6300d26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:33.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa63727d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6301a8a10 0x7fa6301a8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:33.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa63727d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6300bbaa0 con 0x7fa6300904f0 2021-04-09T18:35:33.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa63727d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6300bbda0 con 0x7fa630090940 2021-04-09T18:35:33.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa63727d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6300baab0 con 0x7fa6301a8a10 2021-04-09T18:35:33.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa635021700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6300904f0 0x7fa6300d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:33.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa635021700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6300904f0 0x7fa6300d20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35340/0 (socket says 172.21.15.79:35340) 2021-04-09T18:35:33.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa635021700 1 -- 172.21.15.79:0/327814178 learned_addr learned my addr 172.21.15.79:0/327814178 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:33.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa634820700 1 --2- 172.21.15.79:0/327814178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa630090940 0x7fa6300d26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:33.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa635822700 1 --2- 172.21.15.79:0/327814178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6301a8a10 0x7fa6301a8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:33.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa635021700 1 -- 172.21.15.79:0/327814178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6301a8a10 msgr2=0x7fa6301a8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:33.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa635021700 1 --2- 172.21.15.79:0/327814178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6301a8a10 0x7fa6301a8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:33.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa635021700 1 -- 172.21.15.79:0/327814178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa630090940 msgr2=0x7fa6300d26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:33.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa635021700 1 --2- 172.21.15.79:0/327814178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa630090940 0x7fa6300d26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:33.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa635021700 1 -- 172.21.15.79:0/327814178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6300be720 con 0x7fa6300904f0 2021-04-09T18:35:33.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa635021700 1 --2- 172.21.15.79:0/327814178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6300904f0 0x7fa6300d20c0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7fa6300874d0 tx=0x7fa624006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:33.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa62dffb700 1 -- 172.21.15.79:0/327814178 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa6300be720 con 0x7fa6300904f0 2021-04-09T18:35:33.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa62dffb700 1 -- 172.21.15.79:0/327814178 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa624011a90 con 0x7fa6300904f0 2021-04-09T18:35:33.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa63727d700 1 -- 172.21.15.79:0/327814178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6300d2d20 con 0x7fa6300904f0 2021-04-09T18:35:33.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa62dffb700 1 -- 172.21.15.79:0/327814178 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa62401d440 con 0x7fa6300904f0 2021-04-09T18:35:33.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.386 7fa63727d700 1 -- 172.21.15.79:0/327814178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6301a9490 con 0x7fa6300904f0 2021-04-09T18:35:33.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.390 7fa62dffb700 1 -- 172.21.15.79:0/327814178 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa624026450 con 0x7fa6300904f0 2021-04-09T18:35:33.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.390 7fa62dffb700 1 --2- 172.21.15.79:0/327814178 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa610029100 0x7fa61002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:33.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.390 7fa62dffb700 1 -- 172.21.15.79:0/327814178 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5190+0+0 (secure 0 0 0) 0x7fa62403ac00 con 0x7fa6300904f0 2021-04-09T18:35:33.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.390 7fa634820700 1 --2- 172.21.15.79:0/327814178 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa610029100 0x7fa61002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:33.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.390 7fa634820700 1 --2- 172.21.15.79:0/327814178 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa610029100 0x7fa61002b650 crc :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:33.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.394 7fa63727d700 1 -- 172.21.15.79:0/327814178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6300e39e0 con 0x7fa6300904f0 2021-04-09T18:35:33.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.402 7fa62dffb700 1 -- 172.21.15.79:0/327814178 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa624009690 con 0x7fa6300904f0 2021-04-09T18:35:33.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:33.562 7fa63727d700 1 -- 172.21.15.79:0/327814178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7fa6301a99d0 con 0x7fa6300904f0 2021-04-09T18:35:34.224 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.218 7fa62dffb700 1 -- 172.21.15.79:0/327814178 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v306) v1 ==== 130+0+0 (secure 0 0 0) 0x7fa624011880 con 0x7fa6300904f0 2021-04-09T18:35:34.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.230 7fa63727d700 1 -- 172.21.15.79:0/327814178 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa610029100 msgr2=0x7fa61002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:34.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.230 7fa63727d700 1 --2- 172.21.15.79:0/327814178 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa610029100 0x7fa61002b650 crc :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:34.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.230 7fa63727d700 1 -- 172.21.15.79:0/327814178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6300904f0 msgr2=0x7fa6300d20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:34.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.230 7fa63727d700 1 --2- 172.21.15.79:0/327814178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6300904f0 0x7fa6300d20c0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7fa6300874d0 tx=0x7fa624006890).stop 2021-04-09T18:35:34.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.230 7fa63727d700 1 -- 172.21.15.79:0/327814178 shutdown_connections 2021-04-09T18:35:34.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.230 7fa63727d700 1 --2- 172.21.15.79:0/327814178 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa610029100 0x7fa61002b650 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:34.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.230 7fa63727d700 1 --2- 172.21.15.79:0/327814178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6301a8a10 0x7fa6301a8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:34.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.230 7fa63727d700 1 --2- 172.21.15.79:0/327814178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6300904f0 0x7fa6300d20c0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:34.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.230 7fa63727d700 1 --2- 172.21.15.79:0/327814178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa630090940 0x7fa6300d26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:34.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.230 7fa63727d700 1 -- 172.21.15.79:0/327814178 >> 172.21.15.79:0/327814178 conn(0x7fa6300d48c0 msgr2=0x7fa6300d4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:34.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.230 7fa63727d700 1 -- 172.21.15.79:0/327814178 shutdown_connections 2021-04-09T18:35:34.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.230 7fa63727d700 1 -- 172.21.15.79:0/327814178 wait complete. 2021-04-09T18:35:34.250 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-04-09T18:35:34.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda56ab0700 1 Processor -- start 2021-04-09T18:35:34.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda56ab0700 1 -- start start 2021-04-09T18:35:34.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda56ab0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda500e9b10 0x7fda5009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:34.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda56ab0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda500fbb50 con 0x7fda501c8040 2021-04-09T18:35:34.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda56ab0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda500e5700 con 0x7fda500f5550 2021-04-09T18:35:34.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda56ab0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda501c3df0 con 0x7fda500e9b10 2021-04-09T18:35:34.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda55055700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fda501c8040 0x7fda501ca4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58292/0 (socket says 172.21.15.79:58292) 2021-04-09T18:35:34.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda55055700 1 -- 172.21.15.79:0/4086468280 learned_addr learned my addr 172.21.15.79:0/4086468280 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:34.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda47fff700 1 --2- 172.21.15.79:0/4086468280 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda500e9b10 0x7fda5009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:34.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda477fe700 1 -- 172.21.15.79:0/4086468280 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714285890 0 0) 0x7fda48001450 con 0x7fda501c8040 2021-04-09T18:35:34.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda477fe700 1 -- 172.21.15.79:0/4086468280 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda38003240 con 0x7fda501c8040 2021-04-09T18:35:34.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda477fe700 1 -- 172.21.15.79:0/4086468280 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307445415 0 0) 0x7fda4c0010d0 con 0x7fda500f5550 2021-04-09T18:35:34.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda477fe700 1 -- 172.21.15.79:0/4086468280 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda38004680 con 0x7fda500f5550 2021-04-09T18:35:34.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda47fff700 1 -- 172.21.15.79:0/4086468280 >> v1:172.21.15.89:6789/0 conn(0x7fda500f5550 legacy=0x7fda500f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:34.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda47fff700 1 -- 172.21.15.79:0/4086468280 >> v1:172.21.15.79:6789/0 conn(0x7fda501c8040 legacy=0x7fda501ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:34.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda47fff700 1 -- 172.21.15.79:0/4086468280 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda500e4360 con 0x7fda500e9b10 2021-04-09T18:35:34.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda47fff700 1 --2- 172.21.15.79:0/4086468280 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda500e9b10 0x7fda5009f110 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fda40002f30 tx=0x7fda4000bcf0).ready entity=mon.2 client_cookie=9fc4b7b2d8e0222b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:34.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda477fe700 1 -- 172.21.15.79:0/4086468280 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fda500e4360 con 0x7fda500e9b10 2021-04-09T18:35:34.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda477fe700 1 -- 172.21.15.79:0/4086468280 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda40009920 con 0x7fda500e9b10 2021-04-09T18:35:34.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda477fe700 1 -- 172.21.15.79:0/4086468280 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fda40009cf0 con 0x7fda500e9b10 2021-04-09T18:35:34.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda56ab0700 1 -- 172.21.15.79:0/4086468280 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda500e9b10 msgr2=0x7fda5009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:34.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.354 7fda56ab0700 1 --2- 172.21.15.79:0/4086468280 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda500e9b10 0x7fda5009f110 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fda40002f30 tx=0x7fda4000bcf0).stop 2021-04-09T18:35:34.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.358 7fda56ab0700 1 -- 172.21.15.79:0/4086468280 shutdown_connections 2021-04-09T18:35:34.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.358 7fda56ab0700 1 --2- 172.21.15.79:0/4086468280 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda500e9b10 0x7fda5009f110 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:34.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.358 7fda56ab0700 1 -- 172.21.15.79:0/4086468280 >> 172.21.15.79:0/4086468280 conn(0x7fda500e6010 msgr2=0x7fda500e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:34.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.358 7fda56ab0700 1 -- 172.21.15.79:0/4086468280 shutdown_connections 2021-04-09T18:35:34.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.358 7fda56ab0700 1 -- 172.21.15.79:0/4086468280 wait complete. 2021-04-09T18:35:34.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.362 7fda56ab0700 1 Processor -- start 2021-04-09T18:35:34.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.362 7fda56ab0700 1 -- start start 2021-04-09T18:35:34.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.362 7fda56ab0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda500abe60 0x7fda500d7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:34.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.362 7fda56ab0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda500ac2b0 0x7fda50096e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:34.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.362 7fda56ab0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda500d7a80 0x7fda500974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:34.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.362 7fda56ab0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda500e9f60 con 0x7fda500abe60 2021-04-09T18:35:34.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.362 7fda56ab0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda500a8fc0 con 0x7fda500ac2b0 2021-04-09T18:35:34.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.362 7fda56ab0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda500a92c0 con 0x7fda500d7a80 2021-04-09T18:35:34.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.362 7fda54854700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda500abe60 0x7fda500d7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:34.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.362 7fda54854700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda500abe60 0x7fda500d7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35352/0 (socket says 172.21.15.79:35352) 2021-04-09T18:35:34.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.362 7fda54854700 1 -- 172.21.15.79:0/2752900937 learned_addr learned my addr 172.21.15.79:0/2752900937 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:34.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.362 7fda55055700 1 --2- 172.21.15.79:0/2752900937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda500d7a80 0x7fda500974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:34.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.362 7fda47fff700 1 --2- 172.21.15.79:0/2752900937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda500ac2b0 0x7fda50096e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:34.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.362 7fda54854700 1 -- 172.21.15.79:0/2752900937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda500d7a80 msgr2=0x7fda500974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:34.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.362 7fda54854700 1 --2- 172.21.15.79:0/2752900937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda500d7a80 0x7fda500974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:34.383 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.362 7fda54854700 1 -- 172.21.15.79:0/2752900937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda500ac2b0 msgr2=0x7fda50096e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:34.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.362 7fda54854700 1 --2- 172.21.15.79:0/2752900937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda500ac2b0 0x7fda50096e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:34.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.362 7fda54854700 1 -- 172.21.15.79:0/2752900937 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda50097ae0 con 0x7fda500abe60 2021-04-09T18:35:34.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.362 7fda54854700 1 --2- 172.21.15.79:0/2752900937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda500abe60 0x7fda500d7450 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7fda4c000b80 tx=0x7fda4c00ca80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:34.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.362 7fda457fa700 1 -- 172.21.15.79:0/2752900937 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fda50097ae0 con 0x7fda500abe60 2021-04-09T18:35:34.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.366 7fda457fa700 1 -- 172.21.15.79:0/2752900937 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c010510 con 0x7fda500abe60 2021-04-09T18:35:34.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.366 7fda457fa700 1 -- 172.21.15.79:0/2752900937 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fda4c0106f0 con 0x7fda500abe60 2021-04-09T18:35:34.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.366 7fda56ab0700 1 -- 172.21.15.79:0/2752900937 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda500a8b50 con 0x7fda500abe60 2021-04-09T18:35:34.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.366 7fda56ab0700 1 -- 172.21.15.79:0/2752900937 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda500aba00 con 0x7fda500abe60 2021-04-09T18:35:34.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.366 7fda457fa700 1 -- 172.21.15.79:0/2752900937 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fda4c019020 con 0x7fda500abe60 2021-04-09T18:35:34.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.366 7fda457fa700 1 --2- 172.21.15.79:0/2752900937 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fda30029100 0x7fda3002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:34.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.366 7fda457fa700 1 -- 172.21.15.79:0/2752900937 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5190+0+0 (secure 0 0 0) 0x7fda4c038b30 con 0x7fda500abe60 2021-04-09T18:35:34.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.366 7fda47fff700 1 --2- 172.21.15.79:0/2752900937 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fda30029100 0x7fda3002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:34.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.366 7fda47fff700 1 --2- 172.21.15.79:0/2752900937 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fda30029100 0x7fda3002b650 crc :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:34.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.382 7fda56ab0700 1 -- 172.21.15.79:0/2752900937 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda500e39f0 con 0x7fda500abe60 2021-04-09T18:35:34.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.386 7fda457fa700 1 -- 172.21.15.79:0/2752900937 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fda50107f80 con 0x7fda500abe60 2021-04-09T18:35:34.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.570 7fda56ab0700 1 -- 172.21.15.79:0/2752900937 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fda500a1c90 con 0x7fda500abe60 2021-04-09T18:35:34.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.574 7fda457fa700 1 -- 172.21.15.79:0/2752900937 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fda4c010300 con 0x7fda500abe60 2021-04-09T18:35:34.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.578 7fda56ab0700 1 -- 172.21.15.79:0/2752900937 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fda30029100 msgr2=0x7fda3002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:34.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.578 7fda56ab0700 1 --2- 172.21.15.79:0/2752900937 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fda30029100 0x7fda3002b650 crc :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:34.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.578 7fda56ab0700 1 -- 172.21.15.79:0/2752900937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda500abe60 msgr2=0x7fda500d7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:34.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.578 7fda56ab0700 1 --2- 172.21.15.79:0/2752900937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda500abe60 0x7fda500d7450 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7fda4c000b80 tx=0x7fda4c00ca80).stop 2021-04-09T18:35:34.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.578 7fda56ab0700 1 -- 172.21.15.79:0/2752900937 shutdown_connections 2021-04-09T18:35:34.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.578 7fda56ab0700 1 --2- 172.21.15.79:0/2752900937 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fda30029100 0x7fda3002b650 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:34.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.578 7fda56ab0700 1 --2- 172.21.15.79:0/2752900937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda500d7a80 0x7fda500974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:34.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.578 7fda56ab0700 1 --2- 172.21.15.79:0/2752900937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda500abe60 0x7fda500d7450 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:34.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.578 7fda56ab0700 1 --2- 172.21.15.79:0/2752900937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda500ac2b0 0x7fda50096e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:34.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.578 7fda56ab0700 1 -- 172.21.15.79:0/2752900937 >> 172.21.15.79:0/2752900937 conn(0x7fda500b0220 msgr2=0x7fda5009a930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:34.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.578 7fda56ab0700 1 -- 172.21.15.79:0/2752900937 shutdown_connections 2021-04-09T18:35:34.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.578 7fda56ab0700 1 -- 172.21.15.79:0/2752900937 wait complete. 2021-04-09T18:35:34.601 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:35:34.601 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:34.615 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:34.633 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:34.651 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:34.670 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:34.694 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:35:34.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:34.695 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:34.696 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:34.703 INFO:teuthology.orchestra.run.smithi090.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-04-09T18:35:34.703 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:35:34.704 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-04-09T18:35:34.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:34.705 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:34.706 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:34.720 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-04-09T18:35:34.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:35:34.722 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-04-09T18:35:34.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:34.723 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:34.723 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:35:34.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:35:34.745 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:35:34.746 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:35:34.746 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:35:34.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.838 7f65704c4700 1 Processor -- start 2021-04-09T18:35:34.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.838 7f65704c4700 1 -- start start 2021-04-09T18:35:34.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f65704c4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65680f5520 0x7f65680f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:34.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f65704c4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65680e9ae0 0x7f656809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:34.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f65704c4700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65680fbb20 con 0x7f65681c2db0 2021-04-09T18:35:34.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f65704c4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65680e9f30 con 0x7f65680e9ae0 2021-04-09T18:35:34.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f65704c4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65680e59d0 con 0x7f65680f5520 2021-04-09T18:35:34.854 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f656da67700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65680e9ae0 0x7f656809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:34.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f656da67700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65680e9ae0 0x7f656809f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35364/0 (socket says 172.21.15.79:35364) 2021-04-09T18:35:34.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f656da67700 1 -- 172.21.15.79:0/3896196662 learned_addr learned my addr 172.21.15.79:0/3896196662 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:34.855 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f656ea69700 1 --1- 172.21.15.79:0/3896196662 >> v1:172.21.15.79:6789/0 conn(0x7f65681c2db0 0x7f65681c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58302/0 (socket says 172.21.15.79:58302) 2021-04-09T18:35:34.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f656e268700 1 --2- 172.21.15.79:0/3896196662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65680f5520 0x7f65680f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:34.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f656d266700 1 -- 172.21.15.79:0/3896196662 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234017616 0 0) 0x7f6560001450 con 0x7f65681c2db0 2021-04-09T18:35:34.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f656da67700 1 -- 172.21.15.79:0/3896196662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65680f5520 msgr2=0x7f65680f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:34.856 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f656da67700 1 --2- 172.21.15.79:0/3896196662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65680f5520 0x7f65680f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:34.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f656da67700 1 -- 172.21.15.79:0/3896196662 >> v1:172.21.15.79:6789/0 conn(0x7f65681c2db0 legacy=0x7f65681c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:34.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f656da67700 1 -- 172.21.15.79:0/3896196662 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65680e56d0 con 0x7f65680e9ae0 2021-04-09T18:35:34.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f656da67700 1 --2- 172.21.15.79:0/3896196662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680e9ae0 0x7f656809f110 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f6558002f30 tx=0x7f655800bda0).ready entity=mon.0 client_cookie=c88a89315c43195b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:34.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f656d266700 1 -- 172.21.15.79:0/3896196662 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f65680e56d0 con 0x7f65680e9ae0 2021-04-09T18:35:34.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f656d266700 1 -- 172.21.15.79:0/3896196662 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65580099d0 con 0x7f65680e9ae0 2021-04-09T18:35:34.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f656d266700 1 -- 172.21.15.79:0/3896196662 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6558009da0 con 0x7f65680e9ae0 2021-04-09T18:35:34.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f65704c4700 1 -- 172.21.15.79:0/3896196662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680e9ae0 msgr2=0x7f656809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:34.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f65704c4700 1 --2- 172.21.15.79:0/3896196662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680e9ae0 0x7f656809f110 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f6558002f30 tx=0x7f655800bda0).stop 2021-04-09T18:35:34.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f65704c4700 1 -- 172.21.15.79:0/3896196662 shutdown_connections 2021-04-09T18:35:34.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f65704c4700 1 --2- 172.21.15.79:0/3896196662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65680f5520 0x7f65680f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:34.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f65704c4700 1 --2- 172.21.15.79:0/3896196662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680e9ae0 0x7f656809f110 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:34.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f65704c4700 1 -- 172.21.15.79:0/3896196662 >> 172.21.15.79:0/3896196662 conn(0x7f65680e5fe0 msgr2=0x7f65680e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:34.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f65704c4700 1 -- 172.21.15.79:0/3896196662 shutdown_connections 2021-04-09T18:35:34.859 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.842 7f65704c4700 1 -- 172.21.15.79:0/3896196662 wait complete. 2021-04-09T18:35:34.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.846 7f65704c4700 1 Processor -- start 2021-04-09T18:35:34.860 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.846 7f65704c4700 1 -- start start 2021-04-09T18:35:34.862 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.846 7f65704c4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65680d6310 0x7f65680bae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:34.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.846 7f65704c4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65680bfeb0 0x7f65680d5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:34.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.846 7f65704c4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680d5e30 0x7f65680977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:34.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.846 7f65704c4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65680974f0 con 0x7f65680d5e30 2021-04-09T18:35:34.863 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.846 7f65704c4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65681aea10 con 0x7f65680d6310 2021-04-09T18:35:34.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.846 7f65704c4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65680971b0 con 0x7f65680bfeb0 2021-04-09T18:35:34.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.846 7f656ea69700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680d5e30 0x7f65680977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:34.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.846 7f656ea69700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680d5e30 0x7f65680977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35370/0 (socket says 172.21.15.79:35370) 2021-04-09T18:35:34.864 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.846 7f656ea69700 1 -- 172.21.15.79:0/3895673709 learned_addr learned my addr 172.21.15.79:0/3895673709 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:34.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.846 7f656da67700 1 --2- 172.21.15.79:0/3895673709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65680bfeb0 0x7f65680d5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:34.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.846 7f656e268700 1 --2- 172.21.15.79:0/3895673709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65680d6310 0x7f65680bae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:34.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.846 7f656ea69700 1 -- 172.21.15.79:0/3895673709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65680bfeb0 msgr2=0x7f65680d5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:34.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.846 7f656ea69700 1 --2- 172.21.15.79:0/3895673709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65680bfeb0 0x7f65680d5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:34.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.846 7f656ea69700 1 -- 172.21.15.79:0/3895673709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65680d6310 msgr2=0x7f65680bae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:34.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.846 7f656ea69700 1 --2- 172.21.15.79:0/3895673709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65680d6310 0x7f65680bae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:34.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.846 7f656ea69700 1 -- 172.21.15.79:0/3895673709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65680c3440 con 0x7f65680d5e30 2021-04-09T18:35:34.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.846 7f656e268700 1 --2- 172.21.15.79:0/3895673709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65680d6310 0x7f65680bae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:34.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.850 7f656ea69700 1 --2- 172.21.15.79:0/3895673709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680d5e30 0x7f65680977f0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f65680d55d0 tx=0x7f656000cf10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:34.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.850 7f655effd700 1 -- 172.21.15.79:0/3895673709 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f65680c3440 con 0x7f65680d5e30 2021-04-09T18:35:34.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.850 7f65704c4700 1 -- 172.21.15.79:0/3895673709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65680c0300 con 0x7f65680d5e30 2021-04-09T18:35:34.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.850 7f65704c4700 1 -- 172.21.15.79:0/3895673709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6568098010 con 0x7f65680d5e30 2021-04-09T18:35:34.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.850 7f655effd700 1 -- 172.21.15.79:0/3895673709 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6560005ac0 con 0x7f65680d5e30 2021-04-09T18:35:34.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.850 7f655effd700 1 -- 172.21.15.79:0/3895673709 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6560007110 con 0x7f65680d5e30 2021-04-09T18:35:34.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.850 7f655effd700 1 -- 172.21.15.79:0/3895673709 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f656001a060 con 0x7f65680d5e30 2021-04-09T18:35:34.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.850 7f655effd700 1 --2- 172.21.15.79:0/3895673709 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6550029100 0x7f655002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:34.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.850 7f655effd700 1 -- 172.21.15.79:0/3895673709 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f6560038c80 con 0x7f65680d5e30 2021-04-09T18:35:34.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.850 7f656e268700 1 --2- 172.21.15.79:0/3895673709 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6550029100 0x7f655002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:34.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.850 7f656e268700 1 --2- 172.21.15.79:0/3895673709 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6550029100 0x7f655002b650 crc :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:34.869 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.854 7f65704c4700 1 -- 172.21.15.79:0/3895673709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65680e39e0 con 0x7f65680d5e30 2021-04-09T18:35:34.870 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:34.858 7f655effd700 1 -- 172.21.15.79:0/3895673709 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f65680f76c0 con 0x7f65680d5e30 2021-04-09T18:35:35.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.022 7f65704c4700 1 -- 172.21.15.79:0/3895673709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f65680f5b20 con 0x7f65680d5e30 2021-04-09T18:35:35.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.022 7f655effd700 1 -- 172.21.15.79:0/3895673709 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v129) v1 ==== 81+0+25942 (secure 0 0 0) 0x7f65600058b0 con 0x7f65680d5e30 2021-04-09T18:35:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:35.032 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:35:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 129, 2021-04-09T18:35:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:35:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:35:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:35:32.205826", 2021-04-09T18:35:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:35:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:35:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:35:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:35:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:35:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:35:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:35:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:35:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:35:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:35:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:35:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:35:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:35:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:35:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:35:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 25, 2021-04-09T18:35:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:35:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:35:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:35:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:35:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:35:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:35:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:35:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:35:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:35:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:35:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:35:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:35:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:35:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:35:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:35:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:35:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:35:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:35:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:35:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:35:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:35:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:35:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:35:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:35:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:35:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:35:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:35:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:35:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:35:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:35:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:35:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:35:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:35:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:35:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:35:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:35:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:35:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:35:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:35:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:35:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:35:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:35:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:35:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:35:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:35:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:35:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:35:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:35:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:35:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:35:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:35:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:35:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:35:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:35:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:35:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:35:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:35:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:35:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:35:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:35:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:35:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:35:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:35:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:35:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:35:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:35:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:35:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:35:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:35:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:35:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:35:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:35:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:35:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 124, 2021-04-09T18:35:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:35:35.064 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:35.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.064 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.064 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:35:35.065 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:35.065 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.065 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.065 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:35.066 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.066 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.066 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:35:35.067 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:35.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.067 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.067 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:35:35.068 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:35.068 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.068 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.069 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:35.069 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.069 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.069 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:35:35.070 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:35.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.070 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.070 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:35:35.071 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:35.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.071 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.072 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:35.072 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.072 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.072 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:35:35.073 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:35.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.073 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.074 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:35:35.074 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:35.074 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.074 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.075 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:35:35.075 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:35:35.075 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:35:35.075 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:35:35.076 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:35.076 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:35.076 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:35.076 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.077 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:35:35.077 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:35:35.077 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:35.078 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:35.078 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:35.078 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:35.078 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:35.078 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:35.079 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:35.079 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 123, 2021-04-09T18:35:35.079 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:35.079 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:35.080 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:35.080 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.080 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.081 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:35:35.081 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:35.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.082 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.082 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:35:35.082 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:35.083 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.083 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.083 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:35.083 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.084 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.084 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:35:35.084 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:35.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.085 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.085 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:35:35.085 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:35.086 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.086 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.086 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:35.086 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.087 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.087 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:35:35.087 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:35.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.088 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.088 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:35:35.088 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:35.089 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.089 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.089 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:35.089 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.090 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.090 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:35:35.090 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:35.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.091 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.091 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:35:35.091 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:35.092 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.092 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.092 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:35:35.092 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:35:35.093 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:35:35.093 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:35:35.093 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:35.093 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:35.093 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:35.094 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.094 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:35:35.095 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:35:35.095 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:35.095 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:35.095 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:35.096 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:35.096 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:35.096 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:35.097 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:35.097 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 124, 2021-04-09T18:35:35.097 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:35.097 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:35.097 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:35.098 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.098 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.098 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:35:35.098 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:35.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.099 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.099 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:35:35.100 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:35.100 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.100 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.100 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:35.101 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.101 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.101 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:35:35.101 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:35.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.102 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.102 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:35:35.103 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:35.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.103 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.103 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:35.104 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.104 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.104 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:35:35.104 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:35.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.105 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.105 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:35:35.105 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:35.106 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.106 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.106 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:35.107 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.107 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.107 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:35:35.107 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:35.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.108 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.108 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:35:35.108 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:35.109 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.109 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.109 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:35:35.109 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:35:35.110 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:35:35.110 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:35:35.110 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:35.110 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:35.111 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:35.111 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.111 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:35:35.112 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:35:35.112 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:35.112 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:35.112 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:35.112 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:35.113 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:35.113 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:35.113 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:35.113 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 124, 2021-04-09T18:35:35.113 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:35.114 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:35.114 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:35.114 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.115 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.115 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:35:35.115 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:35.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.116 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.116 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:35:35.116 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:35.116 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.116 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.117 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:35.117 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.117 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.118 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:35:35.118 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:35.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.118 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.119 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:35:35.119 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:35.119 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.119 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.120 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:35.120 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.120 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.121 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:35:35.121 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:35.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.121 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.122 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:35:35.122 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:35.122 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.122 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.123 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:35.123 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.123 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.124 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:35:35.124 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:35.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.124 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.125 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:35:35.125 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:35.125 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.125 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.126 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:35:35.126 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:35:35.126 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:35:35.127 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:35:35.127 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:35.127 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:35.127 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:35.127 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.128 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:35:35.128 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:35:35.128 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:35.129 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:35.129 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:35.129 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:35.129 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:35.129 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:35.130 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:35.130 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 117, 2021-04-09T18:35:35.130 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:35.130 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:35.131 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:35.131 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.132 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.132 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:35:35.132 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:35.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.133 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:35:35.133 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:35.134 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.134 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.134 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:35.135 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.135 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.135 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:35:35.135 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:35.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.136 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.136 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:35:35.136 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:35.137 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.137 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.137 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:35.137 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.138 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.138 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:35:35.138 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:35.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.139 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.139 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:35:35.139 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:35.140 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.140 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.140 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:35.140 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.141 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.141 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:35:35.141 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:35.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.142 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.142 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:35:35.142 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:35.142 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.143 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.143 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:35:35.143 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:35:35.143 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:35:35.144 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:35:35.144 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:35.144 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:35.144 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:35.145 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.145 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:35:35.145 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:35:35.146 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:35.146 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:35.146 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:35.146 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:35.146 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:35.147 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:35.147 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:35.147 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 123, 2021-04-09T18:35:35.147 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:35.147 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:35.148 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:35.148 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.148 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.149 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:35:35.149 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:35.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.149 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.150 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:35:35.150 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:35.150 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.150 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.151 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:35.151 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.151 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.151 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:35:35.152 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:35.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.152 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.152 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:35:35.153 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:35.153 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.153 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.153 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:35.154 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.154 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.154 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:35:35.154 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:35.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.155 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.155 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:35:35.156 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:35.156 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.156 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.156 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:35.157 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.157 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.157 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:35:35.157 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:35.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.158 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.158 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:35:35.158 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:35.159 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.159 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.159 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:35:35.159 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:35:35.160 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:35:35.160 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:35:35.160 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:35.160 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:35.161 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:35.161 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.161 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:35:35.162 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:35:35.162 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:35.162 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:35.162 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:35.162 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:35.163 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:35.163 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:35.163 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:35.163 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 124, 2021-04-09T18:35:35.163 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:35.164 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:35.164 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:35.164 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.164 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.165 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:35:35.165 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:35.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.165 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.166 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:35:35.166 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:35.166 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.166 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.167 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:35.167 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.167 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.168 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:35:35.168 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:35.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.168 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.169 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:35:35.169 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:35.169 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.169 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.170 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:35.170 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.170 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.170 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:35:35.171 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:35.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.171 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.171 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:35:35.172 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:35.172 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.172 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.172 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:35.173 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.173 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.173 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:35:35.173 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:35.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.174 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.174 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:35:35.174 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:35.175 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.175 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.175 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:35:35.175 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:35:35.176 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:35:35.176 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:35:35.176 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:35.176 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:35.177 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:35.177 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.177 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:35:35.178 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:35:35.178 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:35.178 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:35.178 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:35.178 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:35.179 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:35.179 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:35.179 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:35.179 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 124, 2021-04-09T18:35:35.179 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:35.180 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:35.180 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:35.180 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.180 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.181 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:35:35.181 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:35.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.181 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.182 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:35:35.182 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:35.182 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.182 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.183 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:35.183 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.183 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.183 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:35:35.184 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:35.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.184 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.184 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:35:35.185 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:35.185 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.185 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.185 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:35.186 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.186 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.186 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:35:35.186 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:35.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.187 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.187 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:35:35.188 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:35.188 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.188 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.188 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:35.189 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:35.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.189 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:35.189 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:35:35.189 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:35.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.190 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:35.190 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:35:35.190 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:35.191 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.191 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.191 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:35:35.191 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:35:35.192 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:35:35.192 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:35:35.192 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:35.192 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:35.192 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:35.193 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:35.193 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.193 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:35:35.193 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:35:35.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.194 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:35:35.194 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:35.194 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:35.194 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:35.194 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:35.195 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:35.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.195 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:35:35.196 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:35.196 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:35.196 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:35.196 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:35.196 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:35.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.197 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:35:35.197 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:35.197 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:35.198 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:35.198 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:35.198 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:35.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.199 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:35:35.199 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:35.199 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:35.199 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:35.199 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:35.200 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:35.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.200 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:35:35.200 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:35.201 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:35.201 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:35.201 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:35.201 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:35.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.202 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:35:35.202 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:35.202 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:35.202 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:35.203 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:35.203 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:35.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.203 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:35:35.204 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:35.204 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:35.204 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:35.204 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:35.204 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:35.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:35.205 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:35:35.205 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:35.205 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:35.206 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:35.206 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:35.206 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:35.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.206 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:35:35.207 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:35:35.207 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:35:35.207 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:35:35.207 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:35:35.208 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": { 2021-04-09T18:35:35.208 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.79:6833/4102869700": "2021-04-10 18:35:28.479141", 2021-04-09T18:35:35.208 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.79:6832/4102869700": "2021-04-10 18:35:28.479141" 2021-04-09T18:35:35.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.208 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:35:35.209 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:35:35.209 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:35:35.209 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:35:35.209 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:35:35.209 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:35:35.210 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:35:35.210 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:35:35.210 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:35:35.210 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:35:35.210 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:35:35.211 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:35:35.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.211 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:35:35.211 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:35:35.211 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:35:35.212 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:35:35.212 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:35:35.212 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:35:35.212 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:35:35.212 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:35.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:35.213 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:35:35.213 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:35:35.213 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:35:35.214 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:35:35.214 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:35:35.214 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:35:35.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.026 7f65704c4700 1 -- 172.21.15.79:0/3895673709 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6550029100 msgr2=0x7f655002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:35.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.026 7f65704c4700 1 --2- 172.21.15.79:0/3895673709 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6550029100 0x7f655002b650 crc :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.026 7f65704c4700 1 -- 172.21.15.79:0/3895673709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680d5e30 msgr2=0x7f65680977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:35.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.026 7f65704c4700 1 --2- 172.21.15.79:0/3895673709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680d5e30 0x7f65680977f0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f65680d55d0 tx=0x7f656000cf10).stop 2021-04-09T18:35:35.216 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.026 7f65704c4700 1 -- 172.21.15.79:0/3895673709 shutdown_connections 2021-04-09T18:35:35.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.026 7f65704c4700 1 --2- 172.21.15.79:0/3895673709 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6550029100 0x7f655002b650 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.026 7f65704c4700 1 --2- 172.21.15.79:0/3895673709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65680d6310 0x7f65680bae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.026 7f65704c4700 1 --2- 172.21.15.79:0/3895673709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680d5e30 0x7f65680977f0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.217 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.026 7f65704c4700 1 --2- 172.21.15.79:0/3895673709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65680bfeb0 0x7f65680d5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.026 7f65704c4700 1 -- 172.21.15.79:0/3895673709 >> 172.21.15.79:0/3895673709 conn(0x7f65681a11d0 msgr2=0x7f6568095520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:35.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.026 7f65704c4700 1 -- 172.21.15.79:0/3895673709 shutdown_connections 2021-04-09T18:35:35.218 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.026 7f65704c4700 1 -- 172.21.15.79:0/3895673709 wait complete. 2021-04-09T18:35:35.219 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:35:35.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.310 7f103031f700 1 Processor -- start 2021-04-09T18:35:35.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.310 7f103031f700 1 -- start start 2021-04-09T18:35:35.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f103031f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f10280e9ae0 0x7f102809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:35.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f103031f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10281c8010 0x7f10281ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:35.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f103031f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10280fbb20 con 0x7f10280f5520 2021-04-09T18:35:35.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f103031f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10281c3dc0 con 0x7f10280e9ae0 2021-04-09T18:35:35.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f103031f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10280e9f30 con 0x7f10281c8010 2021-04-09T18:35:35.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f102e8c4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10281c8010 0x7f10281ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:35.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f102d8c2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f10280e9ae0 0x7f102809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:35.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f102e8c4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10281c8010 0x7f10281ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:60606/0 (socket says 172.21.15.79:60606) 2021-04-09T18:35:35.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f102e0c3700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f10280f5520 0x7f10280f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:58786/0 (socket says 172.21.15.79:58786) 2021-04-09T18:35:35.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f102d8c2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f10280e9ae0 0x7f102809f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:51950/0 (socket says 172.21.15.79:51950) 2021-04-09T18:35:35.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f102e8c4700 1 -- 172.21.15.79:0/2895600461 learned_addr learned my addr 172.21.15.79:0/2895600461 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:35.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f102d8c2700 1 -- 172.21.15.79:0/2895600461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10281c8010 msgr2=0x7f10281ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:35.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f102d8c2700 1 --2- 172.21.15.79:0/2895600461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10281c8010 0x7f10281ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.329 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f102d8c2700 1 -- 172.21.15.79:0/2895600461 >> v1:172.21.15.89:6789/0 conn(0x7f10280f5520 legacy=0x7f10280f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:35.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f102d0c1700 1 -- 172.21.15.79:0/2895600461 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403701282 0 0) 0x7f10240010d0 con 0x7f10280f5520 2021-04-09T18:35:35.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f102d8c2700 1 -- 172.21.15.79:0/2895600461 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10280e56d0 con 0x7f10280e9ae0 2021-04-09T18:35:35.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f102d8c2700 1 --2- 172.21.15.79:0/2895600461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10280e9ae0 0x7f102809f110 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f10280f6f00 tx=0x7f101800bd70).ready entity=mon.1 client_cookie=e4fb286eb64df874 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:35.330 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f102d0c1700 1 -- 172.21.15.79:0/2895600461 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f10280e56d0 con 0x7f10280e9ae0 2021-04-09T18:35:35.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f102d0c1700 1 -- 172.21.15.79:0/2895600461 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1018009810 con 0x7f10280e9ae0 2021-04-09T18:35:35.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f102d0c1700 1 -- 172.21.15.79:0/2895600461 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1018009be0 con 0x7f10280e9ae0 2021-04-09T18:35:35.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f103031f700 1 -- 172.21.15.79:0/2895600461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10280e9ae0 msgr2=0x7f102809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:35.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.314 7f103031f700 1 --2- 172.21.15.79:0/2895600461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10280e9ae0 0x7f102809f110 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f10280f6f00 tx=0x7f101800bd70).stop 2021-04-09T18:35:35.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.318 7f103031f700 1 -- 172.21.15.79:0/2895600461 shutdown_connections 2021-04-09T18:35:35.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.318 7f103031f700 1 --2- 172.21.15.79:0/2895600461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10281c8010 0x7f10281ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.318 7f103031f700 1 --2- 172.21.15.79:0/2895600461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10280e9ae0 0x7f102809f110 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.318 7f103031f700 1 -- 172.21.15.79:0/2895600461 >> 172.21.15.79:0/2895600461 conn(0x7f10280e5fe0 msgr2=0x7f10280e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:35.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.318 7f103031f700 1 -- 172.21.15.79:0/2895600461 shutdown_connections 2021-04-09T18:35:35.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.318 7f103031f700 1 -- 172.21.15.79:0/2895600461 wait complete. 2021-04-09T18:35:35.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f103031f700 1 Processor -- start 2021-04-09T18:35:35.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f103031f700 1 -- start start 2021-04-09T18:35:35.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f103031f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1028095430 0x7f10280a7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:35.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f103031f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10280bc140 0x7f10280cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:35.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f103031f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10280bc590 0x7f10280d0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:35.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f103031f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10280a8b20 con 0x7f1028095430 2021-04-09T18:35:35.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f103031f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10280a9120 con 0x7f10280bc140 2021-04-09T18:35:35.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f103031f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10280a8e20 con 0x7f10280bc590 2021-04-09T18:35:35.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f102e0c3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1028095430 0x7f10280a7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:35.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f102e0c3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1028095430 0x7f10280a7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35380/0 (socket says 172.21.15.79:35380) 2021-04-09T18:35:35.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f102e0c3700 1 -- 172.21.15.79:0/4231258334 learned_addr learned my addr 172.21.15.79:0/4231258334 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:35.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f102d8c2700 1 --2- 172.21.15.79:0/4231258334 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10280bc140 0x7f10280cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:35.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f102e8c4700 1 --2- 172.21.15.79:0/4231258334 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10280bc590 0x7f10280d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:35.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f102e0c3700 1 -- 172.21.15.79:0/4231258334 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10280bc590 msgr2=0x7f10280d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:35.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f102e0c3700 1 --2- 172.21.15.79:0/4231258334 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10280bc590 0x7f10280d0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f102e0c3700 1 -- 172.21.15.79:0/4231258334 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10280bc140 msgr2=0x7f10280cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:35.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f102e0c3700 1 --2- 172.21.15.79:0/4231258334 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10280bc140 0x7f10280cfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f102e0c3700 1 -- 172.21.15.79:0/4231258334 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10280b9f20 con 0x7f1028095430 2021-04-09T18:35:35.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f102e8c4700 1 --2- 172.21.15.79:0/4231258334 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10280bc590 0x7f10280d0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:35.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f102e0c3700 1 --2- 172.21.15.79:0/4231258334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1028095430 0x7f10280a7ba0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f10280ba500 tx=0x7f102400cb30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:35.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f101effd700 1 -- 172.21.15.79:0/4231258334 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f10280b9f20 con 0x7f1028095430 2021-04-09T18:35:35.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f103031f700 1 -- 172.21.15.79:0/4231258334 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1028094a40 con 0x7f1028095430 2021-04-09T18:35:35.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f101effd700 1 -- 172.21.15.79:0/4231258334 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1024007320 con 0x7f1028095430 2021-04-09T18:35:35.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f101effd700 1 -- 172.21.15.79:0/4231258334 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1024005720 con 0x7f1028095430 2021-04-09T18:35:35.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.322 7f103031f700 1 -- 172.21.15.79:0/4231258334 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10280d0a50 con 0x7f1028095430 2021-04-09T18:35:35.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.326 7f101effd700 1 -- 172.21.15.79:0/4231258334 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f102401a020 con 0x7f1028095430 2021-04-09T18:35:35.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.326 7f101effd700 1 --2- 172.21.15.79:0/4231258334 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1010029100 0x7f101002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:35.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.326 7f101effd700 1 -- 172.21.15.79:0/4231258334 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f1024038f10 con 0x7f1028095430 2021-04-09T18:35:35.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.326 7f102d8c2700 1 --2- 172.21.15.79:0/4231258334 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1010029100 0x7f101002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:35.345 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.326 7f102d8c2700 1 --2- 172.21.15.79:0/4231258334 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1010029100 0x7f101002b650 crc :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:35.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.342 7f103031f700 1 -- 172.21.15.79:0/4231258334 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10280e39e0 con 0x7f1028095430 2021-04-09T18:35:35.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.346 7f101effd700 1 -- 172.21.15.79:0/4231258334 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1024000bf0 con 0x7f1028095430 2021-04-09T18:35:35.520 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.514 7f103031f700 1 -- 172.21.15.79:0/4231258334 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10280a1cc0 con 0x7f1028095430 2021-04-09T18:35:35.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.514 7f101effd700 1 -- 172.21.15.79:0/4231258334 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+1174 (secure 0 0 0) 0x7f1024007110 con 0x7f1028095430 2021-04-09T18:35:35.528 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:35.528 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":82,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7842,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1552365531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1552365531},{"type":"v1","addr":"172.21.15.89:6835","nonce":1552365531}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":77},{"gid":8091,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/705034154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":705034154},{"type":"v1","addr":"172.21.15.79:6833","nonce":705034154}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":82}],"filesystems":[]} 2021-04-09T18:35:35.530 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 82 2021-04-09T18:35:35.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.518 7f103031f700 1 -- 172.21.15.79:0/4231258334 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1010029100 msgr2=0x7f101002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:35.530 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.518 7f103031f700 1 --2- 172.21.15.79:0/4231258334 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1010029100 0x7f101002b650 crc :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.518 7f103031f700 1 -- 172.21.15.79:0/4231258334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1028095430 msgr2=0x7f10280a7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.518 7f103031f700 1 --2- 172.21.15.79:0/4231258334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1028095430 0x7f10280a7ba0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f10280ba500 tx=0x7f102400cb30).stop 2021-04-09T18:35:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.518 7f103031f700 1 -- 172.21.15.79:0/4231258334 shutdown_connections 2021-04-09T18:35:35.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.518 7f103031f700 1 --2- 172.21.15.79:0/4231258334 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f1010029100 0x7f101002b650 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.518 7f103031f700 1 --2- 172.21.15.79:0/4231258334 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10280bc590 0x7f10280d0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.518 7f103031f700 1 --2- 172.21.15.79:0/4231258334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1028095430 0x7f10280a7ba0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.518 7f103031f700 1 --2- 172.21.15.79:0/4231258334 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10280bc140 0x7f10280cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.518 7f103031f700 1 -- 172.21.15.79:0/4231258334 >> 172.21.15.79:0/4231258334 conn(0x7f102809b240 msgr2=0x7f10280bcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:35.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.518 7f103031f700 1 -- 172.21.15.79:0/4231258334 shutdown_connections 2021-04-09T18:35:35.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.518 7f103031f700 1 -- 172.21.15.79:0/4231258334 wait complete. 2021-04-09T18:35:35.534 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:35:35.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.618 7fef5a11a700 1 Processor -- start 2021-04-09T18:35:35.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.618 7fef5a11a700 1 -- start start 2021-04-09T18:35:35.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.618 7fef5a11a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef540f5510 0x7fef540f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:35.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.618 7fef5a11a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fef540e9ad0 0x7fef5409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:35.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.618 7fef5a11a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fef541c2da0 0x7fef541c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:35.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.618 7fef5a11a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef540e9f20 con 0x7fef541c2da0 2021-04-09T18:35:35.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.618 7fef5a11a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef540e59c0 con 0x7fef540e9ad0 2021-04-09T18:35:35.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.618 7fef5a11a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef540fbb10 con 0x7fef540f5510 2021-04-09T18:35:35.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.618 7fef53fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fef541c2da0 0x7fef541c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:35.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.618 7fef53fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fef541c2da0 0x7fef541c31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35392/0 (socket says 172.21.15.79:35392) 2021-04-09T18:35:35.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.618 7fef53fff700 1 -- 172.21.15.79:0/2027319208 learned_addr learned my addr 172.21.15.79:0/2027319208 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:35.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.618 7fef537fe700 1 --2- 172.21.15.79:0/2027319208 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef540f5510 0x7fef540f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:35.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.618 7fef52ffd700 1 --2- 172.21.15.79:0/2027319208 >> v2:172.21.15.89:3300/0 conn(0x7fef540e9ad0 0x7fef5409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:35.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.622 7fef53fff700 1 -- 172.21.15.79:0/2027319208 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef540f5510 msgr2=0x7fef540f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:35.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.622 7fef53fff700 1 --2- 172.21.15.79:0/2027319208 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef540f5510 0x7fef540f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.622 7fef53fff700 1 -- 172.21.15.79:0/2027319208 >> v2:172.21.15.89:3300/0 conn(0x7fef540e9ad0 msgr2=0x7fef5409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:35.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.622 7fef53fff700 1 --2- 172.21.15.79:0/2027319208 >> v2:172.21.15.89:3300/0 conn(0x7fef540e9ad0 0x7fef5409f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.622 7fef53fff700 1 -- 172.21.15.79:0/2027319208 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef540e56c0 con 0x7fef541c2da0 2021-04-09T18:35:35.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.622 7fef52ffd700 1 --2- 172.21.15.79:0/2027319208 >> v2:172.21.15.89:3300/0 conn(0x7fef540e9ad0 0x7fef5409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:35.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.622 7fef53fff700 1 --2- 172.21.15.79:0/2027319208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef541c2da0 0x7fef541c31f0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7fef4c0032b0 tx=0x7fef4c00b3c0).ready entity=mon.0 client_cookie=36eb7dce6173c4d3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:35.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.622 7fef527fc700 1 -- 172.21.15.79:0/2027319208 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef540e56c0 con 0x7fef541c2da0 2021-04-09T18:35:35.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.622 7fef527fc700 1 -- 172.21.15.79:0/2027319208 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c00bc20 con 0x7fef541c2da0 2021-04-09T18:35:35.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.622 7fef527fc700 1 -- 172.21.15.79:0/2027319208 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef4c002020 con 0x7fef541c2da0 2021-04-09T18:35:35.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.622 7fef5a11a700 1 -- 172.21.15.79:0/2027319208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef541c2da0 msgr2=0x7fef541c31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:35.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.622 7fef5a11a700 1 --2- 172.21.15.79:0/2027319208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef541c2da0 0x7fef541c31f0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7fef4c0032b0 tx=0x7fef4c00b3c0).stop 2021-04-09T18:35:35.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.622 7fef5a11a700 1 -- 172.21.15.79:0/2027319208 shutdown_connections 2021-04-09T18:35:35.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.622 7fef5a11a700 1 --2- 172.21.15.79:0/2027319208 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef540f5510 0x7fef540f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.622 7fef5a11a700 1 --2- 172.21.15.79:0/2027319208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef541c2da0 0x7fef541c31f0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.622 7fef5a11a700 1 --2- 172.21.15.79:0/2027319208 >> v2:172.21.15.89:3300/0 conn(0x7fef540e9ad0 0x7fef5409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.622 7fef5a11a700 1 -- 172.21.15.79:0/2027319208 >> 172.21.15.79:0/2027319208 conn(0x7fef540e5fd0 msgr2=0x7fef540e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:35.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.622 7fef5a11a700 1 -- 172.21.15.79:0/2027319208 shutdown_connections 2021-04-09T18:35:35.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.622 7fef5a11a700 1 -- 172.21.15.79:0/2027319208 wait complete. 2021-04-09T18:35:35.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef5a11a700 1 Processor -- start 2021-04-09T18:35:35.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef5a11a700 1 -- start start 2021-04-09T18:35:35.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef5a11a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef540aa600 0x7fef540d53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:35.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef5a11a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef54091940 0x7fef54094e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:35.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef5a11a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef541a6d50 0x7fef541a71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:35.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef5a11a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef54091640 con 0x7fef541a6d50 2021-04-09T18:35:35.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef5a11a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef54095a10 con 0x7fef540aa600 2021-04-09T18:35:35.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef5a11a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef541a77d0 con 0x7fef54091940 2021-04-09T18:35:35.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef53fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef541a6d50 0x7fef541a71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:35.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef53fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef541a6d50 0x7fef541a71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35398/0 (socket says 172.21.15.79:35398) 2021-04-09T18:35:35.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef53fff700 1 -- 172.21.15.79:0/2296553841 learned_addr learned my addr 172.21.15.79:0/2296553841 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:35.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef52ffd700 1 --2- 172.21.15.79:0/2296553841 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef54091940 0x7fef54094e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:35.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef537fe700 1 --2- 172.21.15.79:0/2296553841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef540aa600 0x7fef540d53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:35.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef53fff700 1 -- 172.21.15.79:0/2296553841 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef54091940 msgr2=0x7fef54094e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:35.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef53fff700 1 --2- 172.21.15.79:0/2296553841 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef54091940 0x7fef54094e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef53fff700 1 -- 172.21.15.79:0/2296553841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef540aa600 msgr2=0x7fef540d53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef53fff700 1 --2- 172.21.15.79:0/2296553841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef540aa600 0x7fef540d53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef53fff700 1 -- 172.21.15.79:0/2296553841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef54095f20 con 0x7fef541a6d50 2021-04-09T18:35:35.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef53fff700 1 --2- 172.21.15.79:0/2296553841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef541a6d50 0x7fef541a71a0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7fef540915c0 tx=0x7fef4c006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:35.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef4bfff700 1 -- 172.21.15.79:0/2296553841 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef54095f20 con 0x7fef541a6d50 2021-04-09T18:35:35.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef4bfff700 1 -- 172.21.15.79:0/2296553841 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c01b670 con 0x7fef541a6d50 2021-04-09T18:35:35.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef5a11a700 1 -- 172.21.15.79:0/2296553841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef540911f0 con 0x7fef541a6d50 2021-04-09T18:35:35.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef4bfff700 1 -- 172.21.15.79:0/2296553841 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef4c01ba40 con 0x7fef541a6d50 2021-04-09T18:35:35.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.626 7fef5a11a700 1 -- 172.21.15.79:0/2296553841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef54091d90 con 0x7fef541a6d50 2021-04-09T18:35:35.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.630 7fef4bfff700 1 -- 172.21.15.79:0/2296553841 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fef4c019040 con 0x7fef541a6d50 2021-04-09T18:35:35.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.630 7fef4bfff700 1 --2- 172.21.15.79:0/2296553841 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fef38029100 0x7fef3802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:35.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.630 7fef4bfff700 1 -- 172.21.15.79:0/2296553841 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5190+0+0 (secure 0 0 0) 0x7fef4c018040 con 0x7fef541a6d50 2021-04-09T18:35:35.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.630 7fef537fe700 1 --2- 172.21.15.79:0/2296553841 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fef38029100 0x7fef3802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:35.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.630 7fef537fe700 1 --2- 172.21.15.79:0/2296553841 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fef38029100 0x7fef3802b650 crc :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:35.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.634 7fef5a11a700 1 -- 172.21.15.79:0/2296553841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef540e39d0 con 0x7fef541a6d50 2021-04-09T18:35:35.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.642 7fef4bfff700 1 -- 172.21.15.79:0/2296553841 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fef4c00ba10 con 0x7fef541a6d50 2021-04-09T18:35:35.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.814 7fef5a11a700 1 -- 172.21.15.79:0/2296553841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef540f5b10 con 0x7fef541a6d50 2021-04-09T18:35:35.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.814 7fef4bfff700 1 -- 172.21.15.79:0/2296553841 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+1174 (secure 0 0 0) 0x7fef4c01b460 con 0x7fef541a6d50 2021-04-09T18:35:35.822 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 82 2021-04-09T18:35:35.823 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:35.823 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":82,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7842,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6835/1552365531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1552365531},{"type":"v1","addr":"172.21.15.89:6835","nonce":1552365531}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":77},{"gid":8091,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/705034154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":705034154},{"type":"v1","addr":"172.21.15.79:6833","nonce":705034154}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":82}],"filesystems":[]} 2021-04-09T18:35:35.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.818 7fef5a11a700 1 -- 172.21.15.79:0/2296553841 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fef38029100 msgr2=0x7fef3802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:35.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.818 7fef5a11a700 1 --2- 172.21.15.79:0/2296553841 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fef38029100 0x7fef3802b650 crc :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.818 7fef5a11a700 1 -- 172.21.15.79:0/2296553841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef541a6d50 msgr2=0x7fef541a71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:35.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.818 7fef5a11a700 1 --2- 172.21.15.79:0/2296553841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef541a6d50 0x7fef541a71a0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7fef540915c0 tx=0x7fef4c006c10).stop 2021-04-09T18:35:35.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.818 7fef5a11a700 1 -- 172.21.15.79:0/2296553841 shutdown_connections 2021-04-09T18:35:35.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.818 7fef5a11a700 1 --2- 172.21.15.79:0/2296553841 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fef38029100 0x7fef3802b650 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.827 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.818 7fef5a11a700 1 --2- 172.21.15.79:0/2296553841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef540aa600 0x7fef540d53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.818 7fef5a11a700 1 --2- 172.21.15.79:0/2296553841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef541a6d50 0x7fef541a71a0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.818 7fef5a11a700 1 --2- 172.21.15.79:0/2296553841 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef54091940 0x7fef54094e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:35.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.818 7fef5a11a700 1 -- 172.21.15.79:0/2296553841 >> 172.21.15.79:0/2296553841 conn(0x7fef54092a70 msgr2=0x7fef54093d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:35.828 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.818 7fef5a11a700 1 -- 172.21.15.79:0/2296553841 shutdown_connections 2021-04-09T18:35:35.829 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.818 7fef5a11a700 1 -- 172.21.15.79:0/2296553841 wait complete. 2021-04-09T18:35:35.833 INFO:tasks.ceph.mds.a:Restarting daemon 2021-04-09T18:35:35.833 INFO:tasks.ceph.mds.a:Stopping old one... 2021-04-09T18:35:35.834 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-04-09T18:35:35.834 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:35:35.834 INFO:tasks.ceph.mds.b:Restarting daemon 2021-04-09T18:35:35.835 INFO:tasks.ceph.mds.b:Stopping old one... 2021-04-09T18:35:35.835 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-04-09T18:35:35.836 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:35:35.848 INFO:tasks.ceph.mds.a:Stopped 2021-04-09T18:35:35.849 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-04-09T18:35:35.852 INFO:tasks.ceph.mds.b:Stopped 2021-04-09T18:35:35.852 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-04-09T18:35:35.892 INFO:tasks.ceph.mds.a:Started 2021-04-09T18:35:35.892 DEBUG:teuthology.parallel:result is None 2021-04-09T18:35:35.896 INFO:tasks.ceph.mds.b:Started 2021-04-09T18:35:35.896 DEBUG:teuthology.parallel:result is None 2021-04-09T18:35:35.896 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-04-09T18:35:35.973 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2021-04-09T18:35:35.981 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2021-04-09T18:35:36.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.990 7f6e3e948700 1 Processor -- start 2021-04-09T18:35:36.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.990 7f6e3e948700 1 -- start start 2021-04-09T18:35:36.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e3e948700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e380f5520 0x7f6e380f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:36.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e3e948700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6e380e9ae0 0x7f6e3809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:36.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e3e948700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e380fbb20 con 0x7f6e381c2db0 2021-04-09T18:35:36.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e3e948700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e380e9f30 con 0x7f6e380e9ae0 2021-04-09T18:35:36.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e3e948700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e380e59d0 con 0x7f6e380f5520 2021-04-09T18:35:36.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e3ceed700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6e381c2db0 0x7f6e381c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58360/0 (socket says 172.21.15.79:58360) 2021-04-09T18:35:36.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e3ceed700 1 -- 172.21.15.79:0/2225176133 learned_addr learned my addr 172.21.15.79:0/2225176133 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:36.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e37fff700 1 --2- 172.21.15.79:0/2225176133 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e380f5520 0x7f6e380f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:36.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e377fe700 1 --2- 172.21.15.79:0/2225176133 >> v2:172.21.15.89:3300/0 conn(0x7f6e380e9ae0 0x7f6e3809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:36.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e36ffd700 1 -- 172.21.15.79:0/2225176133 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794647193 0 0) 0x7f6e300010d0 con 0x7f6e381c2db0 2021-04-09T18:35:36.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e36ffd700 1 -- 172.21.15.79:0/2225176133 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e24003240 con 0x7f6e381c2db0 2021-04-09T18:35:36.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e37fff700 1 -- 172.21.15.79:0/2225176133 >> v2:172.21.15.89:3300/0 conn(0x7f6e380e9ae0 msgr2=0x7f6e3809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:36.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e37fff700 1 --2- 172.21.15.79:0/2225176133 >> v2:172.21.15.89:3300/0 conn(0x7f6e380e9ae0 0x7f6e3809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e37fff700 1 -- 172.21.15.79:0/2225176133 >> v1:172.21.15.79:6789/0 conn(0x7f6e381c2db0 legacy=0x7f6e381c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:36.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e37fff700 1 -- 172.21.15.79:0/2225176133 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e380e56d0 con 0x7f6e380f5520 2021-04-09T18:35:36.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e377fe700 1 --2- 172.21.15.79:0/2225176133 >> v2:172.21.15.89:3300/0 conn(0x7f6e380e9ae0 0x7f6e3809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:36.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e37fff700 1 --2- 172.21.15.79:0/2225176133 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e380f5520 0x7f6e380f64b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f6e200032b0 tx=0x7f6e2000b0e0).ready entity=mon.2 client_cookie=626970e0e73f2f95 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:36.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e36ffd700 1 -- 172.21.15.79:0/2225176133 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6e380e56d0 con 0x7f6e380f5520 2021-04-09T18:35:36.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e36ffd700 1 -- 172.21.15.79:0/2225176133 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2000bab0 con 0x7f6e380f5520 2021-04-09T18:35:36.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e36ffd700 1 -- 172.21.15.79:0/2225176133 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6e20002020 con 0x7f6e380f5520 2021-04-09T18:35:36.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e3e948700 1 -- 172.21.15.79:0/2225176133 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e380f5520 msgr2=0x7f6e380f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:36.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e3e948700 1 --2- 172.21.15.79:0/2225176133 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e380f5520 0x7f6e380f64b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f6e200032b0 tx=0x7f6e2000b0e0).stop 2021-04-09T18:35:36.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e3e948700 1 -- 172.21.15.79:0/2225176133 shutdown_connections 2021-04-09T18:35:36.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e3e948700 1 --2- 172.21.15.79:0/2225176133 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e380f5520 0x7f6e380f64b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e3e948700 1 --2- 172.21.15.79:0/2225176133 >> v2:172.21.15.89:3300/0 conn(0x7f6e380e9ae0 0x7f6e3809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e3e948700 1 -- 172.21.15.79:0/2225176133 >> 172.21.15.79:0/2225176133 conn(0x7f6e380e5fe0 msgr2=0x7f6e380e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e3e948700 1 -- 172.21.15.79:0/2225176133 shutdown_connections 2021-04-09T18:35:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.994 7f6e3e948700 1 -- 172.21.15.79:0/2225176133 wait complete. 2021-04-09T18:35:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e3e948700 1 Processor -- start 2021-04-09T18:35:36.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e3e948700 1 -- start start 2021-04-09T18:35:36.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e3e948700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e380d0400 0x7f6e380cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:36.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e3e948700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e380cf3f0 0x7f6e38099bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:36.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e3e948700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3809a200 0x7f6e380d5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:36.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e3e948700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3809aac0 con 0x7f6e3809a200 2021-04-09T18:35:36.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e3e948700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e380cf840 con 0x7f6e380cf3f0 2021-04-09T18:35:36.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e3e948700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e38093cc0 con 0x7f6e380d0400 2021-04-09T18:35:36.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e3ceed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3809a200 0x7f6e380d5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:36.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e3ceed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3809a200 0x7f6e380d5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35424/0 (socket says 172.21.15.79:35424) 2021-04-09T18:35:36.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e3ceed700 1 -- 172.21.15.79:0/821479444 learned_addr learned my addr 172.21.15.79:0/821479444 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:36.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e37fff700 1 --2- 172.21.15.79:0/821479444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e380d0400 0x7f6e380cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:36.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e377fe700 1 --2- 172.21.15.79:0/821479444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e380cf3f0 0x7f6e38099bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:36.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e3ceed700 1 -- 172.21.15.79:0/821479444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e380d0400 msgr2=0x7f6e380cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:36.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e3ceed700 1 --2- 172.21.15.79:0/821479444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e380d0400 0x7f6e380cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e3ceed700 1 -- 172.21.15.79:0/821479444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e380cf3f0 msgr2=0x7f6e38099bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:36.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e3ceed700 1 --2- 172.21.15.79:0/821479444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e380cf3f0 0x7f6e38099bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e3ceed700 1 -- 172.21.15.79:0/821479444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e380997b0 con 0x7f6e3809a200 2021-04-09T18:35:36.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e3ceed700 1 --2- 172.21.15.79:0/821479444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3809a200 0x7f6e380d5090 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f6e380d30b0 tx=0x7f6e3000cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:36.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e34ff9700 1 -- 172.21.15.79:0/821479444 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6e300072e0 con 0x7f6e3809a200 2021-04-09T18:35:36.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e34ff9700 1 -- 172.21.15.79:0/821479444 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e300055f0 con 0x7f6e3809a200 2021-04-09T18:35:36.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e3e948700 1 -- 172.21.15.79:0/821479444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e381a7ec0 con 0x7f6e3809a200 2021-04-09T18:35:36.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e34ff9700 1 -- 172.21.15.79:0/821479444 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6e300059c0 con 0x7f6e3809a200 2021-04-09T18:35:36.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:35.998 7f6e3e948700 1 -- 172.21.15.79:0/821479444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3808f260 con 0x7f6e3809a200 2021-04-09T18:35:36.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.002 7f6e34ff9700 1 -- 172.21.15.79:0/821479444 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6e30005bc0 con 0x7f6e3809a200 2021-04-09T18:35:36.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.002 7f6e34ff9700 1 --2- 172.21.15.79:0/821479444 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6e1c029100 0x7f6e1c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:36.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.002 7f6e34ff9700 1 -- 172.21.15.79:0/821479444 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5190+0+0 (secure 0 0 0) 0x7f6e30038db0 con 0x7f6e3809a200 2021-04-09T18:35:36.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.002 7f6e37fff700 1 --2- 172.21.15.79:0/821479444 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6e1c029100 0x7f6e1c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:36.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.002 7f6e37fff700 1 --2- 172.21.15.79:0/821479444 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6e1c029100 0x7f6e1c02b650 crc :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:36.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.006 7f6e3e948700 1 -- 172.21.15.79:0/821479444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e380e39e0 con 0x7f6e3809a200 2021-04-09T18:35:36.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.010 7f6e34ff9700 1 -- 172.21.15.79:0/821479444 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6e300070d0 con 0x7f6e3809a200 2021-04-09T18:35:36.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.186 7f6e3e948700 1 -- 172.21.15.79:0/821479444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f6e380f5b20 con 0x7f6e3809a200 2021-04-09T18:35:36.234 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.226 7f6e34ff9700 1 -- 172.21.15.79:0/821479444 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v130) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6e380f76c0 con 0x7f6e3809a200 2021-04-09T18:35:36.256 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blacklist entries 2021-04-09T18:35:36.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.254 7f6e3e948700 1 -- 172.21.15.79:0/821479444 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6e1c029100 msgr2=0x7f6e1c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:36.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.254 7f6e3e948700 1 --2- 172.21.15.79:0/821479444 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6e1c029100 0x7f6e1c02b650 crc :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.254 7f6e3e948700 1 -- 172.21.15.79:0/821479444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3809a200 msgr2=0x7f6e380d5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:36.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.254 7f6e3e948700 1 --2- 172.21.15.79:0/821479444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3809a200 0x7f6e380d5090 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f6e380d30b0 tx=0x7f6e3000cae0).stop 2021-04-09T18:35:36.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.254 7f6e3e948700 1 -- 172.21.15.79:0/821479444 shutdown_connections 2021-04-09T18:35:36.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.254 7f6e3e948700 1 --2- 172.21.15.79:0/821479444 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6e1c029100 0x7f6e1c02b650 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.254 7f6e3e948700 1 --2- 172.21.15.79:0/821479444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e3809a200 0x7f6e380d5090 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.254 7f6e3e948700 1 --2- 172.21.15.79:0/821479444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e380d0400 0x7f6e380cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.254 7f6e3e948700 1 --2- 172.21.15.79:0/821479444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e380cf3f0 0x7f6e38099bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.254 7f6e3e948700 1 -- 172.21.15.79:0/821479444 >> 172.21.15.79:0/821479444 conn(0x7f6e380bb040 msgr2=0x7f6e380d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:36.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.254 7f6e3e948700 1 -- 172.21.15.79:0/821479444 shutdown_connections 2021-04-09T18:35:36.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.254 7f6e3e948700 1 -- 172.21.15.79:0/821479444 wait complete. 2021-04-09T18:35:36.272 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-04-09T18:35:36.274 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-04-09T18:35:36.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.358 7f9d88532700 1 Processor -- start 2021-04-09T18:35:36.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.358 7f9d88532700 1 -- start start 2021-04-09T18:35:36.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d88532700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9d800e9ae0 0x7f9d8009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:36.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d88532700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d801c8010 0x7f9d801ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:36.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d88532700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d800fbb20 con 0x7f9d800f5520 2021-04-09T18:35:36.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d88532700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d801c3dc0 con 0x7f9d800e9ae0 2021-04-09T18:35:36.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d88532700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d800e9f30 con 0x7f9d801c8010 2021-04-09T18:35:36.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d85ad5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9d800e9ae0 0x7f9d8009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:36.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d85ad5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9d800e9ae0 0x7f9d8009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35430/0 (socket says 172.21.15.79:35430) 2021-04-09T18:35:36.378 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d85ad5700 1 -- 172.21.15.79:0/4053295906 learned_addr learned my addr 172.21.15.79:0/4053295906 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:36.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d86ad7700 1 --2- 172.21.15.79:0/4053295906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d801c8010 0x7f9d801ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:36.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d85ad5700 1 -- 172.21.15.79:0/4053295906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d801c8010 msgr2=0x7f9d801ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:36.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d85ad5700 1 --2- 172.21.15.79:0/4053295906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d801c8010 0x7f9d801ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d85ad5700 1 -- 172.21.15.79:0/4053295906 >> v1:172.21.15.89:6789/0 conn(0x7f9d800f5520 legacy=0x7f9d800f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:36.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d85ad5700 1 -- 172.21.15.79:0/4053295906 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d800e56d0 con 0x7f9d800e9ae0 2021-04-09T18:35:36.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d86ad7700 1 --2- 172.21.15.79:0/4053295906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d801c8010 0x7f9d801ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:36.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d85ad5700 1 --2- 172.21.15.79:0/4053295906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d800e9ae0 0x7f9d8009f110 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f9d800f6f00 tx=0x7f9d7000bdd0).ready entity=mon.0 client_cookie=d342029fd871956 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:36.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d852d4700 1 -- 172.21.15.79:0/4053295906 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d800e56d0 con 0x7f9d800e9ae0 2021-04-09T18:35:36.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d852d4700 1 -- 172.21.15.79:0/4053295906 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d70009990 con 0x7f9d800e9ae0 2021-04-09T18:35:36.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d852d4700 1 -- 172.21.15.79:0/4053295906 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d70009d60 con 0x7f9d800e9ae0 2021-04-09T18:35:36.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d88532700 1 -- 172.21.15.79:0/4053295906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d800e9ae0 msgr2=0x7f9d8009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:36.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d88532700 1 --2- 172.21.15.79:0/4053295906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d800e9ae0 0x7f9d8009f110 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f9d800f6f00 tx=0x7f9d7000bdd0).stop 2021-04-09T18:35:36.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d88532700 1 -- 172.21.15.79:0/4053295906 shutdown_connections 2021-04-09T18:35:36.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d88532700 1 --2- 172.21.15.79:0/4053295906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d801c8010 0x7f9d801ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.382 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d88532700 1 --2- 172.21.15.79:0/4053295906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d800e9ae0 0x7f9d8009f110 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d88532700 1 -- 172.21.15.79:0/4053295906 >> 172.21.15.79:0/4053295906 conn(0x7f9d800e5fe0 msgr2=0x7f9d800e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:36.384 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d88532700 1 -- 172.21.15.79:0/4053295906 shutdown_connections 2021-04-09T18:35:36.385 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.362 7f9d88532700 1 -- 172.21.15.79:0/4053295906 wait complete. 2021-04-09T18:35:36.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d88532700 1 Processor -- start 2021-04-09T18:35:36.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d88532700 1 -- start start 2021-04-09T18:35:36.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d88532700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d80092620 0x7f9d800d2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:36.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d88532700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d80092a70 0x7f9d800bbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:36.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d88532700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d800d2770 0x7f9d800bc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:36.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d88532700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d800d8170 con 0x7f9d800d2770 2021-04-09T18:35:36.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d88532700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d800d8470 con 0x7f9d80092620 2021-04-09T18:35:36.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d88532700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d800bc9b0 con 0x7f9d80092a70 2021-04-09T18:35:36.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d86ad7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d800d2770 0x7f9d800bc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:36.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d86ad7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d800d2770 0x7f9d800bc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35434/0 (socket says 172.21.15.79:35434) 2021-04-09T18:35:36.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d86ad7700 1 -- 172.21.15.79:0/4112976570 learned_addr learned my addr 172.21.15.79:0/4112976570 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:36.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d85ad5700 1 --2- 172.21.15.79:0/4112976570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d80092a70 0x7f9d800bbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:36.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d862d6700 1 --2- 172.21.15.79:0/4112976570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d80092620 0x7f9d800d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:36.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d86ad7700 1 -- 172.21.15.79:0/4112976570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d80092a70 msgr2=0x7f9d800bbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:36.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d86ad7700 1 --2- 172.21.15.79:0/4112976570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d80092a70 0x7f9d800bbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d86ad7700 1 -- 172.21.15.79:0/4112976570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d80092620 msgr2=0x7f9d800d2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:36.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d86ad7700 1 --2- 172.21.15.79:0/4112976570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d80092620 0x7f9d800d2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d86ad7700 1 -- 172.21.15.79:0/4112976570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d800bc700 con 0x7f9d800d2770 2021-04-09T18:35:36.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d86ad7700 1 --2- 172.21.15.79:0/4112976570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d800d2770 0x7f9d800bc0d0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7f9d8019da50 tx=0x7f9d78009f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:36.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d76ffd700 1 -- 172.21.15.79:0/4112976570 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d800bc700 con 0x7f9d800d2770 2021-04-09T18:35:36.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d76ffd700 1 -- 172.21.15.79:0/4112976570 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7800cac0 con 0x7f9d800d2770 2021-04-09T18:35:36.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.366 7f9d88532700 1 -- 172.21.15.79:0/4112976570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d80090770 con 0x7f9d800d2770 2021-04-09T18:35:36.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.370 7f9d76ffd700 1 -- 172.21.15.79:0/4112976570 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d78013430 con 0x7f9d800d2770 2021-04-09T18:35:36.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.370 7f9d88532700 1 -- 172.21.15.79:0/4112976570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d800d8740 con 0x7f9d800d2770 2021-04-09T18:35:36.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.370 7f9d76ffd700 1 -- 172.21.15.79:0/4112976570 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9d78013630 con 0x7f9d800d2770 2021-04-09T18:35:36.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.370 7f9d76ffd700 1 --2- 172.21.15.79:0/4112976570 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9d68029100 0x7f9d6802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:36.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.370 7f9d76ffd700 1 -- 172.21.15.79:0/4112976570 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f9d78039900 con 0x7f9d800d2770 2021-04-09T18:35:36.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.370 7f9d862d6700 1 --2- 172.21.15.79:0/4112976570 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9d68029100 0x7f9d6802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:36.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.370 7f9d862d6700 1 --2- 172.21.15.79:0/4112976570 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9d68029100 0x7f9d6802b650 crc :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:36.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.374 7f9d88532700 1 -- 172.21.15.79:0/4112976570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d800e39e0 con 0x7f9d800d2770 2021-04-09T18:35:36.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.378 7f9d76ffd700 1 -- 172.21.15.79:0/4112976570 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9d800f76c0 con 0x7f9d800d2770 2021-04-09T18:35:36.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.538 7f9d88532700 1 -- 172.21.15.79:0/4112976570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9d800a1cc0 con 0x7f9d800d2770 2021-04-09T18:35:36.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.538 7f9d76ffd700 1 -- 172.21.15.79:0/4112976570 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v38) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f9d78010040 con 0x7f9d800d2770 2021-04-09T18:35:36.548 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:36.549 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:35:36.549 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2021-04-09T18:35:36.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:36.549 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2021-04-09T18:35:36.550 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgovEoMhAAbDfArG3lSFAdk80rS/4iEQ==", 2021-04-09T18:35:36.550 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:36.550 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:35:36.550 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:36.551 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:36.551 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:36.551 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:36.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:36.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:36.552 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2021-04-09T18:35:36.552 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgN4sfOBAAPjvDX11uLM+vgdFpdP49Kw==", 2021-04-09T18:35:36.552 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:36.553 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:35:36.553 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:36.553 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:36.554 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:36.554 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:36.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:36.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:36.555 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2021-04-09T18:35:36.555 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQALnHBgro0COxAAgbe5jxAZH9bD7zDLbtdkhQ==", 2021-04-09T18:35:36.555 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:36.555 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:36.556 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:36.556 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:36.556 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:36.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:36.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:36.557 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2021-04-09T18:35:36.557 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAPnHBghZ/oARAAhkN+fnZJiskmHnvvs+G8NA==", 2021-04-09T18:35:36.557 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:36.558 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:36.558 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:36.558 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:36.558 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:36.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:36.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:36.559 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2021-04-09T18:35:36.559 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQASnHBgWT2FBxAACrSTbwbF18k9aPeYNohelw==", 2021-04-09T18:35:36.559 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:36.560 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:36.560 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:36.560 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:36.561 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:36.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:36.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:36.561 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2021-04-09T18:35:36.562 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAVnHBgPHy6CxAAFq+yki4AZe5ybodgTO/4/Q==", 2021-04-09T18:35:36.562 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:36.562 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:36.563 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:36.564 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:36.564 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:36.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:36.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:36.565 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2021-04-09T18:35:36.565 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAanHBgfbs4NhAAQzxM9dDML4RgQP8yamkuVw==", 2021-04-09T18:35:36.565 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:36.566 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:36.566 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:36.567 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:36.567 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:36.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:36.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:36.568 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2021-04-09T18:35:36.568 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAdnHBgi0WLOhAA4OBguOCjtmzqulUjTJ+GhQ==", 2021-04-09T18:35:36.568 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:36.569 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:36.569 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:36.569 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:36.570 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:36.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:36.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:36.571 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2021-04-09T18:35:36.571 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAhnHBgCs+PAxAAOm0wSMe/1Bu9vfTrpmrLkg==", 2021-04-09T18:35:36.571 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:36.572 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:36.572 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:36.572 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:36.573 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:36.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:36.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:36.573 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2021-04-09T18:35:36.574 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAknHBgH1S3CBAAUcdUIW7O6wH482l1yZBKBw==", 2021-04-09T18:35:36.574 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:36.574 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:36.574 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:36.574 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:36.575 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:36.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:36.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:36.576 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2021-04-09T18:35:36.576 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgxEq9BxAAap2nrjhcrf2aHzygtMclVw==", 2021-04-09T18:35:36.576 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:36.576 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:35:36.577 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:35:36.577 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:35:36.577 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:36.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:36.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:36.578 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2021-04-09T18:35:36.578 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBguJFeDRAAWL4NV4tsYRAqcwJ26kjm2Q==", 2021-04-09T18:35:36.579 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:36.580 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:35:36.580 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:35:36.580 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:35:36.580 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:36.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:36.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:36.581 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2021-04-09T18:35:36.581 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAJnHBgN9X5EhAA3DBPdlRHVBHXJNH9nRFW0A==", 2021-04-09T18:35:36.581 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:36.582 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2021-04-09T18:35:36.582 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2021-04-09T18:35:36.582 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw pool=cephfs_data" 2021-04-09T18:35:36.582 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:36.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:36.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:36.583 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2021-04-09T18:35:36.583 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgHOSVDBAAMMqd8paqBSTQRgR7n4EXGQ==", 2021-04-09T18:35:36.583 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:36.584 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:35:36.584 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2021-04-09T18:35:36.584 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2021-04-09T18:35:36.584 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:36.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:36.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:36.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:36.586 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2021-04-09T18:35:36.586 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgmHJhLxAAyhBrx08J7ZFKu34MYC2Wyg==", 2021-04-09T18:35:36.587 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:36.587 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:35:36.587 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:35:36.588 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:36.588 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:36.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:36.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:36.589 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2021-04-09T18:35:36.589 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQAInHBgNCCXKhAA/bKOzzjVHldj6RpMGu0c8g==", 2021-04-09T18:35:36.589 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2021-04-09T18:35:36.589 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2021-04-09T18:35:36.590 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2021-04-09T18:35:36.590 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2021-04-09T18:35:36.590 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:36.590 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:36.591 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:36.591 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:35:36.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.546 7f9d88532700 1 -- 172.21.15.79:0/4112976570 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9d68029100 msgr2=0x7f9d6802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:36.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.546 7f9d88532700 1 --2- 172.21.15.79:0/4112976570 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9d68029100 0x7f9d6802b650 crc :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.546 7f9d88532700 1 -- 172.21.15.79:0/4112976570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d800d2770 msgr2=0x7f9d800bc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:36.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.546 7f9d88532700 1 --2- 172.21.15.79:0/4112976570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d800d2770 0x7f9d800bc0d0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7f9d8019da50 tx=0x7f9d78009f70).stop 2021-04-09T18:35:36.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.546 7f9d88532700 1 -- 172.21.15.79:0/4112976570 shutdown_connections 2021-04-09T18:35:36.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.546 7f9d88532700 1 --2- 172.21.15.79:0/4112976570 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9d68029100 0x7f9d6802b650 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.546 7f9d88532700 1 --2- 172.21.15.79:0/4112976570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d80092620 0x7f9d800d2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.546 7f9d88532700 1 --2- 172.21.15.79:0/4112976570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d800d2770 0x7f9d800bc0d0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.546 7f9d88532700 1 --2- 172.21.15.79:0/4112976570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d80092a70 0x7f9d800bbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.546 7f9d88532700 1 -- 172.21.15.79:0/4112976570 >> 172.21.15.79:0/4112976570 conn(0x7f9d800964a0 msgr2=0x7f9d800bdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:36.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.546 7f9d88532700 1 -- 172.21.15.79:0/4112976570 shutdown_connections 2021-04-09T18:35:36.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.546 7f9d88532700 1 -- 172.21.15.79:0/4112976570 wait complete. 2021-04-09T18:35:36.597 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:35:36.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2fbd4c700 1 Processor -- start 2021-04-09T18:35:36.697 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2fbd4c700 1 -- start start 2021-04-09T18:35:36.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2fbd4c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd2f40e9ad0 0x7fd2f409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:36.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2fbd4c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd2f41c8000 0x7fd2f41ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:36.698 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2fbd4c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f40fbb10 con 0x7fd2f40f5510 2021-04-09T18:35:36.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2fbd4c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f41c3db0 con 0x7fd2f41c8000 2021-04-09T18:35:36.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2fbd4c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f40e9f20 con 0x7fd2f40e9ad0 2021-04-09T18:35:36.699 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2f9af0700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd2f40f5510 0x7fd2f40f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58384/0 (socket says 172.21.15.79:58384) 2021-04-09T18:35:36.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2f9af0700 1 -- 172.21.15.79:0/99506300 learned_addr learned my addr 172.21.15.79:0/99506300 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:36.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2fa2f1700 1 --2- 172.21.15.79:0/99506300 >> v2:172.21.15.79:3300/0 conn(0x7fd2f41c8000 0x7fd2f41ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:36.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2f92ef700 1 --2- 172.21.15.79:0/99506300 >> v2:172.21.15.89:3300/0 conn(0x7fd2f40e9ad0 0x7fd2f409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:36.700 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2f8aee700 1 -- 172.21.15.79:0/99506300 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 76670110 0 0) 0x7fd2f00010d0 con 0x7fd2f40f5510 2021-04-09T18:35:36.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2f8aee700 1 -- 172.21.15.79:0/99506300 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2e0003240 con 0x7fd2f40f5510 2021-04-09T18:35:36.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2fa2f1700 1 -- 172.21.15.79:0/99506300 >> v2:172.21.15.89:3300/0 conn(0x7fd2f40e9ad0 msgr2=0x7fd2f409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:36.701 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2fa2f1700 1 --2- 172.21.15.79:0/99506300 >> v2:172.21.15.89:3300/0 conn(0x7fd2f40e9ad0 0x7fd2f409f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2fa2f1700 1 -- 172.21.15.79:0/99506300 >> v1:172.21.15.79:6789/0 conn(0x7fd2f40f5510 legacy=0x7fd2f40f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:36.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2fa2f1700 1 -- 172.21.15.79:0/99506300 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f40e56c0 con 0x7fd2f41c8000 2021-04-09T18:35:36.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2fa2f1700 1 --2- 172.21.15.79:0/99506300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2f41c8000 0x7fd2f41ca460 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7fd2ec0032b0 tx=0x7fd2ec00b3c0).ready entity=mon.0 client_cookie=5dcf1294945f04e5 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:36.702 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2f8aee700 1 -- 172.21.15.79:0/99506300 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd2f40e56c0 con 0x7fd2f41c8000 2021-04-09T18:35:36.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2f8aee700 1 -- 172.21.15.79:0/99506300 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ec00bc20 con 0x7fd2f41c8000 2021-04-09T18:35:36.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2f8aee700 1 -- 172.21.15.79:0/99506300 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd2ec002020 con 0x7fd2f41c8000 2021-04-09T18:35:36.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2fbd4c700 1 -- 172.21.15.79:0/99506300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2f41c8000 msgr2=0x7fd2f41ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:36.703 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.686 7fd2fbd4c700 1 --2- 172.21.15.79:0/99506300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2f41c8000 0x7fd2f41ca460 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7fd2ec0032b0 tx=0x7fd2ec00b3c0).stop 2021-04-09T18:35:36.704 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.690 7fd2fbd4c700 1 -- 172.21.15.79:0/99506300 shutdown_connections 2021-04-09T18:35:36.707 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.690 7fd2fbd4c700 1 --2- 172.21.15.79:0/99506300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2f41c8000 0x7fd2f41ca460 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.708 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.690 7fd2fbd4c700 1 --2- 172.21.15.79:0/99506300 >> v2:172.21.15.89:3300/0 conn(0x7fd2f40e9ad0 0x7fd2f409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.690 7fd2fbd4c700 1 -- 172.21.15.79:0/99506300 >> 172.21.15.79:0/99506300 conn(0x7fd2f40e5fd0 msgr2=0x7fd2f40e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:36.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.690 7fd2fbd4c700 1 -- 172.21.15.79:0/99506300 shutdown_connections 2021-04-09T18:35:36.709 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.690 7fd2fbd4c700 1 -- 172.21.15.79:0/99506300 wait complete. 2021-04-09T18:35:36.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.690 7fd2fbd4c700 1 Processor -- start 2021-04-09T18:35:36.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.690 7fd2fbd4c700 1 -- start start 2021-04-09T18:35:36.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.690 7fd2fbd4c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2f40a9380 0x7fd2f40bbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:36.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.690 7fd2fbd4c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2f40a8a80 0x7fd2f40d22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:36.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.690 7fd2fbd4c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2f40d2900 0x7fd2f40ba970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:36.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.690 7fd2fbd4c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f40b9a30 con 0x7fd2f40a8a80 2021-04-09T18:35:36.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.690 7fd2fbd4c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f40a99f0 con 0x7fd2f40a9380 2021-04-09T18:35:36.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.690 7fd2fbd4c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f40a8ed0 con 0x7fd2f40d2900 2021-04-09T18:35:36.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2f92ef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2f40a8a80 0x7fd2f40d22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:36.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2f92ef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2f40a8a80 0x7fd2f40d22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35450/0 (socket says 172.21.15.79:35450) 2021-04-09T18:35:36.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2f92ef700 1 -- 172.21.15.79:0/2873985320 learned_addr learned my addr 172.21.15.79:0/2873985320 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:36.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2f9af0700 1 --2- 172.21.15.79:0/2873985320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2f40a9380 0x7fd2f40bbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:36.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2fa2f1700 1 --2- 172.21.15.79:0/2873985320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2f40d2900 0x7fd2f40ba970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:36.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2f92ef700 1 -- 172.21.15.79:0/2873985320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2f40d2900 msgr2=0x7fd2f40ba970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:36.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2f92ef700 1 --2- 172.21.15.79:0/2873985320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2f40d2900 0x7fd2f40ba970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2f92ef700 1 -- 172.21.15.79:0/2873985320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2f40a9380 msgr2=0x7fd2f40bbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:36.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2f92ef700 1 --2- 172.21.15.79:0/2873985320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2f40a9380 0x7fd2f40bbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2f92ef700 1 -- 172.21.15.79:0/2873985320 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f40bbb20 con 0x7fd2f40a8a80 2021-04-09T18:35:36.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2f92ef700 1 --2- 172.21.15.79:0/2873985320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2f40a8a80 0x7fd2f40d22d0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7fd2f40942e0 tx=0x7fd2e800c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:36.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2e67fc700 1 -- 172.21.15.79:0/2873985320 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd2f40bbb20 con 0x7fd2f40a8a80 2021-04-09T18:35:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2e67fc700 1 -- 172.21.15.79:0/2873985320 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e800cc10 con 0x7fd2f40a8a80 2021-04-09T18:35:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2fbd4c700 1 -- 172.21.15.79:0/2873985320 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f40bafa0 con 0x7fd2f40a8a80 2021-04-09T18:35:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2e67fc700 1 -- 172.21.15.79:0/2873985320 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd2e800f040 con 0x7fd2f40a8a80 2021-04-09T18:35:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2fbd4c700 1 -- 172.21.15.79:0/2873985320 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f40bb450 con 0x7fd2f40a8a80 2021-04-09T18:35:36.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2e67fc700 1 -- 172.21.15.79:0/2873985320 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd2e8011070 con 0x7fd2f40a8a80 2021-04-09T18:35:36.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2e67fc700 1 --2- 172.21.15.79:0/2873985320 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd2dc029100 0x7fd2dc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:36.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2e67fc700 1 -- 172.21.15.79:0/2873985320 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fd2e8010040 con 0x7fd2f40a8a80 2021-04-09T18:35:36.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2f9af0700 1 --2- 172.21.15.79:0/2873985320 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd2dc029100 0x7fd2dc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:36.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.694 7fd2f9af0700 1 --2- 172.21.15.79:0/2873985320 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd2dc029100 0x7fd2dc02b650 crc :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:36.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.698 7fd2fbd4c700 1 -- 172.21.15.79:0/2873985320 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f40e39d0 con 0x7fd2f40a8a80 2021-04-09T18:35:36.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.706 7fd2e67fc700 1 -- 172.21.15.79:0/2873985320 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd2e800c810 con 0x7fd2f40a8a80 2021-04-09T18:35:36.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.866 7fd2fbd4c700 1 -- 172.21.15.79:0/2873985320 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2f40a1cb0 con 0x7fd2f40a8a80 2021-04-09T18:35:36.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.870 7fd2e67fc700 1 -- 172.21.15.79:0/2873985320 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+11387 (secure 0 0 0) 0x7fd2e8000bf0 con 0x7fd2f40a8a80 2021-04-09T18:35:36.876 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:36.877 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":130,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:35:36.223297","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:35:36.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.870 7fd2fbd4c700 1 -- 172.21.15.79:0/2873985320 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd2dc029100 msgr2=0x7fd2dc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:36.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.870 7fd2fbd4c700 1 --2- 172.21.15.79:0/2873985320 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd2dc029100 0x7fd2dc02b650 crc :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.874 7fd2fbd4c700 1 -- 172.21.15.79:0/2873985320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2f40a8a80 msgr2=0x7fd2f40d22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:36.880 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.874 7fd2fbd4c700 1 --2- 172.21.15.79:0/2873985320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2f40a8a80 0x7fd2f40d22d0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7fd2f40942e0 tx=0x7fd2e800c150).stop 2021-04-09T18:35:36.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.874 7fd2fbd4c700 1 -- 172.21.15.79:0/2873985320 shutdown_connections 2021-04-09T18:35:36.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.874 7fd2fbd4c700 1 --2- 172.21.15.79:0/2873985320 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd2dc029100 0x7fd2dc02b650 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.874 7fd2fbd4c700 1 --2- 172.21.15.79:0/2873985320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2f40a9380 0x7fd2f40bbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.874 7fd2fbd4c700 1 --2- 172.21.15.79:0/2873985320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2f40d2900 0x7fd2f40ba970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.874 7fd2fbd4c700 1 --2- 172.21.15.79:0/2873985320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2f40a8a80 0x7fd2f40d22d0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:36.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.874 7fd2fbd4c700 1 -- 172.21.15.79:0/2873985320 >> 172.21.15.79:0/2873985320 conn(0x7fd2f40bce90 msgr2=0x7fd2f40937b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:36.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.874 7fd2fbd4c700 1 -- 172.21.15.79:0/2873985320 shutdown_connections 2021-04-09T18:35:36.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.874 7fd2fbd4c700 1 -- 172.21.15.79:0/2873985320 wait complete. 2021-04-09T18:35:36.890 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-04-09T18:35:36.891 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:35:37.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f01878d5700 1 Processor -- start 2021-04-09T18:35:37.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f01878d5700 1 -- start start 2021-04-09T18:35:37.005 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f01878d5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f01800f5550 0x7f01800f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:37.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f01878d5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f01800e9b10 0x7f018009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:37.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f01878d5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01800fbb50 con 0x7f01801c2de0 2021-04-09T18:35:37.006 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f01878d5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01800e9f60 con 0x7f01800e9b10 2021-04-09T18:35:37.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f01878d5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01800e5a00 con 0x7f01800f5550 2021-04-09T18:35:37.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f0184e78700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f01800e9b10 0x7f018009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:37.007 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f0184e78700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f01800e9b10 0x7f018009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35456/0 (socket says 172.21.15.79:35456) 2021-04-09T18:35:37.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f0184e78700 1 -- 172.21.15.79:0/2133245767 learned_addr learned my addr 172.21.15.79:0/2133245767 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:37.008 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f0185679700 1 --2- 172.21.15.79:0/2133245767 >> v2:172.21.15.89:3300/0 conn(0x7f01800f5550 0x7f01800f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:37.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f0184e78700 1 -- 172.21.15.79:0/2133245767 >> v2:172.21.15.89:3300/0 conn(0x7f01800f5550 msgr2=0x7f01800f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:37.009 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f0184e78700 1 --2- 172.21.15.79:0/2133245767 >> v2:172.21.15.89:3300/0 conn(0x7f01800f5550 0x7f01800f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f0184e78700 1 -- 172.21.15.79:0/2133245767 >> v1:172.21.15.79:6789/0 conn(0x7f01801c2de0 legacy=0x7f01801c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:37.010 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f0184e78700 1 -- 172.21.15.79:0/2133245767 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01800e5700 con 0x7f01800e9b10 2021-04-09T18:35:37.011 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f0185679700 1 --2- 172.21.15.79:0/2133245767 >> v2:172.21.15.89:3300/0 conn(0x7f01800f5550 0x7f01800f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:35:37.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f0184e78700 1 --2- 172.21.15.79:0/2133245767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01800e9b10 0x7f018009f110 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f0174002f30 tx=0x7f017400bd70).ready entity=mon.0 client_cookie=690f57af384f9998 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:37.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f0173fff700 1 -- 172.21.15.79:0/2133245767 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f01800e5700 con 0x7f01800e9b10 2021-04-09T18:35:37.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f0173fff700 1 -- 172.21.15.79:0/2133245767 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0174009950 con 0x7f01800e9b10 2021-04-09T18:35:37.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f0173fff700 1 -- 172.21.15.79:0/2133245767 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0174009d20 con 0x7f01800e9b10 2021-04-09T18:35:37.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f01878d5700 1 -- 172.21.15.79:0/2133245767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01800e9b10 msgr2=0x7f018009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:37.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f01878d5700 1 --2- 172.21.15.79:0/2133245767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01800e9b10 0x7f018009f110 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f0174002f30 tx=0x7f017400bd70).stop 2021-04-09T18:35:37.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f01878d5700 1 -- 172.21.15.79:0/2133245767 shutdown_connections 2021-04-09T18:35:37.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f01878d5700 1 --2- 172.21.15.79:0/2133245767 >> v2:172.21.15.89:3300/0 conn(0x7f01800f5550 0x7f01800f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f01878d5700 1 --2- 172.21.15.79:0/2133245767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01800e9b10 0x7f018009f110 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f01878d5700 1 -- 172.21.15.79:0/2133245767 >> 172.21.15.79:0/2133245767 conn(0x7f01800e6010 msgr2=0x7f01800e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:37.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f01878d5700 1 -- 172.21.15.79:0/2133245767 shutdown_connections 2021-04-09T18:35:37.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.990 7f01878d5700 1 -- 172.21.15.79:0/2133245767 wait complete. 2021-04-09T18:35:37.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.994 7f01878d5700 1 Processor -- start 2021-04-09T18:35:37.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.994 7f01878d5700 1 -- start start 2021-04-09T18:35:37.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.994 7f01878d5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f018008ee00 0x7f01800b8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:37.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.994 7f01878d5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01800d0db0 0x7f01800d1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:37.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.994 7f01878d5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0180092430 0x7f0180092880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:37.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.994 7f01878d5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01800b6dc0 con 0x7f01800d0db0 2021-04-09T18:35:37.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.994 7f01878d5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01800b70c0 con 0x7f0180092430 2021-04-09T18:35:37.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.994 7f01878d5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018008f250 con 0x7f018008ee00 2021-04-09T18:35:37.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.994 7f0184e78700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01800d0db0 0x7f01800d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:37.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.994 7f0184e78700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01800d0db0 0x7f01800d1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35462/0 (socket says 172.21.15.79:35462) 2021-04-09T18:35:37.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.994 7f0184e78700 1 -- 172.21.15.79:0/3830181484 learned_addr learned my addr 172.21.15.79:0/3830181484 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:37.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.994 7f0185e7a700 1 --2- 172.21.15.79:0/3830181484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0180092430 0x7f0180092880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:37.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.994 7f0185679700 1 --2- 172.21.15.79:0/3830181484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f018008ee00 0x7f01800b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:37.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.994 7f0184e78700 1 -- 172.21.15.79:0/3830181484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f018008ee00 msgr2=0x7f01800b8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:37.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.994 7f0184e78700 1 --2- 172.21.15.79:0/3830181484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f018008ee00 0x7f01800b8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.994 7f0184e78700 1 -- 172.21.15.79:0/3830181484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0180092430 msgr2=0x7f0180092880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:37.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.994 7f0184e78700 1 --2- 172.21.15.79:0/3830181484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0180092430 0x7f0180092880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.994 7f0184e78700 1 -- 172.21.15.79:0/3830181484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0180092eb0 con 0x7f01800d0db0 2021-04-09T18:35:37.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.994 7f0185679700 1 --2- 172.21.15.79:0/3830181484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f018008ee00 0x7f01800b8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:35:37.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.994 7f0184e78700 1 --2- 172.21.15.79:0/3830181484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01800d0db0 0x7f01800d1200 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f01800b9940 tx=0x7f0174006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:37.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.998 7f0171ffb700 1 -- 172.21.15.79:0/3830181484 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0174011d70 con 0x7f01800d0db0 2021-04-09T18:35:37.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.998 7f0171ffb700 1 -- 172.21.15.79:0/3830181484 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017401d440 con 0x7f01800d0db0 2021-04-09T18:35:37.020 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.998 7f0171ffb700 1 -- 172.21.15.79:0/3830181484 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f017401d810 con 0x7f01800d0db0 2021-04-09T18:35:37.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.998 7f01878d5700 1 -- 172.21.15.79:0/3830181484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01800932b0 con 0x7f01800d0db0 2021-04-09T18:35:37.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.998 7f01878d5700 1 -- 172.21.15.79:0/3830181484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01800b8c90 con 0x7f01800d0db0 2021-04-09T18:35:37.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.998 7f0171ffb700 1 -- 172.21.15.79:0/3830181484 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0174026450 con 0x7f01800d0db0 2021-04-09T18:35:37.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.998 7f0171ffb700 1 --2- 172.21.15.79:0/3830181484 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0160029100 0x7f016002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:37.021 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.998 7f0171ffb700 1 -- 172.21.15.79:0/3830181484 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f017403aee0 con 0x7f01800d0db0 2021-04-09T18:35:37.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.998 7f0185679700 1 --2- 172.21.15.79:0/3830181484 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0160029100 0x7f016002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:37.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:36.998 7f0185679700 1 --2- 172.21.15.79:0/3830181484 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0160029100 0x7f016002b650 crc :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:37.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.006 7f01878d5700 1 -- 172.21.15.79:0/3830181484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01800b96a0 con 0x7f01800d0db0 2021-04-09T18:35:37.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.010 7f0171ffb700 1 -- 172.21.15.79:0/3830181484 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0174009740 con 0x7f01800d0db0 2021-04-09T18:35:37.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.174 7f01878d5700 1 -- 172.21.15.79:0/3830181484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f01800e39f0 con 0x7f01800d0db0 2021-04-09T18:35:37.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.174 7f0171ffb700 1 -- 172.21.15.79:0/3830181484 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v130) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0174011b60 con 0x7f01800d0db0 2021-04-09T18:35:37.182 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:35:37.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.178 7f01878d5700 1 -- 172.21.15.79:0/3830181484 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0160029100 msgr2=0x7f016002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:37.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.178 7f01878d5700 1 --2- 172.21.15.79:0/3830181484 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0160029100 0x7f016002b650 crc :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.178 7f01878d5700 1 -- 172.21.15.79:0/3830181484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01800d0db0 msgr2=0x7f01800d1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:37.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.178 7f01878d5700 1 --2- 172.21.15.79:0/3830181484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01800d0db0 0x7f01800d1200 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f01800b9940 tx=0x7f0174006890).stop 2021-04-09T18:35:37.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.178 7f01878d5700 1 -- 172.21.15.79:0/3830181484 shutdown_connections 2021-04-09T18:35:37.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.178 7f01878d5700 1 --2- 172.21.15.79:0/3830181484 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0160029100 0x7f016002b650 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.178 7f01878d5700 1 --2- 172.21.15.79:0/3830181484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0180092430 0x7f0180092880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.178 7f01878d5700 1 --2- 172.21.15.79:0/3830181484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f018008ee00 0x7f01800b8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.178 7f01878d5700 1 --2- 172.21.15.79:0/3830181484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01800d0db0 0x7f01800d1200 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.178 7f01878d5700 1 -- 172.21.15.79:0/3830181484 >> 172.21.15.79:0/3830181484 conn(0x7f01800d8b80 msgr2=0x7f01800b9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:37.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.178 7f01878d5700 1 -- 172.21.15.79:0/3830181484 shutdown_connections 2021-04-09T18:35:37.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.178 7f01878d5700 1 -- 172.21.15.79:0/3830181484 wait complete. 2021-04-09T18:35:37.199 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-04-09T18:35:37.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdc02b88700 1 Processor -- start 2021-04-09T18:35:37.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdc02b88700 1 -- start start 2021-04-09T18:35:37.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdc02b88700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbfc0f5510 0x7fdbfc0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:37.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdc02b88700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdbfc0e9ad0 0x7fdbfc09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:37.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdc02b88700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbfc0fbb10 con 0x7fdbfc1c2da0 2021-04-09T18:35:37.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdc02b88700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbfc0e9f20 con 0x7fdbfc0e9ad0 2021-04-09T18:35:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdc02b88700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc0e59c0 con 0x7fdbfc0f5510 2021-04-09T18:35:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdc0112d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdbfc1c2da0 0x7fdbfc1c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58416/0 (socket says 172.21.15.79:58416) 2021-04-09T18:35:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdc0112d700 1 -- 172.21.15.79:0/3799945159 learned_addr learned my addr 172.21.15.79:0/3799945159 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdbfbfff700 1 --2- 172.21.15.79:0/3799945159 >> v2:172.21.15.79:3300/0 conn(0x7fdbfc0e9ad0 0x7fdbfc09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdc0092c700 1 --2- 172.21.15.79:0/3799945159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbfc0f5510 0x7fdbfc0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdbfb7fe700 1 -- 172.21.15.79:0/3799945159 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999252658 0 0) 0x7fdbf40010d0 con 0x7fdbfc1c2da0 2021-04-09T18:35:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdbfb7fe700 1 -- 172.21.15.79:0/3799945159 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbe8003240 con 0x7fdbfc1c2da0 2021-04-09T18:35:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdbfbfff700 1 -- 172.21.15.79:0/3799945159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbfc0f5510 msgr2=0x7fdbfc0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdbfbfff700 1 --2- 172.21.15.79:0/3799945159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbfc0f5510 0x7fdbfc0f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdbfbfff700 1 -- 172.21.15.79:0/3799945159 >> v1:172.21.15.79:6789/0 conn(0x7fdbfc1c2da0 legacy=0x7fdbfc1c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdbfbfff700 1 -- 172.21.15.79:0/3799945159 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc0e56c0 con 0x7fdbfc0e9ad0 2021-04-09T18:35:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdbfbfff700 1 --2- 172.21.15.79:0/3799945159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbfc0e9ad0 0x7fdbfc09f100 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7fdbe40032b0 tx=0x7fdbe400b3c0).ready entity=mon.0 client_cookie=fca3c836d6cfda2e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdbfb7fe700 1 -- 172.21.15.79:0/3799945159 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdbfc0e56c0 con 0x7fdbfc0e9ad0 2021-04-09T18:35:37.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdbfb7fe700 1 -- 172.21.15.79:0/3799945159 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe400bc20 con 0x7fdbfc0e9ad0 2021-04-09T18:35:37.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdbfb7fe700 1 -- 172.21.15.79:0/3799945159 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdbe4002020 con 0x7fdbfc0e9ad0 2021-04-09T18:35:37.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdc02b88700 1 -- 172.21.15.79:0/3799945159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbfc0e9ad0 msgr2=0x7fdbfc09f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:37.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdc02b88700 1 --2- 172.21.15.79:0/3799945159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbfc0e9ad0 0x7fdbfc09f100 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7fdbe40032b0 tx=0x7fdbe400b3c0).stop 2021-04-09T18:35:37.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdc02b88700 1 -- 172.21.15.79:0/3799945159 shutdown_connections 2021-04-09T18:35:37.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdc02b88700 1 --2- 172.21.15.79:0/3799945159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbfc0f5510 0x7fdbfc0f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdc02b88700 1 --2- 172.21.15.79:0/3799945159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbfc0e9ad0 0x7fdbfc09f100 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdc02b88700 1 -- 172.21.15.79:0/3799945159 >> 172.21.15.79:0/3799945159 conn(0x7fdbfc0e5fd0 msgr2=0x7fdbfc0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:37.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdc02b88700 1 -- 172.21.15.79:0/3799945159 shutdown_connections 2021-04-09T18:35:37.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.290 7fdc02b88700 1 -- 172.21.15.79:0/3799945159 wait complete. 2021-04-09T18:35:37.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.294 7fdc02b88700 1 Processor -- start 2021-04-09T18:35:37.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdc02b88700 1 -- start start 2021-04-09T18:35:37.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdc02b88700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbfc0d88e0 0x7fdbfc09a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:37.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdc02b88700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbfc094680 0x7fdbfc094ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:37.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdc02b88700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbfc0cf400 0x7fdbfc0cf850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:37.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdc02b88700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc094380 con 0x7fdbfc0d88e0 2021-04-09T18:35:37.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdc02b88700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc09aac0 con 0x7fdbfc094680 2021-04-09T18:35:37.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdc02b88700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc08fed0 con 0x7fdbfc0cf400 2021-04-09T18:35:37.313 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdc0092c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbfc0d88e0 0x7fdbfc09a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:37.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdc0092c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbfc0d88e0 0x7fdbfc09a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35476/0 (socket says 172.21.15.79:35476) 2021-04-09T18:35:37.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdc0092c700 1 -- 172.21.15.79:0/611966855 learned_addr learned my addr 172.21.15.79:0/611966855 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:37.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdc0112d700 1 --2- 172.21.15.79:0/611966855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbfc0cf400 0x7fdbfc0cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:37.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdbfbfff700 1 --2- 172.21.15.79:0/611966855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbfc094680 0x7fdbfc094ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:37.314 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdc0092c700 1 -- 172.21.15.79:0/611966855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbfc0cf400 msgr2=0x7fdbfc0cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:37.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdc0092c700 1 --2- 172.21.15.79:0/611966855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbfc0cf400 0x7fdbfc0cf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdc0092c700 1 -- 172.21.15.79:0/611966855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbfc094680 msgr2=0x7fdbfc094ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:37.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdc0092c700 1 --2- 172.21.15.79:0/611966855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbfc094680 0x7fdbfc094ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdc0092c700 1 -- 172.21.15.79:0/611966855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc0d8d30 con 0x7fdbfc0d88e0 2021-04-09T18:35:37.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdbfbfff700 1 --2- 172.21.15.79:0/611966855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbfc094680 0x7fdbfc094ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:35:37.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdc0092c700 1 --2- 172.21.15.79:0/611966855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbfc0d88e0 0x7fdbfc09a490 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7fdbec006920 tx=0x7fdbec00c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:37.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdbf97fa700 1 -- 172.21.15.79:0/611966855 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdbfc0d8d30 con 0x7fdbfc0d88e0 2021-04-09T18:35:37.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdbf97fa700 1 -- 172.21.15.79:0/611966855 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec00cb50 con 0x7fdbfc0d88e0 2021-04-09T18:35:37.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdbf97fa700 1 -- 172.21.15.79:0/611966855 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdbec00f040 con 0x7fdbfc0d88e0 2021-04-09T18:35:37.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdc02b88700 1 -- 172.21.15.79:0/611966855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbfc099950 con 0x7fdbfc0d88e0 2021-04-09T18:35:37.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdc02b88700 1 -- 172.21.15.79:0/611966855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbfc0cfe80 con 0x7fdbfc0d88e0 2021-04-09T18:35:37.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdbf97fa700 1 -- 172.21.15.79:0/611966855 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fdbec011070 con 0x7fdbfc0d88e0 2021-04-09T18:35:37.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdbf97fa700 1 --2- 172.21.15.79:0/611966855 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdbe0029100 0x7fdbe002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:37.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdbf97fa700 1 -- 172.21.15.79:0/611966855 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5104+0+0 (secure 0 0 0) 0x7fdbec010040 con 0x7fdbfc0d88e0 2021-04-09T18:35:37.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.298 7fdbfbfff700 1 --2- 172.21.15.79:0/611966855 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdbe0029100 0x7fdbe002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:37.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.302 7fdbfbfff700 1 --2- 172.21.15.79:0/611966855 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdbe0029100 0x7fdbe002b650 crc :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:37.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.302 7fdc02b88700 1 -- 172.21.15.79:0/611966855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbfc0e39d0 con 0x7fdbfc0d88e0 2021-04-09T18:35:37.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.306 7fdbf97fa700 1 -- 172.21.15.79:0/611966855 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fdbec00c750 con 0x7fdbfc0d88e0 2021-04-09T18:35:37.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.458 7fdc02b88700 1 -- 172.21.15.79:0/611966855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdbfc0f5b10 con 0x7fdbfc0d88e0 2021-04-09T18:35:37.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.462 7fdbf97fa700 1 -- 172.21.15.79:0/611966855 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v130) v1 ==== 84+0+64 (secure 0 0 0) 0x7fdbec000bf0 con 0x7fdbfc0d88e0 2021-04-09T18:35:37.468 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:37.468 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2021-04-09T18:35:37.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:37.469 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2021-04-09T18:35:37.469 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": "rbd" 2021-04-09T18:35:37.469 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:37.469 INFO:teuthology.orchestra.run.smithi079.stdout:] 2021-04-09T18:35:37.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.462 7fdc02b88700 1 -- 172.21.15.79:0/611966855 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdbe0029100 msgr2=0x7fdbe002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:37.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.462 7fdc02b88700 1 --2- 172.21.15.79:0/611966855 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdbe0029100 0x7fdbe002b650 crc :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.462 7fdc02b88700 1 -- 172.21.15.79:0/611966855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbfc0d88e0 msgr2=0x7fdbfc09a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.462 7fdc02b88700 1 --2- 172.21.15.79:0/611966855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbfc0d88e0 0x7fdbfc09a490 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7fdbec006920 tx=0x7fdbec00c150).stop 2021-04-09T18:35:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.462 7fdc02b88700 1 -- 172.21.15.79:0/611966855 shutdown_connections 2021-04-09T18:35:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.462 7fdc02b88700 1 --2- 172.21.15.79:0/611966855 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdbe0029100 0x7fdbe002b650 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.462 7fdc02b88700 1 --2- 172.21.15.79:0/611966855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbfc0cf400 0x7fdbfc0cf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.462 7fdc02b88700 1 --2- 172.21.15.79:0/611966855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbfc0d88e0 0x7fdbfc09a490 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.462 7fdc02b88700 1 --2- 172.21.15.79:0/611966855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbfc094680 0x7fdbfc094ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.462 7fdc02b88700 1 -- 172.21.15.79:0/611966855 >> 172.21.15.79:0/611966855 conn(0x7fdbfc093630 msgr2=0x7fdbfc0d71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.462 7fdc02b88700 1 -- 172.21.15.79:0/611966855 shutdown_connections 2021-04-09T18:35:37.473 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.462 7fdc02b88700 1 -- 172.21.15.79:0/611966855 wait complete. 2021-04-09T18:35:37.480 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-04-09T18:35:37.481 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-04-09T18:35:37.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f7693121700 1 Processor -- start 2021-04-09T18:35:37.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f7693121700 1 -- start start 2021-04-09T18:35:37.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f7693121700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f768c1c9050 0x7f768c1cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:37.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f7693121700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768c0fbb50 con 0x7f768c0f5550 2021-04-09T18:35:37.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f7693121700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768c09f910 con 0x7f768c0e9b10 2021-04-09T18:35:37.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f7693121700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f768c1c3df0 con 0x7f768c1c9050 2021-04-09T18:35:37.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f7690ec5700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f768c0f5550 0x7f768c0f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58428/0 (socket says 172.21.15.79:58428) 2021-04-09T18:35:37.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f7690ec5700 1 -- 172.21.15.79:0/960370628 learned_addr learned my addr 172.21.15.79:0/960370628 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:37.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f76916c6700 1 --2- 172.21.15.79:0/960370628 >> v2:172.21.15.89:3300/0 conn(0x7f768c1c9050 0x7f768c1cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:37.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768b7fe700 1 -- 172.21.15.79:0/960370628 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652866818 0 0) 0x7f767c001450 con 0x7f768c0f5550 2021-04-09T18:35:37.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768b7fe700 1 -- 172.21.15.79:0/960370628 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7678003240 con 0x7f768c0f5550 2021-04-09T18:35:37.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768b7fe700 1 -- 172.21.15.79:0/960370628 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4181907418 0 0) 0x7f76740010d0 con 0x7f768c0e9b10 2021-04-09T18:35:37.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768b7fe700 1 -- 172.21.15.79:0/960370628 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7678003620 con 0x7f768c0e9b10 2021-04-09T18:35:37.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768b7fe700 1 -- 172.21.15.79:0/960370628 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3167814754 0 0) 0x7f767c0019d0 con 0x7f768c0f5550 2021-04-09T18:35:37.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768b7fe700 1 -- 172.21.15.79:0/960370628 >> v2:172.21.15.89:3300/0 conn(0x7f768c1c9050 msgr2=0x7f768c1cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:37.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768b7fe700 1 --2- 172.21.15.79:0/960370628 >> v2:172.21.15.89:3300/0 conn(0x7f768c1c9050 0x7f768c1cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768b7fe700 1 -- 172.21.15.79:0/960370628 >> v1:172.21.15.89:6789/0 conn(0x7f768c0e9b10 legacy=0x7f768c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:37.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768b7fe700 1 -- 172.21.15.79:0/960370628 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c0e5700 con 0x7f768c0f5550 2021-04-09T18:35:37.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768b7fe700 1 -- 172.21.15.79:0/960370628 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f767c001f30 con 0x7f768c0f5550 2021-04-09T18:35:37.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768b7fe700 1 -- 172.21.15.79:0/960370628 >> v1:172.21.15.79:6789/0 conn(0x7f768c0f5550 legacy=0x7f768c0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:37.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768b7fe700 1 --2- 172.21.15.79:0/960370628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7678003d10 0x7f76780045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:37.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768b7fe700 1 --2- 172.21.15.79:0/960370628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7678004bd0 0x7f76780097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:37.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768b7fe700 1 --2- 172.21.15.79:0/960370628 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7678005020 0x7f767800be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:37.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768b7fe700 1 -- 172.21.15.79:0/960370628 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c1c3df0 con 0x7f7678003d10 2021-04-09T18:35:37.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768b7fe700 1 -- 172.21.15.79:0/960370628 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76780505b0 con 0x7f7678004bd0 2021-04-09T18:35:37.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768b7fe700 1 -- 172.21.15.79:0/960370628 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76780507b0 con 0x7f7678005020 2021-04-09T18:35:37.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f7690ec5700 1 --2- 172.21.15.79:0/960370628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7678003d10 0x7f76780045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:37.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768bfff700 1 --2- 172.21.15.79:0/960370628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7678004bd0 0x7f76780097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:37.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f76916c6700 1 --2- 172.21.15.79:0/960370628 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7678005020 0x7f767800be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:37.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f7690ec5700 1 -- 172.21.15.79:0/960370628 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7678005020 msgr2=0x7f767800be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:37.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f7690ec5700 1 --2- 172.21.15.79:0/960370628 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7678005020 0x7f767800be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f7690ec5700 1 -- 172.21.15.79:0/960370628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7678004bd0 msgr2=0x7f76780097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:37.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f7690ec5700 1 --2- 172.21.15.79:0/960370628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7678004bd0 0x7f76780097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f7690ec5700 1 -- 172.21.15.79:0/960370628 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7678050aa0 con 0x7f7678003d10 2021-04-09T18:35:37.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f76916c6700 1 -- 172.21.15.79:0/960370628 reap_dead start 2021-04-09T18:35:37.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f7690ec5700 1 --2- 172.21.15.79:0/960370628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7678003d10 0x7f76780045a0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f767c001d00 tx=0x7f767c00ae60).ready entity=mon.0 client_cookie=f5a319d3f760c161 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:37.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768b7fe700 1 -- 172.21.15.79:0/960370628 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7678050aa0 con 0x7f7678003d10 2021-04-09T18:35:37.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768b7fe700 1 -- 172.21.15.79:0/960370628 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c005b80 con 0x7f7678003d10 2021-04-09T18:35:37.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f768b7fe700 1 -- 172.21.15.79:0/960370628 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f768c0e5700 con 0x7f7678003d10 2021-04-09T18:35:37.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f7693121700 1 -- 172.21.15.79:0/960370628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7678003d10 msgr2=0x7f76780045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:37.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.566 7f7693121700 1 --2- 172.21.15.79:0/960370628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7678003d10 0x7f76780045a0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f767c001d00 tx=0x7f767c00ae60).stop 2021-04-09T18:35:37.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.570 7f7693121700 1 -- 172.21.15.79:0/960370628 shutdown_connections 2021-04-09T18:35:37.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.570 7f7693121700 1 --2- 172.21.15.79:0/960370628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7678003d10 0x7f76780045a0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.570 7f7693121700 1 -- 172.21.15.79:0/960370628 >> 172.21.15.79:0/960370628 conn(0x7f768c0e6010 msgr2=0x7f768c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:37.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.570 7f7693121700 1 -- 172.21.15.79:0/960370628 shutdown_connections 2021-04-09T18:35:37.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.570 7f7693121700 1 -- 172.21.15.79:0/960370628 wait complete. 2021-04-09T18:35:37.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.570 7f7693121700 1 Processor -- start 2021-04-09T18:35:37.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.570 7f7693121700 1 -- start start 2021-04-09T18:35:37.590 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.570 7f7693121700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f768c0c34f0 0x7f768c0ad590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:37.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.570 7f7693121700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f768c09b280 0x7f768c1c0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:37.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.570 7f7693121700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f768c1b1450 0x7f768c1b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:37.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.570 7f7693121700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c0e9f60 con 0x7f768c1b1450 2021-04-09T18:35:37.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.570 7f7693121700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c0c3c00 con 0x7f768c09b280 2021-04-09T18:35:37.591 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.570 7f7693121700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768c0c3f00 con 0x7f768c0c34f0 2021-04-09T18:35:37.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.574 7f76916c6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f768c1b1450 0x7f768c1b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:37.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.574 7f76916c6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f768c1b1450 0x7f768c1b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35498/0 (socket says 172.21.15.79:35498) 2021-04-09T18:35:37.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.574 7f76916c6700 1 -- 172.21.15.79:0/39856843 learned_addr learned my addr 172.21.15.79:0/39856843 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:37.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.574 7f7690ec5700 1 --2- 172.21.15.79:0/39856843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f768c0c34f0 0x7f768c0ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:37.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.574 7f768bfff700 1 --2- 172.21.15.79:0/39856843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f768c09b280 0x7f768c1c0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:37.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.574 7f76916c6700 1 -- 172.21.15.79:0/39856843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f768c0c34f0 msgr2=0x7f768c0ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:37.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.574 7f76916c6700 1 --2- 172.21.15.79:0/39856843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f768c0c34f0 0x7f768c0ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.574 7f76916c6700 1 -- 172.21.15.79:0/39856843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f768c09b280 msgr2=0x7f768c1c0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:37.593 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.574 7f76916c6700 1 --2- 172.21.15.79:0/39856843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f768c09b280 0x7f768c1c0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:37.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.574 7f76916c6700 1 -- 172.21.15.79:0/39856843 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c1c07a0 con 0x7f768c1b1450 2021-04-09T18:35:37.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.574 7f76916c6700 1 --2- 172.21.15.79:0/39856843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f768c1b1450 0x7f768c1b18a0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f768c0974d0 tx=0x7f7684006e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:37.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.574 7f76897fa700 1 -- 172.21.15.79:0/39856843 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f768c1c07a0 con 0x7f768c1b1450 2021-04-09T18:35:37.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.574 7f76897fa700 1 -- 172.21.15.79:0/39856843 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768400f840 con 0x7f768c1b1450 2021-04-09T18:35:37.594 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.574 7f7693121700 1 -- 172.21.15.79:0/39856843 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768c1b1ed0 con 0x7f768c1b1450 2021-04-09T18:35:37.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.574 7f76897fa700 1 -- 172.21.15.79:0/39856843 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7684019070 con 0x7f768c1b1450 2021-04-09T18:35:37.595 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.574 7f7693121700 1 -- 172.21.15.79:0/39856843 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768c0a33f0 con 0x7f768c1b1450 2021-04-09T18:35:37.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.574 7f76897fa700 1 -- 172.21.15.79:0/39856843 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f768400fc10 con 0x7f768c1b1450 2021-04-09T18:35:37.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.574 7f76897fa700 1 --2- 172.21.15.79:0/39856843 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7670029100 0x7f767002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:37.596 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.574 7f76897fa700 1 -- 172.21.15.79:0/39856843 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5104+0+0 (secure 0 0 0) 0x7f7684010040 con 0x7f768c1b1450 2021-04-09T18:35:37.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.574 7f7690ec5700 1 --2- 172.21.15.79:0/39856843 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7670029100 0x7f767002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:37.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.578 7f7690ec5700 1 --2- 172.21.15.79:0/39856843 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7670029100 0x7f767002b650 crc :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:37.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.578 7f7693121700 1 -- 172.21.15.79:0/39856843 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f768c0e39f0 con 0x7f768c1b1450 2021-04-09T18:35:37.597 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.586 7f76897fa700 1 -- 172.21.15.79:0/39856843 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7684000bf0 con 0x7f768c1b1450 2021-04-09T18:35:37.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:37.750 7f7693121700 1 -- 172.21.15.79:0/39856843 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f768c0f5b50 con 0x7f768c1b1450 2021-04-09T18:35:38.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.242 7f76897fa700 1 -- 172.21.15.79:0/39856843 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v131) v1 ==== 133+0+0 (secure 0 0 0) 0x7f768400f630 con 0x7f768c1b1450 2021-04-09T18:35:38.272 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2021-04-09T18:35:38.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.270 7f7693121700 1 -- 172.21.15.79:0/39856843 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7670029100 msgr2=0x7f767002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:38.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.270 7f7693121700 1 --2- 172.21.15.79:0/39856843 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7670029100 0x7f767002b650 crc :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:38.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.270 7f7693121700 1 -- 172.21.15.79:0/39856843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f768c1b1450 msgr2=0x7f768c1b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:38.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.270 7f7693121700 1 --2- 172.21.15.79:0/39856843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f768c1b1450 0x7f768c1b18a0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f768c0974d0 tx=0x7f7684006e70).stop 2021-04-09T18:35:38.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.270 7f7693121700 1 -- 172.21.15.79:0/39856843 shutdown_connections 2021-04-09T18:35:38.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.270 7f7693121700 1 --2- 172.21.15.79:0/39856843 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7670029100 0x7f767002b650 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:38.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.270 7f7693121700 1 --2- 172.21.15.79:0/39856843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f768c1b1450 0x7f768c1b18a0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:38.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.270 7f7693121700 1 --2- 172.21.15.79:0/39856843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f768c0c34f0 0x7f768c0ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:38.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.270 7f7693121700 1 --2- 172.21.15.79:0/39856843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f768c09b280 0x7f768c1c0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:38.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.270 7f7693121700 1 -- 172.21.15.79:0/39856843 >> 172.21.15.79:0/39856843 conn(0x7f768c0a2490 msgr2=0x7f768c0d8580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:38.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.270 7f7693121700 1 -- 172.21.15.79:0/39856843 shutdown_connections 2021-04-09T18:35:38.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.270 7f7693121700 1 -- 172.21.15.79:0/39856843 wait complete. 2021-04-09T18:35:38.295 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-04-09T18:35:38.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f77a566e700 1 Processor -- start 2021-04-09T18:35:38.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f77a566e700 1 -- start start 2021-04-09T18:35:38.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f77a566e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f77a00e9b10 0x7f77a009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:38.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f77a566e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f77a01c8040 0x7f77a01ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:38.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f77a566e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a00fbb50 con 0x7f77a00f5550 2021-04-09T18:35:38.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f77a566e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a01c3df0 con 0x7f77a00e9b10 2021-04-09T18:35:38.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f77a566e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a00e9f60 con 0x7f77a01c8040 2021-04-09T18:35:38.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f779f247700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f77a00f5550 0x7f77a00f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58446/0 (socket says 172.21.15.79:58446) 2021-04-09T18:35:38.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f779f247700 1 -- 172.21.15.79:0/834358931 learned_addr learned my addr 172.21.15.79:0/834358931 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:38.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f7797fff700 1 --2- 172.21.15.79:0/834358931 >> v2:172.21.15.79:3300/0 conn(0x7f77a00e9b10 0x7f77a009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:38.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f779fa48700 1 --2- 172.21.15.79:0/834358931 >> v2:172.21.15.89:3300/0 conn(0x7f77a01c8040 0x7f77a01ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:38.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f779ea46700 1 -- 172.21.15.79:0/834358931 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730352706 0 0) 0x7f77900010d0 con 0x7f77a00f5550 2021-04-09T18:35:38.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f779ea46700 1 -- 172.21.15.79:0/834358931 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f778c003240 con 0x7f77a00f5550 2021-04-09T18:35:38.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f7797fff700 1 -- 172.21.15.79:0/834358931 >> v2:172.21.15.89:3300/0 conn(0x7f77a01c8040 msgr2=0x7f77a01ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:38.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f7797fff700 1 --2- 172.21.15.79:0/834358931 >> v2:172.21.15.89:3300/0 conn(0x7f77a01c8040 0x7f77a01ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:38.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f7797fff700 1 -- 172.21.15.79:0/834358931 >> v1:172.21.15.79:6789/0 conn(0x7f77a00f5550 legacy=0x7f77a00f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:38.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f7797fff700 1 -- 172.21.15.79:0/834358931 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a00e5700 con 0x7f77a00e9b10 2021-04-09T18:35:38.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f7797fff700 1 --2- 172.21.15.79:0/834358931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a00e9b10 0x7f77a009f110 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f7788002f30 tx=0x7f778800bd10).ready entity=mon.0 client_cookie=fae6757b74bffbb2 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:38.429 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f779ea46700 1 -- 172.21.15.79:0/834358931 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f77a00e5700 con 0x7f77a00e9b10 2021-04-09T18:35:38.429 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f779ea46700 1 -- 172.21.15.79:0/834358931 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77880098a0 con 0x7f77a00e9b10 2021-04-09T18:35:38.430 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f779ea46700 1 -- 172.21.15.79:0/834358931 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7788009c70 con 0x7f77a00e9b10 2021-04-09T18:35:38.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f77a566e700 1 -- 172.21.15.79:0/834358931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a00e9b10 msgr2=0x7f77a009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:38.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.406 7f77a566e700 1 --2- 172.21.15.79:0/834358931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a00e9b10 0x7f77a009f110 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f7788002f30 tx=0x7f778800bd10).stop 2021-04-09T18:35:38.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.410 7f77a566e700 1 -- 172.21.15.79:0/834358931 shutdown_connections 2021-04-09T18:35:38.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.410 7f77a566e700 1 --2- 172.21.15.79:0/834358931 >> v2:172.21.15.89:3300/0 conn(0x7f77a01c8040 0x7f77a01ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:38.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.410 7f77a566e700 1 --2- 172.21.15.79:0/834358931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a00e9b10 0x7f77a009f110 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:38.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.410 7f77a566e700 1 -- 172.21.15.79:0/834358931 >> 172.21.15.79:0/834358931 conn(0x7f77a00e6010 msgr2=0x7f77a00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:38.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.410 7f77a566e700 1 -- 172.21.15.79:0/834358931 shutdown_connections 2021-04-09T18:35:38.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.410 7f77a566e700 1 -- 172.21.15.79:0/834358931 wait complete. 2021-04-09T18:35:38.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f77a566e700 1 Processor -- start 2021-04-09T18:35:38.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f77a566e700 1 -- start start 2021-04-09T18:35:38.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f77a566e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77a00acf60 0x7f77a0094fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:38.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f77a566e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a009adb0 0x7f77a00d0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:38.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f77a566e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77a0099fe0 0x7f77a009a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:38.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f77a566e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a0094cb0 con 0x7f77a009adb0 2021-04-09T18:35:38.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f77a566e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00944d0 con 0x7f77a0099fe0 2021-04-09T18:35:38.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f77a566e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a0094840 con 0x7f77a00acf60 2021-04-09T18:35:38.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f7797fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a009adb0 0x7f77a00d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:38.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f7797fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a009adb0 0x7f77a00d0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35512/0 (socket says 172.21.15.79:35512) 2021-04-09T18:35:38.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f7797fff700 1 -- 172.21.15.79:0/132476783 learned_addr learned my addr 172.21.15.79:0/132476783 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:38.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f779f247700 1 --2- 172.21.15.79:0/132476783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77a00acf60 0x7f77a0094fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:38.449 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f779fa48700 1 --2- 172.21.15.79:0/132476783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77a0099fe0 0x7f77a009a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:38.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f7797fff700 1 -- 172.21.15.79:0/132476783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77a00acf60 msgr2=0x7f77a0094fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:38.450 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f7797fff700 1 --2- 172.21.15.79:0/132476783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77a00acf60 0x7f77a0094fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:38.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f7797fff700 1 -- 172.21.15.79:0/132476783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77a0099fe0 msgr2=0x7f77a009a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:38.451 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f7797fff700 1 --2- 172.21.15.79:0/132476783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77a0099fe0 0x7f77a009a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:38.452 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f7797fff700 1 -- 172.21.15.79:0/132476783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a00d10a0 con 0x7f77a009adb0 2021-04-09T18:35:38.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f779f247700 1 --2- 172.21.15.79:0/132476783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77a00acf60 0x7f77a0094fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:38.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f7797fff700 1 --2- 172.21.15.79:0/132476783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a009adb0 0x7f77a00d0a70 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f7788002f30 tx=0x7f7788006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:38.453 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f779ca42700 1 -- 172.21.15.79:0/132476783 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f77a00d10a0 con 0x7f77a009adb0 2021-04-09T18:35:38.454 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f779ca42700 1 -- 172.21.15.79:0/132476783 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7788011c50 con 0x7f77a009adb0 2021-04-09T18:35:38.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f77a566e700 1 -- 172.21.15.79:0/132476783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a009aa60 con 0x7f77a009adb0 2021-04-09T18:35:38.455 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f779ca42700 1 -- 172.21.15.79:0/132476783 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f778801d630 con 0x7f77a009adb0 2021-04-09T18:35:38.456 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.414 7f77a566e700 1 -- 172.21.15.79:0/132476783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a01aa590 con 0x7f77a009adb0 2021-04-09T18:35:38.457 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.418 7f779ca42700 1 -- 172.21.15.79:0/132476783 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7788026450 con 0x7f77a009adb0 2021-04-09T18:35:38.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.418 7f779ca42700 1 --2- 172.21.15.79:0/132476783 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7784029100 0x7f778402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:38.458 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.418 7f779ca42700 1 -- 172.21.15.79:0/132476783 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5458+0+0 (secure 0 0 0) 0x7f778803ad10 con 0x7f77a009adb0 2021-04-09T18:35:38.462 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.418 7f779f247700 1 --2- 172.21.15.79:0/132476783 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7784029100 0x7f778402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:38.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.418 7f779f247700 1 --2- 172.21.15.79:0/132476783 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7784029100 0x7f778402b650 crc :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:38.463 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.434 7f77a566e700 1 -- 172.21.15.79:0/132476783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a00e39f0 con 0x7f77a009adb0 2021-04-09T18:35:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.442 7f779ca42700 1 -- 172.21.15.79:0/132476783 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7788009690 con 0x7f77a009adb0 2021-04-09T18:35:38.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:38.598 7f77a566e700 1 -- 172.21.15.79:0/132476783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f77a00f5b50 con 0x7f77a009adb0 2021-04-09T18:35:39.255 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.250 7f779ca42700 1 -- 172.21.15.79:0/132476783 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v132) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7788011a40 con 0x7f77a009adb0 2021-04-09T18:35:39.271 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2021-04-09T18:35:39.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.266 7f77a566e700 1 -- 172.21.15.79:0/132476783 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7784029100 msgr2=0x7f778402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:39.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.266 7f77a566e700 1 --2- 172.21.15.79:0/132476783 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7784029100 0x7f778402b650 crc :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.266 7f77a566e700 1 -- 172.21.15.79:0/132476783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a009adb0 msgr2=0x7f77a00d0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:39.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.266 7f77a566e700 1 --2- 172.21.15.79:0/132476783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a009adb0 0x7f77a00d0a70 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f7788002f30 tx=0x7f7788006890).stop 2021-04-09T18:35:39.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.266 7f77a566e700 1 -- 172.21.15.79:0/132476783 shutdown_connections 2021-04-09T18:35:39.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.266 7f77a566e700 1 --2- 172.21.15.79:0/132476783 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7784029100 0x7f778402b650 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.266 7f77a566e700 1 --2- 172.21.15.79:0/132476783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77a0099fe0 0x7f77a009a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.266 7f77a566e700 1 --2- 172.21.15.79:0/132476783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77a00acf60 0x7f77a0094fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.266 7f77a566e700 1 --2- 172.21.15.79:0/132476783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a009adb0 0x7f77a00d0a70 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.266 7f77a566e700 1 -- 172.21.15.79:0/132476783 >> 172.21.15.79:0/132476783 conn(0x7f77a0093cf0 msgr2=0x7f77a008eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:39.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.266 7f77a566e700 1 -- 172.21.15.79:0/132476783 shutdown_connections 2021-04-09T18:35:39.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.266 7f77a566e700 1 -- 172.21.15.79:0/132476783 wait complete. 2021-04-09T18:35:39.286 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-04-09T18:35:39.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5e0e04700 1 Processor -- start 2021-04-09T18:35:39.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5e0e04700 1 -- start start 2021-04-09T18:35:39.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5e0e04700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5dc0e9b00 0x7fc5dc09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:39.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5e0e04700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5dc1c8030 0x7fc5dc1ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:39.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5e0e04700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5dc0fbb40 con 0x7fc5dc0f5540 2021-04-09T18:35:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5e0e04700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5dc1c3de0 con 0x7fc5dc1c8030 2021-04-09T18:35:39.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5e0e04700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0e9f50 con 0x7fc5dc0e9b00 2021-04-09T18:35:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5daaef700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc5dc0f5540 0x7fc5dc0f64d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58460/0 (socket says 172.21.15.79:58460) 2021-04-09T18:35:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5daaef700 1 -- 172.21.15.79:0/171501676 learned_addr learned my addr 172.21.15.79:0/171501676 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:39.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5da2ee700 1 --2- 172.21.15.79:0/171501676 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5dc0e9b00 0x7fc5dc09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:39.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5db2f0700 1 --2- 172.21.15.79:0/171501676 >> v2:172.21.15.89:3300/0 conn(0x7fc5dc1c8030 0x7fc5dc1ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:39.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5d9aed700 1 -- 172.21.15.79:0/171501676 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302511273 0 0) 0x7fc5cc001450 con 0x7fc5dc0f5540 2021-04-09T18:35:39.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5d9aed700 1 -- 172.21.15.79:0/171501676 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5c8003240 con 0x7fc5dc0f5540 2021-04-09T18:35:39.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5db2f0700 1 -- 172.21.15.79:0/171501676 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5dc0e9b00 msgr2=0x7fc5dc09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:39.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5db2f0700 1 --2- 172.21.15.79:0/171501676 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5dc0e9b00 0x7fc5dc09f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5db2f0700 1 -- 172.21.15.79:0/171501676 >> v1:172.21.15.79:6789/0 conn(0x7fc5dc0f5540 legacy=0x7fc5dc0f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:39.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5db2f0700 1 -- 172.21.15.79:0/171501676 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc0e56f0 con 0x7fc5dc1c8030 2021-04-09T18:35:39.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5da2ee700 1 --2- 172.21.15.79:0/171501676 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5dc0e9b00 0x7fc5dc09f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:39.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5db2f0700 1 --2- 172.21.15.79:0/171501676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5dc1c8030 0x7fc5dc1ca490 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fc5d4002f30 tx=0x7fc5d400bd40).ready entity=mon.1 client_cookie=4991670b2bc3bc3d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:39.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5d9aed700 1 -- 172.21.15.79:0/171501676 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc5dc0e56f0 con 0x7fc5dc1c8030 2021-04-09T18:35:39.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5d9aed700 1 -- 172.21.15.79:0/171501676 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d4009850 con 0x7fc5dc1c8030 2021-04-09T18:35:39.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5d9aed700 1 -- 172.21.15.79:0/171501676 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc5d4009c20 con 0x7fc5dc1c8030 2021-04-09T18:35:39.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5e0e04700 1 -- 172.21.15.79:0/171501676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5dc1c8030 msgr2=0x7fc5dc1ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:39.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5e0e04700 1 --2- 172.21.15.79:0/171501676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5dc1c8030 0x7fc5dc1ca490 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fc5d4002f30 tx=0x7fc5d400bd40).stop 2021-04-09T18:35:39.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5e0e04700 1 -- 172.21.15.79:0/171501676 shutdown_connections 2021-04-09T18:35:39.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5e0e04700 1 --2- 172.21.15.79:0/171501676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5dc1c8030 0x7fc5dc1ca490 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5e0e04700 1 --2- 172.21.15.79:0/171501676 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5dc0e9b00 0x7fc5dc09f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5e0e04700 1 -- 172.21.15.79:0/171501676 >> 172.21.15.79:0/171501676 conn(0x7fc5dc0e6000 msgr2=0x7fc5dc0e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:39.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5e0e04700 1 -- 172.21.15.79:0/171501676 shutdown_connections 2021-04-09T18:35:39.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.402 7fc5e0e04700 1 -- 172.21.15.79:0/171501676 wait complete. 2021-04-09T18:35:39.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.406 7fc5e0e04700 1 Processor -- start 2021-04-09T18:35:39.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.406 7fc5e0e04700 1 -- start start 2021-04-09T18:35:39.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.406 7fc5e0e04700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5dc098e70 0x7fc5dc0d4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:39.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.406 7fc5e0e04700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5dc0a2e60 0x7fc5dc1b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:39.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.406 7fc5e0e04700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5dc0a32b0 0x7fc5dc1b1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:39.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.406 7fc5e0e04700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0976b0 con 0x7fc5dc0a2e60 2021-04-09T18:35:39.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.406 7fc5e0e04700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc1b1ba0 con 0x7fc5dc0a32b0 2021-04-09T18:35:39.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.406 7fc5e0e04700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0a3d40 con 0x7fc5dc098e70 2021-04-09T18:35:39.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.406 7fc5daaef700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5dc098e70 0x7fc5dc0d4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:39.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.406 7fc5da2ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5dc0a2e60 0x7fc5dc1b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:39.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.406 7fc5daaef700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5dc098e70 0x7fc5dc0d4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:60752/0 (socket says 172.21.15.79:60752) 2021-04-09T18:35:39.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.406 7fc5daaef700 1 -- 172.21.15.79:0/2996518958 learned_addr learned my addr 172.21.15.79:0/2996518958 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:39.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.410 7fc5db2f0700 1 --2- 172.21.15.79:0/2996518958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5dc0a32b0 0x7fc5dc1b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:39.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.410 7fc5daaef700 1 -- 172.21.15.79:0/2996518958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5dc0a32b0 msgr2=0x7fc5dc1b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:39.438 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.410 7fc5daaef700 1 --2- 172.21.15.79:0/2996518958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5dc0a32b0 0x7fc5dc1b1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.439 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.410 7fc5daaef700 1 -- 172.21.15.79:0/2996518958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5dc0a2e60 msgr2=0x7fc5dc1b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:39.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.410 7fc5daaef700 1 --2- 172.21.15.79:0/2996518958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5dc0a2e60 0x7fc5dc1b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.410 7fc5daaef700 1 -- 172.21.15.79:0/2996518958 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc0d53c0 con 0x7fc5dc098e70 2021-04-09T18:35:39.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.410 7fc5daaef700 1 --2- 172.21.15.79:0/2996518958 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5dc098e70 0x7fc5dc0d4d90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fc5cc000f00 tx=0x7fc5cc00cde0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:39.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.410 7fc5d37fe700 1 -- 172.21.15.79:0/2996518958 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc5dc0d53c0 con 0x7fc5dc098e70 2021-04-09T18:35:39.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.410 7fc5d37fe700 1 -- 172.21.15.79:0/2996518958 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5cc005c50 con 0x7fc5dc098e70 2021-04-09T18:35:39.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.410 7fc5e0e04700 1 -- 172.21.15.79:0/2996518958 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5dc0b5a40 con 0x7fc5dc098e70 2021-04-09T18:35:39.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.410 7fc5d37fe700 1 -- 172.21.15.79:0/2996518958 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc5cc007300 con 0x7fc5dc098e70 2021-04-09T18:35:39.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.410 7fc5e0e04700 1 -- 172.21.15.79:0/2996518958 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5dc0b5f20 con 0x7fc5dc098e70 2021-04-09T18:35:39.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.410 7fc5d37fe700 1 -- 172.21.15.79:0/2996518958 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc5cc01a060 con 0x7fc5dc098e70 2021-04-09T18:35:39.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.410 7fc5d37fe700 1 --2- 172.21.15.79:0/2996518958 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc5c0029100 0x7fc5c002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:39.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.410 7fc5d37fe700 1 -- 172.21.15.79:0/2996518958 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc5cc039170 con 0x7fc5dc098e70 2021-04-09T18:35:39.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.410 7fc5da2ee700 1 --2- 172.21.15.79:0/2996518958 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc5c0029100 0x7fc5c002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:39.447 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.410 7fc5da2ee700 1 --2- 172.21.15.79:0/2996518958 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc5c0029100 0x7fc5c002b650 crc :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:39.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.414 7fc5e0e04700 1 -- 172.21.15.79:0/2996518958 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5dc0e39e0 con 0x7fc5dc098e70 2021-04-09T18:35:39.448 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.422 7fc5d37fe700 1 -- 172.21.15.79:0/2996518958 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc5cc005a40 con 0x7fc5dc098e70 2021-04-09T18:35:39.592 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.586 7fc5e0e04700 1 -- 172.21.15.79:0/2996518958 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7fc5dc0f5b40 con 0x7fc5dc098e70 2021-04-09T18:35:39.603 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.598 7fc5d37fe700 1 -- 172.21.15.79:0/2996518958 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 26 and data pool 27 v83) v1 ==== 189+0+0 (secure 0 0 0) 0x7fc5dc107f70 con 0x7fc5dc098e70 2021-04-09T18:35:39.608 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 26 and data pool 27 2021-04-09T18:35:39.611 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.606 7fc5e0e04700 1 -- 172.21.15.79:0/2996518958 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc5c0029100 msgr2=0x7fc5c002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:39.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.606 7fc5e0e04700 1 --2- 172.21.15.79:0/2996518958 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc5c0029100 0x7fc5c002b650 crc :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.606 7fc5e0e04700 1 -- 172.21.15.79:0/2996518958 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5dc098e70 msgr2=0x7fc5dc0d4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:39.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.606 7fc5e0e04700 1 --2- 172.21.15.79:0/2996518958 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5dc098e70 0x7fc5dc0d4d90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fc5cc000f00 tx=0x7fc5cc00cde0).stop 2021-04-09T18:35:39.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.606 7fc5e0e04700 1 -- 172.21.15.79:0/2996518958 shutdown_connections 2021-04-09T18:35:39.612 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.606 7fc5e0e04700 1 --2- 172.21.15.79:0/2996518958 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc5c0029100 0x7fc5c002b650 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.606 7fc5e0e04700 1 --2- 172.21.15.79:0/2996518958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5dc0a32b0 0x7fc5dc1b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.606 7fc5e0e04700 1 --2- 172.21.15.79:0/2996518958 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5dc098e70 0x7fc5dc0d4d90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.606 7fc5e0e04700 1 --2- 172.21.15.79:0/2996518958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5dc0a2e60 0x7fc5dc1b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.613 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.606 7fc5e0e04700 1 -- 172.21.15.79:0/2996518958 >> 172.21.15.79:0/2996518958 conn(0x7fc5dc09aea0 msgr2=0x7fc5dc0d7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:39.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.606 7fc5e0e04700 1 -- 172.21.15.79:0/2996518958 shutdown_connections 2021-04-09T18:35:39.614 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.606 7fc5e0e04700 1 -- 172.21.15.79:0/2996518958 wait complete. 2021-04-09T18:35:39.621 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:35:39.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.706 7fd1aabe0700 1 Processor -- start 2021-04-09T18:35:39.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.706 7fd1aabe0700 1 -- start start 2021-04-09T18:35:39.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.706 7fd1aabe0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd1a40e9ae0 0x7fd1a409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:39.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.706 7fd1aabe0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a40fbb20 con 0x7fd1a40f5520 2021-04-09T18:35:39.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.706 7fd1aabe0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a40e56d0 con 0x7fd1a41c8010 2021-04-09T18:35:39.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.706 7fd1aabe0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a41c3dc0 con 0x7fd1a40e9ae0 2021-04-09T18:35:39.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.706 7fd1a8984700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd1a40f5520 0x7fd1a40f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58474/0 (socket says 172.21.15.79:58474) 2021-04-09T18:35:39.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.706 7fd1a8984700 1 -- 172.21.15.79:0/3517754070 learned_addr learned my addr 172.21.15.79:0/3517754070 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:39.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.706 7fd19bfff700 1 --2- 172.21.15.79:0/3517754070 >> v2:172.21.15.89:3300/0 conn(0x7fd1a40e9ae0 0x7fd1a409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:39.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.706 7fd19b7fe700 1 -- 172.21.15.79:0/3517754070 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015820904 0 0) 0x7fd1a00010d0 con 0x7fd1a40f5520 2021-04-09T18:35:39.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.706 7fd19b7fe700 1 -- 172.21.15.79:0/3517754070 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd18c003240 con 0x7fd1a40f5520 2021-04-09T18:35:39.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.706 7fd19bfff700 1 -- 172.21.15.79:0/3517754070 >> v1:172.21.15.89:6789/0 conn(0x7fd1a41c8010 legacy=0x7fd1a41ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:39.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.706 7fd19bfff700 1 -- 172.21.15.79:0/3517754070 >> v1:172.21.15.79:6789/0 conn(0x7fd1a40f5520 legacy=0x7fd1a40f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:39.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.706 7fd19bfff700 1 -- 172.21.15.79:0/3517754070 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a40e4330 con 0x7fd1a40e9ae0 2021-04-09T18:35:39.734 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.706 7fd19bfff700 1 --2- 172.21.15.79:0/3517754070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1a40e9ae0 0x7fd1a409f110 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fd194002f30 tx=0x7fd19400bcc0).ready entity=mon.1 client_cookie=af161172e751a507 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:39.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.710 7fd19b7fe700 1 -- 172.21.15.79:0/3517754070 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1a40e4330 con 0x7fd1a40e9ae0 2021-04-09T18:35:39.735 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.710 7fd19b7fe700 1 -- 172.21.15.79:0/3517754070 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd194009800 con 0x7fd1a40e9ae0 2021-04-09T18:35:39.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.710 7fd19b7fe700 1 -- 172.21.15.79:0/3517754070 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd194009bd0 con 0x7fd1a40e9ae0 2021-04-09T18:35:39.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.710 7fd1aabe0700 1 -- 172.21.15.79:0/3517754070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1a40e9ae0 msgr2=0x7fd1a409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:39.736 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.710 7fd1aabe0700 1 --2- 172.21.15.79:0/3517754070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1a40e9ae0 0x7fd1a409f110 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fd194002f30 tx=0x7fd19400bcc0).stop 2021-04-09T18:35:39.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.710 7fd1aabe0700 1 -- 172.21.15.79:0/3517754070 shutdown_connections 2021-04-09T18:35:39.737 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.710 7fd1aabe0700 1 --2- 172.21.15.79:0/3517754070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1a40e9ae0 0x7fd1a409f110 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.710 7fd1aabe0700 1 -- 172.21.15.79:0/3517754070 >> 172.21.15.79:0/3517754070 conn(0x7fd1a40e5fe0 msgr2=0x7fd1a40e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:39.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.710 7fd1aabe0700 1 -- 172.21.15.79:0/3517754070 shutdown_connections 2021-04-09T18:35:39.738 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.710 7fd1aabe0700 1 -- 172.21.15.79:0/3517754070 wait complete. 2021-04-09T18:35:39.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.714 7fd1aabe0700 1 Processor -- start 2021-04-09T18:35:39.739 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.714 7fd1aabe0700 1 -- start start 2021-04-09T18:35:39.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.714 7fd1aabe0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1a41af560 0x7fd1a40ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:39.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.714 7fd1aabe0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a41af9b0 0x7fd1a40d50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:39.740 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.714 7fd1aabe0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a40d56f0 0x7fd1a40989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:39.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.714 7fd1aabe0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a40e9f30 con 0x7fd1a41af9b0 2021-04-09T18:35:39.741 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.714 7fd1aabe0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a40986d0 con 0x7fd1a41af560 2021-04-09T18:35:39.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.714 7fd1aabe0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a40acdd0 con 0x7fd1a40d56f0 2021-04-09T18:35:39.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.714 7fd19bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a41af9b0 0x7fd1a40d50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:39.742 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.714 7fd19bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a41af9b0 0x7fd1a40d50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35540/0 (socket says 172.21.15.79:35540) 2021-04-09T18:35:39.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.714 7fd19bfff700 1 -- 172.21.15.79:0/2953980400 learned_addr learned my addr 172.21.15.79:0/2953980400 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:39.743 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.714 7fd1a8984700 1 --2- 172.21.15.79:0/2953980400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1a41af560 0x7fd1a40ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:39.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.714 7fd1a9185700 1 --2- 172.21.15.79:0/2953980400 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a40d56f0 0x7fd1a40989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:39.744 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.714 7fd19bfff700 1 -- 172.21.15.79:0/2953980400 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a40d56f0 msgr2=0x7fd1a40989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:39.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.714 7fd19bfff700 1 --2- 172.21.15.79:0/2953980400 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a40d56f0 0x7fd1a40989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.714 7fd19bfff700 1 -- 172.21.15.79:0/2953980400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1a41af560 msgr2=0x7fd1a40ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:39.745 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.714 7fd19bfff700 1 --2- 172.21.15.79:0/2953980400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1a41af560 0x7fd1a40ac7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.714 7fd19bfff700 1 -- 172.21.15.79:0/2953980400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a4098260 con 0x7fd1a41af9b0 2021-04-09T18:35:39.746 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.718 7fd19bfff700 1 --2- 172.21.15.79:0/2953980400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a41af9b0 0x7fd1a40d50c0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7fd1a40d8240 tx=0x7fd194006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:39.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.718 7fd1997fa700 1 -- 172.21.15.79:0/2953980400 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1a4098260 con 0x7fd1a41af9b0 2021-04-09T18:35:39.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.718 7fd1997fa700 1 -- 172.21.15.79:0/2953980400 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd194011c40 con 0x7fd1a41af9b0 2021-04-09T18:35:39.747 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.718 7fd1997fa700 1 -- 172.21.15.79:0/2953980400 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd19401d630 con 0x7fd1a41af9b0 2021-04-09T18:35:39.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.718 7fd1aabe0700 1 -- 172.21.15.79:0/2953980400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a4099000 con 0x7fd1a41af9b0 2021-04-09T18:35:39.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.718 7fd1aabe0700 1 -- 172.21.15.79:0/2953980400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a40993f0 con 0x7fd1a41af9b0 2021-04-09T18:35:39.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.718 7fd1aabe0700 1 -- 172.21.15.79:0/2953980400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a40e39e0 con 0x7fd1a41af9b0 2021-04-09T18:35:39.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.722 7fd1997fa700 1 -- 172.21.15.79:0/2953980400 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd19401d830 con 0x7fd1a41af9b0 2021-04-09T18:35:39.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.722 7fd1997fa700 1 --2- 172.21.15.79:0/2953980400 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd184029100 0x7fd18402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:39.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.722 7fd1997fa700 1 -- 172.21.15.79:0/2953980400 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5924+0+0 (secure 0 0 0) 0x7fd19403b440 con 0x7fd1a41af9b0 2021-04-09T18:35:39.750 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.722 7fd1a8984700 1 --2- 172.21.15.79:0/2953980400 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd184029100 0x7fd18402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:39.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.722 7fd1a8984700 1 --2- 172.21.15.79:0/2953980400 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd184029100 0x7fd18402b650 crc :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:39.752 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.730 7fd1997fa700 1 -- 172.21.15.79:0/2953980400 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd1940095f0 con 0x7fd1a41af9b0 2021-04-09T18:35:39.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.894 7fd1aabe0700 1 -- 172.21.15.79:0/2953980400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1a40f5b20 con 0x7fd1a41af9b0 2021-04-09T18:35:39.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.894 7fd1997fa700 1 -- 172.21.15.79:0/2953980400 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+14253 (secure 0 0 0) 0x7fd194011a30 con 0x7fd1a41af9b0 2021-04-09T18:35:39.904 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:39.904 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":133,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:35:39.593051","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:35:37.809302","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2021-04-09 18:35:38.660109","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:35:39.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.898 7fd1aabe0700 1 -- 172.21.15.79:0/2953980400 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd184029100 msgr2=0x7fd18402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:39.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.898 7fd1aabe0700 1 --2- 172.21.15.79:0/2953980400 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd184029100 0x7fd18402b650 crc :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.898 7fd1aabe0700 1 -- 172.21.15.79:0/2953980400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a41af9b0 msgr2=0x7fd1a40d50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:39.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.898 7fd1aabe0700 1 --2- 172.21.15.79:0/2953980400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a41af9b0 0x7fd1a40d50c0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7fd1a40d8240 tx=0x7fd194006890).stop 2021-04-09T18:35:39.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.898 7fd1aabe0700 1 -- 172.21.15.79:0/2953980400 shutdown_connections 2021-04-09T18:35:39.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.898 7fd1aabe0700 1 --2- 172.21.15.79:0/2953980400 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd184029100 0x7fd18402b650 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.898 7fd1aabe0700 1 --2- 172.21.15.79:0/2953980400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1a41af560 0x7fd1a40ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.898 7fd1aabe0700 1 --2- 172.21.15.79:0/2953980400 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a40d56f0 0x7fd1a40989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.898 7fd1aabe0700 1 --2- 172.21.15.79:0/2953980400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a41af9b0 0x7fd1a40d50c0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:39.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.898 7fd1aabe0700 1 -- 172.21.15.79:0/2953980400 >> 172.21.15.79:0/2953980400 conn(0x7fd1a409af80 msgr2=0x7fd1a409a600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:39.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.898 7fd1aabe0700 1 -- 172.21.15.79:0/2953980400 shutdown_connections 2021-04-09T18:35:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:39.898 7fd1aabe0700 1 -- 172.21.15.79:0/2953980400 wait complete. 2021-04-09T18:35:39.917 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:35:40.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1da7fe700 1 Processor -- start 2021-04-09T18:35:40.012 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1da7fe700 1 -- start start 2021-04-09T18:35:40.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1da7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1d40f5510 0x7fb1d40f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:40.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1da7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb1d41c8000 0x7fb1d41ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:40.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1da7fe700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d40fbb10 con 0x7fb1d40e9ad0 2021-04-09T18:35:40.013 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1da7fe700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d40e9f20 con 0x7fb1d41c8000 2021-04-09T18:35:40.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1da7fe700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d41c3db0 con 0x7fb1d40f5510 2021-04-09T18:35:40.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1d8da3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb1d41c8000 0x7fb1d41ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:40.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1d3fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1d40f5510 0x7fb1d40f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:40.014 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1d8da3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb1d41c8000 0x7fb1d41ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:52122/0 (socket says 172.21.15.79:52122) 2021-04-09T18:35:40.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1d8da3700 1 -- 172.21.15.79:0/1399857627 learned_addr learned my addr 172.21.15.79:0/1399857627 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:40.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1d37fe700 1 --1- 172.21.15.79:0/1399857627 >> v1:172.21.15.89:6789/0 conn(0x7fb1d40e9ad0 0x7fb1d409f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:58962/0 (socket says 172.21.15.79:58962) 2021-04-09T18:35:40.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1d3fff700 1 -- 172.21.15.79:0/1399857627 >> v2:172.21.15.89:3300/0 conn(0x7fb1d41c8000 msgr2=0x7fb1d41ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:40.015 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1d3fff700 1 --2- 172.21.15.79:0/1399857627 >> v2:172.21.15.89:3300/0 conn(0x7fb1d41c8000 0x7fb1d41ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1d3fff700 1 -- 172.21.15.79:0/1399857627 >> v1:172.21.15.89:6789/0 conn(0x7fb1d40e9ad0 legacy=0x7fb1d409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:40.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1d3fff700 1 -- 172.21.15.79:0/1399857627 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d409f900 con 0x7fb1d40f5510 2021-04-09T18:35:40.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1d8da3700 1 --2- 172.21.15.79:0/1399857627 >> v2:172.21.15.89:3300/0 conn(0x7fb1d41c8000 0x7fb1d41ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:40.016 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1d3fff700 1 --2- 172.21.15.79:0/1399857627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1d40f5510 0x7fb1d40f64a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fb1c40016c0 tx=0x7fb1c40013c0).ready entity=mon.2 client_cookie=35040ed9e6c692b2 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:40.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1d2ffd700 1 -- 172.21.15.79:0/1399857627 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb1d409f900 con 0x7fb1d40f5510 2021-04-09T18:35:40.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1d2ffd700 1 -- 172.21.15.79:0/1399857627 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc0096c0 con 0x7fb1d40f5510 2021-04-09T18:35:40.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1d2ffd700 1 -- 172.21.15.79:0/1399857627 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb1cc009ad0 con 0x7fb1d40f5510 2021-04-09T18:35:40.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1da7fe700 1 -- 172.21.15.79:0/1399857627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1d40f5510 msgr2=0x7fb1d40f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:40.017 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1da7fe700 1 --2- 172.21.15.79:0/1399857627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1d40f5510 0x7fb1d40f64a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fb1c40016c0 tx=0x7fb1c40013c0).stop 2021-04-09T18:35:40.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1da7fe700 1 -- 172.21.15.79:0/1399857627 shutdown_connections 2021-04-09T18:35:40.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1da7fe700 1 --2- 172.21.15.79:0/1399857627 >> v2:172.21.15.89:3300/0 conn(0x7fb1d41c8000 0x7fb1d41ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1da7fe700 1 --2- 172.21.15.79:0/1399857627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1d40f5510 0x7fb1d40f64a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.018 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1da7fe700 1 -- 172.21.15.79:0/1399857627 >> 172.21.15.79:0/1399857627 conn(0x7fb1d40e5fd0 msgr2=0x7fb1d40e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:40.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1da7fe700 1 -- 172.21.15.79:0/1399857627 shutdown_connections 2021-04-09T18:35:40.019 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.002 7fb1da7fe700 1 -- 172.21.15.79:0/1399857627 wait complete. 2021-04-09T18:35:40.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.006 7fb1da7fe700 1 Processor -- start 2021-04-09T18:35:40.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.006 7fb1da7fe700 1 -- start start 2021-04-09T18:35:40.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.006 7fb1da7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1d40b8260 0x7fb1d40a9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:40.022 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.006 7fb1da7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1d40b6af0 0x7fb1d40b93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:40.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.006 7fb1da7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1d41aaa00 0x7fb1d41aae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:40.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.006 7fb1da7fe700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40b7ad0 con 0x7fb1d40b6af0 2021-04-09T18:35:40.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.006 7fb1da7fe700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40a96b0 con 0x7fb1d40b8260 2021-04-09T18:35:40.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.006 7fb1da7fe700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40b7660 con 0x7fb1d41aaa00 2021-04-09T18:35:40.023 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.006 7fb1d8da3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1d41aaa00 0x7fb1d41aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:40.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.006 7fb1d3fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1d40b8260 0x7fb1d40a9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:40.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.006 7fb1d8da3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1d41aaa00 0x7fb1d41aae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:60782/0 (socket says 172.21.15.79:60782) 2021-04-09T18:35:40.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.006 7fb1d8da3700 1 -- 172.21.15.79:0/4171336264 learned_addr learned my addr 172.21.15.79:0/4171336264 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:40.024 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.006 7fb1d37fe700 1 --2- 172.21.15.79:0/4171336264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1d40b6af0 0x7fb1d40b93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:40.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.006 7fb1d8da3700 1 -- 172.21.15.79:0/4171336264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1d40b8260 msgr2=0x7fb1d40a9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:40.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.006 7fb1d8da3700 1 --2- 172.21.15.79:0/4171336264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1d40b8260 0x7fb1d40a9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.025 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.006 7fb1d8da3700 1 -- 172.21.15.79:0/4171336264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1d40b6af0 msgr2=0x7fb1d40b93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.006 7fb1d8da3700 1 --2- 172.21.15.79:0/4171336264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1d40b6af0 0x7fb1d40b93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.026 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.006 7fb1d8da3700 1 -- 172.21.15.79:0/4171336264 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d40b7dd0 con 0x7fb1d41aaa00 2021-04-09T18:35:40.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.006 7fb1d8da3700 1 --2- 172.21.15.79:0/4171336264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1d41aaa00 0x7fb1d41aae50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fb1d4093ee0 tx=0x7fb1c800c430).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:40.027 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.010 7fb1d0ff9700 1 -- 172.21.15.79:0/4171336264 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb1d40b7dd0 con 0x7fb1d41aaa00 2021-04-09T18:35:40.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.010 7fb1d0ff9700 1 -- 172.21.15.79:0/4171336264 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c800cc50 con 0x7fb1d41aaa00 2021-04-09T18:35:40.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.010 7fb1da7fe700 1 -- 172.21.15.79:0/4171336264 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d40b99f0 con 0x7fb1d41aaa00 2021-04-09T18:35:40.028 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.010 7fb1d0ff9700 1 -- 172.21.15.79:0/4171336264 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb1c800f040 con 0x7fb1d41aaa00 2021-04-09T18:35:40.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.010 7fb1da7fe700 1 -- 172.21.15.79:0/4171336264 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d41aeca0 con 0x7fb1d41aaa00 2021-04-09T18:35:40.029 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.010 7fb1d0ff9700 1 -- 172.21.15.79:0/4171336264 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb1c8022060 con 0x7fb1d41aaa00 2021-04-09T18:35:40.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.010 7fb1d0ff9700 1 --2- 172.21.15.79:0/4171336264 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb1b4029100 0x7fb1b402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:40.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.010 7fb1d0ff9700 1 -- 172.21.15.79:0/4171336264 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fb1c8010040 con 0x7fb1d41aaa00 2021-04-09T18:35:40.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.010 7fb1d3fff700 1 --2- 172.21.15.79:0/4171336264 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb1b4029100 0x7fb1b402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:40.030 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.010 7fb1d3fff700 1 --2- 172.21.15.79:0/4171336264 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb1b4029100 0x7fb1b402b650 crc :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:40.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.014 7fb1da7fe700 1 -- 172.21.15.79:0/4171336264 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d40e39d0 con 0x7fb1d41aaa00 2021-04-09T18:35:40.031 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.022 7fb1d0ff9700 1 -- 172.21.15.79:0/4171336264 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb1c800ca40 con 0x7fb1d41aaa00 2021-04-09T18:35:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.182 7fb1da7fe700 1 -- 172.21.15.79:0/4171336264 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1d40f5b10 con 0x7fb1d41aaa00 2021-04-09T18:35:40.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.182 7fb1d0ff9700 1 -- 172.21.15.79:0/4171336264 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+14359 (secure 0 0 0) 0x7fb1d40f76b0 con 0x7fb1d41aaa00 2021-04-09T18:35:40.191 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:40.192 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":135,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:35:39.987855","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:35:37.809302","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2021-04-09 18:35:38.660109","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6835/1552365531":"2021-04-10 18:35:39.980332","172.21.15.89:6834/1552365531":"2021-04-10 18:35:39.980332"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:35:40.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.186 7fb1da7fe700 1 -- 172.21.15.79:0/4171336264 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb1b4029100 msgr2=0x7fb1b402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:40.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.186 7fb1da7fe700 1 --2- 172.21.15.79:0/4171336264 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb1b4029100 0x7fb1b402b650 crc :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.186 7fb1da7fe700 1 -- 172.21.15.79:0/4171336264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1d41aaa00 msgr2=0x7fb1d41aae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:40.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.186 7fb1da7fe700 1 --2- 172.21.15.79:0/4171336264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1d41aaa00 0x7fb1d41aae50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fb1d4093ee0 tx=0x7fb1c800c430).stop 2021-04-09T18:35:40.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.186 7fb1da7fe700 1 -- 172.21.15.79:0/4171336264 shutdown_connections 2021-04-09T18:35:40.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.186 7fb1da7fe700 1 --2- 172.21.15.79:0/4171336264 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb1b4029100 0x7fb1b402b650 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.186 7fb1da7fe700 1 --2- 172.21.15.79:0/4171336264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1d40b8260 0x7fb1d40a9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.186 7fb1da7fe700 1 --2- 172.21.15.79:0/4171336264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1d41aaa00 0x7fb1d41aae50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.186 7fb1da7fe700 1 --2- 172.21.15.79:0/4171336264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1d40b6af0 0x7fb1d40b93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.186 7fb1da7fe700 1 -- 172.21.15.79:0/4171336264 >> 172.21.15.79:0/4171336264 conn(0x7fb1d4093f20 msgr2=0x7fb1d40d7800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:40.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.186 7fb1da7fe700 1 -- 172.21.15.79:0/4171336264 shutdown_connections 2021-04-09T18:35:40.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.186 7fb1da7fe700 1 -- 172.21.15.79:0/4171336264 wait complete. 2021-04-09T18:35:40.204 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-04-09T18:35:40.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.290 7f59f92ca700 1 Processor -- start 2021-04-09T18:35:40.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.290 7f59f92ca700 1 -- start start 2021-04-09T18:35:40.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.290 7f59f92ca700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f59f40f5550 0x7f59f40f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:40.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.290 7f59f92ca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59f41c8040 0x7f59f41ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:40.305 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.290 7f59f92ca700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f40fbb50 con 0x7f59f40e9b10 2021-04-09T18:35:40.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.290 7f59f92ca700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f40e9f60 con 0x7f59f40f5550 2021-04-09T18:35:40.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.290 7f59f92ca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f41c3df0 con 0x7f59f41c8040 2021-04-09T18:35:40.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.290 7f59f3005700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f59f40f5550 0x7f59f40f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:40.306 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.294 7f59f3005700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f59f40f5550 0x7f59f40f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35562/0 (socket says 172.21.15.79:35562) 2021-04-09T18:35:40.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.294 7f59f3005700 1 -- 172.21.15.79:0/724732876 learned_addr learned my addr 172.21.15.79:0/724732876 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:40.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.294 7f59f3806700 1 --2- 172.21.15.79:0/724732876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59f41c8040 0x7f59f41ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:40.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.294 7f59f3005700 1 -- 172.21.15.79:0/724732876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59f41c8040 msgr2=0x7f59f41ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:40.307 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.294 7f59f3005700 1 --2- 172.21.15.79:0/724732876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59f41c8040 0x7f59f41ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.294 7f59f3005700 1 -- 172.21.15.79:0/724732876 >> v1:172.21.15.89:6789/0 conn(0x7f59f40e9b10 legacy=0x7f59f409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:40.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.294 7f59f2003700 1 -- 172.21.15.79:0/724732876 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 628895586 0 0) 0x7f59e80010d0 con 0x7f59f40e9b10 2021-04-09T18:35:40.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.294 7f59f3005700 1 -- 172.21.15.79:0/724732876 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f409f910 con 0x7f59f40f5550 2021-04-09T18:35:40.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.294 7f59f3005700 1 --2- 172.21.15.79:0/724732876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59f40f5550 0x7f59f40f64e0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f59f40f6f30 tx=0x7f59e400bdd0).ready entity=mon.0 client_cookie=c2b7c823548d1b56 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:40.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.294 7f59f2003700 1 -- 172.21.15.79:0/724732876 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59f409f910 con 0x7f59f40f5550 2021-04-09T18:35:40.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.294 7f59f2003700 1 -- 172.21.15.79:0/724732876 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e4009990 con 0x7f59f40f5550 2021-04-09T18:35:40.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.294 7f59f2003700 1 -- 172.21.15.79:0/724732876 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59e4009d60 con 0x7f59f40f5550 2021-04-09T18:35:40.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.294 7f59f92ca700 1 -- 172.21.15.79:0/724732876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59f40f5550 msgr2=0x7f59f40f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:40.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.294 7f59f92ca700 1 --2- 172.21.15.79:0/724732876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59f40f5550 0x7f59f40f64e0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f59f40f6f30 tx=0x7f59e400bdd0).stop 2021-04-09T18:35:40.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.294 7f59f92ca700 1 -- 172.21.15.79:0/724732876 shutdown_connections 2021-04-09T18:35:40.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.294 7f59f92ca700 1 --2- 172.21.15.79:0/724732876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59f41c8040 0x7f59f41ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.294 7f59f92ca700 1 --2- 172.21.15.79:0/724732876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59f40f5550 0x7f59f40f64e0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.294 7f59f92ca700 1 -- 172.21.15.79:0/724732876 >> 172.21.15.79:0/724732876 conn(0x7f59f40e6010 msgr2=0x7f59f40e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:40.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.294 7f59f92ca700 1 -- 172.21.15.79:0/724732876 shutdown_connections 2021-04-09T18:35:40.312 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.294 7f59f92ca700 1 -- 172.21.15.79:0/724732876 wait complete. 2021-04-09T18:35:40.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.298 7f59f92ca700 1 Processor -- start 2021-04-09T18:35:40.315 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.298 7f59f92ca700 1 -- start start 2021-04-09T18:35:40.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.298 7f59f92ca700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59f4096280 0x7f59f40ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:40.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.298 7f59f92ca700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59f41a1440 0x7f59f40bb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:40.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.298 7f59f92ca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59f4098100 0x7f59f4098550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:40.316 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.298 7f59f92ca700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f4096880 con 0x7f59f41a1440 2021-04-09T18:35:40.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.298 7f59f92ca700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f4096b80 con 0x7f59f4096280 2021-04-09T18:35:40.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.298 7f59f92ca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f41c0990 con 0x7f59f4098100 2021-04-09T18:35:40.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.298 7f59f2804700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59f41a1440 0x7f59f40bb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:40.317 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.298 7f59f2804700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59f41a1440 0x7f59f40bb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35568/0 (socket says 172.21.15.79:35568) 2021-04-09T18:35:40.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.298 7f59f2804700 1 -- 172.21.15.79:0/1496449400 learned_addr learned my addr 172.21.15.79:0/1496449400 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:40.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.298 7f59f3005700 1 --2- 172.21.15.79:0/1496449400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59f4096280 0x7f59f40ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:40.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.298 7f59f3806700 1 --2- 172.21.15.79:0/1496449400 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59f4098100 0x7f59f4098550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:40.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.298 7f59f2804700 1 -- 172.21.15.79:0/1496449400 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59f4098100 msgr2=0x7f59f4098550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:40.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.298 7f59f2804700 1 --2- 172.21.15.79:0/1496449400 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59f4098100 0x7f59f4098550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.298 7f59f2804700 1 -- 172.21.15.79:0/1496449400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59f4096280 msgr2=0x7f59f40ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:40.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.298 7f59f2804700 1 --2- 172.21.15.79:0/1496449400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59f4096280 0x7f59f40ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.302 7f59f2804700 1 -- 172.21.15.79:0/1496449400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f41af000 con 0x7f59f41a1440 2021-04-09T18:35:40.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.302 7f59f3005700 1 --2- 172.21.15.79:0/1496449400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59f4096280 0x7f59f40ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:40.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.302 7f59f2804700 1 --2- 172.21.15.79:0/1496449400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59f41a1440 0x7f59f40bb000 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f59f41c0b40 tx=0x7f59e800cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:40.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.302 7f59dbfff700 1 -- 172.21.15.79:0/1496449400 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59f41af000 con 0x7f59f41a1440 2021-04-09T18:35:40.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.302 7f59dbfff700 1 -- 172.21.15.79:0/1496449400 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e8010510 con 0x7f59f41a1440 2021-04-09T18:35:40.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.302 7f59f92ca700 1 -- 172.21.15.79:0/1496449400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f41af2c0 con 0x7f59f41a1440 2021-04-09T18:35:40.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.302 7f59dbfff700 1 -- 172.21.15.79:0/1496449400 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59e80106f0 con 0x7f59f41a1440 2021-04-09T18:35:40.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.302 7f59f92ca700 1 -- 172.21.15.79:0/1496449400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f41af820 con 0x7f59f41a1440 2021-04-09T18:35:40.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.302 7f59dbfff700 1 -- 172.21.15.79:0/1496449400 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f59e8019020 con 0x7f59f41a1440 2021-04-09T18:35:40.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.302 7f59dbfff700 1 --2- 172.21.15.79:0/1496449400 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f59d4029100 0x7f59d402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:40.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.302 7f59dbfff700 1 -- 172.21.15.79:0/1496449400 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f59e8038e30 con 0x7f59f41a1440 2021-04-09T18:35:40.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.302 7f59f3005700 1 --2- 172.21.15.79:0/1496449400 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f59d4029100 0x7f59d402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:40.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.302 7f59f3005700 1 --2- 172.21.15.79:0/1496449400 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f59d4029100 0x7f59d402b650 crc :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:40.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.302 7f59f92ca700 1 -- 172.21.15.79:0/1496449400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f40e39f0 con 0x7f59f41a1440 2021-04-09T18:35:40.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.310 7f59dbfff700 1 -- 172.21.15.79:0/1496449400 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f59e8010300 con 0x7f59f41a1440 2021-04-09T18:35:40.489 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.482 7f59f92ca700 1 -- 172.21.15.79:0/1496449400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f59f40f5b50 con 0x7f59f41a1440 2021-04-09T18:35:40.597 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:35:40.594 7fbcd0516700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:35:40.602 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.594 7f59dbfff700 1 -- 172.21.15.79:0/1496449400 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v84) v1 ==== 118+0+0 (secure 0 0 0) 0x7f59e8000bf0 con 0x7f59f41a1440 2021-04-09T18:35:40.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.650 7f59f92ca700 1 -- 172.21.15.79:0/1496449400 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f59d4029100 msgr2=0x7f59d402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:40.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.650 7f59f92ca700 1 --2- 172.21.15.79:0/1496449400 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f59d4029100 0x7f59d402b650 crc :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.650 7f59f92ca700 1 -- 172.21.15.79:0/1496449400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59f41a1440 msgr2=0x7f59f40bb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:40.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.650 7f59f92ca700 1 --2- 172.21.15.79:0/1496449400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59f41a1440 0x7f59f40bb000 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f59f41c0b40 tx=0x7f59e800cae0).stop 2021-04-09T18:35:40.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.650 7f59f92ca700 1 -- 172.21.15.79:0/1496449400 shutdown_connections 2021-04-09T18:35:40.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.650 7f59f92ca700 1 --2- 172.21.15.79:0/1496449400 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f59d4029100 0x7f59d402b650 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.650 7f59f92ca700 1 --2- 172.21.15.79:0/1496449400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59f4096280 0x7f59f40ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.650 7f59f92ca700 1 --2- 172.21.15.79:0/1496449400 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59f4098100 0x7f59f4098550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.650 7f59f92ca700 1 --2- 172.21.15.79:0/1496449400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59f41a1440 0x7f59f40bb000 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.650 7f59f92ca700 1 -- 172.21.15.79:0/1496449400 >> 172.21.15.79:0/1496449400 conn(0x7f59f40afc30 msgr2=0x7f59f40a6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:40.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.650 7f59f92ca700 1 -- 172.21.15.79:0/1496449400 shutdown_connections 2021-04-09T18:35:40.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.650 7f59f92ca700 1 -- 172.21.15.79:0/1496449400 wait complete. 2021-04-09T18:35:40.670 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:35:40.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.758 7f270c129700 1 Processor -- start 2021-04-09T18:35:40.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.758 7f270c129700 1 -- start start 2021-04-09T18:35:40.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.758 7f270c129700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27040f5510 0x7f27040f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:40.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.758 7f270c129700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27041c8000 0x7f27041ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:40.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.758 7f270c129700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27040fbb10 con 0x7f27040e9ad0 2021-04-09T18:35:40.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.758 7f270c129700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27040e9f20 con 0x7f27041c8000 2021-04-09T18:35:40.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.758 7f270c129700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27041c3db0 con 0x7f27040f5510 2021-04-09T18:35:40.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.758 7f270a6ce700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27041c8000 0x7f27041ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:40.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.762 7f270a6ce700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27041c8000 0x7f27041ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35580/0 (socket says 172.21.15.79:35580) 2021-04-09T18:35:40.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.762 7f270a6ce700 1 -- 172.21.15.79:0/598728226 learned_addr learned my addr 172.21.15.79:0/598728226 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:40.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.762 7f2709ecd700 1 --2- 172.21.15.79:0/598728226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27040f5510 0x7f27040f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:40.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.762 7f270a6ce700 1 -- 172.21.15.79:0/598728226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27040f5510 msgr2=0x7f27040f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:40.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.762 7f270a6ce700 1 --2- 172.21.15.79:0/598728226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27040f5510 0x7f27040f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.762 7f270a6ce700 1 -- 172.21.15.79:0/598728226 >> v1:172.21.15.89:6789/0 conn(0x7f27040e9ad0 legacy=0x7f270409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:40.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.762 7f270a6ce700 1 -- 172.21.15.79:0/598728226 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270409f900 con 0x7f27041c8000 2021-04-09T18:35:40.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.762 7f270a6ce700 1 --2- 172.21.15.79:0/598728226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27041c8000 0x7f27041ca460 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f26fc002f30 tx=0x7f26fc00bda0).ready entity=mon.0 client_cookie=f47e0b562c4015c8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:40.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.762 7f2708ecb700 1 -- 172.21.15.79:0/598728226 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f270409f900 con 0x7f27041c8000 2021-04-09T18:35:40.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.762 7f2708ecb700 1 -- 172.21.15.79:0/598728226 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc0099d0 con 0x7f27041c8000 2021-04-09T18:35:40.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.762 7f2708ecb700 1 -- 172.21.15.79:0/598728226 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f26fc009da0 con 0x7f27041c8000 2021-04-09T18:35:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.762 7f270c129700 1 -- 172.21.15.79:0/598728226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27041c8000 msgr2=0x7f27041ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.762 7f270c129700 1 --2- 172.21.15.79:0/598728226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27041c8000 0x7f27041ca460 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f26fc002f30 tx=0x7f26fc00bda0).stop 2021-04-09T18:35:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.762 7f270c129700 1 -- 172.21.15.79:0/598728226 shutdown_connections 2021-04-09T18:35:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.762 7f270c129700 1 --2- 172.21.15.79:0/598728226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27041c8000 0x7f27041ca460 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.762 7f270c129700 1 --2- 172.21.15.79:0/598728226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27040f5510 0x7f27040f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.762 7f270c129700 1 -- 172.21.15.79:0/598728226 >> 172.21.15.79:0/598728226 conn(0x7f27040e5fd0 msgr2=0x7f27040e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:40.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.762 7f270c129700 1 -- 172.21.15.79:0/598728226 shutdown_connections 2021-04-09T18:35:40.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.762 7f270c129700 1 -- 172.21.15.79:0/598728226 wait complete. 2021-04-09T18:35:40.782 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.766 7f270c129700 1 Processor -- start 2021-04-09T18:35:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.766 7f270c129700 1 -- start start 2021-04-09T18:35:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.766 7f270c129700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27040af4b0 0x7f2704097340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.766 7f270c129700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2704098620 0x7f27040abf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:40.783 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.766 7f270c129700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2704098a70 0x7f27040d4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:40.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.766 7f270c129700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2704098320 con 0x7f2704098620 2021-04-09T18:35:40.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.766 7f270c129700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27040ac980 con 0x7f27040af4b0 2021-04-09T18:35:40.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.766 7f270c129700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2704097bb0 con 0x7f2704098a70 2021-04-09T18:35:40.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.766 7f27096cc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2704098620 0x7f27040abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:40.784 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.766 7f27096cc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2704098620 0x7f27040abf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35584/0 (socket says 172.21.15.79:35584) 2021-04-09T18:35:40.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.766 7f27096cc700 1 -- 172.21.15.79:0/3918628122 learned_addr learned my addr 172.21.15.79:0/3918628122 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:40.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.766 7f2709ecd700 1 --2- 172.21.15.79:0/3918628122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27040af4b0 0x7f2704097340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:40.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.766 7f270a6ce700 1 --2- 172.21.15.79:0/3918628122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2704098a70 0x7f27040d4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:40.785 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.770 7f27096cc700 1 -- 172.21.15.79:0/3918628122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2704098a70 msgr2=0x7f27040d4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:40.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.770 7f27096cc700 1 --2- 172.21.15.79:0/3918628122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2704098a70 0x7f27040d4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.770 7f27096cc700 1 -- 172.21.15.79:0/3918628122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27040af4b0 msgr2=0x7f2704097340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:40.786 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.770 7f27096cc700 1 --2- 172.21.15.79:0/3918628122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27040af4b0 0x7f2704097340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.770 7f27096cc700 1 -- 172.21.15.79:0/3918628122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27040ac5a0 con 0x7f2704098620 2021-04-09T18:35:40.787 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.770 7f27096cc700 1 --2- 172.21.15.79:0/3918628122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2704098620 0x7f27040abf70 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f26ec000b80 tx=0x7f26ec00ca80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:40.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.770 7f27027fc700 1 -- 172.21.15.79:0/3918628122 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f27040ac5a0 con 0x7f2704098620 2021-04-09T18:35:40.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.770 7f27027fc700 1 -- 172.21.15.79:0/3918628122 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ec010510 con 0x7f2704098620 2021-04-09T18:35:40.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.770 7f270c129700 1 -- 172.21.15.79:0/3918628122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27040d5190 con 0x7f2704098620 2021-04-09T18:35:40.788 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.770 7f27027fc700 1 -- 172.21.15.79:0/3918628122 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f26ec0106f0 con 0x7f2704098620 2021-04-09T18:35:40.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.770 7f270c129700 1 -- 172.21.15.79:0/3918628122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27040acdd0 con 0x7f2704098620 2021-04-09T18:35:40.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.770 7f27027fc700 1 -- 172.21.15.79:0/3918628122 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f26ec019020 con 0x7f2704098620 2021-04-09T18:35:40.789 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.770 7f27027fc700 1 --2- 172.21.15.79:0/3918628122 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f26e8029100 0x7f26e802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:40.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.770 7f27027fc700 1 -- 172.21.15.79:0/3918628122 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f26ec038f40 con 0x7f2704098620 2021-04-09T18:35:40.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.770 7f2709ecd700 1 --2- 172.21.15.79:0/3918628122 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f26e8029100 0x7f26e802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:40.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.770 7f2709ecd700 1 --2- 172.21.15.79:0/3918628122 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f26e8029100 0x7f26e802b650 crc :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:40.790 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.774 7f270c129700 1 -- 172.21.15.79:0/3918628122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27040e39d0 con 0x7f2704098620 2021-04-09T18:35:40.791 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.782 7f27027fc700 1 -- 172.21.15.79:0/3918628122 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f26ec010300 con 0x7f2704098620 2021-04-09T18:35:40.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.954 7f270c129700 1 -- 172.21.15.79:0/3918628122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27040f5b10 con 0x7f2704098620 2021-04-09T18:35:40.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.954 7f27027fc700 1 -- 172.21.15.79:0/3918628122 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+2109 (secure 0 0 0) 0x7f26ec000bf0 con 0x7f2704098620 2021-04-09T18:35:40.962 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 85 2021-04-09T18:35:40.962 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:40.963 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":85,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8175,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/2663381192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2663381192},{"type":"v1","addr":"172.21.15.79:6833","nonce":2663381192}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:35:39.593350","modified":"2021-04-09 18:35:40.601307","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7055":{"gid":7055,"name":"b","rank":0,"incarnation":85,"state":"up:creating","state_seq":2,"addr":"172.21.15.89:6835/4071560647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":4071560647},{"type":"v1","addr":"172.21.15.89:6835","nonce":4071560647}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-04-09T18:35:40.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.958 7f270c129700 1 -- 172.21.15.79:0/3918628122 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f26e8029100 msgr2=0x7f26e802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:40.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.958 7f270c129700 1 --2- 172.21.15.79:0/3918628122 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f26e8029100 0x7f26e802b650 crc :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.958 7f270c129700 1 -- 172.21.15.79:0/3918628122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2704098620 msgr2=0x7f27040abf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:40.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.958 7f270c129700 1 --2- 172.21.15.79:0/3918628122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2704098620 0x7f27040abf70 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f26ec000b80 tx=0x7f26ec00ca80).stop 2021-04-09T18:35:40.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.958 7f270c129700 1 -- 172.21.15.79:0/3918628122 shutdown_connections 2021-04-09T18:35:40.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.958 7f270c129700 1 --2- 172.21.15.79:0/3918628122 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f26e8029100 0x7f26e802b650 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.958 7f270c129700 1 --2- 172.21.15.79:0/3918628122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27040af4b0 0x7f2704097340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.958 7f270c129700 1 --2- 172.21.15.79:0/3918628122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2704098a70 0x7f27040d4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.958 7f270c129700 1 --2- 172.21.15.79:0/3918628122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2704098620 0x7f27040abf70 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:40.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.958 7f270c129700 1 -- 172.21.15.79:0/3918628122 >> 172.21.15.79:0/3918628122 conn(0x7f27040993e0 msgr2=0x7f27040a6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:40.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.958 7f270c129700 1 -- 172.21.15.79:0/3918628122 shutdown_connections 2021-04-09T18:35:40.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:40.958 7f270c129700 1 -- 172.21.15.79:0/3918628122 wait complete. 2021-04-09T18:35:40.974 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:35:41.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.066 7feda511a700 1 Processor -- start 2021-04-09T18:35:41.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.066 7feda511a700 1 -- start start 2021-04-09T18:35:41.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.066 7feda511a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feda00e9ad0 0x7feda009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:41.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.066 7feda511a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda00fbb10 con 0x7feda00f5510 2021-04-09T18:35:41.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.066 7feda511a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda00e56c0 con 0x7feda01c8000 2021-04-09T18:35:41.078 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.066 7feda511a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda01c3db0 con 0x7feda00e9ad0 2021-04-09T18:35:41.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.066 7fed9e59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feda00e9ad0 0x7feda009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:41.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.066 7fed9e59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feda00e9ad0 0x7feda009f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35590/0 (socket says 172.21.15.79:35590) 2021-04-09T18:35:41.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.066 7fed9e59c700 1 -- 172.21.15.79:0/3042591103 learned_addr learned my addr 172.21.15.79:0/3042591103 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:41.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.066 7fed9ed9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7feda00f5510 0x7feda00f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58532/0 (socket says 172.21.15.79:58532) 2021-04-09T18:35:41.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.066 7fed9e59c700 1 -- 172.21.15.79:0/3042591103 >> v1:172.21.15.89:6789/0 conn(0x7feda01c8000 legacy=0x7feda01ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:41.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.066 7fed9e59c700 1 -- 172.21.15.79:0/3042591103 >> v1:172.21.15.79:6789/0 conn(0x7feda00f5510 legacy=0x7feda00f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:41.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.066 7fed9e59c700 1 -- 172.21.15.79:0/3042591103 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda00e4320 con 0x7feda00e9ad0 2021-04-09T18:35:41.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.066 7fed9e59c700 1 --2- 172.21.15.79:0/3042591103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda00e9ad0 0x7feda009f100 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7fed94002f30 tx=0x7fed9400bd20).ready entity=mon.0 client_cookie=fde1c7b86c7afb63 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:41.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.066 7fed9dd9b700 1 -- 172.21.15.79:0/3042591103 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feda00e4320 con 0x7feda00e9ad0 2021-04-09T18:35:41.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.066 7fed9dd9b700 1 -- 172.21.15.79:0/3042591103 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed94009a20 con 0x7feda00e9ad0 2021-04-09T18:35:41.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.066 7fed9dd9b700 1 -- 172.21.15.79:0/3042591103 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fed94009df0 con 0x7feda00e9ad0 2021-04-09T18:35:41.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.066 7feda511a700 1 -- 172.21.15.79:0/3042591103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda00e9ad0 msgr2=0x7feda009f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:41.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.066 7feda511a700 1 --2- 172.21.15.79:0/3042591103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda00e9ad0 0x7feda009f100 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7fed94002f30 tx=0x7fed9400bd20).stop 2021-04-09T18:35:41.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.070 7feda511a700 1 -- 172.21.15.79:0/3042591103 shutdown_connections 2021-04-09T18:35:41.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.070 7feda511a700 1 --2- 172.21.15.79:0/3042591103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda00e9ad0 0x7feda009f100 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.070 7feda511a700 1 -- 172.21.15.79:0/3042591103 >> 172.21.15.79:0/3042591103 conn(0x7feda00e5fd0 msgr2=0x7feda00e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:41.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.070 7feda511a700 1 -- 172.21.15.79:0/3042591103 shutdown_connections 2021-04-09T18:35:41.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.070 7feda511a700 1 -- 172.21.15.79:0/3042591103 wait complete. 2021-04-09T18:35:41.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.070 7feda511a700 1 Processor -- start 2021-04-09T18:35:41.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.070 7feda511a700 1 -- start start 2021-04-09T18:35:41.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7feda511a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feda0093b90 0x7feda0095c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:41.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7feda511a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda00bfea0 0x7feda00c0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:41.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7feda511a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda00c1550 0x7feda01d2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:41.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7feda511a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda00e9f20 con 0x7feda00bfea0 2021-04-09T18:35:41.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7feda511a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda00c0c20 con 0x7feda00c1550 2021-04-09T18:35:41.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7feda511a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda00c03a0 con 0x7feda0093b90 2021-04-09T18:35:41.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7fed9e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda00bfea0 0x7feda00c0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:41.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7fed9e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda00bfea0 0x7feda00c0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35598/0 (socket says 172.21.15.79:35598) 2021-04-09T18:35:41.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7fed9e59c700 1 -- 172.21.15.79:0/2387104211 learned_addr learned my addr 172.21.15.79:0/2387104211 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:41.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7fed9ed9d700 1 --2- 172.21.15.79:0/2387104211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feda0093b90 0x7feda0095c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:41.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7fed9f59e700 1 --2- 172.21.15.79:0/2387104211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda00c1550 0x7feda01d2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:41.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7fed9e59c700 1 -- 172.21.15.79:0/2387104211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feda0093b90 msgr2=0x7feda0095c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:41.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7fed9e59c700 1 --2- 172.21.15.79:0/2387104211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feda0093b90 0x7feda0095c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7fed9e59c700 1 -- 172.21.15.79:0/2387104211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda00c1550 msgr2=0x7feda01d2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:41.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7fed9e59c700 1 --2- 172.21.15.79:0/2387104211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda00c1550 0x7feda01d2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7fed9e59c700 1 -- 172.21.15.79:0/2387104211 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda00c07b0 con 0x7feda00bfea0 2021-04-09T18:35:41.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7fed9f59e700 1 --2- 172.21.15.79:0/2387104211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda00c1550 0x7feda01d2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:41.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7fed9e59c700 1 --2- 172.21.15.79:0/2387104211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda00bfea0 0x7feda00c0f20 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7feda00874c0 tx=0x7fed94006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:41.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7fed8f7fe700 1 -- 172.21.15.79:0/2387104211 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feda00c07b0 con 0x7feda00bfea0 2021-04-09T18:35:41.096 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7fed8f7fe700 1 -- 172.21.15.79:0/2387104211 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9401d440 con 0x7feda00bfea0 2021-04-09T18:35:41.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7feda511a700 1 -- 172.21.15.79:0/2387104211 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda0096260 con 0x7feda00bfea0 2021-04-09T18:35:41.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7fed8f7fe700 1 -- 172.21.15.79:0/2387104211 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fed9401d810 con 0x7feda00bfea0 2021-04-09T18:35:41.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7feda511a700 1 -- 172.21.15.79:0/2387104211 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda01d3440 con 0x7feda00bfea0 2021-04-09T18:35:41.097 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7fed8f7fe700 1 -- 172.21.15.79:0/2387104211 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fed94026450 con 0x7feda00bfea0 2021-04-09T18:35:41.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7fed8f7fe700 1 --2- 172.21.15.79:0/2387104211 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fed84029100 0x7fed8402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:41.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.074 7fed8f7fe700 1 -- 172.21.15.79:0/2387104211 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fed9403b270 con 0x7feda00bfea0 2021-04-09T18:35:41.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.078 7fed9ed9d700 1 --2- 172.21.15.79:0/2387104211 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fed84029100 0x7fed8402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:41.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.078 7fed9ed9d700 1 --2- 172.21.15.79:0/2387104211 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fed84029100 0x7fed8402b650 crc :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:41.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.078 7feda511a700 1 -- 172.21.15.79:0/2387104211 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda00e39d0 con 0x7feda00bfea0 2021-04-09T18:35:41.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.086 7fed8f7fe700 1 -- 172.21.15.79:0/2387104211 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fed94011dd0 con 0x7feda00bfea0 2021-04-09T18:35:41.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.258 7feda511a700 1 -- 172.21.15.79:0/2387104211 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feda00a1cb0 con 0x7feda00bfea0 2021-04-09T18:35:41.267 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.262 7fed8f7fe700 1 -- 172.21.15.79:0/2387104211 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+14359 (secure 0 0 0) 0x7fed94009810 con 0x7feda00bfea0 2021-04-09T18:35:41.272 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:41.272 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":135,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:35:39.987855","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:35:37.809302","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2021-04-09 18:35:38.660109","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6835/1552365531":"2021-04-10 18:35:39.980332","172.21.15.89:6834/1552365531":"2021-04-10 18:35:39.980332"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:35:41.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.266 7feda511a700 1 -- 172.21.15.79:0/2387104211 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fed84029100 msgr2=0x7fed8402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:41.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.266 7feda511a700 1 --2- 172.21.15.79:0/2387104211 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fed84029100 0x7fed8402b650 crc :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.266 7feda511a700 1 -- 172.21.15.79:0/2387104211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda00bfea0 msgr2=0x7feda00c0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:41.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.266 7feda511a700 1 --2- 172.21.15.79:0/2387104211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda00bfea0 0x7feda00c0f20 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7feda00874c0 tx=0x7fed94006890).stop 2021-04-09T18:35:41.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.266 7feda511a700 1 -- 172.21.15.79:0/2387104211 shutdown_connections 2021-04-09T18:35:41.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.266 7feda511a700 1 --2- 172.21.15.79:0/2387104211 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fed84029100 0x7fed8402b650 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.266 7feda511a700 1 --2- 172.21.15.79:0/2387104211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda00c1550 0x7feda01d2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.266 7feda511a700 1 --2- 172.21.15.79:0/2387104211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feda0093b90 0x7feda0095c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.266 7feda511a700 1 --2- 172.21.15.79:0/2387104211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feda00bfea0 0x7feda00c0f20 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.266 7feda511a700 1 -- 172.21.15.79:0/2387104211 >> 172.21.15.79:0/2387104211 conn(0x7feda0097640 msgr2=0x7feda0097a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:41.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.266 7feda511a700 1 -- 172.21.15.79:0/2387104211 shutdown_connections 2021-04-09T18:35:41.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.270 7feda511a700 1 -- 172.21.15.79:0/2387104211 wait complete. 2021-04-09T18:35:41.291 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:35:41.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.386 7f4d550b1700 1 Processor -- start 2021-04-09T18:35:41.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.386 7f4d550b1700 1 -- start start 2021-04-09T18:35:41.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.386 7f4d550b1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4d500f5580 0x7f4d500f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:41.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.386 7f4d550b1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d500e9b40 0x7f4d5009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:41.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.386 7f4d550b1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d500fbb80 con 0x7f4d501c6e30 2021-04-09T18:35:41.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.386 7f4d550b1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d500e9f90 con 0x7f4d500f5580 2021-04-09T18:35:41.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.386 7f4d550b1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d500e59b0 con 0x7f4d500e9b40 2021-04-09T18:35:41.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.386 7f4d4f59e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4d501c6e30 0x7f4d501c9290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58550/0 (socket says 172.21.15.79:58550) 2021-04-09T18:35:41.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.386 7f4d4f59e700 1 -- 172.21.15.79:0/2239427465 learned_addr learned my addr 172.21.15.79:0/2239427465 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:41.401 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.386 7f4d4ed9d700 1 --2- 172.21.15.79:0/2239427465 >> v2:172.21.15.89:3300/0 conn(0x7f4d500f5580 0x7f4d500f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:41.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.386 7f4d4e59c700 1 --2- 172.21.15.79:0/2239427465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d500e9b40 0x7f4d5009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:41.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.386 7f4d4dd9b700 1 -- 172.21.15.79:0/2239427465 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231250125 0 0) 0x7f4d48001450 con 0x7f4d501c6e30 2021-04-09T18:35:41.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.386 7f4d4dd9b700 1 -- 172.21.15.79:0/2239427465 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d38003240 con 0x7f4d501c6e30 2021-04-09T18:35:41.402 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.386 7f4d4dd9b700 1 -- 172.21.15.79:0/2239427465 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2967917454 0 0) 0x7f4d480019d0 con 0x7f4d501c6e30 2021-04-09T18:35:41.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.386 7f4d4dd9b700 1 -- 172.21.15.79:0/2239427465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d500e9b40 msgr2=0x7f4d5009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:41.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.386 7f4d4dd9b700 1 --2- 172.21.15.79:0/2239427465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d500e9b40 0x7f4d5009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.386 7f4d4dd9b700 1 -- 172.21.15.79:0/2239427465 >> v2:172.21.15.89:3300/0 conn(0x7f4d500f5580 msgr2=0x7f4d500f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:41.403 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.386 7f4d4dd9b700 1 --2- 172.21.15.79:0/2239427465 >> v2:172.21.15.89:3300/0 conn(0x7f4d500f5580 0x7f4d500f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.386 7f4d4dd9b700 1 -- 172.21.15.79:0/2239427465 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d500e56b0 con 0x7f4d501c6e30 2021-04-09T18:35:41.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.386 7f4d4dd9b700 1 -- 172.21.15.79:0/2239427465 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f4d48001f30 con 0x7f4d501c6e30 2021-04-09T18:35:41.404 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4dd9b700 1 -- 172.21.15.79:0/2239427465 >> v1:172.21.15.79:6789/0 conn(0x7f4d501c6e30 legacy=0x7f4d501c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4dd9b700 1 --2- 172.21.15.79:0/2239427465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d380038c0 0x7f4d38003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4dd9b700 1 --2- 172.21.15.79:0/2239427465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d380045a0 0x7f4d380049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4dd9b700 1 --2- 172.21.15.79:0/2239427465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d3804d7f0 0x7f4d3804fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4dd9b700 1 -- 172.21.15.79:0/2239427465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d500e9f90 con 0x7f4d380038c0 2021-04-09T18:35:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4dd9b700 1 -- 172.21.15.79:0/2239427465 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d500e59b0 con 0x7f4d380045a0 2021-04-09T18:35:41.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4dd9b700 1 -- 172.21.15.79:0/2239427465 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d38005280 con 0x7f4d3804d7f0 2021-04-09T18:35:41.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4ed9d700 1 --2- 172.21.15.79:0/2239427465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d380038c0 0x7f4d38003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:41.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4e59c700 1 --2- 172.21.15.79:0/2239427465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d380045a0 0x7f4d380049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:41.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4f59e700 1 --2- 172.21.15.79:0/2239427465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d3804d7f0 0x7f4d3804fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:41.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4ed9d700 1 -- 172.21.15.79:0/2239427465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d3804d7f0 msgr2=0x7f4d3804fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:41.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4ed9d700 1 --2- 172.21.15.79:0/2239427465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d3804d7f0 0x7f4d3804fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4ed9d700 1 -- 172.21.15.79:0/2239427465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d380045a0 msgr2=0x7f4d380049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:41.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4ed9d700 1 --2- 172.21.15.79:0/2239427465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d380045a0 0x7f4d380049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4ed9d700 1 -- 172.21.15.79:0/2239427465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d38050280 con 0x7f4d380038c0 2021-04-09T18:35:41.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4f59e700 1 --2- 172.21.15.79:0/2239427465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d3804d7f0 0x7f4d3804fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:35:41.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4ed9d700 1 --2- 172.21.15.79:0/2239427465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d380038c0 0x7f4d38003d70 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7f4d4000c000 tx=0x7f4d4000e1d0).ready entity=mon.0 client_cookie=e2865f1d3d870fe0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:41.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4dd9b700 1 -- 172.21.15.79:0/2239427465 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d38050280 con 0x7f4d380038c0 2021-04-09T18:35:41.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4dd9b700 1 -- 172.21.15.79:0/2239427465 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4000ec90 con 0x7f4d380038c0 2021-04-09T18:35:41.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4dd9b700 1 -- 172.21.15.79:0/2239427465 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d4000f040 con 0x7f4d380038c0 2021-04-09T18:35:41.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d550b1700 1 -- 172.21.15.79:0/2239427465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d380038c0 msgr2=0x7f4d38003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:41.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d550b1700 1 --2- 172.21.15.79:0/2239427465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d380038c0 0x7f4d38003d70 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7f4d4000c000 tx=0x7f4d4000e1d0).stop 2021-04-09T18:35:41.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d4f59e700 1 -- 172.21.15.79:0/2239427465 reap_dead start 2021-04-09T18:35:41.410 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d550b1700 1 -- 172.21.15.79:0/2239427465 shutdown_connections 2021-04-09T18:35:41.410 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d550b1700 1 -- 172.21.15.79:0/2239427465 >> 172.21.15.79:0/2239427465 conn(0x7f4d500e6040 msgr2=0x7f4d500e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:41.410 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d550b1700 1 -- 172.21.15.79:0/2239427465 shutdown_connections 2021-04-09T18:35:41.410 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.390 7f4d550b1700 1 -- 172.21.15.79:0/2239427465 wait complete. 2021-04-09T18:35:41.410 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d550b1700 1 Processor -- start 2021-04-09T18:35:41.411 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d550b1700 1 -- start start 2021-04-09T18:35:41.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d550b1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d500c3720 0x7f4d5019dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:41.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d550b1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d500c3b70 0x7f4d5019e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:41.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d550b1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d50099cf0 0x7f4d5009a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:41.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d550b1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d500a30b0 con 0x7f4d500c3b70 2021-04-09T18:35:41.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d550b1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d500bb6a0 con 0x7f4d500c3720 2021-04-09T18:35:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d550b1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d500a33b0 con 0x7f4d50099cf0 2021-04-09T18:35:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d4e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d500c3b70 0x7f4d5019e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d4e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d500c3b70 0x7f4d5019e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35616/0 (socket says 172.21.15.79:35616) 2021-04-09T18:35:41.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d4e59c700 1 -- 172.21.15.79:0/1481977535 learned_addr learned my addr 172.21.15.79:0/1481977535 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:41.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d4ed9d700 1 --2- 172.21.15.79:0/1481977535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d500c3720 0x7f4d5019dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:41.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d4f59e700 1 --2- 172.21.15.79:0/1481977535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d50099cf0 0x7f4d5009a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:41.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d4e59c700 1 -- 172.21.15.79:0/1481977535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d50099cf0 msgr2=0x7f4d5009a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:41.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d4e59c700 1 --2- 172.21.15.79:0/1481977535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d50099cf0 0x7f4d5009a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d4e59c700 1 -- 172.21.15.79:0/1481977535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d500c3720 msgr2=0x7f4d5019dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:41.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d4e59c700 1 --2- 172.21.15.79:0/1481977535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d500c3720 0x7f4d5019dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d4e59c700 1 -- 172.21.15.79:0/1481977535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d500a2c60 con 0x7f4d500c3b70 2021-04-09T18:35:41.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d4ed9d700 1 --2- 172.21.15.79:0/1481977535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d500c3720 0x7f4d5019dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:41.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d4f59e700 1 --2- 172.21.15.79:0/1481977535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d50099cf0 0x7f4d5009a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:41.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d4e59c700 1 --2- 172.21.15.79:0/1481977535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d500c3b70 0x7f4d5019e280 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7f4d500a35b0 tx=0x7f4d4400e4b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:41.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d3f7fe700 1 -- 172.21.15.79:0/1481977535 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d500a2c60 con 0x7f4d500c3b70 2021-04-09T18:35:41.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d3f7fe700 1 -- 172.21.15.79:0/1481977535 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4400e9e0 con 0x7f4d500c3b70 2021-04-09T18:35:41.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d550b1700 1 -- 172.21.15.79:0/1481977535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d500a27b0 con 0x7f4d500c3b70 2021-04-09T18:35:41.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d3f7fe700 1 -- 172.21.15.79:0/1481977535 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d4400f040 con 0x7f4d500c3b70 2021-04-09T18:35:41.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.394 7f4d550b1700 1 -- 172.21.15.79:0/1481977535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d500d6c60 con 0x7f4d500c3b70 2021-04-09T18:35:41.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.398 7f4d3f7fe700 1 -- 172.21.15.79:0/1481977535 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4d44024060 con 0x7f4d500c3b70 2021-04-09T18:35:41.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.398 7f4d3f7fe700 1 --2- 172.21.15.79:0/1481977535 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d34029100 0x7f4d3402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:41.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.398 7f4d3f7fe700 1 -- 172.21.15.79:0/1481977535 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f4d440395e0 con 0x7f4d500c3b70 2021-04-09T18:35:41.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.398 7f4d4ed9d700 1 --2- 172.21.15.79:0/1481977535 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d34029100 0x7f4d3402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:41.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.398 7f4d4ed9d700 1 --2- 172.21.15.79:0/1481977535 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d34029100 0x7f4d3402b650 crc :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:41.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.398 7f4d550b1700 1 -- 172.21.15.79:0/1481977535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d50088d30 con 0x7f4d500c3b70 2021-04-09T18:35:41.429 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.402 7f4d3f7fe700 1 -- 172.21.15.79:0/1481977535 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4d44010d70 con 0x7f4d500c3b70 2021-04-09T18:35:41.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.566 7f4d550b1700 1 -- 172.21.15.79:0/1481977535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4d50087550 con 0x7f4d500c3b70 2021-04-09T18:35:41.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.574 7f4d3f7fe700 1 -- 172.21.15.79:0/1481977535 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v39) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4d44000bf0 con 0x7f4d500c3b70 2021-04-09T18:35:41.580 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2021-04-09T18:35:41.584 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.578 7f4d550b1700 1 -- 172.21.15.79:0/1481977535 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d34029100 msgr2=0x7f4d3402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:41.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.578 7f4d550b1700 1 --2- 172.21.15.79:0/1481977535 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d34029100 0x7f4d3402b650 crc :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.578 7f4d550b1700 1 -- 172.21.15.79:0/1481977535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d500c3b70 msgr2=0x7f4d5019e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:41.585 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.578 7f4d550b1700 1 --2- 172.21.15.79:0/1481977535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d500c3b70 0x7f4d5019e280 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7f4d500a35b0 tx=0x7f4d4400e4b0).stop 2021-04-09T18:35:41.586 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.578 7f4d550b1700 1 -- 172.21.15.79:0/1481977535 shutdown_connections 2021-04-09T18:35:41.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.578 7f4d550b1700 1 --2- 172.21.15.79:0/1481977535 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4d34029100 0x7f4d3402b650 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.587 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.578 7f4d550b1700 1 --2- 172.21.15.79:0/1481977535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d500c3720 0x7f4d5019dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.578 7f4d550b1700 1 --2- 172.21.15.79:0/1481977535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d50099cf0 0x7f4d5009a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.578 7f4d550b1700 1 --2- 172.21.15.79:0/1481977535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d500c3b70 0x7f4d5019e280 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.578 7f4d550b1700 1 -- 172.21.15.79:0/1481977535 >> 172.21.15.79:0/1481977535 conn(0x7f4d500a4ff0 msgr2=0x7f4d5009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:41.588 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.578 7f4d550b1700 1 -- 172.21.15.79:0/1481977535 shutdown_connections 2021-04-09T18:35:41.589 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.578 7f4d550b1700 1 -- 172.21.15.79:0/1481977535 wait complete. 2021-04-09T18:35:41.599 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:35:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b4ebe8700 1 Processor -- start 2021-04-09T18:35:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b4ebe8700 1 -- start start 2021-04-09T18:35:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b4ebe8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8b480e9b40 0x7f8b4809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b4ebe8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b481c7e40 0x7f8b481ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b4ebe8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b480fbb80 con 0x7f8b480f5580 2021-04-09T18:35:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b4ebe8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b480e9f90 con 0x7f8b480e9b40 2021-04-09T18:35:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b4ebe8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480e59b0 con 0x7f8b481c7e40 2021-04-09T18:35:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b47fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8b480e9b40 0x7f8b4809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b4d18d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b481c7e40 0x7f8b481ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b47fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8b480e9b40 0x7f8b4809f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:52200/0 (socket says 172.21.15.79:52200) 2021-04-09T18:35:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b4d18d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b481c7e40 0x7f8b481ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:60856/0 (socket says 172.21.15.79:60856) 2021-04-09T18:35:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b47fff700 1 -- 172.21.15.79:0/4024297621 learned_addr learned my addr 172.21.15.79:0/4024297621 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b4c98c700 1 --1- 172.21.15.79:0/4024297621 >> v1:172.21.15.89:6789/0 conn(0x7f8b480f5580 0x7f8b480f6510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:59036/0 (socket says 172.21.15.79:59036) 2021-04-09T18:35:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b47fff700 1 -- 172.21.15.79:0/4024297621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b481c7e40 msgr2=0x7f8b481ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b47fff700 1 --2- 172.21.15.79:0/4024297621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b481c7e40 0x7f8b481ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b47fff700 1 -- 172.21.15.79:0/4024297621 >> v1:172.21.15.89:6789/0 conn(0x7f8b480f5580 legacy=0x7f8b480f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:41.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b47fff700 1 -- 172.21.15.79:0/4024297621 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b480e56b0 con 0x7f8b480e9b40 2021-04-09T18:35:41.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b47fff700 1 --2- 172.21.15.79:0/4024297621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b480e9b40 0x7f8b4809f110 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f8b38001340 tx=0x7f8b38001040).ready entity=mon.1 client_cookie=bde9bbe080b70063 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:41.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b477fe700 1 -- 172.21.15.79:0/4024297621 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b480e56b0 con 0x7f8b480e9b40 2021-04-09T18:35:41.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b477fe700 1 -- 172.21.15.79:0/4024297621 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3000ba50 con 0x7f8b480e9b40 2021-04-09T18:35:41.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b477fe700 1 -- 172.21.15.79:0/4024297621 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b30002020 con 0x7f8b480e9b40 2021-04-09T18:35:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b4ebe8700 1 -- 172.21.15.79:0/4024297621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b480e9b40 msgr2=0x7f8b4809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.694 7f8b4ebe8700 1 --2- 172.21.15.79:0/4024297621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b480e9b40 0x7f8b4809f110 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f8b38001340 tx=0x7f8b38001040).stop 2021-04-09T18:35:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.698 7f8b4ebe8700 1 -- 172.21.15.79:0/4024297621 shutdown_connections 2021-04-09T18:35:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.698 7f8b4ebe8700 1 --2- 172.21.15.79:0/4024297621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b481c7e40 0x7f8b481ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.698 7f8b4ebe8700 1 --2- 172.21.15.79:0/4024297621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b480e9b40 0x7f8b4809f110 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.698 7f8b4ebe8700 1 -- 172.21.15.79:0/4024297621 >> 172.21.15.79:0/4024297621 conn(0x7f8b480e6040 msgr2=0x7f8b480e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.698 7f8b4ebe8700 1 -- 172.21.15.79:0/4024297621 shutdown_connections 2021-04-09T18:35:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.698 7f8b4ebe8700 1 -- 172.21.15.79:0/4024297621 wait complete. 2021-04-09T18:35:41.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.698 7f8b4ebe8700 1 Processor -- start 2021-04-09T18:35:41.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.698 7f8b4ebe8700 1 -- start start 2021-04-09T18:35:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.698 7f8b4ebe8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b481a7380 0x7f8b480ba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.698 7f8b4ebe8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b480ba920 0x7f8b480bda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.698 7f8b4ebe8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b480be0c0 0x7f8b481a6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.698 7f8b4ebe8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b48047500 con 0x7f8b480ba920 2021-04-09T18:35:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.698 7f8b4ebe8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480bc1a0 con 0x7f8b480be0c0 2021-04-09T18:35:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.698 7f8b4ebe8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480bc4a0 con 0x7f8b481a7380 2021-04-09T18:35:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.698 7f8b47fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b480ba920 0x7f8b480bda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.698 7f8b47fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b480ba920 0x7f8b480bda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35630/0 (socket says 172.21.15.79:35630) 2021-04-09T18:35:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.698 7f8b47fff700 1 -- 172.21.15.79:0/773310335 learned_addr learned my addr 172.21.15.79:0/773310335 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:41.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.698 7f8b4c98c700 1 --2- 172.21.15.79:0/773310335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b481a7380 0x7f8b480ba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:41.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.698 7f8b4d18d700 1 --2- 172.21.15.79:0/773310335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b480be0c0 0x7f8b481a6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:41.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.702 7f8b47fff700 1 -- 172.21.15.79:0/773310335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b481a7380 msgr2=0x7f8b480ba2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.702 7f8b47fff700 1 --2- 172.21.15.79:0/773310335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b481a7380 0x7f8b480ba2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.702 7f8b47fff700 1 -- 172.21.15.79:0/773310335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b480be0c0 msgr2=0x7f8b481a6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.702 7f8b47fff700 1 --2- 172.21.15.79:0/773310335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b480be0c0 0x7f8b481a6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.702 7f8b47fff700 1 -- 172.21.15.79:0/773310335 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b481a77d0 con 0x7f8b480ba920 2021-04-09T18:35:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.702 7f8b4c98c700 1 --2- 172.21.15.79:0/773310335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b481a7380 0x7f8b480ba2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.702 7f8b47fff700 1 --2- 172.21.15.79:0/773310335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b480ba920 0x7f8b480bda90 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f8b480d51a0 tx=0x7f8b30006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.702 7f8b457fa700 1 -- 172.21.15.79:0/773310335 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b481a77d0 con 0x7f8b480ba920 2021-04-09T18:35:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.702 7f8b457fa700 1 -- 172.21.15.79:0/773310335 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3001b670 con 0x7f8b480ba920 2021-04-09T18:35:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.702 7f8b4ebe8700 1 -- 172.21.15.79:0/773310335 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b481a7a90 con 0x7f8b480ba920 2021-04-09T18:35:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.702 7f8b457fa700 1 -- 172.21.15.79:0/773310335 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b3001ba40 con 0x7f8b480ba920 2021-04-09T18:35:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.702 7f8b4ebe8700 1 -- 172.21.15.79:0/773310335 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b481a6b10 con 0x7f8b480ba920 2021-04-09T18:35:41.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.702 7f8b457fa700 1 -- 172.21.15.79:0/773310335 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8b30019040 con 0x7f8b480ba920 2021-04-09T18:35:41.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.702 7f8b457fa700 1 --2- 172.21.15.79:0/773310335 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b20029100 0x7f8b2002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:41.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.702 7f8b457fa700 1 -- 172.21.15.79:0/773310335 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f8b30018040 con 0x7f8b480ba920 2021-04-09T18:35:41.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.702 7f8b4c98c700 1 --2- 172.21.15.79:0/773310335 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b20029100 0x7f8b2002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:41.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.702 7f8b4c98c700 1 --2- 172.21.15.79:0/773310335 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b20029100 0x7f8b2002b650 crc :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:41.857 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.710 7f8b4ebe8700 1 -- 172.21.15.79:0/773310335 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b48088d30 con 0x7f8b480ba920 2021-04-09T18:35:41.858 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.718 7f8b457fa700 1 -- 172.21.15.79:0/773310335 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8b3001b460 con 0x7f8b480ba920 2021-04-09T18:35:41.891 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.886 7f8b4ebe8700 1 -- 172.21.15.79:0/773310335 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f8b480e39a0 con 0x7f8b480ba920 2021-04-09T18:35:41.897 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.890 7f8b457fa700 1 -- 172.21.15.79:0/773310335 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v40) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8b3000b840 con 0x7f8b480ba920 2021-04-09T18:35:41.899 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.1 2021-04-09T18:35:41.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.894 7f8b4ebe8700 1 -- 172.21.15.79:0/773310335 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b20029100 msgr2=0x7f8b2002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:41.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.894 7f8b4ebe8700 1 --2- 172.21.15.79:0/773310335 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b20029100 0x7f8b2002b650 crc :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.894 7f8b4ebe8700 1 -- 172.21.15.79:0/773310335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b480ba920 msgr2=0x7f8b480bda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:41.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.894 7f8b4ebe8700 1 --2- 172.21.15.79:0/773310335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b480ba920 0x7f8b480bda90 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f8b480d51a0 tx=0x7f8b30006c10).stop 2021-04-09T18:35:41.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.894 7f8b4ebe8700 1 -- 172.21.15.79:0/773310335 shutdown_connections 2021-04-09T18:35:41.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.894 7f8b4ebe8700 1 --2- 172.21.15.79:0/773310335 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8b20029100 0x7f8b2002b650 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.894 7f8b4ebe8700 1 --2- 172.21.15.79:0/773310335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b480be0c0 0x7f8b481a6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.894 7f8b4ebe8700 1 --2- 172.21.15.79:0/773310335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b481a7380 0x7f8b480ba2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.894 7f8b4ebe8700 1 --2- 172.21.15.79:0/773310335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b480ba920 0x7f8b480bda90 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:41.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.894 7f8b4ebe8700 1 -- 172.21.15.79:0/773310335 >> 172.21.15.79:0/773310335 conn(0x7f8b4808ef10 msgr2=0x7f8b480d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:41.908 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.894 7f8b4ebe8700 1 -- 172.21.15.79:0/773310335 shutdown_connections 2021-04-09T18:35:41.909 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:41.894 7f8b4ebe8700 1 -- 172.21.15.79:0/773310335 wait complete. 2021-04-09T18:35:41.914 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-04-09T18:35:42.035 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.010 7f9b86d31700 1 Processor -- start 2021-04-09T18:35:42.036 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.010 7f9b86d31700 1 -- start start 2021-04-09T18:35:42.037 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.010 7f9b86d31700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9b801c8e50 0x7f9b801cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.010 7f9b86d31700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b800fbb80 con 0x7f9b800e9b40 2021-04-09T18:35:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.010 7f9b86d31700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8009f910 con 0x7f9b800f5580 2021-04-09T18:35:42.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.010 7f9b86d31700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b800e9f90 con 0x7f9b801c8e50 2021-04-09T18:35:42.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.010 7f9b7ffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9b800e9b40 0x7f9b8009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58582/0 (socket says 172.21.15.79:58582) 2021-04-09T18:35:42.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.010 7f9b7ffff700 1 -- 172.21.15.79:0/1053137137 learned_addr learned my addr 172.21.15.79:0/1053137137 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:42.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.010 7f9b852d6700 1 --2- 172.21.15.79:0/1053137137 >> v2:172.21.15.79:3300/0 conn(0x7f9b801c8e50 0x7f9b801cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:42.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.010 7f9b7f7fe700 1 -- 172.21.15.79:0/1053137137 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502998985 0 0) 0x7f9b680010d0 con 0x7f9b800e9b40 2021-04-09T18:35:42.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.010 7f9b7f7fe700 1 -- 172.21.15.79:0/1053137137 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b6c003240 con 0x7f9b800e9b40 2021-04-09T18:35:42.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.010 7f9b7f7fe700 1 -- 172.21.15.79:0/1053137137 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649664733 0 0) 0x7f9b78001450 con 0x7f9b800f5580 2021-04-09T18:35:42.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.010 7f9b852d6700 1 -- 172.21.15.79:0/1053137137 >> v1:172.21.15.89:6789/0 conn(0x7f9b800f5580 legacy=0x7f9b800f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:42.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.010 7f9b852d6700 1 -- 172.21.15.79:0/1053137137 >> v1:172.21.15.79:6789/0 conn(0x7f9b800e9b40 legacy=0x7f9b8009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:42.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.010 7f9b852d6700 1 -- 172.21.15.79:0/1053137137 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b800e56b0 con 0x7f9b801c8e50 2021-04-09T18:35:42.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.010 7f9b852d6700 1 --2- 172.21.15.79:0/1053137137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b801c8e50 0x7f9b801cb2b0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f9b70002f30 tx=0x7f9b7000bcc0).ready entity=mon.0 client_cookie=a1818538f69f1eaf server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:42.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.010 7f9b7f7fe700 1 -- 172.21.15.79:0/1053137137 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b800e56b0 con 0x7f9b801c8e50 2021-04-09T18:35:42.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.014 7f9b7f7fe700 1 -- 172.21.15.79:0/1053137137 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b70009800 con 0x7f9b801c8e50 2021-04-09T18:35:42.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.014 7f9b7f7fe700 1 -- 172.21.15.79:0/1053137137 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b70009bd0 con 0x7f9b801c8e50 2021-04-09T18:35:42.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.014 7f9b86d31700 1 -- 172.21.15.79:0/1053137137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b801c8e50 msgr2=0x7f9b801cb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:42.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.014 7f9b86d31700 1 --2- 172.21.15.79:0/1053137137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b801c8e50 0x7f9b801cb2b0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f9b70002f30 tx=0x7f9b7000bcc0).stop 2021-04-09T18:35:42.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.014 7f9b86d31700 1 -- 172.21.15.79:0/1053137137 shutdown_connections 2021-04-09T18:35:42.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.014 7f9b86d31700 1 --2- 172.21.15.79:0/1053137137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b801c8e50 0x7f9b801cb2b0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.014 7f9b86d31700 1 -- 172.21.15.79:0/1053137137 >> 172.21.15.79:0/1053137137 conn(0x7f9b800e6040 msgr2=0x7f9b800e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:42.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.014 7f9b86d31700 1 -- 172.21.15.79:0/1053137137 shutdown_connections 2021-04-09T18:35:42.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.014 7f9b86d31700 1 -- 172.21.15.79:0/1053137137 wait complete. 2021-04-09T18:35:42.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.014 7f9b86d31700 1 Processor -- start 2021-04-09T18:35:42.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b86d31700 1 -- start start 2021-04-09T18:35:42.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b86d31700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b80098280 0x7f9b80097610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:42.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b86d31700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b800d5270 0x7f9b800c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:42.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b86d31700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b800d56c0 0x7f9b800c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:42.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b86d31700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8019d350 con 0x7f9b800d5270 2021-04-09T18:35:42.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b86d31700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b80097c40 con 0x7f9b80098280 2021-04-09T18:35:42.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b86d31700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800986d0 con 0x7f9b800d56c0 2021-04-09T18:35:42.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b7ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b800d5270 0x7f9b800c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:42.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b7ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b800d5270 0x7f9b800c4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35644/0 (socket says 172.21.15.79:35644) 2021-04-09T18:35:42.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b7ffff700 1 -- 172.21.15.79:0/3117338551 learned_addr learned my addr 172.21.15.79:0/3117338551 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:42.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b852d6700 1 --2- 172.21.15.79:0/3117338551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b800d56c0 0x7f9b800c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:42.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b84ad5700 1 --2- 172.21.15.79:0/3117338551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b80098280 0x7f9b80097610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:42.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b852d6700 1 -- 172.21.15.79:0/3117338551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b80098280 msgr2=0x7f9b80097610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:42.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b852d6700 1 --2- 172.21.15.79:0/3117338551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b80098280 0x7f9b80097610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b852d6700 1 -- 172.21.15.79:0/3117338551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b800d5270 msgr2=0x7f9b800c4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:42.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b852d6700 1 --2- 172.21.15.79:0/3117338551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b800d5270 0x7f9b800c4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b852d6700 1 -- 172.21.15.79:0/3117338551 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8019d650 con 0x7f9b800d56c0 2021-04-09T18:35:42.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b7ffff700 1 --2- 172.21.15.79:0/3117338551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b800d5270 0x7f9b800c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:42.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b852d6700 1 --2- 172.21.15.79:0/3117338551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b800d56c0 0x7f9b800c4e70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f9b70002f30 tx=0x7f9b70006890).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:42.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b7d7fa700 1 -- 172.21.15.79:0/3117338551 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b8019d650 con 0x7f9b800d56c0 2021-04-09T18:35:42.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b7d7fa700 1 -- 172.21.15.79:0/3117338551 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7001d450 con 0x7f9b800d56c0 2021-04-09T18:35:42.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b86d31700 1 -- 172.21.15.79:0/3117338551 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b800c54a0 con 0x7f9b800d56c0 2021-04-09T18:35:42.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b7d7fa700 1 -- 172.21.15.79:0/3117338551 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b7001d630 con 0x7f9b800d56c0 2021-04-09T18:35:42.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.018 7f9b86d31700 1 -- 172.21.15.79:0/3117338551 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b800c59a0 con 0x7f9b800d56c0 2021-04-09T18:35:42.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.022 7f9b7d7fa700 1 -- 172.21.15.79:0/3117338551 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9b70018370 con 0x7f9b800d56c0 2021-04-09T18:35:42.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.022 7f9b7d7fa700 1 --2- 172.21.15.79:0/3117338551 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9b64029100 0x7f9b6402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:42.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.022 7f9b7d7fa700 1 -- 172.21.15.79:0/3117338551 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f9b7003a970 con 0x7f9b800d56c0 2021-04-09T18:35:42.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.022 7f9b84ad5700 1 --2- 172.21.15.79:0/3117338551 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9b64029100 0x7f9b6402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.022 7f9b84ad5700 1 --2- 172.21.15.79:0/3117338551 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9b64029100 0x7f9b6402b650 crc :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.026 7f9b86d31700 1 -- 172.21.15.79:0/3117338551 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b80088d30 con 0x7f9b800d56c0 2021-04-09T18:35:42.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.034 7f9b7d7fa700 1 -- 172.21.15.79:0/3117338551 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9b70011dd0 con 0x7f9b800d56c0 2021-04-09T18:35:42.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.198 7f9b86d31700 1 -- 172.21.15.79:0/3117338551 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9b800e39a0 con 0x7f9b800d56c0 2021-04-09T18:35:42.214 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.206 7f9b7d7fa700 1 -- 172.21.15.79:0/3117338551 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v41) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9b700095f0 con 0x7f9b800d56c0 2021-04-09T18:35:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.2 2021-04-09T18:35:42.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.218 7f9b86d31700 1 -- 172.21.15.79:0/3117338551 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9b64029100 msgr2=0x7f9b6402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:42.226 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.218 7f9b86d31700 1 --2- 172.21.15.79:0/3117338551 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9b64029100 0x7f9b6402b650 crc :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.218 7f9b86d31700 1 -- 172.21.15.79:0/3117338551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b800d56c0 msgr2=0x7f9b800c4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:42.227 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.218 7f9b86d31700 1 --2- 172.21.15.79:0/3117338551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b800d56c0 0x7f9b800c4e70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f9b70002f30 tx=0x7f9b70006890).stop 2021-04-09T18:35:42.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.218 7f9b86d31700 1 -- 172.21.15.79:0/3117338551 shutdown_connections 2021-04-09T18:35:42.228 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.218 7f9b86d31700 1 --2- 172.21.15.79:0/3117338551 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9b64029100 0x7f9b6402b650 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.218 7f9b86d31700 1 --2- 172.21.15.79:0/3117338551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b80098280 0x7f9b80097610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.229 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.218 7f9b86d31700 1 --2- 172.21.15.79:0/3117338551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b800d56c0 0x7f9b800c4e70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.218 7f9b86d31700 1 --2- 172.21.15.79:0/3117338551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b800d5270 0x7f9b800c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.230 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.218 7f9b86d31700 1 -- 172.21.15.79:0/3117338551 >> 172.21.15.79:0/3117338551 conn(0x7f9b800a4060 msgr2=0x7f9b8009ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:42.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.218 7f9b86d31700 1 -- 172.21.15.79:0/3117338551 shutdown_connections 2021-04-09T18:35:42.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.218 7f9b86d31700 1 -- 172.21.15.79:0/3117338551 wait complete. 2021-04-09T18:35:42.237 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:35:42.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.322 7fe9b84eb700 1 Processor -- start 2021-04-09T18:35:42.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.322 7fe9b84eb700 1 -- start start 2021-04-09T18:35:42.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b84eb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b01c9010 0x7fe9b01cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:42.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b84eb700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b00fbb10 con 0x7fe9b00f5510 2021-04-09T18:35:42.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b84eb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b009f900 con 0x7fe9b00e9ad0 2021-04-09T18:35:42.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b84eb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b01c3db0 con 0x7fe9b01c9010 2021-04-09T18:35:42.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b628f700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe9b00f5510 0x7fe9b00f64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58596/0 (socket says 172.21.15.79:58596) 2021-04-09T18:35:42.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b628f700 1 -- 172.21.15.79:0/666457424 learned_addr learned my addr 172.21.15.79:0/666457424 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:42.339 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b6a90700 1 --2- 172.21.15.79:0/666457424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b01c9010 0x7fe9b01cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:42.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b528d700 1 -- 172.21.15.79:0/666457424 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158449627 0 0) 0x7fe9ac0010d0 con 0x7fe9b00f5510 2021-04-09T18:35:42.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b528d700 1 -- 172.21.15.79:0/666457424 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe99c003240 con 0x7fe9b00f5510 2021-04-09T18:35:42.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b528d700 1 -- 172.21.15.79:0/666457424 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465335326 0 0) 0x7fe9a40010d0 con 0x7fe9b00e9ad0 2021-04-09T18:35:42.340 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b528d700 1 -- 172.21.15.79:0/666457424 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe99c003620 con 0x7fe9b00e9ad0 2021-04-09T18:35:42.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b6a90700 1 -- 172.21.15.79:0/666457424 >> v1:172.21.15.89:6789/0 conn(0x7fe9b00e9ad0 legacy=0x7fe9b009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:42.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b6a90700 1 -- 172.21.15.79:0/666457424 >> v1:172.21.15.79:6789/0 conn(0x7fe9b00f5510 legacy=0x7fe9b00f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:42.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b6a90700 1 -- 172.21.15.79:0/666457424 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b00e56c0 con 0x7fe9b01c9010 2021-04-09T18:35:42.341 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b6a90700 1 --2- 172.21.15.79:0/666457424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b01c9010 0x7fe9b01cb470 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fe9a80032b0 tx=0x7fe9a800b0e0).ready entity=mon.2 client_cookie=1923d36d998c8197 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:42.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b528d700 1 -- 172.21.15.79:0/666457424 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe9b00e56c0 con 0x7fe9b01c9010 2021-04-09T18:35:42.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b528d700 1 -- 172.21.15.79:0/666457424 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a800baf0 con 0x7fe9b01c9010 2021-04-09T18:35:42.342 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b528d700 1 -- 172.21.15.79:0/666457424 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe9a8002020 con 0x7fe9b01c9010 2021-04-09T18:35:42.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b84eb700 1 -- 172.21.15.79:0/666457424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b01c9010 msgr2=0x7fe9b01cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:42.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b84eb700 1 --2- 172.21.15.79:0/666457424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b01c9010 0x7fe9b01cb470 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fe9a80032b0 tx=0x7fe9a800b0e0).stop 2021-04-09T18:35:42.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b84eb700 1 -- 172.21.15.79:0/666457424 shutdown_connections 2021-04-09T18:35:42.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b84eb700 1 --2- 172.21.15.79:0/666457424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b01c9010 0x7fe9b01cb470 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.343 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.326 7fe9b84eb700 1 -- 172.21.15.79:0/666457424 >> 172.21.15.79:0/666457424 conn(0x7fe9b00e5fd0 msgr2=0x7fe9b00e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:42.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.330 7fe9b84eb700 1 -- 172.21.15.79:0/666457424 shutdown_connections 2021-04-09T18:35:42.344 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.330 7fe9b84eb700 1 -- 172.21.15.79:0/666457424 wait complete. 2021-04-09T18:35:42.347 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.330 7fe9b84eb700 1 Processor -- start 2021-04-09T18:35:42.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.330 7fe9b84eb700 1 -- start start 2021-04-09T18:35:42.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.330 7fe9b84eb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b00d76d0 0x7fe9b00cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:42.348 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.330 7fe9b84eb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9b00cc950 0x7fe9b00d5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:42.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.330 7fe9b84eb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b00d6400 0x7fe9b00d7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:42.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.330 7fe9b84eb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b00885b0 con 0x7fe9b00d6400 2021-04-09T18:35:42.349 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.330 7fe9b84eb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b00e9f20 con 0x7fe9b00cc950 2021-04-09T18:35:42.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.330 7fe9b84eb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b0091350 con 0x7fe9b00d76d0 2021-04-09T18:35:42.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.334 7fe9b6a90700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b00d6400 0x7fe9b00d7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:42.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.334 7fe9b6a90700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b00d6400 0x7fe9b00d7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35662/0 (socket says 172.21.15.79:35662) 2021-04-09T18:35:42.350 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.334 7fe9b6a90700 1 -- 172.21.15.79:0/2318383038 learned_addr learned my addr 172.21.15.79:0/2318383038 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:42.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.334 7fe9b628f700 1 --2- 172.21.15.79:0/2318383038 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b00d76d0 0x7fe9b00cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:42.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.334 7fe9b5a8e700 1 --2- 172.21.15.79:0/2318383038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9b00cc950 0x7fe9b00d5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:42.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.334 7fe9b6a90700 1 -- 172.21.15.79:0/2318383038 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b00d76d0 msgr2=0x7fe9b00cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:42.351 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.334 7fe9b6a90700 1 --2- 172.21.15.79:0/2318383038 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b00d76d0 0x7fe9b00cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.334 7fe9b6a90700 1 -- 172.21.15.79:0/2318383038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9b00cc950 msgr2=0x7fe9b00d5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:42.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.334 7fe9b6a90700 1 --2- 172.21.15.79:0/2318383038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9b00cc950 0x7fe9b00d5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.352 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.334 7fe9b6a90700 1 -- 172.21.15.79:0/2318383038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b0091650 con 0x7fe9b00d6400 2021-04-09T18:35:42.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.334 7fe9b6a90700 1 --2- 172.21.15.79:0/2318383038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b00d6400 0x7fe9b00d7d70 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7fe9b00e8b30 tx=0x7fe9a8006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:42.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.334 7fe9a2ffd700 1 -- 172.21.15.79:0/2318383038 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe9b0091650 con 0x7fe9b00d6400 2021-04-09T18:35:42.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.334 7fe9a2ffd700 1 -- 172.21.15.79:0/2318383038 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a801f030 con 0x7fe9b00d6400 2021-04-09T18:35:42.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.334 7fe9b84eb700 1 -- 172.21.15.79:0/2318383038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b00d8d80 con 0x7fe9b00d6400 2021-04-09T18:35:42.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.334 7fe9a2ffd700 1 -- 172.21.15.79:0/2318383038 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe9a8002020 con 0x7fe9b00d6400 2021-04-09T18:35:42.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.334 7fe9b84eb700 1 -- 172.21.15.79:0/2318383038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b00d83a0 con 0x7fe9b00d6400 2021-04-09T18:35:42.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.334 7fe9a2ffd700 1 -- 172.21.15.79:0/2318383038 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe9a802a060 con 0x7fe9b00d6400 2021-04-09T18:35:42.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.334 7fe9a2ffd700 1 --2- 172.21.15.79:0/2318383038 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe998029100 0x7fe99802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:42.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.334 7fe9a2ffd700 1 -- 172.21.15.79:0/2318383038 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fe9a803b620 con 0x7fe9b00d6400 2021-04-09T18:35:42.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.334 7fe9b628f700 1 --2- 172.21.15.79:0/2318383038 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe998029100 0x7fe99802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:42.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.338 7fe9b628f700 1 --2- 172.21.15.79:0/2318383038 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe998029100 0x7fe99802b650 crc :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:42.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.338 7fe9b84eb700 1 -- 172.21.15.79:0/2318383038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b00e39d0 con 0x7fe9b00d6400 2021-04-09T18:35:42.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.346 7fe9a2ffd700 1 -- 172.21.15.79:0/2318383038 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe9a800b8e0 con 0x7fe9b00d6400 2021-04-09T18:35:42.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.518 7fe9b84eb700 1 -- 172.21.15.79:0/2318383038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9b00f5b10 con 0x7fe9b00d6400 2021-04-09T18:35:42.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.518 7fe9a2ffd700 1 -- 172.21.15.79:0/2318383038 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+2107 (secure 0 0 0) 0x7fe9a8031850 con 0x7fe9b00d6400 2021-04-09T18:35:42.528 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 86 2021-04-09T18:35:42.528 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:42.528 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":86,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8175,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/2663381192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2663381192},{"type":"v1","addr":"172.21.15.79:6833","nonce":2663381192}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:35:39.593350","modified":"2021-04-09 18:35:41.603617","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7055":{"gid":7055,"name":"b","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/4071560647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":4071560647},{"type":"v1","addr":"172.21.15.89:6835","nonce":4071560647}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-04-09T18:35:42.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.522 7fe9b84eb700 1 -- 172.21.15.79:0/2318383038 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe998029100 msgr2=0x7fe99802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:42.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.522 7fe9b84eb700 1 --2- 172.21.15.79:0/2318383038 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe998029100 0x7fe99802b650 crc :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.522 7fe9b84eb700 1 -- 172.21.15.79:0/2318383038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b00d6400 msgr2=0x7fe9b00d7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:42.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.522 7fe9b84eb700 1 --2- 172.21.15.79:0/2318383038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b00d6400 0x7fe9b00d7d70 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7fe9b00e8b30 tx=0x7fe9a8006c10).stop 2021-04-09T18:35:42.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.522 7fe9b84eb700 1 -- 172.21.15.79:0/2318383038 shutdown_connections 2021-04-09T18:35:42.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.522 7fe9b84eb700 1 --2- 172.21.15.79:0/2318383038 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe998029100 0x7fe99802b650 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.522 7fe9b84eb700 1 --2- 172.21.15.79:0/2318383038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b00d6400 0x7fe9b00d7d70 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.522 7fe9b84eb700 1 --2- 172.21.15.79:0/2318383038 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b00d76d0 0x7fe9b00cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.522 7fe9b84eb700 1 --2- 172.21.15.79:0/2318383038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9b00cc950 0x7fe9b00d5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.522 7fe9b84eb700 1 -- 172.21.15.79:0/2318383038 >> 172.21.15.79:0/2318383038 conn(0x7fe9b008e0d0 msgr2=0x7fe9b00d3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:42.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.522 7fe9b84eb700 1 -- 172.21.15.79:0/2318383038 shutdown_connections 2021-04-09T18:35:42.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.526 7fe9b84eb700 1 -- 172.21.15.79:0/2318383038 wait complete. 2021-04-09T18:35:42.741 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:35:39.593350', 'modified': '2021-04-09 18:35:41.603617', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 134, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7055}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7055': {'gid': 7055, 'name': 'b', 'rank': 0, 'incarnation': 85, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6835/4071560647', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 4071560647}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 4071560647}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:35:42.742 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:35:42.743 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2021-04-09T18:35:42.836 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:35:42.837 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:35:42.837 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2021-04-09T18:35:42.837 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 7055, 2021-04-09T18:35:42.837 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2021-04-09T18:35:42.838 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2021-04-09T18:35:42.838 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 2.230099016, 2021-04-09T18:35:42.838 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 86, 2021-04-09T18:35:42.838 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 135, 2021-04-09T18:35:42.839 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 135, 2021-04-09T18:35:42.839 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 6.8603653470000001 2021-04-09T18:35:42.839 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:35:42.843 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 7055, "want_state": "up:active", "state": "up:active", "rank_uptime": 2.230099016, "mdsmap_epoch": 86, "osdmap_epoch": 135, "osdmap_epoch_barrier": 135, "uptime": 6.8603653470000001 } 2021-04-09T18:35:42.844 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:35:42.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.938 7fa241b48700 1 Processor -- start 2021-04-09T18:35:42.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.938 7fa241b48700 1 -- start start 2021-04-09T18:35:42.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.938 7fa241b48700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa23c0f5520 0x7fa23c0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:42.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.938 7fa241b48700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa23c0e9ae0 0x7fa23c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:42.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.938 7fa241b48700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23c0fbb20 con 0x7fa23c1c2db0 2021-04-09T18:35:42.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.938 7fa241b48700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23c0e9f30 con 0x7fa23c0f5520 2021-04-09T18:35:42.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.938 7fa241b48700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0e59d0 con 0x7fa23c0e9ae0 2021-04-09T18:35:42.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.938 7fa23b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa23c0f5520 0x7fa23c0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:42.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.938 7fa23b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa23c0f5520 0x7fa23c0f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35666/0 (socket says 172.21.15.79:35666) 2021-04-09T18:35:42.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.938 7fa23b7fe700 1 -- 172.21.15.79:0/804318278 learned_addr learned my addr 172.21.15.79:0/804318278 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:42.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.938 7fa23affd700 1 --2- 172.21.15.79:0/804318278 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa23c0e9ae0 0x7fa23c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:42.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.938 7fa23b7fe700 1 -- 172.21.15.79:0/804318278 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa23c0e9ae0 msgr2=0x7fa23c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:42.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.938 7fa23b7fe700 1 --2- 172.21.15.79:0/804318278 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa23c0e9ae0 0x7fa23c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.938 7fa23b7fe700 1 -- 172.21.15.79:0/804318278 >> v1:172.21.15.89:6789/0 conn(0x7fa23c1c2db0 legacy=0x7fa23c1c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:42.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.938 7fa23b7fe700 1 -- 172.21.15.79:0/804318278 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c0e56d0 con 0x7fa23c0f5520 2021-04-09T18:35:42.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.942 7fa23b7fe700 1 --2- 172.21.15.79:0/804318278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa23c0f5520 0x7fa23c0f64b0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7fa22c002f30 tx=0x7fa22c00bda0).ready entity=mon.0 client_cookie=c26bd61061b9688a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:42.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.942 7fa23a7fc700 1 -- 172.21.15.79:0/804318278 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa23c0e56d0 con 0x7fa23c0f5520 2021-04-09T18:35:42.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.942 7fa23a7fc700 1 -- 172.21.15.79:0/804318278 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c0099d0 con 0x7fa23c0f5520 2021-04-09T18:35:42.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.942 7fa23a7fc700 1 -- 172.21.15.79:0/804318278 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa22c009da0 con 0x7fa23c0f5520 2021-04-09T18:35:42.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.942 7fa241b48700 1 -- 172.21.15.79:0/804318278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa23c0f5520 msgr2=0x7fa23c0f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:42.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.942 7fa241b48700 1 --2- 172.21.15.79:0/804318278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa23c0f5520 0x7fa23c0f64b0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7fa22c002f30 tx=0x7fa22c00bda0).stop 2021-04-09T18:35:42.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.942 7fa241b48700 1 -- 172.21.15.79:0/804318278 shutdown_connections 2021-04-09T18:35:42.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.942 7fa241b48700 1 --2- 172.21.15.79:0/804318278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa23c0f5520 0x7fa23c0f64b0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.942 7fa241b48700 1 --2- 172.21.15.79:0/804318278 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa23c0e9ae0 0x7fa23c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.942 7fa241b48700 1 -- 172.21.15.79:0/804318278 >> 172.21.15.79:0/804318278 conn(0x7fa23c0e5fe0 msgr2=0x7fa23c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:42.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.942 7fa241b48700 1 -- 172.21.15.79:0/804318278 shutdown_connections 2021-04-09T18:35:42.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.942 7fa241b48700 1 -- 172.21.15.79:0/804318278 wait complete. 2021-04-09T18:35:42.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa241b48700 1 Processor -- start 2021-04-09T18:35:42.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa241b48700 1 -- start start 2021-04-09T18:35:42.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa241b48700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa23c0b5bc0 0x7fa23c0c1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:42.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa241b48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa23c0b7440 0x7fa23c0af660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:42.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa241b48700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa23c0afc90 0x7fa23c1b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:42.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa241b48700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0b7140 con 0x7fa23c0b7440 2021-04-09T18:35:42.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa241b48700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c096d00 con 0x7fa23c0b5bc0 2021-04-09T18:35:42.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa241b48700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0992b0 con 0x7fa23c0afc90 2021-04-09T18:35:42.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa23affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa23c0b7440 0x7fa23c0af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:42.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa23affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa23c0b7440 0x7fa23c0af660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35672/0 (socket says 172.21.15.79:35672) 2021-04-09T18:35:42.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa23affd700 1 -- 172.21.15.79:0/2328588812 learned_addr learned my addr 172.21.15.79:0/2328588812 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:42.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa23b7fe700 1 --2- 172.21.15.79:0/2328588812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa23c0b5bc0 0x7fa23c0c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:42.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa23bfff700 1 --2- 172.21.15.79:0/2328588812 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa23c0afc90 0x7fa23c1b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:42.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa23affd700 1 -- 172.21.15.79:0/2328588812 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa23c0afc90 msgr2=0x7fa23c1b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:42.963 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa23affd700 1 --2- 172.21.15.79:0/2328588812 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa23c0afc90 0x7fa23c1b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa23affd700 1 -- 172.21.15.79:0/2328588812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa23c0b5bc0 msgr2=0x7fa23c0c1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:42.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa23affd700 1 --2- 172.21.15.79:0/2328588812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa23c0b5bc0 0x7fa23c0c1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:42.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa23affd700 1 -- 172.21.15.79:0/2328588812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c0b7890 con 0x7fa23c0b7440 2021-04-09T18:35:42.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa23bfff700 1 --2- 172.21.15.79:0/2328588812 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa23c0afc90 0x7fa23c1b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:42.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa23affd700 1 --2- 172.21.15.79:0/2328588812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa23c0b7440 0x7fa23c0af660 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7fa23000c000 tx=0x7fa23000ef20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:42.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa223fff700 1 -- 172.21.15.79:0/2328588812 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa23c0b7890 con 0x7fa23c0b7440 2021-04-09T18:35:42.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa223fff700 1 -- 172.21.15.79:0/2328588812 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23000cb80 con 0x7fa23c0b7440 2021-04-09T18:35:42.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa241b48700 1 -- 172.21.15.79:0/2328588812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23c1b1570 con 0x7fa23c0b7440 2021-04-09T18:35:42.965 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa223fff700 1 -- 172.21.15.79:0/2328588812 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa23000f040 con 0x7fa23c0b7440 2021-04-09T18:35:42.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.946 7fa241b48700 1 -- 172.21.15.79:0/2328588812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23c1b1ae0 con 0x7fa23c0b7440 2021-04-09T18:35:42.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.950 7fa223fff700 1 -- 172.21.15.79:0/2328588812 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa230011070 con 0x7fa23c0b7440 2021-04-09T18:35:42.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.950 7fa223fff700 1 --2- 172.21.15.79:0/2328588812 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa21c029100 0x7fa21c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:42.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.950 7fa223fff700 1 -- 172.21.15.79:0/2328588812 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fa230010040 con 0x7fa23c0b7440 2021-04-09T18:35:42.966 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.950 7fa23b7fe700 1 --2- 172.21.15.79:0/2328588812 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa21c029100 0x7fa21c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:42.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.950 7fa23b7fe700 1 --2- 172.21.15.79:0/2328588812 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa21c029100 0x7fa21c02b650 crc :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:42.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.950 7fa241b48700 1 -- 172.21.15.79:0/2328588812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23c0e39e0 con 0x7fa23c0b7440 2021-04-09T18:35:42.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:42.958 7fa223fff700 1 -- 172.21.15.79:0/2328588812 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa23c0e5ca0 con 0x7fa23c0b7440 2021-04-09T18:35:43.133 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.126 7fa241b48700 1 -- 172.21.15.79:0/2328588812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa23c0f5b20 con 0x7fa23c0b7440 2021-04-09T18:35:43.135 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.130 7fa223fff700 1 -- 172.21.15.79:0/2328588812 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+14359 (secure 0 0 0) 0x7fa23002e830 con 0x7fa23c0b7440 2021-04-09T18:35:43.136 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:43.137 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":135,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:35:39.987855","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:35:37.809302","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2021-04-09 18:35:38.660109","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6835/1552365531":"2021-04-10 18:35:39.980332","172.21.15.89:6834/1552365531":"2021-04-10 18:35:39.980332"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:35:43.139 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.134 7fa241b48700 1 -- 172.21.15.79:0/2328588812 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa21c029100 msgr2=0x7fa21c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:43.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.134 7fa241b48700 1 --2- 172.21.15.79:0/2328588812 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa21c029100 0x7fa21c02b650 crc :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.134 7fa241b48700 1 -- 172.21.15.79:0/2328588812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa23c0b7440 msgr2=0x7fa23c0af660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:43.140 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.134 7fa241b48700 1 --2- 172.21.15.79:0/2328588812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa23c0b7440 0x7fa23c0af660 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7fa23000c000 tx=0x7fa23000ef20).stop 2021-04-09T18:35:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.134 7fa241b48700 1 -- 172.21.15.79:0/2328588812 shutdown_connections 2021-04-09T18:35:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.134 7fa241b48700 1 --2- 172.21.15.79:0/2328588812 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa21c029100 0x7fa21c02b650 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.134 7fa241b48700 1 --2- 172.21.15.79:0/2328588812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa23c0b5bc0 0x7fa23c0c1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.134 7fa241b48700 1 --2- 172.21.15.79:0/2328588812 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa23c0afc90 0x7fa23c1b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.141 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.134 7fa241b48700 1 --2- 172.21.15.79:0/2328588812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa23c0b7440 0x7fa23c0af660 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.134 7fa241b48700 1 -- 172.21.15.79:0/2328588812 >> 172.21.15.79:0/2328588812 conn(0x7fa23c09a040 msgr2=0x7fa23c099540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:43.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.134 7fa241b48700 1 -- 172.21.15.79:0/2328588812 shutdown_connections 2021-04-09T18:35:43.142 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.134 7fa241b48700 1 -- 172.21.15.79:0/2328588812 wait complete. 2021-04-09T18:35:43.151 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 26, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:35:37.809302', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '133', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 27, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:35:38.660109', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '134', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:35:43.152 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:35:43.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef59407700 1 Processor -- start 2021-04-09T18:35:43.258 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef59407700 1 -- start start 2021-04-09T18:35:43.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef59407700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef540e9b10 0x7fef5409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:43.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef59407700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef540fbb50 con 0x7fef540f5550 2021-04-09T18:35:43.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef59407700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef540e5700 con 0x7fef541c8040 2021-04-09T18:35:43.259 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef59407700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef541c3df0 con 0x7fef540e9b10 2021-04-09T18:35:43.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef53005700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fef540f5550 0x7fef540f64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58622/0 (socket says 172.21.15.79:58622) 2021-04-09T18:35:43.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef53005700 1 -- 172.21.15.79:0/2587636884 learned_addr learned my addr 172.21.15.79:0/2587636884 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:43.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef52804700 1 --2- 172.21.15.79:0/2587636884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef540e9b10 0x7fef5409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:43.260 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef52003700 1 -- 172.21.15.79:0/2587636884 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620020166 0 0) 0x7fef440010d0 con 0x7fef540f5550 2021-04-09T18:35:43.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef52003700 1 -- 172.21.15.79:0/2587636884 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef3c003240 con 0x7fef540f5550 2021-04-09T18:35:43.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef52003700 1 -- 172.21.15.79:0/2587636884 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044970488 0 0) 0x7fef4c001450 con 0x7fef541c8040 2021-04-09T18:35:43.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef52003700 1 -- 172.21.15.79:0/2587636884 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef3c003620 con 0x7fef541c8040 2021-04-09T18:35:43.261 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef52804700 1 -- 172.21.15.79:0/2587636884 >> v1:172.21.15.89:6789/0 conn(0x7fef541c8040 legacy=0x7fef541ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:43.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef52804700 1 -- 172.21.15.79:0/2587636884 >> v1:172.21.15.79:6789/0 conn(0x7fef540f5550 legacy=0x7fef540f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:43.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef52003700 1 -- 172.21.15.79:0/2587636884 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1350128032 0 0) 0x7fef44001650 con 0x7fef540f5550 2021-04-09T18:35:43.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef52804700 1 -- 172.21.15.79:0/2587636884 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef540e4360 con 0x7fef540e9b10 2021-04-09T18:35:43.262 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef52804700 1 --2- 172.21.15.79:0/2587636884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef540e9b10 0x7fef5409f110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fef44001980 tx=0x7fef4800bcf0).ready entity=mon.2 client_cookie=75ae15ca997aacfd server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:43.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef52003700 1 -- 172.21.15.79:0/2587636884 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef540e4360 con 0x7fef540e9b10 2021-04-09T18:35:43.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef52003700 1 -- 172.21.15.79:0/2587636884 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef48009790 con 0x7fef540e9b10 2021-04-09T18:35:43.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef52003700 1 -- 172.21.15.79:0/2587636884 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef44001bb0 con 0x7fef540e9b10 2021-04-09T18:35:43.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef59407700 1 -- 172.21.15.79:0/2587636884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef540e9b10 msgr2=0x7fef5409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:43.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.246 7fef59407700 1 --2- 172.21.15.79:0/2587636884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef540e9b10 0x7fef5409f110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fef44001980 tx=0x7fef4800bcf0).stop 2021-04-09T18:35:43.264 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.250 7fef59407700 1 -- 172.21.15.79:0/2587636884 shutdown_connections 2021-04-09T18:35:43.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.250 7fef59407700 1 --2- 172.21.15.79:0/2587636884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef540e9b10 0x7fef5409f110 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.250 7fef59407700 1 -- 172.21.15.79:0/2587636884 >> 172.21.15.79:0/2587636884 conn(0x7fef540e6010 msgr2=0x7fef540e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:43.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.250 7fef59407700 1 -- 172.21.15.79:0/2587636884 shutdown_connections 2021-04-09T18:35:43.266 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.250 7fef59407700 1 -- 172.21.15.79:0/2587636884 wait complete. 2021-04-09T18:35:43.269 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef59407700 1 Processor -- start 2021-04-09T18:35:43.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef59407700 1 -- start start 2021-04-09T18:35:43.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef59407700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef5408f480 0x7fef5408f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:43.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef59407700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef540c2dc0 0x7fef540c3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:43.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef59407700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef54099980 0x7fef54099dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:43.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef59407700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef540e9f60 con 0x7fef54099980 2021-04-09T18:35:43.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef59407700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef540d5860 con 0x7fef540c2dc0 2021-04-09T18:35:43.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef59407700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef540d5b60 con 0x7fef5408f480 2021-04-09T18:35:43.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef53806700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef54099980 0x7fef54099dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:43.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef52804700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef540c2dc0 0x7fef540c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:43.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef53806700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef54099980 0x7fef54099dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35690/0 (socket says 172.21.15.79:35690) 2021-04-09T18:35:43.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef53806700 1 -- 172.21.15.79:0/1938143942 learned_addr learned my addr 172.21.15.79:0/1938143942 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:43.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef53005700 1 --2- 172.21.15.79:0/1938143942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef5408f480 0x7fef5408f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:43.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef52804700 1 -- 172.21.15.79:0/1938143942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef5408f480 msgr2=0x7fef5408f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:43.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef52804700 1 --2- 172.21.15.79:0/1938143942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef5408f480 0x7fef5408f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef52804700 1 -- 172.21.15.79:0/1938143942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef54099980 msgr2=0x7fef54099dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:43.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef52804700 1 --2- 172.21.15.79:0/1938143942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef54099980 0x7fef54099dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef52804700 1 -- 172.21.15.79:0/1938143942 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef540c3840 con 0x7fef540c2dc0 2021-04-09T18:35:43.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef53806700 1 --2- 172.21.15.79:0/1938143942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef54099980 0x7fef54099dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:43.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef53005700 1 --2- 172.21.15.79:0/1938143942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef5408f480 0x7fef5408f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:43.275 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef52804700 1 --2- 172.21.15.79:0/1938143942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef540c2dc0 0x7fef540c3210 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fef540b98b0 tx=0x7fef48006890).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:43.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef3bfff700 1 -- 172.21.15.79:0/1938143942 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef540c3840 con 0x7fef540c2dc0 2021-04-09T18:35:43.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef3bfff700 1 -- 172.21.15.79:0/1938143942 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef48011980 con 0x7fef540c2dc0 2021-04-09T18:35:43.276 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef59407700 1 -- 172.21.15.79:0/1938143942 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5408f160 con 0x7fef540c2dc0 2021-04-09T18:35:43.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef3bfff700 1 -- 172.21.15.79:0/1938143942 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef48011d50 con 0x7fef540c2dc0 2021-04-09T18:35:43.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.254 7fef59407700 1 -- 172.21.15.79:0/1938143942 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef540d5410 con 0x7fef540c2dc0 2021-04-09T18:35:43.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.258 7fef3bfff700 1 -- 172.21.15.79:0/1938143942 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fef480263b0 con 0x7fef540c2dc0 2021-04-09T18:35:43.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.258 7fef3bfff700 1 --2- 172.21.15.79:0/1938143942 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fef34029100 0x7fef3402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:43.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.258 7fef3bfff700 1 -- 172.21.15.79:0/1938143942 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fef4803b430 con 0x7fef540c2dc0 2021-04-09T18:35:43.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.258 7fef53005700 1 --2- 172.21.15.79:0/1938143942 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fef34029100 0x7fef3402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:43.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.258 7fef53005700 1 --2- 172.21.15.79:0/1938143942 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fef34029100 0x7fef3402b650 crc :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:43.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.258 7fef59407700 1 -- 172.21.15.79:0/1938143942 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef540e39f0 con 0x7fef540c2dc0 2021-04-09T18:35:43.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.266 7fef3bfff700 1 -- 172.21.15.79:0/1938143942 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fef48011770 con 0x7fef540c2dc0 2021-04-09T18:35:43.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.426 7fef59407700 1 -- 172.21.15.79:0/1938143942 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fef540a1c90 con 0x7fef540c2dc0 2021-04-09T18:35:43.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.426 7fef3bfff700 1 -- 172.21.15.79:0/1938143942 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v135) v1 ==== 92+0+10 (secure 0 0 0) 0x7fef48009580 con 0x7fef540c2dc0 2021-04-09T18:35:43.436 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:35:43.442 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.434 7fef59407700 1 -- 172.21.15.79:0/1938143942 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fef34029100 msgr2=0x7fef3402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:43.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.434 7fef59407700 1 --2- 172.21.15.79:0/1938143942 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fef34029100 0x7fef3402b650 crc :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.443 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.434 7fef59407700 1 -- 172.21.15.79:0/1938143942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef540c2dc0 msgr2=0x7fef540c3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:43.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.434 7fef59407700 1 --2- 172.21.15.79:0/1938143942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef540c2dc0 0x7fef540c3210 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fef540b98b0 tx=0x7fef48006890).stop 2021-04-09T18:35:43.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.434 7fef59407700 1 -- 172.21.15.79:0/1938143942 shutdown_connections 2021-04-09T18:35:43.444 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.434 7fef59407700 1 --2- 172.21.15.79:0/1938143942 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fef34029100 0x7fef3402b650 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.434 7fef59407700 1 --2- 172.21.15.79:0/1938143942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef54099980 0x7fef54099dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.434 7fef59407700 1 --2- 172.21.15.79:0/1938143942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef5408f480 0x7fef5408f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.445 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.434 7fef59407700 1 --2- 172.21.15.79:0/1938143942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef540c2dc0 0x7fef540c3210 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.434 7fef59407700 1 -- 172.21.15.79:0/1938143942 >> 172.21.15.79:0/1938143942 conn(0x7fef540d6f90 msgr2=0x7fef5408e570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:43.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.434 7fef59407700 1 -- 172.21.15.79:0/1938143942 shutdown_connections 2021-04-09T18:35:43.446 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.434 7fef59407700 1 -- 172.21.15.79:0/1938143942 wait complete. 2021-04-09T18:35:43.454 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:35:43.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f35093700 1 Processor -- start 2021-04-09T18:35:43.565 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f35093700 1 -- start start 2021-04-09T18:35:43.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f35093700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f300f5550 0x7f2f300f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:43.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f35093700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2f301c8040 0x7f2f301ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:43.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f35093700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f300fbb50 con 0x7f2f300e9b10 2021-04-09T18:35:43.566 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f35093700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f300e9f60 con 0x7f2f301c8040 2021-04-09T18:35:43.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f35093700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f301c3df0 con 0x7f2f300f5550 2021-04-09T18:35:43.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f2f59e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2f301c8040 0x7f2f301ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:43.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f2f59e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2f301c8040 0x7f2f301ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35698/0 (socket says 172.21.15.79:35698) 2021-04-09T18:35:43.567 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f2e59c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2f300e9b10 0x7f2f3009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58638/0 (socket says 172.21.15.79:58638) 2021-04-09T18:35:43.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f2f59e700 1 -- 172.21.15.79:0/1063172877 learned_addr learned my addr 172.21.15.79:0/1063172877 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:43.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f2ed9d700 1 --2- 172.21.15.79:0/1063172877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f300f5550 0x7f2f300f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:43.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f2f59e700 1 -- 172.21.15.79:0/1063172877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f300f5550 msgr2=0x7f2f300f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:43.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f2f59e700 1 --2- 172.21.15.79:0/1063172877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f300f5550 0x7f2f300f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.568 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f2f59e700 1 -- 172.21.15.79:0/1063172877 >> v1:172.21.15.79:6789/0 conn(0x7f2f300e9b10 legacy=0x7f2f3009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:43.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f2dd9b700 1 -- 172.21.15.79:0/1063172877 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921227725 0 0) 0x7f2f180010d0 con 0x7f2f300e9b10 2021-04-09T18:35:43.569 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f2f59e700 1 -- 172.21.15.79:0/1063172877 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3009f910 con 0x7f2f301c8040 2021-04-09T18:35:43.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f2ed9d700 1 --2- 172.21.15.79:0/1063172877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f300f5550 0x7f2f300f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:43.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f2f59e700 1 --2- 172.21.15.79:0/1063172877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f301c8040 0x7f2f301ca4a0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f2f280032b0 tx=0x7f2f2800b3c0).ready entity=mon.0 client_cookie=cb53a5db9410a500 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:43.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f2dd9b700 1 -- 172.21.15.79:0/1063172877 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2f3009f910 con 0x7f2f301c8040 2021-04-09T18:35:43.570 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f2dd9b700 1 -- 172.21.15.79:0/1063172877 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2800bc20 con 0x7f2f301c8040 2021-04-09T18:35:43.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f2dd9b700 1 -- 172.21.15.79:0/1063172877 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2f28002020 con 0x7f2f301c8040 2021-04-09T18:35:43.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f35093700 1 -- 172.21.15.79:0/1063172877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f301c8040 msgr2=0x7f2f301ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:43.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.554 7f2f35093700 1 --2- 172.21.15.79:0/1063172877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f301c8040 0x7f2f301ca4a0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f2f280032b0 tx=0x7f2f2800b3c0).stop 2021-04-09T18:35:43.571 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f35093700 1 -- 172.21.15.79:0/1063172877 shutdown_connections 2021-04-09T18:35:43.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f35093700 1 --2- 172.21.15.79:0/1063172877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f301c8040 0x7f2f301ca4a0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f35093700 1 --2- 172.21.15.79:0/1063172877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f300f5550 0x7f2f300f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f35093700 1 -- 172.21.15.79:0/1063172877 >> 172.21.15.79:0/1063172877 conn(0x7f2f300e6010 msgr2=0x7f2f300e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:43.572 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f35093700 1 -- 172.21.15.79:0/1063172877 shutdown_connections 2021-04-09T18:35:43.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f35093700 1 -- 172.21.15.79:0/1063172877 wait complete. 2021-04-09T18:35:43.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f35093700 1 Processor -- start 2021-04-09T18:35:43.573 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f35093700 1 -- start start 2021-04-09T18:35:43.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f35093700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f300aa690 0x7f2f301aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:43.576 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f35093700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f300aaae0 0x7f2f301aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:43.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f35093700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f301a6500 0x7f2f301a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:43.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f35093700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f30088590 con 0x7f2f300aaae0 2021-04-09T18:35:43.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f35093700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f300ad070 con 0x7f2f300aa690 2021-04-09T18:35:43.577 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f35093700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f300ad370 con 0x7f2f301a6500 2021-04-09T18:35:43.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f2e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f300aaae0 0x7f2f301aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:43.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f2e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f300aaae0 0x7f2f301aaec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35700/0 (socket says 172.21.15.79:35700) 2021-04-09T18:35:43.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f2e59c700 1 -- 172.21.15.79:0/1494929774 learned_addr learned my addr 172.21.15.79:0/1494929774 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:43.578 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f2ed9d700 1 --2- 172.21.15.79:0/1494929774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f300aa690 0x7f2f301aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:43.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f2f59e700 1 --2- 172.21.15.79:0/1494929774 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f301a6500 0x7f2f301a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:43.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f2e59c700 1 -- 172.21.15.79:0/1494929774 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f301a6500 msgr2=0x7f2f301a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:43.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f2e59c700 1 --2- 172.21.15.79:0/1494929774 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f301a6500 0x7f2f301a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.579 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f2e59c700 1 -- 172.21.15.79:0/1494929774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f300aa690 msgr2=0x7f2f301aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:43.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f2e59c700 1 --2- 172.21.15.79:0/1494929774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f300aa690 0x7f2f301aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f2e59c700 1 -- 172.21.15.79:0/1494929774 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f300ab790 con 0x7f2f300aaae0 2021-04-09T18:35:43.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.558 7f2f2ed9d700 1 --2- 172.21.15.79:0/1494929774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f300aa690 0x7f2f301aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:43.580 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.562 7f2f2e59c700 1 --2- 172.21.15.79:0/1494929774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f300aaae0 0x7f2f301aaec0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f2f300ac7d0 tx=0x7f2f1800cb30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:43.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.562 7f2f277fe700 1 -- 172.21.15.79:0/1494929774 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2f300ab790 con 0x7f2f300aaae0 2021-04-09T18:35:43.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.562 7f2f277fe700 1 -- 172.21.15.79:0/1494929774 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f18007320 con 0x7f2f300aaae0 2021-04-09T18:35:43.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.562 7f2f277fe700 1 -- 172.21.15.79:0/1494929774 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2f18005720 con 0x7f2f300aaae0 2021-04-09T18:35:43.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.562 7f2f35093700 1 -- 172.21.15.79:0/1494929774 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f301ab4f0 con 0x7f2f300aaae0 2021-04-09T18:35:43.581 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.562 7f2f35093700 1 -- 172.21.15.79:0/1494929774 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f301a6f80 con 0x7f2f300aaae0 2021-04-09T18:35:43.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.562 7f2f277fe700 1 -- 172.21.15.79:0/1494929774 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2f1801a020 con 0x7f2f300aaae0 2021-04-09T18:35:43.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.562 7f2f277fe700 1 --2- 172.21.15.79:0/1494929774 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2f14029100 0x7f2f1402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:43.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.562 7f2f277fe700 1 -- 172.21.15.79:0/1494929774 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f2f180392c0 con 0x7f2f300aaae0 2021-04-09T18:35:43.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.562 7f2f2ed9d700 1 --2- 172.21.15.79:0/1494929774 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2f14029100 0x7f2f1402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:43.582 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.562 7f2f2ed9d700 1 --2- 172.21.15.79:0/1494929774 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2f14029100 0x7f2f1402b650 crc :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:43.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.570 7f2f35093700 1 -- 172.21.15.79:0/1494929774 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f300e39f0 con 0x7f2f300aaae0 2021-04-09T18:35:43.583 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.574 7f2f277fe700 1 -- 172.21.15.79:0/1494929774 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2f18007110 con 0x7f2f300aaae0 2021-04-09T18:35:43.748 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.742 7f2f35093700 1 -- 172.21.15.79:0/1494929774 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f2f300f5b50 con 0x7f2f300aaae0 2021-04-09T18:35:43.749 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.742 7f2f277fe700 1 -- 172.21.15.79:0/1494929774 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v135) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2f300e5cd0 con 0x7f2f300aaae0 2021-04-09T18:35:43.751 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:35:43.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.746 7f2f35093700 1 -- 172.21.15.79:0/1494929774 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2f14029100 msgr2=0x7f2f1402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:43.754 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.746 7f2f35093700 1 --2- 172.21.15.79:0/1494929774 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2f14029100 0x7f2f1402b650 crc :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.746 7f2f35093700 1 -- 172.21.15.79:0/1494929774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f300aaae0 msgr2=0x7f2f301aaec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:43.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.746 7f2f35093700 1 --2- 172.21.15.79:0/1494929774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f300aaae0 0x7f2f301aaec0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f2f300ac7d0 tx=0x7f2f1800cb30).stop 2021-04-09T18:35:43.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.746 7f2f35093700 1 -- 172.21.15.79:0/1494929774 shutdown_connections 2021-04-09T18:35:43.755 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.746 7f2f35093700 1 --2- 172.21.15.79:0/1494929774 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2f14029100 0x7f2f1402b650 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.746 7f2f35093700 1 --2- 172.21.15.79:0/1494929774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f300aa690 0x7f2f301aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.746 7f2f35093700 1 --2- 172.21.15.79:0/1494929774 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f301a6500 0x7f2f301a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.756 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.746 7f2f35093700 1 --2- 172.21.15.79:0/1494929774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f300aaae0 0x7f2f301aaec0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.746 7f2f35093700 1 -- 172.21.15.79:0/1494929774 >> 172.21.15.79:0/1494929774 conn(0x7f2f300d8050 msgr2=0x7f2f300ba6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:43.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.746 7f2f35093700 1 -- 172.21.15.79:0/1494929774 shutdown_connections 2021-04-09T18:35:43.757 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.746 7f2f35093700 1 -- 172.21.15.79:0/1494929774 wait complete. 2021-04-09T18:35:43.769 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:35:43.873 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.858 7f4f1fa7c700 1 Processor -- start 2021-04-09T18:35:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.858 7f4f1fa7c700 1 -- start start 2021-04-09T18:35:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1fa7c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f180e9b10 0x7f4f1809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1fa7c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f180fbb50 con 0x7f4f181c8040 2021-04-09T18:35:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1fa7c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f180e5700 con 0x7f4f180f5550 2021-04-09T18:35:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1fa7c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f181c3df0 con 0x7f4f180e9b10 2021-04-09T18:35:43.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1e021700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4f181c8040 0x7f4f181ca4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58650/0 (socket says 172.21.15.79:58650) 2021-04-09T18:35:43.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1e021700 1 -- 172.21.15.79:0/3644090868 learned_addr learned my addr 172.21.15.79:0/3644090868 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:43.875 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1d01f700 1 --2- 172.21.15.79:0/3644090868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f180e9b10 0x7f4f1809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:43.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1c81e700 1 -- 172.21.15.79:0/3644090868 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246314907 0 0) 0x7f4f10001450 con 0x7f4f181c8040 2021-04-09T18:35:43.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1c81e700 1 -- 172.21.15.79:0/3644090868 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f04003240 con 0x7f4f181c8040 2021-04-09T18:35:43.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1c81e700 1 -- 172.21.15.79:0/3644090868 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600265679 0 0) 0x7f4f140010d0 con 0x7f4f180f5550 2021-04-09T18:35:43.876 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1c81e700 1 -- 172.21.15.79:0/3644090868 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f04003620 con 0x7f4f180f5550 2021-04-09T18:35:43.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1d01f700 1 -- 172.21.15.79:0/3644090868 >> v1:172.21.15.89:6789/0 conn(0x7f4f180f5550 legacy=0x7f4f180f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:43.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1d01f700 1 -- 172.21.15.79:0/3644090868 >> v1:172.21.15.79:6789/0 conn(0x7f4f181c8040 legacy=0x7f4f181ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:43.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1d01f700 1 -- 172.21.15.79:0/3644090868 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f180e4360 con 0x7f4f180e9b10 2021-04-09T18:35:43.877 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1d01f700 1 --2- 172.21.15.79:0/3644090868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f180e9b10 0x7f4f1809f110 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f4f08002f30 tx=0x7f4f0800bcf0).ready entity=mon.2 client_cookie=b7df7533ff9446d4 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:43.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1c81e700 1 -- 172.21.15.79:0/3644090868 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4f180e4360 con 0x7f4f180e9b10 2021-04-09T18:35:43.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1c81e700 1 -- 172.21.15.79:0/3644090868 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f08009920 con 0x7f4f180e9b10 2021-04-09T18:35:43.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1c81e700 1 -- 172.21.15.79:0/3644090868 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4f08009cf0 con 0x7f4f180e9b10 2021-04-09T18:35:43.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1fa7c700 1 -- 172.21.15.79:0/3644090868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f180e9b10 msgr2=0x7f4f1809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:43.878 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1fa7c700 1 --2- 172.21.15.79:0/3644090868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f180e9b10 0x7f4f1809f110 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f4f08002f30 tx=0x7f4f0800bcf0).stop 2021-04-09T18:35:43.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1fa7c700 1 -- 172.21.15.79:0/3644090868 shutdown_connections 2021-04-09T18:35:43.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1fa7c700 1 --2- 172.21.15.79:0/3644090868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f180e9b10 0x7f4f1809f110 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1fa7c700 1 -- 172.21.15.79:0/3644090868 >> 172.21.15.79:0/3644090868 conn(0x7f4f180e6010 msgr2=0x7f4f180e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:43.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1fa7c700 1 -- 172.21.15.79:0/3644090868 shutdown_connections 2021-04-09T18:35:43.879 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.862 7f4f1fa7c700 1 -- 172.21.15.79:0/3644090868 wait complete. 2021-04-09T18:35:43.882 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1fa7c700 1 Processor -- start 2021-04-09T18:35:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1fa7c700 1 -- start start 2021-04-09T18:35:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1fa7c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f18090520 0x7f4f180d4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1fa7c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f180d6830 0x7f4f18090f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1fa7c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f180915a0 0x7f4f180ce900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1fa7c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180e9f60 con 0x7f4f180915a0 2021-04-09T18:35:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1fa7c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f18090c70 con 0x7f4f18090520 2021-04-09T18:35:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1fa7c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180d6c80 con 0x7f4f180d6830 2021-04-09T18:35:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1e021700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f180915a0 0x7f4f180ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:43.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1e021700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f180915a0 0x7f4f180ce900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35716/0 (socket says 172.21.15.79:35716) 2021-04-09T18:35:43.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1d01f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f180d6830 0x7f4f18090f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:43.885 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1e021700 1 -- 172.21.15.79:0/287507352 learned_addr learned my addr 172.21.15.79:0/287507352 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:43.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1d820700 1 --2- 172.21.15.79:0/287507352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f18090520 0x7f4f180d4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:43.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1e021700 1 -- 172.21.15.79:0/287507352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f180d6830 msgr2=0x7f4f18090f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:43.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1e021700 1 --2- 172.21.15.79:0/287507352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f180d6830 0x7f4f18090f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.886 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1e021700 1 -- 172.21.15.79:0/287507352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f18090520 msgr2=0x7f4f180d4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:43.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1e021700 1 --2- 172.21.15.79:0/287507352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f18090520 0x7f4f180d4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:43.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1e021700 1 -- 172.21.15.79:0/287507352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f180d5440 con 0x7f4f180915a0 2021-04-09T18:35:43.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1d01f700 1 --2- 172.21.15.79:0/287507352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f180d6830 0x7f4f18090f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:43.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1d820700 1 --2- 172.21.15.79:0/287507352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f18090520 0x7f4f180d4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:43.887 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1e021700 1 --2- 172.21.15.79:0/287507352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f180915a0 0x7f4f180ce900 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f4f180ba970 tx=0x7f4f1000cec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:43.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f0e7fc700 1 -- 172.21.15.79:0/287507352 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4f180d5440 con 0x7f4f180915a0 2021-04-09T18:35:43.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f0e7fc700 1 -- 172.21.15.79:0/287507352 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f10005b80 con 0x7f4f180915a0 2021-04-09T18:35:43.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1fa7c700 1 -- 172.21.15.79:0/287507352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f180d57e0 con 0x7f4f180915a0 2021-04-09T18:35:43.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f0e7fc700 1 -- 172.21.15.79:0/287507352 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4f10007110 con 0x7f4f180915a0 2021-04-09T18:35:43.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.870 7f4f1fa7c700 1 -- 172.21.15.79:0/287507352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f180cf0c0 con 0x7f4f180915a0 2021-04-09T18:35:43.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.874 7f4f0e7fc700 1 -- 172.21.15.79:0/287507352 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4f1001a060 con 0x7f4f180915a0 2021-04-09T18:35:43.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.874 7f4f0e7fc700 1 --2- 172.21.15.79:0/287507352 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4f00029100 0x7f4f0002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:43.889 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.874 7f4f0e7fc700 1 -- 172.21.15.79:0/287507352 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f4f10038f90 con 0x7f4f180915a0 2021-04-09T18:35:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.874 7f4f1d820700 1 --2- 172.21.15.79:0/287507352 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4f00029100 0x7f4f0002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.874 7f4f1d820700 1 --2- 172.21.15.79:0/287507352 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4f00029100 0x7f4f0002b650 crc :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.890 7f4f1fa7c700 1 -- 172.21.15.79:0/287507352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f180e39f0 con 0x7f4f180915a0 2021-04-09T18:35:43.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:43.894 7f4f0e7fc700 1 -- 172.21.15.79:0/287507352 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4f10000f70 con 0x7f4f180915a0 2021-04-09T18:35:44.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.050 7f4f1fa7c700 1 -- 172.21.15.79:0/287507352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f4f180d59e0 con 0x7f4f180915a0 2021-04-09T18:35:44.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.054 7f4f0e7fc700 1 -- 172.21.15.79:0/287507352 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v135) v1 ==== 100+0+10 (secure 0 0 0) 0x7f4f10005970 con 0x7f4f180915a0 2021-04-09T18:35:44.060 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:35:44.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.054 7f4f1fa7c700 1 -- 172.21.15.79:0/287507352 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4f00029100 msgr2=0x7f4f0002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:44.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.054 7f4f1fa7c700 1 --2- 172.21.15.79:0/287507352 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4f00029100 0x7f4f0002b650 crc :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:44.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.054 7f4f1fa7c700 1 -- 172.21.15.79:0/287507352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f180915a0 msgr2=0x7f4f180ce900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:44.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.054 7f4f1fa7c700 1 --2- 172.21.15.79:0/287507352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f180915a0 0x7f4f180ce900 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f4f180ba970 tx=0x7f4f1000cec0).stop 2021-04-09T18:35:44.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.054 7f4f1fa7c700 1 -- 172.21.15.79:0/287507352 shutdown_connections 2021-04-09T18:35:44.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.054 7f4f1fa7c700 1 --2- 172.21.15.79:0/287507352 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4f00029100 0x7f4f0002b650 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:44.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.054 7f4f1fa7c700 1 --2- 172.21.15.79:0/287507352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f18090520 0x7f4f180d4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:44.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.054 7f4f1fa7c700 1 --2- 172.21.15.79:0/287507352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f180915a0 0x7f4f180ce900 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:44.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.054 7f4f1fa7c700 1 --2- 172.21.15.79:0/287507352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f180d6830 0x7f4f18090f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:44.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.054 7f4f1fa7c700 1 -- 172.21.15.79:0/287507352 >> 172.21.15.79:0/287507352 conn(0x7f4f180d7140 msgr2=0x7f4f1808e560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:44.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.054 7f4f1fa7c700 1 -- 172.21.15.79:0/287507352 shutdown_connections 2021-04-09T18:35:44.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.054 7f4f1fa7c700 1 -- 172.21.15.79:0/287507352 wait complete. 2021-04-09T18:35:44.072 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:35:44.072 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:35:44.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20b55d5700 1 Processor -- start 2021-04-09T18:35:44.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20b55d5700 1 -- start start 2021-04-09T18:35:44.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20b55d5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b00f5510 0x7f20b00f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:44.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20b55d5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f20b00e9ad0 0x7f20b009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:44.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20b55d5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b00fbb10 con 0x7f20b01c2da0 2021-04-09T18:35:44.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20b55d5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b00e9f20 con 0x7f20b00e9ad0 2021-04-09T18:35:44.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20b55d5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00e59c0 con 0x7f20b00f5510 2021-04-09T18:35:44.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20af247700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b00f5510 0x7f20b00f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:44.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20aea46700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f20b00e9ad0 0x7f20b009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:44.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20aea46700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f20b00e9ad0 0x7f20b009f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:52294/0 (socket says 172.21.15.79:52294) 2021-04-09T18:35:44.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20af247700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b00f5510 0x7f20b00f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:60948/0 (socket says 172.21.15.79:60948) 2021-04-09T18:35:44.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20aea46700 1 -- 172.21.15.79:0/2969160582 learned_addr learned my addr 172.21.15.79:0/2969160582 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:44.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20afa48700 1 --1- 172.21.15.79:0/2969160582 >> v1:172.21.15.89:6789/0 conn(0x7f20b01c2da0 0x7f20b01c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:59136/0 (socket says 172.21.15.79:59136) 2021-04-09T18:35:44.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20aea46700 1 -- 172.21.15.79:0/2969160582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b00f5510 msgr2=0x7f20b00f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:44.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20aea46700 1 --2- 172.21.15.79:0/2969160582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b00f5510 0x7f20b00f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:44.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20aea46700 1 -- 172.21.15.79:0/2969160582 >> v1:172.21.15.89:6789/0 conn(0x7f20b01c2da0 legacy=0x7f20b01c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:44.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20ae245700 1 -- 172.21.15.79:0/2969160582 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127610526 0 0) 0x7f20a8001450 con 0x7f20b01c2da0 2021-04-09T18:35:44.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20aea46700 1 -- 172.21.15.79:0/2969160582 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b00e56c0 con 0x7f20b00e9ad0 2021-04-09T18:35:44.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20af247700 1 --2- 172.21.15.79:0/2969160582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b00f5510 0x7f20b00f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:44.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20aea46700 1 --2- 172.21.15.79:0/2969160582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20b00e9ad0 0x7f20b009f100 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f2098002f30 tx=0x7f209800bda0).ready entity=mon.1 client_cookie=ae02e145461e2ca0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:44.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20ae245700 1 -- 172.21.15.79:0/2969160582 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f20b00e56c0 con 0x7f20b00e9ad0 2021-04-09T18:35:44.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20ae245700 1 -- 172.21.15.79:0/2969160582 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20980099d0 con 0x7f20b00e9ad0 2021-04-09T18:35:44.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.162 7f20ae245700 1 -- 172.21.15.79:0/2969160582 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2098009da0 con 0x7f20b00e9ad0 2021-04-09T18:35:44.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.166 7f20b55d5700 1 -- 172.21.15.79:0/2969160582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20b00e9ad0 msgr2=0x7f20b009f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:44.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.166 7f20b55d5700 1 --2- 172.21.15.79:0/2969160582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20b00e9ad0 0x7f20b009f100 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f2098002f30 tx=0x7f209800bda0).stop 2021-04-09T18:35:44.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.166 7f20b55d5700 1 -- 172.21.15.79:0/2969160582 shutdown_connections 2021-04-09T18:35:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.166 7f20b55d5700 1 --2- 172.21.15.79:0/2969160582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b00f5510 0x7f20b00f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.166 7f20b55d5700 1 --2- 172.21.15.79:0/2969160582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20b00e9ad0 0x7f20b009f100 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.166 7f20b55d5700 1 -- 172.21.15.79:0/2969160582 >> 172.21.15.79:0/2969160582 conn(0x7f20b00e5fd0 msgr2=0x7f20b00e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.166 7f20b55d5700 1 -- 172.21.15.79:0/2969160582 shutdown_connections 2021-04-09T18:35:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.166 7f20b55d5700 1 -- 172.21.15.79:0/2969160582 wait complete. 2021-04-09T18:35:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20b55d5700 1 Processor -- start 2021-04-09T18:35:44.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20b55d5700 1 -- start start 2021-04-09T18:35:44.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20b55d5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20b00bade0 0x7f20b00a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:44.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20b55d5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b00cd760 0x7f20b00cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:44.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20b55d5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b01a4770 0x7f20b01a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:44.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20b55d5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00b94f0 con 0x7f20b01a4770 2021-04-09T18:35:44.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20b55d5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00b97f0 con 0x7f20b00bade0 2021-04-09T18:35:44.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20b55d5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00d6290 con 0x7f20b00cd760 2021-04-09T18:35:44.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20afa48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b01a4770 0x7f20b01a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:44.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20aea46700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b00cd760 0x7f20b00cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:44.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20af247700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20b00bade0 0x7f20b00a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:44.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20afa48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b01a4770 0x7f20b01a4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35730/0 (socket says 172.21.15.79:35730) 2021-04-09T18:35:44.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20afa48700 1 -- 172.21.15.79:0/3650060211 learned_addr learned my addr 172.21.15.79:0/3650060211 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:44.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20afa48700 1 -- 172.21.15.79:0/3650060211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b00cd760 msgr2=0x7f20b00cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:44.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20afa48700 1 --2- 172.21.15.79:0/3650060211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b00cd760 0x7f20b00cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:44.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20afa48700 1 -- 172.21.15.79:0/3650060211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20b00bade0 msgr2=0x7f20b00a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20afa48700 1 --2- 172.21.15.79:0/3650060211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20b00bade0 0x7f20b00a7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20afa48700 1 -- 172.21.15.79:0/3650060211 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b0098a70 con 0x7f20b01a4770 2021-04-09T18:35:44.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20aea46700 1 --2- 172.21.15.79:0/3650060211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b00cd760 0x7f20b00cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:44.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20af247700 1 --2- 172.21.15.79:0/3650060211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20b00bade0 0x7f20b00a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:44.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20afa48700 1 --2- 172.21.15.79:0/3650060211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b01a4770 0x7f20b01a4bc0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f20b00874c0 tx=0x7f20a800cf10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:44.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.170 7f20a7fff700 1 -- 172.21.15.79:0/3650060211 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f20b0098a70 con 0x7f20b01a4770 2021-04-09T18:35:44.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.174 7f20b55d5700 1 -- 172.21.15.79:0/3650060211 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b00a83a0 con 0x7f20b01a4770 2021-04-09T18:35:44.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.174 7f20a7fff700 1 -- 172.21.15.79:0/3650060211 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a8005ac0 con 0x7f20b01a4770 2021-04-09T18:35:44.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.174 7f20a7fff700 1 -- 172.21.15.79:0/3650060211 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f20a8007110 con 0x7f20b01a4770 2021-04-09T18:35:44.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.174 7f20b55d5700 1 -- 172.21.15.79:0/3650060211 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b00b90a0 con 0x7f20b01a4770 2021-04-09T18:35:44.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.174 7f20a7fff700 1 -- 172.21.15.79:0/3650060211 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f20a801a060 con 0x7f20b01a4770 2021-04-09T18:35:44.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.174 7f20a7fff700 1 --2- 172.21.15.79:0/3650060211 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2094029100 0x7f209402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:44.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.174 7f20a7fff700 1 -- 172.21.15.79:0/3650060211 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f20a8038f30 con 0x7f20b01a4770 2021-04-09T18:35:44.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.174 7f20af247700 1 --2- 172.21.15.79:0/3650060211 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2094029100 0x7f209402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:44.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.174 7f20b55d5700 1 -- 172.21.15.79:0/3650060211 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b00e39d0 con 0x7f20b01a4770 2021-04-09T18:35:44.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.174 7f20af247700 1 --2- 172.21.15.79:0/3650060211 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2094029100 0x7f209402b650 crc :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:44.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.182 7f20a7fff700 1 -- 172.21.15.79:0/3650060211 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f20b00f76b0 con 0x7f20b01a4770 2021-04-09T18:35:44.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.350 7f20b55d5700 1 -- 172.21.15.79:0/3650060211 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20b00f5b10 con 0x7f20b01a4770 2021-04-09T18:35:44.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.350 7f20a7fff700 1 -- 172.21.15.79:0/3650060211 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f20a80058b0 con 0x7f20b01a4770 2021-04-09T18:35:44.359 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:44.359 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":86,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8175,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/2663381192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2663381192},{"type":"v1","addr":"172.21.15.79:6833","nonce":2663381192}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:35:39.593350","modified":"2021-04-09 18:35:41.603617","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7055":{"gid":7055,"name":"b","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/4071560647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":4071560647},{"type":"v1","addr":"172.21.15.89:6835","nonce":4071560647}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-04-09T18:35:44.360 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 86 2021-04-09T18:35:44.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.354 7f20b55d5700 1 -- 172.21.15.79:0/3650060211 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2094029100 msgr2=0x7f209402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:44.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.354 7f20b55d5700 1 --2- 172.21.15.79:0/3650060211 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2094029100 0x7f209402b650 crc :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:44.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.354 7f20b55d5700 1 -- 172.21.15.79:0/3650060211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b01a4770 msgr2=0x7f20b01a4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:44.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.354 7f20b55d5700 1 --2- 172.21.15.79:0/3650060211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b01a4770 0x7f20b01a4bc0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f20b00874c0 tx=0x7f20a800cf10).stop 2021-04-09T18:35:44.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.354 7f20b55d5700 1 -- 172.21.15.79:0/3650060211 shutdown_connections 2021-04-09T18:35:44.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.354 7f20b55d5700 1 --2- 172.21.15.79:0/3650060211 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2094029100 0x7f209402b650 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:44.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.354 7f20b55d5700 1 --2- 172.21.15.79:0/3650060211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20b00bade0 0x7f20b00a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:44.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.354 7f20b55d5700 1 --2- 172.21.15.79:0/3650060211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20b01a4770 0x7f20b01a4bc0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:44.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.354 7f20b55d5700 1 --2- 172.21.15.79:0/3650060211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b00cd760 0x7f20b00cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:44.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.354 7f20b55d5700 1 -- 172.21.15.79:0/3650060211 >> 172.21.15.79:0/3650060211 conn(0x7f20b00d2b10 msgr2=0x7f20b00d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:44.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.354 7f20b55d5700 1 -- 172.21.15.79:0/3650060211 shutdown_connections 2021-04-09T18:35:44.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:44.354 7f20b55d5700 1 -- 172.21.15.79:0/3650060211 wait complete. 2021-04-09T18:35:44.573 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:35:39.593350', 'modified': '2021-04-09 18:35:41.603617', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 134, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7055}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7055': {'gid': 7055, 'name': 'b', 'rank': 0, 'incarnation': 85, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6835/4071560647', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 4071560647}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 4071560647}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:35:44.574 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:35:44.575 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2021-04-09T18:35:44.668 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:35:44.669 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:35:44.669 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2021-04-09T18:35:44.669 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 7055, 2021-04-09T18:35:44.669 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2021-04-09T18:35:44.670 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2021-04-09T18:35:44.670 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 4.0621714000000004, 2021-04-09T18:35:44.670 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 86, 2021-04-09T18:35:44.670 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 135, 2021-04-09T18:35:44.671 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 135, 2021-04-09T18:35:44.671 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 8.692437344 2021-04-09T18:35:44.671 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:35:44.675 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 7055, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.0621714000000004, "mdsmap_epoch": 86, "osdmap_epoch": 135, "osdmap_epoch_barrier": 135, "uptime": 8.692437344 } 2021-04-09T18:35:44.675 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:35:44.676 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-04-09T18:35:44.676 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi090.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-04-09T18:35:44.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:44.677 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:44.685 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:35:44.742 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:35:44.743 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:35:44.782 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:35:44.785 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:35:44.787 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:35:44.797 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:35:44.798 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:35:44.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:44.799 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:35:44.800 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:35:44.803 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:35:44.898 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:35:44.903 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:44.946 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2021-04-09T18:35:44.985 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:35:44.986 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:35:45.016 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[14263]: starting ceph client 2021-04-09T18:35:45.016 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:2021-04-09 18:35:45.010 7fc3544920c0 -1 init, newargv = 0x5557d0758640 newargc=9 2021-04-09T18:35:45.025 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[14263]: starting fuse 2021-04-09T18:35:45.038 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:35:45.038 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:35:45.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:45.040 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2021-04-09T18:35:45.092 INFO:teuthology.orchestra.run.smithi090.stdout:49 2021-04-09T18:35:45.093 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:35:45.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:45.094 DEBUG:teuthology.orchestra.run.smithi090:> sudo python3 -c ' 2021-04-09T18:35:45.094 DEBUG:teuthology.orchestra.run.smithi090:> import glob 2021-04-09T18:35:45.095 DEBUG:teuthology.orchestra.run.smithi090:> import re 2021-04-09T18:35:45.095 DEBUG:teuthology.orchestra.run.smithi090:> import os 2021-04-09T18:35:45.095 DEBUG:teuthology.orchestra.run.smithi090:> import subprocess 2021-04-09T18:35:45.096 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:35:45.096 DEBUG:teuthology.orchestra.run.smithi090:> def find_socket(client_name): 2021-04-09T18:35:45.097 DEBUG:teuthology.orchestra.run.smithi090:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-04-09T18:35:45.097 DEBUG:teuthology.orchestra.run.smithi090:> files = glob.glob(asok_path) 2021-04-09T18:35:45.098 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:35:45.098 DEBUG:teuthology.orchestra.run.smithi090:> # Given a non-glob path, it better be there 2021-04-09T18:35:45.099 DEBUG:teuthology.orchestra.run.smithi090:> if "*" not in asok_path: 2021-04-09T18:35:45.099 DEBUG:teuthology.orchestra.run.smithi090:> assert(len(files) == 1) 2021-04-09T18:35:45.100 DEBUG:teuthology.orchestra.run.smithi090:> return files[0] 2021-04-09T18:35:45.100 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:35:45.101 DEBUG:teuthology.orchestra.run.smithi090:> for f in files: 2021-04-09T18:35:45.101 DEBUG:teuthology.orchestra.run.smithi090:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:35:45.101 DEBUG:teuthology.orchestra.run.smithi090:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:35:45.102 DEBUG:teuthology.orchestra.run.smithi090:> return f 2021-04-09T18:35:45.102 DEBUG:teuthology.orchestra.run.smithi090:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:35:45.103 DEBUG:teuthology.orchestra.run.smithi090:> 2021-04-09T18:35:45.103 DEBUG:teuthology.orchestra.run.smithi090:> print(find_socket("client.0")) 2021-04-09T18:35:45.103 DEBUG:teuthology.orchestra.run.smithi090:> ' 2021-04-09T18:35:45.182 INFO:teuthology.orchestra.run.smithi090.stdout:/var/run/ceph/ceph-client.0.14263.asok 2021-04-09T18:35:45.188 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14263.asok 2021-04-09T18:35:45.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:45.189 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14263.asok status 2021-04-09T18:35:45.269 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2021-04-09T18:35:45.270 INFO:teuthology.orchestra.run.smithi090.stdout: "metadata": { 2021-04-09T18:35:45.270 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:35:45.270 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:35:45.271 INFO:teuthology.orchestra.run.smithi090.stdout: "entity_id": "0", 2021-04-09T18:35:45.271 INFO:teuthology.orchestra.run.smithi090.stdout: "hostname": "smithi090", 2021-04-09T18:35:45.271 INFO:teuthology.orchestra.run.smithi090.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-04-09T18:35:45.271 INFO:teuthology.orchestra.run.smithi090.stdout: "pid": "14263", 2021-04-09T18:35:45.272 INFO:teuthology.orchestra.run.smithi090.stdout: "root": "/" 2021-04-09T18:35:45.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:35:45.272 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_count": 0, 2021-04-09T18:35:45.272 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_pinned_count": 0, 2021-04-09T18:35:45.272 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 8328, 2021-04-09T18:35:45.273 INFO:teuthology.orchestra.run.smithi090.stdout: "inst": { 2021-04-09T18:35:45.273 INFO:teuthology.orchestra.run.smithi090.stdout: "name": { 2021-04-09T18:35:45.273 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "client", 2021-04-09T18:35:45.273 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 8328 2021-04-09T18:35:45.274 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:35:45.274 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:35:45.274 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:35:45.274 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:35:45.275 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 2989354225 2021-04-09T18:35:45.275 INFO:teuthology.orchestra.run.smithi090.stdout: } 2021-04-09T18:35:45.275 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:35:45.276 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2021-04-09T18:35:45.276 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2021-04-09T18:35:45.276 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2021-04-09T18:35:45.277 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 2989354225 2021-04-09T18:35:45.277 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2021-04-09T18:35:45.277 INFO:teuthology.orchestra.run.smithi090.stdout: "inst_str": "client.8328 172.21.15.90:0/2989354225", 2021-04-09T18:35:45.278 INFO:teuthology.orchestra.run.smithi090.stdout: "addr_str": "172.21.15.90:0/2989354225", 2021-04-09T18:35:45.278 INFO:teuthology.orchestra.run.smithi090.stdout: "inode_count": 1, 2021-04-09T18:35:45.278 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_epoch": 86, 2021-04-09T18:35:45.279 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch": 135, 2021-04-09T18:35:45.279 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:35:45.280 INFO:teuthology.orchestra.run.smithi090.stdout: "blacklisted": false, 2021-04-09T18:35:45.280 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs" 2021-04-09T18:35:45.281 INFO:teuthology.orchestra.run.smithi090.stdout:} 2021-04-09T18:35:45.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:45.283 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:45.284 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:45.291 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:35:45.293 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:35:45.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:45.295 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:45.355 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:35:45.465 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.450 7f04d9f5f700 1 Processor -- start 2021-04-09T18:35:45.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.450 7f04d9f5f700 1 -- start start 2021-04-09T18:35:45.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d9f5f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04d40e9ad0 0x7f04d409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:45.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d9f5f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04d41c8000 0x7f04d41ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:45.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d9f5f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d40fbb10 con 0x7f04d40f5510 2021-04-09T18:35:45.466 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d9f5f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d41c3db0 con 0x7f04d40e9ad0 2021-04-09T18:35:45.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d9f5f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40e9f20 con 0x7f04d41c8000 2021-04-09T18:35:45.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d2ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04d40e9ad0 0x7f04d409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:45.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d2ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04d40e9ad0 0x7f04d409f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35738/0 (socket says 172.21.15.79:35738) 2021-04-09T18:35:45.467 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d2ffd700 1 -- 172.21.15.79:0/854592877 learned_addr learned my addr 172.21.15.79:0/854592877 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:45.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d3fff700 1 --2- 172.21.15.79:0/854592877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04d41c8000 0x7f04d41ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:45.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d2ffd700 1 -- 172.21.15.79:0/854592877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04d41c8000 msgr2=0x7f04d41ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:45.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d2ffd700 1 --2- 172.21.15.79:0/854592877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04d41c8000 0x7f04d41ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:45.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d2ffd700 1 -- 172.21.15.79:0/854592877 >> v1:172.21.15.89:6789/0 conn(0x7f04d40f5510 legacy=0x7f04d40f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:45.468 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d2ffd700 1 -- 172.21.15.79:0/854592877 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d40e56c0 con 0x7f04d40e9ad0 2021-04-09T18:35:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d3fff700 1 --2- 172.21.15.79:0/854592877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04d41c8000 0x7f04d41ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d2ffd700 1 --2- 172.21.15.79:0/854592877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04d40e9ad0 0x7f04d409f100 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f04d40f6ef0 tx=0x7f04c800bdd0).ready entity=mon.0 client_cookie=3adb96fbe1bd5884 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d27fc700 1 -- 172.21.15.79:0/854592877 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f04d40e56c0 con 0x7f04d40e9ad0 2021-04-09T18:35:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d27fc700 1 -- 172.21.15.79:0/854592877 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c8009940 con 0x7f04d40e9ad0 2021-04-09T18:35:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d27fc700 1 -- 172.21.15.79:0/854592877 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f04c8009d50 con 0x7f04d40e9ad0 2021-04-09T18:35:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d9f5f700 1 -- 172.21.15.79:0/854592877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04d40e9ad0 msgr2=0x7f04d409f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d9f5f700 1 --2- 172.21.15.79:0/854592877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04d40e9ad0 0x7f04d409f100 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f04d40f6ef0 tx=0x7f04c800bdd0).stop 2021-04-09T18:35:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d9f5f700 1 -- 172.21.15.79:0/854592877 shutdown_connections 2021-04-09T18:35:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d9f5f700 1 --2- 172.21.15.79:0/854592877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04d41c8000 0x7f04d41ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:45.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d9f5f700 1 --2- 172.21.15.79:0/854592877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04d40e9ad0 0x7f04d409f100 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:45.471 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d9f5f700 1 -- 172.21.15.79:0/854592877 >> 172.21.15.79:0/854592877 conn(0x7f04d40e5fd0 msgr2=0x7f04d40e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d9f5f700 1 -- 172.21.15.79:0/854592877 shutdown_connections 2021-04-09T18:35:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.454 7f04d9f5f700 1 -- 172.21.15.79:0/854592877 wait complete. 2021-04-09T18:35:45.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.458 7f04d9f5f700 1 Processor -- start 2021-04-09T18:35:45.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.458 7f04d9f5f700 1 -- start start 2021-04-09T18:35:45.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04d9f5f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04d4098630 0x7f04d40b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:45.475 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04d9f5f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04d40afd90 0x7f04d4097940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04d9f5f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04d40b01e0 0x7f04d40c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04d9f5f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d4098da0 con 0x7f04d4098630 2021-04-09T18:35:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04d9f5f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40990a0 con 0x7f04d40afd90 2021-04-09T18:35:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04d9f5f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d4098a80 con 0x7f04d40b01e0 2021-04-09T18:35:45.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04d37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04d4098630 0x7f04d40b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:45.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04d37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04d4098630 0x7f04d40b4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35740/0 (socket says 172.21.15.79:35740) 2021-04-09T18:35:45.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04d37fe700 1 -- 172.21.15.79:0/3421169130 learned_addr learned my addr 172.21.15.79:0/3421169130 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:45.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04d2ffd700 1 --2- 172.21.15.79:0/3421169130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04d40afd90 0x7f04d4097940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:45.477 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04d3fff700 1 --2- 172.21.15.79:0/3421169130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04d40b01e0 0x7f04d40c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04d37fe700 1 -- 172.21.15.79:0/3421169130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04d40b01e0 msgr2=0x7f04d40c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04d37fe700 1 --2- 172.21.15.79:0/3421169130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04d40b01e0 0x7f04d40c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04d37fe700 1 -- 172.21.15.79:0/3421169130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04d40afd90 msgr2=0x7f04d4097940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04d37fe700 1 --2- 172.21.15.79:0/3421169130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04d40afd90 0x7f04d4097940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:45.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04d37fe700 1 -- 172.21.15.79:0/3421169130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d4097f70 con 0x7f04d4098630 2021-04-09T18:35:45.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04d37fe700 1 --2- 172.21.15.79:0/3421169130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04d4098630 0x7f04d40b4580 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f04d40d8280 tx=0x7f04c4009b40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:45.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04bbfff700 1 -- 172.21.15.79:0/3421169130 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f04d4097f70 con 0x7f04d4098630 2021-04-09T18:35:45.479 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04bbfff700 1 -- 172.21.15.79:0/3421169130 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c400d780 con 0x7f04d4098630 2021-04-09T18:35:45.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04d9f5f700 1 -- 172.21.15.79:0/3421169130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d40c4d90 con 0x7f04d4098630 2021-04-09T18:35:45.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04bbfff700 1 -- 172.21.15.79:0/3421169130 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f04c400db50 con 0x7f04d4098630 2021-04-09T18:35:45.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04d9f5f700 1 -- 172.21.15.79:0/3421169130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d40c52a0 con 0x7f04d4098630 2021-04-09T18:35:45.480 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04bbfff700 1 -- 172.21.15.79:0/3421169130 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f04c400e070 con 0x7f04d4098630 2021-04-09T18:35:45.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04bbfff700 1 --2- 172.21.15.79:0/3421169130 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f04b4029100 0x7f04b402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:45.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04bbfff700 1 -- 172.21.15.79:0/3421169130 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f04c400d040 con 0x7f04d4098630 2021-04-09T18:35:45.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.462 7f04d2ffd700 1 --2- 172.21.15.79:0/3421169130 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f04b4029100 0x7f04b402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:45.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.466 7f04d2ffd700 1 --2- 172.21.15.79:0/3421169130 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f04b4029100 0x7f04b402b650 crc :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:45.481 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.466 7f04d9f5f700 1 -- 172.21.15.79:0/3421169130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d40e39d0 con 0x7f04d4098630 2021-04-09T18:35:45.483 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.470 7f04bbfff700 1 -- 172.21.15.79:0/3421169130 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f04c400d380 con 0x7f04d4098630 2021-04-09T18:35:45.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.634 7f04d9f5f700 1 -- 172.21.15.79:0/3421169130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04d40a1cb0 con 0x7f04d4098630 2021-04-09T18:35:45.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.634 7f04bbfff700 1 -- 172.21.15.79:0/3421169130 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+14359 (secure 0 0 0) 0x7f04d4107f40 con 0x7f04d4098630 2021-04-09T18:35:45.643 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:45.644 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":135,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:35:39.987855","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:35:37.809302","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2021-04-09 18:35:38.660109","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6835/1552365531":"2021-04-10 18:35:39.980332","172.21.15.89:6834/1552365531":"2021-04-10 18:35:39.980332"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:35:45.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.638 7f04d9f5f700 1 -- 172.21.15.79:0/3421169130 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f04b4029100 msgr2=0x7f04b402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:45.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.638 7f04d9f5f700 1 --2- 172.21.15.79:0/3421169130 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f04b4029100 0x7f04b402b650 crc :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:45.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.638 7f04d9f5f700 1 -- 172.21.15.79:0/3421169130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04d4098630 msgr2=0x7f04d40b4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:45.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.638 7f04d9f5f700 1 --2- 172.21.15.79:0/3421169130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04d4098630 0x7f04d40b4580 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f04d40d8280 tx=0x7f04c4009b40).stop 2021-04-09T18:35:45.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.638 7f04d9f5f700 1 -- 172.21.15.79:0/3421169130 shutdown_connections 2021-04-09T18:35:45.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.638 7f04d9f5f700 1 --2- 172.21.15.79:0/3421169130 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f04b4029100 0x7f04b402b650 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:45.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.638 7f04d9f5f700 1 --2- 172.21.15.79:0/3421169130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04d40b01e0 0x7f04d40c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:45.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.638 7f04d9f5f700 1 --2- 172.21.15.79:0/3421169130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04d4098630 0x7f04d40b4580 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:45.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.638 7f04d9f5f700 1 --2- 172.21.15.79:0/3421169130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04d40afd90 0x7f04d4097940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:45.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.638 7f04d9f5f700 1 -- 172.21.15.79:0/3421169130 >> 172.21.15.79:0/3421169130 conn(0x7f04d409acf0 msgr2=0x7f04d409a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:45.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.638 7f04d9f5f700 1 -- 172.21.15.79:0/3421169130 shutdown_connections 2021-04-09T18:35:45.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.638 7f04d9f5f700 1 -- 172.21.15.79:0/3421169130 wait complete. 2021-04-09T18:35:45.657 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:26:06.311357', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 26, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:35:37.809302', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '133', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 27, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:35:38.660109', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '134', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:35:45.658 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:35:45.758 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.746 7fe769ab3700 1 Processor -- start 2021-04-09T18:35:45.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.746 7fe769ab3700 1 -- start start 2021-04-09T18:35:45.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe769ab3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe7640f5550 0x7fe7640f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:45.759 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe769ab3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe7640e9b10 0x7fe76409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:45.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe769ab3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7640fbb50 con 0x7fe7641c2de0 2021-04-09T18:35:45.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe769ab3700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7640e9f60 con 0x7fe7640e9b10 2021-04-09T18:35:45.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe769ab3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7640e5a00 con 0x7fe7640f5550 2021-04-09T18:35:45.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe762ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe7640e9b10 0x7fe76409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:45.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe762ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe7640e9b10 0x7fe76409f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35748/0 (socket says 172.21.15.79:35748) 2021-04-09T18:35:45.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe763fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe7641c2de0 0x7fe7641c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58694/0 (socket says 172.21.15.79:58694) 2021-04-09T18:35:45.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe762ffd700 1 -- 172.21.15.79:0/705609399 learned_addr learned my addr 172.21.15.79:0/705609399 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:45.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe7637fe700 1 --2- 172.21.15.79:0/705609399 >> v2:172.21.15.89:3300/0 conn(0x7fe7640f5550 0x7fe7640f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:45.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe762ffd700 1 -- 172.21.15.79:0/705609399 >> v2:172.21.15.89:3300/0 conn(0x7fe7640f5550 msgr2=0x7fe7640f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:45.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe762ffd700 1 --2- 172.21.15.79:0/705609399 >> v2:172.21.15.89:3300/0 conn(0x7fe7640f5550 0x7fe7640f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:45.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe762ffd700 1 -- 172.21.15.79:0/705609399 >> v1:172.21.15.79:6789/0 conn(0x7fe7641c2de0 legacy=0x7fe7641c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:45.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe7627fc700 1 -- 172.21.15.79:0/705609399 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666234633 0 0) 0x7fe75c0010d0 con 0x7fe7641c2de0 2021-04-09T18:35:45.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe762ffd700 1 -- 172.21.15.79:0/705609399 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7640e5700 con 0x7fe7640e9b10 2021-04-09T18:35:45.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe7637fe700 1 --2- 172.21.15.79:0/705609399 >> v2:172.21.15.89:3300/0 conn(0x7fe7640f5550 0x7fe7640f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:35:45.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe762ffd700 1 --2- 172.21.15.79:0/705609399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7640e9b10 0x7fe76409f110 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7fe7540032b0 tx=0x7fe75400b3c0).ready entity=mon.0 client_cookie=bba2a4ba777374 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:45.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe7627fc700 1 -- 172.21.15.79:0/705609399 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe7640e5700 con 0x7fe7640e9b10 2021-04-09T18:35:45.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe7627fc700 1 -- 172.21.15.79:0/705609399 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75400bc20 con 0x7fe7640e9b10 2021-04-09T18:35:45.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe7627fc700 1 -- 172.21.15.79:0/705609399 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe754002020 con 0x7fe7640e9b10 2021-04-09T18:35:45.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe769ab3700 1 -- 172.21.15.79:0/705609399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7640e9b10 msgr2=0x7fe76409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:45.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe769ab3700 1 --2- 172.21.15.79:0/705609399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7640e9b10 0x7fe76409f110 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7fe7540032b0 tx=0x7fe75400b3c0).stop 2021-04-09T18:35:45.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe769ab3700 1 -- 172.21.15.79:0/705609399 shutdown_connections 2021-04-09T18:35:45.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe769ab3700 1 --2- 172.21.15.79:0/705609399 >> v2:172.21.15.89:3300/0 conn(0x7fe7640f5550 0x7fe7640f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:45.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe769ab3700 1 --2- 172.21.15.79:0/705609399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7640e9b10 0x7fe76409f110 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:45.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe769ab3700 1 -- 172.21.15.79:0/705609399 >> 172.21.15.79:0/705609399 conn(0x7fe7640e6010 msgr2=0x7fe7640e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:45.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe769ab3700 1 -- 172.21.15.79:0/705609399 shutdown_connections 2021-04-09T18:35:45.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.750 7fe769ab3700 1 -- 172.21.15.79:0/705609399 wait complete. 2021-04-09T18:35:45.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe769ab3700 1 Processor -- start 2021-04-09T18:35:45.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe769ab3700 1 -- start start 2021-04-09T18:35:45.768 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe769ab3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe76419d700 0x7fe7640bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:45.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe769ab3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7640bb060 0x7fe7641ad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:45.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe769ab3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7641adff0 0x7fe7640c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:45.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe769ab3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7640e8b20 con 0x7fe7641adff0 2021-04-09T18:35:45.769 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe769ab3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76419be60 con 0x7fe7640bb060 2021-04-09T18:35:45.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe769ab3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76419c160 con 0x7fe76419d700 2021-04-09T18:35:45.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe763fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7641adff0 0x7fe7640c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:45.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe763fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7641adff0 0x7fe7640c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35758/0 (socket says 172.21.15.79:35758) 2021-04-09T18:35:45.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe763fff700 1 -- 172.21.15.79:0/1019605602 learned_addr learned my addr 172.21.15.79:0/1019605602 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:45.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe7637fe700 1 --2- 172.21.15.79:0/1019605602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe76419d700 0x7fe7640bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:45.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe762ffd700 1 --2- 172.21.15.79:0/1019605602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7640bb060 0x7fe7641ad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:45.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe763fff700 1 -- 172.21.15.79:0/1019605602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe76419d700 msgr2=0x7fe7640bfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:45.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe763fff700 1 --2- 172.21.15.79:0/1019605602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe76419d700 0x7fe7640bfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:45.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe763fff700 1 -- 172.21.15.79:0/1019605602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7640bb060 msgr2=0x7fe7641ad9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:45.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe763fff700 1 --2- 172.21.15.79:0/1019605602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7640bb060 0x7fe7641ad9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:45.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe763fff700 1 -- 172.21.15.79:0/1019605602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7641c0980 con 0x7fe7641adff0 2021-04-09T18:35:45.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe763fff700 1 --2- 172.21.15.79:0/1019605602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7641adff0 0x7fe7640c73f0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7fe7640d7e70 tx=0x7fe75c00cb30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:45.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe75bfff700 1 -- 172.21.15.79:0/1019605602 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe7641c0980 con 0x7fe7641adff0 2021-04-09T18:35:45.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe769ab3700 1 -- 172.21.15.79:0/1019605602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7640c3bc0 con 0x7fe7641adff0 2021-04-09T18:35:45.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe75bfff700 1 -- 172.21.15.79:0/1019605602 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c007320 con 0x7fe7641adff0 2021-04-09T18:35:45.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe75bfff700 1 -- 172.21.15.79:0/1019605602 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe75c005720 con 0x7fe7641adff0 2021-04-09T18:35:45.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe769ab3700 1 -- 172.21.15.79:0/1019605602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76419ba10 con 0x7fe7641adff0 2021-04-09T18:35:45.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.754 7fe75bfff700 1 -- 172.21.15.79:0/1019605602 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe75c01a020 con 0x7fe7641adff0 2021-04-09T18:35:45.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.758 7fe75bfff700 1 --2- 172.21.15.79:0/1019605602 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe748029100 0x7fe74802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:45.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.758 7fe75bfff700 1 -- 172.21.15.79:0/1019605602 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fe75c039180 con 0x7fe7641adff0 2021-04-09T18:35:45.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.758 7fe7637fe700 1 --2- 172.21.15.79:0/1019605602 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe748029100 0x7fe74802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:45.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.758 7fe7637fe700 1 --2- 172.21.15.79:0/1019605602 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe748029100 0x7fe74802b650 crc :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:45.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.762 7fe769ab3700 1 -- 172.21.15.79:0/1019605602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7640e39f0 con 0x7fe7641adff0 2021-04-09T18:35:45.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.770 7fe75bfff700 1 -- 172.21.15.79:0/1019605602 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe75c007110 con 0x7fe7641adff0 2021-04-09T18:35:45.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.926 7fe769ab3700 1 -- 172.21.15.79:0/1019605602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fe7640f5b50 con 0x7fe7641adff0 2021-04-09T18:35:45.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.930 7fe75bfff700 1 -- 172.21.15.79:0/1019605602 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v135) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe75c000bf0 con 0x7fe7641adff0 2021-04-09T18:35:45.937 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:35:45.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.934 7fe769ab3700 1 -- 172.21.15.79:0/1019605602 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe748029100 msgr2=0x7fe74802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:45.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.934 7fe769ab3700 1 --2- 172.21.15.79:0/1019605602 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe748029100 0x7fe74802b650 crc :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:45.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.934 7fe769ab3700 1 -- 172.21.15.79:0/1019605602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7641adff0 msgr2=0x7fe7640c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:45.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.934 7fe769ab3700 1 --2- 172.21.15.79:0/1019605602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7641adff0 0x7fe7640c73f0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7fe7640d7e70 tx=0x7fe75c00cb30).stop 2021-04-09T18:35:45.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.934 7fe769ab3700 1 -- 172.21.15.79:0/1019605602 shutdown_connections 2021-04-09T18:35:45.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.934 7fe769ab3700 1 --2- 172.21.15.79:0/1019605602 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe748029100 0x7fe74802b650 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:45.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.934 7fe769ab3700 1 --2- 172.21.15.79:0/1019605602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7641adff0 0x7fe7640c73f0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:45.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.934 7fe769ab3700 1 --2- 172.21.15.79:0/1019605602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe76419d700 0x7fe7640bfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:45.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.934 7fe769ab3700 1 --2- 172.21.15.79:0/1019605602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7640bb060 0x7fe7641ad9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:45.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.934 7fe769ab3700 1 -- 172.21.15.79:0/1019605602 >> 172.21.15.79:0/1019605602 conn(0x7fe76409a9a0 msgr2=0x7fe7640d80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:45.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.934 7fe769ab3700 1 -- 172.21.15.79:0/1019605602 shutdown_connections 2021-04-09T18:35:45.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:45.934 7fe769ab3700 1 -- 172.21.15.79:0/1019605602 wait complete. 2021-04-09T18:35:45.949 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:35:46.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.038 7f7e4c4ec700 1 Processor -- start 2021-04-09T18:35:46.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.038 7f7e4c4ec700 1 -- start start 2021-04-09T18:35:46.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.038 7f7e4c4ec700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7e440f5550 0x7f7e440f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.038 7f7e4c4ec700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e440fbb50 con 0x7f7e441c8040 2021-04-09T18:35:46.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.038 7f7e4c4ec700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e4409f910 con 0x7f7e440e9b10 2021-04-09T18:35:46.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.038 7f7e4c4ec700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e440e9f60 con 0x7f7e440f5550 2021-04-09T18:35:46.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.038 7f7e4aa91700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7e441c8040 0x7f7e441ca4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58708/0 (socket says 172.21.15.79:58708) 2021-04-09T18:35:46.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.038 7f7e4aa91700 1 -- 172.21.15.79:0/3871379968 learned_addr learned my addr 172.21.15.79:0/3871379968 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:46.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.038 7f7e4a290700 1 --2- 172.21.15.79:0/3871379968 >> v2:172.21.15.89:3300/0 conn(0x7f7e440f5550 0x7f7e440f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.038 7f7e4928e700 1 -- 172.21.15.79:0/3871379968 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387907656 0 0) 0x7f7e3c001450 con 0x7f7e441c8040 2021-04-09T18:35:46.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.038 7f7e4928e700 1 -- 172.21.15.79:0/3871379968 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e30003240 con 0x7f7e441c8040 2021-04-09T18:35:46.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.038 7f7e4928e700 1 -- 172.21.15.79:0/3871379968 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3108094507 0 0) 0x7f7e3c0019d0 con 0x7f7e441c8040 2021-04-09T18:35:46.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.038 7f7e4928e700 1 -- 172.21.15.79:0/3871379968 >> v2:172.21.15.89:3300/0 conn(0x7f7e440f5550 msgr2=0x7f7e440f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:46.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.038 7f7e4928e700 1 --2- 172.21.15.79:0/3871379968 >> v2:172.21.15.89:3300/0 conn(0x7f7e440f5550 0x7f7e440f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.038 7f7e4928e700 1 -- 172.21.15.79:0/3871379968 >> v1:172.21.15.89:6789/0 conn(0x7f7e440e9b10 legacy=0x7f7e4409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:46.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.038 7f7e4928e700 1 -- 172.21.15.79:0/3871379968 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e440e5700 con 0x7f7e441c8040 2021-04-09T18:35:46.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.038 7f7e4928e700 1 -- 172.21.15.79:0/3871379968 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f7e3c001f30 con 0x7f7e441c8040 2021-04-09T18:35:46.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4928e700 1 -- 172.21.15.79:0/3871379968 >> v1:172.21.15.79:6789/0 conn(0x7f7e441c8040 legacy=0x7f7e441ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:46.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4928e700 1 --2- 172.21.15.79:0/3871379968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e300038c0 0x7f7e30003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4928e700 1 --2- 172.21.15.79:0/3871379968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e300045a0 0x7f7e300049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4928e700 1 --2- 172.21.15.79:0/3871379968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e300097e0 0x7f7e3000bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4928e700 1 -- 172.21.15.79:0/3871379968 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440e9f60 con 0x7f7e300038c0 2021-04-09T18:35:46.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4928e700 1 -- 172.21.15.79:0/3871379968 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e300053f0 con 0x7f7e300045a0 2021-04-09T18:35:46.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4a290700 1 --2- 172.21.15.79:0/3871379968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e300038c0 0x7f7e30003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4928e700 1 -- 172.21.15.79:0/3871379968 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e30050300 con 0x7f7e300097e0 2021-04-09T18:35:46.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e49a8f700 1 --2- 172.21.15.79:0/3871379968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e300045a0 0x7f7e300049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4aa91700 1 --2- 172.21.15.79:0/3871379968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e300097e0 0x7f7e3000bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4a290700 1 -- 172.21.15.79:0/3871379968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e300097e0 msgr2=0x7f7e3000bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:46.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4a290700 1 --2- 172.21.15.79:0/3871379968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e300097e0 0x7f7e3000bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4a290700 1 -- 172.21.15.79:0/3871379968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e300045a0 msgr2=0x7f7e300049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:46.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4a290700 1 --2- 172.21.15.79:0/3871379968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e300045a0 0x7f7e300049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4a290700 1 -- 172.21.15.79:0/3871379968 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e300505f0 con 0x7f7e300038c0 2021-04-09T18:35:46.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4aa91700 1 -- 172.21.15.79:0/3871379968 reap_dead start 2021-04-09T18:35:46.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4a290700 1 --2- 172.21.15.79:0/3871379968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e300038c0 0x7f7e30003d30 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f7e3800c000 tx=0x7f7e3800e1d0).ready entity=mon.0 client_cookie=427a76ab62211937 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:46.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4928e700 1 -- 172.21.15.79:0/3871379968 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7e300505f0 con 0x7f7e300038c0 2021-04-09T18:35:46.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4928e700 1 -- 172.21.15.79:0/3871379968 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3800ec90 con 0x7f7e300038c0 2021-04-09T18:35:46.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4928e700 1 -- 172.21.15.79:0/3871379968 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7e3800f040 con 0x7f7e300038c0 2021-04-09T18:35:46.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4c4ec700 1 -- 172.21.15.79:0/3871379968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e300038c0 msgr2=0x7f7e30003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:46.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4c4ec700 1 --2- 172.21.15.79:0/3871379968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e300038c0 0x7f7e30003d30 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f7e3800c000 tx=0x7f7e3800e1d0).stop 2021-04-09T18:35:46.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4c4ec700 1 -- 172.21.15.79:0/3871379968 shutdown_connections 2021-04-09T18:35:46.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4c4ec700 1 --2- 172.21.15.79:0/3871379968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e300038c0 0x7f7e30003d30 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4c4ec700 1 -- 172.21.15.79:0/3871379968 >> 172.21.15.79:0/3871379968 conn(0x7f7e440e6010 msgr2=0x7f7e440e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:46.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4c4ec700 1 -- 172.21.15.79:0/3871379968 shutdown_connections 2021-04-09T18:35:46.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.042 7f7e4c4ec700 1 -- 172.21.15.79:0/3871379968 wait complete. 2021-04-09T18:35:46.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.046 7f7e4c4ec700 1 Processor -- start 2021-04-09T18:35:46.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.046 7f7e4c4ec700 1 -- start start 2021-04-09T18:35:46.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.046 7f7e4c4ec700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e440af280 0x7f7e44098a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.046 7f7e4c4ec700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e44099090 0x7f7e441c00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.046 7f7e4c4ec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e441c0700 0x7f7e441ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.046 7f7e4c4ec700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e441c3df0 con 0x7f7e44099090 2021-04-09T18:35:46.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.046 7f7e4c4ec700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e44098760 con 0x7f7e440af280 2021-04-09T18:35:46.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.046 7f7e4c4ec700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e44098010 con 0x7f7e441c0700 2021-04-09T18:35:46.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e49a8f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e44099090 0x7f7e441c00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e49a8f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e44099090 0x7f7e441c00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35778/0 (socket says 172.21.15.79:35778) 2021-04-09T18:35:46.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e49a8f700 1 -- 172.21.15.79:0/1143886202 learned_addr learned my addr 172.21.15.79:0/1143886202 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:46.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e4aa91700 1 --2- 172.21.15.79:0/1143886202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e441c0700 0x7f7e441ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e4a290700 1 --2- 172.21.15.79:0/1143886202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e440af280 0x7f7e44098a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e49a8f700 1 -- 172.21.15.79:0/1143886202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e441c0700 msgr2=0x7f7e441ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:46.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e49a8f700 1 --2- 172.21.15.79:0/1143886202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e441c0700 0x7f7e441ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e49a8f700 1 -- 172.21.15.79:0/1143886202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e440af280 msgr2=0x7f7e44098a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:46.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e49a8f700 1 --2- 172.21.15.79:0/1143886202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e440af280 0x7f7e44098a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e49a8f700 1 -- 172.21.15.79:0/1143886202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e440a3620 con 0x7f7e44099090 2021-04-09T18:35:46.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e4aa91700 1 --2- 172.21.15.79:0/1143886202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e441c0700 0x7f7e441ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:46.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e4a290700 1 --2- 172.21.15.79:0/1143886202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e440af280 0x7f7e44098a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:46.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e49a8f700 1 --2- 172.21.15.79:0/1143886202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e44099090 0x7f7e441c00d0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f7e440986e0 tx=0x7f7e4000fd40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:46.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e36ffd700 1 -- 172.21.15.79:0/1143886202 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7e40010040 con 0x7f7e44099090 2021-04-09T18:35:46.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e36ffd700 1 -- 172.21.15.79:0/1143886202 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4000d7b0 con 0x7f7e44099090 2021-04-09T18:35:46.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e4c4ec700 1 -- 172.21.15.79:0/1143886202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e44097c30 con 0x7f7e44099090 2021-04-09T18:35:46.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e36ffd700 1 -- 172.21.15.79:0/1143886202 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7e4000db80 con 0x7f7e44099090 2021-04-09T18:35:46.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e4c4ec700 1 -- 172.21.15.79:0/1143886202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e441a0d50 con 0x7f7e44099090 2021-04-09T18:35:46.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e36ffd700 1 -- 172.21.15.79:0/1143886202 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7e4001a020 con 0x7f7e44099090 2021-04-09T18:35:46.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e36ffd700 1 --2- 172.21.15.79:0/1143886202 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7e2c029100 0x7f7e2c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e36ffd700 1 -- 172.21.15.79:0/1143886202 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f7e40011040 con 0x7f7e44099090 2021-04-09T18:35:46.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e4a290700 1 --2- 172.21.15.79:0/1143886202 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7e2c029100 0x7f7e2c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.050 7f7e4a290700 1 --2- 172.21.15.79:0/1143886202 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7e2c029100 0x7f7e2c02b650 crc :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:46.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.054 7f7e4c4ec700 1 -- 172.21.15.79:0/1143886202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e440e39f0 con 0x7f7e44099090 2021-04-09T18:35:46.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.062 7f7e36ffd700 1 -- 172.21.15.79:0/1143886202 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7e40000bf0 con 0x7f7e44099090 2021-04-09T18:35:46.231 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.226 7f7e4c4ec700 1 -- 172.21.15.79:0/1143886202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f7e440a1c90 con 0x7f7e44099090 2021-04-09T18:35:46.232 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.226 7f7e36ffd700 1 -- 172.21.15.79:0/1143886202 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v135) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7e4000d5a0 con 0x7f7e44099090 2021-04-09T18:35:46.232 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:35:46.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.226 7f7e4c4ec700 1 -- 172.21.15.79:0/1143886202 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7e2c029100 msgr2=0x7f7e2c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:46.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.226 7f7e4c4ec700 1 --2- 172.21.15.79:0/1143886202 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7e2c029100 0x7f7e2c02b650 crc :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.226 7f7e4c4ec700 1 -- 172.21.15.79:0/1143886202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e44099090 msgr2=0x7f7e441c00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:46.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.226 7f7e4c4ec700 1 --2- 172.21.15.79:0/1143886202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e44099090 0x7f7e441c00d0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f7e440986e0 tx=0x7f7e4000fd40).stop 2021-04-09T18:35:46.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.226 7f7e4c4ec700 1 -- 172.21.15.79:0/1143886202 shutdown_connections 2021-04-09T18:35:46.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.226 7f7e4c4ec700 1 --2- 172.21.15.79:0/1143886202 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7e2c029100 0x7f7e2c02b650 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.226 7f7e4c4ec700 1 --2- 172.21.15.79:0/1143886202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e440af280 0x7f7e44098a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.236 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.226 7f7e4c4ec700 1 --2- 172.21.15.79:0/1143886202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e441c0700 0x7f7e441ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.226 7f7e4c4ec700 1 --2- 172.21.15.79:0/1143886202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e44099090 0x7f7e441c00d0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.226 7f7e4c4ec700 1 -- 172.21.15.79:0/1143886202 >> 172.21.15.79:0/1143886202 conn(0x7f7e440d86c0 msgr2=0x7f7e440c05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:46.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.230 7f7e4c4ec700 1 -- 172.21.15.79:0/1143886202 shutdown_connections 2021-04-09T18:35:46.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.230 7f7e4c4ec700 1 -- 172.21.15.79:0/1143886202 wait complete. 2021-04-09T18:35:46.244 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:35:46.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.338 7fd9031a5700 1 Processor -- start 2021-04-09T18:35:46.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.338 7fd9031a5700 1 -- start start 2021-04-09T18:35:46.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.338 7fd9031a5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd8fc0f5550 0x7fd8fc0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.353 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.338 7fd9031a5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd8fc1c8040 0x7fd8fc1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.338 7fd9031a5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8fc0fbb50 con 0x7fd8fc0e9b10 2021-04-09T18:35:46.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.338 7fd9031a5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8fc0e9f60 con 0x7fd8fc0f5550 2021-04-09T18:35:46.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.338 7fd9031a5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8fc1c3df0 con 0x7fd8fc1c8040 2021-04-09T18:35:46.354 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.342 7fd900f49700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd8fc0f5550 0x7fd8fc0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.342 7fd900f49700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd8fc0f5550 0x7fd8fc0f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35782/0 (socket says 172.21.15.79:35782) 2021-04-09T18:35:46.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.342 7fd900f49700 1 -- 172.21.15.79:0/387633536 learned_addr learned my addr 172.21.15.79:0/387633536 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:46.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.342 7fd90174a700 1 --2- 172.21.15.79:0/387633536 >> v2:172.21.15.89:3300/0 conn(0x7fd8fc1c8040 0x7fd8fc1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.342 7fd900f49700 1 -- 172.21.15.79:0/387633536 >> v2:172.21.15.89:3300/0 conn(0x7fd8fc1c8040 msgr2=0x7fd8fc1ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:46.355 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.342 7fd900f49700 1 --2- 172.21.15.79:0/387633536 >> v2:172.21.15.89:3300/0 conn(0x7fd8fc1c8040 0x7fd8fc1ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.342 7fd900f49700 1 -- 172.21.15.79:0/387633536 >> v1:172.21.15.89:6789/0 conn(0x7fd8fc0e9b10 legacy=0x7fd8fc09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:46.356 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.342 7fd900f49700 1 -- 172.21.15.79:0/387633536 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc09f910 con 0x7fd8fc0f5550 2021-04-09T18:35:46.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.342 7fd900f49700 1 --2- 172.21.15.79:0/387633536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8fc0f5550 0x7fd8fc0f64e0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7fd8ec002f30 tx=0x7fd8ec00bd70).ready entity=mon.0 client_cookie=2d47b819c9f0f59d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:46.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.342 7fd8fb7fe700 1 -- 172.21.15.79:0/387633536 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd8fc09f910 con 0x7fd8fc0f5550 2021-04-09T18:35:46.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.342 7fd8fb7fe700 1 -- 172.21.15.79:0/387633536 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec009900 con 0x7fd8fc0f5550 2021-04-09T18:35:46.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.342 7fd8fb7fe700 1 -- 172.21.15.79:0/387633536 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd8ec009cd0 con 0x7fd8fc0f5550 2021-04-09T18:35:46.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.342 7fd9031a5700 1 -- 172.21.15.79:0/387633536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8fc0f5550 msgr2=0x7fd8fc0f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:46.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.342 7fd9031a5700 1 --2- 172.21.15.79:0/387633536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8fc0f5550 0x7fd8fc0f64e0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7fd8ec002f30 tx=0x7fd8ec00bd70).stop 2021-04-09T18:35:46.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.342 7fd9031a5700 1 -- 172.21.15.79:0/387633536 shutdown_connections 2021-04-09T18:35:46.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.342 7fd9031a5700 1 --2- 172.21.15.79:0/387633536 >> v2:172.21.15.89:3300/0 conn(0x7fd8fc1c8040 0x7fd8fc1ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.342 7fd9031a5700 1 --2- 172.21.15.79:0/387633536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8fc0f5550 0x7fd8fc0f64e0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.342 7fd9031a5700 1 -- 172.21.15.79:0/387633536 >> 172.21.15.79:0/387633536 conn(0x7fd8fc0e6010 msgr2=0x7fd8fc0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:46.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.342 7fd9031a5700 1 -- 172.21.15.79:0/387633536 shutdown_connections 2021-04-09T18:35:46.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.342 7fd9031a5700 1 -- 172.21.15.79:0/387633536 wait complete. 2021-04-09T18:35:46.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd9031a5700 1 Processor -- start 2021-04-09T18:35:46.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd9031a5700 1 -- start start 2021-04-09T18:35:46.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd9031a5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8fc090fc0 0x7fd8fc091410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd9031a5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8fc091a40 0x7fd8fc1aac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd9031a5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8fc1ab2a0 0x7fd8fc1ab6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd9031a5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc0e1ac0 con 0x7fd8fc090fc0 2021-04-09T18:35:46.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd9031a5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc092a20 con 0x7fd8fc091a40 2021-04-09T18:35:46.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd9031a5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc0bb1d0 con 0x7fd8fc1ab2a0 2021-04-09T18:35:46.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd900f49700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8fc090fc0 0x7fd8fc091410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd900f49700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8fc090fc0 0x7fd8fc091410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35790/0 (socket says 172.21.15.79:35790) 2021-04-09T18:35:46.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd900f49700 1 -- 172.21.15.79:0/134071952 learned_addr learned my addr 172.21.15.79:0/134071952 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:46.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd90174a700 1 --2- 172.21.15.79:0/134071952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8fc1ab2a0 0x7fd8fc1ab6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd8fbfff700 1 --2- 172.21.15.79:0/134071952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8fc091a40 0x7fd8fc1aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd900f49700 1 -- 172.21.15.79:0/134071952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8fc1ab2a0 msgr2=0x7fd8fc1ab6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:46.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd900f49700 1 --2- 172.21.15.79:0/134071952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8fc1ab2a0 0x7fd8fc1ab6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd900f49700 1 -- 172.21.15.79:0/134071952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8fc091a40 msgr2=0x7fd8fc1aac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:46.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd900f49700 1 --2- 172.21.15.79:0/134071952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8fc091a40 0x7fd8fc1aac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd900f49700 1 -- 172.21.15.79:0/134071952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc092d20 con 0x7fd8fc090fc0 2021-04-09T18:35:46.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd900f49700 1 --2- 172.21.15.79:0/134071952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8fc090fc0 0x7fd8fc091410 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7fd8fc0929a0 tx=0x7fd8ec006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:46.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd8f97fa700 1 -- 172.21.15.79:0/134071952 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd8fc092d20 con 0x7fd8fc090fc0 2021-04-09T18:35:46.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd9031a5700 1 -- 172.21.15.79:0/134071952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8fc091e90 con 0x7fd8fc090fc0 2021-04-09T18:35:46.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd9031a5700 1 -- 172.21.15.79:0/134071952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8fc0be7a0 con 0x7fd8fc090fc0 2021-04-09T18:35:46.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd8f97fa700 1 -- 172.21.15.79:0/134071952 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec011d70 con 0x7fd8fc090fc0 2021-04-09T18:35:46.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.346 7fd8f97fa700 1 -- 172.21.15.79:0/134071952 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd8ec021070 con 0x7fd8fc090fc0 2021-04-09T18:35:46.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.350 7fd8f97fa700 1 -- 172.21.15.79:0/134071952 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd8ec025410 con 0x7fd8fc090fc0 2021-04-09T18:35:46.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.350 7fd8f97fa700 1 --2- 172.21.15.79:0/134071952 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd8dc029100 0x7fd8dc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.350 7fd8f97fa700 1 -- 172.21.15.79:0/134071952 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fd8ec018030 con 0x7fd8fc090fc0 2021-04-09T18:35:46.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.350 7fd8fbfff700 1 --2- 172.21.15.79:0/134071952 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd8dc029100 0x7fd8dc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.350 7fd8fbfff700 1 --2- 172.21.15.79:0/134071952 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd8dc029100 0x7fd8dc02b650 crc :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:46.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.354 7fd9031a5700 1 -- 172.21.15.79:0/134071952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8fc0e39f0 con 0x7fd8fc090fc0 2021-04-09T18:35:46.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.358 7fd8f97fa700 1 -- 172.21.15.79:0/134071952 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd8ec0096f0 con 0x7fd8fc090fc0 2021-04-09T18:35:46.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.514 7fd9031a5700 1 -- 172.21.15.79:0/134071952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fd8fc0a1c90 con 0x7fd8fc090fc0 2021-04-09T18:35:46.521 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.514 7fd8f97fa700 1 -- 172.21.15.79:0/134071952 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v135) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd8ec011b60 con 0x7fd8fc090fc0 2021-04-09T18:35:46.522 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2021-04-09T18:35:46.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.518 7fd9031a5700 1 -- 172.21.15.79:0/134071952 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd8dc029100 msgr2=0x7fd8dc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:46.524 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.518 7fd9031a5700 1 --2- 172.21.15.79:0/134071952 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd8dc029100 0x7fd8dc02b650 crc :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.518 7fd9031a5700 1 -- 172.21.15.79:0/134071952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8fc090fc0 msgr2=0x7fd8fc091410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:46.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.518 7fd9031a5700 1 --2- 172.21.15.79:0/134071952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8fc090fc0 0x7fd8fc091410 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7fd8fc0929a0 tx=0x7fd8ec006890).stop 2021-04-09T18:35:46.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.518 7fd9031a5700 1 -- 172.21.15.79:0/134071952 shutdown_connections 2021-04-09T18:35:46.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.518 7fd9031a5700 1 --2- 172.21.15.79:0/134071952 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd8dc029100 0x7fd8dc02b650 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.518 7fd9031a5700 1 --2- 172.21.15.79:0/134071952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8fc1ab2a0 0x7fd8fc1ab6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.518 7fd9031a5700 1 --2- 172.21.15.79:0/134071952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8fc090fc0 0x7fd8fc091410 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.518 7fd9031a5700 1 --2- 172.21.15.79:0/134071952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8fc091a40 0x7fd8fc1aac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.518 7fd9031a5700 1 -- 172.21.15.79:0/134071952 >> 172.21.15.79:0/134071952 conn(0x7fd8fc094a00 msgr2=0x7fd8fc0d4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:46.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.518 7fd9031a5700 1 -- 172.21.15.79:0/134071952 shutdown_connections 2021-04-09T18:35:46.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.518 7fd9031a5700 1 -- 172.21.15.79:0/134071952 wait complete. 2021-04-09T18:35:46.538 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:35:46.539 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:35:46.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.622 7fa885324700 1 Processor -- start 2021-04-09T18:35:46.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.622 7fa885324700 1 -- start start 2021-04-09T18:35:46.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.622 7fa885324700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8800f5510 0x7fa8800f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.622 7fa885324700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa8800e9ad0 0x7fa88009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.622 7fa885324700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa8801c2da0 0x7fa8801c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.622 7fa885324700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8800e9f20 con 0x7fa8800e9ad0 2021-04-09T18:35:46.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.622 7fa885324700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8800e59c0 con 0x7fa8801c2da0 2021-04-09T18:35:46.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.622 7fa885324700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8800fbb10 con 0x7fa8800f5510 2021-04-09T18:35:46.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.622 7fa87e804700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa8800e9ad0 0x7fa88009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.622 7fa87e804700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa8800e9ad0 0x7fa88009f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35796/0 (socket says 172.21.15.79:35796) 2021-04-09T18:35:46.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.622 7fa87e804700 1 -- 172.21.15.79:0/3426681573 learned_addr learned my addr 172.21.15.79:0/3426681573 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:46.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.622 7fa87f806700 1 --2- 172.21.15.79:0/3426681573 >> v2:172.21.15.89:3300/0 conn(0x7fa8801c2da0 0x7fa8801c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.622 7fa87f005700 1 --2- 172.21.15.79:0/3426681573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8800f5510 0x7fa8800f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.626 7fa87e804700 1 -- 172.21.15.79:0/3426681573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8800f5510 msgr2=0x7fa8800f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:46.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.626 7fa87e804700 1 --2- 172.21.15.79:0/3426681573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8800f5510 0x7fa8800f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.626 7fa87e804700 1 -- 172.21.15.79:0/3426681573 >> v2:172.21.15.89:3300/0 conn(0x7fa8801c2da0 msgr2=0x7fa8801c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:46.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.626 7fa87e804700 1 --2- 172.21.15.79:0/3426681573 >> v2:172.21.15.89:3300/0 conn(0x7fa8801c2da0 0x7fa8801c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.626 7fa87e804700 1 -- 172.21.15.79:0/3426681573 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8800e56c0 con 0x7fa8800e9ad0 2021-04-09T18:35:46.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.626 7fa87e804700 1 --2- 172.21.15.79:0/3426681573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8800e9ad0 0x7fa88009f100 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7fa874002f30 tx=0x7fa87400bd70).ready entity=mon.0 client_cookie=8f22881a0ba303e1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:46.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.626 7fa87e003700 1 -- 172.21.15.79:0/3426681573 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa8800e56c0 con 0x7fa8800e9ad0 2021-04-09T18:35:46.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.626 7fa87e003700 1 -- 172.21.15.79:0/3426681573 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8740098b0 con 0x7fa8800e9ad0 2021-04-09T18:35:46.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.626 7fa87e003700 1 -- 172.21.15.79:0/3426681573 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa874009c80 con 0x7fa8800e9ad0 2021-04-09T18:35:46.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.626 7fa885324700 1 -- 172.21.15.79:0/3426681573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8800e9ad0 msgr2=0x7fa88009f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:46.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.626 7fa885324700 1 --2- 172.21.15.79:0/3426681573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8800e9ad0 0x7fa88009f100 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7fa874002f30 tx=0x7fa87400bd70).stop 2021-04-09T18:35:46.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.626 7fa885324700 1 -- 172.21.15.79:0/3426681573 shutdown_connections 2021-04-09T18:35:46.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.626 7fa885324700 1 --2- 172.21.15.79:0/3426681573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8800f5510 0x7fa8800f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.626 7fa885324700 1 --2- 172.21.15.79:0/3426681573 >> v2:172.21.15.89:3300/0 conn(0x7fa8801c2da0 0x7fa8801c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.626 7fa885324700 1 --2- 172.21.15.79:0/3426681573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8800e9ad0 0x7fa88009f100 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.626 7fa885324700 1 -- 172.21.15.79:0/3426681573 >> 172.21.15.79:0/3426681573 conn(0x7fa8800e5fd0 msgr2=0x7fa8800e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:46.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.626 7fa885324700 1 -- 172.21.15.79:0/3426681573 shutdown_connections 2021-04-09T18:35:46.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.626 7fa885324700 1 -- 172.21.15.79:0/3426681573 wait complete. 2021-04-09T18:35:46.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa885324700 1 Processor -- start 2021-04-09T18:35:46.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa885324700 1 -- start start 2021-04-09T18:35:46.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa885324700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8800ba8e0 0x7fa8800ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa885324700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8800d79e0 0x7fa8800d7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa885324700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8800c2f00 0x7fa8800c3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa885324700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8800ac840 con 0x7fa8800c2f00 2021-04-09T18:35:46.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa885324700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8800acb40 con 0x7fa8800d79e0 2021-04-09T18:35:46.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa885324700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8800c3980 con 0x7fa8800ba8e0 2021-04-09T18:35:46.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa87f806700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8800c2f00 0x7fa8800c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa87f806700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8800c2f00 0x7fa8800c3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35804/0 (socket says 172.21.15.79:35804) 2021-04-09T18:35:46.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa87f806700 1 -- 172.21.15.79:0/3682482904 learned_addr learned my addr 172.21.15.79:0/3682482904 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:46.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa87f005700 1 --2- 172.21.15.79:0/3682482904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8800ba8e0 0x7fa8800ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa87e804700 1 --2- 172.21.15.79:0/3682482904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8800d79e0 0x7fa8800d7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa87f806700 1 -- 172.21.15.79:0/3682482904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8800ba8e0 msgr2=0x7fa8800ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:46.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa87f806700 1 --2- 172.21.15.79:0/3682482904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8800ba8e0 0x7fa8800ae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa87f806700 1 -- 172.21.15.79:0/3682482904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8800d79e0 msgr2=0x7fa8800d7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:46.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa87f806700 1 --2- 172.21.15.79:0/3682482904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8800d79e0 0x7fa8800d7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa87f806700 1 -- 172.21.15.79:0/3682482904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8800abf80 con 0x7fa8800c2f00 2021-04-09T18:35:46.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa87e804700 1 --2- 172.21.15.79:0/3682482904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8800d79e0 0x7fa8800d7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:46.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa87f806700 1 --2- 172.21.15.79:0/3682482904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8800c2f00 0x7fa8800c3350 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7fa8801a2ca0 tx=0x7fa87800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:46.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.630 7fa867fff700 1 -- 172.21.15.79:0/3682482904 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa8800abf80 con 0x7fa8800c2f00 2021-04-09T18:35:46.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.634 7fa867fff700 1 -- 172.21.15.79:0/3682482904 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87800cb70 con 0x7fa8800c2f00 2021-04-09T18:35:46.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.634 7fa885324700 1 -- 172.21.15.79:0/3682482904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8800ac3d0 con 0x7fa8800c2f00 2021-04-09T18:35:46.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.634 7fa867fff700 1 -- 172.21.15.79:0/3682482904 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa87800f040 con 0x7fa8800c2f00 2021-04-09T18:35:46.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.634 7fa885324700 1 -- 172.21.15.79:0/3682482904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8800ae760 con 0x7fa8800c2f00 2021-04-09T18:35:46.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.634 7fa867fff700 1 -- 172.21.15.79:0/3682482904 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa878022060 con 0x7fa8800c2f00 2021-04-09T18:35:46.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.634 7fa867fff700 1 --2- 172.21.15.79:0/3682482904 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa860029100 0x7fa86002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:46.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.634 7fa867fff700 1 -- 172.21.15.79:0/3682482904 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7fa878010040 con 0x7fa8800c2f00 2021-04-09T18:35:46.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.634 7fa87f005700 1 --2- 172.21.15.79:0/3682482904 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa860029100 0x7fa86002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:46.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.634 7fa87f005700 1 --2- 172.21.15.79:0/3682482904 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa860029100 0x7fa86002b650 crc :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:46.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.638 7fa885324700 1 -- 172.21.15.79:0/3682482904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8800e39d0 con 0x7fa8800c2f00 2021-04-09T18:35:46.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.642 7fa867fff700 1 -- 172.21.15.79:0/3682482904 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa87800c960 con 0x7fa8800c2f00 2021-04-09T18:35:46.813 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.806 7fa885324700 1 -- 172.21.15.79:0/3682482904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8800f5b10 con 0x7fa8800c2f00 2021-04-09T18:35:46.814 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.806 7fa867fff700 1 -- 172.21.15.79:0/3682482904 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+2107 (secure 0 0 0) 0x7fa878000f70 con 0x7fa8800c2f00 2021-04-09T18:35:46.816 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 86 2021-04-09T18:35:46.817 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:46.817 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":86,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8175,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/2663381192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2663381192},{"type":"v1","addr":"172.21.15.79:6833","nonce":2663381192}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:35:39.593350","modified":"2021-04-09 18:35:41.603617","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7055":{"gid":7055,"name":"b","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/4071560647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":4071560647},{"type":"v1","addr":"172.21.15.89:6835","nonce":4071560647}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-04-09T18:35:46.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.814 7fa885324700 1 -- 172.21.15.79:0/3682482904 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa860029100 msgr2=0x7fa86002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:46.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.814 7fa885324700 1 --2- 172.21.15.79:0/3682482904 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa860029100 0x7fa86002b650 crc :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.814 7fa885324700 1 -- 172.21.15.79:0/3682482904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8800c2f00 msgr2=0x7fa8800c3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:46.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.814 7fa885324700 1 --2- 172.21.15.79:0/3682482904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8800c2f00 0x7fa8800c3350 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7fa8801a2ca0 tx=0x7fa87800c430).stop 2021-04-09T18:35:46.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.814 7fa885324700 1 -- 172.21.15.79:0/3682482904 shutdown_connections 2021-04-09T18:35:46.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.814 7fa885324700 1 --2- 172.21.15.79:0/3682482904 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa860029100 0x7fa86002b650 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.814 7fa885324700 1 --2- 172.21.15.79:0/3682482904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8800c2f00 0x7fa8800c3350 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.814 7fa885324700 1 --2- 172.21.15.79:0/3682482904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8800ba8e0 0x7fa8800ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.814 7fa885324700 1 --2- 172.21.15.79:0/3682482904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8800d79e0 0x7fa8800d7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:46.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.814 7fa885324700 1 -- 172.21.15.79:0/3682482904 >> 172.21.15.79:0/3682482904 conn(0x7fa8800bb0c0 msgr2=0x7fa8800aeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:46.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.814 7fa885324700 1 -- 172.21.15.79:0/3682482904 shutdown_connections 2021-04-09T18:35:46.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:46.814 7fa885324700 1 -- 172.21.15.79:0/3682482904 wait complete. 2021-04-09T18:35:47.036 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:35:39.593350', 'modified': '2021-04-09 18:35:41.603617', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 134, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7055}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7055': {'gid': 7055, 'name': 'b', 'rank': 0, 'incarnation': 85, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6835/4071560647', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 4071560647}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 4071560647}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:35:47.037 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:35:47.037 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2021-04-09T18:35:47.128 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2021-04-09T18:35:47.129 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:35:47.129 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2021-04-09T18:35:47.130 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 7055, 2021-04-09T18:35:47.130 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2021-04-09T18:35:47.130 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2021-04-09T18:35:47.131 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 6.5218671009999998, 2021-04-09T18:35:47.131 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 86, 2021-04-09T18:35:47.132 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 135, 2021-04-09T18:35:47.132 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 135, 2021-04-09T18:35:47.132 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 11.152126263 2021-04-09T18:35:47.133 INFO:teuthology.orchestra.run.smithi089.stdout:} 2021-04-09T18:35:47.134 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", "whoami": 0, "id": 7055, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.5218671009999998, "mdsmap_epoch": 86, "osdmap_epoch": 135, "osdmap_epoch_barrier": 135, "uptime": 11.152126263 } 2021-04-09T18:35:47.135 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:35:47.135 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-04-09T18:35:47.136 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi136.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-04-09T18:35:47.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:47.136 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:47.145 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:35:47.201 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:35:47.202 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:35:47.261 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:35:47.262 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:35:47.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:47.263 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:35:47.313 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:35:47.313 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:47.360 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:35:47.377 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:35:47.378 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:35:47.430 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:35:47.432 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:35:47.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:47.434 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:35:47.436 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:2021-04-09 18:35:47.430 7f8c9d6820c0 -1 init, newargv = 0x55de4a6f5d60 newargc=9 2021-04-09T18:35:47.436 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13882]: starting ceph client 2021-04-09T18:35:47.444 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13882]: starting fuse 2021-04-09T18:35:48.542 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2021-04-09T18:35:48.562 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:35:48.563 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:35:48.618 INFO:teuthology.orchestra.run.smithi136.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-04-09T18:35:48.619 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:35:48.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:48.622 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2021-04-09T18:35:48.668 INFO:teuthology.orchestra.run.smithi136.stdout:49 2021-04-09T18:35:48.669 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-04-09T18:35:48.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:48.670 DEBUG:teuthology.orchestra.run.smithi136:> sudo python3 -c ' 2021-04-09T18:35:48.670 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2021-04-09T18:35:48.670 DEBUG:teuthology.orchestra.run.smithi136:> import re 2021-04-09T18:35:48.671 DEBUG:teuthology.orchestra.run.smithi136:> import os 2021-04-09T18:35:48.671 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2021-04-09T18:35:48.672 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:35:48.672 DEBUG:teuthology.orchestra.run.smithi136:> def find_socket(client_name): 2021-04-09T18:35:48.672 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-04-09T18:35:48.673 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2021-04-09T18:35:48.673 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:35:48.673 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2021-04-09T18:35:48.674 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2021-04-09T18:35:48.674 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2021-04-09T18:35:48.675 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2021-04-09T18:35:48.675 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:35:48.675 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2021-04-09T18:35:48.676 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:35:48.677 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:35:48.677 DEBUG:teuthology.orchestra.run.smithi136:> return f 2021-04-09T18:35:48.677 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:35:48.678 DEBUG:teuthology.orchestra.run.smithi136:> 2021-04-09T18:35:48.678 DEBUG:teuthology.orchestra.run.smithi136:> print(find_socket("client.1")) 2021-04-09T18:35:48.679 DEBUG:teuthology.orchestra.run.smithi136:> ' 2021-04-09T18:35:48.758 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.1.13882.asok 2021-04-09T18:35:48.763 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13882.asok 2021-04-09T18:35:48.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:48.764 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13882.asok status 2021-04-09T18:35:48.839 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2021-04-09T18:35:48.840 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2021-04-09T18:35:48.840 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:35:48.840 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:35:48.840 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "1", 2021-04-09T18:35:48.841 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2021-04-09T18:35:48.841 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-04-09T18:35:48.841 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "13882", 2021-04-09T18:35:48.841 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2021-04-09T18:35:48.842 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:35:48.842 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2021-04-09T18:35:48.842 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2021-04-09T18:35:48.842 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 7190, 2021-04-09T18:35:48.842 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2021-04-09T18:35:48.843 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2021-04-09T18:35:48.843 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2021-04-09T18:35:48.843 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 7190 2021-04-09T18:35:48.843 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:35:48.844 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-04-09T18:35:48.844 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-04-09T18:35:48.844 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-04-09T18:35:48.844 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 525072141 2021-04-09T18:35:48.844 INFO:teuthology.orchestra.run.smithi136.stdout: } 2021-04-09T18:35:48.845 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:35:48.845 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2021-04-09T18:35:48.846 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2021-04-09T18:35:48.846 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "172.21.15.136:0", 2021-04-09T18:35:48.847 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 525072141 2021-04-09T18:35:48.847 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2021-04-09T18:35:48.847 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.7190 172.21.15.136:0/525072141", 2021-04-09T18:35:48.848 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "172.21.15.136:0/525072141", 2021-04-09T18:35:48.849 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2021-04-09T18:35:48.849 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 86, 2021-04-09T18:35:48.849 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 135, 2021-04-09T18:35:48.850 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:35:48.850 INFO:teuthology.orchestra.run.smithi136.stdout: "blacklisted": false, 2021-04-09T18:35:48.851 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2021-04-09T18:35:48.851 INFO:teuthology.orchestra.run.smithi136.stdout:} 2021-04-09T18:35:48.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:48.855 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:48.856 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:48.865 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-04-09T18:35:48.866 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-04-09T18:35:48.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:48.867 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:48.928 DEBUG:teuthology.orchestra.run.smithi090:> cd /home/ubuntu/cephtest/mnt.0 && sudo getfattr --only-values -n ceph.dir.rctime . 2021-04-09T18:35:48.962 INFO:teuthology.orchestra.run.smithi090.stdout:1617993348.921342975 2021-04-09T18:35:48.962 INFO:tasks.cephfs.test_misc:rctime = 1617993348.921342975 2021-04-09T18:35:48.963 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-04-09T18:35:48.963 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:48.983 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:49.002 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:49.022 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:49.040 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-04-09T18:35:49.061 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-04-09T18:35:49.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:49.062 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:49.063 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:49.072 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2021-04-09T18:35:49.074 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:35:49.074 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi090.front.sepia.ceph.com... 2021-04-09T18:35:49.075 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:35:49.075 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:49.146 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi090.stderr:ceph-fuse[14263]: fuse finished with error 0 and tester_r 0 2021-04-09T18:35:49.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:49.148 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:49.148 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:49.199 INFO:teuthology.orchestra.run.smithi090.stdout:ext2/ext3 2021-04-09T18:35:49.201 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:35:49.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:35:49.214 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:49.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:49.261 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:49.261 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:49.269 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2021-04-09T18:35:49.271 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-04-09T18:35:49.271 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2021-04-09T18:35:49.272 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:35:49.272 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:49.347 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi136.stderr:ceph-fuse[13882]: fuse finished with error 0 and tester_r 0 2021-04-09T18:35:49.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:49.350 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:49.351 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:49.397 INFO:teuthology.orchestra.run.smithi136.stdout:ext2/ext3 2021-04-09T18:35:49.398 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:35:49.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:35:49.430 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:49.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:49.477 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:49.478 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:35:49.485 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:35:49.486 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:35:49.487 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:35:49.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:35:49.489 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:35:49.537 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-04-09T18:35:49.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.630 7f0a1c55f700 1 Processor -- start 2021-04-09T18:35:49.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.630 7f0a1c55f700 1 -- start start 2021-04-09T18:35:49.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.630 7f0a1c55f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0a140f5510 0x7f0a140f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:49.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.630 7f0a1c55f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0a140e9ad0 0x7f0a1409f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:49.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.630 7f0a1c55f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a141c2da0 0x7f0a141c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:49.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.630 7f0a1c55f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a140e9f20 con 0x7f0a140f5510 2021-04-09T18:35:49.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.630 7f0a1c55f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a140e59c0 con 0x7f0a140e9ad0 2021-04-09T18:35:49.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.630 7f0a1c55f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a140fbb10 con 0x7f0a141c2da0 2021-04-09T18:35:49.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.630 7f0a1a303700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0a140f5510 0x7f0a140f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:49.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.630 7f0a1a303700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0a140f5510 0x7f0a140f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35808/0 (socket says 172.21.15.79:35808) 2021-04-09T18:35:49.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.630 7f0a1a303700 1 -- 172.21.15.79:0/2609861526 learned_addr learned my addr 172.21.15.79:0/2609861526 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:49.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.630 7f0a1ab04700 1 --2- 172.21.15.79:0/2609861526 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a141c2da0 0x7f0a141c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:49.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.630 7f0a19b02700 1 --2- 172.21.15.79:0/2609861526 >> v2:172.21.15.89:3300/0 conn(0x7f0a140e9ad0 0x7f0a1409f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:49.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.634 7f0a1a303700 1 -- 172.21.15.79:0/2609861526 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a141c2da0 msgr2=0x7f0a141c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:49.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.634 7f0a1a303700 1 --2- 172.21.15.79:0/2609861526 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a141c2da0 0x7f0a141c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:49.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.634 7f0a1a303700 1 -- 172.21.15.79:0/2609861526 >> v2:172.21.15.89:3300/0 conn(0x7f0a140e9ad0 msgr2=0x7f0a1409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:49.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.634 7f0a1a303700 1 --2- 172.21.15.79:0/2609861526 >> v2:172.21.15.89:3300/0 conn(0x7f0a140e9ad0 0x7f0a1409f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:49.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.634 7f0a1a303700 1 -- 172.21.15.79:0/2609861526 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a140e56c0 con 0x7f0a140f5510 2021-04-09T18:35:49.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.634 7f0a1a303700 1 --2- 172.21.15.79:0/2609861526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a140f5510 0x7f0a140f64a0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f0a14125430 tx=0x7f0a0800bda0).ready entity=mon.0 client_cookie=fae04f094d4d0c1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:49.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.634 7f0a19301700 1 -- 172.21.15.79:0/2609861526 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0a140e56c0 con 0x7f0a140f5510 2021-04-09T18:35:49.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.634 7f0a19301700 1 -- 172.21.15.79:0/2609861526 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a08009940 con 0x7f0a140f5510 2021-04-09T18:35:49.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.634 7f0a19301700 1 -- 172.21.15.79:0/2609861526 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0a08009d10 con 0x7f0a140f5510 2021-04-09T18:35:49.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.634 7f0a1c55f700 1 -- 172.21.15.79:0/2609861526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a140f5510 msgr2=0x7f0a140f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:49.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.634 7f0a1c55f700 1 --2- 172.21.15.79:0/2609861526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a140f5510 0x7f0a140f64a0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f0a14125430 tx=0x7f0a0800bda0).stop 2021-04-09T18:35:49.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.634 7f0a1c55f700 1 -- 172.21.15.79:0/2609861526 shutdown_connections 2021-04-09T18:35:49.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.634 7f0a1c55f700 1 --2- 172.21.15.79:0/2609861526 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a141c2da0 0x7f0a141c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:49.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.634 7f0a1c55f700 1 --2- 172.21.15.79:0/2609861526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a140f5510 0x7f0a140f64a0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:49.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.634 7f0a1c55f700 1 --2- 172.21.15.79:0/2609861526 >> v2:172.21.15.89:3300/0 conn(0x7f0a140e9ad0 0x7f0a1409f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:49.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.634 7f0a1c55f700 1 -- 172.21.15.79:0/2609861526 >> 172.21.15.79:0/2609861526 conn(0x7f0a140e5fd0 msgr2=0x7f0a140e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:49.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.634 7f0a1c55f700 1 -- 172.21.15.79:0/2609861526 shutdown_connections 2021-04-09T18:35:49.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.634 7f0a1c55f700 1 -- 172.21.15.79:0/2609861526 wait complete. 2021-04-09T18:35:49.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.638 7f0a1c55f700 1 Processor -- start 2021-04-09T18:35:49.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.638 7f0a1c55f700 1 -- start start 2021-04-09T18:35:49.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.638 7f0a1c55f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a141a16a0 0x7f0a140bae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:49.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.638 7f0a1c55f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a14097540 0x7f0a140c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:49.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.638 7f0a1c55f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a1419dbe0 0x7f0a140c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:49.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.638 7f0a1c55f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a140e1ac0 con 0x7f0a1419dbe0 2021-04-09T18:35:49.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.638 7f0a1c55f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a14097e40 con 0x7f0a14097540 2021-04-09T18:35:49.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.638 7f0a1c55f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a14098140 con 0x7f0a141a16a0 2021-04-09T18:35:49.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.638 7f0a1ab04700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a1419dbe0 0x7f0a140c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:49.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.638 7f0a1ab04700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a1419dbe0 0x7f0a140c1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35818/0 (socket says 172.21.15.79:35818) 2021-04-09T18:35:49.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.638 7f0a19b02700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a14097540 0x7f0a140c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:49.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.638 7f0a1ab04700 1 -- 172.21.15.79:0/1463720281 learned_addr learned my addr 172.21.15.79:0/1463720281 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:49.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.638 7f0a1a303700 1 --2- 172.21.15.79:0/1463720281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a141a16a0 0x7f0a140bae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:49.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.642 7f0a1ab04700 1 -- 172.21.15.79:0/1463720281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a141a16a0 msgr2=0x7f0a140bae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:49.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.642 7f0a1ab04700 1 --2- 172.21.15.79:0/1463720281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a141a16a0 0x7f0a140bae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:49.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.642 7f0a1ab04700 1 -- 172.21.15.79:0/1463720281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a14097540 msgr2=0x7f0a140c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:49.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.642 7f0a1ab04700 1 --2- 172.21.15.79:0/1463720281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a14097540 0x7f0a140c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:49.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.642 7f0a1ab04700 1 -- 172.21.15.79:0/1463720281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a14097990 con 0x7f0a1419dbe0 2021-04-09T18:35:49.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.642 7f0a1ab04700 1 --2- 172.21.15.79:0/1463720281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a1419dbe0 0x7f0a140c1720 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f0a0c00c000 tx=0x7f0a0c00c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.642 7f0a06ffd700 1 -- 172.21.15.79:0/1463720281 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0a14097990 con 0x7f0a1419dbe0 2021-04-09T18:35:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.642 7f0a06ffd700 1 -- 172.21.15.79:0/1463720281 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c00cb70 con 0x7f0a1419dbe0 2021-04-09T18:35:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.642 7f0a06ffd700 1 -- 172.21.15.79:0/1463720281 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0a0c00f040 con 0x7f0a1419dbe0 2021-04-09T18:35:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.642 7f0a1c55f700 1 -- 172.21.15.79:0/1463720281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1419e030 con 0x7f0a1419dbe0 2021-04-09T18:35:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.642 7f0a1c55f700 1 -- 172.21.15.79:0/1463720281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a140c1ee0 con 0x7f0a1419dbe0 2021-04-09T18:35:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.642 7f0a06ffd700 1 -- 172.21.15.79:0/1463720281 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0a0c022060 con 0x7f0a1419dbe0 2021-04-09T18:35:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.642 7f0a06ffd700 1 --2- 172.21.15.79:0/1463720281 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f09fc029100 0x7f09fc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.642 7f0a06ffd700 1 -- 172.21.15.79:0/1463720281 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f0a0c010040 con 0x7f0a1419dbe0 2021-04-09T18:35:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.642 7f0a1a303700 1 --2- 172.21.15.79:0/1463720281 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f09fc029100 0x7f09fc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.642 7f0a1a303700 1 --2- 172.21.15.79:0/1463720281 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f09fc029100 0x7f09fc02b650 crc :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:49.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.646 7f0a1c55f700 1 -- 172.21.15.79:0/1463720281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a140e39d0 con 0x7f0a1419dbe0 2021-04-09T18:35:49.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.650 7f0a06ffd700 1 -- 172.21.15.79:0/1463720281 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0a0c00c960 con 0x7f0a1419dbe0 2021-04-09T18:35:49.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.814 7f0a1c55f700 1 -- 172.21.15.79:0/1463720281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f0a140f5b10 con 0x7f0a1419dbe0 2021-04-09T18:35:49.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.818 7f0a06ffd700 1 -- 172.21.15.79:0/1463720281 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v135) v1 ==== 81+0+30910 (secure 0 0 0) 0x7f0a140f76b0 con 0x7f0a1419dbe0 2021-04-09T18:35:49.826 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:49.826 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2021-04-09T18:35:49.827 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 135, 2021-04-09T18:35:49.827 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "fc927781-121d-4817-b30c-0c6f9e107f84", 2021-04-09T18:35:49.828 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2021-04-09 18:25:53.111554", 2021-04-09T18:35:49.828 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2021-04-09 18:35:39.987855", 2021-04-09T18:35:49.829 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:35:49.829 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2021-04-09 18:26:01.966378", 2021-04-09T18:35:49.830 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-04-09T18:35:49.830 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2021-04-09T18:35:49.831 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2021-04-09T18:35:49.831 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2021-04-09T18:35:49.832 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2021-04-09T18:35:49.832 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2021-04-09T18:35:49.832 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2021-04-09T18:35:49.833 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:35:49.833 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2021-04-09T18:35:49.833 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2021-04-09T18:35:49.834 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-04-09T18:35:49.834 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2021-04-09T18:35:49.834 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2021-04-09T18:35:49.834 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 27, 2021-04-09T18:35:49.835 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2021-04-09T18:35:49.835 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "jewel", 2021-04-09T18:35:49.835 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2021-04-09T18:35:49.835 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "nautilus", 2021-04-09T18:35:49.835 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2021-04-09T18:35:49.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.836 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2021-04-09T18:35:49.836 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2021-04-09T18:35:49.837 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:26:06.311357", 2021-04-09T18:35:49.837 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:35:49.837 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:35:49.837 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:35:49.838 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:35:49.838 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:35:49.838 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:35:49.838 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:35:49.839 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:35:49.839 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:35:49.839 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:35:49.839 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:35:49.840 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:35:49.840 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:35:49.841 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:35:49.841 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:35:49.841 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:35:49.842 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:35:49.842 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:35:49.842 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:35:49.843 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:35:49.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.843 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2021-04-09T18:35:49.843 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:35:49.844 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:35:49.844 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:35:49.844 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:35:49.844 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:35:49.845 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:35:49.845 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:35:49.845 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:35:49.845 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:35:49.846 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:35:49.846 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:35:49.846 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:35:49.846 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:35:49.846 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:35:49.847 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:35:49.847 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:35:49.847 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:35:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:35:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:35:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:35:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:35:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:35:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:35:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:35:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:35:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:35:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.850 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:35:49.850 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:35:49.850 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:35:49.850 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:35:49.851 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:35:49.851 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:35:49.851 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:35:49.852 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:35:49.852 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:35:49.852 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:35:49.852 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:35:49.853 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:35:49.853 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:35:49.853 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2021-04-09T18:35:49.853 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.854 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 26, 2021-04-09T18:35:49.854 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2021-04-09T18:35:49.855 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:35:37.809302", 2021-04-09T18:35:49.855 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:35:49.855 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:35:49.856 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:35:49.856 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:35:49.856 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:35:49.857 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:35:49.857 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:35:49.857 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:35:49.858 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:35:49.858 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:35:49.859 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:35:49.859 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:35:49.859 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:35:49.860 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:35:49.860 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:35:49.860 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:35:49.860 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:35:49.861 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:35:49.861 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:35:49.861 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:35:49.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.862 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "133", 2021-04-09T18:35:49.863 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:35:49.863 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:35:49.864 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:35:49.864 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:35:49.865 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:35:49.865 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:35:49.866 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:35:49.866 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:35:49.867 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:35:49.867 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:35:49.869 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:35:49.869 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:35:49.870 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:35:49.870 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:35:49.871 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:35:49.872 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:35:49.873 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:35:49.873 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:35:49.874 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:35:49.874 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:35:49.874 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:35:49.874 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:35:49.875 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:35:49.875 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:35:49.875 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:35:49.875 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:35:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:35:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:35:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:35:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:35:49.877 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:35:49.877 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:35:49.877 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:35:49.877 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:35:49.878 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:35:49.878 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:35:49.878 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:35:49.878 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2021-04-09T18:35:49.878 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2021-04-09T18:35:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2021-04-09T18:35:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2021-04-09T18:35:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:35:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:35:49.880 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2021-04-09T18:35:49.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 27, 2021-04-09T18:35:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2021-04-09T18:35:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2021-04-09 18:35:38.660109", 2021-04-09T18:35:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2021-04-09T18:35:49.882 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2021-04-09T18:35:49.882 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2021-04-09T18:35:49.882 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2021-04-09T18:35:49.882 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2021-04-09T18:35:49.882 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2021-04-09T18:35:49.883 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2021-04-09T18:35:49.883 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "warn", 2021-04-09T18:35:49.883 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2021-04-09T18:35:49.883 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2021-04-09T18:35:49.884 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2021-04-09T18:35:49.884 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2021-04-09T18:35:49.884 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2021-04-09T18:35:49.884 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2021-04-09T18:35:49.884 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2021-04-09T18:35:49.885 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2021-04-09T18:35:49.885 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2021-04-09T18:35:49.885 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2021-04-09T18:35:49.885 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2021-04-09T18:35:49.886 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2021-04-09T18:35:49.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.886 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "134", 2021-04-09T18:35:49.886 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2021-04-09T18:35:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2021-04-09T18:35:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2021-04-09T18:35:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2021-04-09T18:35:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2021-04-09T18:35:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2021-04-09T18:35:49.888 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2021-04-09T18:35:49.888 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2021-04-09T18:35:49.888 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2021-04-09T18:35:49.888 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2021-04-09T18:35:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2021-04-09T18:35:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2021-04-09T18:35:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2021-04-09T18:35:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2021-04-09T18:35:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2021-04-09T18:35:49.890 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2021-04-09T18:35:49.890 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2021-04-09T18:35:49.890 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2021-04-09T18:35:49.890 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-04-09T18:35:49.890 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-04-09T18:35:49.891 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2021-04-09T18:35:49.891 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2021-04-09T18:35:49.891 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2021-04-09T18:35:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2021-04-09T18:35:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2021-04-09T18:35:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2021-04-09T18:35:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2021-04-09T18:35:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2021-04-09T18:35:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2021-04-09T18:35:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2021-04-09T18:35:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2021-04-09T18:35:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2021-04-09T18:35:49.894 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2021-04-09T18:35:49.894 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2021-04-09T18:35:49.894 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2021-04-09T18:35:49.894 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2021-04-09T18:35:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2021-04-09T18:35:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2021-04-09T18:35:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2021-04-09T18:35:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2021-04-09T18:35:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2021-04-09T18:35:49.896 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.896 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.896 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.896 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:35:49.896 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2021-04-09T18:35:49.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.897 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:35:49.897 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c93158fb-a785-4502-86ef-88ead369a3cc", 2021-04-09T18:35:49.897 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:49.898 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:49.898 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:49.898 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:49.898 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:49.898 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:49.899 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:49.899 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 132, 2021-04-09T18:35:49.899 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:49.899 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:49.899 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:49.900 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.900 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.900 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2021-04-09T18:35:49.901 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:49.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.901 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.901 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2021-04-09T18:35:49.902 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:49.902 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.902 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.902 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2021-04-09T18:35:49.904 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:49.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.904 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.904 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2021-04-09T18:35:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:49.906 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.906 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.906 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2021-04-09T18:35:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2021-04-09T18:35:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2021-04-09T18:35:49.910 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:49.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.910 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.910 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2021-04-09T18:35:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13961 2021-04-09T18:35:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6804/13961", 2021-04-09T18:35:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6808/13961", 2021-04-09T18:35:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/13961", 2021-04-09T18:35:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6812/13961", 2021-04-09T18:35:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:49.913 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:49.913 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.914 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:35:49.914 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "cfc0e117-1dd7-40de-9774-b60b84f691dc", 2021-04-09T18:35:49.914 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:49.914 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:49.914 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 131, 2021-04-09T18:35:49.916 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:49.916 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:49.916 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:49.916 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.917 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.917 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2021-04-09T18:35:49.917 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:49.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.918 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.918 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2021-04-09T18:35:49.918 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:49.918 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.919 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.919 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:49.919 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.920 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.920 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2021-04-09T18:35:49.920 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:49.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.921 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.921 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2021-04-09T18:35:49.921 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:49.921 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.922 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.922 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2021-04-09T18:35:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:49.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.924 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.925 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2021-04-09T18:35:49.925 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:49.925 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.926 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.926 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:49.926 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.927 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.927 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2021-04-09T18:35:49.927 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:49.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.928 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.928 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2021-04-09T18:35:49.928 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13963 2021-04-09T18:35:49.928 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/13963", 2021-04-09T18:35:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6805/13963", 2021-04-09T18:35:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6813/13963", 2021-04-09T18:35:49.930 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6809/13963", 2021-04-09T18:35:49.930 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:49.930 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:49.930 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:49.931 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.931 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:35:49.931 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "3e132e36-804a-4e09-bf33-351ef28cc52a", 2021-04-09T18:35:49.932 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:49.932 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:49.932 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:49.932 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:49.932 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:49.933 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:49.933 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:49.933 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 132, 2021-04-09T18:35:49.933 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:49.934 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:49.934 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:49.934 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.934 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.935 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2021-04-09T18:35:49.935 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:49.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.935 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2021-04-09T18:35:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.937 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:49.937 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.937 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.938 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2021-04-09T18:35:49.938 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:49.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.938 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2021-04-09T18:35:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2021-04-09T18:35:49.941 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:49.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.941 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.942 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2021-04-09T18:35:49.942 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:49.942 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.942 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2021-04-09T18:35:49.944 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:49.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.944 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.944 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2021-04-09T18:35:49.945 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13962 2021-04-09T18:35:49.945 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.945 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.946 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/13962", 2021-04-09T18:35:49.946 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/13962", 2021-04-09T18:35:49.946 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/13962", 2021-04-09T18:35:49.946 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/13962", 2021-04-09T18:35:49.946 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:49.947 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:49.947 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:49.947 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.948 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:35:49.948 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "5bee6c91-4f04-4f4d-9643-80d7ae17feb0", 2021-04-09T18:35:49.948 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:49.948 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:49.950 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 124, 2021-04-09T18:35:49.950 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:49.950 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:49.950 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:49.950 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2021-04-09T18:35:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.952 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.952 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2021-04-09T18:35:49.952 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:49.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.953 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.953 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:49.953 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.954 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2021-04-09T18:35:49.954 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:49.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.955 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.955 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2021-04-09T18:35:49.955 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:49.956 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.956 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.956 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:49.956 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.957 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.957 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2021-04-09T18:35:49.957 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:49.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.958 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.958 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2021-04-09T18:35:49.958 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:49.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.959 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.959 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:49.959 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.960 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.960 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2021-04-09T18:35:49.960 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:49.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.961 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.961 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2021-04-09T18:35:49.961 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 13987 2021-04-09T18:35:49.961 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.962 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.962 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/13987", 2021-04-09T18:35:49.963 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/13987", 2021-04-09T18:35:49.963 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/13987", 2021-04-09T18:35:49.963 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/13987", 2021-04-09T18:35:49.963 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:49.963 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:49.964 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:49.964 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.964 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:35:49.965 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c0d62925-071d-468c-8425-fedf7ef98e7f", 2021-04-09T18:35:49.965 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:49.965 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:49.965 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:49.966 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:49.966 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:49.966 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:49.966 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:49.966 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 132, 2021-04-09T18:35:49.967 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:49.967 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:49.967 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:49.967 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.968 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.968 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6826", 2021-04-09T18:35:49.968 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:49.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.969 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.969 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6827", 2021-04-09T18:35:49.970 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:49.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.970 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.970 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:49.971 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.971 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.971 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6828", 2021-04-09T18:35:49.972 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:49.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.972 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.972 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6829", 2021-04-09T18:35:49.973 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:49.973 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.973 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.973 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:49.974 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.974 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.974 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6832", 2021-04-09T18:35:49.974 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:49.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.975 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.975 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6833", 2021-04-09T18:35:49.976 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:49.976 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.976 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.976 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:49.977 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.977 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.977 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6830", 2021-04-09T18:35:49.977 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:49.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.978 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.978 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6831", 2021-04-09T18:35:49.978 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14212 2021-04-09T18:35:49.979 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.979 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.979 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6827/14212", 2021-04-09T18:35:49.980 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6829/14212", 2021-04-09T18:35:49.980 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6833/14212", 2021-04-09T18:35:49.980 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6831/14212", 2021-04-09T18:35:49.980 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:49.980 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:49.981 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:49.981 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.981 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:35:49.982 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "27d54918-b90c-4c75-b31b-e3ac664baee2", 2021-04-09T18:35:49.982 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:49.982 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:49.982 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:49.982 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:49.983 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:49.983 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:49.983 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:49.983 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 132, 2021-04-09T18:35:49.984 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:49.984 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:49.984 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:49.984 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.985 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6810", 2021-04-09T18:35:49.985 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:49.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.986 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.986 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6811", 2021-04-09T18:35:49.986 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:49.986 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.986 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.987 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:49.987 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.988 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.988 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6812", 2021-04-09T18:35:49.988 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:49.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.989 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.989 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6813", 2021-04-09T18:35:49.989 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:49.989 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.989 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.990 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:49.990 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.990 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.991 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6816", 2021-04-09T18:35:49.991 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:49.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.992 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.992 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6817", 2021-04-09T18:35:49.992 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:49.992 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.992 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.993 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:49.993 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:49.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.993 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:49.994 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6814", 2021-04-09T18:35:49.994 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:49.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.994 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:49.995 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6815", 2021-04-09T18:35:49.995 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14210 2021-04-09T18:35:49.995 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:49.995 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.996 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6811/14210", 2021-04-09T18:35:49.996 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6813/14210", 2021-04-09T18:35:49.996 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6817/14210", 2021-04-09T18:35:49.996 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6815/14210", 2021-04-09T18:35:49.997 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:49.997 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:49.997 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:49.997 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:49.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:49.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:49.998 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:35:49.998 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d3e702a2-a197-49dd-b937-5b81239f2654", 2021-04-09T18:35:49.998 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:49.998 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:49.999 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:49.999 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:49.999 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:49.999 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:49.999 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:50.000 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 132, 2021-04-09T18:35:50.000 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:50.000 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:50.000 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:50.001 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:50.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.001 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:50.001 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6802", 2021-04-09T18:35:50.001 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:50.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.002 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:50.002 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6803", 2021-04-09T18:35:50.002 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:50.003 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:50.003 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:50.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.003 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:50.003 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:50.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.004 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:50.004 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6804", 2021-04-09T18:35:50.004 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:50.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.005 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:50.005 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6805", 2021-04-09T18:35:50.005 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:50.005 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:50.006 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:50.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.006 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:50.006 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:50.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.007 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:50.007 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6808", 2021-04-09T18:35:50.007 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:50.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.008 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:50.008 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6809", 2021-04-09T18:35:50.008 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:50.008 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:50.009 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:50.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.009 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:50.009 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:50.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.010 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:50.010 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6806", 2021-04-09T18:35:50.010 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:50.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.011 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:50.011 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6807", 2021-04-09T18:35:50.011 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14211 2021-04-09T18:35:50.011 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:50.012 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:50.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.012 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6803/14211", 2021-04-09T18:35:50.012 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6805/14211", 2021-04-09T18:35:50.012 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6809/14211", 2021-04-09T18:35:50.013 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6807/14211", 2021-04-09T18:35:50.013 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:50.013 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:50.013 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:50.014 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:50.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.014 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:35:50.014 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88f940d9-7a5a-4c50-9e09-de72bf87623f", 2021-04-09T18:35:50.015 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2021-04-09T18:35:50.015 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2021-04-09T18:35:50.015 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2021-04-09T18:35:50.015 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2021-04-09T18:35:50.015 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2021-04-09T18:35:50.016 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2021-04-09T18:35:50.016 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2021-04-09T18:35:50.016 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 131, 2021-04-09T18:35:50.016 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2021-04-09T18:35:50.017 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2021-04-09T18:35:50.017 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2021-04-09T18:35:50.017 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:50.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.017 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:50.018 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6818", 2021-04-09T18:35:50.018 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:50.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.018 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:50.019 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6819", 2021-04-09T18:35:50.019 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:50.019 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:50.019 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:50.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.020 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2021-04-09T18:35:50.020 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:50.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.020 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:50.021 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6820", 2021-04-09T18:35:50.021 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:50.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.021 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:50.022 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6821", 2021-04-09T18:35:50.022 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:50.022 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:50.022 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:50.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.023 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2021-04-09T18:35:50.023 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:50.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.023 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:50.024 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6824", 2021-04-09T18:35:50.024 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:50.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.024 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:50.025 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6825", 2021-04-09T18:35:50.025 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:50.025 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:50.025 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:50.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.026 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2021-04-09T18:35:50.026 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2021-04-09T18:35:50.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.026 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2021-04-09T18:35:50.026 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6822", 2021-04-09T18:35:50.027 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:50.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.027 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2021-04-09T18:35:50.028 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.89:6823", 2021-04-09T18:35:50.028 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 14233 2021-04-09T18:35:50.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:50.028 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:50.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.029 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.89:6819/14233", 2021-04-09T18:35:50.029 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.89:6821/14233", 2021-04-09T18:35:50.029 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.89:6825/14233", 2021-04-09T18:35:50.029 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.89:6823/14233", 2021-04-09T18:35:50.029 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2021-04-09T18:35:50.030 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2021-04-09T18:35:50.030 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2021-04-09T18:35:50.030 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2021-04-09T18:35:50.030 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:50.030 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:35:50.031 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2021-04-09T18:35:50.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.031 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2021-04-09T18:35:50.031 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:50.032 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:50.032 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:50.032 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:50.032 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:50.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.033 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2021-04-09T18:35:50.033 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:50.033 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:50.033 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:50.034 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:50.034 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:50.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.034 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2021-04-09T18:35:50.035 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:50.035 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:50.035 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:50.035 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:50.035 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:50.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.036 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2021-04-09T18:35:50.036 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:50.037 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:50.037 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:50.037 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:50.037 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:50.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.038 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2021-04-09T18:35:50.038 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:50.038 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:50.038 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:50.039 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:50.039 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:50.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.039 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2021-04-09T18:35:50.040 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:50.040 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:50.040 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:50.040 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:50.040 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:50.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.041 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2021-04-09T18:35:50.041 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:50.042 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:50.042 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:50.042 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:50.042 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:50.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2021-04-09T18:35:50.043 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2021-04-09T18:35:50.043 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2021-04-09T18:35:50.043 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2021-04-09T18:35:50.043 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2021-04-09T18:35:50.044 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4611087854035861503, 2021-04-09T18:35:50.044 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0 2021-04-09T18:35:50.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:50.044 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2021-04-09T18:35:50.045 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2021-04-09T18:35:50.045 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2021-04-09T18:35:50.045 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2021-04-09T18:35:50.045 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2021-04-09T18:35:50.045 INFO:teuthology.orchestra.run.smithi079.stdout: "blacklist": { 2021-04-09T18:35:50.046 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6835/1552365531": "2021-04-10 18:35:39.980332", 2021-04-09T18:35:50.046 INFO:teuthology.orchestra.run.smithi079.stdout: "172.21.15.89:6834/1552365531": "2021-04-10 18:35:39.980332" 2021-04-09T18:35:50.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.046 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2021-04-09T18:35:50.046 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_data": { 2021-04-09T18:35:50.047 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-device-class": "", 2021-04-09T18:35:50.047 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:35:50.047 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-root": "default", 2021-04-09T18:35:50.047 INFO:teuthology.orchestra.run.smithi079.stdout: "jerasure-per-chunk-alignment": "false", 2021-04-09T18:35:50.047 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:35:50.048 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "2", 2021-04-09T18:35:50.048 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:35:50.048 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:35:50.048 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van", 2021-04-09T18:35:50.048 INFO:teuthology.orchestra.run.smithi079.stdout: "w": "8" 2021-04-09T18:35:50.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.049 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2021-04-09T18:35:50.049 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2021-04-09T18:35:50.049 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2021-04-09T18:35:50.049 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2021-04-09T18:35:50.050 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2021-04-09T18:35:50.050 INFO:teuthology.orchestra.run.smithi079.stdout: "ruleset-failure-domain": "osd", 2021-04-09T18:35:50.050 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2021-04-09T18:35:50.050 INFO:teuthology.orchestra.run.smithi079.stdout: } 2021-04-09T18:35:50.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2021-04-09T18:35:50.051 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2021-04-09T18:35:50.051 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2021-04-09T18:35:50.051 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2021-04-09T18:35:50.051 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2021-04-09T18:35:50.052 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {} 2021-04-09T18:35:50.052 INFO:teuthology.orchestra.run.smithi079.stdout:} 2021-04-09T18:35:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.822 7f0a1c55f700 1 -- 172.21.15.79:0/1463720281 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f09fc029100 msgr2=0x7f09fc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.822 7f0a1c55f700 1 --2- 172.21.15.79:0/1463720281 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f09fc029100 0x7f09fc02b650 crc :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.822 7f0a1c55f700 1 -- 172.21.15.79:0/1463720281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a1419dbe0 msgr2=0x7f0a140c1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.822 7f0a1c55f700 1 --2- 172.21.15.79:0/1463720281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a1419dbe0 0x7f0a140c1720 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f0a0c00c000 tx=0x7f0a0c00c430).stop 2021-04-09T18:35:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.822 7f0a1c55f700 1 -- 172.21.15.79:0/1463720281 shutdown_connections 2021-04-09T18:35:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.822 7f0a1c55f700 1 --2- 172.21.15.79:0/1463720281 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f09fc029100 0x7f09fc02b650 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.822 7f0a1c55f700 1 --2- 172.21.15.79:0/1463720281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a1419dbe0 0x7f0a140c1720 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.822 7f0a1c55f700 1 --2- 172.21.15.79:0/1463720281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a141a16a0 0x7f0a140bae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.822 7f0a1c55f700 1 --2- 172.21.15.79:0/1463720281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a14097540 0x7f0a140c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.822 7f0a1c55f700 1 -- 172.21.15.79:0/1463720281 >> 172.21.15.79:0/1463720281 conn(0x7f0a140a7040 msgr2=0x7f0a140d80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.822 7f0a1c55f700 1 -- 172.21.15.79:0/1463720281 shutdown_connections 2021-04-09T18:35:50.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:49.822 7f0a1c55f700 1 -- 172.21.15.79:0/1463720281 wait complete. 2021-04-09T18:35:50.057 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:35:50.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.162 7f92e2133700 1 Processor -- start 2021-04-09T18:35:50.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.166 7f92e2133700 1 -- start start 2021-04-09T18:35:50.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.166 7f92e2133700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f92dc0f5510 0x7f92dc0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:50.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.166 7f92e2133700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f92dc1c8000 0x7f92dc1ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:50.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.166 7f92e2133700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92dc0fbb10 con 0x7f92dc0e9ad0 2021-04-09T18:35:50.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.166 7f92e2133700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92dc0e9f20 con 0x7f92dc1c8000 2021-04-09T18:35:50.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.166 7f92e2133700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92dc1c3db0 con 0x7f92dc0f5510 2021-04-09T18:35:50.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.166 7f92dbfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f92dc1c8000 0x7f92dc1ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:50.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.166 7f92dbfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f92dc1c8000 0x7f92dc1ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35826/0 (socket says 172.21.15.79:35826) 2021-04-09T18:35:50.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.166 7f92dbfff700 1 -- 172.21.15.79:0/1107419787 learned_addr learned my addr 172.21.15.79:0/1107419787 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:50.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.166 7f92db7fe700 1 --2- 172.21.15.79:0/1107419787 >> v2:172.21.15.89:3300/0 conn(0x7f92dc0f5510 0x7f92dc0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:50.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.166 7f92dbfff700 1 -- 172.21.15.79:0/1107419787 >> v2:172.21.15.89:3300/0 conn(0x7f92dc0f5510 msgr2=0x7f92dc0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:50.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.166 7f92dbfff700 1 --2- 172.21.15.79:0/1107419787 >> v2:172.21.15.89:3300/0 conn(0x7f92dc0f5510 0x7f92dc0f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.166 7f92dbfff700 1 -- 172.21.15.79:0/1107419787 >> v1:172.21.15.89:6789/0 conn(0x7f92dc0e9ad0 legacy=0x7f92dc09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:50.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.166 7f92dbfff700 1 -- 172.21.15.79:0/1107419787 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92dc09f900 con 0x7f92dc1c8000 2021-04-09T18:35:50.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.166 7f92dbfff700 1 --2- 172.21.15.79:0/1107419787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc1c8000 0x7f92dc1ca460 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f92d40032b0 tx=0x7f92d400b3c0).ready entity=mon.0 client_cookie=b98d91e81498b095 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:50.186 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.166 7f92da7fc700 1 -- 172.21.15.79:0/1107419787 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f92dc09f900 con 0x7f92dc1c8000 2021-04-09T18:35:50.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.166 7f92da7fc700 1 -- 172.21.15.79:0/1107419787 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d400bc20 con 0x7f92dc1c8000 2021-04-09T18:35:50.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.166 7f92da7fc700 1 -- 172.21.15.79:0/1107419787 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f92d4002020 con 0x7f92dc1c8000 2021-04-09T18:35:50.187 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.166 7f92e2133700 1 -- 172.21.15.79:0/1107419787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc1c8000 msgr2=0x7f92dc1ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.166 7f92e2133700 1 --2- 172.21.15.79:0/1107419787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc1c8000 0x7f92dc1ca460 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f92d40032b0 tx=0x7f92d400b3c0).stop 2021-04-09T18:35:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.170 7f92e2133700 1 -- 172.21.15.79:0/1107419787 shutdown_connections 2021-04-09T18:35:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.170 7f92e2133700 1 --2- 172.21.15.79:0/1107419787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc1c8000 0x7f92dc1ca460 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.170 7f92e2133700 1 --2- 172.21.15.79:0/1107419787 >> v2:172.21.15.89:3300/0 conn(0x7f92dc0f5510 0x7f92dc0f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.170 7f92e2133700 1 -- 172.21.15.79:0/1107419787 >> 172.21.15.79:0/1107419787 conn(0x7f92dc0e5fd0 msgr2=0x7f92dc0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:50.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.170 7f92e2133700 1 -- 172.21.15.79:0/1107419787 shutdown_connections 2021-04-09T18:35:50.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.170 7f92e2133700 1 -- 172.21.15.79:0/1107419787 wait complete. 2021-04-09T18:35:50.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92e2133700 1 Processor -- start 2021-04-09T18:35:50.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92e2133700 1 -- start start 2021-04-09T18:35:50.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92e2133700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc0d6c70 0x7f92dc1a66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:50.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92e2133700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92dc0d70c0 0x7f92dc1a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:50.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92e2133700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92dc0d5bd0 0x7f92dc0d6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:50.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92e2133700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc0e8ae0 con 0x7f92dc0d6c70 2021-04-09T18:35:50.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92e2133700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc0bc570 con 0x7f92dc0d5bd0 2021-04-09T18:35:50.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92e2133700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc0d5820 con 0x7f92dc0d70c0 2021-04-09T18:35:50.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92db7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc0d6c70 0x7f92dc1a66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:50.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92db7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc0d6c70 0x7f92dc1a66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35830/0 (socket says 172.21.15.79:35830) 2021-04-09T18:35:50.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92db7fe700 1 -- 172.21.15.79:0/2679824439 learned_addr learned my addr 172.21.15.79:0/2679824439 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:50.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92dbfff700 1 --2- 172.21.15.79:0/2679824439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92dc0d5bd0 0x7f92dc0d6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:50.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92daffd700 1 --2- 172.21.15.79:0/2679824439 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92dc0d70c0 0x7f92dc1a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:50.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92db7fe700 1 -- 172.21.15.79:0/2679824439 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92dc0d70c0 msgr2=0x7f92dc1a6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:50.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92db7fe700 1 --2- 172.21.15.79:0/2679824439 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92dc0d70c0 0x7f92dc1a6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92db7fe700 1 -- 172.21.15.79:0/2679824439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92dc0d5bd0 msgr2=0x7f92dc0d6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:50.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92db7fe700 1 --2- 172.21.15.79:0/2679824439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92dc0d5bd0 0x7f92dc0d6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92db7fe700 1 -- 172.21.15.79:0/2679824439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92dc0d6650 con 0x7f92dc0d6c70 2021-04-09T18:35:50.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92db7fe700 1 --2- 172.21.15.79:0/2679824439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc0d6c70 0x7f92dc1a66f0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7f92cc006920 tx=0x7f92cc00c150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:50.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92c3fff700 1 -- 172.21.15.79:0/2679824439 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f92dc0d6650 con 0x7f92dc0d6c70 2021-04-09T18:35:50.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92c3fff700 1 -- 172.21.15.79:0/2679824439 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92cc00cbb0 con 0x7f92dc0d6c70 2021-04-09T18:35:50.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92e2133700 1 -- 172.21.15.79:0/2679824439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92dc0bc870 con 0x7f92dc0d6c70 2021-04-09T18:35:50.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92c3fff700 1 -- 172.21.15.79:0/2679824439 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f92cc00f040 con 0x7f92dc0d6c70 2021-04-09T18:35:50.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.174 7f92e2133700 1 -- 172.21.15.79:0/2679824439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92dc0bcd80 con 0x7f92dc0d6c70 2021-04-09T18:35:50.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.178 7f92c3fff700 1 -- 172.21.15.79:0/2679824439 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f92cc011070 con 0x7f92dc0d6c70 2021-04-09T18:35:50.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.178 7f92c3fff700 1 --2- 172.21.15.79:0/2679824439 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f92bc029100 0x7f92bc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:50.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.178 7f92c3fff700 1 -- 172.21.15.79:0/2679824439 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f92cc010040 con 0x7f92dc0d6c70 2021-04-09T18:35:50.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.178 7f92daffd700 1 --2- 172.21.15.79:0/2679824439 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f92bc029100 0x7f92bc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:50.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.178 7f92daffd700 1 --2- 172.21.15.79:0/2679824439 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f92bc029100 0x7f92bc02b650 crc :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:50.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.194 7f92e2133700 1 -- 172.21.15.79:0/2679824439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92dc0e39d0 con 0x7f92dc0d6c70 2021-04-09T18:35:50.209 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.202 7f92c3fff700 1 -- 172.21.15.79:0/2679824439 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f92cc00c7b0 con 0x7f92dc0d6c70 2021-04-09T18:35:50.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.374 7f92e2133700 1 -- 172.21.15.79:0/2679824439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92dc0f5b10 con 0x7f92dc0d6c70 2021-04-09T18:35:50.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.374 7f92c3fff700 1 -- 172.21.15.79:0/2679824439 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f92cc000bf0 con 0x7f92dc0d6c70 2021-04-09T18:35:50.382 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 86 2021-04-09T18:35:50.382 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:50.383 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":86,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8175,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/2663381192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2663381192},{"type":"v1","addr":"172.21.15.79:6833","nonce":2663381192}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:35:39.593350","modified":"2021-04-09 18:35:41.603617","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7055":{"gid":7055,"name":"b","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/4071560647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":4071560647},{"type":"v1","addr":"172.21.15.89:6835","nonce":4071560647}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-04-09T18:35:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.378 7f92e2133700 1 -- 172.21.15.79:0/2679824439 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f92bc029100 msgr2=0x7f92bc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.378 7f92e2133700 1 --2- 172.21.15.79:0/2679824439 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f92bc029100 0x7f92bc02b650 crc :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.378 7f92e2133700 1 -- 172.21.15.79:0/2679824439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc0d6c70 msgr2=0x7f92dc1a66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.378 7f92e2133700 1 --2- 172.21.15.79:0/2679824439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc0d6c70 0x7f92dc1a66f0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7f92cc006920 tx=0x7f92cc00c150).stop 2021-04-09T18:35:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.378 7f92e2133700 1 -- 172.21.15.79:0/2679824439 shutdown_connections 2021-04-09T18:35:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.378 7f92e2133700 1 --2- 172.21.15.79:0/2679824439 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f92bc029100 0x7f92bc02b650 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.378 7f92e2133700 1 --2- 172.21.15.79:0/2679824439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92dc0d5bd0 0x7f92dc0d6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.378 7f92e2133700 1 --2- 172.21.15.79:0/2679824439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc0d6c70 0x7f92dc1a66f0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.378 7f92e2133700 1 --2- 172.21.15.79:0/2679824439 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92dc0d70c0 0x7f92dc1a6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.378 7f92e2133700 1 -- 172.21.15.79:0/2679824439 >> 172.21.15.79:0/2679824439 conn(0x7f92dc0935d0 msgr2=0x7f92dc0d78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.378 7f92e2133700 1 -- 172.21.15.79:0/2679824439 shutdown_connections 2021-04-09T18:35:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.378 7f92e2133700 1 -- 172.21.15.79:0/2679824439 wait complete. 2021-04-09T18:35:50.397 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-04-09T18:35:50.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0af139a700 1 Processor -- start 2021-04-09T18:35:50.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0af139a700 1 -- start start 2021-04-09T18:35:50.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0af139a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0aec0f5520 0x7f0aec0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:50.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0af139a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aec0fbb20 con 0x7f0aec1c8010 2021-04-09T18:35:50.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0af139a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aec09f910 con 0x7f0aec0e9ae0 2021-04-09T18:35:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0af139a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec0e9f30 con 0x7f0aec0f5520 2021-04-09T18:35:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aeb806700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0aec1c8010 0x7f0aec1ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58780/0 (socket says 172.21.15.79:58780) 2021-04-09T18:35:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aeb806700 1 -- 172.21.15.79:0/140095266 learned_addr learned my addr 172.21.15.79:0/140095266 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aeb005700 1 --2- 172.21.15.79:0/140095266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0aec0f5520 0x7f0aec0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aea003700 1 -- 172.21.15.79:0/140095266 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061202231 0 0) 0x7f0ae4001450 con 0x7f0aec1c8010 2021-04-09T18:35:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aea003700 1 -- 172.21.15.79:0/140095266 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ad4003240 con 0x7f0aec1c8010 2021-04-09T18:35:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aea003700 1 -- 172.21.15.79:0/140095266 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 807468174 0 0) 0x7f0ae40019d0 con 0x7f0aec1c8010 2021-04-09T18:35:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aea003700 1 -- 172.21.15.79:0/140095266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0aec0f5520 msgr2=0x7f0aec0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aea003700 1 --2- 172.21.15.79:0/140095266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0aec0f5520 0x7f0aec0f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aea003700 1 -- 172.21.15.79:0/140095266 >> v1:172.21.15.89:6789/0 conn(0x7f0aec0e9ae0 legacy=0x7f0aec09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aea003700 1 -- 172.21.15.79:0/140095266 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec0e56d0 con 0x7f0aec1c8010 2021-04-09T18:35:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aea003700 1 -- 172.21.15.79:0/140095266 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f0ae4001f30 con 0x7f0aec1c8010 2021-04-09T18:35:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aea003700 1 -- 172.21.15.79:0/140095266 >> v1:172.21.15.79:6789/0 conn(0x7f0aec1c8010 legacy=0x7f0aec1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aea003700 1 --2- 172.21.15.79:0/140095266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ad40038f0 0x7f0ad4003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aea003700 1 --2- 172.21.15.79:0/140095266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ad40045a0 0x7f0ad40049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aea003700 1 --2- 172.21.15.79:0/140095266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ad40097e0 0x7f0ad400bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aea003700 1 -- 172.21.15.79:0/140095266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec0e9f30 con 0x7f0ad40038f0 2021-04-09T18:35:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aea003700 1 -- 172.21.15.79:0/140095266 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad40051d0 con 0x7f0ad40045a0 2021-04-09T18:35:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aea003700 1 -- 172.21.15.79:0/140095266 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad40053d0 con 0x7f0ad40097e0 2021-04-09T18:35:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aeb005700 1 --2- 172.21.15.79:0/140095266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ad40038f0 0x7f0ad4003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aeb806700 1 --2- 172.21.15.79:0/140095266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ad40097e0 0x7f0ad400bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aea804700 1 --2- 172.21.15.79:0/140095266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ad40045a0 0x7f0ad40049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aeb005700 1 -- 172.21.15.79:0/140095266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ad40097e0 msgr2=0x7f0ad400bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aeb005700 1 --2- 172.21.15.79:0/140095266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ad40097e0 0x7f0ad400bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aeb005700 1 -- 172.21.15.79:0/140095266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ad40045a0 msgr2=0x7f0ad40049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aeb005700 1 --2- 172.21.15.79:0/140095266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ad40045a0 0x7f0ad40049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aeb005700 1 -- 172.21.15.79:0/140095266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad4050390 con 0x7f0ad40038f0 2021-04-09T18:35:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aeb005700 1 --2- 172.21.15.79:0/140095266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ad40038f0 0x7f0ad4003d60 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f0adc00c000 tx=0x7f0adc00e1d0).ready entity=mon.0 client_cookie=385797179ba37062 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:50.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aea003700 1 -- 172.21.15.79:0/140095266 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ad4050390 con 0x7f0ad40038f0 2021-04-09T18:35:50.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aea003700 1 -- 172.21.15.79:0/140095266 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc00ec90 con 0x7f0ad40038f0 2021-04-09T18:35:50.506 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aea003700 1 -- 172.21.15.79:0/140095266 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0adc00f040 con 0x7f0ad40038f0 2021-04-09T18:35:50.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0af139a700 1 -- 172.21.15.79:0/140095266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ad40038f0 msgr2=0x7f0ad4003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:50.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0af139a700 1 --2- 172.21.15.79:0/140095266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ad40038f0 0x7f0ad4003d60 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f0adc00c000 tx=0x7f0adc00e1d0).stop 2021-04-09T18:35:50.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.486 7f0aeb806700 1 -- 172.21.15.79:0/140095266 reap_dead start 2021-04-09T18:35:50.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.490 7f0af139a700 1 -- 172.21.15.79:0/140095266 shutdown_connections 2021-04-09T18:35:50.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.490 7f0af139a700 1 -- 172.21.15.79:0/140095266 >> 172.21.15.79:0/140095266 conn(0x7f0aec0e5fe0 msgr2=0x7f0aec0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:50.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.490 7f0af139a700 1 -- 172.21.15.79:0/140095266 shutdown_connections 2021-04-09T18:35:50.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.490 7f0af139a700 1 -- 172.21.15.79:0/140095266 wait complete. 2021-04-09T18:35:50.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.490 7f0af139a700 1 Processor -- start 2021-04-09T18:35:50.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.490 7f0af139a700 1 -- start start 2021-04-09T18:35:50.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0af139a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0aec0b1390 0x7f0aec0b9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:50.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0af139a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec0af770 0x7f0aec0ab790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:50.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0af139a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0aec0abdc0 0x7f0aec096fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:50.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0af139a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec1c3dc0 con 0x7f0aec0af770 2021-04-09T18:35:50.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0af139a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec0c4460 con 0x7f0aec0abdc0 2021-04-09T18:35:50.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0af139a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec0b1cd0 con 0x7f0aec0b1390 2021-04-09T18:35:50.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0aea804700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec0af770 0x7f0aec0ab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:50.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0aeb005700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0aec0b1390 0x7f0aec0b9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:50.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0aea804700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec0af770 0x7f0aec0ab790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35850/0 (socket says 172.21.15.79:35850) 2021-04-09T18:35:50.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0aea804700 1 -- 172.21.15.79:0/54662864 learned_addr learned my addr 172.21.15.79:0/54662864 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:50.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0aeb806700 1 --2- 172.21.15.79:0/54662864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0aec0abdc0 0x7f0aec096fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:50.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0aea804700 1 -- 172.21.15.79:0/54662864 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0aec0b1390 msgr2=0x7f0aec0b9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:50.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0aea804700 1 --2- 172.21.15.79:0/54662864 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0aec0b1390 0x7f0aec0b9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0aea804700 1 -- 172.21.15.79:0/54662864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0aec0abdc0 msgr2=0x7f0aec096fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:50.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0aea804700 1 --2- 172.21.15.79:0/54662864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0aec0abdc0 0x7f0aec096fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0aea804700 1 -- 172.21.15.79:0/54662864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec0ba1f0 con 0x7f0aec0af770 2021-04-09T18:35:50.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0aeb005700 1 --2- 172.21.15.79:0/54662864 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0aec0b1390 0x7f0aec0b9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:50.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0aeb806700 1 --2- 172.21.15.79:0/54662864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0aec0abdc0 0x7f0aec096fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:50.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0aea804700 1 --2- 172.21.15.79:0/54662864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec0af770 0x7f0aec0ab790 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7f0aec0b1950 tx=0x7f0ae000fd70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:50.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0ad3fff700 1 -- 172.21.15.79:0/54662864 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0aec0ba1f0 con 0x7f0aec0af770 2021-04-09T18:35:50.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0ad3fff700 1 -- 172.21.15.79:0/54662864 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae000d940 con 0x7f0aec0af770 2021-04-09T18:35:50.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0af139a700 1 -- 172.21.15.79:0/54662864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aec097610 con 0x7f0aec0af770 2021-04-09T18:35:50.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0ad3fff700 1 -- 172.21.15.79:0/54662864 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ae0018020 con 0x7f0aec0af770 2021-04-09T18:35:50.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0af139a700 1 -- 172.21.15.79:0/54662864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aec097b10 con 0x7f0aec0af770 2021-04-09T18:35:50.516 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0ad3fff700 1 -- 172.21.15.79:0/54662864 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0ae0012070 con 0x7f0aec0af770 2021-04-09T18:35:50.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0ad3fff700 1 --2- 172.21.15.79:0/54662864 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0acc029100 0x7f0acc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:50.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.494 7f0ad3fff700 1 -- 172.21.15.79:0/54662864 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6010+0+0 (secure 0 0 0) 0x7f0ae0011040 con 0x7f0aec0af770 2021-04-09T18:35:50.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.498 7f0aeb005700 1 --2- 172.21.15.79:0/54662864 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0acc029100 0x7f0acc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:50.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.498 7f0aeb005700 1 --2- 172.21.15.79:0/54662864 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0acc029100 0x7f0acc02b650 crc :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:50.517 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.498 7f0af139a700 1 -- 172.21.15.79:0/54662864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aec0e39e0 con 0x7f0aec0af770 2021-04-09T18:35:50.518 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.506 7f0ad3fff700 1 -- 172.21.15.79:0/54662864 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0ae000d540 con 0x7f0aec0af770 2021-04-09T18:35:50.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.658 7f0af139a700 1 -- 172.21.15.79:0/54662864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0aec0f5b20 con 0x7f0aec0af770 2021-04-09T18:35:50.878 INFO:tasks.ceph.mon.a.smithi079.stderr:2021-04-09 18:35:50.874 7fbcd0516700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:35:50.888 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.882 7f0ad3fff700 1 -- 172.21.15.79:0/54662864 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v87) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0ae0000bf0 con 0x7f0aec0af770 2021-04-09T18:35:50.915 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2021-04-09T18:35:50.929 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-04-09T18:35:50.934 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.926 7f0af139a700 1 -- 172.21.15.79:0/54662864 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0acc029100 msgr2=0x7f0acc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:50.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.926 7f0af139a700 1 --2- 172.21.15.79:0/54662864 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0acc029100 0x7f0acc02b650 crc :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.935 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.926 7f0af139a700 1 -- 172.21.15.79:0/54662864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec0af770 msgr2=0x7f0aec0ab790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:50.936 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.926 7f0af139a700 1 --2- 172.21.15.79:0/54662864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec0af770 0x7f0aec0ab790 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7f0aec0b1950 tx=0x7f0ae000fd70).stop 2021-04-09T18:35:50.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.926 7f0af139a700 1 -- 172.21.15.79:0/54662864 shutdown_connections 2021-04-09T18:35:50.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.926 7f0af139a700 1 --2- 172.21.15.79:0/54662864 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f0acc029100 0x7f0acc02b650 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.937 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.926 7f0af139a700 1 --2- 172.21.15.79:0/54662864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0aec0abdc0 0x7f0aec096fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.939 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.926 7f0af139a700 1 --2- 172.21.15.79:0/54662864 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0aec0b1390 0x7f0aec0b9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.926 7f0af139a700 1 --2- 172.21.15.79:0/54662864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec0af770 0x7f0aec0ab790 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:50.940 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.926 7f0af139a700 1 -- 172.21.15.79:0/54662864 >> 172.21.15.79:0/54662864 conn(0x7f0aec099fe0 msgr2=0x7f0aec0baab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:50.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.926 7f0af139a700 1 -- 172.21.15.79:0/54662864 shutdown_connections 2021-04-09T18:35:50.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:50.926 7f0af139a700 1 -- 172.21.15.79:0/54662864 wait complete. 2021-04-09T18:35:50.953 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:35:51.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f84528f4700 1 Processor -- start 2021-04-09T18:35:51.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f84528f4700 1 -- start start 2021-04-09T18:35:51.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f84528f4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f844c0f5510 0x7f844c0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:51.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f84528f4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f844c0e9ad0 0x7f844c09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:51.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f84528f4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f844c1c2da0 0x7f844c1c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:51.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f84528f4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f844c0e9f20 con 0x7f844c0f5510 2021-04-09T18:35:51.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f84528f4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f844c0e59c0 con 0x7f844c1c2da0 2021-04-09T18:35:51.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f84528f4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844c0fbb10 con 0x7f844c0e9ad0 2021-04-09T18:35:51.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f844bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f844c0f5510 0x7f844c0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:51.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f844bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f844c0f5510 0x7f844c0f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35856/0 (socket says 172.21.15.79:35856) 2021-04-09T18:35:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f844bfff700 1 -- 172.21.15.79:0/1804993618 learned_addr learned my addr 172.21.15.79:0/1804993618 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f8450e99700 1 --2- 172.21.15.79:0/1804993618 >> v2:172.21.15.89:3300/0 conn(0x7f844c1c2da0 0x7f844c1c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f844b7fe700 1 --2- 172.21.15.79:0/1804993618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f844c0e9ad0 0x7f844c09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:51.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f844bfff700 1 -- 172.21.15.79:0/1804993618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f844c0e9ad0 msgr2=0x7f844c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:51.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f844bfff700 1 --2- 172.21.15.79:0/1804993618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f844c0e9ad0 0x7f844c09f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f844bfff700 1 -- 172.21.15.79:0/1804993618 >> v2:172.21.15.89:3300/0 conn(0x7f844c1c2da0 msgr2=0x7f844c1c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:51.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f844bfff700 1 --2- 172.21.15.79:0/1804993618 >> v2:172.21.15.89:3300/0 conn(0x7f844c1c2da0 0x7f844c1c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f844bfff700 1 -- 172.21.15.79:0/1804993618 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c0e56c0 con 0x7f844c0f5510 2021-04-09T18:35:51.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f8450e99700 1 --2- 172.21.15.79:0/1804993618 >> v2:172.21.15.89:3300/0 conn(0x7f844c1c2da0 0x7f844c1c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:51.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f844bfff700 1 --2- 172.21.15.79:0/1804993618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844c0f5510 0x7f844c0f64a0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7f843c002f30 tx=0x7f843c00bd70).ready entity=mon.0 client_cookie=a548f63a9d19d324 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:51.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f844affd700 1 -- 172.21.15.79:0/1804993618 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f844c0e56c0 con 0x7f844c0f5510 2021-04-09T18:35:51.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f844affd700 1 -- 172.21.15.79:0/1804993618 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c0098b0 con 0x7f844c0f5510 2021-04-09T18:35:51.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f844affd700 1 -- 172.21.15.79:0/1804993618 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f843c009c80 con 0x7f844c0f5510 2021-04-09T18:35:51.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f84528f4700 1 -- 172.21.15.79:0/1804993618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844c0f5510 msgr2=0x7f844c0f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:51.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.050 7f84528f4700 1 --2- 172.21.15.79:0/1804993618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844c0f5510 0x7f844c0f64a0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7f843c002f30 tx=0x7f843c00bd70).stop 2021-04-09T18:35:51.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.054 7f84528f4700 1 -- 172.21.15.79:0/1804993618 shutdown_connections 2021-04-09T18:35:51.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.054 7f84528f4700 1 --2- 172.21.15.79:0/1804993618 >> v2:172.21.15.89:3300/0 conn(0x7f844c1c2da0 0x7f844c1c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.054 7f84528f4700 1 --2- 172.21.15.79:0/1804993618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844c0f5510 0x7f844c0f64a0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.054 7f84528f4700 1 --2- 172.21.15.79:0/1804993618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f844c0e9ad0 0x7f844c09f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.054 7f84528f4700 1 -- 172.21.15.79:0/1804993618 >> 172.21.15.79:0/1804993618 conn(0x7f844c0e5fd0 msgr2=0x7f844c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:51.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.054 7f84528f4700 1 -- 172.21.15.79:0/1804993618 shutdown_connections 2021-04-09T18:35:51.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.054 7f84528f4700 1 -- 172.21.15.79:0/1804993618 wait complete. 2021-04-09T18:35:51.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f84528f4700 1 Processor -- start 2021-04-09T18:35:51.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f84528f4700 1 -- start start 2021-04-09T18:35:51.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f84528f4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f844c0ae420 0x7f844c0badc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:51.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f84528f4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f844c0a8d10 0x7f844c0a9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:51.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f84528f4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844c0a9790 0x7f844c0d45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:51.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f84528f4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c0aeb90 con 0x7f844c0a9790 2021-04-09T18:35:51.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f84528f4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c0ae870 con 0x7f844c0a8d10 2021-04-09T18:35:51.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f84528f4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844c1aa750 con 0x7f844c0ae420 2021-04-09T18:35:51.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f8450e99700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844c0a9790 0x7f844c0d45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:51.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f8450e99700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844c0a9790 0x7f844c0d45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35866/0 (socket says 172.21.15.79:35866) 2021-04-09T18:35:51.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f8450e99700 1 -- 172.21.15.79:0/3162081352 learned_addr learned my addr 172.21.15.79:0/3162081352 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:51.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f844b7fe700 1 --2- 172.21.15.79:0/3162081352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f844c0a8d10 0x7f844c0a9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:51.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f844bfff700 1 --2- 172.21.15.79:0/3162081352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f844c0ae420 0x7f844c0badc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:51.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f8450e99700 1 -- 172.21.15.79:0/3162081352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f844c0ae420 msgr2=0x7f844c0badc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:51.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f8450e99700 1 --2- 172.21.15.79:0/3162081352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f844c0ae420 0x7f844c0badc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f8450e99700 1 -- 172.21.15.79:0/3162081352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f844c0a8d10 msgr2=0x7f844c0a9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:51.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f8450e99700 1 --2- 172.21.15.79:0/3162081352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f844c0a8d10 0x7f844c0a9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f8450e99700 1 -- 172.21.15.79:0/3162081352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c0ab870 con 0x7f844c0a9790 2021-04-09T18:35:51.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f8450e99700 1 --2- 172.21.15.79:0/3162081352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844c0a9790 0x7f844c0d45b0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f844c0c0d60 tx=0x7f844400c540).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:51.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f8448ff9700 1 -- 172.21.15.79:0/3162081352 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f844c0ab870 con 0x7f844c0a9790 2021-04-09T18:35:51.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f8448ff9700 1 -- 172.21.15.79:0/3162081352 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844400ce10 con 0x7f844c0a9790 2021-04-09T18:35:51.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f84528f4700 1 -- 172.21.15.79:0/3162081352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f844c0d4be0 con 0x7f844c0a9790 2021-04-09T18:35:51.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f8448ff9700 1 -- 172.21.15.79:0/3162081352 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f844400f040 con 0x7f844c0a9790 2021-04-09T18:35:51.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.058 7f84528f4700 1 -- 172.21.15.79:0/3162081352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844c0d50c0 con 0x7f844c0a9790 2021-04-09T18:35:51.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.062 7f8448ff9700 1 -- 172.21.15.79:0/3162081352 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8444022060 con 0x7f844c0a9790 2021-04-09T18:35:51.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.062 7f8448ff9700 1 --2- 172.21.15.79:0/3162081352 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8430029100 0x7f843002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:51.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.062 7f8448ff9700 1 -- 172.21.15.79:0/3162081352 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6096+0+0 (secure 0 0 0) 0x7f8444010040 con 0x7f844c0a9790 2021-04-09T18:35:51.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.062 7f844bfff700 1 --2- 172.21.15.79:0/3162081352 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8430029100 0x7f843002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:51.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.062 7f84528f4700 1 -- 172.21.15.79:0/3162081352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f844c0e39d0 con 0x7f844c0a9790 2021-04-09T18:35:51.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.062 7f844bfff700 1 --2- 172.21.15.79:0/3162081352 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8430029100 0x7f843002b650 crc :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:51.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.066 7f8448ff9700 1 -- 172.21.15.79:0/3162081352 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f844400cc00 con 0x7f844c0a9790 2021-04-09T18:35:51.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.234 7f84528f4700 1 -- 172.21.15.79:0/3162081352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f844c0f5b10 con 0x7f844c0a9790 2021-04-09T18:35:51.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.234 7f8448ff9700 1 -- 172.21.15.79:0/3162081352 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+1761 (secure 0 0 0) 0x7f844c0f76b0 con 0x7f844c0a9790 2021-04-09T18:35:51.241 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 87 2021-04-09T18:35:51.242 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:51.242 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":87,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8175,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6833/2663381192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2663381192},{"type":"v1","addr":"172.21.15.79:6833","nonce":2663381192}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":87,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:35:39.593350","modified":"2021-04-09 18:35:50.876755","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":136,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-04-09T18:35:51.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.238 7f84528f4700 1 -- 172.21.15.79:0/3162081352 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8430029100 msgr2=0x7f843002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:51.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.238 7f84528f4700 1 --2- 172.21.15.79:0/3162081352 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8430029100 0x7f843002b650 crc :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.238 7f84528f4700 1 -- 172.21.15.79:0/3162081352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844c0a9790 msgr2=0x7f844c0d45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:51.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.238 7f84528f4700 1 --2- 172.21.15.79:0/3162081352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844c0a9790 0x7f844c0d45b0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f844c0c0d60 tx=0x7f844400c540).stop 2021-04-09T18:35:51.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.238 7f84528f4700 1 -- 172.21.15.79:0/3162081352 shutdown_connections 2021-04-09T18:35:51.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.238 7f84528f4700 1 --2- 172.21.15.79:0/3162081352 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f8430029100 0x7f843002b650 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.245 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.238 7f84528f4700 1 --2- 172.21.15.79:0/3162081352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f844c0a9790 0x7f844c0d45b0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.238 7f84528f4700 1 --2- 172.21.15.79:0/3162081352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f844c0ae420 0x7f844c0badc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.238 7f84528f4700 1 --2- 172.21.15.79:0/3162081352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f844c0a8d10 0x7f844c0a9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.238 7f84528f4700 1 -- 172.21.15.79:0/3162081352 >> 172.21.15.79:0/3162081352 conn(0x7f844c09b1d0 msgr2=0x7f844c0af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:51.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.238 7f84528f4700 1 -- 172.21.15.79:0/3162081352 shutdown_connections 2021-04-09T18:35:51.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.238 7f84528f4700 1 -- 172.21.15.79:0/3162081352 wait complete. 2021-04-09T18:35:51.253 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-04-09T18:35:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.342 7f7e601ee700 1 Processor -- start 2021-04-09T18:35:51.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.342 7f7e601ee700 1 -- start start 2021-04-09T18:35:51.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.342 7f7e601ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e580f5520 0x7f7e580f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:51.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.342 7f7e601ee700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7e581c8010 0x7f7e581ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:51.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.342 7f7e601ee700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e580fbb20 con 0x7f7e580e9ae0 2021-04-09T18:35:51.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.342 7f7e601ee700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e580e9f30 con 0x7f7e581c8010 2021-04-09T18:35:51.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.342 7f7e601ee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e581c3dc0 con 0x7f7e580f5520 2021-04-09T18:35:51.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e5e793700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7e581c8010 0x7f7e581ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:51.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e5df92700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e580f5520 0x7f7e580f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:51.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e5e793700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7e581c8010 0x7f7e581ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:52448/0 (socket says 172.21.15.79:52448) 2021-04-09T18:35:51.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e5e793700 1 -- 172.21.15.79:0/315712422 learned_addr learned my addr 172.21.15.79:0/315712422 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:51.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e5d791700 1 --1- 172.21.15.79:0/315712422 >> v1:172.21.15.89:6789/0 conn(0x7f7e580e9ae0 0x7f7e5809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:59284/0 (socket says 172.21.15.79:59284) 2021-04-09T18:35:51.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e5e793700 1 -- 172.21.15.79:0/315712422 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e580f5520 msgr2=0x7f7e580f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:51.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e5e793700 1 --2- 172.21.15.79:0/315712422 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e580f5520 0x7f7e580f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e5cf90700 1 -- 172.21.15.79:0/315712422 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808669273 0 0) 0x7f7e480010d0 con 0x7f7e580e9ae0 2021-04-09T18:35:51.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e5e793700 1 -- 172.21.15.79:0/315712422 >> v1:172.21.15.89:6789/0 conn(0x7f7e580e9ae0 legacy=0x7f7e5809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:51.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e5e793700 1 -- 172.21.15.79:0/315712422 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5809f910 con 0x7f7e581c8010 2021-04-09T18:35:51.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e5df92700 1 --2- 172.21.15.79:0/315712422 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e580f5520 0x7f7e580f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:51.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e5e793700 1 --2- 172.21.15.79:0/315712422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e581c8010 0x7f7e581ca470 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f7e500032b0 tx=0x7f7e5000b3c0).ready entity=mon.1 client_cookie=aff4eddbb286d5a0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:51.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e5cf90700 1 -- 172.21.15.79:0/315712422 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7e5809f910 con 0x7f7e581c8010 2021-04-09T18:35:51.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e5cf90700 1 -- 172.21.15.79:0/315712422 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5000bc20 con 0x7f7e581c8010 2021-04-09T18:35:51.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e5cf90700 1 -- 172.21.15.79:0/315712422 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7e50002020 con 0x7f7e581c8010 2021-04-09T18:35:51.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e601ee700 1 -- 172.21.15.79:0/315712422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e581c8010 msgr2=0x7f7e581ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:51.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e601ee700 1 --2- 172.21.15.79:0/315712422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e581c8010 0x7f7e581ca470 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f7e500032b0 tx=0x7f7e5000b3c0).stop 2021-04-09T18:35:51.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e601ee700 1 -- 172.21.15.79:0/315712422 shutdown_connections 2021-04-09T18:35:51.366 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e601ee700 1 --2- 172.21.15.79:0/315712422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e581c8010 0x7f7e581ca470 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e601ee700 1 --2- 172.21.15.79:0/315712422 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e580f5520 0x7f7e580f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e601ee700 1 -- 172.21.15.79:0/315712422 >> 172.21.15.79:0/315712422 conn(0x7f7e580e5fe0 msgr2=0x7f7e580e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:51.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e601ee700 1 -- 172.21.15.79:0/315712422 shutdown_connections 2021-04-09T18:35:51.367 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.346 7f7e601ee700 1 -- 172.21.15.79:0/315712422 wait complete. 2021-04-09T18:35:51.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.350 7f7e601ee700 1 Processor -- start 2021-04-09T18:35:51.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.350 7f7e601ee700 1 -- start start 2021-04-09T18:35:51.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.350 7f7e601ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e580cf830 0x7f7e580cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:51.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.350 7f7e601ee700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e581a8480 0x7f7e581a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:51.368 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.350 7f7e601ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e580acdd0 0x7f7e580ad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:51.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.350 7f7e601ee700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5809acf0 con 0x7f7e580cf830 2021-04-09T18:35:51.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.350 7f7e601ee700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5809a4c0 con 0x7f7e581a8480 2021-04-09T18:35:51.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.350 7f7e601ee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e581a8f00 con 0x7f7e580acdd0 2021-04-09T18:35:51.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.350 7f7e5df92700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e580cf830 0x7f7e580cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:51.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.350 7f7e5df92700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e580cf830 0x7f7e580cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35880/0 (socket says 172.21.15.79:35880) 2021-04-09T18:35:51.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.350 7f7e5df92700 1 -- 172.21.15.79:0/1648858972 learned_addr learned my addr 172.21.15.79:0/1648858972 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:51.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.350 7f7e5e793700 1 --2- 172.21.15.79:0/1648858972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e580acdd0 0x7f7e580ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:51.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.350 7f7e5d791700 1 --2- 172.21.15.79:0/1648858972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e581a8480 0x7f7e581a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:51.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.350 7f7e5df92700 1 -- 172.21.15.79:0/1648858972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e580acdd0 msgr2=0x7f7e580ad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:51.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.350 7f7e5df92700 1 --2- 172.21.15.79:0/1648858972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e580acdd0 0x7f7e580ad220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.350 7f7e5df92700 1 -- 172.21.15.79:0/1648858972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e581a8480 msgr2=0x7f7e581a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:51.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.350 7f7e5df92700 1 --2- 172.21.15.79:0/1648858972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e581a8480 0x7f7e581a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.350 7f7e5df92700 1 -- 172.21.15.79:0/1648858972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e580ad850 con 0x7f7e580cf830 2021-04-09T18:35:51.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.354 7f7e5df92700 1 --2- 172.21.15.79:0/1648858972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e580cf830 0x7f7e580cfc80 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f7e5400b140 tx=0x7f7e5400c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:51.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.354 7f7e4e7fc700 1 -- 172.21.15.79:0/1648858972 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7e580ad850 con 0x7f7e580cf830 2021-04-09T18:35:51.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.354 7f7e4e7fc700 1 -- 172.21.15.79:0/1648858972 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e540123f0 con 0x7f7e580cf830 2021-04-09T18:35:51.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.354 7f7e601ee700 1 -- 172.21.15.79:0/1648858972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5809aff0 con 0x7f7e580cf830 2021-04-09T18:35:51.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.354 7f7e4e7fc700 1 -- 172.21.15.79:0/1648858972 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7e5400f040 con 0x7f7e580cf830 2021-04-09T18:35:51.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.354 7f7e601ee700 1 -- 172.21.15.79:0/1648858972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5808f9f0 con 0x7f7e580cf830 2021-04-09T18:35:51.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.354 7f7e4e7fc700 1 -- 172.21.15.79:0/1648858972 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7e54011070 con 0x7f7e580cf830 2021-04-09T18:35:51.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.354 7f7e4e7fc700 1 --2- 172.21.15.79:0/1648858972 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7e40029100 0x7f7e4002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:51.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.354 7f7e4e7fc700 1 -- 172.21.15.79:0/1648858972 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6096+0+0 (secure 0 0 0) 0x7f7e54010040 con 0x7f7e580cf830 2021-04-09T18:35:51.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.354 7f7e5d791700 1 --2- 172.21.15.79:0/1648858972 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7e40029100 0x7f7e4002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:51.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.354 7f7e5d791700 1 --2- 172.21.15.79:0/1648858972 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7e40029100 0x7f7e4002b650 crc :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:51.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.358 7f7e601ee700 1 -- 172.21.15.79:0/1648858972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e580e39e0 con 0x7f7e580cf830 2021-04-09T18:35:51.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.362 7f7e4e7fc700 1 -- 172.21.15.79:0/1648858972 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7e54000bf0 con 0x7f7e580cf830 2021-04-09T18:35:51.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.526 7f7e601ee700 1 -- 172.21.15.79:0/1648858972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7e580f5b20 con 0x7f7e580cf830 2021-04-09T18:35:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.882 7f7e4e7fc700 1 -- 172.21.15.79:0/1648858972 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v88) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7e5400ca90 con 0x7f7e580cf830 2021-04-09T18:35:51.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.898 7f7e601ee700 1 -- 172.21.15.79:0/1648858972 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7e40029100 msgr2=0x7f7e4002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:51.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.898 7f7e601ee700 1 --2- 172.21.15.79:0/1648858972 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7e40029100 0x7f7e4002b650 crc :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.898 7f7e601ee700 1 -- 172.21.15.79:0/1648858972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e580cf830 msgr2=0x7f7e580cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:51.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.898 7f7e601ee700 1 --2- 172.21.15.79:0/1648858972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e580cf830 0x7f7e580cfc80 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f7e5400b140 tx=0x7f7e5400c430).stop 2021-04-09T18:35:51.904 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.898 7f7e601ee700 1 -- 172.21.15.79:0/1648858972 shutdown_connections 2021-04-09T18:35:51.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.898 7f7e601ee700 1 --2- 172.21.15.79:0/1648858972 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7e40029100 0x7f7e4002b650 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.898 7f7e601ee700 1 --2- 172.21.15.79:0/1648858972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e580acdd0 0x7f7e580ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.898 7f7e601ee700 1 --2- 172.21.15.79:0/1648858972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e580cf830 0x7f7e580cfc80 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.905 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.898 7f7e601ee700 1 --2- 172.21.15.79:0/1648858972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e581a8480 0x7f7e581a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:51.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.898 7f7e601ee700 1 -- 172.21.15.79:0/1648858972 >> 172.21.15.79:0/1648858972 conn(0x7f7e58093f70 msgr2=0x7f7e580ba880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:51.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.898 7f7e601ee700 1 -- 172.21.15.79:0/1648858972 shutdown_connections 2021-04-09T18:35:51.906 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:51.898 7f7e601ee700 1 -- 172.21.15.79:0/1648858972 wait complete. 2021-04-09T18:35:51.922 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-04-09T18:35:52.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d1c5ac700 1 Processor -- start 2021-04-09T18:35:52.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d1c5ac700 1 -- start start 2021-04-09T18:35:52.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d1c5ac700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d140f5550 0x7f9d140f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:52.042 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d1c5ac700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9d140e9b10 0x7f9d1409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:52.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d1c5ac700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d140fbb50 con 0x7f9d141c2de0 2021-04-09T18:35:52.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d1c5ac700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d140e9f60 con 0x7f9d140e9b10 2021-04-09T18:35:52.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d1c5ac700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140e5a00 con 0x7f9d140f5550 2021-04-09T18:35:52.043 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d1ab51700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9d141c2de0 0x7f9d141c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58828/0 (socket says 172.21.15.79:58828) 2021-04-09T18:35:52.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d1ab51700 1 -- 172.21.15.79:0/3935507751 learned_addr learned my addr 172.21.15.79:0/3935507751 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:52.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d19b4f700 1 --2- 172.21.15.79:0/3935507751 >> v2:172.21.15.79:3300/0 conn(0x7f9d140e9b10 0x7f9d1409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:52.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d1a350700 1 --2- 172.21.15.79:0/3935507751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d140f5550 0x7f9d140f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:52.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d19b4f700 1 -- 172.21.15.79:0/3935507751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d140f5550 msgr2=0x7f9d140f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:52.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d19b4f700 1 --2- 172.21.15.79:0/3935507751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d140f5550 0x7f9d140f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:52.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d19b4f700 1 -- 172.21.15.79:0/3935507751 >> v1:172.21.15.79:6789/0 conn(0x7f9d141c2de0 legacy=0x7f9d141c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:52.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d19b4f700 1 -- 172.21.15.79:0/3935507751 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d140e5700 con 0x7f9d140e9b10 2021-04-09T18:35:52.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d1934e700 1 -- 172.21.15.79:0/3935507751 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281628862 0 0) 0x7f9d0c001450 con 0x7f9d141c2de0 2021-04-09T18:35:52.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d19b4f700 1 --2- 172.21.15.79:0/3935507751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d140e9b10 0x7f9d1409f110 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f9d08002f30 tx=0x7f9d0800bd40).ready entity=mon.0 client_cookie=13fef057bcaed79a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:52.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d1934e700 1 -- 172.21.15.79:0/3935507751 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d140e5700 con 0x7f9d140e9b10 2021-04-09T18:35:52.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d1934e700 1 -- 172.21.15.79:0/3935507751 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d08009850 con 0x7f9d140e9b10 2021-04-09T18:35:52.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d1934e700 1 -- 172.21.15.79:0/3935507751 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d08009c20 con 0x7f9d140e9b10 2021-04-09T18:35:52.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d1c5ac700 1 -- 172.21.15.79:0/3935507751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d140e9b10 msgr2=0x7f9d1409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:52.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.026 7f9d1c5ac700 1 --2- 172.21.15.79:0/3935507751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d140e9b10 0x7f9d1409f110 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f9d08002f30 tx=0x7f9d0800bd40).stop 2021-04-09T18:35:52.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.030 7f9d1c5ac700 1 -- 172.21.15.79:0/3935507751 shutdown_connections 2021-04-09T18:35:52.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.030 7f9d1c5ac700 1 --2- 172.21.15.79:0/3935507751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d140f5550 0x7f9d140f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:52.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.030 7f9d1c5ac700 1 --2- 172.21.15.79:0/3935507751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d140e9b10 0x7f9d1409f110 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:52.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.030 7f9d1c5ac700 1 -- 172.21.15.79:0/3935507751 >> 172.21.15.79:0/3935507751 conn(0x7f9d140e6010 msgr2=0x7f9d140e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:52.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.030 7f9d1c5ac700 1 -- 172.21.15.79:0/3935507751 shutdown_connections 2021-04-09T18:35:52.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.030 7f9d1c5ac700 1 -- 172.21.15.79:0/3935507751 wait complete. 2021-04-09T18:35:52.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.030 7f9d1c5ac700 1 Processor -- start 2021-04-09T18:35:52.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.030 7f9d1c5ac700 1 -- start start 2021-04-09T18:35:52.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.030 7f9d1c5ac700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d140adc70 0x7f9d140ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:52.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.030 7f9d1c5ac700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d140d0ec0 0x7f9d140d1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:52.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.030 7f9d1c5ac700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d140d4b60 0x7f9d140d4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:52.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.030 7f9d1c5ac700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140aaf90 con 0x7f9d140adc70 2021-04-09T18:35:52.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.030 7f9d1c5ac700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140ab290 con 0x7f9d140d0ec0 2021-04-09T18:35:52.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.030 7f9d1c5ac700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140aa720 con 0x7f9d140d4b60 2021-04-09T18:35:52.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.034 7f9d1a350700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d140adc70 0x7f9d140ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:52.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.034 7f9d1a350700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d140adc70 0x7f9d140ae0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35890/0 (socket says 172.21.15.79:35890) 2021-04-09T18:35:52.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.034 7f9d1a350700 1 -- 172.21.15.79:0/4093465349 learned_addr learned my addr 172.21.15.79:0/4093465349 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:52.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.034 7f9d1ab51700 1 --2- 172.21.15.79:0/4093465349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d140d4b60 0x7f9d140d4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:52.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.034 7f9d19b4f700 1 --2- 172.21.15.79:0/4093465349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d140d0ec0 0x7f9d140d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:52.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.034 7f9d1ab51700 1 -- 172.21.15.79:0/4093465349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d140d0ec0 msgr2=0x7f9d140d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:52.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.034 7f9d1ab51700 1 --2- 172.21.15.79:0/4093465349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d140d0ec0 0x7f9d140d1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:52.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.034 7f9d1ab51700 1 -- 172.21.15.79:0/4093465349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d140adc70 msgr2=0x7f9d140ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:52.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.034 7f9d1ab51700 1 --2- 172.21.15.79:0/4093465349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d140adc70 0x7f9d140ae0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:52.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.034 7f9d1ab51700 1 -- 172.21.15.79:0/4093465349 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d140aab20 con 0x7f9d140d4b60 2021-04-09T18:35:52.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.034 7f9d1ab51700 1 --2- 172.21.15.79:0/4093465349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d140d4b60 0x7f9d140d4fb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f9d140baaf0 tx=0x7f9d0c00ce00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:52.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.034 7f9d06ffd700 1 -- 172.21.15.79:0/4093465349 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d140aab20 con 0x7f9d140d4b60 2021-04-09T18:35:52.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.034 7f9d06ffd700 1 -- 172.21.15.79:0/4093465349 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c005b80 con 0x7f9d140d4b60 2021-04-09T18:35:52.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.034 7f9d1c5ac700 1 -- 172.21.15.79:0/4093465349 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d140d55e0 con 0x7f9d140d4b60 2021-04-09T18:35:52.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.034 7f9d06ffd700 1 -- 172.21.15.79:0/4093465349 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d0c007110 con 0x7f9d140d4b60 2021-04-09T18:35:52.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.034 7f9d1c5ac700 1 -- 172.21.15.79:0/4093465349 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d140ac830 con 0x7f9d140d4b60 2021-04-09T18:35:52.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.034 7f9d06ffd700 1 -- 172.21.15.79:0/4093465349 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9d0c01a020 con 0x7f9d140d4b60 2021-04-09T18:35:52.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.034 7f9d06ffd700 1 --2- 172.21.15.79:0/4093465349 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9cfc029100 0x7f9cfc02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:52.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.034 7f9d06ffd700 1 -- 172.21.15.79:0/4093465349 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6096+0+0 (secure 0 0 0) 0x7f9d0c0394f0 con 0x7f9d140d4b60 2021-04-09T18:35:52.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.038 7f9d1a350700 1 --2- 172.21.15.79:0/4093465349 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9cfc029100 0x7f9cfc02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:52.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.038 7f9d1a350700 1 --2- 172.21.15.79:0/4093465349 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9cfc029100 0x7f9cfc02b650 crc :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:52.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.042 7f9d1c5ac700 1 -- 172.21.15.79:0/4093465349 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d140e39f0 con 0x7f9d140d4b60 2021-04-09T18:35:52.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.050 7f9d06ffd700 1 -- 172.21.15.79:0/4093465349 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9d0c005970 con 0x7f9d140d4b60 2021-04-09T18:35:52.222 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.214 7f9d1c5ac700 1 -- 172.21.15.79:0/4093465349 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9d140f5b50 con 0x7f9d140d4b60 2021-04-09T18:35:52.907 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.902 7f9d06ffd700 1 -- 172.21.15.79:0/4093465349 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v137) v1 ==== 185+0+0 (secure 0 0 0) 0x7f9d0c000f70 con 0x7f9d140d4b60 2021-04-09T18:35:52.937 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2021-04-09T18:35:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.934 7f9d1c5ac700 1 -- 172.21.15.79:0/4093465349 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9cfc029100 msgr2=0x7f9cfc02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.934 7f9d1c5ac700 1 --2- 172.21.15.79:0/4093465349 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9cfc029100 0x7f9cfc02b650 crc :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.934 7f9d1c5ac700 1 -- 172.21.15.79:0/4093465349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d140d4b60 msgr2=0x7f9d140d4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.934 7f9d1c5ac700 1 --2- 172.21.15.79:0/4093465349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d140d4b60 0x7f9d140d4fb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f9d140baaf0 tx=0x7f9d0c00ce00).stop 2021-04-09T18:35:52.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.934 7f9d1c5ac700 1 -- 172.21.15.79:0/4093465349 shutdown_connections 2021-04-09T18:35:52.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.934 7f9d1c5ac700 1 --2- 172.21.15.79:0/4093465349 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f9cfc029100 0x7f9cfc02b650 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:52.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.934 7f9d1c5ac700 1 --2- 172.21.15.79:0/4093465349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d140d4b60 0x7f9d140d4fb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:52.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.934 7f9d1c5ac700 1 --2- 172.21.15.79:0/4093465349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d140adc70 0x7f9d140ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:52.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.934 7f9d1c5ac700 1 --2- 172.21.15.79:0/4093465349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d140d0ec0 0x7f9d140d1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:52.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.934 7f9d1c5ac700 1 -- 172.21.15.79:0/4093465349 >> 172.21.15.79:0/4093465349 conn(0x7f9d140d8b80 msgr2=0x7f9d140b9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:52.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.934 7f9d1c5ac700 1 -- 172.21.15.79:0/4093465349 shutdown_connections 2021-04-09T18:35:52.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:52.934 7f9d1c5ac700 1 -- 172.21.15.79:0/4093465349 wait complete. 2021-04-09T18:35:52.955 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-04-09T18:35:53.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.058 7f00df418700 1 Processor -- start 2021-04-09T18:35:53.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.058 7f00df418700 1 -- start start 2021-04-09T18:35:53.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.058 7f00df418700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f00d81c9050 0x7f00d81cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:53.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.058 7f00df418700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d80fbb50 con 0x7f00d80e9b10 2021-04-09T18:35:53.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.058 7f00df418700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d809f910 con 0x7f00d80f5550 2021-04-09T18:35:53.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.058 7f00df418700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d81c3df0 con 0x7f00d81c9050 2021-04-09T18:35:53.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.058 7f00dc9bb700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f00d80e9b10 0x7f00d809f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58840/0 (socket says 172.21.15.79:58840) 2021-04-09T18:35:53.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.058 7f00dc9bb700 1 -- 172.21.15.79:0/2664762115 learned_addr learned my addr 172.21.15.79:0/2664762115 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:53.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.058 7f00dd9bd700 1 --2- 172.21.15.79:0/2664762115 >> v2:172.21.15.89:3300/0 conn(0x7f00d81c9050 0x7f00d81cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:53.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.058 7f00cffff700 1 -- 172.21.15.79:0/2664762115 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3562180068 0 0) 0x7f00c80010d0 con 0x7f00d80e9b10 2021-04-09T18:35:53.073 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.058 7f00cffff700 1 -- 172.21.15.79:0/2664762115 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00c4003240 con 0x7f00d80e9b10 2021-04-09T18:35:53.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.058 7f00dd9bd700 1 -- 172.21.15.79:0/2664762115 >> v1:172.21.15.89:6789/0 conn(0x7f00d80f5550 legacy=0x7f00d80f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:53.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.058 7f00dd9bd700 1 -- 172.21.15.79:0/2664762115 >> v1:172.21.15.79:6789/0 conn(0x7f00d80e9b10 legacy=0x7f00d809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:53.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.058 7f00dd9bd700 1 -- 172.21.15.79:0/2664762115 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d80e5700 con 0x7f00d81c9050 2021-04-09T18:35:53.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.058 7f00dd9bd700 1 --2- 172.21.15.79:0/2664762115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00d81c9050 0x7f00d81cb4b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f00d00032b0 tx=0x7f00d000b0e0).ready entity=mon.1 client_cookie=28b636b102a90f39 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:53.074 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.062 7f00cffff700 1 -- 172.21.15.79:0/2664762115 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f00d80e5700 con 0x7f00d81c9050 2021-04-09T18:35:53.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.062 7f00cffff700 1 -- 172.21.15.79:0/2664762115 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d000bab0 con 0x7f00d81c9050 2021-04-09T18:35:53.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.062 7f00cffff700 1 -- 172.21.15.79:0/2664762115 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f00d0002020 con 0x7f00d81c9050 2021-04-09T18:35:53.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.062 7f00df418700 1 -- 172.21.15.79:0/2664762115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00d81c9050 msgr2=0x7f00d81cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:53.075 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.062 7f00df418700 1 --2- 172.21.15.79:0/2664762115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00d81c9050 0x7f00d81cb4b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f00d00032b0 tx=0x7f00d000b0e0).stop 2021-04-09T18:35:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.062 7f00df418700 1 -- 172.21.15.79:0/2664762115 shutdown_connections 2021-04-09T18:35:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.062 7f00df418700 1 --2- 172.21.15.79:0/2664762115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00d81c9050 0x7f00d81cb4b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.062 7f00df418700 1 -- 172.21.15.79:0/2664762115 >> 172.21.15.79:0/2664762115 conn(0x7f00d80e6010 msgr2=0x7f00d80e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.062 7f00df418700 1 -- 172.21.15.79:0/2664762115 shutdown_connections 2021-04-09T18:35:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.062 7f00df418700 1 -- 172.21.15.79:0/2664762115 wait complete. 2021-04-09T18:35:53.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00df418700 1 Processor -- start 2021-04-09T18:35:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00df418700 1 -- start start 2021-04-09T18:35:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00df418700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00d80b0320 0x7f00d80af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00df418700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00d81aaee0 0x7f00d81ab330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00df418700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00d80d4cf0 0x7f00d80d5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:53.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00df418700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d80e9f60 con 0x7f00d80b0320 2021-04-09T18:35:53.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00df418700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d819ba10 con 0x7f00d81aaee0 2021-04-09T18:35:53.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00df418700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d819c010 con 0x7f00d80d4cf0 2021-04-09T18:35:53.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00dd1bc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00d80b0320 0x7f00d80af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00dd1bc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00d80b0320 0x7f00d80af9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35904/0 (socket says 172.21.15.79:35904) 2021-04-09T18:35:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00dd1bc700 1 -- 172.21.15.79:0/1979206751 learned_addr learned my addr 172.21.15.79:0/1979206751 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00dc9bb700 1 --2- 172.21.15.79:0/1979206751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00d81aaee0 0x7f00d81ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00dd9bd700 1 --2- 172.21.15.79:0/1979206751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00d80d4cf0 0x7f00d80d5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00dd9bd700 1 -- 172.21.15.79:0/1979206751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00d81aaee0 msgr2=0x7f00d81ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:53.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00dd9bd700 1 --2- 172.21.15.79:0/1979206751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00d81aaee0 0x7f00d81ab330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:53.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00dd9bd700 1 -- 172.21.15.79:0/1979206751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00d80b0320 msgr2=0x7f00d80af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:53.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00dd9bd700 1 --2- 172.21.15.79:0/1979206751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00d80b0320 0x7f00d80af9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:53.083 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00dd9bd700 1 -- 172.21.15.79:0/1979206751 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d80b0770 con 0x7f00d80d4cf0 2021-04-09T18:35:53.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00dd1bc700 1 --2- 172.21.15.79:0/1979206751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00d80b0320 0x7f00d80af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:53.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00dc9bb700 1 --2- 172.21.15.79:0/1979206751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00d81aaee0 0x7f00d81ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:53.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00dd9bd700 1 --2- 172.21.15.79:0/1979206751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00d80d4cf0 0x7f00d80d5140 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f00d819bc90 tx=0x7f00d0006c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:53.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00cdffb700 1 -- 172.21.15.79:0/1979206751 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f00d80b0770 con 0x7f00d80d4cf0 2021-04-09T18:35:53.084 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00cdffb700 1 -- 172.21.15.79:0/1979206751 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d001b5e0 con 0x7f00d80d4cf0 2021-04-09T18:35:53.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00df418700 1 -- 172.21.15.79:0/1979206751 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d80afff0 con 0x7f00d80d4cf0 2021-04-09T18:35:53.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00cdffb700 1 -- 172.21.15.79:0/1979206751 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f00d0017040 con 0x7f00d80d4cf0 2021-04-09T18:35:53.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.066 7f00df418700 1 -- 172.21.15.79:0/1979206751 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d80d5770 con 0x7f00d80d4cf0 2021-04-09T18:35:53.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.070 7f00cdffb700 1 -- 172.21.15.79:0/1979206751 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f00d001b9b0 con 0x7f00d80d4cf0 2021-04-09T18:35:53.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.070 7f00cdffb700 1 --2- 172.21.15.79:0/1979206751 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f00b8029100 0x7f00b802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:53.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.070 7f00cdffb700 1 -- 172.21.15.79:0/1979206751 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5658+0+0 (secure 0 0 0) 0x7f00d0018030 con 0x7f00d80d4cf0 2021-04-09T18:35:53.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.070 7f00dd1bc700 1 --2- 172.21.15.79:0/1979206751 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f00b8029100 0x7f00b802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:53.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.070 7f00dd1bc700 1 --2- 172.21.15.79:0/1979206751 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f00b8029100 0x7f00b802b650 crc :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:53.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.074 7f00df418700 1 -- 172.21.15.79:0/1979206751 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d80e39f0 con 0x7f00d80d4cf0 2021-04-09T18:35:53.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.082 7f00cdffb700 1 -- 172.21.15.79:0/1979206751 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f00d000b8a0 con 0x7f00d80d4cf0 2021-04-09T18:35:53.256 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.250 7f00df418700 1 -- 172.21.15.79:0/1979206751 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f00d80a1c90 con 0x7f00d80d4cf0 2021-04-09T18:35:53.911 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.906 7f00cdffb700 1 -- 172.21.15.79:0/1979206751 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v138) v1 ==== 173+0+0 (secure 0 0 0) 0x7f00d001b3d0 con 0x7f00d80d4cf0 2021-04-09T18:35:53.921 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2021-04-09T18:35:53.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.918 7f00df418700 1 -- 172.21.15.79:0/1979206751 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f00b8029100 msgr2=0x7f00b802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:53.926 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.918 7f00df418700 1 --2- 172.21.15.79:0/1979206751 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f00b8029100 0x7f00b802b650 crc :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:53.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.918 7f00df418700 1 -- 172.21.15.79:0/1979206751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00d80d4cf0 msgr2=0x7f00d80d5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:53.927 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.918 7f00df418700 1 --2- 172.21.15.79:0/1979206751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00d80d4cf0 0x7f00d80d5140 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f00d819bc90 tx=0x7f00d0006c10).stop 2021-04-09T18:35:53.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.918 7f00df418700 1 -- 172.21.15.79:0/1979206751 shutdown_connections 2021-04-09T18:35:53.928 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.918 7f00df418700 1 --2- 172.21.15.79:0/1979206751 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f00b8029100 0x7f00b802b650 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:53.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.918 7f00df418700 1 --2- 172.21.15.79:0/1979206751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00d80d4cf0 0x7f00d80d5140 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:53.929 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.918 7f00df418700 1 --2- 172.21.15.79:0/1979206751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00d80b0320 0x7f00d80af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:53.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.918 7f00df418700 1 --2- 172.21.15.79:0/1979206751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00d81aaee0 0x7f00d81ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:53.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.918 7f00df418700 1 -- 172.21.15.79:0/1979206751 >> 172.21.15.79:0/1979206751 conn(0x7f00d80ba880 msgr2=0x7f00d809a540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:53.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.918 7f00df418700 1 -- 172.21.15.79:0/1979206751 shutdown_connections 2021-04-09T18:35:53.930 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:53.918 7f00df418700 1 -- 172.21.15.79:0/1979206751 wait complete. 2021-04-09T18:35:53.938 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-04-09T18:35:54.044 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.026 7f16c49b1700 1 Processor -- start 2021-04-09T18:35:54.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.026 7f16c49b1700 1 -- start start 2021-04-09T18:35:54.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.026 7f16c49b1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16c00f5520 0x7f16c00f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:54.045 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.026 7f16c49b1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c00fbb20 con 0x7f16c00e9ae0 2021-04-09T18:35:54.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.026 7f16c49b1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c009f910 con 0x7f16c01c8010 2021-04-09T18:35:54.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.026 7f16c49b1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c00e9f30 con 0x7f16c00f5520 2021-04-09T18:35:54.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.026 7f16bdda3700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f16c00e9ae0 0x7f16c009f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58856/0 (socket says 172.21.15.79:58856) 2021-04-09T18:35:54.046 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.026 7f16bdda3700 1 -- 172.21.15.79:0/2546411810 learned_addr learned my addr 172.21.15.79:0/2546411810 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:54.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16be5a4700 1 --2- 172.21.15.79:0/2546411810 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16c00f5520 0x7f16c00f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:54.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bd5a2700 1 -- 172.21.15.79:0/2546411810 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228679080 0 0) 0x7f16a80010d0 con 0x7f16c00e9ae0 2021-04-09T18:35:54.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bd5a2700 1 -- 172.21.15.79:0/2546411810 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16ac003240 con 0x7f16c00e9ae0 2021-04-09T18:35:54.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bd5a2700 1 -- 172.21.15.79:0/2546411810 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313397071 0 0) 0x7f16b80010d0 con 0x7f16c01c8010 2021-04-09T18:35:54.047 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bd5a2700 1 -- 172.21.15.79:0/2546411810 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16ac003620 con 0x7f16c01c8010 2021-04-09T18:35:54.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bd5a2700 1 -- 172.21.15.79:0/2546411810 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 164370886 0 0) 0x7f16a8001650 con 0x7f16c00e9ae0 2021-04-09T18:35:54.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bd5a2700 1 -- 172.21.15.79:0/2546411810 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16c00f5520 msgr2=0x7f16c00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:54.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bd5a2700 1 --2- 172.21.15.79:0/2546411810 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16c00f5520 0x7f16c00f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.048 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bd5a2700 1 -- 172.21.15.79:0/2546411810 >> v1:172.21.15.89:6789/0 conn(0x7f16c01c8010 legacy=0x7f16c01ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:54.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bd5a2700 1 -- 172.21.15.79:0/2546411810 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c00e56d0 con 0x7f16c00e9ae0 2021-04-09T18:35:54.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bd5a2700 1 -- 172.21.15.79:0/2546411810 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f16a8001bb0 con 0x7f16c00e9ae0 2021-04-09T18:35:54.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bd5a2700 1 -- 172.21.15.79:0/2546411810 >> v1:172.21.15.79:6789/0 conn(0x7f16c00e9ae0 legacy=0x7f16c009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:54.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bd5a2700 1 --2- 172.21.15.79:0/2546411810 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16ac003d40 0x7f16ac0045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:54.049 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bd5a2700 1 --2- 172.21.15.79:0/2546411810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16ac004bd0 0x7f16ac0097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:54.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bd5a2700 1 --2- 172.21.15.79:0/2546411810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16ac005020 0x7f16ac00be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:54.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bd5a2700 1 -- 172.21.15.79:0/2546411810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c00e9f30 con 0x7f16ac005020 2021-04-09T18:35:54.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bd5a2700 1 -- 172.21.15.79:0/2546411810 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac050460 con 0x7f16ac004bd0 2021-04-09T18:35:54.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bd5a2700 1 -- 172.21.15.79:0/2546411810 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac050610 con 0x7f16ac003d40 2021-04-09T18:35:54.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16be5a4700 1 --2- 172.21.15.79:0/2546411810 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16ac003d40 0x7f16ac0045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:54.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16beda5700 1 --2- 172.21.15.79:0/2546411810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16ac005020 0x7f16ac00be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:54.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bdda3700 1 --2- 172.21.15.79:0/2546411810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16ac004bd0 0x7f16ac0097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:54.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16beda5700 1 -- 172.21.15.79:0/2546411810 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16ac003d40 msgr2=0x7f16ac0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:54.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16beda5700 1 --2- 172.21.15.79:0/2546411810 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16ac003d40 0x7f16ac0045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16beda5700 1 -- 172.21.15.79:0/2546411810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16ac004bd0 msgr2=0x7f16ac0097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:54.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16beda5700 1 --2- 172.21.15.79:0/2546411810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16ac004bd0 0x7f16ac0097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16beda5700 1 -- 172.21.15.79:0/2546411810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac0508d0 con 0x7f16ac005020 2021-04-09T18:35:54.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16be5a4700 1 --2- 172.21.15.79:0/2546411810 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16ac003d40 0x7f16ac0045a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:54.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16beda5700 1 --2- 172.21.15.79:0/2546411810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16ac005020 0x7f16ac00be20 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f16ac004510 tx=0x7f16b800c0e0).ready entity=mon.0 client_cookie=70df3a1cdb455f68 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:54.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bd5a2700 1 -- 172.21.15.79:0/2546411810 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f16ac0508d0 con 0x7f16ac005020 2021-04-09T18:35:54.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bd5a2700 1 -- 172.21.15.79:0/2546411810 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b800ca30 con 0x7f16ac005020 2021-04-09T18:35:54.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16bd5a2700 1 -- 172.21.15.79:0/2546411810 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f16b800ce00 con 0x7f16ac005020 2021-04-09T18:35:54.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16c49b1700 1 -- 172.21.15.79:0/2546411810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16ac005020 msgr2=0x7f16ac00be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:54.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16c49b1700 1 --2- 172.21.15.79:0/2546411810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16ac005020 0x7f16ac00be20 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f16ac004510 tx=0x7f16b800c0e0).stop 2021-04-09T18:35:54.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16beda5700 1 -- 172.21.15.79:0/2546411810 reap_dead start 2021-04-09T18:35:54.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16c49b1700 1 -- 172.21.15.79:0/2546411810 shutdown_connections 2021-04-09T18:35:54.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16c49b1700 1 -- 172.21.15.79:0/2546411810 >> 172.21.15.79:0/2546411810 conn(0x7f16c00e5fe0 msgr2=0x7f16c00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:54.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16c49b1700 1 -- 172.21.15.79:0/2546411810 shutdown_connections 2021-04-09T18:35:54.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.030 7f16c49b1700 1 -- 172.21.15.79:0/2546411810 wait complete. 2021-04-09T18:35:54.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.034 7f16c49b1700 1 Processor -- start 2021-04-09T18:35:54.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.034 7f16c49b1700 1 -- start start 2021-04-09T18:35:54.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.034 7f16c49b1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16c00c5110 0x7f16c01c0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:54.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.034 7f16c49b1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c01c06b0 0x7f16c01b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:54.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.034 7f16c49b1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16c00c5560 0x7f16c01b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:54.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.034 7f16c49b1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c01c3dc0 con 0x7f16c01c06b0 2021-04-09T18:35:54.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.034 7f16c49b1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c00af060 con 0x7f16c00c5560 2021-04-09T18:35:54.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.034 7f16c49b1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c00af360 con 0x7f16c00c5110 2021-04-09T18:35:54.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.034 7f16bdda3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c01c06b0 0x7f16c01b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:54.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.034 7f16bdda3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c01c06b0 0x7f16c01b1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35926/0 (socket says 172.21.15.79:35926) 2021-04-09T18:35:54.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.034 7f16bdda3700 1 -- 172.21.15.79:0/1867176403 learned_addr learned my addr 172.21.15.79:0/1867176403 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:54.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.034 7f16be5a4700 1 --2- 172.21.15.79:0/1867176403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16c00c5110 0x7f16c01c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:54.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.034 7f16beda5700 1 --2- 172.21.15.79:0/1867176403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16c00c5560 0x7f16c01b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:54.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.038 7f16bdda3700 1 -- 172.21.15.79:0/1867176403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16c00c5110 msgr2=0x7f16c01c0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:54.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.038 7f16bdda3700 1 --2- 172.21.15.79:0/1867176403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16c00c5110 0x7f16c01c0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.038 7f16bdda3700 1 -- 172.21.15.79:0/1867176403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16c00c5560 msgr2=0x7f16c01b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:54.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.038 7f16bdda3700 1 --2- 172.21.15.79:0/1867176403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16c00c5560 0x7f16c01b1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.038 7f16bdda3700 1 -- 172.21.15.79:0/1867176403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c00b0900 con 0x7f16c01c06b0 2021-04-09T18:35:54.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.038 7f16be5a4700 1 --2- 172.21.15.79:0/1867176403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16c00c5110 0x7f16c01c0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:54.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.038 7f16bdda3700 1 --2- 172.21.15.79:0/1867176403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c01c06b0 0x7f16c01b1650 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f16c00a3410 tx=0x7f16a8004e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:54.059 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.038 7f16b6ffd700 1 -- 172.21.15.79:0/1867176403 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f16c00b0900 con 0x7f16c01c06b0 2021-04-09T18:35:54.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.038 7f16b6ffd700 1 -- 172.21.15.79:0/1867176403 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a800fa90 con 0x7f16c01c06b0 2021-04-09T18:35:54.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.038 7f16b6ffd700 1 -- 172.21.15.79:0/1867176403 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f16a8010040 con 0x7f16c01c06b0 2021-04-09T18:35:54.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.038 7f16c49b1700 1 -- 172.21.15.79:0/1867176403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c00b1a20 con 0x7f16c01c06b0 2021-04-09T18:35:54.060 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.038 7f16c49b1700 1 -- 172.21.15.79:0/1867176403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c01b22b0 con 0x7f16c01c06b0 2021-04-09T18:35:54.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.038 7f16b6ffd700 1 -- 172.21.15.79:0/1867176403 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f16a801b060 con 0x7f16c01c06b0 2021-04-09T18:35:54.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.038 7f16b6ffd700 1 --2- 172.21.15.79:0/1867176403 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f16a4029100 0x7f16a402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:54.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.038 7f16b6ffd700 1 -- 172.21.15.79:0/1867176403 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f16a8011040 con 0x7f16c01c06b0 2021-04-09T18:35:54.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.038 7f16be5a4700 1 --2- 172.21.15.79:0/1867176403 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f16a4029100 0x7f16a402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:54.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.038 7f16be5a4700 1 --2- 172.21.15.79:0/1867176403 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f16a4029100 0x7f16a402b650 crc :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:54.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.042 7f16c49b1700 1 -- 172.21.15.79:0/1867176403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c0097260 con 0x7f16c01c06b0 2021-04-09T18:35:54.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.046 7f16b6ffd700 1 -- 172.21.15.79:0/1867176403 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f16a800f690 con 0x7f16c01c06b0 2021-04-09T18:35:54.235 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.230 7f16c49b1700 1 -- 172.21.15.79:0/1867176403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f16c00e39e0 con 0x7f16c01c06b0 2021-04-09T18:35:54.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.234 7f16b6ffd700 1 -- 172.21.15.79:0/1867176403 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f16a8000bf0 con 0x7f16c01c06b0 2021-04-09T18:35:54.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.238 7f16c49b1700 1 -- 172.21.15.79:0/1867176403 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f16a4029100 msgr2=0x7f16a402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:54.246 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.238 7f16c49b1700 1 --2- 172.21.15.79:0/1867176403 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f16a4029100 0x7f16a402b650 crc :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.238 7f16c49b1700 1 -- 172.21.15.79:0/1867176403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c01c06b0 msgr2=0x7f16c01b1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:54.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.238 7f16c49b1700 1 --2- 172.21.15.79:0/1867176403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c01c06b0 0x7f16c01b1650 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f16c00a3410 tx=0x7f16a8004e60).stop 2021-04-09T18:35:54.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.238 7f16c49b1700 1 -- 172.21.15.79:0/1867176403 shutdown_connections 2021-04-09T18:35:54.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.238 7f16c49b1700 1 --2- 172.21.15.79:0/1867176403 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f16a4029100 0x7f16a402b650 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.238 7f16c49b1700 1 --2- 172.21.15.79:0/1867176403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16c00c5560 0x7f16c01b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.238 7f16c49b1700 1 --2- 172.21.15.79:0/1867176403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16c00c5110 0x7f16c01c0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.238 7f16c49b1700 1 --2- 172.21.15.79:0/1867176403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c01c06b0 0x7f16c01b1650 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.238 7f16c49b1700 1 -- 172.21.15.79:0/1867176403 >> 172.21.15.79:0/1867176403 conn(0x7f16c00babf0 msgr2=0x7f16c00d86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:54.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.238 7f16c49b1700 1 -- 172.21.15.79:0/1867176403 shutdown_connections 2021-04-09T18:35:54.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.238 7f16c49b1700 1 -- 172.21.15.79:0/1867176403 wait complete. 2021-04-09T18:35:54.259 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2021-04-09T18:35:54.357 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7f54f7700 1 Processor -- start 2021-04-09T18:35:54.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7f54f7700 1 -- start start 2021-04-09T18:35:54.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7f54f7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7f00f5520 0x7fa7f00f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:54.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7f54f7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa7f00e9ae0 0x7fa7f009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:54.358 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7f54f7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa7f01c2db0 0x7fa7f01c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:54.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7f54f7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f00e9f30 con 0x7fa7f01c2db0 2021-04-09T18:35:54.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7f54f7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f00e59d0 con 0x7fa7f00e9ae0 2021-04-09T18:35:54.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7f54f7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f00fbb20 con 0x7fa7f00f5520 2021-04-09T18:35:54.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7efa48700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa7f01c2db0 0x7fa7f01c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:54.359 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7efa48700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa7f01c2db0 0x7fa7f01c3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35936/0 (socket says 172.21.15.79:35936) 2021-04-09T18:35:54.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7efa48700 1 -- 172.21.15.79:0/3343522599 learned_addr learned my addr 172.21.15.79:0/3343522599 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:54.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7eea46700 1 --2- 172.21.15.79:0/3343522599 >> v2:172.21.15.89:3300/0 conn(0x7fa7f00e9ae0 0x7fa7f009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:54.360 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7ef247700 1 --2- 172.21.15.79:0/3343522599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7f00f5520 0x7fa7f00f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:54.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7efa48700 1 -- 172.21.15.79:0/3343522599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7f00f5520 msgr2=0x7fa7f00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:54.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7efa48700 1 --2- 172.21.15.79:0/3343522599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7f00f5520 0x7fa7f00f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7efa48700 1 -- 172.21.15.79:0/3343522599 >> v2:172.21.15.89:3300/0 conn(0x7fa7f00e9ae0 msgr2=0x7fa7f009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:54.361 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7efa48700 1 --2- 172.21.15.79:0/3343522599 >> v2:172.21.15.89:3300/0 conn(0x7fa7f00e9ae0 0x7fa7f009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7efa48700 1 -- 172.21.15.79:0/3343522599 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f00e56d0 con 0x7fa7f01c2db0 2021-04-09T18:35:54.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7ef247700 1 --2- 172.21.15.79:0/3343522599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7f00f5520 0x7fa7f00f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:54.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7efa48700 1 --2- 172.21.15.79:0/3343522599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7f01c2db0 0x7fa7f01c3200 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7fa7e0002f30 tx=0x7fa7e000bd70).ready entity=mon.0 client_cookie=33cc913ca774a96b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:54.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7ee245700 1 -- 172.21.15.79:0/3343522599 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa7f00e56d0 con 0x7fa7f01c2db0 2021-04-09T18:35:54.362 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7ee245700 1 -- 172.21.15.79:0/3343522599 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e00098b0 con 0x7fa7f01c2db0 2021-04-09T18:35:54.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7ee245700 1 -- 172.21.15.79:0/3343522599 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa7e0009c80 con 0x7fa7f01c2db0 2021-04-09T18:35:54.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7f54f7700 1 -- 172.21.15.79:0/3343522599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7f01c2db0 msgr2=0x7fa7f01c3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:54.363 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7f54f7700 1 --2- 172.21.15.79:0/3343522599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7f01c2db0 0x7fa7f01c3200 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7fa7e0002f30 tx=0x7fa7e000bd70).stop 2021-04-09T18:35:54.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7f54f7700 1 -- 172.21.15.79:0/3343522599 shutdown_connections 2021-04-09T18:35:54.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7f54f7700 1 --2- 172.21.15.79:0/3343522599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7f00f5520 0x7fa7f00f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7f54f7700 1 --2- 172.21.15.79:0/3343522599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7f01c2db0 0x7fa7f01c3200 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7f54f7700 1 --2- 172.21.15.79:0/3343522599 >> v2:172.21.15.89:3300/0 conn(0x7fa7f00e9ae0 0x7fa7f009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.364 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7f54f7700 1 -- 172.21.15.79:0/3343522599 >> 172.21.15.79:0/3343522599 conn(0x7fa7f00e5fe0 msgr2=0x7fa7f00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:54.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7f54f7700 1 -- 172.21.15.79:0/3343522599 shutdown_connections 2021-04-09T18:35:54.365 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.346 7fa7f54f7700 1 -- 172.21.15.79:0/3343522599 wait complete. 2021-04-09T18:35:54.369 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.350 7fa7f54f7700 1 Processor -- start 2021-04-09T18:35:54.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.350 7fa7f54f7700 1 -- start start 2021-04-09T18:35:54.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7f54f7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7f00ab650 0x7fa7f00badd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:54.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7f54f7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7f00a7c20 0x7fa7f00ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:54.370 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7f54f7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7f00ae640 0x7fa7f00960f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:54.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7f54f7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f00a8520 con 0x7fa7f00ae640 2021-04-09T18:35:54.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7f54f7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f00a8820 con 0x7fa7f00ab650 2021-04-09T18:35:54.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7f54f7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f01c0930 con 0x7fa7f00a7c20 2021-04-09T18:35:54.371 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7efa48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7f00ae640 0x7fa7f00960f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:54.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7efa48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7f00ae640 0x7fa7f00960f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35942/0 (socket says 172.21.15.79:35942) 2021-04-09T18:35:54.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7efa48700 1 -- 172.21.15.79:0/847252363 learned_addr learned my addr 172.21.15.79:0/847252363 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:54.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7eea46700 1 --2- 172.21.15.79:0/847252363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7f00a7c20 0x7fa7f00ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:54.372 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7ef247700 1 --2- 172.21.15.79:0/847252363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7f00ab650 0x7fa7f00badd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:54.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7efa48700 1 -- 172.21.15.79:0/847252363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7f00a7c20 msgr2=0x7fa7f00ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:54.373 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7efa48700 1 --2- 172.21.15.79:0/847252363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7f00a7c20 0x7fa7f00ae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7efa48700 1 -- 172.21.15.79:0/847252363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7f00ab650 msgr2=0x7fa7f00badd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:54.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7efa48700 1 --2- 172.21.15.79:0/847252363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7f00ab650 0x7fa7f00badd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.374 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7efa48700 1 -- 172.21.15.79:0/847252363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f00a8070 con 0x7fa7f00ae640 2021-04-09T18:35:54.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7efa48700 1 --2- 172.21.15.79:0/847252363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7f00ae640 0x7fa7f00960f0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7fa7e0002f30 tx=0x7fa7e0006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:54.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7e7fff700 1 -- 172.21.15.79:0/847252363 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa7f00a8070 con 0x7fa7f00ae640 2021-04-09T18:35:54.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7e7fff700 1 -- 172.21.15.79:0/847252363 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e0018580 con 0x7fa7f00ae640 2021-04-09T18:35:54.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7f54f7700 1 -- 172.21.15.79:0/847252363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f00aea90 con 0x7fa7f00ae640 2021-04-09T18:35:54.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7e7fff700 1 -- 172.21.15.79:0/847252363 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa7e0018950 con 0x7fa7f00ae640 2021-04-09T18:35:54.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7f54f7700 1 -- 172.21.15.79:0/847252363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f0096720 con 0x7fa7f00ae640 2021-04-09T18:35:54.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7e7fff700 1 -- 172.21.15.79:0/847252363 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa7e0028060 con 0x7fa7f00ae640 2021-04-09T18:35:54.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7e7fff700 1 --2- 172.21.15.79:0/847252363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa7d40290a0 0x7fa7d402b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:54.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.354 7fa7e7fff700 1 -- 172.21.15.79:0/847252363 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7fa7e003c070 con 0x7fa7f00ae640 2021-04-09T18:35:54.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.358 7fa7ef247700 1 --2- 172.21.15.79:0/847252363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa7d40290a0 0x7fa7d402b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:54.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.358 7fa7ef247700 1 --2- 172.21.15.79:0/847252363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa7d40290a0 0x7fa7d402b5f0 crc :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:54.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.358 7fa7f54f7700 1 -- 172.21.15.79:0/847252363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f00e39e0 con 0x7fa7f00ae640 2021-04-09T18:35:54.377 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.362 7fa7e7fff700 1 -- 172.21.15.79:0/847252363 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa7e00096a0 con 0x7fa7f00ae640 2021-04-09T18:35:54.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.526 7fa7f54f7700 1 -- 172.21.15.79:0/847252363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7fa7f00f5b20 con 0x7fa7f00ae640 2021-04-09T18:35:54.919 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.914 7fa7e7fff700 1 -- 172.21.15.79:0/847252363 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v325) v1 ==== 127+0+0 (secure 0 0 0) 0x7fa7e0018370 con 0x7fa7f00ae640 2021-04-09T18:35:54.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.942 7fa7f54f7700 1 -- 172.21.15.79:0/847252363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa7d40290a0 msgr2=0x7fa7d402b5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:54.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.942 7fa7f54f7700 1 --2- 172.21.15.79:0/847252363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa7d40290a0 0x7fa7d402b5f0 crc :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.942 7fa7f54f7700 1 -- 172.21.15.79:0/847252363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7f00ae640 msgr2=0x7fa7f00960f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:54.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.942 7fa7f54f7700 1 --2- 172.21.15.79:0/847252363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7f00ae640 0x7fa7f00960f0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7fa7e0002f30 tx=0x7fa7e0006890).stop 2021-04-09T18:35:54.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.942 7fa7f54f7700 1 -- 172.21.15.79:0/847252363 shutdown_connections 2021-04-09T18:35:54.951 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.942 7fa7f54f7700 1 --2- 172.21.15.79:0/847252363 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fa7d40290a0 0x7fa7d402b5f0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.942 7fa7f54f7700 1 --2- 172.21.15.79:0/847252363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7f00ab650 0x7fa7f00badd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.942 7fa7f54f7700 1 --2- 172.21.15.79:0/847252363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7f00ae640 0x7fa7f00960f0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.942 7fa7f54f7700 1 --2- 172.21.15.79:0/847252363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7f00a7c20 0x7fa7f00ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:54.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.942 7fa7f54f7700 1 -- 172.21.15.79:0/847252363 >> 172.21.15.79:0/847252363 conn(0x7fa7f009b220 msgr2=0x7fa7f00aef90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:54.952 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.942 7fa7f54f7700 1 -- 172.21.15.79:0/847252363 shutdown_connections 2021-04-09T18:35:54.953 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:54.942 7fa7f54f7700 1 -- 172.21.15.79:0/847252363 wait complete. 2021-04-09T18:35:54.964 INFO:tasks.cephfs_test_runner:test_root_rctime (tasks.cephfs.test_misc.TestMisc) ... ok 2021-04-09T18:35:54.964 INFO:tasks.cephfs_test_runner: 2021-04-09T18:35:54.965 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-04-09T18:35:54.965 INFO:tasks.cephfs_test_runner:Ran 11 tests in 551.668s 2021-04-09T18:35:54.965 INFO:tasks.cephfs_test_runner: 2021-04-09T18:35:54.966 INFO:tasks.cephfs_test_runner:OK 2021-04-09T18:35:54.966 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2021-04-09T18:35:54.975 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2021-04-09T18:35:55.061 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2021-04-09T18:35:55.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:55.062 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:55.062 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:35:55.069 INFO:teuthology.orchestra.run.smithi090.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-04-09T18:35:55.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:35:55.071 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-04-09T18:35:55.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:55.072 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:55.072 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-04-09T18:35:55.079 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-04-09T18:35:55.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:35:55.082 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-04-09T18:35:55.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:35:55.083 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:35:55.083 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-04-09T18:35:55.091 INFO:teuthology.orchestra.run.smithi144.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-04-09T18:35:55.092 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:35:55.093 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-04-09T18:35:55.094 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2021-04-09T18:35:55.129 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2021-04-09T18:35:55.130 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:35:55.237 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf317c5700 1 Processor -- start 2021-04-09T18:35:55.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf317c5700 1 -- start start 2021-04-09T18:35:55.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf317c5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf2c0e9ad0 0x7faf2c09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.238 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf317c5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faf2c1c8000 0x7faf2c1ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf317c5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf2c0fbb10 con 0x7faf2c0f5510 2021-04-09T18:35:55.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf317c5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2c1c3db0 con 0x7faf2c1c8000 2021-04-09T18:35:55.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf317c5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0e9f20 con 0x7faf2c0e9ad0 2021-04-09T18:35:55.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf2bd51700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faf2c1c8000 0x7faf2c1ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.239 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf2bd51700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faf2c1c8000 0x7faf2c1ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35950/0 (socket says 172.21.15.79:35950) 2021-04-09T18:35:55.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf2bd51700 1 -- 172.21.15.79:0/69588879 learned_addr learned my addr 172.21.15.79:0/69588879 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:55.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf2ad4f700 1 --2- 172.21.15.79:0/69588879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf2c0e9ad0 0x7faf2c09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf2bd51700 1 -- 172.21.15.79:0/69588879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf2c0e9ad0 msgr2=0x7faf2c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:55.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf2bd51700 1 --2- 172.21.15.79:0/69588879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf2c0e9ad0 0x7faf2c09f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.240 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf2bd51700 1 -- 172.21.15.79:0/69588879 >> v1:172.21.15.89:6789/0 conn(0x7faf2c0f5510 legacy=0x7faf2c0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:55.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf2bd51700 1 -- 172.21.15.79:0/69588879 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c0e56c0 con 0x7faf2c1c8000 2021-04-09T18:35:55.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf2bd51700 1 --2- 172.21.15.79:0/69588879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf2c1c8000 0x7faf2c1ca460 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7faf24002f30 tx=0x7faf2400bda0).ready entity=mon.0 client_cookie=21667a8a1854af73 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:55.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf2a54e700 1 -- 172.21.15.79:0/69588879 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf2c0e56c0 con 0x7faf2c1c8000 2021-04-09T18:35:55.241 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf2a54e700 1 -- 172.21.15.79:0/69588879 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf240099d0 con 0x7faf2c1c8000 2021-04-09T18:35:55.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf2a54e700 1 -- 172.21.15.79:0/69588879 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf24009da0 con 0x7faf2c1c8000 2021-04-09T18:35:55.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf317c5700 1 -- 172.21.15.79:0/69588879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf2c1c8000 msgr2=0x7faf2c1ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:55.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.226 7faf317c5700 1 --2- 172.21.15.79:0/69588879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf2c1c8000 0x7faf2c1ca460 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7faf24002f30 tx=0x7faf2400bda0).stop 2021-04-09T18:35:55.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.230 7faf317c5700 1 -- 172.21.15.79:0/69588879 shutdown_connections 2021-04-09T18:35:55.242 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.230 7faf317c5700 1 --2- 172.21.15.79:0/69588879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf2c1c8000 0x7faf2c1ca460 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.230 7faf317c5700 1 --2- 172.21.15.79:0/69588879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf2c0e9ad0 0x7faf2c09f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.230 7faf317c5700 1 -- 172.21.15.79:0/69588879 >> 172.21.15.79:0/69588879 conn(0x7faf2c0e5fd0 msgr2=0x7faf2c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:55.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.230 7faf317c5700 1 -- 172.21.15.79:0/69588879 shutdown_connections 2021-04-09T18:35:55.243 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.230 7faf317c5700 1 -- 172.21.15.79:0/69588879 wait complete. 2021-04-09T18:35:55.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.230 7faf317c5700 1 Processor -- start 2021-04-09T18:35:55.244 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.230 7faf317c5700 1 -- start start 2021-04-09T18:35:55.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.230 7faf317c5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf2c0ad5f0 0x7faf2c1aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.230 7faf317c5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf2c1a2510 0x7faf2c0af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.247 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.230 7faf317c5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf2c0d5030 0x7faf2c0d5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.230 7faf317c5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0add40 con 0x7faf2c0ad5f0 2021-04-09T18:35:55.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.230 7faf317c5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0ada40 con 0x7faf2c1a2510 2021-04-09T18:35:55.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.230 7faf317c5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0ae040 con 0x7faf2c0d5030 2021-04-09T18:35:55.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf2b550700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf2c0ad5f0 0x7faf2c1aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.248 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf2b550700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf2c0ad5f0 0x7faf2c1aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35952/0 (socket says 172.21.15.79:35952) 2021-04-09T18:35:55.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf2b550700 1 -- 172.21.15.79:0/1775486955 learned_addr learned my addr 172.21.15.79:0/1775486955 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:55.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf2bd51700 1 --2- 172.21.15.79:0/1775486955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf2c0d5030 0x7faf2c0d5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf2ad4f700 1 --2- 172.21.15.79:0/1775486955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf2c1a2510 0x7faf2c0af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf2b550700 1 -- 172.21.15.79:0/1775486955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf2c0d5030 msgr2=0x7faf2c0d5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:55.249 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf2b550700 1 --2- 172.21.15.79:0/1775486955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf2c0d5030 0x7faf2c0d5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf2b550700 1 -- 172.21.15.79:0/1775486955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf2c1a2510 msgr2=0x7faf2c0af5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:55.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf2b550700 1 --2- 172.21.15.79:0/1775486955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf2c1a2510 0x7faf2c0af5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf2b550700 1 -- 172.21.15.79:0/1775486955 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c1a2960 con 0x7faf2c0ad5f0 2021-04-09T18:35:55.250 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf2ad4f700 1 --2- 172.21.15.79:0/1775486955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf2c1a2510 0x7faf2c0af5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:55.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf2b550700 1 --2- 172.21.15.79:0/1775486955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf2c0ad5f0 0x7faf2c1aedf0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7faf2c0874c0 tx=0x7faf1400cae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:55.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf23fff700 1 -- 172.21.15.79:0/1775486955 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf2c1a2960 con 0x7faf2c0ad5f0 2021-04-09T18:35:55.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf23fff700 1 -- 172.21.15.79:0/1775486955 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf14010510 con 0x7faf2c0ad5f0 2021-04-09T18:35:55.251 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf317c5700 1 -- 172.21.15.79:0/1775486955 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2c0afc10 con 0x7faf2c0ad5f0 2021-04-09T18:35:55.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf23fff700 1 -- 172.21.15.79:0/1775486955 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf140106f0 con 0x7faf2c0ad5f0 2021-04-09T18:35:55.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf317c5700 1 -- 172.21.15.79:0/1775486955 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2c0a84b0 con 0x7faf2c0ad5f0 2021-04-09T18:35:55.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf23fff700 1 -- 172.21.15.79:0/1775486955 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7faf14019020 con 0x7faf2c0ad5f0 2021-04-09T18:35:55.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf23fff700 1 --2- 172.21.15.79:0/1775486955 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf10029100 0x7faf1002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.252 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf23fff700 1 -- 172.21.15.79:0/1775486955 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7faf14038b20 con 0x7faf2c0ad5f0 2021-04-09T18:35:55.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.234 7faf2ad4f700 1 --2- 172.21.15.79:0/1775486955 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf10029100 0x7faf1002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.238 7faf2ad4f700 1 --2- 172.21.15.79:0/1775486955 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf10029100 0x7faf1002b650 crc :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:55.253 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.238 7faf317c5700 1 -- 172.21.15.79:0/1775486955 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2c0e39d0 con 0x7faf2c0ad5f0 2021-04-09T18:35:55.254 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.246 7faf23fff700 1 -- 172.21.15.79:0/1775486955 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7faf14000bf0 con 0x7faf2c0ad5f0 2021-04-09T18:35:55.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.414 7faf317c5700 1 -- 172.21.15.79:0/1775486955 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf2c0f5b10 con 0x7faf2c0ad5f0 2021-04-09T18:35:55.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.414 7faf23fff700 1 -- 172.21.15.79:0/1775486955 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+11626 (secure 0 0 0) 0x7faf14010300 con 0x7faf2c0ad5f0 2021-04-09T18:35:55.424 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:55.424 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":138,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:35:53.899915","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6834/4071560647":"2021-04-10 18:35:50.664130","172.21.15.89:6835/1552365531":"2021-04-10 18:35:39.980332","172.21.15.89:6835/4071560647":"2021-04-10 18:35:50.664130","172.21.15.89:6834/1552365531":"2021-04-10 18:35:39.980332"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:35:55.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.422 7faf317c5700 1 -- 172.21.15.79:0/1775486955 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf10029100 msgr2=0x7faf1002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:55.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.422 7faf317c5700 1 --2- 172.21.15.79:0/1775486955 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf10029100 0x7faf1002b650 crc :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.422 7faf317c5700 1 -- 172.21.15.79:0/1775486955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf2c0ad5f0 msgr2=0x7faf2c1aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:55.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.422 7faf317c5700 1 --2- 172.21.15.79:0/1775486955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf2c0ad5f0 0x7faf2c1aedf0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7faf2c0874c0 tx=0x7faf1400cae0).stop 2021-04-09T18:35:55.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.422 7faf317c5700 1 -- 172.21.15.79:0/1775486955 shutdown_connections 2021-04-09T18:35:55.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.422 7faf317c5700 1 --2- 172.21.15.79:0/1775486955 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7faf10029100 0x7faf1002b650 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.428 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.422 7faf317c5700 1 --2- 172.21.15.79:0/1775486955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf2c0d5030 0x7faf2c0d5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.429 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.422 7faf317c5700 1 --2- 172.21.15.79:0/1775486955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf2c0ad5f0 0x7faf2c1aedf0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.429 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.422 7faf317c5700 1 --2- 172.21.15.79:0/1775486955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf2c1a2510 0x7faf2c0af5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.429 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.422 7faf317c5700 1 -- 172.21.15.79:0/1775486955 >> 172.21.15.79:0/1775486955 conn(0x7faf2c096b20 msgr2=0x7faf2c0d8280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:55.429 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.422 7faf317c5700 1 -- 172.21.15.79:0/1775486955 shutdown_connections 2021-04-09T18:35:55.430 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.422 7faf317c5700 1 -- 172.21.15.79:0/1775486955 wait complete. 2021-04-09T18:35:55.437 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-04-09T18:35:55.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.526 7fe4144ed700 1 Processor -- start 2021-04-09T18:35:55.541 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.526 7fe4144ed700 1 -- start start 2021-04-09T18:35:55.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe4144ed700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe40c0f5510 0x7fe40c0f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe4144ed700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe40c0e9ad0 0x7fe40c09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe4144ed700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe40c0fbb10 con 0x7fe40c1c2da0 2021-04-09T18:35:55.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe4144ed700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe40c0e9f20 con 0x7fe40c0e9ad0 2021-04-09T18:35:55.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe4144ed700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c0e59c0 con 0x7fe40c0f5510 2021-04-09T18:35:55.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe411a90700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe40c0e9ad0 0x7fe40c09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe411a90700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe40c0e9ad0 0x7fe40c09f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35962/0 (socket says 172.21.15.79:35962) 2021-04-09T18:35:55.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe411a90700 1 -- 172.21.15.79:0/1386435938 learned_addr learned my addr 172.21.15.79:0/1386435938 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:55.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe412291700 1 --2- 172.21.15.79:0/1386435938 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe40c0f5510 0x7fe40c0f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe411a90700 1 -- 172.21.15.79:0/1386435938 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe40c0f5510 msgr2=0x7fe40c0f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:55.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe411a90700 1 --2- 172.21.15.79:0/1386435938 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe40c0f5510 0x7fe40c0f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe411a90700 1 -- 172.21.15.79:0/1386435938 >> v1:172.21.15.89:6789/0 conn(0x7fe40c1c2da0 legacy=0x7fe40c1c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:55.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe411a90700 1 -- 172.21.15.79:0/1386435938 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c0e56c0 con 0x7fe40c0e9ad0 2021-04-09T18:35:55.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe411a90700 1 --2- 172.21.15.79:0/1386435938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe40c0e9ad0 0x7fe40c09f100 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7fe3fc002f30 tx=0x7fe3fc00bda0).ready entity=mon.0 client_cookie=d446804bf00b6433 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:55.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe41128f700 1 -- 172.21.15.79:0/1386435938 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe40c0e56c0 con 0x7fe40c0e9ad0 2021-04-09T18:35:55.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe41128f700 1 -- 172.21.15.79:0/1386435938 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3fc0099d0 con 0x7fe40c0e9ad0 2021-04-09T18:35:55.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe41128f700 1 -- 172.21.15.79:0/1386435938 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe3fc009da0 con 0x7fe40c0e9ad0 2021-04-09T18:35:55.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe4144ed700 1 -- 172.21.15.79:0/1386435938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe40c0e9ad0 msgr2=0x7fe40c09f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:55.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe4144ed700 1 --2- 172.21.15.79:0/1386435938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe40c0e9ad0 0x7fe40c09f100 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7fe3fc002f30 tx=0x7fe3fc00bda0).stop 2021-04-09T18:35:55.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe4144ed700 1 -- 172.21.15.79:0/1386435938 shutdown_connections 2021-04-09T18:35:55.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe4144ed700 1 --2- 172.21.15.79:0/1386435938 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe40c0f5510 0x7fe40c0f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe4144ed700 1 --2- 172.21.15.79:0/1386435938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe40c0e9ad0 0x7fe40c09f100 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe4144ed700 1 -- 172.21.15.79:0/1386435938 >> 172.21.15.79:0/1386435938 conn(0x7fe40c0e5fd0 msgr2=0x7fe40c0e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:55.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe4144ed700 1 -- 172.21.15.79:0/1386435938 shutdown_connections 2021-04-09T18:35:55.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.530 7fe4144ed700 1 -- 172.21.15.79:0/1386435938 wait complete. 2021-04-09T18:35:55.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.534 7fe4144ed700 1 Processor -- start 2021-04-09T18:35:55.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.534 7fe4144ed700 1 -- start start 2021-04-09T18:35:55.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe4144ed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe40c0d50b0 0x7fe40c0cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe4144ed700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe40c094b90 0x7fe40c093f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe4144ed700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe40c094540 0x7fe40c0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.551 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe4144ed700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c099b30 con 0x7fe40c0d50b0 2021-04-09T18:35:55.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe4144ed700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c099e30 con 0x7fe40c094b90 2021-04-09T18:35:55.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe4144ed700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c0ceae0 con 0x7fe40c094540 2021-04-09T18:35:55.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe412291700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe40c0d50b0 0x7fe40c0cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe412291700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe40c0d50b0 0x7fe40c0cfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35966/0 (socket says 172.21.15.79:35966) 2021-04-09T18:35:55.552 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe412291700 1 -- 172.21.15.79:0/2365734942 learned_addr learned my addr 172.21.15.79:0/2365734942 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:55.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe411a90700 1 --2- 172.21.15.79:0/2365734942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe40c094b90 0x7fe40c093f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe412a92700 1 --2- 172.21.15.79:0/2365734942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe40c094540 0x7fe40c0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.553 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe412291700 1 -- 172.21.15.79:0/2365734942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe40c094540 msgr2=0x7fe40c0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:55.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe412291700 1 --2- 172.21.15.79:0/2365734942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe40c094540 0x7fe40c0ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe412291700 1 -- 172.21.15.79:0/2365734942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe40c094b90 msgr2=0x7fe40c093f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:55.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe412291700 1 --2- 172.21.15.79:0/2365734942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe40c094b90 0x7fe40c093f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.554 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe412291700 1 -- 172.21.15.79:0/2365734942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c0ced10 con 0x7fe40c0d50b0 2021-04-09T18:35:55.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe412291700 1 --2- 172.21.15.79:0/2365734942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe40c0d50b0 0x7fe40c0cfed0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7fe40c099ab0 tx=0x7fe40800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:55.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe402ffd700 1 -- 172.21.15.79:0/2365734942 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe40c0ced10 con 0x7fe40c0d50b0 2021-04-09T18:35:55.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe4144ed700 1 -- 172.21.15.79:0/2365734942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe40c0cef70 con 0x7fe40c0d50b0 2021-04-09T18:35:55.555 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe402ffd700 1 -- 172.21.15.79:0/2365734942 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40800cd60 con 0x7fe40c0d50b0 2021-04-09T18:35:55.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe4144ed700 1 -- 172.21.15.79:0/2365734942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe40c08f280 con 0x7fe40c0d50b0 2021-04-09T18:35:55.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe402ffd700 1 -- 172.21.15.79:0/2365734942 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe40800f040 con 0x7fe40c0d50b0 2021-04-09T18:35:55.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe402ffd700 1 -- 172.21.15.79:0/2365734942 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe408011070 con 0x7fe40c0d50b0 2021-04-09T18:35:55.556 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe402ffd700 1 --2- 172.21.15.79:0/2365734942 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe3f4029100 0x7fe3f402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe402ffd700 1 -- 172.21.15.79:0/2365734942 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7fe408010040 con 0x7fe40c0d50b0 2021-04-09T18:35:55.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe411a90700 1 --2- 172.21.15.79:0/2365734942 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe3f4029100 0x7fe3f402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.538 7fe411a90700 1 --2- 172.21.15.79:0/2365734942 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe3f4029100 0x7fe3f402b650 crc :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:55.557 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.542 7fe4144ed700 1 -- 172.21.15.79:0/2365734942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe40c0e39d0 con 0x7fe40c0d50b0 2021-04-09T18:35:55.558 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.546 7fe402ffd700 1 -- 172.21.15.79:0/2365734942 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe408000bf0 con 0x7fe40c0d50b0 2021-04-09T18:35:55.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.706 7fe4144ed700 1 -- 172.21.15.79:0/2365734942 --> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7fe40c0f5b10 con 0x7fe3f4029100 2021-04-09T18:35:55.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.710 7fe402ffd700 1 -- 172.21.15.79:0/2365734942 <== mgr.4100 v2:172.21.15.89:6800/13779 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+64286 (crc 0 0 0) 0x7fe40c0f5b10 con 0x7fe3f4029100 2021-04-09T18:35:55.720 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:55.720 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2021-04-09T18:35:55.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.714 7fe4144ed700 1 -- 172.21.15.79:0/2365734942 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe3f4029100 msgr2=0x7fe3f402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:55.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.714 7fe4144ed700 1 --2- 172.21.15.79:0/2365734942 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe3f4029100 0x7fe3f402b650 crc :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.714 7fe4144ed700 1 -- 172.21.15.79:0/2365734942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe40c0d50b0 msgr2=0x7fe40c0cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:55.723 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.714 7fe4144ed700 1 --2- 172.21.15.79:0/2365734942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe40c0d50b0 0x7fe40c0cfed0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7fe40c099ab0 tx=0x7fe40800c430).stop 2021-04-09T18:35:55.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.714 7fe4144ed700 1 -- 172.21.15.79:0/2365734942 shutdown_connections 2021-04-09T18:35:55.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.714 7fe4144ed700 1 --2- 172.21.15.79:0/2365734942 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe3f4029100 0x7fe3f402b650 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.714 7fe4144ed700 1 --2- 172.21.15.79:0/2365734942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe40c094540 0x7fe40c0ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.724 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.714 7fe4144ed700 1 --2- 172.21.15.79:0/2365734942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe40c0d50b0 0x7fe40c0cfed0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.714 7fe4144ed700 1 --2- 172.21.15.79:0/2365734942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe40c094b90 0x7fe40c093f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.714 7fe4144ed700 1 -- 172.21.15.79:0/2365734942 >> 172.21.15.79:0/2365734942 conn(0x7fe40c093580 msgr2=0x7fe40c0baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:55.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.714 7fe4144ed700 1 -- 172.21.15.79:0/2365734942 shutdown_connections 2021-04-09T18:35:55.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.714 7fe4144ed700 1 -- 172.21.15.79:0/2365734942 wait complete. 2021-04-09T18:35:55.733 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":434,"stamp":"2021-04-09 18:35:54.123291","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":8402260,"kb_used_data":13568,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746572460,"statfs":{"total":773094113280,"available":764490199040,"internally_reserved":8589934592,"allocated":13893632,"data_stored":6355572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2286,"num_objects":-21,"num_object_clones":0,"num_object_copies":-42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-44,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.781475"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"121","reported_epoch":"135","state":"active+clean","last_fresh":"2021-04-09 18:35:40.020421","last_change":"2021-04-09 18:26:08.058514","last_active":"2021-04-09 18:35:40.020421","last_peered":"2021-04-09 18:35:40.020421","last_clean":"2021-04-09 18:35:40.020421","last_became_active":"2021-04-09 18:26:08.058166","last_became_peered":"2021-04-09 18:26:08.058166","last_unstale":"2021-04-09 18:35:40.020421","last_undegraded":"2021-04-09 18:35:40.020421","last_fullsized":"2021-04-09 18:35:40.020421","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"121","reported_epoch":"135","state":"active+clean","last_fresh":"2021-04-09 18:35:40.020606","last_change":"2021-04-09 18:26:08.061036","last_active":"2021-04-09 18:35:40.020606","last_peered":"2021-04-09 18:35:40.020606","last_clean":"2021-04-09 18:35:40.020606","last_became_active":"2021-04-09 18:26:08.060740","last_became_peered":"2021-04-09 18:26:08.060740","last_unstale":"2021-04-09 18:35:40.020606","last_undegraded":"2021-04-09 18:35:40.020606","last_fullsized":"2021-04-09 18:35:40.020606","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"118","reported_epoch":"136","state":"active+clean","last_fresh":"2021-04-09 18:35:50.767534","last_change":"2021-04-09 18:26:08.061551","last_active":"2021-04-09 18:35:50.767534","last_peered":"2021-04-09 18:35:50.767534","last_clean":"2021-04-09 18:35:50.767534","last_became_active":"2021-04-09 18:26:08.061226","last_became_peered":"2021-04-09 18:26:08.061226","last_unstale":"2021-04-09 18:35:50.767534","last_undegraded":"2021-04-09 18:35:50.767534","last_fullsized":"2021-04-09 18:35:50.767534","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"119","reported_epoch":"136","state":"active+clean","last_fresh":"2021-04-09 18:35:50.768356","last_change":"2021-04-09 18:26:08.058408","last_active":"2021-04-09 18:35:50.768356","last_peered":"2021-04-09 18:35:50.768356","last_clean":"2021-04-09 18:35:50.768356","last_became_active":"2021-04-09 18:26:08.058080","last_became_peered":"2021-04-09 18:26:08.058080","last_unstale":"2021-04-09 18:35:50.768356","last_undegraded":"2021-04-09 18:35:50.768356","last_fullsized":"2021-04-09 18:35:50.768356","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"124","reported_epoch":"136","state":"active+clean","last_fresh":"2021-04-09 18:35:50.671876","last_change":"2021-04-09 18:26:08.054702","last_active":"2021-04-09 18:35:50.671876","last_peered":"2021-04-09 18:35:50.671876","last_clean":"2021-04-09 18:35:50.671876","last_became_active":"2021-04-09 18:26:08.054144","last_became_peered":"2021-04-09 18:26:08.054144","last_unstale":"2021-04-09 18:35:50.671876","last_undegraded":"2021-04-09 18:35:50.671876","last_fullsized":"2021-04-09 18:35:50.671876","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"117","reported_epoch":"136","state":"active+clean","last_fresh":"2021-04-09 18:35:50.767279","last_change":"2021-04-09 18:26:08.061669","last_active":"2021-04-09 18:35:50.767279","last_peered":"2021-04-09 18:35:50.767279","last_clean":"2021-04-09 18:35:50.767279","last_became_active":"2021-04-09 18:26:08.060952","last_became_peered":"2021-04-09 18:26:08.060952","last_unstale":"2021-04-09 18:35:50.767279","last_undegraded":"2021-04-09 18:35:50.767279","last_fullsized":"2021-04-09 18:35:50.767279","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"117","reported_epoch":"136","state":"active+clean","last_fresh":"2021-04-09 18:35:50.767592","last_change":"2021-04-09 18:26:08.060814","last_active":"2021-04-09 18:35:50.767592","last_peered":"2021-04-09 18:35:50.767592","last_clean":"2021-04-09 18:35:50.767592","last_became_active":"2021-04-09 18:26:08.060463","last_became_peered":"2021-04-09 18:26:08.060463","last_unstale":"2021-04-09 18:35:50.767592","last_undegraded":"2021-04-09 18:35:50.767592","last_fullsized":"2021-04-09 18:35:50.767592","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"124","reported_epoch":"136","state":"active+clean","last_fresh":"2021-04-09 18:35:50.668875","last_change":"2021-04-09 18:26:08.054741","last_active":"2021-04-09 18:35:50.668875","last_peered":"2021-04-09 18:35:50.668875","last_clean":"2021-04-09 18:35:50.668875","last_became_active":"2021-04-09 18:26:08.054184","last_became_peered":"2021-04-09 18:26:08.054184","last_unstale":"2021-04-09 18:35:50.668875","last_undegraded":"2021-04-09 18:35:50.668875","last_fullsized":"2021-04-09 18:35:50.668875","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574968,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1050276,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321564,"statfs":{"total":96636764160,"available":95561281536,"internally_reserved":1073741824,"allocated":1732608,"data_stored":793245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:35:25 2021","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.45800000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.089,"5min":1.119,"15min":1.119},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.72299999999999998},"min":{"1min":0.56200000000000006,"5min":0.311,"15min":0.311},"max":{"1min":0.94399999999999995,"5min":1.036,"15min":1.27},"last":0.67800000000000005}]},{"osd":1,"last update":"Fri Apr 9 18:35:25 2021","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.71399999999999997,"15min":0.75600000000000001},"min":{"1min":0.56399999999999995,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.1970000000000001,"5min":1.268,"15min":1.268},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.76800000000000002,"15min":0.78100000000000003},"min":{"1min":0.53800000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.98199999999999998,"5min":1.038,"15min":1.139},"last":0.60699999999999998}]},{"osd":2,"last update":"Fri Apr 9 18:35:25 2021","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70899999999999996,"15min":0.73599999999999999},"min":{"1min":0.52200000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86399999999999999,"5min":1.2150000000000001,"15min":1.7769999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79000000000000004,"15min":0.81899999999999995},"min":{"1min":0.64600000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96199999999999997,"5min":1.399,"15min":1.399},"last":0.65700000000000003}]},{"osd":3,"last update":"Fri Apr 9 18:35:25 2021","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.752,"15min":0.79500000000000004},"min":{"1min":0.58699999999999997,"5min":0.49299999999999999,"15min":0.47599999999999998},"max":{"1min":0.94999999999999996,"5min":1.514,"15min":1.9630000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.80700000000000005,"15min":0.86399999999999999},"min":{"1min":0.625,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0029999999999999,"5min":1.343,"15min":1.343},"last":0.755}]},{"osd":4,"last update":"Fri Apr 9 18:35:25 2021","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.68600000000000005,"15min":0.77200000000000002},"min":{"1min":0.438,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0589999999999999,"5min":1.181,"15min":1.859},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.83299999999999996,"15min":0.88900000000000001},"min":{"1min":0.58599999999999997,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.109,"5min":1.2889999999999999,"15min":2.4039999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Fri Apr 9 18:35:25 2021","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.82399999999999995,"15min":0.91900000000000004},"min":{"1min":0.67500000000000004,"5min":0.38,"15min":0.38},"max":{"1min":1.0549999999999999,"5min":1.47,"15min":3.0960000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.84599999999999997,"15min":0.91400000000000003},"min":{"1min":0.498,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0449999999999999,"5min":1.1890000000000001,"15min":3.1219999999999999},"last":0.83299999999999996}]},{"osd":6,"last update":"Fri Apr 9 18:35:25 2021","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.85399999999999998,"15min":0.90900000000000003},"min":{"1min":0.60299999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0509999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86799999999999999,"15min":0.91400000000000003},"min":{"1min":0.51000000000000001,"5min":0.439,"15min":0.437},"max":{"1min":1.0609999999999999,"5min":2.0720000000000001,"15min":2.335},"last":0.746}]}]},{"osd":6,"up_from":13,"seq":55834574968,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1050272,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321568,"statfs":{"total":96636764160,"available":95561285632,"internally_reserved":1073741824,"allocated":1728512,"data_stored":793211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56299999999999994,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.022,"5min":1.069,"15min":1.4910000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.749,"15min":0.78900000000000003},"min":{"1min":0.56299999999999994,"5min":0.50900000000000001,"15min":0.42699999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":2.0179999999999998},"last":0.66800000000000004}]},{"osd":1,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.76000000000000001,"15min":0.76100000000000001},"min":{"1min":0.50700000000000001,"5min":0.43099999999999999,"15min":0.379},"max":{"1min":0.99099999999999999,"5min":1.0600000000000001,"15min":1.075},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78700000000000003,"15min":0.79700000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0069999999999999,"5min":1.1200000000000001,"15min":1.3100000000000001},"last":0.90700000000000003}]},{"osd":2,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72299999999999998,"15min":0.75700000000000001},"min":{"1min":0.52400000000000002,"5min":0.48799999999999999,"15min":0.47499999999999998},"max":{"1min":0.88400000000000001,"5min":1.077,"15min":1.4830000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.79900000000000004,"15min":0.82299999999999995},"min":{"1min":0.5,"5min":0.46899999999999997,"15min":0.45900000000000002},"max":{"1min":1.01,"5min":1.1220000000000001,"15min":1.6599999999999999},"last":0.83499999999999996}]},{"osd":3,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80700000000000005,"15min":0.82799999999999996},"min":{"1min":0.51600000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.3100000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.82499999999999996},"min":{"1min":0.55500000000000005,"5min":0.505,"15min":0.505},"max":{"1min":0.88500000000000001,"5min":1.038,"15min":1.552},"last":0.872}]},{"osd":4,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.75,"15min":0.79200000000000004},"min":{"1min":0.56999999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91300000000000003,"5min":1.165,"15min":1.284},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.81399999999999995,"15min":0.90000000000000002},"min":{"1min":0.57799999999999996,"5min":0.41699999999999998,"15min":0.38100000000000001},"max":{"1min":0.92400000000000004,"5min":1.0840000000000001,"15min":2.0840000000000001},"last":0.76100000000000001}]},{"osd":5,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80200000000000005,"15min":0.82299999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0189999999999999,"5min":1.137,"15min":1.3899999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.86699999999999999,"15min":0.91100000000000003},"min":{"1min":0.64800000000000002,"5min":0.56499999999999995,"15min":0.41399999999999998},"max":{"1min":0.96299999999999997,"5min":1.3560000000000001,"15min":1.7190000000000001},"last":0.92500000000000004}]},{"osd":7,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.89500000000000002,"15min":0.95399999999999996},"min":{"1min":0.63400000000000001,"5min":0.59299999999999997,"15min":0.45400000000000001},"max":{"1min":1.024,"5min":1.284,"15min":1.444},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.879,"15min":0.92200000000000004},"min":{"1min":0.66100000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1839999999999999,"5min":1.2350000000000001,"15min":1.681},"last":0.78100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574968,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1050292,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321548,"statfs":{"total":96636764160,"available":95561265152,"internally_reserved":1073741824,"allocated":1748992,"data_stored":797959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.73499999999999999,"15min":0.71699999999999997},"min":{"1min":0.54400000000000004,"5min":0.40300000000000002,"15min":0.33500000000000002},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.67200000000000004,"5min":0.498,"15min":0.32300000000000001},"max":{"1min":1.048,"5min":1.073,"15min":1.2470000000000001},"last":1.087}]},{"osd":1,"last update":"Fri Apr 9 18:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.754,"15min":0.73199999999999998},"min":{"1min":0.54100000000000004,"5min":0.505,"15min":0.432},"max":{"1min":1.099,"5min":1.099,"15min":1.389},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.752,"15min":0.77500000000000002},"min":{"1min":0.55600000000000005,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.036,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Apr 9 18:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.51300000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.6379999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.749,"15min":0.80800000000000005},"min":{"1min":0.49199999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.173,"5min":1.173,"15min":2.8220000000000001},"last":0.79000000000000004}]},{"osd":3,"last update":"Fri Apr 9 18:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.80400000000000005,"15min":0.86299999999999999},"min":{"1min":0.64300000000000002,"5min":0.52800000000000002,"15min":0.51900000000000002},"max":{"1min":1.26,"5min":1.26,"15min":2.46},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82099999999999995,"15min":0.86299999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.46600000000000003},"max":{"1min":1.155,"5min":1.155,"15min":2.8999999999999999},"last":0.64800000000000002}]},{"osd":4,"last update":"Fri Apr 9 18:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76200000000000001,"15min":0.78100000000000003},"min":{"1min":0.48399999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.143,"5min":1.212,"15min":1.212},"last":0.749},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92300000000000004,"15min":0.97899999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":3.1259999999999999},"last":1.0549999999999999}]},{"osd":6,"last update":"Fri Apr 9 18:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84099999999999997,"15min":0.88600000000000001},"min":{"1min":0.56200000000000006,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.89200000000000002,"15min":0.90300000000000002},"min":{"1min":0.63200000000000001,"5min":0.63,"15min":0.53300000000000003},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.88400000000000001}]},{"osd":7,"last update":"Fri Apr 9 18:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.89600000000000002,"15min":0.95999999999999996},"min":{"1min":0.61899999999999999,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.274,"5min":1.274,"15min":3.1819999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.92400000000000004,"15min":0.98299999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3,"5min":1.3,"15min":2.9590000000000001},"last":0.91200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1050284,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321556,"statfs":{"total":96636764160,"available":95561273344,"internally_reserved":1073741824,"allocated":1740800,"data_stored":793405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56100000000000005,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.42899999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.0800000000000001,"5min":1.091,"15min":1.091},"last":0.57299999999999995}]},{"osd":2,"last update":"Fri Apr 9 18:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.63500000000000001},"min":{"1min":0.42299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79500000000000004,"5min":0.94899999999999995,"15min":1.169},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.622,"15min":0.57899999999999996},"min":{"1min":0.379,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":3.0270000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.73799999999999999}]},{"osd":3,"last update":"Fri Apr 9 18:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78400000000000003,"5min":0.92400000000000004,"15min":0.92800000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.64300000000000002,"15min":0.67300000000000004},"min":{"1min":0.48599999999999999,"5min":0.41199999999999998,"15min":0.40600000000000003},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.877},"last":0.65300000000000002}]},{"osd":4,"last update":"Fri Apr 9 18:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.81499999999999995,"15min":0.82899999999999996},"min":{"1min":0.73899999999999999,"5min":0.56999999999999995,"15min":0.53300000000000003},"max":{"1min":1.1080000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.86399999999999999,"15min":0.84499999999999997},"min":{"1min":0.72599999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0629999999999999,"5min":1.0640000000000001,"15min":1.129},"last":0.79600000000000004}]},{"osd":5,"last update":"Fri Apr 9 18:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.88200000000000001,"15min":0.874},"min":{"1min":0.67800000000000005,"5min":0.443,"15min":0.443},"max":{"1min":1.141,"5min":1.306,"15min":1.8100000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.88800000000000001,"15min":0.88700000000000001},"min":{"1min":0.65000000000000002,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1659999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.83599999999999997}]},{"osd":6,"last update":"Fri Apr 9 18:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.86299999999999999,"15min":0.88100000000000001},"min":{"1min":0.61099999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.7490000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.875},"min":{"1min":0.65700000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.131,"5min":1.369,"15min":1.849},"last":0.89700000000000002}]},{"osd":7,"last update":"Fri Apr 9 18:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89200000000000002,"15min":0.86499999999999999},"min":{"1min":0.60499999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.196,"5min":1.2270000000000001,"15min":1.3520000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.90100000000000002,"15min":0.93799999999999994},"min":{"1min":0.624,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0649999999999999,"5min":1.2829999999999999,"15min":1.9350000000000001},"last":0.86299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574970,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1050272,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321568,"statfs":{"total":96636764160,"available":95561285632,"internally_reserved":1073741824,"allocated":1728512,"data_stored":793211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 9 18:35:19 2021","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52700000000000002,"15min":0.59399999999999997},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76200000000000001,"5min":0.98199999999999998,"15min":1.361},"last":0.751},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.628},"min":{"1min":0.372,"5min":0.312,"15min":0.312},"max":{"1min":0.84599999999999997,"5min":0.94699999999999995,"15min":1.4390000000000001},"last":0.46000000000000002}]},{"osd":2,"last update":"Fri Apr 9 18:35:19 2021","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59399999999999997,"15min":0.67700000000000005},"min":{"1min":0.40600000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":1.9730000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.63300000000000001,"15min":0.69399999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82899999999999996,"5min":1.0029999999999999,"15min":1.6120000000000001},"last":0.52400000000000002}]},{"osd":3,"last update":"Fri Apr 9 18:35:19 2021","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.60399999999999998,"15min":0.65600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36299999999999999},"max":{"1min":0.77200000000000002,"5min":1.0700000000000001,"15min":2.7160000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.73299999999999998,"15min":0.78200000000000003},"min":{"1min":0.48499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.3769999999999998,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":0.68200000000000005}]},{"osd":4,"last update":"Fri Apr 9 18:35:19 2021","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.874,"15min":0.92200000000000004},"min":{"1min":0.53200000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.198,"5min":1.198,"15min":2.04},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.85299999999999998,"15min":0.92200000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.52400000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":2.968},"last":0.91300000000000003}]},{"osd":5,"last update":"Fri Apr 9 18:35:19 2021","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.85999999999999999,"15min":0.93799999999999994},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.8069999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.84799999999999998,"15min":0.90700000000000003},"min":{"1min":0.62,"5min":0.62,"15min":0.57899999999999996},"max":{"1min":1.0229999999999999,"5min":1.218,"15min":2.9119999999999999},"last":0.97299999999999998}]},{"osd":6,"last update":"Fri Apr 9 18:35:19 2021","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82899999999999996,"15min":0.89300000000000002},"min":{"1min":0.64700000000000002,"5min":0.628,"15min":0.628},"max":{"1min":1.0800000000000001,"5min":1.4410000000000001,"15min":3.21},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.90900000000000003,"15min":0.98699999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.4369999999999998,"5min":2.4369999999999998,"15min":2.5430000000000001},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Apr 9 18:35:19 2021","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.93100000000000005,"15min":0.96699999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1200000000000001,"5min":1.258,"15min":2.2559999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.94699999999999995,"15min":1.014},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1379999999999999,"5min":1.381,"15min":3.8330000000000002},"last":1.0049999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574970,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1050300,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321540,"statfs":{"total":96636764160,"available":95561256960,"internally_reserved":1073741824,"allocated":1757184,"data_stored":798119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.60999999999999999},"min":{"1min":0.48099999999999998,"5min":0.314,"15min":0.20100000000000001},"max":{"1min":0.86499999999999999,"5min":0.92900000000000005,"15min":1.6910000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.625,"15min":0.67600000000000005},"min":{"1min":0.38700000000000001,"5min":0.315,"15min":0.314},"max":{"1min":1.0720000000000001,"5min":1.081,"15min":2.2799999999999998},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.64000000000000001,"15min":0.65300000000000002},"min":{"1min":0.504,"5min":0.35899999999999999,"15min":0.28299999999999997},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.1579999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68700000000000006,"15min":0.71999999999999997},"min":{"1min":0.46999999999999997,"5min":0.34899999999999998,"15min":0.26600000000000001},"max":{"1min":1.0109999999999999,"5min":1.0429999999999999,"15min":1.1890000000000001},"last":0.64700000000000002}]},{"osd":3,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58699999999999997,"15min":0.64200000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.308},"max":{"1min":0.85599999999999998,"5min":1.0629999999999999,"15min":2.5129999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69299999999999995,"15min":0.70999999999999996},"min":{"1min":0.496,"5min":0.46300000000000002,"15min":0.27400000000000002},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.246},"last":0.57999999999999996}]},{"osd":4,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88800000000000001,"15min":0.88700000000000001},"min":{"1min":0.77300000000000002,"5min":0.61199999999999999,"15min":0.54700000000000004},"max":{"1min":1.167,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.093},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.877,"15min":0.88200000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.54000000000000004},"max":{"1min":1.1060000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.85299999999999998}]},{"osd":5,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79700000000000004,"15min":0.877},"min":{"1min":0.66400000000000003,"5min":0.55800000000000005,"15min":0.45300000000000001},"max":{"1min":0.97899999999999998,"5min":1.24,"15min":3.2080000000000002},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.84799999999999998,"15min":0.88800000000000001},"min":{"1min":0.72099999999999997,"5min":0.61299999999999999,"15min":0.48099999999999998},"max":{"1min":1.232,"5min":1.3120000000000001,"15min":2.355},"last":0.78400000000000003}]},{"osd":6,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.91100000000000003,"15min":0.93700000000000006},"min":{"1min":0.68000000000000005,"5min":0.626,"15min":0.58099999999999996},"max":{"1min":1.29,"5min":1.355,"15min":1.391},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.92300000000000004,"15min":0.96899999999999997},"min":{"1min":0.76400000000000001,"5min":0.69999999999999996,"15min":0.39000000000000001},"max":{"1min":1.165,"5min":1.3999999999999999,"15min":3.141},"last":1.0249999999999999}]},{"osd":7,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89200000000000002,"15min":0.95599999999999996},"min":{"1min":0.68500000000000005,"5min":0.61699999999999999,"15min":0.41899999999999998},"max":{"1min":1.129,"5min":1.242,"15min":1.7470000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.90400000000000003,"15min":0.98999999999999999},"min":{"1min":0.82799999999999996,"5min":0.63600000000000001,"15min":0.434},"max":{"1min":1.1539999999999999,"5min":1.337,"15min":3.258},"last":0.89800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574968,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1050272,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321568,"statfs":{"total":96636764160,"available":95561285632,"internally_reserved":1073741824,"allocated":1728512,"data_stored":793211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:35:16 2021","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.434,"5min":0.317,"15min":0.28799999999999998},"max":{"1min":0.71199999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.628},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.44400000000000001,"5min":0.32900000000000001,"15min":0.29099999999999998},"max":{"1min":0.79800000000000004,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.68200000000000005}]},{"osd":1,"last update":"Fri Apr 9 18:35:16 2021","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.55400000000000005},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73499999999999999,"5min":0.749,"15min":0.89400000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67900000000000005,"15min":0.66800000000000004},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.03,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.71099999999999997}]},{"osd":2,"last update":"Fri Apr 9 18:35:16 2021","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63500000000000001,"15min":0.66900000000000004},"min":{"1min":0.42299999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.878,"5min":0.96999999999999997,"15min":1.117},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.75600000000000001,"15min":0.73299999999999998},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.35899999999999999},"max":{"1min":0.94899999999999995,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":0.77500000000000002}]},{"osd":4,"last update":"Fri Apr 9 18:35:16 2021","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.81599999999999995,"15min":0.81499999999999995},"min":{"1min":0.624,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.052,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.81000000000000005,"15min":0.79000000000000004},"min":{"1min":0.64500000000000002,"5min":0.57499999999999996,"15min":0.50700000000000001},"max":{"1min":0.94099999999999995,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.91000000000000003}]},{"osd":5,"last update":"Fri Apr 9 18:35:16 2021","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.81699999999999995,"15min":0.83299999999999996},"min":{"1min":0.61799999999999999,"5min":0.61199999999999999,"15min":0.53600000000000003},"max":{"1min":0.999,"5min":1.095,"15min":1.196},"last":0.996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.89300000000000002,"15min":0.88300000000000001},"min":{"1min":0.71899999999999997,"5min":0.57499999999999996,"15min":0.53800000000000003},"max":{"1min":1.1479999999999999,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.82899999999999996}]},{"osd":6,"last update":"Fri Apr 9 18:35:16 2021","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89500000000000002,"15min":0.91300000000000003},"min":{"1min":0.72699999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0960000000000001,"5min":1.899,"15min":1.899},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.89200000000000002,"15min":0.90400000000000003},"min":{"1min":0.65400000000000003,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1080000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.755}]},{"osd":7,"last update":"Fri Apr 9 18:35:16 2021","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.94299999999999995,"15min":0.94699999999999995},"min":{"1min":0.67600000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.143,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.89000000000000001,"15min":0.90300000000000002},"min":{"1min":0.76300000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0980000000000001,"5min":1.1879999999999999,"15min":1.252},"last":1.0369999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574969,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1050292,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321548,"statfs":{"total":96636764160,"available":95561265152,"internally_reserved":1073741824,"allocated":1728512,"data_stored":793211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.47099999999999997,"5min":0.46100000000000002,"15min":0.39600000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71299999999999997,"15min":0.71399999999999997},"min":{"1min":0.54900000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":1.373,"15min":1.8280000000000001},"last":0.748}]},{"osd":1,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.745,"15min":0.745},"min":{"1min":0.46100000000000002,"5min":0.45100000000000001,"15min":0.443},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.87},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75700000000000001,"15min":0.76300000000000001},"min":{"1min":0.59199999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.98299999999999998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.65900000000000003}]},{"osd":2,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.745,"15min":0.746},"min":{"1min":0.496,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96899999999999997,"5min":1.26,"15min":1.776},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77300000000000002,"15min":0.78400000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.84099999999999997}]},{"osd":3,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81799999999999995,"15min":0.82399999999999995},"min":{"1min":0.57999999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.159},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.83999999999999997,"15min":0.86499999999999999},"min":{"1min":0.65800000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.121,"5min":1.466,"15min":1.8600000000000001},"last":0.97799999999999998}]},{"osd":5,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.755,"15min":0.79000000000000004},"min":{"1min":0.54800000000000004,"5min":0.46000000000000002,"15min":0.41499999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.1850000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82699999999999996,"15min":0.84199999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.497},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.80900000000000005}]},{"osd":6,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.86199999999999999,"15min":0.92700000000000005},"min":{"1min":0.624,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.248},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.91300000000000003,"15min":0.93700000000000006},"min":{"1min":0.71399999999999997,"5min":0.61399999999999999,"15min":0.45200000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.546},"last":0.99199999999999999}]},{"osd":7,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.84199999999999997,"15min":0.86399999999999999},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":1.1259999999999999,"5min":1.4350000000000001,"15min":1.893},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.91600000000000004,"15min":0.95599999999999996},"min":{"1min":0.74299999999999999,"5min":0.55400000000000005,"15min":0.48599999999999999},"max":{"1min":1.298,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.96199999999999997}]}]}]}} 2021-04-09T18:35:55.736 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:35:55.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e809c700 1 Processor -- start 2021-04-09T18:35:55.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e809c700 1 -- start start 2021-04-09T18:35:55.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e809c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f43e00f5510 0x7f43e00f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e809c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e01c8000 0x7f43e01ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e809c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e00fbb10 con 0x7f43e00e9ad0 2021-04-09T18:35:55.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e809c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e00e9f20 con 0x7f43e00f5510 2021-04-09T18:35:55.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e809c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e01c3db0 con 0x7f43e01c8000 2021-04-09T18:35:55.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e563f700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f43e00e9ad0 0x7f43e009f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58916/0 (socket says 172.21.15.79:58916) 2021-04-09T18:35:55.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e563f700 1 -- 172.21.15.79:0/773252368 learned_addr learned my addr 172.21.15.79:0/773252368 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:55.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e6641700 1 --2- 172.21.15.79:0/773252368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e01c8000 0x7f43e01ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e5e40700 1 --2- 172.21.15.79:0/773252368 >> v2:172.21.15.89:3300/0 conn(0x7f43e00f5510 0x7f43e00f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e4e3e700 1 -- 172.21.15.79:0/773252368 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703746688 0 0) 0x7f43d00010d0 con 0x7f43e00e9ad0 2021-04-09T18:35:55.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e4e3e700 1 -- 172.21.15.79:0/773252368 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43cc003240 con 0x7f43e00e9ad0 2021-04-09T18:35:55.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e4e3e700 1 -- 172.21.15.79:0/773252368 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1426236175 0 0) 0x7f43d0001650 con 0x7f43e00e9ad0 2021-04-09T18:35:55.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e4e3e700 1 -- 172.21.15.79:0/773252368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e01c8000 msgr2=0x7f43e01ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:55.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e4e3e700 1 --2- 172.21.15.79:0/773252368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e01c8000 0x7f43e01ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e4e3e700 1 -- 172.21.15.79:0/773252368 >> v2:172.21.15.89:3300/0 conn(0x7f43e00f5510 msgr2=0x7f43e00f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:55.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e4e3e700 1 --2- 172.21.15.79:0/773252368 >> v2:172.21.15.89:3300/0 conn(0x7f43e00f5510 0x7f43e00f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e4e3e700 1 -- 172.21.15.79:0/773252368 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e009f900 con 0x7f43e00e9ad0 2021-04-09T18:35:55.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e4e3e700 1 -- 172.21.15.79:0/773252368 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2105717127 0 0) 0x7f43d0001bb0 con 0x7f43e00e9ad0 2021-04-09T18:35:55.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e4e3e700 1 -- 172.21.15.79:0/773252368 >> v1:172.21.15.79:6789/0 conn(0x7f43e00e9ad0 legacy=0x7f43e009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:55.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e4e3e700 1 --2- 172.21.15.79:0/773252368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43cc0038f0 0x7f43cc003d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e4e3e700 1 --2- 172.21.15.79:0/773252368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43cc0045a0 0x7f43cc0049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e4e3e700 1 --2- 172.21.15.79:0/773252368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43cc005070 0x7f43cc04f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e4e3e700 1 -- 172.21.15.79:0/773252368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e00e9f20 con 0x7f43cc005070 2021-04-09T18:35:55.838 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e4e3e700 1 -- 172.21.15.79:0/773252368 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e01c3db0 con 0x7f43cc0045a0 2021-04-09T18:35:55.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e4e3e700 1 -- 172.21.15.79:0/773252368 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc04ffa0 con 0x7f43cc0038f0 2021-04-09T18:35:55.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e6641700 1 --2- 172.21.15.79:0/773252368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43cc005070 0x7f43cc04f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e563f700 1 --2- 172.21.15.79:0/773252368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43cc0045a0 0x7f43cc0049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e5e40700 1 --2- 172.21.15.79:0/773252368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43cc0038f0 0x7f43cc003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.839 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e6641700 1 -- 172.21.15.79:0/773252368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43cc0038f0 msgr2=0x7f43cc003d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:55.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e6641700 1 --2- 172.21.15.79:0/773252368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43cc0038f0 0x7f43cc003d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e6641700 1 -- 172.21.15.79:0/773252368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43cc0045a0 msgr2=0x7f43cc0049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:55.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e6641700 1 --2- 172.21.15.79:0/773252368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43cc0045a0 0x7f43cc0049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.818 7f43e6641700 1 -- 172.21.15.79:0/773252368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc050290 con 0x7f43cc005070 2021-04-09T18:35:55.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.822 7f43e6641700 1 --2- 172.21.15.79:0/773252368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43cc005070 0x7f43cc04f800 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f43d800c000 tx=0x7f43d8009f70).ready entity=mon.0 client_cookie=61988b51c564a669 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:55.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.822 7f43e4e3e700 1 -- 172.21.15.79:0/773252368 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f43cc050290 con 0x7f43cc005070 2021-04-09T18:35:55.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.822 7f43e4e3e700 1 -- 172.21.15.79:0/773252368 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d800ecf0 con 0x7f43cc005070 2021-04-09T18:35:55.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.822 7f43e4e3e700 1 -- 172.21.15.79:0/773252368 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f43d800f040 con 0x7f43cc005070 2021-04-09T18:35:55.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.822 7f43e809c700 1 -- 172.21.15.79:0/773252368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43cc005070 msgr2=0x7f43cc04f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:55.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.822 7f43e809c700 1 --2- 172.21.15.79:0/773252368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43cc005070 0x7f43cc04f800 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f43d800c000 tx=0x7f43d8009f70).stop 2021-04-09T18:35:55.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.822 7f43e6641700 1 -- 172.21.15.79:0/773252368 reap_dead start 2021-04-09T18:35:55.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.822 7f43e809c700 1 -- 172.21.15.79:0/773252368 shutdown_connections 2021-04-09T18:35:55.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.822 7f43e809c700 1 -- 172.21.15.79:0/773252368 >> 172.21.15.79:0/773252368 conn(0x7f43e00e5fd0 msgr2=0x7f43e00e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:55.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.822 7f43e809c700 1 -- 172.21.15.79:0/773252368 shutdown_connections 2021-04-09T18:35:55.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.822 7f43e809c700 1 -- 172.21.15.79:0/773252368 wait complete. 2021-04-09T18:35:55.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.826 7f43e809c700 1 Processor -- start 2021-04-09T18:35:55.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.826 7f43e809c700 1 -- start start 2021-04-09T18:35:55.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.826 7f43e809c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e019d7b0 0x7f43e00c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.826 7f43e809c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e0099480 0x7f43e00a3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.826 7f43e809c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e00a2860 0x7f43e00d4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.826 7f43e809c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e019bbb0 con 0x7f43e019d7b0 2021-04-09T18:35:55.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.826 7f43e809c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e019beb0 con 0x7f43e00a2860 2021-04-09T18:35:55.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.826 7f43e809c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e00a3890 con 0x7f43e0099480 2021-04-09T18:35:55.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.826 7f43e5e40700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e019d7b0 0x7f43e00c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.826 7f43e5e40700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e019d7b0 0x7f43e00c3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35986/0 (socket says 172.21.15.79:35986) 2021-04-09T18:35:55.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.826 7f43e5e40700 1 -- 172.21.15.79:0/1799254600 learned_addr learned my addr 172.21.15.79:0/1799254600 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:55.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.826 7f43e563f700 1 --2- 172.21.15.79:0/1799254600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e0099480 0x7f43e00a3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.826 7f43e6641700 1 --2- 172.21.15.79:0/1799254600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e00a2860 0x7f43e00d4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.830 7f43e5e40700 1 -- 172.21.15.79:0/1799254600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e0099480 msgr2=0x7f43e00a3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:55.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.830 7f43e5e40700 1 --2- 172.21.15.79:0/1799254600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e0099480 0x7f43e00a3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.830 7f43e5e40700 1 -- 172.21.15.79:0/1799254600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e00a2860 msgr2=0x7f43e00d4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:55.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.830 7f43e5e40700 1 --2- 172.21.15.79:0/1799254600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e00a2860 0x7f43e00d4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:55.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.830 7f43e5e40700 1 -- 172.21.15.79:0/1799254600 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e00a2cb0 con 0x7f43e019d7b0 2021-04-09T18:35:55.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.830 7f43e563f700 1 --2- 172.21.15.79:0/1799254600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e0099480 0x7f43e00a3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:55.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.830 7f43e5e40700 1 --2- 172.21.15.79:0/1799254600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e019d7b0 0x7f43e00c3fb0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f43e00d8380 tx=0x7f43dc00f520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:55.850 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.830 7f43d67fc700 1 -- 172.21.15.79:0/1799254600 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f43e00a2cb0 con 0x7f43e019d7b0 2021-04-09T18:35:55.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.830 7f43d67fc700 1 -- 172.21.15.79:0/1799254600 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc00fa50 con 0x7f43e019d7b0 2021-04-09T18:35:55.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.830 7f43e809c700 1 -- 172.21.15.79:0/1799254600 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e00d5430 con 0x7f43e019d7b0 2021-04-09T18:35:55.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.830 7f43d67fc700 1 -- 172.21.15.79:0/1799254600 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f43dc00f040 con 0x7f43e019d7b0 2021-04-09T18:35:55.851 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.830 7f43e809c700 1 -- 172.21.15.79:0/1799254600 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e00d5960 con 0x7f43e019d7b0 2021-04-09T18:35:55.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.830 7f43d67fc700 1 -- 172.21.15.79:0/1799254600 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f43dc00fc30 con 0x7f43e019d7b0 2021-04-09T18:35:55.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.830 7f43d67fc700 1 --2- 172.21.15.79:0/1799254600 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f43c8029100 0x7f43c802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:55.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.830 7f43d67fc700 1 -- 172.21.15.79:0/1799254600 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f43dc023060 con 0x7f43e019d7b0 2021-04-09T18:35:55.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.830 7f43e563f700 1 --2- 172.21.15.79:0/1799254600 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f43c8029100 0x7f43c802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:55.852 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.830 7f43e563f700 1 --2- 172.21.15.79:0/1799254600 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f43c8029100 0x7f43c802b650 crc :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:55.853 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.846 7f43e809c700 1 -- 172.21.15.79:0/1799254600 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e00e39d0 con 0x7f43e019d7b0 2021-04-09T18:35:55.861 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:55.854 7f43d67fc700 1 -- 172.21.15.79:0/1799254600 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f43dc011db0 con 0x7f43e019d7b0 2021-04-09T18:35:56.033 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:56.026 7f43e809c700 1 -- 172.21.15.79:0/1799254600 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43e00a1cb0 con 0x7f43e019d7b0 2021-04-09T18:35:56.034 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:56.026 7f43d67fc700 1 -- 172.21.15.79:0/1799254600 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+11626 (secure 0 0 0) 0x7f43dc02dd80 con 0x7f43e019d7b0 2021-04-09T18:35:56.036 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:35:56.036 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":138,"fsid":"fc927781-121d-4817-b30c-0c6f9e107f84","created":"2021-04-09 18:25:53.111554","modified":"2021-04-09 18:35:53.899915","last_up_change":"2021-04-09 18:26:01.966378","last_in_change":"2021-04-09 18:26:01.966378","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:26:06.311357","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c93158fb-a785-4502-86ef-88ead369a3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":13961},{"type":"v1","addr":"172.21.15.79:6804","nonce":13961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":13961},{"type":"v1","addr":"172.21.15.79:6808","nonce":13961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":13961},{"type":"v1","addr":"172.21.15.79:6815","nonce":13961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":13961},{"type":"v1","addr":"172.21.15.79:6812","nonce":13961}]},"public_addr":"172.21.15.79:6804/13961","cluster_addr":"172.21.15.79:6808/13961","heartbeat_back_addr":"172.21.15.79:6815/13961","heartbeat_front_addr":"172.21.15.79:6812/13961","state":["exists","up"]},{"osd":1,"uuid":"cfc0e117-1dd7-40de-9774-b60b84f691dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":13963},{"type":"v1","addr":"172.21.15.79:6801","nonce":13963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":13963},{"type":"v1","addr":"172.21.15.79:6805","nonce":13963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":13963},{"type":"v1","addr":"172.21.15.79:6813","nonce":13963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":13963},{"type":"v1","addr":"172.21.15.79:6809","nonce":13963}]},"public_addr":"172.21.15.79:6801/13963","cluster_addr":"172.21.15.79:6805/13963","heartbeat_back_addr":"172.21.15.79:6813/13963","heartbeat_front_addr":"172.21.15.79:6809/13963","state":["exists","up"]},{"osd":2,"uuid":"3e132e36-804a-4e09-bf33-351ef28cc52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":13962},{"type":"v1","addr":"172.21.15.79:6817","nonce":13962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":13962},{"type":"v1","addr":"172.21.15.79:6819","nonce":13962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":13962},{"type":"v1","addr":"172.21.15.79:6823","nonce":13962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":13962},{"type":"v1","addr":"172.21.15.79:6821","nonce":13962}]},"public_addr":"172.21.15.79:6817/13962","cluster_addr":"172.21.15.79:6819/13962","heartbeat_back_addr":"172.21.15.79:6823/13962","heartbeat_front_addr":"172.21.15.79:6821/13962","state":["exists","up"]},{"osd":3,"uuid":"5bee6c91-4f04-4f4d-9643-80d7ae17feb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":13987},{"type":"v1","addr":"172.21.15.79:6825","nonce":13987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":13987},{"type":"v1","addr":"172.21.15.79:6827","nonce":13987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":13987},{"type":"v1","addr":"172.21.15.79:6831","nonce":13987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":13987},{"type":"v1","addr":"172.21.15.79:6829","nonce":13987}]},"public_addr":"172.21.15.79:6825/13987","cluster_addr":"172.21.15.79:6827/13987","heartbeat_back_addr":"172.21.15.79:6831/13987","heartbeat_front_addr":"172.21.15.79:6829/13987","state":["exists","up"]},{"osd":4,"uuid":"c0d62925-071d-468c-8425-fedf7ef98e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":14212},{"type":"v1","addr":"172.21.15.89:6827","nonce":14212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":14212},{"type":"v1","addr":"172.21.15.89:6829","nonce":14212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":14212},{"type":"v1","addr":"172.21.15.89:6833","nonce":14212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":14212},{"type":"v1","addr":"172.21.15.89:6831","nonce":14212}]},"public_addr":"172.21.15.89:6827/14212","cluster_addr":"172.21.15.89:6829/14212","heartbeat_back_addr":"172.21.15.89:6833/14212","heartbeat_front_addr":"172.21.15.89:6831/14212","state":["exists","up"]},{"osd":5,"uuid":"27d54918-b90c-4c75-b31b-e3ac664baee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":14210},{"type":"v1","addr":"172.21.15.89:6811","nonce":14210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":14210},{"type":"v1","addr":"172.21.15.89:6813","nonce":14210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":14210},{"type":"v1","addr":"172.21.15.89:6817","nonce":14210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":14210},{"type":"v1","addr":"172.21.15.89:6815","nonce":14210}]},"public_addr":"172.21.15.89:6811/14210","cluster_addr":"172.21.15.89:6813/14210","heartbeat_back_addr":"172.21.15.89:6817/14210","heartbeat_front_addr":"172.21.15.89:6815/14210","state":["exists","up"]},{"osd":6,"uuid":"d3e702a2-a197-49dd-b937-5b81239f2654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":14211},{"type":"v1","addr":"172.21.15.89:6803","nonce":14211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":14211},{"type":"v1","addr":"172.21.15.89:6805","nonce":14211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":14211},{"type":"v1","addr":"172.21.15.89:6809","nonce":14211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":14211},{"type":"v1","addr":"172.21.15.89:6807","nonce":14211}]},"public_addr":"172.21.15.89:6803/14211","cluster_addr":"172.21.15.89:6805/14211","heartbeat_back_addr":"172.21.15.89:6809/14211","heartbeat_front_addr":"172.21.15.89:6807/14211","state":["exists","up"]},{"osd":7,"uuid":"88f940d9-7a5a-4c50-9e09-de72bf87623f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":14233},{"type":"v1","addr":"172.21.15.89:6819","nonce":14233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":14233},{"type":"v1","addr":"172.21.15.89:6821","nonce":14233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":14233},{"type":"v1","addr":"172.21.15.89:6825","nonce":14233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":14233},{"type":"v1","addr":"172.21.15.89:6823","nonce":14233}]},"public_addr":"172.21.15.89:6819/14233","cluster_addr":"172.21.15.89:6821/14233","heartbeat_back_addr":"172.21.15.89:6825/14233","heartbeat_front_addr":"172.21.15.89:6823/14233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.89:6834/4071560647":"2021-04-10 18:35:50.664130","172.21.15.89:6835/1552365531":"2021-04-10 18:35:39.980332","172.21.15.89:6835/4071560647":"2021-04-10 18:35:50.664130","172.21.15.89:6834/1552365531":"2021-04-10 18:35:39.980332"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:35:56.038 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:56.030 7f43e809c700 1 -- 172.21.15.79:0/1799254600 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f43c8029100 msgr2=0x7f43c802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:56.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:56.030 7f43e809c700 1 --2- 172.21.15.79:0/1799254600 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f43c8029100 0x7f43c802b650 crc :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:56.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:56.030 7f43e809c700 1 -- 172.21.15.79:0/1799254600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e019d7b0 msgr2=0x7f43e00c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:56.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:56.030 7f43e809c700 1 --2- 172.21.15.79:0/1799254600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e019d7b0 0x7f43e00c3fb0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f43e00d8380 tx=0x7f43dc00f520).stop 2021-04-09T18:35:56.039 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:56.030 7f43e809c700 1 -- 172.21.15.79:0/1799254600 shutdown_connections 2021-04-09T18:35:56.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:56.030 7f43e809c700 1 --2- 172.21.15.79:0/1799254600 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f43c8029100 0x7f43c802b650 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:56.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:56.030 7f43e809c700 1 --2- 172.21.15.79:0/1799254600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e00a2860 0x7f43e00d4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:56.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:56.030 7f43e809c700 1 --2- 172.21.15.79:0/1799254600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e019d7b0 0x7f43e00c3fb0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:56.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:56.030 7f43e809c700 1 --2- 172.21.15.79:0/1799254600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e0099480 0x7f43e00a3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:56.040 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:56.030 7f43e809c700 1 -- 172.21.15.79:0/1799254600 >> 172.21.15.79:0/1799254600 conn(0x7f43e009b2c0 msgr2=0x7f43e009a820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:56.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:56.034 7f43e809c700 1 -- 172.21.15.79:0/1799254600 shutdown_connections 2021-04-09T18:35:56.041 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:56.034 7f43e809c700 1 -- 172.21.15.79:0/1799254600 wait complete. 2021-04-09T18:35:57.054 INFO:tasks.ceph:Scrubbing osd.0 2021-04-09T18:35:57.055 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2021-04-09T18:35:57.167 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.150 7fe17441c700 1 Processor -- start 2021-04-09T18:35:57.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.150 7fe17441c700 1 -- start start 2021-04-09T18:35:57.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe17441c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe16c0f5550 0x7fe16c0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.168 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe17441c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe16c0e9b10 0x7fe16c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe17441c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe16c1c2de0 0x7fe16c1c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe17441c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16c0e9f60 con 0x7fe16c0e9b10 2021-04-09T18:35:57.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe17441c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16c0e5a00 con 0x7fe16c1c2de0 2021-04-09T18:35:57.169 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe17441c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c0fbb50 con 0x7fe16c0f5550 2021-04-09T18:35:57.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe1719bf700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe16c0e9b10 0x7fe16c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe1719bf700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe16c0e9b10 0x7fe16c09f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35996/0 (socket says 172.21.15.79:35996) 2021-04-09T18:35:57.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe1719bf700 1 -- 172.21.15.79:0/1476028037 learned_addr learned my addr 172.21.15.79:0/1476028037 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:57.170 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe1721c0700 1 --2- 172.21.15.79:0/1476028037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe16c0f5550 0x7fe16c0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe1729c1700 1 --2- 172.21.15.79:0/1476028037 >> v2:172.21.15.89:3300/0 conn(0x7fe16c1c2de0 0x7fe16c1c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe1719bf700 1 -- 172.21.15.79:0/1476028037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe16c0f5550 msgr2=0x7fe16c0f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:57.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe1719bf700 1 --2- 172.21.15.79:0/1476028037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe16c0f5550 0x7fe16c0f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.171 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe1719bf700 1 -- 172.21.15.79:0/1476028037 >> v2:172.21.15.89:3300/0 conn(0x7fe16c1c2de0 msgr2=0x7fe16c1c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:57.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe1719bf700 1 --2- 172.21.15.79:0/1476028037 >> v2:172.21.15.89:3300/0 conn(0x7fe16c1c2de0 0x7fe16c1c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe1719bf700 1 -- 172.21.15.79:0/1476028037 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c0e5700 con 0x7fe16c0e9b10 2021-04-09T18:35:57.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe1721c0700 1 --2- 172.21.15.79:0/1476028037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe16c0f5550 0x7fe16c0f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:57.172 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe1719bf700 1 --2- 172.21.15.79:0/1476028037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c0e9b10 0x7fe16c09f110 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7fe15c002f30 tx=0x7fe15c00bd70).ready entity=mon.0 client_cookie=eb3f66c1f1ecbd85 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:57.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe1711be700 1 -- 172.21.15.79:0/1476028037 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe16c0e5700 con 0x7fe16c0e9b10 2021-04-09T18:35:57.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe1711be700 1 -- 172.21.15.79:0/1476028037 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15c0098b0 con 0x7fe16c0e9b10 2021-04-09T18:35:57.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe1711be700 1 -- 172.21.15.79:0/1476028037 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe15c009c80 con 0x7fe16c0e9b10 2021-04-09T18:35:57.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe17441c700 1 -- 172.21.15.79:0/1476028037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c0e9b10 msgr2=0x7fe16c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.173 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe17441c700 1 --2- 172.21.15.79:0/1476028037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c0e9b10 0x7fe16c09f110 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7fe15c002f30 tx=0x7fe15c00bd70).stop 2021-04-09T18:35:57.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe17441c700 1 -- 172.21.15.79:0/1476028037 shutdown_connections 2021-04-09T18:35:57.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe17441c700 1 --2- 172.21.15.79:0/1476028037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe16c0f5550 0x7fe16c0f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe17441c700 1 --2- 172.21.15.79:0/1476028037 >> v2:172.21.15.89:3300/0 conn(0x7fe16c1c2de0 0x7fe16c1c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe17441c700 1 --2- 172.21.15.79:0/1476028037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c0e9b10 0x7fe16c09f110 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.174 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe17441c700 1 -- 172.21.15.79:0/1476028037 >> 172.21.15.79:0/1476028037 conn(0x7fe16c0e6010 msgr2=0x7fe16c0e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:57.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe17441c700 1 -- 172.21.15.79:0/1476028037 shutdown_connections 2021-04-09T18:35:57.175 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.154 7fe17441c700 1 -- 172.21.15.79:0/1476028037 wait complete. 2021-04-09T18:35:57.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.158 7fe17441c700 1 Processor -- start 2021-04-09T18:35:57.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.158 7fe17441c700 1 -- start start 2021-04-09T18:35:57.176 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.158 7fe17441c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c0988d0 0x7fe16c0c2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.158 7fe17441c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe16c0baf20 0x7fe16c1ad920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.177 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.158 7fe17441c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe16c0bfeb0 0x7fe16c1b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.158 7fe17441c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c0c0f10 con 0x7fe16c0988d0 2021-04-09T18:35:57.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.158 7fe17441c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c0c1210 con 0x7fe16c0baf20 2021-04-09T18:35:57.178 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.158 7fe17441c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c0c2dc0 con 0x7fe16c0bfeb0 2021-04-09T18:35:57.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.158 7fe1721c0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c0988d0 0x7fe16c0c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.179 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.158 7fe1721c0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c0988d0 0x7fe16c0c2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36000/0 (socket says 172.21.15.79:36000) 2021-04-09T18:35:57.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.158 7fe1721c0700 1 -- 172.21.15.79:0/2479546653 learned_addr learned my addr 172.21.15.79:0/2479546653 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:57.180 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.158 7fe1719bf700 1 --2- 172.21.15.79:0/2479546653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe16c0baf20 0x7fe16c1ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.158 7fe1729c1700 1 --2- 172.21.15.79:0/2479546653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe16c0bfeb0 0x7fe16c1b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.181 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.158 7fe1721c0700 1 -- 172.21.15.79:0/2479546653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe16c0bfeb0 msgr2=0x7fe16c1b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.158 7fe1721c0700 1 --2- 172.21.15.79:0/2479546653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe16c0bfeb0 0x7fe16c1b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.158 7fe1721c0700 1 -- 172.21.15.79:0/2479546653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe16c0baf20 msgr2=0x7fe16c1ad920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.182 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.158 7fe1721c0700 1 --2- 172.21.15.79:0/2479546653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe16c0baf20 0x7fe16c1ad920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.158 7fe1721c0700 1 -- 172.21.15.79:0/2479546653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c1adf50 con 0x7fe16c0988d0 2021-04-09T18:35:57.183 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.158 7fe1721c0700 1 --2- 172.21.15.79:0/2479546653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c0988d0 0x7fe16c0c2790 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7fe16800efc0 tx=0x7fe16800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:57.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.158 7fe162ffd700 1 -- 172.21.15.79:0/2479546653 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe16800f040 con 0x7fe16c0988d0 2021-04-09T18:35:57.184 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.162 7fe162ffd700 1 -- 172.21.15.79:0/2479546653 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1680123f0 con 0x7fe16c0988d0 2021-04-09T18:35:57.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.162 7fe17441c700 1 -- 172.21.15.79:0/2479546653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe16c0c0300 con 0x7fe16c0988d0 2021-04-09T18:35:57.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.162 7fe162ffd700 1 -- 172.21.15.79:0/2479546653 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1680127c0 con 0x7fe16c0988d0 2021-04-09T18:35:57.185 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.162 7fe17441c700 1 -- 172.21.15.79:0/2479546653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16c1b16a0 con 0x7fe16c0988d0 2021-04-09T18:35:57.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.162 7fe162ffd700 1 -- 172.21.15.79:0/2479546653 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe168011070 con 0x7fe16c0988d0 2021-04-09T18:35:57.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.162 7fe162ffd700 1 --2- 172.21.15.79:0/2479546653 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe154029100 0x7fe15402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.162 7fe162ffd700 1 -- 172.21.15.79:0/2479546653 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7fe168010040 con 0x7fe16c0988d0 2021-04-09T18:35:57.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.162 7fe1719bf700 1 --2- 172.21.15.79:0/2479546653 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe154029100 0x7fe15402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.162 7fe1719bf700 1 --2- 172.21.15.79:0/2479546653 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe154029100 0x7fe15402b650 crc :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:57.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.166 7fe17441c700 1 --2- 172.21.15.79:0/2479546653 >> [v2:172.21.15.79:6802/13961,v1:172.21.15.79:6804/13961] conn(0x7fe16c049150 0x7fe16c0495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.166 7fe17441c700 1 -- 172.21.15.79:0/2479546653 --> [v2:172.21.15.79:6802/13961,v1:172.21.15.79:6804/13961] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe16c0e39f0 con 0x7fe16c049150 2021-04-09T18:35:57.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.166 7fe1729c1700 1 --2- 172.21.15.79:0/2479546653 >> [v2:172.21.15.79:6802/13961,v1:172.21.15.79:6804/13961] conn(0x7fe16c049150 0x7fe16c0495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.166 7fe1729c1700 1 --2- 172.21.15.79:0/2479546653 >> [v2:172.21.15.79:6802/13961,v1:172.21.15.79:6804/13961] conn(0x7fe16c049150 0x7fe16c0495a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:57.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.166 7fe162ffd700 1 -- 172.21.15.79:0/2479546653 <== osd.0 v2:172.21.15.79:6802/13961 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7fe16c0e39f0 con 0x7fe16c049150 2021-04-09T18:35:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.178 7fe17441c700 1 -- 172.21.15.79:0/2479546653 --> [v2:172.21.15.79:6802/13961,v1:172.21.15.79:6804/13961] -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7fe16c0f5b50 con 0x7fe16c049150 2021-04-09T18:35:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.178 7fe162ffd700 1 -- 172.21.15.79:0/2479546653 <== osd.0 v2:172.21.15.79:6802/13961 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (crc 0 0 0) 0x7fe16c0f5b50 con 0x7fe16c049150 2021-04-09T18:35:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:Set osd_debug_deep_scrub_sleep to 0 2021-04-09T18:35:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.178 7fe17441c700 1 -- 172.21.15.79:0/2479546653 >> [v2:172.21.15.79:6802/13961,v1:172.21.15.79:6804/13961] conn(0x7fe16c049150 msgr2=0x7fe16c0495a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.178 7fe17441c700 1 --2- 172.21.15.79:0/2479546653 >> [v2:172.21.15.79:6802/13961,v1:172.21.15.79:6804/13961] conn(0x7fe16c049150 0x7fe16c0495a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.178 7fe17441c700 1 -- 172.21.15.79:0/2479546653 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe154029100 msgr2=0x7fe15402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.178 7fe17441c700 1 --2- 172.21.15.79:0/2479546653 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fe154029100 0x7fe15402b650 crc :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.178 7fe17441c700 1 -- 172.21.15.79:0/2479546653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c0988d0 msgr2=0x7fe16c0c2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.178 7fe17441c700 1 --2- 172.21.15.79:0/2479546653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c0988d0 0x7fe16c0c2790 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7fe16800efc0 tx=0x7fe16800c430).stop 2021-04-09T18:35:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.182 7fe1729c1700 1 -- 172.21.15.79:0/2479546653 reap_dead start 2021-04-09T18:35:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.182 7fe17441c700 1 -- 172.21.15.79:0/2479546653 shutdown_connections 2021-04-09T18:35:57.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.182 7fe17441c700 1 -- 172.21.15.79:0/2479546653 >> 172.21.15.79:0/2479546653 conn(0x7fe16c09b1e0 msgr2=0x7fe16c09a540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:57.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.182 7fe17441c700 1 -- 172.21.15.79:0/2479546653 shutdown_connections 2021-04-09T18:35:57.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.182 7fe17441c700 1 -- 172.21.15.79:0/2479546653 wait complete. 2021-04-09T18:35:57.201 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2021-04-09T18:35:57.318 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f6041f88700 1 Processor -- start 2021-04-09T18:35:57.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f6041f88700 1 -- start start 2021-04-09T18:35:57.319 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f6041f88700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f603c0f5520 0x7f603c0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f6041f88700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f603c0e9ae0 0x7f603c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.320 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f6041f88700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603c0fbb20 con 0x7f603c1c2db0 2021-04-09T18:35:57.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f6041f88700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603c0e9f30 con 0x7f603c0e9ae0 2021-04-09T18:35:57.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f6041f88700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603c0e59d0 con 0x7f603c0f5520 2021-04-09T18:35:57.321 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f603affd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f603c0e9ae0 0x7f603c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f603affd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f603c0e9ae0 0x7f603c09f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36012/0 (socket says 172.21.15.79:36012) 2021-04-09T18:35:57.322 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f603affd700 1 -- 172.21.15.79:0/1332770676 learned_addr learned my addr 172.21.15.79:0/1332770676 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:57.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f603bfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f603c1c2db0 0x7f603c1c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58956/0 (socket says 172.21.15.79:58956) 2021-04-09T18:35:57.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f603b7fe700 1 --2- 172.21.15.79:0/1332770676 >> v2:172.21.15.89:3300/0 conn(0x7f603c0f5520 0x7f603c0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.323 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f603affd700 1 -- 172.21.15.79:0/1332770676 >> v2:172.21.15.89:3300/0 conn(0x7f603c0f5520 msgr2=0x7f603c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:57.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f603affd700 1 --2- 172.21.15.79:0/1332770676 >> v2:172.21.15.89:3300/0 conn(0x7f603c0f5520 0x7f603c0f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f603affd700 1 -- 172.21.15.79:0/1332770676 >> v1:172.21.15.79:6789/0 conn(0x7f603c1c2db0 legacy=0x7f603c1c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.324 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f603a7fc700 1 -- 172.21.15.79:0/1332770676 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 711996285 0 0) 0x7f60340010d0 con 0x7f603c1c2db0 2021-04-09T18:35:57.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f603affd700 1 -- 172.21.15.79:0/1332770676 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c0e56d0 con 0x7f603c0e9ae0 2021-04-09T18:35:57.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f603b7fe700 1 --2- 172.21.15.79:0/1332770676 >> v2:172.21.15.89:3300/0 conn(0x7f603c0f5520 0x7f603c0f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:57.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f603affd700 1 --2- 172.21.15.79:0/1332770676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c0e9ae0 0x7f603c09f110 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f6024002f30 tx=0x7f602400bd70).ready entity=mon.0 client_cookie=1e257f656708246a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:57.325 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f603a7fc700 1 -- 172.21.15.79:0/1332770676 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f603c0e56d0 con 0x7f603c0e9ae0 2021-04-09T18:35:57.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f603a7fc700 1 -- 172.21.15.79:0/1332770676 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6024009950 con 0x7f603c0e9ae0 2021-04-09T18:35:57.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f603a7fc700 1 -- 172.21.15.79:0/1332770676 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6024009d20 con 0x7f603c0e9ae0 2021-04-09T18:35:57.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f6041f88700 1 -- 172.21.15.79:0/1332770676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c0e9ae0 msgr2=0x7f603c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.326 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.306 7f6041f88700 1 --2- 172.21.15.79:0/1332770676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c0e9ae0 0x7f603c09f110 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f6024002f30 tx=0x7f602400bd70).stop 2021-04-09T18:35:57.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.310 7f6041f88700 1 -- 172.21.15.79:0/1332770676 shutdown_connections 2021-04-09T18:35:57.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.310 7f6041f88700 1 --2- 172.21.15.79:0/1332770676 >> v2:172.21.15.89:3300/0 conn(0x7f603c0f5520 0x7f603c0f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.310 7f6041f88700 1 --2- 172.21.15.79:0/1332770676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c0e9ae0 0x7f603c09f110 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.327 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.310 7f6041f88700 1 -- 172.21.15.79:0/1332770676 >> 172.21.15.79:0/1332770676 conn(0x7f603c0e5fe0 msgr2=0x7f603c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:57.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.310 7f6041f88700 1 -- 172.21.15.79:0/1332770676 shutdown_connections 2021-04-09T18:35:57.328 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.310 7f6041f88700 1 -- 172.21.15.79:0/1332770676 wait complete. 2021-04-09T18:35:57.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f6041f88700 1 Processor -- start 2021-04-09T18:35:57.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f6041f88700 1 -- start start 2021-04-09T18:35:57.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f6041f88700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f603c0b9060 0x7f603c090b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.331 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f6041f88700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f603c0d6980 0x7f603c0d4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f6041f88700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c0ce8c0 0x7f603c0ced10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f6041f88700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c090810 con 0x7f603c0ce8c0 2021-04-09T18:35:57.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f6041f88700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0d6dd0 con 0x7f603c0b9060 2021-04-09T18:35:57.332 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f6041f88700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0d55d0 con 0x7f603c0d6980 2021-04-09T18:35:57.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f603bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c0ce8c0 0x7f603c0ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f603bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c0ce8c0 0x7f603c0ced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36020/0 (socket says 172.21.15.79:36020) 2021-04-09T18:35:57.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f603bfff700 1 -- 172.21.15.79:0/2783202489 learned_addr learned my addr 172.21.15.79:0/2783202489 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:57.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f603b7fe700 1 --2- 172.21.15.79:0/2783202489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f603c0b9060 0x7f603c090b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.333 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f603affd700 1 --2- 172.21.15.79:0/2783202489 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f603c0d6980 0x7f603c0d4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f603bfff700 1 -- 172.21.15.79:0/2783202489 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f603c0d6980 msgr2=0x7f603c0d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f603bfff700 1 --2- 172.21.15.79:0/2783202489 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f603c0d6980 0x7f603c0d4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f603bfff700 1 -- 172.21.15.79:0/2783202489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f603c0b9060 msgr2=0x7f603c090b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.334 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f603bfff700 1 --2- 172.21.15.79:0/2783202489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f603c0b9060 0x7f603c090b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f603bfff700 1 -- 172.21.15.79:0/2783202489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c0903a0 con 0x7f603c0ce8c0 2021-04-09T18:35:57.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f603bfff700 1 --2- 172.21.15.79:0/2783202489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c0ce8c0 0x7f603c0ced10 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7f603c094f80 tx=0x7f603400cb00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:57.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f6033fff700 1 -- 172.21.15.79:0/2783202489 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f603c0903a0 con 0x7f603c0ce8c0 2021-04-09T18:35:57.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f6033fff700 1 -- 172.21.15.79:0/2783202489 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6034007320 con 0x7f603c0ce8c0 2021-04-09T18:35:57.335 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f6041f88700 1 -- 172.21.15.79:0/2783202489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603c0cf340 con 0x7f603c0ce8c0 2021-04-09T18:35:57.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f6033fff700 1 -- 172.21.15.79:0/2783202489 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6034005720 con 0x7f603c0ce8c0 2021-04-09T18:35:57.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.314 7f6041f88700 1 -- 172.21.15.79:0/2783202489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603c0d7d10 con 0x7f603c0ce8c0 2021-04-09T18:35:57.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.318 7f6033fff700 1 -- 172.21.15.79:0/2783202489 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f603401a020 con 0x7f603c0ce8c0 2021-04-09T18:35:57.336 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.318 7f6033fff700 1 --2- 172.21.15.79:0/2783202489 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6020029100 0x7f602002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.318 7f6033fff700 1 -- 172.21.15.79:0/2783202489 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f6034038f20 con 0x7f603c0ce8c0 2021-04-09T18:35:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.318 7f603b7fe700 1 --2- 172.21.15.79:0/2783202489 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6020029100 0x7f602002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.318 7f6041f88700 1 -- 172.21.15.79:0/2783202489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603c0e39e0 con 0x7f603c0ce8c0 2021-04-09T18:35:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.318 7f603b7fe700 1 --2- 172.21.15.79:0/2783202489 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6020029100 0x7f602002b650 crc :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:57.338 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.326 7f6033fff700 1 -- 172.21.15.79:0/2783202489 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6034000bf0 con 0x7f603c0ce8c0 2021-04-09T18:35:57.494 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.486 7f6041f88700 1 -- 172.21.15.79:0/2783202489 --> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] -- command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mgr", ""]}) v1 -- 0x7f603c0f5b20 con 0x7f6020029100 2021-04-09T18:35:57.495 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.490 7f6033fff700 1 -- 172.21.15.79:0/2783202489 <== mgr.4100 v2:172.21.15.89:6800/13779 1 ==== command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7f603c0f5b20 con 0x7f6020029100 2021-04-09T18:35:57.495 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 0 to deep-scrub 2021-04-09T18:35:57.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.490 7f6041f88700 1 -- 172.21.15.79:0/2783202489 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6020029100 msgr2=0x7f602002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.490 7f6041f88700 1 --2- 172.21.15.79:0/2783202489 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6020029100 0x7f602002b650 crc :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.490 7f6041f88700 1 -- 172.21.15.79:0/2783202489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c0ce8c0 msgr2=0x7f603c0ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.490 7f6041f88700 1 --2- 172.21.15.79:0/2783202489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c0ce8c0 0x7f603c0ced10 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7f603c094f80 tx=0x7f603400cb00).stop 2021-04-09T18:35:57.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.490 7f6041f88700 1 -- 172.21.15.79:0/2783202489 shutdown_connections 2021-04-09T18:35:57.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.490 7f6041f88700 1 --2- 172.21.15.79:0/2783202489 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6020029100 0x7f602002b650 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.490 7f6041f88700 1 --2- 172.21.15.79:0/2783202489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f603c0b9060 0x7f603c090b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.490 7f6041f88700 1 --2- 172.21.15.79:0/2783202489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f603c0ce8c0 0x7f603c0ced10 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.490 7f6041f88700 1 --2- 172.21.15.79:0/2783202489 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f603c0d6980 0x7f603c0d4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.490 7f6041f88700 1 -- 172.21.15.79:0/2783202489 >> 172.21.15.79:0/2783202489 conn(0x7f603c093620 msgr2=0x7f603c0d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:57.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.490 7f6041f88700 1 -- 172.21.15.79:0/2783202489 shutdown_connections 2021-04-09T18:35:57.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.490 7f6041f88700 1 -- 172.21.15.79:0/2783202489 wait complete. 2021-04-09T18:35:57.512 INFO:tasks.ceph:Scrubbing osd.1 2021-04-09T18:35:57.513 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2021-04-09T18:35:57.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc53c7c700 1 Processor -- start 2021-04-09T18:35:57.619 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc53c7c700 1 -- start start 2021-04-09T18:35:57.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc53c7c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdc4c0f5540 0x7fdc4c0f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc53c7c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc4c1c8030 0x7fdc4c1ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc53c7c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4c0fbb40 con 0x7fdc4c0e9b00 2021-04-09T18:35:57.620 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc53c7c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4c0e9f50 con 0x7fdc4c0f5540 2021-04-09T18:35:57.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc53c7c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c1c3de0 con 0x7fdc4c1c8030 2021-04-09T18:35:57.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc5121f700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdc4c0e9b00 0x7fdc4c09f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58966/0 (socket says 172.21.15.79:58966) 2021-04-09T18:35:57.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc5121f700 1 -- 172.21.15.79:0/3478657396 learned_addr learned my addr 172.21.15.79:0/3478657396 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:57.621 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc51a20700 1 --2- 172.21.15.79:0/3478657396 >> v2:172.21.15.89:3300/0 conn(0x7fdc4c0f5540 0x7fdc4c0f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc52221700 1 --2- 172.21.15.79:0/3478657396 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc4c1c8030 0x7fdc4c1ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc50a1e700 1 -- 172.21.15.79:0/3478657396 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3869800228 0 0) 0x7fdc3c0010d0 con 0x7fdc4c0e9b00 2021-04-09T18:35:57.622 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc50a1e700 1 -- 172.21.15.79:0/3478657396 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc34003240 con 0x7fdc4c0e9b00 2021-04-09T18:35:57.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc51a20700 1 -- 172.21.15.79:0/3478657396 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc4c1c8030 msgr2=0x7fdc4c1ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:57.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc51a20700 1 --2- 172.21.15.79:0/3478657396 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc4c1c8030 0x7fdc4c1ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc51a20700 1 -- 172.21.15.79:0/3478657396 >> v1:172.21.15.79:6789/0 conn(0x7fdc4c0e9b00 legacy=0x7fdc4c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.623 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc51a20700 1 -- 172.21.15.79:0/3478657396 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c09f900 con 0x7fdc4c0f5540 2021-04-09T18:35:57.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc51a20700 1 --2- 172.21.15.79:0/3478657396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc4c0f5540 0x7fdc4c0f64d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fdc4c0f6f20 tx=0x7fdc4800b3c0).ready entity=mon.1 client_cookie=3cea681e8f0ab7bf server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:57.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc50a1e700 1 -- 172.21.15.79:0/3478657396 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdc4c09f900 con 0x7fdc4c0f5540 2021-04-09T18:35:57.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc50a1e700 1 -- 172.21.15.79:0/3478657396 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4800bbe0 con 0x7fdc4c0f5540 2021-04-09T18:35:57.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc50a1e700 1 -- 172.21.15.79:0/3478657396 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdc48002020 con 0x7fdc4c0f5540 2021-04-09T18:35:57.624 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc53c7c700 1 -- 172.21.15.79:0/3478657396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc4c0f5540 msgr2=0x7fdc4c0f64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.606 7fdc53c7c700 1 --2- 172.21.15.79:0/3478657396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc4c0f5540 0x7fdc4c0f64d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fdc4c0f6f20 tx=0x7fdc4800b3c0).stop 2021-04-09T18:35:57.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.610 7fdc53c7c700 1 -- 172.21.15.79:0/3478657396 shutdown_connections 2021-04-09T18:35:57.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.610 7fdc53c7c700 1 --2- 172.21.15.79:0/3478657396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc4c0f5540 0x7fdc4c0f64d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.625 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.610 7fdc53c7c700 1 --2- 172.21.15.79:0/3478657396 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc4c1c8030 0x7fdc4c1ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.610 7fdc53c7c700 1 -- 172.21.15.79:0/3478657396 >> 172.21.15.79:0/3478657396 conn(0x7fdc4c0e6000 msgr2=0x7fdc4c0e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:57.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.610 7fdc53c7c700 1 -- 172.21.15.79:0/3478657396 shutdown_connections 2021-04-09T18:35:57.626 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.610 7fdc53c7c700 1 -- 172.21.15.79:0/3478657396 wait complete. 2021-04-09T18:35:57.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.614 7fdc53c7c700 1 Processor -- start 2021-04-09T18:35:57.631 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.614 7fdc53c7c700 1 -- start start 2021-04-09T18:35:57.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.614 7fdc53c7c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc4c1c06c0 0x7fdc4c0bad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.632 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.614 7fdc53c7c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc4c0ae460 0x7fdc4c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.614 7fdc53c7c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc4c0972f0 0x7fdc4c097740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.614 7fdc53c7c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c098a50 con 0x7fdc4c0ae460 2021-04-09T18:35:57.633 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.614 7fdc53c7c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c0aeee0 con 0x7fdc4c0972f0 2021-04-09T18:35:57.634 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.614 7fdc53c7c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c0d6640 con 0x7fdc4c1c06c0 2021-04-09T18:35:57.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.614 7fdc5121f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc4c0ae460 0x7fdc4c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.635 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.614 7fdc51a20700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc4c1c06c0 0x7fdc4c0bad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.614 7fdc5121f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc4c0ae460 0x7fdc4c0ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36032/0 (socket says 172.21.15.79:36032) 2021-04-09T18:35:57.636 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.614 7fdc5121f700 1 -- 172.21.15.79:0/2623104107 learned_addr learned my addr 172.21.15.79:0/2623104107 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:57.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.614 7fdc52221700 1 --2- 172.21.15.79:0/2623104107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc4c0972f0 0x7fdc4c097740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.614 7fdc5121f700 1 -- 172.21.15.79:0/2623104107 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc4c1c06c0 msgr2=0x7fdc4c0bad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.637 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.614 7fdc5121f700 1 --2- 172.21.15.79:0/2623104107 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc4c1c06c0 0x7fdc4c0bad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.614 7fdc5121f700 1 -- 172.21.15.79:0/2623104107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc4c0972f0 msgr2=0x7fdc4c097740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.614 7fdc5121f700 1 --2- 172.21.15.79:0/2623104107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc4c0972f0 0x7fdc4c097740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.638 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.614 7fdc5121f700 1 -- 172.21.15.79:0/2623104107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c0bb340 con 0x7fdc4c0ae460 2021-04-09T18:35:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.614 7fdc52221700 1 --2- 172.21.15.79:0/2623104107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc4c0972f0 0x7fdc4c097740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.618 7fdc5121f700 1 --2- 172.21.15.79:0/2623104107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc4c0ae460 0x7fdc4c0ae8b0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7fdc3c000b80 tx=0x7fdc3c00ca80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.618 7fdc427fc700 1 -- 172.21.15.79:0/2623104107 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdc4c0bb340 con 0x7fdc4c0ae460 2021-04-09T18:35:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.618 7fdc427fc700 1 -- 172.21.15.79:0/2623104107 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c0072e0 con 0x7fdc4c0ae460 2021-04-09T18:35:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.618 7fdc53c7c700 1 -- 172.21.15.79:0/2623104107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc4c0985e0 con 0x7fdc4c0ae460 2021-04-09T18:35:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.618 7fdc427fc700 1 -- 172.21.15.79:0/2623104107 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdc3c0057e0 con 0x7fdc4c0ae460 2021-04-09T18:35:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.618 7fdc53c7c700 1 -- 172.21.15.79:0/2623104107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4c0ad550 con 0x7fdc4c0ae460 2021-04-09T18:35:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.618 7fdc427fc700 1 -- 172.21.15.79:0/2623104107 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fdc3c0059e0 con 0x7fdc4c0ae460 2021-04-09T18:35:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.618 7fdc427fc700 1 --2- 172.21.15.79:0/2623104107 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdc2c029100 0x7fdc2c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.618 7fdc427fc700 1 -- 172.21.15.79:0/2623104107 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7fdc3c038b40 con 0x7fdc4c0ae460 2021-04-09T18:35:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.618 7fdc51a20700 1 --2- 172.21.15.79:0/2623104107 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdc2c029100 0x7fdc2c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.618 7fdc51a20700 1 --2- 172.21.15.79:0/2623104107 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdc2c029100 0x7fdc2c02b650 crc :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.618 7fdc53c7c700 1 --2- 172.21.15.79:0/2623104107 >> [v2:172.21.15.79:6800/13963,v1:172.21.15.79:6801/13963] conn(0x7fdc4c0af0d0 0x7fdc4c049140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.618 7fdc53c7c700 1 -- 172.21.15.79:0/2623104107 --> [v2:172.21.15.79:6800/13963,v1:172.21.15.79:6801/13963] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc4c0e39e0 con 0x7fdc4c0af0d0 2021-04-09T18:35:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.618 7fdc52221700 1 --2- 172.21.15.79:0/2623104107 >> [v2:172.21.15.79:6800/13963,v1:172.21.15.79:6801/13963] conn(0x7fdc4c0af0d0 0x7fdc4c049140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.622 7fdc52221700 1 --2- 172.21.15.79:0/2623104107 >> [v2:172.21.15.79:6800/13963,v1:172.21.15.79:6801/13963] conn(0x7fdc4c0af0d0 0x7fdc4c049140 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.622 7fdc427fc700 1 -- 172.21.15.79:0/2623104107 <== osd.1 v2:172.21.15.79:6800/13963 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7fdc4c0e39e0 con 0x7fdc4c0af0d0 2021-04-09T18:35:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.634 7fdc53c7c700 1 -- 172.21.15.79:0/2623104107 --> [v2:172.21.15.79:6800/13963,v1:172.21.15.79:6801/13963] -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7fdc4c0f5b40 con 0x7fdc4c0af0d0 2021-04-09T18:35:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.638 7fdc427fc700 1 -- 172.21.15.79:0/2623104107 <== osd.1 v2:172.21.15.79:6800/13963 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (crc 0 0 0) 0x7fdc4c0f5b40 con 0x7fdc4c0af0d0 2021-04-09T18:35:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:Set osd_debug_deep_scrub_sleep to 0 2021-04-09T18:35:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.638 7fdc53c7c700 1 -- 172.21.15.79:0/2623104107 >> [v2:172.21.15.79:6800/13963,v1:172.21.15.79:6801/13963] conn(0x7fdc4c0af0d0 msgr2=0x7fdc4c049140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.638 7fdc53c7c700 1 --2- 172.21.15.79:0/2623104107 >> [v2:172.21.15.79:6800/13963,v1:172.21.15.79:6801/13963] conn(0x7fdc4c0af0d0 0x7fdc4c049140 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.638 7fdc53c7c700 1 -- 172.21.15.79:0/2623104107 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdc2c029100 msgr2=0x7fdc2c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.638 7fdc53c7c700 1 --2- 172.21.15.79:0/2623104107 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdc2c029100 0x7fdc2c02b650 crc :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.638 7fdc53c7c700 1 -- 172.21.15.79:0/2623104107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc4c0ae460 msgr2=0x7fdc4c0ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.638 7fdc53c7c700 1 --2- 172.21.15.79:0/2623104107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc4c0ae460 0x7fdc4c0ae8b0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7fdc3c000b80 tx=0x7fdc3c00ca80).stop 2021-04-09T18:35:57.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.638 7fdc52221700 1 -- 172.21.15.79:0/2623104107 reap_dead start 2021-04-09T18:35:57.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.638 7fdc53c7c700 1 -- 172.21.15.79:0/2623104107 shutdown_connections 2021-04-09T18:35:57.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.638 7fdc53c7c700 1 -- 172.21.15.79:0/2623104107 >> 172.21.15.79:0/2623104107 conn(0x7fdc4c0afd30 msgr2=0x7fdc4c0a6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:57.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.638 7fdc53c7c700 1 -- 172.21.15.79:0/2623104107 shutdown_connections 2021-04-09T18:35:57.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.638 7fdc53c7c700 1 -- 172.21.15.79:0/2623104107 wait complete. 2021-04-09T18:35:57.654 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2021-04-09T18:35:57.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.746 7f7ca5c01700 1 Processor -- start 2021-04-09T18:35:57.760 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.746 7f7ca5c01700 1 -- start start 2021-04-09T18:35:57.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.746 7f7ca5c01700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca00e9ae0 0x7f7ca009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.746 7f7ca5c01700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca00fbb20 con 0x7f7ca01c8010 2021-04-09T18:35:57.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.746 7f7ca5c01700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca00e56d0 con 0x7f7ca00f5520 2021-04-09T18:35:57.761 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.746 7f7ca5c01700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca01c3dc0 con 0x7f7ca00e9ae0 2021-04-09T18:35:57.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.746 7f7c9ffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7ca01c8010 0x7f7ca01ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58982/0 (socket says 172.21.15.79:58982) 2021-04-09T18:35:57.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.746 7f7c9ffff700 1 -- 172.21.15.79:0/4228088666 learned_addr learned my addr 172.21.15.79:0/4228088666 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:57.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.746 7f7c9effd700 1 --2- 172.21.15.79:0/4228088666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca00e9ae0 0x7f7ca009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.762 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.750 7f7c9e7fc700 1 -- 172.21.15.79:0/4228088666 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497427457 0 0) 0x7f7c98001450 con 0x7f7ca01c8010 2021-04-09T18:35:57.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.750 7f7c9e7fc700 1 -- 172.21.15.79:0/4228088666 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c8c003240 con 0x7f7ca01c8010 2021-04-09T18:35:57.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.750 7f7c9e7fc700 1 -- 172.21.15.79:0/4228088666 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516591365 0 0) 0x7f7c900010d0 con 0x7f7ca00f5520 2021-04-09T18:35:57.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.750 7f7c9e7fc700 1 -- 172.21.15.79:0/4228088666 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c8c004680 con 0x7f7ca00f5520 2021-04-09T18:35:57.763 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.750 7f7c9effd700 1 -- 172.21.15.79:0/4228088666 >> v1:172.21.15.89:6789/0 conn(0x7f7ca00f5520 legacy=0x7f7ca00f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.750 7f7c9effd700 1 -- 172.21.15.79:0/4228088666 >> v1:172.21.15.79:6789/0 conn(0x7f7ca01c8010 legacy=0x7f7ca01ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.750 7f7c9effd700 1 -- 172.21.15.79:0/4228088666 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca00e4330 con 0x7f7ca00e9ae0 2021-04-09T18:35:57.764 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.750 7f7c9effd700 1 --2- 172.21.15.79:0/4228088666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca00e9ae0 0x7f7ca009f110 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f7c88002f30 tx=0x7f7c8800bcf0).ready entity=mon.2 client_cookie=b126e0599a0d6946 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:57.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.750 7f7c9e7fc700 1 -- 172.21.15.79:0/4228088666 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7ca00e4330 con 0x7f7ca00e9ae0 2021-04-09T18:35:57.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.750 7f7c9e7fc700 1 -- 172.21.15.79:0/4228088666 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c88009920 con 0x7f7ca00e9ae0 2021-04-09T18:35:57.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.750 7f7c9e7fc700 1 -- 172.21.15.79:0/4228088666 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c88009cf0 con 0x7f7ca00e9ae0 2021-04-09T18:35:57.765 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.750 7f7ca5c01700 1 -- 172.21.15.79:0/4228088666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca00e9ae0 msgr2=0x7f7ca009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.750 7f7ca5c01700 1 --2- 172.21.15.79:0/4228088666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca00e9ae0 0x7f7ca009f110 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f7c88002f30 tx=0x7f7c8800bcf0).stop 2021-04-09T18:35:57.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.750 7f7ca5c01700 1 -- 172.21.15.79:0/4228088666 shutdown_connections 2021-04-09T18:35:57.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.750 7f7ca5c01700 1 --2- 172.21.15.79:0/4228088666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca00e9ae0 0x7f7ca009f110 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.750 7f7ca5c01700 1 -- 172.21.15.79:0/4228088666 >> 172.21.15.79:0/4228088666 conn(0x7f7ca00e5fe0 msgr2=0x7f7ca00e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:57.766 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.750 7f7ca5c01700 1 -- 172.21.15.79:0/4228088666 shutdown_connections 2021-04-09T18:35:57.767 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.750 7f7ca5c01700 1 -- 172.21.15.79:0/4228088666 wait complete. 2021-04-09T18:35:57.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.754 7f7ca5c01700 1 Processor -- start 2021-04-09T18:35:57.770 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.754 7f7ca5c01700 1 -- start start 2021-04-09T18:35:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.754 7f7ca5c01700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ca008f960 0x7f7ca00ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.754 7f7ca5c01700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca00af2b0 0x7f7ca00ad790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.754 7f7ca5c01700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ca00addc0 0x7f7ca0091870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.754 7f7ca5c01700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00e9f30 con 0x7f7ca00addc0 2021-04-09T18:35:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.754 7f7ca5c01700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca0091570 con 0x7f7ca008f960 2021-04-09T18:35:57.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.754 7f7ca5c01700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00af700 con 0x7f7ca00af2b0 2021-04-09T18:35:57.772 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.754 7f7c9ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ca00addc0 0x7f7ca0091870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.754 7f7c9f7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ca008f960 0x7f7ca00ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.754 7f7c9ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ca00addc0 0x7f7ca0091870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36048/0 (socket says 172.21.15.79:36048) 2021-04-09T18:35:57.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.754 7f7c9f7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ca008f960 0x7f7ca00ae990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:52618/0 (socket says 172.21.15.79:52618) 2021-04-09T18:35:57.773 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.754 7f7c9ffff700 1 -- 172.21.15.79:0/3119995193 learned_addr learned my addr 172.21.15.79:0/3119995193 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:57.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.754 7f7c9effd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca00af2b0 0x7f7ca00ad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.758 7f7c9ffff700 1 -- 172.21.15.79:0/3119995193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca00af2b0 msgr2=0x7f7ca00ad790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.758 7f7c9ffff700 1 --2- 172.21.15.79:0/3119995193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca00af2b0 0x7f7ca00ad790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.758 7f7c9ffff700 1 -- 172.21.15.79:0/3119995193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ca008f960 msgr2=0x7f7ca00ae990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.774 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.758 7f7c9ffff700 1 --2- 172.21.15.79:0/3119995193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ca008f960 0x7f7ca00ae990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.758 7f7c9ffff700 1 -- 172.21.15.79:0/3119995193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca00ba120 con 0x7f7ca00addc0 2021-04-09T18:35:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.758 7f7c9ffff700 1 --2- 172.21.15.79:0/3119995193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ca00addc0 0x7f7ca0091870 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f7c98001210 tx=0x7f7c9800ce60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.758 7f7c97fff700 1 -- 172.21.15.79:0/3119995193 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7ca00ba120 con 0x7f7ca00addc0 2021-04-09T18:35:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.758 7f7c97fff700 1 -- 172.21.15.79:0/3119995193 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c98005b80 con 0x7f7ca00addc0 2021-04-09T18:35:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.758 7f7ca5c01700 1 -- 172.21.15.79:0/3119995193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca00aefc0 con 0x7f7ca00addc0 2021-04-09T18:35:57.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.758 7f7c97fff700 1 -- 172.21.15.79:0/3119995193 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c98007110 con 0x7f7ca00addc0 2021-04-09T18:35:57.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.758 7f7ca5c01700 1 -- 172.21.15.79:0/3119995193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca0092030 con 0x7f7ca00addc0 2021-04-09T18:35:57.776 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.758 7f7c97fff700 1 -- 172.21.15.79:0/3119995193 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7c9801a060 con 0x7f7ca00addc0 2021-04-09T18:35:57.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.758 7f7c97fff700 1 --2- 172.21.15.79:0/3119995193 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c84029100 0x7f7c8402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:57.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.758 7f7c97fff700 1 -- 172.21.15.79:0/3119995193 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f7c98038da0 con 0x7f7ca00addc0 2021-04-09T18:35:57.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.758 7f7c9f7fe700 1 --2- 172.21.15.79:0/3119995193 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c84029100 0x7f7c8402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:57.777 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.758 7f7c9f7fe700 1 --2- 172.21.15.79:0/3119995193 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c84029100 0x7f7c8402b650 crc :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:57.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.762 7f7ca5c01700 1 -- 172.21.15.79:0/3119995193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca00e39e0 con 0x7f7ca00addc0 2021-04-09T18:35:57.778 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.770 7f7c97fff700 1 -- 172.21.15.79:0/3119995193 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7c98000f70 con 0x7f7ca00addc0 2021-04-09T18:35:57.941 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.934 7f7ca5c01700 1 -- 172.21.15.79:0/3119995193 --> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] -- command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mgr", ""]}) v1 -- 0x7f7ca00c5cb0 con 0x7f7c84029100 2021-04-09T18:35:57.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.934 7f7c97fff700 1 -- 172.21.15.79:0/3119995193 <== mgr.4100 v2:172.21.15.89:6800/13779 1 ==== command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7f7c90001730 con 0x7f7c84029100 2021-04-09T18:35:57.943 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 1 to deep-scrub 2021-04-09T18:35:57.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.938 7f7ca5c01700 1 -- 172.21.15.79:0/3119995193 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c84029100 msgr2=0x7f7c8402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.938 7f7ca5c01700 1 --2- 172.21.15.79:0/3119995193 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c84029100 0x7f7c8402b650 crc :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.938 7f7ca5c01700 1 -- 172.21.15.79:0/3119995193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ca00addc0 msgr2=0x7f7ca0091870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:57.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.938 7f7ca5c01700 1 --2- 172.21.15.79:0/3119995193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ca00addc0 0x7f7ca0091870 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f7c98001210 tx=0x7f7c9800ce60).stop 2021-04-09T18:35:57.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.938 7f7ca5c01700 1 -- 172.21.15.79:0/3119995193 shutdown_connections 2021-04-09T18:35:57.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.938 7f7ca5c01700 1 --2- 172.21.15.79:0/3119995193 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f7c84029100 0x7f7c8402b650 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.938 7f7ca5c01700 1 --2- 172.21.15.79:0/3119995193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ca008f960 0x7f7ca00ae990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.938 7f7ca5c01700 1 --2- 172.21.15.79:0/3119995193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ca00addc0 0x7f7ca0091870 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.938 7f7ca5c01700 1 --2- 172.21.15.79:0/3119995193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca00af2b0 0x7f7ca00ad790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:57.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.938 7f7ca5c01700 1 -- 172.21.15.79:0/3119995193 >> 172.21.15.79:0/3119995193 conn(0x7f7ca00baee0 msgr2=0x7f7ca00d8790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:57.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.938 7f7ca5c01700 1 -- 172.21.15.79:0/3119995193 shutdown_connections 2021-04-09T18:35:57.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:57.938 7f7ca5c01700 1 -- 172.21.15.79:0/3119995193 wait complete. 2021-04-09T18:35:57.955 INFO:tasks.ceph:Scrubbing osd.2 2021-04-09T18:35:57.956 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2021-04-09T18:35:58.050 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.038 7ff9d3a1b700 1 Processor -- start 2021-04-09T18:35:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.038 7ff9d3a1b700 1 -- start start 2021-04-09T18:35:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.038 7ff9d3a1b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9cc0e9b00 0x7ff9cc09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.038 7ff9d3a1b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff9cc1c8030 0x7ff9cc1ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.038 7ff9d3a1b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9cc0fbb40 con 0x7ff9cc0f5540 2021-04-09T18:35:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.038 7ff9d3a1b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9cc1c3de0 con 0x7ff9cc1c8030 2021-04-09T18:35:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.038 7ff9d3a1b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc0e9f50 con 0x7ff9cc0e9b00 2021-04-09T18:35:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.038 7ff9d17bf700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff9cc0f5540 0x7ff9cc0f64d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58994/0 (socket says 172.21.15.79:58994) 2021-04-09T18:35:58.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.038 7ff9d17bf700 1 -- 172.21.15.79:0/3429587831 learned_addr learned my addr 172.21.15.79:0/3429587831 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:58.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9d1fc0700 1 --2- 172.21.15.79:0/3429587831 >> v2:172.21.15.79:3300/0 conn(0x7ff9cc1c8030 0x7ff9cc1ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9d0fbe700 1 --2- 172.21.15.79:0/3429587831 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9cc0e9b00 0x7ff9cc09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.053 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9cbfff700 1 -- 172.21.15.79:0/3429587831 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215773647 0 0) 0x7ff9b40010d0 con 0x7ff9cc0f5540 2021-04-09T18:35:58.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9cbfff700 1 -- 172.21.15.79:0/3429587831 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9b8003240 con 0x7ff9cc0f5540 2021-04-09T18:35:58.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9d1fc0700 1 -- 172.21.15.79:0/3429587831 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9cc0e9b00 msgr2=0x7ff9cc09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:58.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9cbfff700 1 -- 172.21.15.79:0/3429587831 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 326557999 0 0) 0x7ff9b4001650 con 0x7ff9cc0f5540 2021-04-09T18:35:58.054 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9d1fc0700 1 --2- 172.21.15.79:0/3429587831 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9cc0e9b00 0x7ff9cc09f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9d1fc0700 1 -- 172.21.15.79:0/3429587831 >> v1:172.21.15.79:6789/0 conn(0x7ff9cc0f5540 legacy=0x7ff9cc0f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9d1fc0700 1 -- 172.21.15.79:0/3429587831 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc0e56f0 con 0x7ff9cc1c8030 2021-04-09T18:35:58.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9d1fc0700 1 --2- 172.21.15.79:0/3429587831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9cc1c8030 0x7ff9cc1ca490 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7ff9b4001df0 tx=0x7ff9c400b3c0).ready entity=mon.0 client_cookie=1e7e213cdb783390 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:58.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9cbfff700 1 -- 172.21.15.79:0/3429587831 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff9cc0e56f0 con 0x7ff9cc1c8030 2021-04-09T18:35:58.055 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9cbfff700 1 -- 172.21.15.79:0/3429587831 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c400bae0 con 0x7ff9cc1c8030 2021-04-09T18:35:58.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9cbfff700 1 -- 172.21.15.79:0/3429587831 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff9c4002020 con 0x7ff9cc1c8030 2021-04-09T18:35:58.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9d3a1b700 1 -- 172.21.15.79:0/3429587831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9cc1c8030 msgr2=0x7ff9cc1ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9d3a1b700 1 --2- 172.21.15.79:0/3429587831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9cc1c8030 0x7ff9cc1ca490 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7ff9b4001df0 tx=0x7ff9c400b3c0).stop 2021-04-09T18:35:58.056 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9d3a1b700 1 -- 172.21.15.79:0/3429587831 shutdown_connections 2021-04-09T18:35:58.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9d3a1b700 1 --2- 172.21.15.79:0/3429587831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9cc1c8030 0x7ff9cc1ca490 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9d3a1b700 1 --2- 172.21.15.79:0/3429587831 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9cc0e9b00 0x7ff9cc09f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9d3a1b700 1 -- 172.21.15.79:0/3429587831 >> 172.21.15.79:0/3429587831 conn(0x7ff9cc0e6000 msgr2=0x7ff9cc0e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:58.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9d3a1b700 1 -- 172.21.15.79:0/3429587831 shutdown_connections 2021-04-09T18:35:58.057 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.042 7ff9d3a1b700 1 -- 172.21.15.79:0/3429587831 wait complete. 2021-04-09T18:35:58.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d3a1b700 1 Processor -- start 2021-04-09T18:35:58.058 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d3a1b700 1 -- start start 2021-04-09T18:35:58.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d3a1b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9cc097e30 0x7ff9cc0d5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.061 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d3a1b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9cc0bff30 0x7ff9cc0c0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d3a1b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9cc096150 0x7ff9cc0965a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d3a1b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc097b30 con 0x7ff9cc096150 2021-04-09T18:35:58.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d3a1b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc0973c0 con 0x7ff9cc097e30 2021-04-09T18:35:58.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d3a1b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc1c0880 con 0x7ff9cc0bff30 2021-04-09T18:35:58.062 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d1fc0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9cc096150 0x7ff9cc0965a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d1fc0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9cc096150 0x7ff9cc0965a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36062/0 (socket says 172.21.15.79:36062) 2021-04-09T18:35:58.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d1fc0700 1 -- 172.21.15.79:0/988799526 learned_addr learned my addr 172.21.15.79:0/988799526 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:58.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d0fbe700 1 --2- 172.21.15.79:0/988799526 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9cc0bff30 0x7ff9cc0c0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.063 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d17bf700 1 --2- 172.21.15.79:0/988799526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9cc097e30 0x7ff9cc0d5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d1fc0700 1 -- 172.21.15.79:0/988799526 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9cc0bff30 msgr2=0x7ff9cc0c0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.064 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d1fc0700 1 --2- 172.21.15.79:0/988799526 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9cc0bff30 0x7ff9cc0c0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d1fc0700 1 -- 172.21.15.79:0/988799526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9cc097e30 msgr2=0x7ff9cc0d5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d1fc0700 1 --2- 172.21.15.79:0/988799526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9cc097e30 0x7ff9cc0d5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.065 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d1fc0700 1 -- 172.21.15.79:0/988799526 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc0bb2b0 con 0x7ff9cc096150 2021-04-09T18:35:58.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d0fbe700 1 --2- 172.21.15.79:0/988799526 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9cc0bff30 0x7ff9cc0c0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:58.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d17bf700 1 --2- 172.21.15.79:0/988799526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9cc097e30 0x7ff9cc0d5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:58.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d1fc0700 1 --2- 172.21.15.79:0/988799526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9cc096150 0x7ff9cc0965a0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7ff9b4001df0 tx=0x7ff9c4006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:58.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9c9ffb700 1 -- 172.21.15.79:0/988799526 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff9cc0bb2b0 con 0x7ff9cc096150 2021-04-09T18:35:58.066 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9c9ffb700 1 -- 172.21.15.79:0/988799526 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c401f020 con 0x7ff9cc096150 2021-04-09T18:35:58.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d3a1b700 1 -- 172.21.15.79:0/988799526 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9cc098280 con 0x7ff9cc096150 2021-04-09T18:35:58.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9c9ffb700 1 -- 172.21.15.79:0/988799526 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff9b4001bb0 con 0x7ff9cc096150 2021-04-09T18:35:58.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9d3a1b700 1 -- 172.21.15.79:0/988799526 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9cc096bd0 con 0x7ff9cc096150 2021-04-09T18:35:58.067 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9c9ffb700 1 -- 172.21.15.79:0/988799526 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff9c402a060 con 0x7ff9cc096150 2021-04-09T18:35:58.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.046 7ff9c9ffb700 1 --2- 172.21.15.79:0/988799526 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff9b0029100 0x7ff9b002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.068 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.050 7ff9c9ffb700 1 -- 172.21.15.79:0/988799526 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7ff9c4003020 con 0x7ff9cc096150 2021-04-09T18:35:58.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.050 7ff9d17bf700 1 --2- 172.21.15.79:0/988799526 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff9b0029100 0x7ff9b002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.069 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.050 7ff9d17bf700 1 --2- 172.21.15.79:0/988799526 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff9b0029100 0x7ff9b002b650 crc :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:58.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.054 7ff9d3a1b700 1 --2- 172.21.15.79:0/988799526 >> [v2:172.21.15.79:6816/13962,v1:172.21.15.79:6817/13962] conn(0x7ff9cc049140 0x7ff9cc049590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.070 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.054 7ff9d3a1b700 1 -- 172.21.15.79:0/988799526 --> [v2:172.21.15.79:6816/13962,v1:172.21.15.79:6817/13962] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff9cc0e39e0 con 0x7ff9cc049140 2021-04-09T18:35:58.071 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.054 7ff9d0fbe700 1 --2- 172.21.15.79:0/988799526 >> [v2:172.21.15.79:6816/13962,v1:172.21.15.79:6817/13962] conn(0x7ff9cc049140 0x7ff9cc049590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.054 7ff9d0fbe700 1 --2- 172.21.15.79:0/988799526 >> [v2:172.21.15.79:6816/13962,v1:172.21.15.79:6817/13962] conn(0x7ff9cc049140 0x7ff9cc049590 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:58.072 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.054 7ff9c9ffb700 1 -- 172.21.15.79:0/988799526 <== osd.2 v2:172.21.15.79:6816/13962 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7ff9cc0e39e0 con 0x7ff9cc049140 2021-04-09T18:35:58.076 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.070 7ff9d3a1b700 1 -- 172.21.15.79:0/988799526 --> [v2:172.21.15.79:6816/13962,v1:172.21.15.79:6817/13962] -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7ff9cc0f5b40 con 0x7ff9cc049140 2021-04-09T18:35:58.077 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.070 7ff9c9ffb700 1 -- 172.21.15.79:0/988799526 <== osd.2 v2:172.21.15.79:6816/13962 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (crc 0 0 0) 0x7ff9cc0f5b40 con 0x7ff9cc049140 2021-04-09T18:35:58.077 INFO:teuthology.orchestra.run.smithi079.stderr:Set osd_debug_deep_scrub_sleep to 0 2021-04-09T18:35:58.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.070 7ff9d3a1b700 1 -- 172.21.15.79:0/988799526 >> [v2:172.21.15.79:6816/13962,v1:172.21.15.79:6817/13962] conn(0x7ff9cc049140 msgr2=0x7ff9cc049590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.070 7ff9d3a1b700 1 --2- 172.21.15.79:0/988799526 >> [v2:172.21.15.79:6816/13962,v1:172.21.15.79:6817/13962] conn(0x7ff9cc049140 0x7ff9cc049590 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.079 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.070 7ff9d3a1b700 1 -- 172.21.15.79:0/988799526 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff9b0029100 msgr2=0x7ff9b002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.070 7ff9d3a1b700 1 --2- 172.21.15.79:0/988799526 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7ff9b0029100 0x7ff9b002b650 crc :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.070 7ff9d3a1b700 1 -- 172.21.15.79:0/988799526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9cc096150 msgr2=0x7ff9cc0965a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.070 7ff9d3a1b700 1 --2- 172.21.15.79:0/988799526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9cc096150 0x7ff9cc0965a0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7ff9b4001df0 tx=0x7ff9c4006c10).stop 2021-04-09T18:35:58.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.070 7ff9d1fc0700 1 -- 172.21.15.79:0/988799526 reap_dead start 2021-04-09T18:35:58.080 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.070 7ff9d3a1b700 1 -- 172.21.15.79:0/988799526 shutdown_connections 2021-04-09T18:35:58.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.070 7ff9d3a1b700 1 -- 172.21.15.79:0/988799526 >> 172.21.15.79:0/988799526 conn(0x7ff9cc09a8e0 msgr2=0x7ff9cc0aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:58.081 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.070 7ff9d3a1b700 1 -- 172.21.15.79:0/988799526 shutdown_connections 2021-04-09T18:35:58.082 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.070 7ff9d3a1b700 1 -- 172.21.15.79:0/988799526 wait complete. 2021-04-09T18:35:58.088 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2021-04-09T18:35:58.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.174 7fc0806a1700 1 Processor -- start 2021-04-09T18:35:58.189 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.174 7fc0806a1700 1 -- start start 2021-04-09T18:35:58.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.174 7fc0806a1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc0780e9ae0 0x7fc07809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.174 7fc0806a1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0781c8010 0x7fc0781ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.174 7fc0806a1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0780fbb20 con 0x7fc0780f5520 2021-04-09T18:35:58.190 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.174 7fc0806a1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0781c3dc0 con 0x7fc0780e9ae0 2021-04-09T18:35:58.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.174 7fc0806a1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0780e9f30 con 0x7fc0781c8010 2021-04-09T18:35:58.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.174 7fc07dc44700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc0780e9ae0 0x7fc07809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.174 7fc07e445700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc0780f5520 0x7fc0780f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:59480/0 (socket says 172.21.15.79:59480) 2021-04-09T18:35:58.191 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.174 7fc07e445700 1 -- 172.21.15.79:0/1673238165 learned_addr learned my addr 172.21.15.79:0/1673238165 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:58.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.174 7fc07ec46700 1 --2- 172.21.15.79:0/1673238165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0781c8010 0x7fc0781ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.174 7fc07dc44700 1 -- 172.21.15.79:0/1673238165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0781c8010 msgr2=0x7fc0781ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:58.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.174 7fc07dc44700 1 --2- 172.21.15.79:0/1673238165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0781c8010 0x7fc0781ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.174 7fc07dc44700 1 -- 172.21.15.79:0/1673238165 >> v1:172.21.15.89:6789/0 conn(0x7fc0780f5520 legacy=0x7fc0780f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.192 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.174 7fc07dc44700 1 -- 172.21.15.79:0/1673238165 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0780e56d0 con 0x7fc0780e9ae0 2021-04-09T18:35:58.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.178 7fc07dc44700 1 --2- 172.21.15.79:0/1673238165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0780e9ae0 0x7fc07809f110 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fc0780f6f00 tx=0x7fc06400bd70).ready entity=mon.1 client_cookie=787c2e1b5f7f2a48 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:58.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.178 7fc07d443700 1 -- 172.21.15.79:0/1673238165 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc0780e56d0 con 0x7fc0780e9ae0 2021-04-09T18:35:58.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.178 7fc07d443700 1 -- 172.21.15.79:0/1673238165 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc064009810 con 0x7fc0780e9ae0 2021-04-09T18:35:58.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.178 7fc07d443700 1 -- 172.21.15.79:0/1673238165 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc064009be0 con 0x7fc0780e9ae0 2021-04-09T18:35:58.193 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.178 7fc0806a1700 1 -- 172.21.15.79:0/1673238165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0780e9ae0 msgr2=0x7fc07809f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.178 7fc0806a1700 1 --2- 172.21.15.79:0/1673238165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0780e9ae0 0x7fc07809f110 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fc0780f6f00 tx=0x7fc06400bd70).stop 2021-04-09T18:35:58.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.178 7fc0806a1700 1 -- 172.21.15.79:0/1673238165 shutdown_connections 2021-04-09T18:35:58.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.178 7fc0806a1700 1 --2- 172.21.15.79:0/1673238165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0781c8010 0x7fc0781ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.194 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.178 7fc0806a1700 1 --2- 172.21.15.79:0/1673238165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0780e9ae0 0x7fc07809f110 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.178 7fc0806a1700 1 -- 172.21.15.79:0/1673238165 >> 172.21.15.79:0/1673238165 conn(0x7fc0780e5fe0 msgr2=0x7fc0780e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:58.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.178 7fc0806a1700 1 -- 172.21.15.79:0/1673238165 shutdown_connections 2021-04-09T18:35:58.195 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.178 7fc0806a1700 1 -- 172.21.15.79:0/1673238165 wait complete. 2021-04-09T18:35:58.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.182 7fc0806a1700 1 Processor -- start 2021-04-09T18:35:58.198 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.182 7fc0806a1700 1 -- start start 2021-04-09T18:35:58.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc0806a1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0780befc0 0x7fc078096740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc0806a1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc078097f50 0x7fc0780d4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.199 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc0806a1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0780983a0 0x7fc0780c00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc0806a1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0780bfdb0 con 0x7fc078097f50 2021-04-09T18:35:58.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc0806a1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0780bf940 con 0x7fc0780983a0 2021-04-09T18:35:58.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc0806a1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0780d5500 con 0x7fc0780befc0 2021-04-09T18:35:58.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc07dc44700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc078097f50 0x7fc0780d4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.200 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc07dc44700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc078097f50 0x7fc0780d4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36076/0 (socket says 172.21.15.79:36076) 2021-04-09T18:35:58.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc07dc44700 1 -- 172.21.15.79:0/992551110 learned_addr learned my addr 172.21.15.79:0/992551110 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:58.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc07ec46700 1 --2- 172.21.15.79:0/992551110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0780983a0 0x7fc0780c00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc07e445700 1 --2- 172.21.15.79:0/992551110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0780befc0 0x7fc078096740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.201 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc07dc44700 1 -- 172.21.15.79:0/992551110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0780befc0 msgr2=0x7fc078096740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc07dc44700 1 --2- 172.21.15.79:0/992551110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0780befc0 0x7fc078096740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc07dc44700 1 -- 172.21.15.79:0/992551110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0780983a0 msgr2=0x7fc0780c00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc07dc44700 1 --2- 172.21.15.79:0/992551110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0780983a0 0x7fc0780c00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc07dc44700 1 -- 172.21.15.79:0/992551110 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0780d5730 con 0x7fc078097f50 2021-04-09T18:35:58.202 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc07e445700 1 --2- 172.21.15.79:0/992551110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0780befc0 0x7fc078096740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:58.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc07ec46700 1 --2- 172.21.15.79:0/992551110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0780983a0 0x7fc0780c00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:58.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc07dc44700 1 --2- 172.21.15.79:0/992551110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc078097f50 0x7fc0780d4ed0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7fc0780d7ff0 tx=0x7fc064006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:58.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc076ffd700 1 -- 172.21.15.79:0/992551110 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc0780d5730 con 0x7fc078097f50 2021-04-09T18:35:58.203 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc076ffd700 1 -- 172.21.15.79:0/992551110 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc064011dc0 con 0x7fc078097f50 2021-04-09T18:35:58.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc076ffd700 1 -- 172.21.15.79:0/992551110 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc064022020 con 0x7fc078097f50 2021-04-09T18:35:58.204 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc0806a1700 1 -- 172.21.15.79:0/992551110 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0780c06e0 con 0x7fc078097f50 2021-04-09T18:35:58.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc0806a1700 1 -- 172.21.15.79:0/992551110 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0780c0b60 con 0x7fc078097f50 2021-04-09T18:35:58.205 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc076ffd700 1 -- 172.21.15.79:0/992551110 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc06401d640 con 0x7fc078097f50 2021-04-09T18:35:58.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc076ffd700 1 --2- 172.21.15.79:0/992551110 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc060029100 0x7fc06002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc076ffd700 1 -- 172.21.15.79:0/992551110 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7fc06403c260 con 0x7fc078097f50 2021-04-09T18:35:58.206 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.186 7fc07e445700 1 --2- 172.21.15.79:0/992551110 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc060029100 0x7fc06002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.207 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.190 7fc07e445700 1 --2- 172.21.15.79:0/992551110 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc060029100 0x7fc06002b650 crc :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:58.210 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.202 7fc0806a1700 1 -- 172.21.15.79:0/992551110 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0780e39e0 con 0x7fc078097f50 2021-04-09T18:35:58.215 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.210 7fc076ffd700 1 -- 172.21.15.79:0/992551110 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc064009600 con 0x7fc078097f50 2021-04-09T18:35:58.375 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.370 7fc0806a1700 1 -- 172.21.15.79:0/992551110 --> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] -- command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mgr", ""]}) v1 -- 0x7fc0780a1cc0 con 0x7fc060029100 2021-04-09T18:35:58.376 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.370 7fc076ffd700 1 -- 172.21.15.79:0/992551110 <== mgr.4100 v2:172.21.15.89:6800/13779 1 ==== command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7fc0780a1cc0 con 0x7fc060029100 2021-04-09T18:35:58.376 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 2 to deep-scrub 2021-04-09T18:35:58.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.370 7fc0806a1700 1 -- 172.21.15.79:0/992551110 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc060029100 msgr2=0x7fc06002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.370 7fc0806a1700 1 --2- 172.21.15.79:0/992551110 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc060029100 0x7fc06002b650 crc :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.370 7fc0806a1700 1 -- 172.21.15.79:0/992551110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc078097f50 msgr2=0x7fc0780d4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.379 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.370 7fc0806a1700 1 --2- 172.21.15.79:0/992551110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc078097f50 0x7fc0780d4ed0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7fc0780d7ff0 tx=0x7fc064006890).stop 2021-04-09T18:35:58.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.370 7fc0806a1700 1 -- 172.21.15.79:0/992551110 shutdown_connections 2021-04-09T18:35:58.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.370 7fc0806a1700 1 --2- 172.21.15.79:0/992551110 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc060029100 0x7fc06002b650 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.370 7fc0806a1700 1 --2- 172.21.15.79:0/992551110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0780983a0 0x7fc0780c00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.380 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.370 7fc0806a1700 1 --2- 172.21.15.79:0/992551110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0780befc0 0x7fc078096740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.370 7fc0806a1700 1 --2- 172.21.15.79:0/992551110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc078097f50 0x7fc0780d4ed0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.370 7fc0806a1700 1 -- 172.21.15.79:0/992551110 >> 172.21.15.79:0/992551110 conn(0x7fc0780d8230 msgr2=0x7fc0780d8680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:58.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.370 7fc0806a1700 1 -- 172.21.15.79:0/992551110 shutdown_connections 2021-04-09T18:35:58.381 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.374 7fc0806a1700 1 -- 172.21.15.79:0/992551110 wait complete. 2021-04-09T18:35:58.388 INFO:tasks.ceph:Scrubbing osd.3 2021-04-09T18:35:58.389 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2021-04-09T18:35:58.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd550adf700 1 Processor -- start 2021-04-09T18:35:58.496 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd550adf700 1 -- start start 2021-04-09T18:35:58.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd550adf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54c0f5540 0x7fd54c0f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd550adf700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd54c1c8030 0x7fd54c1ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd550adf700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54c0fbb40 con 0x7fd54c0e9b00 2021-04-09T18:35:58.497 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd550adf700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54c0e9f50 con 0x7fd54c1c8030 2021-04-09T18:35:58.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd550adf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c1c3de0 con 0x7fd54c0f5540 2021-04-09T18:35:58.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd549fe5700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd54c0e9b00 0x7fd54c09f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59024/0 (socket says 172.21.15.79:59024) 2021-04-09T18:35:58.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd549fe5700 1 -- 172.21.15.79:0/62707108 learned_addr learned my addr 172.21.15.79:0/62707108 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:58.498 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd54afe7700 1 --2- 172.21.15.79:0/62707108 >> v2:172.21.15.89:3300/0 conn(0x7fd54c1c8030 0x7fd54c1ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd54a7e6700 1 --2- 172.21.15.79:0/62707108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54c0f5540 0x7fd54c0f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd5497e4700 1 -- 172.21.15.79:0/62707108 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087735455 0 0) 0x7fd5400010d0 con 0x7fd54c0e9b00 2021-04-09T18:35:58.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd5497e4700 1 -- 172.21.15.79:0/62707108 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd534003240 con 0x7fd54c0e9b00 2021-04-09T18:35:58.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd54afe7700 1 -- 172.21.15.79:0/62707108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54c0f5540 msgr2=0x7fd54c0f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:58.499 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd54afe7700 1 --2- 172.21.15.79:0/62707108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54c0f5540 0x7fd54c0f64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd54afe7700 1 -- 172.21.15.79:0/62707108 >> v1:172.21.15.79:6789/0 conn(0x7fd54c0e9b00 legacy=0x7fd54c09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd54afe7700 1 -- 172.21.15.79:0/62707108 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c09f900 con 0x7fd54c1c8030 2021-04-09T18:35:58.500 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd54a7e6700 1 --2- 172.21.15.79:0/62707108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54c0f5540 0x7fd54c0f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:58.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd54afe7700 1 --2- 172.21.15.79:0/62707108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd54c1c8030 0x7fd54c1ca490 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fd5440032b0 tx=0x7fd54400b3c0).ready entity=mon.1 client_cookie=f965720700b05cfa server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:58.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd5497e4700 1 -- 172.21.15.79:0/62707108 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd54c09f900 con 0x7fd54c1c8030 2021-04-09T18:35:58.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd5497e4700 1 -- 172.21.15.79:0/62707108 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54400bc20 con 0x7fd54c1c8030 2021-04-09T18:35:58.501 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd5497e4700 1 -- 172.21.15.79:0/62707108 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd544002020 con 0x7fd54c1c8030 2021-04-09T18:35:58.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd550adf700 1 -- 172.21.15.79:0/62707108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd54c1c8030 msgr2=0x7fd54c1ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd550adf700 1 --2- 172.21.15.79:0/62707108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd54c1c8030 0x7fd54c1ca490 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fd5440032b0 tx=0x7fd54400b3c0).stop 2021-04-09T18:35:58.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd550adf700 1 -- 172.21.15.79:0/62707108 shutdown_connections 2021-04-09T18:35:58.502 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd550adf700 1 --2- 172.21.15.79:0/62707108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd54c1c8030 0x7fd54c1ca490 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd550adf700 1 --2- 172.21.15.79:0/62707108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54c0f5540 0x7fd54c0f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd550adf700 1 -- 172.21.15.79:0/62707108 >> 172.21.15.79:0/62707108 conn(0x7fd54c0e6000 msgr2=0x7fd54c0e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:58.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd550adf700 1 -- 172.21.15.79:0/62707108 shutdown_connections 2021-04-09T18:35:58.503 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.486 7fd550adf700 1 -- 172.21.15.79:0/62707108 wait complete. 2021-04-09T18:35:58.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.490 7fd550adf700 1 Processor -- start 2021-04-09T18:35:58.507 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.490 7fd550adf700 1 -- start start 2021-04-09T18:35:58.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.490 7fd550adf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd54c0abfd0 0x7fd54c0ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.490 7fd550adf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54c0bac50 0x7fd54c0d5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.490 7fd550adf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd54c0bb0a0 0x7fd54c0d44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.508 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.490 7fd550adf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c0ac720 con 0x7fd54c0bb0a0 2021-04-09T18:35:58.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.490 7fd550adf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c0ac420 con 0x7fd54c0abfd0 2021-04-09T18:35:58.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.490 7fd550adf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c0aca20 con 0x7fd54c0bac50 2021-04-09T18:35:58.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.490 7fd54afe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd54c0bb0a0 0x7fd54c0d44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.490 7fd54afe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd54c0bb0a0 0x7fd54c0d44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36092/0 (socket says 172.21.15.79:36092) 2021-04-09T18:35:58.509 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.490 7fd54afe7700 1 -- 172.21.15.79:0/70970266 learned_addr learned my addr 172.21.15.79:0/70970266 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:58.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.490 7fd549fe5700 1 --2- 172.21.15.79:0/70970266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54c0bac50 0x7fd54c0d5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.490 7fd54a7e6700 1 --2- 172.21.15.79:0/70970266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd54c0abfd0 0x7fd54c0ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.490 7fd54afe7700 1 -- 172.21.15.79:0/70970266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54c0bac50 msgr2=0x7fd54c0d5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.490 7fd54afe7700 1 --2- 172.21.15.79:0/70970266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54c0bac50 0x7fd54c0d5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.510 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.490 7fd54afe7700 1 -- 172.21.15.79:0/70970266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd54c0abfd0 msgr2=0x7fd54c0ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.490 7fd54afe7700 1 --2- 172.21.15.79:0/70970266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd54c0abfd0 0x7fd54c0ae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.490 7fd54afe7700 1 -- 172.21.15.79:0/70970266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c0d61d0 con 0x7fd54c0bb0a0 2021-04-09T18:35:58.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.490 7fd54a7e6700 1 --2- 172.21.15.79:0/70970266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd54c0abfd0 0x7fd54c0ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:58.511 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.490 7fd54afe7700 1 --2- 172.21.15.79:0/70970266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd54c0bb0a0 0x7fd54c0d44d0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7fd54c0c0d30 tx=0x7fd544006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:58.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.494 7fd53affd700 1 -- 172.21.15.79:0/70970266 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd54c0d61d0 con 0x7fd54c0bb0a0 2021-04-09T18:35:58.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.494 7fd53affd700 1 -- 172.21.15.79:0/70970266 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54401f030 con 0x7fd54c0bb0a0 2021-04-09T18:35:58.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.494 7fd550adf700 1 -- 172.21.15.79:0/70970266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54c0d6490 con 0x7fd54c0bb0a0 2021-04-09T18:35:58.512 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.494 7fd53affd700 1 -- 172.21.15.79:0/70970266 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd544002020 con 0x7fd54c0bb0a0 2021-04-09T18:35:58.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.494 7fd550adf700 1 -- 172.21.15.79:0/70970266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54c0d4c90 con 0x7fd54c0bb0a0 2021-04-09T18:35:58.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.494 7fd53affd700 1 -- 172.21.15.79:0/70970266 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd54402a060 con 0x7fd54c0bb0a0 2021-04-09T18:35:58.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.494 7fd53affd700 1 --2- 172.21.15.79:0/70970266 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd530029100 0x7fd53002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.494 7fd53affd700 1 -- 172.21.15.79:0/70970266 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7fd54403b340 con 0x7fd54c0bb0a0 2021-04-09T18:35:58.513 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.494 7fd54a7e6700 1 --2- 172.21.15.79:0/70970266 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd530029100 0x7fd53002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.494 7fd54a7e6700 1 --2- 172.21.15.79:0/70970266 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd530029100 0x7fd53002b650 crc :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:58.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.498 7fd550adf700 1 --2- 172.21.15.79:0/70970266 >> [v2:172.21.15.79:6824/13987,v1:172.21.15.79:6825/13987] conn(0x7fd54c1adbe0 0x7fd54c1ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.498 7fd550adf700 1 -- 172.21.15.79:0/70970266 --> [v2:172.21.15.79:6824/13987,v1:172.21.15.79:6825/13987] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd54c0e39e0 con 0x7fd54c1adbe0 2021-04-09T18:35:58.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.498 7fd549fe5700 1 --2- 172.21.15.79:0/70970266 >> [v2:172.21.15.79:6824/13987,v1:172.21.15.79:6825/13987] conn(0x7fd54c1adbe0 0x7fd54c1ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.514 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.498 7fd549fe5700 1 --2- 172.21.15.79:0/70970266 >> [v2:172.21.15.79:6824/13987,v1:172.21.15.79:6825/13987] conn(0x7fd54c1adbe0 0x7fd54c1ae030 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:58.515 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.502 7fd53affd700 1 -- 172.21.15.79:0/70970266 <== osd.3 v2:172.21.15.79:6824/13987 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7fd54c0e39e0 con 0x7fd54c1adbe0 2021-04-09T18:35:58.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.518 7fd550adf700 1 -- 172.21.15.79:0/70970266 --> [v2:172.21.15.79:6824/13987,v1:172.21.15.79:6825/13987] -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7fd54c0f5b40 con 0x7fd54c1adbe0 2021-04-09T18:35:58.523 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.518 7fd53affd700 1 -- 172.21.15.79:0/70970266 <== osd.3 v2:172.21.15.79:6824/13987 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (crc 0 0 0) 0x7fd54c0f5b40 con 0x7fd54c1adbe0 2021-04-09T18:35:58.524 INFO:teuthology.orchestra.run.smithi079.stderr:Set osd_debug_deep_scrub_sleep to 0 2021-04-09T18:35:58.525 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.518 7fd550adf700 1 -- 172.21.15.79:0/70970266 >> [v2:172.21.15.79:6824/13987,v1:172.21.15.79:6825/13987] conn(0x7fd54c1adbe0 msgr2=0x7fd54c1ae030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.518 7fd550adf700 1 --2- 172.21.15.79:0/70970266 >> [v2:172.21.15.79:6824/13987,v1:172.21.15.79:6825/13987] conn(0x7fd54c1adbe0 0x7fd54c1ae030 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.518 7fd550adf700 1 -- 172.21.15.79:0/70970266 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd530029100 msgr2=0x7fd53002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.518 7fd550adf700 1 --2- 172.21.15.79:0/70970266 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd530029100 0x7fd53002b650 crc :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.526 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.518 7fd550adf700 1 -- 172.21.15.79:0/70970266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd54c0bb0a0 msgr2=0x7fd54c0d44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.518 7fd550adf700 1 --2- 172.21.15.79:0/70970266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd54c0bb0a0 0x7fd54c0d44d0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7fd54c0c0d30 tx=0x7fd544006c10).stop 2021-04-09T18:35:58.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.518 7fd54afe7700 1 -- 172.21.15.79:0/70970266 reap_dead start 2021-04-09T18:35:58.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.518 7fd550adf700 1 -- 172.21.15.79:0/70970266 shutdown_connections 2021-04-09T18:35:58.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.518 7fd550adf700 1 -- 172.21.15.79:0/70970266 >> 172.21.15.79:0/70970266 conn(0x7fd54c098ac0 msgr2=0x7fd54c0954e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:58.527 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.518 7fd550adf700 1 -- 172.21.15.79:0/70970266 shutdown_connections 2021-04-09T18:35:58.528 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.518 7fd550adf700 1 -- 172.21.15.79:0/70970266 wait complete. 2021-04-09T18:35:58.536 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2021-04-09T18:35:58.641 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.622 7fbb05870700 1 Processor -- start 2021-04-09T18:35:58.642 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.622 7fbb05870700 1 -- start start 2021-04-09T18:35:58.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.622 7fbb05870700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb000e9ae0 0x7fbb0009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.622 7fbb05870700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbb001c8010 0x7fbb001ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.643 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.622 7fbb05870700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb000fbb20 con 0x7fbb000f5520 2021-04-09T18:35:58.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.622 7fbb05870700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb001c3dc0 con 0x7fbb001c8010 2021-04-09T18:35:58.644 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.622 7fbb05870700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb000e9f30 con 0x7fbb000e9ae0 2021-04-09T18:35:58.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.622 7fbaffd51700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbb001c8010 0x7fbb001ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.622 7fbaffd51700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbb001c8010 0x7fbb001ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36102/0 (socket says 172.21.15.79:36102) 2021-04-09T18:35:58.645 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.622 7fbaffd51700 1 -- 172.21.15.79:0/2030927243 learned_addr learned my addr 172.21.15.79:0/2030927243 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:58.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.622 7fbafed4f700 1 --2- 172.21.15.79:0/2030927243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb000e9ae0 0x7fbb0009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.622 7fbaffd51700 1 -- 172.21.15.79:0/2030927243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb000e9ae0 msgr2=0x7fbb0009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:58.646 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.622 7fbaffd51700 1 --2- 172.21.15.79:0/2030927243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb000e9ae0 0x7fbb0009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.622 7fbaffd51700 1 -- 172.21.15.79:0/2030927243 >> v1:172.21.15.89:6789/0 conn(0x7fbb000f5520 legacy=0x7fbb000f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.647 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.622 7fbaffd51700 1 -- 172.21.15.79:0/2030927243 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb000e56d0 con 0x7fbb001c8010 2021-04-09T18:35:58.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.622 7fbaffd51700 1 --2- 172.21.15.79:0/2030927243 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb001c8010 0x7fbb001ca470 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7fbaf80032b0 tx=0x7fbaf800b3c0).ready entity=mon.0 client_cookie=b16b3e3ea9dcbcbe server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:58.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.626 7fbafe54e700 1 -- 172.21.15.79:0/2030927243 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbb000e56d0 con 0x7fbb001c8010 2021-04-09T18:35:58.648 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.626 7fbafe54e700 1 -- 172.21.15.79:0/2030927243 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf800bc20 con 0x7fbb001c8010 2021-04-09T18:35:58.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.626 7fbafe54e700 1 -- 172.21.15.79:0/2030927243 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbaf8002020 con 0x7fbb001c8010 2021-04-09T18:35:58.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.626 7fbb05870700 1 -- 172.21.15.79:0/2030927243 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb001c8010 msgr2=0x7fbb001ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.649 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.626 7fbb05870700 1 --2- 172.21.15.79:0/2030927243 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb001c8010 0x7fbb001ca470 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7fbaf80032b0 tx=0x7fbaf800b3c0).stop 2021-04-09T18:35:58.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.626 7fbb05870700 1 -- 172.21.15.79:0/2030927243 shutdown_connections 2021-04-09T18:35:58.650 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.626 7fbb05870700 1 --2- 172.21.15.79:0/2030927243 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb001c8010 0x7fbb001ca470 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.626 7fbb05870700 1 --2- 172.21.15.79:0/2030927243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb000e9ae0 0x7fbb0009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.626 7fbb05870700 1 -- 172.21.15.79:0/2030927243 >> 172.21.15.79:0/2030927243 conn(0x7fbb000e5fe0 msgr2=0x7fbb000e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:58.651 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.626 7fbb05870700 1 -- 172.21.15.79:0/2030927243 shutdown_connections 2021-04-09T18:35:58.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.626 7fbb05870700 1 -- 172.21.15.79:0/2030927243 wait complete. 2021-04-09T18:35:58.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.626 7fbb05870700 1 Processor -- start 2021-04-09T18:35:58.652 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.626 7fbb05870700 1 -- start start 2021-04-09T18:35:58.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbb05870700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb000a3ae0 0x7fbb000d4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbb05870700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb000c3ac0 0x7fbb000c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.653 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbb05870700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb000c4540 0x7fbb001b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbb05870700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb000c2220 con 0x7fbb000a3ae0 2021-04-09T18:35:58.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbb05870700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb000c2520 con 0x7fbb000c3ac0 2021-04-09T18:35:58.654 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbb05870700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb000c4990 con 0x7fbb000c4540 2021-04-09T18:35:58.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbaff550700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb000a3ae0 0x7fbb000d4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbafed4f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb000c3ac0 0x7fbb000c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.655 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbaff550700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb000a3ae0 0x7fbb000d4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36104/0 (socket says 172.21.15.79:36104) 2021-04-09T18:35:58.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbafed4f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb000c3ac0 0x7fbb000c3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:52680/0 (socket says 172.21.15.79:52680) 2021-04-09T18:35:58.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbafed4f700 1 -- 172.21.15.79:0/623790095 learned_addr learned my addr 172.21.15.79:0/623790095 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:58.656 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbaffd51700 1 --2- 172.21.15.79:0/623790095 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb000c4540 0x7fbb001b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbaff550700 1 -- 172.21.15.79:0/623790095 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb000c4540 msgr2=0x7fbb001b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.657 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbaff550700 1 --2- 172.21.15.79:0/623790095 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb000c4540 0x7fbb001b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbaff550700 1 -- 172.21.15.79:0/623790095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb000c3ac0 msgr2=0x7fbb000c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbaff550700 1 --2- 172.21.15.79:0/623790095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb000c3ac0 0x7fbb000c3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.658 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbaff550700 1 -- 172.21.15.79:0/623790095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb00099370 con 0x7fbb000a3ae0 2021-04-09T18:35:58.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbafed4f700 1 --2- 172.21.15.79:0/623790095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb000c3ac0 0x7fbb000c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:58.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbaff550700 1 --2- 172.21.15.79:0/623790095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb000a3ae0 0x7fbb000d4d70 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7fbb000c21a0 tx=0x7fbaf000cab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:58.659 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbaf7fff700 1 -- 172.21.15.79:0/623790095 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbb00099370 con 0x7fbb000a3ae0 2021-04-09T18:35:58.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbaf7fff700 1 -- 172.21.15.79:0/623790095 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf000e4a0 con 0x7fbb000a3ae0 2021-04-09T18:35:58.660 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbb05870700 1 -- 172.21.15.79:0/623790095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb000c4d10 con 0x7fbb000a3ae0 2021-04-09T18:35:58.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbaf7fff700 1 -- 172.21.15.79:0/623790095 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbaf000e870 con 0x7fbb000a3ae0 2021-04-09T18:35:58.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbb05870700 1 -- 172.21.15.79:0/623790095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb000d5530 con 0x7fbb000a3ae0 2021-04-09T18:35:58.661 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbaf7fff700 1 -- 172.21.15.79:0/623790095 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fbaf000ea70 con 0x7fbb000a3ae0 2021-04-09T18:35:58.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.630 7fbaf7fff700 1 --2- 172.21.15.79:0/623790095 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbae4029100 0x7fbae402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.634 7fbaf7fff700 1 -- 172.21.15.79:0/623790095 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7fbaf00389b0 con 0x7fbb000a3ae0 2021-04-09T18:35:58.662 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.634 7fbafed4f700 1 --2- 172.21.15.79:0/623790095 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbae4029100 0x7fbae402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.663 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.634 7fbafed4f700 1 --2- 172.21.15.79:0/623790095 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbae4029100 0x7fbae402b650 crc :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:58.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.638 7fbb05870700 1 -- 172.21.15.79:0/623790095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb000e39e0 con 0x7fbb000a3ae0 2021-04-09T18:35:58.664 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.646 7fbaf7fff700 1 -- 172.21.15.79:0/623790095 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fbaf0000bf0 con 0x7fbb000a3ae0 2021-04-09T18:35:58.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.810 7fbb05870700 1 -- 172.21.15.79:0/623790095 --> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] -- command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mgr", ""]}) v1 -- 0x7fbb000c8810 con 0x7fbae4029100 2021-04-09T18:35:58.818 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.810 7fbaf7fff700 1 -- 172.21.15.79:0/623790095 <== mgr.4100 v2:172.21.15.89:6800/13779 1 ==== command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7fbae8011470 con 0x7fbae4029100 2021-04-09T18:35:58.819 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 3 to deep-scrub 2021-04-09T18:35:58.821 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.814 7fbb05870700 1 -- 172.21.15.79:0/623790095 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbae4029100 msgr2=0x7fbae402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.814 7fbb05870700 1 --2- 172.21.15.79:0/623790095 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbae4029100 0x7fbae402b650 crc :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.814 7fbb05870700 1 -- 172.21.15.79:0/623790095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb000a3ae0 msgr2=0x7fbb000d4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.822 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.814 7fbb05870700 1 --2- 172.21.15.79:0/623790095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb000a3ae0 0x7fbb000d4d70 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7fbb000c21a0 tx=0x7fbaf000cab0).stop 2021-04-09T18:35:58.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.814 7fbb05870700 1 -- 172.21.15.79:0/623790095 shutdown_connections 2021-04-09T18:35:58.823 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.814 7fbb05870700 1 --2- 172.21.15.79:0/623790095 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbae4029100 0x7fbae402b650 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.814 7fbb05870700 1 --2- 172.21.15.79:0/623790095 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb000c4540 0x7fbb001b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.824 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.814 7fbb05870700 1 --2- 172.21.15.79:0/623790095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb000a3ae0 0x7fbb000d4d70 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.814 7fbb05870700 1 --2- 172.21.15.79:0/623790095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb000c3ac0 0x7fbb000c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.814 7fbb05870700 1 -- 172.21.15.79:0/623790095 >> 172.21.15.79:0/623790095 conn(0x7fbb0009a200 msgr2=0x7fbb000996a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:58.825 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.814 7fbb05870700 1 -- 172.21.15.79:0/623790095 shutdown_connections 2021-04-09T18:35:58.826 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.814 7fbb05870700 1 -- 172.21.15.79:0/623790095 wait complete. 2021-04-09T18:35:58.830 INFO:tasks.ceph:Scrubbing osd.4 2021-04-09T18:35:58.831 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2021-04-09T18:35:58.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd0a5699700 1 Processor -- start 2021-04-09T18:35:58.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd0a5699700 1 -- start start 2021-04-09T18:35:58.942 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd0a5699700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a00f5540 0x7fd0a00f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd0a5699700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd0a00e9b00 0x7fd0a009f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd0a5699700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd0a01c2dd0 0x7fd0a01c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd0a5699700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a00e9f50 con 0x7fd0a00e9b00 2021-04-09T18:35:58.943 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd0a5699700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a00e59f0 con 0x7fd0a01c2dd0 2021-04-09T18:35:58.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd0a5699700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a00fbb40 con 0x7fd0a00f5540 2021-04-09T18:35:58.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd09ea46700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd0a00e9b00 0x7fd0a009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd09ea46700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd0a00e9b00 0x7fd0a009f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36114/0 (socket says 172.21.15.79:36114) 2021-04-09T18:35:58.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd09ea46700 1 -- 172.21.15.79:0/1950442785 learned_addr learned my addr 172.21.15.79:0/1950442785 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:58.944 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd09fa48700 1 --2- 172.21.15.79:0/1950442785 >> v2:172.21.15.89:3300/0 conn(0x7fd0a01c2dd0 0x7fd0a01c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd09f247700 1 --2- 172.21.15.79:0/1950442785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a00f5540 0x7fd0a00f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd09ea46700 1 -- 172.21.15.79:0/1950442785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a00f5540 msgr2=0x7fd0a00f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:58.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd09ea46700 1 --2- 172.21.15.79:0/1950442785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a00f5540 0x7fd0a00f64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.945 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd09ea46700 1 -- 172.21.15.79:0/1950442785 >> v2:172.21.15.89:3300/0 conn(0x7fd0a01c2dd0 msgr2=0x7fd0a01c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:58.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd09ea46700 1 --2- 172.21.15.79:0/1950442785 >> v2:172.21.15.89:3300/0 conn(0x7fd0a01c2dd0 0x7fd0a01c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd09ea46700 1 -- 172.21.15.79:0/1950442785 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a00e56f0 con 0x7fd0a00e9b00 2021-04-09T18:35:58.946 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd09fa48700 1 --2- 172.21.15.79:0/1950442785 >> v2:172.21.15.89:3300/0 conn(0x7fd0a01c2dd0 0x7fd0a01c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:35:58.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd09f247700 1 --2- 172.21.15.79:0/1950442785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a00f5540 0x7fd0a00f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:35:58.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd09ea46700 1 --2- 172.21.15.79:0/1950442785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0a00e9b00 0x7fd0a009f100 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7fd0880032b0 tx=0x7fd08800b3c0).ready entity=mon.0 client_cookie=ff83945230f2efa server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:58.947 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd09e245700 1 -- 172.21.15.79:0/1950442785 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0a00e56f0 con 0x7fd0a00e9b00 2021-04-09T18:35:58.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd09e245700 1 -- 172.21.15.79:0/1950442785 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08800bc20 con 0x7fd0a00e9b00 2021-04-09T18:35:58.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd09e245700 1 -- 172.21.15.79:0/1950442785 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd088002020 con 0x7fd0a00e9b00 2021-04-09T18:35:58.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd0a5699700 1 -- 172.21.15.79:0/1950442785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0a00e9b00 msgr2=0x7fd0a009f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.948 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.930 7fd0a5699700 1 --2- 172.21.15.79:0/1950442785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0a00e9b00 0x7fd0a009f100 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7fd0880032b0 tx=0x7fd08800b3c0).stop 2021-04-09T18:35:58.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.934 7fd0a5699700 1 -- 172.21.15.79:0/1950442785 shutdown_connections 2021-04-09T18:35:58.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.934 7fd0a5699700 1 --2- 172.21.15.79:0/1950442785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a00f5540 0x7fd0a00f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.934 7fd0a5699700 1 --2- 172.21.15.79:0/1950442785 >> v2:172.21.15.89:3300/0 conn(0x7fd0a01c2dd0 0x7fd0a01c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.949 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.934 7fd0a5699700 1 --2- 172.21.15.79:0/1950442785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0a00e9b00 0x7fd0a009f100 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.934 7fd0a5699700 1 -- 172.21.15.79:0/1950442785 >> 172.21.15.79:0/1950442785 conn(0x7fd0a00e6000 msgr2=0x7fd0a00e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:58.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.934 7fd0a5699700 1 -- 172.21.15.79:0/1950442785 shutdown_connections 2021-04-09T18:35:58.950 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.934 7fd0a5699700 1 -- 172.21.15.79:0/1950442785 wait complete. 2021-04-09T18:35:58.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd0a5699700 1 Processor -- start 2021-04-09T18:35:58.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd0a5699700 1 -- start start 2021-04-09T18:35:58.954 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd0a5699700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0a00d1b50 0x7fd0a00d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd0a5699700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a0098810 0x7fd0a0098c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd0a5699700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a0099880 0x7fd0a0099cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd0a5699700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a0097290 con 0x7fd0a00d1b50 2021-04-09T18:35:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd0a5699700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a0099290 con 0x7fd0a0098810 2021-04-09T18:35:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd0a5699700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a0096a60 con 0x7fd0a0099880 2021-04-09T18:35:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd09f247700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0a00d1b50 0x7fd0a00d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd09f247700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0a00d1b50 0x7fd0a00d1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36118/0 (socket says 172.21.15.79:36118) 2021-04-09T18:35:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd09f247700 1 -- 172.21.15.79:0/3588969980 learned_addr learned my addr 172.21.15.79:0/3588969980 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:58.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd09ea46700 1 --2- 172.21.15.79:0/3588969980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a0098810 0x7fd0a0098c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.957 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd09fa48700 1 --2- 172.21.15.79:0/3588969980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a0099880 0x7fd0a0099cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd09f247700 1 -- 172.21.15.79:0/3588969980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a0099880 msgr2=0x7fd0a0099cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd09f247700 1 --2- 172.21.15.79:0/3588969980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a0099880 0x7fd0a0099cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd09f247700 1 -- 172.21.15.79:0/3588969980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a0098810 msgr2=0x7fd0a0098c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.958 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd09f247700 1 --2- 172.21.15.79:0/3588969980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a0098810 0x7fd0a0098c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd09f247700 1 -- 172.21.15.79:0/3588969980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a009a300 con 0x7fd0a00d1b50 2021-04-09T18:35:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd09ea46700 1 --2- 172.21.15.79:0/3588969980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a0098810 0x7fd0a0098c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd09fa48700 1 --2- 172.21.15.79:0/3588969980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a0099880 0x7fd0a0099cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:35:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd09f247700 1 --2- 172.21.15.79:0/3588969980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0a00d1b50 0x7fd0a00d1fa0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7fd0a008ee80 tx=0x7fd09000cd20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd097fff700 1 -- 172.21.15.79:0/3588969980 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0a009a300 con 0x7fd0a00d1b50 2021-04-09T18:35:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd097fff700 1 -- 172.21.15.79:0/3588969980 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0900076a0 con 0x7fd0a00d1b50 2021-04-09T18:35:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd0a5699700 1 -- 172.21.15.79:0/3588969980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a009a5c0 con 0x7fd0a00d1b50 2021-04-09T18:35:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd097fff700 1 -- 172.21.15.79:0/3588969980 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd090007a70 con 0x7fd0a00d1b50 2021-04-09T18:35:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.938 7fd0a5699700 1 -- 172.21.15.79:0/3588969980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a00d8070 con 0x7fd0a00d1b50 2021-04-09T18:35:58.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.942 7fd097fff700 1 -- 172.21.15.79:0/3588969980 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd090007c70 con 0x7fd0a00d1b50 2021-04-09T18:35:58.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.942 7fd097fff700 1 --2- 172.21.15.79:0/3588969980 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd084029100 0x7fd08402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.942 7fd097fff700 1 -- 172.21.15.79:0/3588969980 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7fd090039520 con 0x7fd0a00d1b50 2021-04-09T18:35:58.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.942 7fd09ea46700 1 --2- 172.21.15.79:0/3588969980 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd084029100 0x7fd08402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.961 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.942 7fd09ea46700 1 --2- 172.21.15.79:0/3588969980 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd084029100 0x7fd08402b650 crc :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:58.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.942 7fd0a5699700 1 --2- 172.21.15.79:0/3588969980 >> [v2:172.21.15.89:6826/14212,v1:172.21.15.89:6827/14212] conn(0x7fd0a00d85f0 0x7fd0a00d8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:58.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.942 7fd0a5699700 1 -- 172.21.15.79:0/3588969980 --> [v2:172.21.15.89:6826/14212,v1:172.21.15.89:6827/14212] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd0a00962c0 con 0x7fd0a00d85f0 2021-04-09T18:35:58.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.946 7fd09fa48700 1 --2- 172.21.15.79:0/3588969980 >> [v2:172.21.15.89:6826/14212,v1:172.21.15.89:6827/14212] conn(0x7fd0a00d85f0 0x7fd0a00d8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:58.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.946 7fd09fa48700 1 --2- 172.21.15.79:0/3588969980 >> [v2:172.21.15.89:6826/14212,v1:172.21.15.89:6827/14212] conn(0x7fd0a00d85f0 0x7fd0a00d8a40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:58.962 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.946 7fd097fff700 1 -- 172.21.15.79:0/3588969980 <== osd.4 v2:172.21.15.89:6826/14212 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7fd0a00962c0 con 0x7fd0a00d85f0 2021-04-09T18:35:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.958 7fd0a5699700 1 -- 172.21.15.79:0/3588969980 --> [v2:172.21.15.89:6826/14212,v1:172.21.15.89:6827/14212] -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7fd0a00e39e0 con 0x7fd0a00d85f0 2021-04-09T18:35:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.958 7fd097fff700 1 -- 172.21.15.79:0/3588969980 <== osd.4 v2:172.21.15.89:6826/14212 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (crc 0 0 0) 0x7fd0a00e39e0 con 0x7fd0a00d85f0 2021-04-09T18:35:58.967 INFO:teuthology.orchestra.run.smithi079.stderr:Set osd_debug_deep_scrub_sleep to 0 2021-04-09T18:35:58.967 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.958 7fd0a5699700 1 -- 172.21.15.79:0/3588969980 >> [v2:172.21.15.89:6826/14212,v1:172.21.15.89:6827/14212] conn(0x7fd0a00d85f0 msgr2=0x7fd0a00d8a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.958 7fd0a5699700 1 --2- 172.21.15.79:0/3588969980 >> [v2:172.21.15.89:6826/14212,v1:172.21.15.89:6827/14212] conn(0x7fd0a00d85f0 0x7fd0a00d8a40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.958 7fd0a5699700 1 -- 172.21.15.79:0/3588969980 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd084029100 msgr2=0x7fd08402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.958 7fd0a5699700 1 --2- 172.21.15.79:0/3588969980 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fd084029100 0x7fd08402b650 crc :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.958 7fd0a5699700 1 -- 172.21.15.79:0/3588969980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0a00d1b50 msgr2=0x7fd0a00d1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.958 7fd0a5699700 1 --2- 172.21.15.79:0/3588969980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0a00d1b50 0x7fd0a00d1fa0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7fd0a008ee80 tx=0x7fd09000cd20).stop 2021-04-09T18:35:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.958 7fd09fa48700 1 -- 172.21.15.79:0/3588969980 reap_dead start 2021-04-09T18:35:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.958 7fd0a5699700 1 -- 172.21.15.79:0/3588969980 shutdown_connections 2021-04-09T18:35:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.958 7fd0a5699700 1 -- 172.21.15.79:0/3588969980 >> 172.21.15.79:0/3588969980 conn(0x7fd0a0092420 msgr2=0x7fd0a0094580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.958 7fd0a5699700 1 -- 172.21.15.79:0/3588969980 shutdown_connections 2021-04-09T18:35:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:58.958 7fd0a5699700 1 -- 172.21.15.79:0/3588969980 wait complete. 2021-04-09T18:35:58.977 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2021-04-09T18:35:59.085 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.070 7fbba1278700 1 Processor -- start 2021-04-09T18:35:59.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.070 7fbba1278700 1 -- start start 2021-04-09T18:35:59.086 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.070 7fbba1278700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb9c0e9ae0 0x7fbb9c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.070 7fbba1278700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9c0fbb20 con 0x7fbb9c1c8010 2021-04-09T18:35:59.087 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.070 7fbba1278700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9c0e56d0 con 0x7fbb9c0f5520 2021-04-09T18:35:59.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.070 7fbba1278700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c1c3dc0 con 0x7fbb9c0e9ae0 2021-04-09T18:35:59.088 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbb9b806700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbb9c1c8010 0x7fbb9c1ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59074/0 (socket says 172.21.15.79:59074) 2021-04-09T18:35:59.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbb9b806700 1 -- 172.21.15.79:0/3786794305 learned_addr learned my addr 172.21.15.79:0/3786794305 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:59.089 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbb9a804700 1 --2- 172.21.15.79:0/3786794305 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb9c0e9ae0 0x7fbb9c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbb9a003700 1 -- 172.21.15.79:0/3786794305 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927164065 0 0) 0x7fbb94001450 con 0x7fbb9c1c8010 2021-04-09T18:35:59.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbb9a003700 1 -- 172.21.15.79:0/3786794305 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb84003240 con 0x7fbb9c1c8010 2021-04-09T18:35:59.090 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbb9a003700 1 -- 172.21.15.79:0/3786794305 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199271436 0 0) 0x7fbb8c0010d0 con 0x7fbb9c0f5520 2021-04-09T18:35:59.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbb9a003700 1 -- 172.21.15.79:0/3786794305 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb84003620 con 0x7fbb9c0f5520 2021-04-09T18:35:59.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbb9a804700 1 -- 172.21.15.79:0/3786794305 >> v1:172.21.15.89:6789/0 conn(0x7fbb9c0f5520 legacy=0x7fbb9c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbb9a804700 1 -- 172.21.15.79:0/3786794305 >> v1:172.21.15.79:6789/0 conn(0x7fbb9c1c8010 legacy=0x7fbb9c1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.091 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbb9a804700 1 -- 172.21.15.79:0/3786794305 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c0e4330 con 0x7fbb9c0e9ae0 2021-04-09T18:35:59.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbb9a804700 1 --2- 172.21.15.79:0/3786794305 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb9c0e9ae0 0x7fbb9c09f110 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fbb90002f30 tx=0x7fbb9000bcf0).ready entity=mon.2 client_cookie=9391d879c9f1642e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:59.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbb9a003700 1 -- 172.21.15.79:0/3786794305 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbb9c0e4330 con 0x7fbb9c0e9ae0 2021-04-09T18:35:59.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbb9a003700 1 -- 172.21.15.79:0/3786794305 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb90009920 con 0x7fbb9c0e9ae0 2021-04-09T18:35:59.092 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbb9a003700 1 -- 172.21.15.79:0/3786794305 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbb90009cf0 con 0x7fbb9c0e9ae0 2021-04-09T18:35:59.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbba1278700 1 -- 172.21.15.79:0/3786794305 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb9c0e9ae0 msgr2=0x7fbb9c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbba1278700 1 --2- 172.21.15.79:0/3786794305 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb9c0e9ae0 0x7fbb9c09f110 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fbb90002f30 tx=0x7fbb9000bcf0).stop 2021-04-09T18:35:59.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbba1278700 1 -- 172.21.15.79:0/3786794305 shutdown_connections 2021-04-09T18:35:59.093 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbba1278700 1 --2- 172.21.15.79:0/3786794305 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb9c0e9ae0 0x7fbb9c09f110 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbba1278700 1 -- 172.21.15.79:0/3786794305 >> 172.21.15.79:0/3786794305 conn(0x7fbb9c0e5fe0 msgr2=0x7fbb9c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:59.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbba1278700 1 -- 172.21.15.79:0/3786794305 shutdown_connections 2021-04-09T18:35:59.094 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.074 7fbba1278700 1 -- 172.21.15.79:0/3786794305 wait complete. 2021-04-09T18:35:59.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.078 7fbba1278700 1 Processor -- start 2021-04-09T18:35:59.095 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.078 7fbba1278700 1 -- start start 2021-04-09T18:35:59.098 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.078 7fbba1278700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb9c1a7b40 0x7fbb9c0b8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.078 7fbba1278700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb9c1a7f90 0x7fbb9c0999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.078 7fbba1278700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb9c0b8690 0x7fbb9c099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.078 7fbba1278700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c0e9f30 con 0x7fbb9c1a7f90 2021-04-09T18:35:59.099 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.078 7fbba1278700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c0b8eb0 con 0x7fbb9c0b8690 2021-04-09T18:35:59.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.078 7fbba1278700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c0d5a90 con 0x7fbb9c1a7b40 2021-04-09T18:35:59.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.082 7fbb9a804700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb9c1a7f90 0x7fbb9c0999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.100 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.082 7fbb9a804700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb9c1a7f90 0x7fbb9c0999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36136/0 (socket says 172.21.15.79:36136) 2021-04-09T18:35:59.102 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.082 7fbb9a804700 1 -- 172.21.15.79:0/1249324591 learned_addr learned my addr 172.21.15.79:0/1249324591 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:59.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.082 7fbb9b806700 1 --2- 172.21.15.79:0/1249324591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb9c0b8690 0x7fbb9c099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.082 7fbb9b005700 1 --2- 172.21.15.79:0/1249324591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb9c1a7b40 0x7fbb9c0b8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.082 7fbb9a804700 1 -- 172.21.15.79:0/1249324591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb9c1a7b40 msgr2=0x7fbb9c0b8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.103 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.082 7fbb9a804700 1 --2- 172.21.15.79:0/1249324591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb9c1a7b40 0x7fbb9c0b8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.082 7fbb9a804700 1 -- 172.21.15.79:0/1249324591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb9c0b8690 msgr2=0x7fbb9c099fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.082 7fbb9a804700 1 --2- 172.21.15.79:0/1249324591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb9c0b8690 0x7fbb9c099fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.104 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.082 7fbb9a804700 1 -- 172.21.15.79:0/1249324591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c09aa70 con 0x7fbb9c1a7f90 2021-04-09T18:35:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.082 7fbb9a804700 1 --2- 172.21.15.79:0/1249324591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb9c1a7f90 0x7fbb9c0999a0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7fbb9c08e120 tx=0x7fbb90006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.082 7fbb83fff700 1 -- 172.21.15.79:0/1249324591 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbb9c09aa70 con 0x7fbb9c1a7f90 2021-04-09T18:35:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.082 7fbb83fff700 1 -- 172.21.15.79:0/1249324591 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb90011bf0 con 0x7fbb9c1a7f90 2021-04-09T18:35:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.082 7fbba1278700 1 -- 172.21.15.79:0/1249324591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9c0d5340 con 0x7fbb9c1a7f90 2021-04-09T18:35:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.082 7fbb83fff700 1 -- 172.21.15.79:0/1249324591 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbb9001d480 con 0x7fbb9c1a7f90 2021-04-09T18:35:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.082 7fbba1278700 1 -- 172.21.15.79:0/1249324591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9c09a600 con 0x7fbb9c1a7f90 2021-04-09T18:35:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.082 7fbb83fff700 1 -- 172.21.15.79:0/1249324591 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fbb900263b0 con 0x7fbb9c1a7f90 2021-04-09T18:35:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.082 7fbb83fff700 1 --2- 172.21.15.79:0/1249324591 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbb7c029100 0x7fbb7c02b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.082 7fbb83fff700 1 -- 172.21.15.79:0/1249324591 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7fbb9003b170 con 0x7fbb9c1a7f90 2021-04-09T18:35:59.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.082 7fbb9b005700 1 --2- 172.21.15.79:0/1249324591 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbb7c029100 0x7fbb7c02b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.086 7fbb9b005700 1 --2- 172.21.15.79:0/1249324591 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbb7c029100 0x7fbb7c02b650 crc :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:59.107 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.086 7fbba1278700 1 -- 172.21.15.79:0/1249324591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9c0e39e0 con 0x7fbb9c1a7f90 2021-04-09T18:35:59.108 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.094 7fbb83fff700 1 -- 172.21.15.79:0/1249324591 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fbb90009710 con 0x7fbb9c1a7f90 2021-04-09T18:35:59.263 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.258 7fbba1278700 1 -- 172.21.15.79:0/1249324591 --> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] -- command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mgr", ""]}) v1 -- 0x7fbb9c0d5750 con 0x7fbb7c029100 2021-04-09T18:35:59.265 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.258 7fbb83fff700 1 -- 172.21.15.79:0/1249324591 <== mgr.4100 v2:172.21.15.89:6800/13779 1 ==== command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7fbb8c001790 con 0x7fbb7c029100 2021-04-09T18:35:59.265 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 4 to deep-scrub 2021-04-09T18:35:59.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.258 7fbba1278700 1 -- 172.21.15.79:0/1249324591 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbb7c029100 msgr2=0x7fbb7c02b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.258 7fbba1278700 1 --2- 172.21.15.79:0/1249324591 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbb7c029100 0x7fbb7c02b650 crc :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.270 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.258 7fbba1278700 1 -- 172.21.15.79:0/1249324591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb9c1a7f90 msgr2=0x7fbb9c0999a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.262 7fbba1278700 1 --2- 172.21.15.79:0/1249324591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb9c1a7f90 0x7fbb9c0999a0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7fbb9c08e120 tx=0x7fbb90006890).stop 2021-04-09T18:35:59.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.262 7fbba1278700 1 -- 172.21.15.79:0/1249324591 shutdown_connections 2021-04-09T18:35:59.271 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.262 7fbba1278700 1 --2- 172.21.15.79:0/1249324591 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbb7c029100 0x7fbb7c02b650 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.262 7fbba1278700 1 --2- 172.21.15.79:0/1249324591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb9c0b8690 0x7fbb9c099fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.262 7fbba1278700 1 --2- 172.21.15.79:0/1249324591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb9c1a7b40 0x7fbb9c0b8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.272 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.262 7fbba1278700 1 --2- 172.21.15.79:0/1249324591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb9c1a7f90 0x7fbb9c0999a0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.262 7fbba1278700 1 -- 172.21.15.79:0/1249324591 >> 172.21.15.79:0/1249324591 conn(0x7fbb9c0d7240 msgr2=0x7fbb9c08e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:59.273 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.262 7fbba1278700 1 -- 172.21.15.79:0/1249324591 shutdown_connections 2021-04-09T18:35:59.274 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.262 7fbba1278700 1 -- 172.21.15.79:0/1249324591 wait complete. 2021-04-09T18:35:59.282 INFO:tasks.ceph:Scrubbing osd.5 2021-04-09T18:35:59.283 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2021-04-09T18:35:59.388 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f22a7649700 1 Processor -- start 2021-04-09T18:35:59.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f22a7649700 1 -- start start 2021-04-09T18:35:59.389 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f22a7649700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22a00e9b10 0x7f22a009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f22a7649700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22a01c8040 0x7f22a01ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f22a7649700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a00fbb50 con 0x7f22a00f5550 2021-04-09T18:35:59.390 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f22a7649700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a01c3df0 con 0x7f22a01c8040 2021-04-09T18:35:59.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f22a7649700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a00e9f60 con 0x7f22a00e9b10 2021-04-09T18:35:59.391 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f22a5bee700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22a01c8040 0x7f22a01ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f22a5bee700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22a01c8040 0x7f22a01ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36146/0 (socket says 172.21.15.79:36146) 2021-04-09T18:35:59.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f22a5bee700 1 -- 172.21.15.79:0/2510548058 learned_addr learned my addr 172.21.15.79:0/2510548058 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:59.392 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f22a4bec700 1 --2- 172.21.15.79:0/2510548058 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22a00e9b10 0x7f22a009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f22a5bee700 1 -- 172.21.15.79:0/2510548058 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22a00e9b10 msgr2=0x7f22a009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:59.393 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f22a5bee700 1 --2- 172.21.15.79:0/2510548058 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22a00e9b10 0x7f22a009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f22a5bee700 1 -- 172.21.15.79:0/2510548058 >> v1:172.21.15.89:6789/0 conn(0x7f22a00f5550 legacy=0x7f22a00f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:59.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f22a5bee700 1 -- 172.21.15.79:0/2510548058 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a00e5700 con 0x7f22a01c8040 2021-04-09T18:35:59.394 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f22a5bee700 1 --2- 172.21.15.79:0/2510548058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a01c8040 0x7f22a01ca4a0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f22980032b0 tx=0x7f229800b3c0).ready entity=mon.0 client_cookie=2469ed83bb299b29 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:59.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f2297fff700 1 -- 172.21.15.79:0/2510548058 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f22a00e5700 con 0x7f22a01c8040 2021-04-09T18:35:59.395 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f2297fff700 1 -- 172.21.15.79:0/2510548058 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229800bc20 con 0x7f22a01c8040 2021-04-09T18:35:59.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f2297fff700 1 -- 172.21.15.79:0/2510548058 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2298002020 con 0x7f22a01c8040 2021-04-09T18:35:59.396 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f22a7649700 1 -- 172.21.15.79:0/2510548058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a01c8040 msgr2=0x7f22a01ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.374 7f22a7649700 1 --2- 172.21.15.79:0/2510548058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a01c8040 0x7f22a01ca4a0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f22980032b0 tx=0x7f229800b3c0).stop 2021-04-09T18:35:59.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.378 7f22a7649700 1 -- 172.21.15.79:0/2510548058 shutdown_connections 2021-04-09T18:35:59.397 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.378 7f22a7649700 1 --2- 172.21.15.79:0/2510548058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a01c8040 0x7f22a01ca4a0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.378 7f22a7649700 1 --2- 172.21.15.79:0/2510548058 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22a00e9b10 0x7f22a009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.398 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.378 7f22a7649700 1 -- 172.21.15.79:0/2510548058 >> 172.21.15.79:0/2510548058 conn(0x7f22a00e6010 msgr2=0x7f22a00e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:59.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.378 7f22a7649700 1 -- 172.21.15.79:0/2510548058 shutdown_connections 2021-04-09T18:35:59.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.378 7f22a7649700 1 -- 172.21.15.79:0/2510548058 wait complete. 2021-04-09T18:35:59.399 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f22a7649700 1 Processor -- start 2021-04-09T18:35:59.400 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f22a7649700 1 -- start start 2021-04-09T18:35:59.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f22a7649700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22a01a0720 0x7f22a00c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.406 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f22a7649700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a00babc0 0x7f22a00ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f22a7649700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22a00bb010 0x7f22a00ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f22a7649700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a00c1490 con 0x7f22a00babc0 2021-04-09T18:35:59.407 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f22a7649700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a00c1790 con 0x7f22a00bb010 2021-04-09T18:35:59.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f22a7649700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a01a1870 con 0x7f22a01a0720 2021-04-09T18:35:59.408 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f22a4bec700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a00babc0 0x7f22a00ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f22a4bec700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a00babc0 0x7f22a00ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36150/0 (socket says 172.21.15.79:36150) 2021-04-09T18:35:59.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f22a4bec700 1 -- 172.21.15.79:0/4213293581 learned_addr learned my addr 172.21.15.79:0/4213293581 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:59.409 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f22a5bee700 1 --2- 172.21.15.79:0/4213293581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22a00bb010 0x7f22a00ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.410 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f22a53ed700 1 --2- 172.21.15.79:0/4213293581 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22a01a0720 0x7f22a00c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.410 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f22a4bec700 1 -- 172.21.15.79:0/4213293581 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22a01a0720 msgr2=0x7f22a00c0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.411 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f22a4bec700 1 --2- 172.21.15.79:0/4213293581 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22a01a0720 0x7f22a00c0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.411 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f22a4bec700 1 -- 172.21.15.79:0/4213293581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22a00bb010 msgr2=0x7f22a00ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.411 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f22a4bec700 1 --2- 172.21.15.79:0/4213293581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22a00bb010 0x7f22a00ae630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.412 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f22a4bec700 1 -- 172.21.15.79:0/4213293581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a00ab910 con 0x7f22a00babc0 2021-04-09T18:35:59.412 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f22a4bec700 1 --2- 172.21.15.79:0/4213293581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a00babc0 0x7f22a00ae000 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f229c00a000 tx=0x7f229c00dd20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:59.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f2295ffb700 1 -- 172.21.15.79:0/4213293581 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f22a00ab910 con 0x7f22a00babc0 2021-04-09T18:35:59.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.382 7f22a7649700 1 -- 172.21.15.79:0/4213293581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a01c0850 con 0x7f22a00babc0 2021-04-09T18:35:59.413 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.386 7f2295ffb700 1 -- 172.21.15.79:0/4213293581 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229c0098f0 con 0x7f22a00babc0 2021-04-09T18:35:59.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.386 7f2295ffb700 1 -- 172.21.15.79:0/4213293581 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f229c00f040 con 0x7f22a00babc0 2021-04-09T18:35:59.414 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.386 7f22a7649700 1 -- 172.21.15.79:0/4213293581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a0096290 con 0x7f22a00babc0 2021-04-09T18:35:59.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.386 7f2295ffb700 1 -- 172.21.15.79:0/4213293581 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f229c009cc0 con 0x7f22a00babc0 2021-04-09T18:35:59.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.386 7f2295ffb700 1 --2- 172.21.15.79:0/4213293581 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2280029100 0x7f228002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.415 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.386 7f2295ffb700 1 -- 172.21.15.79:0/4213293581 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f229c010070 con 0x7f22a00babc0 2021-04-09T18:35:59.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.386 7f22a53ed700 1 --2- 172.21.15.79:0/4213293581 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2280029100 0x7f228002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.416 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.386 7f22a53ed700 1 --2- 172.21.15.79:0/4213293581 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2280029100 0x7f228002b650 crc :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:59.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.386 7f22a7649700 1 --2- 172.21.15.79:0/4213293581 >> [v2:172.21.15.89:6810/14210,v1:172.21.15.89:6811/14210] conn(0x7f22a00968d0 0x7f22a0049150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.386 7f22a7649700 1 -- 172.21.15.79:0/4213293581 --> [v2:172.21.15.89:6810/14210,v1:172.21.15.89:6811/14210] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22a00e39f0 con 0x7f22a00968d0 2021-04-09T18:35:59.417 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.386 7f22a5bee700 1 --2- 172.21.15.79:0/4213293581 >> [v2:172.21.15.89:6810/14210,v1:172.21.15.89:6811/14210] conn(0x7f22a00968d0 0x7f22a0049150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.390 7f22a5bee700 1 --2- 172.21.15.79:0/4213293581 >> [v2:172.21.15.89:6810/14210,v1:172.21.15.89:6811/14210] conn(0x7f22a00968d0 0x7f22a0049150 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:59.418 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.390 7f2295ffb700 1 -- 172.21.15.79:0/4213293581 <== osd.5 v2:172.21.15.89:6810/14210 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f22a00e39f0 con 0x7f22a00968d0 2021-04-09T18:35:59.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.402 7f22a7649700 1 -- 172.21.15.79:0/4213293581 --> [v2:172.21.15.89:6810/14210,v1:172.21.15.89:6811/14210] -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7f22a00f5b50 con 0x7f22a00968d0 2021-04-09T18:35:59.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.402 7f2295ffb700 1 -- 172.21.15.79:0/4213293581 <== osd.5 v2:172.21.15.89:6810/14210 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (crc 0 0 0) 0x7f22a00f5b50 con 0x7f22a00968d0 2021-04-09T18:35:59.423 INFO:teuthology.orchestra.run.smithi079.stderr:Set osd_debug_deep_scrub_sleep to 0 2021-04-09T18:35:59.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.402 7f22a7649700 1 -- 172.21.15.79:0/4213293581 >> [v2:172.21.15.89:6810/14210,v1:172.21.15.89:6811/14210] conn(0x7f22a00968d0 msgr2=0x7f22a0049150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.402 7f22a7649700 1 --2- 172.21.15.79:0/4213293581 >> [v2:172.21.15.89:6810/14210,v1:172.21.15.89:6811/14210] conn(0x7f22a00968d0 0x7f22a0049150 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.402 7f22a7649700 1 -- 172.21.15.79:0/4213293581 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2280029100 msgr2=0x7f228002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.402 7f22a7649700 1 --2- 172.21.15.79:0/4213293581 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f2280029100 0x7f228002b650 crc :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.402 7f22a7649700 1 -- 172.21.15.79:0/4213293581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a00babc0 msgr2=0x7f22a00ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.402 7f22a7649700 1 --2- 172.21.15.79:0/4213293581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a00babc0 0x7f22a00ae000 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f229c00a000 tx=0x7f229c00dd20).stop 2021-04-09T18:35:59.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.402 7f22a5bee700 1 -- 172.21.15.79:0/4213293581 reap_dead start 2021-04-09T18:35:59.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.402 7f22a7649700 1 -- 172.21.15.79:0/4213293581 shutdown_connections 2021-04-09T18:35:59.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.402 7f22a7649700 1 -- 172.21.15.79:0/4213293581 >> 172.21.15.79:0/4213293581 conn(0x7f22a01a1170 msgr2=0x7f22a0095510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:59.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.402 7f22a7649700 1 -- 172.21.15.79:0/4213293581 shutdown_connections 2021-04-09T18:35:59.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.402 7f22a7649700 1 -- 172.21.15.79:0/4213293581 wait complete. 2021-04-09T18:35:59.428 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2021-04-09T18:35:59.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.518 7f6a697a1700 1 Processor -- start 2021-04-09T18:35:59.531 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.518 7f6a697a1700 1 -- start start 2021-04-09T18:35:59.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.518 7f6a697a1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6a640f5520 0x7f6a640f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.518 7f6a697a1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6a640e9ae0 0x7f6a6409f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.518 7f6a697a1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a641c2db0 0x7f6a641c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.532 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.518 7f6a697a1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a640e9f30 con 0x7f6a640e9ae0 2021-04-09T18:35:59.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.518 7f6a697a1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a640e59d0 con 0x7f6a640f5520 2021-04-09T18:35:59.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.518 7f6a697a1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a640fbb20 con 0x7f6a641c2db0 2021-04-09T18:35:59.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.518 7f6a62cf4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6a640e9ae0 0x7f6a6409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.518 7f6a62cf4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6a640e9ae0 0x7f6a6409f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36160/0 (socket says 172.21.15.79:36160) 2021-04-09T18:35:59.533 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.518 7f6a62cf4700 1 -- 172.21.15.79:0/2191776357 learned_addr learned my addr 172.21.15.79:0/2191776357 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:59.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a63cf6700 1 --2- 172.21.15.79:0/2191776357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a641c2db0 0x7f6a641c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a634f5700 1 --2- 172.21.15.79:0/2191776357 >> v2:172.21.15.89:3300/0 conn(0x7f6a640f5520 0x7f6a640f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a62cf4700 1 -- 172.21.15.79:0/2191776357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a641c2db0 msgr2=0x7f6a641c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:59.534 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a62cf4700 1 --2- 172.21.15.79:0/2191776357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a641c2db0 0x7f6a641c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a62cf4700 1 -- 172.21.15.79:0/2191776357 >> v2:172.21.15.89:3300/0 conn(0x7f6a640f5520 msgr2=0x7f6a640f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:59.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a62cf4700 1 --2- 172.21.15.79:0/2191776357 >> v2:172.21.15.89:3300/0 conn(0x7f6a640f5520 0x7f6a640f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.535 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a62cf4700 1 -- 172.21.15.79:0/2191776357 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a640e56d0 con 0x7f6a640e9ae0 2021-04-09T18:35:59.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a634f5700 1 --2- 172.21.15.79:0/2191776357 >> v2:172.21.15.89:3300/0 conn(0x7f6a640f5520 0x7f6a640f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:35:59.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a62cf4700 1 --2- 172.21.15.79:0/2191776357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a640e9ae0 0x7f6a6409f110 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f6a64125440 tx=0x7f6a4c00bda0).ready entity=mon.0 client_cookie=da3283776be39759 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:59.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a624f3700 1 -- 172.21.15.79:0/2191776357 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6a640e56d0 con 0x7f6a640e9ae0 2021-04-09T18:35:59.536 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a624f3700 1 -- 172.21.15.79:0/2191776357 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c009940 con 0x7f6a640e9ae0 2021-04-09T18:35:59.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a624f3700 1 -- 172.21.15.79:0/2191776357 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6a4c009d10 con 0x7f6a640e9ae0 2021-04-09T18:35:59.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a697a1700 1 -- 172.21.15.79:0/2191776357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a640e9ae0 msgr2=0x7f6a6409f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a697a1700 1 --2- 172.21.15.79:0/2191776357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a640e9ae0 0x7f6a6409f110 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f6a64125440 tx=0x7f6a4c00bda0).stop 2021-04-09T18:35:59.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a697a1700 1 -- 172.21.15.79:0/2191776357 shutdown_connections 2021-04-09T18:35:59.537 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a697a1700 1 --2- 172.21.15.79:0/2191776357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a641c2db0 0x7f6a641c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a697a1700 1 --2- 172.21.15.79:0/2191776357 >> v2:172.21.15.89:3300/0 conn(0x7f6a640f5520 0x7f6a640f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a697a1700 1 --2- 172.21.15.79:0/2191776357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a640e9ae0 0x7f6a6409f110 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.538 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a697a1700 1 -- 172.21.15.79:0/2191776357 >> 172.21.15.79:0/2191776357 conn(0x7f6a640e5fe0 msgr2=0x7f6a640e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:59.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a697a1700 1 -- 172.21.15.79:0/2191776357 shutdown_connections 2021-04-09T18:35:59.539 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.522 7f6a697a1700 1 -- 172.21.15.79:0/2191776357 wait complete. 2021-04-09T18:35:59.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a697a1700 1 Processor -- start 2021-04-09T18:35:59.542 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a697a1700 1 -- start start 2021-04-09T18:35:59.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a697a1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a640c1130 0x7f6a640d5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a697a1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a640c3c50 0x7f6a641ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.543 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a697a1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a641aaa40 0x7f6a641aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a697a1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a640c2150 con 0x7f6a640c3c50 2021-04-09T18:35:59.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a697a1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a640c2450 con 0x7f6a641aaa40 2021-04-09T18:35:59.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a697a1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a640bb460 con 0x7f6a640c1130 2021-04-09T18:35:59.544 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a62cf4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a640c3c50 0x7f6a641ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a62cf4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a640c3c50 0x7f6a641ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36164/0 (socket says 172.21.15.79:36164) 2021-04-09T18:35:59.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a62cf4700 1 -- 172.21.15.79:0/2202370659 learned_addr learned my addr 172.21.15.79:0/2202370659 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:59.545 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a63cf6700 1 --2- 172.21.15.79:0/2202370659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a641aaa40 0x7f6a641aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a634f5700 1 --2- 172.21.15.79:0/2202370659 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a640c1130 0x7f6a640d5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.546 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a62cf4700 1 -- 172.21.15.79:0/2202370659 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a640c1130 msgr2=0x7f6a640d5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a62cf4700 1 --2- 172.21.15.79:0/2202370659 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a640c1130 0x7f6a640d5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a62cf4700 1 -- 172.21.15.79:0/2202370659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a641aaa40 msgr2=0x7f6a641aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a62cf4700 1 --2- 172.21.15.79:0/2202370659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a641aaa40 0x7f6a641aae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a62cf4700 1 -- 172.21.15.79:0/2202370659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a640c39d0 con 0x7f6a640c3c50 2021-04-09T18:35:59.547 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a62cf4700 1 --2- 172.21.15.79:0/2202370659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a640c3c50 0x7f6a641ae000 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f6a64099b80 tx=0x7f6a4c006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:59.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a5bfff700 1 -- 172.21.15.79:0/2202370659 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6a640c39d0 con 0x7f6a640c3c50 2021-04-09T18:35:59.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a5bfff700 1 -- 172.21.15.79:0/2202370659 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c01d450 con 0x7f6a640c3c50 2021-04-09T18:35:59.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a697a1700 1 -- 172.21.15.79:0/2202370659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a641abcc0 con 0x7f6a640c3c50 2021-04-09T18:35:59.548 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a5bfff700 1 -- 172.21.15.79:0/2202370659 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6a4c022070 con 0x7f6a640c3c50 2021-04-09T18:35:59.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.526 7f6a697a1700 1 -- 172.21.15.79:0/2202370659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a640c0470 con 0x7f6a640c3c50 2021-04-09T18:35:59.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.530 7f6a5bfff700 1 -- 172.21.15.79:0/2202370659 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6a4c026410 con 0x7f6a640c3c50 2021-04-09T18:35:59.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.530 7f6a5bfff700 1 --2- 172.21.15.79:0/2202370659 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6a48029100 0x7f6a4802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.530 7f6a5bfff700 1 -- 172.21.15.79:0/2202370659 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f6a4c03ba20 con 0x7f6a640c3c50 2021-04-09T18:35:59.549 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.530 7f6a634f5700 1 --2- 172.21.15.79:0/2202370659 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6a48029100 0x7f6a4802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.530 7f6a634f5700 1 --2- 172.21.15.79:0/2202370659 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6a48029100 0x7f6a4802b650 crc :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:59.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.534 7f6a697a1700 1 -- 172.21.15.79:0/2202370659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a640e39e0 con 0x7f6a640c3c50 2021-04-09T18:35:59.550 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.542 7f6a5bfff700 1 -- 172.21.15.79:0/2202370659 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6a4c009730 con 0x7f6a640c3c50 2021-04-09T18:35:59.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.710 7f6a697a1700 1 -- 172.21.15.79:0/2202370659 --> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] -- command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mgr", ""]}) v1 -- 0x7f6a640f5b20 con 0x7f6a48029100 2021-04-09T18:35:59.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.710 7f6a5bfff700 1 -- 172.21.15.79:0/2202370659 <== mgr.4100 v2:172.21.15.89:6800/13779 1 ==== command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7f6a640f5b20 con 0x7f6a48029100 2021-04-09T18:35:59.717 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 5 to deep-scrub 2021-04-09T18:35:59.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.714 7f6a697a1700 1 -- 172.21.15.79:0/2202370659 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6a48029100 msgr2=0x7f6a4802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.714 7f6a697a1700 1 --2- 172.21.15.79:0/2202370659 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6a48029100 0x7f6a4802b650 crc :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.714 7f6a697a1700 1 -- 172.21.15.79:0/2202370659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a640c3c50 msgr2=0x7f6a641ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.714 7f6a697a1700 1 --2- 172.21.15.79:0/2202370659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a640c3c50 0x7f6a641ae000 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f6a64099b80 tx=0x7f6a4c006890).stop 2021-04-09T18:35:59.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.714 7f6a697a1700 1 -- 172.21.15.79:0/2202370659 shutdown_connections 2021-04-09T18:35:59.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.714 7f6a697a1700 1 --2- 172.21.15.79:0/2202370659 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f6a48029100 0x7f6a4802b650 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.714 7f6a697a1700 1 --2- 172.21.15.79:0/2202370659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a641aaa40 0x7f6a641aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.714 7f6a697a1700 1 --2- 172.21.15.79:0/2202370659 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a640c1130 0x7f6a640d5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.714 7f6a697a1700 1 --2- 172.21.15.79:0/2202370659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a640c3c50 0x7f6a641ae000 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.714 7f6a697a1700 1 -- 172.21.15.79:0/2202370659 >> 172.21.15.79:0/2202370659 conn(0x7f6a6409ab80 msgr2=0x7f6a6409a170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:59.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.714 7f6a697a1700 1 -- 172.21.15.79:0/2202370659 shutdown_connections 2021-04-09T18:35:59.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.714 7f6a697a1700 1 -- 172.21.15.79:0/2202370659 wait complete. 2021-04-09T18:35:59.729 INFO:tasks.ceph:Scrubbing osd.6 2021-04-09T18:35:59.729 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2021-04-09T18:35:59.831 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.818 7fb9b0dba700 1 Processor -- start 2021-04-09T18:35:59.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.818 7fb9b0dba700 1 -- start start 2021-04-09T18:35:59.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.818 7fb9b0dba700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9ac0e9b00 0x7fb9ac09f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.818 7fb9b0dba700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb9ac1c8030 0x7fb9ac1ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.832 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.818 7fb9b0dba700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ac0fbb40 con 0x7fb9ac0f5540 2021-04-09T18:35:59.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.818 7fb9b0dba700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ac1c3de0 con 0x7fb9ac1c8030 2021-04-09T18:35:59.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.818 7fb9b0dba700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0e9f50 con 0x7fb9ac0e9b00 2021-04-09T18:35:59.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.818 7fb9ab2f0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb9ac1c8030 0x7fb9ac1ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.818 7fb9ab2f0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb9ac1c8030 0x7fb9ac1ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36174/0 (socket says 172.21.15.79:36174) 2021-04-09T18:35:59.833 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.818 7fb9ab2f0700 1 -- 172.21.15.79:0/2846085547 learned_addr learned my addr 172.21.15.79:0/2846085547 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:59.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.818 7fb9aa2ee700 1 --2- 172.21.15.79:0/2846085547 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9ac0e9b00 0x7fb9ac09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.818 7fb9ab2f0700 1 -- 172.21.15.79:0/2846085547 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9ac0e9b00 msgr2=0x7fb9ac09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:35:59.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.818 7fb9ab2f0700 1 --2- 172.21.15.79:0/2846085547 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9ac0e9b00 0x7fb9ac09f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.834 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.818 7fb9ab2f0700 1 -- 172.21.15.79:0/2846085547 >> v1:172.21.15.89:6789/0 conn(0x7fb9ac0f5540 legacy=0x7fb9ac0f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.818 7fb9ab2f0700 1 -- 172.21.15.79:0/2846085547 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac0e56f0 con 0x7fb9ac1c8030 2021-04-09T18:35:59.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.822 7fb9ab2f0700 1 --2- 172.21.15.79:0/2846085547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9ac1c8030 0x7fb9ac1ca490 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7fb9a4002f30 tx=0x7fb9a400bda0).ready entity=mon.0 client_cookie=fcbada4fabbde080 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:59.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.822 7fb9a9aed700 1 -- 172.21.15.79:0/2846085547 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb9ac0e56f0 con 0x7fb9ac1c8030 2021-04-09T18:35:59.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.822 7fb9a9aed700 1 -- 172.21.15.79:0/2846085547 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a40099d0 con 0x7fb9ac1c8030 2021-04-09T18:35:59.835 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.822 7fb9a9aed700 1 -- 172.21.15.79:0/2846085547 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb9a4009da0 con 0x7fb9ac1c8030 2021-04-09T18:35:59.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.822 7fb9b0dba700 1 -- 172.21.15.79:0/2846085547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9ac1c8030 msgr2=0x7fb9ac1ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.822 7fb9b0dba700 1 --2- 172.21.15.79:0/2846085547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9ac1c8030 0x7fb9ac1ca490 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7fb9a4002f30 tx=0x7fb9a400bda0).stop 2021-04-09T18:35:59.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.822 7fb9b0dba700 1 -- 172.21.15.79:0/2846085547 shutdown_connections 2021-04-09T18:35:59.836 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.822 7fb9b0dba700 1 --2- 172.21.15.79:0/2846085547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9ac1c8030 0x7fb9ac1ca490 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.822 7fb9b0dba700 1 --2- 172.21.15.79:0/2846085547 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9ac0e9b00 0x7fb9ac09f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.822 7fb9b0dba700 1 -- 172.21.15.79:0/2846085547 >> 172.21.15.79:0/2846085547 conn(0x7fb9ac0e6000 msgr2=0x7fb9ac0e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:59.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.822 7fb9b0dba700 1 -- 172.21.15.79:0/2846085547 shutdown_connections 2021-04-09T18:35:59.837 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.822 7fb9b0dba700 1 -- 172.21.15.79:0/2846085547 wait complete. 2021-04-09T18:35:59.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.826 7fb9b0dba700 1 Processor -- start 2021-04-09T18:35:59.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.826 7fb9b0dba700 1 -- start start 2021-04-09T18:35:59.840 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.826 7fb9b0dba700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9ac0bae60 0x7fb9ac0983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.826 7fb9b0dba700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9ac0d5fb0 0x7fb9ac0d4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.826 7fb9b0dba700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9ac0d6400 0x7fb9ac097300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.826 7fb9b0dba700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0aca90 con 0x7fb9ac0d6400 2021-04-09T18:35:59.841 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.826 7fb9b0dba700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0acd90 con 0x7fb9ac0bae60 2021-04-09T18:35:59.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.826 7fb9b0dba700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac098a00 con 0x7fb9ac0d5fb0 2021-04-09T18:35:59.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.826 7fb9ab2f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9ac0d6400 0x7fb9ac097300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.826 7fb9ab2f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9ac0d6400 0x7fb9ac097300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36180/0 (socket says 172.21.15.79:36180) 2021-04-09T18:35:59.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.826 7fb9ab2f0700 1 -- 172.21.15.79:0/111142166 learned_addr learned my addr 172.21.15.79:0/111142166 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:59.842 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.826 7fb9aaaef700 1 --2- 172.21.15.79:0/111142166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9ac0bae60 0x7fb9ac0983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.826 7fb9aa2ee700 1 --2- 172.21.15.79:0/111142166 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9ac0d5fb0 0x7fb9ac0d4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.826 7fb9ab2f0700 1 -- 172.21.15.79:0/111142166 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9ac0d5fb0 msgr2=0x7fb9ac0d4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.826 7fb9ab2f0700 1 --2- 172.21.15.79:0/111142166 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9ac0d5fb0 0x7fb9ac0d4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.843 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.826 7fb9ab2f0700 1 -- 172.21.15.79:0/111142166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9ac0bae60 msgr2=0x7fb9ac0983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.826 7fb9ab2f0700 1 --2- 172.21.15.79:0/111142166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9ac0bae60 0x7fb9ac0983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.826 7fb9ab2f0700 1 -- 172.21.15.79:0/111142166 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac0ac620 con 0x7fb9ac0d6400 2021-04-09T18:35:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.826 7fb9aa2ee700 1 --2- 172.21.15.79:0/111142166 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9ac0d5fb0 0x7fb9ac0d4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.826 7fb9aaaef700 1 --2- 172.21.15.79:0/111142166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9ac0bae60 0x7fb9ac0983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:35:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.830 7fb9ab2f0700 1 --2- 172.21.15.79:0/111142166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9ac0d6400 0x7fb9ac097300 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7fb9a4002f30 tx=0x7fb9a4006890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.830 7fb9a37fe700 1 -- 172.21.15.79:0/111142166 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb9ac0ac620 con 0x7fb9ac0d6400 2021-04-09T18:35:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.830 7fb9a37fe700 1 -- 172.21.15.79:0/111142166 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a4011be0 con 0x7fb9ac0d6400 2021-04-09T18:35:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.830 7fb9b0dba700 1 -- 172.21.15.79:0/111142166 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ac0bb2b0 con 0x7fb9ac0d6400 2021-04-09T18:35:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.830 7fb9a37fe700 1 -- 172.21.15.79:0/111142166 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb9a4022020 con 0x7fb9ac0d6400 2021-04-09T18:35:59.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.830 7fb9b0dba700 1 -- 172.21.15.79:0/111142166 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ac0ae4c0 con 0x7fb9ac0d6400 2021-04-09T18:35:59.846 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.830 7fb9a37fe700 1 -- 172.21.15.79:0/111142166 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb9a401c4e0 con 0x7fb9ac0d6400 2021-04-09T18:35:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.830 7fb9a37fe700 1 --2- 172.21.15.79:0/111142166 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb990029100 0x7fb99002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.830 7fb9a37fe700 1 -- 172.21.15.79:0/111142166 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7fb9a403d440 con 0x7fb9ac0d6400 2021-04-09T18:35:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.830 7fb9aaaef700 1 --2- 172.21.15.79:0/111142166 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb990029100 0x7fb99002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.830 7fb9aaaef700 1 --2- 172.21.15.79:0/111142166 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb990029100 0x7fb99002b650 crc :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.834 7fb9b0dba700 1 --2- 172.21.15.79:0/111142166 >> [v2:172.21.15.89:6802/14211,v1:172.21.15.89:6803/14211] conn(0x7fb9ac097930 0x7fb9ac0961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.834 7fb9b0dba700 1 -- 172.21.15.79:0/111142166 --> [v2:172.21.15.89:6802/14211,v1:172.21.15.89:6803/14211] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb9ac0e39e0 con 0x7fb9ac097930 2021-04-09T18:35:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.834 7fb9aa2ee700 1 --2- 172.21.15.79:0/111142166 >> [v2:172.21.15.89:6802/14211,v1:172.21.15.89:6803/14211] conn(0x7fb9ac097930 0x7fb9ac0961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.855 INFO:teuthology.orchestra.run.smithi079.stderr:Set osd_debug_deep_scrub_sleep to 0 2021-04-09T18:35:59.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.834 7fb9aa2ee700 1 --2- 172.21.15.79:0/111142166 >> [v2:172.21.15.89:6802/14211,v1:172.21.15.89:6803/14211] conn(0x7fb9ac097930 0x7fb9ac0961f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:59.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.834 7fb9a37fe700 1 -- 172.21.15.79:0/111142166 <== osd.6 v2:172.21.15.89:6802/14211 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7fb9ac0e39e0 con 0x7fb9ac097930 2021-04-09T18:35:59.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.850 7fb9b0dba700 1 -- 172.21.15.79:0/111142166 --> [v2:172.21.15.89:6802/14211,v1:172.21.15.89:6803/14211] -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7fb9ac0f5b40 con 0x7fb9ac097930 2021-04-09T18:35:59.865 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.850 7fb9a37fe700 1 -- 172.21.15.79:0/111142166 <== osd.6 v2:172.21.15.89:6802/14211 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (crc 0 0 0) 0x7fb9ac0f5b40 con 0x7fb9ac097930 2021-04-09T18:35:59.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.850 7fb9b0dba700 1 -- 172.21.15.79:0/111142166 >> [v2:172.21.15.89:6802/14211,v1:172.21.15.89:6803/14211] conn(0x7fb9ac097930 msgr2=0x7fb9ac0961f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.850 7fb9b0dba700 1 --2- 172.21.15.79:0/111142166 >> [v2:172.21.15.89:6802/14211,v1:172.21.15.89:6803/14211] conn(0x7fb9ac097930 0x7fb9ac0961f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.850 7fb9b0dba700 1 -- 172.21.15.79:0/111142166 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb990029100 msgr2=0x7fb99002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.866 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.850 7fb9b0dba700 1 --2- 172.21.15.79:0/111142166 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fb990029100 0x7fb99002b650 crc :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.850 7fb9b0dba700 1 -- 172.21.15.79:0/111142166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9ac0d6400 msgr2=0x7fb9ac097300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.850 7fb9b0dba700 1 --2- 172.21.15.79:0/111142166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9ac0d6400 0x7fb9ac097300 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7fb9a4002f30 tx=0x7fb9a4006890).stop 2021-04-09T18:35:59.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.850 7fb9ab2f0700 1 -- 172.21.15.79:0/111142166 reap_dead start 2021-04-09T18:35:59.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.850 7fb9b0dba700 1 -- 172.21.15.79:0/111142166 shutdown_connections 2021-04-09T18:35:59.867 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.850 7fb9b0dba700 1 -- 172.21.15.79:0/111142166 >> 172.21.15.79:0/111142166 conn(0x7fb9ac09aa10 msgr2=0x7fb9ac0d7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:59.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.850 7fb9b0dba700 1 -- 172.21.15.79:0/111142166 shutdown_connections 2021-04-09T18:35:59.868 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.850 7fb9b0dba700 1 -- 172.21.15.79:0/111142166 wait complete. 2021-04-09T18:35:59.883 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2021-04-09T18:35:59.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.970 7fdc41d9a700 1 Processor -- start 2021-04-09T18:35:59.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.970 7fdc41d9a700 1 -- start start 2021-04-09T18:35:59.990 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc41d9a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc3c0f5520 0x7fdc3c0f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc41d9a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc3c0fbb20 con 0x7fdc3c0e9ae0 2021-04-09T18:35:59.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc41d9a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc3c09f910 con 0x7fdc3c1c8010 2021-04-09T18:35:59.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc41d9a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c0e9f30 con 0x7fdc3c0f5520 2021-04-09T18:35:59.991 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc3affd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdc3c0e9ae0 0x7fdc3c09f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59132/0 (socket says 172.21.15.79:59132) 2021-04-09T18:35:59.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc3affd700 1 -- 172.21.15.79:0/1527136490 learned_addr learned my addr 172.21.15.79:0/1527136490 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:35:59.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc3b7fe700 1 --2- 172.21.15.79:0/1527136490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc3c0f5520 0x7fdc3c0f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc3a7fc700 1 -- 172.21.15.79:0/1527136490 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538464364 0 0) 0x7fdc240010d0 con 0x7fdc3c0e9ae0 2021-04-09T18:35:59.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc3a7fc700 1 -- 172.21.15.79:0/1527136490 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc1c003240 con 0x7fdc3c0e9ae0 2021-04-09T18:35:59.992 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc3b7fe700 1 -- 172.21.15.79:0/1527136490 >> v1:172.21.15.89:6789/0 conn(0x7fdc3c1c8010 legacy=0x7fdc3c1ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc3b7fe700 1 -- 172.21.15.79:0/1527136490 >> v1:172.21.15.79:6789/0 conn(0x7fdc3c0e9ae0 legacy=0x7fdc3c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc3b7fe700 1 -- 172.21.15.79:0/1527136490 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3c0e56d0 con 0x7fdc3c0f5520 2021-04-09T18:35:59.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc3b7fe700 1 --2- 172.21.15.79:0/1527136490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc3c0f5520 0x7fdc3c0f64b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fdc340032b0 tx=0x7fdc3400b0e0).ready entity=mon.2 client_cookie=d44637dfcae730fb server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:35:59.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc3a7fc700 1 -- 172.21.15.79:0/1527136490 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdc3c0e56d0 con 0x7fdc3c0f5520 2021-04-09T18:35:59.993 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc3a7fc700 1 -- 172.21.15.79:0/1527136490 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3400baf0 con 0x7fdc3c0f5520 2021-04-09T18:35:59.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc41d9a700 1 -- 172.21.15.79:0/1527136490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc3c0f5520 msgr2=0x7fdc3c0f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc3a7fc700 1 -- 172.21.15.79:0/1527136490 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdc34002020 con 0x7fdc3c0f5520 2021-04-09T18:35:59.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc41d9a700 1 --2- 172.21.15.79:0/1527136490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc3c0f5520 0x7fdc3c0f64b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fdc340032b0 tx=0x7fdc3400b0e0).stop 2021-04-09T18:35:59.994 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc41d9a700 1 -- 172.21.15.79:0/1527136490 shutdown_connections 2021-04-09T18:35:59.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc41d9a700 1 --2- 172.21.15.79:0/1527136490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc3c0f5520 0x7fdc3c0f64b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc41d9a700 1 -- 172.21.15.79:0/1527136490 >> 172.21.15.79:0/1527136490 conn(0x7fdc3c0e5fe0 msgr2=0x7fdc3c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:35:59.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc41d9a700 1 -- 172.21.15.79:0/1527136490 shutdown_connections 2021-04-09T18:35:59.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.974 7fdc41d9a700 1 -- 172.21.15.79:0/1527136490 wait complete. 2021-04-09T18:35:59.995 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.978 7fdc41d9a700 1 Processor -- start 2021-04-09T18:35:59.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.978 7fdc41d9a700 1 -- start start 2021-04-09T18:35:59.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc41d9a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc3c19d5c0 0x7fdc3c0afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc41d9a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc3c1ab010 0x7fdc3c0d51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.996 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc41d9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc3c0d57f0 0x7fdc3c1ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:35:59.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc41d9a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c1c3dc0 con 0x7fdc3c0d57f0 2021-04-09T18:35:59.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc41d9a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c19bd20 con 0x7fdc3c1ab010 2021-04-09T18:35:59.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc41d9a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c19c020 con 0x7fdc3c19d5c0 2021-04-09T18:35:59.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc3bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc3c0d57f0 0x7fdc3c1ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.997 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc3bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc3c0d57f0 0x7fdc3c1ae630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36196/0 (socket says 172.21.15.79:36196) 2021-04-09T18:35:59.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc3bfff700 1 -- 172.21.15.79:0/2637458473 learned_addr learned my addr 172.21.15.79:0/2637458473 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:35:59.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc3affd700 1 --2- 172.21.15.79:0/2637458473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc3c1ab010 0x7fdc3c0d51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc3b7fe700 1 --2- 172.21.15.79:0/2637458473 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc3c19d5c0 0x7fdc3c0afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:35:59.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc3bfff700 1 -- 172.21.15.79:0/2637458473 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc3c19d5c0 msgr2=0x7fdc3c0afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.998 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc3bfff700 1 --2- 172.21.15.79:0/2637458473 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc3c19d5c0 0x7fdc3c0afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc3bfff700 1 -- 172.21.15.79:0/2637458473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc3c1ab010 msgr2=0x7fdc3c0d51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:35:59.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc3bfff700 1 --2- 172.21.15.79:0/2637458473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc3c1ab010 0x7fdc3c0d51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:35:59.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc3bfff700 1 -- 172.21.15.79:0/2637458473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3c1a2210 con 0x7fdc3c0d57f0 2021-04-09T18:35:59.999 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc3bfff700 1 --2- 172.21.15.79:0/2637458473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc3c0d57f0 0x7fdc3c1ae630 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7fdc3c0d83c0 tx=0x7fdc2c00cb10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:36:00.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc33fff700 1 -- 172.21.15.79:0/2637458473 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdc3c1a2210 con 0x7fdc3c0d57f0 2021-04-09T18:36:00.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc33fff700 1 -- 172.21.15.79:0/2637458473 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2c007240 con 0x7fdc3c0d57f0 2021-04-09T18:36:00.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc41d9a700 1 -- 172.21.15.79:0/2637458473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc3c0b00a0 con 0x7fdc3c0d57f0 2021-04-09T18:36:00.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc33fff700 1 -- 172.21.15.79:0/2637458473 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdc2c0066e0 con 0x7fdc3c0d57f0 2021-04-09T18:36:00.000 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc41d9a700 1 -- 172.21.15.79:0/2637458473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc3c19da10 con 0x7fdc3c0d57f0 2021-04-09T18:36:00.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc33fff700 1 -- 172.21.15.79:0/2637458473 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fdc2c0068e0 con 0x7fdc3c0d57f0 2021-04-09T18:36:00.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc33fff700 1 --2- 172.21.15.79:0/2637458473 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdc14029100 0x7fdc1402b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.002 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc33fff700 1 -- 172.21.15.79:0/2637458473 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7fdc2c038cd0 con 0x7fdc3c0d57f0 2021-04-09T18:36:00.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.982 7fdc3b7fe700 1 --2- 172.21.15.79:0/2637458473 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdc14029100 0x7fdc1402b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.986 7fdc3b7fe700 1 --2- 172.21.15.79:0/2637458473 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdc14029100 0x7fdc1402b650 crc :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:36:00.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.986 7fdc41d9a700 1 -- 172.21.15.79:0/2637458473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc3c0e39e0 con 0x7fdc3c0d57f0 2021-04-09T18:36:00.003 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:35:59.990 7fdc33fff700 1 -- 172.21.15.79:0/2637458473 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fdc2c007030 con 0x7fdc3c0d57f0 2021-04-09T18:36:00.157 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.150 7fdc41d9a700 1 -- 172.21.15.79:0/2637458473 --> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] -- command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mgr", ""]}) v1 -- 0x7fdc3c0b02a0 con 0x7fdc14029100 2021-04-09T18:36:00.158 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.150 7fdc33fff700 1 -- 172.21.15.79:0/2637458473 <== mgr.4100 v2:172.21.15.89:6800/13779 1 ==== command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7fdc3c0b02a0 con 0x7fdc14029100 2021-04-09T18:36:00.158 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 6 to deep-scrub 2021-04-09T18:36:00.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.154 7fdc41d9a700 1 -- 172.21.15.79:0/2637458473 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdc14029100 msgr2=0x7fdc1402b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:36:00.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.154 7fdc41d9a700 1 --2- 172.21.15.79:0/2637458473 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdc14029100 0x7fdc1402b650 crc :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.161 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.154 7fdc41d9a700 1 -- 172.21.15.79:0/2637458473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc3c0d57f0 msgr2=0x7fdc3c1ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:36:00.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.154 7fdc41d9a700 1 --2- 172.21.15.79:0/2637458473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc3c0d57f0 0x7fdc3c1ae630 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7fdc3c0d83c0 tx=0x7fdc2c00cb10).stop 2021-04-09T18:36:00.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.154 7fdc41d9a700 1 -- 172.21.15.79:0/2637458473 shutdown_connections 2021-04-09T18:36:00.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.154 7fdc41d9a700 1 --2- 172.21.15.79:0/2637458473 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fdc14029100 0x7fdc1402b650 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.154 7fdc41d9a700 1 --2- 172.21.15.79:0/2637458473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc3c0d57f0 0x7fdc3c1ae630 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.162 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.154 7fdc41d9a700 1 --2- 172.21.15.79:0/2637458473 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc3c19d5c0 0x7fdc3c0afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.154 7fdc41d9a700 1 --2- 172.21.15.79:0/2637458473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc3c1ab010 0x7fdc3c0d51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.154 7fdc41d9a700 1 -- 172.21.15.79:0/2637458473 >> 172.21.15.79:0/2637458473 conn(0x7fdc3c09b2a0 msgr2=0x7fdc3c0ba7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:36:00.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.154 7fdc41d9a700 1 -- 172.21.15.79:0/2637458473 shutdown_connections 2021-04-09T18:36:00.163 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.154 7fdc41d9a700 1 -- 172.21.15.79:0/2637458473 wait complete. 2021-04-09T18:36:00.170 INFO:tasks.ceph:Scrubbing osd.7 2021-04-09T18:36:00.171 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2021-04-09T18:36:00.277 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8ff4e700 1 Processor -- start 2021-04-09T18:36:00.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8ff4e700 1 -- start start 2021-04-09T18:36:00.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8ff4e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4e880e9b10 0x7f4e8809f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8ff4e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4e881c8040 0x7f4e881ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.278 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8ff4e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e880fbb50 con 0x7f4e880f5550 2021-04-09T18:36:00.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8ff4e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e881c3df0 con 0x7f4e881c8040 2021-04-09T18:36:00.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8ff4e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e880e9f60 con 0x7f4e880e9b10 2021-04-09T18:36:00.279 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8e4f3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4e881c8040 0x7f4e881ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8e4f3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4e881c8040 0x7f4e881ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36200/0 (socket says 172.21.15.79:36200) 2021-04-09T18:36:00.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8e4f3700 1 -- 172.21.15.79:0/2008343356 learned_addr learned my addr 172.21.15.79:0/2008343356 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:36:00.280 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8d4f1700 1 --2- 172.21.15.79:0/2008343356 >> v2:172.21.15.89:3300/0 conn(0x7f4e880e9b10 0x7f4e8809f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8e4f3700 1 -- 172.21.15.79:0/2008343356 >> v2:172.21.15.89:3300/0 conn(0x7f4e880e9b10 msgr2=0x7f4e8809f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:36:00.281 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8e4f3700 1 --2- 172.21.15.79:0/2008343356 >> v2:172.21.15.89:3300/0 conn(0x7f4e880e9b10 0x7f4e8809f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8e4f3700 1 -- 172.21.15.79:0/2008343356 >> v1:172.21.15.89:6789/0 conn(0x7f4e880f5550 legacy=0x7f4e880f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:36:00.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8e4f3700 1 -- 172.21.15.79:0/2008343356 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e880e5700 con 0x7f4e881c8040 2021-04-09T18:36:00.282 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8e4f3700 1 --2- 172.21.15.79:0/2008343356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e881c8040 0x7f4e881ca4a0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7f4e800032b0 tx=0x7f4e8000b3c0).ready entity=mon.0 client_cookie=9ade52f988bc1305 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:36:00.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8ccf0700 1 -- 172.21.15.79:0/2008343356 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4e880e5700 con 0x7f4e881c8040 2021-04-09T18:36:00.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8ccf0700 1 -- 172.21.15.79:0/2008343356 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8000bc20 con 0x7f4e881c8040 2021-04-09T18:36:00.283 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8ccf0700 1 -- 172.21.15.79:0/2008343356 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4e80002020 con 0x7f4e881c8040 2021-04-09T18:36:00.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8ff4e700 1 -- 172.21.15.79:0/2008343356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e881c8040 msgr2=0x7f4e881ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:36:00.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8ff4e700 1 --2- 172.21.15.79:0/2008343356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e881c8040 0x7f4e881ca4a0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7f4e800032b0 tx=0x7f4e8000b3c0).stop 2021-04-09T18:36:00.284 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8ff4e700 1 -- 172.21.15.79:0/2008343356 shutdown_connections 2021-04-09T18:36:00.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8ff4e700 1 --2- 172.21.15.79:0/2008343356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e881c8040 0x7f4e881ca4a0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.285 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8ff4e700 1 --2- 172.21.15.79:0/2008343356 >> v2:172.21.15.89:3300/0 conn(0x7f4e880e9b10 0x7f4e8809f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8ff4e700 1 -- 172.21.15.79:0/2008343356 >> 172.21.15.79:0/2008343356 conn(0x7f4e880e6010 msgr2=0x7f4e880e9310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:36:00.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8ff4e700 1 -- 172.21.15.79:0/2008343356 shutdown_connections 2021-04-09T18:36:00.286 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.266 7f4e8ff4e700 1 -- 172.21.15.79:0/2008343356 wait complete. 2021-04-09T18:36:00.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.270 7f4e8ff4e700 1 Processor -- start 2021-04-09T18:36:00.287 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.270 7f4e8ff4e700 1 -- start start 2021-04-09T18:36:00.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.270 7f4e8ff4e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e880baa60 0x7f4e88095fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.270 7f4e8ff4e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e880a5600 0x7f4e880d2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.293 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.270 7f4e8ff4e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e880a5a50 0x7f4e880d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.270 7f4e8ff4e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e880b91c0 con 0x7f4e880a5a50 2021-04-09T18:36:00.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.270 7f4e8ff4e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e880b94c0 con 0x7f4e880a5600 2021-04-09T18:36:00.294 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.270 7f4e8ff4e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e88090ae0 con 0x7f4e880baa60 2021-04-09T18:36:00.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.270 7f4e8e4f3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e880a5a50 0x7f4e880d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.270 7f4e8e4f3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e880a5a50 0x7f4e880d26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36210/0 (socket says 172.21.15.79:36210) 2021-04-09T18:36:00.295 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.270 7f4e8e4f3700 1 -- 172.21.15.79:0/2694135243 learned_addr learned my addr 172.21.15.79:0/2694135243 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:36:00.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.274 7f4e8dcf2700 1 --2- 172.21.15.79:0/2694135243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e880baa60 0x7f4e88095fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.274 7f4e8d4f1700 1 --2- 172.21.15.79:0/2694135243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e880a5600 0x7f4e880d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.296 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.274 7f4e8e4f3700 1 -- 172.21.15.79:0/2694135243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e880baa60 msgr2=0x7f4e88095fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:36:00.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.274 7f4e8e4f3700 1 --2- 172.21.15.79:0/2694135243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e880baa60 0x7f4e88095fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.274 7f4e8e4f3700 1 -- 172.21.15.79:0/2694135243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e880a5600 msgr2=0x7f4e880d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:36:00.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.274 7f4e8e4f3700 1 --2- 172.21.15.79:0/2694135243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e880a5600 0x7f4e880d2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.274 7f4e8e4f3700 1 -- 172.21.15.79:0/2694135243 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e880965f0 con 0x7f4e880a5a50 2021-04-09T18:36:00.297 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.274 7f4e8dcf2700 1 --2- 172.21.15.79:0/2694135243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e880baa60 0x7f4e88095fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:36:00.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.274 7f4e8d4f1700 1 --2- 172.21.15.79:0/2694135243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e880a5600 0x7f4e880d2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:36:00.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.274 7f4e8e4f3700 1 --2- 172.21.15.79:0/2694135243 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e880a5a50 0x7f4e880d26b0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f4e800032b0 tx=0x7f4e80006c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:36:00.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.274 7f4e7e7fc700 1 -- 172.21.15.79:0/2694135243 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4e880965f0 con 0x7f4e880a5a50 2021-04-09T18:36:00.298 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.274 7f4e7e7fc700 1 -- 172.21.15.79:0/2694135243 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8001a5d0 con 0x7f4e880a5a50 2021-04-09T18:36:00.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.274 7f4e8ff4e700 1 -- 172.21.15.79:0/2694135243 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e88096940 con 0x7f4e880a5a50 2021-04-09T18:36:00.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.274 7f4e7e7fc700 1 -- 172.21.15.79:0/2694135243 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4e80020020 con 0x7f4e880a5a50 2021-04-09T18:36:00.299 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.274 7f4e8ff4e700 1 -- 172.21.15.79:0/2694135243 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e880b8ce0 con 0x7f4e880a5a50 2021-04-09T18:36:00.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.274 7f4e7e7fc700 1 -- 172.21.15.79:0/2694135243 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4e80019040 con 0x7f4e880a5a50 2021-04-09T18:36:00.300 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.274 7f4e7e7fc700 1 --2- 172.21.15.79:0/2694135243 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4e70029100 0x7f4e7002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.274 7f4e7e7fc700 1 -- 172.21.15.79:0/2694135243 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7f4e80018040 con 0x7f4e880a5a50 2021-04-09T18:36:00.301 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.274 7f4e8dcf2700 1 --2- 172.21.15.79:0/2694135243 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4e70029100 0x7f4e7002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.278 7f4e8dcf2700 1 --2- 172.21.15.79:0/2694135243 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4e70029100 0x7f4e7002b650 crc :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:36:00.302 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.278 7f4e8ff4e700 1 --2- 172.21.15.79:0/2694135243 >> [v2:172.21.15.89:6818/14233,v1:172.21.15.89:6819/14233] conn(0x7f4e880a9bb0 0x7f4e881a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.278 7f4e8ff4e700 1 -- 172.21.15.79:0/2694135243 --> [v2:172.21.15.89:6818/14233,v1:172.21.15.89:6819/14233] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4e880e39f0 con 0x7f4e880a9bb0 2021-04-09T18:36:00.303 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.282 7f4e8d4f1700 1 --2- 172.21.15.79:0/2694135243 >> [v2:172.21.15.89:6818/14233,v1:172.21.15.89:6819/14233] conn(0x7f4e880a9bb0 0x7f4e881a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.282 7f4e8d4f1700 1 --2- 172.21.15.79:0/2694135243 >> [v2:172.21.15.89:6818/14233,v1:172.21.15.89:6819/14233] conn(0x7f4e880a9bb0 0x7f4e881a88a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:36:00.304 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.282 7f4e7e7fc700 1 -- 172.21.15.79:0/2694135243 <== osd.7 v2:172.21.15.89:6818/14233 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f4e880e39f0 con 0x7f4e880a9bb0 2021-04-09T18:36:00.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.298 7f4e8ff4e700 1 -- 172.21.15.79:0/2694135243 --> [v2:172.21.15.89:6818/14233,v1:172.21.15.89:6819/14233] -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7f4e880a1c90 con 0x7f4e880a9bb0 2021-04-09T18:36:00.308 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.298 7f4e7e7fc700 1 -- 172.21.15.79:0/2694135243 <== osd.7 v2:172.21.15.89:6818/14233 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (crc 0 0 0) 0x7f4e880a1c90 con 0x7f4e880a9bb0 2021-04-09T18:36:00.309 INFO:teuthology.orchestra.run.smithi079.stderr:Set osd_debug_deep_scrub_sleep to 0 2021-04-09T18:36:00.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.298 7f4e8ff4e700 1 -- 172.21.15.79:0/2694135243 >> [v2:172.21.15.89:6818/14233,v1:172.21.15.89:6819/14233] conn(0x7f4e880a9bb0 msgr2=0x7f4e881a88a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:36:00.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.298 7f4e8ff4e700 1 --2- 172.21.15.79:0/2694135243 >> [v2:172.21.15.89:6818/14233,v1:172.21.15.89:6819/14233] conn(0x7f4e880a9bb0 0x7f4e881a88a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.309 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.298 7f4e8ff4e700 1 -- 172.21.15.79:0/2694135243 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4e70029100 msgr2=0x7f4e7002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:36:00.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.298 7f4e8ff4e700 1 --2- 172.21.15.79:0/2694135243 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7f4e70029100 0x7f4e7002b650 crc :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.298 7f4e8ff4e700 1 -- 172.21.15.79:0/2694135243 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e880a5a50 msgr2=0x7f4e880d26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:36:00.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.298 7f4e8ff4e700 1 --2- 172.21.15.79:0/2694135243 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e880a5a50 0x7f4e880d26b0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f4e800032b0 tx=0x7f4e80006c10).stop 2021-04-09T18:36:00.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.298 7f4e8e4f3700 1 -- 172.21.15.79:0/2694135243 reap_dead start 2021-04-09T18:36:00.310 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.298 7f4e8ff4e700 1 -- 172.21.15.79:0/2694135243 shutdown_connections 2021-04-09T18:36:00.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.298 7f4e8ff4e700 1 -- 172.21.15.79:0/2694135243 >> 172.21.15.79:0/2694135243 conn(0x7f4e880951e0 msgr2=0x7f4e88094860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:36:00.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.298 7f4e8ff4e700 1 -- 172.21.15.79:0/2694135243 shutdown_connections 2021-04-09T18:36:00.311 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.298 7f4e8ff4e700 1 -- 172.21.15.79:0/2694135243 wait complete. 2021-04-09T18:36:00.317 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2021-04-09T18:36:00.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.406 7fbc61278700 1 Processor -- start 2021-04-09T18:36:00.419 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.406 7fbc61278700 1 -- start start 2021-04-09T18:36:00.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.406 7fbc61278700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc5c0e9ae0 0x7fbc5c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.406 7fbc61278700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbc5c1c8010 0x7fbc5c1ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.406 7fbc61278700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5c0fbb20 con 0x7fbc5c0f5520 2021-04-09T18:36:00.420 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.406 7fbc61278700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5c1c3dc0 con 0x7fbc5c1c8010 2021-04-09T18:36:00.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.406 7fbc61278700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0e9f30 con 0x7fbc5c0e9ae0 2021-04-09T18:36:00.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.406 7fbc5a804700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc5c0e9ae0 0x7fbc5c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.406 7fbc5b806700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbc5c1c8010 0x7fbc5c1ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.406 7fbc5b005700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fbc5c0f5520 0x7fbc5c0f64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:59628/0 (socket says 172.21.15.79:59628) 2021-04-09T18:36:00.421 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.406 7fbc5a804700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc5c0e9ae0 0x7fbc5c09f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:33214/0 (socket says 172.21.15.79:33214) 2021-04-09T18:36:00.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.406 7fbc5b806700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbc5c1c8010 0x7fbc5c1ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:52794/0 (socket says 172.21.15.79:52794) 2021-04-09T18:36:00.422 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.406 7fbc5b005700 1 -- 172.21.15.79:0/2428945980 learned_addr learned my addr 172.21.15.79:0/2428945980 (peer_addr_for_me v1:172.21.15.79:0/0) 2021-04-09T18:36:00.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.406 7fbc5b806700 1 -- 172.21.15.79:0/2428945980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc5c0e9ae0 msgr2=0x7fbc5c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:36:00.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.406 7fbc5b806700 1 --2- 172.21.15.79:0/2428945980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc5c0e9ae0 0x7fbc5c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.406 7fbc5b806700 1 -- 172.21.15.79:0/2428945980 >> v1:172.21.15.89:6789/0 conn(0x7fbc5c0f5520 legacy=0x7fbc5c0f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:36:00.423 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.406 7fbc5b806700 1 -- 172.21.15.79:0/2428945980 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5c0e56d0 con 0x7fbc5c1c8010 2021-04-09T18:36:00.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.406 7fbc5a804700 1 --2- 172.21.15.79:0/2428945980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc5c0e9ae0 0x7fbc5c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:36:00.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.406 7fbc5a003700 1 -- 172.21.15.79:0/2428945980 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686978521 0 0) 0x7fbc4c0010d0 con 0x7fbc5c0f5520 2021-04-09T18:36:00.424 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.406 7fbc5b806700 1 --2- 172.21.15.79:0/2428945980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc5c1c8010 0x7fbc5c1ca470 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fbc54002f30 tx=0x7fbc5400bd40).ready entity=mon.1 client_cookie=7adac3e9757ee442 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:36:00.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.410 7fbc5a003700 1 -- 172.21.15.79:0/2428945980 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbc5c0e56d0 con 0x7fbc5c1c8010 2021-04-09T18:36:00.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.410 7fbc5a003700 1 -- 172.21.15.79:0/2428945980 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc54009850 con 0x7fbc5c1c8010 2021-04-09T18:36:00.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.410 7fbc5a003700 1 -- 172.21.15.79:0/2428945980 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbc54009c20 con 0x7fbc5c1c8010 2021-04-09T18:36:00.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.410 7fbc61278700 1 -- 172.21.15.79:0/2428945980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc5c1c8010 msgr2=0x7fbc5c1ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:36:00.425 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.410 7fbc61278700 1 --2- 172.21.15.79:0/2428945980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc5c1c8010 0x7fbc5c1ca470 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fbc54002f30 tx=0x7fbc5400bd40).stop 2021-04-09T18:36:00.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.410 7fbc61278700 1 -- 172.21.15.79:0/2428945980 shutdown_connections 2021-04-09T18:36:00.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.410 7fbc61278700 1 --2- 172.21.15.79:0/2428945980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc5c1c8010 0x7fbc5c1ca470 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.410 7fbc61278700 1 --2- 172.21.15.79:0/2428945980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc5c0e9ae0 0x7fbc5c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.410 7fbc61278700 1 -- 172.21.15.79:0/2428945980 >> 172.21.15.79:0/2428945980 conn(0x7fbc5c0e5fe0 msgr2=0x7fbc5c0e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:36:00.426 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.410 7fbc61278700 1 -- 172.21.15.79:0/2428945980 shutdown_connections 2021-04-09T18:36:00.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.410 7fbc61278700 1 -- 172.21.15.79:0/2428945980 wait complete. 2021-04-09T18:36:00.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc61278700 1 Processor -- start 2021-04-09T18:36:00.427 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc61278700 1 -- start start 2021-04-09T18:36:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc61278700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc5c08fe20 0x7fbc5c08f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc61278700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc5c091f90 0x7fbc5c0923e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc61278700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc5c0d1bd0 0x7fbc5c0d2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc61278700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0bd980 con 0x7fbc5c08fe20 2021-04-09T18:36:00.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc61278700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0909e0 con 0x7fbc5c0d1bd0 2021-04-09T18:36:00.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc61278700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0bd210 con 0x7fbc5c091f90 2021-04-09T18:36:00.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc5b005700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc5c08fe20 0x7fbc5c08f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.432 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc5b005700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc5c08fe20 0x7fbc5c08f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36222/0 (socket says 172.21.15.79:36222) 2021-04-09T18:36:00.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc5b005700 1 -- 172.21.15.79:0/3270603603 learned_addr learned my addr 172.21.15.79:0/3270603603 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:36:00.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc5a804700 1 --2- 172.21.15.79:0/3270603603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc5c091f90 0x7fbc5c0923e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc5b806700 1 --2- 172.21.15.79:0/3270603603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc5c0d1bd0 0x7fbc5c0d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc5b005700 1 -- 172.21.15.79:0/3270603603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc5c091f90 msgr2=0x7fbc5c0923e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:36:00.433 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc5b005700 1 --2- 172.21.15.79:0/3270603603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc5c091f90 0x7fbc5c0923e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc5b005700 1 -- 172.21.15.79:0/3270603603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc5c0d1bd0 msgr2=0x7fbc5c0d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:36:00.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc5b005700 1 --2- 172.21.15.79:0/3270603603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc5c0d1bd0 0x7fbc5c0d2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc5b005700 1 -- 172.21.15.79:0/3270603603 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5c090270 con 0x7fbc5c08fe20 2021-04-09T18:36:00.434 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc5b005700 1 --2- 172.21.15.79:0/3270603603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc5c08fe20 0x7fbc5c08f460 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7fbc5c0bd4a0 tx=0x7fbc4c00cb40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:36:00.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc53fff700 1 -- 172.21.15.79:0/3270603603 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbc5c090270 con 0x7fbc5c08fe20 2021-04-09T18:36:00.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc61278700 1 -- 172.21.15.79:0/3270603603 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc5c1a7190 con 0x7fbc5c08fe20 2021-04-09T18:36:00.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc53fff700 1 -- 172.21.15.79:0/3270603603 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c007320 con 0x7fbc5c08fe20 2021-04-09T18:36:00.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc53fff700 1 -- 172.21.15.79:0/3270603603 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbc4c0057e0 con 0x7fbc5c08fe20 2021-04-09T18:36:00.435 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.414 7fbc61278700 1 -- 172.21.15.79:0/3270603603 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5c08fa90 con 0x7fbc5c08fe20 2021-04-09T18:36:00.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.418 7fbc53fff700 1 -- 172.21.15.79:0/3270603603 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fbc4c01a060 con 0x7fbc5c08fe20 2021-04-09T18:36:00.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.418 7fbc53fff700 1 --2- 172.21.15.79:0/3270603603 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbc38029100 0x7fbc3802b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.418 7fbc53fff700 1 -- 172.21.15.79:0/3270603603 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7fbc4c038a40 con 0x7fbc5c08fe20 2021-04-09T18:36:00.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.418 7fbc5a804700 1 --2- 172.21.15.79:0/3270603603 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbc38029100 0x7fbc3802b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.436 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.418 7fbc5a804700 1 --2- 172.21.15.79:0/3270603603 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbc38029100 0x7fbc3802b650 crc :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:36:00.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.422 7fbc61278700 1 -- 172.21.15.79:0/3270603603 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5c0e39e0 con 0x7fbc5c08fe20 2021-04-09T18:36:00.437 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.430 7fbc53fff700 1 -- 172.21.15.79:0/3270603603 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fbc4c007110 con 0x7fbc5c08fe20 2021-04-09T18:36:00.600 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.594 7fbc61278700 1 -- 172.21.15.79:0/3270603603 --> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] -- command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mgr", ""]}) v1 -- 0x7fbc5c0f5b20 con 0x7fbc38029100 2021-04-09T18:36:00.601 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.594 7fbc53fff700 1 -- 172.21.15.79:0/3270603603 <== mgr.4100 v2:172.21.15.89:6800/13779 1 ==== command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7fbc5c0f5b20 con 0x7fbc38029100 2021-04-09T18:36:00.602 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 7 to deep-scrub 2021-04-09T18:36:00.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.598 7fbc61278700 1 -- 172.21.15.79:0/3270603603 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbc38029100 msgr2=0x7fbc3802b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:36:00.604 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.598 7fbc61278700 1 --2- 172.21.15.79:0/3270603603 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbc38029100 0x7fbc3802b650 crc :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.598 7fbc61278700 1 -- 172.21.15.79:0/3270603603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc5c08fe20 msgr2=0x7fbc5c08f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:36:00.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.598 7fbc61278700 1 --2- 172.21.15.79:0/3270603603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc5c08fe20 0x7fbc5c08f460 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7fbc5c0bd4a0 tx=0x7fbc4c00cb40).stop 2021-04-09T18:36:00.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.598 7fbc61278700 1 -- 172.21.15.79:0/3270603603 shutdown_connections 2021-04-09T18:36:00.605 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.598 7fbc61278700 1 --2- 172.21.15.79:0/3270603603 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fbc38029100 0x7fbc3802b650 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.598 7fbc61278700 1 --2- 172.21.15.79:0/3270603603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc5c0d1bd0 0x7fbc5c0d2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.598 7fbc61278700 1 --2- 172.21.15.79:0/3270603603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc5c08fe20 0x7fbc5c08f460 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.606 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.598 7fbc61278700 1 --2- 172.21.15.79:0/3270603603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc5c091f90 0x7fbc5c0923e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.598 7fbc61278700 1 -- 172.21.15.79:0/3270603603 >> 172.21.15.79:0/3270603603 conn(0x7fbc5c094e50 msgr2=0x7fbc5c0d3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:36:00.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.598 7fbc61278700 1 -- 172.21.15.79:0/3270603603 shutdown_connections 2021-04-09T18:36:00.607 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.598 7fbc61278700 1 -- 172.21.15.79:0/3270603603 wait complete. 2021-04-09T18:36:00.614 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-04-09T18:36:00.714 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.702 7fc915cf3700 1 Processor -- start 2021-04-09T18:36:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.702 7fc915cf3700 1 -- start start 2021-04-09T18:36:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.702 7fc915cf3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc9100f5520 0x7fc9100f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.702 7fc915cf3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9100e9ae0 0x7fc91009f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.702 7fc915cf3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc9101c2db0 0x7fc9101c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.702 7fc915cf3700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9100e9f30 con 0x7fc9100f5520 2021-04-09T18:36:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.702 7fc915cf3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9100e59d0 con 0x7fc9101c2db0 2021-04-09T18:36:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.702 7fc915cf3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9100fbb20 con 0x7fc9100e9ae0 2021-04-09T18:36:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.702 7fc90f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc9100f5520 0x7fc9100f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.702 7fc90f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc9100f5520 0x7fc9100f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36232/0 (socket says 172.21.15.79:36232) 2021-04-09T18:36:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.702 7fc90f7fe700 1 -- 172.21.15.79:0/2024396974 learned_addr learned my addr 172.21.15.79:0/2024396974 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:36:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.702 7fc90ffff700 1 --2- 172.21.15.79:0/2024396974 >> v2:172.21.15.89:3300/0 conn(0x7fc9101c2db0 0x7fc9101c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.702 7fc90effd700 1 --2- 172.21.15.79:0/2024396974 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9100e9ae0 0x7fc91009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.702 7fc90f7fe700 1 -- 172.21.15.79:0/2024396974 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9100e9ae0 msgr2=0x7fc91009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:36:00.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.702 7fc90f7fe700 1 --2- 172.21.15.79:0/2024396974 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9100e9ae0 0x7fc91009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.702 7fc90f7fe700 1 -- 172.21.15.79:0/2024396974 >> v2:172.21.15.89:3300/0 conn(0x7fc9101c2db0 msgr2=0x7fc9101c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:36:00.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.702 7fc90f7fe700 1 --2- 172.21.15.79:0/2024396974 >> v2:172.21.15.89:3300/0 conn(0x7fc9101c2db0 0x7fc9101c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.718 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.702 7fc90f7fe700 1 -- 172.21.15.79:0/2024396974 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9100e56d0 con 0x7fc9100f5520 2021-04-09T18:36:00.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.702 7fc90effd700 1 --2- 172.21.15.79:0/2024396974 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9100e9ae0 0x7fc91009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:36:00.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.702 7fc90f7fe700 1 --2- 172.21.15.79:0/2024396974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9100f5520 0x7fc9100f64b0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7fc900002f30 tx=0x7fc90000bd70).ready entity=mon.0 client_cookie=dd8985fb6953e0ee server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:36:00.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.706 7fc90e7fc700 1 -- 172.21.15.79:0/2024396974 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc9100e56d0 con 0x7fc9100f5520 2021-04-09T18:36:00.719 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.706 7fc90e7fc700 1 -- 172.21.15.79:0/2024396974 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9000098b0 con 0x7fc9100f5520 2021-04-09T18:36:00.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.706 7fc90e7fc700 1 -- 172.21.15.79:0/2024396974 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc900009c80 con 0x7fc9100f5520 2021-04-09T18:36:00.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.706 7fc915cf3700 1 -- 172.21.15.79:0/2024396974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9100f5520 msgr2=0x7fc9100f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:36:00.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.706 7fc915cf3700 1 --2- 172.21.15.79:0/2024396974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9100f5520 0x7fc9100f64b0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7fc900002f30 tx=0x7fc90000bd70).stop 2021-04-09T18:36:00.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.706 7fc915cf3700 1 -- 172.21.15.79:0/2024396974 shutdown_connections 2021-04-09T18:36:00.720 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.706 7fc915cf3700 1 --2- 172.21.15.79:0/2024396974 >> v2:172.21.15.89:3300/0 conn(0x7fc9101c2db0 0x7fc9101c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.706 7fc915cf3700 1 --2- 172.21.15.79:0/2024396974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9100f5520 0x7fc9100f64b0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.706 7fc915cf3700 1 --2- 172.21.15.79:0/2024396974 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9100e9ae0 0x7fc91009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.706 7fc915cf3700 1 -- 172.21.15.79:0/2024396974 >> 172.21.15.79:0/2024396974 conn(0x7fc9100e5fe0 msgr2=0x7fc9100e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:36:00.721 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.706 7fc915cf3700 1 -- 172.21.15.79:0/2024396974 shutdown_connections 2021-04-09T18:36:00.722 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.706 7fc915cf3700 1 -- 172.21.15.79:0/2024396974 wait complete. 2021-04-09T18:36:00.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc915cf3700 1 Processor -- start 2021-04-09T18:36:00.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc915cf3700 1 -- start start 2021-04-09T18:36:00.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc915cf3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9100ad210 0x7fc9100c2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.725 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc915cf3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9100c3490 0x7fc9100adc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc915cf3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9100c38e0 0x7fc9100d7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc915cf3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9100ad980 con 0x7fc9100c38e0 2021-04-09T18:36:00.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc915cf3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9100ad660 con 0x7fc9100c3490 2021-04-09T18:36:00.726 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc915cf3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9100b4960 con 0x7fc9100ad210 2021-04-09T18:36:00.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc90ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9100c38e0 0x7fc9100d7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc90ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9100c38e0 0x7fc9100d7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36240/0 (socket says 172.21.15.79:36240) 2021-04-09T18:36:00.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc90ffff700 1 -- 172.21.15.79:0/4157233252 learned_addr learned my addr 172.21.15.79:0/4157233252 (peer_addr_for_me v2:172.21.15.79:0/0) 2021-04-09T18:36:00.727 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc90effd700 1 --2- 172.21.15.79:0/4157233252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9100c3490 0x7fc9100adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc90f7fe700 1 --2- 172.21.15.79:0/4157233252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9100ad210 0x7fc9100c2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc90ffff700 1 -- 172.21.15.79:0/4157233252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9100ad210 msgr2=0x7fc9100c2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:36:00.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc90ffff700 1 --2- 172.21.15.79:0/4157233252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9100ad210 0x7fc9100c2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.728 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc90ffff700 1 -- 172.21.15.79:0/4157233252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9100c3490 msgr2=0x7fc9100adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:36:00.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc90ffff700 1 --2- 172.21.15.79:0/4157233252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9100c3490 0x7fc9100adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc90ffff700 1 -- 172.21.15.79:0/4157233252 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9100ab920 con 0x7fc9100c38e0 2021-04-09T18:36:00.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc90ffff700 1 --2- 172.21.15.79:0/4157233252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9100c38e0 0x7fc9100d7b30 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7fc9100b4b60 tx=0x7fc90800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:36:00.729 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc8f7fff700 1 -- 172.21.15.79:0/4157233252 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc9100ab920 con 0x7fc9100c38e0 2021-04-09T18:36:00.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc8f7fff700 1 -- 172.21.15.79:0/4157233252 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90800cb70 con 0x7fc9100c38e0 2021-04-09T18:36:00.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc8f7fff700 1 -- 172.21.15.79:0/4157233252 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc90800f040 con 0x7fc9100c38e0 2021-04-09T18:36:00.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc915cf3700 1 -- 172.21.15.79:0/4157233252 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9100c3110 con 0x7fc9100c38e0 2021-04-09T18:36:00.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.710 7fc915cf3700 1 -- 172.21.15.79:0/4157233252 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9100ae440 con 0x7fc9100c38e0 2021-04-09T18:36:00.730 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.714 7fc8f7fff700 1 -- 172.21.15.79:0/4157233252 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc908022060 con 0x7fc9100c38e0 2021-04-09T18:36:00.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.714 7fc8f7fff700 1 --2- 172.21.15.79:0/4157233252 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc8f0029100 0x7fc8f002b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:36:00.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.714 7fc8f7fff700 1 -- 172.21.15.79:0/4157233252 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5276+0+0 (secure 0 0 0) 0x7fc908010040 con 0x7fc9100c38e0 2021-04-09T18:36:00.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.714 7fc90f7fe700 1 --2- 172.21.15.79:0/4157233252 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc8f0029100 0x7fc8f002b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:36:00.731 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.714 7fc90f7fe700 1 --2- 172.21.15.79:0/4157233252 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc8f0029100 0x7fc8f002b650 crc :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:36:00.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.718 7fc915cf3700 1 -- 172.21.15.79:0/4157233252 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9100e39e0 con 0x7fc9100c38e0 2021-04-09T18:36:00.732 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.722 7fc8f7fff700 1 -- 172.21.15.79:0/4157233252 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc90800c960 con 0x7fc9100c38e0 2021-04-09T18:36:00.890 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.882 7fc915cf3700 1 -- 172.21.15.79:0/4157233252 --> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7fc9100f5b20 con 0x7fc8f0029100 2021-04-09T18:36:00.896 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.894 7fc8f7fff700 1 -- 172.21.15.79:0/4157233252 <== mgr.4100 v2:172.21.15.89:6800/13779 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+64221 (crc 0 0 0) 0x7fc9100f5b20 con 0x7fc8f0029100 2021-04-09T18:36:00.898 INFO:teuthology.orchestra.run.smithi079.stdout: 2021-04-09T18:36:00.898 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2021-04-09T18:36:00.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.894 7fc915cf3700 1 -- 172.21.15.79:0/4157233252 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc8f0029100 msgr2=0x7fc8f002b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:36:00.900 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.894 7fc915cf3700 1 --2- 172.21.15.79:0/4157233252 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc8f0029100 0x7fc8f002b650 crc :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.894 7fc915cf3700 1 -- 172.21.15.79:0/4157233252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9100c38e0 msgr2=0x7fc9100d7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:36:00.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.894 7fc915cf3700 1 --2- 172.21.15.79:0/4157233252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9100c38e0 0x7fc9100d7b30 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7fc9100b4b60 tx=0x7fc90800c430).stop 2021-04-09T18:36:00.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.894 7fc915cf3700 1 -- 172.21.15.79:0/4157233252 shutdown_connections 2021-04-09T18:36:00.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.894 7fc915cf3700 1 --2- 172.21.15.79:0/4157233252 >> [v2:172.21.15.89:6800/13779,v1:172.21.15.89:6801/13779] conn(0x7fc8f0029100 0x7fc8f002b650 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.901 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.894 7fc915cf3700 1 --2- 172.21.15.79:0/4157233252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9100c38e0 0x7fc9100d7b30 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.894 7fc915cf3700 1 --2- 172.21.15.79:0/4157233252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9100ad210 0x7fc9100c2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.894 7fc915cf3700 1 --2- 172.21.15.79:0/4157233252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9100c3490 0x7fc9100adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:36:00.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.894 7fc915cf3700 1 -- 172.21.15.79:0/4157233252 >> 172.21.15.79:0/4157233252 conn(0x7fc91009a460 msgr2=0x7fc9100aef00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:36:00.902 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.894 7fc915cf3700 1 -- 172.21.15.79:0/4157233252 shutdown_connections 2021-04-09T18:36:00.903 INFO:teuthology.orchestra.run.smithi079.stderr:2021-04-09 18:36:00.894 7fc915cf3700 1 -- 172.21.15.79:0/4157233252 wait complete. 2021-04-09T18:36:00.910 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":437,"stamp":"2021-04-09 18:36:00.124940","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":8402456,"kb_used_data":13760,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746572264,"statfs":{"total":773094113280,"available":764489998336,"internally_reserved":8589934592,"allocated":14090240,"data_stored":6442920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2286,"num_objects":-21,"num_object_clones":0,"num_object_copies":-42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-44,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.781475"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"123","reported_epoch":"137","state":"active+clean","last_fresh":"2021-04-09 18:35:53.008555","last_change":"2021-04-09 18:26:08.058514","last_active":"2021-04-09 18:35:53.008555","last_peered":"2021-04-09 18:35:53.008555","last_clean":"2021-04-09 18:35:53.008555","last_became_active":"2021-04-09 18:26:08.058166","last_became_peered":"2021-04-09 18:26:08.058166","last_unstale":"2021-04-09 18:35:53.008555","last_undegraded":"2021-04-09 18:35:53.008555","last_fullsized":"2021-04-09 18:35:53.008555","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"123","reported_epoch":"137","state":"active+clean","last_fresh":"2021-04-09 18:35:53.008424","last_change":"2021-04-09 18:26:08.061036","last_active":"2021-04-09 18:35:53.008424","last_peered":"2021-04-09 18:35:53.008424","last_clean":"2021-04-09 18:35:53.008424","last_became_active":"2021-04-09 18:26:08.060740","last_became_peered":"2021-04-09 18:26:08.060740","last_unstale":"2021-04-09 18:35:53.008424","last_undegraded":"2021-04-09 18:35:53.008424","last_fullsized":"2021-04-09 18:35:53.008424","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"119","reported_epoch":"137","state":"active+clean","last_fresh":"2021-04-09 18:35:53.008972","last_change":"2021-04-09 18:26:08.061551","last_active":"2021-04-09 18:35:53.008972","last_peered":"2021-04-09 18:35:53.008972","last_clean":"2021-04-09 18:35:53.008972","last_became_active":"2021-04-09 18:26:08.061226","last_became_peered":"2021-04-09 18:26:08.061226","last_unstale":"2021-04-09 18:35:53.008972","last_undegraded":"2021-04-09 18:35:53.008972","last_fullsized":"2021-04-09 18:35:53.008972","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"120","reported_epoch":"137","state":"active+clean","last_fresh":"2021-04-09 18:35:53.006851","last_change":"2021-04-09 18:26:08.058408","last_active":"2021-04-09 18:35:53.006851","last_peered":"2021-04-09 18:35:53.006851","last_clean":"2021-04-09 18:35:53.006851","last_became_active":"2021-04-09 18:26:08.058080","last_became_peered":"2021-04-09 18:26:08.058080","last_unstale":"2021-04-09 18:35:53.006851","last_undegraded":"2021-04-09 18:35:53.006851","last_fullsized":"2021-04-09 18:35:53.006851","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"125","reported_epoch":"137","state":"active+clean","last_fresh":"2021-04-09 18:35:52.904678","last_change":"2021-04-09 18:26:08.054702","last_active":"2021-04-09 18:35:52.904678","last_peered":"2021-04-09 18:35:52.904678","last_clean":"2021-04-09 18:35:52.904678","last_became_active":"2021-04-09 18:26:08.054144","last_became_peered":"2021-04-09 18:26:08.054144","last_unstale":"2021-04-09 18:35:52.904678","last_undegraded":"2021-04-09 18:35:52.904678","last_fullsized":"2021-04-09 18:35:52.904678","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"118","reported_epoch":"137","state":"active+clean","last_fresh":"2021-04-09 18:35:53.009579","last_change":"2021-04-09 18:26:08.061669","last_active":"2021-04-09 18:35:53.009579","last_peered":"2021-04-09 18:35:53.009579","last_clean":"2021-04-09 18:35:53.009579","last_became_active":"2021-04-09 18:26:08.060952","last_became_peered":"2021-04-09 18:26:08.060952","last_unstale":"2021-04-09 18:35:53.009579","last_undegraded":"2021-04-09 18:35:53.009579","last_fullsized":"2021-04-09 18:35:53.009579","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"118","reported_epoch":"137","state":"active+clean","last_fresh":"2021-04-09 18:35:53.009742","last_change":"2021-04-09 18:26:08.060814","last_active":"2021-04-09 18:35:53.009742","last_peered":"2021-04-09 18:35:53.009742","last_clean":"2021-04-09 18:35:53.009742","last_became_active":"2021-04-09 18:26:08.060463","last_became_peered":"2021-04-09 18:26:08.060463","last_unstale":"2021-04-09 18:35:53.009742","last_undegraded":"2021-04-09 18:35:53.009742","last_fullsized":"2021-04-09 18:35:53.009742","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"125","reported_epoch":"137","state":"active+clean","last_fresh":"2021-04-09 18:35:53.007627","last_change":"2021-04-09 18:26:08.054741","last_active":"2021-04-09 18:35:53.007627","last_peered":"2021-04-09 18:35:53.007627","last_clean":"2021-04-09 18:35:53.007627","last_became_active":"2021-04-09 18:26:08.054184","last_became_peered":"2021-04-09 18:26:08.054184","last_unstale":"2021-04-09 18:35:53.007627","last_undegraded":"2021-04-09 18:35:53.007627","last_fullsized":"2021-04-09 18:35:53.007627","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:26:07.037875","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:26:07.037875","last_clean_scrub_stamp":"2021-04-09 18:26:07.037875","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574969,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1050304,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321536,"statfs":{"total":96636764160,"available":95561252864,"internally_reserved":1073741824,"allocated":1761280,"data_stored":805365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:35:25 2021","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.45800000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.089,"5min":1.119,"15min":1.119},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.72299999999999998},"min":{"1min":0.56200000000000006,"5min":0.311,"15min":0.311},"max":{"1min":0.94399999999999995,"5min":1.036,"15min":1.27},"last":0.78400000000000003}]},{"osd":1,"last update":"Fri Apr 9 18:35:25 2021","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.71399999999999997,"15min":0.75600000000000001},"min":{"1min":0.56399999999999995,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.1970000000000001,"5min":1.268,"15min":1.268},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.76800000000000002,"15min":0.78100000000000003},"min":{"1min":0.53800000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.98199999999999998,"5min":1.038,"15min":1.139},"last":0.66100000000000003}]},{"osd":2,"last update":"Fri Apr 9 18:35:25 2021","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70899999999999996,"15min":0.73599999999999999},"min":{"1min":0.52200000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86399999999999999,"5min":1.2150000000000001,"15min":1.7769999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79000000000000004,"15min":0.81899999999999995},"min":{"1min":0.64600000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96199999999999997,"5min":1.399,"15min":1.399},"last":0.61899999999999999}]},{"osd":3,"last update":"Fri Apr 9 18:35:25 2021","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.752,"15min":0.79500000000000004},"min":{"1min":0.58699999999999997,"5min":0.49299999999999999,"15min":0.47599999999999998},"max":{"1min":0.94999999999999996,"5min":1.514,"15min":1.9630000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.80700000000000005,"15min":0.86399999999999999},"min":{"1min":0.625,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0029999999999999,"5min":1.343,"15min":1.343},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Apr 9 18:35:25 2021","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.68600000000000005,"15min":0.77200000000000002},"min":{"1min":0.438,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0589999999999999,"5min":1.181,"15min":1.859},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.83299999999999996,"15min":0.88900000000000001},"min":{"1min":0.58599999999999997,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.109,"5min":1.2889999999999999,"15min":2.4039999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Apr 9 18:35:25 2021","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.82399999999999995,"15min":0.91900000000000004},"min":{"1min":0.67500000000000004,"5min":0.38,"15min":0.38},"max":{"1min":1.0549999999999999,"5min":1.47,"15min":3.0960000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.84599999999999997,"15min":0.91400000000000003},"min":{"1min":0.498,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0449999999999999,"5min":1.1890000000000001,"15min":3.1219999999999999},"last":0.72799999999999998}]},{"osd":6,"last update":"Fri Apr 9 18:35:25 2021","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.85399999999999998,"15min":0.90900000000000003},"min":{"1min":0.60299999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0509999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86799999999999999,"15min":0.91400000000000003},"min":{"1min":0.51000000000000001,"5min":0.439,"15min":0.437},"max":{"1min":1.0609999999999999,"5min":2.0720000000000001,"15min":2.335},"last":0.64800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574969,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1050304,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321536,"statfs":{"total":96636764160,"available":95561252864,"internally_reserved":1073741824,"allocated":1761280,"data_stored":805365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56299999999999994,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.022,"5min":1.069,"15min":1.4910000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.749,"15min":0.78900000000000003},"min":{"1min":0.56299999999999994,"5min":0.50900000000000001,"15min":0.42699999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":2.0179999999999998},"last":0.82999999999999996}]},{"osd":1,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.76000000000000001,"15min":0.76100000000000001},"min":{"1min":0.50700000000000001,"5min":0.43099999999999999,"15min":0.379},"max":{"1min":0.99099999999999999,"5min":1.0600000000000001,"15min":1.075},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78700000000000003,"15min":0.79700000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0069999999999999,"5min":1.1200000000000001,"15min":1.3100000000000001},"last":0.72899999999999998}]},{"osd":2,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72299999999999998,"15min":0.75700000000000001},"min":{"1min":0.52400000000000002,"5min":0.48799999999999999,"15min":0.47499999999999998},"max":{"1min":0.88400000000000001,"5min":1.077,"15min":1.4830000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.79900000000000004,"15min":0.82299999999999995},"min":{"1min":0.5,"5min":0.46899999999999997,"15min":0.45900000000000002},"max":{"1min":1.01,"5min":1.1220000000000001,"15min":1.6599999999999999},"last":0.70399999999999996}]},{"osd":3,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80700000000000005,"15min":0.82799999999999996},"min":{"1min":0.51600000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.3100000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.82499999999999996},"min":{"1min":0.55500000000000005,"5min":0.505,"15min":0.505},"max":{"1min":0.88500000000000001,"5min":1.038,"15min":1.552},"last":0.85699999999999998}]},{"osd":4,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.75,"15min":0.79200000000000004},"min":{"1min":0.56999999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91300000000000003,"5min":1.165,"15min":1.284},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.81399999999999995,"15min":0.90000000000000002},"min":{"1min":0.57799999999999996,"5min":0.41699999999999998,"15min":0.38100000000000001},"max":{"1min":0.92400000000000004,"5min":1.0840000000000001,"15min":2.0840000000000001},"last":0.88600000000000001}]},{"osd":5,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80200000000000005,"15min":0.82299999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0189999999999999,"5min":1.137,"15min":1.3899999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.86699999999999999,"15min":0.91100000000000003},"min":{"1min":0.64800000000000002,"5min":0.56499999999999995,"15min":0.41399999999999998},"max":{"1min":0.96299999999999997,"5min":1.3560000000000001,"15min":1.7190000000000001},"last":0.78100000000000003}]},{"osd":7,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.89500000000000002,"15min":0.95399999999999996},"min":{"1min":0.63400000000000001,"5min":0.59299999999999997,"15min":0.45400000000000001},"max":{"1min":1.024,"5min":1.284,"15min":1.444},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.879,"15min":0.92200000000000004},"min":{"1min":0.66100000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1839999999999999,"5min":1.2350000000000001,"15min":1.681},"last":0.77100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574969,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1050316,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321524,"statfs":{"total":96636764160,"available":95561240576,"internally_reserved":1073741824,"allocated":1761280,"data_stored":805365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.73499999999999999,"15min":0.71699999999999997},"min":{"1min":0.54400000000000004,"5min":0.40300000000000002,"15min":0.33500000000000002},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.754},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.67200000000000004,"5min":0.498,"15min":0.32300000000000001},"max":{"1min":1.048,"5min":1.073,"15min":1.2470000000000001},"last":0.79300000000000004}]},{"osd":1,"last update":"Fri Apr 9 18:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.754,"15min":0.73199999999999998},"min":{"1min":0.54100000000000004,"5min":0.505,"15min":0.432},"max":{"1min":1.099,"5min":1.099,"15min":1.389},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.752,"15min":0.77500000000000002},"min":{"1min":0.55600000000000005,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.036,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.624}]},{"osd":2,"last update":"Fri Apr 9 18:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.51300000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.6379999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.749,"15min":0.80800000000000005},"min":{"1min":0.49199999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.173,"5min":1.173,"15min":2.8220000000000001},"last":0.71899999999999997}]},{"osd":3,"last update":"Fri Apr 9 18:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.80400000000000005,"15min":0.86299999999999999},"min":{"1min":0.64300000000000002,"5min":0.52800000000000002,"15min":0.51900000000000002},"max":{"1min":1.26,"5min":1.26,"15min":2.46},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82099999999999995,"15min":0.86299999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.46600000000000003},"max":{"1min":1.155,"5min":1.155,"15min":2.8999999999999999},"last":0.76500000000000001}]},{"osd":4,"last update":"Fri Apr 9 18:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76200000000000001,"15min":0.78100000000000003},"min":{"1min":0.48399999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.143,"5min":1.212,"15min":1.212},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92300000000000004,"15min":0.97899999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":3.1259999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Apr 9 18:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84099999999999997,"15min":0.88600000000000001},"min":{"1min":0.56200000000000006,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.89200000000000002,"15min":0.90300000000000002},"min":{"1min":0.63200000000000001,"5min":0.63,"15min":0.53300000000000003},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.81799999999999995}]},{"osd":7,"last update":"Fri Apr 9 18:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.89600000000000002,"15min":0.95999999999999996},"min":{"1min":0.61899999999999999,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.274,"5min":1.274,"15min":3.1819999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.92400000000000004,"15min":0.98299999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3,"5min":1.3,"15min":2.9590000000000001},"last":0.83699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574969,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1050304,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321536,"statfs":{"total":96636764160,"available":95561252864,"internally_reserved":1073741824,"allocated":1761280,"data_stored":805365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56100000000000005,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.42899999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.0800000000000001,"5min":1.091,"15min":1.091},"last":0.629}]},{"osd":2,"last update":"Fri Apr 9 18:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.63500000000000001},"min":{"1min":0.42299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79500000000000004,"5min":0.94899999999999995,"15min":1.169},"last":0.434},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.622,"15min":0.57899999999999996},"min":{"1min":0.379,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":3.0270000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri Apr 9 18:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78400000000000003,"5min":0.92400000000000004,"15min":0.92800000000000005},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.64300000000000002,"15min":0.67300000000000004},"min":{"1min":0.48599999999999999,"5min":0.41199999999999998,"15min":0.40600000000000003},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.877},"last":0.72399999999999998}]},{"osd":4,"last update":"Fri Apr 9 18:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.81499999999999995,"15min":0.82899999999999996},"min":{"1min":0.73899999999999999,"5min":0.56999999999999995,"15min":0.53300000000000003},"max":{"1min":1.1080000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.86399999999999999,"15min":0.84499999999999997},"min":{"1min":0.72599999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0629999999999999,"5min":1.0640000000000001,"15min":1.129},"last":0.78200000000000003}]},{"osd":5,"last update":"Fri Apr 9 18:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.88200000000000001,"15min":0.874},"min":{"1min":0.67800000000000005,"5min":0.443,"15min":0.443},"max":{"1min":1.141,"5min":1.306,"15min":1.8100000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.88800000000000001,"15min":0.88700000000000001},"min":{"1min":0.65000000000000002,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1659999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.95899999999999996}]},{"osd":6,"last update":"Fri Apr 9 18:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.86299999999999999,"15min":0.88100000000000001},"min":{"1min":0.61099999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.7490000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.875},"min":{"1min":0.65700000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.131,"5min":1.369,"15min":1.849},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Apr 9 18:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89200000000000002,"15min":0.86499999999999999},"min":{"1min":0.60499999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.196,"5min":1.2270000000000001,"15min":1.3520000000000001},"last":0.996},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.90100000000000002,"15min":0.93799999999999994},"min":{"1min":0.624,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0649999999999999,"5min":1.2829999999999999,"15min":1.9350000000000001},"last":0.92400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574971,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1050304,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321536,"statfs":{"total":96636764160,"available":95561252864,"internally_reserved":1073741824,"allocated":1761280,"data_stored":805365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 9 18:35:19 2021","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52700000000000002,"15min":0.59399999999999997},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76200000000000001,"5min":0.98199999999999998,"15min":1.361},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.628},"min":{"1min":0.372,"5min":0.312,"15min":0.312},"max":{"1min":0.84599999999999997,"5min":0.94699999999999995,"15min":1.4390000000000001},"last":0.56699999999999995}]},{"osd":2,"last update":"Fri Apr 9 18:35:19 2021","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59399999999999997,"15min":0.67700000000000005},"min":{"1min":0.40600000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":1.9730000000000001},"last":0.501},{"interface":"front","average":{"1min":0.629,"5min":0.63300000000000001,"15min":0.69399999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82899999999999996,"5min":1.0029999999999999,"15min":1.6120000000000001},"last":0.622}]},{"osd":3,"last update":"Fri Apr 9 18:35:19 2021","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.60399999999999998,"15min":0.65600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36299999999999999},"max":{"1min":0.77200000000000002,"5min":1.0700000000000001,"15min":2.7160000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.73299999999999998,"15min":0.78200000000000003},"min":{"1min":0.48499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.3769999999999998,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":0.68300000000000005}]},{"osd":4,"last update":"Fri Apr 9 18:35:19 2021","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.874,"15min":0.92200000000000004},"min":{"1min":0.53200000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.198,"5min":1.198,"15min":2.04},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.85299999999999998,"15min":0.92200000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.52400000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":2.968},"last":0.65900000000000003}]},{"osd":5,"last update":"Fri Apr 9 18:35:19 2021","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.85999999999999999,"15min":0.93799999999999994},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.8069999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.84799999999999998,"15min":0.90700000000000003},"min":{"1min":0.62,"5min":0.62,"15min":0.57899999999999996},"max":{"1min":1.0229999999999999,"5min":1.218,"15min":2.9119999999999999},"last":0.98799999999999999}]},{"osd":6,"last update":"Fri Apr 9 18:35:19 2021","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82899999999999996,"15min":0.89300000000000002},"min":{"1min":0.64700000000000002,"5min":0.628,"15min":0.628},"max":{"1min":1.0800000000000001,"5min":1.4410000000000001,"15min":3.21},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.90900000000000003,"15min":0.98699999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.4369999999999998,"5min":2.4369999999999998,"15min":2.5430000000000001},"last":0.84199999999999997}]},{"osd":7,"last update":"Fri Apr 9 18:35:19 2021","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.93100000000000005,"15min":0.96699999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1200000000000001,"5min":1.258,"15min":2.2559999999999998},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.94699999999999995,"15min":1.014},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1379999999999999,"5min":1.381,"15min":3.8330000000000002},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574971,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1050316,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321524,"statfs":{"total":96636764160,"available":95561240576,"internally_reserved":1073741824,"allocated":1761280,"data_stored":805365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.60999999999999999},"min":{"1min":0.48099999999999998,"5min":0.314,"15min":0.20100000000000001},"max":{"1min":0.86499999999999999,"5min":0.92900000000000005,"15min":1.6910000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.625,"15min":0.67600000000000005},"min":{"1min":0.38700000000000001,"5min":0.315,"15min":0.314},"max":{"1min":1.0720000000000001,"5min":1.081,"15min":2.2799999999999998},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.64000000000000001,"15min":0.65300000000000002},"min":{"1min":0.504,"5min":0.35899999999999999,"15min":0.28299999999999997},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.1579999999999999},"last":0.749},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68700000000000006,"15min":0.71999999999999997},"min":{"1min":0.46999999999999997,"5min":0.34899999999999998,"15min":0.26600000000000001},"max":{"1min":1.0109999999999999,"5min":1.0429999999999999,"15min":1.1890000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58699999999999997,"15min":0.64200000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.308},"max":{"1min":0.85599999999999998,"5min":1.0629999999999999,"15min":2.5129999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69299999999999995,"15min":0.70999999999999996},"min":{"1min":0.496,"5min":0.46300000000000002,"15min":0.27400000000000002},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.246},"last":0.66400000000000003}]},{"osd":4,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88800000000000001,"15min":0.88700000000000001},"min":{"1min":0.77300000000000002,"5min":0.61199999999999999,"15min":0.54700000000000004},"max":{"1min":1.167,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.877,"15min":0.88200000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.54000000000000004},"max":{"1min":1.1060000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.80700000000000005}]},{"osd":5,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79700000000000004,"15min":0.877},"min":{"1min":0.66400000000000003,"5min":0.55800000000000005,"15min":0.45300000000000001},"max":{"1min":0.97899999999999998,"5min":1.24,"15min":3.2080000000000002},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.84799999999999998,"15min":0.88800000000000001},"min":{"1min":0.72099999999999997,"5min":0.61299999999999999,"15min":0.48099999999999998},"max":{"1min":1.232,"5min":1.3120000000000001,"15min":2.355},"last":0.86399999999999999}]},{"osd":6,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.91100000000000003,"15min":0.93700000000000006},"min":{"1min":0.68000000000000005,"5min":0.626,"15min":0.58099999999999996},"max":{"1min":1.29,"5min":1.355,"15min":1.391},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.92300000000000004,"15min":0.96899999999999997},"min":{"1min":0.76400000000000001,"5min":0.69999999999999996,"15min":0.39000000000000001},"max":{"1min":1.165,"5min":1.3999999999999999,"15min":3.141},"last":1.026}]},{"osd":7,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89200000000000002,"15min":0.95599999999999996},"min":{"1min":0.68500000000000005,"5min":0.61699999999999999,"15min":0.41899999999999998},"max":{"1min":1.129,"5min":1.242,"15min":1.7470000000000001},"last":0.877},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.90400000000000003,"15min":0.98999999999999999},"min":{"1min":0.82799999999999996,"5min":0.63600000000000001,"15min":0.434},"max":{"1min":1.1539999999999999,"5min":1.337,"15min":3.258},"last":1.1259999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574969,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1050304,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321536,"statfs":{"total":96636764160,"available":95561252864,"internally_reserved":1073741824,"allocated":1761280,"data_stored":805365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:35:16 2021","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.434,"5min":0.317,"15min":0.28799999999999998},"max":{"1min":0.71199999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.44400000000000001,"5min":0.32900000000000001,"15min":0.29099999999999998},"max":{"1min":0.79800000000000004,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.0129999999999999}]},{"osd":1,"last update":"Fri Apr 9 18:35:16 2021","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.55400000000000005},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73499999999999999,"5min":0.749,"15min":0.89400000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67900000000000005,"15min":0.66800000000000004},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.03,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.82299999999999995}]},{"osd":2,"last update":"Fri Apr 9 18:35:16 2021","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63500000000000001,"15min":0.66900000000000004},"min":{"1min":0.42299999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.878,"5min":0.96999999999999997,"15min":1.117},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.75600000000000001,"15min":0.73299999999999998},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.35899999999999999},"max":{"1min":0.94899999999999995,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":0.69699999999999995}]},{"osd":4,"last update":"Fri Apr 9 18:35:16 2021","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.81599999999999995,"15min":0.81499999999999995},"min":{"1min":0.624,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.052,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.28},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.81000000000000005,"15min":0.79000000000000004},"min":{"1min":0.64500000000000002,"5min":0.57499999999999996,"15min":0.50700000000000001},"max":{"1min":0.94099999999999995,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.99199999999999999}]},{"osd":5,"last update":"Fri Apr 9 18:35:16 2021","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.81699999999999995,"15min":0.83299999999999996},"min":{"1min":0.61799999999999999,"5min":0.61199999999999999,"15min":0.53600000000000003},"max":{"1min":0.999,"5min":1.095,"15min":1.196},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.89300000000000002,"15min":0.88300000000000001},"min":{"1min":0.71899999999999997,"5min":0.57499999999999996,"15min":0.53800000000000003},"max":{"1min":1.1479999999999999,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.97099999999999997}]},{"osd":6,"last update":"Fri Apr 9 18:35:16 2021","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89500000000000002,"15min":0.91300000000000003},"min":{"1min":0.72699999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0960000000000001,"5min":1.899,"15min":1.899},"last":1.03},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.89200000000000002,"15min":0.90400000000000003},"min":{"1min":0.65400000000000003,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1080000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.0760000000000001}]},{"osd":7,"last update":"Fri Apr 9 18:35:16 2021","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.94299999999999995,"15min":0.94699999999999995},"min":{"1min":0.67600000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.143,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":1.171},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.89000000000000001,"15min":0.90300000000000002},"min":{"1min":0.76300000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0980000000000001,"5min":1.1879999999999999,"15min":1.252},"last":1.121}]}]},{"osd":4,"up_from":13,"seq":55834574970,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1050304,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321536,"statfs":{"total":96636764160,"available":95561252864,"internally_reserved":1073741824,"allocated":1761280,"data_stored":805365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.47099999999999997,"5min":0.46100000000000002,"15min":0.39600000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71299999999999997,"15min":0.71399999999999997},"min":{"1min":0.54900000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":1.373,"15min":1.8280000000000001},"last":0.86199999999999999}]},{"osd":1,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.745,"15min":0.745},"min":{"1min":0.46100000000000002,"5min":0.45100000000000001,"15min":0.443},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75700000000000001,"15min":0.76300000000000001},"min":{"1min":0.59199999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.98299999999999998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.75700000000000001}]},{"osd":2,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.745,"15min":0.746},"min":{"1min":0.496,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96899999999999997,"5min":1.26,"15min":1.776},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77300000000000002,"15min":0.78400000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.93400000000000005}]},{"osd":3,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81799999999999995,"15min":0.82399999999999995},"min":{"1min":0.57999999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.159},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.83999999999999997,"15min":0.86499999999999999},"min":{"1min":0.65800000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.121,"5min":1.466,"15min":1.8600000000000001},"last":1.024}]},{"osd":5,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.755,"15min":0.79000000000000004},"min":{"1min":0.54800000000000004,"5min":0.46000000000000002,"15min":0.41499999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.1850000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82699999999999996,"15min":0.84199999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.497},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.83199999999999996}]},{"osd":6,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.86199999999999999,"15min":0.92700000000000005},"min":{"1min":0.624,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.248},"last":0.997},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.91300000000000003,"15min":0.93700000000000006},"min":{"1min":0.71399999999999997,"5min":0.61399999999999999,"15min":0.45200000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.546},"last":0.96299999999999997}]},{"osd":7,"last update":"Fri Apr 9 18:35:17 2021","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.84199999999999997,"15min":0.86399999999999999},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":1.1259999999999999,"5min":1.4350000000000001,"15min":1.893},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.91600000000000004,"15min":0.95599999999999996},"min":{"1min":0.74299999999999999,"5min":0.55400000000000005,"15min":0.48599999999999999},"max":{"1min":1.298,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.038}]}]}]}} 2021-04-09T18:36:00.915 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2021-04-09 18:26:07.037875 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=26, tm_sec=7, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=35, tm_sec=56, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:36:00.915 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2021-04-09 18:26:07.037875 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=26, tm_sec=7, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=35, tm_sec=56, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:36:00.915 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2021-04-09 18:26:07.037875 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=26, tm_sec=7, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=35, tm_sec=56, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:36:00.916 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2021-04-09 18:26:07.037875 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=26, tm_sec=7, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=35, tm_sec=56, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:36:00.917 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2021-04-09 18:26:07.037875 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=26, tm_sec=7, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=35, tm_sec=56, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:36:00.917 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2021-04-09 18:26:07.037875 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=26, tm_sec=7, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=35, tm_sec=56, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:36:00.917 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2021-04-09 18:26:07.037875 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=26, tm_sec=7, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=35, tm_sec=56, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:36:00.918 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2021-04-09 18:26:07.037875 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=26, tm_sec=7, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=35, tm_sec=56, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:36:00.918 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2021-04-09T18:36:02.753 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-04-09T18:36:02.753 DEBUG:teuthology.task.console_log:Killing console logger for smithi079 2021-04-09T18:36:02.754 DEBUG:teuthology.task.console_log:Killing console logger for smithi089 2021-04-09T18:36:02.754 DEBUG:teuthology.task.console_log:Killing console logger for smithi090 2021-04-09T18:36:02.755 DEBUG:teuthology.task.console_log:Killing console logger for smithi136 2021-04-09T18:36:02.755 DEBUG:teuthology.task.console_log:Killing console logger for smithi144 2021-04-09T18:36:02.756 DEBUG:teuthology.exit:Finished running handlers